[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 14:49:32.122720  6549 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.6.101.126:45859
I20260709 14:49:32.125355  6549 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 14:49:32.126869  6549 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 14:49:32.151167  6556 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 14:49:32.152134  6558 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 14:49:32.154754  6549 server_base.cc:1061] running on GCE node
W20260709 14:49:32.152439  6555 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 14:49:33.354398  6549 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 14:49:33.354893  6549 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 14:49:33.355099  6549 hybrid_clock.cc:648] HybridClock initialized: now 1783608573355074 us; error 0 us; skew 500 ppm
I20260709 14:49:33.356175  6549 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 14:49:33.365525  6549 webserver.cc:533] Webserver started at http://127.6.101.126:40293/ using document root <none> and password file <none>
I20260709 14:49:33.366827  6549 fs_manager.cc:362] Metadata directory not provided
I20260709 14:49:33.367120  6549 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 14:49:33.367686  6549 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 14:49:33.375910  6549 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783608571892863-6549-0/minicluster-data/master-0-root/instance:
uuid: "d922cd1351b74d869c49dd88988157d3"
format_stamp: "Formatted at 2026-07-09 14:49:33 on dist-test-slave-lv34"
I20260709 14:49:33.388710  6549 fs_manager.cc:696] Time spent creating directory manager: real 0.012s	user 0.013s	sys 0.000s
I20260709 14:49:33.397174  6564 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 14:49:33.400740  6549 fs_manager.cc:730] Time spent opening block manager: real 0.007s	user 0.007s	sys 0.000s
I20260709 14:49:33.401388  6549 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783608571892863-6549-0/minicluster-data/master-0-root
uuid: "d922cd1351b74d869c49dd88988157d3"
format_stamp: "Formatted at 2026-07-09 14:49:33 on dist-test-slave-lv34"
I20260709 14:49:33.401865  6549 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783608571892863-6549-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783608571892863-6549-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783608571892863-6549-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 14:49:33.463344  6549 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 14:49:33.465651  6549 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 14:49:33.466327  6549 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 14:49:33.575448  6549 rpc_server.cc:307] RPC server started. Bound to: 127.6.101.126:45859
I20260709 14:49:33.575613  6615 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.101.126:45859 every 8 connection(s)
I20260709 14:49:33.587494  6616 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:49:33.620859  6616 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d922cd1351b74d869c49dd88988157d3: Bootstrap starting.
I20260709 14:49:33.630095  6616 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d922cd1351b74d869c49dd88988157d3: Neither blocks nor log segments found. Creating new log.
I20260709 14:49:33.634047  6616 log.cc:826] T 00000000000000000000000000000000 P d922cd1351b74d869c49dd88988157d3: Log is configured to *not* fsync() on all Append() calls
I20260709 14:49:33.643035  6616 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d922cd1351b74d869c49dd88988157d3: No bootstrap required, opened a new log
I20260709 14:49:33.682679  6616 raft_consensus.cc:359] T 00000000000000000000000000000000 P d922cd1351b74d869c49dd88988157d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d922cd1351b74d869c49dd88988157d3" member_type: VOTER }
I20260709 14:49:33.684896  6616 raft_consensus.cc:385] T 00000000000000000000000000000000 P d922cd1351b74d869c49dd88988157d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:49:33.685460  6616 raft_consensus.cc:740] T 00000000000000000000000000000000 P d922cd1351b74d869c49dd88988157d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d922cd1351b74d869c49dd88988157d3, State: Initialized, Role: FOLLOWER
I20260709 14:49:33.687184  6616 consensus_queue.cc:260] T 00000000000000000000000000000000 P d922cd1351b74d869c49dd88988157d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d922cd1351b74d869c49dd88988157d3" member_type: VOTER }
I20260709 14:49:33.688002  6616 raft_consensus.cc:399] T 00000000000000000000000000000000 P d922cd1351b74d869c49dd88988157d3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 14:49:33.688469  6616 raft_consensus.cc:493] T 00000000000000000000000000000000 P d922cd1351b74d869c49dd88988157d3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 14:49:33.688896  6616 raft_consensus.cc:3060] T 00000000000000000000000000000000 P d922cd1351b74d869c49dd88988157d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:49:33.701635  6616 raft_consensus.cc:515] T 00000000000000000000000000000000 P d922cd1351b74d869c49dd88988157d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d922cd1351b74d869c49dd88988157d3" member_type: VOTER }
I20260709 14:49:33.703056  6616 leader_election.cc:304] T 00000000000000000000000000000000 P d922cd1351b74d869c49dd88988157d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d922cd1351b74d869c49dd88988157d3; no voters: 
I20260709 14:49:33.705600  6616 leader_election.cc:290] T 00000000000000000000000000000000 P d922cd1351b74d869c49dd88988157d3 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 14:49:33.706001  6619 raft_consensus.cc:2804] T 00000000000000000000000000000000 P d922cd1351b74d869c49dd88988157d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:49:33.709403  6619 raft_consensus.cc:697] T 00000000000000000000000000000000 P d922cd1351b74d869c49dd88988157d3 [term 1 LEADER]: Becoming Leader. State: Replica: d922cd1351b74d869c49dd88988157d3, State: Running, Role: LEADER
I20260709 14:49:33.710820  6619 consensus_queue.cc:237] T 00000000000000000000000000000000 P d922cd1351b74d869c49dd88988157d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d922cd1351b74d869c49dd88988157d3" member_type: VOTER }
I20260709 14:49:33.713126  6616 sys_catalog.cc:565] T 00000000000000000000000000000000 P d922cd1351b74d869c49dd88988157d3 [sys.catalog]: configured and running, proceeding with master startup.
W20260709 14:49:33.724664  6570 tablet.cc:2406] T 00000000000000000000000000000000 P d922cd1351b74d869c49dd88988157d3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 14:49:33.725790  6620 sys_catalog.cc:455] T 00000000000000000000000000000000 P d922cd1351b74d869c49dd88988157d3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d922cd1351b74d869c49dd88988157d3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d922cd1351b74d869c49dd88988157d3" member_type: VOTER } }
I20260709 14:49:33.727705  6620 sys_catalog.cc:458] T 00000000000000000000000000000000 P d922cd1351b74d869c49dd88988157d3 [sys.catalog]: This master's current role is: LEADER
I20260709 14:49:33.730145  6621 sys_catalog.cc:455] T 00000000000000000000000000000000 P d922cd1351b74d869c49dd88988157d3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d922cd1351b74d869c49dd88988157d3. Latest consensus state: current_term: 1 leader_uuid: "d922cd1351b74d869c49dd88988157d3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d922cd1351b74d869c49dd88988157d3" member_type: VOTER } }
I20260709 14:49:33.731101  6621 sys_catalog.cc:458] T 00000000000000000000000000000000 P d922cd1351b74d869c49dd88988157d3 [sys.catalog]: This master's current role is: LEADER
I20260709 14:49:33.733311  6627 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 14:49:33.751186  6627 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 14:49:33.754071  6549 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 14:49:33.778681  6627 catalog_manager.cc:1383] Generated new cluster ID: ba276fae21db488fb5cc2aa3a6fa8a4e
I20260709 14:49:33.779093  6627 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 14:49:33.804195  6627 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 14:49:33.806470  6627 catalog_manager.cc:1540] Loading token signing keys...
I20260709 14:49:33.825218  6627 catalog_manager.cc:6070] T 00000000000000000000000000000000 P d922cd1351b74d869c49dd88988157d3: Generated new TSK 0
I20260709 14:49:33.826715  6627 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 14:49:33.887144  6549 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 14:49:33.901865  6638 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 14:49:33.908958  6639 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 14:49:33.912595  6549 server_base.cc:1061] running on GCE node
W20260709 14:49:33.913743  6641 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 14:49:33.915120  6549 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 14:49:33.915629  6549 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 14:49:33.915913  6549 hybrid_clock.cc:648] HybridClock initialized: now 1783608573915889 us; error 0 us; skew 500 ppm
I20260709 14:49:33.917517  6549 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 14:49:33.925112  6549 webserver.cc:533] Webserver started at http://127.6.101.65:33611/ using document root <none> and password file <none>
I20260709 14:49:33.926012  6549 fs_manager.cc:362] Metadata directory not provided
I20260709 14:49:33.926333  6549 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 14:49:33.926748  6549 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 14:49:33.930579  6549 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783608571892863-6549-0/minicluster-data/ts-0-root/instance:
uuid: "25b7964825a6462295c0606a06169676"
format_stamp: "Formatted at 2026-07-09 14:49:33 on dist-test-slave-lv34"
I20260709 14:49:33.946758  6549 fs_manager.cc:696] Time spent creating directory manager: real 0.013s	user 0.010s	sys 0.001s
I20260709 14:49:33.957234  6646 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 14:49:33.959386  6549 fs_manager.cc:730] Time spent opening block manager: real 0.006s	user 0.002s	sys 0.001s
I20260709 14:49:33.960386  6549 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783608571892863-6549-0/minicluster-data/ts-0-root
uuid: "25b7964825a6462295c0606a06169676"
format_stamp: "Formatted at 2026-07-09 14:49:33 on dist-test-slave-lv34"
I20260709 14:49:33.962937  6549 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783608571892863-6549-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783608571892863-6549-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783608571892863-6549-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 14:49:34.020840  6549 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 14:49:34.026890  6549 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 14:49:34.030267  6549 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 14:49:34.044852  6549 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 14:49:34.045297  6549 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 14:49:34.045707  6549 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 14:49:34.045966  6549 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 14:49:34.234180  6708 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.101.65:34615 every 8 connection(s)
I20260709 14:49:34.234055  6549 rpc_server.cc:307] RPC server started. Bound to: 127.6.101.65:34615
I20260709 14:49:34.247655  6549 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 14:49:34.266635  6713 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 14:49:34.269439  6714 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 14:49:34.278074  6716 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 14:49:34.279253  6549 server_base.cc:1061] running on GCE node
I20260709 14:49:34.282456  6549 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 14:49:34.283020  6549 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 14:49:34.283613  6549 hybrid_clock.cc:648] HybridClock initialized: now 1783608574283577 us; error 0 us; skew 500 ppm
I20260709 14:49:34.285223  6549 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 14:49:34.294868  6709 heartbeater.cc:344] Connected to a master server at 127.6.101.126:45859
I20260709 14:49:34.295449  6549 webserver.cc:533] Webserver started at http://127.6.101.66:40175/ using document root <none> and password file <none>
I20260709 14:49:34.295742  6709 heartbeater.cc:461] Registering TS with master...
I20260709 14:49:34.296479  6549 fs_manager.cc:362] Metadata directory not provided
I20260709 14:49:34.296927  6549 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 14:49:34.297695  6549 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 14:49:34.297818  6709 heartbeater.cc:507] Master 127.6.101.126:45859 requested a full tablet report, sending...
I20260709 14:49:34.299940  6549 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783608571892863-6549-0/minicluster-data/ts-1-root/instance:
uuid: "41999337784141c5834094008bf6ba97"
format_stamp: "Formatted at 2026-07-09 14:49:34 on dist-test-slave-lv34"
I20260709 14:49:34.304370  6581 ts_manager.cc:194] Registered new tserver with Master: 25b7964825a6462295c0606a06169676 (127.6.101.65:34615)
I20260709 14:49:34.308449  6549 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.004s	sys 0.004s
I20260709 14:49:34.313344  6721 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 14:49:34.313354  6581 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58508
I20260709 14:49:34.314416  6549 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 14:49:34.314785  6549 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783608571892863-6549-0/minicluster-data/ts-1-root
uuid: "41999337784141c5834094008bf6ba97"
format_stamp: "Formatted at 2026-07-09 14:49:34 on dist-test-slave-lv34"
I20260709 14:49:34.315145  6549 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783608571892863-6549-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783608571892863-6549-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783608571892863-6549-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 14:49:34.340739  6549 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 14:49:34.342552  6549 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 14:49:34.344561  6549 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 14:49:34.347849  6549 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 14:49:34.348124  6549 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 14:49:34.348430  6549 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 14:49:34.348600  6549 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 14:49:34.488516  6549 rpc_server.cc:307] RPC server started. Bound to: 127.6.101.66:35001
I20260709 14:49:34.490398  6783 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.101.66:35001 every 8 connection(s)
I20260709 14:49:34.497723  6549 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 14:49:34.509922  6787 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 14:49:34.514035  6784 heartbeater.cc:344] Connected to a master server at 127.6.101.126:45859
I20260709 14:49:34.515060  6784 heartbeater.cc:461] Registering TS with master...
I20260709 14:49:34.516691  6784 heartbeater.cc:507] Master 127.6.101.126:45859 requested a full tablet report, sending...
W20260709 14:49:34.520498  6788 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 14:49:34.520536  6581 ts_manager.cc:194] Registered new tserver with Master: 41999337784141c5834094008bf6ba97 (127.6.101.66:35001)
W20260709 14:49:34.524149  6790 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 14:49:34.524204  6581 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58516
I20260709 14:49:34.525185  6549 server_base.cc:1061] running on GCE node
I20260709 14:49:34.527742  6549 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 14:49:34.528127  6549 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 14:49:34.528460  6549 hybrid_clock.cc:648] HybridClock initialized: now 1783608574528427 us; error 0 us; skew 500 ppm
I20260709 14:49:34.529201  6549 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 14:49:34.532850  6549 webserver.cc:533] Webserver started at http://127.6.101.67:38663/ using document root <none> and password file <none>
I20260709 14:49:34.533550  6549 fs_manager.cc:362] Metadata directory not provided
I20260709 14:49:34.533790  6549 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 14:49:34.534111  6549 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 14:49:34.535391  6549 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783608571892863-6549-0/minicluster-data/ts-2-root/instance:
uuid: "bf2d93774f73406ead205c8ba8c9da13"
format_stamp: "Formatted at 2026-07-09 14:49:34 on dist-test-slave-lv34"
I20260709 14:49:34.542343  6549 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.007s	sys 0.001s
I20260709 14:49:34.547654  6795 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 14:49:34.548795  6549 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.000s
I20260709 14:49:34.549199  6549 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783608571892863-6549-0/minicluster-data/ts-2-root
uuid: "bf2d93774f73406ead205c8ba8c9da13"
format_stamp: "Formatted at 2026-07-09 14:49:34 on dist-test-slave-lv34"
I20260709 14:49:34.549595  6549 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783608571892863-6549-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783608571892863-6549-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783608571892863-6549-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 14:49:34.579401  6549 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 14:49:34.581111  6549 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 14:49:34.584048  6549 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 14:49:34.588500  6549 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 14:49:34.588912  6549 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 14:49:34.589512  6549 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 14:49:34.589704  6549 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 14:49:34.724193  6549 rpc_server.cc:307] RPC server started. Bound to: 127.6.101.67:46675
I20260709 14:49:34.724457  6857 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.101.67:46675 every 8 connection(s)
I20260709 14:49:34.751185  6858 heartbeater.cc:344] Connected to a master server at 127.6.101.126:45859
I20260709 14:49:34.751803  6858 heartbeater.cc:461] Registering TS with master...
I20260709 14:49:34.753007  6858 heartbeater.cc:507] Master 127.6.101.126:45859 requested a full tablet report, sending...
I20260709 14:49:34.756711  6581 ts_manager.cc:194] Registered new tserver with Master: bf2d93774f73406ead205c8ba8c9da13 (127.6.101.67:46675)
I20260709 14:49:34.757715  6549 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.023167669s
I20260709 14:49:34.758898  6581 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58522
I20260709 14:49:34.835112  6581 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58534:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 14:49:34.839869  6581 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 14:49:35.016727  6746 tablet_service.cc:1511] Processing CreateTablet for tablet c8ac07644f37427e80f77c67ccac9328 (DEFAULT_TABLE table=test-workload [id=88f57ab84db34f60b280348cce405f9e]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 14:49:35.019833  6747 tablet_service.cc:1511] Processing CreateTablet for tablet bc290da245804ddc92d9597c5da52a82 (DEFAULT_TABLE table=test-workload [id=88f57ab84db34f60b280348cce405f9e]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 14:49:35.011212  6749 tablet_service.cc:1511] Processing CreateTablet for tablet d58c1f5d4e1c448eab811059e23165cc (DEFAULT_TABLE table=test-workload [id=88f57ab84db34f60b280348cce405f9e]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 14:49:35.024905  6746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8ac07644f37427e80f77c67ccac9328. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:49:35.026978  6822 tablet_service.cc:1511] Processing CreateTablet for tablet 1dbff5d6a7234db3a8f367fe9b30d615 (DEFAULT_TABLE table=test-workload [id=88f57ab84db34f60b280348cce405f9e]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 14:49:35.025671  6745 tablet_service.cc:1511] Processing CreateTablet for tablet 82a2d00569854cd990c582b9693829ff (DEFAULT_TABLE table=test-workload [id=88f57ab84db34f60b280348cce405f9e]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 14:49:35.044368  6747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc290da245804ddc92d9597c5da52a82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:49:35.054783  6670 tablet_service.cc:1511] Processing CreateTablet for tablet 82a2d00569854cd990c582b9693829ff (DEFAULT_TABLE table=test-workload [id=88f57ab84db34f60b280348cce405f9e]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 14:49:35.057283  6670 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82a2d00569854cd990c582b9693829ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:49:35.050522  6672 tablet_service.cc:1511] Processing CreateTablet for tablet bc290da245804ddc92d9597c5da52a82 (DEFAULT_TABLE table=test-workload [id=88f57ab84db34f60b280348cce405f9e]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 14:49:35.060364  6822 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1dbff5d6a7234db3a8f367fe9b30d615. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:49:35.062366  6673 tablet_service.cc:1511] Processing CreateTablet for tablet 1dbff5d6a7234db3a8f367fe9b30d615 (DEFAULT_TABLE table=test-workload [id=88f57ab84db34f60b280348cce405f9e]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 14:49:35.050000  6823 tablet_service.cc:1511] Processing CreateTablet for tablet d58c1f5d4e1c448eab811059e23165cc (DEFAULT_TABLE table=test-workload [id=88f57ab84db34f60b280348cce405f9e]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 14:49:35.047271  6748 tablet_service.cc:1511] Processing CreateTablet for tablet 1dbff5d6a7234db3a8f367fe9b30d615 (DEFAULT_TABLE table=test-workload [id=88f57ab84db34f60b280348cce405f9e]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 14:49:35.063659  6745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82a2d00569854cd990c582b9693829ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:49:35.058725  6820 tablet_service.cc:1511] Processing CreateTablet for tablet c8ac07644f37427e80f77c67ccac9328 (DEFAULT_TABLE table=test-workload [id=88f57ab84db34f60b280348cce405f9e]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 14:49:35.058599  6671 tablet_service.cc:1511] Processing CreateTablet for tablet c8ac07644f37427e80f77c67ccac9328 (DEFAULT_TABLE table=test-workload [id=88f57ab84db34f60b280348cce405f9e]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 14:49:35.072409  6821 tablet_service.cc:1511] Processing CreateTablet for tablet bc290da245804ddc92d9597c5da52a82 (DEFAULT_TABLE table=test-workload [id=88f57ab84db34f60b280348cce405f9e]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 14:49:35.075346  6823 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d58c1f5d4e1c448eab811059e23165cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:49:35.081699  6672 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc290da245804ddc92d9597c5da52a82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:49:35.066272  6819 tablet_service.cc:1511] Processing CreateTablet for tablet 82a2d00569854cd990c582b9693829ff (DEFAULT_TABLE table=test-workload [id=88f57ab84db34f60b280348cce405f9e]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 14:49:35.083214  6820 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8ac07644f37427e80f77c67ccac9328. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:49:35.086834  6821 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc290da245804ddc92d9597c5da52a82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:49:35.075632  6744 tablet_service.cc:1511] Processing CreateTablet for tablet 3d8096f833ea45ce9471c56d3ce1a68b (DEFAULT_TABLE table=test-workload [id=88f57ab84db34f60b280348cce405f9e]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 14:49:35.072278  6674 tablet_service.cc:1511] Processing CreateTablet for tablet d58c1f5d4e1c448eab811059e23165cc (DEFAULT_TABLE table=test-workload [id=88f57ab84db34f60b280348cce405f9e]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 14:49:35.090204  6669 tablet_service.cc:1511] Processing CreateTablet for tablet 3d8096f833ea45ce9471c56d3ce1a68b (DEFAULT_TABLE table=test-workload [id=88f57ab84db34f60b280348cce405f9e]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 14:49:35.093324  6819 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82a2d00569854cd990c582b9693829ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:49:35.093998  6749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d58c1f5d4e1c448eab811059e23165cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:49:35.101310  6748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1dbff5d6a7234db3a8f367fe9b30d615. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:49:35.099208  6671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8ac07644f37427e80f77c67ccac9328. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:49:35.108238  6673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1dbff5d6a7234db3a8f367fe9b30d615. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:49:35.109123  6818 tablet_service.cc:1511] Processing CreateTablet for tablet 3d8096f833ea45ce9471c56d3ce1a68b (DEFAULT_TABLE table=test-workload [id=88f57ab84db34f60b280348cce405f9e]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 14:49:35.113054  6818 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d8096f833ea45ce9471c56d3ce1a68b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:49:35.115979  6669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d8096f833ea45ce9471c56d3ce1a68b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:49:35.114207  6744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d8096f833ea45ce9471c56d3ce1a68b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:49:35.119999  6674 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d58c1f5d4e1c448eab811059e23165cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:49:35.139164  6668 tablet_service.cc:1511] Processing CreateTablet for tablet 5ce18799382e46108fbcbed2c364321d (DEFAULT_TABLE table=test-workload [id=88f57ab84db34f60b280348cce405f9e]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 14:49:35.149104  6668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ce18799382e46108fbcbed2c364321d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:49:35.172372  6743 tablet_service.cc:1511] Processing CreateTablet for tablet 5ce18799382e46108fbcbed2c364321d (DEFAULT_TABLE table=test-workload [id=88f57ab84db34f60b280348cce405f9e]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 14:49:35.179491  6743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ce18799382e46108fbcbed2c364321d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:49:35.230870  6667 tablet_service.cc:1511] Processing CreateTablet for tablet 07255af297cd4ac59277e81984f07f9c (DEFAULT_TABLE table=test-workload [id=88f57ab84db34f60b280348cce405f9e]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 14:49:35.230871  6817 tablet_service.cc:1511] Processing CreateTablet for tablet 5ce18799382e46108fbcbed2c364321d (DEFAULT_TABLE table=test-workload [id=88f57ab84db34f60b280348cce405f9e]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 14:49:35.234742  6667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07255af297cd4ac59277e81984f07f9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:49:35.243959  6817 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ce18799382e46108fbcbed2c364321d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:49:35.254592  6742 tablet_service.cc:1511] Processing CreateTablet for tablet 07255af297cd4ac59277e81984f07f9c (DEFAULT_TABLE table=test-workload [id=88f57ab84db34f60b280348cce405f9e]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 14:49:35.256409  6742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07255af297cd4ac59277e81984f07f9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:49:35.290577  6816 tablet_service.cc:1511] Processing CreateTablet for tablet 07255af297cd4ac59277e81984f07f9c (DEFAULT_TABLE table=test-workload [id=88f57ab84db34f60b280348cce405f9e]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 14:49:35.294143  6816 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07255af297cd4ac59277e81984f07f9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:49:35.319084  6709 heartbeater.cc:499] Master 127.6.101.126:45859 was elected leader, sending a full tablet report...
I20260709 14:49:35.346475  6666 tablet_service.cc:1511] Processing CreateTablet for tablet be9352545ba44d68a3704b39c623e774 (DEFAULT_TABLE table=test-workload [id=88f57ab84db34f60b280348cce405f9e]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 14:49:35.349058  6666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be9352545ba44d68a3704b39c623e774. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:49:35.356006  6877 tablet_bootstrap.cc:492] T 82a2d00569854cd990c582b9693829ff P bf2d93774f73406ead205c8ba8c9da13: Bootstrap starting.
I20260709 14:49:35.365638  6878 tablet_bootstrap.cc:492] T c8ac07644f37427e80f77c67ccac9328 P 41999337784141c5834094008bf6ba97: Bootstrap starting.
I20260709 14:49:35.377272  6745 tablet_service.cc:1511] Processing CreateTablet for tablet be9352545ba44d68a3704b39c623e774 (DEFAULT_TABLE table=test-workload [id=88f57ab84db34f60b280348cce405f9e]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 14:49:35.356691  6820 tablet_service.cc:1511] Processing CreateTablet for tablet be9352545ba44d68a3704b39c623e774 (DEFAULT_TABLE table=test-workload [id=88f57ab84db34f60b280348cce405f9e]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 14:49:35.388748  6820 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be9352545ba44d68a3704b39c623e774. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:49:35.407953  6745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be9352545ba44d68a3704b39c623e774. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:49:35.408916  6877 tablet_bootstrap.cc:654] T 82a2d00569854cd990c582b9693829ff P bf2d93774f73406ead205c8ba8c9da13: Neither blocks nor log segments found. Creating new log.
I20260709 14:49:35.424122  6879 tablet_bootstrap.cc:492] T c8ac07644f37427e80f77c67ccac9328 P 25b7964825a6462295c0606a06169676: Bootstrap starting.
I20260709 14:49:35.439217  6878 tablet_bootstrap.cc:654] T c8ac07644f37427e80f77c67ccac9328 P 41999337784141c5834094008bf6ba97: Neither blocks nor log segments found. Creating new log.
I20260709 14:49:35.468801  6879 tablet_bootstrap.cc:654] T c8ac07644f37427e80f77c67ccac9328 P 25b7964825a6462295c0606a06169676: Neither blocks nor log segments found. Creating new log.
I20260709 14:49:35.476498  6878 tablet_bootstrap.cc:492] T c8ac07644f37427e80f77c67ccac9328 P 41999337784141c5834094008bf6ba97: No bootstrap required, opened a new log
I20260709 14:49:35.477437  6878 ts_tablet_manager.cc:1403] T c8ac07644f37427e80f77c67ccac9328 P 41999337784141c5834094008bf6ba97: Time spent bootstrapping tablet: real 0.147s	user 0.028s	sys 0.006s
I20260709 14:49:35.483881  6878 raft_consensus.cc:359] T c8ac07644f37427e80f77c67ccac9328 P 41999337784141c5834094008bf6ba97 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:35.485028  6878 raft_consensus.cc:385] T c8ac07644f37427e80f77c67ccac9328 P 41999337784141c5834094008bf6ba97 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:49:35.485428  6878 raft_consensus.cc:740] T c8ac07644f37427e80f77c67ccac9328 P 41999337784141c5834094008bf6ba97 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41999337784141c5834094008bf6ba97, State: Initialized, Role: FOLLOWER
I20260709 14:49:35.486418  6878 consensus_queue.cc:260] T c8ac07644f37427e80f77c67ccac9328 P 41999337784141c5834094008bf6ba97 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:35.493808  6879 tablet_bootstrap.cc:492] T c8ac07644f37427e80f77c67ccac9328 P 25b7964825a6462295c0606a06169676: No bootstrap required, opened a new log
I20260709 14:49:35.494401  6879 ts_tablet_manager.cc:1403] T c8ac07644f37427e80f77c67ccac9328 P 25b7964825a6462295c0606a06169676: Time spent bootstrapping tablet: real 0.092s	user 0.014s	sys 0.009s
I20260709 14:49:35.507825  6784 heartbeater.cc:499] Master 127.6.101.126:45859 was elected leader, sending a full tablet report...
I20260709 14:49:35.508268  6878 ts_tablet_manager.cc:1434] T c8ac07644f37427e80f77c67ccac9328 P 41999337784141c5834094008bf6ba97: Time spent starting tablet: real 0.030s	user 0.014s	sys 0.012s
I20260709 14:49:35.509325  6877 tablet_bootstrap.cc:492] T 82a2d00569854cd990c582b9693829ff P bf2d93774f73406ead205c8ba8c9da13: No bootstrap required, opened a new log
I20260709 14:49:35.509868  6878 tablet_bootstrap.cc:492] T 82a2d00569854cd990c582b9693829ff P 41999337784141c5834094008bf6ba97: Bootstrap starting.
I20260709 14:49:35.507953  6879 raft_consensus.cc:359] T c8ac07644f37427e80f77c67ccac9328 P 25b7964825a6462295c0606a06169676 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:35.510975  6879 raft_consensus.cc:385] T c8ac07644f37427e80f77c67ccac9328 P 25b7964825a6462295c0606a06169676 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:49:35.511348  6879 raft_consensus.cc:740] T c8ac07644f37427e80f77c67ccac9328 P 25b7964825a6462295c0606a06169676 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25b7964825a6462295c0606a06169676, State: Initialized, Role: FOLLOWER
I20260709 14:49:35.512271  6879 consensus_queue.cc:260] T c8ac07644f37427e80f77c67ccac9328 P 25b7964825a6462295c0606a06169676 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:35.509910  6877 ts_tablet_manager.cc:1403] T 82a2d00569854cd990c582b9693829ff P bf2d93774f73406ead205c8ba8c9da13: Time spent bootstrapping tablet: real 0.173s	user 0.020s	sys 0.032s
I20260709 14:49:35.521610  6878 tablet_bootstrap.cc:654] T 82a2d00569854cd990c582b9693829ff P 41999337784141c5834094008bf6ba97: Neither blocks nor log segments found. Creating new log.
I20260709 14:49:35.522101  6877 raft_consensus.cc:359] T 82a2d00569854cd990c582b9693829ff P bf2d93774f73406ead205c8ba8c9da13 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:35.525876  6877 raft_consensus.cc:385] T 82a2d00569854cd990c582b9693829ff P bf2d93774f73406ead205c8ba8c9da13 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:49:35.526343  6877 raft_consensus.cc:740] T 82a2d00569854cd990c582b9693829ff P bf2d93774f73406ead205c8ba8c9da13 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf2d93774f73406ead205c8ba8c9da13, State: Initialized, Role: FOLLOWER
I20260709 14:49:35.527503  6877 consensus_queue.cc:260] T 82a2d00569854cd990c582b9693829ff P bf2d93774f73406ead205c8ba8c9da13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:35.534041  6879 ts_tablet_manager.cc:1434] T c8ac07644f37427e80f77c67ccac9328 P 25b7964825a6462295c0606a06169676: Time spent starting tablet: real 0.039s	user 0.006s	sys 0.016s
I20260709 14:49:35.535431  6879 tablet_bootstrap.cc:492] T 3d8096f833ea45ce9471c56d3ce1a68b P 25b7964825a6462295c0606a06169676: Bootstrap starting.
I20260709 14:49:35.539285  6877 ts_tablet_manager.cc:1434] T 82a2d00569854cd990c582b9693829ff P bf2d93774f73406ead205c8ba8c9da13: Time spent starting tablet: real 0.025s	user 0.011s	sys 0.006s
I20260709 14:49:35.545094  6858 heartbeater.cc:499] Master 127.6.101.126:45859 was elected leader, sending a full tablet report...
I20260709 14:49:35.547842  6878 tablet_bootstrap.cc:492] T 82a2d00569854cd990c582b9693829ff P 41999337784141c5834094008bf6ba97: No bootstrap required, opened a new log
I20260709 14:49:35.547946  6879 tablet_bootstrap.cc:654] T 3d8096f833ea45ce9471c56d3ce1a68b P 25b7964825a6462295c0606a06169676: Neither blocks nor log segments found. Creating new log.
I20260709 14:49:35.548700  6878 ts_tablet_manager.cc:1403] T 82a2d00569854cd990c582b9693829ff P 41999337784141c5834094008bf6ba97: Time spent bootstrapping tablet: real 0.039s	user 0.004s	sys 0.011s
I20260709 14:49:35.562139  6877 tablet_bootstrap.cc:492] T c8ac07644f37427e80f77c67ccac9328 P bf2d93774f73406ead205c8ba8c9da13: Bootstrap starting.
I20260709 14:49:35.564302  6878 raft_consensus.cc:359] T 82a2d00569854cd990c582b9693829ff P 41999337784141c5834094008bf6ba97 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:35.565599  6878 raft_consensus.cc:385] T 82a2d00569854cd990c582b9693829ff P 41999337784141c5834094008bf6ba97 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:49:35.566000  6878 raft_consensus.cc:740] T 82a2d00569854cd990c582b9693829ff P 41999337784141c5834094008bf6ba97 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41999337784141c5834094008bf6ba97, State: Initialized, Role: FOLLOWER
I20260709 14:49:35.567138  6878 consensus_queue.cc:260] T 82a2d00569854cd990c582b9693829ff P 41999337784141c5834094008bf6ba97 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:35.571411  6879 tablet_bootstrap.cc:492] T 3d8096f833ea45ce9471c56d3ce1a68b P 25b7964825a6462295c0606a06169676: No bootstrap required, opened a new log
I20260709 14:49:35.571890  6877 tablet_bootstrap.cc:654] T c8ac07644f37427e80f77c67ccac9328 P bf2d93774f73406ead205c8ba8c9da13: Neither blocks nor log segments found. Creating new log.
I20260709 14:49:35.572721  6879 ts_tablet_manager.cc:1403] T 3d8096f833ea45ce9471c56d3ce1a68b P 25b7964825a6462295c0606a06169676: Time spent bootstrapping tablet: real 0.038s	user 0.007s	sys 0.014s
I20260709 14:49:35.577570  6878 ts_tablet_manager.cc:1434] T 82a2d00569854cd990c582b9693829ff P 41999337784141c5834094008bf6ba97: Time spent starting tablet: real 0.028s	user 0.011s	sys 0.004s
I20260709 14:49:35.579388  6878 tablet_bootstrap.cc:492] T bc290da245804ddc92d9597c5da52a82 P 41999337784141c5834094008bf6ba97: Bootstrap starting.
I20260709 14:49:35.586758  6877 tablet_bootstrap.cc:492] T c8ac07644f37427e80f77c67ccac9328 P bf2d93774f73406ead205c8ba8c9da13: No bootstrap required, opened a new log
I20260709 14:49:35.587489  6877 ts_tablet_manager.cc:1403] T c8ac07644f37427e80f77c67ccac9328 P bf2d93774f73406ead205c8ba8c9da13: Time spent bootstrapping tablet: real 0.026s	user 0.017s	sys 0.006s
I20260709 14:49:35.587323  6879 raft_consensus.cc:359] T 3d8096f833ea45ce9471c56d3ce1a68b P 25b7964825a6462295c0606a06169676 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:35.588249  6879 raft_consensus.cc:385] T 3d8096f833ea45ce9471c56d3ce1a68b P 25b7964825a6462295c0606a06169676 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:49:35.588619  6879 raft_consensus.cc:740] T 3d8096f833ea45ce9471c56d3ce1a68b P 25b7964825a6462295c0606a06169676 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25b7964825a6462295c0606a06169676, State: Initialized, Role: FOLLOWER
I20260709 14:49:35.589483  6879 consensus_queue.cc:260] T 3d8096f833ea45ce9471c56d3ce1a68b P 25b7964825a6462295c0606a06169676 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:35.592193  6884 raft_consensus.cc:493] T c8ac07644f37427e80f77c67ccac9328 P 25b7964825a6462295c0606a06169676 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:49:35.592986  6879 ts_tablet_manager.cc:1434] T 3d8096f833ea45ce9471c56d3ce1a68b P 25b7964825a6462295c0606a06169676: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.001s
I20260709 14:49:35.592890  6884 raft_consensus.cc:515] T c8ac07644f37427e80f77c67ccac9328 P 25b7964825a6462295c0606a06169676 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:35.594521  6879 tablet_bootstrap.cc:492] T d58c1f5d4e1c448eab811059e23165cc P 25b7964825a6462295c0606a06169676: Bootstrap starting.
I20260709 14:49:35.599493  6878 tablet_bootstrap.cc:654] T bc290da245804ddc92d9597c5da52a82 P 41999337784141c5834094008bf6ba97: Neither blocks nor log segments found. Creating new log.
I20260709 14:49:35.600709  6884 leader_election.cc:290] T c8ac07644f37427e80f77c67ccac9328 P 25b7964825a6462295c0606a06169676 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 41999337784141c5834094008bf6ba97 (127.6.101.66:35001), bf2d93774f73406ead205c8ba8c9da13 (127.6.101.67:46675)
I20260709 14:49:35.605770  6877 raft_consensus.cc:359] T c8ac07644f37427e80f77c67ccac9328 P bf2d93774f73406ead205c8ba8c9da13 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:35.606707  6877 raft_consensus.cc:385] T c8ac07644f37427e80f77c67ccac9328 P bf2d93774f73406ead205c8ba8c9da13 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:49:35.607059  6877 raft_consensus.cc:740] T c8ac07644f37427e80f77c67ccac9328 P bf2d93774f73406ead205c8ba8c9da13 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf2d93774f73406ead205c8ba8c9da13, State: Initialized, Role: FOLLOWER
I20260709 14:49:35.608193  6877 consensus_queue.cc:260] T c8ac07644f37427e80f77c67ccac9328 P bf2d93774f73406ead205c8ba8c9da13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:35.625041  6879 tablet_bootstrap.cc:654] T d58c1f5d4e1c448eab811059e23165cc P 25b7964825a6462295c0606a06169676: Neither blocks nor log segments found. Creating new log.
I20260709 14:49:35.627259  6877 ts_tablet_manager.cc:1434] T c8ac07644f37427e80f77c67ccac9328 P bf2d93774f73406ead205c8ba8c9da13: Time spent starting tablet: real 0.039s	user 0.009s	sys 0.000s
I20260709 14:49:35.638890  6877 tablet_bootstrap.cc:492] T 1dbff5d6a7234db3a8f367fe9b30d615 P bf2d93774f73406ead205c8ba8c9da13: Bootstrap starting.
I20260709 14:49:35.645056  6878 tablet_bootstrap.cc:492] T bc290da245804ddc92d9597c5da52a82 P 41999337784141c5834094008bf6ba97: No bootstrap required, opened a new log
I20260709 14:49:35.646548  6878 ts_tablet_manager.cc:1403] T bc290da245804ddc92d9597c5da52a82 P 41999337784141c5834094008bf6ba97: Time spent bootstrapping tablet: real 0.067s	user 0.014s	sys 0.005s
I20260709 14:49:35.656569  6878 raft_consensus.cc:359] T bc290da245804ddc92d9597c5da52a82 P 41999337784141c5834094008bf6ba97 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:35.657804  6878 raft_consensus.cc:385] T bc290da245804ddc92d9597c5da52a82 P 41999337784141c5834094008bf6ba97 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:49:35.658192  6878 raft_consensus.cc:740] T bc290da245804ddc92d9597c5da52a82 P 41999337784141c5834094008bf6ba97 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41999337784141c5834094008bf6ba97, State: Initialized, Role: FOLLOWER
I20260709 14:49:35.659077  6878 consensus_queue.cc:260] T bc290da245804ddc92d9597c5da52a82 P 41999337784141c5834094008bf6ba97 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:35.670367  6877 tablet_bootstrap.cc:654] T 1dbff5d6a7234db3a8f367fe9b30d615 P bf2d93774f73406ead205c8ba8c9da13: Neither blocks nor log segments found. Creating new log.
I20260709 14:49:35.671164  6833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ac07644f37427e80f77c67ccac9328" candidate_uuid: "25b7964825a6462295c0606a06169676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf2d93774f73406ead205c8ba8c9da13" is_pre_election: true
I20260709 14:49:35.673303  6833 raft_consensus.cc:2468] T c8ac07644f37427e80f77c67ccac9328 P bf2d93774f73406ead205c8ba8c9da13 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b7964825a6462295c0606a06169676 in term 0.
I20260709 14:49:35.675521  6883 raft_consensus.cc:493] T 82a2d00569854cd990c582b9693829ff P 41999337784141c5834094008bf6ba97 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:49:35.677603  6883 raft_consensus.cc:515] T 82a2d00569854cd990c582b9693829ff P 41999337784141c5834094008bf6ba97 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:35.679454  6650 leader_election.cc:304] T c8ac07644f37427e80f77c67ccac9328 P 25b7964825a6462295c0606a06169676 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b7964825a6462295c0606a06169676, bf2d93774f73406ead205c8ba8c9da13; no voters: 
I20260709 14:49:35.684417  6884 raft_consensus.cc:2804] T c8ac07644f37427e80f77c67ccac9328 P 25b7964825a6462295c0606a06169676 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:49:35.684902  6884 raft_consensus.cc:493] T c8ac07644f37427e80f77c67ccac9328 P 25b7964825a6462295c0606a06169676 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:49:35.685441  6884 raft_consensus.cc:3060] T c8ac07644f37427e80f77c67ccac9328 P 25b7964825a6462295c0606a06169676 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:49:35.686409  6879 tablet_bootstrap.cc:492] T d58c1f5d4e1c448eab811059e23165cc P 25b7964825a6462295c0606a06169676: No bootstrap required, opened a new log
I20260709 14:49:35.687497  6879 ts_tablet_manager.cc:1403] T d58c1f5d4e1c448eab811059e23165cc P 25b7964825a6462295c0606a06169676: Time spent bootstrapping tablet: real 0.093s	user 0.020s	sys 0.007s
I20260709 14:49:35.687783  6878 ts_tablet_manager.cc:1434] T bc290da245804ddc92d9597c5da52a82 P 41999337784141c5834094008bf6ba97: Time spent starting tablet: real 0.040s	user 0.007s	sys 0.004s
I20260709 14:49:35.693368  6878 tablet_bootstrap.cc:492] T 1dbff5d6a7234db3a8f367fe9b30d615 P 41999337784141c5834094008bf6ba97: Bootstrap starting.
I20260709 14:49:35.698007  6879 raft_consensus.cc:359] T d58c1f5d4e1c448eab811059e23165cc P 25b7964825a6462295c0606a06169676 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } } peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } }
I20260709 14:49:35.699112  6879 raft_consensus.cc:385] T d58c1f5d4e1c448eab811059e23165cc P 25b7964825a6462295c0606a06169676 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:49:35.699852  6879 raft_consensus.cc:740] T d58c1f5d4e1c448eab811059e23165cc P 25b7964825a6462295c0606a06169676 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25b7964825a6462295c0606a06169676, State: Initialized, Role: FOLLOWER
I20260709 14:49:35.701831  6883 leader_election.cc:290] T 82a2d00569854cd990c582b9693829ff P 41999337784141c5834094008bf6ba97 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25b7964825a6462295c0606a06169676 (127.6.101.65:34615), bf2d93774f73406ead205c8ba8c9da13 (127.6.101.67:46675)
I20260709 14:49:35.701694  6879 consensus_queue.cc:260] T d58c1f5d4e1c448eab811059e23165cc P 25b7964825a6462295c0606a06169676 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } } peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } }
I20260709 14:49:35.704497  6883 raft_consensus.cc:493] T c8ac07644f37427e80f77c67ccac9328 P 41999337784141c5834094008bf6ba97 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:49:35.705819  6883 raft_consensus.cc:515] T c8ac07644f37427e80f77c67ccac9328 P 41999337784141c5834094008bf6ba97 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:35.710475  6883 leader_election.cc:290] T c8ac07644f37427e80f77c67ccac9328 P 41999337784141c5834094008bf6ba97 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25b7964825a6462295c0606a06169676 (127.6.101.65:34615), bf2d93774f73406ead205c8ba8c9da13 (127.6.101.67:46675)
I20260709 14:49:35.711297  6884 raft_consensus.cc:515] T c8ac07644f37427e80f77c67ccac9328 P 25b7964825a6462295c0606a06169676 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:35.723013  6884 leader_election.cc:290] T c8ac07644f37427e80f77c67ccac9328 P 25b7964825a6462295c0606a06169676 [CANDIDATE]: Term 1 election: Requested vote from peers 41999337784141c5834094008bf6ba97 (127.6.101.66:35001), bf2d93774f73406ead205c8ba8c9da13 (127.6.101.67:46675)
I20260709 14:49:35.727758  6878 tablet_bootstrap.cc:654] T 1dbff5d6a7234db3a8f367fe9b30d615 P 41999337784141c5834094008bf6ba97: Neither blocks nor log segments found. Creating new log.
I20260709 14:49:35.727723  6833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ac07644f37427e80f77c67ccac9328" candidate_uuid: "25b7964825a6462295c0606a06169676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf2d93774f73406ead205c8ba8c9da13"
I20260709 14:49:35.732391  6833 raft_consensus.cc:3060] T c8ac07644f37427e80f77c67ccac9328 P bf2d93774f73406ead205c8ba8c9da13 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:49:35.743466  6759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ac07644f37427e80f77c67ccac9328" candidate_uuid: "25b7964825a6462295c0606a06169676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41999337784141c5834094008bf6ba97" is_pre_election: true
I20260709 14:49:35.750854  6758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ac07644f37427e80f77c67ccac9328" candidate_uuid: "25b7964825a6462295c0606a06169676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41999337784141c5834094008bf6ba97"
I20260709 14:49:35.755476  6759 raft_consensus.cc:2468] T c8ac07644f37427e80f77c67ccac9328 P 41999337784141c5834094008bf6ba97 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b7964825a6462295c0606a06169676 in term 0.
I20260709 14:49:35.762542  6877 tablet_bootstrap.cc:492] T 1dbff5d6a7234db3a8f367fe9b30d615 P bf2d93774f73406ead205c8ba8c9da13: No bootstrap required, opened a new log
I20260709 14:49:35.763166  6877 ts_tablet_manager.cc:1403] T 1dbff5d6a7234db3a8f367fe9b30d615 P bf2d93774f73406ead205c8ba8c9da13: Time spent bootstrapping tablet: real 0.125s	user 0.019s	sys 0.018s
I20260709 14:49:35.768893  6833 raft_consensus.cc:2468] T c8ac07644f37427e80f77c67ccac9328 P bf2d93774f73406ead205c8ba8c9da13 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b7964825a6462295c0606a06169676 in term 1.
W20260709 14:49:35.769755  6629 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 14:49:35.769925  6879 ts_tablet_manager.cc:1434] T d58c1f5d4e1c448eab811059e23165cc P 25b7964825a6462295c0606a06169676: Time spent starting tablet: real 0.082s	user 0.014s	sys 0.005s
I20260709 14:49:35.772089  6650 leader_election.cc:304] T c8ac07644f37427e80f77c67ccac9328 P 25b7964825a6462295c0606a06169676 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b7964825a6462295c0606a06169676, bf2d93774f73406ead205c8ba8c9da13; no voters: 41999337784141c5834094008bf6ba97
I20260709 14:49:35.774466  6879 tablet_bootstrap.cc:492] T 1dbff5d6a7234db3a8f367fe9b30d615 P 25b7964825a6462295c0606a06169676: Bootstrap starting.
I20260709 14:49:35.777410  6877 raft_consensus.cc:359] T 1dbff5d6a7234db3a8f367fe9b30d615 P bf2d93774f73406ead205c8ba8c9da13 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:35.778936  6899 raft_consensus.cc:2804] T c8ac07644f37427e80f77c67ccac9328 P 25b7964825a6462295c0606a06169676 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:49:35.778298  6877 raft_consensus.cc:385] T 1dbff5d6a7234db3a8f367fe9b30d615 P bf2d93774f73406ead205c8ba8c9da13 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:49:35.779778  6877 raft_consensus.cc:740] T 1dbff5d6a7234db3a8f367fe9b30d615 P bf2d93774f73406ead205c8ba8c9da13 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf2d93774f73406ead205c8ba8c9da13, State: Initialized, Role: FOLLOWER
I20260709 14:49:35.783120  6877 consensus_queue.cc:260] T 1dbff5d6a7234db3a8f367fe9b30d615 P bf2d93774f73406ead205c8ba8c9da13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:35.779640  6899 raft_consensus.cc:697] T c8ac07644f37427e80f77c67ccac9328 P 25b7964825a6462295c0606a06169676 [term 1 LEADER]: Becoming Leader. State: Replica: 25b7964825a6462295c0606a06169676, State: Running, Role: LEADER
I20260709 14:49:35.788929  6879 tablet_bootstrap.cc:654] T 1dbff5d6a7234db3a8f367fe9b30d615 P 25b7964825a6462295c0606a06169676: Neither blocks nor log segments found. Creating new log.
I20260709 14:49:35.785302  6899 consensus_queue.cc:237] T c8ac07644f37427e80f77c67ccac9328 P 25b7964825a6462295c0606a06169676 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:35.792486  6877 ts_tablet_manager.cc:1434] T 1dbff5d6a7234db3a8f367fe9b30d615 P bf2d93774f73406ead205c8ba8c9da13: Time spent starting tablet: real 0.029s	user 0.000s	sys 0.011s
I20260709 14:49:35.794566  6877 tablet_bootstrap.cc:492] T 3d8096f833ea45ce9471c56d3ce1a68b P bf2d93774f73406ead205c8ba8c9da13: Bootstrap starting.
I20260709 14:49:35.796206  6833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a2d00569854cd990c582b9693829ff" candidate_uuid: "41999337784141c5834094008bf6ba97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf2d93774f73406ead205c8ba8c9da13" is_pre_election: true
I20260709 14:49:35.797077  6833 raft_consensus.cc:2468] T 82a2d00569854cd990c582b9693829ff P bf2d93774f73406ead205c8ba8c9da13 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41999337784141c5834094008bf6ba97 in term 0.
I20260709 14:49:35.796350  6832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ac07644f37427e80f77c67ccac9328" candidate_uuid: "41999337784141c5834094008bf6ba97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf2d93774f73406ead205c8ba8c9da13" is_pre_election: true
I20260709 14:49:35.798470  6832 raft_consensus.cc:2393] T c8ac07644f37427e80f77c67ccac9328 P bf2d93774f73406ead205c8ba8c9da13 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 41999337784141c5834094008bf6ba97 in current term 1: Already voted for candidate 25b7964825a6462295c0606a06169676 in this term.
I20260709 14:49:35.800957  6725 leader_election.cc:304] T 82a2d00569854cd990c582b9693829ff P 41999337784141c5834094008bf6ba97 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41999337784141c5834094008bf6ba97, bf2d93774f73406ead205c8ba8c9da13; no voters: 
I20260709 14:49:35.805508  6895 raft_consensus.cc:2804] T 82a2d00569854cd990c582b9693829ff P 41999337784141c5834094008bf6ba97 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:49:35.806315  6895 raft_consensus.cc:493] T 82a2d00569854cd990c582b9693829ff P 41999337784141c5834094008bf6ba97 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:49:35.807934  6895 raft_consensus.cc:3060] T 82a2d00569854cd990c582b9693829ff P 41999337784141c5834094008bf6ba97 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:49:35.817180  6877 tablet_bootstrap.cc:654] T 3d8096f833ea45ce9471c56d3ce1a68b P bf2d93774f73406ead205c8ba8c9da13: Neither blocks nor log segments found. Creating new log.
I20260709 14:49:35.825711  6878 tablet_bootstrap.cc:492] T 1dbff5d6a7234db3a8f367fe9b30d615 P 41999337784141c5834094008bf6ba97: No bootstrap required, opened a new log
I20260709 14:49:35.826386  6878 ts_tablet_manager.cc:1403] T 1dbff5d6a7234db3a8f367fe9b30d615 P 41999337784141c5834094008bf6ba97: Time spent bootstrapping tablet: real 0.134s	user 0.024s	sys 0.009s
I20260709 14:49:35.833410  6683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ac07644f37427e80f77c67ccac9328" candidate_uuid: "41999337784141c5834094008bf6ba97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b7964825a6462295c0606a06169676" is_pre_election: true
I20260709 14:49:35.840519  6684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a2d00569854cd990c582b9693829ff" candidate_uuid: "41999337784141c5834094008bf6ba97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b7964825a6462295c0606a06169676" is_pre_election: true
I20260709 14:49:35.840850  6878 raft_consensus.cc:359] T 1dbff5d6a7234db3a8f367fe9b30d615 P 41999337784141c5834094008bf6ba97 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:35.842082  6878 raft_consensus.cc:385] T 1dbff5d6a7234db3a8f367fe9b30d615 P 41999337784141c5834094008bf6ba97 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:49:35.842519  6878 raft_consensus.cc:740] T 1dbff5d6a7234db3a8f367fe9b30d615 P 41999337784141c5834094008bf6ba97 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41999337784141c5834094008bf6ba97, State: Initialized, Role: FOLLOWER
I20260709 14:49:35.844331  6878 consensus_queue.cc:260] T 1dbff5d6a7234db3a8f367fe9b30d615 P 41999337784141c5834094008bf6ba97 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:35.844856  6722 leader_election.cc:304] T c8ac07644f37427e80f77c67ccac9328 P 41999337784141c5834094008bf6ba97 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41999337784141c5834094008bf6ba97; no voters: 25b7964825a6462295c0606a06169676, bf2d93774f73406ead205c8ba8c9da13
I20260709 14:49:35.846977  6886 raft_consensus.cc:493] T 1dbff5d6a7234db3a8f367fe9b30d615 P bf2d93774f73406ead205c8ba8c9da13 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:49:35.848057  6886 raft_consensus.cc:515] T 1dbff5d6a7234db3a8f367fe9b30d615 P bf2d93774f73406ead205c8ba8c9da13 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:35.856510  6884 raft_consensus.cc:493] T 3d8096f833ea45ce9471c56d3ce1a68b P 25b7964825a6462295c0606a06169676 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:49:35.857513  6884 raft_consensus.cc:515] T 3d8096f833ea45ce9471c56d3ce1a68b P 25b7964825a6462295c0606a06169676 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:35.860780  6883 raft_consensus.cc:3060] T c8ac07644f37427e80f77c67ccac9328 P 41999337784141c5834094008bf6ba97 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:49:35.855166  6886 leader_election.cc:290] T 1dbff5d6a7234db3a8f367fe9b30d615 P bf2d93774f73406ead205c8ba8c9da13 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25b7964825a6462295c0606a06169676 (127.6.101.65:34615), 41999337784141c5834094008bf6ba97 (127.6.101.66:35001)
I20260709 14:49:35.869303  6895 raft_consensus.cc:515] T 82a2d00569854cd990c582b9693829ff P 41999337784141c5834094008bf6ba97 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:35.875962  6832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a2d00569854cd990c582b9693829ff" candidate_uuid: "41999337784141c5834094008bf6ba97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf2d93774f73406ead205c8ba8c9da13"
I20260709 14:49:35.877702  6832 raft_consensus.cc:3060] T 82a2d00569854cd990c582b9693829ff P bf2d93774f73406ead205c8ba8c9da13 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:49:35.879411  6895 leader_election.cc:290] T 82a2d00569854cd990c582b9693829ff P 41999337784141c5834094008bf6ba97 [CANDIDATE]: Term 1 election: Requested vote from peers 25b7964825a6462295c0606a06169676 (127.6.101.65:34615), bf2d93774f73406ead205c8ba8c9da13 (127.6.101.67:46675)
I20260709 14:49:35.884531  6879 tablet_bootstrap.cc:492] T 1dbff5d6a7234db3a8f367fe9b30d615 P 25b7964825a6462295c0606a06169676: No bootstrap required, opened a new log
I20260709 14:49:35.885308  6879 ts_tablet_manager.cc:1403] T 1dbff5d6a7234db3a8f367fe9b30d615 P 25b7964825a6462295c0606a06169676: Time spent bootstrapping tablet: real 0.111s	user 0.020s	sys 0.024s
I20260709 14:49:35.885847  6758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d8096f833ea45ce9471c56d3ce1a68b" candidate_uuid: "25b7964825a6462295c0606a06169676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41999337784141c5834094008bf6ba97" is_pre_election: true
I20260709 14:49:35.888779  6884 leader_election.cc:290] T 3d8096f833ea45ce9471c56d3ce1a68b P 25b7964825a6462295c0606a06169676 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 41999337784141c5834094008bf6ba97 (127.6.101.66:35001), bf2d93774f73406ead205c8ba8c9da13 (127.6.101.67:46675)
I20260709 14:49:35.890566  6833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d8096f833ea45ce9471c56d3ce1a68b" candidate_uuid: "25b7964825a6462295c0606a06169676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf2d93774f73406ead205c8ba8c9da13" is_pre_election: true
W20260709 14:49:35.891801  6648 leader_election.cc:343] T 3d8096f833ea45ce9471c56d3ce1a68b P 25b7964825a6462295c0606a06169676 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 41999337784141c5834094008bf6ba97 (127.6.101.66:35001): Illegal state: must be running to vote when last-logged opid is not known
W20260709 14:49:35.893354  6722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:34615, user_credentials={real_user=slave}} blocked reactor thread for 48586.3us
I20260709 14:49:35.896265  6877 tablet_bootstrap.cc:492] T 3d8096f833ea45ce9471c56d3ce1a68b P bf2d93774f73406ead205c8ba8c9da13: No bootstrap required, opened a new log
I20260709 14:49:35.896956  6877 ts_tablet_manager.cc:1403] T 3d8096f833ea45ce9471c56d3ce1a68b P bf2d93774f73406ead205c8ba8c9da13: Time spent bootstrapping tablet: real 0.103s	user 0.032s	sys 0.016s
W20260709 14:49:35.903107  6650 leader_election.cc:343] T 3d8096f833ea45ce9471c56d3ce1a68b P 25b7964825a6462295c0606a06169676 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bf2d93774f73406ead205c8ba8c9da13 (127.6.101.67:46675): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:49:35.903735  6650 leader_election.cc:304] T 3d8096f833ea45ce9471c56d3ce1a68b P 25b7964825a6462295c0606a06169676 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b7964825a6462295c0606a06169676; no voters: 41999337784141c5834094008bf6ba97, bf2d93774f73406ead205c8ba8c9da13
I20260709 14:49:35.905045  6884 raft_consensus.cc:2749] T 3d8096f833ea45ce9471c56d3ce1a68b P 25b7964825a6462295c0606a06169676 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:49:35.904677  6879 raft_consensus.cc:359] T 1dbff5d6a7234db3a8f367fe9b30d615 P 25b7964825a6462295c0606a06169676 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
W20260709 14:49:35.912441  6722 leader_election.cc:343] T 82a2d00569854cd990c582b9693829ff P 41999337784141c5834094008bf6ba97 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25b7964825a6462295c0606a06169676 (127.6.101.65:34615): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:49:35.913022  6832 raft_consensus.cc:2468] T 82a2d00569854cd990c582b9693829ff P bf2d93774f73406ead205c8ba8c9da13 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41999337784141c5834094008bf6ba97 in term 1.
I20260709 14:49:35.911689  6879 raft_consensus.cc:385] T 1dbff5d6a7234db3a8f367fe9b30d615 P 25b7964825a6462295c0606a06169676 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:49:35.914985  6684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a2d00569854cd990c582b9693829ff" candidate_uuid: "41999337784141c5834094008bf6ba97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b7964825a6462295c0606a06169676"
I20260709 14:49:35.915966  6879 raft_consensus.cc:740] T 1dbff5d6a7234db3a8f367fe9b30d615 P 25b7964825a6462295c0606a06169676 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25b7964825a6462295c0606a06169676, State: Initialized, Role: FOLLOWER
I20260709 14:49:35.915691  6878 ts_tablet_manager.cc:1434] T 1dbff5d6a7234db3a8f367fe9b30d615 P 41999337784141c5834094008bf6ba97: Time spent starting tablet: real 0.088s	user 0.009s	sys 0.002s
I20260709 14:49:35.917577  6883 raft_consensus.cc:2749] T c8ac07644f37427e80f77c67ccac9328 P 41999337784141c5834094008bf6ba97 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:49:35.917755  6877 raft_consensus.cc:359] T 3d8096f833ea45ce9471c56d3ce1a68b P bf2d93774f73406ead205c8ba8c9da13 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
W20260709 14:49:35.919343  6722 leader_election.cc:343] T 82a2d00569854cd990c582b9693829ff P 41999337784141c5834094008bf6ba97 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 25b7964825a6462295c0606a06169676 (127.6.101.65:34615): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:49:35.920403  6877 raft_consensus.cc:385] T 3d8096f833ea45ce9471c56d3ce1a68b P bf2d93774f73406ead205c8ba8c9da13 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:49:35.921703  6725 leader_election.cc:304] T 82a2d00569854cd990c582b9693829ff P 41999337784141c5834094008bf6ba97 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 41999337784141c5834094008bf6ba97, bf2d93774f73406ead205c8ba8c9da13; no voters: 25b7964825a6462295c0606a06169676
I20260709 14:49:35.924360  6883 raft_consensus.cc:2804] T 82a2d00569854cd990c582b9693829ff P 41999337784141c5834094008bf6ba97 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:49:35.925526  6883 raft_consensus.cc:697] T 82a2d00569854cd990c582b9693829ff P 41999337784141c5834094008bf6ba97 [term 1 LEADER]: Becoming Leader. State: Replica: 41999337784141c5834094008bf6ba97, State: Running, Role: LEADER
I20260709 14:49:35.920393  6879 consensus_queue.cc:260] T 1dbff5d6a7234db3a8f367fe9b30d615 P 25b7964825a6462295c0606a06169676 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:35.921748  6877 raft_consensus.cc:740] T 3d8096f833ea45ce9471c56d3ce1a68b P bf2d93774f73406ead205c8ba8c9da13 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf2d93774f73406ead205c8ba8c9da13, State: Initialized, Role: FOLLOWER
I20260709 14:49:35.926961  6883 consensus_queue.cc:237] T 82a2d00569854cd990c582b9693829ff P 41999337784141c5834094008bf6ba97 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:35.929340  6878 tablet_bootstrap.cc:492] T 5ce18799382e46108fbcbed2c364321d P 41999337784141c5834094008bf6ba97: Bootstrap starting.
I20260709 14:49:35.933336  6877 consensus_queue.cc:260] T 3d8096f833ea45ce9471c56d3ce1a68b P bf2d93774f73406ead205c8ba8c9da13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:35.927393  6580 catalog_manager.cc:5697] T c8ac07644f37427e80f77c67ccac9328 P 25b7964825a6462295c0606a06169676 reported cstate change: term changed from 0 to 1, leader changed from <none> to 25b7964825a6462295c0606a06169676 (127.6.101.65). New cstate: current_term: 1 leader_uuid: "25b7964825a6462295c0606a06169676" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } health_report { overall_health: UNKNOWN } } }
I20260709 14:49:35.936762  6879 ts_tablet_manager.cc:1434] T 1dbff5d6a7234db3a8f367fe9b30d615 P 25b7964825a6462295c0606a06169676: Time spent starting tablet: real 0.051s	user 0.001s	sys 0.011s
I20260709 14:49:35.945979  6877 ts_tablet_manager.cc:1434] T 3d8096f833ea45ce9471c56d3ce1a68b P bf2d93774f73406ead205c8ba8c9da13: Time spent starting tablet: real 0.049s	user 0.009s	sys 0.002s
I20260709 14:49:35.948395  6879 tablet_bootstrap.cc:492] T 5ce18799382e46108fbcbed2c364321d P 25b7964825a6462295c0606a06169676: Bootstrap starting.
I20260709 14:49:35.951766  6877 tablet_bootstrap.cc:492] T d58c1f5d4e1c448eab811059e23165cc P bf2d93774f73406ead205c8ba8c9da13: Bootstrap starting.
I20260709 14:49:35.953882  6579 catalog_manager.cc:5697] T 82a2d00569854cd990c582b9693829ff P 41999337784141c5834094008bf6ba97 reported cstate change: term changed from 0 to 1, leader changed from <none> to 41999337784141c5834094008bf6ba97 (127.6.101.66). New cstate: current_term: 1 leader_uuid: "41999337784141c5834094008bf6ba97" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } health_report { overall_health: UNKNOWN } } }
I20260709 14:49:35.968158  6878 tablet_bootstrap.cc:654] T 5ce18799382e46108fbcbed2c364321d P 41999337784141c5834094008bf6ba97: Neither blocks nor log segments found. Creating new log.
I20260709 14:49:35.968138  6684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbff5d6a7234db3a8f367fe9b30d615" candidate_uuid: "bf2d93774f73406ead205c8ba8c9da13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b7964825a6462295c0606a06169676" is_pre_election: true
I20260709 14:49:35.969380  6684 raft_consensus.cc:2468] T 1dbff5d6a7234db3a8f367fe9b30d615 P 25b7964825a6462295c0606a06169676 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf2d93774f73406ead205c8ba8c9da13 in term 0.
I20260709 14:49:35.984206  6879 tablet_bootstrap.cc:654] T 5ce18799382e46108fbcbed2c364321d P 25b7964825a6462295c0606a06169676: Neither blocks nor log segments found. Creating new log.
I20260709 14:49:35.990392  6796 leader_election.cc:304] T 1dbff5d6a7234db3a8f367fe9b30d615 P bf2d93774f73406ead205c8ba8c9da13 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b7964825a6462295c0606a06169676, bf2d93774f73406ead205c8ba8c9da13; no voters: 
I20260709 14:49:35.991472  6886 raft_consensus.cc:2804] T 1dbff5d6a7234db3a8f367fe9b30d615 P bf2d93774f73406ead205c8ba8c9da13 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:49:35.992600  6886 raft_consensus.cc:493] T 1dbff5d6a7234db3a8f367fe9b30d615 P bf2d93774f73406ead205c8ba8c9da13 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:49:35.996120  6886 raft_consensus.cc:3060] T 1dbff5d6a7234db3a8f367fe9b30d615 P bf2d93774f73406ead205c8ba8c9da13 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:49:35.998558  6758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbff5d6a7234db3a8f367fe9b30d615" candidate_uuid: "bf2d93774f73406ead205c8ba8c9da13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41999337784141c5834094008bf6ba97" is_pre_election: true
I20260709 14:49:35.999872  6758 raft_consensus.cc:2468] T 1dbff5d6a7234db3a8f367fe9b30d615 P 41999337784141c5834094008bf6ba97 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf2d93774f73406ead205c8ba8c9da13 in term 0.
I20260709 14:49:36.002192  6884 raft_consensus.cc:493] T d58c1f5d4e1c448eab811059e23165cc P 25b7964825a6462295c0606a06169676 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:49:36.004441  6884 raft_consensus.cc:515] T d58c1f5d4e1c448eab811059e23165cc P 25b7964825a6462295c0606a06169676 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } } peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } }
I20260709 14:49:36.008244  6884 leader_election.cc:290] T d58c1f5d4e1c448eab811059e23165cc P 25b7964825a6462295c0606a06169676 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 41999337784141c5834094008bf6ba97 (127.6.101.66:35001), bf2d93774f73406ead205c8ba8c9da13 (127.6.101.67:46675)
I20260709 14:49:36.008165  6758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d58c1f5d4e1c448eab811059e23165cc" candidate_uuid: "25b7964825a6462295c0606a06169676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41999337784141c5834094008bf6ba97" is_pre_election: true
I20260709 14:49:36.009368  6832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d58c1f5d4e1c448eab811059e23165cc" candidate_uuid: "25b7964825a6462295c0606a06169676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf2d93774f73406ead205c8ba8c9da13" is_pre_election: true
W20260709 14:49:36.011559  6648 leader_election.cc:343] T d58c1f5d4e1c448eab811059e23165cc P 25b7964825a6462295c0606a06169676 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 41999337784141c5834094008bf6ba97 (127.6.101.66:35001): Illegal state: must be running to vote when last-logged opid is not known
W20260709 14:49:36.013161  6650 leader_election.cc:343] T d58c1f5d4e1c448eab811059e23165cc P 25b7964825a6462295c0606a06169676 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bf2d93774f73406ead205c8ba8c9da13 (127.6.101.67:46675): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:49:36.013724  6650 leader_election.cc:304] T d58c1f5d4e1c448eab811059e23165cc P 25b7964825a6462295c0606a06169676 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b7964825a6462295c0606a06169676; no voters: 41999337784141c5834094008bf6ba97, bf2d93774f73406ead205c8ba8c9da13
I20260709 14:49:36.015050  6884 raft_consensus.cc:2749] T d58c1f5d4e1c448eab811059e23165cc P 25b7964825a6462295c0606a06169676 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:49:36.015599  6878 tablet_bootstrap.cc:492] T 5ce18799382e46108fbcbed2c364321d P 41999337784141c5834094008bf6ba97: No bootstrap required, opened a new log
I20260709 14:49:36.014606  6886 raft_consensus.cc:515] T 1dbff5d6a7234db3a8f367fe9b30d615 P bf2d93774f73406ead205c8ba8c9da13 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:36.018146  6878 ts_tablet_manager.cc:1403] T 5ce18799382e46108fbcbed2c364321d P 41999337784141c5834094008bf6ba97: Time spent bootstrapping tablet: real 0.089s	user 0.009s	sys 0.011s
I20260709 14:49:36.021852  6883 raft_consensus.cc:493] T bc290da245804ddc92d9597c5da52a82 P 41999337784141c5834094008bf6ba97 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:49:36.022927  6883 raft_consensus.cc:515] T bc290da245804ddc92d9597c5da52a82 P 41999337784141c5834094008bf6ba97 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:36.026333  6684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbff5d6a7234db3a8f367fe9b30d615" candidate_uuid: "bf2d93774f73406ead205c8ba8c9da13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b7964825a6462295c0606a06169676"
I20260709 14:49:36.027235  6878 raft_consensus.cc:359] T 5ce18799382e46108fbcbed2c364321d P 41999337784141c5834094008bf6ba97 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:36.028519  6883 leader_election.cc:290] T bc290da245804ddc92d9597c5da52a82 P 41999337784141c5834094008bf6ba97 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25b7964825a6462295c0606a06169676 (127.6.101.65:34615), bf2d93774f73406ead205c8ba8c9da13 (127.6.101.67:46675)
I20260709 14:49:36.028721  6832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc290da245804ddc92d9597c5da52a82" candidate_uuid: "41999337784141c5834094008bf6ba97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf2d93774f73406ead205c8ba8c9da13" is_pre_election: true
I20260709 14:49:36.028741  6683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc290da245804ddc92d9597c5da52a82" candidate_uuid: "41999337784141c5834094008bf6ba97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b7964825a6462295c0606a06169676" is_pre_election: true
I20260709 14:49:36.027200  6684 raft_consensus.cc:3060] T 1dbff5d6a7234db3a8f367fe9b30d615 P 25b7964825a6462295c0606a06169676 [term 0 FOLLOWER]: Advancing to term 1
W20260709 14:49:36.031018  6725 leader_election.cc:343] T bc290da245804ddc92d9597c5da52a82 P 41999337784141c5834094008bf6ba97 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bf2d93774f73406ead205c8ba8c9da13 (127.6.101.67:46675): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:49:36.031632  6878 raft_consensus.cc:385] T 5ce18799382e46108fbcbed2c364321d P 41999337784141c5834094008bf6ba97 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:49:36.032140  6878 raft_consensus.cc:740] T 5ce18799382e46108fbcbed2c364321d P 41999337784141c5834094008bf6ba97 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41999337784141c5834094008bf6ba97, State: Initialized, Role: FOLLOWER
W20260709 14:49:36.032501  6722 leader_election.cc:343] T bc290da245804ddc92d9597c5da52a82 P 41999337784141c5834094008bf6ba97 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25b7964825a6462295c0606a06169676 (127.6.101.65:34615): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:49:36.031670  6886 leader_election.cc:290] T 1dbff5d6a7234db3a8f367fe9b30d615 P bf2d93774f73406ead205c8ba8c9da13 [CANDIDATE]: Term 1 election: Requested vote from peers 25b7964825a6462295c0606a06169676 (127.6.101.65:34615), 41999337784141c5834094008bf6ba97 (127.6.101.66:35001)
I20260709 14:49:36.033804  6877 tablet_bootstrap.cc:654] T d58c1f5d4e1c448eab811059e23165cc P bf2d93774f73406ead205c8ba8c9da13: Neither blocks nor log segments found. Creating new log.
I20260709 14:49:36.032976  6878 consensus_queue.cc:260] T 5ce18799382e46108fbcbed2c364321d P 41999337784141c5834094008bf6ba97 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:36.040021  6878 ts_tablet_manager.cc:1434] T 5ce18799382e46108fbcbed2c364321d P 41999337784141c5834094008bf6ba97: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.002s
I20260709 14:49:36.042002  6878 tablet_bootstrap.cc:492] T 3d8096f833ea45ce9471c56d3ce1a68b P 41999337784141c5834094008bf6ba97: Bootstrap starting.
I20260709 14:49:36.044442  6879 tablet_bootstrap.cc:492] T 5ce18799382e46108fbcbed2c364321d P 25b7964825a6462295c0606a06169676: No bootstrap required, opened a new log
I20260709 14:49:36.044018  6722 leader_election.cc:304] T bc290da245804ddc92d9597c5da52a82 P 41999337784141c5834094008bf6ba97 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41999337784141c5834094008bf6ba97; no voters: 25b7964825a6462295c0606a06169676, bf2d93774f73406ead205c8ba8c9da13
I20260709 14:49:36.045547  6883 raft_consensus.cc:2749] T bc290da245804ddc92d9597c5da52a82 P 41999337784141c5834094008bf6ba97 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:49:36.047104  6879 ts_tablet_manager.cc:1403] T 5ce18799382e46108fbcbed2c364321d P 25b7964825a6462295c0606a06169676: Time spent bootstrapping tablet: real 0.106s	user 0.014s	sys 0.007s
I20260709 14:49:36.059268  6886 raft_consensus.cc:493] T 3d8096f833ea45ce9471c56d3ce1a68b P bf2d93774f73406ead205c8ba8c9da13 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:49:36.059957  6886 raft_consensus.cc:515] T 3d8096f833ea45ce9471c56d3ce1a68b P bf2d93774f73406ead205c8ba8c9da13 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:36.060338  6758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbff5d6a7234db3a8f367fe9b30d615" candidate_uuid: "bf2d93774f73406ead205c8ba8c9da13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41999337784141c5834094008bf6ba97"
I20260709 14:49:36.061304  6758 raft_consensus.cc:3060] T 1dbff5d6a7234db3a8f367fe9b30d615 P 41999337784141c5834094008bf6ba97 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:49:36.069303  6879 raft_consensus.cc:359] T 5ce18799382e46108fbcbed2c364321d P 25b7964825a6462295c0606a06169676 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:36.071420  6683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d8096f833ea45ce9471c56d3ce1a68b" candidate_uuid: "bf2d93774f73406ead205c8ba8c9da13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b7964825a6462295c0606a06169676" is_pre_election: true
I20260709 14:49:36.072129  6683 raft_consensus.cc:2468] T 3d8096f833ea45ce9471c56d3ce1a68b P 25b7964825a6462295c0606a06169676 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf2d93774f73406ead205c8ba8c9da13 in term 0.
I20260709 14:49:36.072683  6759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d8096f833ea45ce9471c56d3ce1a68b" candidate_uuid: "bf2d93774f73406ead205c8ba8c9da13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41999337784141c5834094008bf6ba97" is_pre_election: true
I20260709 14:49:36.073549  6796 leader_election.cc:304] T 3d8096f833ea45ce9471c56d3ce1a68b P bf2d93774f73406ead205c8ba8c9da13 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b7964825a6462295c0606a06169676, bf2d93774f73406ead205c8ba8c9da13; no voters: 
I20260709 14:49:36.070185  6879 raft_consensus.cc:385] T 5ce18799382e46108fbcbed2c364321d P 25b7964825a6462295c0606a06169676 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:49:36.079809  6879 raft_consensus.cc:740] T 5ce18799382e46108fbcbed2c364321d P 25b7964825a6462295c0606a06169676 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25b7964825a6462295c0606a06169676, State: Initialized, Role: FOLLOWER
W20260709 14:49:36.079751  6797 leader_election.cc:343] T 3d8096f833ea45ce9471c56d3ce1a68b P bf2d93774f73406ead205c8ba8c9da13 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 41999337784141c5834094008bf6ba97 (127.6.101.66:35001): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:49:36.079950  6886 leader_election.cc:290] T 3d8096f833ea45ce9471c56d3ce1a68b P bf2d93774f73406ead205c8ba8c9da13 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25b7964825a6462295c0606a06169676 (127.6.101.65:34615), 41999337784141c5834094008bf6ba97 (127.6.101.66:35001)
I20260709 14:49:36.081457  6886 raft_consensus.cc:2804] T 3d8096f833ea45ce9471c56d3ce1a68b P bf2d93774f73406ead205c8ba8c9da13 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:49:36.082310  6886 raft_consensus.cc:493] T 3d8096f833ea45ce9471c56d3ce1a68b P bf2d93774f73406ead205c8ba8c9da13 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:49:36.082790  6886 raft_consensus.cc:3060] T 3d8096f833ea45ce9471c56d3ce1a68b P bf2d93774f73406ead205c8ba8c9da13 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:49:36.075263  6684 raft_consensus.cc:2468] T 1dbff5d6a7234db3a8f367fe9b30d615 P 25b7964825a6462295c0606a06169676 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf2d93774f73406ead205c8ba8c9da13 in term 1.
I20260709 14:49:36.085039  6879 consensus_queue.cc:260] T 5ce18799382e46108fbcbed2c364321d P 25b7964825a6462295c0606a06169676 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:36.091351  6879 ts_tablet_manager.cc:1434] T 5ce18799382e46108fbcbed2c364321d P 25b7964825a6462295c0606a06169676: Time spent starting tablet: real 0.035s	user 0.009s	sys 0.000s
I20260709 14:49:36.092958  6879 tablet_bootstrap.cc:492] T bc290da245804ddc92d9597c5da52a82 P 25b7964825a6462295c0606a06169676: Bootstrap starting.
I20260709 14:49:36.095652  6758 raft_consensus.cc:2468] T 1dbff5d6a7234db3a8f367fe9b30d615 P 41999337784141c5834094008bf6ba97 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf2d93774f73406ead205c8ba8c9da13 in term 1.
I20260709 14:49:36.096787  6796 leader_election.cc:304] T 1dbff5d6a7234db3a8f367fe9b30d615 P bf2d93774f73406ead205c8ba8c9da13 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b7964825a6462295c0606a06169676, bf2d93774f73406ead205c8ba8c9da13; no voters: 
I20260709 14:49:36.104809  6886 raft_consensus.cc:515] T 3d8096f833ea45ce9471c56d3ce1a68b P bf2d93774f73406ead205c8ba8c9da13 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:36.104522  6915 raft_consensus.cc:2804] T 1dbff5d6a7234db3a8f367fe9b30d615 P bf2d93774f73406ead205c8ba8c9da13 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:49:36.109593  6877 tablet_bootstrap.cc:492] T d58c1f5d4e1c448eab811059e23165cc P bf2d93774f73406ead205c8ba8c9da13: No bootstrap required, opened a new log
I20260709 14:49:36.110265  6877 ts_tablet_manager.cc:1403] T d58c1f5d4e1c448eab811059e23165cc P bf2d93774f73406ead205c8ba8c9da13: Time spent bootstrapping tablet: real 0.160s	user 0.028s	sys 0.025s
I20260709 14:49:36.111632  6684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d8096f833ea45ce9471c56d3ce1a68b" candidate_uuid: "bf2d93774f73406ead205c8ba8c9da13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b7964825a6462295c0606a06169676"
I20260709 14:49:36.112620  6684 raft_consensus.cc:3060] T 3d8096f833ea45ce9471c56d3ce1a68b P 25b7964825a6462295c0606a06169676 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:49:36.112620  6879 tablet_bootstrap.cc:654] T bc290da245804ddc92d9597c5da52a82 P 25b7964825a6462295c0606a06169676: Neither blocks nor log segments found. Creating new log.
I20260709 14:49:36.118057  6886 leader_election.cc:290] T 3d8096f833ea45ce9471c56d3ce1a68b P bf2d93774f73406ead205c8ba8c9da13 [CANDIDATE]: Term 1 election: Requested vote from peers 25b7964825a6462295c0606a06169676 (127.6.101.65:34615), 41999337784141c5834094008bf6ba97 (127.6.101.66:35001)
I20260709 14:49:36.118983  6758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d8096f833ea45ce9471c56d3ce1a68b" candidate_uuid: "bf2d93774f73406ead205c8ba8c9da13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41999337784141c5834094008bf6ba97"
I20260709 14:49:36.114156  6878 tablet_bootstrap.cc:654] T 3d8096f833ea45ce9471c56d3ce1a68b P 41999337784141c5834094008bf6ba97: Neither blocks nor log segments found. Creating new log.
I20260709 14:49:36.119120  6877 raft_consensus.cc:359] T d58c1f5d4e1c448eab811059e23165cc P bf2d93774f73406ead205c8ba8c9da13 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } } peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } }
W20260709 14:49:36.122479  6797 leader_election.cc:343] T 3d8096f833ea45ce9471c56d3ce1a68b P bf2d93774f73406ead205c8ba8c9da13 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 41999337784141c5834094008bf6ba97 (127.6.101.66:35001): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:49:36.125682  6877 raft_consensus.cc:385] T d58c1f5d4e1c448eab811059e23165cc P bf2d93774f73406ead205c8ba8c9da13 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:49:36.126125  6877 raft_consensus.cc:740] T d58c1f5d4e1c448eab811059e23165cc P bf2d93774f73406ead205c8ba8c9da13 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf2d93774f73406ead205c8ba8c9da13, State: Initialized, Role: FOLLOWER
I20260709 14:49:36.124933  6684 raft_consensus.cc:2468] T 3d8096f833ea45ce9471c56d3ce1a68b P 25b7964825a6462295c0606a06169676 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf2d93774f73406ead205c8ba8c9da13 in term 1.
I20260709 14:49:36.133188  6796 leader_election.cc:304] T 3d8096f833ea45ce9471c56d3ce1a68b P bf2d93774f73406ead205c8ba8c9da13 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b7964825a6462295c0606a06169676, bf2d93774f73406ead205c8ba8c9da13; no voters: 41999337784141c5834094008bf6ba97
I20260709 14:49:36.134869  6886 raft_consensus.cc:2804] T 3d8096f833ea45ce9471c56d3ce1a68b P bf2d93774f73406ead205c8ba8c9da13 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:49:36.135654  6886 raft_consensus.cc:697] T 3d8096f833ea45ce9471c56d3ce1a68b P bf2d93774f73406ead205c8ba8c9da13 [term 1 LEADER]: Becoming Leader. State: Replica: bf2d93774f73406ead205c8ba8c9da13, State: Running, Role: LEADER
I20260709 14:49:36.136698  6886 consensus_queue.cc:237] T 3d8096f833ea45ce9471c56d3ce1a68b P bf2d93774f73406ead205c8ba8c9da13 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:36.144296  6877 consensus_queue.cc:260] T d58c1f5d4e1c448eab811059e23165cc P bf2d93774f73406ead205c8ba8c9da13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } } peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } }
I20260709 14:49:36.148129  6877 ts_tablet_manager.cc:1434] T d58c1f5d4e1c448eab811059e23165cc P bf2d93774f73406ead205c8ba8c9da13: Time spent starting tablet: real 0.038s	user 0.009s	sys 0.001s
I20260709 14:49:36.148996  6915 raft_consensus.cc:697] T 1dbff5d6a7234db3a8f367fe9b30d615 P bf2d93774f73406ead205c8ba8c9da13 [term 1 LEADER]: Becoming Leader. State: Replica: bf2d93774f73406ead205c8ba8c9da13, State: Running, Role: LEADER
I20260709 14:49:36.149485  6877 tablet_bootstrap.cc:492] T bc290da245804ddc92d9597c5da52a82 P bf2d93774f73406ead205c8ba8c9da13: Bootstrap starting.
I20260709 14:49:36.150229  6915 consensus_queue.cc:237] T 1dbff5d6a7234db3a8f367fe9b30d615 P bf2d93774f73406ead205c8ba8c9da13 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:36.149109  6879 tablet_bootstrap.cc:492] T bc290da245804ddc92d9597c5da52a82 P 25b7964825a6462295c0606a06169676: No bootstrap required, opened a new log
I20260709 14:49:36.155000  6879 ts_tablet_manager.cc:1403] T bc290da245804ddc92d9597c5da52a82 P 25b7964825a6462295c0606a06169676: Time spent bootstrapping tablet: real 0.062s	user 0.016s	sys 0.002s
I20260709 14:49:36.175398  6879 raft_consensus.cc:359] T bc290da245804ddc92d9597c5da52a82 P 25b7964825a6462295c0606a06169676 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:36.177462  6879 raft_consensus.cc:385] T bc290da245804ddc92d9597c5da52a82 P 25b7964825a6462295c0606a06169676 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:49:36.177992  6879 raft_consensus.cc:740] T bc290da245804ddc92d9597c5da52a82 P 25b7964825a6462295c0606a06169676 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25b7964825a6462295c0606a06169676, State: Initialized, Role: FOLLOWER
I20260709 14:49:36.178951  6877 tablet_bootstrap.cc:654] T bc290da245804ddc92d9597c5da52a82 P bf2d93774f73406ead205c8ba8c9da13: Neither blocks nor log segments found. Creating new log.
I20260709 14:49:36.179446  6879 consensus_queue.cc:260] T bc290da245804ddc92d9597c5da52a82 P 25b7964825a6462295c0606a06169676 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:36.187608  6878 tablet_bootstrap.cc:492] T 3d8096f833ea45ce9471c56d3ce1a68b P 41999337784141c5834094008bf6ba97: No bootstrap required, opened a new log
I20260709 14:49:36.189839  6878 ts_tablet_manager.cc:1403] T 3d8096f833ea45ce9471c56d3ce1a68b P 41999337784141c5834094008bf6ba97: Time spent bootstrapping tablet: real 0.149s	user 0.023s	sys 0.010s
I20260709 14:49:36.194485  6878 raft_consensus.cc:359] T 3d8096f833ea45ce9471c56d3ce1a68b P 41999337784141c5834094008bf6ba97 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:36.196036  6878 raft_consensus.cc:385] T 3d8096f833ea45ce9471c56d3ce1a68b P 41999337784141c5834094008bf6ba97 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:49:36.196370  6879 ts_tablet_manager.cc:1434] T bc290da245804ddc92d9597c5da52a82 P 25b7964825a6462295c0606a06169676: Time spent starting tablet: real 0.039s	user 0.011s	sys 0.000s
I20260709 14:49:36.196465  6878 raft_consensus.cc:740] T 3d8096f833ea45ce9471c56d3ce1a68b P 41999337784141c5834094008bf6ba97 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41999337784141c5834094008bf6ba97, State: Initialized, Role: FOLLOWER
I20260709 14:49:36.199129  6879 tablet_bootstrap.cc:492] T 07255af297cd4ac59277e81984f07f9c P 25b7964825a6462295c0606a06169676: Bootstrap starting.
I20260709 14:49:36.198158  6878 consensus_queue.cc:260] T 3d8096f833ea45ce9471c56d3ce1a68b P 41999337784141c5834094008bf6ba97 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:36.206333  6877 tablet_bootstrap.cc:492] T bc290da245804ddc92d9597c5da52a82 P bf2d93774f73406ead205c8ba8c9da13: No bootstrap required, opened a new log
I20260709 14:49:36.207056  6877 ts_tablet_manager.cc:1403] T bc290da245804ddc92d9597c5da52a82 P bf2d93774f73406ead205c8ba8c9da13: Time spent bootstrapping tablet: real 0.058s	user 0.025s	sys 0.002s
I20260709 14:49:36.210443  6877 raft_consensus.cc:359] T bc290da245804ddc92d9597c5da52a82 P bf2d93774f73406ead205c8ba8c9da13 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:36.211386  6877 raft_consensus.cc:385] T bc290da245804ddc92d9597c5da52a82 P bf2d93774f73406ead205c8ba8c9da13 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:49:36.211724  6877 raft_consensus.cc:740] T bc290da245804ddc92d9597c5da52a82 P bf2d93774f73406ead205c8ba8c9da13 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf2d93774f73406ead205c8ba8c9da13, State: Initialized, Role: FOLLOWER
I20260709 14:49:36.210758  6578 catalog_manager.cc:5697] T 1dbff5d6a7234db3a8f367fe9b30d615 P bf2d93774f73406ead205c8ba8c9da13 reported cstate change: term changed from 0 to 1, leader changed from <none> to bf2d93774f73406ead205c8ba8c9da13 (127.6.101.67). New cstate: current_term: 1 leader_uuid: "bf2d93774f73406ead205c8ba8c9da13" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } health_report { overall_health: HEALTHY } } }
I20260709 14:49:36.222978  6884 consensus_queue.cc:1048] T c8ac07644f37427e80f77c67ccac9328 P 25b7964825a6462295c0606a06169676 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:49:36.230454  6878 ts_tablet_manager.cc:1434] T 3d8096f833ea45ce9471c56d3ce1a68b P 41999337784141c5834094008bf6ba97: Time spent starting tablet: real 0.040s	user 0.011s	sys 0.000s
I20260709 14:49:36.231983  6878 tablet_bootstrap.cc:492] T 07255af297cd4ac59277e81984f07f9c P 41999337784141c5834094008bf6ba97: Bootstrap starting.
I20260709 14:49:36.240702  6877 consensus_queue.cc:260] T bc290da245804ddc92d9597c5da52a82 P bf2d93774f73406ead205c8ba8c9da13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:36.242192  6886 raft_consensus.cc:493] T bc290da245804ddc92d9597c5da52a82 P bf2d93774f73406ead205c8ba8c9da13 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:49:36.242764  6886 raft_consensus.cc:515] T bc290da245804ddc92d9597c5da52a82 P bf2d93774f73406ead205c8ba8c9da13 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:36.240876  6579 catalog_manager.cc:5697] T 3d8096f833ea45ce9471c56d3ce1a68b P bf2d93774f73406ead205c8ba8c9da13 reported cstate change: term changed from 0 to 1, leader changed from <none> to bf2d93774f73406ead205c8ba8c9da13 (127.6.101.67). New cstate: current_term: 1 leader_uuid: "bf2d93774f73406ead205c8ba8c9da13" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } health_report { overall_health: HEALTHY } } }
I20260709 14:49:36.245155  6879 tablet_bootstrap.cc:654] T 07255af297cd4ac59277e81984f07f9c P 25b7964825a6462295c0606a06169676: Neither blocks nor log segments found. Creating new log.
I20260709 14:49:36.247967  6886 leader_election.cc:290] T bc290da245804ddc92d9597c5da52a82 P bf2d93774f73406ead205c8ba8c9da13 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25b7964825a6462295c0606a06169676 (127.6.101.65:34615), 41999337784141c5834094008bf6ba97 (127.6.101.66:35001)
I20260709 14:49:36.249716  6684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc290da245804ddc92d9597c5da52a82" candidate_uuid: "bf2d93774f73406ead205c8ba8c9da13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b7964825a6462295c0606a06169676" is_pre_election: true
I20260709 14:49:36.250558  6684 raft_consensus.cc:2468] T bc290da245804ddc92d9597c5da52a82 P 25b7964825a6462295c0606a06169676 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf2d93774f73406ead205c8ba8c9da13 in term 0.
I20260709 14:49:36.250833  6758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc290da245804ddc92d9597c5da52a82" candidate_uuid: "bf2d93774f73406ead205c8ba8c9da13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41999337784141c5834094008bf6ba97" is_pre_election: true
I20260709 14:49:36.251777  6758 raft_consensus.cc:2468] T bc290da245804ddc92d9597c5da52a82 P 41999337784141c5834094008bf6ba97 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf2d93774f73406ead205c8ba8c9da13 in term 0.
I20260709 14:49:36.250794  6877 ts_tablet_manager.cc:1434] T bc290da245804ddc92d9597c5da52a82 P bf2d93774f73406ead205c8ba8c9da13: Time spent starting tablet: real 0.043s	user 0.010s	sys 0.000s
I20260709 14:49:36.253788  6878 tablet_bootstrap.cc:654] T 07255af297cd4ac59277e81984f07f9c P 41999337784141c5834094008bf6ba97: Neither blocks nor log segments found. Creating new log.
I20260709 14:49:36.253990  6797 leader_election.cc:304] T bc290da245804ddc92d9597c5da52a82 P bf2d93774f73406ead205c8ba8c9da13 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41999337784141c5834094008bf6ba97, bf2d93774f73406ead205c8ba8c9da13; no voters: 
I20260709 14:49:36.254012  6877 tablet_bootstrap.cc:492] T 5ce18799382e46108fbcbed2c364321d P bf2d93774f73406ead205c8ba8c9da13: Bootstrap starting.
I20260709 14:49:36.256583  6886 raft_consensus.cc:2804] T bc290da245804ddc92d9597c5da52a82 P bf2d93774f73406ead205c8ba8c9da13 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:49:36.257174  6886 raft_consensus.cc:493] T bc290da245804ddc92d9597c5da52a82 P bf2d93774f73406ead205c8ba8c9da13 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:49:36.257814  6886 raft_consensus.cc:3060] T bc290da245804ddc92d9597c5da52a82 P bf2d93774f73406ead205c8ba8c9da13 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:49:36.273921  6886 raft_consensus.cc:515] T bc290da245804ddc92d9597c5da52a82 P bf2d93774f73406ead205c8ba8c9da13 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:36.275537  6879 tablet_bootstrap.cc:492] T 07255af297cd4ac59277e81984f07f9c P 25b7964825a6462295c0606a06169676: No bootstrap required, opened a new log
I20260709 14:49:36.276120  6879 ts_tablet_manager.cc:1403] T 07255af297cd4ac59277e81984f07f9c P 25b7964825a6462295c0606a06169676: Time spent bootstrapping tablet: real 0.078s	user 0.014s	sys 0.014s
I20260709 14:49:36.280097  6886 leader_election.cc:290] T bc290da245804ddc92d9597c5da52a82 P bf2d93774f73406ead205c8ba8c9da13 [CANDIDATE]: Term 1 election: Requested vote from peers 25b7964825a6462295c0606a06169676 (127.6.101.65:34615), 41999337784141c5834094008bf6ba97 (127.6.101.66:35001)
I20260709 14:49:36.280521  6684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc290da245804ddc92d9597c5da52a82" candidate_uuid: "bf2d93774f73406ead205c8ba8c9da13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b7964825a6462295c0606a06169676"
I20260709 14:49:36.281497  6684 raft_consensus.cc:3060] T bc290da245804ddc92d9597c5da52a82 P 25b7964825a6462295c0606a06169676 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:49:36.281951  6758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc290da245804ddc92d9597c5da52a82" candidate_uuid: "bf2d93774f73406ead205c8ba8c9da13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41999337784141c5834094008bf6ba97"
I20260709 14:49:36.281721  6879 raft_consensus.cc:359] T 07255af297cd4ac59277e81984f07f9c P 25b7964825a6462295c0606a06169676 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:36.282729  6879 raft_consensus.cc:385] T 07255af297cd4ac59277e81984f07f9c P 25b7964825a6462295c0606a06169676 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:49:36.282697  6758 raft_consensus.cc:3060] T bc290da245804ddc92d9597c5da52a82 P 41999337784141c5834094008bf6ba97 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:49:36.288015  6877 tablet_bootstrap.cc:654] T 5ce18799382e46108fbcbed2c364321d P bf2d93774f73406ead205c8ba8c9da13: Neither blocks nor log segments found. Creating new log.
I20260709 14:49:36.289834  6878 tablet_bootstrap.cc:492] T 07255af297cd4ac59277e81984f07f9c P 41999337784141c5834094008bf6ba97: No bootstrap required, opened a new log
I20260709 14:49:36.290442  6878 ts_tablet_manager.cc:1403] T 07255af297cd4ac59277e81984f07f9c P 41999337784141c5834094008bf6ba97: Time spent bootstrapping tablet: real 0.059s	user 0.009s	sys 0.006s
I20260709 14:49:36.292076  6879 raft_consensus.cc:740] T 07255af297cd4ac59277e81984f07f9c P 25b7964825a6462295c0606a06169676 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25b7964825a6462295c0606a06169676, State: Initialized, Role: FOLLOWER
I20260709 14:49:36.294152  6879 consensus_queue.cc:260] T 07255af297cd4ac59277e81984f07f9c P 25b7964825a6462295c0606a06169676 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:36.296044  6878 raft_consensus.cc:359] T 07255af297cd4ac59277e81984f07f9c P 41999337784141c5834094008bf6ba97 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:36.297124  6878 raft_consensus.cc:385] T 07255af297cd4ac59277e81984f07f9c P 41999337784141c5834094008bf6ba97 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:49:36.297572  6878 raft_consensus.cc:740] T 07255af297cd4ac59277e81984f07f9c P 41999337784141c5834094008bf6ba97 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41999337784141c5834094008bf6ba97, State: Initialized, Role: FOLLOWER
I20260709 14:49:36.300046  6878 consensus_queue.cc:260] T 07255af297cd4ac59277e81984f07f9c P 41999337784141c5834094008bf6ba97 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:36.301666  6684 raft_consensus.cc:2468] T bc290da245804ddc92d9597c5da52a82 P 25b7964825a6462295c0606a06169676 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf2d93774f73406ead205c8ba8c9da13 in term 1.
I20260709 14:49:36.304986  6878 ts_tablet_manager.cc:1434] T 07255af297cd4ac59277e81984f07f9c P 41999337784141c5834094008bf6ba97: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.004s
I20260709 14:49:36.306509  6796 leader_election.cc:304] T bc290da245804ddc92d9597c5da52a82 P bf2d93774f73406ead205c8ba8c9da13 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b7964825a6462295c0606a06169676, bf2d93774f73406ead205c8ba8c9da13; no voters: 
I20260709 14:49:36.308106  6878 tablet_bootstrap.cc:492] T d58c1f5d4e1c448eab811059e23165cc P 41999337784141c5834094008bf6ba97: Bootstrap starting.
I20260709 14:49:36.309170  6886 raft_consensus.cc:2804] T bc290da245804ddc92d9597c5da52a82 P bf2d93774f73406ead205c8ba8c9da13 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:49:36.311102  6886 raft_consensus.cc:697] T bc290da245804ddc92d9597c5da52a82 P bf2d93774f73406ead205c8ba8c9da13 [term 1 LEADER]: Becoming Leader. State: Replica: bf2d93774f73406ead205c8ba8c9da13, State: Running, Role: LEADER
I20260709 14:49:36.312346  6886 consensus_queue.cc:237] T bc290da245804ddc92d9597c5da52a82 P bf2d93774f73406ead205c8ba8c9da13 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:36.319554  6878 tablet_bootstrap.cc:654] T d58c1f5d4e1c448eab811059e23165cc P 41999337784141c5834094008bf6ba97: Neither blocks nor log segments found. Creating new log.
I20260709 14:49:36.337599  6899 consensus_queue.cc:1048] T c8ac07644f37427e80f77c67ccac9328 P 25b7964825a6462295c0606a06169676 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:49:36.340765  6883 raft_consensus.cc:493] T 07255af297cd4ac59277e81984f07f9c P 41999337784141c5834094008bf6ba97 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:49:36.341508  6883 raft_consensus.cc:515] T 07255af297cd4ac59277e81984f07f9c P 41999337784141c5834094008bf6ba97 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:36.350519  6883 leader_election.cc:290] T 07255af297cd4ac59277e81984f07f9c P 41999337784141c5834094008bf6ba97 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25b7964825a6462295c0606a06169676 (127.6.101.65:34615), bf2d93774f73406ead205c8ba8c9da13 (127.6.101.67:46675)
I20260709 14:49:36.343523  6758 raft_consensus.cc:2468] T bc290da245804ddc92d9597c5da52a82 P 41999337784141c5834094008bf6ba97 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf2d93774f73406ead205c8ba8c9da13 in term 1.
I20260709 14:49:36.349785  6579 catalog_manager.cc:5697] T bc290da245804ddc92d9597c5da52a82 P bf2d93774f73406ead205c8ba8c9da13 reported cstate change: term changed from 0 to 1, leader changed from <none> to bf2d93774f73406ead205c8ba8c9da13 (127.6.101.67). New cstate: current_term: 1 leader_uuid: "bf2d93774f73406ead205c8ba8c9da13" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } health_report { overall_health: HEALTHY } } }
I20260709 14:49:36.358371  6833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07255af297cd4ac59277e81984f07f9c" candidate_uuid: "41999337784141c5834094008bf6ba97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf2d93774f73406ead205c8ba8c9da13" is_pre_election: true
I20260709 14:49:36.358747  6684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07255af297cd4ac59277e81984f07f9c" candidate_uuid: "41999337784141c5834094008bf6ba97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b7964825a6462295c0606a06169676" is_pre_election: true
I20260709 14:49:36.359371  6684 raft_consensus.cc:2468] T 07255af297cd4ac59277e81984f07f9c P 25b7964825a6462295c0606a06169676 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41999337784141c5834094008bf6ba97 in term 0.
I20260709 14:49:36.360492  6886 raft_consensus.cc:493] T d58c1f5d4e1c448eab811059e23165cc P bf2d93774f73406ead205c8ba8c9da13 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:49:36.360373  6725 leader_election.cc:343] T 07255af297cd4ac59277e81984f07f9c P 41999337784141c5834094008bf6ba97 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bf2d93774f73406ead205c8ba8c9da13 (127.6.101.67:46675): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:49:36.361464  6722 leader_election.cc:304] T 07255af297cd4ac59277e81984f07f9c P 41999337784141c5834094008bf6ba97 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b7964825a6462295c0606a06169676, 41999337784141c5834094008bf6ba97; no voters: bf2d93774f73406ead205c8ba8c9da13
I20260709 14:49:36.361141  6886 raft_consensus.cc:515] T d58c1f5d4e1c448eab811059e23165cc P bf2d93774f73406ead205c8ba8c9da13 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } } peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } }
I20260709 14:49:36.362980  6883 raft_consensus.cc:2804] T 07255af297cd4ac59277e81984f07f9c P 41999337784141c5834094008bf6ba97 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:49:36.363399  6883 raft_consensus.cc:493] T 07255af297cd4ac59277e81984f07f9c P 41999337784141c5834094008bf6ba97 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:49:36.363905  6883 raft_consensus.cc:3060] T 07255af297cd4ac59277e81984f07f9c P 41999337784141c5834094008bf6ba97 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:49:36.364862  6758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d58c1f5d4e1c448eab811059e23165cc" candidate_uuid: "bf2d93774f73406ead205c8ba8c9da13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41999337784141c5834094008bf6ba97" is_pre_election: true
I20260709 14:49:36.366673  6879 ts_tablet_manager.cc:1434] T 07255af297cd4ac59277e81984f07f9c P 25b7964825a6462295c0606a06169676: Time spent starting tablet: real 0.089s	user 0.002s	sys 0.009s
I20260709 14:49:36.360296  6877 tablet_bootstrap.cc:492] T 5ce18799382e46108fbcbed2c364321d P bf2d93774f73406ead205c8ba8c9da13: No bootstrap required, opened a new log
W20260709 14:49:36.366460  6797 leader_election.cc:343] T d58c1f5d4e1c448eab811059e23165cc P bf2d93774f73406ead205c8ba8c9da13 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 41999337784141c5834094008bf6ba97 (127.6.101.66:35001): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:49:36.368862  6877 ts_tablet_manager.cc:1403] T 5ce18799382e46108fbcbed2c364321d P bf2d93774f73406ead205c8ba8c9da13: Time spent bootstrapping tablet: real 0.115s	user 0.016s	sys 0.002s
I20260709 14:49:36.370008  6886 leader_election.cc:290] T d58c1f5d4e1c448eab811059e23165cc P bf2d93774f73406ead205c8ba8c9da13 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 41999337784141c5834094008bf6ba97 (127.6.101.66:35001), 25b7964825a6462295c0606a06169676 (127.6.101.65:34615)
I20260709 14:49:36.370678  6684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d58c1f5d4e1c448eab811059e23165cc" candidate_uuid: "bf2d93774f73406ead205c8ba8c9da13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b7964825a6462295c0606a06169676" is_pre_election: true
I20260709 14:49:36.371838  6684 raft_consensus.cc:2468] T d58c1f5d4e1c448eab811059e23165cc P 25b7964825a6462295c0606a06169676 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf2d93774f73406ead205c8ba8c9da13 in term 0.
I20260709 14:49:36.378830  6879 tablet_bootstrap.cc:492] T 82a2d00569854cd990c582b9693829ff P 25b7964825a6462295c0606a06169676: Bootstrap starting.
I20260709 14:49:36.380551  6796 leader_election.cc:304] T d58c1f5d4e1c448eab811059e23165cc P bf2d93774f73406ead205c8ba8c9da13 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b7964825a6462295c0606a06169676, bf2d93774f73406ead205c8ba8c9da13; no voters: 41999337784141c5834094008bf6ba97
I20260709 14:49:36.382756  6886 raft_consensus.cc:2804] T d58c1f5d4e1c448eab811059e23165cc P bf2d93774f73406ead205c8ba8c9da13 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:49:36.383260  6886 raft_consensus.cc:493] T d58c1f5d4e1c448eab811059e23165cc P bf2d93774f73406ead205c8ba8c9da13 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:49:36.383484  6877 raft_consensus.cc:359] T 5ce18799382e46108fbcbed2c364321d P bf2d93774f73406ead205c8ba8c9da13 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:36.384789  6877 raft_consensus.cc:385] T 5ce18799382e46108fbcbed2c364321d P bf2d93774f73406ead205c8ba8c9da13 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:49:36.385619  6877 raft_consensus.cc:740] T 5ce18799382e46108fbcbed2c364321d P bf2d93774f73406ead205c8ba8c9da13 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf2d93774f73406ead205c8ba8c9da13, State: Initialized, Role: FOLLOWER
I20260709 14:49:36.383632  6886 raft_consensus.cc:3060] T d58c1f5d4e1c448eab811059e23165cc P bf2d93774f73406ead205c8ba8c9da13 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:49:36.387758  6883 raft_consensus.cc:515] T 07255af297cd4ac59277e81984f07f9c P 41999337784141c5834094008bf6ba97 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:36.387413  6877 consensus_queue.cc:260] T 5ce18799382e46108fbcbed2c364321d P bf2d93774f73406ead205c8ba8c9da13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:36.391103  6907 raft_consensus.cc:493] T 5ce18799382e46108fbcbed2c364321d P 41999337784141c5834094008bf6ba97 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:49:36.391993  6907 raft_consensus.cc:515] T 5ce18799382e46108fbcbed2c364321d P 41999337784141c5834094008bf6ba97 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:36.402465  6684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07255af297cd4ac59277e81984f07f9c" candidate_uuid: "41999337784141c5834094008bf6ba97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b7964825a6462295c0606a06169676"
I20260709 14:49:36.402900  6832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07255af297cd4ac59277e81984f07f9c" candidate_uuid: "41999337784141c5834094008bf6ba97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf2d93774f73406ead205c8ba8c9da13"
I20260709 14:49:36.403434  6684 raft_consensus.cc:3060] T 07255af297cd4ac59277e81984f07f9c P 25b7964825a6462295c0606a06169676 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:49:36.404759  6879 tablet_bootstrap.cc:654] T 82a2d00569854cd990c582b9693829ff P 25b7964825a6462295c0606a06169676: Neither blocks nor log segments found. Creating new log.
W20260709 14:49:36.405519  6725 leader_election.cc:343] T 07255af297cd4ac59277e81984f07f9c P 41999337784141c5834094008bf6ba97 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bf2d93774f73406ead205c8ba8c9da13 (127.6.101.67:46675): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:49:36.402786  6907 leader_election.cc:290] T 5ce18799382e46108fbcbed2c364321d P 41999337784141c5834094008bf6ba97 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25b7964825a6462295c0606a06169676 (127.6.101.65:34615), bf2d93774f73406ead205c8ba8c9da13 (127.6.101.67:46675)
I20260709 14:49:36.409333  6877 ts_tablet_manager.cc:1434] T 5ce18799382e46108fbcbed2c364321d P bf2d93774f73406ead205c8ba8c9da13: Time spent starting tablet: real 0.039s	user 0.006s	sys 0.005s
I20260709 14:49:36.409957  6832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce18799382e46108fbcbed2c364321d" candidate_uuid: "41999337784141c5834094008bf6ba97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf2d93774f73406ead205c8ba8c9da13" is_pre_election: true
I20260709 14:49:36.410830  6877 tablet_bootstrap.cc:492] T 07255af297cd4ac59277e81984f07f9c P bf2d93774f73406ead205c8ba8c9da13: Bootstrap starting.
I20260709 14:49:36.410755  6832 raft_consensus.cc:2468] T 5ce18799382e46108fbcbed2c364321d P bf2d93774f73406ead205c8ba8c9da13 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41999337784141c5834094008bf6ba97 in term 0.
I20260709 14:49:36.412779  6725 leader_election.cc:304] T 5ce18799382e46108fbcbed2c364321d P 41999337784141c5834094008bf6ba97 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41999337784141c5834094008bf6ba97, bf2d93774f73406ead205c8ba8c9da13; no voters: 
I20260709 14:49:36.414625  6907 raft_consensus.cc:2804] T 5ce18799382e46108fbcbed2c364321d P 41999337784141c5834094008bf6ba97 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:49:36.415163  6907 raft_consensus.cc:493] T 5ce18799382e46108fbcbed2c364321d P 41999337784141c5834094008bf6ba97 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:49:36.417552  6907 raft_consensus.cc:3060] T 5ce18799382e46108fbcbed2c364321d P 41999337784141c5834094008bf6ba97 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:49:36.415213  6886 raft_consensus.cc:515] T d58c1f5d4e1c448eab811059e23165cc P bf2d93774f73406ead205c8ba8c9da13 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } } peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } }
I20260709 14:49:36.424268  6886 leader_election.cc:290] T d58c1f5d4e1c448eab811059e23165cc P bf2d93774f73406ead205c8ba8c9da13 [CANDIDATE]: Term 1 election: Requested vote from peers 41999337784141c5834094008bf6ba97 (127.6.101.66:35001), 25b7964825a6462295c0606a06169676 (127.6.101.65:34615)
I20260709 14:49:36.418321  6883 leader_election.cc:290] T 07255af297cd4ac59277e81984f07f9c P 41999337784141c5834094008bf6ba97 [CANDIDATE]: Term 1 election: Requested vote from peers 25b7964825a6462295c0606a06169676 (127.6.101.65:34615), bf2d93774f73406ead205c8ba8c9da13 (127.6.101.67:46675)
I20260709 14:49:36.425838  6684 raft_consensus.cc:2468] T 07255af297cd4ac59277e81984f07f9c P 25b7964825a6462295c0606a06169676 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41999337784141c5834094008bf6ba97 in term 1.
I20260709 14:49:36.425979  6683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d58c1f5d4e1c448eab811059e23165cc" candidate_uuid: "bf2d93774f73406ead205c8ba8c9da13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b7964825a6462295c0606a06169676"
I20260709 14:49:36.428066  6878 tablet_bootstrap.cc:492] T d58c1f5d4e1c448eab811059e23165cc P 41999337784141c5834094008bf6ba97: No bootstrap required, opened a new log
I20260709 14:49:36.430502  6878 ts_tablet_manager.cc:1403] T d58c1f5d4e1c448eab811059e23165cc P 41999337784141c5834094008bf6ba97: Time spent bootstrapping tablet: real 0.123s	user 0.019s	sys 0.025s
I20260709 14:49:36.431397  6683 raft_consensus.cc:3060] T d58c1f5d4e1c448eab811059e23165cc P 25b7964825a6462295c0606a06169676 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:49:36.434655  6758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d58c1f5d4e1c448eab811059e23165cc" candidate_uuid: "bf2d93774f73406ead205c8ba8c9da13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41999337784141c5834094008bf6ba97"
I20260709 14:49:36.435896  6684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce18799382e46108fbcbed2c364321d" candidate_uuid: "41999337784141c5834094008bf6ba97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b7964825a6462295c0606a06169676" is_pre_election: true
I20260709 14:49:36.434538  6722 leader_election.cc:304] T 07255af297cd4ac59277e81984f07f9c P 41999337784141c5834094008bf6ba97 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b7964825a6462295c0606a06169676, 41999337784141c5834094008bf6ba97; no voters: bf2d93774f73406ead205c8ba8c9da13
I20260709 14:49:36.436930  6684 raft_consensus.cc:2468] T 5ce18799382e46108fbcbed2c364321d P 25b7964825a6462295c0606a06169676 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41999337784141c5834094008bf6ba97 in term 0.
I20260709 14:49:36.451998  6934 raft_consensus.cc:2804] T 07255af297cd4ac59277e81984f07f9c P 41999337784141c5834094008bf6ba97 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:49:36.452641  6934 raft_consensus.cc:697] T 07255af297cd4ac59277e81984f07f9c P 41999337784141c5834094008bf6ba97 [term 1 LEADER]: Becoming Leader. State: Replica: 41999337784141c5834094008bf6ba97, State: Running, Role: LEADER
I20260709 14:49:36.453765  6934 consensus_queue.cc:237] T 07255af297cd4ac59277e81984f07f9c P 41999337784141c5834094008bf6ba97 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:36.456539  6883 consensus_queue.cc:1048] T 82a2d00569854cd990c582b9693829ff P 41999337784141c5834094008bf6ba97 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:49:36.466938  6878 raft_consensus.cc:359] T d58c1f5d4e1c448eab811059e23165cc P 41999337784141c5834094008bf6ba97 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } } peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } }
I20260709 14:49:36.468225  6878 raft_consensus.cc:385] T d58c1f5d4e1c448eab811059e23165cc P 41999337784141c5834094008bf6ba97 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:49:36.468859  6878 raft_consensus.cc:740] T d58c1f5d4e1c448eab811059e23165cc P 41999337784141c5834094008bf6ba97 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41999337784141c5834094008bf6ba97, State: Initialized, Role: FOLLOWER
I20260709 14:49:36.476379  6878 consensus_queue.cc:260] T d58c1f5d4e1c448eab811059e23165cc P 41999337784141c5834094008bf6ba97 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } } peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } }
W20260709 14:49:36.478319  6797 leader_election.cc:343] T d58c1f5d4e1c448eab811059e23165cc P bf2d93774f73406ead205c8ba8c9da13 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 41999337784141c5834094008bf6ba97 (127.6.101.66:35001): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:49:36.479141  6878 ts_tablet_manager.cc:1434] T d58c1f5d4e1c448eab811059e23165cc P 41999337784141c5834094008bf6ba97: Time spent starting tablet: real 0.048s	user 0.009s	sys 0.004s
I20260709 14:49:36.480475  6907 raft_consensus.cc:515] T 5ce18799382e46108fbcbed2c364321d P 41999337784141c5834094008bf6ba97 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:36.481017  6878 tablet_bootstrap.cc:492] T be9352545ba44d68a3704b39c623e774 P 41999337784141c5834094008bf6ba97: Bootstrap starting.
I20260709 14:49:36.483433  6683 raft_consensus.cc:2468] T d58c1f5d4e1c448eab811059e23165cc P 25b7964825a6462295c0606a06169676 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf2d93774f73406ead205c8ba8c9da13 in term 1.
I20260709 14:49:36.485049  6796 leader_election.cc:304] T d58c1f5d4e1c448eab811059e23165cc P bf2d93774f73406ead205c8ba8c9da13 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b7964825a6462295c0606a06169676, bf2d93774f73406ead205c8ba8c9da13; no voters: 41999337784141c5834094008bf6ba97
I20260709 14:49:36.485320  6907 leader_election.cc:290] T 5ce18799382e46108fbcbed2c364321d P 41999337784141c5834094008bf6ba97 [CANDIDATE]: Term 1 election: Requested vote from peers 25b7964825a6462295c0606a06169676 (127.6.101.65:34615), bf2d93774f73406ead205c8ba8c9da13 (127.6.101.67:46675)
I20260709 14:49:36.486701  6886 raft_consensus.cc:2804] T d58c1f5d4e1c448eab811059e23165cc P bf2d93774f73406ead205c8ba8c9da13 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:49:36.487272  6886 raft_consensus.cc:697] T d58c1f5d4e1c448eab811059e23165cc P bf2d93774f73406ead205c8ba8c9da13 [term 1 LEADER]: Becoming Leader. State: Replica: bf2d93774f73406ead205c8ba8c9da13, State: Running, Role: LEADER
I20260709 14:49:36.488209  6886 consensus_queue.cc:237] T d58c1f5d4e1c448eab811059e23165cc P bf2d93774f73406ead205c8ba8c9da13 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } } peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } }
I20260709 14:49:36.492439  6833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce18799382e46108fbcbed2c364321d" candidate_uuid: "41999337784141c5834094008bf6ba97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf2d93774f73406ead205c8ba8c9da13"
I20260709 14:49:36.493289  6833 raft_consensus.cc:3060] T 5ce18799382e46108fbcbed2c364321d P bf2d93774f73406ead205c8ba8c9da13 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:49:36.498752  6907 raft_consensus.cc:493] T 3d8096f833ea45ce9471c56d3ce1a68b P 41999337784141c5834094008bf6ba97 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:49:36.500000  6907 raft_consensus.cc:515] T 3d8096f833ea45ce9471c56d3ce1a68b P 41999337784141c5834094008bf6ba97 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
W20260709 14:49:36.501905  6722 consensus_peers.cc:597] T 82a2d00569854cd990c582b9693829ff P 41999337784141c5834094008bf6ba97 -> Peer 25b7964825a6462295c0606a06169676 (127.6.101.65:34615): Couldn't send request to peer 25b7964825a6462295c0606a06169676. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:49:36.506420  6833 raft_consensus.cc:2468] T 5ce18799382e46108fbcbed2c364321d P bf2d93774f73406ead205c8ba8c9da13 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41999337784141c5834094008bf6ba97 in term 1.
I20260709 14:49:36.508303  6725 leader_election.cc:304] T 5ce18799382e46108fbcbed2c364321d P 41999337784141c5834094008bf6ba97 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41999337784141c5834094008bf6ba97, bf2d93774f73406ead205c8ba8c9da13; no voters: 
I20260709 14:49:36.526837  6935 raft_consensus.cc:2804] T 5ce18799382e46108fbcbed2c364321d P 41999337784141c5834094008bf6ba97 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:49:36.535274  6877 tablet_bootstrap.cc:654] T 07255af297cd4ac59277e81984f07f9c P bf2d93774f73406ead205c8ba8c9da13: Neither blocks nor log segments found. Creating new log.
I20260709 14:49:36.528370  6935 raft_consensus.cc:697] T 5ce18799382e46108fbcbed2c364321d P 41999337784141c5834094008bf6ba97 [term 1 LEADER]: Becoming Leader. State: Replica: 41999337784141c5834094008bf6ba97, State: Running, Role: LEADER
I20260709 14:49:36.533620  6907 leader_election.cc:290] T 3d8096f833ea45ce9471c56d3ce1a68b P 41999337784141c5834094008bf6ba97 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25b7964825a6462295c0606a06169676 (127.6.101.65:34615), bf2d93774f73406ead205c8ba8c9da13 (127.6.101.67:46675)
I20260709 14:49:36.538517  6935 consensus_queue.cc:237] T 5ce18799382e46108fbcbed2c364321d P 41999337784141c5834094008bf6ba97 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:36.541375  6879 tablet_bootstrap.cc:492] T 82a2d00569854cd990c582b9693829ff P 25b7964825a6462295c0606a06169676: No bootstrap required, opened a new log
I20260709 14:49:36.542167  6879 ts_tablet_manager.cc:1403] T 82a2d00569854cd990c582b9693829ff P 25b7964825a6462295c0606a06169676: Time spent bootstrapping tablet: real 0.164s	user 0.018s	sys 0.004s
I20260709 14:49:36.543484  6683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce18799382e46108fbcbed2c364321d" candidate_uuid: "41999337784141c5834094008bf6ba97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b7964825a6462295c0606a06169676"
I20260709 14:49:36.544392  6683 raft_consensus.cc:3060] T 5ce18799382e46108fbcbed2c364321d P 25b7964825a6462295c0606a06169676 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:49:36.545822  6684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d8096f833ea45ce9471c56d3ce1a68b" candidate_uuid: "41999337784141c5834094008bf6ba97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b7964825a6462295c0606a06169676" is_pre_election: true
I20260709 14:49:36.546202  6833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d8096f833ea45ce9471c56d3ce1a68b" candidate_uuid: "41999337784141c5834094008bf6ba97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf2d93774f73406ead205c8ba8c9da13" is_pre_election: true
I20260709 14:49:36.552188  6879 raft_consensus.cc:359] T 82a2d00569854cd990c582b9693829ff P 25b7964825a6462295c0606a06169676 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:36.553165  6879 raft_consensus.cc:385] T 82a2d00569854cd990c582b9693829ff P 25b7964825a6462295c0606a06169676 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:49:36.553544  6879 raft_consensus.cc:740] T 82a2d00569854cd990c582b9693829ff P 25b7964825a6462295c0606a06169676 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25b7964825a6462295c0606a06169676, State: Initialized, Role: FOLLOWER
I20260709 14:49:36.554452  6879 consensus_queue.cc:260] T 82a2d00569854cd990c582b9693829ff P 25b7964825a6462295c0606a06169676 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:36.557996  6879 ts_tablet_manager.cc:1434] T 82a2d00569854cd990c582b9693829ff P 25b7964825a6462295c0606a06169676: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.001s
I20260709 14:49:36.559381  6879 tablet_bootstrap.cc:492] T be9352545ba44d68a3704b39c623e774 P 25b7964825a6462295c0606a06169676: Bootstrap starting.
I20260709 14:49:36.557627  6684 raft_consensus.cc:2393] T 3d8096f833ea45ce9471c56d3ce1a68b P 25b7964825a6462295c0606a06169676 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 41999337784141c5834094008bf6ba97 in current term 1: Already voted for candidate bf2d93774f73406ead205c8ba8c9da13 in this term.
I20260709 14:49:36.569909  6722 leader_election.cc:304] T 3d8096f833ea45ce9471c56d3ce1a68b P 41999337784141c5834094008bf6ba97 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41999337784141c5834094008bf6ba97; no voters: 25b7964825a6462295c0606a06169676, bf2d93774f73406ead205c8ba8c9da13
I20260709 14:49:36.571170  6907 raft_consensus.cc:3060] T 3d8096f833ea45ce9471c56d3ce1a68b P 41999337784141c5834094008bf6ba97 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:49:36.580739  6915 consensus_queue.cc:1048] T 1dbff5d6a7234db3a8f367fe9b30d615 P bf2d93774f73406ead205c8ba8c9da13 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:49:36.585224  6683 raft_consensus.cc:2468] T 5ce18799382e46108fbcbed2c364321d P 25b7964825a6462295c0606a06169676 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41999337784141c5834094008bf6ba97 in term 1.
I20260709 14:49:36.596246  6907 raft_consensus.cc:2749] T 3d8096f833ea45ce9471c56d3ce1a68b P 41999337784141c5834094008bf6ba97 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:49:36.600162  6878 tablet_bootstrap.cc:654] T be9352545ba44d68a3704b39c623e774 P 41999337784141c5834094008bf6ba97: Neither blocks nor log segments found. Creating new log.
I20260709 14:49:36.607436  6877 tablet_bootstrap.cc:492] T 07255af297cd4ac59277e81984f07f9c P bf2d93774f73406ead205c8ba8c9da13: No bootstrap required, opened a new log
I20260709 14:49:36.603063  6578 catalog_manager.cc:5697] T d58c1f5d4e1c448eab811059e23165cc P bf2d93774f73406ead205c8ba8c9da13 reported cstate change: term changed from 0 to 1, leader changed from <none> to bf2d93774f73406ead205c8ba8c9da13 (127.6.101.67). New cstate: current_term: 1 leader_uuid: "bf2d93774f73406ead205c8ba8c9da13" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } health_report { overall_health: UNKNOWN } } }
I20260709 14:49:36.609046  6877 ts_tablet_manager.cc:1403] T 07255af297cd4ac59277e81984f07f9c P bf2d93774f73406ead205c8ba8c9da13: Time spent bootstrapping tablet: real 0.198s	user 0.031s	sys 0.017s
I20260709 14:49:36.614195  6879 tablet_bootstrap.cc:654] T be9352545ba44d68a3704b39c623e774 P 25b7964825a6462295c0606a06169676: Neither blocks nor log segments found. Creating new log.
I20260709 14:49:36.623857  6877 raft_consensus.cc:359] T 07255af297cd4ac59277e81984f07f9c P bf2d93774f73406ead205c8ba8c9da13 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:36.624879  6877 raft_consensus.cc:385] T 07255af297cd4ac59277e81984f07f9c P bf2d93774f73406ead205c8ba8c9da13 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:49:36.625219  6877 raft_consensus.cc:740] T 07255af297cd4ac59277e81984f07f9c P bf2d93774f73406ead205c8ba8c9da13 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf2d93774f73406ead205c8ba8c9da13, State: Initialized, Role: FOLLOWER
I20260709 14:49:36.626368  6877 consensus_queue.cc:260] T 07255af297cd4ac59277e81984f07f9c P bf2d93774f73406ead205c8ba8c9da13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:36.678133  6915 consensus_queue.cc:1048] T 3d8096f833ea45ce9471c56d3ce1a68b P bf2d93774f73406ead205c8ba8c9da13 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 14:49:36.680127  6797 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:35001, user_credentials={real_user=slave}} blocked reactor thread for 51295.7us
I20260709 14:49:36.686955  6915 consensus_queue.cc:1048] T 3d8096f833ea45ce9471c56d3ce1a68b P bf2d93774f73406ead205c8ba8c9da13 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:49:36.693012  6884 raft_consensus.cc:493] T 82a2d00569854cd990c582b9693829ff P 25b7964825a6462295c0606a06169676 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:49:36.693794  6884 raft_consensus.cc:515] T 82a2d00569854cd990c582b9693829ff P 25b7964825a6462295c0606a06169676 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:36.695958  6878 tablet_bootstrap.cc:492] T be9352545ba44d68a3704b39c623e774 P 41999337784141c5834094008bf6ba97: No bootstrap required, opened a new log
I20260709 14:49:36.696702  6878 ts_tablet_manager.cc:1403] T be9352545ba44d68a3704b39c623e774 P 41999337784141c5834094008bf6ba97: Time spent bootstrapping tablet: real 0.216s	user 0.012s	sys 0.022s
I20260709 14:49:36.697872  6877 ts_tablet_manager.cc:1434] T 07255af297cd4ac59277e81984f07f9c P bf2d93774f73406ead205c8ba8c9da13: Time spent starting tablet: real 0.087s	user 0.008s	sys 0.004s
I20260709 14:49:36.699260  6877 tablet_bootstrap.cc:492] T be9352545ba44d68a3704b39c623e774 P bf2d93774f73406ead205c8ba8c9da13: Bootstrap starting.
I20260709 14:49:36.707644  6759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a2d00569854cd990c582b9693829ff" candidate_uuid: "25b7964825a6462295c0606a06169676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41999337784141c5834094008bf6ba97" is_pre_election: true
I20260709 14:49:36.709218  6884 leader_election.cc:290] T 82a2d00569854cd990c582b9693829ff P 25b7964825a6462295c0606a06169676 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 41999337784141c5834094008bf6ba97 (127.6.101.66:35001), bf2d93774f73406ead205c8ba8c9da13 (127.6.101.67:46675)
I20260709 14:49:36.713016  6832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a2d00569854cd990c582b9693829ff" candidate_uuid: "25b7964825a6462295c0606a06169676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf2d93774f73406ead205c8ba8c9da13" is_pre_election: true
I20260709 14:49:36.716022  6878 raft_consensus.cc:359] T be9352545ba44d68a3704b39c623e774 P 41999337784141c5834094008bf6ba97 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:36.717005  6878 raft_consensus.cc:385] T be9352545ba44d68a3704b39c623e774 P 41999337784141c5834094008bf6ba97 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:49:36.717582  6878 raft_consensus.cc:740] T be9352545ba44d68a3704b39c623e774 P 41999337784141c5834094008bf6ba97 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41999337784141c5834094008bf6ba97, State: Initialized, Role: FOLLOWER
I20260709 14:49:36.713975  6579 catalog_manager.cc:5697] T 07255af297cd4ac59277e81984f07f9c P 41999337784141c5834094008bf6ba97 reported cstate change: term changed from 0 to 1, leader changed from <none> to 41999337784141c5834094008bf6ba97 (127.6.101.66). New cstate: current_term: 1 leader_uuid: "41999337784141c5834094008bf6ba97" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } health_report { overall_health: UNKNOWN } } }
I20260709 14:49:36.719689  6878 consensus_queue.cc:260] T be9352545ba44d68a3704b39c623e774 P 41999337784141c5834094008bf6ba97 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:36.724298  6879 tablet_bootstrap.cc:492] T be9352545ba44d68a3704b39c623e774 P 25b7964825a6462295c0606a06169676: No bootstrap required, opened a new log
I20260709 14:49:36.722604  6579 catalog_manager.cc:5697] T 5ce18799382e46108fbcbed2c364321d P 41999337784141c5834094008bf6ba97 reported cstate change: term changed from 0 to 1, leader changed from <none> to 41999337784141c5834094008bf6ba97 (127.6.101.66). New cstate: current_term: 1 leader_uuid: "41999337784141c5834094008bf6ba97" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } health_report { overall_health: UNKNOWN } } }
I20260709 14:49:36.726966  6879 ts_tablet_manager.cc:1403] T be9352545ba44d68a3704b39c623e774 P 25b7964825a6462295c0606a06169676: Time spent bootstrapping tablet: real 0.168s	user 0.041s	sys 0.032s
I20260709 14:49:36.727322  6877 tablet_bootstrap.cc:654] T be9352545ba44d68a3704b39c623e774 P bf2d93774f73406ead205c8ba8c9da13: Neither blocks nor log segments found. Creating new log.
I20260709 14:49:36.728322  6946 consensus_queue.cc:1048] T 1dbff5d6a7234db3a8f367fe9b30d615 P bf2d93774f73406ead205c8ba8c9da13 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:49:36.729053  6878 ts_tablet_manager.cc:1434] T be9352545ba44d68a3704b39c623e774 P 41999337784141c5834094008bf6ba97: Time spent starting tablet: real 0.032s	user 0.010s	sys 0.001s
I20260709 14:49:36.754992  6935 raft_consensus.cc:493] T d58c1f5d4e1c448eab811059e23165cc P 41999337784141c5834094008bf6ba97 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:49:36.755788  6935 raft_consensus.cc:515] T d58c1f5d4e1c448eab811059e23165cc P 41999337784141c5834094008bf6ba97 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } } peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } }
I20260709 14:49:36.760458  6935 leader_election.cc:290] T d58c1f5d4e1c448eab811059e23165cc P 41999337784141c5834094008bf6ba97 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bf2d93774f73406ead205c8ba8c9da13 (127.6.101.67:46675), 25b7964825a6462295c0606a06169676 (127.6.101.65:34615)
I20260709 14:49:36.761701  6832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d58c1f5d4e1c448eab811059e23165cc" candidate_uuid: "41999337784141c5834094008bf6ba97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf2d93774f73406ead205c8ba8c9da13" is_pre_election: true
I20260709 14:49:36.762265  6650 leader_election.cc:304] T 82a2d00569854cd990c582b9693829ff P 25b7964825a6462295c0606a06169676 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b7964825a6462295c0606a06169676; no voters: 41999337784141c5834094008bf6ba97, bf2d93774f73406ead205c8ba8c9da13
I20260709 14:49:36.763531  6884 raft_consensus.cc:2749] T 82a2d00569854cd990c582b9693829ff P 25b7964825a6462295c0606a06169676 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:49:36.760444  6879 raft_consensus.cc:359] T be9352545ba44d68a3704b39c623e774 P 25b7964825a6462295c0606a06169676 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:36.765969  6879 raft_consensus.cc:385] T be9352545ba44d68a3704b39c623e774 P 25b7964825a6462295c0606a06169676 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:49:36.766194  6682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d58c1f5d4e1c448eab811059e23165cc" candidate_uuid: "41999337784141c5834094008bf6ba97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b7964825a6462295c0606a06169676" is_pre_election: true
I20260709 14:49:36.766352  6879 raft_consensus.cc:740] T be9352545ba44d68a3704b39c623e774 P 25b7964825a6462295c0606a06169676 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25b7964825a6462295c0606a06169676, State: Initialized, Role: FOLLOWER
I20260709 14:49:36.767450  6682 raft_consensus.cc:2393] T d58c1f5d4e1c448eab811059e23165cc P 25b7964825a6462295c0606a06169676 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 41999337784141c5834094008bf6ba97 in current term 1: Already voted for candidate bf2d93774f73406ead205c8ba8c9da13 in this term.
I20260709 14:49:36.768088  6879 consensus_queue.cc:260] T be9352545ba44d68a3704b39c623e774 P 25b7964825a6462295c0606a06169676 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:36.772792  6879 ts_tablet_manager.cc:1434] T be9352545ba44d68a3704b39c623e774 P 25b7964825a6462295c0606a06169676: Time spent starting tablet: real 0.045s	user 0.008s	sys 0.007s
I20260709 14:49:36.783017  6722 leader_election.cc:304] T d58c1f5d4e1c448eab811059e23165cc P 41999337784141c5834094008bf6ba97 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41999337784141c5834094008bf6ba97; no voters: 25b7964825a6462295c0606a06169676, bf2d93774f73406ead205c8ba8c9da13
I20260709 14:49:36.784026  6946 consensus_queue.cc:1048] T bc290da245804ddc92d9597c5da52a82 P bf2d93774f73406ead205c8ba8c9da13 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:49:36.792867  6935 raft_consensus.cc:3060] T d58c1f5d4e1c448eab811059e23165cc P 41999337784141c5834094008bf6ba97 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:49:36.793620  6915 consensus_queue.cc:1048] T bc290da245804ddc92d9597c5da52a82 P bf2d93774f73406ead205c8ba8c9da13 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:49:36.802819  6877 tablet_bootstrap.cc:492] T be9352545ba44d68a3704b39c623e774 P bf2d93774f73406ead205c8ba8c9da13: No bootstrap required, opened a new log
I20260709 14:49:36.803635  6877 ts_tablet_manager.cc:1403] T be9352545ba44d68a3704b39c623e774 P bf2d93774f73406ead205c8ba8c9da13: Time spent bootstrapping tablet: real 0.105s	user 0.034s	sys 0.004s
I20260709 14:49:36.811010  6907 raft_consensus.cc:493] T be9352545ba44d68a3704b39c623e774 P 41999337784141c5834094008bf6ba97 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:49:36.813271  6907 raft_consensus.cc:515] T be9352545ba44d68a3704b39c623e774 P 41999337784141c5834094008bf6ba97 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
W20260709 14:49:36.814677  6629 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 14:49:36.804097  6935 raft_consensus.cc:2749] T d58c1f5d4e1c448eab811059e23165cc P 41999337784141c5834094008bf6ba97 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:49:36.820751  6884 raft_consensus.cc:493] T be9352545ba44d68a3704b39c623e774 P 25b7964825a6462295c0606a06169676 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:49:36.821480  6884 raft_consensus.cc:515] T be9352545ba44d68a3704b39c623e774 P 25b7964825a6462295c0606a06169676 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:36.824285  6884 leader_election.cc:290] T be9352545ba44d68a3704b39c623e774 P 25b7964825a6462295c0606a06169676 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 41999337784141c5834094008bf6ba97 (127.6.101.66:35001), bf2d93774f73406ead205c8ba8c9da13 (127.6.101.67:46675)
I20260709 14:49:36.827082  6832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9352545ba44d68a3704b39c623e774" candidate_uuid: "41999337784141c5834094008bf6ba97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf2d93774f73406ead205c8ba8c9da13" is_pre_election: true
I20260709 14:49:36.824321  6907 leader_election.cc:290] T be9352545ba44d68a3704b39c623e774 P 41999337784141c5834094008bf6ba97 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25b7964825a6462295c0606a06169676 (127.6.101.65:34615), bf2d93774f73406ead205c8ba8c9da13 (127.6.101.67:46675)
I20260709 14:49:36.830200  6833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9352545ba44d68a3704b39c623e774" candidate_uuid: "25b7964825a6462295c0606a06169676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf2d93774f73406ead205c8ba8c9da13" is_pre_election: true
W20260709 14:49:36.835642  6650 leader_election.cc:343] T be9352545ba44d68a3704b39c623e774 P 25b7964825a6462295c0606a06169676 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bf2d93774f73406ead205c8ba8c9da13 (127.6.101.67:46675): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:49:36.832573  6682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9352545ba44d68a3704b39c623e774" candidate_uuid: "41999337784141c5834094008bf6ba97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b7964825a6462295c0606a06169676" is_pre_election: true
I20260709 14:49:36.836556  6682 raft_consensus.cc:2468] T be9352545ba44d68a3704b39c623e774 P 25b7964825a6462295c0606a06169676 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41999337784141c5834094008bf6ba97 in term 0.
W20260709 14:49:36.836747  6725 leader_election.cc:343] T be9352545ba44d68a3704b39c623e774 P 41999337784141c5834094008bf6ba97 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bf2d93774f73406ead205c8ba8c9da13 (127.6.101.67:46675): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:49:36.836481  6758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9352545ba44d68a3704b39c623e774" candidate_uuid: "25b7964825a6462295c0606a06169676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41999337784141c5834094008bf6ba97" is_pre_election: true
I20260709 14:49:36.838371  6758 raft_consensus.cc:2468] T be9352545ba44d68a3704b39c623e774 P 41999337784141c5834094008bf6ba97 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b7964825a6462295c0606a06169676 in term 0.
I20260709 14:49:36.839316  6877 raft_consensus.cc:359] T be9352545ba44d68a3704b39c623e774 P bf2d93774f73406ead205c8ba8c9da13 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:36.840193  6877 raft_consensus.cc:385] T be9352545ba44d68a3704b39c623e774 P bf2d93774f73406ead205c8ba8c9da13 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:49:36.840845  6877 raft_consensus.cc:740] T be9352545ba44d68a3704b39c623e774 P bf2d93774f73406ead205c8ba8c9da13 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf2d93774f73406ead205c8ba8c9da13, State: Initialized, Role: FOLLOWER
I20260709 14:49:36.839058  6722 leader_election.cc:304] T be9352545ba44d68a3704b39c623e774 P 41999337784141c5834094008bf6ba97 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b7964825a6462295c0606a06169676, 41999337784141c5834094008bf6ba97; no voters: bf2d93774f73406ead205c8ba8c9da13
I20260709 14:49:36.842007  6648 leader_election.cc:304] T be9352545ba44d68a3704b39c623e774 P 25b7964825a6462295c0606a06169676 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b7964825a6462295c0606a06169676, 41999337784141c5834094008bf6ba97; no voters: bf2d93774f73406ead205c8ba8c9da13
I20260709 14:49:36.843304  6884 raft_consensus.cc:2804] T be9352545ba44d68a3704b39c623e774 P 25b7964825a6462295c0606a06169676 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:49:36.843714  6884 raft_consensus.cc:493] T be9352545ba44d68a3704b39c623e774 P 25b7964825a6462295c0606a06169676 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:49:36.843954  6877 consensus_queue.cc:260] T be9352545ba44d68a3704b39c623e774 P bf2d93774f73406ead205c8ba8c9da13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:36.843304  6907 raft_consensus.cc:2804] T be9352545ba44d68a3704b39c623e774 P 41999337784141c5834094008bf6ba97 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:49:36.844121  6884 raft_consensus.cc:3060] T be9352545ba44d68a3704b39c623e774 P 25b7964825a6462295c0606a06169676 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:49:36.848795  6907 raft_consensus.cc:493] T be9352545ba44d68a3704b39c623e774 P 41999337784141c5834094008bf6ba97 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:49:36.853885  6907 raft_consensus.cc:3060] T be9352545ba44d68a3704b39c623e774 P 41999337784141c5834094008bf6ba97 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:49:36.855785  6877 ts_tablet_manager.cc:1434] T be9352545ba44d68a3704b39c623e774 P bf2d93774f73406ead205c8ba8c9da13: Time spent starting tablet: real 0.052s	user 0.006s	sys 0.003s
I20260709 14:49:36.896206  6907 raft_consensus.cc:515] T be9352545ba44d68a3704b39c623e774 P 41999337784141c5834094008bf6ba97 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:36.900579  6683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9352545ba44d68a3704b39c623e774" candidate_uuid: "41999337784141c5834094008bf6ba97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b7964825a6462295c0606a06169676"
I20260709 14:49:36.901548  6884 raft_consensus.cc:515] T be9352545ba44d68a3704b39c623e774 P 25b7964825a6462295c0606a06169676 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:36.904616  6832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9352545ba44d68a3704b39c623e774" candidate_uuid: "41999337784141c5834094008bf6ba97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf2d93774f73406ead205c8ba8c9da13"
I20260709 14:49:36.905483  6832 raft_consensus.cc:3060] T be9352545ba44d68a3704b39c623e774 P bf2d93774f73406ead205c8ba8c9da13 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:49:36.903322  6907 leader_election.cc:290] T be9352545ba44d68a3704b39c623e774 P 41999337784141c5834094008bf6ba97 [CANDIDATE]: Term 1 election: Requested vote from peers 25b7964825a6462295c0606a06169676 (127.6.101.65:34615), bf2d93774f73406ead205c8ba8c9da13 (127.6.101.67:46675)
I20260709 14:49:36.911772  6683 raft_consensus.cc:2393] T be9352545ba44d68a3704b39c623e774 P 25b7964825a6462295c0606a06169676 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 41999337784141c5834094008bf6ba97 in current term 1: Already voted for candidate 25b7964825a6462295c0606a06169676 in this term.
I20260709 14:49:36.915056  6832 raft_consensus.cc:2468] T be9352545ba44d68a3704b39c623e774 P bf2d93774f73406ead205c8ba8c9da13 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41999337784141c5834094008bf6ba97 in term 1.
I20260709 14:49:36.917464  6725 leader_election.cc:304] T be9352545ba44d68a3704b39c623e774 P 41999337784141c5834094008bf6ba97 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 41999337784141c5834094008bf6ba97, bf2d93774f73406ead205c8ba8c9da13; no voters: 25b7964825a6462295c0606a06169676
I20260709 14:49:36.920476  6884 leader_election.cc:290] T be9352545ba44d68a3704b39c623e774 P 25b7964825a6462295c0606a06169676 [CANDIDATE]: Term 1 election: Requested vote from peers 41999337784141c5834094008bf6ba97 (127.6.101.66:35001), bf2d93774f73406ead205c8ba8c9da13 (127.6.101.67:46675)
I20260709 14:49:36.923810  6833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9352545ba44d68a3704b39c623e774" candidate_uuid: "25b7964825a6462295c0606a06169676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf2d93774f73406ead205c8ba8c9da13"
I20260709 14:49:36.924719  6833 raft_consensus.cc:2393] T be9352545ba44d68a3704b39c623e774 P bf2d93774f73406ead205c8ba8c9da13 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b7964825a6462295c0606a06169676 in current term 1: Already voted for candidate 41999337784141c5834094008bf6ba97 in this term.
I20260709 14:49:36.925277  6907 raft_consensus.cc:2804] T be9352545ba44d68a3704b39c623e774 P 41999337784141c5834094008bf6ba97 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:49:36.926165  6907 raft_consensus.cc:697] T be9352545ba44d68a3704b39c623e774 P 41999337784141c5834094008bf6ba97 [term 1 LEADER]: Becoming Leader. State: Replica: 41999337784141c5834094008bf6ba97, State: Running, Role: LEADER
I20260709 14:49:36.927376  6907 consensus_queue.cc:237] T be9352545ba44d68a3704b39c623e774 P 41999337784141c5834094008bf6ba97 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:36.930138  6757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9352545ba44d68a3704b39c623e774" candidate_uuid: "25b7964825a6462295c0606a06169676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41999337784141c5834094008bf6ba97"
I20260709 14:49:36.932199  6648 leader_election.cc:304] T be9352545ba44d68a3704b39c623e774 P 25b7964825a6462295c0606a06169676 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b7964825a6462295c0606a06169676; no voters: 41999337784141c5834094008bf6ba97, bf2d93774f73406ead205c8ba8c9da13
I20260709 14:49:36.934016  6884 raft_consensus.cc:2749] T be9352545ba44d68a3704b39c623e774 P 25b7964825a6462295c0606a06169676 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 14:49:36.949321  6907 consensus_queue.cc:1048] T 5ce18799382e46108fbcbed2c364321d P 41999337784141c5834094008bf6ba97 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 14:49:36.948796  6580 catalog_manager.cc:5697] T be9352545ba44d68a3704b39c623e774 P 41999337784141c5834094008bf6ba97 reported cstate change: term changed from 0 to 1, leader changed from <none> to 41999337784141c5834094008bf6ba97 (127.6.101.66). New cstate: current_term: 1 leader_uuid: "41999337784141c5834094008bf6ba97" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } health_report { overall_health: UNKNOWN } } }
I20260709 14:49:36.966424  6936 consensus_queue.cc:1048] T 5ce18799382e46108fbcbed2c364321d P 41999337784141c5834094008bf6ba97 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:49:36.976999  6683 raft_consensus.cc:3060] T 82a2d00569854cd990c582b9693829ff P 25b7964825a6462295c0606a06169676 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:49:36.996845  6947 consensus_queue.cc:1048] T d58c1f5d4e1c448eab811059e23165cc P bf2d93774f73406ead205c8ba8c9da13 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:49:37.025942  6934 consensus_queue.cc:1048] T 07255af297cd4ac59277e81984f07f9c P 41999337784141c5834094008bf6ba97 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:49:37.033560  6947 consensus_queue.cc:1048] T d58c1f5d4e1c448eab811059e23165cc P bf2d93774f73406ead205c8ba8c9da13 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 14:49:37.048322  6832 raft_consensus.cc:3060] T 07255af297cd4ac59277e81984f07f9c P bf2d93774f73406ead205c8ba8c9da13 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:49:37.060681  6935 consensus_queue.cc:1048] T 07255af297cd4ac59277e81984f07f9c P 41999337784141c5834094008bf6ba97 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:49:37.327703  6833 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d58c1f5d4e1c448eab811059e23165cc"
dest_uuid: "bf2d93774f73406ead205c8ba8c9da13"
mode: GRACEFUL
new_leader_uuid: "25b7964825a6462295c0606a06169676"
 from {username='slave'} at 127.0.0.1:46190
I20260709 14:49:37.328482  6833 raft_consensus.cc:606] T d58c1f5d4e1c448eab811059e23165cc P bf2d93774f73406ead205c8ba8c9da13 [term 1 LEADER]: Received request to transfer leadership to TS 25b7964825a6462295c0606a06169676
I20260709 14:49:37.337684  6833 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1dbff5d6a7234db3a8f367fe9b30d615"
dest_uuid: "bf2d93774f73406ead205c8ba8c9da13"
mode: GRACEFUL
new_leader_uuid: "25b7964825a6462295c0606a06169676"
 from {username='slave'} at 127.0.0.1:46190
I20260709 14:49:37.338418  6833 raft_consensus.cc:606] T 1dbff5d6a7234db3a8f367fe9b30d615 P bf2d93774f73406ead205c8ba8c9da13 [term 1 LEADER]: Received request to transfer leadership to TS 25b7964825a6462295c0606a06169676
I20260709 14:49:37.348507  6833 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bc290da245804ddc92d9597c5da52a82"
dest_uuid: "bf2d93774f73406ead205c8ba8c9da13"
mode: GRACEFUL
new_leader_uuid: "25b7964825a6462295c0606a06169676"
 from {username='slave'} at 127.0.0.1:46190
I20260709 14:49:37.349154  6833 raft_consensus.cc:606] T bc290da245804ddc92d9597c5da52a82 P bf2d93774f73406ead205c8ba8c9da13 [term 1 LEADER]: Received request to transfer leadership to TS 25b7964825a6462295c0606a06169676
I20260709 14:49:37.368893  6833 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3d8096f833ea45ce9471c56d3ce1a68b"
dest_uuid: "bf2d93774f73406ead205c8ba8c9da13"
mode: GRACEFUL
new_leader_uuid: "41999337784141c5834094008bf6ba97"
 from {username='slave'} at 127.0.0.1:46190
I20260709 14:49:37.370004  6833 raft_consensus.cc:606] T 3d8096f833ea45ce9471c56d3ce1a68b P bf2d93774f73406ead205c8ba8c9da13 [term 1 LEADER]: Received request to transfer leadership to TS 41999337784141c5834094008bf6ba97
I20260709 14:49:37.399991  6757 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "be9352545ba44d68a3704b39c623e774"
dest_uuid: "41999337784141c5834094008bf6ba97"
mode: GRACEFUL
new_leader_uuid: "bf2d93774f73406ead205c8ba8c9da13"
 from {username='slave'} at 127.0.0.1:49666
I20260709 14:49:37.400983  6757 raft_consensus.cc:606] T be9352545ba44d68a3704b39c623e774 P 41999337784141c5834094008bf6ba97 [term 1 LEADER]: Received request to transfer leadership to TS bf2d93774f73406ead205c8ba8c9da13
I20260709 14:49:37.487607  6935 consensus_queue.cc:1048] T be9352545ba44d68a3704b39c623e774 P 41999337784141c5834094008bf6ba97 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 14:49:37.504554  6936 consensus_queue.cc:1048] T be9352545ba44d68a3704b39c623e774 P 41999337784141c5834094008bf6ba97 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 14:49:37.524227  6907 raft_consensus.cc:993] T be9352545ba44d68a3704b39c623e774 P 41999337784141c5834094008bf6ba97: : Instructing follower bf2d93774f73406ead205c8ba8c9da13 to start an election
I20260709 14:49:37.525419  6907 raft_consensus.cc:1081] T be9352545ba44d68a3704b39c623e774 P 41999337784141c5834094008bf6ba97 [term 1 LEADER]: Signalling peer bf2d93774f73406ead205c8ba8c9da13 to start an election
I20260709 14:49:37.527709  6833 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "be9352545ba44d68a3704b39c623e774"
dest_uuid: "bf2d93774f73406ead205c8ba8c9da13"
 from {username='slave'} at 127.0.0.1:46176
I20260709 14:49:37.529022  6833 raft_consensus.cc:493] T be9352545ba44d68a3704b39c623e774 P bf2d93774f73406ead205c8ba8c9da13 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:49:37.529556  6833 raft_consensus.cc:3060] T be9352545ba44d68a3704b39c623e774 P bf2d93774f73406ead205c8ba8c9da13 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:49:37.538534  6833 raft_consensus.cc:515] T be9352545ba44d68a3704b39c623e774 P bf2d93774f73406ead205c8ba8c9da13 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:37.541653  6833 leader_election.cc:290] T be9352545ba44d68a3704b39c623e774 P bf2d93774f73406ead205c8ba8c9da13 [CANDIDATE]: Term 2 election: Requested vote from peers 25b7964825a6462295c0606a06169676 (127.6.101.65:34615), 41999337784141c5834094008bf6ba97 (127.6.101.66:35001)
I20260709 14:49:37.543125  6683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9352545ba44d68a3704b39c623e774" candidate_uuid: "bf2d93774f73406ead205c8ba8c9da13" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "25b7964825a6462295c0606a06169676"
I20260709 14:49:37.543787  6757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9352545ba44d68a3704b39c623e774" candidate_uuid: "bf2d93774f73406ead205c8ba8c9da13" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "41999337784141c5834094008bf6ba97"
I20260709 14:49:37.544111  6683 raft_consensus.cc:3060] T be9352545ba44d68a3704b39c623e774 P 25b7964825a6462295c0606a06169676 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:49:37.544534  6757 raft_consensus.cc:3055] T be9352545ba44d68a3704b39c623e774 P 41999337784141c5834094008bf6ba97 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 14:49:37.545060  6757 raft_consensus.cc:740] T be9352545ba44d68a3704b39c623e774 P 41999337784141c5834094008bf6ba97 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 41999337784141c5834094008bf6ba97, State: Running, Role: LEADER
I20260709 14:49:37.546296  6757 consensus_queue.cc:260] T be9352545ba44d68a3704b39c623e774 P 41999337784141c5834094008bf6ba97 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:37.548082  6757 raft_consensus.cc:3060] T be9352545ba44d68a3704b39c623e774 P 41999337784141c5834094008bf6ba97 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:49:37.551293  6683 raft_consensus.cc:2468] T be9352545ba44d68a3704b39c623e774 P 25b7964825a6462295c0606a06169676 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf2d93774f73406ead205c8ba8c9da13 in term 2.
I20260709 14:49:37.552897  6796 leader_election.cc:304] T be9352545ba44d68a3704b39c623e774 P bf2d93774f73406ead205c8ba8c9da13 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b7964825a6462295c0606a06169676, bf2d93774f73406ead205c8ba8c9da13; no voters: 
I20260709 14:49:37.556959  6947 raft_consensus.cc:2804] T be9352545ba44d68a3704b39c623e774 P bf2d93774f73406ead205c8ba8c9da13 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:49:37.557713  6947 raft_consensus.cc:697] T be9352545ba44d68a3704b39c623e774 P bf2d93774f73406ead205c8ba8c9da13 [term 2 LEADER]: Becoming Leader. State: Replica: bf2d93774f73406ead205c8ba8c9da13, State: Running, Role: LEADER
I20260709 14:49:37.558037  6757 raft_consensus.cc:2468] T be9352545ba44d68a3704b39c623e774 P 41999337784141c5834094008bf6ba97 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf2d93774f73406ead205c8ba8c9da13 in term 2.
I20260709 14:49:37.558626  6947 consensus_queue.cc:237] T be9352545ba44d68a3704b39c623e774 P bf2d93774f73406ead205c8ba8c9da13 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:37.563302  6915 raft_consensus.cc:993] T d58c1f5d4e1c448eab811059e23165cc P bf2d93774f73406ead205c8ba8c9da13: : Instructing follower 25b7964825a6462295c0606a06169676 to start an election
I20260709 14:49:37.563944  6947 raft_consensus.cc:1081] T d58c1f5d4e1c448eab811059e23165cc P bf2d93774f73406ead205c8ba8c9da13 [term 1 LEADER]: Signalling peer 25b7964825a6462295c0606a06169676 to start an election
I20260709 14:49:37.566090  6683 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d58c1f5d4e1c448eab811059e23165cc"
dest_uuid: "25b7964825a6462295c0606a06169676"
 from {username='slave'} at 127.0.0.1:42198
I20260709 14:49:37.567031  6683 raft_consensus.cc:493] T d58c1f5d4e1c448eab811059e23165cc P 25b7964825a6462295c0606a06169676 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:49:37.567708  6683 raft_consensus.cc:3060] T d58c1f5d4e1c448eab811059e23165cc P 25b7964825a6462295c0606a06169676 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:49:37.566990  6579 catalog_manager.cc:5697] T be9352545ba44d68a3704b39c623e774 P bf2d93774f73406ead205c8ba8c9da13 reported cstate change: term changed from 1 to 2, leader changed from 41999337784141c5834094008bf6ba97 (127.6.101.66) to bf2d93774f73406ead205c8ba8c9da13 (127.6.101.67). New cstate: current_term: 2 leader_uuid: "bf2d93774f73406ead205c8ba8c9da13" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } health_report { overall_health: HEALTHY } } }
I20260709 14:49:37.576339  6683 raft_consensus.cc:515] T d58c1f5d4e1c448eab811059e23165cc P 25b7964825a6462295c0606a06169676 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } } peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } }
I20260709 14:49:37.580958  6833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d58c1f5d4e1c448eab811059e23165cc" candidate_uuid: "25b7964825a6462295c0606a06169676" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bf2d93774f73406ead205c8ba8c9da13"
I20260709 14:49:37.581782  6833 raft_consensus.cc:3055] T d58c1f5d4e1c448eab811059e23165cc P bf2d93774f73406ead205c8ba8c9da13 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 14:49:37.581611  6757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d58c1f5d4e1c448eab811059e23165cc" candidate_uuid: "25b7964825a6462295c0606a06169676" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "41999337784141c5834094008bf6ba97"
I20260709 14:49:37.582280  6833 raft_consensus.cc:740] T d58c1f5d4e1c448eab811059e23165cc P bf2d93774f73406ead205c8ba8c9da13 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bf2d93774f73406ead205c8ba8c9da13, State: Running, Role: LEADER
I20260709 14:49:37.583056  6757 raft_consensus.cc:3060] T d58c1f5d4e1c448eab811059e23165cc P 41999337784141c5834094008bf6ba97 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:49:37.583662  6683 leader_election.cc:290] T d58c1f5d4e1c448eab811059e23165cc P 25b7964825a6462295c0606a06169676 [CANDIDATE]: Term 2 election: Requested vote from peers 41999337784141c5834094008bf6ba97 (127.6.101.66:35001), bf2d93774f73406ead205c8ba8c9da13 (127.6.101.67:46675)
I20260709 14:49:37.583425  6833 consensus_queue.cc:260] T d58c1f5d4e1c448eab811059e23165cc P bf2d93774f73406ead205c8ba8c9da13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } } peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } }
I20260709 14:49:37.584893  6833 raft_consensus.cc:3060] T d58c1f5d4e1c448eab811059e23165cc P bf2d93774f73406ead205c8ba8c9da13 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:49:37.592765  6757 raft_consensus.cc:2468] T d58c1f5d4e1c448eab811059e23165cc P 41999337784141c5834094008bf6ba97 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b7964825a6462295c0606a06169676 in term 2.
I20260709 14:49:37.593879  6833 raft_consensus.cc:2468] T d58c1f5d4e1c448eab811059e23165cc P bf2d93774f73406ead205c8ba8c9da13 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b7964825a6462295c0606a06169676 in term 2.
I20260709 14:49:37.594121  6648 leader_election.cc:304] T d58c1f5d4e1c448eab811059e23165cc P 25b7964825a6462295c0606a06169676 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b7964825a6462295c0606a06169676, 41999337784141c5834094008bf6ba97; no voters: 
I20260709 14:49:37.594978  6884 raft_consensus.cc:2804] T d58c1f5d4e1c448eab811059e23165cc P 25b7964825a6462295c0606a06169676 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:49:37.596344  6884 raft_consensus.cc:697] T d58c1f5d4e1c448eab811059e23165cc P 25b7964825a6462295c0606a06169676 [term 2 LEADER]: Becoming Leader. State: Replica: 25b7964825a6462295c0606a06169676, State: Running, Role: LEADER
I20260709 14:49:37.597172  6884 consensus_queue.cc:237] T d58c1f5d4e1c448eab811059e23165cc P 25b7964825a6462295c0606a06169676 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } } peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } }
I20260709 14:49:37.605213  6579 catalog_manager.cc:5697] T d58c1f5d4e1c448eab811059e23165cc P 25b7964825a6462295c0606a06169676 reported cstate change: term changed from 1 to 2, leader changed from bf2d93774f73406ead205c8ba8c9da13 (127.6.101.67) to 25b7964825a6462295c0606a06169676 (127.6.101.65). New cstate: current_term: 2 leader_uuid: "25b7964825a6462295c0606a06169676" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } health_report { overall_health: HEALTHY } } }
I20260709 14:49:37.695462  6947 raft_consensus.cc:993] T 1dbff5d6a7234db3a8f367fe9b30d615 P bf2d93774f73406ead205c8ba8c9da13: : Instructing follower 25b7964825a6462295c0606a06169676 to start an election
I20260709 14:49:37.695943  6915 raft_consensus.cc:1081] T 1dbff5d6a7234db3a8f367fe9b30d615 P bf2d93774f73406ead205c8ba8c9da13 [term 1 LEADER]: Signalling peer 25b7964825a6462295c0606a06169676 to start an election
I20260709 14:49:37.698065  6683 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1dbff5d6a7234db3a8f367fe9b30d615"
dest_uuid: "25b7964825a6462295c0606a06169676"
 from {username='slave'} at 127.0.0.1:42198
I20260709 14:49:37.698633  6683 raft_consensus.cc:493] T 1dbff5d6a7234db3a8f367fe9b30d615 P 25b7964825a6462295c0606a06169676 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:49:37.698992  6683 raft_consensus.cc:3060] T 1dbff5d6a7234db3a8f367fe9b30d615 P 25b7964825a6462295c0606a06169676 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:49:37.699429  6915 raft_consensus.cc:993] T 3d8096f833ea45ce9471c56d3ce1a68b P bf2d93774f73406ead205c8ba8c9da13: : Instructing follower 41999337784141c5834094008bf6ba97 to start an election
I20260709 14:49:37.700106  6952 raft_consensus.cc:1081] T 3d8096f833ea45ce9471c56d3ce1a68b P bf2d93774f73406ead205c8ba8c9da13 [term 1 LEADER]: Signalling peer 41999337784141c5834094008bf6ba97 to start an election
I20260709 14:49:37.702559  6757 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3d8096f833ea45ce9471c56d3ce1a68b"
dest_uuid: "41999337784141c5834094008bf6ba97"
 from {username='slave'} at 127.0.0.1:49650
I20260709 14:49:37.703331  6757 raft_consensus.cc:493] T 3d8096f833ea45ce9471c56d3ce1a68b P 41999337784141c5834094008bf6ba97 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:49:37.703769  6757 raft_consensus.cc:3060] T 3d8096f833ea45ce9471c56d3ce1a68b P 41999337784141c5834094008bf6ba97 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:49:37.706373  6683 raft_consensus.cc:515] T 1dbff5d6a7234db3a8f367fe9b30d615 P 25b7964825a6462295c0606a06169676 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:37.711262  6833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbff5d6a7234db3a8f367fe9b30d615" candidate_uuid: "25b7964825a6462295c0606a06169676" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bf2d93774f73406ead205c8ba8c9da13"
I20260709 14:49:37.711990  6683 leader_election.cc:290] T 1dbff5d6a7234db3a8f367fe9b30d615 P 25b7964825a6462295c0606a06169676 [CANDIDATE]: Term 2 election: Requested vote from peers 41999337784141c5834094008bf6ba97 (127.6.101.66:35001), bf2d93774f73406ead205c8ba8c9da13 (127.6.101.67:46675)
I20260709 14:49:37.712154  6833 raft_consensus.cc:3055] T 1dbff5d6a7234db3a8f367fe9b30d615 P bf2d93774f73406ead205c8ba8c9da13 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 14:49:37.711154  6758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbff5d6a7234db3a8f367fe9b30d615" candidate_uuid: "25b7964825a6462295c0606a06169676" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "41999337784141c5834094008bf6ba97"
I20260709 14:49:37.712783  6833 raft_consensus.cc:740] T 1dbff5d6a7234db3a8f367fe9b30d615 P bf2d93774f73406ead205c8ba8c9da13 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bf2d93774f73406ead205c8ba8c9da13, State: Running, Role: LEADER
I20260709 14:49:37.713718  6758 raft_consensus.cc:3060] T 1dbff5d6a7234db3a8f367fe9b30d615 P 41999337784141c5834094008bf6ba97 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:49:37.712634  6757 raft_consensus.cc:515] T 3d8096f833ea45ce9471c56d3ce1a68b P 41999337784141c5834094008bf6ba97 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:37.714169  6833 consensus_queue.cc:260] T 1dbff5d6a7234db3a8f367fe9b30d615 P bf2d93774f73406ead205c8ba8c9da13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:37.715485  6833 raft_consensus.cc:3060] T 1dbff5d6a7234db3a8f367fe9b30d615 P bf2d93774f73406ead205c8ba8c9da13 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:49:37.717594  6683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d8096f833ea45ce9471c56d3ce1a68b" candidate_uuid: "41999337784141c5834094008bf6ba97" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "25b7964825a6462295c0606a06169676"
I20260709 14:49:37.718413  6683 raft_consensus.cc:3060] T 3d8096f833ea45ce9471c56d3ce1a68b P 25b7964825a6462295c0606a06169676 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:49:37.721290  6832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d8096f833ea45ce9471c56d3ce1a68b" candidate_uuid: "41999337784141c5834094008bf6ba97" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bf2d93774f73406ead205c8ba8c9da13"
I20260709 14:49:37.719373  6757 leader_election.cc:290] T 3d8096f833ea45ce9471c56d3ce1a68b P 41999337784141c5834094008bf6ba97 [CANDIDATE]: Term 2 election: Requested vote from peers 25b7964825a6462295c0606a06169676 (127.6.101.65:34615), bf2d93774f73406ead205c8ba8c9da13 (127.6.101.67:46675)
I20260709 14:49:37.722330  6832 raft_consensus.cc:3055] T 3d8096f833ea45ce9471c56d3ce1a68b P bf2d93774f73406ead205c8ba8c9da13 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 14:49:37.722951  6832 raft_consensus.cc:740] T 3d8096f833ea45ce9471c56d3ce1a68b P bf2d93774f73406ead205c8ba8c9da13 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bf2d93774f73406ead205c8ba8c9da13, State: Running, Role: LEADER
I20260709 14:49:37.723544  6758 raft_consensus.cc:2468] T 1dbff5d6a7234db3a8f367fe9b30d615 P 41999337784141c5834094008bf6ba97 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b7964825a6462295c0606a06169676 in term 2.
I20260709 14:49:37.723845  6832 consensus_queue.cc:260] T 3d8096f833ea45ce9471c56d3ce1a68b P bf2d93774f73406ead205c8ba8c9da13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:37.724910  6648 leader_election.cc:304] T 1dbff5d6a7234db3a8f367fe9b30d615 P 25b7964825a6462295c0606a06169676 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b7964825a6462295c0606a06169676, 41999337784141c5834094008bf6ba97; no voters: 
I20260709 14:49:37.725795  6884 raft_consensus.cc:2804] T 1dbff5d6a7234db3a8f367fe9b30d615 P 25b7964825a6462295c0606a06169676 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:49:37.726270  6884 raft_consensus.cc:697] T 1dbff5d6a7234db3a8f367fe9b30d615 P 25b7964825a6462295c0606a06169676 [term 2 LEADER]: Becoming Leader. State: Replica: 25b7964825a6462295c0606a06169676, State: Running, Role: LEADER
I20260709 14:49:37.727094  6884 consensus_queue.cc:237] T 1dbff5d6a7234db3a8f367fe9b30d615 P 25b7964825a6462295c0606a06169676 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:37.730944  6833 raft_consensus.cc:2468] T 1dbff5d6a7234db3a8f367fe9b30d615 P bf2d93774f73406ead205c8ba8c9da13 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b7964825a6462295c0606a06169676 in term 2.
I20260709 14:49:37.731123  6683 raft_consensus.cc:2468] T 3d8096f833ea45ce9471c56d3ce1a68b P 25b7964825a6462295c0606a06169676 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41999337784141c5834094008bf6ba97 in term 2.
I20260709 14:49:37.725207  6832 raft_consensus.cc:3060] T 3d8096f833ea45ce9471c56d3ce1a68b P bf2d93774f73406ead205c8ba8c9da13 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:49:37.733497  6722 leader_election.cc:304] T 3d8096f833ea45ce9471c56d3ce1a68b P 41999337784141c5834094008bf6ba97 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b7964825a6462295c0606a06169676, 41999337784141c5834094008bf6ba97; no voters: 
I20260709 14:49:37.734583  6907 raft_consensus.cc:2804] T 3d8096f833ea45ce9471c56d3ce1a68b P 41999337784141c5834094008bf6ba97 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:49:37.735154  6907 raft_consensus.cc:697] T 3d8096f833ea45ce9471c56d3ce1a68b P 41999337784141c5834094008bf6ba97 [term 2 LEADER]: Becoming Leader. State: Replica: 41999337784141c5834094008bf6ba97, State: Running, Role: LEADER
I20260709 14:49:37.736167  6907 consensus_queue.cc:237] T 3d8096f833ea45ce9471c56d3ce1a68b P 41999337784141c5834094008bf6ba97 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:37.743126  6832 raft_consensus.cc:2468] T 3d8096f833ea45ce9471c56d3ce1a68b P bf2d93774f73406ead205c8ba8c9da13 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41999337784141c5834094008bf6ba97 in term 2.
I20260709 14:49:37.742666  6579 catalog_manager.cc:5697] T 1dbff5d6a7234db3a8f367fe9b30d615 P 25b7964825a6462295c0606a06169676 reported cstate change: term changed from 1 to 2, leader changed from bf2d93774f73406ead205c8ba8c9da13 (127.6.101.67) to 25b7964825a6462295c0606a06169676 (127.6.101.65). New cstate: current_term: 2 leader_uuid: "25b7964825a6462295c0606a06169676" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } health_report { overall_health: UNKNOWN } } }
I20260709 14:49:37.747727  6580 catalog_manager.cc:5697] T 3d8096f833ea45ce9471c56d3ce1a68b P 41999337784141c5834094008bf6ba97 reported cstate change: term changed from 1 to 2, leader changed from bf2d93774f73406ead205c8ba8c9da13 (127.6.101.67) to 41999337784141c5834094008bf6ba97 (127.6.101.66). New cstate: current_term: 2 leader_uuid: "41999337784141c5834094008bf6ba97" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } health_report { overall_health: UNKNOWN } } }
I20260709 14:49:37.831983  6915 raft_consensus.cc:993] T bc290da245804ddc92d9597c5da52a82 P bf2d93774f73406ead205c8ba8c9da13: : Instructing follower 25b7964825a6462295c0606a06169676 to start an election
I20260709 14:49:37.832659  6952 raft_consensus.cc:1081] T bc290da245804ddc92d9597c5da52a82 P bf2d93774f73406ead205c8ba8c9da13 [term 1 LEADER]: Signalling peer 25b7964825a6462295c0606a06169676 to start an election
I20260709 14:49:37.834950  6683 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bc290da245804ddc92d9597c5da52a82"
dest_uuid: "25b7964825a6462295c0606a06169676"
 from {username='slave'} at 127.0.0.1:42198
I20260709 14:49:37.835731  6683 raft_consensus.cc:493] T bc290da245804ddc92d9597c5da52a82 P 25b7964825a6462295c0606a06169676 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:49:37.836151  6683 raft_consensus.cc:3060] T bc290da245804ddc92d9597c5da52a82 P 25b7964825a6462295c0606a06169676 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:49:37.846307  6683 raft_consensus.cc:515] T bc290da245804ddc92d9597c5da52a82 P 25b7964825a6462295c0606a06169676 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:37.849632  6683 leader_election.cc:290] T bc290da245804ddc92d9597c5da52a82 P 25b7964825a6462295c0606a06169676 [CANDIDATE]: Term 2 election: Requested vote from peers 41999337784141c5834094008bf6ba97 (127.6.101.66:35001), bf2d93774f73406ead205c8ba8c9da13 (127.6.101.67:46675)
I20260709 14:49:37.849848  6758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc290da245804ddc92d9597c5da52a82" candidate_uuid: "25b7964825a6462295c0606a06169676" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "41999337784141c5834094008bf6ba97"
I20260709 14:49:37.850435  6758 raft_consensus.cc:3060] T bc290da245804ddc92d9597c5da52a82 P 41999337784141c5834094008bf6ba97 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:49:37.850711  6832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc290da245804ddc92d9597c5da52a82" candidate_uuid: "25b7964825a6462295c0606a06169676" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bf2d93774f73406ead205c8ba8c9da13"
I20260709 14:49:37.852106  6832 raft_consensus.cc:3055] T bc290da245804ddc92d9597c5da52a82 P bf2d93774f73406ead205c8ba8c9da13 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 14:49:37.852516  6832 raft_consensus.cc:740] T bc290da245804ddc92d9597c5da52a82 P bf2d93774f73406ead205c8ba8c9da13 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bf2d93774f73406ead205c8ba8c9da13, State: Running, Role: LEADER
I20260709 14:49:37.853529  6832 consensus_queue.cc:260] T bc290da245804ddc92d9597c5da52a82 P bf2d93774f73406ead205c8ba8c9da13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:37.854909  6832 raft_consensus.cc:3060] T bc290da245804ddc92d9597c5da52a82 P bf2d93774f73406ead205c8ba8c9da13 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:49:37.859014  6758 raft_consensus.cc:2468] T bc290da245804ddc92d9597c5da52a82 P 41999337784141c5834094008bf6ba97 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b7964825a6462295c0606a06169676 in term 2.
I20260709 14:49:37.861317  6648 leader_election.cc:304] T bc290da245804ddc92d9597c5da52a82 P 25b7964825a6462295c0606a06169676 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b7964825a6462295c0606a06169676, 41999337784141c5834094008bf6ba97; no voters: 
I20260709 14:49:37.862877  6884 raft_consensus.cc:2804] T bc290da245804ddc92d9597c5da52a82 P 25b7964825a6462295c0606a06169676 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:49:37.863674  6884 raft_consensus.cc:697] T bc290da245804ddc92d9597c5da52a82 P 25b7964825a6462295c0606a06169676 [term 2 LEADER]: Becoming Leader. State: Replica: 25b7964825a6462295c0606a06169676, State: Running, Role: LEADER
I20260709 14:49:37.864640  6884 consensus_queue.cc:237] T bc290da245804ddc92d9597c5da52a82 P 25b7964825a6462295c0606a06169676 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:37.865149  6832 raft_consensus.cc:2468] T bc290da245804ddc92d9597c5da52a82 P bf2d93774f73406ead205c8ba8c9da13 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b7964825a6462295c0606a06169676 in term 2.
I20260709 14:49:37.874887  6580 catalog_manager.cc:5697] T bc290da245804ddc92d9597c5da52a82 P 25b7964825a6462295c0606a06169676 reported cstate change: term changed from 1 to 2, leader changed from bf2d93774f73406ead205c8ba8c9da13 (127.6.101.67) to 25b7964825a6462295c0606a06169676 (127.6.101.65). New cstate: current_term: 2 leader_uuid: "25b7964825a6462295c0606a06169676" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } health_report { overall_health: UNKNOWN } } }
I20260709 14:49:38.040340  6758 raft_consensus.cc:1275] T be9352545ba44d68a3704b39c623e774 P 41999337784141c5834094008bf6ba97 [term 2 FOLLOWER]: Refusing update from remote peer bf2d93774f73406ead205c8ba8c9da13: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:49:38.043068  6952 consensus_queue.cc:1048] T be9352545ba44d68a3704b39c623e774 P bf2d93774f73406ead205c8ba8c9da13 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 14:49:38.076496  6683 raft_consensus.cc:1275] T be9352545ba44d68a3704b39c623e774 P 25b7964825a6462295c0606a06169676 [term 2 FOLLOWER]: Refusing update from remote peer bf2d93774f73406ead205c8ba8c9da13: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:49:38.079002  6952 consensus_queue.cc:1048] T be9352545ba44d68a3704b39c623e774 P bf2d93774f73406ead205c8ba8c9da13 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 14:49:38.120525  6758 raft_consensus.cc:1275] T d58c1f5d4e1c448eab811059e23165cc P 41999337784141c5834094008bf6ba97 [term 2 FOLLOWER]: Refusing update from remote peer 25b7964825a6462295c0606a06169676: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:49:38.121968  6832 raft_consensus.cc:1275] T d58c1f5d4e1c448eab811059e23165cc P bf2d93774f73406ead205c8ba8c9da13 [term 2 FOLLOWER]: Refusing update from remote peer 25b7964825a6462295c0606a06169676: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:49:38.122457  6884 consensus_queue.cc:1048] T d58c1f5d4e1c448eab811059e23165cc P 25b7964825a6462295c0606a06169676 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 14:49:38.124028  6884 consensus_queue.cc:1048] T d58c1f5d4e1c448eab811059e23165cc P 25b7964825a6462295c0606a06169676 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 14:49:38.157743  6683 raft_consensus.cc:1275] T 3d8096f833ea45ce9471c56d3ce1a68b P 25b7964825a6462295c0606a06169676 [term 2 FOLLOWER]: Refusing update from remote peer 41999337784141c5834094008bf6ba97: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:49:38.160084  6907 consensus_queue.cc:1048] T 3d8096f833ea45ce9471c56d3ce1a68b P 41999337784141c5834094008bf6ba97 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 14:49:38.161968  6832 raft_consensus.cc:1275] T 1dbff5d6a7234db3a8f367fe9b30d615 P bf2d93774f73406ead205c8ba8c9da13 [term 2 FOLLOWER]: Refusing update from remote peer 25b7964825a6462295c0606a06169676: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:49:38.165189  6972 consensus_queue.cc:1048] T 1dbff5d6a7234db3a8f367fe9b30d615 P 25b7964825a6462295c0606a06169676 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 14:49:38.175359  6833 raft_consensus.cc:1275] T 3d8096f833ea45ce9471c56d3ce1a68b P bf2d93774f73406ead205c8ba8c9da13 [term 2 FOLLOWER]: Refusing update from remote peer 41999337784141c5834094008bf6ba97: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:49:38.178535  6936 consensus_queue.cc:1048] T 3d8096f833ea45ce9471c56d3ce1a68b P 41999337784141c5834094008bf6ba97 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 14:49:38.203092  6758 raft_consensus.cc:1275] T 1dbff5d6a7234db3a8f367fe9b30d615 P 41999337784141c5834094008bf6ba97 [term 2 FOLLOWER]: Refusing update from remote peer 25b7964825a6462295c0606a06169676: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:49:38.205463  6979 consensus_queue.cc:1048] T 1dbff5d6a7234db3a8f367fe9b30d615 P 25b7964825a6462295c0606a06169676 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 14:49:38.310612  6832 raft_consensus.cc:1275] T bc290da245804ddc92d9597c5da52a82 P bf2d93774f73406ead205c8ba8c9da13 [term 2 FOLLOWER]: Refusing update from remote peer 25b7964825a6462295c0606a06169676: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:49:38.312487  6979 consensus_queue.cc:1048] T bc290da245804ddc92d9597c5da52a82 P 25b7964825a6462295c0606a06169676 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 14:49:38.326623  6758 raft_consensus.cc:1275] T bc290da245804ddc92d9597c5da52a82 P 41999337784141c5834094008bf6ba97 [term 2 FOLLOWER]: Refusing update from remote peer 25b7964825a6462295c0606a06169676: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:49:38.329860  6979 consensus_queue.cc:1048] T bc290da245804ddc92d9597c5da52a82 P 25b7964825a6462295c0606a06169676 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 14:49:40.094130  6993 raft_consensus.cc:493] T 5ce18799382e46108fbcbed2c364321d P 25b7964825a6462295c0606a06169676 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 41999337784141c5834094008bf6ba97)
I20260709 14:49:40.095156  6993 raft_consensus.cc:515] T 5ce18799382e46108fbcbed2c364321d P 25b7964825a6462295c0606a06169676 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:40.097923  6993 leader_election.cc:290] T 5ce18799382e46108fbcbed2c364321d P 25b7964825a6462295c0606a06169676 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 41999337784141c5834094008bf6ba97 (127.6.101.66:35001), bf2d93774f73406ead205c8ba8c9da13 (127.6.101.67:46675)
I20260709 14:49:40.100654  6993 raft_consensus.cc:493] T be9352545ba44d68a3704b39c623e774 P 25b7964825a6462295c0606a06169676 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bf2d93774f73406ead205c8ba8c9da13)
I20260709 14:49:40.101476  6993 raft_consensus.cc:515] T be9352545ba44d68a3704b39c623e774 P 25b7964825a6462295c0606a06169676 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:40.103888  6993 leader_election.cc:290] T be9352545ba44d68a3704b39c623e774 P 25b7964825a6462295c0606a06169676 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 41999337784141c5834094008bf6ba97 (127.6.101.66:35001), bf2d93774f73406ead205c8ba8c9da13 (127.6.101.67:46675)
I20260709 14:49:40.207916  6993 raft_consensus.cc:493] T 07255af297cd4ac59277e81984f07f9c P 25b7964825a6462295c0606a06169676 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 41999337784141c5834094008bf6ba97)
I20260709 14:49:40.208696  6993 raft_consensus.cc:515] T 07255af297cd4ac59277e81984f07f9c P 25b7964825a6462295c0606a06169676 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:40.212273  6993 leader_election.cc:290] T 07255af297cd4ac59277e81984f07f9c P 25b7964825a6462295c0606a06169676 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 41999337784141c5834094008bf6ba97 (127.6.101.66:35001), bf2d93774f73406ead205c8ba8c9da13 (127.6.101.67:46675)
I20260709 14:49:40.283993  6993 raft_consensus.cc:493] T 3d8096f833ea45ce9471c56d3ce1a68b P 25b7964825a6462295c0606a06169676 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 41999337784141c5834094008bf6ba97)
I20260709 14:49:40.284950  6993 raft_consensus.cc:515] T 3d8096f833ea45ce9471c56d3ce1a68b P 25b7964825a6462295c0606a06169676 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:40.290431  6993 leader_election.cc:290] T 3d8096f833ea45ce9471c56d3ce1a68b P 25b7964825a6462295c0606a06169676 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 41999337784141c5834094008bf6ba97 (127.6.101.66:35001), bf2d93774f73406ead205c8ba8c9da13 (127.6.101.67:46675)
I20260709 14:49:40.500442  6907 raft_consensus.cc:493] T c8ac07644f37427e80f77c67ccac9328 P 41999337784141c5834094008bf6ba97 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 25b7964825a6462295c0606a06169676)
I20260709 14:49:40.517788  6952 raft_consensus.cc:493] T 5ce18799382e46108fbcbed2c364321d P bf2d93774f73406ead205c8ba8c9da13 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 41999337784141c5834094008bf6ba97)
I20260709 14:49:40.518440  6952 raft_consensus.cc:515] T 5ce18799382e46108fbcbed2c364321d P bf2d93774f73406ead205c8ba8c9da13 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:40.520833  6997 raft_consensus.cc:493] T 3d8096f833ea45ce9471c56d3ce1a68b P bf2d93774f73406ead205c8ba8c9da13 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 41999337784141c5834094008bf6ba97)
I20260709 14:49:40.501140  6907 raft_consensus.cc:515] T c8ac07644f37427e80f77c67ccac9328 P 41999337784141c5834094008bf6ba97 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:40.521189  6952 leader_election.cc:290] T 5ce18799382e46108fbcbed2c364321d P bf2d93774f73406ead205c8ba8c9da13 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 25b7964825a6462295c0606a06169676 (127.6.101.65:34615), 41999337784141c5834094008bf6ba97 (127.6.101.66:35001)
I20260709 14:49:40.533473  6907 leader_election.cc:290] T c8ac07644f37427e80f77c67ccac9328 P 41999337784141c5834094008bf6ba97 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 25b7964825a6462295c0606a06169676 (127.6.101.65:34615), bf2d93774f73406ead205c8ba8c9da13 (127.6.101.67:46675)
I20260709 14:49:40.523373  6995 raft_consensus.cc:493] T d58c1f5d4e1c448eab811059e23165cc P bf2d93774f73406ead205c8ba8c9da13 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 25b7964825a6462295c0606a06169676)
I20260709 14:49:40.535439  6995 raft_consensus.cc:515] T d58c1f5d4e1c448eab811059e23165cc P bf2d93774f73406ead205c8ba8c9da13 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } } peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } }
I20260709 14:49:40.521445  6997 raft_consensus.cc:515] T 3d8096f833ea45ce9471c56d3ce1a68b P bf2d93774f73406ead205c8ba8c9da13 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:40.537202  6758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce18799382e46108fbcbed2c364321d" candidate_uuid: "25b7964825a6462295c0606a06169676" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "41999337784141c5834094008bf6ba97" is_pre_election: true
I20260709 14:49:40.539729  6907 raft_consensus.cc:493] T 1dbff5d6a7234db3a8f367fe9b30d615 P 41999337784141c5834094008bf6ba97 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 25b7964825a6462295c0606a06169676)
I20260709 14:49:40.542795  6907 raft_consensus.cc:515] T 1dbff5d6a7234db3a8f367fe9b30d615 P 41999337784141c5834094008bf6ba97 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:40.542914  6756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d8096f833ea45ce9471c56d3ce1a68b" candidate_uuid: "25b7964825a6462295c0606a06169676" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "41999337784141c5834094008bf6ba97" is_pre_election: true
I20260709 14:49:40.548159  6907 leader_election.cc:290] T 1dbff5d6a7234db3a8f367fe9b30d615 P 41999337784141c5834094008bf6ba97 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 25b7964825a6462295c0606a06169676 (127.6.101.65:34615), bf2d93774f73406ead205c8ba8c9da13 (127.6.101.67:46675)
I20260709 14:49:40.546231  6996 raft_consensus.cc:493] T bc290da245804ddc92d9597c5da52a82 P 41999337784141c5834094008bf6ba97 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 25b7964825a6462295c0606a06169676)
I20260709 14:49:40.543702  6757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9352545ba44d68a3704b39c623e774" candidate_uuid: "25b7964825a6462295c0606a06169676" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "41999337784141c5834094008bf6ba97" is_pre_election: true
I20260709 14:49:40.546540  6759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07255af297cd4ac59277e81984f07f9c" candidate_uuid: "25b7964825a6462295c0606a06169676" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "41999337784141c5834094008bf6ba97" is_pre_election: true
I20260709 14:49:40.550271  6757 raft_consensus.cc:2468] T be9352545ba44d68a3704b39c623e774 P 41999337784141c5834094008bf6ba97 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b7964825a6462295c0606a06169676 in term 2.
I20260709 14:49:40.551437  6996 raft_consensus.cc:515] T bc290da245804ddc92d9597c5da52a82 P 41999337784141c5834094008bf6ba97 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:40.554438  6996 leader_election.cc:290] T bc290da245804ddc92d9597c5da52a82 P 41999337784141c5834094008bf6ba97 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 25b7964825a6462295c0606a06169676 (127.6.101.65:34615), bf2d93774f73406ead205c8ba8c9da13 (127.6.101.67:46675)
I20260709 14:49:40.549109  6997 leader_election.cc:290] T 3d8096f833ea45ce9471c56d3ce1a68b P bf2d93774f73406ead205c8ba8c9da13 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 25b7964825a6462295c0606a06169676 (127.6.101.65:34615), 41999337784141c5834094008bf6ba97 (127.6.101.66:35001)
I20260709 14:49:40.560155  6759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce18799382e46108fbcbed2c364321d" candidate_uuid: "bf2d93774f73406ead205c8ba8c9da13" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "41999337784141c5834094008bf6ba97" is_pre_election: true
I20260709 14:49:40.634262  6684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ac07644f37427e80f77c67ccac9328" candidate_uuid: "41999337784141c5834094008bf6ba97" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25b7964825a6462295c0606a06169676" is_pre_election: true
I20260709 14:49:40.661952  6756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d8096f833ea45ce9471c56d3ce1a68b" candidate_uuid: "bf2d93774f73406ead205c8ba8c9da13" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "41999337784141c5834094008bf6ba97" is_pre_election: true
I20260709 14:49:40.665735  6952 raft_consensus.cc:493] T 07255af297cd4ac59277e81984f07f9c P bf2d93774f73406ead205c8ba8c9da13 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 41999337784141c5834094008bf6ba97)
I20260709 14:49:40.667126  6952 raft_consensus.cc:515] T 07255af297cd4ac59277e81984f07f9c P bf2d93774f73406ead205c8ba8c9da13 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:40.680675  6952 leader_election.cc:290] T 07255af297cd4ac59277e81984f07f9c P bf2d93774f73406ead205c8ba8c9da13 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 25b7964825a6462295c0606a06169676 (127.6.101.65:34615), 41999337784141c5834094008bf6ba97 (127.6.101.66:35001)
I20260709 14:49:40.681361  6952 raft_consensus.cc:493] T c8ac07644f37427e80f77c67ccac9328 P bf2d93774f73406ead205c8ba8c9da13 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 25b7964825a6462295c0606a06169676)
I20260709 14:49:40.682646  6952 raft_consensus.cc:515] T c8ac07644f37427e80f77c67ccac9328 P bf2d93774f73406ead205c8ba8c9da13 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:40.685453  6997 raft_consensus.cc:493] T 82a2d00569854cd990c582b9693829ff P bf2d93774f73406ead205c8ba8c9da13 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 41999337784141c5834094008bf6ba97)
I20260709 14:49:40.686349  6997 raft_consensus.cc:515] T 82a2d00569854cd990c582b9693829ff P bf2d93774f73406ead205c8ba8c9da13 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:40.691598  6997 leader_election.cc:290] T 82a2d00569854cd990c582b9693829ff P bf2d93774f73406ead205c8ba8c9da13 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 25b7964825a6462295c0606a06169676 (127.6.101.65:34615), 41999337784141c5834094008bf6ba97 (127.6.101.66:35001)
I20260709 14:49:40.701328  6755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07255af297cd4ac59277e81984f07f9c" candidate_uuid: "bf2d93774f73406ead205c8ba8c9da13" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "41999337784141c5834094008bf6ba97" is_pre_election: true
I20260709 14:49:40.710867  6995 leader_election.cc:290] T d58c1f5d4e1c448eab811059e23165cc P bf2d93774f73406ead205c8ba8c9da13 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 41999337784141c5834094008bf6ba97 (127.6.101.66:35001), 25b7964825a6462295c0606a06169676 (127.6.101.65:34615)
I20260709 14:49:40.714012  6952 leader_election.cc:290] T c8ac07644f37427e80f77c67ccac9328 P bf2d93774f73406ead205c8ba8c9da13 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 25b7964825a6462295c0606a06169676 (127.6.101.65:34615), 41999337784141c5834094008bf6ba97 (127.6.101.66:35001)
I20260709 14:49:40.718346  6684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbff5d6a7234db3a8f367fe9b30d615" candidate_uuid: "41999337784141c5834094008bf6ba97" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25b7964825a6462295c0606a06169676" is_pre_election: true
I20260709 14:49:40.718807  6683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc290da245804ddc92d9597c5da52a82" candidate_uuid: "41999337784141c5834094008bf6ba97" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25b7964825a6462295c0606a06169676" is_pre_election: true
I20260709 14:49:40.722376  6832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce18799382e46108fbcbed2c364321d" candidate_uuid: "25b7964825a6462295c0606a06169676" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf2d93774f73406ead205c8ba8c9da13" is_pre_election: true
I20260709 14:49:40.723583  6832 raft_consensus.cc:2468] T 5ce18799382e46108fbcbed2c364321d P bf2d93774f73406ead205c8ba8c9da13 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b7964825a6462295c0606a06169676 in term 1.
I20260709 14:49:40.727252  6832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9352545ba44d68a3704b39c623e774" candidate_uuid: "25b7964825a6462295c0606a06169676" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bf2d93774f73406ead205c8ba8c9da13" is_pre_election: true
I20260709 14:49:40.729817  6833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07255af297cd4ac59277e81984f07f9c" candidate_uuid: "25b7964825a6462295c0606a06169676" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf2d93774f73406ead205c8ba8c9da13" is_pre_election: true
I20260709 14:49:40.730612  6833 raft_consensus.cc:2468] T 07255af297cd4ac59277e81984f07f9c P bf2d93774f73406ead205c8ba8c9da13 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b7964825a6462295c0606a06169676 in term 1.
W20260709 14:49:40.734035  6780 debug-util.cc:398] Leaking SignalData structure 0x7b0800125060 after lost signal to thread 6552
W20260709 14:49:40.735730  6780 debug-util.cc:398] Leaking SignalData structure 0x7b0800125740 after lost signal to thread 6615
I20260709 14:49:40.736506  6832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d8096f833ea45ce9471c56d3ce1a68b" candidate_uuid: "25b7964825a6462295c0606a06169676" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bf2d93774f73406ead205c8ba8c9da13" is_pre_election: true
W20260709 14:49:40.737545  6780 debug-util.cc:398] Leaking SignalData structure 0x7b0800041980 after lost signal to thread 6708
W20260709 14:49:40.740203  6780 debug-util.cc:398] Leaking SignalData structure 0x7b080003e660 after lost signal to thread 6783
I20260709 14:49:40.742038  6648 leader_election.cc:304] T be9352545ba44d68a3704b39c623e774 P 25b7964825a6462295c0606a06169676 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b7964825a6462295c0606a06169676, 41999337784141c5834094008bf6ba97; no voters: 
W20260709 14:49:40.742340  6780 debug-util.cc:398] Leaking SignalData structure 0x7b080009a840 after lost signal to thread 6857
W20260709 14:49:40.744830  6797 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:35001, user_credentials={real_user=slave}} blocked reactor thread for 53243.7us
I20260709 14:49:40.747262  6993 raft_consensus.cc:2804] T be9352545ba44d68a3704b39c623e774 P 25b7964825a6462295c0606a06169676 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 14:49:40.747771  6993 raft_consensus.cc:493] T be9352545ba44d68a3704b39c623e774 P 25b7964825a6462295c0606a06169676 [term 2 FOLLOWER]: Starting leader election (detected failure of leader bf2d93774f73406ead205c8ba8c9da13)
I20260709 14:49:40.748198  6993 raft_consensus.cc:3060] T be9352545ba44d68a3704b39c623e774 P 25b7964825a6462295c0606a06169676 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:49:40.756459  6759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ac07644f37427e80f77c67ccac9328" candidate_uuid: "bf2d93774f73406ead205c8ba8c9da13" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "41999337784141c5834094008bf6ba97" is_pre_election: true
I20260709 14:49:40.756366  6755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a2d00569854cd990c582b9693829ff" candidate_uuid: "bf2d93774f73406ead205c8ba8c9da13" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "41999337784141c5834094008bf6ba97" is_pre_election: true
I20260709 14:49:40.759001  6756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d58c1f5d4e1c448eab811059e23165cc" candidate_uuid: "bf2d93774f73406ead205c8ba8c9da13" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "41999337784141c5834094008bf6ba97" is_pre_election: true
I20260709 14:49:40.738132  6832 raft_consensus.cc:2468] T 3d8096f833ea45ce9471c56d3ce1a68b P bf2d93774f73406ead205c8ba8c9da13 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b7964825a6462295c0606a06169676 in term 2.
I20260709 14:49:40.764147  6683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce18799382e46108fbcbed2c364321d" candidate_uuid: "bf2d93774f73406ead205c8ba8c9da13" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25b7964825a6462295c0606a06169676" is_pre_election: true
I20260709 14:49:40.764362  6684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d8096f833ea45ce9471c56d3ce1a68b" candidate_uuid: "bf2d93774f73406ead205c8ba8c9da13" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25b7964825a6462295c0606a06169676" is_pre_election: true
I20260709 14:49:40.765734  6682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07255af297cd4ac59277e81984f07f9c" candidate_uuid: "bf2d93774f73406ead205c8ba8c9da13" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25b7964825a6462295c0606a06169676" is_pre_election: true
I20260709 14:49:40.765934  6681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a2d00569854cd990c582b9693829ff" candidate_uuid: "bf2d93774f73406ead205c8ba8c9da13" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25b7964825a6462295c0606a06169676" is_pre_election: true
I20260709 14:49:40.766115  6993 raft_consensus.cc:515] T be9352545ba44d68a3704b39c623e774 P 25b7964825a6462295c0606a06169676 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:40.768350  6681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d58c1f5d4e1c448eab811059e23165cc" candidate_uuid: "bf2d93774f73406ead205c8ba8c9da13" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25b7964825a6462295c0606a06169676" is_pre_election: true
I20260709 14:49:40.769869  6682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ac07644f37427e80f77c67ccac9328" candidate_uuid: "bf2d93774f73406ead205c8ba8c9da13" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25b7964825a6462295c0606a06169676" is_pre_election: true
I20260709 14:49:40.769580  6993 leader_election.cc:290] T be9352545ba44d68a3704b39c623e774 P 25b7964825a6462295c0606a06169676 [CANDIDATE]: Term 3 election: Requested vote from peers 41999337784141c5834094008bf6ba97 (127.6.101.66:35001), bf2d93774f73406ead205c8ba8c9da13 (127.6.101.67:46675)
I20260709 14:49:40.769475  6796 leader_election.cc:304] T 5ce18799382e46108fbcbed2c364321d P bf2d93774f73406ead205c8ba8c9da13 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf2d93774f73406ead205c8ba8c9da13; no voters: 25b7964825a6462295c0606a06169676, 41999337784141c5834094008bf6ba97
I20260709 14:49:40.772158  6796 leader_election.cc:304] T 3d8096f833ea45ce9471c56d3ce1a68b P bf2d93774f73406ead205c8ba8c9da13 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf2d93774f73406ead205c8ba8c9da13; no voters: 25b7964825a6462295c0606a06169676, 41999337784141c5834094008bf6ba97
I20260709 14:49:40.773607  6756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9352545ba44d68a3704b39c623e774" candidate_uuid: "25b7964825a6462295c0606a06169676" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "41999337784141c5834094008bf6ba97"
I20260709 14:49:40.773866  6796 leader_election.cc:304] T 07255af297cd4ac59277e81984f07f9c P bf2d93774f73406ead205c8ba8c9da13 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf2d93774f73406ead205c8ba8c9da13; no voters: 25b7964825a6462295c0606a06169676, 41999337784141c5834094008bf6ba97
I20260709 14:49:40.775360  6999 raft_consensus.cc:2749] T 5ce18799382e46108fbcbed2c364321d P bf2d93774f73406ead205c8ba8c9da13 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 14:49:40.776146  6999 raft_consensus.cc:2749] T 3d8096f833ea45ce9471c56d3ce1a68b P bf2d93774f73406ead205c8ba8c9da13 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 14:49:40.776780  6999 raft_consensus.cc:2749] T 07255af297cd4ac59277e81984f07f9c P bf2d93774f73406ead205c8ba8c9da13 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 14:49:40.781440  6797 leader_election.cc:304] T 82a2d00569854cd990c582b9693829ff P bf2d93774f73406ead205c8ba8c9da13 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf2d93774f73406ead205c8ba8c9da13; no voters: 25b7964825a6462295c0606a06169676, 41999337784141c5834094008bf6ba97
I20260709 14:49:40.782366  6997 raft_consensus.cc:2749] T 82a2d00569854cd990c582b9693829ff P bf2d93774f73406ead205c8ba8c9da13 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 14:49:40.782490  6650 leader_election.cc:304] T 5ce18799382e46108fbcbed2c364321d P 25b7964825a6462295c0606a06169676 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b7964825a6462295c0606a06169676, bf2d93774f73406ead205c8ba8c9da13; no voters: 41999337784141c5834094008bf6ba97
I20260709 14:49:40.784132  6990 raft_consensus.cc:2804] T 5ce18799382e46108fbcbed2c364321d P 25b7964825a6462295c0606a06169676 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 14:49:40.784621  6990 raft_consensus.cc:493] T 5ce18799382e46108fbcbed2c364321d P 25b7964825a6462295c0606a06169676 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 41999337784141c5834094008bf6ba97)
I20260709 14:49:40.785022  6990 raft_consensus.cc:3060] T 5ce18799382e46108fbcbed2c364321d P 25b7964825a6462295c0606a06169676 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:49:40.788647  6650 leader_election.cc:304] T 07255af297cd4ac59277e81984f07f9c P 25b7964825a6462295c0606a06169676 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b7964825a6462295c0606a06169676, bf2d93774f73406ead205c8ba8c9da13; no voters: 41999337784141c5834094008bf6ba97
I20260709 14:49:40.790297  6991 raft_consensus.cc:2804] T 07255af297cd4ac59277e81984f07f9c P 25b7964825a6462295c0606a06169676 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 14:49:40.790621  6831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ac07644f37427e80f77c67ccac9328" candidate_uuid: "41999337784141c5834094008bf6ba97" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf2d93774f73406ead205c8ba8c9da13" is_pre_election: true
I20260709 14:49:40.790796  6991 raft_consensus.cc:493] T 07255af297cd4ac59277e81984f07f9c P 25b7964825a6462295c0606a06169676 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 41999337784141c5834094008bf6ba97)
I20260709 14:49:40.793856  6991 raft_consensus.cc:3060] T 07255af297cd4ac59277e81984f07f9c P 25b7964825a6462295c0606a06169676 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:49:40.793812  6831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbff5d6a7234db3a8f367fe9b30d615" candidate_uuid: "41999337784141c5834094008bf6ba97" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bf2d93774f73406ead205c8ba8c9da13" is_pre_election: true
I20260709 14:49:40.798024  6831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc290da245804ddc92d9597c5da52a82" candidate_uuid: "41999337784141c5834094008bf6ba97" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bf2d93774f73406ead205c8ba8c9da13" is_pre_election: true
I20260709 14:49:40.798219  6990 raft_consensus.cc:515] T 5ce18799382e46108fbcbed2c364321d P 25b7964825a6462295c0606a06169676 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:40.801496  6990 leader_election.cc:290] T 5ce18799382e46108fbcbed2c364321d P 25b7964825a6462295c0606a06169676 [CANDIDATE]: Term 2 election: Requested vote from peers 41999337784141c5834094008bf6ba97 (127.6.101.66:35001), bf2d93774f73406ead205c8ba8c9da13 (127.6.101.67:46675)
I20260709 14:49:40.804143  6725 leader_election.cc:304] T c8ac07644f37427e80f77c67ccac9328 P 41999337784141c5834094008bf6ba97 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41999337784141c5834094008bf6ba97; no voters: 25b7964825a6462295c0606a06169676, bf2d93774f73406ead205c8ba8c9da13
I20260709 14:49:40.806205  6725 leader_election.cc:304] T 1dbff5d6a7234db3a8f367fe9b30d615 P 41999337784141c5834094008bf6ba97 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41999337784141c5834094008bf6ba97; no voters: 25b7964825a6462295c0606a06169676, bf2d93774f73406ead205c8ba8c9da13
I20260709 14:49:40.807467  6994 raft_consensus.cc:2749] T c8ac07644f37427e80f77c67ccac9328 P 41999337784141c5834094008bf6ba97 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 14:49:40.808770  6650 leader_election.cc:304] T 3d8096f833ea45ce9471c56d3ce1a68b P 25b7964825a6462295c0606a06169676 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b7964825a6462295c0606a06169676, bf2d93774f73406ead205c8ba8c9da13; no voters: 41999337784141c5834094008bf6ba97
I20260709 14:49:40.809084  6994 raft_consensus.cc:2749] T 1dbff5d6a7234db3a8f367fe9b30d615 P 41999337784141c5834094008bf6ba97 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 14:49:40.811535  6796 leader_election.cc:304] T d58c1f5d4e1c448eab811059e23165cc P bf2d93774f73406ead205c8ba8c9da13 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf2d93774f73406ead205c8ba8c9da13; no voters: 25b7964825a6462295c0606a06169676, 41999337784141c5834094008bf6ba97
I20260709 14:49:40.811518  6725 leader_election.cc:304] T bc290da245804ddc92d9597c5da52a82 P 41999337784141c5834094008bf6ba97 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41999337784141c5834094008bf6ba97; no voters: 25b7964825a6462295c0606a06169676, bf2d93774f73406ead205c8ba8c9da13
I20260709 14:49:40.812849  6997 raft_consensus.cc:2749] T d58c1f5d4e1c448eab811059e23165cc P bf2d93774f73406ead205c8ba8c9da13 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 14:49:40.813896  6831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9352545ba44d68a3704b39c623e774" candidate_uuid: "25b7964825a6462295c0606a06169676" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bf2d93774f73406ead205c8ba8c9da13"
I20260709 14:49:40.814040  6796 leader_election.cc:304] T c8ac07644f37427e80f77c67ccac9328 P bf2d93774f73406ead205c8ba8c9da13 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf2d93774f73406ead205c8ba8c9da13; no voters: 25b7964825a6462295c0606a06169676, 41999337784141c5834094008bf6ba97
I20260709 14:49:40.814613  6994 raft_consensus.cc:2749] T bc290da245804ddc92d9597c5da52a82 P 41999337784141c5834094008bf6ba97 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 14:49:40.815618  6997 raft_consensus.cc:2749] T c8ac07644f37427e80f77c67ccac9328 P bf2d93774f73406ead205c8ba8c9da13 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 14:49:40.815529  6991 raft_consensus.cc:515] T 07255af297cd4ac59277e81984f07f9c P 25b7964825a6462295c0606a06169676 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:40.818638  6756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce18799382e46108fbcbed2c364321d" candidate_uuid: "25b7964825a6462295c0606a06169676" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "41999337784141c5834094008bf6ba97"
I20260709 14:49:40.819151  6991 leader_election.cc:290] T 07255af297cd4ac59277e81984f07f9c P 25b7964825a6462295c0606a06169676 [CANDIDATE]: Term 2 election: Requested vote from peers 41999337784141c5834094008bf6ba97 (127.6.101.66:35001), bf2d93774f73406ead205c8ba8c9da13 (127.6.101.67:46675)
I20260709 14:49:40.820178  6759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07255af297cd4ac59277e81984f07f9c" candidate_uuid: "25b7964825a6462295c0606a06169676" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "41999337784141c5834094008bf6ba97"
I20260709 14:49:40.821277  6831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce18799382e46108fbcbed2c364321d" candidate_uuid: "25b7964825a6462295c0606a06169676" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf2d93774f73406ead205c8ba8c9da13"
I20260709 14:49:40.811743  6993 raft_consensus.cc:2804] T 3d8096f833ea45ce9471c56d3ce1a68b P 25b7964825a6462295c0606a06169676 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 14:49:40.822956  6993 raft_consensus.cc:493] T 3d8096f833ea45ce9471c56d3ce1a68b P 25b7964825a6462295c0606a06169676 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 41999337784141c5834094008bf6ba97)
I20260709 14:49:40.823414  6993 raft_consensus.cc:3060] T 3d8096f833ea45ce9471c56d3ce1a68b P 25b7964825a6462295c0606a06169676 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:49:40.823726  6831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07255af297cd4ac59277e81984f07f9c" candidate_uuid: "25b7964825a6462295c0606a06169676" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf2d93774f73406ead205c8ba8c9da13"
I20260709 14:49:40.825856  6650 leader_election.cc:304] T be9352545ba44d68a3704b39c623e774 P 25b7964825a6462295c0606a06169676 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b7964825a6462295c0606a06169676; no voters: 41999337784141c5834094008bf6ba97, bf2d93774f73406ead205c8ba8c9da13
I20260709 14:49:40.827217  6991 raft_consensus.cc:2749] T be9352545ba44d68a3704b39c623e774 P 25b7964825a6462295c0606a06169676 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 14:49:40.827873  6650 leader_election.cc:304] T 5ce18799382e46108fbcbed2c364321d P 25b7964825a6462295c0606a06169676 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b7964825a6462295c0606a06169676; no voters: 41999337784141c5834094008bf6ba97, bf2d93774f73406ead205c8ba8c9da13
I20260709 14:49:40.828846  6991 raft_consensus.cc:2749] T 5ce18799382e46108fbcbed2c364321d P 25b7964825a6462295c0606a06169676 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 14:49:40.829912  6650 leader_election.cc:304] T 07255af297cd4ac59277e81984f07f9c P 25b7964825a6462295c0606a06169676 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b7964825a6462295c0606a06169676; no voters: 41999337784141c5834094008bf6ba97, bf2d93774f73406ead205c8ba8c9da13
I20260709 14:49:40.831084  6991 raft_consensus.cc:2749] T 07255af297cd4ac59277e81984f07f9c P 25b7964825a6462295c0606a06169676 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 14:49:40.833940  6993 raft_consensus.cc:515] T 3d8096f833ea45ce9471c56d3ce1a68b P 25b7964825a6462295c0606a06169676 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:40.836488  6993 leader_election.cc:290] T 3d8096f833ea45ce9471c56d3ce1a68b P 25b7964825a6462295c0606a06169676 [CANDIDATE]: Term 3 election: Requested vote from peers 41999337784141c5834094008bf6ba97 (127.6.101.66:35001), bf2d93774f73406ead205c8ba8c9da13 (127.6.101.67:46675)
I20260709 14:49:40.838018  6759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d8096f833ea45ce9471c56d3ce1a68b" candidate_uuid: "25b7964825a6462295c0606a06169676" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "41999337784141c5834094008bf6ba97"
I20260709 14:49:40.838567  6831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d8096f833ea45ce9471c56d3ce1a68b" candidate_uuid: "25b7964825a6462295c0606a06169676" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bf2d93774f73406ead205c8ba8c9da13"
I20260709 14:49:40.840420  6650 leader_election.cc:304] T 3d8096f833ea45ce9471c56d3ce1a68b P 25b7964825a6462295c0606a06169676 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b7964825a6462295c0606a06169676; no voters: 41999337784141c5834094008bf6ba97, bf2d93774f73406ead205c8ba8c9da13
I20260709 14:49:40.841617  6993 raft_consensus.cc:2749] T 3d8096f833ea45ce9471c56d3ce1a68b P 25b7964825a6462295c0606a06169676 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 14:49:40.955591  6682 raft_consensus.cc:1240] T be9352545ba44d68a3704b39c623e774 P 25b7964825a6462295c0606a06169676 [term 3 FOLLOWER]: Rejecting Update request from peer bf2d93774f73406ead205c8ba8c9da13 for earlier term 2. Current term is 3. Ops: []
I20260709 14:49:40.958048  6997 consensus_queue.cc:1059] T be9352545ba44d68a3704b39c623e774 P bf2d93774f73406ead205c8ba8c9da13 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 14:49:40.959511  6995 raft_consensus.cc:3055] T be9352545ba44d68a3704b39c623e774 P bf2d93774f73406ead205c8ba8c9da13 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 14:49:40.960036  6995 raft_consensus.cc:740] T be9352545ba44d68a3704b39c623e774 P bf2d93774f73406ead205c8ba8c9da13 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bf2d93774f73406ead205c8ba8c9da13, State: Running, Role: LEADER
I20260709 14:49:40.961433  6995 consensus_queue.cc:260] T be9352545ba44d68a3704b39c623e774 P bf2d93774f73406ead205c8ba8c9da13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:40.963459  6995 raft_consensus.cc:3060] T be9352545ba44d68a3704b39c623e774 P bf2d93774f73406ead205c8ba8c9da13 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:49:40.987471  6682 raft_consensus.cc:1240] T 3d8096f833ea45ce9471c56d3ce1a68b P 25b7964825a6462295c0606a06169676 [term 3 FOLLOWER]: Rejecting Update request from peer 41999337784141c5834094008bf6ba97 for earlier term 2. Current term is 3. Ops: []
I20260709 14:49:40.989800  6994 consensus_queue.cc:1059] T 3d8096f833ea45ce9471c56d3ce1a68b P 41999337784141c5834094008bf6ba97 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 14:49:40.991330  6996 raft_consensus.cc:3055] T 3d8096f833ea45ce9471c56d3ce1a68b P 41999337784141c5834094008bf6ba97 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 14:49:40.991849  6996 raft_consensus.cc:740] T 3d8096f833ea45ce9471c56d3ce1a68b P 41999337784141c5834094008bf6ba97 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 41999337784141c5834094008bf6ba97, State: Running, Role: LEADER
I20260709 14:49:40.992900  6996 consensus_queue.cc:260] T 3d8096f833ea45ce9471c56d3ce1a68b P 41999337784141c5834094008bf6ba97 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:40.994495  6996 raft_consensus.cc:3060] T 3d8096f833ea45ce9471c56d3ce1a68b P 41999337784141c5834094008bf6ba97 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:49:40.999989  6682 raft_consensus.cc:1240] T 5ce18799382e46108fbcbed2c364321d P 25b7964825a6462295c0606a06169676 [term 2 FOLLOWER]: Rejecting Update request from peer 41999337784141c5834094008bf6ba97 for earlier term 1. Current term is 2. Ops: []
I20260709 14:49:41.001406  6994 consensus_queue.cc:1059] T 5ce18799382e46108fbcbed2c364321d P 41999337784141c5834094008bf6ba97 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 14:49:41.002511  6907 raft_consensus.cc:3055] T 5ce18799382e46108fbcbed2c364321d P 41999337784141c5834094008bf6ba97 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 14:49:41.003050  6907 raft_consensus.cc:740] T 5ce18799382e46108fbcbed2c364321d P 41999337784141c5834094008bf6ba97 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 41999337784141c5834094008bf6ba97, State: Running, Role: LEADER
I20260709 14:49:41.004151  6907 consensus_queue.cc:260] T 5ce18799382e46108fbcbed2c364321d P 41999337784141c5834094008bf6ba97 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:41.005731  6907 raft_consensus.cc:3060] T 5ce18799382e46108fbcbed2c364321d P 41999337784141c5834094008bf6ba97 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:49:41.008791  6682 raft_consensus.cc:1240] T 07255af297cd4ac59277e81984f07f9c P 25b7964825a6462295c0606a06169676 [term 2 FOLLOWER]: Rejecting Update request from peer 41999337784141c5834094008bf6ba97 for earlier term 1. Current term is 2. Ops: []
I20260709 14:49:41.012140  6998 consensus_queue.cc:1059] T 07255af297cd4ac59277e81984f07f9c P 41999337784141c5834094008bf6ba97 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 14:49:41.013788  6998 raft_consensus.cc:3055] T 07255af297cd4ac59277e81984f07f9c P 41999337784141c5834094008bf6ba97 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 14:49:41.014066  6998 raft_consensus.cc:740] T 07255af297cd4ac59277e81984f07f9c P 41999337784141c5834094008bf6ba97 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 41999337784141c5834094008bf6ba97, State: Running, Role: LEADER
I20260709 14:49:41.014838  6998 consensus_queue.cc:260] T 07255af297cd4ac59277e81984f07f9c P 41999337784141c5834094008bf6ba97 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:41.015789  6998 raft_consensus.cc:3060] T 07255af297cd4ac59277e81984f07f9c P 41999337784141c5834094008bf6ba97 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:49:42.062542  6998 raft_consensus.cc:493] T be9352545ba44d68a3704b39c623e774 P 41999337784141c5834094008bf6ba97 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bf2d93774f73406ead205c8ba8c9da13)
I20260709 14:49:42.064154  6998 raft_consensus.cc:515] T be9352545ba44d68a3704b39c623e774 P 41999337784141c5834094008bf6ba97 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:42.068945  6682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9352545ba44d68a3704b39c623e774" candidate_uuid: "41999337784141c5834094008bf6ba97" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25b7964825a6462295c0606a06169676" is_pre_election: true
I20260709 14:49:42.070003  6831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9352545ba44d68a3704b39c623e774" candidate_uuid: "41999337784141c5834094008bf6ba97" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bf2d93774f73406ead205c8ba8c9da13" is_pre_election: true
I20260709 14:49:42.070441  6682 raft_consensus.cc:2393] T be9352545ba44d68a3704b39c623e774 P 25b7964825a6462295c0606a06169676 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 41999337784141c5834094008bf6ba97 in current term 3: Already voted for candidate 25b7964825a6462295c0606a06169676 in this term.
I20260709 14:49:42.071120  6998 leader_election.cc:290] T be9352545ba44d68a3704b39c623e774 P 41999337784141c5834094008bf6ba97 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 25b7964825a6462295c0606a06169676 (127.6.101.65:34615), bf2d93774f73406ead205c8ba8c9da13 (127.6.101.67:46675)
I20260709 14:49:42.071252  6831 raft_consensus.cc:2468] T be9352545ba44d68a3704b39c623e774 P bf2d93774f73406ead205c8ba8c9da13 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41999337784141c5834094008bf6ba97 in term 3.
I20260709 14:49:42.073921  6725 leader_election.cc:304] T be9352545ba44d68a3704b39c623e774 P 41999337784141c5834094008bf6ba97 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 41999337784141c5834094008bf6ba97, bf2d93774f73406ead205c8ba8c9da13; no voters: 25b7964825a6462295c0606a06169676
I20260709 14:49:42.075428  6998 raft_consensus.cc:2804] T be9352545ba44d68a3704b39c623e774 P 41999337784141c5834094008bf6ba97 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 14:49:42.076017  6998 raft_consensus.cc:493] T be9352545ba44d68a3704b39c623e774 P 41999337784141c5834094008bf6ba97 [term 2 FOLLOWER]: Starting leader election (detected failure of leader bf2d93774f73406ead205c8ba8c9da13)
I20260709 14:49:42.076390  6998 raft_consensus.cc:3060] T be9352545ba44d68a3704b39c623e774 P 41999337784141c5834094008bf6ba97 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:49:42.084276  6998 raft_consensus.cc:515] T be9352545ba44d68a3704b39c623e774 P 41999337784141c5834094008bf6ba97 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:42.086952  6998 leader_election.cc:290] T be9352545ba44d68a3704b39c623e774 P 41999337784141c5834094008bf6ba97 [CANDIDATE]: Term 3 election: Requested vote from peers 25b7964825a6462295c0606a06169676 (127.6.101.65:34615), bf2d93774f73406ead205c8ba8c9da13 (127.6.101.67:46675)
I20260709 14:49:42.088217  6831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9352545ba44d68a3704b39c623e774" candidate_uuid: "41999337784141c5834094008bf6ba97" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bf2d93774f73406ead205c8ba8c9da13"
I20260709 14:49:42.088346  6682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9352545ba44d68a3704b39c623e774" candidate_uuid: "41999337784141c5834094008bf6ba97" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25b7964825a6462295c0606a06169676"
I20260709 14:49:42.089628  6682 raft_consensus.cc:2393] T be9352545ba44d68a3704b39c623e774 P 25b7964825a6462295c0606a06169676 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 41999337784141c5834094008bf6ba97 in current term 3: Already voted for candidate 25b7964825a6462295c0606a06169676 in this term.
I20260709 14:49:42.098634  6831 raft_consensus.cc:2468] T be9352545ba44d68a3704b39c623e774 P bf2d93774f73406ead205c8ba8c9da13 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41999337784141c5834094008bf6ba97 in term 3.
I20260709 14:49:42.099922  6725 leader_election.cc:304] T be9352545ba44d68a3704b39c623e774 P 41999337784141c5834094008bf6ba97 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 41999337784141c5834094008bf6ba97, bf2d93774f73406ead205c8ba8c9da13; no voters: 25b7964825a6462295c0606a06169676
I20260709 14:49:42.100994  6998 raft_consensus.cc:2804] T be9352545ba44d68a3704b39c623e774 P 41999337784141c5834094008bf6ba97 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 14:49:42.102332  6998 raft_consensus.cc:697] T be9352545ba44d68a3704b39c623e774 P 41999337784141c5834094008bf6ba97 [term 3 LEADER]: Becoming Leader. State: Replica: 41999337784141c5834094008bf6ba97, State: Running, Role: LEADER
I20260709 14:49:42.103219  6998 consensus_queue.cc:237] T be9352545ba44d68a3704b39c623e774 P 41999337784141c5834094008bf6ba97 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:42.121080  6579 catalog_manager.cc:5697] T be9352545ba44d68a3704b39c623e774 P 41999337784141c5834094008bf6ba97 reported cstate change: term changed from 2 to 3, leader changed from bf2d93774f73406ead205c8ba8c9da13 (127.6.101.67) to 41999337784141c5834094008bf6ba97 (127.6.101.66). New cstate: current_term: 3 leader_uuid: "41999337784141c5834094008bf6ba97" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } health_report { overall_health: UNKNOWN } } }
I20260709 14:49:42.264094  6998 raft_consensus.cc:493] T 3d8096f833ea45ce9471c56d3ce1a68b P 41999337784141c5834094008bf6ba97 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:49:42.265462  6998 raft_consensus.cc:515] T 3d8096f833ea45ce9471c56d3ce1a68b P 41999337784141c5834094008bf6ba97 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:42.272270  6682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d8096f833ea45ce9471c56d3ce1a68b" candidate_uuid: "41999337784141c5834094008bf6ba97" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25b7964825a6462295c0606a06169676" is_pre_election: true
I20260709 14:49:42.273821  6831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d8096f833ea45ce9471c56d3ce1a68b" candidate_uuid: "41999337784141c5834094008bf6ba97" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bf2d93774f73406ead205c8ba8c9da13" is_pre_election: true
I20260709 14:49:42.274648  6682 raft_consensus.cc:2468] T 3d8096f833ea45ce9471c56d3ce1a68b P 25b7964825a6462295c0606a06169676 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41999337784141c5834094008bf6ba97 in term 3.
I20260709 14:49:42.277177  6998 leader_election.cc:290] T 3d8096f833ea45ce9471c56d3ce1a68b P 41999337784141c5834094008bf6ba97 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 25b7964825a6462295c0606a06169676 (127.6.101.65:34615), bf2d93774f73406ead205c8ba8c9da13 (127.6.101.67:46675)
I20260709 14:49:42.277920  6722 leader_election.cc:304] T 3d8096f833ea45ce9471c56d3ce1a68b P 41999337784141c5834094008bf6ba97 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b7964825a6462295c0606a06169676, 41999337784141c5834094008bf6ba97; no voters: bf2d93774f73406ead205c8ba8c9da13
I20260709 14:49:42.279014  6998 raft_consensus.cc:2804] T 3d8096f833ea45ce9471c56d3ce1a68b P 41999337784141c5834094008bf6ba97 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 14:49:42.279520  6998 raft_consensus.cc:493] T 3d8096f833ea45ce9471c56d3ce1a68b P 41999337784141c5834094008bf6ba97 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:49:42.279857  6998 raft_consensus.cc:3060] T 3d8096f833ea45ce9471c56d3ce1a68b P 41999337784141c5834094008bf6ba97 [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:49:42.293124  6549 auto_leader_rebalancer-test.cc:378] The leader distribution is 
I20260709 14:49:42.294904  6549 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 14:49:42.295454  6998 raft_consensus.cc:515] T 3d8096f833ea45ce9471c56d3ce1a68b P 41999337784141c5834094008bf6ba97 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:42.298724  6998 leader_election.cc:290] T 3d8096f833ea45ce9471c56d3ce1a68b P 41999337784141c5834094008bf6ba97 [CANDIDATE]: Term 4 election: Requested vote from peers 25b7964825a6462295c0606a06169676 (127.6.101.65:34615), bf2d93774f73406ead205c8ba8c9da13 (127.6.101.67:46675)
I20260709 14:49:42.299965  6682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d8096f833ea45ce9471c56d3ce1a68b" candidate_uuid: "41999337784141c5834094008bf6ba97" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25b7964825a6462295c0606a06169676"
I20260709 14:49:42.300603  6831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d8096f833ea45ce9471c56d3ce1a68b" candidate_uuid: "41999337784141c5834094008bf6ba97" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bf2d93774f73406ead205c8ba8c9da13"
I20260709 14:49:42.301083  6682 raft_consensus.cc:3060] T 3d8096f833ea45ce9471c56d3ce1a68b P 25b7964825a6462295c0606a06169676 [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:49:42.324034  6682 raft_consensus.cc:2468] T 3d8096f833ea45ce9471c56d3ce1a68b P 25b7964825a6462295c0606a06169676 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41999337784141c5834094008bf6ba97 in term 4.
I20260709 14:49:42.325227  7009 raft_consensus.cc:493] T 07255af297cd4ac59277e81984f07f9c P bf2d93774f73406ead205c8ba8c9da13 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 41999337784141c5834094008bf6ba97)
I20260709 14:49:42.326042  7009 raft_consensus.cc:515] T 07255af297cd4ac59277e81984f07f9c P bf2d93774f73406ead205c8ba8c9da13 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:42.328927  7009 leader_election.cc:290] T 07255af297cd4ac59277e81984f07f9c P bf2d93774f73406ead205c8ba8c9da13 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 25b7964825a6462295c0606a06169676 (127.6.101.65:34615), 41999337784141c5834094008bf6ba97 (127.6.101.66:35001)
I20260709 14:49:42.329562  7009 raft_consensus.cc:493] T 3d8096f833ea45ce9471c56d3ce1a68b P bf2d93774f73406ead205c8ba8c9da13 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 41999337784141c5834094008bf6ba97)
I20260709 14:49:42.330132  7009 raft_consensus.cc:515] T 3d8096f833ea45ce9471c56d3ce1a68b P bf2d93774f73406ead205c8ba8c9da13 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:42.332891  7009 leader_election.cc:290] T 3d8096f833ea45ce9471c56d3ce1a68b P bf2d93774f73406ead205c8ba8c9da13 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 25b7964825a6462295c0606a06169676 (127.6.101.65:34615), 41999337784141c5834094008bf6ba97 (127.6.101.66:35001)
I20260709 14:49:42.335220  6681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07255af297cd4ac59277e81984f07f9c" candidate_uuid: "bf2d93774f73406ead205c8ba8c9da13" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25b7964825a6462295c0606a06169676" is_pre_election: true
I20260709 14:49:42.335220  6722 leader_election.cc:304] T 3d8096f833ea45ce9471c56d3ce1a68b P 41999337784141c5834094008bf6ba97 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b7964825a6462295c0606a06169676, 41999337784141c5834094008bf6ba97; no voters: bf2d93774f73406ead205c8ba8c9da13
I20260709 14:49:42.336779  6681 raft_consensus.cc:2393] T 07255af297cd4ac59277e81984f07f9c P 25b7964825a6462295c0606a06169676 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bf2d93774f73406ead205c8ba8c9da13 in current term 2: Already voted for candidate 25b7964825a6462295c0606a06169676 in this term.
I20260709 14:49:42.337476  6998 raft_consensus.cc:2804] T 3d8096f833ea45ce9471c56d3ce1a68b P 41999337784141c5834094008bf6ba97 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 14:49:42.338215  6998 raft_consensus.cc:697] T 3d8096f833ea45ce9471c56d3ce1a68b P 41999337784141c5834094008bf6ba97 [term 4 LEADER]: Becoming Leader. State: Replica: 41999337784141c5834094008bf6ba97, State: Running, Role: LEADER
I20260709 14:49:42.332691  6759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07255af297cd4ac59277e81984f07f9c" candidate_uuid: "bf2d93774f73406ead205c8ba8c9da13" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "41999337784141c5834094008bf6ba97" is_pre_election: true
I20260709 14:49:42.339481  6759 raft_consensus.cc:2468] T 07255af297cd4ac59277e81984f07f9c P 41999337784141c5834094008bf6ba97 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf2d93774f73406ead205c8ba8c9da13 in term 2.
I20260709 14:49:42.339751  6998 consensus_queue.cc:237] T 3d8096f833ea45ce9471c56d3ce1a68b P 41999337784141c5834094008bf6ba97 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:42.345817  6681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d8096f833ea45ce9471c56d3ce1a68b" candidate_uuid: "bf2d93774f73406ead205c8ba8c9da13" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25b7964825a6462295c0606a06169676" is_pre_election: true
I20260709 14:49:42.347087  6681 raft_consensus.cc:2368] T 3d8096f833ea45ce9471c56d3ce1a68b P 25b7964825a6462295c0606a06169676 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bf2d93774f73406ead205c8ba8c9da13 for earlier term 3. Current term is 4.
I20260709 14:49:42.346884  6797 leader_election.cc:304] T 07255af297cd4ac59277e81984f07f9c P bf2d93774f73406ead205c8ba8c9da13 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 41999337784141c5834094008bf6ba97, bf2d93774f73406ead205c8ba8c9da13; no voters: 25b7964825a6462295c0606a06169676
I20260709 14:49:42.348389  7009 raft_consensus.cc:2804] T 07255af297cd4ac59277e81984f07f9c P bf2d93774f73406ead205c8ba8c9da13 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 14:49:42.348907  7009 raft_consensus.cc:493] T 07255af297cd4ac59277e81984f07f9c P bf2d93774f73406ead205c8ba8c9da13 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 41999337784141c5834094008bf6ba97)
I20260709 14:49:42.349423  6759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d8096f833ea45ce9471c56d3ce1a68b" candidate_uuid: "bf2d93774f73406ead205c8ba8c9da13" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "41999337784141c5834094008bf6ba97" is_pre_election: true
I20260709 14:49:42.349803  6796 leader_election.cc:400] T 3d8096f833ea45ce9471c56d3ce1a68b P bf2d93774f73406ead205c8ba8c9da13 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 25b7964825a6462295c0606a06169676 (127.6.101.65:34615) with higher term. Message: Invalid argument: T 3d8096f833ea45ce9471c56d3ce1a68b P 25b7964825a6462295c0606a06169676 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bf2d93774f73406ead205c8ba8c9da13 for earlier term 3. Current term is 4.
I20260709 14:49:42.350136  6796 leader_election.cc:403] T 3d8096f833ea45ce9471c56d3ce1a68b P bf2d93774f73406ead205c8ba8c9da13 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 14:49:42.349416  7009 raft_consensus.cc:3060] T 07255af297cd4ac59277e81984f07f9c P bf2d93774f73406ead205c8ba8c9da13 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:49:42.366547  6578 catalog_manager.cc:5697] T 3d8096f833ea45ce9471c56d3ce1a68b P 41999337784141c5834094008bf6ba97 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "41999337784141c5834094008bf6ba97" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } health_report { overall_health: UNKNOWN } } }
I20260709 14:49:42.370324  7010 raft_consensus.cc:3060] T 3d8096f833ea45ce9471c56d3ce1a68b P bf2d93774f73406ead205c8ba8c9da13 [term 2 FOLLOWER]: Advancing to term 4
I20260709 14:49:42.368657  7009 raft_consensus.cc:515] T 07255af297cd4ac59277e81984f07f9c P bf2d93774f73406ead205c8ba8c9da13 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:42.383072  7009 leader_election.cc:290] T 07255af297cd4ac59277e81984f07f9c P bf2d93774f73406ead205c8ba8c9da13 [CANDIDATE]: Term 2 election: Requested vote from peers 25b7964825a6462295c0606a06169676 (127.6.101.65:34615), 41999337784141c5834094008bf6ba97 (127.6.101.66:35001)
I20260709 14:49:42.386340  6759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07255af297cd4ac59277e81984f07f9c" candidate_uuid: "bf2d93774f73406ead205c8ba8c9da13" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "41999337784141c5834094008bf6ba97"
I20260709 14:49:42.387910  6682 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1dbff5d6a7234db3a8f367fe9b30d615"
dest_uuid: "25b7964825a6462295c0606a06169676"
mode: GRACEFUL
new_leader_uuid: "bf2d93774f73406ead205c8ba8c9da13"
 from {username='slave'} at 127.0.0.1:42214
I20260709 14:49:42.388876  6682 raft_consensus.cc:606] T 1dbff5d6a7234db3a8f367fe9b30d615 P 25b7964825a6462295c0606a06169676 [term 2 LEADER]: Received request to transfer leadership to TS bf2d93774f73406ead205c8ba8c9da13
I20260709 14:49:42.389881  6681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07255af297cd4ac59277e81984f07f9c" candidate_uuid: "bf2d93774f73406ead205c8ba8c9da13" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25b7964825a6462295c0606a06169676"
I20260709 14:49:42.391256  6681 raft_consensus.cc:2393] T 07255af297cd4ac59277e81984f07f9c P 25b7964825a6462295c0606a06169676 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate bf2d93774f73406ead205c8ba8c9da13 in current term 2: Already voted for candidate 25b7964825a6462295c0606a06169676 in this term.
I20260709 14:49:42.399885  7010 raft_consensus.cc:2749] T 3d8096f833ea45ce9471c56d3ce1a68b P bf2d93774f73406ead205c8ba8c9da13 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 25b7964825a6462295c0606a06169676 (127.6.101.65:34615) with higher term. Message: Invalid argument: T 3d8096f833ea45ce9471c56d3ce1a68b P 25b7964825a6462295c0606a06169676 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bf2d93774f73406ead205c8ba8c9da13 for earlier term 3. Current term is 4.
I20260709 14:49:42.400494  6759 raft_consensus.cc:2468] T 07255af297cd4ac59277e81984f07f9c P 41999337784141c5834094008bf6ba97 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf2d93774f73406ead205c8ba8c9da13 in term 2.
I20260709 14:49:42.402580  6797 leader_election.cc:304] T 07255af297cd4ac59277e81984f07f9c P bf2d93774f73406ead205c8ba8c9da13 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 41999337784141c5834094008bf6ba97, bf2d93774f73406ead205c8ba8c9da13; no voters: 25b7964825a6462295c0606a06169676
I20260709 14:49:42.403491  7010 raft_consensus.cc:2804] T 07255af297cd4ac59277e81984f07f9c P bf2d93774f73406ead205c8ba8c9da13 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:49:42.404018  7010 raft_consensus.cc:697] T 07255af297cd4ac59277e81984f07f9c P bf2d93774f73406ead205c8ba8c9da13 [term 2 LEADER]: Becoming Leader. State: Replica: bf2d93774f73406ead205c8ba8c9da13, State: Running, Role: LEADER
I20260709 14:49:42.404927  7010 consensus_queue.cc:237] T 07255af297cd4ac59277e81984f07f9c P bf2d93774f73406ead205c8ba8c9da13 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:42.418833  6578 catalog_manager.cc:5697] T 07255af297cd4ac59277e81984f07f9c P bf2d93774f73406ead205c8ba8c9da13 reported cstate change: term changed from 1 to 2, leader changed from 41999337784141c5834094008bf6ba97 (127.6.101.66) to bf2d93774f73406ead205c8ba8c9da13 (127.6.101.67). New cstate: current_term: 2 leader_uuid: "bf2d93774f73406ead205c8ba8c9da13" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } health_report { overall_health: HEALTHY } } }
I20260709 14:49:42.423627  6759 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3d8096f833ea45ce9471c56d3ce1a68b"
dest_uuid: "41999337784141c5834094008bf6ba97"
mode: GRACEFUL
new_leader_uuid: "bf2d93774f73406ead205c8ba8c9da13"
 from {username='slave'} at 127.0.0.1:49668
I20260709 14:49:42.424577  6759 raft_consensus.cc:606] T 3d8096f833ea45ce9471c56d3ce1a68b P 41999337784141c5834094008bf6ba97 [term 4 LEADER]: Received request to transfer leadership to TS bf2d93774f73406ead205c8ba8c9da13
I20260709 14:49:42.430238  6759 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5ce18799382e46108fbcbed2c364321d"
dest_uuid: "41999337784141c5834094008bf6ba97"
mode: GRACEFUL
new_leader_uuid: "bf2d93774f73406ead205c8ba8c9da13"
 from {username='slave'} at 127.0.0.1:49668
I20260709 14:49:42.431116  6759 raft_consensus.cc:606] T 5ce18799382e46108fbcbed2c364321d P 41999337784141c5834094008bf6ba97 [term 2 FOLLOWER]: Received request to transfer leadership to TS bf2d93774f73406ead205c8ba8c9da13
I20260709 14:49:42.431577  6759 raft_consensus.cc:614] T 5ce18799382e46108fbcbed2c364321d P 41999337784141c5834094008bf6ba97 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 14:49:42.433300  6549 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 14:49:42.434388  6549 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 14:49:42.450284  7010 raft_consensus.cc:493] T 5ce18799382e46108fbcbed2c364321d P bf2d93774f73406ead205c8ba8c9da13 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 41999337784141c5834094008bf6ba97)
I20260709 14:49:42.451118  7010 raft_consensus.cc:515] T 5ce18799382e46108fbcbed2c364321d P bf2d93774f73406ead205c8ba8c9da13 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:42.453712  7010 leader_election.cc:290] T 5ce18799382e46108fbcbed2c364321d P bf2d93774f73406ead205c8ba8c9da13 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 25b7964825a6462295c0606a06169676 (127.6.101.65:34615), 41999337784141c5834094008bf6ba97 (127.6.101.66:35001)
I20260709 14:49:42.455178  6681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce18799382e46108fbcbed2c364321d" candidate_uuid: "bf2d93774f73406ead205c8ba8c9da13" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25b7964825a6462295c0606a06169676" is_pre_election: true
I20260709 14:49:42.455366  6759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce18799382e46108fbcbed2c364321d" candidate_uuid: "bf2d93774f73406ead205c8ba8c9da13" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "41999337784141c5834094008bf6ba97" is_pre_election: true
I20260709 14:49:42.456176  6681 raft_consensus.cc:2393] T 5ce18799382e46108fbcbed2c364321d P 25b7964825a6462295c0606a06169676 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bf2d93774f73406ead205c8ba8c9da13 in current term 2: Already voted for candidate 25b7964825a6462295c0606a06169676 in this term.
I20260709 14:49:42.456138  6759 raft_consensus.cc:2468] T 5ce18799382e46108fbcbed2c364321d P 41999337784141c5834094008bf6ba97 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf2d93774f73406ead205c8ba8c9da13 in term 2.
I20260709 14:49:42.457530  6797 leader_election.cc:304] T 5ce18799382e46108fbcbed2c364321d P bf2d93774f73406ead205c8ba8c9da13 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41999337784141c5834094008bf6ba97, bf2d93774f73406ead205c8ba8c9da13; no voters: 
I20260709 14:49:42.458483  7010 raft_consensus.cc:2804] T 5ce18799382e46108fbcbed2c364321d P bf2d93774f73406ead205c8ba8c9da13 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 14:49:42.458894  7010 raft_consensus.cc:493] T 5ce18799382e46108fbcbed2c364321d P bf2d93774f73406ead205c8ba8c9da13 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 41999337784141c5834094008bf6ba97)
I20260709 14:49:42.459209  7010 raft_consensus.cc:3060] T 5ce18799382e46108fbcbed2c364321d P bf2d93774f73406ead205c8ba8c9da13 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:49:42.466380  7010 raft_consensus.cc:515] T 5ce18799382e46108fbcbed2c364321d P bf2d93774f73406ead205c8ba8c9da13 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:42.468401  7010 leader_election.cc:290] T 5ce18799382e46108fbcbed2c364321d P bf2d93774f73406ead205c8ba8c9da13 [CANDIDATE]: Term 2 election: Requested vote from peers 25b7964825a6462295c0606a06169676 (127.6.101.65:34615), 41999337784141c5834094008bf6ba97 (127.6.101.66:35001)
I20260709 14:49:42.469625  6759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce18799382e46108fbcbed2c364321d" candidate_uuid: "bf2d93774f73406ead205c8ba8c9da13" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "41999337784141c5834094008bf6ba97"
I20260709 14:49:42.469638  6681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce18799382e46108fbcbed2c364321d" candidate_uuid: "bf2d93774f73406ead205c8ba8c9da13" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25b7964825a6462295c0606a06169676"
I20260709 14:49:42.470685  6681 raft_consensus.cc:2393] T 5ce18799382e46108fbcbed2c364321d P 25b7964825a6462295c0606a06169676 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate bf2d93774f73406ead205c8ba8c9da13 in current term 2: Already voted for candidate 25b7964825a6462295c0606a06169676 in this term.
I20260709 14:49:42.476943  6759 raft_consensus.cc:2468] T 5ce18799382e46108fbcbed2c364321d P 41999337784141c5834094008bf6ba97 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf2d93774f73406ead205c8ba8c9da13 in term 2.
I20260709 14:49:42.478678  6797 leader_election.cc:304] T 5ce18799382e46108fbcbed2c364321d P bf2d93774f73406ead205c8ba8c9da13 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 41999337784141c5834094008bf6ba97, bf2d93774f73406ead205c8ba8c9da13; no voters: 25b7964825a6462295c0606a06169676
I20260709 14:49:42.480556  7010 raft_consensus.cc:2804] T 5ce18799382e46108fbcbed2c364321d P bf2d93774f73406ead205c8ba8c9da13 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:49:42.481158  7010 raft_consensus.cc:697] T 5ce18799382e46108fbcbed2c364321d P bf2d93774f73406ead205c8ba8c9da13 [term 2 LEADER]: Becoming Leader. State: Replica: bf2d93774f73406ead205c8ba8c9da13, State: Running, Role: LEADER
I20260709 14:49:42.482401  7010 consensus_queue.cc:237] T 5ce18799382e46108fbcbed2c364321d P bf2d93774f73406ead205c8ba8c9da13 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:42.492388  6578 catalog_manager.cc:5697] T 5ce18799382e46108fbcbed2c364321d P bf2d93774f73406ead205c8ba8c9da13 reported cstate change: term changed from 1 to 2, leader changed from 41999337784141c5834094008bf6ba97 (127.6.101.66) to bf2d93774f73406ead205c8ba8c9da13 (127.6.101.67). New cstate: current_term: 2 leader_uuid: "bf2d93774f73406ead205c8ba8c9da13" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } health_report { overall_health: HEALTHY } } }
I20260709 14:49:42.597470  6831 raft_consensus.cc:1275] T be9352545ba44d68a3704b39c623e774 P bf2d93774f73406ead205c8ba8c9da13 [term 3 FOLLOWER]: Refusing update from remote peer 41999337784141c5834094008bf6ba97: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 14:49:42.599124  6998 consensus_queue.cc:1048] T be9352545ba44d68a3704b39c623e774 P 41999337784141c5834094008bf6ba97 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 14:49:42.627746  6681 raft_consensus.cc:1275] T be9352545ba44d68a3704b39c623e774 P 25b7964825a6462295c0606a06169676 [term 3 FOLLOWER]: Refusing update from remote peer 41999337784141c5834094008bf6ba97: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 14:49:42.629913  6998 consensus_queue.cc:1048] T be9352545ba44d68a3704b39c623e774 P 41999337784141c5834094008bf6ba97 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 14:49:42.708161  6993 raft_consensus.cc:493] T 07255af297cd4ac59277e81984f07f9c P 25b7964825a6462295c0606a06169676 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:49:42.708752  6993 raft_consensus.cc:515] T 07255af297cd4ac59277e81984f07f9c P 25b7964825a6462295c0606a06169676 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:42.711447  6993 leader_election.cc:290] T 07255af297cd4ac59277e81984f07f9c P 25b7964825a6462295c0606a06169676 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 41999337784141c5834094008bf6ba97 (127.6.101.66:35001), bf2d93774f73406ead205c8ba8c9da13 (127.6.101.67:46675)
I20260709 14:49:42.712563  6759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07255af297cd4ac59277e81984f07f9c" candidate_uuid: "25b7964825a6462295c0606a06169676" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "41999337784141c5834094008bf6ba97" is_pre_election: true
I20260709 14:49:42.713347  6832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07255af297cd4ac59277e81984f07f9c" candidate_uuid: "25b7964825a6462295c0606a06169676" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf2d93774f73406ead205c8ba8c9da13" is_pre_election: true
I20260709 14:49:42.713382  6759 raft_consensus.cc:2468] T 07255af297cd4ac59277e81984f07f9c P 41999337784141c5834094008bf6ba97 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b7964825a6462295c0606a06169676 in term 2.
I20260709 14:49:42.715525  6648 leader_election.cc:304] T 07255af297cd4ac59277e81984f07f9c P 25b7964825a6462295c0606a06169676 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b7964825a6462295c0606a06169676, 41999337784141c5834094008bf6ba97; no voters: bf2d93774f73406ead205c8ba8c9da13
I20260709 14:49:42.716681  6993 raft_consensus.cc:2804] T 07255af297cd4ac59277e81984f07f9c P 25b7964825a6462295c0606a06169676 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 14:49:42.717156  6993 raft_consensus.cc:493] T 07255af297cd4ac59277e81984f07f9c P 25b7964825a6462295c0606a06169676 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:49:42.717557  6993 raft_consensus.cc:3060] T 07255af297cd4ac59277e81984f07f9c P 25b7964825a6462295c0606a06169676 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:49:42.724884  6993 raft_consensus.cc:515] T 07255af297cd4ac59277e81984f07f9c P 25b7964825a6462295c0606a06169676 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:42.727847  6993 leader_election.cc:290] T 07255af297cd4ac59277e81984f07f9c P 25b7964825a6462295c0606a06169676 [CANDIDATE]: Term 3 election: Requested vote from peers 41999337784141c5834094008bf6ba97 (127.6.101.66:35001), bf2d93774f73406ead205c8ba8c9da13 (127.6.101.67:46675)
I20260709 14:49:42.728200  6832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07255af297cd4ac59277e81984f07f9c" candidate_uuid: "25b7964825a6462295c0606a06169676" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf2d93774f73406ead205c8ba8c9da13"
I20260709 14:49:42.728405  6759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07255af297cd4ac59277e81984f07f9c" candidate_uuid: "25b7964825a6462295c0606a06169676" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "41999337784141c5834094008bf6ba97"
I20260709 14:49:42.729493  6759 raft_consensus.cc:3060] T 07255af297cd4ac59277e81984f07f9c P 41999337784141c5834094008bf6ba97 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:49:42.738098  6759 raft_consensus.cc:2468] T 07255af297cd4ac59277e81984f07f9c P 41999337784141c5834094008bf6ba97 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b7964825a6462295c0606a06169676 in term 3.
I20260709 14:49:42.739811  6648 leader_election.cc:304] T 07255af297cd4ac59277e81984f07f9c P 25b7964825a6462295c0606a06169676 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b7964825a6462295c0606a06169676, 41999337784141c5834094008bf6ba97; no voters: bf2d93774f73406ead205c8ba8c9da13
I20260709 14:49:42.741295  6993 raft_consensus.cc:2804] T 07255af297cd4ac59277e81984f07f9c P 25b7964825a6462295c0606a06169676 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 14:49:42.741919  6993 raft_consensus.cc:697] T 07255af297cd4ac59277e81984f07f9c P 25b7964825a6462295c0606a06169676 [term 3 LEADER]: Becoming Leader. State: Replica: 25b7964825a6462295c0606a06169676, State: Running, Role: LEADER
I20260709 14:49:42.742928  6993 consensus_queue.cc:237] T 07255af297cd4ac59277e81984f07f9c P 25b7964825a6462295c0606a06169676 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:42.754148  6579 catalog_manager.cc:5697] T 07255af297cd4ac59277e81984f07f9c P 25b7964825a6462295c0606a06169676 reported cstate change: term changed from 2 to 3, leader changed from bf2d93774f73406ead205c8ba8c9da13 (127.6.101.67) to 25b7964825a6462295c0606a06169676 (127.6.101.65). New cstate: current_term: 3 leader_uuid: "25b7964825a6462295c0606a06169676" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } health_report { overall_health: UNKNOWN } } }
I20260709 14:49:42.762912  6993 raft_consensus.cc:493] T 5ce18799382e46108fbcbed2c364321d P 25b7964825a6462295c0606a06169676 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:49:42.764191  6993 raft_consensus.cc:515] T 5ce18799382e46108fbcbed2c364321d P 25b7964825a6462295c0606a06169676 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:42.767979  6993 leader_election.cc:290] T 5ce18799382e46108fbcbed2c364321d P 25b7964825a6462295c0606a06169676 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 41999337784141c5834094008bf6ba97 (127.6.101.66:35001), bf2d93774f73406ead205c8ba8c9da13 (127.6.101.67:46675)
I20260709 14:49:42.768123  6759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce18799382e46108fbcbed2c364321d" candidate_uuid: "25b7964825a6462295c0606a06169676" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "41999337784141c5834094008bf6ba97" is_pre_election: true
I20260709 14:49:42.768882  6759 raft_consensus.cc:2468] T 5ce18799382e46108fbcbed2c364321d P 41999337784141c5834094008bf6ba97 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b7964825a6462295c0606a06169676 in term 2.
I20260709 14:49:42.769109  6832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce18799382e46108fbcbed2c364321d" candidate_uuid: "25b7964825a6462295c0606a06169676" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf2d93774f73406ead205c8ba8c9da13" is_pre_election: true
I20260709 14:49:42.770139  6648 leader_election.cc:304] T 5ce18799382e46108fbcbed2c364321d P 25b7964825a6462295c0606a06169676 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b7964825a6462295c0606a06169676, 41999337784141c5834094008bf6ba97; no voters: 
I20260709 14:49:42.771114  6993 raft_consensus.cc:2804] T 5ce18799382e46108fbcbed2c364321d P 25b7964825a6462295c0606a06169676 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 14:49:42.771517  6993 raft_consensus.cc:493] T 5ce18799382e46108fbcbed2c364321d P 25b7964825a6462295c0606a06169676 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:49:42.771896  6993 raft_consensus.cc:3060] T 5ce18799382e46108fbcbed2c364321d P 25b7964825a6462295c0606a06169676 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:49:42.778852  6993 raft_consensus.cc:515] T 5ce18799382e46108fbcbed2c364321d P 25b7964825a6462295c0606a06169676 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:42.780853  6993 leader_election.cc:290] T 5ce18799382e46108fbcbed2c364321d P 25b7964825a6462295c0606a06169676 [CANDIDATE]: Term 3 election: Requested vote from peers 41999337784141c5834094008bf6ba97 (127.6.101.66:35001), bf2d93774f73406ead205c8ba8c9da13 (127.6.101.67:46675)
I20260709 14:49:42.782270  6759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce18799382e46108fbcbed2c364321d" candidate_uuid: "25b7964825a6462295c0606a06169676" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "41999337784141c5834094008bf6ba97"
I20260709 14:49:42.782924  6759 raft_consensus.cc:3060] T 5ce18799382e46108fbcbed2c364321d P 41999337784141c5834094008bf6ba97 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:49:42.782536  6832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce18799382e46108fbcbed2c364321d" candidate_uuid: "25b7964825a6462295c0606a06169676" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf2d93774f73406ead205c8ba8c9da13"
I20260709 14:49:42.789198  6759 raft_consensus.cc:2468] T 5ce18799382e46108fbcbed2c364321d P 41999337784141c5834094008bf6ba97 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b7964825a6462295c0606a06169676 in term 3.
I20260709 14:49:42.790822  6648 leader_election.cc:304] T 5ce18799382e46108fbcbed2c364321d P 25b7964825a6462295c0606a06169676 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b7964825a6462295c0606a06169676, 41999337784141c5834094008bf6ba97; no voters: bf2d93774f73406ead205c8ba8c9da13
I20260709 14:49:42.791779  6993 raft_consensus.cc:2804] T 5ce18799382e46108fbcbed2c364321d P 25b7964825a6462295c0606a06169676 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 14:49:42.792335  6993 raft_consensus.cc:697] T 5ce18799382e46108fbcbed2c364321d P 25b7964825a6462295c0606a06169676 [term 3 LEADER]: Becoming Leader. State: Replica: 25b7964825a6462295c0606a06169676, State: Running, Role: LEADER
I20260709 14:49:42.793217  6993 consensus_queue.cc:237] T 5ce18799382e46108fbcbed2c364321d P 25b7964825a6462295c0606a06169676 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:42.802603  6579 catalog_manager.cc:5697] T 5ce18799382e46108fbcbed2c364321d P 25b7964825a6462295c0606a06169676 reported cstate change: term changed from 2 to 3, leader changed from bf2d93774f73406ead205c8ba8c9da13 (127.6.101.67) to 25b7964825a6462295c0606a06169676 (127.6.101.65). New cstate: current_term: 3 leader_uuid: "25b7964825a6462295c0606a06169676" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } health_report { overall_health: UNKNOWN } } }
I20260709 14:49:42.817863  6832 raft_consensus.cc:1275] T 3d8096f833ea45ce9471c56d3ce1a68b P bf2d93774f73406ead205c8ba8c9da13 [term 4 FOLLOWER]: Refusing update from remote peer 41999337784141c5834094008bf6ba97: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 14:49:42.819496  6998 consensus_queue.cc:1048] T 3d8096f833ea45ce9471c56d3ce1a68b P 41999337784141c5834094008bf6ba97 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 14:49:42.823218  6759 raft_consensus.cc:1240] T 07255af297cd4ac59277e81984f07f9c P 41999337784141c5834094008bf6ba97 [term 3 FOLLOWER]: Rejecting Update request from peer bf2d93774f73406ead205c8ba8c9da13 for earlier term 2. Current term is 3. Ops: []
I20260709 14:49:42.826093  7009 consensus_queue.cc:1059] T 07255af297cd4ac59277e81984f07f9c P bf2d93774f73406ead205c8ba8c9da13 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 14:49:42.827207  7009 raft_consensus.cc:3055] T 07255af297cd4ac59277e81984f07f9c P bf2d93774f73406ead205c8ba8c9da13 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 14:49:42.827560  7009 raft_consensus.cc:740] T 07255af297cd4ac59277e81984f07f9c P bf2d93774f73406ead205c8ba8c9da13 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bf2d93774f73406ead205c8ba8c9da13, State: Running, Role: LEADER
I20260709 14:49:42.828755  7009 consensus_queue.cc:260] T 07255af297cd4ac59277e81984f07f9c P bf2d93774f73406ead205c8ba8c9da13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:42.830590  7009 raft_consensus.cc:3060] T 07255af297cd4ac59277e81984f07f9c P bf2d93774f73406ead205c8ba8c9da13 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:49:42.833069  7001 raft_consensus.cc:993] T 3d8096f833ea45ce9471c56d3ce1a68b P 41999337784141c5834094008bf6ba97: : Instructing follower bf2d93774f73406ead205c8ba8c9da13 to start an election
I20260709 14:49:42.833724  7001 raft_consensus.cc:1081] T 3d8096f833ea45ce9471c56d3ce1a68b P 41999337784141c5834094008bf6ba97 [term 4 LEADER]: Signalling peer bf2d93774f73406ead205c8ba8c9da13 to start an election
I20260709 14:49:42.837535  6831 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3d8096f833ea45ce9471c56d3ce1a68b"
dest_uuid: "bf2d93774f73406ead205c8ba8c9da13"
 from {username='slave'} at 127.0.0.1:46176
I20260709 14:49:42.838281  6831 raft_consensus.cc:493] T 3d8096f833ea45ce9471c56d3ce1a68b P bf2d93774f73406ead205c8ba8c9da13 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:49:42.838653  6831 raft_consensus.cc:3060] T 3d8096f833ea45ce9471c56d3ce1a68b P bf2d93774f73406ead205c8ba8c9da13 [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:49:42.840590  6681 raft_consensus.cc:1275] T 3d8096f833ea45ce9471c56d3ce1a68b P 25b7964825a6462295c0606a06169676 [term 4 FOLLOWER]: Refusing update from remote peer 41999337784141c5834094008bf6ba97: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 14:49:42.844518  6998 consensus_queue.cc:1048] T 3d8096f833ea45ce9471c56d3ce1a68b P 41999337784141c5834094008bf6ba97 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 14:49:42.850180  6831 raft_consensus.cc:515] T 3d8096f833ea45ce9471c56d3ce1a68b P bf2d93774f73406ead205c8ba8c9da13 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:42.851648  6832 raft_consensus.cc:1240] T 3d8096f833ea45ce9471c56d3ce1a68b P bf2d93774f73406ead205c8ba8c9da13 [term 5 FOLLOWER]: Rejecting Update request from peer 41999337784141c5834094008bf6ba97 for earlier term 4. Current term is 5. Ops: []
I20260709 14:49:42.855455  7003 raft_consensus.cc:993] T 1dbff5d6a7234db3a8f367fe9b30d615 P 25b7964825a6462295c0606a06169676: : Instructing follower bf2d93774f73406ead205c8ba8c9da13 to start an election
I20260709 14:49:42.856024  7003 raft_consensus.cc:1081] T 1dbff5d6a7234db3a8f367fe9b30d615 P 25b7964825a6462295c0606a06169676 [term 2 LEADER]: Signalling peer bf2d93774f73406ead205c8ba8c9da13 to start an election
I20260709 14:49:42.858650  6833 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1dbff5d6a7234db3a8f367fe9b30d615"
dest_uuid: "bf2d93774f73406ead205c8ba8c9da13"
 from {username='slave'} at 127.0.0.1:46166
I20260709 14:49:42.859354  6833 raft_consensus.cc:493] T 1dbff5d6a7234db3a8f367fe9b30d615 P bf2d93774f73406ead205c8ba8c9da13 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:49:42.859774  6833 raft_consensus.cc:3060] T 1dbff5d6a7234db3a8f367fe9b30d615 P bf2d93774f73406ead205c8ba8c9da13 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:49:42.859684  6998 consensus_queue.cc:1059] T 3d8096f833ea45ce9471c56d3ce1a68b P 41999337784141c5834094008bf6ba97 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 14:49:42.860739  6998 raft_consensus.cc:3055] T 3d8096f833ea45ce9471c56d3ce1a68b P 41999337784141c5834094008bf6ba97 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 14:49:42.861110  6998 raft_consensus.cc:740] T 3d8096f833ea45ce9471c56d3ce1a68b P 41999337784141c5834094008bf6ba97 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 41999337784141c5834094008bf6ba97, State: Running, Role: LEADER
I20260709 14:49:42.862097  6998 consensus_queue.cc:260] T 3d8096f833ea45ce9471c56d3ce1a68b P 41999337784141c5834094008bf6ba97 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:42.863143  6998 raft_consensus.cc:3060] T 3d8096f833ea45ce9471c56d3ce1a68b P 41999337784141c5834094008bf6ba97 [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:49:42.866319  6682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d8096f833ea45ce9471c56d3ce1a68b" candidate_uuid: "bf2d93774f73406ead205c8ba8c9da13" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "25b7964825a6462295c0606a06169676"
I20260709 14:49:42.870612  6833 raft_consensus.cc:515] T 1dbff5d6a7234db3a8f367fe9b30d615 P bf2d93774f73406ead205c8ba8c9da13 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:42.876305  6681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbff5d6a7234db3a8f367fe9b30d615" candidate_uuid: "bf2d93774f73406ead205c8ba8c9da13" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "25b7964825a6462295c0606a06169676"
I20260709 14:49:42.878958  6681 raft_consensus.cc:3055] T 1dbff5d6a7234db3a8f367fe9b30d615 P 25b7964825a6462295c0606a06169676 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 14:49:42.879429  6681 raft_consensus.cc:740] T 1dbff5d6a7234db3a8f367fe9b30d615 P 25b7964825a6462295c0606a06169676 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 25b7964825a6462295c0606a06169676, State: Running, Role: LEADER
I20260709 14:49:42.879261  6756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbff5d6a7234db3a8f367fe9b30d615" candidate_uuid: "bf2d93774f73406ead205c8ba8c9da13" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "41999337784141c5834094008bf6ba97"
I20260709 14:49:42.880183  6756 raft_consensus.cc:3060] T 1dbff5d6a7234db3a8f367fe9b30d615 P 41999337784141c5834094008bf6ba97 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:49:42.880349  6681 consensus_queue.cc:260] T 1dbff5d6a7234db3a8f367fe9b30d615 P 25b7964825a6462295c0606a06169676 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:42.881824  6681 raft_consensus.cc:3060] T 1dbff5d6a7234db3a8f367fe9b30d615 P 25b7964825a6462295c0606a06169676 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:49:42.877763  6759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d8096f833ea45ce9471c56d3ce1a68b" candidate_uuid: "bf2d93774f73406ead205c8ba8c9da13" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "41999337784141c5834094008bf6ba97"
I20260709 14:49:42.889891  6833 leader_election.cc:290] T 1dbff5d6a7234db3a8f367fe9b30d615 P bf2d93774f73406ead205c8ba8c9da13 [CANDIDATE]: Term 3 election: Requested vote from peers 25b7964825a6462295c0606a06169676 (127.6.101.65:34615), 41999337784141c5834094008bf6ba97 (127.6.101.66:35001)
I20260709 14:49:42.891680  6681 raft_consensus.cc:2468] T 1dbff5d6a7234db3a8f367fe9b30d615 P 25b7964825a6462295c0606a06169676 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf2d93774f73406ead205c8ba8c9da13 in term 3.
I20260709 14:49:42.893775  6796 leader_election.cc:304] T 1dbff5d6a7234db3a8f367fe9b30d615 P bf2d93774f73406ead205c8ba8c9da13 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b7964825a6462295c0606a06169676, bf2d93774f73406ead205c8ba8c9da13; no voters: 
I20260709 14:49:42.894137  6831 leader_election.cc:290] T 3d8096f833ea45ce9471c56d3ce1a68b P bf2d93774f73406ead205c8ba8c9da13 [CANDIDATE]: Term 5 election: Requested vote from peers 25b7964825a6462295c0606a06169676 (127.6.101.65:34615), 41999337784141c5834094008bf6ba97 (127.6.101.66:35001)
I20260709 14:49:42.895026  7009 raft_consensus.cc:2804] T 1dbff5d6a7234db3a8f367fe9b30d615 P bf2d93774f73406ead205c8ba8c9da13 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 14:49:42.896330  7009 raft_consensus.cc:697] T 1dbff5d6a7234db3a8f367fe9b30d615 P bf2d93774f73406ead205c8ba8c9da13 [term 3 LEADER]: Becoming Leader. State: Replica: bf2d93774f73406ead205c8ba8c9da13, State: Running, Role: LEADER
I20260709 14:49:42.897609  6756 raft_consensus.cc:2468] T 1dbff5d6a7234db3a8f367fe9b30d615 P 41999337784141c5834094008bf6ba97 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf2d93774f73406ead205c8ba8c9da13 in term 3.
I20260709 14:49:42.898463  7009 consensus_queue.cc:237] T 1dbff5d6a7234db3a8f367fe9b30d615 P bf2d93774f73406ead205c8ba8c9da13 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:42.906473  6759 raft_consensus.cc:2468] T 3d8096f833ea45ce9471c56d3ce1a68b P 41999337784141c5834094008bf6ba97 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf2d93774f73406ead205c8ba8c9da13 in term 5.
I20260709 14:49:42.910425  6578 catalog_manager.cc:5697] T 1dbff5d6a7234db3a8f367fe9b30d615 P bf2d93774f73406ead205c8ba8c9da13 reported cstate change: term changed from 2 to 3, leader changed from 25b7964825a6462295c0606a06169676 (127.6.101.65) to bf2d93774f73406ead205c8ba8c9da13 (127.6.101.67). New cstate: current_term: 3 leader_uuid: "bf2d93774f73406ead205c8ba8c9da13" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } health_report { overall_health: HEALTHY } } }
I20260709 14:49:42.910938  6797 leader_election.cc:304] T 3d8096f833ea45ce9471c56d3ce1a68b P bf2d93774f73406ead205c8ba8c9da13 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 41999337784141c5834094008bf6ba97, bf2d93774f73406ead205c8ba8c9da13; no voters: 25b7964825a6462295c0606a06169676
I20260709 14:49:42.912544  7009 raft_consensus.cc:2804] T 3d8096f833ea45ce9471c56d3ce1a68b P bf2d93774f73406ead205c8ba8c9da13 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 14:49:42.913339  7009 raft_consensus.cc:697] T 3d8096f833ea45ce9471c56d3ce1a68b P bf2d93774f73406ead205c8ba8c9da13 [term 5 LEADER]: Becoming Leader. State: Replica: bf2d93774f73406ead205c8ba8c9da13, State: Running, Role: LEADER
I20260709 14:49:42.914717  7009 consensus_queue.cc:237] T 3d8096f833ea45ce9471c56d3ce1a68b P bf2d93774f73406ead205c8ba8c9da13 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:42.928185  6578 catalog_manager.cc:5697] T 3d8096f833ea45ce9471c56d3ce1a68b P bf2d93774f73406ead205c8ba8c9da13 reported cstate change: term changed from 4 to 5, leader changed from 41999337784141c5834094008bf6ba97 (127.6.101.66) to bf2d93774f73406ead205c8ba8c9da13 (127.6.101.67). New cstate: current_term: 5 leader_uuid: "bf2d93774f73406ead205c8ba8c9da13" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } health_report { overall_health: HEALTHY } } }
I20260709 14:49:42.986608  6681 raft_consensus.cc:1240] T 5ce18799382e46108fbcbed2c364321d P 25b7964825a6462295c0606a06169676 [term 3 LEADER]: Rejecting Update request from peer bf2d93774f73406ead205c8ba8c9da13 for earlier term 2. Current term is 3. Ops: []
I20260709 14:49:42.988359  7009 consensus_queue.cc:1059] T 5ce18799382e46108fbcbed2c364321d P bf2d93774f73406ead205c8ba8c9da13 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 14:49:42.989226  7009 consensus_queue.cc:1243] T 5ce18799382e46108fbcbed2c364321d P bf2d93774f73406ead205c8ba8c9da13 [LEADER]: Peer 25b7964825a6462295c0606a06169676 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 14:49:42.989813  7010 raft_consensus.cc:3055] T 5ce18799382e46108fbcbed2c364321d P bf2d93774f73406ead205c8ba8c9da13 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 14:49:42.990180  7010 raft_consensus.cc:740] T 5ce18799382e46108fbcbed2c364321d P bf2d93774f73406ead205c8ba8c9da13 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bf2d93774f73406ead205c8ba8c9da13, State: Running, Role: LEADER
I20260709 14:49:42.991215  7010 consensus_queue.cc:260] T 5ce18799382e46108fbcbed2c364321d P bf2d93774f73406ead205c8ba8c9da13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:42.992466  7010 raft_consensus.cc:3060] T 5ce18799382e46108fbcbed2c364321d P bf2d93774f73406ead205c8ba8c9da13 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:49:43.198709  6759 raft_consensus.cc:1275] T 07255af297cd4ac59277e81984f07f9c P 41999337784141c5834094008bf6ba97 [term 3 FOLLOWER]: Refusing update from remote peer 25b7964825a6462295c0606a06169676: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 14:49:43.200752  6993 consensus_queue.cc:1048] T 07255af297cd4ac59277e81984f07f9c P 25b7964825a6462295c0606a06169676 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 14:49:43.226011  6831 raft_consensus.cc:1275] T 07255af297cd4ac59277e81984f07f9c P bf2d93774f73406ead205c8ba8c9da13 [term 3 FOLLOWER]: Refusing update from remote peer 25b7964825a6462295c0606a06169676: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 14:49:43.226552  6831 pending_rounds.cc:85] T 07255af297cd4ac59277e81984f07f9c P bf2d93774f73406ead205c8ba8c9da13: Aborting all ops after (but not including) 1
I20260709 14:49:43.226915  6831 pending_rounds.cc:107] T 07255af297cd4ac59277e81984f07f9c P bf2d93774f73406ead205c8ba8c9da13: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 14:49:43.227258  6831 raft_consensus.cc:2889] T 07255af297cd4ac59277e81984f07f9c P bf2d93774f73406ead205c8ba8c9da13 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:49:43.235078  7003 consensus_queue.cc:1048] T 07255af297cd4ac59277e81984f07f9c P 25b7964825a6462295c0606a06169676 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 14:49:43.312143  6759 raft_consensus.cc:1275] T 3d8096f833ea45ce9471c56d3ce1a68b P 41999337784141c5834094008bf6ba97 [term 5 FOLLOWER]: Refusing update from remote peer bf2d93774f73406ead205c8ba8c9da13: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 14:49:43.313663  7010 consensus_queue.cc:1048] T 3d8096f833ea45ce9471c56d3ce1a68b P bf2d93774f73406ead205c8ba8c9da13 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 14:49:43.325330  6681 raft_consensus.cc:3060] T 3d8096f833ea45ce9471c56d3ce1a68b P 25b7964825a6462295c0606a06169676 [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:49:43.332916  6681 raft_consensus.cc:1275] T 3d8096f833ea45ce9471c56d3ce1a68b P 25b7964825a6462295c0606a06169676 [term 5 FOLLOWER]: Refusing update from remote peer bf2d93774f73406ead205c8ba8c9da13: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 14:49:43.334555  7032 consensus_queue.cc:1048] T 3d8096f833ea45ce9471c56d3ce1a68b P bf2d93774f73406ead205c8ba8c9da13 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 14:49:43.346138  6831 raft_consensus.cc:1275] T 5ce18799382e46108fbcbed2c364321d P bf2d93774f73406ead205c8ba8c9da13 [term 3 FOLLOWER]: Refusing update from remote peer 25b7964825a6462295c0606a06169676: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 14:49:43.346658  6831 pending_rounds.cc:85] T 5ce18799382e46108fbcbed2c364321d P bf2d93774f73406ead205c8ba8c9da13: Aborting all ops after (but not including) 1
I20260709 14:49:43.346920  6831 pending_rounds.cc:107] T 5ce18799382e46108fbcbed2c364321d P bf2d93774f73406ead205c8ba8c9da13: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 14:49:43.347182  6831 raft_consensus.cc:2889] T 5ce18799382e46108fbcbed2c364321d P bf2d93774f73406ead205c8ba8c9da13 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:49:43.350903  7003 consensus_queue.cc:1048] T 5ce18799382e46108fbcbed2c364321d P 25b7964825a6462295c0606a06169676 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 14:49:43.356805  6759 raft_consensus.cc:1275] T 1dbff5d6a7234db3a8f367fe9b30d615 P 41999337784141c5834094008bf6ba97 [term 3 FOLLOWER]: Refusing update from remote peer bf2d93774f73406ead205c8ba8c9da13: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 14:49:43.358814  7010 consensus_queue.cc:1048] T 1dbff5d6a7234db3a8f367fe9b30d615 P bf2d93774f73406ead205c8ba8c9da13 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 14:49:43.365293  6756 raft_consensus.cc:1275] T 5ce18799382e46108fbcbed2c364321d P 41999337784141c5834094008bf6ba97 [term 3 FOLLOWER]: Refusing update from remote peer 25b7964825a6462295c0606a06169676: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 14:49:43.367333  6993 consensus_queue.cc:1048] T 5ce18799382e46108fbcbed2c364321d P 25b7964825a6462295c0606a06169676 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 14:49:43.394137  6681 raft_consensus.cc:1275] T 1dbff5d6a7234db3a8f367fe9b30d615 P 25b7964825a6462295c0606a06169676 [term 3 FOLLOWER]: Refusing update from remote peer bf2d93774f73406ead205c8ba8c9da13: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 14:49:43.396202  7009 consensus_queue.cc:1048] T 1dbff5d6a7234db3a8f367fe9b30d615 P bf2d93774f73406ead205c8ba8c9da13 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 14:49:43.435649  6549 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 14:49:43.447330  6549 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 14:49:43.458434  6681 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "07255af297cd4ac59277e81984f07f9c"
dest_uuid: "25b7964825a6462295c0606a06169676"
mode: GRACEFUL
new_leader_uuid: "41999337784141c5834094008bf6ba97"
 from {username='slave'} at 127.0.0.1:42214
I20260709 14:49:43.459159  6681 raft_consensus.cc:606] T 07255af297cd4ac59277e81984f07f9c P 25b7964825a6462295c0606a06169676 [term 3 LEADER]: Received request to transfer leadership to TS 41999337784141c5834094008bf6ba97
I20260709 14:49:43.462967  6681 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c8ac07644f37427e80f77c67ccac9328"
dest_uuid: "25b7964825a6462295c0606a06169676"
mode: GRACEFUL
new_leader_uuid: "bf2d93774f73406ead205c8ba8c9da13"
 from {username='slave'} at 127.0.0.1:42214
I20260709 14:49:43.463765  6681 raft_consensus.cc:606] T c8ac07644f37427e80f77c67ccac9328 P 25b7964825a6462295c0606a06169676 [term 1 LEADER]: Received request to transfer leadership to TS bf2d93774f73406ead205c8ba8c9da13
I20260709 14:49:43.465605  6549 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 14:49:43.499866  6549 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 14:49:44.502372  6549 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 14:49:44.571635  6648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:35001, user_credentials={real_user=slave}} blocked reactor thread for 352666us
I20260709 14:49:44.586020  7037 raft_consensus.cc:993] T 07255af297cd4ac59277e81984f07f9c P 25b7964825a6462295c0606a06169676: : Instructing follower 41999337784141c5834094008bf6ba97 to start an election
I20260709 14:49:44.587045  7003 raft_consensus.cc:1081] T 07255af297cd4ac59277e81984f07f9c P 25b7964825a6462295c0606a06169676 [term 3 LEADER]: Signalling peer 41999337784141c5834094008bf6ba97 to start an election
I20260709 14:49:44.667179  6759 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "07255af297cd4ac59277e81984f07f9c"
dest_uuid: "41999337784141c5834094008bf6ba97"
 from {username='slave'} at 127.0.0.1:49634
I20260709 14:49:44.668001  6759 raft_consensus.cc:493] T 07255af297cd4ac59277e81984f07f9c P 41999337784141c5834094008bf6ba97 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:49:44.668632  6759 raft_consensus.cc:3060] T 07255af297cd4ac59277e81984f07f9c P 41999337784141c5834094008bf6ba97 [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:49:44.687134  6759 raft_consensus.cc:515] T 07255af297cd4ac59277e81984f07f9c P 41999337784141c5834094008bf6ba97 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:44.691156  6759 leader_election.cc:290] T 07255af297cd4ac59277e81984f07f9c P 41999337784141c5834094008bf6ba97 [CANDIDATE]: Term 4 election: Requested vote from peers 25b7964825a6462295c0606a06169676 (127.6.101.65:34615), bf2d93774f73406ead205c8ba8c9da13 (127.6.101.67:46675)
I20260709 14:49:44.691332  6832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07255af297cd4ac59277e81984f07f9c" candidate_uuid: "41999337784141c5834094008bf6ba97" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "bf2d93774f73406ead205c8ba8c9da13"
I20260709 14:49:44.692529  6832 raft_consensus.cc:3060] T 07255af297cd4ac59277e81984f07f9c P bf2d93774f73406ead205c8ba8c9da13 [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:49:44.694166  6549 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 14:49:44.698762  6684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07255af297cd4ac59277e81984f07f9c" candidate_uuid: "41999337784141c5834094008bf6ba97" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "25b7964825a6462295c0606a06169676"
I20260709 14:49:44.700651  6684 raft_consensus.cc:3055] T 07255af297cd4ac59277e81984f07f9c P 25b7964825a6462295c0606a06169676 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 14:49:44.701025  6684 raft_consensus.cc:740] T 07255af297cd4ac59277e81984f07f9c P 25b7964825a6462295c0606a06169676 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 25b7964825a6462295c0606a06169676, State: Running, Role: LEADER
I20260709 14:49:44.701887  6684 consensus_queue.cc:260] T 07255af297cd4ac59277e81984f07f9c P 25b7964825a6462295c0606a06169676 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:44.703325  6684 raft_consensus.cc:3060] T 07255af297cd4ac59277e81984f07f9c P 25b7964825a6462295c0606a06169676 [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:49:44.703570  6832 raft_consensus.cc:2468] T 07255af297cd4ac59277e81984f07f9c P bf2d93774f73406ead205c8ba8c9da13 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41999337784141c5834094008bf6ba97 in term 4.
I20260709 14:49:44.711248  6725 leader_election.cc:304] T 07255af297cd4ac59277e81984f07f9c P 41999337784141c5834094008bf6ba97 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41999337784141c5834094008bf6ba97, bf2d93774f73406ead205c8ba8c9da13; no voters: 
I20260709 14:49:44.712218  7039 raft_consensus.cc:2804] T 07255af297cd4ac59277e81984f07f9c P 41999337784141c5834094008bf6ba97 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 14:49:44.712762  7039 raft_consensus.cc:697] T 07255af297cd4ac59277e81984f07f9c P 41999337784141c5834094008bf6ba97 [term 4 LEADER]: Becoming Leader. State: Replica: 41999337784141c5834094008bf6ba97, State: Running, Role: LEADER
I20260709 14:49:44.712812  6682 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5ce18799382e46108fbcbed2c364321d"
dest_uuid: "25b7964825a6462295c0606a06169676"
mode: GRACEFUL
new_leader_uuid: "41999337784141c5834094008bf6ba97"
 from {username='slave'} at 127.0.0.1:42214
I20260709 14:49:44.714056  6684 raft_consensus.cc:2468] T 07255af297cd4ac59277e81984f07f9c P 25b7964825a6462295c0606a06169676 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41999337784141c5834094008bf6ba97 in term 4.
I20260709 14:49:44.713608  7039 consensus_queue.cc:237] T 07255af297cd4ac59277e81984f07f9c P 41999337784141c5834094008bf6ba97 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:44.713599  6682 raft_consensus.cc:606] T 5ce18799382e46108fbcbed2c364321d P 25b7964825a6462295c0606a06169676 [term 3 LEADER]: Received request to transfer leadership to TS 41999337784141c5834094008bf6ba97
I20260709 14:49:44.719017  6682 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c8ac07644f37427e80f77c67ccac9328"
dest_uuid: "25b7964825a6462295c0606a06169676"
mode: GRACEFUL
new_leader_uuid: "bf2d93774f73406ead205c8ba8c9da13"
 from {username='slave'} at 127.0.0.1:42214
I20260709 14:49:44.719796  6682 raft_consensus.cc:606] T c8ac07644f37427e80f77c67ccac9328 P 25b7964825a6462295c0606a06169676 [term 1 LEADER]: Received request to transfer leadership to TS bf2d93774f73406ead205c8ba8c9da13
I20260709 14:49:44.721853  6549 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 14:49:44.728919  6549 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 14:49:44.731143  6578 catalog_manager.cc:5697] T 07255af297cd4ac59277e81984f07f9c P 41999337784141c5834094008bf6ba97 reported cstate change: term changed from 3 to 4, leader changed from 25b7964825a6462295c0606a06169676 (127.6.101.65) to 41999337784141c5834094008bf6ba97 (127.6.101.66). New cstate: current_term: 4 leader_uuid: "41999337784141c5834094008bf6ba97" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } health_report { overall_health: UNKNOWN } } }
W20260709 14:49:44.788035  6612 debug-util.cc:398] Leaking SignalData structure 0x7b0800062060 after lost signal to thread 6552
W20260709 14:49:44.788997  6612 debug-util.cc:398] Leaking SignalData structure 0x7b0800062740 after lost signal to thread 6615
W20260709 14:49:44.790015  6612 debug-util.cc:398] Leaking SignalData structure 0x7b0800106f80 after lost signal to thread 6708
W20260709 14:49:44.790886  6612 debug-util.cc:398] Leaking SignalData structure 0x7b08000e9820 after lost signal to thread 6783
W20260709 14:49:44.791733  6612 debug-util.cc:398] Leaking SignalData structure 0x7b08001f2700 after lost signal to thread 6857
I20260709 14:49:44.898322  6993 raft_consensus.cc:993] T 5ce18799382e46108fbcbed2c364321d P 25b7964825a6462295c0606a06169676: : Instructing follower 41999337784141c5834094008bf6ba97 to start an election
I20260709 14:49:44.899210  7029 raft_consensus.cc:1081] T 5ce18799382e46108fbcbed2c364321d P 25b7964825a6462295c0606a06169676 [term 3 LEADER]: Signalling peer 41999337784141c5834094008bf6ba97 to start an election
I20260709 14:49:44.901451  6759 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5ce18799382e46108fbcbed2c364321d"
dest_uuid: "41999337784141c5834094008bf6ba97"
 from {username='slave'} at 127.0.0.1:49634
I20260709 14:49:44.902258  6759 raft_consensus.cc:493] T 5ce18799382e46108fbcbed2c364321d P 41999337784141c5834094008bf6ba97 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:49:44.902722  6759 raft_consensus.cc:3060] T 5ce18799382e46108fbcbed2c364321d P 41999337784141c5834094008bf6ba97 [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:49:44.912436  6759 raft_consensus.cc:515] T 5ce18799382e46108fbcbed2c364321d P 41999337784141c5834094008bf6ba97 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:44.915298  6759 leader_election.cc:290] T 5ce18799382e46108fbcbed2c364321d P 41999337784141c5834094008bf6ba97 [CANDIDATE]: Term 4 election: Requested vote from peers 25b7964825a6462295c0606a06169676 (127.6.101.65:34615), bf2d93774f73406ead205c8ba8c9da13 (127.6.101.67:46675)
I20260709 14:49:44.916527  6682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce18799382e46108fbcbed2c364321d" candidate_uuid: "41999337784141c5834094008bf6ba97" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "25b7964825a6462295c0606a06169676"
I20260709 14:49:44.916714  6832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce18799382e46108fbcbed2c364321d" candidate_uuid: "41999337784141c5834094008bf6ba97" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "bf2d93774f73406ead205c8ba8c9da13"
I20260709 14:49:44.917336  6682 raft_consensus.cc:3055] T 5ce18799382e46108fbcbed2c364321d P 25b7964825a6462295c0606a06169676 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 14:49:44.917506  6832 raft_consensus.cc:3060] T 5ce18799382e46108fbcbed2c364321d P bf2d93774f73406ead205c8ba8c9da13 [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:49:44.917829  6682 raft_consensus.cc:740] T 5ce18799382e46108fbcbed2c364321d P 25b7964825a6462295c0606a06169676 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 25b7964825a6462295c0606a06169676, State: Running, Role: LEADER
I20260709 14:49:44.918735  6682 consensus_queue.cc:260] T 5ce18799382e46108fbcbed2c364321d P 25b7964825a6462295c0606a06169676 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:44.920173  6682 raft_consensus.cc:3060] T 5ce18799382e46108fbcbed2c364321d P 25b7964825a6462295c0606a06169676 [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:49:44.926717  6682 raft_consensus.cc:2468] T 5ce18799382e46108fbcbed2c364321d P 25b7964825a6462295c0606a06169676 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41999337784141c5834094008bf6ba97 in term 4.
I20260709 14:49:44.927994  6722 leader_election.cc:304] T 5ce18799382e46108fbcbed2c364321d P 41999337784141c5834094008bf6ba97 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b7964825a6462295c0606a06169676, 41999337784141c5834094008bf6ba97; no voters: 
I20260709 14:49:44.928027  6832 raft_consensus.cc:2468] T 5ce18799382e46108fbcbed2c364321d P bf2d93774f73406ead205c8ba8c9da13 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41999337784141c5834094008bf6ba97 in term 4.
I20260709 14:49:44.929060  7039 raft_consensus.cc:2804] T 5ce18799382e46108fbcbed2c364321d P 41999337784141c5834094008bf6ba97 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 14:49:44.929626  7039 raft_consensus.cc:697] T 5ce18799382e46108fbcbed2c364321d P 41999337784141c5834094008bf6ba97 [term 4 LEADER]: Becoming Leader. State: Replica: 41999337784141c5834094008bf6ba97, State: Running, Role: LEADER
I20260709 14:49:44.930526  7039 consensus_queue.cc:237] T 5ce18799382e46108fbcbed2c364321d P 41999337784141c5834094008bf6ba97 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:44.940203  6578 catalog_manager.cc:5697] T 5ce18799382e46108fbcbed2c364321d P 41999337784141c5834094008bf6ba97 reported cstate change: term changed from 3 to 4, leader changed from 25b7964825a6462295c0606a06169676 (127.6.101.65) to 41999337784141c5834094008bf6ba97 (127.6.101.66). New cstate: current_term: 4 leader_uuid: "41999337784141c5834094008bf6ba97" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } health_report { overall_health: UNKNOWN } } }
I20260709 14:49:45.077183  6993 raft_consensus.cc:993] T c8ac07644f37427e80f77c67ccac9328 P 25b7964825a6462295c0606a06169676: : Instructing follower bf2d93774f73406ead205c8ba8c9da13 to start an election
I20260709 14:49:45.077960  7029 raft_consensus.cc:1081] T c8ac07644f37427e80f77c67ccac9328 P 25b7964825a6462295c0606a06169676 [term 1 LEADER]: Signalling peer bf2d93774f73406ead205c8ba8c9da13 to start an election
I20260709 14:49:45.080521  6832 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c8ac07644f37427e80f77c67ccac9328"
dest_uuid: "bf2d93774f73406ead205c8ba8c9da13"
 from {username='slave'} at 127.0.0.1:46166
I20260709 14:49:45.081518  6832 raft_consensus.cc:493] T c8ac07644f37427e80f77c67ccac9328 P bf2d93774f73406ead205c8ba8c9da13 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:49:45.082041  6832 raft_consensus.cc:3060] T c8ac07644f37427e80f77c67ccac9328 P bf2d93774f73406ead205c8ba8c9da13 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:49:45.093648  6832 raft_consensus.cc:515] T c8ac07644f37427e80f77c67ccac9328 P bf2d93774f73406ead205c8ba8c9da13 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:45.096451  6832 leader_election.cc:290] T c8ac07644f37427e80f77c67ccac9328 P bf2d93774f73406ead205c8ba8c9da13 [CANDIDATE]: Term 2 election: Requested vote from peers 25b7964825a6462295c0606a06169676 (127.6.101.65:34615), 41999337784141c5834094008bf6ba97 (127.6.101.66:35001)
I20260709 14:49:45.097592  6682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ac07644f37427e80f77c67ccac9328" candidate_uuid: "bf2d93774f73406ead205c8ba8c9da13" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "25b7964825a6462295c0606a06169676"
I20260709 14:49:45.097769  6759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ac07644f37427e80f77c67ccac9328" candidate_uuid: "bf2d93774f73406ead205c8ba8c9da13" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "41999337784141c5834094008bf6ba97"
I20260709 14:49:45.098362  6682 raft_consensus.cc:3055] T c8ac07644f37427e80f77c67ccac9328 P 25b7964825a6462295c0606a06169676 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 14:49:45.098750  6759 raft_consensus.cc:3060] T c8ac07644f37427e80f77c67ccac9328 P 41999337784141c5834094008bf6ba97 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:49:45.098707  6682 raft_consensus.cc:740] T c8ac07644f37427e80f77c67ccac9328 P 25b7964825a6462295c0606a06169676 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 25b7964825a6462295c0606a06169676, State: Running, Role: LEADER
I20260709 14:49:45.100257  6682 consensus_queue.cc:260] T c8ac07644f37427e80f77c67ccac9328 P 25b7964825a6462295c0606a06169676 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:45.102468  6682 raft_consensus.cc:3060] T c8ac07644f37427e80f77c67ccac9328 P 25b7964825a6462295c0606a06169676 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:49:45.109990  6759 raft_consensus.cc:2468] T c8ac07644f37427e80f77c67ccac9328 P 41999337784141c5834094008bf6ba97 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf2d93774f73406ead205c8ba8c9da13 in term 2.
I20260709 14:49:45.111618  6797 leader_election.cc:304] T c8ac07644f37427e80f77c67ccac9328 P bf2d93774f73406ead205c8ba8c9da13 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41999337784141c5834094008bf6ba97, bf2d93774f73406ead205c8ba8c9da13; no voters: 
I20260709 14:49:45.112526  6682 raft_consensus.cc:2468] T c8ac07644f37427e80f77c67ccac9328 P 25b7964825a6462295c0606a06169676 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf2d93774f73406ead205c8ba8c9da13 in term 2.
I20260709 14:49:45.112699  7009 raft_consensus.cc:2804] T c8ac07644f37427e80f77c67ccac9328 P bf2d93774f73406ead205c8ba8c9da13 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:49:45.114034  7009 raft_consensus.cc:697] T c8ac07644f37427e80f77c67ccac9328 P bf2d93774f73406ead205c8ba8c9da13 [term 2 LEADER]: Becoming Leader. State: Replica: bf2d93774f73406ead205c8ba8c9da13, State: Running, Role: LEADER
I20260709 14:49:45.115298  7009 consensus_queue.cc:237] T c8ac07644f37427e80f77c67ccac9328 P bf2d93774f73406ead205c8ba8c9da13 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:45.126873  6578 catalog_manager.cc:5697] T c8ac07644f37427e80f77c67ccac9328 P bf2d93774f73406ead205c8ba8c9da13 reported cstate change: term changed from 1 to 2, leader changed from 25b7964825a6462295c0606a06169676 (127.6.101.65) to bf2d93774f73406ead205c8ba8c9da13 (127.6.101.67). New cstate: current_term: 2 leader_uuid: "bf2d93774f73406ead205c8ba8c9da13" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } health_report { overall_health: HEALTHY } } }
I20260709 14:49:45.294066  6682 raft_consensus.cc:1275] T 07255af297cd4ac59277e81984f07f9c P 25b7964825a6462295c0606a06169676 [term 4 FOLLOWER]: Refusing update from remote peer 41999337784141c5834094008bf6ba97: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 14:49:45.295957  7039 consensus_queue.cc:1048] T 07255af297cd4ac59277e81984f07f9c P 41999337784141c5834094008bf6ba97 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 14:49:45.315438  6832 raft_consensus.cc:1275] T 07255af297cd4ac59277e81984f07f9c P bf2d93774f73406ead205c8ba8c9da13 [term 4 FOLLOWER]: Refusing update from remote peer 41999337784141c5834094008bf6ba97: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 14:49:45.317901  7039 consensus_queue.cc:1048] T 07255af297cd4ac59277e81984f07f9c P 41999337784141c5834094008bf6ba97 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 14:49:45.717871  6759 raft_consensus.cc:1275] T c8ac07644f37427e80f77c67ccac9328 P 41999337784141c5834094008bf6ba97 [term 2 FOLLOWER]: Refusing update from remote peer bf2d93774f73406ead205c8ba8c9da13: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:49:45.775426  6832 raft_consensus.cc:1275] T 5ce18799382e46108fbcbed2c364321d P bf2d93774f73406ead205c8ba8c9da13 [term 4 FOLLOWER]: Refusing update from remote peer 41999337784141c5834094008bf6ba97: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 14:49:45.777515  7028 consensus_queue.cc:1048] T 5ce18799382e46108fbcbed2c364321d P 41999337784141c5834094008bf6ba97 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 14:49:46.235236  6683 raft_consensus.cc:1275] T 5ce18799382e46108fbcbed2c364321d P 25b7964825a6462295c0606a06169676 [term 4 FOLLOWER]: Refusing update from remote peer 41999337784141c5834094008bf6ba97: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 14:49:46.237581  6681 raft_consensus.cc:1275] T c8ac07644f37427e80f77c67ccac9328 P 25b7964825a6462295c0606a06169676 [term 2 FOLLOWER]: Refusing update from remote peer bf2d93774f73406ead205c8ba8c9da13: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:49:46.243022  7039 consensus_queue.cc:1048] T 5ce18799382e46108fbcbed2c364321d P 41999337784141c5834094008bf6ba97 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 14:49:46.260325  7009 consensus_queue.cc:1048] T c8ac07644f37427e80f77c67ccac9328 P bf2d93774f73406ead205c8ba8c9da13 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 14:49:46.299906  7009 consensus_queue.cc:1048] T c8ac07644f37427e80f77c67ccac9328 P bf2d93774f73406ead205c8ba8c9da13 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 14:49:46.314931  6725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:46675, user_credentials={real_user=slave}} blocked reactor thread for 58483.2us
W20260709 14:49:46.353703  6796 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:34615, user_credentials={real_user=slave}} blocked reactor thread for 66294.8us
I20260709 14:49:46.429490  6549 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 14:49:46.443146  6549 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 14:49:46.454250  6759 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "07255af297cd4ac59277e81984f07f9c"
dest_uuid: "41999337784141c5834094008bf6ba97"
mode: GRACEFUL
new_leader_uuid: "25b7964825a6462295c0606a06169676"
 from {username='slave'} at 127.0.0.1:49668
I20260709 14:49:46.454993  6759 raft_consensus.cc:606] T 07255af297cd4ac59277e81984f07f9c P 41999337784141c5834094008bf6ba97 [term 4 LEADER]: Received request to transfer leadership to TS 25b7964825a6462295c0606a06169676
I20260709 14:49:46.456506  6549 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 14:49:46.457154  6549 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 14:49:46.705113  7061 raft_consensus.cc:993] T 07255af297cd4ac59277e81984f07f9c P 41999337784141c5834094008bf6ba97: : Instructing follower 25b7964825a6462295c0606a06169676 to start an election
I20260709 14:49:46.705981  7061 raft_consensus.cc:1081] T 07255af297cd4ac59277e81984f07f9c P 41999337784141c5834094008bf6ba97 [term 4 LEADER]: Signalling peer 25b7964825a6462295c0606a06169676 to start an election
I20260709 14:49:46.709003  6681 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "07255af297cd4ac59277e81984f07f9c"
dest_uuid: "25b7964825a6462295c0606a06169676"
 from {username='slave'} at 127.0.0.1:42184
I20260709 14:49:46.709846  6681 raft_consensus.cc:493] T 07255af297cd4ac59277e81984f07f9c P 25b7964825a6462295c0606a06169676 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:49:46.710351  6681 raft_consensus.cc:3060] T 07255af297cd4ac59277e81984f07f9c P 25b7964825a6462295c0606a06169676 [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:49:46.719089  6681 raft_consensus.cc:515] T 07255af297cd4ac59277e81984f07f9c P 25b7964825a6462295c0606a06169676 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:46.721796  6681 leader_election.cc:290] T 07255af297cd4ac59277e81984f07f9c P 25b7964825a6462295c0606a06169676 [CANDIDATE]: Term 5 election: Requested vote from peers 41999337784141c5834094008bf6ba97 (127.6.101.66:35001), bf2d93774f73406ead205c8ba8c9da13 (127.6.101.67:46675)
I20260709 14:49:46.723053  6830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07255af297cd4ac59277e81984f07f9c" candidate_uuid: "25b7964825a6462295c0606a06169676" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "bf2d93774f73406ead205c8ba8c9da13"
I20260709 14:49:46.722926  6759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07255af297cd4ac59277e81984f07f9c" candidate_uuid: "25b7964825a6462295c0606a06169676" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "41999337784141c5834094008bf6ba97"
I20260709 14:49:46.723874  6759 raft_consensus.cc:3055] T 07255af297cd4ac59277e81984f07f9c P 41999337784141c5834094008bf6ba97 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 14:49:46.723874  6830 raft_consensus.cc:3060] T 07255af297cd4ac59277e81984f07f9c P bf2d93774f73406ead205c8ba8c9da13 [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:49:46.724417  6759 raft_consensus.cc:740] T 07255af297cd4ac59277e81984f07f9c P 41999337784141c5834094008bf6ba97 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 41999337784141c5834094008bf6ba97, State: Running, Role: LEADER
I20260709 14:49:46.725395  6759 consensus_queue.cc:260] T 07255af297cd4ac59277e81984f07f9c P 41999337784141c5834094008bf6ba97 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:46.726378  6759 raft_consensus.cc:3060] T 07255af297cd4ac59277e81984f07f9c P 41999337784141c5834094008bf6ba97 [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:49:46.732311  6759 raft_consensus.cc:2468] T 07255af297cd4ac59277e81984f07f9c P 41999337784141c5834094008bf6ba97 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b7964825a6462295c0606a06169676 in term 5.
I20260709 14:49:46.734198  6648 leader_election.cc:304] T 07255af297cd4ac59277e81984f07f9c P 25b7964825a6462295c0606a06169676 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b7964825a6462295c0606a06169676, 41999337784141c5834094008bf6ba97; no voters: 
I20260709 14:49:46.735206  7056 raft_consensus.cc:2804] T 07255af297cd4ac59277e81984f07f9c P 25b7964825a6462295c0606a06169676 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 14:49:46.735976  7056 raft_consensus.cc:697] T 07255af297cd4ac59277e81984f07f9c P 25b7964825a6462295c0606a06169676 [term 5 LEADER]: Becoming Leader. State: Replica: 25b7964825a6462295c0606a06169676, State: Running, Role: LEADER
I20260709 14:49:46.736963  7056 consensus_queue.cc:237] T 07255af297cd4ac59277e81984f07f9c P 25b7964825a6462295c0606a06169676 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:46.734733  6830 raft_consensus.cc:2468] T 07255af297cd4ac59277e81984f07f9c P bf2d93774f73406ead205c8ba8c9da13 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b7964825a6462295c0606a06169676 in term 5.
I20260709 14:49:46.748047  6580 catalog_manager.cc:5697] T 07255af297cd4ac59277e81984f07f9c P 25b7964825a6462295c0606a06169676 reported cstate change: term changed from 4 to 5, leader changed from 41999337784141c5834094008bf6ba97 (127.6.101.66) to 25b7964825a6462295c0606a06169676 (127.6.101.65). New cstate: current_term: 5 leader_uuid: "25b7964825a6462295c0606a06169676" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } health_report { overall_health: UNKNOWN } } }
W20260709 14:49:47.058106  6780 debug-util.cc:398] Leaking SignalData structure 0x7b08000976e0 after lost signal to thread 6552
W20260709 14:49:47.059384  6780 debug-util.cc:398] Leaking SignalData structure 0x7b0800092ee0 after lost signal to thread 6615
W20260709 14:49:47.060680  6780 debug-util.cc:398] Leaking SignalData structure 0x7b0800125160 after lost signal to thread 6708
W20260709 14:49:47.061834  6780 debug-util.cc:398] Leaking SignalData structure 0x7b080002ae40 after lost signal to thread 6783
W20260709 14:49:47.063055  6780 debug-util.cc:398] Leaking SignalData structure 0x7b0800097ea0 after lost signal to thread 6857
I20260709 14:49:47.251597  6830 raft_consensus.cc:1275] T 07255af297cd4ac59277e81984f07f9c P bf2d93774f73406ead205c8ba8c9da13 [term 5 FOLLOWER]: Refusing update from remote peer 25b7964825a6462295c0606a06169676: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 14:49:47.253567  7056 consensus_queue.cc:1048] T 07255af297cd4ac59277e81984f07f9c P 25b7964825a6462295c0606a06169676 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 14:49:47.320284  6759 raft_consensus.cc:1275] T 07255af297cd4ac59277e81984f07f9c P 41999337784141c5834094008bf6ba97 [term 5 FOLLOWER]: Refusing update from remote peer 25b7964825a6462295c0606a06169676: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 14:49:47.322628  7056 consensus_queue.cc:1048] T 07255af297cd4ac59277e81984f07f9c P 25b7964825a6462295c0606a06169676 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 14:49:47.458369  6549 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 14:49:47.513850  6681 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d58c1f5d4e1c448eab811059e23165cc"
dest_uuid: "25b7964825a6462295c0606a06169676"
mode: GRACEFUL
new_leader_uuid: "41999337784141c5834094008bf6ba97"
 from {username='slave'} at 127.0.0.1:57950
I20260709 14:49:47.514566  6681 raft_consensus.cc:606] T d58c1f5d4e1c448eab811059e23165cc P 25b7964825a6462295c0606a06169676 [term 2 LEADER]: Received request to transfer leadership to TS 41999337784141c5834094008bf6ba97
I20260709 14:49:47.523219  6830 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1dbff5d6a7234db3a8f367fe9b30d615"
dest_uuid: "bf2d93774f73406ead205c8ba8c9da13"
mode: GRACEFUL
new_leader_uuid: "41999337784141c5834094008bf6ba97"
 from {username='slave'} at 127.0.0.1:46190
I20260709 14:49:47.524171  6830 raft_consensus.cc:606] T 1dbff5d6a7234db3a8f367fe9b30d615 P bf2d93774f73406ead205c8ba8c9da13 [term 3 LEADER]: Received request to transfer leadership to TS 41999337784141c5834094008bf6ba97
I20260709 14:49:47.532617  6681 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bc290da245804ddc92d9597c5da52a82"
dest_uuid: "25b7964825a6462295c0606a06169676"
mode: GRACEFUL
new_leader_uuid: "41999337784141c5834094008bf6ba97"
 from {username='slave'} at 127.0.0.1:57950
I20260709 14:49:47.533407  6681 raft_consensus.cc:606] T bc290da245804ddc92d9597c5da52a82 P 25b7964825a6462295c0606a06169676 [term 2 LEADER]: Received request to transfer leadership to TS 41999337784141c5834094008bf6ba97
I20260709 14:49:47.541945  6830 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c8ac07644f37427e80f77c67ccac9328"
dest_uuid: "bf2d93774f73406ead205c8ba8c9da13"
mode: GRACEFUL
new_leader_uuid: "41999337784141c5834094008bf6ba97"
 from {username='slave'} at 127.0.0.1:46190
I20260709 14:49:47.542650  6830 raft_consensus.cc:606] T c8ac07644f37427e80f77c67ccac9328 P bf2d93774f73406ead205c8ba8c9da13 [term 2 LEADER]: Received request to transfer leadership to TS 41999337784141c5834094008bf6ba97
I20260709 14:49:47.554468  6830 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3d8096f833ea45ce9471c56d3ce1a68b"
dest_uuid: "bf2d93774f73406ead205c8ba8c9da13"
mode: GRACEFUL
new_leader_uuid: "41999337784141c5834094008bf6ba97"
 from {username='slave'} at 127.0.0.1:46190
I20260709 14:49:47.555266  6830 raft_consensus.cc:606] T 3d8096f833ea45ce9471c56d3ce1a68b P bf2d93774f73406ead205c8ba8c9da13 [term 5 LEADER]: Received request to transfer leadership to TS 41999337784141c5834094008bf6ba97
I20260709 14:49:47.567559  6681 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "07255af297cd4ac59277e81984f07f9c"
dest_uuid: "25b7964825a6462295c0606a06169676"
mode: GRACEFUL
new_leader_uuid: "41999337784141c5834094008bf6ba97"
 from {username='slave'} at 127.0.0.1:57950
I20260709 14:49:47.568439  6681 raft_consensus.cc:606] T 07255af297cd4ac59277e81984f07f9c P 25b7964825a6462295c0606a06169676 [term 5 LEADER]: Received request to transfer leadership to TS 41999337784141c5834094008bf6ba97
I20260709 14:49:47.575846  6756 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "be9352545ba44d68a3704b39c623e774"
dest_uuid: "41999337784141c5834094008bf6ba97"
mode: GRACEFUL
new_leader_uuid: "bf2d93774f73406ead205c8ba8c9da13"
 from {username='slave'} at 127.0.0.1:49666
I20260709 14:49:47.576510  6756 raft_consensus.cc:606] T be9352545ba44d68a3704b39c623e774 P 41999337784141c5834094008bf6ba97 [term 3 LEADER]: Received request to transfer leadership to TS bf2d93774f73406ead205c8ba8c9da13
I20260709 14:49:47.723626  7077 raft_consensus.cc:993] T d58c1f5d4e1c448eab811059e23165cc P 25b7964825a6462295c0606a06169676: : Instructing follower 41999337784141c5834094008bf6ba97 to start an election
I20260709 14:49:47.724030  7056 raft_consensus.cc:993] T bc290da245804ddc92d9597c5da52a82 P 25b7964825a6462295c0606a06169676: : Instructing follower 41999337784141c5834094008bf6ba97 to start an election
I20260709 14:49:47.724371  7077 raft_consensus.cc:1081] T d58c1f5d4e1c448eab811059e23165cc P 25b7964825a6462295c0606a06169676 [term 2 LEADER]: Signalling peer 41999337784141c5834094008bf6ba97 to start an election
I20260709 14:49:47.724563  7056 raft_consensus.cc:1081] T bc290da245804ddc92d9597c5da52a82 P 25b7964825a6462295c0606a06169676 [term 2 LEADER]: Signalling peer 41999337784141c5834094008bf6ba97 to start an election
I20260709 14:49:47.729501  6759 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d58c1f5d4e1c448eab811059e23165cc"
dest_uuid: "41999337784141c5834094008bf6ba97"
 from {username='slave'} at 127.0.0.1:49634
I20260709 14:49:47.728812  6756 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bc290da245804ddc92d9597c5da52a82"
dest_uuid: "41999337784141c5834094008bf6ba97"
 from {username='slave'} at 127.0.0.1:49634
I20260709 14:49:47.730307  6759 raft_consensus.cc:493] T d58c1f5d4e1c448eab811059e23165cc P 41999337784141c5834094008bf6ba97 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:49:47.730747  6756 raft_consensus.cc:493] T bc290da245804ddc92d9597c5da52a82 P 41999337784141c5834094008bf6ba97 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:49:47.730837  6759 raft_consensus.cc:3060] T d58c1f5d4e1c448eab811059e23165cc P 41999337784141c5834094008bf6ba97 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:49:47.731141  6756 raft_consensus.cc:3060] T bc290da245804ddc92d9597c5da52a82 P 41999337784141c5834094008bf6ba97 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:49:47.742200  6759 raft_consensus.cc:515] T d58c1f5d4e1c448eab811059e23165cc P 41999337784141c5834094008bf6ba97 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } } peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } }
I20260709 14:49:47.745922  6830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d58c1f5d4e1c448eab811059e23165cc" candidate_uuid: "41999337784141c5834094008bf6ba97" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bf2d93774f73406ead205c8ba8c9da13"
I20260709 14:49:47.746779  6830 raft_consensus.cc:3060] T d58c1f5d4e1c448eab811059e23165cc P bf2d93774f73406ead205c8ba8c9da13 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:49:47.754096  6681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d58c1f5d4e1c448eab811059e23165cc" candidate_uuid: "41999337784141c5834094008bf6ba97" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "25b7964825a6462295c0606a06169676"
I20260709 14:49:47.754791  6681 raft_consensus.cc:3055] T d58c1f5d4e1c448eab811059e23165cc P 25b7964825a6462295c0606a06169676 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 14:49:47.755131  6681 raft_consensus.cc:740] T d58c1f5d4e1c448eab811059e23165cc P 25b7964825a6462295c0606a06169676 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 25b7964825a6462295c0606a06169676, State: Running, Role: LEADER
I20260709 14:49:47.752986  6756 raft_consensus.cc:515] T bc290da245804ddc92d9597c5da52a82 P 41999337784141c5834094008bf6ba97 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:47.756013  6681 consensus_queue.cc:260] T d58c1f5d4e1c448eab811059e23165cc P 25b7964825a6462295c0606a06169676 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } } peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } }
I20260709 14:49:47.759820  6684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc290da245804ddc92d9597c5da52a82" candidate_uuid: "41999337784141c5834094008bf6ba97" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "25b7964825a6462295c0606a06169676"
I20260709 14:49:47.760483  6684 raft_consensus.cc:3055] T bc290da245804ddc92d9597c5da52a82 P 25b7964825a6462295c0606a06169676 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 14:49:47.760524  6681 raft_consensus.cc:3060] T d58c1f5d4e1c448eab811059e23165cc P 25b7964825a6462295c0606a06169676 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:49:47.760986  6684 raft_consensus.cc:740] T bc290da245804ddc92d9597c5da52a82 P 25b7964825a6462295c0606a06169676 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 25b7964825a6462295c0606a06169676, State: Running, Role: LEADER
I20260709 14:49:47.761529  6756 leader_election.cc:290] T bc290da245804ddc92d9597c5da52a82 P 41999337784141c5834094008bf6ba97 [CANDIDATE]: Term 3 election: Requested vote from peers 25b7964825a6462295c0606a06169676 (127.6.101.65:34615), bf2d93774f73406ead205c8ba8c9da13 (127.6.101.67:46675)
I20260709 14:49:47.761951  6684 consensus_queue.cc:260] T bc290da245804ddc92d9597c5da52a82 P 25b7964825a6462295c0606a06169676 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:47.763249  6684 raft_consensus.cc:3060] T bc290da245804ddc92d9597c5da52a82 P 25b7964825a6462295c0606a06169676 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:49:47.763099  6833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc290da245804ddc92d9597c5da52a82" candidate_uuid: "41999337784141c5834094008bf6ba97" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bf2d93774f73406ead205c8ba8c9da13"
I20260709 14:49:47.763895  6833 raft_consensus.cc:3060] T bc290da245804ddc92d9597c5da52a82 P bf2d93774f73406ead205c8ba8c9da13 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:49:47.771608  6684 raft_consensus.cc:2468] T bc290da245804ddc92d9597c5da52a82 P 25b7964825a6462295c0606a06169676 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41999337784141c5834094008bf6ba97 in term 3.
I20260709 14:49:47.773294  6722 leader_election.cc:304] T bc290da245804ddc92d9597c5da52a82 P 41999337784141c5834094008bf6ba97 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b7964825a6462295c0606a06169676, 41999337784141c5834094008bf6ba97; no voters: 
I20260709 14:49:47.774303  7061 raft_consensus.cc:2804] T bc290da245804ddc92d9597c5da52a82 P 41999337784141c5834094008bf6ba97 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 14:49:47.775928  6833 raft_consensus.cc:2468] T bc290da245804ddc92d9597c5da52a82 P bf2d93774f73406ead205c8ba8c9da13 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41999337784141c5834094008bf6ba97 in term 3.
I20260709 14:49:47.779242  7061 raft_consensus.cc:697] T bc290da245804ddc92d9597c5da52a82 P 41999337784141c5834094008bf6ba97 [term 3 LEADER]: Becoming Leader. State: Replica: 41999337784141c5834094008bf6ba97, State: Running, Role: LEADER
I20260709 14:49:47.780408  7061 consensus_queue.cc:237] T bc290da245804ddc92d9597c5da52a82 P 41999337784141c5834094008bf6ba97 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:47.787161  7085 raft_consensus.cc:993] T 1dbff5d6a7234db3a8f367fe9b30d615 P bf2d93774f73406ead205c8ba8c9da13: : Instructing follower 41999337784141c5834094008bf6ba97 to start an election
I20260709 14:49:47.787786  6759 leader_election.cc:290] T d58c1f5d4e1c448eab811059e23165cc P 41999337784141c5834094008bf6ba97 [CANDIDATE]: Term 3 election: Requested vote from peers bf2d93774f73406ead205c8ba8c9da13 (127.6.101.67:46675), 25b7964825a6462295c0606a06169676 (127.6.101.65:34615)
I20260709 14:49:47.792793  7066 raft_consensus.cc:1081] T 1dbff5d6a7234db3a8f367fe9b30d615 P bf2d93774f73406ead205c8ba8c9da13 [term 3 LEADER]: Signalling peer 41999337784141c5834094008bf6ba97 to start an election
I20260709 14:49:47.803125  7077 raft_consensus.cc:993] T 07255af297cd4ac59277e81984f07f9c P 25b7964825a6462295c0606a06169676: : Instructing follower 41999337784141c5834094008bf6ba97 to start an election
I20260709 14:49:47.803606  7077 raft_consensus.cc:1081] T 07255af297cd4ac59277e81984f07f9c P 25b7964825a6462295c0606a06169676 [term 5 LEADER]: Signalling peer 41999337784141c5834094008bf6ba97 to start an election
I20260709 14:49:47.803850  6681 raft_consensus.cc:2468] T d58c1f5d4e1c448eab811059e23165cc P 25b7964825a6462295c0606a06169676 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41999337784141c5834094008bf6ba97 in term 3.
I20260709 14:49:47.806409  6722 leader_election.cc:304] T d58c1f5d4e1c448eab811059e23165cc P 41999337784141c5834094008bf6ba97 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b7964825a6462295c0606a06169676, 41999337784141c5834094008bf6ba97; no voters: 
I20260709 14:49:47.808581  7086 raft_consensus.cc:2804] T d58c1f5d4e1c448eab811059e23165cc P 41999337784141c5834094008bf6ba97 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 14:49:47.810462  6756 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "07255af297cd4ac59277e81984f07f9c"
dest_uuid: "41999337784141c5834094008bf6ba97"
 from {username='slave'} at 127.0.0.1:49634
I20260709 14:49:47.811121  6756 raft_consensus.cc:493] T 07255af297cd4ac59277e81984f07f9c P 41999337784141c5834094008bf6ba97 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:49:47.811563  6756 raft_consensus.cc:3060] T 07255af297cd4ac59277e81984f07f9c P 41999337784141c5834094008bf6ba97 [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:49:47.813920  6830 raft_consensus.cc:2468] T d58c1f5d4e1c448eab811059e23165cc P bf2d93774f73406ead205c8ba8c9da13 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41999337784141c5834094008bf6ba97 in term 3.
I20260709 14:49:47.831642  7086 raft_consensus.cc:697] T d58c1f5d4e1c448eab811059e23165cc P 41999337784141c5834094008bf6ba97 [term 3 LEADER]: Becoming Leader. State: Replica: 41999337784141c5834094008bf6ba97, State: Running, Role: LEADER
I20260709 14:49:47.832892  7086 consensus_queue.cc:237] T d58c1f5d4e1c448eab811059e23165cc P 41999337784141c5834094008bf6ba97 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } } peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } }
I20260709 14:49:47.835098  6759 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1dbff5d6a7234db3a8f367fe9b30d615"
dest_uuid: "41999337784141c5834094008bf6ba97"
 from {username='slave'} at 127.0.0.1:49650
I20260709 14:49:47.835760  6759 raft_consensus.cc:493] T 1dbff5d6a7234db3a8f367fe9b30d615 P 41999337784141c5834094008bf6ba97 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:49:47.836191  6759 raft_consensus.cc:3060] T 1dbff5d6a7234db3a8f367fe9b30d615 P 41999337784141c5834094008bf6ba97 [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:49:47.852058  6756 raft_consensus.cc:515] T 07255af297cd4ac59277e81984f07f9c P 41999337784141c5834094008bf6ba97 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:47.856897  7090 raft_consensus.cc:993] T be9352545ba44d68a3704b39c623e774 P 41999337784141c5834094008bf6ba97: : Instructing follower bf2d93774f73406ead205c8ba8c9da13 to start an election
I20260709 14:49:47.874971  6580 catalog_manager.cc:5697] T bc290da245804ddc92d9597c5da52a82 P 41999337784141c5834094008bf6ba97 reported cstate change: term changed from 2 to 3, leader changed from 25b7964825a6462295c0606a06169676 (127.6.101.65) to 41999337784141c5834094008bf6ba97 (127.6.101.66). New cstate: current_term: 3 leader_uuid: "41999337784141c5834094008bf6ba97" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } health_report { overall_health: UNKNOWN } } }
I20260709 14:49:47.881742  7085 raft_consensus.cc:993] T c8ac07644f37427e80f77c67ccac9328 P bf2d93774f73406ead205c8ba8c9da13: : Instructing follower 41999337784141c5834094008bf6ba97 to start an election
I20260709 14:49:47.882202  6756 leader_election.cc:290] T 07255af297cd4ac59277e81984f07f9c P 41999337784141c5834094008bf6ba97 [CANDIDATE]: Term 6 election: Requested vote from peers 25b7964825a6462295c0606a06169676 (127.6.101.65:34615), bf2d93774f73406ead205c8ba8c9da13 (127.6.101.67:46675)
I20260709 14:49:47.883527  7085 raft_consensus.cc:1081] T c8ac07644f37427e80f77c67ccac9328 P bf2d93774f73406ead205c8ba8c9da13 [term 2 LEADER]: Signalling peer 41999337784141c5834094008bf6ba97 to start an election
I20260709 14:49:47.886427  7090 raft_consensus.cc:1081] T be9352545ba44d68a3704b39c623e774 P 41999337784141c5834094008bf6ba97 [term 3 LEADER]: Signalling peer bf2d93774f73406ead205c8ba8c9da13 to start an election
I20260709 14:49:47.886853  6684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07255af297cd4ac59277e81984f07f9c" candidate_uuid: "41999337784141c5834094008bf6ba97" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "25b7964825a6462295c0606a06169676"
I20260709 14:49:47.887887  6684 raft_consensus.cc:3055] T 07255af297cd4ac59277e81984f07f9c P 25b7964825a6462295c0606a06169676 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 14:49:47.888288  6684 raft_consensus.cc:740] T 07255af297cd4ac59277e81984f07f9c P 25b7964825a6462295c0606a06169676 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 25b7964825a6462295c0606a06169676, State: Running, Role: LEADER
I20260709 14:49:47.888236  6830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07255af297cd4ac59277e81984f07f9c" candidate_uuid: "41999337784141c5834094008bf6ba97" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "bf2d93774f73406ead205c8ba8c9da13"
I20260709 14:49:47.888907  6830 raft_consensus.cc:3060] T 07255af297cd4ac59277e81984f07f9c P bf2d93774f73406ead205c8ba8c9da13 [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:49:47.889350  6684 consensus_queue.cc:260] T 07255af297cd4ac59277e81984f07f9c P 25b7964825a6462295c0606a06169676 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:47.890790  6684 raft_consensus.cc:3060] T 07255af297cd4ac59277e81984f07f9c P 25b7964825a6462295c0606a06169676 [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:49:47.894830  6833 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "be9352545ba44d68a3704b39c623e774"
dest_uuid: "bf2d93774f73406ead205c8ba8c9da13"
 from {username='slave'} at 127.0.0.1:46176
I20260709 14:49:47.895519  6833 raft_consensus.cc:493] T be9352545ba44d68a3704b39c623e774 P bf2d93774f73406ead205c8ba8c9da13 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:49:47.897897  6759 raft_consensus.cc:515] T 1dbff5d6a7234db3a8f367fe9b30d615 P 41999337784141c5834094008bf6ba97 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:47.898145  6833 raft_consensus.cc:3060] T be9352545ba44d68a3704b39c623e774 P bf2d93774f73406ead205c8ba8c9da13 [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:49:47.901895  6756 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c8ac07644f37427e80f77c67ccac9328"
dest_uuid: "41999337784141c5834094008bf6ba97"
 from {username='slave'} at 127.0.0.1:49650
I20260709 14:49:47.902681  6756 raft_consensus.cc:493] T c8ac07644f37427e80f77c67ccac9328 P 41999337784141c5834094008bf6ba97 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:49:47.903436  6756 raft_consensus.cc:3060] T c8ac07644f37427e80f77c67ccac9328 P 41999337784141c5834094008bf6ba97 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:49:47.910804  6681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbff5d6a7234db3a8f367fe9b30d615" candidate_uuid: "41999337784141c5834094008bf6ba97" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "25b7964825a6462295c0606a06169676"
I20260709 14:49:47.911885  6681 raft_consensus.cc:3060] T 1dbff5d6a7234db3a8f367fe9b30d615 P 25b7964825a6462295c0606a06169676 [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:49:47.913815  6832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbff5d6a7234db3a8f367fe9b30d615" candidate_uuid: "41999337784141c5834094008bf6ba97" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "bf2d93774f73406ead205c8ba8c9da13"
I20260709 14:49:47.918902  6832 raft_consensus.cc:3055] T 1dbff5d6a7234db3a8f367fe9b30d615 P bf2d93774f73406ead205c8ba8c9da13 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 14:49:47.919167  6832 raft_consensus.cc:740] T 1dbff5d6a7234db3a8f367fe9b30d615 P bf2d93774f73406ead205c8ba8c9da13 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bf2d93774f73406ead205c8ba8c9da13, State: Running, Role: LEADER
I20260709 14:49:47.919876  6832 consensus_queue.cc:260] T 1dbff5d6a7234db3a8f367fe9b30d615 P bf2d93774f73406ead205c8ba8c9da13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:47.917121  7085 raft_consensus.cc:993] T 3d8096f833ea45ce9471c56d3ce1a68b P bf2d93774f73406ead205c8ba8c9da13: : Instructing follower 41999337784141c5834094008bf6ba97 to start an election
I20260709 14:49:47.921959  6832 raft_consensus.cc:3060] T 1dbff5d6a7234db3a8f367fe9b30d615 P bf2d93774f73406ead205c8ba8c9da13 [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:49:47.917986  6833 raft_consensus.cc:515] T be9352545ba44d68a3704b39c623e774 P bf2d93774f73406ead205c8ba8c9da13 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:47.917479  6759 leader_election.cc:290] T 1dbff5d6a7234db3a8f367fe9b30d615 P 41999337784141c5834094008bf6ba97 [CANDIDATE]: Term 4 election: Requested vote from peers 25b7964825a6462295c0606a06169676 (127.6.101.65:34615), bf2d93774f73406ead205c8ba8c9da13 (127.6.101.67:46675)
I20260709 14:49:47.925135  7066 raft_consensus.cc:1081] T 3d8096f833ea45ce9471c56d3ce1a68b P bf2d93774f73406ead205c8ba8c9da13 [term 5 LEADER]: Signalling peer 41999337784141c5834094008bf6ba97 to start an election
I20260709 14:49:47.913211  6830 raft_consensus.cc:2468] T 07255af297cd4ac59277e81984f07f9c P bf2d93774f73406ead205c8ba8c9da13 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41999337784141c5834094008bf6ba97 in term 6.
I20260709 14:49:47.929502  6833 leader_election.cc:290] T be9352545ba44d68a3704b39c623e774 P bf2d93774f73406ead205c8ba8c9da13 [CANDIDATE]: Term 4 election: Requested vote from peers 25b7964825a6462295c0606a06169676 (127.6.101.65:34615), 41999337784141c5834094008bf6ba97 (127.6.101.66:35001)
I20260709 14:49:47.931017  6680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9352545ba44d68a3704b39c623e774" candidate_uuid: "bf2d93774f73406ead205c8ba8c9da13" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "25b7964825a6462295c0606a06169676"
I20260709 14:49:47.931766  6725 leader_election.cc:304] T 07255af297cd4ac59277e81984f07f9c P 41999337784141c5834094008bf6ba97 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41999337784141c5834094008bf6ba97, bf2d93774f73406ead205c8ba8c9da13; no voters: 
I20260709 14:49:47.933109  7090 raft_consensus.cc:2804] T 07255af297cd4ac59277e81984f07f9c P 41999337784141c5834094008bf6ba97 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 14:49:47.931847  6680 raft_consensus.cc:3060] T be9352545ba44d68a3704b39c623e774 P 25b7964825a6462295c0606a06169676 [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:49:47.936601  6832 raft_consensus.cc:2468] T 1dbff5d6a7234db3a8f367fe9b30d615 P bf2d93774f73406ead205c8ba8c9da13 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41999337784141c5834094008bf6ba97 in term 4.
I20260709 14:49:47.933698  7090 raft_consensus.cc:697] T 07255af297cd4ac59277e81984f07f9c P 41999337784141c5834094008bf6ba97 [term 6 LEADER]: Becoming Leader. State: Replica: 41999337784141c5834094008bf6ba97, State: Running, Role: LEADER
I20260709 14:49:47.938339  6725 leader_election.cc:304] T 1dbff5d6a7234db3a8f367fe9b30d615 P 41999337784141c5834094008bf6ba97 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41999337784141c5834094008bf6ba97, bf2d93774f73406ead205c8ba8c9da13; no voters: 
I20260709 14:49:47.939015  6757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9352545ba44d68a3704b39c623e774" candidate_uuid: "bf2d93774f73406ead205c8ba8c9da13" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "41999337784141c5834094008bf6ba97"
I20260709 14:49:47.940728  6757 raft_consensus.cc:3055] T be9352545ba44d68a3704b39c623e774 P 41999337784141c5834094008bf6ba97 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 14:49:47.941063  6757 raft_consensus.cc:740] T be9352545ba44d68a3704b39c623e774 P 41999337784141c5834094008bf6ba97 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 41999337784141c5834094008bf6ba97, State: Running, Role: LEADER
I20260709 14:49:47.941704  6759 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3d8096f833ea45ce9471c56d3ce1a68b"
dest_uuid: "41999337784141c5834094008bf6ba97"
 from {username='slave'} at 127.0.0.1:49650
I20260709 14:49:47.942353  6759 raft_consensus.cc:493] T 3d8096f833ea45ce9471c56d3ce1a68b P 41999337784141c5834094008bf6ba97 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:49:47.942124  6757 consensus_queue.cc:260] T be9352545ba44d68a3704b39c623e774 P 41999337784141c5834094008bf6ba97 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:47.942745  6759 raft_consensus.cc:3060] T 3d8096f833ea45ce9471c56d3ce1a68b P 41999337784141c5834094008bf6ba97 [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:49:47.943552  6757 raft_consensus.cc:3060] T be9352545ba44d68a3704b39c623e774 P 41999337784141c5834094008bf6ba97 [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:49:47.939474  7090 consensus_queue.cc:237] T 07255af297cd4ac59277e81984f07f9c P 41999337784141c5834094008bf6ba97 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:47.946451  7088 raft_consensus.cc:2804] T 1dbff5d6a7234db3a8f367fe9b30d615 P 41999337784141c5834094008bf6ba97 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 14:49:47.947096  7088 raft_consensus.cc:697] T 1dbff5d6a7234db3a8f367fe9b30d615 P 41999337784141c5834094008bf6ba97 [term 4 LEADER]: Becoming Leader. State: Replica: 41999337784141c5834094008bf6ba97, State: Running, Role: LEADER
I20260709 14:49:47.918381  6684 raft_consensus.cc:2468] T 07255af297cd4ac59277e81984f07f9c P 25b7964825a6462295c0606a06169676 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41999337784141c5834094008bf6ba97 in term 6.
I20260709 14:49:47.949965  7088 consensus_queue.cc:237] T 1dbff5d6a7234db3a8f367fe9b30d615 P 41999337784141c5834094008bf6ba97 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:47.942549  6756 raft_consensus.cc:515] T c8ac07644f37427e80f77c67ccac9328 P 41999337784141c5834094008bf6ba97 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:47.956950  6759 raft_consensus.cc:515] T 3d8096f833ea45ce9471c56d3ce1a68b P 41999337784141c5834094008bf6ba97 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:47.960196  6684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ac07644f37427e80f77c67ccac9328" candidate_uuid: "41999337784141c5834094008bf6ba97" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "25b7964825a6462295c0606a06169676"
I20260709 14:49:47.960942  6684 raft_consensus.cc:3060] T c8ac07644f37427e80f77c67ccac9328 P 25b7964825a6462295c0606a06169676 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:49:47.950078  6681 raft_consensus.cc:2468] T 1dbff5d6a7234db3a8f367fe9b30d615 P 25b7964825a6462295c0606a06169676 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41999337784141c5834094008bf6ba97 in term 4.
I20260709 14:49:47.963469  6759 leader_election.cc:290] T 3d8096f833ea45ce9471c56d3ce1a68b P 41999337784141c5834094008bf6ba97 [CANDIDATE]: Term 6 election: Requested vote from peers 25b7964825a6462295c0606a06169676 (127.6.101.65:34615), bf2d93774f73406ead205c8ba8c9da13 (127.6.101.67:46675)
I20260709 14:49:47.963944  6756 leader_election.cc:290] T c8ac07644f37427e80f77c67ccac9328 P 41999337784141c5834094008bf6ba97 [CANDIDATE]: Term 3 election: Requested vote from peers 25b7964825a6462295c0606a06169676 (127.6.101.65:34615), bf2d93774f73406ead205c8ba8c9da13 (127.6.101.67:46675)
I20260709 14:49:47.965934  6832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ac07644f37427e80f77c67ccac9328" candidate_uuid: "41999337784141c5834094008bf6ba97" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bf2d93774f73406ead205c8ba8c9da13"
I20260709 14:49:47.967331  6832 raft_consensus.cc:3055] T c8ac07644f37427e80f77c67ccac9328 P bf2d93774f73406ead205c8ba8c9da13 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 14:49:47.967576  6832 raft_consensus.cc:740] T c8ac07644f37427e80f77c67ccac9328 P bf2d93774f73406ead205c8ba8c9da13 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bf2d93774f73406ead205c8ba8c9da13, State: Running, Role: LEADER
I20260709 14:49:47.968290  6832 consensus_queue.cc:260] T c8ac07644f37427e80f77c67ccac9328 P bf2d93774f73406ead205c8ba8c9da13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:47.969161  6832 raft_consensus.cc:3060] T c8ac07644f37427e80f77c67ccac9328 P bf2d93774f73406ead205c8ba8c9da13 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:49:47.966444  6678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d8096f833ea45ce9471c56d3ce1a68b" candidate_uuid: "41999337784141c5834094008bf6ba97" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "25b7964825a6462295c0606a06169676"
I20260709 14:49:47.966655  6830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d8096f833ea45ce9471c56d3ce1a68b" candidate_uuid: "41999337784141c5834094008bf6ba97" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "bf2d93774f73406ead205c8ba8c9da13"
I20260709 14:49:47.972658  6678 raft_consensus.cc:3060] T 3d8096f833ea45ce9471c56d3ce1a68b P 25b7964825a6462295c0606a06169676 [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:49:47.973001  6830 raft_consensus.cc:3055] T 3d8096f833ea45ce9471c56d3ce1a68b P bf2d93774f73406ead205c8ba8c9da13 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 14:49:47.974763  6830 raft_consensus.cc:740] T 3d8096f833ea45ce9471c56d3ce1a68b P bf2d93774f73406ead205c8ba8c9da13 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: bf2d93774f73406ead205c8ba8c9da13, State: Running, Role: LEADER
I20260709 14:49:47.977921  6757 raft_consensus.cc:2468] T be9352545ba44d68a3704b39c623e774 P 41999337784141c5834094008bf6ba97 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf2d93774f73406ead205c8ba8c9da13 in term 4.
I20260709 14:49:47.979012  6684 raft_consensus.cc:2468] T c8ac07644f37427e80f77c67ccac9328 P 25b7964825a6462295c0606a06169676 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41999337784141c5834094008bf6ba97 in term 3.
I20260709 14:49:47.980799  6832 raft_consensus.cc:2468] T c8ac07644f37427e80f77c67ccac9328 P bf2d93774f73406ead205c8ba8c9da13 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41999337784141c5834094008bf6ba97 in term 3.
I20260709 14:49:47.982223  6725 leader_election.cc:304] T c8ac07644f37427e80f77c67ccac9328 P 41999337784141c5834094008bf6ba97 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41999337784141c5834094008bf6ba97, bf2d93774f73406ead205c8ba8c9da13; no voters: 
I20260709 14:49:47.985216  7086 raft_consensus.cc:2804] T c8ac07644f37427e80f77c67ccac9328 P 41999337784141c5834094008bf6ba97 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 14:49:47.985903  7086 raft_consensus.cc:697] T c8ac07644f37427e80f77c67ccac9328 P 41999337784141c5834094008bf6ba97 [term 3 LEADER]: Becoming Leader. State: Replica: 41999337784141c5834094008bf6ba97, State: Running, Role: LEADER
I20260709 14:49:47.976404  6830 consensus_queue.cc:260] T 3d8096f833ea45ce9471c56d3ce1a68b P bf2d93774f73406ead205c8ba8c9da13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:47.987090  6830 raft_consensus.cc:3060] T 3d8096f833ea45ce9471c56d3ce1a68b P bf2d93774f73406ead205c8ba8c9da13 [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:49:47.986860  7086 consensus_queue.cc:237] T c8ac07644f37427e80f77c67ccac9328 P 41999337784141c5834094008bf6ba97 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:47.970082  6680 raft_consensus.cc:2468] T be9352545ba44d68a3704b39c623e774 P 25b7964825a6462295c0606a06169676 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf2d93774f73406ead205c8ba8c9da13 in term 4.
I20260709 14:49:47.998453  6678 raft_consensus.cc:2468] T 3d8096f833ea45ce9471c56d3ce1a68b P 25b7964825a6462295c0606a06169676 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41999337784141c5834094008bf6ba97 in term 6.
I20260709 14:49:48.004362  6797 leader_election.cc:304] T be9352545ba44d68a3704b39c623e774 P bf2d93774f73406ead205c8ba8c9da13 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41999337784141c5834094008bf6ba97, bf2d93774f73406ead205c8ba8c9da13; no voters: 
I20260709 14:49:48.008368  6722 leader_election.cc:304] T 3d8096f833ea45ce9471c56d3ce1a68b P 41999337784141c5834094008bf6ba97 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b7964825a6462295c0606a06169676, 41999337784141c5834094008bf6ba97; no voters: 
I20260709 14:49:48.010819  7095 raft_consensus.cc:2804] T be9352545ba44d68a3704b39c623e774 P bf2d93774f73406ead205c8ba8c9da13 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 14:49:48.011432  7091 raft_consensus.cc:2804] T 3d8096f833ea45ce9471c56d3ce1a68b P 41999337784141c5834094008bf6ba97 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 14:49:48.012758  7095 raft_consensus.cc:697] T be9352545ba44d68a3704b39c623e774 P bf2d93774f73406ead205c8ba8c9da13 [term 4 LEADER]: Becoming Leader. State: Replica: bf2d93774f73406ead205c8ba8c9da13, State: Running, Role: LEADER
I20260709 14:49:48.012342  7091 raft_consensus.cc:697] T 3d8096f833ea45ce9471c56d3ce1a68b P 41999337784141c5834094008bf6ba97 [term 6 LEADER]: Becoming Leader. State: Replica: 41999337784141c5834094008bf6ba97, State: Running, Role: LEADER
I20260709 14:49:48.014889  7095 consensus_queue.cc:237] T be9352545ba44d68a3704b39c623e774 P bf2d93774f73406ead205c8ba8c9da13 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:48.019763  7091 consensus_queue.cc:237] T 3d8096f833ea45ce9471c56d3ce1a68b P 41999337784141c5834094008bf6ba97 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:48.040966  6830 raft_consensus.cc:2468] T 3d8096f833ea45ce9471c56d3ce1a68b P bf2d93774f73406ead205c8ba8c9da13 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41999337784141c5834094008bf6ba97 in term 6.
I20260709 14:49:48.054836  6580 catalog_manager.cc:5697] T be9352545ba44d68a3704b39c623e774 P bf2d93774f73406ead205c8ba8c9da13 reported cstate change: term changed from 3 to 4, leader changed from 41999337784141c5834094008bf6ba97 (127.6.101.66) to bf2d93774f73406ead205c8ba8c9da13 (127.6.101.67). New cstate: current_term: 4 leader_uuid: "bf2d93774f73406ead205c8ba8c9da13" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } health_report { overall_health: HEALTHY } } }
I20260709 14:49:48.059973  6578 catalog_manager.cc:5697] T 3d8096f833ea45ce9471c56d3ce1a68b P 41999337784141c5834094008bf6ba97 reported cstate change: term changed from 5 to 6, leader changed from bf2d93774f73406ead205c8ba8c9da13 (127.6.101.67) to 41999337784141c5834094008bf6ba97 (127.6.101.66). New cstate: current_term: 6 leader_uuid: "41999337784141c5834094008bf6ba97" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } health_report { overall_health: UNKNOWN } } }
I20260709 14:49:48.061825  6578 catalog_manager.cc:5697] T d58c1f5d4e1c448eab811059e23165cc P 41999337784141c5834094008bf6ba97 reported cstate change: term changed from 2 to 3, leader changed from 25b7964825a6462295c0606a06169676 (127.6.101.65) to 41999337784141c5834094008bf6ba97 (127.6.101.66). New cstate: current_term: 3 leader_uuid: "41999337784141c5834094008bf6ba97" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } health_report { overall_health: UNKNOWN } } }
I20260709 14:49:48.063378  6578 catalog_manager.cc:5697] T 07255af297cd4ac59277e81984f07f9c P 41999337784141c5834094008bf6ba97 reported cstate change: term changed from 5 to 6, leader changed from 25b7964825a6462295c0606a06169676 (127.6.101.65) to 41999337784141c5834094008bf6ba97 (127.6.101.66). New cstate: current_term: 6 leader_uuid: "41999337784141c5834094008bf6ba97" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } health_report { overall_health: UNKNOWN } } }
I20260709 14:49:48.064886  6578 catalog_manager.cc:5697] T 1dbff5d6a7234db3a8f367fe9b30d615 P 41999337784141c5834094008bf6ba97 reported cstate change: term changed from 3 to 4, leader changed from bf2d93774f73406ead205c8ba8c9da13 (127.6.101.67) to 41999337784141c5834094008bf6ba97 (127.6.101.66). New cstate: current_term: 4 leader_uuid: "41999337784141c5834094008bf6ba97" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } health_report { overall_health: UNKNOWN } } }
I20260709 14:49:48.068188  6578 catalog_manager.cc:5697] T c8ac07644f37427e80f77c67ccac9328 P 41999337784141c5834094008bf6ba97 reported cstate change: term changed from 2 to 3, leader changed from bf2d93774f73406ead205c8ba8c9da13 (127.6.101.67) to 41999337784141c5834094008bf6ba97 (127.6.101.66). New cstate: current_term: 3 leader_uuid: "41999337784141c5834094008bf6ba97" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } health_report { overall_health: UNKNOWN } } }
I20260709 14:49:48.175601  6830 raft_consensus.cc:1275] T bc290da245804ddc92d9597c5da52a82 P bf2d93774f73406ead205c8ba8c9da13 [term 3 FOLLOWER]: Refusing update from remote peer 41999337784141c5834094008bf6ba97: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 14:49:48.177793  7091 consensus_queue.cc:1048] T bc290da245804ddc92d9597c5da52a82 P 41999337784141c5834094008bf6ba97 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 14:49:48.198442  6684 raft_consensus.cc:1275] T bc290da245804ddc92d9597c5da52a82 P 25b7964825a6462295c0606a06169676 [term 3 FOLLOWER]: Refusing update from remote peer 41999337784141c5834094008bf6ba97: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 14:49:48.202265  7086 consensus_queue.cc:1048] T bc290da245804ddc92d9597c5da52a82 P 41999337784141c5834094008bf6ba97 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 14:49:48.304515  6684 raft_consensus.cc:1275] T d58c1f5d4e1c448eab811059e23165cc P 25b7964825a6462295c0606a06169676 [term 3 FOLLOWER]: Refusing update from remote peer 41999337784141c5834094008bf6ba97: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 14:49:48.306689  7091 consensus_queue.cc:1048] T d58c1f5d4e1c448eab811059e23165cc P 41999337784141c5834094008bf6ba97 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 14:49:48.319160  6830 raft_consensus.cc:1275] T d58c1f5d4e1c448eab811059e23165cc P bf2d93774f73406ead205c8ba8c9da13 [term 3 FOLLOWER]: Refusing update from remote peer 41999337784141c5834094008bf6ba97: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 14:49:48.321281  7088 consensus_queue.cc:1048] T d58c1f5d4e1c448eab811059e23165cc P 41999337784141c5834094008bf6ba97 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 14:49:48.417330  6830 raft_consensus.cc:1275] T 3d8096f833ea45ce9471c56d3ce1a68b P bf2d93774f73406ead205c8ba8c9da13 [term 6 FOLLOWER]: Refusing update from remote peer 41999337784141c5834094008bf6ba97: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 14:49:48.419134  7088 consensus_queue.cc:1048] T 3d8096f833ea45ce9471c56d3ce1a68b P 41999337784141c5834094008bf6ba97 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 14:49:48.431234  6684 raft_consensus.cc:1275] T 3d8096f833ea45ce9471c56d3ce1a68b P 25b7964825a6462295c0606a06169676 [term 6 FOLLOWER]: Refusing update from remote peer 41999337784141c5834094008bf6ba97: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 14:49:48.433195  7088 consensus_queue.cc:1048] T 3d8096f833ea45ce9471c56d3ce1a68b P 41999337784141c5834094008bf6ba97 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 14:49:48.451924  6684 raft_consensus.cc:1275] T be9352545ba44d68a3704b39c623e774 P 25b7964825a6462295c0606a06169676 [term 4 FOLLOWER]: Refusing update from remote peer bf2d93774f73406ead205c8ba8c9da13: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 14:49:48.454192  7095 consensus_queue.cc:1048] T be9352545ba44d68a3704b39c623e774 P bf2d93774f73406ead205c8ba8c9da13 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 14:49:48.468703  6757 raft_consensus.cc:1275] T be9352545ba44d68a3704b39c623e774 P 41999337784141c5834094008bf6ba97 [term 4 FOLLOWER]: Refusing update from remote peer bf2d93774f73406ead205c8ba8c9da13: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 14:49:48.470849  7095 consensus_queue.cc:1048] T be9352545ba44d68a3704b39c623e774 P bf2d93774f73406ead205c8ba8c9da13 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 14:49:48.509408  6830 raft_consensus.cc:1275] T 1dbff5d6a7234db3a8f367fe9b30d615 P bf2d93774f73406ead205c8ba8c9da13 [term 4 FOLLOWER]: Refusing update from remote peer 41999337784141c5834094008bf6ba97: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 14:49:48.511059  7090 consensus_queue.cc:1048] T 1dbff5d6a7234db3a8f367fe9b30d615 P 41999337784141c5834094008bf6ba97 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 14:49:48.524371  6684 raft_consensus.cc:1275] T 1dbff5d6a7234db3a8f367fe9b30d615 P 25b7964825a6462295c0606a06169676 [term 4 FOLLOWER]: Refusing update from remote peer 41999337784141c5834094008bf6ba97: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 14:49:48.526644  7088 consensus_queue.cc:1048] T 1dbff5d6a7234db3a8f367fe9b30d615 P 41999337784141c5834094008bf6ba97 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 14:49:48.531363  6830 raft_consensus.cc:1275] T 07255af297cd4ac59277e81984f07f9c P bf2d93774f73406ead205c8ba8c9da13 [term 6 FOLLOWER]: Refusing update from remote peer 41999337784141c5834094008bf6ba97: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 14:49:48.532851  7088 consensus_queue.cc:1048] T 07255af297cd4ac59277e81984f07f9c P 41999337784141c5834094008bf6ba97 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 14:49:48.540774  6680 raft_consensus.cc:1275] T c8ac07644f37427e80f77c67ccac9328 P 25b7964825a6462295c0606a06169676 [term 3 FOLLOWER]: Refusing update from remote peer 41999337784141c5834094008bf6ba97: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 14:49:48.543625  7091 consensus_queue.cc:1048] T c8ac07644f37427e80f77c67ccac9328 P 41999337784141c5834094008bf6ba97 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 14:49:48.547796  6678 raft_consensus.cc:1275] T 07255af297cd4ac59277e81984f07f9c P 25b7964825a6462295c0606a06169676 [term 6 FOLLOWER]: Refusing update from remote peer 41999337784141c5834094008bf6ba97: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 14:49:48.552016  7088 consensus_queue.cc:1048] T 07255af297cd4ac59277e81984f07f9c P 41999337784141c5834094008bf6ba97 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 14:49:48.557924  6832 raft_consensus.cc:1275] T c8ac07644f37427e80f77c67ccac9328 P bf2d93774f73406ead205c8ba8c9da13 [term 3 FOLLOWER]: Refusing update from remote peer 41999337784141c5834094008bf6ba97: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 14:49:48.562023  7091 consensus_queue.cc:1048] T c8ac07644f37427e80f77c67ccac9328 P 41999337784141c5834094008bf6ba97 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 14:49:50.120692  6612 debug-util.cc:398] Leaking SignalData structure 0x7b0800188980 after lost signal to thread 6552
W20260709 14:49:50.121670  6612 debug-util.cc:398] Leaking SignalData structure 0x7b0800104480 after lost signal to thread 6615
W20260709 14:49:50.122628  6612 debug-util.cc:398] Leaking SignalData structure 0x7b0800062420 after lost signal to thread 6708
W20260709 14:49:50.123620  6612 debug-util.cc:398] Leaking SignalData structure 0x7b08001f74a0 after lost signal to thread 6783
W20260709 14:49:50.124533  6612 debug-util.cc:398] Leaking SignalData structure 0x7b0800040fa0 after lost signal to thread 6857
I20260709 14:49:51.297840  6549 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 14:49:51.307072  6757 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "07255af297cd4ac59277e81984f07f9c"
dest_uuid: "41999337784141c5834094008bf6ba97"
mode: GRACEFUL
new_leader_uuid: "25b7964825a6462295c0606a06169676"
 from {username='slave'} at 127.0.0.1:49668
I20260709 14:49:51.307700  6757 raft_consensus.cc:606] T 07255af297cd4ac59277e81984f07f9c P 41999337784141c5834094008bf6ba97 [term 6 LEADER]: Received request to transfer leadership to TS 25b7964825a6462295c0606a06169676
I20260709 14:49:51.311235  6757 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1dbff5d6a7234db3a8f367fe9b30d615"
dest_uuid: "41999337784141c5834094008bf6ba97"
mode: GRACEFUL
new_leader_uuid: "25b7964825a6462295c0606a06169676"
 from {username='slave'} at 127.0.0.1:49668
I20260709 14:49:51.311908  6757 raft_consensus.cc:606] T 1dbff5d6a7234db3a8f367fe9b30d615 P 41999337784141c5834094008bf6ba97 [term 4 LEADER]: Received request to transfer leadership to TS 25b7964825a6462295c0606a06169676
I20260709 14:49:51.315442  6757 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5ce18799382e46108fbcbed2c364321d"
dest_uuid: "41999337784141c5834094008bf6ba97"
mode: GRACEFUL
new_leader_uuid: "bf2d93774f73406ead205c8ba8c9da13"
 from {username='slave'} at 127.0.0.1:49668
I20260709 14:49:51.316135  6757 raft_consensus.cc:606] T 5ce18799382e46108fbcbed2c364321d P 41999337784141c5834094008bf6ba97 [term 4 LEADER]: Received request to transfer leadership to TS bf2d93774f73406ead205c8ba8c9da13
I20260709 14:49:51.319314  6757 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "82a2d00569854cd990c582b9693829ff"
dest_uuid: "41999337784141c5834094008bf6ba97"
mode: GRACEFUL
new_leader_uuid: "bf2d93774f73406ead205c8ba8c9da13"
 from {username='slave'} at 127.0.0.1:49668
I20260709 14:49:51.320009  6757 raft_consensus.cc:606] T 82a2d00569854cd990c582b9693829ff P 41999337784141c5834094008bf6ba97 [term 1 LEADER]: Received request to transfer leadership to TS bf2d93774f73406ead205c8ba8c9da13
I20260709 14:49:51.322975  6757 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c8ac07644f37427e80f77c67ccac9328"
dest_uuid: "41999337784141c5834094008bf6ba97"
mode: GRACEFUL
new_leader_uuid: "25b7964825a6462295c0606a06169676"
 from {username='slave'} at 127.0.0.1:49668
I20260709 14:49:51.323601  6757 raft_consensus.cc:606] T c8ac07644f37427e80f77c67ccac9328 P 41999337784141c5834094008bf6ba97 [term 3 LEADER]: Received request to transfer leadership to TS 25b7964825a6462295c0606a06169676
I20260709 14:49:51.324973  6549 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 14:49:51.325593  6549 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 14:49:51.462585  7126 raft_consensus.cc:993] T c8ac07644f37427e80f77c67ccac9328 P 41999337784141c5834094008bf6ba97: : Instructing follower 25b7964825a6462295c0606a06169676 to start an election
I20260709 14:49:51.463331  7086 raft_consensus.cc:1081] T c8ac07644f37427e80f77c67ccac9328 P 41999337784141c5834094008bf6ba97 [term 3 LEADER]: Signalling peer 25b7964825a6462295c0606a06169676 to start an election
I20260709 14:49:51.465446  6681 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c8ac07644f37427e80f77c67ccac9328"
dest_uuid: "25b7964825a6462295c0606a06169676"
 from {username='slave'} at 127.0.0.1:42184
I20260709 14:49:51.466262  6681 raft_consensus.cc:493] T c8ac07644f37427e80f77c67ccac9328 P 25b7964825a6462295c0606a06169676 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:49:51.466638  6681 raft_consensus.cc:3060] T c8ac07644f37427e80f77c67ccac9328 P 25b7964825a6462295c0606a06169676 [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:49:51.474087  6681 raft_consensus.cc:515] T c8ac07644f37427e80f77c67ccac9328 P 25b7964825a6462295c0606a06169676 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:51.477072  6681 leader_election.cc:290] T c8ac07644f37427e80f77c67ccac9328 P 25b7964825a6462295c0606a06169676 [CANDIDATE]: Term 4 election: Requested vote from peers 41999337784141c5834094008bf6ba97 (127.6.101.66:35001), bf2d93774f73406ead205c8ba8c9da13 (127.6.101.67:46675)
I20260709 14:49:51.478214  6833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ac07644f37427e80f77c67ccac9328" candidate_uuid: "25b7964825a6462295c0606a06169676" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "bf2d93774f73406ead205c8ba8c9da13"
I20260709 14:49:51.478255  6757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ac07644f37427e80f77c67ccac9328" candidate_uuid: "25b7964825a6462295c0606a06169676" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "41999337784141c5834094008bf6ba97"
I20260709 14:49:51.478914  6833 raft_consensus.cc:3060] T c8ac07644f37427e80f77c67ccac9328 P bf2d93774f73406ead205c8ba8c9da13 [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:49:51.479044  6757 raft_consensus.cc:3055] T c8ac07644f37427e80f77c67ccac9328 P 41999337784141c5834094008bf6ba97 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 14:49:51.479451  6757 raft_consensus.cc:740] T c8ac07644f37427e80f77c67ccac9328 P 41999337784141c5834094008bf6ba97 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 41999337784141c5834094008bf6ba97, State: Running, Role: LEADER
I20260709 14:49:51.480240  6757 consensus_queue.cc:260] T c8ac07644f37427e80f77c67ccac9328 P 41999337784141c5834094008bf6ba97 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:51.481281  6757 raft_consensus.cc:3060] T c8ac07644f37427e80f77c67ccac9328 P 41999337784141c5834094008bf6ba97 [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:49:51.484532  6833 raft_consensus.cc:2468] T c8ac07644f37427e80f77c67ccac9328 P bf2d93774f73406ead205c8ba8c9da13 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b7964825a6462295c0606a06169676 in term 4.
I20260709 14:49:51.486151  6650 leader_election.cc:304] T c8ac07644f37427e80f77c67ccac9328 P 25b7964825a6462295c0606a06169676 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b7964825a6462295c0606a06169676, bf2d93774f73406ead205c8ba8c9da13; no voters: 
I20260709 14:49:51.488031  7127 raft_consensus.cc:2804] T c8ac07644f37427e80f77c67ccac9328 P 25b7964825a6462295c0606a06169676 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 14:49:51.489614  7127 raft_consensus.cc:697] T c8ac07644f37427e80f77c67ccac9328 P 25b7964825a6462295c0606a06169676 [term 4 LEADER]: Becoming Leader. State: Replica: 25b7964825a6462295c0606a06169676, State: Running, Role: LEADER
I20260709 14:49:51.489830  6757 raft_consensus.cc:2468] T c8ac07644f37427e80f77c67ccac9328 P 41999337784141c5834094008bf6ba97 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b7964825a6462295c0606a06169676 in term 4.
I20260709 14:49:51.491125  7127 consensus_queue.cc:237] T c8ac07644f37427e80f77c67ccac9328 P 25b7964825a6462295c0606a06169676 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:51.502386  6578 catalog_manager.cc:5697] T c8ac07644f37427e80f77c67ccac9328 P 25b7964825a6462295c0606a06169676 reported cstate change: term changed from 3 to 4, leader changed from 41999337784141c5834094008bf6ba97 (127.6.101.66) to 25b7964825a6462295c0606a06169676 (127.6.101.65). New cstate: current_term: 4 leader_uuid: "25b7964825a6462295c0606a06169676" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } health_report { overall_health: UNKNOWN } } }
I20260709 14:49:51.510324  7086 raft_consensus.cc:993] T 1dbff5d6a7234db3a8f367fe9b30d615 P 41999337784141c5834094008bf6ba97: : Instructing follower 25b7964825a6462295c0606a06169676 to start an election
I20260709 14:49:51.512275  7126 raft_consensus.cc:1081] T 1dbff5d6a7234db3a8f367fe9b30d615 P 41999337784141c5834094008bf6ba97 [term 4 LEADER]: Signalling peer 25b7964825a6462295c0606a06169676 to start an election
I20260709 14:49:51.515354  6681 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1dbff5d6a7234db3a8f367fe9b30d615"
dest_uuid: "25b7964825a6462295c0606a06169676"
 from {username='slave'} at 127.0.0.1:42184
I20260709 14:49:51.516721  6681 raft_consensus.cc:493] T 1dbff5d6a7234db3a8f367fe9b30d615 P 25b7964825a6462295c0606a06169676 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:49:51.517957  7126 raft_consensus.cc:993] T 82a2d00569854cd990c582b9693829ff P 41999337784141c5834094008bf6ba97: : Instructing follower bf2d93774f73406ead205c8ba8c9da13 to start an election
I20260709 14:49:51.518278  6681 raft_consensus.cc:3060] T 1dbff5d6a7234db3a8f367fe9b30d615 P 25b7964825a6462295c0606a06169676 [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:49:51.518630  7132 raft_consensus.cc:1081] T 82a2d00569854cd990c582b9693829ff P 41999337784141c5834094008bf6ba97 [term 1 LEADER]: Signalling peer bf2d93774f73406ead205c8ba8c9da13 to start an election
I20260709 14:49:51.521149  6833 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "82a2d00569854cd990c582b9693829ff"
dest_uuid: "bf2d93774f73406ead205c8ba8c9da13"
 from {username='slave'} at 127.0.0.1:46176
I20260709 14:49:51.521801  6833 raft_consensus.cc:493] T 82a2d00569854cd990c582b9693829ff P bf2d93774f73406ead205c8ba8c9da13 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:49:51.522178  6833 raft_consensus.cc:3060] T 82a2d00569854cd990c582b9693829ff P bf2d93774f73406ead205c8ba8c9da13 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:49:51.529162  6681 raft_consensus.cc:515] T 1dbff5d6a7234db3a8f367fe9b30d615 P 25b7964825a6462295c0606a06169676 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:51.531701  6833 raft_consensus.cc:515] T 82a2d00569854cd990c582b9693829ff P bf2d93774f73406ead205c8ba8c9da13 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:51.534442  6681 leader_election.cc:290] T 1dbff5d6a7234db3a8f367fe9b30d615 P 25b7964825a6462295c0606a06169676 [CANDIDATE]: Term 5 election: Requested vote from peers 41999337784141c5834094008bf6ba97 (127.6.101.66:35001), bf2d93774f73406ead205c8ba8c9da13 (127.6.101.67:46675)
I20260709 14:49:51.536412  6757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbff5d6a7234db3a8f367fe9b30d615" candidate_uuid: "25b7964825a6462295c0606a06169676" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "41999337784141c5834094008bf6ba97"
I20260709 14:49:51.536789  6828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbff5d6a7234db3a8f367fe9b30d615" candidate_uuid: "25b7964825a6462295c0606a06169676" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "bf2d93774f73406ead205c8ba8c9da13"
I20260709 14:49:51.537163  6757 raft_consensus.cc:3055] T 1dbff5d6a7234db3a8f367fe9b30d615 P 41999337784141c5834094008bf6ba97 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 14:49:51.537358  6828 raft_consensus.cc:3060] T 1dbff5d6a7234db3a8f367fe9b30d615 P bf2d93774f73406ead205c8ba8c9da13 [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:49:51.537587  6757 raft_consensus.cc:740] T 1dbff5d6a7234db3a8f367fe9b30d615 P 41999337784141c5834094008bf6ba97 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 41999337784141c5834094008bf6ba97, State: Running, Role: LEADER
I20260709 14:49:51.538546  6757 consensus_queue.cc:260] T 1dbff5d6a7234db3a8f367fe9b30d615 P 41999337784141c5834094008bf6ba97 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:51.539497  6681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a2d00569854cd990c582b9693829ff" candidate_uuid: "bf2d93774f73406ead205c8ba8c9da13" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "25b7964825a6462295c0606a06169676"
I20260709 14:49:51.539729  6756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a2d00569854cd990c582b9693829ff" candidate_uuid: "bf2d93774f73406ead205c8ba8c9da13" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "41999337784141c5834094008bf6ba97"
I20260709 14:49:51.538564  6833 leader_election.cc:290] T 82a2d00569854cd990c582b9693829ff P bf2d93774f73406ead205c8ba8c9da13 [CANDIDATE]: Term 2 election: Requested vote from peers 25b7964825a6462295c0606a06169676 (127.6.101.65:34615), 41999337784141c5834094008bf6ba97 (127.6.101.66:35001)
I20260709 14:49:51.540238  6757 raft_consensus.cc:3060] T 1dbff5d6a7234db3a8f367fe9b30d615 P 41999337784141c5834094008bf6ba97 [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:49:51.540356  6756 raft_consensus.cc:3055] T 82a2d00569854cd990c582b9693829ff P 41999337784141c5834094008bf6ba97 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 14:49:51.541468  6756 raft_consensus.cc:740] T 82a2d00569854cd990c582b9693829ff P 41999337784141c5834094008bf6ba97 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 41999337784141c5834094008bf6ba97, State: Running, Role: LEADER
I20260709 14:49:51.540993  6681 raft_consensus.cc:3060] T 82a2d00569854cd990c582b9693829ff P 25b7964825a6462295c0606a06169676 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:49:51.542354  6756 consensus_queue.cc:260] T 82a2d00569854cd990c582b9693829ff P 41999337784141c5834094008bf6ba97 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:51.544669  6756 raft_consensus.cc:3060] T 82a2d00569854cd990c582b9693829ff P 41999337784141c5834094008bf6ba97 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:49:51.546669  6828 raft_consensus.cc:2468] T 1dbff5d6a7234db3a8f367fe9b30d615 P bf2d93774f73406ead205c8ba8c9da13 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b7964825a6462295c0606a06169676 in term 5.
I20260709 14:49:51.548418  6650 leader_election.cc:304] T 1dbff5d6a7234db3a8f367fe9b30d615 P 25b7964825a6462295c0606a06169676 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b7964825a6462295c0606a06169676, bf2d93774f73406ead205c8ba8c9da13; no voters: 
I20260709 14:49:51.549714  7127 raft_consensus.cc:2804] T 1dbff5d6a7234db3a8f367fe9b30d615 P 25b7964825a6462295c0606a06169676 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 14:49:51.550256  7127 raft_consensus.cc:697] T 1dbff5d6a7234db3a8f367fe9b30d615 P 25b7964825a6462295c0606a06169676 [term 5 LEADER]: Becoming Leader. State: Replica: 25b7964825a6462295c0606a06169676, State: Running, Role: LEADER
I20260709 14:49:51.551153  7127 consensus_queue.cc:237] T 1dbff5d6a7234db3a8f367fe9b30d615 P 25b7964825a6462295c0606a06169676 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:51.552080  6681 raft_consensus.cc:2468] T 82a2d00569854cd990c582b9693829ff P 25b7964825a6462295c0606a06169676 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf2d93774f73406ead205c8ba8c9da13 in term 2.
I20260709 14:49:51.553141  6757 raft_consensus.cc:2468] T 1dbff5d6a7234db3a8f367fe9b30d615 P 41999337784141c5834094008bf6ba97 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b7964825a6462295c0606a06169676 in term 5.
I20260709 14:49:51.554076  6796 leader_election.cc:304] T 82a2d00569854cd990c582b9693829ff P bf2d93774f73406ead205c8ba8c9da13 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b7964825a6462295c0606a06169676, bf2d93774f73406ead205c8ba8c9da13; no voters: 
I20260709 14:49:51.555110  7124 raft_consensus.cc:2804] T 82a2d00569854cd990c582b9693829ff P bf2d93774f73406ead205c8ba8c9da13 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:49:51.556541  7124 raft_consensus.cc:697] T 82a2d00569854cd990c582b9693829ff P bf2d93774f73406ead205c8ba8c9da13 [term 2 LEADER]: Becoming Leader. State: Replica: bf2d93774f73406ead205c8ba8c9da13, State: Running, Role: LEADER
I20260709 14:49:51.558085  6756 raft_consensus.cc:2468] T 82a2d00569854cd990c582b9693829ff P 41999337784141c5834094008bf6ba97 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf2d93774f73406ead205c8ba8c9da13 in term 2.
I20260709 14:49:51.557549  7124 consensus_queue.cc:237] T 82a2d00569854cd990c582b9693829ff P bf2d93774f73406ead205c8ba8c9da13 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:51.563433  6578 catalog_manager.cc:5697] T 1dbff5d6a7234db3a8f367fe9b30d615 P 25b7964825a6462295c0606a06169676 reported cstate change: term changed from 4 to 5, leader changed from 41999337784141c5834094008bf6ba97 (127.6.101.66) to 25b7964825a6462295c0606a06169676 (127.6.101.65). New cstate: current_term: 5 leader_uuid: "25b7964825a6462295c0606a06169676" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } health_report { overall_health: UNKNOWN } } }
I20260709 14:49:51.570437  6580 catalog_manager.cc:5697] T 82a2d00569854cd990c582b9693829ff P bf2d93774f73406ead205c8ba8c9da13 reported cstate change: term changed from 1 to 2, leader changed from 41999337784141c5834094008bf6ba97 (127.6.101.66) to bf2d93774f73406ead205c8ba8c9da13 (127.6.101.67). New cstate: current_term: 2 leader_uuid: "bf2d93774f73406ead205c8ba8c9da13" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } health_report { overall_health: HEALTHY } } }
I20260709 14:49:51.727293  7086 raft_consensus.cc:993] T 5ce18799382e46108fbcbed2c364321d P 41999337784141c5834094008bf6ba97: : Instructing follower bf2d93774f73406ead205c8ba8c9da13 to start an election
I20260709 14:49:51.727936  7086 raft_consensus.cc:1081] T 5ce18799382e46108fbcbed2c364321d P 41999337784141c5834094008bf6ba97 [term 4 LEADER]: Signalling peer bf2d93774f73406ead205c8ba8c9da13 to start an election
I20260709 14:49:51.729882  6828 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5ce18799382e46108fbcbed2c364321d"
dest_uuid: "bf2d93774f73406ead205c8ba8c9da13"
 from {username='slave'} at 127.0.0.1:46176
I20260709 14:49:51.730304  7132 raft_consensus.cc:993] T 07255af297cd4ac59277e81984f07f9c P 41999337784141c5834094008bf6ba97: : Instructing follower 25b7964825a6462295c0606a06169676 to start an election
I20260709 14:49:51.730496  6828 raft_consensus.cc:493] T 5ce18799382e46108fbcbed2c364321d P bf2d93774f73406ead205c8ba8c9da13 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:49:51.730906  6828 raft_consensus.cc:3060] T 5ce18799382e46108fbcbed2c364321d P bf2d93774f73406ead205c8ba8c9da13 [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:49:51.730813  7086 raft_consensus.cc:1081] T 07255af297cd4ac59277e81984f07f9c P 41999337784141c5834094008bf6ba97 [term 6 LEADER]: Signalling peer 25b7964825a6462295c0606a06169676 to start an election
I20260709 14:49:51.733000  6681 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "07255af297cd4ac59277e81984f07f9c"
dest_uuid: "25b7964825a6462295c0606a06169676"
 from {username='slave'} at 127.0.0.1:42184
I20260709 14:49:51.733608  6681 raft_consensus.cc:493] T 07255af297cd4ac59277e81984f07f9c P 25b7964825a6462295c0606a06169676 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:49:51.733899  6681 raft_consensus.cc:3060] T 07255af297cd4ac59277e81984f07f9c P 25b7964825a6462295c0606a06169676 [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:49:51.737905  6828 raft_consensus.cc:515] T 5ce18799382e46108fbcbed2c364321d P bf2d93774f73406ead205c8ba8c9da13 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:51.739976  6828 leader_election.cc:290] T 5ce18799382e46108fbcbed2c364321d P bf2d93774f73406ead205c8ba8c9da13 [CANDIDATE]: Term 5 election: Requested vote from peers 25b7964825a6462295c0606a06169676 (127.6.101.65:34615), 41999337784141c5834094008bf6ba97 (127.6.101.66:35001)
I20260709 14:49:51.739992  6681 raft_consensus.cc:515] T 07255af297cd4ac59277e81984f07f9c P 25b7964825a6462295c0606a06169676 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:51.740868  6680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce18799382e46108fbcbed2c364321d" candidate_uuid: "bf2d93774f73406ead205c8ba8c9da13" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "25b7964825a6462295c0606a06169676"
I20260709 14:49:51.741555  6680 raft_consensus.cc:3060] T 5ce18799382e46108fbcbed2c364321d P 25b7964825a6462295c0606a06169676 [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:49:51.741622  6756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce18799382e46108fbcbed2c364321d" candidate_uuid: "bf2d93774f73406ead205c8ba8c9da13" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "41999337784141c5834094008bf6ba97"
I20260709 14:49:51.742542  6681 leader_election.cc:290] T 07255af297cd4ac59277e81984f07f9c P 25b7964825a6462295c0606a06169676 [CANDIDATE]: Term 7 election: Requested vote from peers 41999337784141c5834094008bf6ba97 (127.6.101.66:35001), bf2d93774f73406ead205c8ba8c9da13 (127.6.101.67:46675)
I20260709 14:49:51.742339  6756 raft_consensus.cc:3055] T 5ce18799382e46108fbcbed2c364321d P 41999337784141c5834094008bf6ba97 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 14:49:51.743221  6756 raft_consensus.cc:740] T 5ce18799382e46108fbcbed2c364321d P 41999337784141c5834094008bf6ba97 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 41999337784141c5834094008bf6ba97, State: Running, Role: LEADER
I20260709 14:49:51.743395  6757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07255af297cd4ac59277e81984f07f9c" candidate_uuid: "25b7964825a6462295c0606a06169676" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: true dest_uuid: "41999337784141c5834094008bf6ba97"
I20260709 14:49:51.744000  6757 raft_consensus.cc:3055] T 07255af297cd4ac59277e81984f07f9c P 41999337784141c5834094008bf6ba97 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 14:49:51.744361  6757 raft_consensus.cc:740] T 07255af297cd4ac59277e81984f07f9c P 41999337784141c5834094008bf6ba97 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 41999337784141c5834094008bf6ba97, State: Running, Role: LEADER
I20260709 14:49:51.744259  6756 consensus_queue.cc:260] T 5ce18799382e46108fbcbed2c364321d P 41999337784141c5834094008bf6ba97 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:51.744465  6828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07255af297cd4ac59277e81984f07f9c" candidate_uuid: "25b7964825a6462295c0606a06169676" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: true dest_uuid: "bf2d93774f73406ead205c8ba8c9da13"
I20260709 14:49:51.745810  6756 raft_consensus.cc:3060] T 5ce18799382e46108fbcbed2c364321d P 41999337784141c5834094008bf6ba97 [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:49:51.745443  6757 consensus_queue.cc:260] T 07255af297cd4ac59277e81984f07f9c P 41999337784141c5834094008bf6ba97 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:51.745915  6828 raft_consensus.cc:3060] T 07255af297cd4ac59277e81984f07f9c P bf2d93774f73406ead205c8ba8c9da13 [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:49:51.746825  6757 raft_consensus.cc:3060] T 07255af297cd4ac59277e81984f07f9c P 41999337784141c5834094008bf6ba97 [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:49:51.751157  6680 raft_consensus.cc:2468] T 5ce18799382e46108fbcbed2c364321d P 25b7964825a6462295c0606a06169676 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf2d93774f73406ead205c8ba8c9da13 in term 5.
I20260709 14:49:51.752713  6796 leader_election.cc:304] T 5ce18799382e46108fbcbed2c364321d P bf2d93774f73406ead205c8ba8c9da13 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b7964825a6462295c0606a06169676, bf2d93774f73406ead205c8ba8c9da13; no voters: 
I20260709 14:49:51.753855  7124 raft_consensus.cc:2804] T 5ce18799382e46108fbcbed2c364321d P bf2d93774f73406ead205c8ba8c9da13 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 14:49:51.754973  6828 raft_consensus.cc:2468] T 07255af297cd4ac59277e81984f07f9c P bf2d93774f73406ead205c8ba8c9da13 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b7964825a6462295c0606a06169676 in term 7.
I20260709 14:49:51.755472  7124 raft_consensus.cc:697] T 5ce18799382e46108fbcbed2c364321d P bf2d93774f73406ead205c8ba8c9da13 [term 5 LEADER]: Becoming Leader. State: Replica: bf2d93774f73406ead205c8ba8c9da13, State: Running, Role: LEADER
I20260709 14:49:51.756349  6650 leader_election.cc:304] T 07255af297cd4ac59277e81984f07f9c P 25b7964825a6462295c0606a06169676 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b7964825a6462295c0606a06169676, bf2d93774f73406ead205c8ba8c9da13; no voters: 
I20260709 14:49:51.756614  7124 consensus_queue.cc:237] T 5ce18799382e46108fbcbed2c364321d P bf2d93774f73406ead205c8ba8c9da13 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:51.755338  6757 raft_consensus.cc:2468] T 07255af297cd4ac59277e81984f07f9c P 41999337784141c5834094008bf6ba97 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b7964825a6462295c0606a06169676 in term 7.
I20260709 14:49:51.757419  7127 raft_consensus.cc:2804] T 07255af297cd4ac59277e81984f07f9c P 25b7964825a6462295c0606a06169676 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 14:49:51.758142  7127 raft_consensus.cc:697] T 07255af297cd4ac59277e81984f07f9c P 25b7964825a6462295c0606a06169676 [term 7 LEADER]: Becoming Leader. State: Replica: 25b7964825a6462295c0606a06169676, State: Running, Role: LEADER
I20260709 14:49:51.755352  6756 raft_consensus.cc:2468] T 5ce18799382e46108fbcbed2c364321d P 41999337784141c5834094008bf6ba97 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf2d93774f73406ead205c8ba8c9da13 in term 5.
I20260709 14:49:51.759035  7127 consensus_queue.cc:237] T 07255af297cd4ac59277e81984f07f9c P 25b7964825a6462295c0606a06169676 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } }
I20260709 14:49:51.766109  6580 catalog_manager.cc:5697] T 5ce18799382e46108fbcbed2c364321d P bf2d93774f73406ead205c8ba8c9da13 reported cstate change: term changed from 4 to 5, leader changed from 41999337784141c5834094008bf6ba97 (127.6.101.66) to bf2d93774f73406ead205c8ba8c9da13 (127.6.101.67). New cstate: current_term: 5 leader_uuid: "bf2d93774f73406ead205c8ba8c9da13" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } health_report { overall_health: HEALTHY } } }
I20260709 14:49:51.769166  6578 catalog_manager.cc:5697] T 07255af297cd4ac59277e81984f07f9c P 25b7964825a6462295c0606a06169676 reported cstate change: term changed from 6 to 7, leader changed from 41999337784141c5834094008bf6ba97 (127.6.101.66) to 25b7964825a6462295c0606a06169676 (127.6.101.65). New cstate: current_term: 7 leader_uuid: "25b7964825a6462295c0606a06169676" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 } health_report { overall_health: UNKNOWN } } }
I20260709 14:49:51.998642  6756 raft_consensus.cc:1275] T 1dbff5d6a7234db3a8f367fe9b30d615 P 41999337784141c5834094008bf6ba97 [term 5 FOLLOWER]: Refusing update from remote peer 25b7964825a6462295c0606a06169676: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 14:49:52.000349  7127 consensus_queue.cc:1048] T 1dbff5d6a7234db3a8f367fe9b30d615 P 25b7964825a6462295c0606a06169676 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 14:49:52.015524  6828 raft_consensus.cc:1275] T 1dbff5d6a7234db3a8f367fe9b30d615 P bf2d93774f73406ead205c8ba8c9da13 [term 5 FOLLOWER]: Refusing update from remote peer 25b7964825a6462295c0606a06169676: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 14:49:52.017807  7127 consensus_queue.cc:1048] T 1dbff5d6a7234db3a8f367fe9b30d615 P 25b7964825a6462295c0606a06169676 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 14:49:52.036224  6756 raft_consensus.cc:1275] T c8ac07644f37427e80f77c67ccac9328 P 41999337784141c5834094008bf6ba97 [term 4 FOLLOWER]: Refusing update from remote peer 25b7964825a6462295c0606a06169676: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 14:49:52.038755  7127 consensus_queue.cc:1048] T c8ac07644f37427e80f77c67ccac9328 P 25b7964825a6462295c0606a06169676 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 14:49:52.042237  6828 raft_consensus.cc:1275] T c8ac07644f37427e80f77c67ccac9328 P bf2d93774f73406ead205c8ba8c9da13 [term 4 FOLLOWER]: Refusing update from remote peer 25b7964825a6462295c0606a06169676: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 14:49:52.044368  7143 consensus_queue.cc:1048] T c8ac07644f37427e80f77c67ccac9328 P 25b7964825a6462295c0606a06169676 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 14:49:52.050523  6680 raft_consensus.cc:1275] T 82a2d00569854cd990c582b9693829ff P 25b7964825a6462295c0606a06169676 [term 2 FOLLOWER]: Refusing update from remote peer bf2d93774f73406ead205c8ba8c9da13: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:49:52.064841  7136 consensus_queue.cc:1048] T 82a2d00569854cd990c582b9693829ff P bf2d93774f73406ead205c8ba8c9da13 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 14:49:52.085850  6756 raft_consensus.cc:1275] T 82a2d00569854cd990c582b9693829ff P 41999337784141c5834094008bf6ba97 [term 2 FOLLOWER]: Refusing update from remote peer bf2d93774f73406ead205c8ba8c9da13: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:49:52.087778  7136 consensus_queue.cc:1048] T 82a2d00569854cd990c582b9693829ff P bf2d93774f73406ead205c8ba8c9da13 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 14:49:52.184340  6756 raft_consensus.cc:1275] T 07255af297cd4ac59277e81984f07f9c P 41999337784141c5834094008bf6ba97 [term 7 FOLLOWER]: Refusing update from remote peer 25b7964825a6462295c0606a06169676: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 14:49:52.186071  7143 consensus_queue.cc:1048] T 07255af297cd4ac59277e81984f07f9c P 25b7964825a6462295c0606a06169676 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 14:49:52.197177  6828 raft_consensus.cc:1275] T 07255af297cd4ac59277e81984f07f9c P bf2d93774f73406ead205c8ba8c9da13 [term 7 FOLLOWER]: Refusing update from remote peer 25b7964825a6462295c0606a06169676: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 14:49:52.199381  7127 consensus_queue.cc:1048] T 07255af297cd4ac59277e81984f07f9c P 25b7964825a6462295c0606a06169676 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf2d93774f73406ead205c8ba8c9da13" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 46675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 14:49:52.235980  6680 raft_consensus.cc:1275] T 5ce18799382e46108fbcbed2c364321d P 25b7964825a6462295c0606a06169676 [term 5 FOLLOWER]: Refusing update from remote peer bf2d93774f73406ead205c8ba8c9da13: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 14:49:52.237767  7150 consensus_queue.cc:1048] T 5ce18799382e46108fbcbed2c364321d P bf2d93774f73406ead205c8ba8c9da13 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b7964825a6462295c0606a06169676" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 34615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 14:49:52.285133  6756 raft_consensus.cc:1275] T 5ce18799382e46108fbcbed2c364321d P 41999337784141c5834094008bf6ba97 [term 5 FOLLOWER]: Refusing update from remote peer bf2d93774f73406ead205c8ba8c9da13: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 14:49:52.288501  7124 consensus_queue.cc:1048] T 5ce18799382e46108fbcbed2c364321d P bf2d93774f73406ead205c8ba8c9da13 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41999337784141c5834094008bf6ba97" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 14:49:52.327188  6549 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 14:49:52.335263  6549 tablet_server.cc:179] TabletServer@127.6.101.65:0 shutting down...
I20260709 14:49:52.378515  6549 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 14:49:52.379592  6549 tablet_replica.cc:333] T be9352545ba44d68a3704b39c623e774 P 25b7964825a6462295c0606a06169676: stopping tablet replica
I20260709 14:49:52.380790  6549 raft_consensus.cc:2243] T be9352545ba44d68a3704b39c623e774 P 25b7964825a6462295c0606a06169676 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 14:49:52.381604  6549 raft_consensus.cc:2272] T be9352545ba44d68a3704b39c623e774 P 25b7964825a6462295c0606a06169676 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 14:49:52.384714  6549 tablet_replica.cc:333] T 07255af297cd4ac59277e81984f07f9c P 25b7964825a6462295c0606a06169676: stopping tablet replica
I20260709 14:49:52.385473  6549 raft_consensus.cc:2243] T 07255af297cd4ac59277e81984f07f9c P 25b7964825a6462295c0606a06169676 [term 7 LEADER]: Raft consensus shutting down.
I20260709 14:49:52.387449  6549 raft_consensus.cc:2272] T 07255af297cd4ac59277e81984f07f9c P 25b7964825a6462295c0606a06169676 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 14:49:52.390695  6549 tablet_replica.cc:333] T bc290da245804ddc92d9597c5da52a82 P 25b7964825a6462295c0606a06169676: stopping tablet replica
W20260709 14:49:52.390754  6796 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 14:49:52.391808  6549 raft_consensus.cc:2243] T bc290da245804ddc92d9597c5da52a82 P 25b7964825a6462295c0606a06169676 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 14:49:52.392815  6549 raft_consensus.cc:2272] T bc290da245804ddc92d9597c5da52a82 P 25b7964825a6462295c0606a06169676 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 14:49:52.395641  6549 tablet_replica.cc:333] T 3d8096f833ea45ce9471c56d3ce1a68b P 25b7964825a6462295c0606a06169676: stopping tablet replica
W20260709 14:49:52.395498  6796 consensus_peers.cc:597] T be9352545ba44d68a3704b39c623e774 P bf2d93774f73406ead205c8ba8c9da13 -> Peer 25b7964825a6462295c0606a06169676 (127.6.101.65:34615): Couldn't send request to peer 25b7964825a6462295c0606a06169676. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:49:52.396457  6549 raft_consensus.cc:2243] T 3d8096f833ea45ce9471c56d3ce1a68b P 25b7964825a6462295c0606a06169676 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 14:49:52.397022  6549 raft_consensus.cc:2272] T 3d8096f833ea45ce9471c56d3ce1a68b P 25b7964825a6462295c0606a06169676 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 14:49:52.399195  6549 tablet_replica.cc:333] T 5ce18799382e46108fbcbed2c364321d P 25b7964825a6462295c0606a06169676: stopping tablet replica
I20260709 14:49:52.399739  6549 raft_consensus.cc:2243] T 5ce18799382e46108fbcbed2c364321d P 25b7964825a6462295c0606a06169676 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 14:49:52.400220  6549 raft_consensus.cc:2272] T 5ce18799382e46108fbcbed2c364321d P 25b7964825a6462295c0606a06169676 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 14:49:52.403075  6549 tablet_replica.cc:333] T d58c1f5d4e1c448eab811059e23165cc P 25b7964825a6462295c0606a06169676: stopping tablet replica
I20260709 14:49:52.403687  6549 raft_consensus.cc:2243] T d58c1f5d4e1c448eab811059e23165cc P 25b7964825a6462295c0606a06169676 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 14:49:52.404276  6549 raft_consensus.cc:2272] T d58c1f5d4e1c448eab811059e23165cc P 25b7964825a6462295c0606a06169676 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 14:49:52.406381  6549 tablet_replica.cc:333] T 82a2d00569854cd990c582b9693829ff P 25b7964825a6462295c0606a06169676: stopping tablet replica
I20260709 14:49:52.407002  6549 raft_consensus.cc:2243] T 82a2d00569854cd990c582b9693829ff P 25b7964825a6462295c0606a06169676 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 14:49:52.407513  6549 raft_consensus.cc:2272] T 82a2d00569854cd990c582b9693829ff P 25b7964825a6462295c0606a06169676 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 14:49:52.410225  6549 tablet_replica.cc:333] T 1dbff5d6a7234db3a8f367fe9b30d615 P 25b7964825a6462295c0606a06169676: stopping tablet replica
I20260709 14:49:52.410763  6549 raft_consensus.cc:2243] T 1dbff5d6a7234db3a8f367fe9b30d615 P 25b7964825a6462295c0606a06169676 [term 5 LEADER]: Raft consensus shutting down.
I20260709 14:49:52.411880  6549 raft_consensus.cc:2272] T 1dbff5d6a7234db3a8f367fe9b30d615 P 25b7964825a6462295c0606a06169676 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 14:49:52.414570  6549 tablet_replica.cc:333] T c8ac07644f37427e80f77c67ccac9328 P 25b7964825a6462295c0606a06169676: stopping tablet replica
I20260709 14:49:52.415247  6549 raft_consensus.cc:2243] T c8ac07644f37427e80f77c67ccac9328 P 25b7964825a6462295c0606a06169676 [term 4 LEADER]: Raft consensus shutting down.
I20260709 14:49:52.416466  6549 raft_consensus.cc:2272] T c8ac07644f37427e80f77c67ccac9328 P 25b7964825a6462295c0606a06169676 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 14:49:52.559702  6549 tablet_server.cc:196] TabletServer@127.6.101.65:0 shutdown complete.
W20260709 14:49:52.562275  6722 consensus_peers.cc:597] T d58c1f5d4e1c448eab811059e23165cc P 41999337784141c5834094008bf6ba97 -> Peer 25b7964825a6462295c0606a06169676 (127.6.101.65:34615): Couldn't send request to peer 25b7964825a6462295c0606a06169676. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:34615: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 14:49:52.562757  6722 consensus_peers.cc:597] T bc290da245804ddc92d9597c5da52a82 P 41999337784141c5834094008bf6ba97 -> Peer 25b7964825a6462295c0606a06169676 (127.6.101.65:34615): Couldn't send request to peer 25b7964825a6462295c0606a06169676. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:34615: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 14:49:52.587459  6549 tablet_server.cc:179] TabletServer@127.6.101.66:0 shutting down...
W20260709 14:49:52.626881  6797 consensus_peers.cc:597] T 82a2d00569854cd990c582b9693829ff P bf2d93774f73406ead205c8ba8c9da13 -> Peer 41999337784141c5834094008bf6ba97 (127.6.101.66:35001): Couldn't send request to peer 41999337784141c5834094008bf6ba97. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:49:52.640453  6549 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 14:49:52.641587  6549 tablet_replica.cc:333] T be9352545ba44d68a3704b39c623e774 P 41999337784141c5834094008bf6ba97: stopping tablet replica
I20260709 14:49:52.642472  6549 raft_consensus.cc:2243] T be9352545ba44d68a3704b39c623e774 P 41999337784141c5834094008bf6ba97 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 14:49:52.643044  6549 raft_consensus.cc:2272] T be9352545ba44d68a3704b39c623e774 P 41999337784141c5834094008bf6ba97 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 14:49:52.645309  6549 tablet_replica.cc:333] T d58c1f5d4e1c448eab811059e23165cc P 41999337784141c5834094008bf6ba97: stopping tablet replica
I20260709 14:49:52.645983  6549 raft_consensus.cc:2243] T d58c1f5d4e1c448eab811059e23165cc P 41999337784141c5834094008bf6ba97 [term 3 LEADER]: Raft consensus shutting down.
I20260709 14:49:52.646901  6549 raft_consensus.cc:2272] T d58c1f5d4e1c448eab811059e23165cc P 41999337784141c5834094008bf6ba97 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 14:49:52.648828  6549 tablet_replica.cc:333] T 07255af297cd4ac59277e81984f07f9c P 41999337784141c5834094008bf6ba97: stopping tablet replica
I20260709 14:49:52.649434  6549 raft_consensus.cc:2243] T 07255af297cd4ac59277e81984f07f9c P 41999337784141c5834094008bf6ba97 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 14:49:52.649971  6549 raft_consensus.cc:2272] T 07255af297cd4ac59277e81984f07f9c P 41999337784141c5834094008bf6ba97 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 14:49:52.652691  6549 tablet_replica.cc:333] T 3d8096f833ea45ce9471c56d3ce1a68b P 41999337784141c5834094008bf6ba97: stopping tablet replica
I20260709 14:49:52.653512  6549 raft_consensus.cc:2243] T 3d8096f833ea45ce9471c56d3ce1a68b P 41999337784141c5834094008bf6ba97 [term 6 LEADER]: Raft consensus shutting down.
I20260709 14:49:52.655228  6549 raft_consensus.cc:2272] T 3d8096f833ea45ce9471c56d3ce1a68b P 41999337784141c5834094008bf6ba97 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 14:49:52.657121  6549 tablet_replica.cc:333] T 5ce18799382e46108fbcbed2c364321d P 41999337784141c5834094008bf6ba97: stopping tablet replica
I20260709 14:49:52.657747  6549 raft_consensus.cc:2243] T 5ce18799382e46108fbcbed2c364321d P 41999337784141c5834094008bf6ba97 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 14:49:52.658196  6549 raft_consensus.cc:2272] T 5ce18799382e46108fbcbed2c364321d P 41999337784141c5834094008bf6ba97 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 14:49:52.661134  6549 tablet_replica.cc:333] T bc290da245804ddc92d9597c5da52a82 P 41999337784141c5834094008bf6ba97: stopping tablet replica
I20260709 14:49:52.661830  6549 raft_consensus.cc:2243] T bc290da245804ddc92d9597c5da52a82 P 41999337784141c5834094008bf6ba97 [term 3 LEADER]: Raft consensus shutting down.
I20260709 14:49:52.662808  6549 raft_consensus.cc:2272] T bc290da245804ddc92d9597c5da52a82 P 41999337784141c5834094008bf6ba97 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 14:49:52.664889  6549 tablet_replica.cc:333] T 82a2d00569854cd990c582b9693829ff P 41999337784141c5834094008bf6ba97: stopping tablet replica
I20260709 14:49:52.665503  6549 raft_consensus.cc:2243] T 82a2d00569854cd990c582b9693829ff P 41999337784141c5834094008bf6ba97 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 14:49:52.665982  6549 raft_consensus.cc:2272] T 82a2d00569854cd990c582b9693829ff P 41999337784141c5834094008bf6ba97 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 14:49:52.668607  6549 tablet_replica.cc:333] T 1dbff5d6a7234db3a8f367fe9b30d615 P 41999337784141c5834094008bf6ba97: stopping tablet replica
I20260709 14:49:52.669518  6549 raft_consensus.cc:2243] T 1dbff5d6a7234db3a8f367fe9b30d615 P 41999337784141c5834094008bf6ba97 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 14:49:52.670635  6549 raft_consensus.cc:2272] T 1dbff5d6a7234db3a8f367fe9b30d615 P 41999337784141c5834094008bf6ba97 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 14:49:52.673974  6549 tablet_replica.cc:333] T c8ac07644f37427e80f77c67ccac9328 P 41999337784141c5834094008bf6ba97: stopping tablet replica
I20260709 14:49:52.675143  6549 raft_consensus.cc:2243] T c8ac07644f37427e80f77c67ccac9328 P 41999337784141c5834094008bf6ba97 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 14:49:52.676455  6549 raft_consensus.cc:2272] T c8ac07644f37427e80f77c67ccac9328 P 41999337784141c5834094008bf6ba97 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 14:49:52.689832  6797 consensus_peers.cc:597] T 5ce18799382e46108fbcbed2c364321d P bf2d93774f73406ead205c8ba8c9da13 -> Peer 41999337784141c5834094008bf6ba97 (127.6.101.66:35001): Couldn't send request to peer 41999337784141c5834094008bf6ba97. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 14:49:52.693658  6796 consensus_peers.cc:597] T 82a2d00569854cd990c582b9693829ff P bf2d93774f73406ead205c8ba8c9da13 -> Peer 25b7964825a6462295c0606a06169676 (127.6.101.65:34615): Couldn't send request to peer 25b7964825a6462295c0606a06169676. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:34615: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 14:49:52.749387  6549 tablet_server.cc:196] TabletServer@127.6.101.66:0 shutdown complete.
I20260709 14:49:52.769487  6549 tablet_server.cc:179] TabletServer@127.6.101.67:0 shutting down...
W20260709 14:49:52.806577  6796 consensus_peers.cc:597] T 5ce18799382e46108fbcbed2c364321d P bf2d93774f73406ead205c8ba8c9da13 -> Peer 25b7964825a6462295c0606a06169676 (127.6.101.65:34615): Couldn't send request to peer 25b7964825a6462295c0606a06169676. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:34615: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 14:49:52.806761  6549 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 14:49:52.807688  6549 tablet_replica.cc:333] T be9352545ba44d68a3704b39c623e774 P bf2d93774f73406ead205c8ba8c9da13: stopping tablet replica
I20260709 14:49:52.808607  6549 raft_consensus.cc:2243] T be9352545ba44d68a3704b39c623e774 P bf2d93774f73406ead205c8ba8c9da13 [term 4 LEADER]: Raft consensus shutting down.
I20260709 14:49:52.809767  6549 raft_consensus.cc:2272] T be9352545ba44d68a3704b39c623e774 P bf2d93774f73406ead205c8ba8c9da13 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 14:49:52.811915  6549 tablet_replica.cc:333] T 07255af297cd4ac59277e81984f07f9c P bf2d93774f73406ead205c8ba8c9da13: stopping tablet replica
I20260709 14:49:52.812506  6549 raft_consensus.cc:2243] T 07255af297cd4ac59277e81984f07f9c P bf2d93774f73406ead205c8ba8c9da13 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 14:49:52.813141  6549 raft_consensus.cc:2272] T 07255af297cd4ac59277e81984f07f9c P bf2d93774f73406ead205c8ba8c9da13 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 14:49:52.816120  6549 tablet_replica.cc:333] T d58c1f5d4e1c448eab811059e23165cc P bf2d93774f73406ead205c8ba8c9da13: stopping tablet replica
I20260709 14:49:52.816672  6549 raft_consensus.cc:2243] T d58c1f5d4e1c448eab811059e23165cc P bf2d93774f73406ead205c8ba8c9da13 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 14:49:52.817215  6549 raft_consensus.cc:2272] T d58c1f5d4e1c448eab811059e23165cc P bf2d93774f73406ead205c8ba8c9da13 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 14:49:52.819199  6549 tablet_replica.cc:333] T 82a2d00569854cd990c582b9693829ff P bf2d93774f73406ead205c8ba8c9da13: stopping tablet replica
I20260709 14:49:52.819723  6549 raft_consensus.cc:2243] T 82a2d00569854cd990c582b9693829ff P bf2d93774f73406ead205c8ba8c9da13 [term 2 LEADER]: Raft consensus shutting down.
I20260709 14:49:52.820549  6549 raft_consensus.cc:2272] T 82a2d00569854cd990c582b9693829ff P bf2d93774f73406ead205c8ba8c9da13 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 14:49:52.823755  6549 tablet_replica.cc:333] T 1dbff5d6a7234db3a8f367fe9b30d615 P bf2d93774f73406ead205c8ba8c9da13: stopping tablet replica
I20260709 14:49:52.824378  6549 raft_consensus.cc:2243] T 1dbff5d6a7234db3a8f367fe9b30d615 P bf2d93774f73406ead205c8ba8c9da13 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 14:49:52.824932  6549 raft_consensus.cc:2272] T 1dbff5d6a7234db3a8f367fe9b30d615 P bf2d93774f73406ead205c8ba8c9da13 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 14:49:52.827783  6549 tablet_replica.cc:333] T c8ac07644f37427e80f77c67ccac9328 P bf2d93774f73406ead205c8ba8c9da13: stopping tablet replica
I20260709 14:49:52.828368  6549 raft_consensus.cc:2243] T c8ac07644f37427e80f77c67ccac9328 P bf2d93774f73406ead205c8ba8c9da13 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 14:49:52.828868  6549 raft_consensus.cc:2272] T c8ac07644f37427e80f77c67ccac9328 P bf2d93774f73406ead205c8ba8c9da13 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 14:49:52.831646  6549 tablet_replica.cc:333] T 5ce18799382e46108fbcbed2c364321d P bf2d93774f73406ead205c8ba8c9da13: stopping tablet replica
I20260709 14:49:52.832301  6549 raft_consensus.cc:2243] T 5ce18799382e46108fbcbed2c364321d P bf2d93774f73406ead205c8ba8c9da13 [term 5 LEADER]: Raft consensus shutting down.
I20260709 14:49:52.833359  6549 raft_consensus.cc:2272] T 5ce18799382e46108fbcbed2c364321d P bf2d93774f73406ead205c8ba8c9da13 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 14:49:52.835752  6549 tablet_replica.cc:333] T bc290da245804ddc92d9597c5da52a82 P bf2d93774f73406ead205c8ba8c9da13: stopping tablet replica
I20260709 14:49:52.836314  6549 raft_consensus.cc:2243] T bc290da245804ddc92d9597c5da52a82 P bf2d93774f73406ead205c8ba8c9da13 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 14:49:52.836782  6549 raft_consensus.cc:2272] T bc290da245804ddc92d9597c5da52a82 P bf2d93774f73406ead205c8ba8c9da13 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 14:49:52.838539  6549 tablet_replica.cc:333] T 3d8096f833ea45ce9471c56d3ce1a68b P bf2d93774f73406ead205c8ba8c9da13: stopping tablet replica
I20260709 14:49:52.838969  6549 raft_consensus.cc:2243] T 3d8096f833ea45ce9471c56d3ce1a68b P bf2d93774f73406ead205c8ba8c9da13 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 14:49:52.839469  6549 raft_consensus.cc:2272] T 3d8096f833ea45ce9471c56d3ce1a68b P bf2d93774f73406ead205c8ba8c9da13 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 14:49:52.868746  6549 tablet_server.cc:196] TabletServer@127.6.101.67:0 shutdown complete.
I20260709 14:49:52.889560  6549 master.cc:562] Master@127.6.101.126:45859 shutting down...
I20260709 14:49:53.040184  6549 raft_consensus.cc:2243] T 00000000000000000000000000000000 P d922cd1351b74d869c49dd88988157d3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 14:49:53.040974  6549 raft_consensus.cc:2272] T 00000000000000000000000000000000 P d922cd1351b74d869c49dd88988157d3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:49:53.041447  6549 tablet_replica.cc:333] T 00000000000000000000000000000000 P d922cd1351b74d869c49dd88988157d3: stopping tablet replica
I20260709 14:49:53.093984  6549 master.cc:584] Master@127.6.101.126:45859 shutdown complete.
25b7964825a6462295c0606a06169676  4
41999337784141c5834094008bf6ba97  5
bf2d93774f73406ead205c8ba8c9da13  0
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (21028 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 14:49:53.145663  6549 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.6.101.126:39763
I20260709 14:49:53.146991  6549 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 14:49:53.153792  7162 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 14:49:53.154127  7163 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 14:49:53.156111  6549 server_base.cc:1061] running on GCE node
W20260709 14:49:53.157371  7165 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 14:49:53.158831  6549 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 14:49:53.159200  6549 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 14:49:53.159372  6549 hybrid_clock.cc:648] HybridClock initialized: now 1783608593159354 us; error 0 us; skew 500 ppm
I20260709 14:49:53.159957  6549 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 14:49:53.163502  6549 webserver.cc:533] Webserver started at http://127.6.101.126:42655/ using document root <none> and password file <none>
I20260709 14:49:53.164147  6549 fs_manager.cc:362] Metadata directory not provided
I20260709 14:49:53.164354  6549 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 14:49:53.164672  6549 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 14:49:53.166144  6549 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783608571892863-6549-0/minicluster-data/master-0-root/instance:
uuid: "b28ee5b94f3949dfaf03f3f81f627658"
format_stamp: "Formatted at 2026-07-09 14:49:53 on dist-test-slave-lv34"
I20260709 14:49:53.172221  6549 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.003s	sys 0.003s
I20260709 14:49:53.176990  7170 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 14:49:53.178465  6549 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 14:49:53.179070  6549 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783608571892863-6549-0/minicluster-data/master-0-root
uuid: "b28ee5b94f3949dfaf03f3f81f627658"
format_stamp: "Formatted at 2026-07-09 14:49:53 on dist-test-slave-lv34"
I20260709 14:49:53.179682  6549 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783608571892863-6549-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783608571892863-6549-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783608571892863-6549-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 14:49:53.200513  6549 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 14:49:53.202340  6549 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 14:49:53.257589  6549 rpc_server.cc:307] RPC server started. Bound to: 127.6.101.126:39763
I20260709 14:49:53.257797  7221 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.101.126:39763 every 8 connection(s)
I20260709 14:49:53.262846  7222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:49:53.273209  7222 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b28ee5b94f3949dfaf03f3f81f627658: Bootstrap starting.
I20260709 14:49:53.278331  7222 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b28ee5b94f3949dfaf03f3f81f627658: Neither blocks nor log segments found. Creating new log.
I20260709 14:49:53.283530  7222 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b28ee5b94f3949dfaf03f3f81f627658: No bootstrap required, opened a new log
I20260709 14:49:53.287035  7222 raft_consensus.cc:359] T 00000000000000000000000000000000 P b28ee5b94f3949dfaf03f3f81f627658 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b28ee5b94f3949dfaf03f3f81f627658" member_type: VOTER }
I20260709 14:49:53.287578  7222 raft_consensus.cc:385] T 00000000000000000000000000000000 P b28ee5b94f3949dfaf03f3f81f627658 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:49:53.287771  7222 raft_consensus.cc:740] T 00000000000000000000000000000000 P b28ee5b94f3949dfaf03f3f81f627658 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b28ee5b94f3949dfaf03f3f81f627658, State: Initialized, Role: FOLLOWER
I20260709 14:49:53.288614  7222 consensus_queue.cc:260] T 00000000000000000000000000000000 P b28ee5b94f3949dfaf03f3f81f627658 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b28ee5b94f3949dfaf03f3f81f627658" member_type: VOTER }
I20260709 14:49:53.289160  7222 raft_consensus.cc:399] T 00000000000000000000000000000000 P b28ee5b94f3949dfaf03f3f81f627658 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 14:49:53.289480  7222 raft_consensus.cc:493] T 00000000000000000000000000000000 P b28ee5b94f3949dfaf03f3f81f627658 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 14:49:53.289711  7222 raft_consensus.cc:3060] T 00000000000000000000000000000000 P b28ee5b94f3949dfaf03f3f81f627658 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:49:53.293942  7222 raft_consensus.cc:515] T 00000000000000000000000000000000 P b28ee5b94f3949dfaf03f3f81f627658 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b28ee5b94f3949dfaf03f3f81f627658" member_type: VOTER }
I20260709 14:49:53.294557  7222 leader_election.cc:304] T 00000000000000000000000000000000 P b28ee5b94f3949dfaf03f3f81f627658 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b28ee5b94f3949dfaf03f3f81f627658; no voters: 
I20260709 14:49:53.295792  7222 leader_election.cc:290] T 00000000000000000000000000000000 P b28ee5b94f3949dfaf03f3f81f627658 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 14:49:53.296327  7225 raft_consensus.cc:2804] T 00000000000000000000000000000000 P b28ee5b94f3949dfaf03f3f81f627658 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:49:53.297816  7225 raft_consensus.cc:697] T 00000000000000000000000000000000 P b28ee5b94f3949dfaf03f3f81f627658 [term 1 LEADER]: Becoming Leader. State: Replica: b28ee5b94f3949dfaf03f3f81f627658, State: Running, Role: LEADER
I20260709 14:49:53.298636  7225 consensus_queue.cc:237] T 00000000000000000000000000000000 P b28ee5b94f3949dfaf03f3f81f627658 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b28ee5b94f3949dfaf03f3f81f627658" member_type: VOTER }
I20260709 14:49:53.298897  7222 sys_catalog.cc:565] T 00000000000000000000000000000000 P b28ee5b94f3949dfaf03f3f81f627658 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 14:49:53.303683  7226 sys_catalog.cc:455] T 00000000000000000000000000000000 P b28ee5b94f3949dfaf03f3f81f627658 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b28ee5b94f3949dfaf03f3f81f627658" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b28ee5b94f3949dfaf03f3f81f627658" member_type: VOTER } }
I20260709 14:49:53.304630  7226 sys_catalog.cc:458] T 00000000000000000000000000000000 P b28ee5b94f3949dfaf03f3f81f627658 [sys.catalog]: This master's current role is: LEADER
I20260709 14:49:53.304710  7227 sys_catalog.cc:455] T 00000000000000000000000000000000 P b28ee5b94f3949dfaf03f3f81f627658 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b28ee5b94f3949dfaf03f3f81f627658. Latest consensus state: current_term: 1 leader_uuid: "b28ee5b94f3949dfaf03f3f81f627658" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b28ee5b94f3949dfaf03f3f81f627658" member_type: VOTER } }
I20260709 14:49:53.305670  7227 sys_catalog.cc:458] T 00000000000000000000000000000000 P b28ee5b94f3949dfaf03f3f81f627658 [sys.catalog]: This master's current role is: LEADER
I20260709 14:49:53.311208  7231 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 14:49:53.318262  7231 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 14:49:53.319967  6549 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 14:49:53.330125  7231 catalog_manager.cc:1383] Generated new cluster ID: 770435447acf42bfbf8d5bb116d1660f
I20260709 14:49:53.330852  7231 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 14:49:53.353917  7231 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 14:49:53.355520  7231 catalog_manager.cc:1540] Loading token signing keys...
I20260709 14:49:53.368700  7231 catalog_manager.cc:6070] T 00000000000000000000000000000000 P b28ee5b94f3949dfaf03f3f81f627658: Generated new TSK 0
I20260709 14:49:53.369509  7231 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 14:49:53.387943  6549 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 14:49:53.396389  7243 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 14:49:53.398108  7244 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 14:49:53.400638  6549 server_base.cc:1061] running on GCE node
W20260709 14:49:53.400533  7246 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 14:49:53.402058  6549 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 14:49:53.402297  6549 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 14:49:53.402460  6549 hybrid_clock.cc:648] HybridClock initialized: now 1783608593402444 us; error 0 us; skew 500 ppm
I20260709 14:49:53.403069  6549 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 14:49:53.406406  6549 webserver.cc:533] Webserver started at http://127.6.101.65:35847/ using document root <none> and password file <none>
I20260709 14:49:53.407013  6549 fs_manager.cc:362] Metadata directory not provided
I20260709 14:49:53.407229  6549 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 14:49:53.407514  6549 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 14:49:53.408723  6549 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783608571892863-6549-0/minicluster-data/ts-0-root/instance:
uuid: "155fc36248c04168afbd796e9ee66493"
format_stamp: "Formatted at 2026-07-09 14:49:53 on dist-test-slave-lv34"
I20260709 14:49:53.414306  6549 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.003s	sys 0.001s
I20260709 14:49:53.418890  7251 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 14:49:53.420202  6549 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 14:49:53.420581  6549 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783608571892863-6549-0/minicluster-data/ts-0-root
uuid: "155fc36248c04168afbd796e9ee66493"
format_stamp: "Formatted at 2026-07-09 14:49:53 on dist-test-slave-lv34"
I20260709 14:49:53.420953  6549 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783608571892863-6549-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783608571892863-6549-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783608571892863-6549-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 14:49:53.452031  6549 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 14:49:53.453619  6549 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 14:49:53.455391  6549 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 14:49:53.458417  6549 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 14:49:53.458709  6549 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 14:49:53.459002  6549 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 14:49:53.459183  6549 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 14:49:53.519373  6549 rpc_server.cc:307] RPC server started. Bound to: 127.6.101.65:43743
I20260709 14:49:53.519421  7313 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.101.65:43743 every 8 connection(s)
I20260709 14:49:53.525838  6549 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 14:49:53.535106  7318 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 14:49:53.536599  7319 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 14:49:53.539485  7321 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 14:49:53.540414  6549 server_base.cc:1061] running on GCE node
I20260709 14:49:53.542078  6549 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 14:49:53.542348  6549 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 14:49:53.542706  6549 hybrid_clock.cc:648] HybridClock initialized: now 1783608593542676 us; error 0 us; skew 500 ppm
I20260709 14:49:53.543708  6549 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 14:49:53.545639  7314 heartbeater.cc:344] Connected to a master server at 127.6.101.126:39763
I20260709 14:49:53.546103  7314 heartbeater.cc:461] Registering TS with master...
I20260709 14:49:53.546918  7314 heartbeater.cc:507] Master 127.6.101.126:39763 requested a full tablet report, sending...
I20260709 14:49:53.547422  6549 webserver.cc:533] Webserver started at http://127.6.101.66:42409/ using document root <none> and password file <none>
I20260709 14:49:53.548120  6549 fs_manager.cc:362] Metadata directory not provided
I20260709 14:49:53.548399  6549 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 14:49:53.548724  6549 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 14:49:53.550094  7187 ts_manager.cc:194] Registered new tserver with Master: 155fc36248c04168afbd796e9ee66493 (127.6.101.65:43743)
I20260709 14:49:53.550789  6549 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783608571892863-6549-0/minicluster-data/ts-1-root/instance:
uuid: "fdf485ed0db84f74868a2c265c56d1d4"
format_stamp: "Formatted at 2026-07-09 14:49:53 on dist-test-slave-lv34"
I20260709 14:49:53.553069  7187 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51192
I20260709 14:49:53.558099  6549 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.004s	sys 0.003s
I20260709 14:49:53.562987  7326 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 14:49:53.564043  6549 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.002s
I20260709 14:49:53.564482  6549 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783608571892863-6549-0/minicluster-data/ts-1-root
uuid: "fdf485ed0db84f74868a2c265c56d1d4"
format_stamp: "Formatted at 2026-07-09 14:49:53 on dist-test-slave-lv34"
I20260709 14:49:53.564843  6549 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783608571892863-6549-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783608571892863-6549-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783608571892863-6549-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 14:49:53.584065  6549 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 14:49:53.585758  6549 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 14:49:53.587555  6549 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 14:49:53.590291  6549 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 14:49:53.590513  6549 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 14:49:53.590785  6549 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 14:49:53.590958  6549 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 14:49:53.649209  6549 rpc_server.cc:307] RPC server started. Bound to: 127.6.101.66:35791
I20260709 14:49:53.649406  7388 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.101.66:35791 every 8 connection(s)
I20260709 14:49:53.655930  6549 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 14:49:53.665282  7392 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 14:49:53.666281  7393 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 14:49:53.670382  6549 server_base.cc:1061] running on GCE node
W20260709 14:49:53.670485  7395 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 14:49:53.671039  7389 heartbeater.cc:344] Connected to a master server at 127.6.101.126:39763
I20260709 14:49:53.671669  7389 heartbeater.cc:461] Registering TS with master...
I20260709 14:49:53.672307  6549 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 14:49:53.672501  7389 heartbeater.cc:507] Master 127.6.101.126:39763 requested a full tablet report, sending...
W20260709 14:49:53.672632  6549 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 14:49:53.672874  6549 hybrid_clock.cc:648] HybridClock initialized: now 1783608593672857 us; error 0 us; skew 500 ppm
I20260709 14:49:53.673838  6549 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 14:49:53.676750  7187 ts_manager.cc:194] Registered new tserver with Master: fdf485ed0db84f74868a2c265c56d1d4 (127.6.101.66:35791)
I20260709 14:49:53.678341  6549 webserver.cc:533] Webserver started at http://127.6.101.67:36143/ using document root <none> and password file <none>
I20260709 14:49:53.679185  6549 fs_manager.cc:362] Metadata directory not provided
I20260709 14:49:53.679126  7187 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51200
I20260709 14:49:53.679566  6549 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 14:49:53.679958  6549 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 14:49:53.681558  6549 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783608571892863-6549-0/minicluster-data/ts-2-root/instance:
uuid: "68f78fc64ad74f9fa62efb081a46832d"
format_stamp: "Formatted at 2026-07-09 14:49:53 on dist-test-slave-lv34"
I20260709 14:49:53.687784  6549 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.005s	sys 0.000s
I20260709 14:49:53.692243  7400 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 14:49:53.693281  6549 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 14:49:53.693611  6549 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783608571892863-6549-0/minicluster-data/ts-2-root
uuid: "68f78fc64ad74f9fa62efb081a46832d"
format_stamp: "Formatted at 2026-07-09 14:49:53 on dist-test-slave-lv34"
I20260709 14:49:53.693889  6549 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783608571892863-6549-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783608571892863-6549-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783608571892863-6549-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 14:49:53.714980  6549 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 14:49:53.716847  6549 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 14:49:53.718694  6549 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 14:49:53.721215  6549 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 14:49:53.721504  6549 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.001s
I20260709 14:49:53.721762  6549 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 14:49:53.721920  6549 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 14:49:53.774963  6549 rpc_server.cc:307] RPC server started. Bound to: 127.6.101.67:42957
I20260709 14:49:53.775120  7462 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.101.67:42957 every 8 connection(s)
I20260709 14:49:53.792392  7463 heartbeater.cc:344] Connected to a master server at 127.6.101.126:39763
I20260709 14:49:53.792848  7463 heartbeater.cc:461] Registering TS with master...
I20260709 14:49:53.793764  7463 heartbeater.cc:507] Master 127.6.101.126:39763 requested a full tablet report, sending...
I20260709 14:49:53.796366  7187 ts_manager.cc:194] Registered new tserver with Master: 68f78fc64ad74f9fa62efb081a46832d (127.6.101.67:42957)
I20260709 14:49:53.796998  6549 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.018378021s
I20260709 14:49:53.798198  7187 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53848
I20260709 14:49:53.829989  7187 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53856:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 14:49:53.833974  7187 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 14:49:53.924815  7428 tablet_service.cc:1511] Processing CreateTablet for tablet 36fe96aff6384e2d807b9f4d1bc8a544 (DEFAULT_TABLE table=test-workload [id=4b613962994c482e9ea4977ea8b85d2a]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 14:49:53.927569  7428 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36fe96aff6384e2d807b9f4d1bc8a544. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:49:53.940219  7427 tablet_service.cc:1511] Processing CreateTablet for tablet 79853f64be7f4e5ebb08a711d87bcede (DEFAULT_TABLE table=test-workload [id=4b613962994c482e9ea4977ea8b85d2a]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 14:49:53.942008  7427 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79853f64be7f4e5ebb08a711d87bcede. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:49:53.941659  7354 tablet_service.cc:1511] Processing CreateTablet for tablet 36fe96aff6384e2d807b9f4d1bc8a544 (DEFAULT_TABLE table=test-workload [id=4b613962994c482e9ea4977ea8b85d2a]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 14:49:53.941659  7353 tablet_service.cc:1511] Processing CreateTablet for tablet 79853f64be7f4e5ebb08a711d87bcede (DEFAULT_TABLE table=test-workload [id=4b613962994c482e9ea4977ea8b85d2a]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 14:49:53.943215  7354 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36fe96aff6384e2d807b9f4d1bc8a544. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:49:53.944450  7353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79853f64be7f4e5ebb08a711d87bcede. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:49:53.950014  7352 tablet_service.cc:1511] Processing CreateTablet for tablet a60aa91e98ae4ad0afc3dd45d4b586f2 (DEFAULT_TABLE table=test-workload [id=4b613962994c482e9ea4977ea8b85d2a]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 14:49:53.952337  7352 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a60aa91e98ae4ad0afc3dd45d4b586f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:49:53.951925  7351 tablet_service.cc:1511] Processing CreateTablet for tablet e93fd08a04f04602bb98df0aca9a314e (DEFAULT_TABLE table=test-workload [id=4b613962994c482e9ea4977ea8b85d2a]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 14:49:53.953845  7351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e93fd08a04f04602bb98df0aca9a314e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:49:53.954768  7426 tablet_service.cc:1511] Processing CreateTablet for tablet a60aa91e98ae4ad0afc3dd45d4b586f2 (DEFAULT_TABLE table=test-workload [id=4b613962994c482e9ea4977ea8b85d2a]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 14:49:53.956566  7426 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a60aa91e98ae4ad0afc3dd45d4b586f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:49:53.964104  7425 tablet_service.cc:1511] Processing CreateTablet for tablet e93fd08a04f04602bb98df0aca9a314e (DEFAULT_TABLE table=test-workload [id=4b613962994c482e9ea4977ea8b85d2a]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 14:49:53.965101  7350 tablet_service.cc:1511] Processing CreateTablet for tablet cddd2927548e4e20b5cc004d23d36978 (DEFAULT_TABLE table=test-workload [id=4b613962994c482e9ea4977ea8b85d2a]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 14:49:53.965960  7425 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e93fd08a04f04602bb98df0aca9a314e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:49:53.967463  7350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cddd2927548e4e20b5cc004d23d36978. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:49:53.968058  7424 tablet_service.cc:1511] Processing CreateTablet for tablet cddd2927548e4e20b5cc004d23d36978 (DEFAULT_TABLE table=test-workload [id=4b613962994c482e9ea4977ea8b85d2a]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 14:49:53.969298  7349 tablet_service.cc:1511] Processing CreateTablet for tablet 21f5ecd80b0b421aad67b6ec53d594d2 (DEFAULT_TABLE table=test-workload [id=4b613962994c482e9ea4977ea8b85d2a]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 14:49:53.970813  7349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21f5ecd80b0b421aad67b6ec53d594d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:49:53.971328  7423 tablet_service.cc:1511] Processing CreateTablet for tablet 21f5ecd80b0b421aad67b6ec53d594d2 (DEFAULT_TABLE table=test-workload [id=4b613962994c482e9ea4977ea8b85d2a]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 14:49:53.969762  7424 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cddd2927548e4e20b5cc004d23d36978. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:49:53.976409  7348 tablet_service.cc:1511] Processing CreateTablet for tablet 22ad3bca8c6b4fa982bb8611615a69dd (DEFAULT_TABLE table=test-workload [id=4b613962994c482e9ea4977ea8b85d2a]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 14:49:53.978323  7423 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21f5ecd80b0b421aad67b6ec53d594d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:49:53.979156  7348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22ad3bca8c6b4fa982bb8611615a69dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:49:53.985061  7422 tablet_service.cc:1511] Processing CreateTablet for tablet 22ad3bca8c6b4fa982bb8611615a69dd (DEFAULT_TABLE table=test-workload [id=4b613962994c482e9ea4977ea8b85d2a]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 14:49:53.988456  7422 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22ad3bca8c6b4fa982bb8611615a69dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:49:53.996445  7347 tablet_service.cc:1511] Processing CreateTablet for tablet 1d10779bfab7437babc4a1e815792595 (DEFAULT_TABLE table=test-workload [id=4b613962994c482e9ea4977ea8b85d2a]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 14:49:53.998122  7347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d10779bfab7437babc4a1e815792595. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:49:54.010002  7275 tablet_service.cc:1511] Processing CreateTablet for tablet cddd2927548e4e20b5cc004d23d36978 (DEFAULT_TABLE table=test-workload [id=4b613962994c482e9ea4977ea8b85d2a]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 14:49:54.011590  7275 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cddd2927548e4e20b5cc004d23d36978. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:49:54.011256  7273 tablet_service.cc:1511] Processing CreateTablet for tablet 22ad3bca8c6b4fa982bb8611615a69dd (DEFAULT_TABLE table=test-workload [id=4b613962994c482e9ea4977ea8b85d2a]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 14:49:54.012578  7273 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22ad3bca8c6b4fa982bb8611615a69dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:49:54.014043  7278 tablet_service.cc:1511] Processing CreateTablet for tablet 79853f64be7f4e5ebb08a711d87bcede (DEFAULT_TABLE table=test-workload [id=4b613962994c482e9ea4977ea8b85d2a]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 14:49:54.015955  7278 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79853f64be7f4e5ebb08a711d87bcede. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:49:54.020781  7271 tablet_service.cc:1511] Processing CreateTablet for tablet dc1712921e544aaba5d8fc45d4767c61 (DEFAULT_TABLE table=test-workload [id=4b613962994c482e9ea4977ea8b85d2a]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 14:49:54.022634  7271 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc1712921e544aaba5d8fc45d4767c61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:49:54.023720  7276 tablet_service.cc:1511] Processing CreateTablet for tablet e93fd08a04f04602bb98df0aca9a314e (DEFAULT_TABLE table=test-workload [id=4b613962994c482e9ea4977ea8b85d2a]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 14:49:54.026479  7274 tablet_service.cc:1511] Processing CreateTablet for tablet 21f5ecd80b0b421aad67b6ec53d594d2 (DEFAULT_TABLE table=test-workload [id=4b613962994c482e9ea4977ea8b85d2a]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 14:49:54.029171  7272 tablet_service.cc:1511] Processing CreateTablet for tablet 1d10779bfab7437babc4a1e815792595 (DEFAULT_TABLE table=test-workload [id=4b613962994c482e9ea4977ea8b85d2a]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 14:49:54.031980  7270 tablet_service.cc:1511] Processing CreateTablet for tablet 4f6ef4ab0acb497681217b9e670bd2c2 (DEFAULT_TABLE table=test-workload [id=4b613962994c482e9ea4977ea8b85d2a]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 14:49:54.039268  7420 tablet_service.cc:1511] Processing CreateTablet for tablet dc1712921e544aaba5d8fc45d4767c61 (DEFAULT_TABLE table=test-workload [id=4b613962994c482e9ea4977ea8b85d2a]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 14:49:54.041124  7420 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc1712921e544aaba5d8fc45d4767c61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:49:54.008195  7279 tablet_service.cc:1511] Processing CreateTablet for tablet 36fe96aff6384e2d807b9f4d1bc8a544 (DEFAULT_TABLE table=test-workload [id=4b613962994c482e9ea4977ea8b85d2a]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 14:49:54.045794  7276 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e93fd08a04f04602bb98df0aca9a314e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:49:54.046810  7272 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d10779bfab7437babc4a1e815792595. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:49:54.020470  7277 tablet_service.cc:1511] Processing CreateTablet for tablet a60aa91e98ae4ad0afc3dd45d4b586f2 (DEFAULT_TABLE table=test-workload [id=4b613962994c482e9ea4977ea8b85d2a]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 14:49:54.039227  7421 tablet_service.cc:1511] Processing CreateTablet for tablet 1d10779bfab7437babc4a1e815792595 (DEFAULT_TABLE table=test-workload [id=4b613962994c482e9ea4977ea8b85d2a]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 14:49:54.053167  7345 tablet_service.cc:1511] Processing CreateTablet for tablet 4f6ef4ab0acb497681217b9e670bd2c2 (DEFAULT_TABLE table=test-workload [id=4b613962994c482e9ea4977ea8b85d2a]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 14:49:54.053772  7421 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d10779bfab7437babc4a1e815792595. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:49:54.054630  7345 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f6ef4ab0acb497681217b9e670bd2c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:49:54.039342  7346 tablet_service.cc:1511] Processing CreateTablet for tablet dc1712921e544aaba5d8fc45d4767c61 (DEFAULT_TABLE table=test-workload [id=4b613962994c482e9ea4977ea8b85d2a]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 14:49:54.058522  7346 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc1712921e544aaba5d8fc45d4767c61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:49:54.065153  7419 tablet_service.cc:1511] Processing CreateTablet for tablet 4f6ef4ab0acb497681217b9e670bd2c2 (DEFAULT_TABLE table=test-workload [id=4b613962994c482e9ea4977ea8b85d2a]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 14:49:54.067270  7419 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f6ef4ab0acb497681217b9e670bd2c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:49:54.061676  7270 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f6ef4ab0acb497681217b9e670bd2c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:49:54.073665  7274 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21f5ecd80b0b421aad67b6ec53d594d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:49:54.079672  7279 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36fe96aff6384e2d807b9f4d1bc8a544. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:49:54.082270  7277 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a60aa91e98ae4ad0afc3dd45d4b586f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:49:54.101652  7478 tablet_bootstrap.cc:492] T 36fe96aff6384e2d807b9f4d1bc8a544 P fdf485ed0db84f74868a2c265c56d1d4: Bootstrap starting.
I20260709 14:49:54.118970  7480 tablet_bootstrap.cc:492] T 22ad3bca8c6b4fa982bb8611615a69dd P 68f78fc64ad74f9fa62efb081a46832d: Bootstrap starting.
I20260709 14:49:54.138721  7480 tablet_bootstrap.cc:654] T 22ad3bca8c6b4fa982bb8611615a69dd P 68f78fc64ad74f9fa62efb081a46832d: Neither blocks nor log segments found. Creating new log.
I20260709 14:49:54.146121  7479 tablet_bootstrap.cc:492] T dc1712921e544aaba5d8fc45d4767c61 P 155fc36248c04168afbd796e9ee66493: Bootstrap starting.
I20260709 14:49:54.184712  7479 tablet_bootstrap.cc:654] T dc1712921e544aaba5d8fc45d4767c61 P 155fc36248c04168afbd796e9ee66493: Neither blocks nor log segments found. Creating new log.
I20260709 14:49:54.186162  7478 tablet_bootstrap.cc:654] T 36fe96aff6384e2d807b9f4d1bc8a544 P fdf485ed0db84f74868a2c265c56d1d4: Neither blocks nor log segments found. Creating new log.
I20260709 14:49:54.195393  7480 tablet_bootstrap.cc:492] T 22ad3bca8c6b4fa982bb8611615a69dd P 68f78fc64ad74f9fa62efb081a46832d: No bootstrap required, opened a new log
I20260709 14:49:54.196015  7480 ts_tablet_manager.cc:1403] T 22ad3bca8c6b4fa982bb8611615a69dd P 68f78fc64ad74f9fa62efb081a46832d: Time spent bootstrapping tablet: real 0.077s	user 0.014s	sys 0.037s
I20260709 14:49:54.216166  7480 raft_consensus.cc:359] T 22ad3bca8c6b4fa982bb8611615a69dd P 68f78fc64ad74f9fa62efb081a46832d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
I20260709 14:49:54.217020  7480 raft_consensus.cc:385] T 22ad3bca8c6b4fa982bb8611615a69dd P 68f78fc64ad74f9fa62efb081a46832d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:49:54.217409  7478 tablet_bootstrap.cc:492] T 36fe96aff6384e2d807b9f4d1bc8a544 P fdf485ed0db84f74868a2c265c56d1d4: No bootstrap required, opened a new log
I20260709 14:49:54.217518  7480 raft_consensus.cc:740] T 22ad3bca8c6b4fa982bb8611615a69dd P 68f78fc64ad74f9fa62efb081a46832d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68f78fc64ad74f9fa62efb081a46832d, State: Initialized, Role: FOLLOWER
I20260709 14:49:54.218428  7478 ts_tablet_manager.cc:1403] T 36fe96aff6384e2d807b9f4d1bc8a544 P fdf485ed0db84f74868a2c265c56d1d4: Time spent bootstrapping tablet: real 0.138s	user 0.007s	sys 0.018s
I20260709 14:49:54.218932  7480 consensus_queue.cc:260] T 22ad3bca8c6b4fa982bb8611615a69dd P 68f78fc64ad74f9fa62efb081a46832d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
I20260709 14:49:54.222628  7480 ts_tablet_manager.cc:1434] T 22ad3bca8c6b4fa982bb8611615a69dd P 68f78fc64ad74f9fa62efb081a46832d: Time spent starting tablet: real 0.026s	user 0.004s	sys 0.005s
I20260709 14:49:54.223027  7463 heartbeater.cc:499] Master 127.6.101.126:39763 was elected leader, sending a full tablet report...
I20260709 14:49:54.222643  7478 raft_consensus.cc:359] T 36fe96aff6384e2d807b9f4d1bc8a544 P fdf485ed0db84f74868a2c265c56d1d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } }
I20260709 14:49:54.223661  7479 tablet_bootstrap.cc:492] T dc1712921e544aaba5d8fc45d4767c61 P 155fc36248c04168afbd796e9ee66493: No bootstrap required, opened a new log
I20260709 14:49:54.223650  7478 raft_consensus.cc:385] T 36fe96aff6384e2d807b9f4d1bc8a544 P fdf485ed0db84f74868a2c265c56d1d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:49:54.224131  7480 tablet_bootstrap.cc:492] T 36fe96aff6384e2d807b9f4d1bc8a544 P 68f78fc64ad74f9fa62efb081a46832d: Bootstrap starting.
I20260709 14:49:54.224301  7478 raft_consensus.cc:740] T 36fe96aff6384e2d807b9f4d1bc8a544 P fdf485ed0db84f74868a2c265c56d1d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fdf485ed0db84f74868a2c265c56d1d4, State: Initialized, Role: FOLLOWER
I20260709 14:49:54.224390  7479 ts_tablet_manager.cc:1403] T dc1712921e544aaba5d8fc45d4767c61 P 155fc36248c04168afbd796e9ee66493: Time spent bootstrapping tablet: real 0.079s	user 0.022s	sys 0.006s
I20260709 14:49:54.225528  7478 consensus_queue.cc:260] T 36fe96aff6384e2d807b9f4d1bc8a544 P fdf485ed0db84f74868a2c265c56d1d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } }
I20260709 14:49:54.228401  7479 raft_consensus.cc:359] T dc1712921e544aaba5d8fc45d4767c61 P 155fc36248c04168afbd796e9ee66493 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
I20260709 14:49:54.229334  7479 raft_consensus.cc:385] T dc1712921e544aaba5d8fc45d4767c61 P 155fc36248c04168afbd796e9ee66493 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:49:54.229768  7479 raft_consensus.cc:740] T dc1712921e544aaba5d8fc45d4767c61 P 155fc36248c04168afbd796e9ee66493 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 155fc36248c04168afbd796e9ee66493, State: Initialized, Role: FOLLOWER
I20260709 14:49:54.231120  7479 consensus_queue.cc:260] T dc1712921e544aaba5d8fc45d4767c61 P 155fc36248c04168afbd796e9ee66493 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
I20260709 14:49:54.231736  7389 heartbeater.cc:499] Master 127.6.101.126:39763 was elected leader, sending a full tablet report...
I20260709 14:49:54.233773  7480 tablet_bootstrap.cc:654] T 36fe96aff6384e2d807b9f4d1bc8a544 P 68f78fc64ad74f9fa62efb081a46832d: Neither blocks nor log segments found. Creating new log.
I20260709 14:49:54.242767  7478 ts_tablet_manager.cc:1434] T 36fe96aff6384e2d807b9f4d1bc8a544 P fdf485ed0db84f74868a2c265c56d1d4: Time spent starting tablet: real 0.024s	user 0.010s	sys 0.001s
I20260709 14:49:54.245324  7478 tablet_bootstrap.cc:492] T e93fd08a04f04602bb98df0aca9a314e P fdf485ed0db84f74868a2c265c56d1d4: Bootstrap starting.
I20260709 14:49:54.245569  7480 tablet_bootstrap.cc:492] T 36fe96aff6384e2d807b9f4d1bc8a544 P 68f78fc64ad74f9fa62efb081a46832d: No bootstrap required, opened a new log
I20260709 14:49:54.246939  7480 ts_tablet_manager.cc:1403] T 36fe96aff6384e2d807b9f4d1bc8a544 P 68f78fc64ad74f9fa62efb081a46832d: Time spent bootstrapping tablet: real 0.023s	user 0.006s	sys 0.015s
I20260709 14:49:54.251005  7480 raft_consensus.cc:359] T 36fe96aff6384e2d807b9f4d1bc8a544 P 68f78fc64ad74f9fa62efb081a46832d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } }
I20260709 14:49:54.252238  7480 raft_consensus.cc:385] T 36fe96aff6384e2d807b9f4d1bc8a544 P 68f78fc64ad74f9fa62efb081a46832d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:49:54.252629  7480 raft_consensus.cc:740] T 36fe96aff6384e2d807b9f4d1bc8a544 P 68f78fc64ad74f9fa62efb081a46832d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68f78fc64ad74f9fa62efb081a46832d, State: Initialized, Role: FOLLOWER
I20260709 14:49:54.253692  7480 consensus_queue.cc:260] T 36fe96aff6384e2d807b9f4d1bc8a544 P 68f78fc64ad74f9fa62efb081a46832d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } }
I20260709 14:49:54.254956  7478 tablet_bootstrap.cc:654] T e93fd08a04f04602bb98df0aca9a314e P fdf485ed0db84f74868a2c265c56d1d4: Neither blocks nor log segments found. Creating new log.
I20260709 14:49:54.256618  7480 ts_tablet_manager.cc:1434] T 36fe96aff6384e2d807b9f4d1bc8a544 P 68f78fc64ad74f9fa62efb081a46832d: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.004s
I20260709 14:49:54.258008  7480 tablet_bootstrap.cc:492] T 79853f64be7f4e5ebb08a711d87bcede P 68f78fc64ad74f9fa62efb081a46832d: Bootstrap starting.
I20260709 14:49:54.267293  7480 tablet_bootstrap.cc:654] T 79853f64be7f4e5ebb08a711d87bcede P 68f78fc64ad74f9fa62efb081a46832d: Neither blocks nor log segments found. Creating new log.
I20260709 14:49:54.268998  7478 tablet_bootstrap.cc:492] T e93fd08a04f04602bb98df0aca9a314e P fdf485ed0db84f74868a2c265c56d1d4: No bootstrap required, opened a new log
I20260709 14:49:54.269762  7478 ts_tablet_manager.cc:1403] T e93fd08a04f04602bb98df0aca9a314e P fdf485ed0db84f74868a2c265c56d1d4: Time spent bootstrapping tablet: real 0.025s	user 0.020s	sys 0.003s
I20260709 14:49:54.273123  7478 raft_consensus.cc:359] T e93fd08a04f04602bb98df0aca9a314e P fdf485ed0db84f74868a2c265c56d1d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
I20260709 14:49:54.274156  7478 raft_consensus.cc:385] T e93fd08a04f04602bb98df0aca9a314e P fdf485ed0db84f74868a2c265c56d1d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:49:54.275161  7478 raft_consensus.cc:740] T e93fd08a04f04602bb98df0aca9a314e P fdf485ed0db84f74868a2c265c56d1d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fdf485ed0db84f74868a2c265c56d1d4, State: Initialized, Role: FOLLOWER
I20260709 14:49:54.275683  7314 heartbeater.cc:499] Master 127.6.101.126:39763 was elected leader, sending a full tablet report...
I20260709 14:49:54.276463  7478 consensus_queue.cc:260] T e93fd08a04f04602bb98df0aca9a314e P fdf485ed0db84f74868a2c265c56d1d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
I20260709 14:49:54.283155  7479 ts_tablet_manager.cc:1434] T dc1712921e544aaba5d8fc45d4767c61 P 155fc36248c04168afbd796e9ee66493: Time spent starting tablet: real 0.058s	user 0.015s	sys 0.034s
I20260709 14:49:54.284996  7479 tablet_bootstrap.cc:492] T 4f6ef4ab0acb497681217b9e670bd2c2 P 155fc36248c04168afbd796e9ee66493: Bootstrap starting.
I20260709 14:49:54.283372  7478 ts_tablet_manager.cc:1434] T e93fd08a04f04602bb98df0aca9a314e P fdf485ed0db84f74868a2c265c56d1d4: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 14:49:54.288424  7478 tablet_bootstrap.cc:492] T a60aa91e98ae4ad0afc3dd45d4b586f2 P fdf485ed0db84f74868a2c265c56d1d4: Bootstrap starting.
I20260709 14:49:54.296253  7478 tablet_bootstrap.cc:654] T a60aa91e98ae4ad0afc3dd45d4b586f2 P fdf485ed0db84f74868a2c265c56d1d4: Neither blocks nor log segments found. Creating new log.
I20260709 14:49:54.299189  7480 tablet_bootstrap.cc:492] T 79853f64be7f4e5ebb08a711d87bcede P 68f78fc64ad74f9fa62efb081a46832d: No bootstrap required, opened a new log
I20260709 14:49:54.300030  7480 ts_tablet_manager.cc:1403] T 79853f64be7f4e5ebb08a711d87bcede P 68f78fc64ad74f9fa62efb081a46832d: Time spent bootstrapping tablet: real 0.042s	user 0.019s	sys 0.007s
I20260709 14:49:54.300323  7479 tablet_bootstrap.cc:654] T 4f6ef4ab0acb497681217b9e670bd2c2 P 155fc36248c04168afbd796e9ee66493: Neither blocks nor log segments found. Creating new log.
I20260709 14:49:54.303498  7480 raft_consensus.cc:359] T 79853f64be7f4e5ebb08a711d87bcede P 68f78fc64ad74f9fa62efb081a46832d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
I20260709 14:49:54.304363  7480 raft_consensus.cc:385] T 79853f64be7f4e5ebb08a711d87bcede P 68f78fc64ad74f9fa62efb081a46832d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:49:54.304687  7480 raft_consensus.cc:740] T 79853f64be7f4e5ebb08a711d87bcede P 68f78fc64ad74f9fa62efb081a46832d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68f78fc64ad74f9fa62efb081a46832d, State: Initialized, Role: FOLLOWER
I20260709 14:49:54.305786  7480 consensus_queue.cc:260] T 79853f64be7f4e5ebb08a711d87bcede P 68f78fc64ad74f9fa62efb081a46832d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
I20260709 14:49:54.311568  7480 ts_tablet_manager.cc:1434] T 79853f64be7f4e5ebb08a711d87bcede P 68f78fc64ad74f9fa62efb081a46832d: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 14:49:54.313422  7480 tablet_bootstrap.cc:492] T 21f5ecd80b0b421aad67b6ec53d594d2 P 68f78fc64ad74f9fa62efb081a46832d: Bootstrap starting.
W20260709 14:49:54.314862  7235 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 14:49:54.331632  7479 tablet_bootstrap.cc:492] T 4f6ef4ab0acb497681217b9e670bd2c2 P 155fc36248c04168afbd796e9ee66493: No bootstrap required, opened a new log
I20260709 14:49:54.332056  7478 tablet_bootstrap.cc:492] T a60aa91e98ae4ad0afc3dd45d4b586f2 P fdf485ed0db84f74868a2c265c56d1d4: No bootstrap required, opened a new log
I20260709 14:49:54.331905  7480 tablet_bootstrap.cc:654] T 21f5ecd80b0b421aad67b6ec53d594d2 P 68f78fc64ad74f9fa62efb081a46832d: Neither blocks nor log segments found. Creating new log.
I20260709 14:49:54.332248  7479 ts_tablet_manager.cc:1403] T 4f6ef4ab0acb497681217b9e670bd2c2 P 155fc36248c04168afbd796e9ee66493: Time spent bootstrapping tablet: real 0.048s	user 0.005s	sys 0.031s
I20260709 14:49:54.332805  7478 ts_tablet_manager.cc:1403] T a60aa91e98ae4ad0afc3dd45d4b586f2 P fdf485ed0db84f74868a2c265c56d1d4: Time spent bootstrapping tablet: real 0.045s	user 0.013s	sys 0.027s
I20260709 14:49:54.334779  7486 raft_consensus.cc:493] T dc1712921e544aaba5d8fc45d4767c61 P 155fc36248c04168afbd796e9ee66493 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:49:54.335521  7486 raft_consensus.cc:515] T dc1712921e544aaba5d8fc45d4767c61 P 155fc36248c04168afbd796e9ee66493 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
I20260709 14:49:54.337083  7478 raft_consensus.cc:359] T a60aa91e98ae4ad0afc3dd45d4b586f2 P fdf485ed0db84f74868a2c265c56d1d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
I20260709 14:49:54.338266  7478 raft_consensus.cc:385] T a60aa91e98ae4ad0afc3dd45d4b586f2 P fdf485ed0db84f74868a2c265c56d1d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:49:54.338712  7480 tablet_bootstrap.cc:492] T 21f5ecd80b0b421aad67b6ec53d594d2 P 68f78fc64ad74f9fa62efb081a46832d: No bootstrap required, opened a new log
I20260709 14:49:54.338745  7478 raft_consensus.cc:740] T a60aa91e98ae4ad0afc3dd45d4b586f2 P fdf485ed0db84f74868a2c265c56d1d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fdf485ed0db84f74868a2c265c56d1d4, State: Initialized, Role: FOLLOWER
I20260709 14:49:54.339365  7480 ts_tablet_manager.cc:1403] T 21f5ecd80b0b421aad67b6ec53d594d2 P 68f78fc64ad74f9fa62efb081a46832d: Time spent bootstrapping tablet: real 0.026s	user 0.010s	sys 0.002s
I20260709 14:49:54.339784  7478 consensus_queue.cc:260] T a60aa91e98ae4ad0afc3dd45d4b586f2 P fdf485ed0db84f74868a2c265c56d1d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
I20260709 14:49:54.343154  7486 leader_election.cc:290] T dc1712921e544aaba5d8fc45d4767c61 P 155fc36248c04168afbd796e9ee66493 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fdf485ed0db84f74868a2c265c56d1d4 (127.6.101.66:35791), 68f78fc64ad74f9fa62efb081a46832d (127.6.101.67:42957)
I20260709 14:49:54.343367  7478 ts_tablet_manager.cc:1434] T a60aa91e98ae4ad0afc3dd45d4b586f2 P fdf485ed0db84f74868a2c265c56d1d4: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 14:49:54.344928  7478 tablet_bootstrap.cc:492] T 21f5ecd80b0b421aad67b6ec53d594d2 P fdf485ed0db84f74868a2c265c56d1d4: Bootstrap starting.
I20260709 14:49:54.348829  7480 raft_consensus.cc:359] T 21f5ecd80b0b421aad67b6ec53d594d2 P 68f78fc64ad74f9fa62efb081a46832d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
I20260709 14:49:54.350153  7480 raft_consensus.cc:385] T 21f5ecd80b0b421aad67b6ec53d594d2 P 68f78fc64ad74f9fa62efb081a46832d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:49:54.350610  7480 raft_consensus.cc:740] T 21f5ecd80b0b421aad67b6ec53d594d2 P 68f78fc64ad74f9fa62efb081a46832d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68f78fc64ad74f9fa62efb081a46832d, State: Initialized, Role: FOLLOWER
I20260709 14:49:54.351497  7480 consensus_queue.cc:260] T 21f5ecd80b0b421aad67b6ec53d594d2 P 68f78fc64ad74f9fa62efb081a46832d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
I20260709 14:49:54.349189  7479 raft_consensus.cc:359] T 4f6ef4ab0acb497681217b9e670bd2c2 P 155fc36248c04168afbd796e9ee66493 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
I20260709 14:49:54.352559  7479 raft_consensus.cc:385] T 4f6ef4ab0acb497681217b9e670bd2c2 P 155fc36248c04168afbd796e9ee66493 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:49:54.352876  7479 raft_consensus.cc:740] T 4f6ef4ab0acb497681217b9e670bd2c2 P 155fc36248c04168afbd796e9ee66493 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 155fc36248c04168afbd796e9ee66493, State: Initialized, Role: FOLLOWER
I20260709 14:49:54.353983  7479 consensus_queue.cc:260] T 4f6ef4ab0acb497681217b9e670bd2c2 P 155fc36248c04168afbd796e9ee66493 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
I20260709 14:49:54.356895  7479 ts_tablet_manager.cc:1434] T 4f6ef4ab0acb497681217b9e670bd2c2 P 155fc36248c04168afbd796e9ee66493: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.001s
I20260709 14:49:54.358158  7484 raft_consensus.cc:493] T 36fe96aff6384e2d807b9f4d1bc8a544 P 68f78fc64ad74f9fa62efb081a46832d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:49:54.358430  7478 tablet_bootstrap.cc:654] T 21f5ecd80b0b421aad67b6ec53d594d2 P fdf485ed0db84f74868a2c265c56d1d4: Neither blocks nor log segments found. Creating new log.
I20260709 14:49:54.361560  7484 raft_consensus.cc:515] T 36fe96aff6384e2d807b9f4d1bc8a544 P 68f78fc64ad74f9fa62efb081a46832d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } }
I20260709 14:49:54.360816  7480 ts_tablet_manager.cc:1434] T 21f5ecd80b0b421aad67b6ec53d594d2 P 68f78fc64ad74f9fa62efb081a46832d: Time spent starting tablet: real 0.021s	user 0.009s	sys 0.001s
I20260709 14:49:54.366945  7480 tablet_bootstrap.cc:492] T dc1712921e544aaba5d8fc45d4767c61 P 68f78fc64ad74f9fa62efb081a46832d: Bootstrap starting.
I20260709 14:49:54.369133  7438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1712921e544aaba5d8fc45d4767c61" candidate_uuid: "155fc36248c04168afbd796e9ee66493" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68f78fc64ad74f9fa62efb081a46832d" is_pre_election: true
W20260709 14:49:54.371850  7253 leader_election.cc:343] T dc1712921e544aaba5d8fc45d4767c61 P 155fc36248c04168afbd796e9ee66493 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 68f78fc64ad74f9fa62efb081a46832d (127.6.101.67:42957): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:49:54.373766  7484 leader_election.cc:290] T 36fe96aff6384e2d807b9f4d1bc8a544 P 68f78fc64ad74f9fa62efb081a46832d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fdf485ed0db84f74868a2c265c56d1d4 (127.6.101.66:35791), 155fc36248c04168afbd796e9ee66493 (127.6.101.65:43743)
I20260709 14:49:54.375860  7485 raft_consensus.cc:493] T 36fe96aff6384e2d807b9f4d1bc8a544 P fdf485ed0db84f74868a2c265c56d1d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:49:54.376665  7480 tablet_bootstrap.cc:654] T dc1712921e544aaba5d8fc45d4767c61 P 68f78fc64ad74f9fa62efb081a46832d: Neither blocks nor log segments found. Creating new log.
I20260709 14:49:54.376443  7485 raft_consensus.cc:515] T 36fe96aff6384e2d807b9f4d1bc8a544 P fdf485ed0db84f74868a2c265c56d1d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } }
I20260709 14:49:54.385784  7485 leader_election.cc:290] T 36fe96aff6384e2d807b9f4d1bc8a544 P fdf485ed0db84f74868a2c265c56d1d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 68f78fc64ad74f9fa62efb081a46832d (127.6.101.67:42957), 155fc36248c04168afbd796e9ee66493 (127.6.101.65:43743)
I20260709 14:49:54.399042  7479 tablet_bootstrap.cc:492] T 22ad3bca8c6b4fa982bb8611615a69dd P 155fc36248c04168afbd796e9ee66493: Bootstrap starting.
I20260709 14:49:54.414880  7289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36fe96aff6384e2d807b9f4d1bc8a544" candidate_uuid: "68f78fc64ad74f9fa62efb081a46832d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "155fc36248c04168afbd796e9ee66493" is_pre_election: true
W20260709 14:49:54.419174  7401 leader_election.cc:343] T 36fe96aff6384e2d807b9f4d1bc8a544 P 68f78fc64ad74f9fa62efb081a46832d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 155fc36248c04168afbd796e9ee66493 (127.6.101.65:43743): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:49:54.420491  7478 tablet_bootstrap.cc:492] T 21f5ecd80b0b421aad67b6ec53d594d2 P fdf485ed0db84f74868a2c265c56d1d4: No bootstrap required, opened a new log
I20260709 14:49:54.421707  7478 ts_tablet_manager.cc:1403] T 21f5ecd80b0b421aad67b6ec53d594d2 P fdf485ed0db84f74868a2c265c56d1d4: Time spent bootstrapping tablet: real 0.077s	user 0.025s	sys 0.013s
I20260709 14:49:54.422021  7364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1712921e544aaba5d8fc45d4767c61" candidate_uuid: "155fc36248c04168afbd796e9ee66493" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fdf485ed0db84f74868a2c265c56d1d4" is_pre_election: true
I20260709 14:49:54.422812  7479 tablet_bootstrap.cc:654] T 22ad3bca8c6b4fa982bb8611615a69dd P 155fc36248c04168afbd796e9ee66493: Neither blocks nor log segments found. Creating new log.
W20260709 14:49:54.425345  7253 leader_election.cc:343] T dc1712921e544aaba5d8fc45d4767c61 P 155fc36248c04168afbd796e9ee66493 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fdf485ed0db84f74868a2c265c56d1d4 (127.6.101.66:35791): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:49:54.425872  7253 leader_election.cc:304] T dc1712921e544aaba5d8fc45d4767c61 P 155fc36248c04168afbd796e9ee66493 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155fc36248c04168afbd796e9ee66493; no voters: 68f78fc64ad74f9fa62efb081a46832d, fdf485ed0db84f74868a2c265c56d1d4
I20260709 14:49:54.426632  7480 tablet_bootstrap.cc:492] T dc1712921e544aaba5d8fc45d4767c61 P 68f78fc64ad74f9fa62efb081a46832d: No bootstrap required, opened a new log
I20260709 14:49:54.426285  7478 raft_consensus.cc:359] T 21f5ecd80b0b421aad67b6ec53d594d2 P fdf485ed0db84f74868a2c265c56d1d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
I20260709 14:49:54.427242  7486 raft_consensus.cc:2749] T dc1712921e544aaba5d8fc45d4767c61 P 155fc36248c04168afbd796e9ee66493 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:49:54.427471  7478 raft_consensus.cc:385] T 21f5ecd80b0b421aad67b6ec53d594d2 P fdf485ed0db84f74868a2c265c56d1d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:49:54.427999  7478 raft_consensus.cc:740] T 21f5ecd80b0b421aad67b6ec53d594d2 P fdf485ed0db84f74868a2c265c56d1d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fdf485ed0db84f74868a2c265c56d1d4, State: Initialized, Role: FOLLOWER
I20260709 14:49:54.428912  7478 consensus_queue.cc:260] T 21f5ecd80b0b421aad67b6ec53d594d2 P fdf485ed0db84f74868a2c265c56d1d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
I20260709 14:49:54.429406  7364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36fe96aff6384e2d807b9f4d1bc8a544" candidate_uuid: "68f78fc64ad74f9fa62efb081a46832d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fdf485ed0db84f74868a2c265c56d1d4" is_pre_election: true
I20260709 14:49:54.430146  7364 raft_consensus.cc:2468] T 36fe96aff6384e2d807b9f4d1bc8a544 P fdf485ed0db84f74868a2c265c56d1d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 68f78fc64ad74f9fa62efb081a46832d in term 0.
I20260709 14:49:54.431702  7402 leader_election.cc:304] T 36fe96aff6384e2d807b9f4d1bc8a544 P 68f78fc64ad74f9fa62efb081a46832d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 68f78fc64ad74f9fa62efb081a46832d, fdf485ed0db84f74868a2c265c56d1d4; no voters: 155fc36248c04168afbd796e9ee66493
I20260709 14:49:54.432135  7478 ts_tablet_manager.cc:1434] T 21f5ecd80b0b421aad67b6ec53d594d2 P fdf485ed0db84f74868a2c265c56d1d4: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.004s
I20260709 14:49:54.433456  7478 tablet_bootstrap.cc:492] T 1d10779bfab7437babc4a1e815792595 P fdf485ed0db84f74868a2c265c56d1d4: Bootstrap starting.
I20260709 14:49:54.435475  7484 raft_consensus.cc:2804] T 36fe96aff6384e2d807b9f4d1bc8a544 P 68f78fc64ad74f9fa62efb081a46832d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:49:54.435940  7484 raft_consensus.cc:493] T 36fe96aff6384e2d807b9f4d1bc8a544 P 68f78fc64ad74f9fa62efb081a46832d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:49:54.436300  7484 raft_consensus.cc:3060] T 36fe96aff6384e2d807b9f4d1bc8a544 P 68f78fc64ad74f9fa62efb081a46832d [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:49:54.441148  7478 tablet_bootstrap.cc:654] T 1d10779bfab7437babc4a1e815792595 P fdf485ed0db84f74868a2c265c56d1d4: Neither blocks nor log segments found. Creating new log.
I20260709 14:49:54.427263  7480 ts_tablet_manager.cc:1403] T dc1712921e544aaba5d8fc45d4767c61 P 68f78fc64ad74f9fa62efb081a46832d: Time spent bootstrapping tablet: real 0.061s	user 0.008s	sys 0.018s
I20260709 14:49:54.447228  7484 raft_consensus.cc:515] T 36fe96aff6384e2d807b9f4d1bc8a544 P 68f78fc64ad74f9fa62efb081a46832d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } }
I20260709 14:49:54.453964  7364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36fe96aff6384e2d807b9f4d1bc8a544" candidate_uuid: "68f78fc64ad74f9fa62efb081a46832d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fdf485ed0db84f74868a2c265c56d1d4"
I20260709 14:49:54.449201  7480 raft_consensus.cc:359] T dc1712921e544aaba5d8fc45d4767c61 P 68f78fc64ad74f9fa62efb081a46832d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
I20260709 14:49:54.456180  7480 raft_consensus.cc:385] T dc1712921e544aaba5d8fc45d4767c61 P 68f78fc64ad74f9fa62efb081a46832d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:49:54.456204  7504 raft_consensus.cc:493] T 79853f64be7f4e5ebb08a711d87bcede P 68f78fc64ad74f9fa62efb081a46832d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:49:54.456651  7480 raft_consensus.cc:740] T dc1712921e544aaba5d8fc45d4767c61 P 68f78fc64ad74f9fa62efb081a46832d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68f78fc64ad74f9fa62efb081a46832d, State: Initialized, Role: FOLLOWER
I20260709 14:49:54.457088  7438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36fe96aff6384e2d807b9f4d1bc8a544" candidate_uuid: "fdf485ed0db84f74868a2c265c56d1d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68f78fc64ad74f9fa62efb081a46832d" is_pre_election: true
I20260709 14:49:54.456926  7504 raft_consensus.cc:515] T 79853f64be7f4e5ebb08a711d87bcede P 68f78fc64ad74f9fa62efb081a46832d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
I20260709 14:49:54.458134  7438 raft_consensus.cc:2393] T 36fe96aff6384e2d807b9f4d1bc8a544 P 68f78fc64ad74f9fa62efb081a46832d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fdf485ed0db84f74868a2c265c56d1d4 in current term 1: Already voted for candidate 68f78fc64ad74f9fa62efb081a46832d in this term.
I20260709 14:49:54.457888  7480 consensus_queue.cc:260] T dc1712921e544aaba5d8fc45d4767c61 P 68f78fc64ad74f9fa62efb081a46832d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
I20260709 14:49:54.455015  7364 raft_consensus.cc:3060] T 36fe96aff6384e2d807b9f4d1bc8a544 P fdf485ed0db84f74868a2c265c56d1d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:49:54.463178  7479 tablet_bootstrap.cc:492] T 22ad3bca8c6b4fa982bb8611615a69dd P 155fc36248c04168afbd796e9ee66493: No bootstrap required, opened a new log
I20260709 14:49:54.463934  7479 ts_tablet_manager.cc:1403] T 22ad3bca8c6b4fa982bb8611615a69dd P 155fc36248c04168afbd796e9ee66493: Time spent bootstrapping tablet: real 0.065s	user 0.004s	sys 0.038s
I20260709 14:49:54.473367  7504 leader_election.cc:290] T 79853f64be7f4e5ebb08a711d87bcede P 68f78fc64ad74f9fa62efb081a46832d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 155fc36248c04168afbd796e9ee66493 (127.6.101.65:43743), fdf485ed0db84f74868a2c265c56d1d4 (127.6.101.66:35791)
I20260709 14:49:54.474659  7289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36fe96aff6384e2d807b9f4d1bc8a544" candidate_uuid: "68f78fc64ad74f9fa62efb081a46832d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "155fc36248c04168afbd796e9ee66493"
I20260709 14:49:54.475750  7363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79853f64be7f4e5ebb08a711d87bcede" candidate_uuid: "68f78fc64ad74f9fa62efb081a46832d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fdf485ed0db84f74868a2c265c56d1d4" is_pre_election: true
I20260709 14:49:54.476339  7288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79853f64be7f4e5ebb08a711d87bcede" candidate_uuid: "68f78fc64ad74f9fa62efb081a46832d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "155fc36248c04168afbd796e9ee66493" is_pre_election: true
W20260709 14:49:54.478655  7402 leader_election.cc:343] T 79853f64be7f4e5ebb08a711d87bcede P 68f78fc64ad74f9fa62efb081a46832d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fdf485ed0db84f74868a2c265c56d1d4 (127.6.101.66:35791): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:49:54.481755  7364 raft_consensus.cc:2468] T 36fe96aff6384e2d807b9f4d1bc8a544 P fdf485ed0db84f74868a2c265c56d1d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68f78fc64ad74f9fa62efb081a46832d in term 1.
I20260709 14:49:54.483268  7480 ts_tablet_manager.cc:1434] T dc1712921e544aaba5d8fc45d4767c61 P 68f78fc64ad74f9fa62efb081a46832d: Time spent starting tablet: real 0.039s	user 0.008s	sys 0.011s
W20260709 14:49:54.483422  7401 leader_election.cc:343] T 36fe96aff6384e2d807b9f4d1bc8a544 P 68f78fc64ad74f9fa62efb081a46832d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 155fc36248c04168afbd796e9ee66493 (127.6.101.65:43743): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:49:54.484108  7402 leader_election.cc:304] T 36fe96aff6384e2d807b9f4d1bc8a544 P 68f78fc64ad74f9fa62efb081a46832d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 68f78fc64ad74f9fa62efb081a46832d, fdf485ed0db84f74868a2c265c56d1d4; no voters: 155fc36248c04168afbd796e9ee66493
W20260709 14:49:54.484647  7401 leader_election.cc:343] T 79853f64be7f4e5ebb08a711d87bcede P 68f78fc64ad74f9fa62efb081a46832d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 155fc36248c04168afbd796e9ee66493 (127.6.101.65:43743): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:49:54.485080  7288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36fe96aff6384e2d807b9f4d1bc8a544" candidate_uuid: "fdf485ed0db84f74868a2c265c56d1d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "155fc36248c04168afbd796e9ee66493" is_pre_election: true
I20260709 14:49:54.485150  7401 leader_election.cc:304] T 79853f64be7f4e5ebb08a711d87bcede P 68f78fc64ad74f9fa62efb081a46832d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 68f78fc64ad74f9fa62efb081a46832d; no voters: 155fc36248c04168afbd796e9ee66493, fdf485ed0db84f74868a2c265c56d1d4
I20260709 14:49:54.485677  7480 tablet_bootstrap.cc:492] T a60aa91e98ae4ad0afc3dd45d4b586f2 P 68f78fc64ad74f9fa62efb081a46832d: Bootstrap starting.
I20260709 14:49:54.486367  7504 raft_consensus.cc:2804] T 36fe96aff6384e2d807b9f4d1bc8a544 P 68f78fc64ad74f9fa62efb081a46832d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:49:54.484702  7479 raft_consensus.cc:359] T 22ad3bca8c6b4fa982bb8611615a69dd P 155fc36248c04168afbd796e9ee66493 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
I20260709 14:49:54.487862  7479 raft_consensus.cc:385] T 22ad3bca8c6b4fa982bb8611615a69dd P 155fc36248c04168afbd796e9ee66493 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:49:54.488390  7479 raft_consensus.cc:740] T 22ad3bca8c6b4fa982bb8611615a69dd P 155fc36248c04168afbd796e9ee66493 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 155fc36248c04168afbd796e9ee66493, State: Initialized, Role: FOLLOWER
I20260709 14:49:54.490032  7485 raft_consensus.cc:493] T e93fd08a04f04602bb98df0aca9a314e P fdf485ed0db84f74868a2c265c56d1d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:49:54.490701  7485 raft_consensus.cc:515] T e93fd08a04f04602bb98df0aca9a314e P fdf485ed0db84f74868a2c265c56d1d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
I20260709 14:49:54.493352  7485 leader_election.cc:290] T e93fd08a04f04602bb98df0aca9a314e P fdf485ed0db84f74868a2c265c56d1d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 155fc36248c04168afbd796e9ee66493 (127.6.101.65:43743), 68f78fc64ad74f9fa62efb081a46832d (127.6.101.67:42957)
I20260709 14:49:54.493880  7480 tablet_bootstrap.cc:654] T a60aa91e98ae4ad0afc3dd45d4b586f2 P 68f78fc64ad74f9fa62efb081a46832d: Neither blocks nor log segments found. Creating new log.
W20260709 14:49:54.494706  7327 leader_election.cc:343] T 36fe96aff6384e2d807b9f4d1bc8a544 P fdf485ed0db84f74868a2c265c56d1d4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 155fc36248c04168afbd796e9ee66493 (127.6.101.65:43743): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:49:54.495499  7327 leader_election.cc:304] T 36fe96aff6384e2d807b9f4d1bc8a544 P fdf485ed0db84f74868a2c265c56d1d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fdf485ed0db84f74868a2c265c56d1d4; no voters: 155fc36248c04168afbd796e9ee66493, 68f78fc64ad74f9fa62efb081a46832d
I20260709 14:49:54.494756  7438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93fd08a04f04602bb98df0aca9a314e" candidate_uuid: "fdf485ed0db84f74868a2c265c56d1d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68f78fc64ad74f9fa62efb081a46832d" is_pre_election: true
I20260709 14:49:54.499089  7485 raft_consensus.cc:2749] T 36fe96aff6384e2d807b9f4d1bc8a544 P fdf485ed0db84f74868a2c265c56d1d4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:49:54.498189  7288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93fd08a04f04602bb98df0aca9a314e" candidate_uuid: "fdf485ed0db84f74868a2c265c56d1d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "155fc36248c04168afbd796e9ee66493" is_pre_election: true
I20260709 14:49:54.479696  7484 leader_election.cc:290] T 36fe96aff6384e2d807b9f4d1bc8a544 P 68f78fc64ad74f9fa62efb081a46832d [CANDIDATE]: Term 1 election: Requested vote from peers fdf485ed0db84f74868a2c265c56d1d4 (127.6.101.66:35791), 155fc36248c04168afbd796e9ee66493 (127.6.101.65:43743)
W20260709 14:49:54.500198  7328 leader_election.cc:343] T e93fd08a04f04602bb98df0aca9a314e P fdf485ed0db84f74868a2c265c56d1d4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 68f78fc64ad74f9fa62efb081a46832d (127.6.101.67:42957): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:49:54.500761  7504 raft_consensus.cc:697] T 36fe96aff6384e2d807b9f4d1bc8a544 P 68f78fc64ad74f9fa62efb081a46832d [term 1 LEADER]: Becoming Leader. State: Replica: 68f78fc64ad74f9fa62efb081a46832d, State: Running, Role: LEADER
W20260709 14:49:54.501720  7327 leader_election.cc:343] T e93fd08a04f04602bb98df0aca9a314e P fdf485ed0db84f74868a2c265c56d1d4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 155fc36248c04168afbd796e9ee66493 (127.6.101.65:43743): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:49:54.502242  7327 leader_election.cc:304] T e93fd08a04f04602bb98df0aca9a314e P fdf485ed0db84f74868a2c265c56d1d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fdf485ed0db84f74868a2c265c56d1d4; no voters: 155fc36248c04168afbd796e9ee66493, 68f78fc64ad74f9fa62efb081a46832d
I20260709 14:49:54.502422  7504 consensus_queue.cc:237] T 36fe96aff6384e2d807b9f4d1bc8a544 P 68f78fc64ad74f9fa62efb081a46832d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } }
I20260709 14:49:54.503327  7485 raft_consensus.cc:2749] T e93fd08a04f04602bb98df0aca9a314e P fdf485ed0db84f74868a2c265c56d1d4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:49:54.489470  7479 consensus_queue.cc:260] T 22ad3bca8c6b4fa982bb8611615a69dd P 155fc36248c04168afbd796e9ee66493 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
I20260709 14:49:54.505530  7484 raft_consensus.cc:2749] T 79853f64be7f4e5ebb08a711d87bcede P 68f78fc64ad74f9fa62efb081a46832d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:49:54.507452  7479 ts_tablet_manager.cc:1434] T 22ad3bca8c6b4fa982bb8611615a69dd P 155fc36248c04168afbd796e9ee66493: Time spent starting tablet: real 0.043s	user 0.003s	sys 0.007s
I20260709 14:49:54.511436  7478 tablet_bootstrap.cc:492] T 1d10779bfab7437babc4a1e815792595 P fdf485ed0db84f74868a2c265c56d1d4: No bootstrap required, opened a new log
I20260709 14:49:54.511466  7480 tablet_bootstrap.cc:492] T a60aa91e98ae4ad0afc3dd45d4b586f2 P 68f78fc64ad74f9fa62efb081a46832d: No bootstrap required, opened a new log
I20260709 14:49:54.512071  7478 ts_tablet_manager.cc:1403] T 1d10779bfab7437babc4a1e815792595 P fdf485ed0db84f74868a2c265c56d1d4: Time spent bootstrapping tablet: real 0.079s	user 0.017s	sys 0.006s
I20260709 14:49:54.512185  7480 ts_tablet_manager.cc:1403] T a60aa91e98ae4ad0afc3dd45d4b586f2 P 68f78fc64ad74f9fa62efb081a46832d: Time spent bootstrapping tablet: real 0.027s	user 0.013s	sys 0.003s
I20260709 14:49:54.515010  7478 raft_consensus.cc:359] T 1d10779bfab7437babc4a1e815792595 P fdf485ed0db84f74868a2c265c56d1d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
I20260709 14:49:54.515973  7507 raft_consensus.cc:493] T 22ad3bca8c6b4fa982bb8611615a69dd P 68f78fc64ad74f9fa62efb081a46832d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:49:54.516041  7478 raft_consensus.cc:385] T 1d10779bfab7437babc4a1e815792595 P fdf485ed0db84f74868a2c265c56d1d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:49:54.516791  7480 raft_consensus.cc:359] T a60aa91e98ae4ad0afc3dd45d4b586f2 P 68f78fc64ad74f9fa62efb081a46832d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
I20260709 14:49:54.516739  7507 raft_consensus.cc:515] T 22ad3bca8c6b4fa982bb8611615a69dd P 68f78fc64ad74f9fa62efb081a46832d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
I20260709 14:49:54.517879  7480 raft_consensus.cc:385] T a60aa91e98ae4ad0afc3dd45d4b586f2 P 68f78fc64ad74f9fa62efb081a46832d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:49:54.518296  7480 raft_consensus.cc:740] T a60aa91e98ae4ad0afc3dd45d4b586f2 P 68f78fc64ad74f9fa62efb081a46832d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68f78fc64ad74f9fa62efb081a46832d, State: Initialized, Role: FOLLOWER
I20260709 14:49:54.518060  7186 catalog_manager.cc:5697] T 36fe96aff6384e2d807b9f4d1bc8a544 P 68f78fc64ad74f9fa62efb081a46832d reported cstate change: term changed from 0 to 1, leader changed from <none> to 68f78fc64ad74f9fa62efb081a46832d (127.6.101.67). New cstate: current_term: 1 leader_uuid: "68f78fc64ad74f9fa62efb081a46832d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } health_report { overall_health: UNKNOWN } } }
I20260709 14:49:54.519369  7480 consensus_queue.cc:260] T a60aa91e98ae4ad0afc3dd45d4b586f2 P 68f78fc64ad74f9fa62efb081a46832d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
I20260709 14:49:54.521396  7288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ad3bca8c6b4fa982bb8611615a69dd" candidate_uuid: "68f78fc64ad74f9fa62efb081a46832d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "155fc36248c04168afbd796e9ee66493" is_pre_election: true
I20260709 14:49:54.522154  7288 raft_consensus.cc:2468] T 22ad3bca8c6b4fa982bb8611615a69dd P 155fc36248c04168afbd796e9ee66493 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 68f78fc64ad74f9fa62efb081a46832d in term 0.
I20260709 14:49:54.522425  7480 ts_tablet_manager.cc:1434] T a60aa91e98ae4ad0afc3dd45d4b586f2 P 68f78fc64ad74f9fa62efb081a46832d: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 14:49:54.523839  7480 tablet_bootstrap.cc:492] T cddd2927548e4e20b5cc004d23d36978 P 68f78fc64ad74f9fa62efb081a46832d: Bootstrap starting.
I20260709 14:49:54.523896  7401 leader_election.cc:304] T 22ad3bca8c6b4fa982bb8611615a69dd P 68f78fc64ad74f9fa62efb081a46832d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155fc36248c04168afbd796e9ee66493, 68f78fc64ad74f9fa62efb081a46832d; no voters: 
I20260709 14:49:54.526539  7504 raft_consensus.cc:2804] T 22ad3bca8c6b4fa982bb8611615a69dd P 68f78fc64ad74f9fa62efb081a46832d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:49:54.526744  7364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ad3bca8c6b4fa982bb8611615a69dd" candidate_uuid: "68f78fc64ad74f9fa62efb081a46832d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fdf485ed0db84f74868a2c265c56d1d4" is_pre_election: true
I20260709 14:49:54.526990  7507 leader_election.cc:290] T 22ad3bca8c6b4fa982bb8611615a69dd P 68f78fc64ad74f9fa62efb081a46832d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 155fc36248c04168afbd796e9ee66493 (127.6.101.65:43743), fdf485ed0db84f74868a2c265c56d1d4 (127.6.101.66:35791)
I20260709 14:49:54.516719  7478 raft_consensus.cc:740] T 1d10779bfab7437babc4a1e815792595 P fdf485ed0db84f74868a2c265c56d1d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fdf485ed0db84f74868a2c265c56d1d4, State: Initialized, Role: FOLLOWER
I20260709 14:49:54.528286  7478 consensus_queue.cc:260] T 1d10779bfab7437babc4a1e815792595 P fdf485ed0db84f74868a2c265c56d1d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
I20260709 14:49:54.528759  7479 tablet_bootstrap.cc:492] T e93fd08a04f04602bb98df0aca9a314e P 155fc36248c04168afbd796e9ee66493: Bootstrap starting.
I20260709 14:49:54.529094  7504 raft_consensus.cc:493] T 22ad3bca8c6b4fa982bb8611615a69dd P 68f78fc64ad74f9fa62efb081a46832d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 14:49:54.528774  7402 leader_election.cc:343] T 22ad3bca8c6b4fa982bb8611615a69dd P 68f78fc64ad74f9fa62efb081a46832d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fdf485ed0db84f74868a2c265c56d1d4 (127.6.101.66:35791): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:49:54.529699  7504 raft_consensus.cc:3060] T 22ad3bca8c6b4fa982bb8611615a69dd P 68f78fc64ad74f9fa62efb081a46832d [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:49:54.532393  7480 tablet_bootstrap.cc:654] T cddd2927548e4e20b5cc004d23d36978 P 68f78fc64ad74f9fa62efb081a46832d: Neither blocks nor log segments found. Creating new log.
I20260709 14:49:54.536659  7479 tablet_bootstrap.cc:654] T e93fd08a04f04602bb98df0aca9a314e P 155fc36248c04168afbd796e9ee66493: Neither blocks nor log segments found. Creating new log.
I20260709 14:49:54.537114  7507 raft_consensus.cc:493] T a60aa91e98ae4ad0afc3dd45d4b586f2 P 68f78fc64ad74f9fa62efb081a46832d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:49:54.537817  7507 raft_consensus.cc:515] T a60aa91e98ae4ad0afc3dd45d4b586f2 P 68f78fc64ad74f9fa62efb081a46832d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
I20260709 14:49:54.541815  7288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60aa91e98ae4ad0afc3dd45d4b586f2" candidate_uuid: "68f78fc64ad74f9fa62efb081a46832d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "155fc36248c04168afbd796e9ee66493" is_pre_election: true
I20260709 14:49:54.541986  7504 raft_consensus.cc:515] T 22ad3bca8c6b4fa982bb8611615a69dd P 68f78fc64ad74f9fa62efb081a46832d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
I20260709 14:49:54.543604  7485 raft_consensus.cc:493] T a60aa91e98ae4ad0afc3dd45d4b586f2 P fdf485ed0db84f74868a2c265c56d1d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:49:54.544283  7485 raft_consensus.cc:515] T a60aa91e98ae4ad0afc3dd45d4b586f2 P fdf485ed0db84f74868a2c265c56d1d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
W20260709 14:49:54.548210  7401 leader_election.cc:343] T a60aa91e98ae4ad0afc3dd45d4b586f2 P 68f78fc64ad74f9fa62efb081a46832d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 155fc36248c04168afbd796e9ee66493 (127.6.101.65:43743): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:49:54.548862  7289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ad3bca8c6b4fa982bb8611615a69dd" candidate_uuid: "68f78fc64ad74f9fa62efb081a46832d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "155fc36248c04168afbd796e9ee66493"
I20260709 14:49:54.549993  7289 raft_consensus.cc:3060] T 22ad3bca8c6b4fa982bb8611615a69dd P 155fc36248c04168afbd796e9ee66493 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:49:54.551111  7479 tablet_bootstrap.cc:492] T e93fd08a04f04602bb98df0aca9a314e P 155fc36248c04168afbd796e9ee66493: No bootstrap required, opened a new log
I20260709 14:49:54.551702  7479 ts_tablet_manager.cc:1403] T e93fd08a04f04602bb98df0aca9a314e P 155fc36248c04168afbd796e9ee66493: Time spent bootstrapping tablet: real 0.023s	user 0.012s	sys 0.007s
I20260709 14:49:54.551918  7478 ts_tablet_manager.cc:1434] T 1d10779bfab7437babc4a1e815792595 P fdf485ed0db84f74868a2c265c56d1d4: Time spent starting tablet: real 0.039s	user 0.009s	sys 0.001s
I20260709 14:49:54.554518  7485 leader_election.cc:290] T a60aa91e98ae4ad0afc3dd45d4b586f2 P fdf485ed0db84f74868a2c265c56d1d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 155fc36248c04168afbd796e9ee66493 (127.6.101.65:43743), 68f78fc64ad74f9fa62efb081a46832d (127.6.101.67:42957)
I20260709 14:49:54.554802  7479 raft_consensus.cc:359] T e93fd08a04f04602bb98df0aca9a314e P 155fc36248c04168afbd796e9ee66493 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
I20260709 14:49:54.555677  7479 raft_consensus.cc:385] T e93fd08a04f04602bb98df0aca9a314e P 155fc36248c04168afbd796e9ee66493 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:49:54.555987  7479 raft_consensus.cc:740] T e93fd08a04f04602bb98df0aca9a314e P 155fc36248c04168afbd796e9ee66493 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 155fc36248c04168afbd796e9ee66493, State: Initialized, Role: FOLLOWER
I20260709 14:49:54.556856  7479 consensus_queue.cc:260] T e93fd08a04f04602bb98df0aca9a314e P 155fc36248c04168afbd796e9ee66493 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
I20260709 14:49:54.559862  7479 ts_tablet_manager.cc:1434] T e93fd08a04f04602bb98df0aca9a314e P 155fc36248c04168afbd796e9ee66493: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 14:49:54.559741  7438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60aa91e98ae4ad0afc3dd45d4b586f2" candidate_uuid: "fdf485ed0db84f74868a2c265c56d1d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68f78fc64ad74f9fa62efb081a46832d" is_pre_election: true
I20260709 14:49:54.560479  7438 raft_consensus.cc:2468] T a60aa91e98ae4ad0afc3dd45d4b586f2 P 68f78fc64ad74f9fa62efb081a46832d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fdf485ed0db84f74868a2c265c56d1d4 in term 0.
I20260709 14:49:54.561519  7288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60aa91e98ae4ad0afc3dd45d4b586f2" candidate_uuid: "fdf485ed0db84f74868a2c265c56d1d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "155fc36248c04168afbd796e9ee66493" is_pre_election: true
I20260709 14:49:54.561610  7328 leader_election.cc:304] T a60aa91e98ae4ad0afc3dd45d4b586f2 P fdf485ed0db84f74868a2c265c56d1d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68f78fc64ad74f9fa62efb081a46832d, fdf485ed0db84f74868a2c265c56d1d4; no voters: 
W20260709 14:49:54.565559  7327 leader_election.cc:343] T a60aa91e98ae4ad0afc3dd45d4b586f2 P fdf485ed0db84f74868a2c265c56d1d4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 155fc36248c04168afbd796e9ee66493 (127.6.101.65:43743): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:49:54.569079  7478 tablet_bootstrap.cc:492] T 4f6ef4ab0acb497681217b9e670bd2c2 P fdf485ed0db84f74868a2c265c56d1d4: Bootstrap starting.
I20260709 14:49:54.569980  7485 raft_consensus.cc:2804] T a60aa91e98ae4ad0afc3dd45d4b586f2 P fdf485ed0db84f74868a2c265c56d1d4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:49:54.570611  7485 raft_consensus.cc:493] T a60aa91e98ae4ad0afc3dd45d4b586f2 P fdf485ed0db84f74868a2c265c56d1d4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:49:54.571030  7485 raft_consensus.cc:3060] T a60aa91e98ae4ad0afc3dd45d4b586f2 P fdf485ed0db84f74868a2c265c56d1d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:49:54.576639  7364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ad3bca8c6b4fa982bb8611615a69dd" candidate_uuid: "68f78fc64ad74f9fa62efb081a46832d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fdf485ed0db84f74868a2c265c56d1d4"
I20260709 14:49:54.577649  7478 tablet_bootstrap.cc:654] T 4f6ef4ab0acb497681217b9e670bd2c2 P fdf485ed0db84f74868a2c265c56d1d4: Neither blocks nor log segments found. Creating new log.
I20260709 14:49:54.578418  7484 raft_consensus.cc:493] T dc1712921e544aaba5d8fc45d4767c61 P 68f78fc64ad74f9fa62efb081a46832d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:49:54.578604  7402 leader_election.cc:343] T 22ad3bca8c6b4fa982bb8611615a69dd P 68f78fc64ad74f9fa62efb081a46832d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fdf485ed0db84f74868a2c265c56d1d4 (127.6.101.66:35791): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:49:54.579051  7484 raft_consensus.cc:515] T dc1712921e544aaba5d8fc45d4767c61 P 68f78fc64ad74f9fa62efb081a46832d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
I20260709 14:49:54.579392  7504 leader_election.cc:290] T 22ad3bca8c6b4fa982bb8611615a69dd P 68f78fc64ad74f9fa62efb081a46832d [CANDIDATE]: Term 1 election: Requested vote from peers 155fc36248c04168afbd796e9ee66493 (127.6.101.65:43743), fdf485ed0db84f74868a2c265c56d1d4 (127.6.101.66:35791)
I20260709 14:49:54.581477  7484 leader_election.cc:290] T dc1712921e544aaba5d8fc45d4767c61 P 68f78fc64ad74f9fa62efb081a46832d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 155fc36248c04168afbd796e9ee66493 (127.6.101.65:43743), fdf485ed0db84f74868a2c265c56d1d4 (127.6.101.66:35791)
I20260709 14:49:54.583381  7486 raft_consensus.cc:493] T e93fd08a04f04602bb98df0aca9a314e P 155fc36248c04168afbd796e9ee66493 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:49:54.584102  7486 raft_consensus.cc:515] T e93fd08a04f04602bb98df0aca9a314e P 155fc36248c04168afbd796e9ee66493 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
I20260709 14:49:54.586695  7486 leader_election.cc:290] T e93fd08a04f04602bb98df0aca9a314e P 155fc36248c04168afbd796e9ee66493 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fdf485ed0db84f74868a2c265c56d1d4 (127.6.101.66:35791), 68f78fc64ad74f9fa62efb081a46832d (127.6.101.67:42957)
I20260709 14:49:54.589717  7478 tablet_bootstrap.cc:492] T 4f6ef4ab0acb497681217b9e670bd2c2 P fdf485ed0db84f74868a2c265c56d1d4: No bootstrap required, opened a new log
I20260709 14:49:54.590368  7478 ts_tablet_manager.cc:1403] T 4f6ef4ab0acb497681217b9e670bd2c2 P fdf485ed0db84f74868a2c265c56d1d4: Time spent bootstrapping tablet: real 0.021s	user 0.007s	sys 0.012s
I20260709 14:49:54.591061  7438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93fd08a04f04602bb98df0aca9a314e" candidate_uuid: "155fc36248c04168afbd796e9ee66493" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68f78fc64ad74f9fa62efb081a46832d" is_pre_election: true
I20260709 14:49:54.593796  7478 raft_consensus.cc:359] T 4f6ef4ab0acb497681217b9e670bd2c2 P fdf485ed0db84f74868a2c265c56d1d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
I20260709 14:49:54.594625  7478 raft_consensus.cc:385] T 4f6ef4ab0acb497681217b9e670bd2c2 P fdf485ed0db84f74868a2c265c56d1d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:49:54.594935  7478 raft_consensus.cc:740] T 4f6ef4ab0acb497681217b9e670bd2c2 P fdf485ed0db84f74868a2c265c56d1d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fdf485ed0db84f74868a2c265c56d1d4, State: Initialized, Role: FOLLOWER
I20260709 14:49:54.595268  7364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1712921e544aaba5d8fc45d4767c61" candidate_uuid: "68f78fc64ad74f9fa62efb081a46832d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fdf485ed0db84f74868a2c265c56d1d4" is_pre_election: true
W20260709 14:49:54.596849  7253 leader_election.cc:343] T e93fd08a04f04602bb98df0aca9a314e P 155fc36248c04168afbd796e9ee66493 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 68f78fc64ad74f9fa62efb081a46832d (127.6.101.67:42957): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:49:54.596138  7478 consensus_queue.cc:260] T 4f6ef4ab0acb497681217b9e670bd2c2 P fdf485ed0db84f74868a2c265c56d1d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
W20260709 14:49:54.597873  7402 leader_election.cc:343] T dc1712921e544aaba5d8fc45d4767c61 P 68f78fc64ad74f9fa62efb081a46832d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fdf485ed0db84f74868a2c265c56d1d4 (127.6.101.66:35791): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:49:54.599098  7288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1712921e544aaba5d8fc45d4767c61" candidate_uuid: "68f78fc64ad74f9fa62efb081a46832d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "155fc36248c04168afbd796e9ee66493" is_pre_election: true
I20260709 14:49:54.600476  7364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93fd08a04f04602bb98df0aca9a314e" candidate_uuid: "155fc36248c04168afbd796e9ee66493" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fdf485ed0db84f74868a2c265c56d1d4" is_pre_election: true
I20260709 14:49:54.601578  7364 raft_consensus.cc:2468] T e93fd08a04f04602bb98df0aca9a314e P fdf485ed0db84f74868a2c265c56d1d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155fc36248c04168afbd796e9ee66493 in term 0.
I20260709 14:49:54.602126  7507 leader_election.cc:290] T a60aa91e98ae4ad0afc3dd45d4b586f2 P 68f78fc64ad74f9fa62efb081a46832d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 155fc36248c04168afbd796e9ee66493 (127.6.101.65:43743), fdf485ed0db84f74868a2c265c56d1d4 (127.6.101.66:35791)
I20260709 14:49:54.583940  7479 tablet_bootstrap.cc:492] T 21f5ecd80b0b421aad67b6ec53d594d2 P 155fc36248c04168afbd796e9ee66493: Bootstrap starting.
I20260709 14:49:54.604085  7363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60aa91e98ae4ad0afc3dd45d4b586f2" candidate_uuid: "68f78fc64ad74f9fa62efb081a46832d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fdf485ed0db84f74868a2c265c56d1d4" is_pre_election: true
I20260709 14:49:54.605062  7288 raft_consensus.cc:2468] T dc1712921e544aaba5d8fc45d4767c61 P 155fc36248c04168afbd796e9ee66493 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 68f78fc64ad74f9fa62efb081a46832d in term 0.
I20260709 14:49:54.606642  7401 leader_election.cc:304] T dc1712921e544aaba5d8fc45d4767c61 P 68f78fc64ad74f9fa62efb081a46832d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155fc36248c04168afbd796e9ee66493, 68f78fc64ad74f9fa62efb081a46832d; no voters: fdf485ed0db84f74868a2c265c56d1d4
I20260709 14:49:54.606675  7478 ts_tablet_manager.cc:1434] T 4f6ef4ab0acb497681217b9e670bd2c2 P fdf485ed0db84f74868a2c265c56d1d4: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 14:49:54.608737  7253 leader_election.cc:304] T e93fd08a04f04602bb98df0aca9a314e P 155fc36248c04168afbd796e9ee66493 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155fc36248c04168afbd796e9ee66493, fdf485ed0db84f74868a2c265c56d1d4; no voters: 68f78fc64ad74f9fa62efb081a46832d
I20260709 14:49:54.601212  7289 raft_consensus.cc:2468] T 22ad3bca8c6b4fa982bb8611615a69dd P 155fc36248c04168afbd796e9ee66493 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68f78fc64ad74f9fa62efb081a46832d in term 1.
I20260709 14:49:54.610697  7486 raft_consensus.cc:2804] T e93fd08a04f04602bb98df0aca9a314e P 155fc36248c04168afbd796e9ee66493 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:49:54.611048  7401 leader_election.cc:304] T 22ad3bca8c6b4fa982bb8611615a69dd P 68f78fc64ad74f9fa62efb081a46832d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155fc36248c04168afbd796e9ee66493, 68f78fc64ad74f9fa62efb081a46832d; no voters: fdf485ed0db84f74868a2c265c56d1d4
I20260709 14:49:54.611490  7486 raft_consensus.cc:493] T e93fd08a04f04602bb98df0aca9a314e P 155fc36248c04168afbd796e9ee66493 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:49:54.612447  7486 raft_consensus.cc:3060] T e93fd08a04f04602bb98df0aca9a314e P 155fc36248c04168afbd796e9ee66493 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:49:54.612632  7484 raft_consensus.cc:2804] T dc1712921e544aaba5d8fc45d4767c61 P 68f78fc64ad74f9fa62efb081a46832d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:49:54.613230  7484 raft_consensus.cc:493] T dc1712921e544aaba5d8fc45d4767c61 P 68f78fc64ad74f9fa62efb081a46832d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:49:54.613629  7484 raft_consensus.cc:3060] T dc1712921e544aaba5d8fc45d4767c61 P 68f78fc64ad74f9fa62efb081a46832d [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:49:54.615365  7507 raft_consensus.cc:2804] T 22ad3bca8c6b4fa982bb8611615a69dd P 68f78fc64ad74f9fa62efb081a46832d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:49:54.616001  7507 raft_consensus.cc:697] T 22ad3bca8c6b4fa982bb8611615a69dd P 68f78fc64ad74f9fa62efb081a46832d [term 1 LEADER]: Becoming Leader. State: Replica: 68f78fc64ad74f9fa62efb081a46832d, State: Running, Role: LEADER
I20260709 14:49:54.617446  7507 consensus_queue.cc:237] T 22ad3bca8c6b4fa982bb8611615a69dd P 68f78fc64ad74f9fa62efb081a46832d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
I20260709 14:49:54.624198  7485 raft_consensus.cc:515] T a60aa91e98ae4ad0afc3dd45d4b586f2 P fdf485ed0db84f74868a2c265c56d1d4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
I20260709 14:49:54.624780  7513 raft_consensus.cc:493] T 4f6ef4ab0acb497681217b9e670bd2c2 P fdf485ed0db84f74868a2c265c56d1d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:49:54.623330  7484 raft_consensus.cc:515] T dc1712921e544aaba5d8fc45d4767c61 P 68f78fc64ad74f9fa62efb081a46832d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
I20260709 14:49:54.625556  7513 raft_consensus.cc:515] T 4f6ef4ab0acb497681217b9e670bd2c2 P fdf485ed0db84f74868a2c265c56d1d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
I20260709 14:49:54.629398  7289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1712921e544aaba5d8fc45d4767c61" candidate_uuid: "68f78fc64ad74f9fa62efb081a46832d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "155fc36248c04168afbd796e9ee66493"
I20260709 14:49:54.629753  7513 leader_election.cc:290] T 4f6ef4ab0acb497681217b9e670bd2c2 P fdf485ed0db84f74868a2c265c56d1d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 155fc36248c04168afbd796e9ee66493 (127.6.101.65:43743), 68f78fc64ad74f9fa62efb081a46832d (127.6.101.67:42957)
I20260709 14:49:54.618105  7478 tablet_bootstrap.cc:492] T cddd2927548e4e20b5cc004d23d36978 P fdf485ed0db84f74868a2c265c56d1d4: Bootstrap starting.
I20260709 14:49:54.630107  7289 raft_consensus.cc:3060] T dc1712921e544aaba5d8fc45d4767c61 P 155fc36248c04168afbd796e9ee66493 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:49:54.631855  7288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f6ef4ab0acb497681217b9e670bd2c2" candidate_uuid: "fdf485ed0db84f74868a2c265c56d1d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "155fc36248c04168afbd796e9ee66493" is_pre_election: true
I20260709 14:49:54.632766  7288 raft_consensus.cc:2468] T 4f6ef4ab0acb497681217b9e670bd2c2 P 155fc36248c04168afbd796e9ee66493 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fdf485ed0db84f74868a2c265c56d1d4 in term 0.
I20260709 14:49:54.633586  7513 raft_consensus.cc:493] T 21f5ecd80b0b421aad67b6ec53d594d2 P fdf485ed0db84f74868a2c265c56d1d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:49:54.634342  7513 raft_consensus.cc:515] T 21f5ecd80b0b421aad67b6ec53d594d2 P fdf485ed0db84f74868a2c265c56d1d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
I20260709 14:49:54.635303  7327 leader_election.cc:304] T 4f6ef4ab0acb497681217b9e670bd2c2 P fdf485ed0db84f74868a2c265c56d1d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155fc36248c04168afbd796e9ee66493, fdf485ed0db84f74868a2c265c56d1d4; no voters: 
I20260709 14:49:54.635452  7364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1712921e544aaba5d8fc45d4767c61" candidate_uuid: "68f78fc64ad74f9fa62efb081a46832d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fdf485ed0db84f74868a2c265c56d1d4"
I20260709 14:49:54.636219  7484 leader_election.cc:290] T dc1712921e544aaba5d8fc45d4767c61 P 68f78fc64ad74f9fa62efb081a46832d [CANDIDATE]: Term 1 election: Requested vote from peers 155fc36248c04168afbd796e9ee66493 (127.6.101.65:43743), fdf485ed0db84f74868a2c265c56d1d4 (127.6.101.66:35791)
W20260709 14:49:54.637754  7402 leader_election.cc:343] T dc1712921e544aaba5d8fc45d4767c61 P 68f78fc64ad74f9fa62efb081a46832d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fdf485ed0db84f74868a2c265c56d1d4 (127.6.101.66:35791): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:49:54.638367  7288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f5ecd80b0b421aad67b6ec53d594d2" candidate_uuid: "fdf485ed0db84f74868a2c265c56d1d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "155fc36248c04168afbd796e9ee66493" is_pre_election: true
I20260709 14:49:54.638399  7513 leader_election.cc:290] T 21f5ecd80b0b421aad67b6ec53d594d2 P fdf485ed0db84f74868a2c265c56d1d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 155fc36248c04168afbd796e9ee66493 (127.6.101.65:43743), 68f78fc64ad74f9fa62efb081a46832d (127.6.101.67:42957)
I20260709 14:49:54.643217  7363 raft_consensus.cc:2393] T a60aa91e98ae4ad0afc3dd45d4b586f2 P fdf485ed0db84f74868a2c265c56d1d4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 68f78fc64ad74f9fa62efb081a46832d in current term 1: Already voted for candidate fdf485ed0db84f74868a2c265c56d1d4 in this term.
W20260709 14:49:54.644990  7327 leader_election.cc:343] T 21f5ecd80b0b421aad67b6ec53d594d2 P fdf485ed0db84f74868a2c265c56d1d4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 155fc36248c04168afbd796e9ee66493 (127.6.101.65:43743): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:49:54.644691  7438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f6ef4ab0acb497681217b9e670bd2c2" candidate_uuid: "fdf485ed0db84f74868a2c265c56d1d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68f78fc64ad74f9fa62efb081a46832d" is_pre_election: true
I20260709 14:49:54.646449  7480 tablet_bootstrap.cc:492] T cddd2927548e4e20b5cc004d23d36978 P 68f78fc64ad74f9fa62efb081a46832d: No bootstrap required, opened a new log
I20260709 14:49:54.647102  7480 ts_tablet_manager.cc:1403] T cddd2927548e4e20b5cc004d23d36978 P 68f78fc64ad74f9fa62efb081a46832d: Time spent bootstrapping tablet: real 0.124s	user 0.015s	sys 0.021s
I20260709 14:49:54.647676  7402 leader_election.cc:304] T a60aa91e98ae4ad0afc3dd45d4b586f2 P 68f78fc64ad74f9fa62efb081a46832d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 68f78fc64ad74f9fa62efb081a46832d; no voters: 155fc36248c04168afbd796e9ee66493, fdf485ed0db84f74868a2c265c56d1d4
I20260709 14:49:54.648720  7288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60aa91e98ae4ad0afc3dd45d4b586f2" candidate_uuid: "fdf485ed0db84f74868a2c265c56d1d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "155fc36248c04168afbd796e9ee66493"
W20260709 14:49:54.649508  7328 leader_election.cc:343] T 4f6ef4ab0acb497681217b9e670bd2c2 P fdf485ed0db84f74868a2c265c56d1d4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 68f78fc64ad74f9fa62efb081a46832d (127.6.101.67:42957): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:49:54.650334  7479 tablet_bootstrap.cc:654] T 21f5ecd80b0b421aad67b6ec53d594d2 P 155fc36248c04168afbd796e9ee66493: Neither blocks nor log segments found. Creating new log.
I20260709 14:49:54.650995  7484 raft_consensus.cc:3060] T a60aa91e98ae4ad0afc3dd45d4b586f2 P 68f78fc64ad74f9fa62efb081a46832d [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:49:54.650753  7480 raft_consensus.cc:359] T cddd2927548e4e20b5cc004d23d36978 P 68f78fc64ad74f9fa62efb081a46832d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
I20260709 14:49:54.651618  7438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f5ecd80b0b421aad67b6ec53d594d2" candidate_uuid: "fdf485ed0db84f74868a2c265c56d1d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68f78fc64ad74f9fa62efb081a46832d" is_pre_election: true
I20260709 14:49:54.652359  7438 raft_consensus.cc:2468] T 21f5ecd80b0b421aad67b6ec53d594d2 P 68f78fc64ad74f9fa62efb081a46832d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fdf485ed0db84f74868a2c265c56d1d4 in term 0.
I20260709 14:49:54.654441  7328 leader_election.cc:304] T 21f5ecd80b0b421aad67b6ec53d594d2 P fdf485ed0db84f74868a2c265c56d1d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 68f78fc64ad74f9fa62efb081a46832d, fdf485ed0db84f74868a2c265c56d1d4; no voters: 155fc36248c04168afbd796e9ee66493
I20260709 14:49:54.651687  7480 raft_consensus.cc:385] T cddd2927548e4e20b5cc004d23d36978 P 68f78fc64ad74f9fa62efb081a46832d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:49:54.623298  7486 raft_consensus.cc:515] T e93fd08a04f04602bb98df0aca9a314e P 155fc36248c04168afbd796e9ee66493 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
I20260709 14:49:54.658252  7480 raft_consensus.cc:740] T cddd2927548e4e20b5cc004d23d36978 P 68f78fc64ad74f9fa62efb081a46832d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68f78fc64ad74f9fa62efb081a46832d, State: Initialized, Role: FOLLOWER
I20260709 14:49:54.659240  7513 raft_consensus.cc:2804] T 4f6ef4ab0acb497681217b9e670bd2c2 P fdf485ed0db84f74868a2c265c56d1d4 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 14:49:54.659890  7327 leader_election.cc:343] T a60aa91e98ae4ad0afc3dd45d4b586f2 P fdf485ed0db84f74868a2c265c56d1d4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 155fc36248c04168afbd796e9ee66493 (127.6.101.65:43743): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:49:54.660027  7513 raft_consensus.cc:493] T 4f6ef4ab0acb497681217b9e670bd2c2 P fdf485ed0db84f74868a2c265c56d1d4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:49:54.660516  7513 raft_consensus.cc:3060] T 4f6ef4ab0acb497681217b9e670bd2c2 P fdf485ed0db84f74868a2c265c56d1d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:49:54.661114  7516 raft_consensus.cc:493] T 1d10779bfab7437babc4a1e815792595 P fdf485ed0db84f74868a2c265c56d1d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:49:54.661912  7485 leader_election.cc:290] T a60aa91e98ae4ad0afc3dd45d4b586f2 P fdf485ed0db84f74868a2c265c56d1d4 [CANDIDATE]: Term 1 election: Requested vote from peers 155fc36248c04168afbd796e9ee66493 (127.6.101.65:43743), 68f78fc64ad74f9fa62efb081a46832d (127.6.101.67:42957)
I20260709 14:49:54.659322  7480 consensus_queue.cc:260] T cddd2927548e4e20b5cc004d23d36978 P 68f78fc64ad74f9fa62efb081a46832d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
I20260709 14:49:54.662573  7516 raft_consensus.cc:515] T 1d10779bfab7437babc4a1e815792595 P fdf485ed0db84f74868a2c265c56d1d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
I20260709 14:49:54.665303  7480 ts_tablet_manager.cc:1434] T cddd2927548e4e20b5cc004d23d36978 P 68f78fc64ad74f9fa62efb081a46832d: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.001s
I20260709 14:49:54.666594  7480 tablet_bootstrap.cc:492] T e93fd08a04f04602bb98df0aca9a314e P 68f78fc64ad74f9fa62efb081a46832d: Bootstrap starting.
I20260709 14:49:54.666757  7288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d10779bfab7437babc4a1e815792595" candidate_uuid: "fdf485ed0db84f74868a2c265c56d1d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "155fc36248c04168afbd796e9ee66493" is_pre_election: true
I20260709 14:49:54.661473  7478 tablet_bootstrap.cc:654] T cddd2927548e4e20b5cc004d23d36978 P fdf485ed0db84f74868a2c265c56d1d4: Neither blocks nor log segments found. Creating new log.
I20260709 14:49:54.668303  7438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60aa91e98ae4ad0afc3dd45d4b586f2" candidate_uuid: "fdf485ed0db84f74868a2c265c56d1d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68f78fc64ad74f9fa62efb081a46832d"
W20260709 14:49:54.668542  7327 leader_election.cc:343] T 1d10779bfab7437babc4a1e815792595 P fdf485ed0db84f74868a2c265c56d1d4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 155fc36248c04168afbd796e9ee66493 (127.6.101.65:43743): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:49:54.669318  7485 raft_consensus.cc:2804] T 21f5ecd80b0b421aad67b6ec53d594d2 P fdf485ed0db84f74868a2c265c56d1d4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:49:54.669718  7485 raft_consensus.cc:493] T 21f5ecd80b0b421aad67b6ec53d594d2 P fdf485ed0db84f74868a2c265c56d1d4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:49:54.670055  7485 raft_consensus.cc:3060] T 21f5ecd80b0b421aad67b6ec53d594d2 P fdf485ed0db84f74868a2c265c56d1d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:49:54.670639  7516 leader_election.cc:290] T 1d10779bfab7437babc4a1e815792595 P fdf485ed0db84f74868a2c265c56d1d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 155fc36248c04168afbd796e9ee66493 (127.6.101.65:43743), 68f78fc64ad74f9fa62efb081a46832d (127.6.101.67:42957)
I20260709 14:49:54.667243  7289 raft_consensus.cc:2468] T dc1712921e544aaba5d8fc45d4767c61 P 155fc36248c04168afbd796e9ee66493 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68f78fc64ad74f9fa62efb081a46832d in term 1.
I20260709 14:49:54.677721  7363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93fd08a04f04602bb98df0aca9a314e" candidate_uuid: "155fc36248c04168afbd796e9ee66493" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fdf485ed0db84f74868a2c265c56d1d4"
I20260709 14:49:54.673094  7437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d10779bfab7437babc4a1e815792595" candidate_uuid: "fdf485ed0db84f74868a2c265c56d1d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68f78fc64ad74f9fa62efb081a46832d" is_pre_election: true
I20260709 14:49:54.678478  7363 raft_consensus.cc:3060] T e93fd08a04f04602bb98df0aca9a314e P fdf485ed0db84f74868a2c265c56d1d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:49:54.679498  7401 leader_election.cc:304] T dc1712921e544aaba5d8fc45d4767c61 P 68f78fc64ad74f9fa62efb081a46832d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155fc36248c04168afbd796e9ee66493, 68f78fc64ad74f9fa62efb081a46832d; no voters: fdf485ed0db84f74868a2c265c56d1d4
I20260709 14:49:54.680528  7478 tablet_bootstrap.cc:492] T cddd2927548e4e20b5cc004d23d36978 P fdf485ed0db84f74868a2c265c56d1d4: No bootstrap required, opened a new log
I20260709 14:49:54.681236  7478 ts_tablet_manager.cc:1403] T cddd2927548e4e20b5cc004d23d36978 P fdf485ed0db84f74868a2c265c56d1d4: Time spent bootstrapping tablet: real 0.063s	user 0.004s	sys 0.012s
I20260709 14:49:54.681865  7504 raft_consensus.cc:2804] T dc1712921e544aaba5d8fc45d4767c61 P 68f78fc64ad74f9fa62efb081a46832d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:49:54.682790  7504 raft_consensus.cc:697] T dc1712921e544aaba5d8fc45d4767c61 P 68f78fc64ad74f9fa62efb081a46832d [term 1 LEADER]: Becoming Leader. State: Replica: 68f78fc64ad74f9fa62efb081a46832d, State: Running, Role: LEADER
I20260709 14:49:54.683780  7504 consensus_queue.cc:237] T dc1712921e544aaba5d8fc45d4767c61 P 68f78fc64ad74f9fa62efb081a46832d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
I20260709 14:49:54.685619  7478 raft_consensus.cc:359] T cddd2927548e4e20b5cc004d23d36978 P fdf485ed0db84f74868a2c265c56d1d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
I20260709 14:49:54.686863  7478 raft_consensus.cc:385] T cddd2927548e4e20b5cc004d23d36978 P fdf485ed0db84f74868a2c265c56d1d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:49:54.687533  7478 raft_consensus.cc:740] T cddd2927548e4e20b5cc004d23d36978 P fdf485ed0db84f74868a2c265c56d1d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fdf485ed0db84f74868a2c265c56d1d4, State: Initialized, Role: FOLLOWER
I20260709 14:49:54.688870  7363 raft_consensus.cc:2468] T e93fd08a04f04602bb98df0aca9a314e P fdf485ed0db84f74868a2c265c56d1d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155fc36248c04168afbd796e9ee66493 in term 1.
I20260709 14:49:54.691107  7253 leader_election.cc:304] T e93fd08a04f04602bb98df0aca9a314e P 155fc36248c04168afbd796e9ee66493 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155fc36248c04168afbd796e9ee66493, fdf485ed0db84f74868a2c265c56d1d4; no voters: 
W20260709 14:49:54.689905  7328 leader_election.cc:343] T 1d10779bfab7437babc4a1e815792595 P fdf485ed0db84f74868a2c265c56d1d4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 68f78fc64ad74f9fa62efb081a46832d (127.6.101.67:42957): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:49:54.692229  7328 leader_election.cc:304] T 1d10779bfab7437babc4a1e815792595 P fdf485ed0db84f74868a2c265c56d1d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fdf485ed0db84f74868a2c265c56d1d4; no voters: 155fc36248c04168afbd796e9ee66493, 68f78fc64ad74f9fa62efb081a46832d
I20260709 14:49:54.676893  7484 raft_consensus.cc:2749] T a60aa91e98ae4ad0afc3dd45d4b586f2 P 68f78fc64ad74f9fa62efb081a46832d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:49:54.688763  7478 consensus_queue.cc:260] T cddd2927548e4e20b5cc004d23d36978 P fdf485ed0db84f74868a2c265c56d1d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
I20260709 14:49:54.694437  7521 raft_consensus.cc:2804] T e93fd08a04f04602bb98df0aca9a314e P 155fc36248c04168afbd796e9ee66493 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:49:54.695293  7478 ts_tablet_manager.cc:1434] T cddd2927548e4e20b5cc004d23d36978 P fdf485ed0db84f74868a2c265c56d1d4: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 14:49:54.720389  7478 tablet_bootstrap.cc:492] T 22ad3bca8c6b4fa982bb8611615a69dd P fdf485ed0db84f74868a2c265c56d1d4: Bootstrap starting.
I20260709 14:49:54.699697  7480 tablet_bootstrap.cc:654] T e93fd08a04f04602bb98df0aca9a314e P 68f78fc64ad74f9fa62efb081a46832d: Neither blocks nor log segments found. Creating new log.
I20260709 14:49:54.703130  7437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93fd08a04f04602bb98df0aca9a314e" candidate_uuid: "155fc36248c04168afbd796e9ee66493" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68f78fc64ad74f9fa62efb081a46832d"
I20260709 14:49:54.703766  7486 leader_election.cc:290] T e93fd08a04f04602bb98df0aca9a314e P 155fc36248c04168afbd796e9ee66493 [CANDIDATE]: Term 1 election: Requested vote from peers fdf485ed0db84f74868a2c265c56d1d4 (127.6.101.66:35791), 68f78fc64ad74f9fa62efb081a46832d (127.6.101.67:42957)
I20260709 14:49:54.704496  7516 raft_consensus.cc:2749] T 1d10779bfab7437babc4a1e815792595 P fdf485ed0db84f74868a2c265c56d1d4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 14:49:54.724108  7253 leader_election.cc:343] T e93fd08a04f04602bb98df0aca9a314e P 155fc36248c04168afbd796e9ee66493 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 68f78fc64ad74f9fa62efb081a46832d (127.6.101.67:42957): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:49:54.711736  7438 raft_consensus.cc:2468] T a60aa91e98ae4ad0afc3dd45d4b586f2 P 68f78fc64ad74f9fa62efb081a46832d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fdf485ed0db84f74868a2c265c56d1d4 in term 1.
I20260709 14:49:54.712535  7479 tablet_bootstrap.cc:492] T 21f5ecd80b0b421aad67b6ec53d594d2 P 155fc36248c04168afbd796e9ee66493: No bootstrap required, opened a new log
I20260709 14:49:54.726692  7479 ts_tablet_manager.cc:1403] T 21f5ecd80b0b421aad67b6ec53d594d2 P 155fc36248c04168afbd796e9ee66493: Time spent bootstrapping tablet: real 0.143s	user 0.017s	sys 0.023s
I20260709 14:49:54.728072  7328 leader_election.cc:304] T a60aa91e98ae4ad0afc3dd45d4b586f2 P fdf485ed0db84f74868a2c265c56d1d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 68f78fc64ad74f9fa62efb081a46832d, fdf485ed0db84f74868a2c265c56d1d4; no voters: 155fc36248c04168afbd796e9ee66493
I20260709 14:49:54.730162  7516 raft_consensus.cc:2804] T a60aa91e98ae4ad0afc3dd45d4b586f2 P fdf485ed0db84f74868a2c265c56d1d4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:49:54.730809  7479 raft_consensus.cc:359] T 21f5ecd80b0b421aad67b6ec53d594d2 P 155fc36248c04168afbd796e9ee66493 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
I20260709 14:49:54.731626  7479 raft_consensus.cc:385] T 21f5ecd80b0b421aad67b6ec53d594d2 P 155fc36248c04168afbd796e9ee66493 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:49:54.731953  7479 raft_consensus.cc:740] T 21f5ecd80b0b421aad67b6ec53d594d2 P 155fc36248c04168afbd796e9ee66493 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 155fc36248c04168afbd796e9ee66493, State: Initialized, Role: FOLLOWER
I20260709 14:49:54.733278  7479 consensus_queue.cc:260] T 21f5ecd80b0b421aad67b6ec53d594d2 P 155fc36248c04168afbd796e9ee66493 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
I20260709 14:49:54.733409  7485 raft_consensus.cc:515] T 21f5ecd80b0b421aad67b6ec53d594d2 P fdf485ed0db84f74868a2c265c56d1d4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
I20260709 14:49:54.718084  7513 raft_consensus.cc:515] T 4f6ef4ab0acb497681217b9e670bd2c2 P fdf485ed0db84f74868a2c265c56d1d4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
I20260709 14:49:54.737543  7480 tablet_bootstrap.cc:492] T e93fd08a04f04602bb98df0aca9a314e P 68f78fc64ad74f9fa62efb081a46832d: No bootstrap required, opened a new log
I20260709 14:49:54.738770  7289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f5ecd80b0b421aad67b6ec53d594d2" candidate_uuid: "fdf485ed0db84f74868a2c265c56d1d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "155fc36248c04168afbd796e9ee66493"
I20260709 14:49:54.739560  7289 raft_consensus.cc:3060] T 21f5ecd80b0b421aad67b6ec53d594d2 P 155fc36248c04168afbd796e9ee66493 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:49:54.740974  7438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f5ecd80b0b421aad67b6ec53d594d2" candidate_uuid: "fdf485ed0db84f74868a2c265c56d1d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68f78fc64ad74f9fa62efb081a46832d"
I20260709 14:49:54.741479  7479 ts_tablet_manager.cc:1434] T 21f5ecd80b0b421aad67b6ec53d594d2 P 155fc36248c04168afbd796e9ee66493: Time spent starting tablet: real 0.014s	user 0.009s	sys 0.000s
I20260709 14:49:54.739434  7485 leader_election.cc:290] T 21f5ecd80b0b421aad67b6ec53d594d2 P fdf485ed0db84f74868a2c265c56d1d4 [CANDIDATE]: Term 1 election: Requested vote from peers 155fc36248c04168afbd796e9ee66493 (127.6.101.65:43743), 68f78fc64ad74f9fa62efb081a46832d (127.6.101.67:42957)
I20260709 14:49:54.741848  7438 raft_consensus.cc:3060] T 21f5ecd80b0b421aad67b6ec53d594d2 P 68f78fc64ad74f9fa62efb081a46832d [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:49:54.742681  7480 ts_tablet_manager.cc:1403] T e93fd08a04f04602bb98df0aca9a314e P 68f78fc64ad74f9fa62efb081a46832d: Time spent bootstrapping tablet: real 0.076s	user 0.012s	sys 0.005s
I20260709 14:49:54.744352  7521 raft_consensus.cc:697] T e93fd08a04f04602bb98df0aca9a314e P 155fc36248c04168afbd796e9ee66493 [term 1 LEADER]: Becoming Leader. State: Replica: 155fc36248c04168afbd796e9ee66493, State: Running, Role: LEADER
I20260709 14:49:54.745733  7521 consensus_queue.cc:237] T e93fd08a04f04602bb98df0aca9a314e P 155fc36248c04168afbd796e9ee66493 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
I20260709 14:49:54.749606  7480 raft_consensus.cc:359] T e93fd08a04f04602bb98df0aca9a314e P 68f78fc64ad74f9fa62efb081a46832d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
I20260709 14:49:54.750607  7480 raft_consensus.cc:385] T e93fd08a04f04602bb98df0aca9a314e P 68f78fc64ad74f9fa62efb081a46832d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:49:54.750954  7480 raft_consensus.cc:740] T e93fd08a04f04602bb98df0aca9a314e P 68f78fc64ad74f9fa62efb081a46832d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68f78fc64ad74f9fa62efb081a46832d, State: Initialized, Role: FOLLOWER
I20260709 14:49:54.752156  7289 raft_consensus.cc:2468] T 21f5ecd80b0b421aad67b6ec53d594d2 P 155fc36248c04168afbd796e9ee66493 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fdf485ed0db84f74868a2c265c56d1d4 in term 1.
I20260709 14:49:54.752094  7480 consensus_queue.cc:260] T e93fd08a04f04602bb98df0aca9a314e P 68f78fc64ad74f9fa62efb081a46832d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
I20260709 14:49:54.753444  7516 raft_consensus.cc:697] T a60aa91e98ae4ad0afc3dd45d4b586f2 P fdf485ed0db84f74868a2c265c56d1d4 [term 1 LEADER]: Becoming Leader. State: Replica: fdf485ed0db84f74868a2c265c56d1d4, State: Running, Role: LEADER
I20260709 14:49:54.755560  7478 tablet_bootstrap.cc:654] T 22ad3bca8c6b4fa982bb8611615a69dd P fdf485ed0db84f74868a2c265c56d1d4: Neither blocks nor log segments found. Creating new log.
I20260709 14:49:54.755396  7516 consensus_queue.cc:237] T a60aa91e98ae4ad0afc3dd45d4b586f2 P fdf485ed0db84f74868a2c265c56d1d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
I20260709 14:49:54.756724  7437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f6ef4ab0acb497681217b9e670bd2c2" candidate_uuid: "fdf485ed0db84f74868a2c265c56d1d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68f78fc64ad74f9fa62efb081a46832d"
I20260709 14:49:54.754676  7513 leader_election.cc:290] T 4f6ef4ab0acb497681217b9e670bd2c2 P fdf485ed0db84f74868a2c265c56d1d4 [CANDIDATE]: Term 1 election: Requested vote from peers 155fc36248c04168afbd796e9ee66493 (127.6.101.65:43743), 68f78fc64ad74f9fa62efb081a46832d (127.6.101.67:42957)
I20260709 14:49:54.757773  7289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f6ef4ab0acb497681217b9e670bd2c2" candidate_uuid: "fdf485ed0db84f74868a2c265c56d1d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "155fc36248c04168afbd796e9ee66493"
I20260709 14:49:54.757985  7327 leader_election.cc:304] T 21f5ecd80b0b421aad67b6ec53d594d2 P fdf485ed0db84f74868a2c265c56d1d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155fc36248c04168afbd796e9ee66493, fdf485ed0db84f74868a2c265c56d1d4; no voters: 
I20260709 14:49:54.759750  7513 raft_consensus.cc:2804] T 21f5ecd80b0b421aad67b6ec53d594d2 P fdf485ed0db84f74868a2c265c56d1d4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:49:54.760425  7513 raft_consensus.cc:697] T 21f5ecd80b0b421aad67b6ec53d594d2 P fdf485ed0db84f74868a2c265c56d1d4 [term 1 LEADER]: Becoming Leader. State: Replica: fdf485ed0db84f74868a2c265c56d1d4, State: Running, Role: LEADER
I20260709 14:49:54.758427  7289 raft_consensus.cc:3060] T 4f6ef4ab0acb497681217b9e670bd2c2 P 155fc36248c04168afbd796e9ee66493 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:49:54.761461  7513 consensus_queue.cc:237] T 21f5ecd80b0b421aad67b6ec53d594d2 P fdf485ed0db84f74868a2c265c56d1d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
I20260709 14:49:54.762566  7480 ts_tablet_manager.cc:1434] T e93fd08a04f04602bb98df0aca9a314e P 68f78fc64ad74f9fa62efb081a46832d: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 14:49:54.763996  7480 tablet_bootstrap.cc:492] T 4f6ef4ab0acb497681217b9e670bd2c2 P 68f78fc64ad74f9fa62efb081a46832d: Bootstrap starting.
W20260709 14:49:54.769337  7328 leader_election.cc:343] T 4f6ef4ab0acb497681217b9e670bd2c2 P fdf485ed0db84f74868a2c265c56d1d4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 68f78fc64ad74f9fa62efb081a46832d (127.6.101.67:42957): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:49:54.771088  7479 tablet_bootstrap.cc:492] T a60aa91e98ae4ad0afc3dd45d4b586f2 P 155fc36248c04168afbd796e9ee66493: Bootstrap starting.
I20260709 14:49:54.772965  7480 tablet_bootstrap.cc:654] T 4f6ef4ab0acb497681217b9e670bd2c2 P 68f78fc64ad74f9fa62efb081a46832d: Neither blocks nor log segments found. Creating new log.
I20260709 14:49:54.776479  7289 raft_consensus.cc:2468] T 4f6ef4ab0acb497681217b9e670bd2c2 P 155fc36248c04168afbd796e9ee66493 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fdf485ed0db84f74868a2c265c56d1d4 in term 1.
I20260709 14:49:54.776022  7186 catalog_manager.cc:5697] T dc1712921e544aaba5d8fc45d4767c61 P 68f78fc64ad74f9fa62efb081a46832d reported cstate change: term changed from 0 to 1, leader changed from <none> to 68f78fc64ad74f9fa62efb081a46832d (127.6.101.67). New cstate: current_term: 1 leader_uuid: "68f78fc64ad74f9fa62efb081a46832d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } health_report { overall_health: HEALTHY } } }
I20260709 14:49:54.784214  7327 leader_election.cc:304] T 4f6ef4ab0acb497681217b9e670bd2c2 P fdf485ed0db84f74868a2c265c56d1d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155fc36248c04168afbd796e9ee66493, fdf485ed0db84f74868a2c265c56d1d4; no voters: 68f78fc64ad74f9fa62efb081a46832d
I20260709 14:49:54.787504  7513 raft_consensus.cc:2804] T 4f6ef4ab0acb497681217b9e670bd2c2 P fdf485ed0db84f74868a2c265c56d1d4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:49:54.787077  7438 raft_consensus.cc:2468] T 21f5ecd80b0b421aad67b6ec53d594d2 P 68f78fc64ad74f9fa62efb081a46832d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fdf485ed0db84f74868a2c265c56d1d4 in term 1.
I20260709 14:49:54.793974  7187 catalog_manager.cc:5697] T e93fd08a04f04602bb98df0aca9a314e P 155fc36248c04168afbd796e9ee66493 reported cstate change: term changed from 0 to 1, leader changed from <none> to 155fc36248c04168afbd796e9ee66493 (127.6.101.65). New cstate: current_term: 1 leader_uuid: "155fc36248c04168afbd796e9ee66493" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } health_report { overall_health: UNKNOWN } } }
I20260709 14:49:54.788967  7513 raft_consensus.cc:697] T 4f6ef4ab0acb497681217b9e670bd2c2 P fdf485ed0db84f74868a2c265c56d1d4 [term 1 LEADER]: Becoming Leader. State: Replica: fdf485ed0db84f74868a2c265c56d1d4, State: Running, Role: LEADER
I20260709 14:49:54.796229  7478 tablet_bootstrap.cc:492] T 22ad3bca8c6b4fa982bb8611615a69dd P fdf485ed0db84f74868a2c265c56d1d4: No bootstrap required, opened a new log
I20260709 14:49:54.795372  7479 tablet_bootstrap.cc:654] T a60aa91e98ae4ad0afc3dd45d4b586f2 P 155fc36248c04168afbd796e9ee66493: Neither blocks nor log segments found. Creating new log.
I20260709 14:49:54.794377  7186 catalog_manager.cc:5697] T 22ad3bca8c6b4fa982bb8611615a69dd P 68f78fc64ad74f9fa62efb081a46832d reported cstate change: term changed from 0 to 1, leader changed from <none> to 68f78fc64ad74f9fa62efb081a46832d (127.6.101.67). New cstate: current_term: 1 leader_uuid: "68f78fc64ad74f9fa62efb081a46832d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } health_report { overall_health: HEALTHY } } }
I20260709 14:49:54.796716  7478 ts_tablet_manager.cc:1403] T 22ad3bca8c6b4fa982bb8611615a69dd P fdf485ed0db84f74868a2c265c56d1d4: Time spent bootstrapping tablet: real 0.077s	user 0.026s	sys 0.000s
I20260709 14:49:54.796651  7513 consensus_queue.cc:237] T 4f6ef4ab0acb497681217b9e670bd2c2 P fdf485ed0db84f74868a2c265c56d1d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
I20260709 14:49:54.803184  7478 raft_consensus.cc:359] T 22ad3bca8c6b4fa982bb8611615a69dd P fdf485ed0db84f74868a2c265c56d1d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
I20260709 14:49:54.804323  7478 raft_consensus.cc:385] T 22ad3bca8c6b4fa982bb8611615a69dd P fdf485ed0db84f74868a2c265c56d1d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:49:54.804714  7478 raft_consensus.cc:740] T 22ad3bca8c6b4fa982bb8611615a69dd P fdf485ed0db84f74868a2c265c56d1d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fdf485ed0db84f74868a2c265c56d1d4, State: Initialized, Role: FOLLOWER
I20260709 14:49:54.805727  7478 consensus_queue.cc:260] T 22ad3bca8c6b4fa982bb8611615a69dd P fdf485ed0db84f74868a2c265c56d1d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
I20260709 14:49:54.808633  7478 ts_tablet_manager.cc:1434] T 22ad3bca8c6b4fa982bb8611615a69dd P fdf485ed0db84f74868a2c265c56d1d4: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 14:49:54.809918  7478 tablet_bootstrap.cc:492] T 79853f64be7f4e5ebb08a711d87bcede P fdf485ed0db84f74868a2c265c56d1d4: Bootstrap starting.
I20260709 14:49:54.814425  7516 raft_consensus.cc:493] T cddd2927548e4e20b5cc004d23d36978 P fdf485ed0db84f74868a2c265c56d1d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:49:54.815263  7516 raft_consensus.cc:515] T cddd2927548e4e20b5cc004d23d36978 P fdf485ed0db84f74868a2c265c56d1d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
I20260709 14:49:54.817611  7516 leader_election.cc:290] T cddd2927548e4e20b5cc004d23d36978 P fdf485ed0db84f74868a2c265c56d1d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 155fc36248c04168afbd796e9ee66493 (127.6.101.65:43743), 68f78fc64ad74f9fa62efb081a46832d (127.6.101.67:42957)
I20260709 14:49:54.819005  7289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cddd2927548e4e20b5cc004d23d36978" candidate_uuid: "fdf485ed0db84f74868a2c265c56d1d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "155fc36248c04168afbd796e9ee66493" is_pre_election: true
I20260709 14:49:54.819938  7438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cddd2927548e4e20b5cc004d23d36978" candidate_uuid: "fdf485ed0db84f74868a2c265c56d1d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68f78fc64ad74f9fa62efb081a46832d" is_pre_election: true
I20260709 14:49:54.820662  7438 raft_consensus.cc:2468] T cddd2927548e4e20b5cc004d23d36978 P 68f78fc64ad74f9fa62efb081a46832d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fdf485ed0db84f74868a2c265c56d1d4 in term 0.
W20260709 14:49:54.821038  7327 leader_election.cc:343] T cddd2927548e4e20b5cc004d23d36978 P fdf485ed0db84f74868a2c265c56d1d4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 155fc36248c04168afbd796e9ee66493 (127.6.101.65:43743): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:49:54.822170  7478 tablet_bootstrap.cc:654] T 79853f64be7f4e5ebb08a711d87bcede P fdf485ed0db84f74868a2c265c56d1d4: Neither blocks nor log segments found. Creating new log.
I20260709 14:49:54.825044  7480 tablet_bootstrap.cc:492] T 4f6ef4ab0acb497681217b9e670bd2c2 P 68f78fc64ad74f9fa62efb081a46832d: No bootstrap required, opened a new log
I20260709 14:49:54.824976  7479 tablet_bootstrap.cc:492] T a60aa91e98ae4ad0afc3dd45d4b586f2 P 155fc36248c04168afbd796e9ee66493: No bootstrap required, opened a new log
I20260709 14:49:54.826128  7480 ts_tablet_manager.cc:1403] T 4f6ef4ab0acb497681217b9e670bd2c2 P 68f78fc64ad74f9fa62efb081a46832d: Time spent bootstrapping tablet: real 0.062s	user 0.018s	sys 0.002s
I20260709 14:49:54.826704  7479 ts_tablet_manager.cc:1403] T a60aa91e98ae4ad0afc3dd45d4b586f2 P 155fc36248c04168afbd796e9ee66493: Time spent bootstrapping tablet: real 0.056s	user 0.021s	sys 0.000s
I20260709 14:49:54.828363  7328 leader_election.cc:304] T cddd2927548e4e20b5cc004d23d36978 P fdf485ed0db84f74868a2c265c56d1d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 68f78fc64ad74f9fa62efb081a46832d, fdf485ed0db84f74868a2c265c56d1d4; no voters: 155fc36248c04168afbd796e9ee66493
I20260709 14:49:54.832386  7479 raft_consensus.cc:359] T a60aa91e98ae4ad0afc3dd45d4b586f2 P 155fc36248c04168afbd796e9ee66493 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
I20260709 14:49:54.832870  7480 raft_consensus.cc:359] T 4f6ef4ab0acb497681217b9e670bd2c2 P 68f78fc64ad74f9fa62efb081a46832d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
I20260709 14:49:54.833420  7479 raft_consensus.cc:385] T a60aa91e98ae4ad0afc3dd45d4b586f2 P 155fc36248c04168afbd796e9ee66493 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:49:54.833845  7480 raft_consensus.cc:385] T 4f6ef4ab0acb497681217b9e670bd2c2 P 68f78fc64ad74f9fa62efb081a46832d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:49:54.834101  7479 raft_consensus.cc:740] T a60aa91e98ae4ad0afc3dd45d4b586f2 P 155fc36248c04168afbd796e9ee66493 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 155fc36248c04168afbd796e9ee66493, State: Initialized, Role: FOLLOWER
I20260709 14:49:54.834379  7480 raft_consensus.cc:740] T 4f6ef4ab0acb497681217b9e670bd2c2 P 68f78fc64ad74f9fa62efb081a46832d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68f78fc64ad74f9fa62efb081a46832d, State: Initialized, Role: FOLLOWER
I20260709 14:49:54.835551  7480 consensus_queue.cc:260] T 4f6ef4ab0acb497681217b9e670bd2c2 P 68f78fc64ad74f9fa62efb081a46832d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
I20260709 14:49:54.825359  7183 catalog_manager.cc:5697] T a60aa91e98ae4ad0afc3dd45d4b586f2 P fdf485ed0db84f74868a2c265c56d1d4 reported cstate change: term changed from 0 to 1, leader changed from <none> to fdf485ed0db84f74868a2c265c56d1d4 (127.6.101.66). New cstate: current_term: 1 leader_uuid: "fdf485ed0db84f74868a2c265c56d1d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } health_report { overall_health: UNKNOWN } } }
I20260709 14:49:54.835461  7479 consensus_queue.cc:260] T a60aa91e98ae4ad0afc3dd45d4b586f2 P 155fc36248c04168afbd796e9ee66493 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
I20260709 14:49:54.838321  7478 tablet_bootstrap.cc:492] T 79853f64be7f4e5ebb08a711d87bcede P fdf485ed0db84f74868a2c265c56d1d4: No bootstrap required, opened a new log
I20260709 14:49:54.838900  7480 ts_tablet_manager.cc:1434] T 4f6ef4ab0acb497681217b9e670bd2c2 P 68f78fc64ad74f9fa62efb081a46832d: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.001s
I20260709 14:49:54.839082  7478 ts_tablet_manager.cc:1403] T 79853f64be7f4e5ebb08a711d87bcede P fdf485ed0db84f74868a2c265c56d1d4: Time spent bootstrapping tablet: real 0.029s	user 0.012s	sys 0.008s
I20260709 14:49:54.839272  7479 ts_tablet_manager.cc:1434] T a60aa91e98ae4ad0afc3dd45d4b586f2 P 155fc36248c04168afbd796e9ee66493: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.002s
I20260709 14:49:54.840104  7480 tablet_bootstrap.cc:492] T 1d10779bfab7437babc4a1e815792595 P 68f78fc64ad74f9fa62efb081a46832d: Bootstrap starting.
I20260709 14:49:54.840767  7479 tablet_bootstrap.cc:492] T cddd2927548e4e20b5cc004d23d36978 P 155fc36248c04168afbd796e9ee66493: Bootstrap starting.
I20260709 14:49:54.841573  7513 raft_consensus.cc:493] T 22ad3bca8c6b4fa982bb8611615a69dd P fdf485ed0db84f74868a2c265c56d1d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:49:54.842105  7513 raft_consensus.cc:515] T 22ad3bca8c6b4fa982bb8611615a69dd P fdf485ed0db84f74868a2c265c56d1d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
I20260709 14:49:54.842885  7478 raft_consensus.cc:359] T 79853f64be7f4e5ebb08a711d87bcede P fdf485ed0db84f74868a2c265c56d1d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
I20260709 14:49:54.843755  7478 raft_consensus.cc:385] T 79853f64be7f4e5ebb08a711d87bcede P fdf485ed0db84f74868a2c265c56d1d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:49:54.844112  7478 raft_consensus.cc:740] T 79853f64be7f4e5ebb08a711d87bcede P fdf485ed0db84f74868a2c265c56d1d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fdf485ed0db84f74868a2c265c56d1d4, State: Initialized, Role: FOLLOWER
I20260709 14:49:54.844388  7513 leader_election.cc:290] T 22ad3bca8c6b4fa982bb8611615a69dd P fdf485ed0db84f74868a2c265c56d1d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 155fc36248c04168afbd796e9ee66493 (127.6.101.65:43743), 68f78fc64ad74f9fa62efb081a46832d (127.6.101.67:42957)
I20260709 14:49:54.845078  7478 consensus_queue.cc:260] T 79853f64be7f4e5ebb08a711d87bcede P fdf485ed0db84f74868a2c265c56d1d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
I20260709 14:49:54.845750  7289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ad3bca8c6b4fa982bb8611615a69dd" candidate_uuid: "fdf485ed0db84f74868a2c265c56d1d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "155fc36248c04168afbd796e9ee66493" is_pre_election: true
I20260709 14:49:54.846617  7289 raft_consensus.cc:2393] T 22ad3bca8c6b4fa982bb8611615a69dd P 155fc36248c04168afbd796e9ee66493 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fdf485ed0db84f74868a2c265c56d1d4 in current term 1: Already voted for candidate 68f78fc64ad74f9fa62efb081a46832d in this term.
I20260709 14:49:54.846769  7524 raft_consensus.cc:2804] T cddd2927548e4e20b5cc004d23d36978 P fdf485ed0db84f74868a2c265c56d1d4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:49:54.847173  7524 raft_consensus.cc:493] T cddd2927548e4e20b5cc004d23d36978 P fdf485ed0db84f74868a2c265c56d1d4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:49:54.847507  7524 raft_consensus.cc:3060] T cddd2927548e4e20b5cc004d23d36978 P fdf485ed0db84f74868a2c265c56d1d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:49:54.847766  7480 tablet_bootstrap.cc:654] T 1d10779bfab7437babc4a1e815792595 P 68f78fc64ad74f9fa62efb081a46832d: Neither blocks nor log segments found. Creating new log.
I20260709 14:49:54.848225  7438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ad3bca8c6b4fa982bb8611615a69dd" candidate_uuid: "fdf485ed0db84f74868a2c265c56d1d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68f78fc64ad74f9fa62efb081a46832d" is_pre_election: true
I20260709 14:49:54.853482  7479 tablet_bootstrap.cc:654] T cddd2927548e4e20b5cc004d23d36978 P 155fc36248c04168afbd796e9ee66493: Neither blocks nor log segments found. Creating new log.
I20260709 14:49:54.855116  7328 leader_election.cc:304] T 22ad3bca8c6b4fa982bb8611615a69dd P fdf485ed0db84f74868a2c265c56d1d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fdf485ed0db84f74868a2c265c56d1d4; no voters: 155fc36248c04168afbd796e9ee66493, 68f78fc64ad74f9fa62efb081a46832d
I20260709 14:49:54.856519  7516 raft_consensus.cc:3060] T 22ad3bca8c6b4fa982bb8611615a69dd P fdf485ed0db84f74868a2c265c56d1d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:49:54.858558  7524 raft_consensus.cc:515] T cddd2927548e4e20b5cc004d23d36978 P fdf485ed0db84f74868a2c265c56d1d4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
I20260709 14:49:54.863364  7289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cddd2927548e4e20b5cc004d23d36978" candidate_uuid: "fdf485ed0db84f74868a2c265c56d1d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "155fc36248c04168afbd796e9ee66493"
W20260709 14:49:54.865520  7327 leader_election.cc:343] T cddd2927548e4e20b5cc004d23d36978 P fdf485ed0db84f74868a2c265c56d1d4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 155fc36248c04168afbd796e9ee66493 (127.6.101.65:43743): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:49:54.860107  7478 ts_tablet_manager.cc:1434] T 79853f64be7f4e5ebb08a711d87bcede P fdf485ed0db84f74868a2c265c56d1d4: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 14:49:54.867326  7478 tablet_bootstrap.cc:492] T dc1712921e544aaba5d8fc45d4767c61 P fdf485ed0db84f74868a2c265c56d1d4: Bootstrap starting.
I20260709 14:49:54.878783  7524 leader_election.cc:290] T cddd2927548e4e20b5cc004d23d36978 P fdf485ed0db84f74868a2c265c56d1d4 [CANDIDATE]: Term 1 election: Requested vote from peers 155fc36248c04168afbd796e9ee66493 (127.6.101.65:43743), 68f78fc64ad74f9fa62efb081a46832d (127.6.101.67:42957)
I20260709 14:49:54.876063  7478 tablet_bootstrap.cc:654] T dc1712921e544aaba5d8fc45d4767c61 P fdf485ed0db84f74868a2c265c56d1d4: Neither blocks nor log segments found. Creating new log.
I20260709 14:49:54.884431  7480 tablet_bootstrap.cc:492] T 1d10779bfab7437babc4a1e815792595 P 68f78fc64ad74f9fa62efb081a46832d: No bootstrap required, opened a new log
I20260709 14:49:54.885141  7480 ts_tablet_manager.cc:1403] T 1d10779bfab7437babc4a1e815792595 P 68f78fc64ad74f9fa62efb081a46832d: Time spent bootstrapping tablet: real 0.045s	user 0.007s	sys 0.010s
I20260709 14:49:54.884721  7479 tablet_bootstrap.cc:492] T cddd2927548e4e20b5cc004d23d36978 P 155fc36248c04168afbd796e9ee66493: No bootstrap required, opened a new log
I20260709 14:49:54.888895  7438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cddd2927548e4e20b5cc004d23d36978" candidate_uuid: "fdf485ed0db84f74868a2c265c56d1d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68f78fc64ad74f9fa62efb081a46832d"
I20260709 14:49:54.889503  7479 ts_tablet_manager.cc:1403] T cddd2927548e4e20b5cc004d23d36978 P 155fc36248c04168afbd796e9ee66493: Time spent bootstrapping tablet: real 0.049s	user 0.024s	sys 0.016s
I20260709 14:49:54.889573  7438 raft_consensus.cc:3060] T cddd2927548e4e20b5cc004d23d36978 P 68f78fc64ad74f9fa62efb081a46832d [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:49:54.890103  7480 raft_consensus.cc:359] T 1d10779bfab7437babc4a1e815792595 P 68f78fc64ad74f9fa62efb081a46832d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
I20260709 14:49:54.891278  7480 raft_consensus.cc:385] T 1d10779bfab7437babc4a1e815792595 P 68f78fc64ad74f9fa62efb081a46832d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:49:54.893839  7480 raft_consensus.cc:740] T 1d10779bfab7437babc4a1e815792595 P 68f78fc64ad74f9fa62efb081a46832d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68f78fc64ad74f9fa62efb081a46832d, State: Initialized, Role: FOLLOWER
I20260709 14:49:54.888787  7516 raft_consensus.cc:2749] T 22ad3bca8c6b4fa982bb8611615a69dd P fdf485ed0db84f74868a2c265c56d1d4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:49:54.896451  7480 consensus_queue.cc:260] T 1d10779bfab7437babc4a1e815792595 P 68f78fc64ad74f9fa62efb081a46832d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
I20260709 14:49:54.893316  7479 raft_consensus.cc:359] T cddd2927548e4e20b5cc004d23d36978 P 155fc36248c04168afbd796e9ee66493 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
I20260709 14:49:54.898362  7479 raft_consensus.cc:385] T cddd2927548e4e20b5cc004d23d36978 P 155fc36248c04168afbd796e9ee66493 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:49:54.898751  7479 raft_consensus.cc:740] T cddd2927548e4e20b5cc004d23d36978 P 155fc36248c04168afbd796e9ee66493 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 155fc36248c04168afbd796e9ee66493, State: Initialized, Role: FOLLOWER
I20260709 14:49:54.899487  7478 tablet_bootstrap.cc:492] T dc1712921e544aaba5d8fc45d4767c61 P fdf485ed0db84f74868a2c265c56d1d4: No bootstrap required, opened a new log
I20260709 14:49:54.900068  7478 ts_tablet_manager.cc:1403] T dc1712921e544aaba5d8fc45d4767c61 P fdf485ed0db84f74868a2c265c56d1d4: Time spent bootstrapping tablet: real 0.033s	user 0.017s	sys 0.006s
I20260709 14:49:54.899724  7479 consensus_queue.cc:260] T cddd2927548e4e20b5cc004d23d36978 P 155fc36248c04168afbd796e9ee66493 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
I20260709 14:49:54.903012  7480 ts_tablet_manager.cc:1434] T 1d10779bfab7437babc4a1e815792595 P 68f78fc64ad74f9fa62efb081a46832d: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 14:49:54.903733  7479 ts_tablet_manager.cc:1434] T cddd2927548e4e20b5cc004d23d36978 P 155fc36248c04168afbd796e9ee66493: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.001s
I20260709 14:49:54.903250  7478 raft_consensus.cc:359] T dc1712921e544aaba5d8fc45d4767c61 P fdf485ed0db84f74868a2c265c56d1d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
I20260709 14:49:54.904214  7478 raft_consensus.cc:385] T dc1712921e544aaba5d8fc45d4767c61 P fdf485ed0db84f74868a2c265c56d1d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:49:54.904544  7478 raft_consensus.cc:740] T dc1712921e544aaba5d8fc45d4767c61 P fdf485ed0db84f74868a2c265c56d1d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fdf485ed0db84f74868a2c265c56d1d4, State: Initialized, Role: FOLLOWER
I20260709 14:49:54.905110  7479 tablet_bootstrap.cc:492] T 1d10779bfab7437babc4a1e815792595 P 155fc36248c04168afbd796e9ee66493: Bootstrap starting.
I20260709 14:49:54.905414  7478 consensus_queue.cc:260] T dc1712921e544aaba5d8fc45d4767c61 P fdf485ed0db84f74868a2c265c56d1d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
I20260709 14:49:54.907997  7478 ts_tablet_manager.cc:1434] T dc1712921e544aaba5d8fc45d4767c61 P fdf485ed0db84f74868a2c265c56d1d4: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.003s
I20260709 14:49:54.911154  7186 catalog_manager.cc:5697] T 21f5ecd80b0b421aad67b6ec53d594d2 P fdf485ed0db84f74868a2c265c56d1d4 reported cstate change: term changed from 0 to 1, leader changed from <none> to fdf485ed0db84f74868a2c265c56d1d4 (127.6.101.66). New cstate: current_term: 1 leader_uuid: "fdf485ed0db84f74868a2c265c56d1d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } health_report { overall_health: UNKNOWN } } }
I20260709 14:49:54.914813  7479 tablet_bootstrap.cc:654] T 1d10779bfab7437babc4a1e815792595 P 155fc36248c04168afbd796e9ee66493: Neither blocks nor log segments found. Creating new log.
I20260709 14:49:54.914129  7186 catalog_manager.cc:5697] T 4f6ef4ab0acb497681217b9e670bd2c2 P fdf485ed0db84f74868a2c265c56d1d4 reported cstate change: term changed from 0 to 1, leader changed from <none> to fdf485ed0db84f74868a2c265c56d1d4 (127.6.101.66). New cstate: current_term: 1 leader_uuid: "fdf485ed0db84f74868a2c265c56d1d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } health_report { overall_health: UNKNOWN } } }
I20260709 14:49:54.928062  7438 raft_consensus.cc:2468] T cddd2927548e4e20b5cc004d23d36978 P 68f78fc64ad74f9fa62efb081a46832d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fdf485ed0db84f74868a2c265c56d1d4 in term 1.
I20260709 14:49:54.929517  7479 tablet_bootstrap.cc:492] T 1d10779bfab7437babc4a1e815792595 P 155fc36248c04168afbd796e9ee66493: No bootstrap required, opened a new log
I20260709 14:49:54.929704  7328 leader_election.cc:304] T cddd2927548e4e20b5cc004d23d36978 P fdf485ed0db84f74868a2c265c56d1d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 68f78fc64ad74f9fa62efb081a46832d, fdf485ed0db84f74868a2c265c56d1d4; no voters: 155fc36248c04168afbd796e9ee66493
I20260709 14:49:54.930104  7479 ts_tablet_manager.cc:1403] T 1d10779bfab7437babc4a1e815792595 P 155fc36248c04168afbd796e9ee66493: Time spent bootstrapping tablet: real 0.025s	user 0.012s	sys 0.005s
I20260709 14:49:54.931171  7516 raft_consensus.cc:2804] T cddd2927548e4e20b5cc004d23d36978 P fdf485ed0db84f74868a2c265c56d1d4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:49:54.931815  7516 raft_consensus.cc:697] T cddd2927548e4e20b5cc004d23d36978 P fdf485ed0db84f74868a2c265c56d1d4 [term 1 LEADER]: Becoming Leader. State: Replica: fdf485ed0db84f74868a2c265c56d1d4, State: Running, Role: LEADER
I20260709 14:49:54.932714  7516 consensus_queue.cc:237] T cddd2927548e4e20b5cc004d23d36978 P fdf485ed0db84f74868a2c265c56d1d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
I20260709 14:49:54.933303  7479 raft_consensus.cc:359] T 1d10779bfab7437babc4a1e815792595 P 155fc36248c04168afbd796e9ee66493 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
I20260709 14:49:54.934051  7479 raft_consensus.cc:385] T 1d10779bfab7437babc4a1e815792595 P 155fc36248c04168afbd796e9ee66493 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:49:54.934347  7479 raft_consensus.cc:740] T 1d10779bfab7437babc4a1e815792595 P 155fc36248c04168afbd796e9ee66493 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 155fc36248c04168afbd796e9ee66493, State: Initialized, Role: FOLLOWER
I20260709 14:49:54.935022  7479 consensus_queue.cc:260] T 1d10779bfab7437babc4a1e815792595 P 155fc36248c04168afbd796e9ee66493 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
I20260709 14:49:54.938186  7479 ts_tablet_manager.cc:1434] T 1d10779bfab7437babc4a1e815792595 P 155fc36248c04168afbd796e9ee66493: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 14:49:54.939476  7479 tablet_bootstrap.cc:492] T 36fe96aff6384e2d807b9f4d1bc8a544 P 155fc36248c04168afbd796e9ee66493: Bootstrap starting.
I20260709 14:49:54.946884  7479 tablet_bootstrap.cc:654] T 36fe96aff6384e2d807b9f4d1bc8a544 P 155fc36248c04168afbd796e9ee66493: Neither blocks nor log segments found. Creating new log.
I20260709 14:49:54.952752  7186 catalog_manager.cc:5697] T cddd2927548e4e20b5cc004d23d36978 P fdf485ed0db84f74868a2c265c56d1d4 reported cstate change: term changed from 0 to 1, leader changed from <none> to fdf485ed0db84f74868a2c265c56d1d4 (127.6.101.66). New cstate: current_term: 1 leader_uuid: "fdf485ed0db84f74868a2c265c56d1d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } health_report { overall_health: UNKNOWN } } }
I20260709 14:49:54.953884  7479 tablet_bootstrap.cc:492] T 36fe96aff6384e2d807b9f4d1bc8a544 P 155fc36248c04168afbd796e9ee66493: No bootstrap required, opened a new log
I20260709 14:49:54.954938  7479 ts_tablet_manager.cc:1403] T 36fe96aff6384e2d807b9f4d1bc8a544 P 155fc36248c04168afbd796e9ee66493: Time spent bootstrapping tablet: real 0.016s	user 0.011s	sys 0.004s
I20260709 14:49:54.959268  7479 raft_consensus.cc:359] T 36fe96aff6384e2d807b9f4d1bc8a544 P 155fc36248c04168afbd796e9ee66493 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } }
I20260709 14:49:54.960085  7479 raft_consensus.cc:385] T 36fe96aff6384e2d807b9f4d1bc8a544 P 155fc36248c04168afbd796e9ee66493 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:49:54.960356  7479 raft_consensus.cc:740] T 36fe96aff6384e2d807b9f4d1bc8a544 P 155fc36248c04168afbd796e9ee66493 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 155fc36248c04168afbd796e9ee66493, State: Initialized, Role: FOLLOWER
I20260709 14:49:54.961148  7479 consensus_queue.cc:260] T 36fe96aff6384e2d807b9f4d1bc8a544 P 155fc36248c04168afbd796e9ee66493 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } }
I20260709 14:49:54.964063  7479 ts_tablet_manager.cc:1434] T 36fe96aff6384e2d807b9f4d1bc8a544 P 155fc36248c04168afbd796e9ee66493: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 14:49:54.965408  7479 tablet_bootstrap.cc:492] T 79853f64be7f4e5ebb08a711d87bcede P 155fc36248c04168afbd796e9ee66493: Bootstrap starting.
I20260709 14:49:54.971472  7504 raft_consensus.cc:493] T 1d10779bfab7437babc4a1e815792595 P 68f78fc64ad74f9fa62efb081a46832d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:49:54.972074  7479 tablet_bootstrap.cc:654] T 79853f64be7f4e5ebb08a711d87bcede P 155fc36248c04168afbd796e9ee66493: Neither blocks nor log segments found. Creating new log.
I20260709 14:49:54.972344  7504 raft_consensus.cc:515] T 1d10779bfab7437babc4a1e815792595 P 68f78fc64ad74f9fa62efb081a46832d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
I20260709 14:49:54.974640  7516 raft_consensus.cc:493] T dc1712921e544aaba5d8fc45d4767c61 P fdf485ed0db84f74868a2c265c56d1d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:49:54.975279  7516 raft_consensus.cc:515] T dc1712921e544aaba5d8fc45d4767c61 P fdf485ed0db84f74868a2c265c56d1d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
I20260709 14:49:54.976195  7289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d10779bfab7437babc4a1e815792595" candidate_uuid: "68f78fc64ad74f9fa62efb081a46832d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "155fc36248c04168afbd796e9ee66493" is_pre_election: true
I20260709 14:49:54.977026  7289 raft_consensus.cc:2468] T 1d10779bfab7437babc4a1e815792595 P 155fc36248c04168afbd796e9ee66493 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 68f78fc64ad74f9fa62efb081a46832d in term 0.
I20260709 14:49:54.979434  7438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1712921e544aaba5d8fc45d4767c61" candidate_uuid: "fdf485ed0db84f74868a2c265c56d1d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68f78fc64ad74f9fa62efb081a46832d" is_pre_election: true
I20260709 14:49:54.980450  7516 leader_election.cc:290] T dc1712921e544aaba5d8fc45d4767c61 P fdf485ed0db84f74868a2c265c56d1d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 155fc36248c04168afbd796e9ee66493 (127.6.101.65:43743), 68f78fc64ad74f9fa62efb081a46832d (127.6.101.67:42957)
I20260709 14:49:54.980697  7504 leader_election.cc:290] T 1d10779bfab7437babc4a1e815792595 P 68f78fc64ad74f9fa62efb081a46832d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 155fc36248c04168afbd796e9ee66493 (127.6.101.65:43743), fdf485ed0db84f74868a2c265c56d1d4 (127.6.101.66:35791)
I20260709 14:49:54.981769  7401 leader_election.cc:304] T 1d10779bfab7437babc4a1e815792595 P 68f78fc64ad74f9fa62efb081a46832d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155fc36248c04168afbd796e9ee66493, 68f78fc64ad74f9fa62efb081a46832d; no voters: 
I20260709 14:49:54.982975  7289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1712921e544aaba5d8fc45d4767c61" candidate_uuid: "fdf485ed0db84f74868a2c265c56d1d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "155fc36248c04168afbd796e9ee66493" is_pre_election: true
I20260709 14:49:54.983407  7363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d10779bfab7437babc4a1e815792595" candidate_uuid: "68f78fc64ad74f9fa62efb081a46832d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fdf485ed0db84f74868a2c265c56d1d4" is_pre_election: true
I20260709 14:49:54.984263  7363 raft_consensus.cc:2468] T 1d10779bfab7437babc4a1e815792595 P fdf485ed0db84f74868a2c265c56d1d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 68f78fc64ad74f9fa62efb081a46832d in term 0.
I20260709 14:49:54.984437  7507 raft_consensus.cc:2804] T 1d10779bfab7437babc4a1e815792595 P 68f78fc64ad74f9fa62efb081a46832d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:49:54.985785  7507 raft_consensus.cc:493] T 1d10779bfab7437babc4a1e815792595 P 68f78fc64ad74f9fa62efb081a46832d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:49:54.986459  7507 raft_consensus.cc:3060] T 1d10779bfab7437babc4a1e815792595 P 68f78fc64ad74f9fa62efb081a46832d [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:49:54.984355  7289 raft_consensus.cc:2393] T dc1712921e544aaba5d8fc45d4767c61 P 155fc36248c04168afbd796e9ee66493 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fdf485ed0db84f74868a2c265c56d1d4 in current term 1: Already voted for candidate 68f78fc64ad74f9fa62efb081a46832d in this term.
I20260709 14:49:54.988343  7327 leader_election.cc:304] T dc1712921e544aaba5d8fc45d4767c61 P fdf485ed0db84f74868a2c265c56d1d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fdf485ed0db84f74868a2c265c56d1d4; no voters: 155fc36248c04168afbd796e9ee66493, 68f78fc64ad74f9fa62efb081a46832d
I20260709 14:49:54.989336  7479 tablet_bootstrap.cc:492] T 79853f64be7f4e5ebb08a711d87bcede P 155fc36248c04168afbd796e9ee66493: No bootstrap required, opened a new log
I20260709 14:49:54.989745  7516 raft_consensus.cc:3060] T dc1712921e544aaba5d8fc45d4767c61 P fdf485ed0db84f74868a2c265c56d1d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:49:54.989591  7504 consensus_queue.cc:1048] T 36fe96aff6384e2d807b9f4d1bc8a544 P 68f78fc64ad74f9fa62efb081a46832d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:49:54.990015  7479 ts_tablet_manager.cc:1403] T 79853f64be7f4e5ebb08a711d87bcede P 155fc36248c04168afbd796e9ee66493: Time spent bootstrapping tablet: real 0.025s	user 0.020s	sys 0.002s
I20260709 14:49:54.993830  7479 raft_consensus.cc:359] T 79853f64be7f4e5ebb08a711d87bcede P 155fc36248c04168afbd796e9ee66493 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
I20260709 14:49:54.994781  7479 raft_consensus.cc:385] T 79853f64be7f4e5ebb08a711d87bcede P 155fc36248c04168afbd796e9ee66493 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:49:54.995136  7479 raft_consensus.cc:740] T 79853f64be7f4e5ebb08a711d87bcede P 155fc36248c04168afbd796e9ee66493 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 155fc36248c04168afbd796e9ee66493, State: Initialized, Role: FOLLOWER
I20260709 14:49:54.995060  7507 raft_consensus.cc:515] T 1d10779bfab7437babc4a1e815792595 P 68f78fc64ad74f9fa62efb081a46832d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
I20260709 14:49:54.996291  7479 consensus_queue.cc:260] T 79853f64be7f4e5ebb08a711d87bcede P 155fc36248c04168afbd796e9ee66493 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
I20260709 14:49:54.998507  7479 ts_tablet_manager.cc:1434] T 79853f64be7f4e5ebb08a711d87bcede P 155fc36248c04168afbd796e9ee66493: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 14:49:54.998878  7516 raft_consensus.cc:2749] T dc1712921e544aaba5d8fc45d4767c61 P fdf485ed0db84f74868a2c265c56d1d4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:49:54.999182  7507 leader_election.cc:290] T 1d10779bfab7437babc4a1e815792595 P 68f78fc64ad74f9fa62efb081a46832d [CANDIDATE]: Term 1 election: Requested vote from peers 155fc36248c04168afbd796e9ee66493 (127.6.101.65:43743), fdf485ed0db84f74868a2c265c56d1d4 (127.6.101.66:35791)
I20260709 14:49:55.001428  7364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d10779bfab7437babc4a1e815792595" candidate_uuid: "68f78fc64ad74f9fa62efb081a46832d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fdf485ed0db84f74868a2c265c56d1d4"
I20260709 14:49:55.002157  7364 raft_consensus.cc:3060] T 1d10779bfab7437babc4a1e815792595 P fdf485ed0db84f74868a2c265c56d1d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:49:55.002409  7289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d10779bfab7437babc4a1e815792595" candidate_uuid: "68f78fc64ad74f9fa62efb081a46832d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "155fc36248c04168afbd796e9ee66493"
I20260709 14:49:55.003680  7289 raft_consensus.cc:3060] T 1d10779bfab7437babc4a1e815792595 P 155fc36248c04168afbd796e9ee66493 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:49:55.012715  7289 raft_consensus.cc:2468] T 1d10779bfab7437babc4a1e815792595 P 155fc36248c04168afbd796e9ee66493 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68f78fc64ad74f9fa62efb081a46832d in term 1.
I20260709 14:49:55.015300  7401 leader_election.cc:304] T 1d10779bfab7437babc4a1e815792595 P 68f78fc64ad74f9fa62efb081a46832d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155fc36248c04168afbd796e9ee66493, 68f78fc64ad74f9fa62efb081a46832d; no voters: 
I20260709 14:49:55.016497  7484 raft_consensus.cc:2804] T 1d10779bfab7437babc4a1e815792595 P 68f78fc64ad74f9fa62efb081a46832d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:49:55.017318  7484 raft_consensus.cc:697] T 1d10779bfab7437babc4a1e815792595 P 68f78fc64ad74f9fa62efb081a46832d [term 1 LEADER]: Becoming Leader. State: Replica: 68f78fc64ad74f9fa62efb081a46832d, State: Running, Role: LEADER
I20260709 14:49:55.017814  7364 raft_consensus.cc:2468] T 1d10779bfab7437babc4a1e815792595 P fdf485ed0db84f74868a2c265c56d1d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68f78fc64ad74f9fa62efb081a46832d in term 1.
I20260709 14:49:55.018782  7484 consensus_queue.cc:237] T 1d10779bfab7437babc4a1e815792595 P 68f78fc64ad74f9fa62efb081a46832d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
I20260709 14:49:55.024662  7289 raft_consensus.cc:3060] T 36fe96aff6384e2d807b9f4d1bc8a544 P 155fc36248c04168afbd796e9ee66493 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:49:55.036141  7484 consensus_queue.cc:1048] T 36fe96aff6384e2d807b9f4d1bc8a544 P 68f78fc64ad74f9fa62efb081a46832d [LEADER]: Connected to new peer: Peer: permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 14:49:55.035753  7186 catalog_manager.cc:5697] T 1d10779bfab7437babc4a1e815792595 P 68f78fc64ad74f9fa62efb081a46832d reported cstate change: term changed from 0 to 1, leader changed from <none> to 68f78fc64ad74f9fa62efb081a46832d (127.6.101.67). New cstate: current_term: 1 leader_uuid: "68f78fc64ad74f9fa62efb081a46832d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } health_report { overall_health: HEALTHY } } }
I20260709 14:49:55.070909  7521 raft_consensus.cc:493] T 79853f64be7f4e5ebb08a711d87bcede P 155fc36248c04168afbd796e9ee66493 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:49:55.071580  7521 raft_consensus.cc:515] T 79853f64be7f4e5ebb08a711d87bcede P 155fc36248c04168afbd796e9ee66493 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
I20260709 14:49:55.073952  7521 leader_election.cc:290] T 79853f64be7f4e5ebb08a711d87bcede P 155fc36248c04168afbd796e9ee66493 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fdf485ed0db84f74868a2c265c56d1d4 (127.6.101.66:35791), 68f78fc64ad74f9fa62efb081a46832d (127.6.101.67:42957)
I20260709 14:49:55.075311  7362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79853f64be7f4e5ebb08a711d87bcede" candidate_uuid: "155fc36248c04168afbd796e9ee66493" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fdf485ed0db84f74868a2c265c56d1d4" is_pre_election: true
I20260709 14:49:55.075649  7438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79853f64be7f4e5ebb08a711d87bcede" candidate_uuid: "155fc36248c04168afbd796e9ee66493" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68f78fc64ad74f9fa62efb081a46832d" is_pre_election: true
I20260709 14:49:55.076306  7438 raft_consensus.cc:2468] T 79853f64be7f4e5ebb08a711d87bcede P 68f78fc64ad74f9fa62efb081a46832d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155fc36248c04168afbd796e9ee66493 in term 0.
I20260709 14:49:55.076285  7362 raft_consensus.cc:2468] T 79853f64be7f4e5ebb08a711d87bcede P fdf485ed0db84f74868a2c265c56d1d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155fc36248c04168afbd796e9ee66493 in term 0.
I20260709 14:49:55.076725  7484 consensus_queue.cc:1048] T dc1712921e544aaba5d8fc45d4767c61 P 68f78fc64ad74f9fa62efb081a46832d [LEADER]: Connected to new peer: Peer: permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:49:55.078277  7253 leader_election.cc:304] T 79853f64be7f4e5ebb08a711d87bcede P 155fc36248c04168afbd796e9ee66493 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155fc36248c04168afbd796e9ee66493, fdf485ed0db84f74868a2c265c56d1d4; no voters: 
I20260709 14:49:55.079615  7521 raft_consensus.cc:2804] T 79853f64be7f4e5ebb08a711d87bcede P 155fc36248c04168afbd796e9ee66493 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:49:55.080056  7521 raft_consensus.cc:493] T 79853f64be7f4e5ebb08a711d87bcede P 155fc36248c04168afbd796e9ee66493 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:49:55.080483  7521 raft_consensus.cc:3060] T 79853f64be7f4e5ebb08a711d87bcede P 155fc36248c04168afbd796e9ee66493 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:49:55.092628  7507 consensus_queue.cc:1048] T dc1712921e544aaba5d8fc45d4767c61 P 68f78fc64ad74f9fa62efb081a46832d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:49:55.093089  7521 raft_consensus.cc:515] T 79853f64be7f4e5ebb08a711d87bcede P 155fc36248c04168afbd796e9ee66493 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
I20260709 14:49:55.095809  7521 leader_election.cc:290] T 79853f64be7f4e5ebb08a711d87bcede P 155fc36248c04168afbd796e9ee66493 [CANDIDATE]: Term 1 election: Requested vote from peers fdf485ed0db84f74868a2c265c56d1d4 (127.6.101.66:35791), 68f78fc64ad74f9fa62efb081a46832d (127.6.101.67:42957)
I20260709 14:49:55.099169  7364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79853f64be7f4e5ebb08a711d87bcede" candidate_uuid: "155fc36248c04168afbd796e9ee66493" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fdf485ed0db84f74868a2c265c56d1d4"
I20260709 14:49:55.100062  7364 raft_consensus.cc:3060] T 79853f64be7f4e5ebb08a711d87bcede P fdf485ed0db84f74868a2c265c56d1d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:49:55.100441  7438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79853f64be7f4e5ebb08a711d87bcede" candidate_uuid: "155fc36248c04168afbd796e9ee66493" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68f78fc64ad74f9fa62efb081a46832d"
I20260709 14:49:55.100991  7438 raft_consensus.cc:3060] T 79853f64be7f4e5ebb08a711d87bcede P 68f78fc64ad74f9fa62efb081a46832d [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:49:55.109436  7438 raft_consensus.cc:2468] T 79853f64be7f4e5ebb08a711d87bcede P 68f78fc64ad74f9fa62efb081a46832d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155fc36248c04168afbd796e9ee66493 in term 1.
I20260709 14:49:55.110695  7253 leader_election.cc:304] T 79853f64be7f4e5ebb08a711d87bcede P 155fc36248c04168afbd796e9ee66493 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155fc36248c04168afbd796e9ee66493, 68f78fc64ad74f9fa62efb081a46832d; no voters: 
I20260709 14:49:55.108868  7364 raft_consensus.cc:2468] T 79853f64be7f4e5ebb08a711d87bcede P fdf485ed0db84f74868a2c265c56d1d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155fc36248c04168afbd796e9ee66493 in term 1.
I20260709 14:49:55.112378  7521 raft_consensus.cc:2804] T 79853f64be7f4e5ebb08a711d87bcede P 155fc36248c04168afbd796e9ee66493 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:49:55.112949  7521 raft_consensus.cc:697] T 79853f64be7f4e5ebb08a711d87bcede P 155fc36248c04168afbd796e9ee66493 [term 1 LEADER]: Becoming Leader. State: Replica: 155fc36248c04168afbd796e9ee66493, State: Running, Role: LEADER
I20260709 14:49:55.114162  7521 consensus_queue.cc:237] T 79853f64be7f4e5ebb08a711d87bcede P 155fc36248c04168afbd796e9ee66493 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
I20260709 14:49:55.125808  7186 catalog_manager.cc:5697] T 79853f64be7f4e5ebb08a711d87bcede P 155fc36248c04168afbd796e9ee66493 reported cstate change: term changed from 0 to 1, leader changed from <none> to 155fc36248c04168afbd796e9ee66493 (127.6.101.65). New cstate: current_term: 1 leader_uuid: "155fc36248c04168afbd796e9ee66493" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } health_report { overall_health: UNKNOWN } } }
I20260709 14:49:55.150933  7521 raft_consensus.cc:493] T cddd2927548e4e20b5cc004d23d36978 P 155fc36248c04168afbd796e9ee66493 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:49:55.151599  7521 raft_consensus.cc:515] T cddd2927548e4e20b5cc004d23d36978 P 155fc36248c04168afbd796e9ee66493 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
I20260709 14:49:55.153496  7521 leader_election.cc:290] T cddd2927548e4e20b5cc004d23d36978 P 155fc36248c04168afbd796e9ee66493 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fdf485ed0db84f74868a2c265c56d1d4 (127.6.101.66:35791), 68f78fc64ad74f9fa62efb081a46832d (127.6.101.67:42957)
I20260709 14:49:55.154237  7507 raft_consensus.cc:493] T e93fd08a04f04602bb98df0aca9a314e P 68f78fc64ad74f9fa62efb081a46832d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:49:55.154497  7364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cddd2927548e4e20b5cc004d23d36978" candidate_uuid: "155fc36248c04168afbd796e9ee66493" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fdf485ed0db84f74868a2c265c56d1d4" is_pre_election: true
I20260709 14:49:55.154960  7438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cddd2927548e4e20b5cc004d23d36978" candidate_uuid: "155fc36248c04168afbd796e9ee66493" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68f78fc64ad74f9fa62efb081a46832d" is_pre_election: true
I20260709 14:49:55.154990  7507 raft_consensus.cc:515] T e93fd08a04f04602bb98df0aca9a314e P 68f78fc64ad74f9fa62efb081a46832d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
I20260709 14:49:55.155948  7438 raft_consensus.cc:2393] T cddd2927548e4e20b5cc004d23d36978 P 68f78fc64ad74f9fa62efb081a46832d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 155fc36248c04168afbd796e9ee66493 in current term 1: Already voted for candidate fdf485ed0db84f74868a2c265c56d1d4 in this term.
I20260709 14:49:55.157302  7507 leader_election.cc:290] T e93fd08a04f04602bb98df0aca9a314e P 68f78fc64ad74f9fa62efb081a46832d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 155fc36248c04168afbd796e9ee66493 (127.6.101.65:43743), fdf485ed0db84f74868a2c265c56d1d4 (127.6.101.66:35791)
I20260709 14:49:55.157168  7253 leader_election.cc:304] T cddd2927548e4e20b5cc004d23d36978 P 155fc36248c04168afbd796e9ee66493 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155fc36248c04168afbd796e9ee66493; no voters: 68f78fc64ad74f9fa62efb081a46832d, fdf485ed0db84f74868a2c265c56d1d4
I20260709 14:49:55.158262  7289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93fd08a04f04602bb98df0aca9a314e" candidate_uuid: "68f78fc64ad74f9fa62efb081a46832d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "155fc36248c04168afbd796e9ee66493" is_pre_election: true
I20260709 14:49:55.158571  7364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93fd08a04f04602bb98df0aca9a314e" candidate_uuid: "68f78fc64ad74f9fa62efb081a46832d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fdf485ed0db84f74868a2c265c56d1d4" is_pre_election: true
I20260709 14:49:55.158245  7521 raft_consensus.cc:3060] T cddd2927548e4e20b5cc004d23d36978 P 155fc36248c04168afbd796e9ee66493 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:49:55.159503  7364 raft_consensus.cc:2393] T e93fd08a04f04602bb98df0aca9a314e P fdf485ed0db84f74868a2c265c56d1d4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 68f78fc64ad74f9fa62efb081a46832d in current term 1: Already voted for candidate 155fc36248c04168afbd796e9ee66493 in this term.
I20260709 14:49:55.160832  7402 leader_election.cc:304] T e93fd08a04f04602bb98df0aca9a314e P 68f78fc64ad74f9fa62efb081a46832d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 68f78fc64ad74f9fa62efb081a46832d; no voters: 155fc36248c04168afbd796e9ee66493, fdf485ed0db84f74868a2c265c56d1d4
I20260709 14:49:55.161723  7507 raft_consensus.cc:3060] T e93fd08a04f04602bb98df0aca9a314e P 68f78fc64ad74f9fa62efb081a46832d [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:49:55.164284  7516 consensus_queue.cc:1048] T a60aa91e98ae4ad0afc3dd45d4b586f2 P fdf485ed0db84f74868a2c265c56d1d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:49:55.169778  7521 raft_consensus.cc:2749] T cddd2927548e4e20b5cc004d23d36978 P 155fc36248c04168afbd796e9ee66493 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:49:55.172212  7507 raft_consensus.cc:2749] T e93fd08a04f04602bb98df0aca9a314e P 68f78fc64ad74f9fa62efb081a46832d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:49:55.173388  7505 consensus_queue.cc:1048] T 22ad3bca8c6b4fa982bb8611615a69dd P 68f78fc64ad74f9fa62efb081a46832d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:49:55.181142  7289 raft_consensus.cc:3060] T a60aa91e98ae4ad0afc3dd45d4b586f2 P 155fc36248c04168afbd796e9ee66493 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:49:55.194892  7524 consensus_queue.cc:1048] T a60aa91e98ae4ad0afc3dd45d4b586f2 P fdf485ed0db84f74868a2c265c56d1d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:49:55.201079  7507 consensus_queue.cc:1048] T 22ad3bca8c6b4fa982bb8611615a69dd P 68f78fc64ad74f9fa62efb081a46832d [LEADER]: Connected to new peer: Peer: permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:49:55.207115  7507 raft_consensus.cc:493] T 4f6ef4ab0acb497681217b9e670bd2c2 P 68f78fc64ad74f9fa62efb081a46832d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:49:55.207969  7507 raft_consensus.cc:515] T 4f6ef4ab0acb497681217b9e670bd2c2 P 68f78fc64ad74f9fa62efb081a46832d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
I20260709 14:49:55.211730  7521 consensus_queue.cc:1048] T e93fd08a04f04602bb98df0aca9a314e P 155fc36248c04168afbd796e9ee66493 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:49:55.212673  7287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f6ef4ab0acb497681217b9e670bd2c2" candidate_uuid: "68f78fc64ad74f9fa62efb081a46832d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "155fc36248c04168afbd796e9ee66493" is_pre_election: true
I20260709 14:49:55.213747  7287 raft_consensus.cc:2393] T 4f6ef4ab0acb497681217b9e670bd2c2 P 155fc36248c04168afbd796e9ee66493 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 68f78fc64ad74f9fa62efb081a46832d in current term 1: Already voted for candidate fdf485ed0db84f74868a2c265c56d1d4 in this term.
I20260709 14:49:55.218180  7507 leader_election.cc:290] T 4f6ef4ab0acb497681217b9e670bd2c2 P 68f78fc64ad74f9fa62efb081a46832d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 155fc36248c04168afbd796e9ee66493 (127.6.101.65:43743), fdf485ed0db84f74868a2c265c56d1d4 (127.6.101.66:35791)
I20260709 14:49:55.218839  7364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f6ef4ab0acb497681217b9e670bd2c2" candidate_uuid: "68f78fc64ad74f9fa62efb081a46832d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fdf485ed0db84f74868a2c265c56d1d4" is_pre_election: true
I20260709 14:49:55.220542  7402 leader_election.cc:304] T 4f6ef4ab0acb497681217b9e670bd2c2 P 68f78fc64ad74f9fa62efb081a46832d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 68f78fc64ad74f9fa62efb081a46832d; no voters: 155fc36248c04168afbd796e9ee66493, fdf485ed0db84f74868a2c265c56d1d4
I20260709 14:49:55.221485  7507 raft_consensus.cc:3060] T 4f6ef4ab0acb497681217b9e670bd2c2 P 68f78fc64ad74f9fa62efb081a46832d [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:49:55.232403  7486 consensus_queue.cc:1048] T e93fd08a04f04602bb98df0aca9a314e P 155fc36248c04168afbd796e9ee66493 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:49:55.232462  7507 raft_consensus.cc:2749] T 4f6ef4ab0acb497681217b9e670bd2c2 P 68f78fc64ad74f9fa62efb081a46832d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:49:55.318181  7516 consensus_queue.cc:1048] T 21f5ecd80b0b421aad67b6ec53d594d2 P fdf485ed0db84f74868a2c265c56d1d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 14:49:55.319113  7524 consensus_queue.cc:1048] T 4f6ef4ab0acb497681217b9e670bd2c2 P fdf485ed0db84f74868a2c265c56d1d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:49:55.335309  7524 consensus_queue.cc:1048] T cddd2927548e4e20b5cc004d23d36978 P fdf485ed0db84f74868a2c265c56d1d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:49:55.339531  7516 consensus_queue.cc:1048] T 21f5ecd80b0b421aad67b6ec53d594d2 P fdf485ed0db84f74868a2c265c56d1d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:49:55.365430  7513 consensus_queue.cc:1048] T 4f6ef4ab0acb497681217b9e670bd2c2 P fdf485ed0db84f74868a2c265c56d1d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:49:55.370007  7438 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "36fe96aff6384e2d807b9f4d1bc8a544"
dest_uuid: "68f78fc64ad74f9fa62efb081a46832d"
mode: GRACEFUL
new_leader_uuid: "155fc36248c04168afbd796e9ee66493"
 from {username='slave'} at 127.0.0.1:39454
I20260709 14:49:55.370832  7438 raft_consensus.cc:606] T 36fe96aff6384e2d807b9f4d1bc8a544 P 68f78fc64ad74f9fa62efb081a46832d [term 1 LEADER]: Received request to transfer leadership to TS 155fc36248c04168afbd796e9ee66493
I20260709 14:49:55.377954  7513 consensus_queue.cc:1048] T cddd2927548e4e20b5cc004d23d36978 P fdf485ed0db84f74868a2c265c56d1d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 14:49:55.420812  7504 consensus_queue.cc:1048] T 1d10779bfab7437babc4a1e815792595 P 68f78fc64ad74f9fa62efb081a46832d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 14:49:55.435055  7364 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a60aa91e98ae4ad0afc3dd45d4b586f2"
dest_uuid: "fdf485ed0db84f74868a2c265c56d1d4"
mode: GRACEFUL
new_leader_uuid: "155fc36248c04168afbd796e9ee66493"
 from {username='slave'} at 127.0.0.1:43026
I20260709 14:49:55.435693  7364 raft_consensus.cc:606] T a60aa91e98ae4ad0afc3dd45d4b586f2 P fdf485ed0db84f74868a2c265c56d1d4 [term 1 LEADER]: Received request to transfer leadership to TS 155fc36248c04168afbd796e9ee66493
I20260709 14:49:55.449954  7484 consensus_queue.cc:1048] T 1d10779bfab7437babc4a1e815792595 P 68f78fc64ad74f9fa62efb081a46832d [LEADER]: Connected to new peer: Peer: permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:49:55.451766  7362 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cddd2927548e4e20b5cc004d23d36978"
dest_uuid: "fdf485ed0db84f74868a2c265c56d1d4"
mode: GRACEFUL
new_leader_uuid: "155fc36248c04168afbd796e9ee66493"
 from {username='slave'} at 127.0.0.1:43026
I20260709 14:49:55.453485  7362 raft_consensus.cc:606] T cddd2927548e4e20b5cc004d23d36978 P fdf485ed0db84f74868a2c265c56d1d4 [term 1 LEADER]: Received request to transfer leadership to TS 155fc36248c04168afbd796e9ee66493
I20260709 14:49:55.466814  7436 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "22ad3bca8c6b4fa982bb8611615a69dd"
dest_uuid: "68f78fc64ad74f9fa62efb081a46832d"
mode: GRACEFUL
new_leader_uuid: "fdf485ed0db84f74868a2c265c56d1d4"
 from {username='slave'} at 127.0.0.1:39454
I20260709 14:49:55.467664  7436 raft_consensus.cc:606] T 22ad3bca8c6b4fa982bb8611615a69dd P 68f78fc64ad74f9fa62efb081a46832d [term 1 LEADER]: Received request to transfer leadership to TS fdf485ed0db84f74868a2c265c56d1d4
I20260709 14:49:55.474534  7436 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1d10779bfab7437babc4a1e815792595"
dest_uuid: "68f78fc64ad74f9fa62efb081a46832d"
mode: GRACEFUL
new_leader_uuid: "fdf485ed0db84f74868a2c265c56d1d4"
 from {username='slave'} at 127.0.0.1:39454
I20260709 14:49:55.475394  7436 raft_consensus.cc:606] T 1d10779bfab7437babc4a1e815792595 P 68f78fc64ad74f9fa62efb081a46832d [term 1 LEADER]: Received request to transfer leadership to TS fdf485ed0db84f74868a2c265c56d1d4
I20260709 14:49:55.482571  7436 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dc1712921e544aaba5d8fc45d4767c61"
dest_uuid: "68f78fc64ad74f9fa62efb081a46832d"
mode: GRACEFUL
new_leader_uuid: "fdf485ed0db84f74868a2c265c56d1d4"
 from {username='slave'} at 127.0.0.1:39454
I20260709 14:49:55.483180  7436 raft_consensus.cc:606] T dc1712921e544aaba5d8fc45d4767c61 P 68f78fc64ad74f9fa62efb081a46832d [term 1 LEADER]: Received request to transfer leadership to TS fdf485ed0db84f74868a2c265c56d1d4
I20260709 14:49:55.493280  7362 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4f6ef4ab0acb497681217b9e670bd2c2"
dest_uuid: "fdf485ed0db84f74868a2c265c56d1d4"
mode: GRACEFUL
new_leader_uuid: "68f78fc64ad74f9fa62efb081a46832d"
 from {username='slave'} at 127.0.0.1:43026
I20260709 14:49:55.494016  7362 raft_consensus.cc:606] T 4f6ef4ab0acb497681217b9e670bd2c2 P fdf485ed0db84f74868a2c265c56d1d4 [term 1 LEADER]: Received request to transfer leadership to TS 68f78fc64ad74f9fa62efb081a46832d
I20260709 14:49:55.555145  7505 raft_consensus.cc:993] T 36fe96aff6384e2d807b9f4d1bc8a544 P 68f78fc64ad74f9fa62efb081a46832d: : Instructing follower 155fc36248c04168afbd796e9ee66493 to start an election
I20260709 14:49:55.555708  7484 raft_consensus.cc:1081] T 36fe96aff6384e2d807b9f4d1bc8a544 P 68f78fc64ad74f9fa62efb081a46832d [term 1 LEADER]: Signalling peer 155fc36248c04168afbd796e9ee66493 to start an election
I20260709 14:49:55.558264  7288 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "36fe96aff6384e2d807b9f4d1bc8a544"
dest_uuid: "155fc36248c04168afbd796e9ee66493"
 from {username='slave'} at 127.0.0.1:55172
I20260709 14:49:55.558965  7288 raft_consensus.cc:493] T 36fe96aff6384e2d807b9f4d1bc8a544 P 155fc36248c04168afbd796e9ee66493 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:49:55.559377  7288 raft_consensus.cc:3060] T 36fe96aff6384e2d807b9f4d1bc8a544 P 155fc36248c04168afbd796e9ee66493 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:49:55.566035  7288 raft_consensus.cc:515] T 36fe96aff6384e2d807b9f4d1bc8a544 P 155fc36248c04168afbd796e9ee66493 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } }
I20260709 14:49:55.568303  7288 leader_election.cc:290] T 36fe96aff6384e2d807b9f4d1bc8a544 P 155fc36248c04168afbd796e9ee66493 [CANDIDATE]: Term 2 election: Requested vote from peers 68f78fc64ad74f9fa62efb081a46832d (127.6.101.67:42957), fdf485ed0db84f74868a2c265c56d1d4 (127.6.101.66:35791)
I20260709 14:49:55.569796  7436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36fe96aff6384e2d807b9f4d1bc8a544" candidate_uuid: "155fc36248c04168afbd796e9ee66493" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "68f78fc64ad74f9fa62efb081a46832d"
I20260709 14:49:55.569840  7362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36fe96aff6384e2d807b9f4d1bc8a544" candidate_uuid: "155fc36248c04168afbd796e9ee66493" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fdf485ed0db84f74868a2c265c56d1d4"
I20260709 14:49:55.570458  7436 raft_consensus.cc:3055] T 36fe96aff6384e2d807b9f4d1bc8a544 P 68f78fc64ad74f9fa62efb081a46832d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 14:49:55.570561  7362 raft_consensus.cc:3060] T 36fe96aff6384e2d807b9f4d1bc8a544 P fdf485ed0db84f74868a2c265c56d1d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:49:55.570794  7436 raft_consensus.cc:740] T 36fe96aff6384e2d807b9f4d1bc8a544 P 68f78fc64ad74f9fa62efb081a46832d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 68f78fc64ad74f9fa62efb081a46832d, State: Running, Role: LEADER
I20260709 14:49:55.571693  7436 consensus_queue.cc:260] T 36fe96aff6384e2d807b9f4d1bc8a544 P 68f78fc64ad74f9fa62efb081a46832d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } }
I20260709 14:49:55.573369  7436 raft_consensus.cc:3060] T 36fe96aff6384e2d807b9f4d1bc8a544 P 68f78fc64ad74f9fa62efb081a46832d [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:49:55.576341  7362 raft_consensus.cc:2468] T 36fe96aff6384e2d807b9f4d1bc8a544 P fdf485ed0db84f74868a2c265c56d1d4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155fc36248c04168afbd796e9ee66493 in term 2.
I20260709 14:49:55.577858  7253 leader_election.cc:304] T 36fe96aff6384e2d807b9f4d1bc8a544 P 155fc36248c04168afbd796e9ee66493 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155fc36248c04168afbd796e9ee66493, fdf485ed0db84f74868a2c265c56d1d4; no voters: 
I20260709 14:49:55.579025  7521 raft_consensus.cc:2804] T 36fe96aff6384e2d807b9f4d1bc8a544 P 155fc36248c04168afbd796e9ee66493 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:49:55.579476  7521 raft_consensus.cc:697] T 36fe96aff6384e2d807b9f4d1bc8a544 P 155fc36248c04168afbd796e9ee66493 [term 2 LEADER]: Becoming Leader. State: Replica: 155fc36248c04168afbd796e9ee66493, State: Running, Role: LEADER
I20260709 14:49:55.579909  7436 raft_consensus.cc:2468] T 36fe96aff6384e2d807b9f4d1bc8a544 P 68f78fc64ad74f9fa62efb081a46832d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155fc36248c04168afbd796e9ee66493 in term 2.
I20260709 14:49:55.580528  7521 consensus_queue.cc:237] T 36fe96aff6384e2d807b9f4d1bc8a544 P 155fc36248c04168afbd796e9ee66493 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } }
I20260709 14:49:55.586678  7505 raft_consensus.cc:993] T 22ad3bca8c6b4fa982bb8611615a69dd P 68f78fc64ad74f9fa62efb081a46832d: : Instructing follower fdf485ed0db84f74868a2c265c56d1d4 to start an election
I20260709 14:49:55.587213  7484 raft_consensus.cc:1081] T 22ad3bca8c6b4fa982bb8611615a69dd P 68f78fc64ad74f9fa62efb081a46832d [term 1 LEADER]: Signalling peer fdf485ed0db84f74868a2c265c56d1d4 to start an election
I20260709 14:49:55.589390  7362 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "22ad3bca8c6b4fa982bb8611615a69dd"
dest_uuid: "fdf485ed0db84f74868a2c265c56d1d4"
 from {username='slave'} at 127.0.0.1:43016
I20260709 14:49:55.588847  7185 catalog_manager.cc:5697] T 36fe96aff6384e2d807b9f4d1bc8a544 P 155fc36248c04168afbd796e9ee66493 reported cstate change: term changed from 1 to 2, leader changed from 68f78fc64ad74f9fa62efb081a46832d (127.6.101.67) to 155fc36248c04168afbd796e9ee66493 (127.6.101.65). New cstate: current_term: 2 leader_uuid: "155fc36248c04168afbd796e9ee66493" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } health_report { overall_health: HEALTHY } } }
I20260709 14:49:55.589982  7362 raft_consensus.cc:493] T 22ad3bca8c6b4fa982bb8611615a69dd P fdf485ed0db84f74868a2c265c56d1d4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:49:55.590446  7362 raft_consensus.cc:3060] T 22ad3bca8c6b4fa982bb8611615a69dd P fdf485ed0db84f74868a2c265c56d1d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:49:55.598634  7362 raft_consensus.cc:515] T 22ad3bca8c6b4fa982bb8611615a69dd P fdf485ed0db84f74868a2c265c56d1d4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
I20260709 14:49:55.601233  7362 leader_election.cc:290] T 22ad3bca8c6b4fa982bb8611615a69dd P fdf485ed0db84f74868a2c265c56d1d4 [CANDIDATE]: Term 2 election: Requested vote from peers 155fc36248c04168afbd796e9ee66493 (127.6.101.65:43743), 68f78fc64ad74f9fa62efb081a46832d (127.6.101.67:42957)
I20260709 14:49:55.603071  7436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ad3bca8c6b4fa982bb8611615a69dd" candidate_uuid: "fdf485ed0db84f74868a2c265c56d1d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "68f78fc64ad74f9fa62efb081a46832d"
I20260709 14:49:55.603053  7288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ad3bca8c6b4fa982bb8611615a69dd" candidate_uuid: "fdf485ed0db84f74868a2c265c56d1d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "155fc36248c04168afbd796e9ee66493"
I20260709 14:49:55.603693  7436 raft_consensus.cc:3055] T 22ad3bca8c6b4fa982bb8611615a69dd P 68f78fc64ad74f9fa62efb081a46832d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 14:49:55.603966  7288 raft_consensus.cc:3060] T 22ad3bca8c6b4fa982bb8611615a69dd P 155fc36248c04168afbd796e9ee66493 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:49:55.604082  7436 raft_consensus.cc:740] T 22ad3bca8c6b4fa982bb8611615a69dd P 68f78fc64ad74f9fa62efb081a46832d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 68f78fc64ad74f9fa62efb081a46832d, State: Running, Role: LEADER
I20260709 14:49:55.604895  7436 consensus_queue.cc:260] T 22ad3bca8c6b4fa982bb8611615a69dd P 68f78fc64ad74f9fa62efb081a46832d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
I20260709 14:49:55.605944  7436 raft_consensus.cc:3060] T 22ad3bca8c6b4fa982bb8611615a69dd P 68f78fc64ad74f9fa62efb081a46832d [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:49:55.611761  7288 raft_consensus.cc:2468] T 22ad3bca8c6b4fa982bb8611615a69dd P 155fc36248c04168afbd796e9ee66493 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fdf485ed0db84f74868a2c265c56d1d4 in term 2.
I20260709 14:49:55.613893  7327 leader_election.cc:304] T 22ad3bca8c6b4fa982bb8611615a69dd P fdf485ed0db84f74868a2c265c56d1d4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155fc36248c04168afbd796e9ee66493, fdf485ed0db84f74868a2c265c56d1d4; no voters: 
I20260709 14:49:55.614979  7524 raft_consensus.cc:2804] T 22ad3bca8c6b4fa982bb8611615a69dd P fdf485ed0db84f74868a2c265c56d1d4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:49:55.615317  7436 raft_consensus.cc:2468] T 22ad3bca8c6b4fa982bb8611615a69dd P 68f78fc64ad74f9fa62efb081a46832d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fdf485ed0db84f74868a2c265c56d1d4 in term 2.
I20260709 14:49:55.615614  7524 raft_consensus.cc:697] T 22ad3bca8c6b4fa982bb8611615a69dd P fdf485ed0db84f74868a2c265c56d1d4 [term 2 LEADER]: Becoming Leader. State: Replica: fdf485ed0db84f74868a2c265c56d1d4, State: Running, Role: LEADER
I20260709 14:49:55.616569  7524 consensus_queue.cc:237] T 22ad3bca8c6b4fa982bb8611615a69dd P fdf485ed0db84f74868a2c265c56d1d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
I20260709 14:49:55.627573  7185 catalog_manager.cc:5697] T 22ad3bca8c6b4fa982bb8611615a69dd P fdf485ed0db84f74868a2c265c56d1d4 reported cstate change: term changed from 1 to 2, leader changed from 68f78fc64ad74f9fa62efb081a46832d (127.6.101.67) to fdf485ed0db84f74868a2c265c56d1d4 (127.6.101.66). New cstate: current_term: 2 leader_uuid: "fdf485ed0db84f74868a2c265c56d1d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } health_report { overall_health: UNKNOWN } } }
I20260709 14:49:55.632750  7521 consensus_queue.cc:1048] T 79853f64be7f4e5ebb08a711d87bcede P 155fc36248c04168afbd796e9ee66493 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 14:49:55.658093  7568 consensus_queue.cc:1048] T 79853f64be7f4e5ebb08a711d87bcede P 155fc36248c04168afbd796e9ee66493 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:49:55.758495  7524 raft_consensus.cc:993] T a60aa91e98ae4ad0afc3dd45d4b586f2 P fdf485ed0db84f74868a2c265c56d1d4: : Instructing follower 155fc36248c04168afbd796e9ee66493 to start an election
I20260709 14:49:55.759666  7524 raft_consensus.cc:1081] T a60aa91e98ae4ad0afc3dd45d4b586f2 P fdf485ed0db84f74868a2c265c56d1d4 [term 1 LEADER]: Signalling peer 155fc36248c04168afbd796e9ee66493 to start an election
I20260709 14:49:55.761881  7288 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a60aa91e98ae4ad0afc3dd45d4b586f2"
dest_uuid: "155fc36248c04168afbd796e9ee66493"
 from {username='slave'} at 127.0.0.1:55176
I20260709 14:49:55.762636  7288 raft_consensus.cc:493] T a60aa91e98ae4ad0afc3dd45d4b586f2 P 155fc36248c04168afbd796e9ee66493 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:49:55.763063  7288 raft_consensus.cc:3060] T a60aa91e98ae4ad0afc3dd45d4b586f2 P 155fc36248c04168afbd796e9ee66493 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:49:55.769807  7288 raft_consensus.cc:515] T a60aa91e98ae4ad0afc3dd45d4b586f2 P 155fc36248c04168afbd796e9ee66493 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
I20260709 14:49:55.771584  7288 leader_election.cc:290] T a60aa91e98ae4ad0afc3dd45d4b586f2 P 155fc36248c04168afbd796e9ee66493 [CANDIDATE]: Term 2 election: Requested vote from peers fdf485ed0db84f74868a2c265c56d1d4 (127.6.101.66:35791), 68f78fc64ad74f9fa62efb081a46832d (127.6.101.67:42957)
I20260709 14:49:55.772907  7362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60aa91e98ae4ad0afc3dd45d4b586f2" candidate_uuid: "155fc36248c04168afbd796e9ee66493" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fdf485ed0db84f74868a2c265c56d1d4"
I20260709 14:49:55.773217  7436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60aa91e98ae4ad0afc3dd45d4b586f2" candidate_uuid: "155fc36248c04168afbd796e9ee66493" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "68f78fc64ad74f9fa62efb081a46832d"
I20260709 14:49:55.773669  7362 raft_consensus.cc:3055] T a60aa91e98ae4ad0afc3dd45d4b586f2 P fdf485ed0db84f74868a2c265c56d1d4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 14:49:55.773805  7436 raft_consensus.cc:3060] T a60aa91e98ae4ad0afc3dd45d4b586f2 P 68f78fc64ad74f9fa62efb081a46832d [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:49:55.774185  7362 raft_consensus.cc:740] T a60aa91e98ae4ad0afc3dd45d4b586f2 P fdf485ed0db84f74868a2c265c56d1d4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fdf485ed0db84f74868a2c265c56d1d4, State: Running, Role: LEADER
I20260709 14:49:55.775104  7362 consensus_queue.cc:260] T a60aa91e98ae4ad0afc3dd45d4b586f2 P fdf485ed0db84f74868a2c265c56d1d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
I20260709 14:49:55.776446  7362 raft_consensus.cc:3060] T a60aa91e98ae4ad0afc3dd45d4b586f2 P fdf485ed0db84f74868a2c265c56d1d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:49:55.781790  7436 raft_consensus.cc:2468] T a60aa91e98ae4ad0afc3dd45d4b586f2 P 68f78fc64ad74f9fa62efb081a46832d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155fc36248c04168afbd796e9ee66493 in term 2.
I20260709 14:49:55.783567  7253 leader_election.cc:304] T a60aa91e98ae4ad0afc3dd45d4b586f2 P 155fc36248c04168afbd796e9ee66493 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155fc36248c04168afbd796e9ee66493, 68f78fc64ad74f9fa62efb081a46832d; no voters: 
I20260709 14:49:55.783759  7362 raft_consensus.cc:2468] T a60aa91e98ae4ad0afc3dd45d4b586f2 P fdf485ed0db84f74868a2c265c56d1d4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155fc36248c04168afbd796e9ee66493 in term 2.
I20260709 14:49:55.784624  7568 raft_consensus.cc:2804] T a60aa91e98ae4ad0afc3dd45d4b586f2 P 155fc36248c04168afbd796e9ee66493 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:49:55.785605  7568 raft_consensus.cc:697] T a60aa91e98ae4ad0afc3dd45d4b586f2 P 155fc36248c04168afbd796e9ee66493 [term 2 LEADER]: Becoming Leader. State: Replica: 155fc36248c04168afbd796e9ee66493, State: Running, Role: LEADER
I20260709 14:49:55.786477  7568 consensus_queue.cc:237] T a60aa91e98ae4ad0afc3dd45d4b586f2 P 155fc36248c04168afbd796e9ee66493 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
I20260709 14:49:55.794250  7186 catalog_manager.cc:5697] T a60aa91e98ae4ad0afc3dd45d4b586f2 P 155fc36248c04168afbd796e9ee66493 reported cstate change: term changed from 1 to 2, leader changed from fdf485ed0db84f74868a2c265c56d1d4 (127.6.101.66) to 155fc36248c04168afbd796e9ee66493 (127.6.101.65). New cstate: current_term: 2 leader_uuid: "155fc36248c04168afbd796e9ee66493" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } health_report { overall_health: UNKNOWN } } }
I20260709 14:49:55.864666  7484 raft_consensus.cc:993] T 1d10779bfab7437babc4a1e815792595 P 68f78fc64ad74f9fa62efb081a46832d: : Instructing follower fdf485ed0db84f74868a2c265c56d1d4 to start an election
I20260709 14:49:55.865325  7505 raft_consensus.cc:1081] T 1d10779bfab7437babc4a1e815792595 P 68f78fc64ad74f9fa62efb081a46832d [term 1 LEADER]: Signalling peer fdf485ed0db84f74868a2c265c56d1d4 to start an election
I20260709 14:49:55.867417  7362 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1d10779bfab7437babc4a1e815792595"
dest_uuid: "fdf485ed0db84f74868a2c265c56d1d4"
 from {username='slave'} at 127.0.0.1:43016
I20260709 14:49:55.868057  7362 raft_consensus.cc:493] T 1d10779bfab7437babc4a1e815792595 P fdf485ed0db84f74868a2c265c56d1d4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:49:55.868414  7362 raft_consensus.cc:3060] T 1d10779bfab7437babc4a1e815792595 P fdf485ed0db84f74868a2c265c56d1d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:49:55.874423  7362 raft_consensus.cc:515] T 1d10779bfab7437babc4a1e815792595 P fdf485ed0db84f74868a2c265c56d1d4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
I20260709 14:49:55.876820  7362 leader_election.cc:290] T 1d10779bfab7437babc4a1e815792595 P fdf485ed0db84f74868a2c265c56d1d4 [CANDIDATE]: Term 2 election: Requested vote from peers 155fc36248c04168afbd796e9ee66493 (127.6.101.65:43743), 68f78fc64ad74f9fa62efb081a46832d (127.6.101.67:42957)
I20260709 14:49:55.878216  7288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d10779bfab7437babc4a1e815792595" candidate_uuid: "fdf485ed0db84f74868a2c265c56d1d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "155fc36248c04168afbd796e9ee66493"
I20260709 14:49:55.878717  7561 raft_consensus.cc:993] T cddd2927548e4e20b5cc004d23d36978 P fdf485ed0db84f74868a2c265c56d1d4: : Instructing follower 155fc36248c04168afbd796e9ee66493 to start an election
I20260709 14:49:55.878219  7436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d10779bfab7437babc4a1e815792595" candidate_uuid: "fdf485ed0db84f74868a2c265c56d1d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "68f78fc64ad74f9fa62efb081a46832d"
I20260709 14:49:55.879233  7288 raft_consensus.cc:3060] T 1d10779bfab7437babc4a1e815792595 P 155fc36248c04168afbd796e9ee66493 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:49:55.879375  7561 raft_consensus.cc:1081] T cddd2927548e4e20b5cc004d23d36978 P fdf485ed0db84f74868a2c265c56d1d4 [term 1 LEADER]: Signalling peer 155fc36248c04168afbd796e9ee66493 to start an election
I20260709 14:49:55.879791  7436 raft_consensus.cc:3055] T 1d10779bfab7437babc4a1e815792595 P 68f78fc64ad74f9fa62efb081a46832d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 14:49:55.880476  7436 raft_consensus.cc:740] T 1d10779bfab7437babc4a1e815792595 P 68f78fc64ad74f9fa62efb081a46832d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 68f78fc64ad74f9fa62efb081a46832d, State: Running, Role: LEADER
I20260709 14:49:55.881567  7436 consensus_queue.cc:260] T 1d10779bfab7437babc4a1e815792595 P 68f78fc64ad74f9fa62efb081a46832d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
I20260709 14:49:55.882915  7287 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cddd2927548e4e20b5cc004d23d36978"
dest_uuid: "155fc36248c04168afbd796e9ee66493"
 from {username='slave'} at 127.0.0.1:55176
I20260709 14:49:55.883570  7436 raft_consensus.cc:3060] T 1d10779bfab7437babc4a1e815792595 P 68f78fc64ad74f9fa62efb081a46832d [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:49:55.883780  7287 raft_consensus.cc:493] T cddd2927548e4e20b5cc004d23d36978 P 155fc36248c04168afbd796e9ee66493 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:49:55.884418  7287 raft_consensus.cc:3060] T cddd2927548e4e20b5cc004d23d36978 P 155fc36248c04168afbd796e9ee66493 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:49:55.888984  7288 raft_consensus.cc:2468] T 1d10779bfab7437babc4a1e815792595 P 155fc36248c04168afbd796e9ee66493 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fdf485ed0db84f74868a2c265c56d1d4 in term 2.
I20260709 14:49:55.890070  7436 raft_consensus.cc:2468] T 1d10779bfab7437babc4a1e815792595 P 68f78fc64ad74f9fa62efb081a46832d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fdf485ed0db84f74868a2c265c56d1d4 in term 2.
I20260709 14:49:55.891254  7327 leader_election.cc:304] T 1d10779bfab7437babc4a1e815792595 P fdf485ed0db84f74868a2c265c56d1d4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155fc36248c04168afbd796e9ee66493, fdf485ed0db84f74868a2c265c56d1d4; no voters: 
I20260709 14:49:55.892408  7524 raft_consensus.cc:2804] T 1d10779bfab7437babc4a1e815792595 P fdf485ed0db84f74868a2c265c56d1d4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:49:55.893057  7524 raft_consensus.cc:697] T 1d10779bfab7437babc4a1e815792595 P fdf485ed0db84f74868a2c265c56d1d4 [term 2 LEADER]: Becoming Leader. State: Replica: fdf485ed0db84f74868a2c265c56d1d4, State: Running, Role: LEADER
I20260709 14:49:55.894426  7287 raft_consensus.cc:515] T cddd2927548e4e20b5cc004d23d36978 P 155fc36248c04168afbd796e9ee66493 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
I20260709 14:49:55.894387  7524 consensus_queue.cc:237] T 1d10779bfab7437babc4a1e815792595 P fdf485ed0db84f74868a2c265c56d1d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
I20260709 14:49:55.896934  7287 leader_election.cc:290] T cddd2927548e4e20b5cc004d23d36978 P 155fc36248c04168afbd796e9ee66493 [CANDIDATE]: Term 2 election: Requested vote from peers fdf485ed0db84f74868a2c265c56d1d4 (127.6.101.66:35791), 68f78fc64ad74f9fa62efb081a46832d (127.6.101.67:42957)
I20260709 14:49:55.898144  7362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cddd2927548e4e20b5cc004d23d36978" candidate_uuid: "155fc36248c04168afbd796e9ee66493" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fdf485ed0db84f74868a2c265c56d1d4"
I20260709 14:49:55.898877  7362 raft_consensus.cc:3055] T cddd2927548e4e20b5cc004d23d36978 P fdf485ed0db84f74868a2c265c56d1d4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 14:49:55.899236  7362 raft_consensus.cc:740] T cddd2927548e4e20b5cc004d23d36978 P fdf485ed0db84f74868a2c265c56d1d4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fdf485ed0db84f74868a2c265c56d1d4, State: Running, Role: LEADER
I20260709 14:49:55.900471  7362 consensus_queue.cc:260] T cddd2927548e4e20b5cc004d23d36978 P fdf485ed0db84f74868a2c265c56d1d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
I20260709 14:49:55.901952  7362 raft_consensus.cc:3060] T cddd2927548e4e20b5cc004d23d36978 P fdf485ed0db84f74868a2c265c56d1d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:49:55.902226  7436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cddd2927548e4e20b5cc004d23d36978" candidate_uuid: "155fc36248c04168afbd796e9ee66493" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "68f78fc64ad74f9fa62efb081a46832d"
I20260709 14:49:55.902796  7436 raft_consensus.cc:3060] T cddd2927548e4e20b5cc004d23d36978 P 68f78fc64ad74f9fa62efb081a46832d [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:49:55.903884  7186 catalog_manager.cc:5697] T 1d10779bfab7437babc4a1e815792595 P fdf485ed0db84f74868a2c265c56d1d4 reported cstate change: term changed from 1 to 2, leader changed from 68f78fc64ad74f9fa62efb081a46832d (127.6.101.67) to fdf485ed0db84f74868a2c265c56d1d4 (127.6.101.66). New cstate: current_term: 2 leader_uuid: "fdf485ed0db84f74868a2c265c56d1d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } health_report { overall_health: UNKNOWN } } }
I20260709 14:49:55.910704  7362 raft_consensus.cc:2468] T cddd2927548e4e20b5cc004d23d36978 P fdf485ed0db84f74868a2c265c56d1d4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155fc36248c04168afbd796e9ee66493 in term 2.
I20260709 14:49:55.911039  7436 raft_consensus.cc:2468] T cddd2927548e4e20b5cc004d23d36978 P 68f78fc64ad74f9fa62efb081a46832d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155fc36248c04168afbd796e9ee66493 in term 2.
I20260709 14:49:55.912292  7253 leader_election.cc:304] T cddd2927548e4e20b5cc004d23d36978 P 155fc36248c04168afbd796e9ee66493 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155fc36248c04168afbd796e9ee66493, fdf485ed0db84f74868a2c265c56d1d4; no voters: 
I20260709 14:49:55.913374  7568 raft_consensus.cc:2804] T cddd2927548e4e20b5cc004d23d36978 P 155fc36248c04168afbd796e9ee66493 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:49:55.913946  7568 raft_consensus.cc:697] T cddd2927548e4e20b5cc004d23d36978 P 155fc36248c04168afbd796e9ee66493 [term 2 LEADER]: Becoming Leader. State: Replica: 155fc36248c04168afbd796e9ee66493, State: Running, Role: LEADER
I20260709 14:49:55.915198  7568 consensus_queue.cc:237] T cddd2927548e4e20b5cc004d23d36978 P 155fc36248c04168afbd796e9ee66493 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
I20260709 14:49:55.925383  7186 catalog_manager.cc:5697] T cddd2927548e4e20b5cc004d23d36978 P 155fc36248c04168afbd796e9ee66493 reported cstate change: term changed from 1 to 2, leader changed from fdf485ed0db84f74868a2c265c56d1d4 (127.6.101.66) to 155fc36248c04168afbd796e9ee66493 (127.6.101.65). New cstate: current_term: 2 leader_uuid: "155fc36248c04168afbd796e9ee66493" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } health_report { overall_health: UNKNOWN } } }
I20260709 14:49:55.978259  7561 raft_consensus.cc:993] T 4f6ef4ab0acb497681217b9e670bd2c2 P fdf485ed0db84f74868a2c265c56d1d4: : Instructing follower 68f78fc64ad74f9fa62efb081a46832d to start an election
I20260709 14:49:55.978884  7524 raft_consensus.cc:1081] T 4f6ef4ab0acb497681217b9e670bd2c2 P fdf485ed0db84f74868a2c265c56d1d4 [term 1 LEADER]: Signalling peer 68f78fc64ad74f9fa62efb081a46832d to start an election
I20260709 14:49:55.981092  7436 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4f6ef4ab0acb497681217b9e670bd2c2"
dest_uuid: "68f78fc64ad74f9fa62efb081a46832d"
 from {username='slave'} at 127.0.0.1:39448
I20260709 14:49:55.981997  7436 raft_consensus.cc:493] T 4f6ef4ab0acb497681217b9e670bd2c2 P 68f78fc64ad74f9fa62efb081a46832d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:49:55.982429  7436 raft_consensus.cc:3060] T 4f6ef4ab0acb497681217b9e670bd2c2 P 68f78fc64ad74f9fa62efb081a46832d [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:49:55.991142  7436 raft_consensus.cc:515] T 4f6ef4ab0acb497681217b9e670bd2c2 P 68f78fc64ad74f9fa62efb081a46832d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
I20260709 14:49:55.993645  7436 leader_election.cc:290] T 4f6ef4ab0acb497681217b9e670bd2c2 P 68f78fc64ad74f9fa62efb081a46832d [CANDIDATE]: Term 2 election: Requested vote from peers 155fc36248c04168afbd796e9ee66493 (127.6.101.65:43743), fdf485ed0db84f74868a2c265c56d1d4 (127.6.101.66:35791)
I20260709 14:49:55.994397  7505 raft_consensus.cc:993] T dc1712921e544aaba5d8fc45d4767c61 P 68f78fc64ad74f9fa62efb081a46832d: : Instructing follower fdf485ed0db84f74868a2c265c56d1d4 to start an election
I20260709 14:49:55.994711  7287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f6ef4ab0acb497681217b9e670bd2c2" candidate_uuid: "68f78fc64ad74f9fa62efb081a46832d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "155fc36248c04168afbd796e9ee66493"
I20260709 14:49:55.995011  7362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f6ef4ab0acb497681217b9e670bd2c2" candidate_uuid: "68f78fc64ad74f9fa62efb081a46832d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fdf485ed0db84f74868a2c265c56d1d4"
I20260709 14:49:55.994997  7507 raft_consensus.cc:1081] T dc1712921e544aaba5d8fc45d4767c61 P 68f78fc64ad74f9fa62efb081a46832d [term 1 LEADER]: Signalling peer fdf485ed0db84f74868a2c265c56d1d4 to start an election
I20260709 14:49:55.995815  7362 raft_consensus.cc:3055] T 4f6ef4ab0acb497681217b9e670bd2c2 P fdf485ed0db84f74868a2c265c56d1d4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 14:49:55.995545  7287 raft_consensus.cc:3060] T 4f6ef4ab0acb497681217b9e670bd2c2 P 155fc36248c04168afbd796e9ee66493 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:49:55.996165  7362 raft_consensus.cc:740] T 4f6ef4ab0acb497681217b9e670bd2c2 P fdf485ed0db84f74868a2c265c56d1d4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fdf485ed0db84f74868a2c265c56d1d4, State: Running, Role: LEADER
I20260709 14:49:55.996991  7362 consensus_queue.cc:260] T 4f6ef4ab0acb497681217b9e670bd2c2 P fdf485ed0db84f74868a2c265c56d1d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
I20260709 14:49:55.997539  7364 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dc1712921e544aaba5d8fc45d4767c61"
dest_uuid: "fdf485ed0db84f74868a2c265c56d1d4"
 from {username='slave'} at 127.0.0.1:43016
I20260709 14:49:55.998412  7364 raft_consensus.cc:493] T dc1712921e544aaba5d8fc45d4767c61 P fdf485ed0db84f74868a2c265c56d1d4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:49:55.998479  7362 raft_consensus.cc:3060] T 4f6ef4ab0acb497681217b9e670bd2c2 P fdf485ed0db84f74868a2c265c56d1d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:49:55.998941  7364 raft_consensus.cc:3060] T dc1712921e544aaba5d8fc45d4767c61 P fdf485ed0db84f74868a2c265c56d1d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:49:56.006253  7362 raft_consensus.cc:2468] T 4f6ef4ab0acb497681217b9e670bd2c2 P fdf485ed0db84f74868a2c265c56d1d4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68f78fc64ad74f9fa62efb081a46832d in term 2.
I20260709 14:49:56.006466  7287 raft_consensus.cc:2468] T 4f6ef4ab0acb497681217b9e670bd2c2 P 155fc36248c04168afbd796e9ee66493 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68f78fc64ad74f9fa62efb081a46832d in term 2.
I20260709 14:49:56.007683  7402 leader_election.cc:304] T 4f6ef4ab0acb497681217b9e670bd2c2 P 68f78fc64ad74f9fa62efb081a46832d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68f78fc64ad74f9fa62efb081a46832d, fdf485ed0db84f74868a2c265c56d1d4; no voters: 
I20260709 14:49:56.007807  7364 raft_consensus.cc:515] T dc1712921e544aaba5d8fc45d4767c61 P fdf485ed0db84f74868a2c265c56d1d4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
I20260709 14:49:56.008873  7507 raft_consensus.cc:2804] T 4f6ef4ab0acb497681217b9e670bd2c2 P 68f78fc64ad74f9fa62efb081a46832d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:49:56.009507  7507 raft_consensus.cc:697] T 4f6ef4ab0acb497681217b9e670bd2c2 P 68f78fc64ad74f9fa62efb081a46832d [term 2 LEADER]: Becoming Leader. State: Replica: 68f78fc64ad74f9fa62efb081a46832d, State: Running, Role: LEADER
I20260709 14:49:56.010847  7364 leader_election.cc:290] T dc1712921e544aaba5d8fc45d4767c61 P fdf485ed0db84f74868a2c265c56d1d4 [CANDIDATE]: Term 2 election: Requested vote from peers 155fc36248c04168afbd796e9ee66493 (127.6.101.65:43743), 68f78fc64ad74f9fa62efb081a46832d (127.6.101.67:42957)
I20260709 14:49:56.011209  7507 consensus_queue.cc:237] T 4f6ef4ab0acb497681217b9e670bd2c2 P 68f78fc64ad74f9fa62efb081a46832d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
I20260709 14:49:56.012212  7436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1712921e544aaba5d8fc45d4767c61" candidate_uuid: "fdf485ed0db84f74868a2c265c56d1d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "68f78fc64ad74f9fa62efb081a46832d"
I20260709 14:49:56.012168  7287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1712921e544aaba5d8fc45d4767c61" candidate_uuid: "fdf485ed0db84f74868a2c265c56d1d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "155fc36248c04168afbd796e9ee66493"
I20260709 14:49:56.013226  7436 raft_consensus.cc:3055] T dc1712921e544aaba5d8fc45d4767c61 P 68f78fc64ad74f9fa62efb081a46832d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 14:49:56.013651  7436 raft_consensus.cc:740] T dc1712921e544aaba5d8fc45d4767c61 P 68f78fc64ad74f9fa62efb081a46832d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 68f78fc64ad74f9fa62efb081a46832d, State: Running, Role: LEADER
I20260709 14:49:56.013782  7287 raft_consensus.cc:3060] T dc1712921e544aaba5d8fc45d4767c61 P 155fc36248c04168afbd796e9ee66493 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:49:56.014596  7436 consensus_queue.cc:260] T dc1712921e544aaba5d8fc45d4767c61 P 68f78fc64ad74f9fa62efb081a46832d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
I20260709 14:49:56.015846  7436 raft_consensus.cc:3060] T dc1712921e544aaba5d8fc45d4767c61 P 68f78fc64ad74f9fa62efb081a46832d [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:49:56.022274  7287 raft_consensus.cc:2468] T dc1712921e544aaba5d8fc45d4767c61 P 155fc36248c04168afbd796e9ee66493 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fdf485ed0db84f74868a2c265c56d1d4 in term 2.
I20260709 14:49:56.023823  7327 leader_election.cc:304] T dc1712921e544aaba5d8fc45d4767c61 P fdf485ed0db84f74868a2c265c56d1d4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155fc36248c04168afbd796e9ee66493, fdf485ed0db84f74868a2c265c56d1d4; no voters: 
I20260709 14:49:56.024844  7524 raft_consensus.cc:2804] T dc1712921e544aaba5d8fc45d4767c61 P fdf485ed0db84f74868a2c265c56d1d4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:49:56.025045  7436 raft_consensus.cc:2468] T dc1712921e544aaba5d8fc45d4767c61 P 68f78fc64ad74f9fa62efb081a46832d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fdf485ed0db84f74868a2c265c56d1d4 in term 2.
I20260709 14:49:56.024284  7186 catalog_manager.cc:5697] T 4f6ef4ab0acb497681217b9e670bd2c2 P 68f78fc64ad74f9fa62efb081a46832d reported cstate change: term changed from 1 to 2, leader changed from fdf485ed0db84f74868a2c265c56d1d4 (127.6.101.66) to 68f78fc64ad74f9fa62efb081a46832d (127.6.101.67). New cstate: current_term: 2 leader_uuid: "68f78fc64ad74f9fa62efb081a46832d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } health_report { overall_health: HEALTHY } } }
I20260709 14:49:56.025509  7524 raft_consensus.cc:697] T dc1712921e544aaba5d8fc45d4767c61 P fdf485ed0db84f74868a2c265c56d1d4 [term 2 LEADER]: Becoming Leader. State: Replica: fdf485ed0db84f74868a2c265c56d1d4, State: Running, Role: LEADER
I20260709 14:49:56.026226  7364 raft_consensus.cc:1275] T 36fe96aff6384e2d807b9f4d1bc8a544 P fdf485ed0db84f74868a2c265c56d1d4 [term 2 FOLLOWER]: Refusing update from remote peer 155fc36248c04168afbd796e9ee66493: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:49:56.026430  7524 consensus_queue.cc:237] T dc1712921e544aaba5d8fc45d4767c61 P fdf485ed0db84f74868a2c265c56d1d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
I20260709 14:49:56.028067  7568 consensus_queue.cc:1048] T 36fe96aff6384e2d807b9f4d1bc8a544 P 155fc36248c04168afbd796e9ee66493 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 14:49:56.036949  7185 catalog_manager.cc:5697] T dc1712921e544aaba5d8fc45d4767c61 P fdf485ed0db84f74868a2c265c56d1d4 reported cstate change: term changed from 1 to 2, leader changed from 68f78fc64ad74f9fa62efb081a46832d (127.6.101.67) to fdf485ed0db84f74868a2c265c56d1d4 (127.6.101.66). New cstate: current_term: 2 leader_uuid: "fdf485ed0db84f74868a2c265c56d1d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } health_report { overall_health: UNKNOWN } } }
I20260709 14:49:56.045446  7436 raft_consensus.cc:1275] T 36fe96aff6384e2d807b9f4d1bc8a544 P 68f78fc64ad74f9fa62efb081a46832d [term 2 FOLLOWER]: Refusing update from remote peer 155fc36248c04168afbd796e9ee66493: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:49:56.047793  7571 consensus_queue.cc:1048] T 36fe96aff6384e2d807b9f4d1bc8a544 P 155fc36248c04168afbd796e9ee66493 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 14:49:56.103714  7287 raft_consensus.cc:1275] T 22ad3bca8c6b4fa982bb8611615a69dd P 155fc36248c04168afbd796e9ee66493 [term 2 FOLLOWER]: Refusing update from remote peer fdf485ed0db84f74868a2c265c56d1d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:49:56.105778  7524 consensus_queue.cc:1048] T 22ad3bca8c6b4fa982bb8611615a69dd P fdf485ed0db84f74868a2c265c56d1d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 14:49:56.116477  7436 raft_consensus.cc:1275] T 22ad3bca8c6b4fa982bb8611615a69dd P 68f78fc64ad74f9fa62efb081a46832d [term 2 FOLLOWER]: Refusing update from remote peer fdf485ed0db84f74868a2c265c56d1d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:49:56.120131  7524 consensus_queue.cc:1048] T 22ad3bca8c6b4fa982bb8611615a69dd P fdf485ed0db84f74868a2c265c56d1d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 14:49:56.177610  7364 raft_consensus.cc:1275] T a60aa91e98ae4ad0afc3dd45d4b586f2 P fdf485ed0db84f74868a2c265c56d1d4 [term 2 FOLLOWER]: Refusing update from remote peer 155fc36248c04168afbd796e9ee66493: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:49:56.180003  7571 consensus_queue.cc:1048] T a60aa91e98ae4ad0afc3dd45d4b586f2 P 155fc36248c04168afbd796e9ee66493 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 14:49:56.192409  7436 raft_consensus.cc:1275] T a60aa91e98ae4ad0afc3dd45d4b586f2 P 68f78fc64ad74f9fa62efb081a46832d [term 2 FOLLOWER]: Refusing update from remote peer 155fc36248c04168afbd796e9ee66493: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:49:56.197314  7571 consensus_queue.cc:1048] T a60aa91e98ae4ad0afc3dd45d4b586f2 P 155fc36248c04168afbd796e9ee66493 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 14:49:56.285691  7287 raft_consensus.cc:1275] T 1d10779bfab7437babc4a1e815792595 P 155fc36248c04168afbd796e9ee66493 [term 2 FOLLOWER]: Refusing update from remote peer fdf485ed0db84f74868a2c265c56d1d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:49:56.287407  7524 consensus_queue.cc:1048] T 1d10779bfab7437babc4a1e815792595 P fdf485ed0db84f74868a2c265c56d1d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 14:49:56.296897  7436 raft_consensus.cc:1275] T 1d10779bfab7437babc4a1e815792595 P 68f78fc64ad74f9fa62efb081a46832d [term 2 FOLLOWER]: Refusing update from remote peer fdf485ed0db84f74868a2c265c56d1d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:49:56.298666  7561 consensus_queue.cc:1048] T 1d10779bfab7437babc4a1e815792595 P fdf485ed0db84f74868a2c265c56d1d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 14:49:56.347532  7436 raft_consensus.cc:1275] T cddd2927548e4e20b5cc004d23d36978 P 68f78fc64ad74f9fa62efb081a46832d [term 2 FOLLOWER]: Refusing update from remote peer 155fc36248c04168afbd796e9ee66493: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:49:56.349478  7571 consensus_queue.cc:1048] T cddd2927548e4e20b5cc004d23d36978 P 155fc36248c04168afbd796e9ee66493 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 14:49:56.352859  7364 raft_consensus.cc:1275] T cddd2927548e4e20b5cc004d23d36978 P fdf485ed0db84f74868a2c265c56d1d4 [term 2 FOLLOWER]: Refusing update from remote peer 155fc36248c04168afbd796e9ee66493: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:49:56.354839  7521 consensus_queue.cc:1048] T cddd2927548e4e20b5cc004d23d36978 P 155fc36248c04168afbd796e9ee66493 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 14:49:56.414119  7436 raft_consensus.cc:1275] T dc1712921e544aaba5d8fc45d4767c61 P 68f78fc64ad74f9fa62efb081a46832d [term 2 FOLLOWER]: Refusing update from remote peer fdf485ed0db84f74868a2c265c56d1d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:49:56.416003  7561 consensus_queue.cc:1048] T dc1712921e544aaba5d8fc45d4767c61 P fdf485ed0db84f74868a2c265c56d1d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 14:49:56.428048  7287 raft_consensus.cc:1275] T dc1712921e544aaba5d8fc45d4767c61 P 155fc36248c04168afbd796e9ee66493 [term 2 FOLLOWER]: Refusing update from remote peer fdf485ed0db84f74868a2c265c56d1d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:49:56.430091  7524 consensus_queue.cc:1048] T dc1712921e544aaba5d8fc45d4767c61 P fdf485ed0db84f74868a2c265c56d1d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 14:49:56.447486  7364 raft_consensus.cc:1275] T 4f6ef4ab0acb497681217b9e670bd2c2 P fdf485ed0db84f74868a2c265c56d1d4 [term 2 FOLLOWER]: Refusing update from remote peer 68f78fc64ad74f9fa62efb081a46832d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:49:56.449504  7507 consensus_queue.cc:1048] T 4f6ef4ab0acb497681217b9e670bd2c2 P 68f78fc64ad74f9fa62efb081a46832d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 14:49:56.463811  7287 raft_consensus.cc:1275] T 4f6ef4ab0acb497681217b9e670bd2c2 P 155fc36248c04168afbd796e9ee66493 [term 2 FOLLOWER]: Refusing update from remote peer 68f78fc64ad74f9fa62efb081a46832d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:49:56.465588  7484 consensus_queue.cc:1048] T 4f6ef4ab0acb497681217b9e670bd2c2 P 68f78fc64ad74f9fa62efb081a46832d [LEADER]: Connected to new peer: Peer: permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 14:49:58.538554  6549 auto_leader_rebalancer-test.cc:410] The leader distribution is 
I20260709 14:49:58.539359  6549 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 14:49:58.563406  7287 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cddd2927548e4e20b5cc004d23d36978"
dest_uuid: "155fc36248c04168afbd796e9ee66493"
mode: GRACEFUL
new_leader_uuid: "68f78fc64ad74f9fa62efb081a46832d"
 from {username='slave'} at 127.0.0.1:55192
I20260709 14:49:58.564100  7287 raft_consensus.cc:606] T cddd2927548e4e20b5cc004d23d36978 P 155fc36248c04168afbd796e9ee66493 [term 2 LEADER]: Received request to transfer leadership to TS 68f78fc64ad74f9fa62efb081a46832d
I20260709 14:49:58.567502  7287 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e93fd08a04f04602bb98df0aca9a314e"
dest_uuid: "155fc36248c04168afbd796e9ee66493"
mode: GRACEFUL
new_leader_uuid: "68f78fc64ad74f9fa62efb081a46832d"
 from {username='slave'} at 127.0.0.1:55192
I20260709 14:49:58.568181  7287 raft_consensus.cc:606] T e93fd08a04f04602bb98df0aca9a314e P 155fc36248c04168afbd796e9ee66493 [term 1 LEADER]: Received request to transfer leadership to TS 68f78fc64ad74f9fa62efb081a46832d
I20260709 14:49:58.569693  6549 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 14:49:58.570355  6549 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 14:49:58.658699  7571 raft_consensus.cc:993] T e93fd08a04f04602bb98df0aca9a314e P 155fc36248c04168afbd796e9ee66493: : Instructing follower 68f78fc64ad74f9fa62efb081a46832d to start an election
I20260709 14:49:58.659257  7581 raft_consensus.cc:1081] T e93fd08a04f04602bb98df0aca9a314e P 155fc36248c04168afbd796e9ee66493 [term 1 LEADER]: Signalling peer 68f78fc64ad74f9fa62efb081a46832d to start an election
I20260709 14:49:58.661466  7436 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e93fd08a04f04602bb98df0aca9a314e"
dest_uuid: "68f78fc64ad74f9fa62efb081a46832d"
 from {username='slave'} at 127.0.0.1:39436
I20260709 14:49:58.662143  7436 raft_consensus.cc:493] T e93fd08a04f04602bb98df0aca9a314e P 68f78fc64ad74f9fa62efb081a46832d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:49:58.662642  7436 raft_consensus.cc:3060] T e93fd08a04f04602bb98df0aca9a314e P 68f78fc64ad74f9fa62efb081a46832d [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:49:58.667626  7436 raft_consensus.cc:515] T e93fd08a04f04602bb98df0aca9a314e P 68f78fc64ad74f9fa62efb081a46832d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
I20260709 14:49:58.669656  7436 leader_election.cc:290] T e93fd08a04f04602bb98df0aca9a314e P 68f78fc64ad74f9fa62efb081a46832d [CANDIDATE]: Term 2 election: Requested vote from peers 155fc36248c04168afbd796e9ee66493 (127.6.101.65:43743), fdf485ed0db84f74868a2c265c56d1d4 (127.6.101.66:35791)
I20260709 14:49:58.671238  7364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93fd08a04f04602bb98df0aca9a314e" candidate_uuid: "68f78fc64ad74f9fa62efb081a46832d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fdf485ed0db84f74868a2c265c56d1d4"
I20260709 14:49:58.671200  7287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93fd08a04f04602bb98df0aca9a314e" candidate_uuid: "68f78fc64ad74f9fa62efb081a46832d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "155fc36248c04168afbd796e9ee66493"
I20260709 14:49:58.671898  7364 raft_consensus.cc:3060] T e93fd08a04f04602bb98df0aca9a314e P fdf485ed0db84f74868a2c265c56d1d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:49:58.672199  7287 raft_consensus.cc:3055] T e93fd08a04f04602bb98df0aca9a314e P 155fc36248c04168afbd796e9ee66493 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 14:49:58.672595  7287 raft_consensus.cc:740] T e93fd08a04f04602bb98df0aca9a314e P 155fc36248c04168afbd796e9ee66493 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 155fc36248c04168afbd796e9ee66493, State: Running, Role: LEADER
I20260709 14:49:58.673930  7287 consensus_queue.cc:260] T e93fd08a04f04602bb98df0aca9a314e P 155fc36248c04168afbd796e9ee66493 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
I20260709 14:49:58.675086  7287 raft_consensus.cc:3060] T e93fd08a04f04602bb98df0aca9a314e P 155fc36248c04168afbd796e9ee66493 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:49:58.678647  7364 raft_consensus.cc:2468] T e93fd08a04f04602bb98df0aca9a314e P fdf485ed0db84f74868a2c265c56d1d4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68f78fc64ad74f9fa62efb081a46832d in term 2.
I20260709 14:49:58.680248  7402 leader_election.cc:304] T e93fd08a04f04602bb98df0aca9a314e P 68f78fc64ad74f9fa62efb081a46832d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68f78fc64ad74f9fa62efb081a46832d, fdf485ed0db84f74868a2c265c56d1d4; no voters: 
I20260709 14:49:58.681113  7484 raft_consensus.cc:2804] T e93fd08a04f04602bb98df0aca9a314e P 68f78fc64ad74f9fa62efb081a46832d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:49:58.682253  7287 raft_consensus.cc:2468] T e93fd08a04f04602bb98df0aca9a314e P 155fc36248c04168afbd796e9ee66493 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68f78fc64ad74f9fa62efb081a46832d in term 2.
I20260709 14:49:58.682571  7484 raft_consensus.cc:697] T e93fd08a04f04602bb98df0aca9a314e P 68f78fc64ad74f9fa62efb081a46832d [term 2 LEADER]: Becoming Leader. State: Replica: 68f78fc64ad74f9fa62efb081a46832d, State: Running, Role: LEADER
I20260709 14:49:58.683709  7484 consensus_queue.cc:237] T e93fd08a04f04602bb98df0aca9a314e P 68f78fc64ad74f9fa62efb081a46832d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
I20260709 14:49:58.693861  7185 catalog_manager.cc:5697] T e93fd08a04f04602bb98df0aca9a314e P 68f78fc64ad74f9fa62efb081a46832d reported cstate change: term changed from 1 to 2, leader changed from 155fc36248c04168afbd796e9ee66493 (127.6.101.65) to 68f78fc64ad74f9fa62efb081a46832d (127.6.101.67). New cstate: current_term: 2 leader_uuid: "68f78fc64ad74f9fa62efb081a46832d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } health_report { overall_health: HEALTHY } } }
I20260709 14:49:58.912993  7571 raft_consensus.cc:993] T cddd2927548e4e20b5cc004d23d36978 P 155fc36248c04168afbd796e9ee66493: : Instructing follower 68f78fc64ad74f9fa62efb081a46832d to start an election
I20260709 14:49:58.913910  7581 raft_consensus.cc:1081] T cddd2927548e4e20b5cc004d23d36978 P 155fc36248c04168afbd796e9ee66493 [term 2 LEADER]: Signalling peer 68f78fc64ad74f9fa62efb081a46832d to start an election
I20260709 14:49:58.916254  7438 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cddd2927548e4e20b5cc004d23d36978"
dest_uuid: "68f78fc64ad74f9fa62efb081a46832d"
 from {username='slave'} at 127.0.0.1:39436
I20260709 14:49:58.916932  7438 raft_consensus.cc:493] T cddd2927548e4e20b5cc004d23d36978 P 68f78fc64ad74f9fa62efb081a46832d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:49:58.917285  7438 raft_consensus.cc:3060] T cddd2927548e4e20b5cc004d23d36978 P 68f78fc64ad74f9fa62efb081a46832d [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:49:58.923558  7438 raft_consensus.cc:515] T cddd2927548e4e20b5cc004d23d36978 P 68f78fc64ad74f9fa62efb081a46832d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
I20260709 14:49:58.925613  7438 leader_election.cc:290] T cddd2927548e4e20b5cc004d23d36978 P 68f78fc64ad74f9fa62efb081a46832d [CANDIDATE]: Term 3 election: Requested vote from peers 155fc36248c04168afbd796e9ee66493 (127.6.101.65:43743), fdf485ed0db84f74868a2c265c56d1d4 (127.6.101.66:35791)
I20260709 14:49:58.926816  7364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cddd2927548e4e20b5cc004d23d36978" candidate_uuid: "68f78fc64ad74f9fa62efb081a46832d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fdf485ed0db84f74868a2c265c56d1d4"
I20260709 14:49:58.926767  7287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cddd2927548e4e20b5cc004d23d36978" candidate_uuid: "68f78fc64ad74f9fa62efb081a46832d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "155fc36248c04168afbd796e9ee66493"
I20260709 14:49:58.927677  7364 raft_consensus.cc:3060] T cddd2927548e4e20b5cc004d23d36978 P fdf485ed0db84f74868a2c265c56d1d4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:49:58.927718  7287 raft_consensus.cc:3055] T cddd2927548e4e20b5cc004d23d36978 P 155fc36248c04168afbd796e9ee66493 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 14:49:58.928244  7287 raft_consensus.cc:740] T cddd2927548e4e20b5cc004d23d36978 P 155fc36248c04168afbd796e9ee66493 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 155fc36248c04168afbd796e9ee66493, State: Running, Role: LEADER
I20260709 14:49:58.929417  7287 consensus_queue.cc:260] T cddd2927548e4e20b5cc004d23d36978 P 155fc36248c04168afbd796e9ee66493 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
I20260709 14:49:58.930876  7287 raft_consensus.cc:3060] T cddd2927548e4e20b5cc004d23d36978 P 155fc36248c04168afbd796e9ee66493 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:49:58.936615  7364 raft_consensus.cc:2468] T cddd2927548e4e20b5cc004d23d36978 P fdf485ed0db84f74868a2c265c56d1d4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68f78fc64ad74f9fa62efb081a46832d in term 3.
I20260709 14:49:58.938333  7402 leader_election.cc:304] T cddd2927548e4e20b5cc004d23d36978 P 68f78fc64ad74f9fa62efb081a46832d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68f78fc64ad74f9fa62efb081a46832d, fdf485ed0db84f74868a2c265c56d1d4; no voters: 
I20260709 14:49:58.938644  7287 raft_consensus.cc:2468] T cddd2927548e4e20b5cc004d23d36978 P 155fc36248c04168afbd796e9ee66493 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68f78fc64ad74f9fa62efb081a46832d in term 3.
I20260709 14:49:58.939491  7484 raft_consensus.cc:2804] T cddd2927548e4e20b5cc004d23d36978 P 68f78fc64ad74f9fa62efb081a46832d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 14:49:58.940107  7484 raft_consensus.cc:697] T cddd2927548e4e20b5cc004d23d36978 P 68f78fc64ad74f9fa62efb081a46832d [term 3 LEADER]: Becoming Leader. State: Replica: 68f78fc64ad74f9fa62efb081a46832d, State: Running, Role: LEADER
I20260709 14:49:58.940908  7484 consensus_queue.cc:237] T cddd2927548e4e20b5cc004d23d36978 P 68f78fc64ad74f9fa62efb081a46832d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
I20260709 14:49:58.952330  7185 catalog_manager.cc:5697] T cddd2927548e4e20b5cc004d23d36978 P 68f78fc64ad74f9fa62efb081a46832d reported cstate change: term changed from 2 to 3, leader changed from 155fc36248c04168afbd796e9ee66493 (127.6.101.65) to 68f78fc64ad74f9fa62efb081a46832d (127.6.101.67). New cstate: current_term: 3 leader_uuid: "68f78fc64ad74f9fa62efb081a46832d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } health_report { overall_health: HEALTHY } } }
I20260709 14:49:59.068370  7364 raft_consensus.cc:1275] T e93fd08a04f04602bb98df0aca9a314e P fdf485ed0db84f74868a2c265c56d1d4 [term 2 FOLLOWER]: Refusing update from remote peer 68f78fc64ad74f9fa62efb081a46832d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:49:59.070155  7484 consensus_queue.cc:1048] T e93fd08a04f04602bb98df0aca9a314e P 68f78fc64ad74f9fa62efb081a46832d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 14:49:59.083670  7287 raft_consensus.cc:1275] T e93fd08a04f04602bb98df0aca9a314e P 155fc36248c04168afbd796e9ee66493 [term 2 FOLLOWER]: Refusing update from remote peer 68f78fc64ad74f9fa62efb081a46832d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:49:59.085379  7484 consensus_queue.cc:1048] T e93fd08a04f04602bb98df0aca9a314e P 68f78fc64ad74f9fa62efb081a46832d [LEADER]: Connected to new peer: Peer: permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 14:49:59.385038  7364 raft_consensus.cc:1275] T cddd2927548e4e20b5cc004d23d36978 P fdf485ed0db84f74868a2c265c56d1d4 [term 3 FOLLOWER]: Refusing update from remote peer 68f78fc64ad74f9fa62efb081a46832d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 14:49:59.386734  7484 consensus_queue.cc:1048] T cddd2927548e4e20b5cc004d23d36978 P 68f78fc64ad74f9fa62efb081a46832d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 14:49:59.399816  7287 raft_consensus.cc:1275] T cddd2927548e4e20b5cc004d23d36978 P 155fc36248c04168afbd796e9ee66493 [term 3 FOLLOWER]: Refusing update from remote peer 68f78fc64ad74f9fa62efb081a46832d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 14:49:59.403054  7484 consensus_queue.cc:1048] T cddd2927548e4e20b5cc004d23d36978 P 68f78fc64ad74f9fa62efb081a46832d [LEADER]: Connected to new peer: Peer: permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 14:49:59.571444  6549 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 14:49:59.597539  7438 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e93fd08a04f04602bb98df0aca9a314e"
dest_uuid: "68f78fc64ad74f9fa62efb081a46832d"
mode: GRACEFUL
new_leader_uuid: "155fc36248c04168afbd796e9ee66493"
 from {username='slave'} at 127.0.0.1:39454
I20260709 14:49:59.598229  7438 raft_consensus.cc:606] T e93fd08a04f04602bb98df0aca9a314e P 68f78fc64ad74f9fa62efb081a46832d [term 2 LEADER]: Received request to transfer leadership to TS 155fc36248c04168afbd796e9ee66493
I20260709 14:49:59.606159  7438 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cddd2927548e4e20b5cc004d23d36978"
dest_uuid: "68f78fc64ad74f9fa62efb081a46832d"
mode: GRACEFUL
new_leader_uuid: "155fc36248c04168afbd796e9ee66493"
 from {username='slave'} at 127.0.0.1:39454
I20260709 14:49:59.607088  7438 raft_consensus.cc:606] T cddd2927548e4e20b5cc004d23d36978 P 68f78fc64ad74f9fa62efb081a46832d [term 3 LEADER]: Received request to transfer leadership to TS 155fc36248c04168afbd796e9ee66493
I20260709 14:49:59.614791  7364 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "21f5ecd80b0b421aad67b6ec53d594d2"
dest_uuid: "fdf485ed0db84f74868a2c265c56d1d4"
mode: GRACEFUL
new_leader_uuid: "155fc36248c04168afbd796e9ee66493"
 from {username='slave'} at 127.0.0.1:43026
I20260709 14:49:59.615686  7364 raft_consensus.cc:606] T 21f5ecd80b0b421aad67b6ec53d594d2 P fdf485ed0db84f74868a2c265c56d1d4 [term 1 LEADER]: Received request to transfer leadership to TS 155fc36248c04168afbd796e9ee66493
I20260709 14:49:59.623744  7364 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "22ad3bca8c6b4fa982bb8611615a69dd"
dest_uuid: "fdf485ed0db84f74868a2c265c56d1d4"
mode: GRACEFUL
new_leader_uuid: "155fc36248c04168afbd796e9ee66493"
 from {username='slave'} at 127.0.0.1:43026
I20260709 14:49:59.624325  7364 raft_consensus.cc:606] T 22ad3bca8c6b4fa982bb8611615a69dd P fdf485ed0db84f74868a2c265c56d1d4 [term 2 LEADER]: Received request to transfer leadership to TS 155fc36248c04168afbd796e9ee66493
I20260709 14:49:59.632959  7364 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1d10779bfab7437babc4a1e815792595"
dest_uuid: "fdf485ed0db84f74868a2c265c56d1d4"
mode: GRACEFUL
new_leader_uuid: "155fc36248c04168afbd796e9ee66493"
 from {username='slave'} at 127.0.0.1:43026
I20260709 14:49:59.634045  7364 raft_consensus.cc:606] T 1d10779bfab7437babc4a1e815792595 P fdf485ed0db84f74868a2c265c56d1d4 [term 2 LEADER]: Received request to transfer leadership to TS 155fc36248c04168afbd796e9ee66493
I20260709 14:49:59.680629  7598 raft_consensus.cc:993] T e93fd08a04f04602bb98df0aca9a314e P 68f78fc64ad74f9fa62efb081a46832d: : Instructing follower 155fc36248c04168afbd796e9ee66493 to start an election
I20260709 14:49:59.681203  7584 raft_consensus.cc:1081] T e93fd08a04f04602bb98df0aca9a314e P 68f78fc64ad74f9fa62efb081a46832d [term 2 LEADER]: Signalling peer 155fc36248c04168afbd796e9ee66493 to start an election
I20260709 14:49:59.683219  7287 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e93fd08a04f04602bb98df0aca9a314e"
dest_uuid: "155fc36248c04168afbd796e9ee66493"
 from {username='slave'} at 127.0.0.1:55172
I20260709 14:49:59.683938  7287 raft_consensus.cc:493] T e93fd08a04f04602bb98df0aca9a314e P 155fc36248c04168afbd796e9ee66493 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:49:59.684312  7287 raft_consensus.cc:3060] T e93fd08a04f04602bb98df0aca9a314e P 155fc36248c04168afbd796e9ee66493 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:49:59.691488  7287 raft_consensus.cc:515] T e93fd08a04f04602bb98df0aca9a314e P 155fc36248c04168afbd796e9ee66493 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
I20260709 14:49:59.693599  7287 leader_election.cc:290] T e93fd08a04f04602bb98df0aca9a314e P 155fc36248c04168afbd796e9ee66493 [CANDIDATE]: Term 3 election: Requested vote from peers fdf485ed0db84f74868a2c265c56d1d4 (127.6.101.66:35791), 68f78fc64ad74f9fa62efb081a46832d (127.6.101.67:42957)
I20260709 14:49:59.694988  7364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93fd08a04f04602bb98df0aca9a314e" candidate_uuid: "155fc36248c04168afbd796e9ee66493" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fdf485ed0db84f74868a2c265c56d1d4"
I20260709 14:49:59.695216  7438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93fd08a04f04602bb98df0aca9a314e" candidate_uuid: "155fc36248c04168afbd796e9ee66493" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "68f78fc64ad74f9fa62efb081a46832d"
I20260709 14:49:59.695757  7364 raft_consensus.cc:3060] T e93fd08a04f04602bb98df0aca9a314e P fdf485ed0db84f74868a2c265c56d1d4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:49:59.695770  7438 raft_consensus.cc:3055] T e93fd08a04f04602bb98df0aca9a314e P 68f78fc64ad74f9fa62efb081a46832d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 14:49:59.696296  7438 raft_consensus.cc:740] T e93fd08a04f04602bb98df0aca9a314e P 68f78fc64ad74f9fa62efb081a46832d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 68f78fc64ad74f9fa62efb081a46832d, State: Running, Role: LEADER
I20260709 14:49:59.697201  7438 consensus_queue.cc:260] T e93fd08a04f04602bb98df0aca9a314e P 68f78fc64ad74f9fa62efb081a46832d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
I20260709 14:49:59.698673  7438 raft_consensus.cc:3060] T e93fd08a04f04602bb98df0aca9a314e P 68f78fc64ad74f9fa62efb081a46832d [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:49:59.706069  7364 raft_consensus.cc:2468] T e93fd08a04f04602bb98df0aca9a314e P fdf485ed0db84f74868a2c265c56d1d4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155fc36248c04168afbd796e9ee66493 in term 3.
I20260709 14:49:59.709607  7253 leader_election.cc:304] T e93fd08a04f04602bb98df0aca9a314e P 155fc36248c04168afbd796e9ee66493 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155fc36248c04168afbd796e9ee66493, fdf485ed0db84f74868a2c265c56d1d4; no voters: 
I20260709 14:49:59.710469  7438 raft_consensus.cc:2468] T e93fd08a04f04602bb98df0aca9a314e P 68f78fc64ad74f9fa62efb081a46832d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155fc36248c04168afbd796e9ee66493 in term 3.
I20260709 14:49:59.710631  7581 raft_consensus.cc:2804] T e93fd08a04f04602bb98df0aca9a314e P 155fc36248c04168afbd796e9ee66493 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 14:49:59.712311  7581 raft_consensus.cc:697] T e93fd08a04f04602bb98df0aca9a314e P 155fc36248c04168afbd796e9ee66493 [term 3 LEADER]: Becoming Leader. State: Replica: 155fc36248c04168afbd796e9ee66493, State: Running, Role: LEADER
I20260709 14:49:59.713465  7581 consensus_queue.cc:237] T e93fd08a04f04602bb98df0aca9a314e P 155fc36248c04168afbd796e9ee66493 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
I20260709 14:49:59.722298  7186 catalog_manager.cc:5697] T e93fd08a04f04602bb98df0aca9a314e P 155fc36248c04168afbd796e9ee66493 reported cstate change: term changed from 2 to 3, leader changed from 68f78fc64ad74f9fa62efb081a46832d (127.6.101.67) to 155fc36248c04168afbd796e9ee66493 (127.6.101.65). New cstate: current_term: 3 leader_uuid: "155fc36248c04168afbd796e9ee66493" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } health_report { overall_health: UNKNOWN } } }
I20260709 14:49:59.776710  7561 raft_consensus.cc:993] T 1d10779bfab7437babc4a1e815792595 P fdf485ed0db84f74868a2c265c56d1d4: : Instructing follower 155fc36248c04168afbd796e9ee66493 to start an election
I20260709 14:49:59.777274  7604 raft_consensus.cc:1081] T 1d10779bfab7437babc4a1e815792595 P fdf485ed0db84f74868a2c265c56d1d4 [term 2 LEADER]: Signalling peer 155fc36248c04168afbd796e9ee66493 to start an election
I20260709 14:49:59.779424  7287 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1d10779bfab7437babc4a1e815792595"
dest_uuid: "155fc36248c04168afbd796e9ee66493"
 from {username='slave'} at 127.0.0.1:55176
I20260709 14:49:59.780035  7287 raft_consensus.cc:493] T 1d10779bfab7437babc4a1e815792595 P 155fc36248c04168afbd796e9ee66493 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:49:59.780368  7287 raft_consensus.cc:3060] T 1d10779bfab7437babc4a1e815792595 P 155fc36248c04168afbd796e9ee66493 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:49:59.786432  7287 raft_consensus.cc:515] T 1d10779bfab7437babc4a1e815792595 P 155fc36248c04168afbd796e9ee66493 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
I20260709 14:49:59.788324  7287 leader_election.cc:290] T 1d10779bfab7437babc4a1e815792595 P 155fc36248c04168afbd796e9ee66493 [CANDIDATE]: Term 3 election: Requested vote from peers fdf485ed0db84f74868a2c265c56d1d4 (127.6.101.66:35791), 68f78fc64ad74f9fa62efb081a46832d (127.6.101.67:42957)
I20260709 14:49:59.789878  7364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d10779bfab7437babc4a1e815792595" candidate_uuid: "155fc36248c04168afbd796e9ee66493" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fdf485ed0db84f74868a2c265c56d1d4"
I20260709 14:49:59.790714  7364 raft_consensus.cc:3055] T 1d10779bfab7437babc4a1e815792595 P fdf485ed0db84f74868a2c265c56d1d4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 14:49:59.791019  7364 raft_consensus.cc:740] T 1d10779bfab7437babc4a1e815792595 P fdf485ed0db84f74868a2c265c56d1d4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fdf485ed0db84f74868a2c265c56d1d4, State: Running, Role: LEADER
I20260709 14:49:59.790861  7438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d10779bfab7437babc4a1e815792595" candidate_uuid: "155fc36248c04168afbd796e9ee66493" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "68f78fc64ad74f9fa62efb081a46832d"
I20260709 14:49:59.791656  7438 raft_consensus.cc:3060] T 1d10779bfab7437babc4a1e815792595 P 68f78fc64ad74f9fa62efb081a46832d [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:49:59.791913  7364 consensus_queue.cc:260] T 1d10779bfab7437babc4a1e815792595 P fdf485ed0db84f74868a2c265c56d1d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
I20260709 14:49:59.793215  7364 raft_consensus.cc:3060] T 1d10779bfab7437babc4a1e815792595 P fdf485ed0db84f74868a2c265c56d1d4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:49:59.796679  7584 raft_consensus.cc:993] T cddd2927548e4e20b5cc004d23d36978 P 68f78fc64ad74f9fa62efb081a46832d: : Instructing follower 155fc36248c04168afbd796e9ee66493 to start an election
I20260709 14:49:59.797588  7584 raft_consensus.cc:1081] T cddd2927548e4e20b5cc004d23d36978 P 68f78fc64ad74f9fa62efb081a46832d [term 3 LEADER]: Signalling peer 155fc36248c04168afbd796e9ee66493 to start an election
I20260709 14:49:59.800176  7288 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cddd2927548e4e20b5cc004d23d36978"
dest_uuid: "155fc36248c04168afbd796e9ee66493"
 from {username='slave'} at 127.0.0.1:55172
I20260709 14:49:59.800848  7288 raft_consensus.cc:493] T cddd2927548e4e20b5cc004d23d36978 P 155fc36248c04168afbd796e9ee66493 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:49:59.801232  7288 raft_consensus.cc:3060] T cddd2927548e4e20b5cc004d23d36978 P 155fc36248c04168afbd796e9ee66493 [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:49:59.803269  7438 raft_consensus.cc:2468] T 1d10779bfab7437babc4a1e815792595 P 68f78fc64ad74f9fa62efb081a46832d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155fc36248c04168afbd796e9ee66493 in term 3.
I20260709 14:49:59.805603  7253 leader_election.cc:304] T 1d10779bfab7437babc4a1e815792595 P 155fc36248c04168afbd796e9ee66493 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155fc36248c04168afbd796e9ee66493, 68f78fc64ad74f9fa62efb081a46832d; no voters: 
I20260709 14:49:59.806596  7581 raft_consensus.cc:2804] T 1d10779bfab7437babc4a1e815792595 P 155fc36248c04168afbd796e9ee66493 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 14:49:59.807101  7581 raft_consensus.cc:697] T 1d10779bfab7437babc4a1e815792595 P 155fc36248c04168afbd796e9ee66493 [term 3 LEADER]: Becoming Leader. State: Replica: 155fc36248c04168afbd796e9ee66493, State: Running, Role: LEADER
I20260709 14:49:59.807984  7364 raft_consensus.cc:2468] T 1d10779bfab7437babc4a1e815792595 P fdf485ed0db84f74868a2c265c56d1d4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155fc36248c04168afbd796e9ee66493 in term 3.
I20260709 14:49:59.808037  7581 consensus_queue.cc:237] T 1d10779bfab7437babc4a1e815792595 P 155fc36248c04168afbd796e9ee66493 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
I20260709 14:49:59.811064  7288 raft_consensus.cc:515] T cddd2927548e4e20b5cc004d23d36978 P 155fc36248c04168afbd796e9ee66493 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
I20260709 14:49:59.813445  7288 leader_election.cc:290] T cddd2927548e4e20b5cc004d23d36978 P 155fc36248c04168afbd796e9ee66493 [CANDIDATE]: Term 4 election: Requested vote from peers fdf485ed0db84f74868a2c265c56d1d4 (127.6.101.66:35791), 68f78fc64ad74f9fa62efb081a46832d (127.6.101.67:42957)
I20260709 14:49:59.814977  7364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cddd2927548e4e20b5cc004d23d36978" candidate_uuid: "155fc36248c04168afbd796e9ee66493" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "fdf485ed0db84f74868a2c265c56d1d4"
I20260709 14:49:59.815227  7438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cddd2927548e4e20b5cc004d23d36978" candidate_uuid: "155fc36248c04168afbd796e9ee66493" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "68f78fc64ad74f9fa62efb081a46832d"
I20260709 14:49:59.815610  7364 raft_consensus.cc:3060] T cddd2927548e4e20b5cc004d23d36978 P fdf485ed0db84f74868a2c265c56d1d4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:49:59.815871  7438 raft_consensus.cc:3055] T cddd2927548e4e20b5cc004d23d36978 P 68f78fc64ad74f9fa62efb081a46832d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 14:49:59.816296  7438 raft_consensus.cc:740] T cddd2927548e4e20b5cc004d23d36978 P 68f78fc64ad74f9fa62efb081a46832d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 68f78fc64ad74f9fa62efb081a46832d, State: Running, Role: LEADER
I20260709 14:49:59.817058  7438 consensus_queue.cc:260] T cddd2927548e4e20b5cc004d23d36978 P 68f78fc64ad74f9fa62efb081a46832d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
I20260709 14:49:59.816993  7186 catalog_manager.cc:5697] T 1d10779bfab7437babc4a1e815792595 P 155fc36248c04168afbd796e9ee66493 reported cstate change: term changed from 2 to 3, leader changed from fdf485ed0db84f74868a2c265c56d1d4 (127.6.101.66) to 155fc36248c04168afbd796e9ee66493 (127.6.101.65). New cstate: current_term: 3 leader_uuid: "155fc36248c04168afbd796e9ee66493" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } health_report { overall_health: UNKNOWN } } }
I20260709 14:49:59.818357  7438 raft_consensus.cc:3060] T cddd2927548e4e20b5cc004d23d36978 P 68f78fc64ad74f9fa62efb081a46832d [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:49:59.822225  7364 raft_consensus.cc:2468] T cddd2927548e4e20b5cc004d23d36978 P fdf485ed0db84f74868a2c265c56d1d4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155fc36248c04168afbd796e9ee66493 in term 4.
I20260709 14:49:59.823473  7253 leader_election.cc:304] T cddd2927548e4e20b5cc004d23d36978 P 155fc36248c04168afbd796e9ee66493 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155fc36248c04168afbd796e9ee66493, fdf485ed0db84f74868a2c265c56d1d4; no voters: 
I20260709 14:49:59.824227  7581 raft_consensus.cc:2804] T cddd2927548e4e20b5cc004d23d36978 P 155fc36248c04168afbd796e9ee66493 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 14:49:59.824697  7581 raft_consensus.cc:697] T cddd2927548e4e20b5cc004d23d36978 P 155fc36248c04168afbd796e9ee66493 [term 4 LEADER]: Becoming Leader. State: Replica: 155fc36248c04168afbd796e9ee66493, State: Running, Role: LEADER
I20260709 14:49:59.825544  7581 consensus_queue.cc:237] T cddd2927548e4e20b5cc004d23d36978 P 155fc36248c04168afbd796e9ee66493 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
I20260709 14:49:59.826566  7438 raft_consensus.cc:2468] T cddd2927548e4e20b5cc004d23d36978 P 68f78fc64ad74f9fa62efb081a46832d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155fc36248c04168afbd796e9ee66493 in term 4.
I20260709 14:49:59.833031  7186 catalog_manager.cc:5697] T cddd2927548e4e20b5cc004d23d36978 P 155fc36248c04168afbd796e9ee66493 reported cstate change: term changed from 3 to 4, leader changed from 68f78fc64ad74f9fa62efb081a46832d (127.6.101.67) to 155fc36248c04168afbd796e9ee66493 (127.6.101.65). New cstate: current_term: 4 leader_uuid: "155fc36248c04168afbd796e9ee66493" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } health_report { overall_health: UNKNOWN } } }
I20260709 14:49:59.898937  7561 raft_consensus.cc:993] T 22ad3bca8c6b4fa982bb8611615a69dd P fdf485ed0db84f74868a2c265c56d1d4: : Instructing follower 155fc36248c04168afbd796e9ee66493 to start an election
I20260709 14:49:59.899451  7561 raft_consensus.cc:1081] T 22ad3bca8c6b4fa982bb8611615a69dd P fdf485ed0db84f74868a2c265c56d1d4 [term 2 LEADER]: Signalling peer 155fc36248c04168afbd796e9ee66493 to start an election
I20260709 14:49:59.902263  7288 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "22ad3bca8c6b4fa982bb8611615a69dd"
dest_uuid: "155fc36248c04168afbd796e9ee66493"
 from {username='slave'} at 127.0.0.1:55176
I20260709 14:49:59.902848  7288 raft_consensus.cc:493] T 22ad3bca8c6b4fa982bb8611615a69dd P 155fc36248c04168afbd796e9ee66493 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:49:59.903182  7288 raft_consensus.cc:3060] T 22ad3bca8c6b4fa982bb8611615a69dd P 155fc36248c04168afbd796e9ee66493 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:49:59.910394  7288 raft_consensus.cc:515] T 22ad3bca8c6b4fa982bb8611615a69dd P 155fc36248c04168afbd796e9ee66493 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
I20260709 14:49:59.912297  7288 leader_election.cc:290] T 22ad3bca8c6b4fa982bb8611615a69dd P 155fc36248c04168afbd796e9ee66493 [CANDIDATE]: Term 3 election: Requested vote from peers fdf485ed0db84f74868a2c265c56d1d4 (127.6.101.66:35791), 68f78fc64ad74f9fa62efb081a46832d (127.6.101.67:42957)
I20260709 14:49:59.913582  7364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ad3bca8c6b4fa982bb8611615a69dd" candidate_uuid: "155fc36248c04168afbd796e9ee66493" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fdf485ed0db84f74868a2c265c56d1d4"
I20260709 14:49:59.913969  7438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ad3bca8c6b4fa982bb8611615a69dd" candidate_uuid: "155fc36248c04168afbd796e9ee66493" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "68f78fc64ad74f9fa62efb081a46832d"
I20260709 14:49:59.914322  7364 raft_consensus.cc:3055] T 22ad3bca8c6b4fa982bb8611615a69dd P fdf485ed0db84f74868a2c265c56d1d4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 14:49:59.914644  7438 raft_consensus.cc:3060] T 22ad3bca8c6b4fa982bb8611615a69dd P 68f78fc64ad74f9fa62efb081a46832d [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:49:59.914644  7364 raft_consensus.cc:740] T 22ad3bca8c6b4fa982bb8611615a69dd P fdf485ed0db84f74868a2c265c56d1d4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fdf485ed0db84f74868a2c265c56d1d4, State: Running, Role: LEADER
I20260709 14:49:59.915668  7364 consensus_queue.cc:260] T 22ad3bca8c6b4fa982bb8611615a69dd P fdf485ed0db84f74868a2c265c56d1d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
I20260709 14:49:59.916808  7364 raft_consensus.cc:3060] T 22ad3bca8c6b4fa982bb8611615a69dd P fdf485ed0db84f74868a2c265c56d1d4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:49:59.921741  7438 raft_consensus.cc:2468] T 22ad3bca8c6b4fa982bb8611615a69dd P 68f78fc64ad74f9fa62efb081a46832d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155fc36248c04168afbd796e9ee66493 in term 3.
I20260709 14:49:59.923493  7253 leader_election.cc:304] T 22ad3bca8c6b4fa982bb8611615a69dd P 155fc36248c04168afbd796e9ee66493 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155fc36248c04168afbd796e9ee66493, 68f78fc64ad74f9fa62efb081a46832d; no voters: 
I20260709 14:49:59.923497  7364 raft_consensus.cc:2468] T 22ad3bca8c6b4fa982bb8611615a69dd P fdf485ed0db84f74868a2c265c56d1d4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155fc36248c04168afbd796e9ee66493 in term 3.
I20260709 14:49:59.924407  7581 raft_consensus.cc:2804] T 22ad3bca8c6b4fa982bb8611615a69dd P 155fc36248c04168afbd796e9ee66493 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 14:49:59.924923  7581 raft_consensus.cc:697] T 22ad3bca8c6b4fa982bb8611615a69dd P 155fc36248c04168afbd796e9ee66493 [term 3 LEADER]: Becoming Leader. State: Replica: 155fc36248c04168afbd796e9ee66493, State: Running, Role: LEADER
I20260709 14:49:59.925747  7581 consensus_queue.cc:237] T 22ad3bca8c6b4fa982bb8611615a69dd P 155fc36248c04168afbd796e9ee66493 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
I20260709 14:49:59.933872  7186 catalog_manager.cc:5697] T 22ad3bca8c6b4fa982bb8611615a69dd P 155fc36248c04168afbd796e9ee66493 reported cstate change: term changed from 2 to 3, leader changed from fdf485ed0db84f74868a2c265c56d1d4 (127.6.101.66) to 155fc36248c04168afbd796e9ee66493 (127.6.101.65). New cstate: current_term: 3 leader_uuid: "155fc36248c04168afbd796e9ee66493" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } health_report { overall_health: UNKNOWN } } }
I20260709 14:50:00.045030  7604 raft_consensus.cc:993] T 21f5ecd80b0b421aad67b6ec53d594d2 P fdf485ed0db84f74868a2c265c56d1d4: : Instructing follower 155fc36248c04168afbd796e9ee66493 to start an election
I20260709 14:50:00.045930  7561 raft_consensus.cc:1081] T 21f5ecd80b0b421aad67b6ec53d594d2 P fdf485ed0db84f74868a2c265c56d1d4 [term 1 LEADER]: Signalling peer 155fc36248c04168afbd796e9ee66493 to start an election
I20260709 14:50:00.048017  7288 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "21f5ecd80b0b421aad67b6ec53d594d2"
dest_uuid: "155fc36248c04168afbd796e9ee66493"
 from {username='slave'} at 127.0.0.1:55176
I20260709 14:50:00.048583  7288 raft_consensus.cc:493] T 21f5ecd80b0b421aad67b6ec53d594d2 P 155fc36248c04168afbd796e9ee66493 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:50:00.048885  7288 raft_consensus.cc:3060] T 21f5ecd80b0b421aad67b6ec53d594d2 P 155fc36248c04168afbd796e9ee66493 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:00.055625  7288 raft_consensus.cc:515] T 21f5ecd80b0b421aad67b6ec53d594d2 P 155fc36248c04168afbd796e9ee66493 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
I20260709 14:50:00.057703  7288 leader_election.cc:290] T 21f5ecd80b0b421aad67b6ec53d594d2 P 155fc36248c04168afbd796e9ee66493 [CANDIDATE]: Term 2 election: Requested vote from peers fdf485ed0db84f74868a2c265c56d1d4 (127.6.101.66:35791), 68f78fc64ad74f9fa62efb081a46832d (127.6.101.67:42957)
I20260709 14:50:00.058812  7364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f5ecd80b0b421aad67b6ec53d594d2" candidate_uuid: "155fc36248c04168afbd796e9ee66493" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fdf485ed0db84f74868a2c265c56d1d4"
I20260709 14:50:00.059144  7438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f5ecd80b0b421aad67b6ec53d594d2" candidate_uuid: "155fc36248c04168afbd796e9ee66493" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "68f78fc64ad74f9fa62efb081a46832d"
I20260709 14:50:00.059305  7364 raft_consensus.cc:3055] T 21f5ecd80b0b421aad67b6ec53d594d2 P fdf485ed0db84f74868a2c265c56d1d4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 14:50:00.059732  7364 raft_consensus.cc:740] T 21f5ecd80b0b421aad67b6ec53d594d2 P fdf485ed0db84f74868a2c265c56d1d4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fdf485ed0db84f74868a2c265c56d1d4, State: Running, Role: LEADER
I20260709 14:50:00.059756  7438 raft_consensus.cc:3060] T 21f5ecd80b0b421aad67b6ec53d594d2 P 68f78fc64ad74f9fa62efb081a46832d [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:00.060480  7364 consensus_queue.cc:260] T 21f5ecd80b0b421aad67b6ec53d594d2 P fdf485ed0db84f74868a2c265c56d1d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
I20260709 14:50:00.061395  7364 raft_consensus.cc:3060] T 21f5ecd80b0b421aad67b6ec53d594d2 P fdf485ed0db84f74868a2c265c56d1d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:00.066659  7438 raft_consensus.cc:2468] T 21f5ecd80b0b421aad67b6ec53d594d2 P 68f78fc64ad74f9fa62efb081a46832d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155fc36248c04168afbd796e9ee66493 in term 2.
I20260709 14:50:00.067209  7364 raft_consensus.cc:2468] T 21f5ecd80b0b421aad67b6ec53d594d2 P fdf485ed0db84f74868a2c265c56d1d4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155fc36248c04168afbd796e9ee66493 in term 2.
I20260709 14:50:00.068043  7253 leader_election.cc:304] T 21f5ecd80b0b421aad67b6ec53d594d2 P 155fc36248c04168afbd796e9ee66493 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155fc36248c04168afbd796e9ee66493, 68f78fc64ad74f9fa62efb081a46832d; no voters: 
I20260709 14:50:00.068923  7581 raft_consensus.cc:2804] T 21f5ecd80b0b421aad67b6ec53d594d2 P 155fc36248c04168afbd796e9ee66493 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:50:00.069492  7581 raft_consensus.cc:697] T 21f5ecd80b0b421aad67b6ec53d594d2 P 155fc36248c04168afbd796e9ee66493 [term 2 LEADER]: Becoming Leader. State: Replica: 155fc36248c04168afbd796e9ee66493, State: Running, Role: LEADER
I20260709 14:50:00.070313  7581 consensus_queue.cc:237] T 21f5ecd80b0b421aad67b6ec53d594d2 P 155fc36248c04168afbd796e9ee66493 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
I20260709 14:50:00.077831  7186 catalog_manager.cc:5697] T 21f5ecd80b0b421aad67b6ec53d594d2 P 155fc36248c04168afbd796e9ee66493 reported cstate change: term changed from 1 to 2, leader changed from fdf485ed0db84f74868a2c265c56d1d4 (127.6.101.66) to 155fc36248c04168afbd796e9ee66493 (127.6.101.65). New cstate: current_term: 2 leader_uuid: "155fc36248c04168afbd796e9ee66493" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } health_report { overall_health: UNKNOWN } } }
I20260709 14:50:00.107125  7438 raft_consensus.cc:1275] T e93fd08a04f04602bb98df0aca9a314e P 68f78fc64ad74f9fa62efb081a46832d [term 3 FOLLOWER]: Refusing update from remote peer 155fc36248c04168afbd796e9ee66493: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 14:50:00.108934  7581 consensus_queue.cc:1048] T e93fd08a04f04602bb98df0aca9a314e P 155fc36248c04168afbd796e9ee66493 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 14:50:00.121058  7364 raft_consensus.cc:1275] T e93fd08a04f04602bb98df0aca9a314e P fdf485ed0db84f74868a2c265c56d1d4 [term 3 FOLLOWER]: Refusing update from remote peer 155fc36248c04168afbd796e9ee66493: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 14:50:00.122665  7600 consensus_queue.cc:1048] T e93fd08a04f04602bb98df0aca9a314e P 155fc36248c04168afbd796e9ee66493 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 14:50:00.365111  7364 raft_consensus.cc:1275] T 1d10779bfab7437babc4a1e815792595 P fdf485ed0db84f74868a2c265c56d1d4 [term 3 FOLLOWER]: Refusing update from remote peer 155fc36248c04168afbd796e9ee66493: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 14:50:00.367501  7600 consensus_queue.cc:1048] T 1d10779bfab7437babc4a1e815792595 P 155fc36248c04168afbd796e9ee66493 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 14:50:00.370245  7438 raft_consensus.cc:1275] T cddd2927548e4e20b5cc004d23d36978 P 68f78fc64ad74f9fa62efb081a46832d [term 4 FOLLOWER]: Refusing update from remote peer 155fc36248c04168afbd796e9ee66493: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 14:50:00.372833  7600 consensus_queue.cc:1048] T cddd2927548e4e20b5cc004d23d36978 P 155fc36248c04168afbd796e9ee66493 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 14:50:00.375226  7362 raft_consensus.cc:1275] T cddd2927548e4e20b5cc004d23d36978 P fdf485ed0db84f74868a2c265c56d1d4 [term 4 FOLLOWER]: Refusing update from remote peer 155fc36248c04168afbd796e9ee66493: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 14:50:00.380721  7614 consensus_queue.cc:1048] T cddd2927548e4e20b5cc004d23d36978 P 155fc36248c04168afbd796e9ee66493 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 14:50:00.387986  7436 raft_consensus.cc:1275] T 1d10779bfab7437babc4a1e815792595 P 68f78fc64ad74f9fa62efb081a46832d [term 3 FOLLOWER]: Refusing update from remote peer 155fc36248c04168afbd796e9ee66493: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 14:50:00.391362  7614 consensus_queue.cc:1048] T 1d10779bfab7437babc4a1e815792595 P 155fc36248c04168afbd796e9ee66493 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 14:50:00.458156  7362 raft_consensus.cc:1275] T 22ad3bca8c6b4fa982bb8611615a69dd P fdf485ed0db84f74868a2c265c56d1d4 [term 3 FOLLOWER]: Refusing update from remote peer 155fc36248c04168afbd796e9ee66493: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 14:50:00.460866  7600 consensus_queue.cc:1048] T 22ad3bca8c6b4fa982bb8611615a69dd P 155fc36248c04168afbd796e9ee66493 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 14:50:00.472286  7436 raft_consensus.cc:1275] T 22ad3bca8c6b4fa982bb8611615a69dd P 68f78fc64ad74f9fa62efb081a46832d [term 3 FOLLOWER]: Refusing update from remote peer 155fc36248c04168afbd796e9ee66493: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 14:50:00.476385  7614 consensus_queue.cc:1048] T 22ad3bca8c6b4fa982bb8611615a69dd P 155fc36248c04168afbd796e9ee66493 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 14:50:00.635944  7362 raft_consensus.cc:1275] T 21f5ecd80b0b421aad67b6ec53d594d2 P fdf485ed0db84f74868a2c265c56d1d4 [term 2 FOLLOWER]: Refusing update from remote peer 155fc36248c04168afbd796e9ee66493: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:50:00.637926  7614 consensus_queue.cc:1048] T 21f5ecd80b0b421aad67b6ec53d594d2 P 155fc36248c04168afbd796e9ee66493 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 14:50:00.650525  7436 raft_consensus.cc:1275] T 21f5ecd80b0b421aad67b6ec53d594d2 P 68f78fc64ad74f9fa62efb081a46832d [term 2 FOLLOWER]: Refusing update from remote peer 155fc36248c04168afbd796e9ee66493: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:50:00.653605  7614 consensus_queue.cc:1048] T 21f5ecd80b0b421aad67b6ec53d594d2 P 155fc36248c04168afbd796e9ee66493 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 14:50:02.644727  6549 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 14:50:02.656808  7288 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1d10779bfab7437babc4a1e815792595"
dest_uuid: "155fc36248c04168afbd796e9ee66493"
mode: GRACEFUL
new_leader_uuid: "fdf485ed0db84f74868a2c265c56d1d4"
 from {username='slave'} at 127.0.0.1:55192
I20260709 14:50:02.657730  7288 raft_consensus.cc:606] T 1d10779bfab7437babc4a1e815792595 P 155fc36248c04168afbd796e9ee66493 [term 3 LEADER]: Received request to transfer leadership to TS fdf485ed0db84f74868a2c265c56d1d4
I20260709 14:50:02.661988  7288 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "36fe96aff6384e2d807b9f4d1bc8a544"
dest_uuid: "155fc36248c04168afbd796e9ee66493"
mode: GRACEFUL
new_leader_uuid: "68f78fc64ad74f9fa62efb081a46832d"
 from {username='slave'} at 127.0.0.1:55192
I20260709 14:50:02.662767  7288 raft_consensus.cc:606] T 36fe96aff6384e2d807b9f4d1bc8a544 P 155fc36248c04168afbd796e9ee66493 [term 2 LEADER]: Received request to transfer leadership to TS 68f78fc64ad74f9fa62efb081a46832d
I20260709 14:50:02.666612  7288 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "79853f64be7f4e5ebb08a711d87bcede"
dest_uuid: "155fc36248c04168afbd796e9ee66493"
mode: GRACEFUL
new_leader_uuid: "fdf485ed0db84f74868a2c265c56d1d4"
 from {username='slave'} at 127.0.0.1:55192
I20260709 14:50:02.667726  7288 raft_consensus.cc:606] T 79853f64be7f4e5ebb08a711d87bcede P 155fc36248c04168afbd796e9ee66493 [term 1 LEADER]: Received request to transfer leadership to TS fdf485ed0db84f74868a2c265c56d1d4
I20260709 14:50:02.671391  7288 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cddd2927548e4e20b5cc004d23d36978"
dest_uuid: "155fc36248c04168afbd796e9ee66493"
mode: GRACEFUL
new_leader_uuid: "68f78fc64ad74f9fa62efb081a46832d"
 from {username='slave'} at 127.0.0.1:55192
I20260709 14:50:02.672415  7288 raft_consensus.cc:606] T cddd2927548e4e20b5cc004d23d36978 P 155fc36248c04168afbd796e9ee66493 [term 4 LEADER]: Received request to transfer leadership to TS 68f78fc64ad74f9fa62efb081a46832d
I20260709 14:50:02.675170  6549 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 14:50:02.675971  6549 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 14:50:02.809233  7614 raft_consensus.cc:993] T 79853f64be7f4e5ebb08a711d87bcede P 155fc36248c04168afbd796e9ee66493: : Instructing follower fdf485ed0db84f74868a2c265c56d1d4 to start an election
I20260709 14:50:02.809840  7614 raft_consensus.cc:1081] T 79853f64be7f4e5ebb08a711d87bcede P 155fc36248c04168afbd796e9ee66493 [term 1 LEADER]: Signalling peer fdf485ed0db84f74868a2c265c56d1d4 to start an election
I20260709 14:50:02.812203  7362 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "79853f64be7f4e5ebb08a711d87bcede"
dest_uuid: "fdf485ed0db84f74868a2c265c56d1d4"
 from {username='slave'} at 127.0.0.1:43012
I20260709 14:50:02.812819  7362 raft_consensus.cc:493] T 79853f64be7f4e5ebb08a711d87bcede P fdf485ed0db84f74868a2c265c56d1d4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:50:02.813225  7362 raft_consensus.cc:3060] T 79853f64be7f4e5ebb08a711d87bcede P fdf485ed0db84f74868a2c265c56d1d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:02.825090  7362 raft_consensus.cc:515] T 79853f64be7f4e5ebb08a711d87bcede P fdf485ed0db84f74868a2c265c56d1d4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
I20260709 14:50:02.827909  7362 leader_election.cc:290] T 79853f64be7f4e5ebb08a711d87bcede P fdf485ed0db84f74868a2c265c56d1d4 [CANDIDATE]: Term 2 election: Requested vote from peers 155fc36248c04168afbd796e9ee66493 (127.6.101.65:43743), 68f78fc64ad74f9fa62efb081a46832d (127.6.101.67:42957)
I20260709 14:50:02.829434  7288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79853f64be7f4e5ebb08a711d87bcede" candidate_uuid: "fdf485ed0db84f74868a2c265c56d1d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "155fc36248c04168afbd796e9ee66493"
I20260709 14:50:02.830214  7438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79853f64be7f4e5ebb08a711d87bcede" candidate_uuid: "fdf485ed0db84f74868a2c265c56d1d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "68f78fc64ad74f9fa62efb081a46832d"
I20260709 14:50:02.830401  7288 raft_consensus.cc:3055] T 79853f64be7f4e5ebb08a711d87bcede P 155fc36248c04168afbd796e9ee66493 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 14:50:02.830891  7438 raft_consensus.cc:3060] T 79853f64be7f4e5ebb08a711d87bcede P 68f78fc64ad74f9fa62efb081a46832d [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:02.830839  7288 raft_consensus.cc:740] T 79853f64be7f4e5ebb08a711d87bcede P 155fc36248c04168afbd796e9ee66493 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 155fc36248c04168afbd796e9ee66493, State: Running, Role: LEADER
I20260709 14:50:02.832006  7288 consensus_queue.cc:260] T 79853f64be7f4e5ebb08a711d87bcede P 155fc36248c04168afbd796e9ee66493 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
I20260709 14:50:02.833544  7288 raft_consensus.cc:3060] T 79853f64be7f4e5ebb08a711d87bcede P 155fc36248c04168afbd796e9ee66493 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:02.841074  7438 raft_consensus.cc:2468] T 79853f64be7f4e5ebb08a711d87bcede P 68f78fc64ad74f9fa62efb081a46832d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fdf485ed0db84f74868a2c265c56d1d4 in term 2.
I20260709 14:50:02.844908  7328 leader_election.cc:304] T 79853f64be7f4e5ebb08a711d87bcede P fdf485ed0db84f74868a2c265c56d1d4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68f78fc64ad74f9fa62efb081a46832d, fdf485ed0db84f74868a2c265c56d1d4; no voters: 
I20260709 14:50:02.846066  7288 raft_consensus.cc:2468] T 79853f64be7f4e5ebb08a711d87bcede P 155fc36248c04168afbd796e9ee66493 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fdf485ed0db84f74868a2c265c56d1d4 in term 2.
I20260709 14:50:02.846342  7561 raft_consensus.cc:2804] T 79853f64be7f4e5ebb08a711d87bcede P fdf485ed0db84f74868a2c265c56d1d4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:50:02.847834  7561 raft_consensus.cc:697] T 79853f64be7f4e5ebb08a711d87bcede P fdf485ed0db84f74868a2c265c56d1d4 [term 2 LEADER]: Becoming Leader. State: Replica: fdf485ed0db84f74868a2c265c56d1d4, State: Running, Role: LEADER
I20260709 14:50:02.849123  7561 consensus_queue.cc:237] T 79853f64be7f4e5ebb08a711d87bcede P fdf485ed0db84f74868a2c265c56d1d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
I20260709 14:50:02.862855  7186 catalog_manager.cc:5697] T 79853f64be7f4e5ebb08a711d87bcede P fdf485ed0db84f74868a2c265c56d1d4 reported cstate change: term changed from 1 to 2, leader changed from 155fc36248c04168afbd796e9ee66493 (127.6.101.65) to fdf485ed0db84f74868a2c265c56d1d4 (127.6.101.66). New cstate: current_term: 2 leader_uuid: "fdf485ed0db84f74868a2c265c56d1d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } health_report { overall_health: UNKNOWN } } }
I20260709 14:50:02.868793  7621 raft_consensus.cc:993] T 36fe96aff6384e2d807b9f4d1bc8a544 P 155fc36248c04168afbd796e9ee66493: : Instructing follower 68f78fc64ad74f9fa62efb081a46832d to start an election
I20260709 14:50:02.869778  7621 raft_consensus.cc:1081] T 36fe96aff6384e2d807b9f4d1bc8a544 P 155fc36248c04168afbd796e9ee66493 [term 2 LEADER]: Signalling peer 68f78fc64ad74f9fa62efb081a46832d to start an election
I20260709 14:50:02.874927  7438 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "36fe96aff6384e2d807b9f4d1bc8a544"
dest_uuid: "68f78fc64ad74f9fa62efb081a46832d"
 from {username='slave'} at 127.0.0.1:39436
I20260709 14:50:02.875782  7438 raft_consensus.cc:493] T 36fe96aff6384e2d807b9f4d1bc8a544 P 68f78fc64ad74f9fa62efb081a46832d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:50:02.876209  7438 raft_consensus.cc:3060] T 36fe96aff6384e2d807b9f4d1bc8a544 P 68f78fc64ad74f9fa62efb081a46832d [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:50:02.889364  7614 raft_consensus.cc:993] T cddd2927548e4e20b5cc004d23d36978 P 155fc36248c04168afbd796e9ee66493: : Instructing follower 68f78fc64ad74f9fa62efb081a46832d to start an election
I20260709 14:50:02.889575  7438 raft_consensus.cc:515] T 36fe96aff6384e2d807b9f4d1bc8a544 P 68f78fc64ad74f9fa62efb081a46832d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } }
I20260709 14:50:02.890462  7621 raft_consensus.cc:1081] T cddd2927548e4e20b5cc004d23d36978 P 155fc36248c04168afbd796e9ee66493 [term 4 LEADER]: Signalling peer 68f78fc64ad74f9fa62efb081a46832d to start an election
I20260709 14:50:02.892125  7438 leader_election.cc:290] T 36fe96aff6384e2d807b9f4d1bc8a544 P 68f78fc64ad74f9fa62efb081a46832d [CANDIDATE]: Term 3 election: Requested vote from peers fdf485ed0db84f74868a2c265c56d1d4 (127.6.101.66:35791), 155fc36248c04168afbd796e9ee66493 (127.6.101.65:43743)
I20260709 14:50:02.893055  7362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36fe96aff6384e2d807b9f4d1bc8a544" candidate_uuid: "68f78fc64ad74f9fa62efb081a46832d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fdf485ed0db84f74868a2c265c56d1d4"
I20260709 14:50:02.893608  7436 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cddd2927548e4e20b5cc004d23d36978"
dest_uuid: "68f78fc64ad74f9fa62efb081a46832d"
 from {username='slave'} at 127.0.0.1:39436
I20260709 14:50:02.893687  7362 raft_consensus.cc:3060] T 36fe96aff6384e2d807b9f4d1bc8a544 P fdf485ed0db84f74868a2c265c56d1d4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:50:02.894198  7436 raft_consensus.cc:493] T cddd2927548e4e20b5cc004d23d36978 P 68f78fc64ad74f9fa62efb081a46832d [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:50:02.894505  7436 raft_consensus.cc:3060] T cddd2927548e4e20b5cc004d23d36978 P 68f78fc64ad74f9fa62efb081a46832d [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:50:02.894433  7288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36fe96aff6384e2d807b9f4d1bc8a544" candidate_uuid: "68f78fc64ad74f9fa62efb081a46832d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "155fc36248c04168afbd796e9ee66493"
I20260709 14:50:02.895318  7288 raft_consensus.cc:3055] T 36fe96aff6384e2d807b9f4d1bc8a544 P 155fc36248c04168afbd796e9ee66493 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 14:50:02.895658  7288 raft_consensus.cc:740] T 36fe96aff6384e2d807b9f4d1bc8a544 P 155fc36248c04168afbd796e9ee66493 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 155fc36248c04168afbd796e9ee66493, State: Running, Role: LEADER
I20260709 14:50:02.897311  7288 consensus_queue.cc:260] T 36fe96aff6384e2d807b9f4d1bc8a544 P 155fc36248c04168afbd796e9ee66493 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } }
I20260709 14:50:02.898602  7288 raft_consensus.cc:3060] T 36fe96aff6384e2d807b9f4d1bc8a544 P 155fc36248c04168afbd796e9ee66493 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:50:02.907361  7362 raft_consensus.cc:2468] T 36fe96aff6384e2d807b9f4d1bc8a544 P fdf485ed0db84f74868a2c265c56d1d4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68f78fc64ad74f9fa62efb081a46832d in term 3.
I20260709 14:50:02.908730  7402 leader_election.cc:304] T 36fe96aff6384e2d807b9f4d1bc8a544 P 68f78fc64ad74f9fa62efb081a46832d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68f78fc64ad74f9fa62efb081a46832d, fdf485ed0db84f74868a2c265c56d1d4; no voters: 
I20260709 14:50:02.910317  7288 raft_consensus.cc:2468] T 36fe96aff6384e2d807b9f4d1bc8a544 P 155fc36248c04168afbd796e9ee66493 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68f78fc64ad74f9fa62efb081a46832d in term 3.
I20260709 14:50:02.910385  7584 raft_consensus.cc:2804] T 36fe96aff6384e2d807b9f4d1bc8a544 P 68f78fc64ad74f9fa62efb081a46832d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 14:50:02.912194  7436 raft_consensus.cc:515] T cddd2927548e4e20b5cc004d23d36978 P 68f78fc64ad74f9fa62efb081a46832d [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
I20260709 14:50:02.913185  7584 raft_consensus.cc:697] T 36fe96aff6384e2d807b9f4d1bc8a544 P 68f78fc64ad74f9fa62efb081a46832d [term 3 LEADER]: Becoming Leader. State: Replica: 68f78fc64ad74f9fa62efb081a46832d, State: Running, Role: LEADER
I20260709 14:50:02.914642  7436 leader_election.cc:290] T cddd2927548e4e20b5cc004d23d36978 P 68f78fc64ad74f9fa62efb081a46832d [CANDIDATE]: Term 5 election: Requested vote from peers 155fc36248c04168afbd796e9ee66493 (127.6.101.65:43743), fdf485ed0db84f74868a2c265c56d1d4 (127.6.101.66:35791)
I20260709 14:50:02.919523  7288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cddd2927548e4e20b5cc004d23d36978" candidate_uuid: "68f78fc64ad74f9fa62efb081a46832d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "155fc36248c04168afbd796e9ee66493"
I20260709 14:50:02.920349  7288 raft_consensus.cc:3055] T cddd2927548e4e20b5cc004d23d36978 P 155fc36248c04168afbd796e9ee66493 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 14:50:02.920682  7288 raft_consensus.cc:740] T cddd2927548e4e20b5cc004d23d36978 P 155fc36248c04168afbd796e9ee66493 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 155fc36248c04168afbd796e9ee66493, State: Running, Role: LEADER
I20260709 14:50:02.920715  7364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cddd2927548e4e20b5cc004d23d36978" candidate_uuid: "68f78fc64ad74f9fa62efb081a46832d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "fdf485ed0db84f74868a2c265c56d1d4"
I20260709 14:50:02.921479  7364 raft_consensus.cc:3060] T cddd2927548e4e20b5cc004d23d36978 P fdf485ed0db84f74868a2c265c56d1d4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:50:02.921762  7288 consensus_queue.cc:260] T cddd2927548e4e20b5cc004d23d36978 P 155fc36248c04168afbd796e9ee66493 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
I20260709 14:50:02.923257  7614 raft_consensus.cc:993] T 1d10779bfab7437babc4a1e815792595 P 155fc36248c04168afbd796e9ee66493: : Instructing follower fdf485ed0db84f74868a2c265c56d1d4 to start an election
I20260709 14:50:02.921546  7584 consensus_queue.cc:237] T 36fe96aff6384e2d807b9f4d1bc8a544 P 68f78fc64ad74f9fa62efb081a46832d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } }
I20260709 14:50:02.923870  7614 raft_consensus.cc:1081] T 1d10779bfab7437babc4a1e815792595 P 155fc36248c04168afbd796e9ee66493 [term 3 LEADER]: Signalling peer fdf485ed0db84f74868a2c265c56d1d4 to start an election
I20260709 14:50:02.923717  7288 raft_consensus.cc:3060] T cddd2927548e4e20b5cc004d23d36978 P 155fc36248c04168afbd796e9ee66493 [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:50:02.926936  7362 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1d10779bfab7437babc4a1e815792595"
dest_uuid: "fdf485ed0db84f74868a2c265c56d1d4"
 from {username='slave'} at 127.0.0.1:43012
I20260709 14:50:02.927964  7362 raft_consensus.cc:493] T 1d10779bfab7437babc4a1e815792595 P fdf485ed0db84f74868a2c265c56d1d4 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:50:02.928588  7362 raft_consensus.cc:3060] T 1d10779bfab7437babc4a1e815792595 P fdf485ed0db84f74868a2c265c56d1d4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:50:02.935199  7288 raft_consensus.cc:2468] T cddd2927548e4e20b5cc004d23d36978 P 155fc36248c04168afbd796e9ee66493 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68f78fc64ad74f9fa62efb081a46832d in term 5.
I20260709 14:50:02.937170  7401 leader_election.cc:304] T cddd2927548e4e20b5cc004d23d36978 P 68f78fc64ad74f9fa62efb081a46832d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155fc36248c04168afbd796e9ee66493, 68f78fc64ad74f9fa62efb081a46832d; no voters: 
I20260709 14:50:02.938707  7629 raft_consensus.cc:2804] T cddd2927548e4e20b5cc004d23d36978 P 68f78fc64ad74f9fa62efb081a46832d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 14:50:02.945180  7364 raft_consensus.cc:2468] T cddd2927548e4e20b5cc004d23d36978 P fdf485ed0db84f74868a2c265c56d1d4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68f78fc64ad74f9fa62efb081a46832d in term 5.
I20260709 14:50:02.949733  7629 raft_consensus.cc:697] T cddd2927548e4e20b5cc004d23d36978 P 68f78fc64ad74f9fa62efb081a46832d [term 5 LEADER]: Becoming Leader. State: Replica: 68f78fc64ad74f9fa62efb081a46832d, State: Running, Role: LEADER
I20260709 14:50:02.951622  7629 consensus_queue.cc:237] T cddd2927548e4e20b5cc004d23d36978 P 68f78fc64ad74f9fa62efb081a46832d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
I20260709 14:50:02.964727  7186 catalog_manager.cc:5697] T 36fe96aff6384e2d807b9f4d1bc8a544 P 68f78fc64ad74f9fa62efb081a46832d reported cstate change: term changed from 2 to 3, leader changed from 155fc36248c04168afbd796e9ee66493 (127.6.101.65) to 68f78fc64ad74f9fa62efb081a46832d (127.6.101.67). New cstate: current_term: 3 leader_uuid: "68f78fc64ad74f9fa62efb081a46832d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } health_report { overall_health: UNKNOWN } } }
I20260709 14:50:02.965477  7362 raft_consensus.cc:515] T 1d10779bfab7437babc4a1e815792595 P fdf485ed0db84f74868a2c265c56d1d4 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
I20260709 14:50:02.968441  7362 leader_election.cc:290] T 1d10779bfab7437babc4a1e815792595 P fdf485ed0db84f74868a2c265c56d1d4 [CANDIDATE]: Term 4 election: Requested vote from peers 155fc36248c04168afbd796e9ee66493 (127.6.101.65:43743), 68f78fc64ad74f9fa62efb081a46832d (127.6.101.67:42957)
I20260709 14:50:02.968964  7288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d10779bfab7437babc4a1e815792595" candidate_uuid: "fdf485ed0db84f74868a2c265c56d1d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "155fc36248c04168afbd796e9ee66493"
I20260709 14:50:02.969781  7288 raft_consensus.cc:3055] T 1d10779bfab7437babc4a1e815792595 P 155fc36248c04168afbd796e9ee66493 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 14:50:02.970069  7288 raft_consensus.cc:740] T 1d10779bfab7437babc4a1e815792595 P 155fc36248c04168afbd796e9ee66493 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 155fc36248c04168afbd796e9ee66493, State: Running, Role: LEADER
I20260709 14:50:02.970453  7436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d10779bfab7437babc4a1e815792595" candidate_uuid: "fdf485ed0db84f74868a2c265c56d1d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "68f78fc64ad74f9fa62efb081a46832d"
I20260709 14:50:02.970691  7288 consensus_queue.cc:260] T 1d10779bfab7437babc4a1e815792595 P 155fc36248c04168afbd796e9ee66493 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
I20260709 14:50:02.971153  7436 raft_consensus.cc:3060] T 1d10779bfab7437babc4a1e815792595 P 68f78fc64ad74f9fa62efb081a46832d [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:50:02.971904  7288 raft_consensus.cc:3060] T 1d10779bfab7437babc4a1e815792595 P 155fc36248c04168afbd796e9ee66493 [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:50:02.980391  7436 raft_consensus.cc:2468] T 1d10779bfab7437babc4a1e815792595 P 68f78fc64ad74f9fa62efb081a46832d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fdf485ed0db84f74868a2c265c56d1d4 in term 4.
I20260709 14:50:02.981838  7328 leader_election.cc:304] T 1d10779bfab7437babc4a1e815792595 P fdf485ed0db84f74868a2c265c56d1d4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68f78fc64ad74f9fa62efb081a46832d, fdf485ed0db84f74868a2c265c56d1d4; no voters: 
I20260709 14:50:02.982945  7561 raft_consensus.cc:2804] T 1d10779bfab7437babc4a1e815792595 P fdf485ed0db84f74868a2c265c56d1d4 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 14:50:02.986733  7288 raft_consensus.cc:2468] T 1d10779bfab7437babc4a1e815792595 P 155fc36248c04168afbd796e9ee66493 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fdf485ed0db84f74868a2c265c56d1d4 in term 4.
I20260709 14:50:02.988022  7561 raft_consensus.cc:697] T 1d10779bfab7437babc4a1e815792595 P fdf485ed0db84f74868a2c265c56d1d4 [term 4 LEADER]: Becoming Leader. State: Replica: fdf485ed0db84f74868a2c265c56d1d4, State: Running, Role: LEADER
I20260709 14:50:02.990456  7186 catalog_manager.cc:5697] T cddd2927548e4e20b5cc004d23d36978 P 68f78fc64ad74f9fa62efb081a46832d reported cstate change: term changed from 4 to 5, leader changed from 155fc36248c04168afbd796e9ee66493 (127.6.101.65) to 68f78fc64ad74f9fa62efb081a46832d (127.6.101.67). New cstate: current_term: 5 leader_uuid: "68f78fc64ad74f9fa62efb081a46832d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } health_report { overall_health: HEALTHY } } }
I20260709 14:50:02.990598  7561 consensus_queue.cc:237] T 1d10779bfab7437babc4a1e815792595 P fdf485ed0db84f74868a2c265c56d1d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } }
I20260709 14:50:03.006546  7185 catalog_manager.cc:5697] T 1d10779bfab7437babc4a1e815792595 P fdf485ed0db84f74868a2c265c56d1d4 reported cstate change: term changed from 3 to 4, leader changed from 155fc36248c04168afbd796e9ee66493 (127.6.101.65) to fdf485ed0db84f74868a2c265c56d1d4 (127.6.101.66). New cstate: current_term: 4 leader_uuid: "fdf485ed0db84f74868a2c265c56d1d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 } health_report { overall_health: UNKNOWN } } }
I20260709 14:50:03.269950  7288 raft_consensus.cc:1275] T 79853f64be7f4e5ebb08a711d87bcede P 155fc36248c04168afbd796e9ee66493 [term 2 FOLLOWER]: Refusing update from remote peer fdf485ed0db84f74868a2c265c56d1d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:50:03.271914  7561 consensus_queue.cc:1048] T 79853f64be7f4e5ebb08a711d87bcede P fdf485ed0db84f74868a2c265c56d1d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 14:50:03.288759  7438 raft_consensus.cc:1275] T 79853f64be7f4e5ebb08a711d87bcede P 68f78fc64ad74f9fa62efb081a46832d [term 2 FOLLOWER]: Refusing update from remote peer fdf485ed0db84f74868a2c265c56d1d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:50:03.290729  7633 consensus_queue.cc:1048] T 79853f64be7f4e5ebb08a711d87bcede P fdf485ed0db84f74868a2c265c56d1d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 14:50:03.335135  7288 raft_consensus.cc:1275] T 36fe96aff6384e2d807b9f4d1bc8a544 P 155fc36248c04168afbd796e9ee66493 [term 3 FOLLOWER]: Refusing update from remote peer 68f78fc64ad74f9fa62efb081a46832d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 14:50:03.336656  7584 consensus_queue.cc:1048] T 36fe96aff6384e2d807b9f4d1bc8a544 P 68f78fc64ad74f9fa62efb081a46832d [LEADER]: Connected to new peer: Peer: permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 14:50:03.339639  7362 raft_consensus.cc:1275] T 36fe96aff6384e2d807b9f4d1bc8a544 P fdf485ed0db84f74868a2c265c56d1d4 [term 3 FOLLOWER]: Refusing update from remote peer 68f78fc64ad74f9fa62efb081a46832d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 14:50:03.342054  7584 consensus_queue.cc:1048] T 36fe96aff6384e2d807b9f4d1bc8a544 P 68f78fc64ad74f9fa62efb081a46832d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 14:50:03.444867  7288 raft_consensus.cc:1275] T 1d10779bfab7437babc4a1e815792595 P 155fc36248c04168afbd796e9ee66493 [term 4 FOLLOWER]: Refusing update from remote peer fdf485ed0db84f74868a2c265c56d1d4: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 14:50:03.446880  7623 consensus_queue.cc:1048] T 1d10779bfab7437babc4a1e815792595 P fdf485ed0db84f74868a2c265c56d1d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 14:50:03.460878  7438 raft_consensus.cc:1275] T 1d10779bfab7437babc4a1e815792595 P 68f78fc64ad74f9fa62efb081a46832d [term 4 FOLLOWER]: Refusing update from remote peer fdf485ed0db84f74868a2c265c56d1d4: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 14:50:03.464210  7633 consensus_queue.cc:1048] T 1d10779bfab7437babc4a1e815792595 P fdf485ed0db84f74868a2c265c56d1d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68f78fc64ad74f9fa62efb081a46832d" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 14:50:03.479031  7288 raft_consensus.cc:1275] T cddd2927548e4e20b5cc004d23d36978 P 155fc36248c04168afbd796e9ee66493 [term 5 FOLLOWER]: Refusing update from remote peer 68f78fc64ad74f9fa62efb081a46832d: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 14:50:03.480751  7631 consensus_queue.cc:1048] T cddd2927548e4e20b5cc004d23d36978 P 68f78fc64ad74f9fa62efb081a46832d [LEADER]: Connected to new peer: Peer: permanent_uuid: "155fc36248c04168afbd796e9ee66493" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 14:50:03.509817  7362 raft_consensus.cc:1275] T cddd2927548e4e20b5cc004d23d36978 P fdf485ed0db84f74868a2c265c56d1d4 [term 5 FOLLOWER]: Refusing update from remote peer 68f78fc64ad74f9fa62efb081a46832d: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 14:50:03.511475  7631 consensus_queue.cc:1048] T cddd2927548e4e20b5cc004d23d36978 P 68f78fc64ad74f9fa62efb081a46832d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fdf485ed0db84f74868a2c265c56d1d4" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 14:50:03.677186  6549 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 14:50:03.688958  6549 tablet_server.cc:179] TabletServer@127.6.101.65:0 shutting down...
I20260709 14:50:03.755245  6549 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 14:50:03.759253  6549 tablet_replica.cc:333] T 36fe96aff6384e2d807b9f4d1bc8a544 P 155fc36248c04168afbd796e9ee66493: stopping tablet replica
I20260709 14:50:03.760425  6549 raft_consensus.cc:2243] T 36fe96aff6384e2d807b9f4d1bc8a544 P 155fc36248c04168afbd796e9ee66493 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 14:50:03.761178  6549 raft_consensus.cc:2272] T 36fe96aff6384e2d807b9f4d1bc8a544 P 155fc36248c04168afbd796e9ee66493 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 14:50:03.762172  7327 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 6 similar messages]
I20260709 14:50:03.765378  6549 tablet_replica.cc:333] T cddd2927548e4e20b5cc004d23d36978 P 155fc36248c04168afbd796e9ee66493: stopping tablet replica
I20260709 14:50:03.766217  6549 raft_consensus.cc:2243] T cddd2927548e4e20b5cc004d23d36978 P 155fc36248c04168afbd796e9ee66493 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 14:50:03.766791  6549 raft_consensus.cc:2272] T cddd2927548e4e20b5cc004d23d36978 P 155fc36248c04168afbd796e9ee66493 [term 5 FOLLOWER]: Raft consensus is shut down!
W20260709 14:50:03.768096  7327 consensus_peers.cc:597] T 79853f64be7f4e5ebb08a711d87bcede P fdf485ed0db84f74868a2c265c56d1d4 -> Peer 155fc36248c04168afbd796e9ee66493 (127.6.101.65:43743): Couldn't send request to peer 155fc36248c04168afbd796e9ee66493. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:50:03.770550  6549 tablet_replica.cc:333] T 79853f64be7f4e5ebb08a711d87bcede P 155fc36248c04168afbd796e9ee66493: stopping tablet replica
I20260709 14:50:03.774154  6549 raft_consensus.cc:2243] T 79853f64be7f4e5ebb08a711d87bcede P 155fc36248c04168afbd796e9ee66493 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 14:50:03.774988  6549 raft_consensus.cc:2272] T 79853f64be7f4e5ebb08a711d87bcede P 155fc36248c04168afbd796e9ee66493 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 14:50:03.779026  6549 tablet_replica.cc:333] T 1d10779bfab7437babc4a1e815792595 P 155fc36248c04168afbd796e9ee66493: stopping tablet replica
W20260709 14:50:03.779678  7327 consensus_peers.cc:597] T dc1712921e544aaba5d8fc45d4767c61 P fdf485ed0db84f74868a2c265c56d1d4 -> Peer 155fc36248c04168afbd796e9ee66493 (127.6.101.65:43743): Couldn't send request to peer 155fc36248c04168afbd796e9ee66493. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:50:03.779871  6549 raft_consensus.cc:2243] T 1d10779bfab7437babc4a1e815792595 P 155fc36248c04168afbd796e9ee66493 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 14:50:03.780591  6549 raft_consensus.cc:2272] T 1d10779bfab7437babc4a1e815792595 P 155fc36248c04168afbd796e9ee66493 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 14:50:03.783703  6549 tablet_replica.cc:333] T a60aa91e98ae4ad0afc3dd45d4b586f2 P 155fc36248c04168afbd796e9ee66493: stopping tablet replica
I20260709 14:50:03.784608  6549 raft_consensus.cc:2243] T a60aa91e98ae4ad0afc3dd45d4b586f2 P 155fc36248c04168afbd796e9ee66493 [term 2 LEADER]: Raft consensus shutting down.
I20260709 14:50:03.785749  6549 raft_consensus.cc:2272] T a60aa91e98ae4ad0afc3dd45d4b586f2 P 155fc36248c04168afbd796e9ee66493 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 14:50:03.788175  6549 tablet_replica.cc:333] T e93fd08a04f04602bb98df0aca9a314e P 155fc36248c04168afbd796e9ee66493: stopping tablet replica
I20260709 14:50:03.788856  6549 raft_consensus.cc:2243] T e93fd08a04f04602bb98df0aca9a314e P 155fc36248c04168afbd796e9ee66493 [term 3 LEADER]: Raft consensus shutting down.
I20260709 14:50:03.790107  6549 raft_consensus.cc:2272] T e93fd08a04f04602bb98df0aca9a314e P 155fc36248c04168afbd796e9ee66493 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 14:50:03.793174  6549 tablet_replica.cc:333] T dc1712921e544aaba5d8fc45d4767c61 P 155fc36248c04168afbd796e9ee66493: stopping tablet replica
I20260709 14:50:03.793928  6549 raft_consensus.cc:2243] T dc1712921e544aaba5d8fc45d4767c61 P 155fc36248c04168afbd796e9ee66493 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 14:50:03.794714  6549 raft_consensus.cc:2272] T dc1712921e544aaba5d8fc45d4767c61 P 155fc36248c04168afbd796e9ee66493 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 14:50:03.797596  6549 tablet_replica.cc:333] T 22ad3bca8c6b4fa982bb8611615a69dd P 155fc36248c04168afbd796e9ee66493: stopping tablet replica
I20260709 14:50:03.798238  6549 raft_consensus.cc:2243] T 22ad3bca8c6b4fa982bb8611615a69dd P 155fc36248c04168afbd796e9ee66493 [term 3 LEADER]: Raft consensus shutting down.
I20260709 14:50:03.799206  6549 raft_consensus.cc:2272] T 22ad3bca8c6b4fa982bb8611615a69dd P 155fc36248c04168afbd796e9ee66493 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 14:50:03.802542  6549 tablet_replica.cc:333] T 4f6ef4ab0acb497681217b9e670bd2c2 P 155fc36248c04168afbd796e9ee66493: stopping tablet replica
I20260709 14:50:03.803186  6549 raft_consensus.cc:2243] T 4f6ef4ab0acb497681217b9e670bd2c2 P 155fc36248c04168afbd796e9ee66493 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 14:50:03.803787  6549 raft_consensus.cc:2272] T 4f6ef4ab0acb497681217b9e670bd2c2 P 155fc36248c04168afbd796e9ee66493 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 14:50:03.806663  6549 tablet_replica.cc:333] T 21f5ecd80b0b421aad67b6ec53d594d2 P 155fc36248c04168afbd796e9ee66493: stopping tablet replica
I20260709 14:50:03.807271  6549 raft_consensus.cc:2243] T 21f5ecd80b0b421aad67b6ec53d594d2 P 155fc36248c04168afbd796e9ee66493 [term 2 LEADER]: Raft consensus shutting down.
I20260709 14:50:03.808477  6549 raft_consensus.cc:2272] T 21f5ecd80b0b421aad67b6ec53d594d2 P 155fc36248c04168afbd796e9ee66493 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 14:50:03.837734  6549 tablet_server.cc:196] TabletServer@127.6.101.65:0 shutdown complete.
I20260709 14:50:03.870445  6549 tablet_server.cc:179] TabletServer@127.6.101.66:0 shutting down...
I20260709 14:50:03.931644  6549 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 14:50:03.932559  6549 tablet_replica.cc:333] T dc1712921e544aaba5d8fc45d4767c61 P fdf485ed0db84f74868a2c265c56d1d4: stopping tablet replica
I20260709 14:50:03.933728  6549 raft_consensus.cc:2243] T dc1712921e544aaba5d8fc45d4767c61 P fdf485ed0db84f74868a2c265c56d1d4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 14:50:03.937161  6549 raft_consensus.cc:2272] T dc1712921e544aaba5d8fc45d4767c61 P fdf485ed0db84f74868a2c265c56d1d4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 14:50:03.941834  6549 tablet_replica.cc:333] T 22ad3bca8c6b4fa982bb8611615a69dd P fdf485ed0db84f74868a2c265c56d1d4: stopping tablet replica
I20260709 14:50:03.942562  6549 raft_consensus.cc:2243] T 22ad3bca8c6b4fa982bb8611615a69dd P fdf485ed0db84f74868a2c265c56d1d4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 14:50:03.943145  6549 raft_consensus.cc:2272] T 22ad3bca8c6b4fa982bb8611615a69dd P fdf485ed0db84f74868a2c265c56d1d4 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 14:50:03.945374  7401 consensus_peers.cc:597] T 4f6ef4ab0acb497681217b9e670bd2c2 P 68f78fc64ad74f9fa62efb081a46832d -> Peer 155fc36248c04168afbd796e9ee66493 (127.6.101.65:43743): Couldn't send request to peer 155fc36248c04168afbd796e9ee66493. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:43743: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 14:50:03.946292  6549 tablet_replica.cc:333] T cddd2927548e4e20b5cc004d23d36978 P fdf485ed0db84f74868a2c265c56d1d4: stopping tablet replica
I20260709 14:50:03.947142  6549 raft_consensus.cc:2243] T cddd2927548e4e20b5cc004d23d36978 P fdf485ed0db84f74868a2c265c56d1d4 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 14:50:03.947753  6549 raft_consensus.cc:2272] T cddd2927548e4e20b5cc004d23d36978 P fdf485ed0db84f74868a2c265c56d1d4 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 14:50:03.950671  6549 tablet_replica.cc:333] T 4f6ef4ab0acb497681217b9e670bd2c2 P fdf485ed0db84f74868a2c265c56d1d4: stopping tablet replica
I20260709 14:50:03.951414  6549 raft_consensus.cc:2243] T 4f6ef4ab0acb497681217b9e670bd2c2 P fdf485ed0db84f74868a2c265c56d1d4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 14:50:03.951930  6549 raft_consensus.cc:2272] T 4f6ef4ab0acb497681217b9e670bd2c2 P fdf485ed0db84f74868a2c265c56d1d4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 14:50:03.954371  6549 tablet_replica.cc:333] T 21f5ecd80b0b421aad67b6ec53d594d2 P fdf485ed0db84f74868a2c265c56d1d4: stopping tablet replica
I20260709 14:50:03.955097  6549 raft_consensus.cc:2243] T 21f5ecd80b0b421aad67b6ec53d594d2 P fdf485ed0db84f74868a2c265c56d1d4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 14:50:03.955731  6549 raft_consensus.cc:2272] T 21f5ecd80b0b421aad67b6ec53d594d2 P fdf485ed0db84f74868a2c265c56d1d4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 14:50:03.958253  6549 tablet_replica.cc:333] T 79853f64be7f4e5ebb08a711d87bcede P fdf485ed0db84f74868a2c265c56d1d4: stopping tablet replica
I20260709 14:50:03.959048  6549 raft_consensus.cc:2243] T 79853f64be7f4e5ebb08a711d87bcede P fdf485ed0db84f74868a2c265c56d1d4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 14:50:03.959980  6549 raft_consensus.cc:2272] T 79853f64be7f4e5ebb08a711d87bcede P fdf485ed0db84f74868a2c265c56d1d4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 14:50:03.962932  6549 tablet_replica.cc:333] T 1d10779bfab7437babc4a1e815792595 P fdf485ed0db84f74868a2c265c56d1d4: stopping tablet replica
I20260709 14:50:03.963754  6549 raft_consensus.cc:2243] T 1d10779bfab7437babc4a1e815792595 P fdf485ed0db84f74868a2c265c56d1d4 [term 4 LEADER]: Raft consensus shutting down.
I20260709 14:50:03.964699  6549 raft_consensus.cc:2272] T 1d10779bfab7437babc4a1e815792595 P fdf485ed0db84f74868a2c265c56d1d4 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 14:50:03.968988  6549 tablet_replica.cc:333] T a60aa91e98ae4ad0afc3dd45d4b586f2 P fdf485ed0db84f74868a2c265c56d1d4: stopping tablet replica
I20260709 14:50:03.969851  6549 raft_consensus.cc:2243] T a60aa91e98ae4ad0afc3dd45d4b586f2 P fdf485ed0db84f74868a2c265c56d1d4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 14:50:03.970584  6549 raft_consensus.cc:2272] T a60aa91e98ae4ad0afc3dd45d4b586f2 P fdf485ed0db84f74868a2c265c56d1d4 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 14:50:03.973140  7401 consensus_peers.cc:597] T 36fe96aff6384e2d807b9f4d1bc8a544 P 68f78fc64ad74f9fa62efb081a46832d -> Peer 155fc36248c04168afbd796e9ee66493 (127.6.101.65:43743): Couldn't send request to peer 155fc36248c04168afbd796e9ee66493. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:43743: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 14:50:03.973551  6549 tablet_replica.cc:333] T e93fd08a04f04602bb98df0aca9a314e P fdf485ed0db84f74868a2c265c56d1d4: stopping tablet replica
I20260709 14:50:03.974257  6549 raft_consensus.cc:2243] T e93fd08a04f04602bb98df0aca9a314e P fdf485ed0db84f74868a2c265c56d1d4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 14:50:03.974788  6549 raft_consensus.cc:2272] T e93fd08a04f04602bb98df0aca9a314e P fdf485ed0db84f74868a2c265c56d1d4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 14:50:03.976918  6549 tablet_replica.cc:333] T 36fe96aff6384e2d807b9f4d1bc8a544 P fdf485ed0db84f74868a2c265c56d1d4: stopping tablet replica
I20260709 14:50:03.977636  6549 raft_consensus.cc:2243] T 36fe96aff6384e2d807b9f4d1bc8a544 P fdf485ed0db84f74868a2c265c56d1d4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 14:50:03.978209  6549 raft_consensus.cc:2272] T 36fe96aff6384e2d807b9f4d1bc8a544 P fdf485ed0db84f74868a2c265c56d1d4 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 14:50:04.029544  7401 consensus_peers.cc:597] T cddd2927548e4e20b5cc004d23d36978 P 68f78fc64ad74f9fa62efb081a46832d -> Peer 155fc36248c04168afbd796e9ee66493 (127.6.101.65:43743): Couldn't send request to peer 155fc36248c04168afbd796e9ee66493. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:43743: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 14:50:04.032171  6549 tablet_server.cc:196] TabletServer@127.6.101.66:0 shutdown complete.
W20260709 14:50:04.069494  7402 consensus_peers.cc:597] T 4f6ef4ab0acb497681217b9e670bd2c2 P 68f78fc64ad74f9fa62efb081a46832d -> Peer fdf485ed0db84f74868a2c265c56d1d4 (127.6.101.66:35791): Couldn't send request to peer fdf485ed0db84f74868a2c265c56d1d4. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.66:35791: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 14:50:04.070290  7402 consensus_peers.cc:597] T cddd2927548e4e20b5cc004d23d36978 P 68f78fc64ad74f9fa62efb081a46832d -> Peer fdf485ed0db84f74868a2c265c56d1d4 (127.6.101.66:35791): Couldn't send request to peer fdf485ed0db84f74868a2c265c56d1d4. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.66:35791: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 14:50:04.083297  6549 tablet_server.cc:179] TabletServer@127.6.101.67:0 shutting down...
I20260709 14:50:04.156493  6549 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 14:50:04.157388  6549 tablet_replica.cc:333] T 4f6ef4ab0acb497681217b9e670bd2c2 P 68f78fc64ad74f9fa62efb081a46832d: stopping tablet replica
I20260709 14:50:04.158422  6549 raft_consensus.cc:2243] T 4f6ef4ab0acb497681217b9e670bd2c2 P 68f78fc64ad74f9fa62efb081a46832d [term 2 LEADER]: Raft consensus shutting down.
I20260709 14:50:04.159931  6549 raft_consensus.cc:2272] T 4f6ef4ab0acb497681217b9e670bd2c2 P 68f78fc64ad74f9fa62efb081a46832d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 14:50:04.162416  6549 tablet_replica.cc:333] T e93fd08a04f04602bb98df0aca9a314e P 68f78fc64ad74f9fa62efb081a46832d: stopping tablet replica
I20260709 14:50:04.163275  6549 raft_consensus.cc:2243] T e93fd08a04f04602bb98df0aca9a314e P 68f78fc64ad74f9fa62efb081a46832d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 14:50:04.163826  6549 raft_consensus.cc:2272] T e93fd08a04f04602bb98df0aca9a314e P 68f78fc64ad74f9fa62efb081a46832d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 14:50:04.166751  6549 tablet_replica.cc:333] T cddd2927548e4e20b5cc004d23d36978 P 68f78fc64ad74f9fa62efb081a46832d: stopping tablet replica
I20260709 14:50:04.167709  6549 raft_consensus.cc:2243] T cddd2927548e4e20b5cc004d23d36978 P 68f78fc64ad74f9fa62efb081a46832d [term 5 LEADER]: Raft consensus shutting down.
I20260709 14:50:04.168776  6549 raft_consensus.cc:2272] T cddd2927548e4e20b5cc004d23d36978 P 68f78fc64ad74f9fa62efb081a46832d [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 14:50:04.171701  6549 tablet_replica.cc:333] T 22ad3bca8c6b4fa982bb8611615a69dd P 68f78fc64ad74f9fa62efb081a46832d: stopping tablet replica
I20260709 14:50:04.172472  6549 raft_consensus.cc:2243] T 22ad3bca8c6b4fa982bb8611615a69dd P 68f78fc64ad74f9fa62efb081a46832d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 14:50:04.173089  6549 raft_consensus.cc:2272] T 22ad3bca8c6b4fa982bb8611615a69dd P 68f78fc64ad74f9fa62efb081a46832d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 14:50:04.175978  6549 tablet_replica.cc:333] T dc1712921e544aaba5d8fc45d4767c61 P 68f78fc64ad74f9fa62efb081a46832d: stopping tablet replica
I20260709 14:50:04.176723  6549 raft_consensus.cc:2243] T dc1712921e544aaba5d8fc45d4767c61 P 68f78fc64ad74f9fa62efb081a46832d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 14:50:04.177547  6549 raft_consensus.cc:2272] T dc1712921e544aaba5d8fc45d4767c61 P 68f78fc64ad74f9fa62efb081a46832d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 14:50:04.180531  6549 tablet_replica.cc:333] T 21f5ecd80b0b421aad67b6ec53d594d2 P 68f78fc64ad74f9fa62efb081a46832d: stopping tablet replica
I20260709 14:50:04.181177  6549 raft_consensus.cc:2243] T 21f5ecd80b0b421aad67b6ec53d594d2 P 68f78fc64ad74f9fa62efb081a46832d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 14:50:04.181838  6549 raft_consensus.cc:2272] T 21f5ecd80b0b421aad67b6ec53d594d2 P 68f78fc64ad74f9fa62efb081a46832d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 14:50:04.184635  6549 tablet_replica.cc:333] T 1d10779bfab7437babc4a1e815792595 P 68f78fc64ad74f9fa62efb081a46832d: stopping tablet replica
I20260709 14:50:04.185446  6549 raft_consensus.cc:2243] T 1d10779bfab7437babc4a1e815792595 P 68f78fc64ad74f9fa62efb081a46832d [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 14:50:04.186137  6549 raft_consensus.cc:2272] T 1d10779bfab7437babc4a1e815792595 P 68f78fc64ad74f9fa62efb081a46832d [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 14:50:04.190026  6549 tablet_replica.cc:333] T a60aa91e98ae4ad0afc3dd45d4b586f2 P 68f78fc64ad74f9fa62efb081a46832d: stopping tablet replica
I20260709 14:50:04.190748  6549 raft_consensus.cc:2243] T a60aa91e98ae4ad0afc3dd45d4b586f2 P 68f78fc64ad74f9fa62efb081a46832d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 14:50:04.191601  6549 raft_consensus.cc:2272] T a60aa91e98ae4ad0afc3dd45d4b586f2 P 68f78fc64ad74f9fa62efb081a46832d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 14:50:04.194177  6549 tablet_replica.cc:333] T 79853f64be7f4e5ebb08a711d87bcede P 68f78fc64ad74f9fa62efb081a46832d: stopping tablet replica
I20260709 14:50:04.194792  6549 raft_consensus.cc:2243] T 79853f64be7f4e5ebb08a711d87bcede P 68f78fc64ad74f9fa62efb081a46832d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 14:50:04.195426  6549 raft_consensus.cc:2272] T 79853f64be7f4e5ebb08a711d87bcede P 68f78fc64ad74f9fa62efb081a46832d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 14:50:04.198889  6549 tablet_replica.cc:333] T 36fe96aff6384e2d807b9f4d1bc8a544 P 68f78fc64ad74f9fa62efb081a46832d: stopping tablet replica
I20260709 14:50:04.199554  6549 raft_consensus.cc:2243] T 36fe96aff6384e2d807b9f4d1bc8a544 P 68f78fc64ad74f9fa62efb081a46832d [term 3 LEADER]: Raft consensus shutting down.
I20260709 14:50:04.200888  6549 raft_consensus.cc:2272] T 36fe96aff6384e2d807b9f4d1bc8a544 P 68f78fc64ad74f9fa62efb081a46832d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 14:50:04.239982  6549 tablet_server.cc:196] TabletServer@127.6.101.67:0 shutdown complete.
I20260709 14:50:04.268728  6549 master.cc:562] Master@127.6.101.126:39763 shutting down...
I20260709 14:50:04.314018  6549 raft_consensus.cc:2243] T 00000000000000000000000000000000 P b28ee5b94f3949dfaf03f3f81f627658 [term 1 LEADER]: Raft consensus shutting down.
I20260709 14:50:04.314654  6549 raft_consensus.cc:2272] T 00000000000000000000000000000000 P b28ee5b94f3949dfaf03f3f81f627658 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:50:04.314991  6549 tablet_replica.cc:333] T 00000000000000000000000000000000 P b28ee5b94f3949dfaf03f3f81f627658: stopping tablet replica
I20260709 14:50:04.343021  6549 master.cc:584] Master@127.6.101.126:39763 shutdown complete.
155fc36248c04168afbd796e9ee66493  5
68f78fc64ad74f9fa62efb081a46832d  1
fdf485ed0db84f74868a2c265c56d1d4  4
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (11277 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 14:50:04.423033  6549 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.6.101.126:38743
I20260709 14:50:04.424253  6549 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 14:50:04.439422  7652 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 14:50:04.440026  7653 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 14:50:04.442291  7655 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 14:50:04.442658  6549 server_base.cc:1061] running on GCE node
I20260709 14:50:04.443823  6549 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 14:50:04.444073  6549 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 14:50:04.444245  6549 hybrid_clock.cc:648] HybridClock initialized: now 1783608604444221 us; error 0 us; skew 500 ppm
I20260709 14:50:04.444800  6549 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 14:50:04.449085  6549 webserver.cc:533] Webserver started at http://127.6.101.126:39377/ using document root <none> and password file <none>
I20260709 14:50:04.449932  6549 fs_manager.cc:362] Metadata directory not provided
I20260709 14:50:04.450138  6549 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 14:50:04.450484  6549 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 14:50:04.451859  6549 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783608571892863-6549-0/minicluster-data/master-0-root/instance:
uuid: "133636659113430cb53b321cb0b1d9ee"
format_stamp: "Formatted at 2026-07-09 14:50:04 on dist-test-slave-lv34"
I20260709 14:50:04.458372  6549 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.002s	sys 0.005s
I20260709 14:50:04.465514  7660 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 14:50:04.466449  6549 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.001s	sys 0.004s
I20260709 14:50:04.466758  6549 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783608571892863-6549-0/minicluster-data/master-0-root
uuid: "133636659113430cb53b321cb0b1d9ee"
format_stamp: "Formatted at 2026-07-09 14:50:04 on dist-test-slave-lv34"
I20260709 14:50:04.467031  6549 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783608571892863-6549-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783608571892863-6549-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783608571892863-6549-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 14:50:04.498345  6549 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 14:50:04.499934  6549 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 14:50:04.558396  6549 rpc_server.cc:307] RPC server started. Bound to: 127.6.101.126:38743
I20260709 14:50:04.558631  7711 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.101.126:38743 every 8 connection(s)
I20260709 14:50:04.565006  7712 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:04.578207  7712 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 133636659113430cb53b321cb0b1d9ee: Bootstrap starting.
I20260709 14:50:04.585170  7712 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 133636659113430cb53b321cb0b1d9ee: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:04.590822  7712 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 133636659113430cb53b321cb0b1d9ee: No bootstrap required, opened a new log
I20260709 14:50:04.593503  7712 raft_consensus.cc:359] T 00000000000000000000000000000000 P 133636659113430cb53b321cb0b1d9ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "133636659113430cb53b321cb0b1d9ee" member_type: VOTER }
I20260709 14:50:04.593987  7712 raft_consensus.cc:385] T 00000000000000000000000000000000 P 133636659113430cb53b321cb0b1d9ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:04.594658  7712 raft_consensus.cc:740] T 00000000000000000000000000000000 P 133636659113430cb53b321cb0b1d9ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 133636659113430cb53b321cb0b1d9ee, State: Initialized, Role: FOLLOWER
I20260709 14:50:04.597476  7712 consensus_queue.cc:260] T 00000000000000000000000000000000 P 133636659113430cb53b321cb0b1d9ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "133636659113430cb53b321cb0b1d9ee" member_type: VOTER }
I20260709 14:50:04.598635  7712 raft_consensus.cc:399] T 00000000000000000000000000000000 P 133636659113430cb53b321cb0b1d9ee [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 14:50:04.599265  7712 raft_consensus.cc:493] T 00000000000000000000000000000000 P 133636659113430cb53b321cb0b1d9ee [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 14:50:04.599692  7712 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 133636659113430cb53b321cb0b1d9ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:04.604435  7712 raft_consensus.cc:515] T 00000000000000000000000000000000 P 133636659113430cb53b321cb0b1d9ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "133636659113430cb53b321cb0b1d9ee" member_type: VOTER }
I20260709 14:50:04.605082  7712 leader_election.cc:304] T 00000000000000000000000000000000 P 133636659113430cb53b321cb0b1d9ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 133636659113430cb53b321cb0b1d9ee; no voters: 
I20260709 14:50:04.606487  7712 leader_election.cc:290] T 00000000000000000000000000000000 P 133636659113430cb53b321cb0b1d9ee [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 14:50:04.607160  7715 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 133636659113430cb53b321cb0b1d9ee [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:50:04.608822  7715 raft_consensus.cc:697] T 00000000000000000000000000000000 P 133636659113430cb53b321cb0b1d9ee [term 1 LEADER]: Becoming Leader. State: Replica: 133636659113430cb53b321cb0b1d9ee, State: Running, Role: LEADER
I20260709 14:50:04.609683  7715 consensus_queue.cc:237] T 00000000000000000000000000000000 P 133636659113430cb53b321cb0b1d9ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "133636659113430cb53b321cb0b1d9ee" member_type: VOTER }
I20260709 14:50:04.610773  7712 sys_catalog.cc:565] T 00000000000000000000000000000000 P 133636659113430cb53b321cb0b1d9ee [sys.catalog]: configured and running, proceeding with master startup.
I20260709 14:50:04.615154  7716 sys_catalog.cc:455] T 00000000000000000000000000000000 P 133636659113430cb53b321cb0b1d9ee [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "133636659113430cb53b321cb0b1d9ee" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "133636659113430cb53b321cb0b1d9ee" member_type: VOTER } }
I20260709 14:50:04.615218  7717 sys_catalog.cc:455] T 00000000000000000000000000000000 P 133636659113430cb53b321cb0b1d9ee [sys.catalog]: SysCatalogTable state changed. Reason: New leader 133636659113430cb53b321cb0b1d9ee. Latest consensus state: current_term: 1 leader_uuid: "133636659113430cb53b321cb0b1d9ee" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "133636659113430cb53b321cb0b1d9ee" member_type: VOTER } }
I20260709 14:50:04.616096  7716 sys_catalog.cc:458] T 00000000000000000000000000000000 P 133636659113430cb53b321cb0b1d9ee [sys.catalog]: This master's current role is: LEADER
I20260709 14:50:04.616245  7717 sys_catalog.cc:458] T 00000000000000000000000000000000 P 133636659113430cb53b321cb0b1d9ee [sys.catalog]: This master's current role is: LEADER
I20260709 14:50:04.623473  7721 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 14:50:04.638082  7721 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 14:50:04.642803  6549 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 14:50:04.655098  7721 catalog_manager.cc:1383] Generated new cluster ID: 7bace30dae874b8e8569381c2c5ceffe
I20260709 14:50:04.656666  7721 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 14:50:04.694685  7721 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 14:50:04.696372  7721 catalog_manager.cc:1540] Loading token signing keys...
I20260709 14:50:04.719666  7721 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 133636659113430cb53b321cb0b1d9ee: Generated new TSK 0
I20260709 14:50:04.720417  7721 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 14:50:04.775564  6549 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 14:50:04.784492  7733 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 14:50:04.785540  7734 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 14:50:04.787511  7736 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 14:50:04.788455  6549 server_base.cc:1061] running on GCE node
I20260709 14:50:04.789844  6549 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 14:50:04.790100  6549 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 14:50:04.790223  6549 hybrid_clock.cc:648] HybridClock initialized: now 1783608604790211 us; error 0 us; skew 500 ppm
I20260709 14:50:04.790836  6549 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 14:50:04.794489  6549 webserver.cc:533] Webserver started at http://127.6.101.65:39019/ using document root <none> and password file <none>
I20260709 14:50:04.795099  6549 fs_manager.cc:362] Metadata directory not provided
I20260709 14:50:04.795302  6549 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 14:50:04.795581  6549 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 14:50:04.796909  6549 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783608571892863-6549-0/minicluster-data/ts-0-root/instance:
uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
format_stamp: "Formatted at 2026-07-09 14:50:04 on dist-test-slave-lv34"
I20260709 14:50:04.803077  6549 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.002s	sys 0.003s
I20260709 14:50:04.808077  7741 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 14:50:04.809404  6549 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 14:50:04.809808  6549 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783608571892863-6549-0/minicluster-data/ts-0-root
uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
format_stamp: "Formatted at 2026-07-09 14:50:04 on dist-test-slave-lv34"
I20260709 14:50:04.810165  6549 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783608571892863-6549-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783608571892863-6549-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783608571892863-6549-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 14:50:04.828989  6549 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 14:50:04.830708  6549 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 14:50:04.832623  6549 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 14:50:04.835731  6549 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 14:50:04.835990  6549 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 14:50:04.836194  6549 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 14:50:04.836354  6549 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 14:50:04.899983  6549 rpc_server.cc:307] RPC server started. Bound to: 127.6.101.65:40587
I20260709 14:50:04.900110  7803 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.101.65:40587 every 8 connection(s)
I20260709 14:50:04.906265  6549 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 14:50:04.918829  7808 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 14:50:04.919377  7809 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 14:50:04.926210  7811 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 14:50:04.930876  6549 server_base.cc:1061] running on GCE node
I20260709 14:50:04.932350  6549 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 14:50:04.932610  6549 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 14:50:04.932749  6549 hybrid_clock.cc:648] HybridClock initialized: now 1783608604932737 us; error 0 us; skew 500 ppm
I20260709 14:50:04.933449  6549 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 14:50:04.936744  6549 webserver.cc:533] Webserver started at http://127.6.101.66:43297/ using document root <none> and password file <none>
I20260709 14:50:04.937577  6549 fs_manager.cc:362] Metadata directory not provided
I20260709 14:50:04.937887  6549 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 14:50:04.938547  6549 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 14:50:04.940200  6549 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783608571892863-6549-0/minicluster-data/ts-1-root/instance:
uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
format_stamp: "Formatted at 2026-07-09 14:50:04 on dist-test-slave-lv34"
I20260709 14:50:04.941221  7804 heartbeater.cc:344] Connected to a master server at 127.6.101.126:38743
I20260709 14:50:04.942318  7804 heartbeater.cc:461] Registering TS with master...
I20260709 14:50:04.943758  7804 heartbeater.cc:507] Master 127.6.101.126:38743 requested a full tablet report, sending...
I20260709 14:50:04.946285  6549 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.001s	sys 0.008s
I20260709 14:50:04.947052  7677 ts_manager.cc:194] Registered new tserver with Master: 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587)
I20260709 14:50:04.949476  7677 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54344
I20260709 14:50:04.950819  7816 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 14:50:04.952415  6549 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 14:50:04.952880  6549 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783608571892863-6549-0/minicluster-data/ts-1-root
uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
format_stamp: "Formatted at 2026-07-09 14:50:04 on dist-test-slave-lv34"
I20260709 14:50:04.953226  6549 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783608571892863-6549-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783608571892863-6549-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783608571892863-6549-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 14:50:04.991768  6549 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 14:50:04.993777  6549 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 14:50:04.995736  6549 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 14:50:04.999209  6549 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 14:50:04.999500  6549 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 14:50:04.999966  6549 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 14:50:05.000164  6549 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 14:50:05.068557  6549 rpc_server.cc:307] RPC server started. Bound to: 127.6.101.66:34529
I20260709 14:50:05.068848  7878 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.101.66:34529 every 8 connection(s)
I20260709 14:50:05.074482  6549 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 14:50:05.084023  7882 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 14:50:05.085688  7883 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 14:50:05.089952  7885 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 14:50:05.091190  6549 server_base.cc:1061] running on GCE node
I20260709 14:50:05.093087  6549 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 14:50:05.093526  6549 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 14:50:05.093752  6549 hybrid_clock.cc:648] HybridClock initialized: now 1783608605093726 us; error 0 us; skew 500 ppm
I20260709 14:50:05.094511  6549 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 14:50:05.094759  7879 heartbeater.cc:344] Connected to a master server at 127.6.101.126:38743
I20260709 14:50:05.095376  7879 heartbeater.cc:461] Registering TS with master...
I20260709 14:50:05.096366  7879 heartbeater.cc:507] Master 127.6.101.126:38743 requested a full tablet report, sending...
I20260709 14:50:05.097870  6549 webserver.cc:533] Webserver started at http://127.6.101.67:45787/ using document root <none> and password file <none>
I20260709 14:50:05.098656  6549 fs_manager.cc:362] Metadata directory not provided
I20260709 14:50:05.098869  6549 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 14:50:05.098990  7677 ts_manager.cc:194] Registered new tserver with Master: 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:50:05.099159  6549 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 14:50:05.100581  7677 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54350
I20260709 14:50:05.100696  6549 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783608571892863-6549-0/minicluster-data/ts-2-root/instance:
uuid: "1e9289592458429bbddb19c2e7b7b7b0"
format_stamp: "Formatted at 2026-07-09 14:50:05 on dist-test-slave-lv34"
I20260709 14:50:05.109779  6549 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.003s	sys 0.002s
I20260709 14:50:05.114737  7890 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 14:50:05.115816  6549 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.002s
I20260709 14:50:05.116310  6549 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783608571892863-6549-0/minicluster-data/ts-2-root
uuid: "1e9289592458429bbddb19c2e7b7b7b0"
format_stamp: "Formatted at 2026-07-09 14:50:05 on dist-test-slave-lv34"
I20260709 14:50:05.116730  6549 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783608571892863-6549-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783608571892863-6549-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783608571892863-6549-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 14:50:05.162498  6549 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 14:50:05.163877  6549 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 14:50:05.165549  6549 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 14:50:05.168045  6549 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 14:50:05.168260  6549 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 14:50:05.168524  6549 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 14:50:05.168663  6549 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 14:50:05.226404  6549 rpc_server.cc:307] RPC server started. Bound to: 127.6.101.67:40785
I20260709 14:50:05.226583  7952 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.101.67:40785 every 8 connection(s)
I20260709 14:50:05.247044  7953 heartbeater.cc:344] Connected to a master server at 127.6.101.126:38743
I20260709 14:50:05.247468  7953 heartbeater.cc:461] Registering TS with master...
I20260709 14:50:05.248288  7953 heartbeater.cc:507] Master 127.6.101.126:38743 requested a full tablet report, sending...
I20260709 14:50:05.250684  7677 ts_manager.cc:194] Registered new tserver with Master: 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:05.250902  6549 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.02033645s
I20260709 14:50:05.252846  7677 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54364
I20260709 14:50:05.286322  7677 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:54378:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 14:50:05.293223  7677 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 14:50:05.538136  7766 tablet_service.cc:1511] Processing CreateTablet for tablet c05bb7d6a8bd42fcb27196db96044bb1 (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 14:50:05.540076  7766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c05bb7d6a8bd42fcb27196db96044bb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:05.545826  7765 tablet_service.cc:1511] Processing CreateTablet for tablet abd9bd9309aa456faee5ac298922892e (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 14:50:05.547585  7765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abd9bd9309aa456faee5ac298922892e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:05.550923  7841 tablet_service.cc:1511] Processing CreateTablet for tablet c05bb7d6a8bd42fcb27196db96044bb1 (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 14:50:05.553687  7841 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c05bb7d6a8bd42fcb27196db96044bb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:05.554090  7763 tablet_service.cc:1511] Processing CreateTablet for tablet 9ce9c0ef2db24c13a8b1402f21819458 (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 14:50:05.557010  7764 tablet_service.cc:1511] Processing CreateTablet for tablet 9441e831627143a991a1556dcdce71e3 (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 14:50:05.561308  7761 tablet_service.cc:1511] Processing CreateTablet for tablet 258d6c2dda954bf5b65930fde8ecb9f3 (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 14:50:05.563014  7768 tablet_service.cc:1511] Processing CreateTablet for tablet 3a01e716f85c42fca2d598794aa97828 (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 14:50:05.560359  7767 tablet_service.cc:1511] Processing CreateTablet for tablet ad8e261558b942c6b42c841689082c10 (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 14:50:05.564422  7843 tablet_service.cc:1511] Processing CreateTablet for tablet 3a01e716f85c42fca2d598794aa97828 (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 14:50:05.565999  7843 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a01e716f85c42fca2d598794aa97828. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:05.566179  7844 tablet_service.cc:1511] Processing CreateTablet for tablet 4c5a5f4d6980405d99119f2f2e97df2f (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 14:50:05.567847  7844 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c5a5f4d6980405d99119f2f2e97df2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:05.563021  7840 tablet_service.cc:1511] Processing CreateTablet for tablet abd9bd9309aa456faee5ac298922892e (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 14:50:05.552290  7762 tablet_service.cc:1511] Processing CreateTablet for tablet 7d45fb2f8502402780de3ab1d9588072 (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 14:50:05.537865  7842 tablet_service.cc:1511] Processing CreateTablet for tablet ad8e261558b942c6b42c841689082c10 (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 14:50:05.577282  7769 tablet_service.cc:1511] Processing CreateTablet for tablet 4c5a5f4d6980405d99119f2f2e97df2f (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 14:50:05.579111  7760 tablet_service.cc:1511] Processing CreateTablet for tablet 9fd10baef95c4d73978299974e0dd8f3 (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 14:50:05.589535  7761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 258d6c2dda954bf5b65930fde8ecb9f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:05.590888  7760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9fd10baef95c4d73978299974e0dd8f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:05.580823  7842 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad8e261558b942c6b42c841689082c10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:05.593365  7836 tablet_service.cc:1511] Processing CreateTablet for tablet 258d6c2dda954bf5b65930fde8ecb9f3 (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 14:50:05.595551  7836 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 258d6c2dda954bf5b65930fde8ecb9f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:05.599078  7835 tablet_service.cc:1511] Processing CreateTablet for tablet 9fd10baef95c4d73978299974e0dd8f3 (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 14:50:05.581275  7839 tablet_service.cc:1511] Processing CreateTablet for tablet 9441e831627143a991a1556dcdce71e3 (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 14:50:05.583177  7838 tablet_service.cc:1511] Processing CreateTablet for tablet 9ce9c0ef2db24c13a8b1402f21819458 (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 14:50:05.604064  7767 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad8e261558b942c6b42c841689082c10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:05.606524  7769 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c5a5f4d6980405d99119f2f2e97df2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:05.611081  7917 tablet_service.cc:1511] Processing CreateTablet for tablet 3a01e716f85c42fca2d598794aa97828 (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 14:50:05.612182  7971 tablet_bootstrap.cc:492] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac: Bootstrap starting.
I20260709 14:50:05.611512  7844 tablet_service.cc:1511] Processing CreateTablet for tablet a18d29d52d304c87b930d4fb5eaf50b1 (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 14:50:05.610765  7763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ce9c0ef2db24c13a8b1402f21819458. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:05.614274  7916 tablet_service.cc:1511] Processing CreateTablet for tablet ad8e261558b942c6b42c841689082c10 (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 14:50:05.615826  7916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad8e261558b942c6b42c841689082c10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:05.616194  7913 tablet_service.cc:1511] Processing CreateTablet for tablet 9441e831627143a991a1556dcdce71e3 (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 14:50:05.617784  7764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9441e831627143a991a1556dcdce71e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:05.618379  7913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9441e831627143a991a1556dcdce71e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:05.618945  7915 tablet_service.cc:1511] Processing CreateTablet for tablet c05bb7d6a8bd42fcb27196db96044bb1 (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 14:50:05.624432  7914 tablet_service.cc:1511] Processing CreateTablet for tablet abd9bd9309aa456faee5ac298922892e (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 14:50:05.587934  7837 tablet_service.cc:1511] Processing CreateTablet for tablet 7d45fb2f8502402780de3ab1d9588072 (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 14:50:05.628793  7762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d45fb2f8502402780de3ab1d9588072. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:05.587777  7918 tablet_service.cc:1511] Processing CreateTablet for tablet 4c5a5f4d6980405d99119f2f2e97df2f (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 14:50:05.628545  7912 tablet_service.cc:1511] Processing CreateTablet for tablet 9ce9c0ef2db24c13a8b1402f21819458 (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 14:50:05.625864  7915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c05bb7d6a8bd42fcb27196db96044bb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:05.631157  7912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ce9c0ef2db24c13a8b1402f21819458. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:05.632459  7917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a01e716f85c42fca2d598794aa97828. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:05.633510  7840 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abd9bd9309aa456faee5ac298922892e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:05.633379  7768 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a01e716f85c42fca2d598794aa97828. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:05.637868  7914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abd9bd9309aa456faee5ac298922892e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 14:50:05.637526  7725 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 14:50:05.646831  7918 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c5a5f4d6980405d99119f2f2e97df2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:05.647334  7838 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ce9c0ef2db24c13a8b1402f21819458. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:05.648065  7844 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a18d29d52d304c87b930d4fb5eaf50b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:05.648694  7839 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9441e831627143a991a1556dcdce71e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:05.649369  7837 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d45fb2f8502402780de3ab1d9588072. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:05.650427  7835 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9fd10baef95c4d73978299974e0dd8f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:05.659400  7911 tablet_service.cc:1511] Processing CreateTablet for tablet 7d45fb2f8502402780de3ab1d9588072 (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 14:50:05.662006  7911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d45fb2f8502402780de3ab1d9588072. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:05.672959  7971 tablet_bootstrap.cc:654] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:05.678884  7910 tablet_service.cc:1511] Processing CreateTablet for tablet 258d6c2dda954bf5b65930fde8ecb9f3 (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 14:50:05.680980  7910 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 258d6c2dda954bf5b65930fde8ecb9f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:05.686930  7909 tablet_service.cc:1511] Processing CreateTablet for tablet 9fd10baef95c4d73978299974e0dd8f3 (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 14:50:05.690219  7909 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9fd10baef95c4d73978299974e0dd8f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:05.756448  7972 tablet_bootstrap.cc:492] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed: Bootstrap starting.
I20260709 14:50:05.779657  7760 tablet_service.cc:1511] Processing CreateTablet for tablet a18d29d52d304c87b930d4fb5eaf50b1 (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 14:50:05.780594  7766 tablet_service.cc:1511] Processing CreateTablet for tablet 6f693cee587949c6bde5463f4fd33b01 (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 14:50:05.781400  7760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a18d29d52d304c87b930d4fb5eaf50b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:05.782522  7766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f693cee587949c6bde5463f4fd33b01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:05.790864  7768 tablet_service.cc:1511] Processing CreateTablet for tablet 9cd6df0b766447119ea9e0acb887af01 (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 14:50:05.792760  7768 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9cd6df0b766447119ea9e0acb887af01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:05.821362  7843 tablet_service.cc:1511] Processing CreateTablet for tablet 6f693cee587949c6bde5463f4fd33b01 (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 14:50:05.809041  7972 tablet_bootstrap.cc:654] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed: Neither blocks nor log segments found. Creating new log.
W20260709 14:50:05.833711  7663 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 56957.3us
I20260709 14:50:05.843349  7912 tablet_service.cc:1511] Processing CreateTablet for tablet a18d29d52d304c87b930d4fb5eaf50b1 (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 14:50:05.855435  7835 tablet_service.cc:1511] Processing CreateTablet for tablet 9cd6df0b766447119ea9e0acb887af01 (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 14:50:05.862389  7763 tablet_service.cc:1511] Processing CreateTablet for tablet e63cef01f72446c09b46b48ebbbd714a (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 14:50:05.867359  7971 tablet_bootstrap.cc:492] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac: No bootstrap required, opened a new log
I20260709 14:50:05.869364  7971 ts_tablet_manager.cc:1403] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent bootstrapping tablet: real 0.258s	user 0.040s	sys 0.027s
I20260709 14:50:05.872131  7765 tablet_service.cc:1511] Processing CreateTablet for tablet 5a31abe772ad42e78f78a2f1d95bcb16 (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 14:50:05.876655  7765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a31abe772ad42e78f78a2f1d95bcb16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:05.875255  7835 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9cd6df0b766447119ea9e0acb887af01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:05.872803  7971 raft_consensus.cc:359] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:05.890995  7842 tablet_service.cc:1511] Processing CreateTablet for tablet e63cef01f72446c09b46b48ebbbd714a (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 14:50:05.897552  7842 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e63cef01f72446c09b46b48ebbbd714a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:05.891103  7974 tablet_bootstrap.cc:492] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0: Bootstrap starting.
I20260709 14:50:05.892406  7838 tablet_service.cc:1511] Processing CreateTablet for tablet 5a31abe772ad42e78f78a2f1d95bcb16 (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 14:50:05.906252  7838 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a31abe772ad42e78f78a2f1d95bcb16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:05.903498  7841 tablet_service.cc:1511] Processing CreateTablet for tablet c1e7a6b95b3947cba44740eb2a23e8d9 (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 14:50:05.895342  7916 tablet_service.cc:1511] Processing CreateTablet for tablet e63cef01f72446c09b46b48ebbbd714a (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 14:50:05.910224  7841 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1e7a6b95b3947cba44740eb2a23e8d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:05.912504  7843 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f693cee587949c6bde5463f4fd33b01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:05.912812  7971 raft_consensus.cc:385] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:05.917773  7971 raft_consensus.cc:740] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Initialized, Role: FOLLOWER
I20260709 14:50:05.918536  7917 tablet_service.cc:1511] Processing CreateTablet for tablet 9cd6df0b766447119ea9e0acb887af01 (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 14:50:05.916699  7911 tablet_service.cc:1511] Processing CreateTablet for tablet 6f693cee587949c6bde5463f4fd33b01 (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 14:50:05.924045  7974 tablet_bootstrap.cc:654] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:05.922914  7914 tablet_service.cc:1511] Processing CreateTablet for tablet 5a31abe772ad42e78f78a2f1d95bcb16 (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 14:50:05.910636  7916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e63cef01f72446c09b46b48ebbbd714a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:05.929847  7912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a18d29d52d304c87b930d4fb5eaf50b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:05.929922  7763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e63cef01f72446c09b46b48ebbbd714a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:05.933679  7767 tablet_service.cc:1511] Processing CreateTablet for tablet c1e7a6b95b3947cba44740eb2a23e8d9 (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 14:50:05.936199  7767 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1e7a6b95b3947cba44740eb2a23e8d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:05.936479  7769 tablet_service.cc:1511] Processing CreateTablet for tablet f0813c88ccff4990b3b5d74b18a3e674 (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 14:50:05.932902  7971 consensus_queue.cc:260] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:05.938586  7917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9cd6df0b766447119ea9e0acb887af01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:05.942021  7913 tablet_service.cc:1511] Processing CreateTablet for tablet c1e7a6b95b3947cba44740eb2a23e8d9 (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 14:50:05.944384  7913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1e7a6b95b3947cba44740eb2a23e8d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:05.945634  7911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f693cee587949c6bde5463f4fd33b01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:05.947839  7761 tablet_service.cc:1511] Processing CreateTablet for tablet ae1f7722fdea49e0b5e9c5d96633eaf9 (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 14:50:05.950872  7761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae1f7722fdea49e0b5e9c5d96633eaf9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:05.950203  7914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a31abe772ad42e78f78a2f1d95bcb16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:05.955205  7915 tablet_service.cc:1511] Processing CreateTablet for tablet ae1f7722fdea49e0b5e9c5d96633eaf9 (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 14:50:05.959884  7804 heartbeater.cc:499] Master 127.6.101.126:38743 was elected leader, sending a full tablet report...
I20260709 14:50:05.960574  7839 tablet_service.cc:1511] Processing CreateTablet for tablet f0813c88ccff4990b3b5d74b18a3e674 (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 14:50:05.962318  7839 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0813c88ccff4990b3b5d74b18a3e674. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:05.977118  7769 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0813c88ccff4990b3b5d74b18a3e674. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:05.964048  7918 tablet_service.cc:1511] Processing CreateTablet for tablet f0813c88ccff4990b3b5d74b18a3e674 (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 14:50:05.985689  7915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae1f7722fdea49e0b5e9c5d96633eaf9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:05.959846  7844 tablet_service.cc:1511] Processing CreateTablet for tablet ae1f7722fdea49e0b5e9c5d96633eaf9 (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 14:50:06.025305  7836 tablet_service.cc:1511] Processing CreateTablet for tablet 15359084dc6a466ca9280b7e4b63454b (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 14:50:06.026671  7971 ts_tablet_manager.cc:1434] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent starting tablet: real 0.157s	user 0.018s	sys 0.003s
I20260709 14:50:06.027520  7762 tablet_service.cc:1511] Processing CreateTablet for tablet 15359084dc6a466ca9280b7e4b63454b (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 14:50:06.028164  7879 heartbeater.cc:499] Master 127.6.101.126:38743 was elected leader, sending a full tablet report...
I20260709 14:50:06.053655  7837 tablet_service.cc:1511] Processing CreateTablet for tablet f8b780b4cd374bdfa269ff8079b90f9c (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 14:50:06.047050  7918 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0813c88ccff4990b3b5d74b18a3e674. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:06.071030  7837 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8b780b4cd374bdfa269ff8079b90f9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:06.073518  7762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15359084dc6a466ca9280b7e4b63454b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 14:50:06.074376  7880 tablet.cc:2406] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 14:50:06.080089  7972 tablet_bootstrap.cc:492] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed: No bootstrap required, opened a new log
I20260709 14:50:06.080746  7972 ts_tablet_manager.cc:1403] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent bootstrapping tablet: real 0.325s	user 0.024s	sys 0.022s
I20260709 14:50:06.085701  7844 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae1f7722fdea49e0b5e9c5d96633eaf9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:06.087906  7910 tablet_service.cc:1511] Processing CreateTablet for tablet f8b780b4cd374bdfa269ff8079b90f9c (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 14:50:06.083524  7974 tablet_bootstrap.cc:492] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0: No bootstrap required, opened a new log
I20260709 14:50:06.083333  7760 tablet_service.cc:1511] Processing CreateTablet for tablet d1e70b78c0514fcda22ba3552f5e82ea (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 14:50:06.094571  7760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1e70b78c0514fcda22ba3552f5e82ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:06.094036  7909 tablet_service.cc:1511] Processing CreateTablet for tablet 15359084dc6a466ca9280b7e4b63454b (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 14:50:06.097841  7974 ts_tablet_manager.cc:1403] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent bootstrapping tablet: real 0.208s	user 0.016s	sys 0.031s
I20260709 14:50:06.106859  7909 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15359084dc6a466ca9280b7e4b63454b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:06.076257  7764 tablet_service.cc:1511] Processing CreateTablet for tablet f8b780b4cd374bdfa269ff8079b90f9c (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 14:50:06.116815  7910 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8b780b4cd374bdfa269ff8079b90f9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:06.119099  7764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8b780b4cd374bdfa269ff8079b90f9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:06.127362  7971 tablet_bootstrap.cc:492] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac: Bootstrap starting.
I20260709 14:50:06.150856  7836 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15359084dc6a466ca9280b7e4b63454b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:06.152709  7840 tablet_service.cc:1511] Processing CreateTablet for tablet 80265d77f70046f997ce9c4fef0a107c (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 14:50:06.120038  7838 tablet_service.cc:1511] Processing CreateTablet for tablet d1e70b78c0514fcda22ba3552f5e82ea (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 14:50:06.131001  7974 raft_consensus.cc:359] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:06.166604  7974 raft_consensus.cc:385] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:06.168043  7974 raft_consensus.cc:740] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Initialized, Role: FOLLOWER
I20260709 14:50:06.140182  7972 raft_consensus.cc:359] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:06.149353  7765 tablet_service.cc:1511] Processing CreateTablet for tablet 80265d77f70046f997ce9c4fef0a107c (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 14:50:06.170588  7765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80265d77f70046f997ce9c4fef0a107c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:06.173563  7972 raft_consensus.cc:385] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:06.174070  7972 raft_consensus.cc:740] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Initialized, Role: FOLLOWER
I20260709 14:50:06.177655  7972 consensus_queue.cc:260] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:06.185659  7840 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80265d77f70046f997ce9c4fef0a107c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:06.218705  7974 consensus_queue.cc:260] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:06.222872  7838 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1e70b78c0514fcda22ba3552f5e82ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:06.230703  7768 tablet_service.cc:1511] Processing CreateTablet for tablet 0ad621bd873f4a429a62f9755f4cc775 (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 14:50:06.232515  7768 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ad621bd873f4a429a62f9755f4cc775. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:06.184932  7911 tablet_service.cc:1511] Processing CreateTablet for tablet d1e70b78c0514fcda22ba3552f5e82ea (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 14:50:06.243088  7911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1e70b78c0514fcda22ba3552f5e82ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:06.216055  7909 tablet_service.cc:1511] Processing CreateTablet for tablet 80265d77f70046f997ce9c4fef0a107c (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 14:50:06.246186  7909 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80265d77f70046f997ce9c4fef0a107c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:06.209041  7971 tablet_bootstrap.cc:654] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:06.256915  7953 heartbeater.cc:499] Master 127.6.101.126:38743 was elected leader, sending a full tablet report...
I20260709 14:50:06.292687  7841 tablet_service.cc:1511] Processing CreateTablet for tablet 0ad621bd873f4a429a62f9755f4cc775 (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 14:50:06.294315  7841 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ad621bd873f4a429a62f9755f4cc775. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:06.315752  7915 tablet_service.cc:1511] Processing CreateTablet for tablet 0ad621bd873f4a429a62f9755f4cc775 (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 14:50:06.318544  7915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ad621bd873f4a429a62f9755f4cc775. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:06.321029  7839 tablet_service.cc:1511] Processing CreateTablet for tablet f69c398b243d41308ddd552fcb6b657c (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 14:50:06.322563  7839 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f69c398b243d41308ddd552fcb6b657c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:06.352748  7976 raft_consensus.cc:493] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:50:06.353374  7976 raft_consensus.cc:515] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:06.397084  7843 tablet_service.cc:1511] Processing CreateTablet for tablet 7a1707111d8045f2b8c2f219724e133d (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 14:50:06.399483  7843 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a1707111d8045f2b8c2f219724e133d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:06.361558  7918 tablet_service.cc:1511] Processing CreateTablet for tablet f69c398b243d41308ddd552fcb6b657c (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 14:50:06.419576  7918 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f69c398b243d41308ddd552fcb6b657c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:06.370785  7976 leader_election.cc:290] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:06.427248  7971 tablet_bootstrap.cc:492] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac: No bootstrap required, opened a new log
I20260709 14:50:06.427934  7971 ts_tablet_manager.cc:1403] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent bootstrapping tablet: real 0.301s	user 0.033s	sys 0.018s
I20260709 14:50:06.446099  7769 tablet_service.cc:1511] Processing CreateTablet for tablet f69c398b243d41308ddd552fcb6b657c (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 14:50:06.448201  7769 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f69c398b243d41308ddd552fcb6b657c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:06.452385  7972 ts_tablet_manager.cc:1434] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent starting tablet: real 0.368s	user 0.014s	sys 0.018s
I20260709 14:50:06.459649  7971 raft_consensus.cc:359] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:06.460661  7974 ts_tablet_manager.cc:1434] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent starting tablet: real 0.362s	user 0.006s	sys 0.027s
I20260709 14:50:06.460752  7971 raft_consensus.cc:385] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:06.462376  7974 tablet_bootstrap.cc:492] T 9ce9c0ef2db24c13a8b1402f21819458 P 1e9289592458429bbddb19c2e7b7b7b0: Bootstrap starting.
I20260709 14:50:06.478410  7844 tablet_service.cc:1511] Processing CreateTablet for tablet 3dcde6b5a9614f56b6fee208e40eae0f (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 14:50:06.478408  7765 tablet_service.cc:1511] Processing CreateTablet for tablet 7a1707111d8045f2b8c2f219724e133d (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 14:50:06.498558  7765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a1707111d8045f2b8c2f219724e133d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:06.495184  7835 tablet_service.cc:1511] Processing CreateTablet for tablet e145ae252e8041f9b5ad2dbebcf279c9 (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 14:50:06.496412  7844 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3dcde6b5a9614f56b6fee208e40eae0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:06.499796  7762 tablet_service.cc:1511] Processing CreateTablet for tablet 939996e77ee64e9fab21aef50758b706 (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 14:50:06.501349  7835 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e145ae252e8041f9b5ad2dbebcf279c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:06.504657  7974 tablet_bootstrap.cc:654] T 9ce9c0ef2db24c13a8b1402f21819458 P 1e9289592458429bbddb19c2e7b7b7b0: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:06.476046  7914 tablet_service.cc:1511] Processing CreateTablet for tablet 7a1707111d8045f2b8c2f219724e133d (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 14:50:06.507133  7914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a1707111d8045f2b8c2f219724e133d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:06.480137  7766 tablet_service.cc:1511] Processing CreateTablet for tablet 3dcde6b5a9614f56b6fee208e40eae0f (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 14:50:06.517017  7766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3dcde6b5a9614f56b6fee208e40eae0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:06.461151  7971 raft_consensus.cc:740] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Initialized, Role: FOLLOWER
I20260709 14:50:06.530018  7762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 939996e77ee64e9fab21aef50758b706. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:06.485682  7916 tablet_service.cc:1511] Processing CreateTablet for tablet 3dcde6b5a9614f56b6fee208e40eae0f (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 14:50:06.487412  7837 tablet_service.cc:1511] Processing CreateTablet for tablet 939996e77ee64e9fab21aef50758b706 (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 14:50:06.535584  7916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3dcde6b5a9614f56b6fee208e40eae0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:06.536494  7837 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 939996e77ee64e9fab21aef50758b706. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:06.481118  7972 tablet_bootstrap.cc:492] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed: Bootstrap starting.
I20260709 14:50:06.561872  7842 tablet_service.cc:1511] Processing CreateTablet for tablet d90f7d5fb59843e0a06107c48f794b4c (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 14:50:06.547068  7909 tablet_service.cc:1511] Processing CreateTablet for tablet 939996e77ee64e9fab21aef50758b706 (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 14:50:06.578866  7909 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 939996e77ee64e9fab21aef50758b706. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:06.574822  7842 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d90f7d5fb59843e0a06107c48f794b4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:06.594655  7974 tablet_bootstrap.cc:492] T 9ce9c0ef2db24c13a8b1402f21819458 P 1e9289592458429bbddb19c2e7b7b7b0: No bootstrap required, opened a new log
I20260709 14:50:06.595307  7974 ts_tablet_manager.cc:1403] T 9ce9c0ef2db24c13a8b1402f21819458 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent bootstrapping tablet: real 0.133s	user 0.018s	sys 0.003s
I20260709 14:50:06.599980  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
W20260709 14:50:06.603842  7819 leader_election.cc:343] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:06.571192  7840 tablet_service.cc:1511] Processing CreateTablet for tablet 783e4874513449ef9084b833f188a6d3 (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 14:50:06.605686  7978 raft_consensus.cc:493] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:50:06.606571  7840 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 783e4874513449ef9084b833f188a6d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:06.606256  7978 raft_consensus.cc:515] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:06.607549  7841 tablet_service.cc:1511] Processing CreateTablet for tablet 6c3288d48c284f02b3b49ffcefea563c (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 14:50:06.609467  7841 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c3288d48c284f02b3b49ffcefea563c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:06.615592  7978 leader_election.cc:290] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:50:06.618142  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:50:06.624831  7918 tablet_service.cc:1511] Processing CreateTablet for tablet e145ae252e8041f9b5ad2dbebcf279c9 (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 14:50:06.626160  7915 tablet_service.cc:1511] Processing CreateTablet for tablet 783e4874513449ef9084b833f188a6d3 (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 14:50:06.626763  7918 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e145ae252e8041f9b5ad2dbebcf279c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:06.631582  7974 raft_consensus.cc:359] T 9ce9c0ef2db24c13a8b1402f21819458 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:06.546810  7971 consensus_queue.cc:260] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:06.633525  7974 raft_consensus.cc:385] T 9ce9c0ef2db24c13a8b1402f21819458 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:06.638446  7915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 783e4874513449ef9084b833f188a6d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:06.634075  7974 raft_consensus.cc:740] T 9ce9c0ef2db24c13a8b1402f21819458 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Initialized, Role: FOLLOWER
I20260709 14:50:06.647001  7972 tablet_bootstrap.cc:654] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed: Neither blocks nor log segments found. Creating new log.
W20260709 14:50:06.647620  7725 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 14:50:06.647156  7913 tablet_service.cc:1511] Processing CreateTablet for tablet d90f7d5fb59843e0a06107c48f794b4c (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 14:50:06.649163  7913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d90f7d5fb59843e0a06107c48f794b4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:06.650110  7979 raft_consensus.cc:493] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:50:06.650846  7979 raft_consensus.cc:515] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:06.664357  7762 tablet_service.cc:1511] Processing CreateTablet for tablet 783e4874513449ef9084b833f188a6d3 (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 14:50:06.666579  7762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 783e4874513449ef9084b833f188a6d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:06.655905  7979 leader_election.cc:290] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:06.672390  7971 ts_tablet_manager.cc:1434] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent starting tablet: real 0.244s	user 0.016s	sys 0.000s
W20260709 14:50:06.711057  7819 leader_election.cc:343] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:06.672389  7764 tablet_service.cc:1511] Processing CreateTablet for tablet d90f7d5fb59843e0a06107c48f794b4c (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 14:50:06.723521  7764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d90f7d5fb59843e0a06107c48f794b4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:06.722553  7819 leader_election.cc:304] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:50:06.725931  7971 tablet_bootstrap.cc:492] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac: Bootstrap starting.
I20260709 14:50:06.721978  7768 tablet_service.cc:1511] Processing CreateTablet for tablet e145ae252e8041f9b5ad2dbebcf279c9 (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 14:50:06.701913  7974 consensus_queue.cc:260] T 9ce9c0ef2db24c13a8b1402f21819458 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:06.730248  7768 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e145ae252e8041f9b5ad2dbebcf279c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:06.719971  7839 tablet_service.cc:1511] Processing CreateTablet for tablet 4ce6f5d59057468c923f98279ba0df4f (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 14:50:06.732113  7974 ts_tablet_manager.cc:1434] T 9ce9c0ef2db24c13a8b1402f21819458 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent starting tablet: real 0.136s	user 0.004s	sys 0.008s
I20260709 14:50:06.734716  7976 raft_consensus.cc:2749] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 14:50:06.734900  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 54552.3us
I20260709 14:50:06.749396  7769 tablet_service.cc:1511] Processing CreateTablet for tablet 6c3288d48c284f02b3b49ffcefea563c (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 14:50:06.751085  7769 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c3288d48c284f02b3b49ffcefea563c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:06.755409  7763 tablet_service.cc:1511] Processing CreateTablet for tablet 4ce6f5d59057468c923f98279ba0df4f (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 14:50:06.758266  7763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ce6f5d59057468c923f98279ba0df4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:06.737985  7909 tablet_service.cc:1511] Processing CreateTablet for tablet 6c3288d48c284f02b3b49ffcefea563c (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 14:50:06.770486  7909 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c3288d48c284f02b3b49ffcefea563c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:06.773097  7841 tablet_service.cc:1511] Processing CreateTablet for tablet 7a4c17373ec546d59a82ce33b6938268 (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 14:50:06.775533  7841 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a4c17373ec546d59a82ce33b6938268. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:06.796881  7838 tablet_service.cc:1511] Processing CreateTablet for tablet 6d2e94b7532d44c5bad6074beb44b463 (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 14:50:06.805351  7838 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d2e94b7532d44c5bad6074beb44b463. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:06.787542  7974 tablet_bootstrap.cc:492] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0: Bootstrap starting.
I20260709 14:50:06.817081  7976 raft_consensus.cc:493] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:50:06.819446  7976 raft_consensus.cc:515] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:06.822088  7976 leader_election.cc:290] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:06.825985  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:50:06.829480  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:50:06.837486  7839 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ce6f5d59057468c923f98279ba0df4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:06.847700  7844 tablet_service.cc:1511] Processing CreateTablet for tablet 9c563cc7cfbe4d59be4ffc5cf847ce56 (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 14:50:06.849763  7844 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c563cc7cfbe4d59be4ffc5cf847ce56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:06.857331  7911 tablet_service.cc:1511] Processing CreateTablet for tablet 4ce6f5d59057468c923f98279ba0df4f (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 14:50:06.859573  7911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ce6f5d59057468c923f98279ba0df4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:06.864662  7917 tablet_service.cc:1511] Processing CreateTablet for tablet 7a4c17373ec546d59a82ce33b6938268 (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 14:50:06.868047  7912 tablet_service.cc:1511] Processing CreateTablet for tablet 6d2e94b7532d44c5bad6074beb44b463 (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 14:50:06.869189  7760 tablet_service.cc:1511] Processing CreateTablet for tablet 6d2e94b7532d44c5bad6074beb44b463 (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 14:50:06.871033  7760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d2e94b7532d44c5bad6074beb44b463. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 14:50:06.867449  7819 leader_election.cc:343] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:06.874823  7917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a4c17373ec546d59a82ce33b6938268. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:06.864158  7766 tablet_service.cc:1511] Processing CreateTablet for tablet 7a4c17373ec546d59a82ce33b6938268 (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 14:50:06.882193  7972 tablet_bootstrap.cc:492] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed: No bootstrap required, opened a new log
I20260709 14:50:06.883209  7972 ts_tablet_manager.cc:1403] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent bootstrapping tablet: real 0.402s	user 0.020s	sys 0.013s
I20260709 14:50:06.884404  7766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a4c17373ec546d59a82ce33b6938268. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:06.887174  7972 raft_consensus.cc:359] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:06.891537  7761 tablet_service.cc:1511] Processing CreateTablet for tablet 9c563cc7cfbe4d59be4ffc5cf847ce56 (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 14:50:06.894395  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:50:06.906463  7835 tablet_service.cc:1511] Processing CreateTablet for tablet b30d297a612a4252bdf5eb6aa21c11ff (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 14:50:06.922247  7761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c563cc7cfbe4d59be4ffc5cf847ce56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:06.922916  7835 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b30d297a612a4252bdf5eb6aa21c11ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:06.926725  7978 raft_consensus.cc:493] T 9ce9c0ef2db24c13a8b1402f21819458 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:50:06.927366  7978 raft_consensus.cc:515] T 9ce9c0ef2db24c13a8b1402f21819458 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:50:06.929601  7893 leader_election.cc:343] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:06.930313  7978 leader_election.cc:290] T 9ce9c0ef2db24c13a8b1402f21819458 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:50:06.933498  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce9c0ef2db24c13a8b1402f21819458" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
W20260709 14:50:06.936414  7893 leader_election.cc:343] T 9ce9c0ef2db24c13a8b1402f21819458 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:06.945348  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:50:06.945132  7910 tablet_service.cc:1511] Processing CreateTablet for tablet b30d297a612a4252bdf5eb6aa21c11ff (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 14:50:06.945581  7916 tablet_service.cc:1511] Processing CreateTablet for tablet 9c563cc7cfbe4d59be4ffc5cf847ce56 (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 14:50:06.908279  7971 tablet_bootstrap.cc:654] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:06.947206  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce9c0ef2db24c13a8b1402f21819458" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:50:06.948894  7974 tablet_bootstrap.cc:654] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0: Neither blocks nor log segments found. Creating new log.
W20260709 14:50:06.912011  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 45230us
I20260709 14:50:06.949524  7972 raft_consensus.cc:385] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:06.950357  7972 raft_consensus.cc:740] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Initialized, Role: FOLLOWER
W20260709 14:50:06.950678  7894 leader_election.cc:343] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:06.951330  7894 leader_election.cc:304] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:06.895957  7912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d2e94b7532d44c5bad6074beb44b463. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 14:50:06.952847  7894 leader_election.cc:343] T 9ce9c0ef2db24c13a8b1402f21819458 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Illegal state: must be running to vote when last-logged opid is not known
W20260709 14:50:06.949712  7819 leader_election.cc:343] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:06.953052  7767 tablet_service.cc:1511] Processing CreateTablet for tablet 46456e760e004d6c8f70251651e0b26b (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 14:50:06.953392  7894 leader_election.cc:304] T 9ce9c0ef2db24c13a8b1402f21819458 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:06.953706  7819 leader_election.cc:304] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:50:06.954502  7767 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46456e760e004d6c8f70251651e0b26b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:06.955257  7910 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b30d297a612a4252bdf5eb6aa21c11ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:06.954523  7976 raft_consensus.cc:2749] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:50:06.954639  7978 raft_consensus.cc:2749] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:50:06.959508  7978 raft_consensus.cc:2749] T 9ce9c0ef2db24c13a8b1402f21819458 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:50:06.960860  7765 tablet_service.cc:1511] Processing CreateTablet for tablet b30d297a612a4252bdf5eb6aa21c11ff (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 14:50:06.966424  7765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b30d297a612a4252bdf5eb6aa21c11ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:06.970984  7837 tablet_service.cc:1511] Processing CreateTablet for tablet 46456e760e004d6c8f70251651e0b26b (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 14:50:06.976430  7916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c563cc7cfbe4d59be4ffc5cf847ce56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:06.996683  7913 tablet_service.cc:1511] Processing CreateTablet for tablet 46456e760e004d6c8f70251651e0b26b (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 14:50:06.997480  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:50:06.998674  7913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46456e760e004d6c8f70251651e0b26b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 14:50:06.999253  7745 leader_election.cc:343] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:07.001847  7837 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46456e760e004d6c8f70251651e0b26b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:07.001482  7972 consensus_queue.cc:260] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:07.007840  7972 ts_tablet_manager.cc:1434] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent starting tablet: real 0.124s	user 0.009s	sys 0.000s
I20260709 14:50:07.020315  7764 tablet_service.cc:1511] Processing CreateTablet for tablet 23d1003a47fa4cb19d9050eb07529044 (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 14:50:07.025602  7972 tablet_bootstrap.cc:492] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed: Bootstrap starting.
I20260709 14:50:07.028508  7842 tablet_service.cc:1511] Processing CreateTablet for tablet 23d1003a47fa4cb19d9050eb07529044 (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 14:50:07.029891  7764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23d1003a47fa4cb19d9050eb07529044. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:07.034777  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
W20260709 14:50:07.052460  7744 leader_election.cc:343] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:07.053085  7744 leader_election.cc:304] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:07.054787  7979 raft_consensus.cc:2749] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:50:07.059966  7842 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23d1003a47fa4cb19d9050eb07529044. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:07.052062  7914 tablet_service.cc:1511] Processing CreateTablet for tablet 23d1003a47fa4cb19d9050eb07529044 (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 14:50:07.085522  7914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23d1003a47fa4cb19d9050eb07529044. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:07.086489  7971 tablet_bootstrap.cc:492] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac: No bootstrap required, opened a new log
I20260709 14:50:07.087203  7971 ts_tablet_manager.cc:1403] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent bootstrapping tablet: real 0.362s	user 0.015s	sys 0.004s
I20260709 14:50:07.092381  7972 tablet_bootstrap.cc:654] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:07.065205  7766 tablet_service.cc:1511] Processing CreateTablet for tablet 7ea45807ea1741b8a66a73294b0f3bb1 (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 14:50:07.103698  7766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ea45807ea1741b8a66a73294b0f3bb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:07.104118  7971 raft_consensus.cc:359] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:07.105196  7971 raft_consensus.cc:385] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:07.105909  7971 raft_consensus.cc:740] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Initialized, Role: FOLLOWER
I20260709 14:50:07.123176  7839 tablet_service.cc:1511] Processing CreateTablet for tablet 7ea45807ea1741b8a66a73294b0f3bb1 (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 14:50:07.124612  7839 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ea45807ea1741b8a66a73294b0f3bb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:07.134508  7844 tablet_service.cc:1511] Processing CreateTablet for tablet 787a21690c744946b36b3d3baa26d8b6 (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 14:50:07.136250  7844 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 787a21690c744946b36b3d3baa26d8b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:07.139055  7835 tablet_service.cc:1511] Processing CreateTablet for tablet 94c22c68d7d64909bc3be2a12cd51375 (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 14:50:07.141527  7835 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94c22c68d7d64909bc3be2a12cd51375. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:07.145939  7971 consensus_queue.cc:260] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:07.147156  7767 tablet_service.cc:1511] Processing CreateTablet for tablet 787a21690c744946b36b3d3baa26d8b6 (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 14:50:07.166536  7767 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 787a21690c744946b36b3d3baa26d8b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:07.169549  7915 tablet_service.cc:1511] Processing CreateTablet for tablet 94c22c68d7d64909bc3be2a12cd51375 (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 14:50:07.171654  7762 tablet_service.cc:1511] Processing CreateTablet for tablet af383cb6c2e843c593c3d86266ffdfdf (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 14:50:07.141954  7917 tablet_service.cc:1511] Processing CreateTablet for tablet 787a21690c744946b36b3d3baa26d8b6 (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 14:50:07.173188  7762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af383cb6c2e843c593c3d86266ffdfdf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:07.150923  7911 tablet_service.cc:1511] Processing CreateTablet for tablet 7ea45807ea1741b8a66a73294b0f3bb1 (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 14:50:07.172953  7915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94c22c68d7d64909bc3be2a12cd51375. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:07.180465  7917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 787a21690c744946b36b3d3baa26d8b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:07.177070  7971 ts_tablet_manager.cc:1434] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent starting tablet: real 0.090s	user 0.000s	sys 0.013s
I20260709 14:50:07.182205  7971 tablet_bootstrap.cc:492] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac: Bootstrap starting.
I20260709 14:50:07.183259  7911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ea45807ea1741b8a66a73294b0f3bb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:07.193086  7974 tablet_bootstrap.cc:492] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0: No bootstrap required, opened a new log
I20260709 14:50:07.192724  7837 tablet_service.cc:1511] Processing CreateTablet for tablet af383cb6c2e843c593c3d86266ffdfdf (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 14:50:07.194362  7974 ts_tablet_manager.cc:1403] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent bootstrapping tablet: real 0.461s	user 0.015s	sys 0.015s
I20260709 14:50:07.195115  7837 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af383cb6c2e843c593c3d86266ffdfdf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:07.199565  7841 tablet_service.cc:1511] Processing CreateTablet for tablet fd30845430df4f21a2512e25b0b9d0d3 (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 14:50:07.202973  7841 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd30845430df4f21a2512e25b0b9d0d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:07.212585  7766 tablet_service.cc:1511] Processing CreateTablet for tablet fd30845430df4f21a2512e25b0b9d0d3 (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 14:50:07.214653  7766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd30845430df4f21a2512e25b0b9d0d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:07.217870  7974 raft_consensus.cc:359] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:07.218973  7974 raft_consensus.cc:385] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:07.219285  7974 raft_consensus.cc:740] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Initialized, Role: FOLLOWER
I20260709 14:50:07.220288  7974 consensus_queue.cc:260] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:07.227682  7972 tablet_bootstrap.cc:492] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed: No bootstrap required, opened a new log
I20260709 14:50:07.228454  7972 ts_tablet_manager.cc:1403] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent bootstrapping tablet: real 0.203s	user 0.032s	sys 0.006s
I20260709 14:50:07.233065  7761 tablet_service.cc:1511] Processing CreateTablet for tablet 94c22c68d7d64909bc3be2a12cd51375 (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 14:50:07.235273  7761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94c22c68d7d64909bc3be2a12cd51375. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:07.240741  7971 tablet_bootstrap.cc:654] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:07.242707  7910 tablet_service.cc:1511] Processing CreateTablet for tablet af383cb6c2e843c593c3d86266ffdfdf (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 14:50:07.244294  7910 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af383cb6c2e843c593c3d86266ffdfdf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:07.293380  7842 tablet_service.cc:1511] Processing CreateTablet for tablet aaec8a5f12b648c88c0b0c55c6ac3a92 (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 14:50:07.295293  7842 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aaec8a5f12b648c88c0b0c55c6ac3a92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:07.302551  7913 tablet_service.cc:1511] Processing CreateTablet for tablet fd30845430df4f21a2512e25b0b9d0d3 (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 14:50:07.304813  7913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd30845430df4f21a2512e25b0b9d0d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:07.306067  7972 raft_consensus.cc:359] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:07.306838  7972 raft_consensus.cc:385] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:07.307132  7972 raft_consensus.cc:740] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Initialized, Role: FOLLOWER
I20260709 14:50:07.308343  7764 tablet_service.cc:1511] Processing CreateTablet for tablet aaec8a5f12b648c88c0b0c55c6ac3a92 (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 14:50:07.308589  7972 consensus_queue.cc:260] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:07.310057  7764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aaec8a5f12b648c88c0b0c55c6ac3a92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:07.304939  7974 ts_tablet_manager.cc:1434] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent starting tablet: real 0.110s	user 0.007s	sys 0.005s
I20260709 14:50:07.327203  7972 ts_tablet_manager.cc:1434] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent starting tablet: real 0.098s	user 0.006s	sys 0.009s
I20260709 14:50:07.333369  7974 tablet_bootstrap.cc:492] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0: Bootstrap starting.
I20260709 14:50:07.334894  7767 tablet_service.cc:1511] Processing CreateTablet for tablet b313d3d5be334c0697556ab7c8cabbf3 (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 14:50:07.335546  7910 tablet_service.cc:1511] Processing CreateTablet for tablet aaec8a5f12b648c88c0b0c55c6ac3a92 (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 14:50:07.337545  7767 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b313d3d5be334c0697556ab7c8cabbf3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:07.337870  7910 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aaec8a5f12b648c88c0b0c55c6ac3a92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:07.342754  7841 tablet_service.cc:1511] Processing CreateTablet for tablet b313d3d5be334c0697556ab7c8cabbf3 (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 14:50:07.344547  7841 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b313d3d5be334c0697556ab7c8cabbf3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:07.354171  7972 tablet_bootstrap.cc:492] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed: Bootstrap starting.
I20260709 14:50:07.359046  7761 tablet_service.cc:1511] Processing CreateTablet for tablet a7960f2a6dc94357a722fa1a67e8383c (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 14:50:07.361021  7761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7960f2a6dc94357a722fa1a67e8383c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:07.364831  7912 tablet_service.cc:1511] Processing CreateTablet for tablet b313d3d5be334c0697556ab7c8cabbf3 (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 14:50:07.367226  7912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b313d3d5be334c0697556ab7c8cabbf3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:07.370606  7835 tablet_service.cc:1511] Processing CreateTablet for tablet a7960f2a6dc94357a722fa1a67e8383c (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 14:50:07.372406  7835 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7960f2a6dc94357a722fa1a67e8383c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:07.372582  7914 tablet_service.cc:1511] Processing CreateTablet for tablet a7960f2a6dc94357a722fa1a67e8383c (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 14:50:07.379329  7971 tablet_bootstrap.cc:492] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac: No bootstrap required, opened a new log
I20260709 14:50:07.386761  7914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7960f2a6dc94357a722fa1a67e8383c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:07.387382  7762 tablet_service.cc:1511] Processing CreateTablet for tablet a766fdd282824a82bd600fc0ffb448ca (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 14:50:07.389494  7762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a766fdd282824a82bd600fc0ffb448ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:07.364861  7974 tablet_bootstrap.cc:654] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:07.393455  7971 ts_tablet_manager.cc:1403] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent bootstrapping tablet: real 0.212s	user 0.009s	sys 0.011s
I20260709 14:50:07.419896  7765 tablet_service.cc:1511] Processing CreateTablet for tablet c05ad41456b24682a1e65d2c804d2956 (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 14:50:07.421881  7765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c05ad41456b24682a1e65d2c804d2956. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:07.423832  7979 raft_consensus.cc:493] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:50:07.424489  7979 raft_consensus.cc:515] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:07.426695  7910 tablet_service.cc:1511] Processing CreateTablet for tablet a766fdd282824a82bd600fc0ffb448ca (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 14:50:07.427356  7979 leader_election.cc:290] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:07.428416  7910 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a766fdd282824a82bd600fc0ffb448ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:07.429728  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:50:07.430482  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:50:07.431002  7853 raft_consensus.cc:2468] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 0.
I20260709 14:50:07.431229  7928 raft_consensus.cc:2468] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 0.
I20260709 14:50:07.434082  7972 tablet_bootstrap.cc:654] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:07.434413  7744 leader_election.cc:304] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:50:07.435575  7979 raft_consensus.cc:2804] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:50:07.436070  7979 raft_consensus.cc:493] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:50:07.436460  7979 raft_consensus.cc:3060] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:07.434219  7844 tablet_service.cc:1511] Processing CreateTablet for tablet a766fdd282824a82bd600fc0ffb448ca (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 14:50:07.450587  7844 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a766fdd282824a82bd600fc0ffb448ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:07.450906  7837 tablet_service.cc:1511] Processing CreateTablet for tablet c05ad41456b24682a1e65d2c804d2956 (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 14:50:07.454283  7911 tablet_service.cc:1511] Processing CreateTablet for tablet c05ad41456b24682a1e65d2c804d2956 (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 14:50:07.456230  7911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c05ad41456b24682a1e65d2c804d2956. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:07.460352  7839 tablet_service.cc:1511] Processing CreateTablet for tablet 1cacfb5953cb4bf2a7fe431923ead129 (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 14:50:07.464849  7913 tablet_service.cc:1511] Processing CreateTablet for tablet 1cacfb5953cb4bf2a7fe431923ead129 (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 14:50:07.464892  7764 tablet_service.cc:1511] Processing CreateTablet for tablet 1cacfb5953cb4bf2a7fe431923ead129 (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 14:50:07.472761  7837 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c05ad41456b24682a1e65d2c804d2956. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:07.434094  7971 raft_consensus.cc:359] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:07.473695  7913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cacfb5953cb4bf2a7fe431923ead129. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:07.474822  7971 raft_consensus.cc:385] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:07.475315  7971 raft_consensus.cc:740] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Initialized, Role: FOLLOWER
I20260709 14:50:07.475685  7839 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cacfb5953cb4bf2a7fe431923ead129. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:07.476409  7971 consensus_queue.cc:260] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:07.480644  7976 raft_consensus.cc:493] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:50:07.480540  7764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cacfb5953cb4bf2a7fe431923ead129. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:07.483929  7976 raft_consensus.cc:515] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:07.491932  7974 tablet_bootstrap.cc:492] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0: No bootstrap required, opened a new log
I20260709 14:50:07.492522  7974 ts_tablet_manager.cc:1403] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent bootstrapping tablet: real 0.159s	user 0.004s	sys 0.016s
I20260709 14:50:07.495289  7838 tablet_service.cc:1511] Processing CreateTablet for tablet 696fba4415c046498d3e10fb37d1a67f (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 14:50:07.497037  7838 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 696fba4415c046498d3e10fb37d1a67f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:07.500662  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
W20260709 14:50:07.502905  7819 leader_election.cc:343] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:07.506837  7916 tablet_service.cc:1511] Processing CreateTablet for tablet 696fba4415c046498d3e10fb37d1a67f (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 14:50:07.509004  7916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 696fba4415c046498d3e10fb37d1a67f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:07.512331  7917 tablet_service.cc:1511] Processing CreateTablet for tablet 5ad88b19ba074d7eb419542cddcebb51 (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 14:50:07.514640  7767 tablet_service.cc:1511] Processing CreateTablet for tablet 5ad88b19ba074d7eb419542cddcebb51 (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 14:50:07.515800  7917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ad88b19ba074d7eb419542cddcebb51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:07.498747  7976 leader_election.cc:290] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:07.522085  7767 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ad88b19ba074d7eb419542cddcebb51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:07.525077  7840 tablet_service.cc:1511] Processing CreateTablet for tablet 1736a0500c6d452ea11b6d10b4034d86 (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 14:50:07.527112  7840 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1736a0500c6d452ea11b6d10b4034d86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:07.508745  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:50:07.528566  7779 raft_consensus.cc:2468] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 0.
I20260709 14:50:07.521977  7761 tablet_service.cc:1511] Processing CreateTablet for tablet 1736a0500c6d452ea11b6d10b4034d86 (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 14:50:07.541699  7761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1736a0500c6d452ea11b6d10b4034d86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:07.543911  7909 tablet_service.cc:1511] Processing CreateTablet for tablet 1736a0500c6d452ea11b6d10b4034d86 (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 14:50:07.496034  7842 tablet_service.cc:1511] Processing CreateTablet for tablet 5ad88b19ba074d7eb419542cddcebb51 (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 14:50:07.548106  7842 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ad88b19ba074d7eb419542cddcebb51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:07.548276  7909 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1736a0500c6d452ea11b6d10b4034d86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:07.504719  7974 raft_consensus.cc:359] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:07.545670  7766 tablet_service.cc:1511] Processing CreateTablet for tablet 696fba4415c046498d3e10fb37d1a67f (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 14:50:07.553951  7819 leader_election.cc:304] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:50:07.554502  7971 ts_tablet_manager.cc:1434] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent starting tablet: real 0.160s	user 0.010s	sys 0.002s
I20260709 14:50:07.556152  7971 tablet_bootstrap.cc:492] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac: Bootstrap starting.
I20260709 14:50:07.560822  7972 tablet_bootstrap.cc:492] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed: No bootstrap required, opened a new log
I20260709 14:50:07.562479  7976 raft_consensus.cc:2804] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:50:07.562996  7976 raft_consensus.cc:493] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:50:07.554903  7766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 696fba4415c046498d3e10fb37d1a67f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:07.552819  7974 raft_consensus.cc:385] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:07.578855  7974 raft_consensus.cc:740] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Initialized, Role: FOLLOWER
I20260709 14:50:07.580044  7841 tablet_service.cc:1511] Processing CreateTablet for tablet 37d50517fdd04953b2868e01a0624afa (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 14:50:07.581398  7915 tablet_service.cc:1511] Processing CreateTablet for tablet 37d50517fdd04953b2868e01a0624afa (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 14:50:07.571620  7976 raft_consensus.cc:3060] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:07.583096  7915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37d50517fdd04953b2868e01a0624afa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:07.576748  7762 tablet_service.cc:1511] Processing CreateTablet for tablet 37d50517fdd04953b2868e01a0624afa (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 14:50:07.580124  7974 consensus_queue.cc:260] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:07.587358  7762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37d50517fdd04953b2868e01a0624afa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:07.587709  7841 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37d50517fdd04953b2868e01a0624afa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:07.562211  7972 ts_tablet_manager.cc:1403] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent bootstrapping tablet: real 0.208s	user 0.018s	sys 0.009s
I20260709 14:50:07.609728  7974 ts_tablet_manager.cc:1434] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent starting tablet: real 0.117s	user 0.015s	sys 0.000s
I20260709 14:50:07.610047  7763 tablet_service.cc:1511] Processing CreateTablet for tablet 6d0d5c36f8664b1382cf3a23a559c621 (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 14:50:07.611289  7974 tablet_bootstrap.cc:492] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0: Bootstrap starting.
I20260709 14:50:07.611506  7763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d0d5c36f8664b1382cf3a23a559c621. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:07.631666  7979 raft_consensus.cc:515] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:07.650238  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
W20260709 14:50:07.650765  7725 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 14:50:07.651314  7853 raft_consensus.cc:3060] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:07.657745  7972 raft_consensus.cc:359] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:07.658713  7972 raft_consensus.cc:385] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:07.659091  7972 raft_consensus.cc:740] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Initialized, Role: FOLLOWER
I20260709 14:50:07.660662  7972 consensus_queue.cc:260] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:07.673516  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:50:07.685547  7928 raft_consensus.cc:3060] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:07.661204  7853 raft_consensus.cc:2468] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 1.
I20260709 14:50:07.679049  7971 tablet_bootstrap.cc:654] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:07.674064  7979 leader_election.cc:290] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:07.682243  7976 raft_consensus.cc:515] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:07.694476  7974 tablet_bootstrap.cc:654] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:07.703596  7844 tablet_service.cc:1511] Processing CreateTablet for tablet 6d0d5c36f8664b1382cf3a23a559c621 (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 14:50:07.716871  7844 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d0d5c36f8664b1382cf3a23a559c621. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:07.722900  7745 leader_election.cc:304] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:50:07.724975  8000 raft_consensus.cc:493] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:50:07.725813  8000 raft_consensus.cc:515] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:07.727648  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:50:07.729517  8000 leader_election.cc:290] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:07.739048  8001 raft_consensus.cc:2804] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:50:07.740056  8001 raft_consensus.cc:697] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:50:07.722926  7976 leader_election.cc:290] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 1 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:07.747095  7916 tablet_service.cc:1511] Processing CreateTablet for tablet 6d0d5c36f8664b1382cf3a23a559c621 (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 14:50:07.747712  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258d6c2dda954bf5b65930fde8ecb9f3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:50:07.757072  7916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d0d5c36f8664b1382cf3a23a559c621. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:07.741631  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:50:07.757843  7779 raft_consensus.cc:3060] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:07.751477  7979 raft_consensus.cc:493] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:50:07.754844  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258d6c2dda954bf5b65930fde8ecb9f3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:50:07.749152  7761 tablet_service.cc:1511] Processing CreateTablet for tablet c6a7a532d2ca462ab2cdcd681e28661d (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
W20260709 14:50:07.746490  7819 leader_election.cc:343] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785): Illegal state: must be running to vote when last-logged opid is not known
W20260709 14:50:07.763574  7819 leader_election.cc:343] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785): Illegal state: must be running to vote when last-logged opid is not known
W20260709 14:50:07.765647  7819 leader_election.cc:343] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:07.769656  7839 tablet_service.cc:1511] Processing CreateTablet for tablet 9ca9650f2c8c4fe08e77c70ee08f3927 (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 14:50:07.771217  7819 leader_election.cc:304] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:50:07.771713  7761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6a7a532d2ca462ab2cdcd681e28661d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:07.772183  7976 raft_consensus.cc:2749] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:50:07.772213  7839 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ca9650f2c8c4fe08e77c70ee08f3927. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:07.761555  7979 raft_consensus.cc:515] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:07.780185  7910 tablet_service.cc:1511] Processing CreateTablet for tablet 9ca9650f2c8c4fe08e77c70ee08f3927 (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 14:50:07.741214  8001 consensus_queue.cc:237] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:07.782047  7910 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ca9650f2c8c4fe08e77c70ee08f3927. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:07.769938  7767 tablet_service.cc:1511] Processing CreateTablet for tablet 9ca9650f2c8c4fe08e77c70ee08f3927 (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 14:50:07.787653  7767 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ca9650f2c8c4fe08e77c70ee08f3927. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:07.791206  7972 ts_tablet_manager.cc:1434] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent starting tablet: real 0.197s	user 0.012s	sys 0.008s
I20260709 14:50:07.791571  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce9c0ef2db24c13a8b1402f21819458" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:50:07.792279  7927 raft_consensus.cc:2468] T 9ce9c0ef2db24c13a8b1402f21819458 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 0.
I20260709 14:50:07.792626  7972 tablet_bootstrap.cc:492] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed: Bootstrap starting.
I20260709 14:50:07.793844  7744 leader_election.cc:304] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:50:07.796679  7838 tablet_service.cc:1511] Processing CreateTablet for tablet c6a7a532d2ca462ab2cdcd681e28661d (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 14:50:07.799813  7979 leader_election.cc:290] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:07.822010  8002 raft_consensus.cc:2804] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:50:07.825423  7837 tablet_service.cc:1511] Processing CreateTablet for tablet 789f551efdf242eb9b285eebd8ea0f1a (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 14:50:07.826267  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce9c0ef2db24c13a8b1402f21819458" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:50:07.830106  7917 tablet_service.cc:1511] Processing CreateTablet for tablet c6a7a532d2ca462ab2cdcd681e28661d (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 14:50:07.831650  7917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6a7a532d2ca462ab2cdcd681e28661d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:07.822496  8002 raft_consensus.cc:493] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:50:07.841069  7909 tablet_service.cc:1511] Processing CreateTablet for tablet 789f551efdf242eb9b285eebd8ea0f1a (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 14:50:07.842959  7909 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 789f551efdf242eb9b285eebd8ea0f1a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 14:50:07.845845  7745 leader_election.cc:343] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:07.841775  8002 raft_consensus.cc:3060] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:07.841282  7763 tablet_service.cc:1511] Processing CreateTablet for tablet 789f551efdf242eb9b285eebd8ea0f1a (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 14:50:07.850045  7928 raft_consensus.cc:2468] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 1.
I20260709 14:50:07.851171  7763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 789f551efdf242eb9b285eebd8ea0f1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:07.854597  7974 tablet_bootstrap.cc:492] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0: No bootstrap required, opened a new log
I20260709 14:50:07.855309  7974 ts_tablet_manager.cc:1403] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent bootstrapping tablet: real 0.244s	user 0.017s	sys 0.029s
I20260709 14:50:07.846354  7838 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6a7a532d2ca462ab2cdcd681e28661d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:07.863704  7837 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 789f551efdf242eb9b285eebd8ea0f1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:07.865329  7844 tablet_service.cc:1511] Processing CreateTablet for tablet 179f6d5364ba445e8eb5aa330b4a0f04 (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 14:50:07.867374  7764 tablet_service.cc:1511] Processing CreateTablet for tablet 179f6d5364ba445e8eb5aa330b4a0f04 (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 14:50:07.869134  7764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 179f6d5364ba445e8eb5aa330b4a0f04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:07.872371  7844 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 179f6d5364ba445e8eb5aa330b4a0f04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:07.869196  7916 tablet_service.cc:1511] Processing CreateTablet for tablet 179f6d5364ba445e8eb5aa330b4a0f04 (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 14:50:07.877417  7766 tablet_service.cc:1511] Processing CreateTablet for tablet ff4c35543cc44c64a939eae4f3e5e258 (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 14:50:07.879500  7779 raft_consensus.cc:2468] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 1.
I20260709 14:50:07.880829  7766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff4c35543cc44c64a939eae4f3e5e258. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:07.881584  7819 leader_election.cc:304] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:50:07.882074  7840 tablet_service.cc:1511] Processing CreateTablet for tablet ff4c35543cc44c64a939eae4f3e5e258 (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 14:50:07.883168  7976 raft_consensus.cc:2804] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:50:07.883514  7840 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff4c35543cc44c64a939eae4f3e5e258. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:07.883734  7976 raft_consensus.cc:697] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:50:07.873075  8002 raft_consensus.cc:515] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:07.884690  7976 consensus_queue.cc:237] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:07.887492  8002 leader_election.cc:290] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:07.889190  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce9c0ef2db24c13a8b1402f21819458" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:50:07.872997  7972 tablet_bootstrap.cc:654] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed: Neither blocks nor log segments found. Creating new log.
W20260709 14:50:07.892905  7745 leader_election.cc:343] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:07.895778  7916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 179f6d5364ba445e8eb5aa330b4a0f04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:07.897904  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce9c0ef2db24c13a8b1402f21819458" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:50:07.898976  7928 raft_consensus.cc:3060] T 9ce9c0ef2db24c13a8b1402f21819458 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:07.901664  7971 tablet_bootstrap.cc:492] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac: No bootstrap required, opened a new log
I20260709 14:50:07.902562  7971 ts_tablet_manager.cc:1403] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent bootstrapping tablet: real 0.347s	user 0.028s	sys 0.008s
I20260709 14:50:07.921725  7915 tablet_service.cc:1511] Processing CreateTablet for tablet ff4c35543cc44c64a939eae4f3e5e258 (DEFAULT_TABLE table=test-workload [id=123c9602cdc6471dbcd54044281f090f]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 14:50:07.923660  7915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff4c35543cc44c64a939eae4f3e5e258. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:07.928395  7676 catalog_manager.cc:5697] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 0 to 1, leader changed from <none> to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 1 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:50:07.903939  7974 raft_consensus.cc:359] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:07.966969  7974 raft_consensus.cc:385] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:07.967507  7974 raft_consensus.cc:740] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Initialized, Role: FOLLOWER
I20260709 14:50:07.968493  7993 raft_consensus.cc:493] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:50:07.969280  7993 raft_consensus.cc:515] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:07.973613  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:50:07.968514  7974 consensus_queue.cc:260] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:50:07.975517  7893 leader_election.cc:343] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:07.964402  7971 raft_consensus.cc:359] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:07.985344  7971 raft_consensus.cc:385] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:07.985462  7993 leader_election.cc:290] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:50:07.987217  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:50:07.988595  7972 tablet_bootstrap.cc:492] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed: No bootstrap required, opened a new log
I20260709 14:50:07.989295  7972 ts_tablet_manager.cc:1403] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent bootstrapping tablet: real 0.197s	user 0.010s	sys 0.013s
I20260709 14:50:07.984952  7677 catalog_manager.cc:5697] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 0 to 1, leader changed from <none> to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 1 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
W20260709 14:50:07.989569  7894 leader_election.cc:343] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:07.985759  7971 raft_consensus.cc:740] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Initialized, Role: FOLLOWER
I20260709 14:50:07.996090  7971 consensus_queue.cc:260] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:07.995237  7894 leader_election.cc:304] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:07.999490  7971 ts_tablet_manager.cc:1434] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent starting tablet: real 0.097s	user 0.011s	sys 0.000s
I20260709 14:50:07.983729  7928 raft_consensus.cc:2468] T 9ce9c0ef2db24c13a8b1402f21819458 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 1.
I20260709 14:50:08.004725  7993 raft_consensus.cc:2749] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:50:08.014608  7744 leader_election.cc:304] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:08.017206  8001 raft_consensus.cc:2804] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:50:08.018514  8001 raft_consensus.cc:697] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:50:08.018987  7971 tablet_bootstrap.cc:492] T 9ce9c0ef2db24c13a8b1402f21819458 P 3876b8ee8d744cb18e91d97aae93b1ac: Bootstrap starting.
I20260709 14:50:08.019447  8001 consensus_queue.cc:237] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:08.034425  7974 ts_tablet_manager.cc:1434] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent starting tablet: real 0.179s	user 0.032s	sys 0.009s
I20260709 14:50:08.035739  7974 tablet_bootstrap.cc:492] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0: Bootstrap starting.
I20260709 14:50:08.018294  7972 raft_consensus.cc:359] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:08.042128  7972 raft_consensus.cc:385] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:08.042622  7972 raft_consensus.cc:740] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Initialized, Role: FOLLOWER
I20260709 14:50:08.043926  7972 consensus_queue.cc:260] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:08.045573  7974 tablet_bootstrap.cc:654] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:08.048043  7972 ts_tablet_manager.cc:1434] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent starting tablet: real 0.058s	user 0.010s	sys 0.000s
I20260709 14:50:08.049810  7972 tablet_bootstrap.cc:492] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed: Bootstrap starting.
I20260709 14:50:08.059806  7971 tablet_bootstrap.cc:654] T 9ce9c0ef2db24c13a8b1402f21819458 P 3876b8ee8d744cb18e91d97aae93b1ac: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:08.061806  7972 tablet_bootstrap.cc:654] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:08.065292  7974 tablet_bootstrap.cc:492] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0: No bootstrap required, opened a new log
I20260709 14:50:08.066231  7974 ts_tablet_manager.cc:1403] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0: Time spent bootstrapping tablet: real 0.031s	user 0.015s	sys 0.005s
I20260709 14:50:08.070334  7971 tablet_bootstrap.cc:492] T 9ce9c0ef2db24c13a8b1402f21819458 P 3876b8ee8d744cb18e91d97aae93b1ac: No bootstrap required, opened a new log
I20260709 14:50:08.070791  7972 tablet_bootstrap.cc:492] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed: No bootstrap required, opened a new log
I20260709 14:50:08.071024  7971 ts_tablet_manager.cc:1403] T 9ce9c0ef2db24c13a8b1402f21819458 P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent bootstrapping tablet: real 0.052s	user 0.018s	sys 0.002s
I20260709 14:50:08.071581  7972 ts_tablet_manager.cc:1403] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent bootstrapping tablet: real 0.022s	user 0.008s	sys 0.008s
I20260709 14:50:08.071630  7974 raft_consensus.cc:359] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:08.072856  7974 raft_consensus.cc:385] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:08.073187  7974 raft_consensus.cc:740] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Initialized, Role: FOLLOWER
I20260709 14:50:08.074218  7974 consensus_queue.cc:260] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:08.076016  7971 raft_consensus.cc:359] T 9ce9c0ef2db24c13a8b1402f21819458 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:08.077548  7971 raft_consensus.cc:385] T 9ce9c0ef2db24c13a8b1402f21819458 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:08.080489  7971 raft_consensus.cc:740] T 9ce9c0ef2db24c13a8b1402f21819458 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Initialized, Role: FOLLOWER
I20260709 14:50:08.078202  7974 ts_tablet_manager.cc:1434] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.001s
I20260709 14:50:08.081827  7972 raft_consensus.cc:359] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:08.082710  7972 raft_consensus.cc:385] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:08.082474  7974 tablet_bootstrap.cc:492] T 9441e831627143a991a1556dcdce71e3 P 1e9289592458429bbddb19c2e7b7b7b0: Bootstrap starting.
I20260709 14:50:08.083266  7972 raft_consensus.cc:740] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Initialized, Role: FOLLOWER
I20260709 14:50:08.084255  7972 consensus_queue.cc:260] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:08.086717  7972 ts_tablet_manager.cc:1434] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 14:50:08.083114  7971 consensus_queue.cc:260] T 9ce9c0ef2db24c13a8b1402f21819458 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:08.093369  7974 tablet_bootstrap.cc:654] T 9441e831627143a991a1556dcdce71e3 P 1e9289592458429bbddb19c2e7b7b7b0: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:08.098646  7971 ts_tablet_manager.cc:1434] T 9ce9c0ef2db24c13a8b1402f21819458 P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent starting tablet: real 0.027s	user 0.003s	sys 0.006s
I20260709 14:50:08.100239  7971 tablet_bootstrap.cc:492] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac: Bootstrap starting.
I20260709 14:50:08.100977  7675 catalog_manager.cc:5697] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 0 to 1, leader changed from <none> to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 1 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:50:08.088593  7972 tablet_bootstrap.cc:492] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed: Bootstrap starting.
I20260709 14:50:08.102716  7974 tablet_bootstrap.cc:492] T 9441e831627143a991a1556dcdce71e3 P 1e9289592458429bbddb19c2e7b7b7b0: No bootstrap required, opened a new log
I20260709 14:50:08.103933  7974 ts_tablet_manager.cc:1403] T 9441e831627143a991a1556dcdce71e3 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent bootstrapping tablet: real 0.022s	user 0.010s	sys 0.006s
I20260709 14:50:08.107692  7974 raft_consensus.cc:359] T 9441e831627143a991a1556dcdce71e3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:08.108501  7974 raft_consensus.cc:385] T 9441e831627143a991a1556dcdce71e3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:08.108795  7974 raft_consensus.cc:740] T 9441e831627143a991a1556dcdce71e3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Initialized, Role: FOLLOWER
I20260709 14:50:08.109732  7974 consensus_queue.cc:260] T 9441e831627143a991a1556dcdce71e3 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:08.114116  7974 ts_tablet_manager.cc:1434] T 9441e831627143a991a1556dcdce71e3 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent starting tablet: real 0.010s	user 0.012s	sys 0.000s
I20260709 14:50:08.114727  7972 tablet_bootstrap.cc:654] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:08.115754  7974 tablet_bootstrap.cc:492] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0: Bootstrap starting.
I20260709 14:50:08.120939  7971 tablet_bootstrap.cc:654] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:08.125622  7974 tablet_bootstrap.cc:654] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:08.136353  8001 raft_consensus.cc:493] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:50:08.137535  8001 raft_consensus.cc:515] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:08.142092  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:50:08.145778  7745 leader_election.cc:343] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:08.149194  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:50:08.150254  7928 raft_consensus.cc:2468] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 0.
I20260709 14:50:08.152241  7744 leader_election.cc:304] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:08.153548  8002 raft_consensus.cc:2804] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:50:08.153986  8002 raft_consensus.cc:493] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:50:08.154376  8002 raft_consensus.cc:3060] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:08.157608  8001 leader_election.cc:290] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:08.178726  8010 raft_consensus.cc:493] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:50:08.179704  8010 raft_consensus.cc:515] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:08.183784  8010 leader_election.cc:290] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:50:08.178705  8002 raft_consensus.cc:515] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:08.185782  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:50:08.188860  8002 leader_election.cc:290] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:08.184870  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:50:08.189944  7779 raft_consensus.cc:2468] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 0.
I20260709 14:50:08.192607  7893 leader_election.cc:304] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:50:08.195670  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:50:08.196592  7928 raft_consensus.cc:3060] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:08.201646  8010 raft_consensus.cc:2804] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:50:08.202275  8010 raft_consensus.cc:493] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:50:08.202642  8010 raft_consensus.cc:3060] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Advancing to term 1
W20260709 14:50:08.211377  7894 leader_election.cc:343] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:08.218161  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
W20260709 14:50:08.220664  7745 leader_election.cc:343] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:08.235460  7928 raft_consensus.cc:2468] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 1.
I20260709 14:50:08.237816  7744 leader_election.cc:304] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:08.239166  8002 raft_consensus.cc:2804] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:50:08.239743  8002 raft_consensus.cc:697] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:50:08.240716  8002 consensus_queue.cc:237] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:08.245437  7976 raft_consensus.cc:493] T 9ce9c0ef2db24c13a8b1402f21819458 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:50:08.246248  7976 raft_consensus.cc:515] T 9ce9c0ef2db24c13a8b1402f21819458 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:08.250229  7976 leader_election.cc:290] T 9ce9c0ef2db24c13a8b1402f21819458 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:08.252470  7993 raft_consensus.cc:493] T 9441e831627143a991a1556dcdce71e3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:50:08.253364  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce9c0ef2db24c13a8b1402f21819458" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:50:08.253212  7993 raft_consensus.cc:515] T 9441e831627143a991a1556dcdce71e3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:08.254536  7927 raft_consensus.cc:2393] T 9ce9c0ef2db24c13a8b1402f21819458 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 1: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:50:08.257428  7993 leader_election.cc:290] T 9441e831627143a991a1556dcdce71e3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:50:08.258142  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9441e831627143a991a1556dcdce71e3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:50:08.260315  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce9c0ef2db24c13a8b1402f21819458" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
W20260709 14:50:08.262531  7893 leader_election.cc:343] T 9441e831627143a991a1556dcdce71e3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:08.267444  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9441e831627143a991a1556dcdce71e3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:50:08.270211  7819 leader_election.cc:304] T 9ce9c0ef2db24c13a8b1402f21819458 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:50:08.272179  7976 raft_consensus.cc:3060] T 9ce9c0ef2db24c13a8b1402f21819458 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Advancing to term 1
W20260709 14:50:08.273751  7894 leader_election.cc:343] T 9441e831627143a991a1556dcdce71e3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:08.274467  7894 leader_election.cc:304] T 9441e831627143a991a1556dcdce71e3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:08.275440  7993 raft_consensus.cc:2749] T 9441e831627143a991a1556dcdce71e3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:50:08.288271  8000 raft_consensus.cc:493] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:50:08.289109  8010 raft_consensus.cc:515] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:08.289633  8000 raft_consensus.cc:515] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:08.291152  7971 tablet_bootstrap.cc:492] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac: No bootstrap required, opened a new log
I20260709 14:50:08.291355  7974 tablet_bootstrap.cc:492] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0: No bootstrap required, opened a new log
I20260709 14:50:08.293273  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:50:08.295123  7971 ts_tablet_manager.cc:1403] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent bootstrapping tablet: real 0.192s	user 0.092s	sys 0.071s
I20260709 14:50:08.294857  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:50:08.298362  7976 raft_consensus.cc:2749] T 9ce9c0ef2db24c13a8b1402f21819458 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:50:08.297762  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:50:08.295713  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
W20260709 14:50:08.300020  7819 leader_election.cc:343] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:08.300624  7927 raft_consensus.cc:2468] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 0.
I20260709 14:50:08.297828  7779 raft_consensus.cc:3060] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Advancing to term 1
W20260709 14:50:08.301934  7894 leader_election.cc:343] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:08.302353  7972 tablet_bootstrap.cc:492] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed: No bootstrap required, opened a new log
I20260709 14:50:08.303063  7972 ts_tablet_manager.cc:1403] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent bootstrapping tablet: real 0.215s	user 0.077s	sys 0.092s
I20260709 14:50:08.303274  7819 leader_election.cc:304] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:50:08.296305  8010 leader_election.cc:290] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:50:08.296319  8000 leader_election.cc:290] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:08.305917  8000 raft_consensus.cc:2804] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:50:08.307054  8000 raft_consensus.cc:493] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:50:08.307811  8000 raft_consensus.cc:3060] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:08.307916  7971 raft_consensus.cc:359] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:08.308911  7971 raft_consensus.cc:385] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:08.309228  7971 raft_consensus.cc:740] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Initialized, Role: FOLLOWER
I20260709 14:50:08.310057  7971 consensus_queue.cc:260] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:08.310153  7972 raft_consensus.cc:359] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:08.311507  7972 raft_consensus.cc:385] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:08.314184  7972 raft_consensus.cc:740] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Initialized, Role: FOLLOWER
I20260709 14:50:08.313340  7779 raft_consensus.cc:2468] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 1.
I20260709 14:50:08.297722  7974 ts_tablet_manager.cc:1403] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0: Time spent bootstrapping tablet: real 0.183s	user 0.099s	sys 0.063s
I20260709 14:50:08.318516  7893 leader_election.cc:304] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:08.320334  8010 raft_consensus.cc:2804] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:50:08.321106  8010 raft_consensus.cc:697] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:50:08.320427  7974 raft_consensus.cc:359] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:08.322501  7974 raft_consensus.cc:385] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:08.322384  8010 consensus_queue.cc:237] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:08.316362  7972 consensus_queue.cc:260] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:08.322942  7974 raft_consensus.cc:740] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Initialized, Role: FOLLOWER
I20260709 14:50:08.312829  7971 ts_tablet_manager.cc:1434] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 14:50:08.325837  7676 catalog_manager.cc:5697] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 0 to 1, leader changed from <none> to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 1 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:50:08.327750  7974 consensus_queue.cc:260] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:08.328337  7971 tablet_bootstrap.cc:492] T 9441e831627143a991a1556dcdce71e3 P 3876b8ee8d744cb18e91d97aae93b1ac: Bootstrap starting.
I20260709 14:50:08.330014  7974 ts_tablet_manager.cc:1434] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.001s
I20260709 14:50:08.331182  7974 tablet_bootstrap.cc:492] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0: Bootstrap starting.
W20260709 14:50:08.332450  7819 consensus_peers.cc:597] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785): Couldn't send request to peer 1e9289592458429bbddb19c2e7b7b7b0. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:50:08.333702  8001 raft_consensus.cc:493] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:50:08.334264  8001 raft_consensus.cc:515] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:08.334887  7972 ts_tablet_manager.cc:1434] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent starting tablet: real 0.031s	user 0.009s	sys 0.002s
I20260709 14:50:08.335341  8000 raft_consensus.cc:515] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:08.336010  7972 tablet_bootstrap.cc:492] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed: Bootstrap starting.
I20260709 14:50:08.336586  8001 leader_election.cc:290] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:08.339322  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:50:08.340049  7971 tablet_bootstrap.cc:654] T 9441e831627143a991a1556dcdce71e3 P 3876b8ee8d744cb18e91d97aae93b1ac: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:08.340188  7927 raft_consensus.cc:2468] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 0.
I20260709 14:50:08.341933  7744 leader_election.cc:304] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:50:08.342073  8000 leader_election.cc:290] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 1 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:08.343955  8001 raft_consensus.cc:2804] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:50:08.352499  8001 raft_consensus.cc:493] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:50:08.352998  8001 raft_consensus.cc:3060] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:08.362530  7972 tablet_bootstrap.cc:654] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:08.349221  7974 tablet_bootstrap.cc:654] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:08.370096  8001 raft_consensus.cc:515] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:08.372835  8001 leader_election.cc:290] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:08.375830  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:50:08.376653  7928 raft_consensus.cc:3060] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:08.377497  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:50:08.378551  7779 raft_consensus.cc:3060] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:08.385447  7972 tablet_bootstrap.cc:492] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed: No bootstrap required, opened a new log
I20260709 14:50:08.386178  7972 ts_tablet_manager.cc:1403] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent bootstrapping tablet: real 0.050s	user 0.015s	sys 0.000s
I20260709 14:50:08.392563  7972 raft_consensus.cc:359] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:08.393698  7972 raft_consensus.cc:385] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:08.394145  7972 raft_consensus.cc:740] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Initialized, Role: FOLLOWER
I20260709 14:50:08.394840  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:50:08.382066  8001 consensus_queue.cc:1048] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.019s
I20260709 14:50:08.401993  8002 consensus_queue.cc:1048] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:50:08.402189  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
W20260709 14:50:08.404284  7745 leader_election.cc:343] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Illegal state: must be running to vote when last-logged opid is not known
W20260709 14:50:08.406553  7745 leader_election.cc:343] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:08.395284  7972 consensus_queue.cc:260] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:08.393543  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:50:08.412853  7927 raft_consensus.cc:3060] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:08.414263  7972 ts_tablet_manager.cc:1434] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent starting tablet: real 0.028s	user 0.008s	sys 0.002s
I20260709 14:50:08.401417  7971 tablet_bootstrap.cc:492] T 9441e831627143a991a1556dcdce71e3 P 3876b8ee8d744cb18e91d97aae93b1ac: No bootstrap required, opened a new log
I20260709 14:50:08.421512  7971 ts_tablet_manager.cc:1403] T 9441e831627143a991a1556dcdce71e3 P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent bootstrapping tablet: real 0.093s	user 0.029s	sys 0.013s
I20260709 14:50:08.427847  7972 tablet_bootstrap.cc:492] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed: Bootstrap starting.
I20260709 14:50:08.426877  7928 raft_consensus.cc:2468] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 1.
I20260709 14:50:08.432556  7744 leader_election.cc:304] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:08.433418  7974 tablet_bootstrap.cc:492] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0: No bootstrap required, opened a new log
I20260709 14:50:08.434031  7974 ts_tablet_manager.cc:1403] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent bootstrapping tablet: real 0.103s	user 0.030s	sys 0.032s
I20260709 14:50:08.434945  8001 raft_consensus.cc:2804] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:50:08.435985  8001 raft_consensus.cc:697] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:50:08.437144  7974 raft_consensus.cc:359] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:08.437048  8001 consensus_queue.cc:237] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:08.438014  7974 raft_consensus.cc:385] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:08.439043  7974 raft_consensus.cc:740] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Initialized, Role: FOLLOWER
I20260709 14:50:08.442109  7974 consensus_queue.cc:260] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:08.450613  7971 raft_consensus.cc:359] T 9441e831627143a991a1556dcdce71e3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:08.452013  7971 raft_consensus.cc:385] T 9441e831627143a991a1556dcdce71e3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:08.463928  7971 raft_consensus.cc:740] T 9441e831627143a991a1556dcdce71e3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Initialized, Role: FOLLOWER
I20260709 14:50:08.454759  7676 catalog_manager.cc:5697] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 1 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:50:08.457510  7779 raft_consensus.cc:2468] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 1.
I20260709 14:50:08.469997  7971 consensus_queue.cc:260] T 9441e831627143a991a1556dcdce71e3 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:08.472383  7971 ts_tablet_manager.cc:1434] T 9441e831627143a991a1556dcdce71e3 P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent starting tablet: real 0.050s	user 0.004s	sys 0.002s
I20260709 14:50:08.473582  7971 tablet_bootstrap.cc:492] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac: Bootstrap starting.
I20260709 14:50:08.480803  7971 tablet_bootstrap.cc:654] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:08.490337  7676 catalog_manager.cc:5697] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 0 to 1, leader changed from <none> to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 1 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:50:08.495519  8024 raft_consensus.cc:493] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:50:08.496237  8024 raft_consensus.cc:515] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:08.498751  8024 leader_election.cc:290] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:08.501117  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:50:08.458423  7972 tablet_bootstrap.cc:654] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:08.459389  8002 consensus_queue.cc:1048] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:50:08.459896  7927 raft_consensus.cc:2468] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 1.
I20260709 14:50:08.461033  8000 consensus_queue.cc:1048] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:50:08.454276  7974 ts_tablet_manager.cc:1434] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent starting tablet: real 0.020s	user 0.009s	sys 0.000s
I20260709 14:50:08.511727  7974 tablet_bootstrap.cc:492] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0: Bootstrap starting.
I20260709 14:50:08.517184  7819 leader_election.cc:304] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:50:08.518697  8000 raft_consensus.cc:2804] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:50:08.520134  8000 raft_consensus.cc:697] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:50:08.520525  7971 tablet_bootstrap.cc:492] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac: No bootstrap required, opened a new log
I20260709 14:50:08.521592  7971 ts_tablet_manager.cc:1403] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent bootstrapping tablet: real 0.048s	user 0.019s	sys 0.020s
I20260709 14:50:08.522209  8000 consensus_queue.cc:237] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:08.523069  7974 tablet_bootstrap.cc:654] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:08.524945  7971 raft_consensus.cc:359] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:08.525822  7971 raft_consensus.cc:385] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:08.526149  7971 raft_consensus.cc:740] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Initialized, Role: FOLLOWER
W20260709 14:50:08.528893  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 63960.7us
I20260709 14:50:08.532136  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:50:08.533077  7779 raft_consensus.cc:2393] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 1: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:50:08.528229  7971 consensus_queue.cc:260] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:08.546156  7971 ts_tablet_manager.cc:1434] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.001s
I20260709 14:50:08.554572  7819 leader_election.cc:304] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:50:08.555989  8024 raft_consensus.cc:3060] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:08.565099  7971 tablet_bootstrap.cc:492] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac: Bootstrap starting.
I20260709 14:50:08.573064  7972 tablet_bootstrap.cc:492] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed: No bootstrap required, opened a new log
I20260709 14:50:08.573892  7972 ts_tablet_manager.cc:1403] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent bootstrapping tablet: real 0.146s	user 0.018s	sys 0.016s
I20260709 14:50:08.582715  8032 consensus_queue.cc:1048] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 14:50:08.588996  7974 tablet_bootstrap.cc:492] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0: No bootstrap required, opened a new log
I20260709 14:50:08.589490  7974 ts_tablet_manager.cc:1403] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent bootstrapping tablet: real 0.078s	user 0.020s	sys 0.018s
I20260709 14:50:08.594172  8033 raft_consensus.cc:493] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:50:08.595263  8033 raft_consensus.cc:515] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:08.602722  7972 raft_consensus.cc:359] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:08.603374  7972 raft_consensus.cc:385] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:08.603858  7972 raft_consensus.cc:740] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Initialized, Role: FOLLOWER
I20260709 14:50:08.605479  7972 consensus_queue.cc:260] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:08.617537  7972 ts_tablet_manager.cc:1434] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent starting tablet: real 0.043s	user 0.009s	sys 0.000s
I20260709 14:50:08.619038  7972 tablet_bootstrap.cc:492] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed: Bootstrap starting.
I20260709 14:50:08.630505  8032 consensus_queue.cc:1048] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:50:08.631130  8024 raft_consensus.cc:2749] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:50:08.634985  8033 leader_election.cc:290] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:08.638767  7972 tablet_bootstrap.cc:654] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:08.639706  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:50:08.640199  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:50:08.640622  7854 raft_consensus.cc:2468] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 0.
I20260709 14:50:08.641093  7928 raft_consensus.cc:2468] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 0.
I20260709 14:50:08.643319  7744 leader_election.cc:304] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:50:08.643302  7974 raft_consensus.cc:359] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:08.644197  7974 raft_consensus.cc:385] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:08.644511  7974 raft_consensus.cc:740] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Initialized, Role: FOLLOWER
I20260709 14:50:08.646003  8033 raft_consensus.cc:2804] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:50:08.646468  8033 raft_consensus.cc:493] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:50:08.646847  8033 raft_consensus.cc:3060] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Advancing to term 1
W20260709 14:50:08.654734  7725 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 14:50:08.654637  7974 consensus_queue.cc:260] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:08.659056  7971 tablet_bootstrap.cc:654] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:08.659845  7974 ts_tablet_manager.cc:1434] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent starting tablet: real 0.070s	user 0.007s	sys 0.000s
I20260709 14:50:08.662081  7974 tablet_bootstrap.cc:492] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0: Bootstrap starting.
I20260709 14:50:08.658165  7677 catalog_manager.cc:5697] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 0 to 1, leader changed from <none> to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 1 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:50:08.672847  8033 raft_consensus.cc:515] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:08.680533  8033 leader_election.cc:290] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:08.682214  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:50:08.684046  7854 raft_consensus.cc:3060] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:08.684718  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:50:08.685782  7927 raft_consensus.cc:3060] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:08.695851  7974 tablet_bootstrap.cc:654] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:08.697475  7927 raft_consensus.cc:2468] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 1.
W20260709 14:50:08.699522  7745 consensus_peers.cc:597] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed -> Peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Couldn't send request to peer 3876b8ee8d744cb18e91d97aae93b1ac. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:50:08.701308  7854 raft_consensus.cc:2468] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 1.
I20260709 14:50:08.705531  7745 leader_election.cc:304] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:50:08.707746  7972 tablet_bootstrap.cc:492] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed: No bootstrap required, opened a new log
I20260709 14:50:08.708330  7972 ts_tablet_manager.cc:1403] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent bootstrapping tablet: real 0.090s	user 0.016s	sys 0.038s
I20260709 14:50:08.708438  8010 consensus_queue.cc:1048] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 14:50:08.707700  8033 raft_consensus.cc:2804] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:50:08.710507  8033 raft_consensus.cc:697] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:50:08.711464  8033 consensus_queue.cc:237] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:08.711762  7972 raft_consensus.cc:359] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:08.712705  7972 raft_consensus.cc:385] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:08.713027  7972 raft_consensus.cc:740] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Initialized, Role: FOLLOWER
I20260709 14:50:08.713977  7972 consensus_queue.cc:260] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:08.716239  7972 ts_tablet_manager.cc:1434] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent starting tablet: real 0.008s	user 0.001s	sys 0.005s
I20260709 14:50:08.717391  7972 tablet_bootstrap.cc:492] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed: Bootstrap starting.
I20260709 14:50:08.724949  8010 raft_consensus.cc:493] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:50:08.725661  8010 raft_consensus.cc:515] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:08.726668  7971 tablet_bootstrap.cc:492] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac: No bootstrap required, opened a new log
I20260709 14:50:08.727208  7971 ts_tablet_manager.cc:1403] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent bootstrapping tablet: real 0.162s	user 0.039s	sys 0.013s
I20260709 14:50:08.727802  7972 tablet_bootstrap.cc:654] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:08.730995  7971 raft_consensus.cc:359] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:08.732081  7971 raft_consensus.cc:385] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:08.732460  7971 raft_consensus.cc:740] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Initialized, Role: FOLLOWER
I20260709 14:50:08.733462  7971 consensus_queue.cc:260] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:08.734346  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:50:08.735953  7971 ts_tablet_manager.cc:1434] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 14:50:08.737618  7971 tablet_bootstrap.cc:492] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac: Bootstrap starting.
I20260709 14:50:08.740170  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:50:08.749128  7894 leader_election.cc:304] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:08.748272  7675 catalog_manager.cc:5697] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 0 to 1, leader changed from <none> to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 1 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:50:08.741212  7972 tablet_bootstrap.cc:492] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed: No bootstrap required, opened a new log
I20260709 14:50:08.740793  8010 leader_election.cc:290] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:50:08.750578  7993 raft_consensus.cc:2749] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:50:08.755369  7972 ts_tablet_manager.cc:1403] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent bootstrapping tablet: real 0.038s	user 0.014s	sys 0.003s
I20260709 14:50:08.759341  7972 raft_consensus.cc:359] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:08.760145  7972 raft_consensus.cc:385] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:08.760373  7972 raft_consensus.cc:740] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Initialized, Role: FOLLOWER
I20260709 14:50:08.760565  7971 tablet_bootstrap.cc:654] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:08.761015  7972 consensus_queue.cc:260] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:08.765336  7972 ts_tablet_manager.cc:1434] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 14:50:08.766414  7972 tablet_bootstrap.cc:492] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed: Bootstrap starting.
I20260709 14:50:08.767573  7974 tablet_bootstrap.cc:492] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0: No bootstrap required, opened a new log
I20260709 14:50:08.768138  7974 ts_tablet_manager.cc:1403] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent bootstrapping tablet: real 0.106s	user 0.022s	sys 0.013s
I20260709 14:50:08.771941  7974 raft_consensus.cc:359] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:08.772927  7974 raft_consensus.cc:385] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:08.773376  7974 raft_consensus.cc:740] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Initialized, Role: FOLLOWER
I20260709 14:50:08.774312  7974 consensus_queue.cc:260] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:08.776473  7972 tablet_bootstrap.cc:654] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:08.776772  7974 ts_tablet_manager.cc:1434] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.004s
I20260709 14:50:08.777920  7974 tablet_bootstrap.cc:492] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0: Bootstrap starting.
I20260709 14:50:08.815864  8010 consensus_queue.cc:1048] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 14:50:08.823369  7974 tablet_bootstrap.cc:654] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:08.824026  7972 tablet_bootstrap.cc:492] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed: No bootstrap required, opened a new log
I20260709 14:50:08.824743  7972 ts_tablet_manager.cc:1403] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent bootstrapping tablet: real 0.059s	user 0.009s	sys 0.002s
I20260709 14:50:08.828470  7971 tablet_bootstrap.cc:492] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac: No bootstrap required, opened a new log
I20260709 14:50:08.829101  7971 ts_tablet_manager.cc:1403] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent bootstrapping tablet: real 0.092s	user 0.016s	sys 0.008s
I20260709 14:50:08.828896  7972 raft_consensus.cc:359] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:08.829653  7972 raft_consensus.cc:385] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:08.829955  7972 raft_consensus.cc:740] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Initialized, Role: FOLLOWER
I20260709 14:50:08.830687  7972 consensus_queue.cc:260] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:08.833446  7972 ts_tablet_manager.cc:1434] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent starting tablet: real 0.008s	user 0.010s	sys 0.000s
I20260709 14:50:08.834771  7972 tablet_bootstrap.cc:492] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed: Bootstrap starting.
I20260709 14:50:08.835480  7971 raft_consensus.cc:359] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:08.837435  7971 raft_consensus.cc:385] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:08.838450  7971 raft_consensus.cc:740] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Initialized, Role: FOLLOWER
I20260709 14:50:08.841404  7974 tablet_bootstrap.cc:492] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0: No bootstrap required, opened a new log
I20260709 14:50:08.841673  7971 consensus_queue.cc:260] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:08.842803  7972 tablet_bootstrap.cc:654] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:08.846451  7971 ts_tablet_manager.cc:1434] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent starting tablet: real 0.017s	user 0.004s	sys 0.003s
I20260709 14:50:08.847524  7971 tablet_bootstrap.cc:492] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac: Bootstrap starting.
I20260709 14:50:08.848959  7972 tablet_bootstrap.cc:492] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed: No bootstrap required, opened a new log
I20260709 14:50:08.853575  7971 tablet_bootstrap.cc:654] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:08.854859  7972 ts_tablet_manager.cc:1403] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.000s
I20260709 14:50:08.854641  7974 ts_tablet_manager.cc:1403] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0: Time spent bootstrapping tablet: real 0.077s	user 0.012s	sys 0.008s
I20260709 14:50:08.858790  7972 raft_consensus.cc:359] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:08.859745  7972 raft_consensus.cc:385] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:08.859540  7974 raft_consensus.cc:359] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:08.860780  7972 raft_consensus.cc:740] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Initialized, Role: FOLLOWER
I20260709 14:50:08.861622  7976 raft_consensus.cc:493] T 9441e831627143a991a1556dcdce71e3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:50:08.862578  7976 raft_consensus.cc:515] T 9441e831627143a991a1556dcdce71e3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:08.862960  7972 consensus_queue.cc:260] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:08.865535  7972 ts_tablet_manager.cc:1434] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.004s
I20260709 14:50:08.866799  7972 tablet_bootstrap.cc:492] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed: Bootstrap starting.
I20260709 14:50:08.868436  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9441e831627143a991a1556dcdce71e3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:50:08.869550  7778 raft_consensus.cc:2468] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 0.
I20260709 14:50:08.872030  7927 raft_consensus.cc:3060] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:08.874804  7972 tablet_bootstrap.cc:654] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:08.878624  7976 leader_election.cc:290] T 9441e831627143a991a1556dcdce71e3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:08.881693  7974 raft_consensus.cc:385] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:08.882318  7819 leader_election.cc:304] T 9441e831627143a991a1556dcdce71e3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:50:08.882651  7974 raft_consensus.cc:740] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Initialized, Role: FOLLOWER
I20260709 14:50:08.884390  8010 raft_consensus.cc:493] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:50:08.883924  7974 consensus_queue.cc:260] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:08.885809  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9441e831627143a991a1556dcdce71e3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:50:08.886669  7926 raft_consensus.cc:2468] T 9441e831627143a991a1556dcdce71e3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 0.
I20260709 14:50:08.885008  8010 raft_consensus.cc:515] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:08.890003  8010 leader_election.cc:290] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:50:08.892225  7971 tablet_bootstrap.cc:492] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac: No bootstrap required, opened a new log
I20260709 14:50:08.892702  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258d6c2dda954bf5b65930fde8ecb9f3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:50:08.893227  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258d6c2dda954bf5b65930fde8ecb9f3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:50:08.895010  7971 ts_tablet_manager.cc:1403] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent bootstrapping tablet: real 0.048s	user 0.012s	sys 0.030s
I20260709 14:50:08.895401  7854 raft_consensus.cc:2468] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 0.
I20260709 14:50:08.895047  7778 raft_consensus.cc:2468] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 0.
I20260709 14:50:08.893942  7974 ts_tablet_manager.cc:1434] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0: Time spent starting tablet: real 0.038s	user 0.010s	sys 0.000s
I20260709 14:50:08.898409  7893 leader_election.cc:304] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:50:08.899428  7974 tablet_bootstrap.cc:492] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0: Bootstrap starting.
I20260709 14:50:08.900492  8053 raft_consensus.cc:493] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:50:08.901063  8053 raft_consensus.cc:515] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:08.901958  7976 raft_consensus.cc:2804] T 9441e831627143a991a1556dcdce71e3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:50:08.902508  7976 raft_consensus.cc:493] T 9441e831627143a991a1556dcdce71e3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:50:08.902988  7976 raft_consensus.cc:3060] T 9441e831627143a991a1556dcdce71e3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:08.903568  8053 leader_election.cc:290] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:50:08.904203  8053 raft_consensus.cc:2804] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:50:08.903438  7971 raft_consensus.cc:359] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:08.906394  7971 raft_consensus.cc:385] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:08.906785  7971 raft_consensus.cc:740] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Initialized, Role: FOLLOWER
I20260709 14:50:08.906733  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:50:08.908159  7971 consensus_queue.cc:260] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:50:08.909162  7893 leader_election.cc:343] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:08.910894  7971 ts_tablet_manager.cc:1434] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 14:50:08.905580  7972 tablet_bootstrap.cc:492] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed: No bootstrap required, opened a new log
I20260709 14:50:08.911643  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:50:08.917039  7972 ts_tablet_manager.cc:1403] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent bootstrapping tablet: real 0.050s	user 0.011s	sys 0.010s
I20260709 14:50:08.917475  7971 tablet_bootstrap.cc:492] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac: Bootstrap starting.
I20260709 14:50:08.904721  8053 raft_consensus.cc:493] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 14:50:08.918920  7894 leader_election.cc:343] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:08.919530  7894 leader_election.cc:304] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:08.920691  8010 raft_consensus.cc:2749] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:50:08.920774  7972 raft_consensus.cc:359] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:08.921818  7972 raft_consensus.cc:385] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:08.922138  7972 raft_consensus.cc:740] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Initialized, Role: FOLLOWER
I20260709 14:50:08.918983  8053 raft_consensus.cc:3060] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:08.923483  7972 consensus_queue.cc:260] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:08.916051  7974 tablet_bootstrap.cc:654] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:08.926345  7972 ts_tablet_manager.cc:1434] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 14:50:08.927639  7972 tablet_bootstrap.cc:492] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1de5e20126fa4d8ca0793d19c7b847ed: Bootstrap starting.
I20260709 14:50:08.933759  7974 tablet_bootstrap.cc:492] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0: No bootstrap required, opened a new log
I20260709 14:50:08.975380  7974 ts_tablet_manager.cc:1403] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0: Time spent bootstrapping tablet: real 0.076s	user 0.005s	sys 0.011s
I20260709 14:50:08.977533  7971 tablet_bootstrap.cc:654] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:08.956048  8000 raft_consensus.cc:493] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:50:08.980460  8000 raft_consensus.cc:515] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:08.981787  7972 tablet_bootstrap.cc:654] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1de5e20126fa4d8ca0793d19c7b847ed: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:08.986268  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:50:08.986886  7974 raft_consensus.cc:359] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:08.987404  8044 consensus_queue.cc:1048] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:50:08.987782  7974 raft_consensus.cc:385] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:08.988135  7974 raft_consensus.cc:740] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Initialized, Role: FOLLOWER
I20260709 14:50:08.989089  7974 consensus_queue.cc:260] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:08.989923  8000 leader_election.cc:290] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:08.992038  7974 ts_tablet_manager.cc:1434] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 14:50:08.993803  7974 tablet_bootstrap.cc:492] T a18d29d52d304c87b930d4fb5eaf50b1 P 1e9289592458429bbddb19c2e7b7b7b0: Bootstrap starting.
I20260709 14:50:08.933051  7976 raft_consensus.cc:515] T 9441e831627143a991a1556dcdce71e3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:09.002271  7976 leader_election.cc:290] T 9441e831627143a991a1556dcdce71e3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 1 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:09.003475  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:50:09.003209  8053 raft_consensus.cc:515] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:09.027194  7974 tablet_bootstrap.cc:654] T a18d29d52d304c87b930d4fb5eaf50b1 P 1e9289592458429bbddb19c2e7b7b7b0: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:09.031215  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258d6c2dda954bf5b65930fde8ecb9f3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:50:09.031708  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258d6c2dda954bf5b65930fde8ecb9f3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:50:09.032403  7779 raft_consensus.cc:3060] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:09.035548  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9441e831627143a991a1556dcdce71e3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:50:09.036432  7928 raft_consensus.cc:3060] T 9441e831627143a991a1556dcdce71e3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:09.032413  7854 raft_consensus.cc:3060] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:09.041352  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9441e831627143a991a1556dcdce71e3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:50:09.043179  7778 raft_consensus.cc:3060] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:09.031262  8053 leader_election.cc:290] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:50:09.053589  8033 consensus_queue.cc:1048] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:50:09.053664  7819 leader_election.cc:304] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:50:09.051528  7976 raft_consensus.cc:493] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:50:09.059448  7976 raft_consensus.cc:515] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:09.061769  8000 raft_consensus.cc:2749] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:50:09.065012  7976 leader_election.cc:290] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:09.068816  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18d29d52d304c87b930d4fb5eaf50b1" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:50:09.070123  7777 raft_consensus.cc:2468] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 0.
I20260709 14:50:09.070960  7971 tablet_bootstrap.cc:492] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac: No bootstrap required, opened a new log
I20260709 14:50:09.071614  7971 ts_tablet_manager.cc:1403] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent bootstrapping tablet: real 0.154s	user 0.064s	sys 0.051s
I20260709 14:50:09.080444  7778 raft_consensus.cc:2468] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 1.
I20260709 14:50:09.080489  7971 raft_consensus.cc:359] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:09.081619  7971 raft_consensus.cc:385] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:09.081945  7971 raft_consensus.cc:740] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Initialized, Role: FOLLOWER
I20260709 14:50:09.085625  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18d29d52d304c87b930d4fb5eaf50b1" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:50:09.092345  7971 consensus_queue.cc:260] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:09.104007  7851 raft_consensus.cc:3060] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:09.097955  7853 raft_consensus.cc:3060] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Advancing to term 1
W20260709 14:50:09.093169  7819 leader_election.cc:343] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:09.118526  7819 leader_election.cc:304] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:50:09.100275  7854 raft_consensus.cc:2468] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 1.
I20260709 14:50:09.128504  7928 raft_consensus.cc:2468] T 9441e831627143a991a1556dcdce71e3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 1.
I20260709 14:50:09.130045  7894 leader_election.cc:304] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:50:09.131421  8053 raft_consensus.cc:2804] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:50:09.132025  8053 raft_consensus.cc:697] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:50:09.133010  8053 consensus_queue.cc:237] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:09.137566  7976 raft_consensus.cc:2804] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:50:09.138180  7976 raft_consensus.cc:493] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:50:09.138579  7976 raft_consensus.cc:3060] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:09.142447  7971 ts_tablet_manager.cc:1434] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent starting tablet: real 0.070s	user 0.013s	sys 0.000s
I20260709 14:50:09.143481  7971 tablet_bootstrap.cc:492] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac: Bootstrap starting.
I20260709 14:50:09.126300  7779 raft_consensus.cc:2468] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 1.
I20260709 14:50:09.151736  7819 leader_election.cc:304] T 9441e831627143a991a1556dcdce71e3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:50:09.165051  8000 raft_consensus.cc:2804] T 9441e831627143a991a1556dcdce71e3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:50:09.165634  8000 raft_consensus.cc:697] T 9441e831627143a991a1556dcdce71e3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:50:09.166522  8000 consensus_queue.cc:237] T 9441e831627143a991a1556dcdce71e3 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:09.180979  8033 consensus_queue.cc:1048] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 14:50:09.189132  7976 raft_consensus.cc:515] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:09.210987  8033 raft_consensus.cc:493] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:50:09.261902  8032 raft_consensus.cc:493] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:50:09.271476  8032 raft_consensus.cc:515] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:09.272826  7972 tablet_bootstrap.cc:492] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1de5e20126fa4d8ca0793d19c7b847ed: No bootstrap required, opened a new log
I20260709 14:50:09.273524  7972 ts_tablet_manager.cc:1403] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent bootstrapping tablet: real 0.346s	user 0.054s	sys 0.035s
W20260709 14:50:09.269043  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 90869us
I20260709 14:50:09.231228  8053 raft_consensus.cc:493] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:50:09.269909  8033 raft_consensus.cc:515] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:50:09.284153  8068 log.cc:927] Time spent T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.085s	user 0.000s	sys 0.004s
I20260709 14:50:09.278244  7974 tablet_bootstrap.cc:492] T a18d29d52d304c87b930d4fb5eaf50b1 P 1e9289592458429bbddb19c2e7b7b7b0: No bootstrap required, opened a new log
I20260709 14:50:09.305879  7974 ts_tablet_manager.cc:1403] T a18d29d52d304c87b930d4fb5eaf50b1 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent bootstrapping tablet: real 0.312s	user 0.033s	sys 0.042s
W20260709 14:50:09.306824  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 77046.2us
I20260709 14:50:09.310797  8033 leader_election.cc:290] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:09.277149  8053 raft_consensus.cc:515] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:50:09.323316  8070 log.cc:927] Time spent T 9441e831627143a991a1556dcdce71e3 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
W20260709 14:50:09.330669  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 54303us
I20260709 14:50:09.319661  8032 leader_election.cc:290] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:09.337922  7976 leader_election.cc:290] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 1 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:09.339293  7971 tablet_bootstrap.cc:654] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:09.334443  8000 raft_consensus.cc:493] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:50:09.347453  8010 raft_consensus.cc:493] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:50:09.363210  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:50:09.369078  8074 consensus_queue.cc:1048] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:50:09.366982  8010 raft_consensus.cc:515] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:50:09.376919  7744 leader_election.cc:343] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:09.377555  7972 raft_consensus.cc:359] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:09.378535  7972 raft_consensus.cc:385] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:09.378787  8010 leader_election.cc:290] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:50:09.353679  8000 raft_consensus.cc:515] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:09.378821  7972 raft_consensus.cc:740] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Initialized, Role: FOLLOWER
I20260709 14:50:09.382166  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:50:09.384441  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:50:09.385756  8000 leader_election.cc:290] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:50:09.387827  7894 leader_election.cc:343] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:09.389833  8053 leader_election.cc:290] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:50:09.388638  7676 catalog_manager.cc:5697] T 9441e831627143a991a1556dcdce71e3 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 0 to 1, leader changed from <none> to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 1 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:50:09.391714  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:50:09.392182  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18d29d52d304c87b930d4fb5eaf50b1" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:50:09.381498  7972 consensus_queue.cc:260] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:09.393303  7777 raft_consensus.cc:3060] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:09.393502  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:50:09.393628  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:50:09.394865  7852 raft_consensus.cc:2468] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 0.
W20260709 14:50:09.396261  7894 leader_election.cc:343] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:09.399400  7974 raft_consensus.cc:359] T a18d29d52d304c87b930d4fb5eaf50b1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:09.408493  7974 raft_consensus.cc:385] T a18d29d52d304c87b930d4fb5eaf50b1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:09.409130  7974 raft_consensus.cc:740] T a18d29d52d304c87b930d4fb5eaf50b1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Initialized, Role: FOLLOWER
I20260709 14:50:09.401671  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:50:09.405905  7745 leader_election.cc:304] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:50:09.401527  7972 ts_tablet_manager.cc:1434] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent starting tablet: real 0.127s	user 0.010s	sys 0.000s
I20260709 14:50:09.410995  7972 tablet_bootstrap.cc:492] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed: Bootstrap starting.
I20260709 14:50:09.416240  7974 consensus_queue.cc:260] T a18d29d52d304c87b930d4fb5eaf50b1 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:50:09.426909  7744 leader_election.cc:343] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:09.502954  7974 ts_tablet_manager.cc:1434] T a18d29d52d304c87b930d4fb5eaf50b1 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent starting tablet: real 0.197s	user 0.023s	sys 0.002s
I20260709 14:50:09.504240  7974 tablet_bootstrap.cc:492] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1e9289592458429bbddb19c2e7b7b7b0: Bootstrap starting.
I20260709 14:50:09.435958  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18d29d52d304c87b930d4fb5eaf50b1" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
W20260709 14:50:09.493094  8072 log.cc:927] Time spent T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.119s	user 0.000s	sys 0.001s
I20260709 14:50:09.510685  7927 raft_consensus.cc:3060] T a18d29d52d304c87b930d4fb5eaf50b1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Advancing to term 1
W20260709 14:50:09.517097  7745 leader_election.cc:343] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:09.517949  7745 leader_election.cc:304] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:09.522957  7927 raft_consensus.cc:2468] T a18d29d52d304c87b930d4fb5eaf50b1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 1.
I20260709 14:50:09.525295  8001 raft_consensus.cc:2749] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:50:09.525116  7819 leader_election.cc:304] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:50:09.533471  7777 raft_consensus.cc:2468] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 1.
W20260709 14:50:09.535332  8064 log.cc:927] Time spent T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.067s	user 0.002s	sys 0.009s
W20260709 14:50:09.501551  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 76789.2us
W20260709 14:50:09.539340  7893 leader_election.cc:343] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:09.417994  8032 raft_consensus.cc:493] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:50:09.407908  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:50:09.462174  8074 raft_consensus.cc:2804] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:50:09.540596  7893 leader_election.cc:304] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:09.583503  8044 consensus_queue.cc:1048] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:50:09.562613  8000 raft_consensus.cc:2804] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:50:09.561940  8074 raft_consensus.cc:493] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:50:09.567740  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:50:09.569090  8078 raft_consensus.cc:493] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:50:09.615042  8074 raft_consensus.cc:3060] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:09.574118  8032 raft_consensus.cc:515] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:09.627746  8073 raft_consensus.cc:493] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:50:09.632380  8073 raft_consensus.cc:515] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:09.617681  8000 raft_consensus.cc:697] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:50:09.642737  7971 tablet_bootstrap.cc:492] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac: No bootstrap required, opened a new log
I20260709 14:50:09.646540  7971 ts_tablet_manager.cc:1403] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent bootstrapping tablet: real 0.503s	user 0.062s	sys 0.052s
I20260709 14:50:09.648797  8078 raft_consensus.cc:515] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:09.653283  8078 leader_election.cc:290] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:50:09.633144  7819 leader_election.cc:343] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785): Illegal state: must be running to vote when last-logged opid is not known
W20260709 14:50:09.656713  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 117434us
I20260709 14:50:09.658635  8073 leader_election.cc:290] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:09.675065  8032 leader_election.cc:290] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:09.669785  8000 consensus_queue.cc:237] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:09.683578  7971 raft_consensus.cc:359] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:09.684211  7971 raft_consensus.cc:385] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:09.684417  7971 raft_consensus.cc:740] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Initialized, Role: FOLLOWER
W20260709 14:50:09.666553  7893 leader_election.cc:343] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:09.667973  8082 raft_consensus.cc:2749] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:50:09.703063  8083 consensus_queue.cc:1048] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 14:50:09.706622  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:50:09.706846  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
W20260709 14:50:09.711289  7725 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 14:50:09.712633  7974 tablet_bootstrap.cc:654] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1e9289592458429bbddb19c2e7b7b7b0: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:09.700160  7971 consensus_queue.cc:260] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:09.700692  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1f7722fdea49e0b5e9c5d96633eaf9" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:50:09.701203  7893 leader_election.cc:304] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:09.702380  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:50:09.720376  7971 ts_tablet_manager.cc:1434] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent starting tablet: real 0.073s	user 0.007s	sys 0.002s
I20260709 14:50:09.721738  7971 tablet_bootstrap.cc:492] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac: Bootstrap starting.
I20260709 14:50:09.719859  8082 raft_consensus.cc:2749] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:50:09.726487  7972 tablet_bootstrap.cc:654] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:09.724323  8044 consensus_queue.cc:1048] T 9441e831627143a991a1556dcdce71e3 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
W20260709 14:50:09.738050  7819 leader_election.cc:343] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785): Illegal state: must be running to vote when last-logged opid is not known
W20260709 14:50:09.740572  7819 leader_election.cc:343] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:09.738037  8078 consensus_queue.cc:1048] T 9441e831627143a991a1556dcdce71e3 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 14:50:09.725957  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 60278.7us
I20260709 14:50:09.749171  7819 leader_election.cc:304] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:50:09.757575  8044 raft_consensus.cc:2749] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:50:09.782155  7974 tablet_bootstrap.cc:492] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1e9289592458429bbddb19c2e7b7b7b0: No bootstrap required, opened a new log
I20260709 14:50:09.782941  7974 ts_tablet_manager.cc:1403] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent bootstrapping tablet: real 0.279s	user 0.020s	sys 0.007s
I20260709 14:50:09.782729  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:50:09.784173  7854 raft_consensus.cc:2468] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 0.
I20260709 14:50:09.750070  8074 raft_consensus.cc:515] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:09.788122  7778 raft_consensus.cc:2393] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 1: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:50:09.792449  8010 consensus_queue.cc:1048] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 14:50:09.795677  7745 leader_election.cc:343] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:09.798563  7819 leader_election.cc:304] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:50:09.800952  8000 raft_consensus.cc:3060] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:09.803540  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1f7722fdea49e0b5e9c5d96633eaf9" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:50:09.806950  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:50:09.806402  8074 leader_election.cc:290] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:09.813541  7974 raft_consensus.cc:359] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:09.814409  7974 raft_consensus.cc:385] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:09.814706  7974 raft_consensus.cc:740] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Initialized, Role: FOLLOWER
I20260709 14:50:09.824640  7974 consensus_queue.cc:260] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:09.797127  7745 leader_election.cc:304] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:50:09.827611  8074 raft_consensus.cc:2804] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:50:09.828155  8074 raft_consensus.cc:493] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:50:09.828540  8074 raft_consensus.cc:3060] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:09.850060  7974 ts_tablet_manager.cc:1434] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent starting tablet: real 0.067s	user 0.013s	sys 0.002s
I20260709 14:50:09.851431  7974 tablet_bootstrap.cc:492] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0: Bootstrap starting.
I20260709 14:50:09.857060  7971 tablet_bootstrap.cc:654] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac: Neither blocks nor log segments found. Creating new log.
W20260709 14:50:09.859652  7744 leader_election.cc:343] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:09.860184  7744 leader_election.cc:304] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:09.860968  8010 consensus_queue.cc:1048] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 14:50:09.861457  7744 leader_election.cc:343] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:09.861605  8032 raft_consensus.cc:2749] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:50:09.866711  8074 raft_consensus.cc:515] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:09.867800  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:50:09.866094  8000 raft_consensus.cc:2749] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:50:09.882064  7974 tablet_bootstrap.cc:654] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:09.891850  8074 leader_election.cc:290] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:09.896306  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:50:09.901419  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:50:09.909327  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:50:09.910619  7852 raft_consensus.cc:3060] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Advancing to term 1
W20260709 14:50:09.932420  7744 leader_election.cc:343] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:09.932447  7972 tablet_bootstrap.cc:492] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed: No bootstrap required, opened a new log
I20260709 14:50:09.935346  7972 ts_tablet_manager.cc:1403] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent bootstrapping tablet: real 0.525s	user 0.019s	sys 0.028s
W20260709 14:50:09.934152  7744 leader_election.cc:343] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:09.939571  7972 raft_consensus.cc:359] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:09.943148  7972 raft_consensus.cc:385] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:09.944224  7972 raft_consensus.cc:740] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Initialized, Role: FOLLOWER
I20260709 14:50:09.945660  7677 catalog_manager.cc:5697] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 0 to 1, leader changed from <none> to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 1 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:50:09.947824  7972 consensus_queue.cc:260] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:09.948591  7852 raft_consensus.cc:2468] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 1.
I20260709 14:50:09.948644  7677 catalog_manager.cc:5697] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 0 to 1, leader changed from <none> to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 1 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:50:09.956278  7974 tablet_bootstrap.cc:492] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0: No bootstrap required, opened a new log
I20260709 14:50:09.956880  7974 ts_tablet_manager.cc:1403] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent bootstrapping tablet: real 0.106s	user 0.007s	sys 0.005s
I20260709 14:50:09.958284  7745 leader_election.cc:304] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:50:09.959831  7971 tablet_bootstrap.cc:492] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac: No bootstrap required, opened a new log
I20260709 14:50:09.960496  7971 ts_tablet_manager.cc:1403] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent bootstrapping tablet: real 0.239s	user 0.009s	sys 0.017s
I20260709 14:50:09.963132  8032 raft_consensus.cc:2804] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:50:09.963858  8032 raft_consensus.cc:697] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:50:09.964766  8032 consensus_queue.cc:237] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:09.965530  7971 raft_consensus.cc:359] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:09.966259  7971 raft_consensus.cc:385] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:09.966534  7971 raft_consensus.cc:740] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Initialized, Role: FOLLOWER
I20260709 14:50:09.967252  7971 consensus_queue.cc:260] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:09.967392  7974 raft_consensus.cc:359] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:09.969862  7972 ts_tablet_manager.cc:1434] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent starting tablet: real 0.034s	user 0.008s	sys 0.000s
I20260709 14:50:09.970130  7974 raft_consensus.cc:385] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:09.970500  7974 raft_consensus.cc:740] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Initialized, Role: FOLLOWER
I20260709 14:50:09.970878  7972 tablet_bootstrap.cc:492] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed: Bootstrap starting.
I20260709 14:50:09.973501  7974 consensus_queue.cc:260] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:09.974200  7971 ts_tablet_manager.cc:1434] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent starting tablet: real 0.013s	user 0.003s	sys 0.006s
I20260709 14:50:09.975718  7971 tablet_bootstrap.cc:492] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac: Bootstrap starting.
I20260709 14:50:09.976225  7854 raft_consensus.cc:2468] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 1.
I20260709 14:50:09.977226  7974 ts_tablet_manager.cc:1434] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent starting tablet: real 0.020s	user 0.011s	sys 0.000s
I20260709 14:50:09.978432  7974 tablet_bootstrap.cc:492] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0: Bootstrap starting.
I20260709 14:50:09.978446  7745 leader_election.cc:304] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:50:09.984122  8084 raft_consensus.cc:2804] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:50:09.985105  8084 raft_consensus.cc:697] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:50:09.990684  8084 consensus_queue.cc:237] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:10.110400  7974 tablet_bootstrap.cc:654] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:10.111151  7971 tablet_bootstrap.cc:654] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:10.113158  7675 catalog_manager.cc:5697] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 0 to 1, leader changed from <none> to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 1 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:50:10.116284  7675 catalog_manager.cc:5697] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 0 to 1, leader changed from <none> to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 1 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:50:10.124377  7972 tablet_bootstrap.cc:654] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:10.136684  7974 tablet_bootstrap.cc:492] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0: No bootstrap required, opened a new log
I20260709 14:50:10.137228  7974 ts_tablet_manager.cc:1403] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent bootstrapping tablet: real 0.159s	user 0.025s	sys 0.000s
I20260709 14:50:10.140118  8085 raft_consensus.cc:493] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:50:10.151561  8085 raft_consensus.cc:515] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:10.152256  7974 raft_consensus.cc:359] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:10.152892  7974 raft_consensus.cc:385] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:10.153163  7974 raft_consensus.cc:740] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Initialized, Role: FOLLOWER
I20260709 14:50:10.153932  7974 consensus_queue.cc:260] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:10.155836  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:50:10.157379  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:50:10.157910  7972 tablet_bootstrap.cc:492] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed: No bootstrap required, opened a new log
I20260709 14:50:10.158682  7972 ts_tablet_manager.cc:1403] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent bootstrapping tablet: real 0.188s	user 0.018s	sys 0.039s
I20260709 14:50:10.158377  7854 raft_consensus.cc:2393] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 1: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:50:10.161646  7971 tablet_bootstrap.cc:492] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac: No bootstrap required, opened a new log
I20260709 14:50:10.162122  7974 ts_tablet_manager.cc:1434] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent starting tablet: real 0.025s	user 0.010s	sys 0.000s
I20260709 14:50:10.162509  7971 ts_tablet_manager.cc:1403] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent bootstrapping tablet: real 0.187s	user 0.016s	sys 0.004s
I20260709 14:50:10.162321  7894 leader_election.cc:304] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:10.162895  8085 leader_election.cc:290] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:50:10.163384  8086 raft_consensus.cc:3060] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:10.164942  7974 tablet_bootstrap.cc:492] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0: Bootstrap starting.
I20260709 14:50:10.169639  7971 raft_consensus.cc:359] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:10.171054  7971 raft_consensus.cc:385] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:10.171962  7971 raft_consensus.cc:740] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Initialized, Role: FOLLOWER
I20260709 14:50:10.173872  8086 raft_consensus.cc:2749] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:50:10.174031  7971 consensus_queue.cc:260] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:10.177788  7972 raft_consensus.cc:359] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:10.180483  7972 raft_consensus.cc:385] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:10.180795  7972 raft_consensus.cc:740] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Initialized, Role: FOLLOWER
I20260709 14:50:10.181069  7971 ts_tablet_manager.cc:1434] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent starting tablet: real 0.016s	user 0.010s	sys 0.000s
I20260709 14:50:10.182323  7971 tablet_bootstrap.cc:492] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac: Bootstrap starting.
I20260709 14:50:10.181973  7972 consensus_queue.cc:260] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:10.180111  7974 tablet_bootstrap.cc:654] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:10.178618  8086 raft_consensus.cc:493] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:50:10.185930  8086 raft_consensus.cc:515] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:10.190928  7971 tablet_bootstrap.cc:654] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:10.192160  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1f7722fdea49e0b5e9c5d96633eaf9" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:50:10.194844  7777 raft_consensus.cc:2468] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 0.
I20260709 14:50:10.195257  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1f7722fdea49e0b5e9c5d96633eaf9" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:50:10.196583  7893 leader_election.cc:304] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:50:10.192538  8086 leader_election.cc:290] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:50:10.197492  7894 leader_election.cc:343] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:10.190814  7972 ts_tablet_manager.cc:1434] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent starting tablet: real 0.032s	user 0.004s	sys 0.006s
I20260709 14:50:10.198079  8086 raft_consensus.cc:2804] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:50:10.202114  7972 tablet_bootstrap.cc:492] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed: Bootstrap starting.
I20260709 14:50:10.202960  8086 raft_consensus.cc:493] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:50:10.209908  8086 raft_consensus.cc:3060] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:10.225188  7972 tablet_bootstrap.cc:654] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:10.229013  8086 raft_consensus.cc:515] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:10.230288  7974 tablet_bootstrap.cc:492] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0: No bootstrap required, opened a new log
I20260709 14:50:10.230969  7974 ts_tablet_manager.cc:1403] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent bootstrapping tablet: real 0.068s	user 0.027s	sys 0.005s
I20260709 14:50:10.232690  8086 leader_election.cc:290] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:50:10.234949  7974 raft_consensus.cc:359] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:10.235805  7974 raft_consensus.cc:385] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:10.236186  7974 raft_consensus.cc:740] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Initialized, Role: FOLLOWER
I20260709 14:50:10.237283  7974 consensus_queue.cc:260] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:10.237924  7971 tablet_bootstrap.cc:492] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac: No bootstrap required, opened a new log
I20260709 14:50:10.238518  7971 ts_tablet_manager.cc:1403] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent bootstrapping tablet: real 0.056s	user 0.018s	sys 0.024s
I20260709 14:50:10.242045  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1f7722fdea49e0b5e9c5d96633eaf9" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:50:10.236030  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1f7722fdea49e0b5e9c5d96633eaf9" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:50:10.242043  7972 tablet_bootstrap.cc:492] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed: No bootstrap required, opened a new log
I20260709 14:50:10.243336  7777 raft_consensus.cc:3060] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:10.243611  7974 ts_tablet_manager.cc:1434] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 14:50:10.243634  7972 ts_tablet_manager.cc:1403] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent bootstrapping tablet: real 0.042s	user 0.021s	sys 0.000s
I20260709 14:50:10.245007  7974 tablet_bootstrap.cc:492] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0: Bootstrap starting.
I20260709 14:50:10.247464  7972 raft_consensus.cc:359] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:10.248255  7972 raft_consensus.cc:385] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:10.248821  7972 raft_consensus.cc:740] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Initialized, Role: FOLLOWER
I20260709 14:50:10.242126  7971 raft_consensus.cc:359] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:10.251611  7971 raft_consensus.cc:385] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 14:50:10.251775  7894 leader_election.cc:343] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:10.251998  7971 raft_consensus.cc:740] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Initialized, Role: FOLLOWER
I20260709 14:50:10.252725  7971 consensus_queue.cc:260] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:10.255525  7971 ts_tablet_manager.cc:1434] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 14:50:10.252745  7972 consensus_queue.cc:260] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:10.256646  7974 tablet_bootstrap.cc:654] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:10.258364  7972 ts_tablet_manager.cc:1434] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 14:50:10.257779  8000 consensus_queue.cc:1048] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:50:10.259454  7972 tablet_bootstrap.cc:492] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed: Bootstrap starting.
I20260709 14:50:10.262302  8084 raft_consensus.cc:493] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:50:10.262908  8084 raft_consensus.cc:515] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:10.266088  7971 tablet_bootstrap.cc:492] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac: Bootstrap starting.
I20260709 14:50:10.267803  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:50:10.273568  7971 tablet_bootstrap.cc:654] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:10.276093  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
W20260709 14:50:10.280191  7745 leader_election.cc:343] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:10.281282  8084 leader_election.cc:290] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:50:10.284453  7744 leader_election.cc:343] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:10.285341  7744 leader_election.cc:304] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:10.289779  7777 raft_consensus.cc:2468] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 1.
I20260709 14:50:10.294346  8044 consensus_queue.cc:1048] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:50:10.296792  8084 raft_consensus.cc:2749] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:50:10.302297  7972 tablet_bootstrap.cc:654] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:10.306125  7974 tablet_bootstrap.cc:492] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0: No bootstrap required, opened a new log
I20260709 14:50:10.308019  7974 ts_tablet_manager.cc:1403] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0: Time spent bootstrapping tablet: real 0.063s	user 0.028s	sys 0.026s
I20260709 14:50:10.309701  8044 raft_consensus.cc:493] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:50:10.310436  8044 raft_consensus.cc:515] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:10.314452  8044 leader_election.cc:290] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:10.315356  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:50:10.314266  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:50:10.315851  7974 raft_consensus.cc:359] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:10.316453  7778 raft_consensus.cc:2468] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 0.
I20260709 14:50:10.316922  7974 raft_consensus.cc:385] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:10.317409  7974 raft_consensus.cc:740] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Initialized, Role: FOLLOWER
I20260709 14:50:10.318387  7974 consensus_queue.cc:260] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:10.319139  7819 leader_election.cc:304] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:50:10.317335  7925 raft_consensus.cc:2468] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 0.
I20260709 14:50:10.320883  7974 ts_tablet_manager.cc:1434] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.002s
I20260709 14:50:10.322685  7974 tablet_bootstrap.cc:492] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0: Bootstrap starting.
I20260709 14:50:10.324030  7893 leader_election.cc:304] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:10.325853  8086 raft_consensus.cc:2804] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:50:10.326514  8086 raft_consensus.cc:697] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:50:10.327450  8086 consensus_queue.cc:237] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:10.329339  8000 raft_consensus.cc:2804] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:50:10.329794  8000 raft_consensus.cc:493] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:50:10.330173  8000 raft_consensus.cc:3060] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:10.335362  7974 tablet_bootstrap.cc:654] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:10.345955  8078 raft_consensus.cc:493] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:50:10.346702  8078 raft_consensus.cc:515] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:10.349128  8078 leader_election.cc:290] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:10.354562  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:50:10.372519  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:50:10.373461  7925 raft_consensus.cc:2468] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 0.
I20260709 14:50:10.387708  7819 leader_election.cc:304] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:50:10.389380  8078 raft_consensus.cc:2804] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:50:10.389928  8078 raft_consensus.cc:493] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:50:10.390622  8078 raft_consensus.cc:3060] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Advancing to term 1
W20260709 14:50:10.398197  7819 leader_election.cc:343] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:10.414613  8000 raft_consensus.cc:515] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:10.414091  8078 raft_consensus.cc:515] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:10.419972  8084 raft_consensus.cc:493] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:50:10.420682  8084 raft_consensus.cc:515] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:10.423180  8084 leader_election.cc:290] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:10.424363  8074 consensus_queue.cc:1048] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:50:10.425859  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:50:10.427579  7852 raft_consensus.cc:2468] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 0.
I20260709 14:50:10.428095  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:50:10.431988  7745 leader_election.cc:304] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:50:10.434856  8074 raft_consensus.cc:2804] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:50:10.435774  8074 raft_consensus.cc:493] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:50:10.436432  8074 raft_consensus.cc:3060] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:10.453913  8032 consensus_queue.cc:1048] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:50:10.467862  7675 catalog_manager.cc:5697] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 1 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:50:10.482837  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:50:10.484812  8078 leader_election.cc:290] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 1 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:10.500486  8084 consensus_queue.cc:1048] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:50:10.500586  8085 raft_consensus.cc:493] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:50:10.501825  8085 raft_consensus.cc:515] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:10.504951  8085 leader_election.cc:290] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:50:10.508905  7925 raft_consensus.cc:3060] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:10.513038  7972 tablet_bootstrap.cc:492] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed: No bootstrap required, opened a new log
I20260709 14:50:10.514053  7972 ts_tablet_manager.cc:1403] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent bootstrapping tablet: real 0.255s	user 0.053s	sys 0.057s
W20260709 14:50:10.518195  7744 leader_election.cc:343] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785): Illegal state: must be running to vote when last-logged opid is not known
W20260709 14:50:10.518261  7819 leader_election.cc:343] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:10.519537  7971 tablet_bootstrap.cc:492] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac: No bootstrap required, opened a new log
I20260709 14:50:10.520326  7971 ts_tablet_manager.cc:1403] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent bootstrapping tablet: real 0.254s	user 0.096s	sys 0.143s
I20260709 14:50:10.523427  7971 raft_consensus.cc:359] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:10.524394  7971 raft_consensus.cc:385] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:10.524855  7971 raft_consensus.cc:740] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Initialized, Role: FOLLOWER
I20260709 14:50:10.525871  7971 consensus_queue.cc:260] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:10.526827  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:50:10.528728  7971 ts_tablet_manager.cc:1434] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 14:50:10.530315  7971 tablet_bootstrap.cc:492] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 3876b8ee8d744cb18e91d97aae93b1ac: Bootstrap starting.
I20260709 14:50:10.533102  7972 raft_consensus.cc:359] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:10.533763  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:50:10.534219  7972 raft_consensus.cc:385] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:10.534541  7926 raft_consensus.cc:3060] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:10.534556  7972 raft_consensus.cc:740] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Initialized, Role: FOLLOWER
I20260709 14:50:10.544443  7974 tablet_bootstrap.cc:492] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0: No bootstrap required, opened a new log
I20260709 14:50:10.545086  7974 ts_tablet_manager.cc:1403] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent bootstrapping tablet: real 0.223s	user 0.032s	sys 0.021s
I20260709 14:50:10.544646  7972 consensus_queue.cc:260] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:10.547556  7972 ts_tablet_manager.cc:1434] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent starting tablet: real 0.033s	user 0.009s	sys 0.000s
I20260709 14:50:10.551020  7974 raft_consensus.cc:359] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:10.552181  7974 raft_consensus.cc:385] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:10.553695  8000 leader_election.cc:290] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 1 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:10.552637  7974 raft_consensus.cc:740] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Initialized, Role: FOLLOWER
I20260709 14:50:10.557349  7974 consensus_queue.cc:260] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:10.561470  7972 tablet_bootstrap.cc:492] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed: Bootstrap starting.
I20260709 14:50:10.562793  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:50:10.569526  7974 ts_tablet_manager.cc:1434] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.002s
I20260709 14:50:10.570847  7974 tablet_bootstrap.cc:492] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0: Bootstrap starting.
I20260709 14:50:10.552404  8074 raft_consensus.cc:515] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:10.579909  7894 leader_election.cc:304] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:10.581640  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:50:10.582984  7925 raft_consensus.cc:3060] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:10.585597  8086 raft_consensus.cc:2749] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:50:10.582818  7926 raft_consensus.cc:2468] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 1.
I20260709 14:50:10.591831  8074 leader_election.cc:290] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:10.596753  7819 leader_election.cc:304] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:50:10.606598  7971 tablet_bootstrap.cc:654] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 3876b8ee8d744cb18e91d97aae93b1ac: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:10.607169  8078 raft_consensus.cc:2804] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:50:10.607713  8078 raft_consensus.cc:697] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:50:10.608781  8078 consensus_queue.cc:237] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:10.605938  7974 tablet_bootstrap.cc:654] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:10.590934  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:50:10.616108  7853 raft_consensus.cc:3060] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:10.605943  7972 tablet_bootstrap.cc:654] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed: Neither blocks nor log segments found. Creating new log.
W20260709 14:50:10.617205  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 55775.4us
I20260709 14:50:10.640939  7925 raft_consensus.cc:2468] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 1.
I20260709 14:50:10.649286  8032 consensus_queue.cc:1048] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
W20260709 14:50:10.648394  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 64479.3us
I20260709 14:50:10.653156  7853 raft_consensus.cc:2468] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 1.
I20260709 14:50:10.690644  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:50:10.686791  8078 raft_consensus.cc:493] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:50:10.688848  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:50:10.695017  7675 catalog_manager.cc:5697] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 0 to 1, leader changed from <none> to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 1 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:50:10.709218  7927 raft_consensus.cc:3060] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:10.685454  8032 raft_consensus.cc:493] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:50:10.711875  8032 raft_consensus.cc:515] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:10.714211  8032 leader_election.cc:290] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:10.661213  7819 leader_election.cc:304] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
W20260709 14:50:10.716423  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 55323.3us
I20260709 14:50:10.718281  8000 raft_consensus.cc:2804] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:50:10.698877  7971 tablet_bootstrap.cc:492] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 3876b8ee8d744cb18e91d97aae93b1ac: No bootstrap required, opened a new log
I20260709 14:50:10.718911  8000 raft_consensus.cc:697] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:50:10.719440  7971 ts_tablet_manager.cc:1403] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent bootstrapping tablet: real 0.189s	user 0.025s	sys 0.013s
I20260709 14:50:10.721531  7776 raft_consensus.cc:3060] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:10.723537  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:50:10.722869  8000 consensus_queue.cc:237] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:10.724331  7850 raft_consensus.cc:2468] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 0.
I20260709 14:50:10.727208  7927 raft_consensus.cc:2468] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 1.
I20260709 14:50:10.722826  8078 raft_consensus.cc:515] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:10.729146  7745 leader_election.cc:304] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:50:10.730290  8032 raft_consensus.cc:2804] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:50:10.730844  8032 raft_consensus.cc:493] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:50:10.731237  8032 raft_consensus.cc:3060] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:10.732969  7745 leader_election.cc:304] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:50:10.734145  8084 raft_consensus.cc:2804] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:50:10.731793  8078 leader_election.cc:290] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:10.734742  8084 raft_consensus.cc:697] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:50:10.731992  7971 raft_consensus.cc:359] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:10.738710  7971 raft_consensus.cc:385] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:10.738549  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:50:10.739154  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:50:10.739864  7926 raft_consensus.cc:2468] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 0.
I20260709 14:50:10.735941  8084 consensus_queue.cc:237] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:10.738799  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:50:10.743566  7927 raft_consensus.cc:2468] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 0.
I20260709 14:50:10.745766  7819 leader_election.cc:304] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:50:10.746866  8078 raft_consensus.cc:2804] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:50:10.747270  8078 raft_consensus.cc:493] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:50:10.747689  7974 tablet_bootstrap.cc:492] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0: No bootstrap required, opened a new log
I20260709 14:50:10.747994  8078 raft_consensus.cc:3060] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:10.748353  7974 ts_tablet_manager.cc:1403] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent bootstrapping tablet: real 0.178s	user 0.023s	sys 0.008s
I20260709 14:50:10.748129  8032 raft_consensus.cc:515] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:10.750990  7972 tablet_bootstrap.cc:492] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed: No bootstrap required, opened a new log
I20260709 14:50:10.739156  7971 raft_consensus.cc:740] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Initialized, Role: FOLLOWER
I20260709 14:50:10.753727  7972 ts_tablet_manager.cc:1403] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent bootstrapping tablet: real 0.204s	user 0.014s	sys 0.017s
I20260709 14:50:10.753885  7971 consensus_queue.cc:260] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:10.757293  7971 ts_tablet_manager.cc:1434] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent starting tablet: real 0.037s	user 0.009s	sys 0.000s
I20260709 14:50:10.758481  7971 tablet_bootstrap.cc:492] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac: Bootstrap starting.
I20260709 14:50:10.760072  7776 raft_consensus.cc:2468] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 1.
I20260709 14:50:10.751191  7974 raft_consensus.cc:359] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:10.762339  7974 raft_consensus.cc:385] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:10.762688  7974 raft_consensus.cc:740] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Initialized, Role: FOLLOWER
I20260709 14:50:10.763535  7974 consensus_queue.cc:260] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:10.767668  7974 ts_tablet_manager.cc:1434] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.001s
W20260709 14:50:10.770210  7819 leader_election.cc:343] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:10.772221  8078 raft_consensus.cc:515] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:10.772867  8032 leader_election.cc:290] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:10.774053  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:50:10.774860  7853 raft_consensus.cc:3060] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:10.779173  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:50:10.779954  7926 raft_consensus.cc:3060] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:10.781782  7974 tablet_bootstrap.cc:492] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0: Bootstrap starting.
I20260709 14:50:10.787348  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
W20260709 14:50:10.791302  7819 leader_election.cc:343] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:10.793627  7974 tablet_bootstrap.cc:654] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:10.793991  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:50:10.794765  7925 raft_consensus.cc:3060] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:10.795821  8078 leader_election.cc:290] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 1 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:10.797526  8086 consensus_queue.cc:1048] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 14:50:10.799923  7677 catalog_manager.cc:5697] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 0 to 1, leader changed from <none> to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 1 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:50:10.803821  7926 raft_consensus.cc:2468] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 1.
I20260709 14:50:10.805652  7744 leader_election.cc:304] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:50:10.806842  8084 raft_consensus.cc:2804] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:50:10.807379  8084 raft_consensus.cc:697] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:50:10.808274  8084 consensus_queue.cc:237] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:10.814177  7675 catalog_manager.cc:5697] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 0 to 1, leader changed from <none> to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 1 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:50:10.820348  7925 raft_consensus.cc:2468] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 1.
I20260709 14:50:10.822098  7819 leader_election.cc:304] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:50:10.823756  8000 raft_consensus.cc:2804] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:50:10.803149  7972 raft_consensus.cc:359] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:10.824365  8000 raft_consensus.cc:697] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:50:10.834362  7972 raft_consensus.cc:385] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:10.834766  7972 raft_consensus.cc:740] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Initialized, Role: FOLLOWER
I20260709 14:50:10.834987  8000 consensus_queue.cc:237] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:10.823774  7853 raft_consensus.cc:2468] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 1.
W20260709 14:50:10.837946  7725 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 14:50:10.843854  7850 raft_consensus.cc:3060] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:10.835703  7972 consensus_queue.cc:260] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:10.863499  7971 tablet_bootstrap.cc:654] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:10.852175  7974 tablet_bootstrap.cc:492] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0: No bootstrap required, opened a new log
I20260709 14:50:10.868081  7972 ts_tablet_manager.cc:1434] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent starting tablet: real 0.114s	user 0.008s	sys 0.000s
I20260709 14:50:10.868516  7974 ts_tablet_manager.cc:1403] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0: Time spent bootstrapping tablet: real 0.087s	user 0.028s	sys 0.016s
I20260709 14:50:10.869316  7972 tablet_bootstrap.cc:492] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed: Bootstrap starting.
I20260709 14:50:10.873414  8086 consensus_queue.cc:1048] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:50:10.873520  7974 raft_consensus.cc:359] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:10.874512  7974 raft_consensus.cc:385] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:10.874840  7974 raft_consensus.cc:740] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Initialized, Role: FOLLOWER
I20260709 14:50:10.875782  7974 consensus_queue.cc:260] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:10.878427  7974 ts_tablet_manager.cc:1434] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 14:50:10.879895  7972 tablet_bootstrap.cc:654] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:10.880283  7974 tablet_bootstrap.cc:492] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0: Bootstrap starting.
I20260709 14:50:10.884308  7676 catalog_manager.cc:5697] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 0 to 1, leader changed from <none> to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 1 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:50:10.866034  7674 catalog_manager.cc:5697] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 0 to 1, leader changed from <none> to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 1 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:50:10.892247  7974 tablet_bootstrap.cc:654] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:10.893187  8069 raft_consensus.cc:493] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:50:10.893900  8069 raft_consensus.cc:515] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:10.899912  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1f7722fdea49e0b5e9c5d96633eaf9" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:50:10.906920  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1f7722fdea49e0b5e9c5d96633eaf9" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:50:10.910974  7819 leader_election.cc:304] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:50:10.912916  8078 raft_consensus.cc:2749] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 14:50:10.914335  8069 leader_election.cc:290] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:10.948966  7971 tablet_bootstrap.cc:492] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac: No bootstrap required, opened a new log
I20260709 14:50:10.949693  7971 ts_tablet_manager.cc:1403] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent bootstrapping tablet: real 0.191s	user 0.019s	sys 0.039s
I20260709 14:50:10.977696  7974 tablet_bootstrap.cc:492] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0: No bootstrap required, opened a new log
I20260709 14:50:10.977921  7971 raft_consensus.cc:359] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:10.978509  7974 ts_tablet_manager.cc:1403] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0: Time spent bootstrapping tablet: real 0.099s	user 0.043s	sys 0.019s
I20260709 14:50:10.978710  7971 raft_consensus.cc:385] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:10.979242  7971 raft_consensus.cc:740] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Initialized, Role: FOLLOWER
I20260709 14:50:10.979418  7972 tablet_bootstrap.cc:492] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed: No bootstrap required, opened a new log
I20260709 14:50:10.979945  7972 ts_tablet_manager.cc:1403] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent bootstrapping tablet: real 0.111s	user 0.029s	sys 0.033s
I20260709 14:50:10.980068  7971 consensus_queue.cc:260] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:10.982493  7971 ts_tablet_manager.cc:1434] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 14:50:10.983256  7972 raft_consensus.cc:359] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:10.983807  7974 raft_consensus.cc:359] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:10.984790  7974 raft_consensus.cc:385] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:10.985176  7974 raft_consensus.cc:740] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Initialized, Role: FOLLOWER
I20260709 14:50:10.984223  7972 raft_consensus.cc:385] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:10.985466  7971 tablet_bootstrap.cc:492] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac: Bootstrap starting.
I20260709 14:50:10.985803  7972 raft_consensus.cc:740] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Initialized, Role: FOLLOWER
I20260709 14:50:10.987141  7972 consensus_queue.cc:260] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:10.989895  7972 ts_tablet_manager.cc:1434] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.001s
I20260709 14:50:10.992654  7972 tablet_bootstrap.cc:492] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed: Bootstrap starting.
I20260709 14:50:10.992759  7971 tablet_bootstrap.cc:654] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:10.991004  7974 consensus_queue.cc:260] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:11.000099  7974 ts_tablet_manager.cc:1434] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 14:50:11.001664  7974 tablet_bootstrap.cc:492] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0: Bootstrap starting.
I20260709 14:50:11.005287  7972 tablet_bootstrap.cc:654] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:11.008028  8085 raft_consensus.cc:493] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:50:11.008735  8085 raft_consensus.cc:515] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:11.016324  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:50:11.016449  8085 leader_election.cc:290] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:50:11.020305  7893 leader_election.cc:343] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:11.021576  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:50:11.024045  7974 tablet_bootstrap.cc:654] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0: Neither blocks nor log segments found. Creating new log.
W20260709 14:50:11.024608  7894 leader_election.cc:343] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:11.028558  7894 leader_election.cc:304] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:11.030867  8085 raft_consensus.cc:2749] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:50:11.031159  7971 tablet_bootstrap.cc:492] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac: No bootstrap required, opened a new log
I20260709 14:50:11.034541  7971 ts_tablet_manager.cc:1403] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent bootstrapping tablet: real 0.049s	user 0.029s	sys 0.011s
I20260709 14:50:11.035012  7972 tablet_bootstrap.cc:492] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed: No bootstrap required, opened a new log
I20260709 14:50:11.035585  7972 ts_tablet_manager.cc:1403] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent bootstrapping tablet: real 0.043s	user 0.013s	sys 0.011s
I20260709 14:50:11.038307  7971 raft_consensus.cc:359] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:11.039487  7972 raft_consensus.cc:359] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:11.040696  7971 raft_consensus.cc:385] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:11.040781  7972 raft_consensus.cc:385] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:11.041124  7971 raft_consensus.cc:740] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Initialized, Role: FOLLOWER
I20260709 14:50:11.041213  7972 raft_consensus.cc:740] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Initialized, Role: FOLLOWER
I20260709 14:50:11.041996  7971 consensus_queue.cc:260] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:11.042104  7972 consensus_queue.cc:260] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:11.044595  7972 ts_tablet_manager.cc:1434] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 14:50:11.045859  7972 tablet_bootstrap.cc:492] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed: Bootstrap starting.
I20260709 14:50:11.044595  7971 ts_tablet_manager.cc:1434] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 14:50:11.052467  7971 tablet_bootstrap.cc:492] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac: Bootstrap starting.
I20260709 14:50:11.052551  7974 tablet_bootstrap.cc:492] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0: No bootstrap required, opened a new log
I20260709 14:50:11.053323  7974 ts_tablet_manager.cc:1403] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0: Time spent bootstrapping tablet: real 0.052s	user 0.012s	sys 0.005s
I20260709 14:50:11.053324  7972 tablet_bootstrap.cc:654] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:11.057353  7974 raft_consensus.cc:359] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:11.058394  7974 raft_consensus.cc:385] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:11.058847  7974 raft_consensus.cc:740] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Initialized, Role: FOLLOWER
I20260709 14:50:11.057514  7776 raft_consensus.cc:3060] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:11.060196  7974 consensus_queue.cc:260] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:11.061030  7971 tablet_bootstrap.cc:654] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:11.068051  7974 ts_tablet_manager.cc:1434] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 14:50:11.069639  7974 tablet_bootstrap.cc:492] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0: Bootstrap starting.
I20260709 14:50:11.078289  7974 tablet_bootstrap.cc:654] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:11.099128  7974 tablet_bootstrap.cc:492] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0: No bootstrap required, opened a new log
I20260709 14:50:11.099840  7974 ts_tablet_manager.cc:1403] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent bootstrapping tablet: real 0.030s	user 0.013s	sys 0.005s
I20260709 14:50:11.103649  8032 raft_consensus.cc:493] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:50:11.104115  7974 raft_consensus.cc:359] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:11.105554  7974 raft_consensus.cc:385] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:11.106012  7974 raft_consensus.cc:740] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Initialized, Role: FOLLOWER
I20260709 14:50:11.104477  8032 raft_consensus.cc:515] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:11.107023  7974 consensus_queue.cc:260] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:11.108466  8032 leader_election.cc:290] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:11.110009  7974 ts_tablet_manager.cc:1434] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent starting tablet: real 0.010s	user 0.010s	sys 0.001s
I20260709 14:50:11.111467  7974 tablet_bootstrap.cc:492] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0: Bootstrap starting.
I20260709 14:50:11.111776  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:50:11.114114  7745 leader_election.cc:343] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:11.115904  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:50:11.116851  7926 raft_consensus.cc:2468] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 0.
I20260709 14:50:11.118914  7744 leader_election.cc:304] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:11.119158  7974 tablet_bootstrap.cc:654] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:11.120116  8084 raft_consensus.cc:2804] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:50:11.120645  8084 raft_consensus.cc:493] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:50:11.121498  8084 raft_consensus.cc:3060] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:11.122282  8085 raft_consensus.cc:493] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:50:11.123018  8085 raft_consensus.cc:515] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:11.127868  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:50:11.130270  7894 leader_election.cc:343] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:11.131119  8085 leader_election.cc:290] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:50:11.132231  8000 consensus_queue.cc:1048] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:50:11.133452  8032 raft_consensus.cc:493] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:50:11.134011  8032 raft_consensus.cc:515] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:11.136703  8032 leader_election.cc:290] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:11.137032  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:50:11.143234  7974 tablet_bootstrap.cc:492] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0: No bootstrap required, opened a new log
I20260709 14:50:11.144057  7974 ts_tablet_manager.cc:1403] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0: Time spent bootstrapping tablet: real 0.033s	user 0.012s	sys 0.007s
I20260709 14:50:11.152406  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:50:11.154139  7926 raft_consensus.cc:2393] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 1: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:50:11.168962  7974 raft_consensus.cc:359] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:11.159191  8000 consensus_queue.cc:1048] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 14:50:11.173657  7974 raft_consensus.cc:385] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:11.175947  7974 raft_consensus.cc:740] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Initialized, Role: FOLLOWER
I20260709 14:50:11.177665  7974 consensus_queue.cc:260] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:11.182108  7744 leader_election.cc:304] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:11.187968  8119 raft_consensus.cc:3060] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:11.187331  8000 consensus_queue.cc:1048] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 14:50:11.198449  8119 raft_consensus.cc:2749] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:50:11.192837  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
W20260709 14:50:11.204420  7893 leader_election.cc:343] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:11.205472  7893 leader_election.cc:304] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:11.207732  8085 raft_consensus.cc:2749] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:50:11.213374  8084 raft_consensus.cc:515] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:11.217548  8119 raft_consensus.cc:493] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:50:11.218230  8119 raft_consensus.cc:515] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:11.221135  8119 leader_election.cc:290] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:11.232501  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:50:11.234447  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:50:11.235453  7853 raft_consensus.cc:2468] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 0.
W20260709 14:50:11.238590  7745 leader_election.cc:343] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:11.239948  7974 ts_tablet_manager.cc:1434] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0: Time spent starting tablet: real 0.096s	user 0.013s	sys 0.000s
I20260709 14:50:11.241644  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:50:11.252066  7927 raft_consensus.cc:2468] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 0.
I20260709 14:50:11.255071  7744 leader_election.cc:304] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:50:11.256700  8032 raft_consensus.cc:2804] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:50:11.257196  7974 tablet_bootstrap.cc:492] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0: Bootstrap starting.
I20260709 14:50:11.260044  8085 raft_consensus.cc:493] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:50:11.261016  8085 raft_consensus.cc:515] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:11.268170  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:50:11.269605  8032 raft_consensus.cc:493] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:50:11.271111  8032 raft_consensus.cc:3060] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:11.271966  7974 tablet_bootstrap.cc:654] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0: Neither blocks nor log segments found. Creating new log.
W20260709 14:50:11.277967  7894 leader_election.cc:343] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:11.279785  8085 leader_election.cc:290] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:50:11.283090  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:50:11.284649  8078 consensus_queue.cc:1048] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:50:11.286010  8119 consensus_queue.cc:1048] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:50:11.287051  8078 consensus_queue.cc:1048] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 14:50:11.287432  7893 leader_election.cc:343] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:11.287928  7893 leader_election.cc:304] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:11.289326  8086 raft_consensus.cc:2749] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:50:11.293686  8044 raft_consensus.cc:493] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:50:11.294546  8044 raft_consensus.cc:515] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:11.297482  8044 leader_election.cc:290] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:11.301565  8119 consensus_queue.cc:1048] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:50:11.322903  7974 tablet_bootstrap.cc:492] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0: No bootstrap required, opened a new log
I20260709 14:50:11.328807  7974 ts_tablet_manager.cc:1403] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent bootstrapping tablet: real 0.078s	user 0.013s	sys 0.004s
I20260709 14:50:11.330572  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:50:11.331509  7776 raft_consensus.cc:2468] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 0.
I20260709 14:50:11.332691  8074 consensus_queue.cc:1048] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 14:50:11.334776  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:50:11.335551  7928 raft_consensus.cc:2468] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 0.
I20260709 14:50:11.340070  7974 raft_consensus.cc:359] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:11.340914  7974 raft_consensus.cc:385] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:11.341203  7974 raft_consensus.cc:740] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Initialized, Role: FOLLOWER
I20260709 14:50:11.341876  7974 consensus_queue.cc:260] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:11.344384  7974 ts_tablet_manager.cc:1434] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.000s
I20260709 14:50:11.346809  7974 tablet_bootstrap.cc:492] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0: Bootstrap starting.
I20260709 14:50:11.355168  7974 tablet_bootstrap.cc:654] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:11.361060  7819 leader_election.cc:304] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:50:11.361577  8084 leader_election.cc:290] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:11.363726  8032 raft_consensus.cc:515] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:11.365729  8044 raft_consensus.cc:2804] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:50:11.366402  8032 leader_election.cc:290] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:11.366521  8044 raft_consensus.cc:493] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:50:11.369592  8044 raft_consensus.cc:3060] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:11.374542  7971 tablet_bootstrap.cc:492] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac: No bootstrap required, opened a new log
I20260709 14:50:11.375295  7971 ts_tablet_manager.cc:1403] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent bootstrapping tablet: real 0.323s	user 0.059s	sys 0.085s
I20260709 14:50:11.405296  7972 tablet_bootstrap.cc:492] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed: No bootstrap required, opened a new log
I20260709 14:50:11.406054  7972 ts_tablet_manager.cc:1403] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent bootstrapping tablet: real 0.360s	user 0.116s	sys 0.154s
I20260709 14:50:11.412307  7971 raft_consensus.cc:359] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:11.413520  7971 raft_consensus.cc:385] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:11.413954  7971 raft_consensus.cc:740] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Initialized, Role: FOLLOWER
I20260709 14:50:11.414798  7971 consensus_queue.cc:260] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:11.413110  8044 raft_consensus.cc:515] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:50:11.425123  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 68007.4us
I20260709 14:50:11.428185  7971 ts_tablet_manager.cc:1434] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent starting tablet: real 0.053s	user 0.006s	sys 0.005s
I20260709 14:50:11.429580  7971 tablet_bootstrap.cc:492] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac: Bootstrap starting.
I20260709 14:50:11.432022  8044 leader_election.cc:290] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 1 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:11.433466  7972 raft_consensus.cc:359] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:11.434278  7972 raft_consensus.cc:385] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:11.434599  7972 raft_consensus.cc:740] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Initialized, Role: FOLLOWER
I20260709 14:50:11.437947  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:50:11.438722  7925 raft_consensus.cc:3060] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:11.442229  8132 raft_consensus.cc:493] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:50:11.442885  7972 consensus_queue.cc:260] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:11.443869  8132 raft_consensus.cc:515] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:11.461799  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:50:11.462236  8132 leader_election.cc:290] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:50:11.462791  7924 raft_consensus.cc:3060] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:11.479652  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:50:11.489675  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:50:11.506526  7894 leader_election.cc:343] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Illegal state: must be running to vote when last-logged opid is not known
W20260709 14:50:11.528916  8146 log.cc:927] Time spent T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
I20260709 14:50:11.566629  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:50:11.567446  7850 raft_consensus.cc:3060] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Advancing to term 1
W20260709 14:50:11.577778  7893 leader_election.cc:343] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:11.586802  7893 leader_election.cc:304] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:11.621804  8086 raft_consensus.cc:493] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:50:11.622651  8086 raft_consensus.cc:515] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:11.645964  7972 ts_tablet_manager.cc:1434] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent starting tablet: real 0.240s	user 0.009s	sys 0.000s
I20260709 14:50:11.647168  7972 tablet_bootstrap.cc:492] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed: Bootstrap starting.
I20260709 14:50:11.649824  7974 tablet_bootstrap.cc:492] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0: No bootstrap required, opened a new log
I20260709 14:50:11.650574  7974 ts_tablet_manager.cc:1403] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0: Time spent bootstrapping tablet: real 0.304s	user 0.040s	sys 0.059s
I20260709 14:50:11.637271  8132 raft_consensus.cc:2749] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:50:11.664119  7925 raft_consensus.cc:2468] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 1.
I20260709 14:50:11.659848  7850 raft_consensus.cc:2468] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 1.
I20260709 14:50:11.642411  8086 leader_election.cc:290] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:50:11.674835  7971 tablet_bootstrap.cc:654] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:11.659848  7924 raft_consensus.cc:2468] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 1.
I20260709 14:50:11.685061  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:50:11.687700  8084 consensus_queue.cc:1048] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:50:11.688050  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:50:11.691442  7928 raft_consensus.cc:3060] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Advancing to term 1
W20260709 14:50:11.685868  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 120556us
I20260709 14:50:11.702445  8044 consensus_queue.cc:1048] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 14:50:11.703877  7894 leader_election.cc:343] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:11.704566  8084 raft_consensus.cc:493] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:50:11.705422  8084 raft_consensus.cc:515] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:11.707629  8084 leader_election.cc:290] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:11.709445  7928 raft_consensus.cc:2468] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 1.
I20260709 14:50:11.710330  7972 tablet_bootstrap.cc:654] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:11.710070  7974 raft_consensus.cc:359] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:11.718731  7974 raft_consensus.cc:385] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:11.719194  7974 raft_consensus.cc:740] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Initialized, Role: FOLLOWER
I20260709 14:50:11.719985  7974 consensus_queue.cc:260] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:11.722695  7974 ts_tablet_manager.cc:1434] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0: Time spent starting tablet: real 0.072s	user 0.007s	sys 0.001s
I20260709 14:50:11.723814  7974 tablet_bootstrap.cc:492] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0: Bootstrap starting.
I20260709 14:50:11.730759  7972 tablet_bootstrap.cc:492] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed: No bootstrap required, opened a new log
I20260709 14:50:11.731249  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:50:11.731441  7972 ts_tablet_manager.cc:1403] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent bootstrapping tablet: real 0.084s	user 0.016s	sys 0.003s
I20260709 14:50:11.731994  7925 raft_consensus.cc:2468] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 0.
I20260709 14:50:11.732225  7974 tablet_bootstrap.cc:654] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:11.733147  8161 raft_consensus.cc:493] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:50:11.733387  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:50:11.733726  8161 raft_consensus.cc:515] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:11.735894  7744 leader_election.cc:304] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:11.736819  8161 leader_election.cc:290] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:50:11.737066  8154 raft_consensus.cc:2804] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:50:11.737500  7744 leader_election.cc:304] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:50:11.737835  8154 raft_consensus.cc:697] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:50:11.738739  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:50:11.739033  8154 consensus_queue.cc:237] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:50:11.740738  7894 leader_election.cc:343] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:11.735041  7972 raft_consensus.cc:359] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:11.746068  7972 raft_consensus.cc:385] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:11.746541  7972 raft_consensus.cc:740] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Initialized, Role: FOLLOWER
I20260709 14:50:11.747395  7972 consensus_queue.cc:260] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:11.747869  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:50:11.754392  7972 ts_tablet_manager.cc:1434] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.001s
I20260709 14:50:11.757520  7972 tablet_bootstrap.cc:492] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed: Bootstrap starting.
I20260709 14:50:11.769677  8074 raft_consensus.cc:2804] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:50:11.770351  8074 raft_consensus.cc:697] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:50:11.771349  8074 consensus_queue.cc:237] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:11.787485  7744 leader_election.cc:304] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:50:11.789896  8084 raft_consensus.cc:2804] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:50:11.790257  8084 raft_consensus.cc:493] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:50:11.790846  7972 tablet_bootstrap.cc:654] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:11.790735  8084 raft_consensus.cc:3060] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:11.792501  7974 tablet_bootstrap.cc:492] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0: No bootstrap required, opened a new log
I20260709 14:50:11.794921  7974 ts_tablet_manager.cc:1403] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0: Time spent bootstrapping tablet: real 0.071s	user 0.023s	sys 0.025s
I20260709 14:50:11.798071  7974 raft_consensus.cc:359] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:11.798936  7974 raft_consensus.cc:385] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:11.799356  7974 raft_consensus.cc:740] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Initialized, Role: FOLLOWER
I20260709 14:50:11.800700  7974 consensus_queue.cc:260] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:11.801393  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:50:11.802649  7778 raft_consensus.cc:3060] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:11.804849  8084 raft_consensus.cc:515] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:11.809091  7974 ts_tablet_manager.cc:1434] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 14:50:11.810405  7974 tablet_bootstrap.cc:492] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0: Bootstrap starting.
I20260709 14:50:11.811085  7778 raft_consensus.cc:2468] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 1.
I20260709 14:50:11.811764  8084 leader_election.cc:290] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:11.817353  7974 tablet_bootstrap.cc:654] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:11.820410  7819 leader_election.cc:304] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
W20260709 14:50:11.822007  7893 leader_election.cc:343] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:11.822594  7893 leader_election.cc:304] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:11.824011  8161 raft_consensus.cc:2749] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:50:11.827214  7972 tablet_bootstrap.cc:492] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed: No bootstrap required, opened a new log
I20260709 14:50:11.828006  7972 ts_tablet_manager.cc:1403] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent bootstrapping tablet: real 0.071s	user 0.012s	sys 0.006s
I20260709 14:50:11.830988  8044 raft_consensus.cc:2804] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:50:11.831892  8044 raft_consensus.cc:697] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
W20260709 14:50:11.832302  7745 leader_election.cc:343] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:11.832804  8044 consensus_queue.cc:237] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:11.833348  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:50:11.830411  7675 catalog_manager.cc:5697] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 0 to 1, leader changed from <none> to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 1 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:50:11.838886  7675 catalog_manager.cc:5697] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 0 to 1, leader changed from <none> to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 1 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:50:11.843705  7974 tablet_bootstrap.cc:492] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0: No bootstrap required, opened a new log
I20260709 14:50:11.844393  7974 ts_tablet_manager.cc:1403] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0: Time spent bootstrapping tablet: real 0.034s	user 0.015s	sys 0.003s
I20260709 14:50:11.841040  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:50:11.846638  7924 raft_consensus.cc:3060] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:11.848188  7974 raft_consensus.cc:359] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:11.849023  7974 raft_consensus.cc:385] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:11.849589  7974 raft_consensus.cc:740] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Initialized, Role: FOLLOWER
I20260709 14:50:11.850373  7974 consensus_queue.cc:260] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:11.852849  7974 ts_tablet_manager.cc:1434] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 14:50:11.854274  7974 tablet_bootstrap.cc:492] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0: Bootstrap starting.
W20260709 14:50:11.848887  7893 leader_election.cc:343] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:11.855681  7893 leader_election.cc:304] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:11.856555  8161 raft_consensus.cc:2749] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:50:11.864965  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
W20260709 14:50:11.868135  7745 leader_election.cc:343] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:11.868884  7971 tablet_bootstrap.cc:492] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac: No bootstrap required, opened a new log
I20260709 14:50:11.869740  7971 ts_tablet_manager.cc:1403] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent bootstrapping tablet: real 0.440s	user 0.050s	sys 0.056s
I20260709 14:50:11.869913  7924 raft_consensus.cc:2468] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 1.
I20260709 14:50:11.872679  7972 raft_consensus.cc:359] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:11.873601  7972 raft_consensus.cc:385] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:11.873708  7971 raft_consensus.cc:359] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:11.874745  7971 raft_consensus.cc:385] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:11.875082  7971 raft_consensus.cc:740] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Initialized, Role: FOLLOWER
I20260709 14:50:11.873919  7972 raft_consensus.cc:740] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Initialized, Role: FOLLOWER
I20260709 14:50:11.875252  7744 leader_election.cc:304] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:11.876055  7971 consensus_queue.cc:260] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:11.881747  8074 raft_consensus.cc:2804] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:50:11.883006  8074 raft_consensus.cc:697] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:50:11.884140  8074 consensus_queue.cc:237] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:11.887334  7971 ts_tablet_manager.cc:1434] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 14:50:11.888496  7971 tablet_bootstrap.cc:492] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac: Bootstrap starting.
I20260709 14:50:11.890743  7972 consensus_queue.cc:260] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:11.903935  7677 catalog_manager.cc:5697] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 0 to 1, leader changed from <none> to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 1 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:50:11.907577  7972 ts_tablet_manager.cc:1434] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent starting tablet: real 0.079s	user 0.010s	sys 0.000s
I20260709 14:50:11.915453  7974 tablet_bootstrap.cc:654] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:11.917685  7971 tablet_bootstrap.cc:654] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:11.918007  7972 tablet_bootstrap.cc:492] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed: Bootstrap starting.
I20260709 14:50:11.926563  7972 tablet_bootstrap.cc:654] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:11.932439  7971 tablet_bootstrap.cc:492] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac: No bootstrap required, opened a new log
I20260709 14:50:11.933231  7971 ts_tablet_manager.cc:1403] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent bootstrapping tablet: real 0.045s	user 0.012s	sys 0.007s
I20260709 14:50:11.937744  7971 raft_consensus.cc:359] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:11.938946  7971 raft_consensus.cc:385] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:11.939440  7971 raft_consensus.cc:740] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Initialized, Role: FOLLOWER
I20260709 14:50:11.940268  7971 consensus_queue.cc:260] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:11.942791  7971 ts_tablet_manager.cc:1434] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 14:50:11.944087  7971 tablet_bootstrap.cc:492] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac: Bootstrap starting.
I20260709 14:50:11.952765  7971 tablet_bootstrap.cc:654] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:11.967648  7971 tablet_bootstrap.cc:492] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac: No bootstrap required, opened a new log
I20260709 14:50:11.968343  7971 ts_tablet_manager.cc:1403] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent bootstrapping tablet: real 0.025s	user 0.012s	sys 0.008s
I20260709 14:50:11.971366  7971 raft_consensus.cc:359] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:11.972187  7971 raft_consensus.cc:385] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:11.972451  7971 raft_consensus.cc:740] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Initialized, Role: FOLLOWER
I20260709 14:50:11.972580  8044 raft_consensus.cc:493] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:50:11.973201  7971 consensus_queue.cc:260] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:11.973320  8044 raft_consensus.cc:515] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:11.978202  7971 ts_tablet_manager.cc:1434] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 14:50:11.979286  7971 tablet_bootstrap.cc:492] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac: Bootstrap starting.
I20260709 14:50:11.980707  8044 leader_election.cc:290] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:11.990890  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:50:11.991732  7776 raft_consensus.cc:2468] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 0.
I20260709 14:50:11.997594  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:50:11.998510  7923 raft_consensus.cc:2468] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 0.
I20260709 14:50:11.999096  7971 tablet_bootstrap.cc:654] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:12.001873  8161 raft_consensus.cc:493] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:50:12.002391  8161 raft_consensus.cc:515] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:12.001758  7972 tablet_bootstrap.cc:492] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed: No bootstrap required, opened a new log
I20260709 14:50:12.003859  7972 ts_tablet_manager.cc:1403] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent bootstrapping tablet: real 0.086s	user 0.039s	sys 0.036s
I20260709 14:50:12.006148  8155 raft_consensus.cc:493] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:50:12.007671  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:50:12.007844  7972 raft_consensus.cc:359] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:12.008661  7972 raft_consensus.cc:385] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:12.009014  7972 raft_consensus.cc:740] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Initialized, Role: FOLLOWER
I20260709 14:50:12.009997  7972 consensus_queue.cc:260] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:50:12.010850  7893 leader_election.cc:343] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:12.007048  8155 raft_consensus.cc:515] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:12.005075  8161 leader_election.cc:290] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:50:12.014122  7972 ts_tablet_manager.cc:1434] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 14:50:12.015668  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:50:12.018442  7851 raft_consensus.cc:2468] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 0.
I20260709 14:50:12.018988  7972 tablet_bootstrap.cc:492] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed: Bootstrap starting.
I20260709 14:50:12.020649  7894 leader_election.cc:304] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:50:12.021857  8086 raft_consensus.cc:2804] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:50:12.022296  8086 raft_consensus.cc:493] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:50:12.022655  8086 raft_consensus.cc:3060] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Advancing to term 1
W20260709 14:50:12.025527  7725 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 14:50:12.028178  7972 tablet_bootstrap.cc:654] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:12.032120  7971 tablet_bootstrap.cc:492] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac: No bootstrap required, opened a new log
I20260709 14:50:12.009768  7819 leader_election.cc:304] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:50:12.040500  7974 tablet_bootstrap.cc:492] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0: No bootstrap required, opened a new log
I20260709 14:50:12.032644  8086 raft_consensus.cc:515] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:12.041015  7974 ts_tablet_manager.cc:1403] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent bootstrapping tablet: real 0.187s	user 0.029s	sys 0.039s
I20260709 14:50:12.033149  8074 raft_consensus.cc:493] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:50:12.042322  8074 raft_consensus.cc:515] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:12.043159  8086 leader_election.cc:290] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:50:12.044790  8074 leader_election.cc:290] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:12.047700  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:50:12.038571  7972 tablet_bootstrap.cc:492] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed: No bootstrap required, opened a new log
I20260709 14:50:12.048575  7972 ts_tablet_manager.cc:1403] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent bootstrapping tablet: real 0.030s	user 0.010s	sys 0.005s
W20260709 14:50:12.049726  7893 leader_election.cc:343] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:12.049494  7675 catalog_manager.cc:5697] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 0 to 1, leader changed from <none> to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 1 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:50:12.048062  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:50:12.050810  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:50:12.051400  7923 raft_consensus.cc:2468] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 0.
I20260709 14:50:12.052917  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:50:12.036841  8155 leader_election.cc:290] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:12.053086  7972 raft_consensus.cc:359] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:12.053890  7972 raft_consensus.cc:385] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:12.054168  7972 raft_consensus.cc:740] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Initialized, Role: FOLLOWER
I20260709 14:50:12.045433  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:50:12.054872  7972 consensus_queue.cc:260] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:12.055621  7851 raft_consensus.cc:3060] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:12.057693  7972 ts_tablet_manager.cc:1434] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 14:50:12.059424  7972 tablet_bootstrap.cc:492] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed: Bootstrap starting.
I20260709 14:50:12.059306  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:50:12.060458  7923 raft_consensus.cc:2393] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 1: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:50:12.039055  8044 raft_consensus.cc:2804] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:50:12.063162  8044 raft_consensus.cc:493] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:50:12.063675  8044 raft_consensus.cc:3060] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:12.054802  7744 leader_election.cc:304] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:50:12.066902  8074 raft_consensus.cc:2804] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:50:12.067055  7972 tablet_bootstrap.cc:654] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:12.067324  8074 raft_consensus.cc:493] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 14:50:12.067503  7745 leader_election.cc:343] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:12.067682  8074 raft_consensus.cc:3060] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:12.079265  8084 raft_consensus.cc:493] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:50:12.079882  8084 raft_consensus.cc:515] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:12.080060  8074 raft_consensus.cc:515] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:12.080361  7819 leader_election.cc:304] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:50:12.032967  7971 ts_tablet_manager.cc:1403] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent bootstrapping tablet: real 0.054s	user 0.021s	sys 0.008s
I20260709 14:50:12.082168  8084 leader_election.cc:290] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:12.082857  8155 raft_consensus.cc:3060] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:12.083125  8074 leader_election.cc:290] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:12.083312  7972 tablet_bootstrap.cc:492] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed: No bootstrap required, opened a new log
I20260709 14:50:12.083544  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:50:12.084259  7972 ts_tablet_manager.cc:1403] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent bootstrapping tablet: real 0.025s	user 0.019s	sys 0.000s
I20260709 14:50:12.084298  7924 raft_consensus.cc:2468] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 0.
I20260709 14:50:12.087016  7744 leader_election.cc:304] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:50:12.088205  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:50:12.088927  7923 raft_consensus.cc:3060] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:12.088972  7972 raft_consensus.cc:359] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:12.089913  7972 raft_consensus.cc:385] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:12.090314  7972 raft_consensus.cc:740] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Initialized, Role: FOLLOWER
I20260709 14:50:12.090994  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:50:12.091286  7972 consensus_queue.cc:260] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:12.091661  7971 raft_consensus.cc:359] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:12.092298  7971 raft_consensus.cc:385] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:12.092465  8084 raft_consensus.cc:2804] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:50:12.092617  7971 raft_consensus.cc:740] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Initialized, Role: FOLLOWER
I20260709 14:50:12.092895  8084 raft_consensus.cc:493] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:50:12.093318  8084 raft_consensus.cc:3060] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:12.093501  7971 consensus_queue.cc:260] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:12.093802  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:50:12.045934  7974 raft_consensus.cc:359] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:12.095175  7974 raft_consensus.cc:385] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:12.095513  7974 raft_consensus.cc:740] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Initialized, Role: FOLLOWER
W20260709 14:50:12.096832  7745 leader_election.cc:343] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Illegal state: must be running to vote when last-logged opid is not known
W20260709 14:50:12.098608  7745 leader_election.cc:343] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:12.102802  7851 raft_consensus.cc:2468] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 1.
I20260709 14:50:12.103816  8155 raft_consensus.cc:2749] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:50:12.102802  7923 raft_consensus.cc:2468] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 1.
I20260709 14:50:12.104616  7894 leader_election.cc:304] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:50:12.105592  8086 raft_consensus.cc:2804] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:50:12.106035  7744 leader_election.cc:304] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:12.106163  7972 ts_tablet_manager.cc:1434] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.002s
I20260709 14:50:12.106077  8086 raft_consensus.cc:697] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:50:12.106757  7974 consensus_queue.cc:260] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:12.108246  7972 tablet_bootstrap.cc:492] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed: Bootstrap starting.
I20260709 14:50:12.107820  8086 consensus_queue.cc:237] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:12.109315  7974 ts_tablet_manager.cc:1434] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent starting tablet: real 0.068s	user 0.009s	sys 0.000s
I20260709 14:50:12.110443  7974 tablet_bootstrap.cc:492] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0: Bootstrap starting.
I20260709 14:50:12.104565  8084 raft_consensus.cc:515] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:12.118790  7972 tablet_bootstrap.cc:654] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:12.118409  8044 raft_consensus.cc:515] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:12.119288  8074 raft_consensus.cc:2804] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:50:12.122144  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:50:12.122941  8074 raft_consensus.cc:697] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:50:12.123060  7776 raft_consensus.cc:3060] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:12.122306  8044 leader_election.cc:290] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 1 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:12.125931  8154 raft_consensus.cc:493] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:50:12.126492  8154 raft_consensus.cc:515] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:12.128161  7974 tablet_bootstrap.cc:654] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:12.128727  8154 leader_election.cc:290] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:12.129869  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:50:12.124526  8074 consensus_queue.cc:237] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:50:12.131847  7745 leader_election.cc:343] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:12.132764  8154 raft_consensus.cc:493] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:50:12.129966  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:50:12.133345  8154 raft_consensus.cc:515] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:12.133643  7923 raft_consensus.cc:2468] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 0.
I20260709 14:50:12.133668  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:50:12.134721  7924 raft_consensus.cc:3060] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:12.135249  7744 leader_election.cc:304] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:12.120381  7971 ts_tablet_manager.cc:1434] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent starting tablet: real 0.038s	user 0.005s	sys 0.001s
I20260709 14:50:12.137825  7971 tablet_bootstrap.cc:492] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac: Bootstrap starting.
I20260709 14:50:12.136312  8119 raft_consensus.cc:2804] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:50:12.139952  8119 raft_consensus.cc:493] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:50:12.140377  8119 raft_consensus.cc:3060] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:12.141791  7776 raft_consensus.cc:2468] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 1.
I20260709 14:50:12.147025  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:50:12.147783  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:50:12.148391  8084 leader_election.cc:290] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:12.148833  7852 raft_consensus.cc:2468] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 0.
I20260709 14:50:12.154392  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
W20260709 14:50:12.156606  7745 leader_election.cc:343] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:12.147830  7923 raft_consensus.cc:3060] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:12.159152  7745 leader_election.cc:304] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:50:12.160552  8084 raft_consensus.cc:2804] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:50:12.162842  8084 raft_consensus.cc:493] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:50:12.163461  8084 raft_consensus.cc:3060] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:12.151336  8154 leader_election.cc:290] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:12.170832  7923 raft_consensus.cc:2468] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 1.
I20260709 14:50:12.172425  7744 leader_election.cc:304] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:12.173768  8154 raft_consensus.cc:2804] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:50:12.174296  8154 raft_consensus.cc:697] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:50:12.181927  7924 raft_consensus.cc:2468] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 1.
I20260709 14:50:12.174216  8119 raft_consensus.cc:515] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:12.214015  7819 leader_election.cc:304] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:50:12.214823  8086 raft_consensus.cc:493] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:50:12.224431  8086 raft_consensus.cc:515] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:12.227701  8155 raft_consensus.cc:2804] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:50:12.227933  8086 leader_election.cc:290] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:50:12.228420  8155 raft_consensus.cc:697] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:50:12.248525  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:50:12.251176  7924 raft_consensus.cc:2468] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 0.
I20260709 14:50:12.198000  8154 consensus_queue.cc:237] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:12.272943  7675 catalog_manager.cc:5697] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 1 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:50:12.275964  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:50:12.282728  7972 tablet_bootstrap.cc:492] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed: No bootstrap required, opened a new log
I20260709 14:50:12.283267  7972 ts_tablet_manager.cc:1403] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent bootstrapping tablet: real 0.175s	user 0.031s	sys 0.021s
I20260709 14:50:12.276957  7851 raft_consensus.cc:2468] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 0.
I20260709 14:50:12.290663  7971 tablet_bootstrap.cc:654] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:12.246994  8155 consensus_queue.cc:237] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:12.302448  7972 raft_consensus.cc:359] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:12.303469  7972 raft_consensus.cc:385] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:12.303776  7972 raft_consensus.cc:740] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Initialized, Role: FOLLOWER
I20260709 14:50:12.298983  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:50:12.314580  8032 consensus_queue.cc:1048] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.028s
I20260709 14:50:12.295415  8084 raft_consensus.cc:515] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:12.344610  7776 raft_consensus.cc:2393] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 1: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:50:12.347744  7677 catalog_manager.cc:5697] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 0 to 1, leader changed from <none> to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 1 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:50:12.334932  7972 consensus_queue.cc:260] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:12.353507  7974 tablet_bootstrap.cc:492] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0: No bootstrap required, opened a new log
I20260709 14:50:12.354403  7974 ts_tablet_manager.cc:1403] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0: Time spent bootstrapping tablet: real 0.244s	user 0.032s	sys 0.043s
I20260709 14:50:12.335522  8119 leader_election.cc:290] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:12.360773  8044 raft_consensus.cc:493] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:50:12.363916  8084 leader_election.cc:290] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:12.380244  8044 raft_consensus.cc:515] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:12.389197  8044 leader_election.cc:290] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:50:12.399890  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 96269us
I20260709 14:50:12.367939  7974 raft_consensus.cc:359] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:12.402905  7974 raft_consensus.cc:385] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:12.403589  7974 raft_consensus.cc:740] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Initialized, Role: FOLLOWER
I20260709 14:50:12.407325  7894 leader_election.cc:304] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:50:12.408838  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:50:12.409839  7923 raft_consensus.cc:3060] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:12.417510  8086 raft_consensus.cc:2804] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:50:12.418043  8086 raft_consensus.cc:493] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:50:12.418440  8086 raft_consensus.cc:3060] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Advancing to term 1
W20260709 14:50:12.408401  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 125056us
I20260709 14:50:12.433634  7974 consensus_queue.cc:260] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:12.460016  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:50:12.462378  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:50:12.463306  7852 raft_consensus.cc:3060] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:12.472764  7850 raft_consensus.cc:3060] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:12.483938  7972 ts_tablet_manager.cc:1434] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent starting tablet: real 0.200s	user 0.012s	sys 0.027s
I20260709 14:50:12.485451  7972 tablet_bootstrap.cc:492] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed: Bootstrap starting.
I20260709 14:50:12.486115  7974 ts_tablet_manager.cc:1434] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0: Time spent starting tablet: real 0.131s	user 0.012s	sys 0.001s
I20260709 14:50:12.487309  7974 tablet_bootstrap.cc:492] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0: Bootstrap starting.
W20260709 14:50:12.483827  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 44573.5us
I20260709 14:50:12.483597  7852 raft_consensus.cc:2468] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 1.
I20260709 14:50:12.521603  7971 tablet_bootstrap.cc:492] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac: No bootstrap required, opened a new log
I20260709 14:50:12.522271  7971 ts_tablet_manager.cc:1403] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent bootstrapping tablet: real 0.385s	user 0.016s	sys 0.007s
I20260709 14:50:12.511509  7923 raft_consensus.cc:2468] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 1.
I20260709 14:50:12.532590  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:50:12.482851  8189 consensus_queue.cc:1048] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.038s
I20260709 14:50:12.533887  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:50:12.533891  7924 raft_consensus.cc:2393] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 1: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:50:12.546211  7971 raft_consensus.cc:359] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:12.546962  7971 raft_consensus.cc:385] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:12.547163  7971 raft_consensus.cc:740] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Initialized, Role: FOLLOWER
W20260709 14:50:12.603248  7745 leader_election.cc:343] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:12.622977  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:50:12.639249  8032 consensus_queue.cc:1048] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:50:12.620312  8086 raft_consensus.cc:515] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:12.647521  7925 raft_consensus.cc:2393] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 1: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:50:12.662909  8206 raft_consensus.cc:493] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:50:12.669886  7745 leader_election.cc:304] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:50:12.672719  8153 raft_consensus.cc:2804] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:50:12.675113  8204 raft_consensus.cc:493] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:50:12.680931  8200 consensus_queue.cc:1048] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 14:50:12.682402  8086 leader_election.cc:290] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:50:12.682698  8032 raft_consensus.cc:493] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:50:12.683627  8032 raft_consensus.cc:515] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:12.675304  8194 consensus_queue.cc:1048] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 14:50:12.687834  8192 consensus_queue.cc:1048] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 14:50:12.688160  8032 leader_election.cc:290] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:12.697366  7972 tablet_bootstrap.cc:654] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:12.698622  7744 leader_election.cc:304] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:12.702889  7974 tablet_bootstrap.cc:654] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:12.703001  8195 raft_consensus.cc:2804] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:50:12.706027  7674 catalog_manager.cc:5697] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 0 to 1, leader changed from <none> to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 1 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:50:12.709424  8195 raft_consensus.cc:697] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:50:12.710878  8195 consensus_queue.cc:237] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:12.714008  7971 consensus_queue.cc:260] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:12.717474  8204 raft_consensus.cc:515] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:12.719992  8078 raft_consensus.cc:493] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:50:12.675982  8153 raft_consensus.cc:697] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:50:12.692710  7675 catalog_manager.cc:5697] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 0 to 1, leader changed from <none> to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 1 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:50:12.676879  8206 raft_consensus.cc:515] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:12.733853  8153 consensus_queue.cc:237] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:12.727555  8078 raft_consensus.cc:515] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:12.738924  7819 leader_election.cc:304] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:50:12.740056  8044 raft_consensus.cc:2749] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:50:12.720952  8204 leader_election.cc:290] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:50:12.748829  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:50:12.749177  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:50:12.757977  7926 raft_consensus.cc:2468] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 0.
I20260709 14:50:12.827122  7971 ts_tablet_manager.cc:1434] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent starting tablet: real 0.304s	user 0.009s	sys 0.008s
W20260709 14:50:12.832729  7893 consensus_peers.cc:597] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:50:12.840700  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:50:12.841938  7853 raft_consensus.cc:2393] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 1: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:50:12.844199  8154 consensus_queue.cc:1048] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:50:12.824630  8206 leader_election.cc:290] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:50:12.866575  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:50:12.868089  7971 tablet_bootstrap.cc:492] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac: Bootstrap starting.
I20260709 14:50:12.868156  7972 tablet_bootstrap.cc:492] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed: No bootstrap required, opened a new log
I20260709 14:50:12.869765  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:50:12.870904  7972 ts_tablet_manager.cc:1403] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent bootstrapping tablet: real 0.386s	user 0.012s	sys 0.018s
W20260709 14:50:12.801082  7745 leader_election.cc:343] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Illegal state: must be running to vote when last-logged opid is not known
W20260709 14:50:12.878029  7894 leader_election.cc:343] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:12.879621  7745 leader_election.cc:304] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:12.886885  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:50:12.888751  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:50:12.889626  7776 raft_consensus.cc:2468] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 0.
I20260709 14:50:12.890650  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:50:12.885435  7972 raft_consensus.cc:359] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:12.896255  7972 raft_consensus.cc:385] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:12.898484  7972 raft_consensus.cc:740] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Initialized, Role: FOLLOWER
I20260709 14:50:12.900738  8206 consensus_queue.cc:1048] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 14:50:12.900882  8195 consensus_queue.cc:1048] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 14:50:12.900156  8153 raft_consensus.cc:2804] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:50:12.909328  8153 raft_consensus.cc:493] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:50:12.909899  8153 raft_consensus.cc:3060] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:12.918255  7974 tablet_bootstrap.cc:492] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0: No bootstrap required, opened a new log
I20260709 14:50:12.921775  7972 consensus_queue.cc:260] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:12.919085  7974 ts_tablet_manager.cc:1403] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent bootstrapping tablet: real 0.432s	user 0.015s	sys 0.012s
W20260709 14:50:12.914279  7894 leader_election.cc:343] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:12.927249  7893 leader_election.cc:304] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:12.936679  8078 leader_election.cc:290] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:12.967756  8206 raft_consensus.cc:2749] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 14:50:12.965112  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 45925.7us
I20260709 14:50:12.976121  7893 leader_election.cc:304] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:12.977615  8204 raft_consensus.cc:2804] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:50:12.978327  8204 raft_consensus.cc:493] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:50:12.978883  8204 raft_consensus.cc:3060] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Advancing to term 1
W20260709 14:50:12.900071  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 99081.3us
I20260709 14:50:12.982971  8190 consensus_queue.cc:1048] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:50:12.994251  7972 ts_tablet_manager.cc:1434] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent starting tablet: real 0.123s	user 0.009s	sys 0.003s
I20260709 14:50:13.007736  7974 raft_consensus.cc:359] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:13.011564  7974 raft_consensus.cc:385] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:13.011893  7974 raft_consensus.cc:740] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Initialized, Role: FOLLOWER
I20260709 14:50:13.019536  7974 consensus_queue.cc:260] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:50:13.010604  7893 leader_election.cc:343] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:13.024574  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:50:13.025007  7974 ts_tablet_manager.cc:1434] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent starting tablet: real 0.101s	user 0.005s	sys 0.005s
I20260709 14:50:13.025939  7923 raft_consensus.cc:2468] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 0.
I20260709 14:50:13.037772  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:50:13.038964  7776 raft_consensus.cc:2468] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 0.
I20260709 14:50:13.046054  7974 tablet_bootstrap.cc:492] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0: Bootstrap starting.
I20260709 14:50:13.031603  7893 leader_election.cc:304] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:50:13.062780  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 62084.5us
W20260709 14:50:13.063153  8216 log.cc:927] Time spent T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.115s	user 0.001s	sys 0.000s
I20260709 14:50:13.062785  8206 raft_consensus.cc:2749] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:50:13.064008  7677 catalog_manager.cc:5697] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 0 to 1, leader changed from <none> to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 1 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:50:13.066016  8189 consensus_queue.cc:1048] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:50:13.073558  8204 raft_consensus.cc:515] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:13.073840  7819 leader_election.cc:304] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:50:13.088203  7971 tablet_bootstrap.cc:654] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:13.089068  7972 tablet_bootstrap.cc:492] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed: Bootstrap starting.
I20260709 14:50:13.067842  8153 raft_consensus.cc:515] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:13.099045  8086 raft_consensus.cc:493] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:50:13.096681  8190 raft_consensus.cc:2804] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:50:13.110993  8086 raft_consensus.cc:515] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:13.109906  8190 raft_consensus.cc:493] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:50:13.114311  8190 raft_consensus.cc:3060] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:13.125779  7677 catalog_manager.cc:5697] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 0 to 1, leader changed from <none> to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 1 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:50:13.115242  8204 leader_election.cc:290] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:50:13.099308  8044 consensus_queue.cc:1048] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.033s
I20260709 14:50:13.138706  8153 leader_election.cc:290] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:50:13.112439  7745 consensus_peers.cc:597] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed -> Peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Couldn't send request to peer 3876b8ee8d744cb18e91d97aae93b1ac. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:50:13.167001  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:50:13.168390  7927 raft_consensus.cc:2393] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 1: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
W20260709 14:50:13.149555  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 46568.6us
W20260709 14:50:13.170749  7745 consensus_peers.cc:597] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed -> Peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Couldn't send request to peer 3876b8ee8d744cb18e91d97aae93b1ac. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:50:13.186342  7974 tablet_bootstrap.cc:654] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0: Neither blocks nor log segments found. Creating new log.
W20260709 14:50:13.186157  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 82029.3us
I20260709 14:50:13.192492  8086 leader_election.cc:290] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:50:13.203512  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c563cc7cfbe4d59be4ffc5cf847ce56" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:50:13.218286  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:50:13.222844  7972 tablet_bootstrap.cc:654] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:13.208501  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:50:13.226624  7777 raft_consensus.cc:2393] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 1: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:50:13.223964  8189 consensus_queue.cc:1048] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260709 14:50:13.243140  8190 raft_consensus.cc:515] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:50:13.216250  7893 leader_election.cc:343] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:13.251782  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c563cc7cfbe4d59be4ffc5cf847ce56" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:50:13.268656  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:50:13.269522  7971 tablet_bootstrap.cc:492] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac: No bootstrap required, opened a new log
I20260709 14:50:13.270481  7971 ts_tablet_manager.cc:1403] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent bootstrapping tablet: real 0.403s	user 0.007s	sys 0.020s
W20260709 14:50:13.277740  7894 leader_election.cc:343] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:13.282577  7894 leader_election.cc:304] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:13.293841  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:50:13.294705  7777 raft_consensus.cc:3060] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:13.294162  8086 raft_consensus.cc:2749] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:50:13.291987  8190 leader_election.cc:290] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 1 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:50:13.323062  7894 leader_election.cc:343] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:13.337779  7971 raft_consensus.cc:359] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:13.338603  7971 raft_consensus.cc:385] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:13.338912  7971 raft_consensus.cc:740] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Initialized, Role: FOLLOWER
I20260709 14:50:13.339843  7971 consensus_queue.cc:260] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:13.340442  7974 tablet_bootstrap.cc:492] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0: No bootstrap required, opened a new log
I20260709 14:50:13.341035  7974 ts_tablet_manager.cc:1403] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent bootstrapping tablet: real 0.295s	user 0.017s	sys 0.017s
I20260709 14:50:13.343276  7971 ts_tablet_manager.cc:1434] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent starting tablet: real 0.072s	user 0.000s	sys 0.007s
I20260709 14:50:13.344663  7971 tablet_bootstrap.cc:492] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac: Bootstrap starting.
W20260709 14:50:13.345489  7745 leader_election.cc:343] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:13.346261  7745 leader_election.cc:304] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:13.347528  8153 raft_consensus.cc:2749] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 14:50:13.331193  7893 leader_election.cc:304] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:13.351791  8159 raft_consensus.cc:2749] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 14:50:13.344785  7974 raft_consensus.cc:359] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:13.354138  7974 raft_consensus.cc:385] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:13.354503  7974 raft_consensus.cc:740] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Initialized, Role: FOLLOWER
I20260709 14:50:13.360641  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:50:13.361410  7923 raft_consensus.cc:3060] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:13.368949  7974 consensus_queue.cc:260] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:13.397034  8199 consensus_queue.cc:1048] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:50:13.397765  7974 ts_tablet_manager.cc:1434] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent starting tablet: real 0.056s	user 0.007s	sys 0.000s
I20260709 14:50:13.402794  8189 consensus_queue.cc:1048] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 14:50:13.403195  7725 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 14:50:13.364804  7777 raft_consensus.cc:2468] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 1.
I20260709 14:50:13.406064  7974 tablet_bootstrap.cc:492] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0: Bootstrap starting.
I20260709 14:50:13.414129  7819 leader_election.cc:304] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:50:13.417778  8191 raft_consensus.cc:2804] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:50:13.420459  8191 raft_consensus.cc:697] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:50:13.421902  8191 consensus_queue.cc:237] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:13.426517  7972 tablet_bootstrap.cc:492] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed: No bootstrap required, opened a new log
I20260709 14:50:13.426676  7852 raft_consensus.cc:3060] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:13.427260  7972 ts_tablet_manager.cc:1403] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent bootstrapping tablet: real 0.339s	user 0.017s	sys 0.034s
I20260709 14:50:13.438484  8195 consensus_queue.cc:1048] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:50:13.411490  7923 raft_consensus.cc:2468] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 1.
I20260709 14:50:13.446259  7972 raft_consensus.cc:359] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:13.448534  7972 raft_consensus.cc:385] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:13.448884  7972 raft_consensus.cc:740] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Initialized, Role: FOLLOWER
W20260709 14:50:13.452828  7745 consensus_peers.cc:597] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed -> Peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Couldn't send request to peer 3876b8ee8d744cb18e91d97aae93b1ac. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:50:13.465644  7972 consensus_queue.cc:260] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:13.473345  7971 tablet_bootstrap.cc:654] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:13.484227  7974 tablet_bootstrap.cc:654] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:13.518291  7972 ts_tablet_manager.cc:1434] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent starting tablet: real 0.090s	user 0.008s	sys 0.000s
I20260709 14:50:13.520011  7972 tablet_bootstrap.cc:492] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed: Bootstrap starting.
I20260709 14:50:13.575246  7675 catalog_manager.cc:5697] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 0 to 1, leader changed from <none> to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 1 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:50:13.584759  7974 tablet_bootstrap.cc:492] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0: No bootstrap required, opened a new log
I20260709 14:50:13.585597  7974 ts_tablet_manager.cc:1403] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0: Time spent bootstrapping tablet: real 0.180s	user 0.018s	sys 0.016s
I20260709 14:50:13.589609  7974 raft_consensus.cc:359] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:13.590458  7974 raft_consensus.cc:385] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:13.590737  7974 raft_consensus.cc:740] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Initialized, Role: FOLLOWER
I20260709 14:50:13.591646  7974 consensus_queue.cc:260] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:13.594832  8189 raft_consensus.cc:493] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:50:13.597112  7971 tablet_bootstrap.cc:492] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac: No bootstrap required, opened a new log
I20260709 14:50:13.597920  7971 ts_tablet_manager.cc:1403] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent bootstrapping tablet: real 0.254s	user 0.042s	sys 0.011s
I20260709 14:50:13.599143  7972 tablet_bootstrap.cc:654] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:13.595476  8189 raft_consensus.cc:515] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:13.599907  7974 ts_tablet_manager.cc:1434] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0: Time spent starting tablet: real 0.014s	user 0.009s	sys 0.000s
I20260709 14:50:13.610620  7974 tablet_bootstrap.cc:492] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0: Bootstrap starting.
I20260709 14:50:13.618757  8189 leader_election.cc:290] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:13.623636  7971 raft_consensus.cc:359] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:13.625176  7971 raft_consensus.cc:385] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:13.625836  7971 raft_consensus.cc:740] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Initialized, Role: FOLLOWER
I20260709 14:50:13.626708  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:50:13.626905  7971 consensus_queue.cc:260] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:50:13.630551  7744 leader_election.cc:343] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:13.635682  7971 ts_tablet_manager.cc:1434] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent starting tablet: real 0.037s	user 0.006s	sys 0.005s
I20260709 14:50:13.630535  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:50:13.644658  7745 leader_election.cc:343] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:13.645200  7745 leader_election.cc:304] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:13.646346  8153 raft_consensus.cc:2749] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:50:13.649852  7974 tablet_bootstrap.cc:654] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:13.650897  7971 tablet_bootstrap.cc:492] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac: Bootstrap starting.
I20260709 14:50:13.655920  7972 tablet_bootstrap.cc:492] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed: No bootstrap required, opened a new log
I20260709 14:50:13.656947  7972 ts_tablet_manager.cc:1403] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent bootstrapping tablet: real 0.137s	user 0.020s	sys 0.011s
I20260709 14:50:13.675082  7972 raft_consensus.cc:359] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:13.684130  7972 raft_consensus.cc:385] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:13.684640  7972 raft_consensus.cc:740] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Initialized, Role: FOLLOWER
I20260709 14:50:13.683640  7971 tablet_bootstrap.cc:654] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:13.687122  7972 consensus_queue.cc:260] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:13.691386  7972 ts_tablet_manager.cc:1434] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.000s
I20260709 14:50:13.693696  7972 tablet_bootstrap.cc:492] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed: Bootstrap starting.
I20260709 14:50:13.703476  7972 tablet_bootstrap.cc:654] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:13.705045  7974 tablet_bootstrap.cc:492] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0: No bootstrap required, opened a new log
I20260709 14:50:13.705603  7974 ts_tablet_manager.cc:1403] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0: Time spent bootstrapping tablet: real 0.095s	user 0.017s	sys 0.008s
I20260709 14:50:13.709031  7974 raft_consensus.cc:359] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:13.711205  7974 raft_consensus.cc:385] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:13.711539  7974 raft_consensus.cc:740] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Initialized, Role: FOLLOWER
I20260709 14:50:13.712272  7974 consensus_queue.cc:260] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:13.714399  7974 ts_tablet_manager.cc:1434] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 14:50:13.725471  7974 tablet_bootstrap.cc:492] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0: Bootstrap starting.
I20260709 14:50:13.733187  7972 tablet_bootstrap.cc:492] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed: No bootstrap required, opened a new log
I20260709 14:50:13.733776  7972 ts_tablet_manager.cc:1403] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent bootstrapping tablet: real 0.040s	user 0.008s	sys 0.013s
I20260709 14:50:13.734092  7971 tablet_bootstrap.cc:492] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac: No bootstrap required, opened a new log
I20260709 14:50:13.734629  7971 ts_tablet_manager.cc:1403] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent bootstrapping tablet: real 0.084s	user 0.014s	sys 0.004s
I20260709 14:50:13.736827  7972 raft_consensus.cc:359] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:13.737706  7972 raft_consensus.cc:385] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:13.738013  7972 raft_consensus.cc:740] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Initialized, Role: FOLLOWER
I20260709 14:50:13.738822  7972 consensus_queue.cc:260] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:13.741454  7972 ts_tablet_manager.cc:1434] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.005s
I20260709 14:50:13.744472  7974 tablet_bootstrap.cc:654] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:13.744513  7971 raft_consensus.cc:359] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:13.745457  7971 raft_consensus.cc:385] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:13.745822  7971 raft_consensus.cc:740] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Initialized, Role: FOLLOWER
I20260709 14:50:13.747926  7972 tablet_bootstrap.cc:492] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed: Bootstrap starting.
I20260709 14:50:13.746556  7971 consensus_queue.cc:260] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:13.755743  7972 tablet_bootstrap.cc:654] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:13.758280  7971 ts_tablet_manager.cc:1434] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.001s
I20260709 14:50:13.759821  7971 tablet_bootstrap.cc:492] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac: Bootstrap starting.
I20260709 14:50:13.765215  8205 raft_consensus.cc:493] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:50:13.765893  8205 raft_consensus.cc:515] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:13.768891  8205 leader_election.cc:290] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:50:13.769706  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783e4874513449ef9084b833f188a6d3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:50:13.773334  7974 tablet_bootstrap.cc:492] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0: No bootstrap required, opened a new log
I20260709 14:50:13.773985  7974 ts_tablet_manager.cc:1403] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent bootstrapping tablet: real 0.056s	user 0.010s	sys 0.006s
I20260709 14:50:13.774453  7972 tablet_bootstrap.cc:492] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed: No bootstrap required, opened a new log
I20260709 14:50:13.775252  7972 ts_tablet_manager.cc:1403] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent bootstrapping tablet: real 0.028s	user 0.013s	sys 0.001s
W20260709 14:50:13.777072  7893 leader_election.cc:343] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:13.777431  7974 raft_consensus.cc:359] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:13.778416  7974 raft_consensus.cc:385] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:13.778839  7974 raft_consensus.cc:740] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Initialized, Role: FOLLOWER
I20260709 14:50:13.779578  7974 consensus_queue.cc:260] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:13.780645  7972 raft_consensus.cc:359] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:13.781842  7972 raft_consensus.cc:385] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:13.782169  7972 raft_consensus.cc:740] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Initialized, Role: FOLLOWER
I20260709 14:50:13.782922  7972 consensus_queue.cc:260] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:13.785148  7972 ts_tablet_manager.cc:1434] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.002s
I20260709 14:50:13.782816  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783e4874513449ef9084b833f188a6d3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:50:13.790529  7852 raft_consensus.cc:2468] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 0.
I20260709 14:50:13.792173  7894 leader_election.cc:304] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:50:13.793490  8205 raft_consensus.cc:2804] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:50:13.793884  8205 raft_consensus.cc:493] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:50:13.794236  8205 raft_consensus.cc:3060] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:13.794965  7974 ts_tablet_manager.cc:1434] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.001s
I20260709 14:50:13.798012  8191 raft_consensus.cc:493] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:50:13.798974  8191 raft_consensus.cc:515] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:13.802488  7974 tablet_bootstrap.cc:492] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0: Bootstrap starting.
I20260709 14:50:13.803828  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:50:13.806847  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:50:13.804936  8191 leader_election.cc:290] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:13.809516  7819 leader_election.cc:304] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:50:13.811221  7974 tablet_bootstrap.cc:654] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:13.812295  8189 raft_consensus.cc:493] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:50:13.812911  8189 raft_consensus.cc:515] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:13.815416  8189 leader_election.cc:290] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:13.825469  7972 tablet_bootstrap.cc:492] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed: Bootstrap starting.
I20260709 14:50:13.830456  8159 raft_consensus.cc:493] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:50:13.831221  8159 raft_consensus.cc:515] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:13.834067  8159 leader_election.cc:290] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:50:13.834802  7972 tablet_bootstrap.cc:654] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:13.839910  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:50:13.839933  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:50:13.839881  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:50:13.841714  7974 tablet_bootstrap.cc:492] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0: No bootstrap required, opened a new log
I20260709 14:50:13.842386  7974 ts_tablet_manager.cc:1403] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent bootstrapping tablet: real 0.040s	user 0.015s	sys 0.021s
W20260709 14:50:13.843395  7745 leader_election.cc:343] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Illegal state: must be running to vote when last-logged opid is not known
W20260709 14:50:13.842594  7893 leader_election.cc:343] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Illegal state: must be running to vote when last-logged opid is not known
W20260709 14:50:13.846131  7894 leader_election.cc:343] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:13.846652  7894 leader_election.cc:304] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:13.846807  7974 raft_consensus.cc:359] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:13.847664  7974 raft_consensus.cc:385] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:13.848106  7974 raft_consensus.cc:740] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Initialized, Role: FOLLOWER
I20260709 14:50:13.848944  8159 raft_consensus.cc:2749] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:50:13.850980  8192 consensus_queue.cc:1048] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:50:13.850198  7974 consensus_queue.cc:260] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:13.851701  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:50:13.852061  7972 tablet_bootstrap.cc:492] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed: No bootstrap required, opened a new log
I20260709 14:50:13.852595  7972 ts_tablet_manager.cc:1403] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent bootstrapping tablet: real 0.027s	user 0.008s	sys 0.003s
I20260709 14:50:13.853523  7974 ts_tablet_manager.cc:1434] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent starting tablet: real 0.011s	user 0.010s	sys 0.000s
I20260709 14:50:13.822455  8191 raft_consensus.cc:2749] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:50:13.855147  7972 raft_consensus.cc:359] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:13.856328  7972 raft_consensus.cc:385] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:13.856731  7972 raft_consensus.cc:740] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Initialized, Role: FOLLOWER
I20260709 14:50:13.857122  7974 tablet_bootstrap.cc:492] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0: Bootstrap starting.
I20260709 14:50:13.857481  7972 consensus_queue.cc:260] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:13.864200  7972 ts_tablet_manager.cc:1434] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.002s
I20260709 14:50:13.881296  7974 tablet_bootstrap.cc:654] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:13.877024  7972 tablet_bootstrap.cc:492] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed: Bootstrap starting.
I20260709 14:50:13.886353  7923 raft_consensus.cc:2468] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 0.
I20260709 14:50:13.872041  8205 raft_consensus.cc:515] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:13.889204  7744 leader_election.cc:304] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:13.890417  8205 leader_election.cc:290] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:50:13.891127  8189 raft_consensus.cc:2804] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:50:13.891566  8189 raft_consensus.cc:493] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:50:13.891912  8189 raft_consensus.cc:3060] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:13.895644  7971 tablet_bootstrap.cc:654] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:13.897805  7972 tablet_bootstrap.cc:654] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:13.901568  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783e4874513449ef9084b833f188a6d3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:50:13.902633  7778 raft_consensus.cc:3060] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:13.903550  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783e4874513449ef9084b833f188a6d3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:50:13.904405  7848 raft_consensus.cc:3060] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:13.919409  7848 raft_consensus.cc:2468] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 1.
I20260709 14:50:13.920200  7778 raft_consensus.cc:2468] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 1.
I20260709 14:50:13.920819  8205 raft_consensus.cc:493] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:50:13.921571  7974 tablet_bootstrap.cc:492] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0: No bootstrap required, opened a new log
I20260709 14:50:13.921387  8205 raft_consensus.cc:515] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:13.922361  7974 ts_tablet_manager.cc:1403] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0: Time spent bootstrapping tablet: real 0.066s	user 0.031s	sys 0.000s
I20260709 14:50:13.923759  8205 leader_election.cc:290] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:50:13.924207  7893 leader_election.cc:304] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:50:13.924728  7971 tablet_bootstrap.cc:492] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac: No bootstrap required, opened a new log
I20260709 14:50:13.925072  8205 raft_consensus.cc:2804] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:50:13.925411  7971 ts_tablet_manager.cc:1403] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent bootstrapping tablet: real 0.166s	user 0.011s	sys 0.008s
I20260709 14:50:13.925777  8205 raft_consensus.cc:697] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:50:13.926872  8205 consensus_queue.cc:237] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:13.929008  7972 tablet_bootstrap.cc:492] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed: No bootstrap required, opened a new log
I20260709 14:50:13.929575  7972 ts_tablet_manager.cc:1403] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent bootstrapping tablet: real 0.053s	user 0.009s	sys 0.007s
I20260709 14:50:13.929929  7974 raft_consensus.cc:359] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:13.930922  7974 raft_consensus.cc:385] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:13.930953  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:50:13.931322  7974 raft_consensus.cc:740] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Initialized, Role: FOLLOWER
I20260709 14:50:13.932320  7974 consensus_queue.cc:260] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:13.932896  7971 raft_consensus.cc:359] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:13.933799  7971 raft_consensus.cc:385] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:13.933714  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:50:13.934217  7971 raft_consensus.cc:740] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Initialized, Role: FOLLOWER
I20260709 14:50:13.935858  7974 ts_tablet_manager.cc:1434] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.003s
W20260709 14:50:13.936725  7893 leader_election.cc:343] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:13.935159  7971 consensus_queue.cc:260] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:13.937973  8159 raft_consensus.cc:493] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:50:13.938895  8159 raft_consensus.cc:515] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:13.939606  7971 ts_tablet_manager.cc:1434] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.001s
I20260709 14:50:13.941609  8159 leader_election.cc:290] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:50:13.942629  7974 tablet_bootstrap.cc:492] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0: Bootstrap starting.
I20260709 14:50:13.942844  8190 consensus_queue.cc:1048] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:50:13.944094  7971 tablet_bootstrap.cc:492] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac: Bootstrap starting.
I20260709 14:50:13.953362  7971 tablet_bootstrap.cc:654] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:13.962838  7974 tablet_bootstrap.cc:654] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:13.963738  7972 raft_consensus.cc:359] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:13.976953  7971 tablet_bootstrap.cc:492] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac: No bootstrap required, opened a new log
I20260709 14:50:13.978111  7971 ts_tablet_manager.cc:1403] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent bootstrapping tablet: real 0.034s	user 0.017s	sys 0.004s
I20260709 14:50:13.983261  7971 raft_consensus.cc:359] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:13.984228  7972 raft_consensus.cc:385] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:13.984211  7852 raft_consensus.cc:3060] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:13.984865  7972 raft_consensus.cc:740] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Initialized, Role: FOLLOWER
I20260709 14:50:13.986168  7972 consensus_queue.cc:260] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:13.988590  7972 ts_tablet_manager.cc:1434] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent starting tablet: real 0.059s	user 0.005s	sys 0.002s
I20260709 14:50:13.990494  7972 tablet_bootstrap.cc:492] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed: Bootstrap starting.
W20260709 14:50:13.938439  7894 leader_election.cc:343] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:13.990170  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:50:13.996260  7778 raft_consensus.cc:2468] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 0.
I20260709 14:50:13.993587  8159 raft_consensus.cc:493] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:50:14.000079  8159 raft_consensus.cc:515] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:14.002622  8159 leader_election.cc:290] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:50:13.989084  7971 raft_consensus.cc:385] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:13.994678  8195 raft_consensus.cc:493] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:50:14.008459  7971 raft_consensus.cc:740] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Initialized, Role: FOLLOWER
I20260709 14:50:14.008611  8195 raft_consensus.cc:515] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:14.009107  7894 leader_election.cc:304] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:14.011086  7971 consensus_queue.cc:260] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:14.016908  8261 raft_consensus.cc:2749] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:50:14.018271  7971 ts_tablet_manager.cc:1434] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent starting tablet: real 0.040s	user 0.011s	sys 0.000s
I20260709 14:50:14.019646  7971 tablet_bootstrap.cc:492] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac: Bootstrap starting.
I20260709 14:50:14.023993  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:50:14.012120  8195 leader_election.cc:290] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:14.008343  7972 tablet_bootstrap.cc:654] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:14.012800  8191 raft_consensus.cc:493] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:50:14.026037  8191 raft_consensus.cc:515] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:14.029191  8191 leader_election.cc:290] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:50:14.017115  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 78719us
I20260709 14:50:14.030464  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:50:14.027269  7893 leader_election.cc:304] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:50:14.015277  8189 raft_consensus.cc:515] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:14.024878  7927 raft_consensus.cc:2468] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 0.
I20260709 14:50:14.032584  8159 raft_consensus.cc:2804] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:50:14.037956  8159 raft_consensus.cc:493] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:50:14.038446  8159 raft_consensus.cc:3060] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:14.038761  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:50:14.040539  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:50:14.049228  7853 raft_consensus.cc:3060] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:14.058166  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:50:14.063055  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
W20260709 14:50:14.064117  7745 leader_election.cc:343] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:14.087973  7674 catalog_manager.cc:5697] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 1 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:50:14.091183  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:50:14.097292  7974 tablet_bootstrap.cc:492] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0: No bootstrap required, opened a new log
I20260709 14:50:14.098129  7974 ts_tablet_manager.cc:1403] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent bootstrapping tablet: real 0.156s	user 0.038s	sys 0.034s
I20260709 14:50:14.101589  8189 leader_election.cc:290] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:50:14.104809  7745 leader_election.cc:343] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:14.106520  7971 tablet_bootstrap.cc:654] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac: Neither blocks nor log segments found. Creating new log.
W20260709 14:50:14.119084  7893 leader_election.cc:343] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:14.112962  8205 raft_consensus.cc:493] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:50:14.121454  7974 raft_consensus.cc:359] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:14.123063  7974 raft_consensus.cc:385] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:14.123414  7974 raft_consensus.cc:740] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Initialized, Role: FOLLOWER
I20260709 14:50:14.129587  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:50:14.130306  7926 raft_consensus.cc:3060] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:14.134052  7974 consensus_queue.cc:260] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:14.132539  7744 leader_election.cc:304] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:14.150315  7974 ts_tablet_manager.cc:1434] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent starting tablet: real 0.052s	user 0.006s	sys 0.004s
I20260709 14:50:14.150401  8159 raft_consensus.cc:515] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:14.152364  7778 raft_consensus.cc:3060] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:14.154405  8195 raft_consensus.cc:2804] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:50:14.128600  8205 raft_consensus.cc:515] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:14.157034  7972 tablet_bootstrap.cc:492] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed: No bootstrap required, opened a new log
I20260709 14:50:14.158100  7972 ts_tablet_manager.cc:1403] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent bootstrapping tablet: real 0.168s	user 0.016s	sys 0.008s
I20260709 14:50:14.159044  8205 leader_election.cc:290] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:50:14.167392  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:50:14.171236  8159 leader_election.cc:290] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:50:14.172174  7972 raft_consensus.cc:359] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:14.173107  7972 raft_consensus.cc:385] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:14.174988  7972 raft_consensus.cc:740] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Initialized, Role: FOLLOWER
I20260709 14:50:14.176841  7974 tablet_bootstrap.cc:492] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0: Bootstrap starting.
W20260709 14:50:14.176932  7894 leader_election.cc:343] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Illegal state: must be running to vote when last-logged opid is not known
W20260709 14:50:14.178514  7894 leader_election.cc:343] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:14.179024  7894 leader_election.cc:304] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:14.179697  7926 raft_consensus.cc:2468] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 1.
I20260709 14:50:14.181391  7972 consensus_queue.cc:260] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:14.183574  7972 ts_tablet_manager.cc:1434] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 14:50:14.183987  8266 raft_consensus.cc:2749] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:50:14.185034  7972 tablet_bootstrap.cc:492] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed: Bootstrap starting.
I20260709 14:50:14.154932  8195 raft_consensus.cc:493] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:50:14.191450  8153 raft_consensus.cc:493] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:50:14.192103  8153 raft_consensus.cc:515] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:14.195555  8153 leader_election.cc:290] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:14.197585  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:50:14.199690  7745 leader_election.cc:343] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:14.212734  7974 tablet_bootstrap.cc:654] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:14.216306  7744 leader_election.cc:304] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:14.200712  8195 raft_consensus.cc:3060] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:14.221930  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:50:14.223871  8189 raft_consensus.cc:2804] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:50:14.237633  7777 raft_consensus.cc:3060] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:14.249778  7971 tablet_bootstrap.cc:492] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac: No bootstrap required, opened a new log
I20260709 14:50:14.250449  7971 ts_tablet_manager.cc:1403] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent bootstrapping tablet: real 0.231s	user 0.024s	sys 0.009s
I20260709 14:50:14.237941  8189 raft_consensus.cc:697] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:50:14.254505  7819 leader_election.cc:304] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:50:14.254922  8190 raft_consensus.cc:493] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:50:14.255455  8190 raft_consensus.cc:515] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:14.272010  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:50:14.274817  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:50:14.278388  7972 tablet_bootstrap.cc:654] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:14.276930  7971 raft_consensus.cc:359] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:14.280349  7971 raft_consensus.cc:385] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:14.280652  7971 raft_consensus.cc:740] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Initialized, Role: FOLLOWER
I20260709 14:50:14.282390  7971 consensus_queue.cc:260] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:50:14.287843  7744 leader_election.cc:343] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:14.292907  7744 leader_election.cc:304] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:14.307150  7971 ts_tablet_manager.cc:1434] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent starting tablet: real 0.056s	user 0.007s	sys 0.002s
I20260709 14:50:14.284108  8189 consensus_queue.cc:237] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:50:14.313630  7894 leader_election.cc:343] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:14.316231  8195 raft_consensus.cc:515] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:14.283695  8190 leader_election.cc:290] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:14.320376  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:50:14.320731  8266 raft_consensus.cc:493] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:50:14.306393  8199 raft_consensus.cc:2749] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 14:50:14.327827  7893 leader_election.cc:343] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:14.328790  7893 leader_election.cc:304] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:14.330050  8263 raft_consensus.cc:2749] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:50:14.325556  8266 raft_consensus.cc:515] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:14.344786  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:50:14.346223  8266 leader_election.cc:290] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:50:14.347084  8195 leader_election.cc:290] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:14.348517  7971 tablet_bootstrap.cc:492] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac: Bootstrap starting.
W20260709 14:50:14.351104  7894 leader_election.cc:343] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:14.352187  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:50:14.353763  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 89779.8us
I20260709 14:50:14.370323  8195 raft_consensus.cc:493] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:50:14.369817  7777 raft_consensus.cc:2468] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 1.
W20260709 14:50:14.382371  7894 leader_election.cc:343] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:14.394325  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:50:14.412344  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:50:14.413194  7927 raft_consensus.cc:3060] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:14.414031  8192 raft_consensus.cc:2749] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:50:14.421944  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:50:14.426522  7927 raft_consensus.cc:2468] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 1.
I20260709 14:50:14.434702  7974 tablet_bootstrap.cc:492] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0: No bootstrap required, opened a new log
I20260709 14:50:14.435370  7974 ts_tablet_manager.cc:1403] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent bootstrapping tablet: real 0.261s	user 0.017s	sys 0.018s
I20260709 14:50:14.435988  7744 leader_election.cc:304] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:50:14.436547  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:50:14.438323  7893 leader_election.cc:304] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:50:14.443729  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 81648us
I20260709 14:50:14.397944  8195 raft_consensus.cc:515] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:14.433771  7922 raft_consensus.cc:2468] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 0.
I20260709 14:50:14.442729  8153 raft_consensus.cc:2804] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:50:14.449838  8266 raft_consensus.cc:2804] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:50:14.499202  7972 tablet_bootstrap.cc:492] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed: No bootstrap required, opened a new log
I20260709 14:50:14.472347  8266 raft_consensus.cc:697] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:50:14.499760  7972 ts_tablet_manager.cc:1403] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent bootstrapping tablet: real 0.315s	user 0.026s	sys 0.028s
I20260709 14:50:14.473757  8153 raft_consensus.cc:697] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
W20260709 14:50:14.500648  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 56155.8us
I20260709 14:50:14.514878  8032 raft_consensus.cc:493] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:50:14.538892  8032 raft_consensus.cc:515] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:14.540863  7972 raft_consensus.cc:359] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:14.541824  7972 raft_consensus.cc:385] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:14.542161  7972 raft_consensus.cc:740] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Initialized, Role: FOLLOWER
W20260709 14:50:14.542527  8280 log.cc:927] Time spent T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
I20260709 14:50:14.542949  8266 consensus_queue.cc:237] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:50:14.545529  8281 log.cc:927] Time spent T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
W20260709 14:50:14.548394  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 43480.9us
I20260709 14:50:14.549511  7819 leader_election.cc:304] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:50:14.511050  8153 consensus_queue.cc:237] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:14.556010  8276 raft_consensus.cc:2804] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:50:14.556535  8276 raft_consensus.cc:493] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 14:50:14.556699  7819 leader_election.cc:343] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:14.556883  8276 raft_consensus.cc:3060] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:14.589035  8032 leader_election.cc:290] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:14.595870  7974 raft_consensus.cc:359] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:14.597079  7974 raft_consensus.cc:385] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:14.597508  7974 raft_consensus.cc:740] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Initialized, Role: FOLLOWER
I20260709 14:50:14.598315  7974 consensus_queue.cc:260] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:14.599092  8195 leader_election.cc:290] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:14.603035  8263 consensus_queue.cc:1048] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 14:50:14.593235  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:50:14.604584  7971 tablet_bootstrap.cc:654] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:14.613106  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c563cc7cfbe4d59be4ffc5cf847ce56" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:50:14.614828  7854 raft_consensus.cc:2468] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 0.
I20260709 14:50:14.587845  8276 raft_consensus.cc:515] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:14.623845  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c563cc7cfbe4d59be4ffc5cf847ce56" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
W20260709 14:50:14.624362  7893 leader_election.cc:343] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:14.624646  7923 raft_consensus.cc:2468] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 0.
I20260709 14:50:14.625172  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:50:14.626935  8276 leader_election.cc:290] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 1 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:14.628435  7972 consensus_queue.cc:260] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:14.634181  7972 ts_tablet_manager.cc:1434] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent starting tablet: real 0.134s	user 0.009s	sys 0.000s
I20260709 14:50:14.634824  7893 leader_election.cc:304] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:14.637681  7972 tablet_bootstrap.cc:492] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed: Bootstrap starting.
I20260709 14:50:14.638298  8263 raft_consensus.cc:2749] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:50:14.642313  7744 leader_election.cc:304] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:50:14.647168  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:50:14.660000  8159 consensus_queue.cc:1048] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 14:50:14.653065  7745 leader_election.cc:343] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:14.655869  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:50:14.666754  7923 raft_consensus.cc:3060] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:14.664292  8289 raft_consensus.cc:2804] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:50:14.667443  8289 raft_consensus.cc:493] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:50:14.669426  8289 raft_consensus.cc:3060] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:14.677003  7971 tablet_bootstrap.cc:492] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac: No bootstrap required, opened a new log
I20260709 14:50:14.678081  7971 ts_tablet_manager.cc:1403] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent bootstrapping tablet: real 0.331s	user 0.014s	sys 0.008s
I20260709 14:50:14.630115  7974 ts_tablet_manager.cc:1434] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent starting tablet: real 0.194s	user 0.008s	sys 0.002s
I20260709 14:50:14.689018  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:50:14.689730  7974 tablet_bootstrap.cc:492] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0: Bootstrap starting.
I20260709 14:50:14.689905  7778 raft_consensus.cc:3060] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:14.699533  8289 raft_consensus.cc:515] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:14.707405  7778 raft_consensus.cc:2468] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 1.
I20260709 14:50:14.708323  7971 raft_consensus.cc:359] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:14.721499  7971 raft_consensus.cc:385] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:14.720896  7675 catalog_manager.cc:5697] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 0 to 1, leader changed from <none> to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 1 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:50:14.712085  7674 catalog_manager.cc:5697] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 1 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:50:14.721910  7971 raft_consensus.cc:740] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Initialized, Role: FOLLOWER
I20260709 14:50:14.725905  7971 consensus_queue.cc:260] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:14.728075  7971 ts_tablet_manager.cc:1434] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent starting tablet: real 0.050s	user 0.005s	sys 0.003s
I20260709 14:50:14.729122  7923 raft_consensus.cc:2468] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 1.
I20260709 14:50:14.730309  7971 tablet_bootstrap.cc:492] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac: Bootstrap starting.
I20260709 14:50:14.748310  7972 tablet_bootstrap.cc:654] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:14.748570  7819 leader_election.cc:304] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:50:14.757802  8291 raft_consensus.cc:493] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:50:14.758490  8291 raft_consensus.cc:515] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:14.762557  8276 raft_consensus.cc:2804] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:50:14.763199  8276 raft_consensus.cc:697] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:50:14.767154  8266 raft_consensus.cc:493] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:50:14.768525  8266 raft_consensus.cc:515] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:14.772174  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:50:14.773100  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:50:14.773105  7778 raft_consensus.cc:2468] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 0.
W20260709 14:50:14.775071  7894 leader_election.cc:343] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:14.777907  7745 leader_election.cc:304] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:14.774377  8266 leader_election.cc:290] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:50:14.780162  8292 raft_consensus.cc:2749] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 14:50:14.782860  8291 leader_election.cc:290] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:14.783351  8276 consensus_queue.cc:237] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:14.788949  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:50:14.789062  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:50:14.789858  7924 raft_consensus.cc:2393] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 1: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:50:14.793198  7974 tablet_bootstrap.cc:654] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:14.776494  7893 leader_election.cc:304] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:14.794114  8266 raft_consensus.cc:2804] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:50:14.804705  8266 raft_consensus.cc:493] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:50:14.805233  8266 raft_consensus.cc:3060] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:14.811626  7971 tablet_bootstrap.cc:654] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:14.807909  7819 leader_election.cc:304] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:50:14.822381  8291 raft_consensus.cc:3060] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:14.822460  8289 leader_election.cc:290] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:14.828231  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c563cc7cfbe4d59be4ffc5cf847ce56" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:50:14.829005  7924 raft_consensus.cc:3060] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:14.830999  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c563cc7cfbe4d59be4ffc5cf847ce56" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:50:14.831679  7848 raft_consensus.cc:3060] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:14.843804  7848 raft_consensus.cc:2468] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 1.
I20260709 14:50:14.843991  7924 raft_consensus.cc:2468] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 1.
I20260709 14:50:14.845376  7745 leader_election.cc:304] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:50:14.849475  8289 raft_consensus.cc:2804] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:50:14.850052  8289 raft_consensus.cc:697] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:50:14.850888  8289 consensus_queue.cc:237] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:14.851861  7674 catalog_manager.cc:5697] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 0 to 1, leader changed from <none> to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 1 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:50:14.858083  7972 tablet_bootstrap.cc:492] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed: No bootstrap required, opened a new log
I20260709 14:50:14.858598  7972 ts_tablet_manager.cc:1403] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent bootstrapping tablet: real 0.221s	user 0.020s	sys 0.029s
I20260709 14:50:14.856532  8266 raft_consensus.cc:515] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:14.863124  8266 leader_election.cc:290] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:50:14.870272  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:50:14.871130  7774 raft_consensus.cc:3060] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:14.879653  7972 raft_consensus.cc:359] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:14.880806  7972 raft_consensus.cc:385] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:14.881145  7972 raft_consensus.cc:740] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Initialized, Role: FOLLOWER
I20260709 14:50:14.882397  7972 consensus_queue.cc:260] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:14.879995  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
W20260709 14:50:14.887959  7894 leader_election.cc:343] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:14.888321  7972 ts_tablet_manager.cc:1434] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent starting tablet: real 0.029s	user 0.004s	sys 0.005s
I20260709 14:50:14.889576  7972 tablet_bootstrap.cc:492] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed: Bootstrap starting.
I20260709 14:50:14.888970  8291 raft_consensus.cc:2749] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:50:14.891826  7974 tablet_bootstrap.cc:492] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0: No bootstrap required, opened a new log
I20260709 14:50:14.896021  7974 ts_tablet_manager.cc:1403] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent bootstrapping tablet: real 0.207s	user 0.024s	sys 0.013s
I20260709 14:50:14.896878  7774 raft_consensus.cc:2468] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 1.
W20260709 14:50:14.909795  7725 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 14:50:14.910877  7893 leader_election.cc:304] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:14.914270  8292 consensus_queue.cc:1048] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:50:14.915334  8266 raft_consensus.cc:2804] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:50:14.924837  8266 raft_consensus.cc:697] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:50:14.925911  8266 consensus_queue.cc:237] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:14.933216  7673 catalog_manager.cc:5697] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 0 to 1, leader changed from <none> to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 1 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:50:14.957564  7675 catalog_manager.cc:5697] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 0 to 1, leader changed from <none> to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 1 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:50:14.960845  7974 raft_consensus.cc:359] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:14.962139  7974 raft_consensus.cc:385] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:14.962486  7974 raft_consensus.cc:740] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Initialized, Role: FOLLOWER
I20260709 14:50:14.964522  8273 consensus_queue.cc:1048] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 14:50:14.973840  7974 consensus_queue.cc:260] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:14.985653  7974 ts_tablet_manager.cc:1434] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent starting tablet: real 0.089s	user 0.008s	sys 0.002s
I20260709 14:50:14.989048  7971 tablet_bootstrap.cc:492] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac: No bootstrap required, opened a new log
I20260709 14:50:14.989727  7971 ts_tablet_manager.cc:1403] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent bootstrapping tablet: real 0.261s	user 0.027s	sys 0.020s
I20260709 14:50:14.992813  8289 consensus_queue.cc:1048] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:50:15.001458  7673 catalog_manager.cc:5697] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 1 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:50:14.998828  7971 raft_consensus.cc:359] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:15.015846  7971 raft_consensus.cc:385] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:15.016343  7971 raft_consensus.cc:740] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Initialized, Role: FOLLOWER
I20260709 14:50:15.017442  7971 consensus_queue.cc:260] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:15.029359  7972 tablet_bootstrap.cc:654] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:15.030330  7971 ts_tablet_manager.cc:1434] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent starting tablet: real 0.040s	user 0.005s	sys 0.003s
I20260709 14:50:15.031555  7971 tablet_bootstrap.cc:492] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac: Bootstrap starting.
I20260709 14:50:15.032440  7974 tablet_bootstrap.cc:492] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0: Bootstrap starting.
I20260709 14:50:15.046708  7974 tablet_bootstrap.cc:654] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:15.047838  7971 tablet_bootstrap.cc:654] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:15.051144  7972 tablet_bootstrap.cc:492] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed: No bootstrap required, opened a new log
I20260709 14:50:15.051697  7972 ts_tablet_manager.cc:1403] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent bootstrapping tablet: real 0.162s	user 0.011s	sys 0.002s
I20260709 14:50:15.061686  7972 raft_consensus.cc:359] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:15.062778  7972 raft_consensus.cc:385] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:15.063120  7972 raft_consensus.cc:740] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Initialized, Role: FOLLOWER
I20260709 14:50:15.063900  7972 consensus_queue.cc:260] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:15.068241  7972 ts_tablet_manager.cc:1434] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 14:50:15.069657  7972 tablet_bootstrap.cc:492] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed: Bootstrap starting.
I20260709 14:50:15.076603  8298 raft_consensus.cc:493] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:50:15.077183  8298 raft_consensus.cc:515] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:15.082008  8298 leader_election.cc:290] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:50:15.084930  7745 consensus_peers.cc:597] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed -> Peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Couldn't send request to peer 3876b8ee8d744cb18e91d97aae93b1ac. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:50:15.085788  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:50:15.091141  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:50:15.091885  7927 raft_consensus.cc:2468] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 1.
I20260709 14:50:15.091938  7847 raft_consensus.cc:2468] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 0.
I20260709 14:50:15.094596  7745 leader_election.cc:304] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:50:15.096583  8289 raft_consensus.cc:2804] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 14:50:15.097858  8289 raft_consensus.cc:493] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:50:15.098276  8289 raft_consensus.cc:3060] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:15.100860  8298 raft_consensus.cc:493] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:50:15.101508  8298 raft_consensus.cc:515] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:15.108741  8298 leader_election.cc:290] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:15.109781  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:50:15.110870  7927 raft_consensus.cc:2468] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 0.
I20260709 14:50:15.111299  7972 tablet_bootstrap.cc:654] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:15.115496  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:50:15.117928  7744 leader_election.cc:304] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:50:15.119323  8298 raft_consensus.cc:2804] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:50:15.119755  8298 raft_consensus.cc:493] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:50:15.120327  8298 raft_consensus.cc:3060] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Advancing to term 1
W20260709 14:50:15.121901  7745 leader_election.cc:343] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:15.123741  7971 tablet_bootstrap.cc:492] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac: No bootstrap required, opened a new log
I20260709 14:50:15.124365  7971 ts_tablet_manager.cc:1403] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent bootstrapping tablet: real 0.093s	user 0.008s	sys 0.033s
I20260709 14:50:15.127158  8289 raft_consensus.cc:515] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:15.130749  8289 leader_election.cc:290] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 2 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:15.134279  7974 tablet_bootstrap.cc:492] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0: No bootstrap required, opened a new log
I20260709 14:50:15.135020  7974 ts_tablet_manager.cc:1403] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent bootstrapping tablet: real 0.144s	user 0.013s	sys 0.011s
I20260709 14:50:15.135725  8298 raft_consensus.cc:515] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:15.136094  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:50:15.136752  7846 raft_consensus.cc:3060] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Advancing to term 2
I20260709 14:50:15.137920  8298 leader_election.cc:290] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:15.134487  7971 raft_consensus.cc:359] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:15.139145  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
W20260709 14:50:15.140571  7745 leader_election.cc:343] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:15.141556  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:50:15.142230  7924 raft_consensus.cc:3060] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:15.142745  8266 consensus_queue.cc:1048] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 14:50:15.143934  7974 raft_consensus.cc:359] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:15.144699  7974 raft_consensus.cc:385] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:15.144963  7974 raft_consensus.cc:740] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Initialized, Role: FOLLOWER
I20260709 14:50:15.145681  7974 consensus_queue.cc:260] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:15.146793  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:50:15.147432  7923 raft_consensus.cc:3060] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:15.147475  7846 raft_consensus.cc:2468] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 2.
I20260709 14:50:15.148278  7974 ts_tablet_manager.cc:1434] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 14:50:15.139138  7971 raft_consensus.cc:385] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:15.148738  7971 raft_consensus.cc:740] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Initialized, Role: FOLLOWER
I20260709 14:50:15.149710  7971 consensus_queue.cc:260] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:15.151310  7974 tablet_bootstrap.cc:492] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0: Bootstrap starting.
W20260709 14:50:15.145591  7894 consensus_peers.cc:597] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Couldn't send request to peer 3876b8ee8d744cb18e91d97aae93b1ac. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:50:15.163427  7924 raft_consensus.cc:2468] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 2.
I20260709 14:50:15.164711  7744 leader_election.cc:304] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:50:15.165738  7971 ts_tablet_manager.cc:1434] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent starting tablet: real 0.041s	user 0.009s	sys 0.000s
I20260709 14:50:15.165663  8292 raft_consensus.cc:2804] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:50:15.166324  8292 raft_consensus.cc:697] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:50:15.167160  8292 consensus_queue.cc:237] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:15.169718  7923 raft_consensus.cc:2468] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 1.
I20260709 14:50:15.171110  7744 leader_election.cc:304] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:15.172977  8289 raft_consensus.cc:2804] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:50:15.174219  8289 raft_consensus.cc:697] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:50:15.175189  8289 consensus_queue.cc:237] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:15.175190  7972 tablet_bootstrap.cc:492] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed: No bootstrap required, opened a new log
I20260709 14:50:15.240057  8263 raft_consensus.cc:493] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:50:15.240796  8263 raft_consensus.cc:515] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:15.247385  8263 leader_election.cc:290] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:50:15.247412  7972 ts_tablet_manager.cc:1403] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent bootstrapping tablet: real 0.178s	user 0.016s	sys 0.014s
I20260709 14:50:15.249045  7971 tablet_bootstrap.cc:492] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac: Bootstrap starting.
I20260709 14:50:15.256765  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:50:15.258419  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
W20260709 14:50:15.258703  7894 leader_election.cc:343] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:15.264240  7972 raft_consensus.cc:359] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:15.268911  7972 raft_consensus.cc:385] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:15.269397  7972 raft_consensus.cc:740] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Initialized, Role: FOLLOWER
I20260709 14:50:15.268317  8159 raft_consensus.cc:493] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:50:15.270277  7972 consensus_queue.cc:260] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:15.270596  8159 raft_consensus.cc:515] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:15.274900  7971 tablet_bootstrap.cc:654] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:15.273236  7972 ts_tablet_manager.cc:1434] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent starting tablet: real 0.022s	user 0.004s	sys 0.001s
I20260709 14:50:15.279474  7972 tablet_bootstrap.cc:492] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed: Bootstrap starting.
I20260709 14:50:15.279685  7974 tablet_bootstrap.cc:654] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:15.286994  7972 tablet_bootstrap.cc:654] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:15.297297  7974 tablet_bootstrap.cc:492] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0: No bootstrap required, opened a new log
I20260709 14:50:15.298053  7974 ts_tablet_manager.cc:1403] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent bootstrapping tablet: real 0.149s	user 0.013s	sys 0.011s
I20260709 14:50:15.300742  7675 catalog_manager.cc:5697] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 0 to 2, leader changed from <none> to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 2 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:50:15.303325  7972 tablet_bootstrap.cc:492] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed: No bootstrap required, opened a new log
I20260709 14:50:15.303983  7972 ts_tablet_manager.cc:1403] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent bootstrapping tablet: real 0.025s	user 0.012s	sys 0.000s
I20260709 14:50:15.307686  7972 raft_consensus.cc:359] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:15.308485  7972 raft_consensus.cc:385] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:15.308773  7972 raft_consensus.cc:740] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Initialized, Role: FOLLOWER
I20260709 14:50:15.314302  8159 leader_election.cc:290] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:50:15.316689  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:50:15.324571  7894 leader_election.cc:343] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:15.326212  7972 consensus_queue.cc:260] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:15.303876  7675 catalog_manager.cc:5697] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 0 to 1, leader changed from <none> to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 1 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:50:15.328926  7972 ts_tablet_manager.cc:1434] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.000s
I20260709 14:50:15.330479  7972 tablet_bootstrap.cc:492] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed: Bootstrap starting.
W20260709 14:50:15.330451  7893 leader_election.cc:343] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:15.331115  7893 leader_election.cc:304] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:15.332108  8159 raft_consensus.cc:2749] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:50:15.342089  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:50:15.344513  8276 raft_consensus.cc:493] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:50:15.345074  8276 raft_consensus.cc:515] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:15.347553  8284 consensus_queue.cc:1048] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 14:50:15.350116  8276 leader_election.cc:290] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:15.352907  8292 consensus_queue.cc:1048] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:50:15.355842  7972 tablet_bootstrap.cc:654] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:15.356896  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:50:15.357875  7971 tablet_bootstrap.cc:492] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac: No bootstrap required, opened a new log
I20260709 14:50:15.359120  7971 ts_tablet_manager.cc:1403] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent bootstrapping tablet: real 0.111s	user 0.015s	sys 0.017s
I20260709 14:50:15.362593  7971 raft_consensus.cc:359] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:15.363345  7971 raft_consensus.cc:385] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:15.363874  7971 raft_consensus.cc:740] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Initialized, Role: FOLLOWER
I20260709 14:50:15.366073  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:50:15.367756  7971 consensus_queue.cc:260] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:15.373858  7971 ts_tablet_manager.cc:1434] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 14:50:15.375116  7971 tablet_bootstrap.cc:492] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac: Bootstrap starting.
I20260709 14:50:15.379992  7972 tablet_bootstrap.cc:492] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed: No bootstrap required, opened a new log
I20260709 14:50:15.385762  7972 ts_tablet_manager.cc:1403] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent bootstrapping tablet: real 0.055s	user 0.011s	sys 0.004s
I20260709 14:50:15.383090  7971 tablet_bootstrap.cc:654] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:15.393385  7972 raft_consensus.cc:359] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:15.394249  7972 raft_consensus.cc:385] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:15.394552  7972 raft_consensus.cc:740] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Initialized, Role: FOLLOWER
I20260709 14:50:15.395241  7972 consensus_queue.cc:260] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:15.397893  7972 ts_tablet_manager.cc:1434] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 14:50:15.399163  7972 tablet_bootstrap.cc:492] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed: Bootstrap starting.
W20260709 14:50:15.399199  7893 leader_election.cc:343] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:15.401731  7893 leader_election.cc:304] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:15.405206  8266 raft_consensus.cc:2749] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:50:15.405731  8276 consensus_queue.cc:1048] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 14:50:15.410388  7974 raft_consensus.cc:359] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:15.411146  7974 raft_consensus.cc:385] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:15.412658  7972 tablet_bootstrap.cc:654] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:15.421350  8286 consensus_queue.cc:1048] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 14:50:15.423743  7971 tablet_bootstrap.cc:492] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac: No bootstrap required, opened a new log
I20260709 14:50:15.424407  7971 ts_tablet_manager.cc:1403] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent bootstrapping tablet: real 0.050s	user 0.009s	sys 0.016s
I20260709 14:50:15.411466  7974 raft_consensus.cc:740] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Initialized, Role: FOLLOWER
I20260709 14:50:15.428071  7971 raft_consensus.cc:359] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:15.429001  7819 leader_election.cc:304] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:50:15.429715  7971 raft_consensus.cc:385] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:15.430166  7971 raft_consensus.cc:740] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Initialized, Role: FOLLOWER
I20260709 14:50:15.430087  8291 raft_consensus.cc:2749] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:50:15.431180  7971 consensus_queue.cc:260] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:15.434530  7971 ts_tablet_manager.cc:1434] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.002s
I20260709 14:50:15.436048  7971 tablet_bootstrap.cc:492] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac: Bootstrap starting.
I20260709 14:50:15.441057  7974 consensus_queue.cc:260] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:15.443595  8319 raft_consensus.cc:493] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:50:15.444583  8319 raft_consensus.cc:515] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:15.445377  7971 tablet_bootstrap.cc:654] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:15.447461  8319 leader_election.cc:290] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:15.460870  7971 tablet_bootstrap.cc:492] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac: No bootstrap required, opened a new log
I20260709 14:50:15.461609  7971 ts_tablet_manager.cc:1403] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent bootstrapping tablet: real 0.026s	user 0.017s	sys 0.005s
I20260709 14:50:15.463924  7974 ts_tablet_manager.cc:1434] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent starting tablet: real 0.165s	user 0.010s	sys 0.000s
W20260709 14:50:15.466238  7894 consensus_peers.cc:597] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Couldn't send request to peer 3876b8ee8d744cb18e91d97aae93b1ac. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:50:15.467630  8319 raft_consensus.cc:493] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:50:15.465138  7971 raft_consensus.cc:359] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:15.485080  7971 raft_consensus.cc:385] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:15.485661  7971 raft_consensus.cc:740] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Initialized, Role: FOLLOWER
I20260709 14:50:15.481997  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:50:15.483490  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:50:15.486611  7927 raft_consensus.cc:2468] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 0.
I20260709 14:50:15.490211  7744 leader_election.cc:304] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:50:15.491211  8292 raft_consensus.cc:2804] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:50:15.491778  8292 raft_consensus.cc:493] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:50:15.492141  8292 raft_consensus.cc:3060] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:15.497314  8263 consensus_queue.cc:1048] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:50:15.499677  7971 consensus_queue.cc:260] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:15.504292  7974 tablet_bootstrap.cc:492] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0: Bootstrap starting.
I20260709 14:50:15.508144  8319 raft_consensus.cc:515] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:15.513739  7971 ts_tablet_manager.cc:1434] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent starting tablet: real 0.052s	user 0.009s	sys 0.000s
W20260709 14:50:15.515195  7745 leader_election.cc:343] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:15.520412  7971 tablet_bootstrap.cc:492] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac: Bootstrap starting.
I20260709 14:50:15.529836  8319 leader_election.cc:290] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:15.533931  7972 tablet_bootstrap.cc:492] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed: No bootstrap required, opened a new log
I20260709 14:50:15.533919  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:50:15.534847  7972 ts_tablet_manager.cc:1403] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent bootstrapping tablet: real 0.136s	user 0.037s	sys 0.017s
I20260709 14:50:15.534972  7927 raft_consensus.cc:2468] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 0.
I20260709 14:50:15.540666  7972 raft_consensus.cc:359] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:15.541514  7972 raft_consensus.cc:385] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:15.541630  7744 leader_election.cc:304] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:50:15.542825  8319 raft_consensus.cc:2804] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:50:15.543473  8319 raft_consensus.cc:493] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:50:15.545631  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:50:15.544130  8319 raft_consensus.cc:3060] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Advancing to term 1
W20260709 14:50:15.549182  7745 leader_election.cc:343] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:15.552237  8298 raft_consensus.cc:493] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:50:15.541834  7972 raft_consensus.cc:740] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Initialized, Role: FOLLOWER
I20260709 14:50:15.554314  8292 raft_consensus.cc:515] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:15.552918  8298 raft_consensus.cc:515] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:15.557940  8298 leader_election.cc:290] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:15.555143  7972 consensus_queue.cc:260] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:15.558876  8292 leader_election.cc:290] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:15.563364  7972 ts_tablet_manager.cc:1434] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent starting tablet: real 0.028s	user 0.010s	sys 0.000s
I20260709 14:50:15.564600  7972 tablet_bootstrap.cc:492] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed: Bootstrap starting.
I20260709 14:50:15.568799  7971 tablet_bootstrap.cc:654] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:15.559645  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:50:15.559274  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
W20260709 14:50:15.571592  7745 leader_election.cc:343] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:15.571612  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:50:15.573150  7927 raft_consensus.cc:3060] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:15.573781  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:50:15.574571  7924 raft_consensus.cc:2468] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 0.
I20260709 14:50:15.577874  7974 tablet_bootstrap.cc:654] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0: Neither blocks nor log segments found. Creating new log.
W20260709 14:50:15.581656  7745 leader_election.cc:343] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:15.592056  7927 raft_consensus.cc:2468] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 1.
I20260709 14:50:15.595260  7972 tablet_bootstrap.cc:654] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:15.603765  7924 raft_consensus.cc:1275] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 14:50:15.615985  7846 raft_consensus.cc:3060] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:15.622725  8319 raft_consensus.cc:515] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:15.627802  8319 leader_election.cc:290] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:15.627967  7744 leader_election.cc:304] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:15.640317  8319 raft_consensus.cc:2804] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:50:15.640726  8319 raft_consensus.cc:493] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:50:15.641101  8319 raft_consensus.cc:3060] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:15.642189  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:50:15.647270  7974 tablet_bootstrap.cc:492] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0: No bootstrap required, opened a new log
I20260709 14:50:15.647944  7974 ts_tablet_manager.cc:1403] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0: Time spent bootstrapping tablet: real 0.144s	user 0.016s	sys 0.011s
I20260709 14:50:15.648942  7744 leader_election.cc:304] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:15.649994  8286 raft_consensus.cc:2804] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:50:15.650733  8286 raft_consensus.cc:697] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:50:15.652767  8298 consensus_queue.cc:1048] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
W20260709 14:50:15.657660  7745 leader_election.cc:343] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:15.651906  8286 consensus_queue.cc:237] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:15.655849  8319 raft_consensus.cc:515] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:15.662976  8159 raft_consensus.cc:493] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:50:15.651624  7974 raft_consensus.cc:359] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:15.665861  7974 raft_consensus.cc:385] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:15.666208  7974 raft_consensus.cc:740] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Initialized, Role: FOLLOWER
I20260709 14:50:15.663544  8159 raft_consensus.cc:515] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:15.667047  7974 consensus_queue.cc:260] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:15.670709  7974 ts_tablet_manager.cc:1434] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.000s
I20260709 14:50:15.672269  7971 tablet_bootstrap.cc:492] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac: No bootstrap required, opened a new log
I20260709 14:50:15.673312  7971 ts_tablet_manager.cc:1403] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent bootstrapping tablet: real 0.156s	user 0.014s	sys 0.016s
I20260709 14:50:15.678457  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:50:15.663323  8319 leader_election.cc:290] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:15.662842  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:50:15.682144  7924 raft_consensus.cc:3060] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:15.684646  8291 raft_consensus.cc:493] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:50:15.683233  8159 leader_election.cc:290] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:50:15.685416  8291 raft_consensus.cc:515] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:15.689728  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:50:15.690896  7926 raft_consensus.cc:3060] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:15.695436  8284 raft_consensus.cc:493] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:50:15.696525  8284 raft_consensus.cc:515] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:15.698783  7974 tablet_bootstrap.cc:492] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0: Bootstrap starting.
I20260709 14:50:15.699213  8284 leader_election.cc:290] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:15.688824  8291 leader_election.cc:290] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:50:15.685432  7745 leader_election.cc:343] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:15.684684  7971 raft_consensus.cc:359] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:15.703641  7971 raft_consensus.cc:385] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:15.703995  7971 raft_consensus.cc:740] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Initialized, Role: FOLLOWER
I20260709 14:50:15.704747  7971 consensus_queue.cc:260] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:15.715772  7972 tablet_bootstrap.cc:492] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed: No bootstrap required, opened a new log
I20260709 14:50:15.717339  7926 raft_consensus.cc:2468] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 1.
I20260709 14:50:15.717056  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:50:15.719981  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:50:15.720240  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:50:15.721956  7972 ts_tablet_manager.cc:1403] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent bootstrapping tablet: real 0.158s	user 0.013s	sys 0.011s
I20260709 14:50:15.726435  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:50:15.727393  7925 raft_consensus.cc:2393] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 1: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:50:15.723440  7744 leader_election.cc:304] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:15.728740  8319 raft_consensus.cc:2804] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:50:15.729405  8319 raft_consensus.cc:697] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:50:15.727587  7847 raft_consensus.cc:1275] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 14:50:15.730513  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:50:15.730333  8319 consensus_queue.cc:237] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:15.721782  7854 raft_consensus.cc:3060] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Advancing to term 1
W20260709 14:50:15.732237  7894 leader_election.cc:343] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:15.733698  8273 consensus_queue.cc:1048] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:50:15.734771  7971 ts_tablet_manager.cc:1434] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent starting tablet: real 0.061s	user 0.008s	sys 0.000s
I20260709 14:50:15.736090  7971 tablet_bootstrap.cc:492] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac: Bootstrap starting.
I20260709 14:50:15.737079  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:50:15.738067  7777 raft_consensus.cc:2468] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 0.
I20260709 14:50:15.729038  7972 raft_consensus.cc:359] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:15.739748  7972 raft_consensus.cc:385] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:15.740272  7819 leader_election.cc:304] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:50:15.741572  7819 leader_election.cc:304] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:50:15.740105  7972 raft_consensus.cc:740] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Initialized, Role: FOLLOWER
I20260709 14:50:15.743073  8291 raft_consensus.cc:3060] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:15.758883  7893 leader_election.cc:304] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:15.761704  8276 raft_consensus.cc:2749] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:50:15.762871  8263 raft_consensus.cc:2804] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:50:15.763388  8263 raft_consensus.cc:493] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:50:15.764581  7972 consensus_queue.cc:260] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:15.764127  8263 raft_consensus.cc:3060] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:15.776728  7972 ts_tablet_manager.cc:1434] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent starting tablet: real 0.054s	user 0.007s	sys 0.002s
I20260709 14:50:15.781641  7974 tablet_bootstrap.cc:654] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:15.781314  7673 catalog_manager.cc:5697] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 0 to 1, leader changed from <none> to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 1 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:50:15.791330  7971 tablet_bootstrap.cc:654] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:15.797475  7972 tablet_bootstrap.cc:492] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed: Bootstrap starting.
I20260709 14:50:15.834724  7974 tablet_bootstrap.cc:492] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0: No bootstrap required, opened a new log
I20260709 14:50:15.835510  7974 ts_tablet_manager.cc:1403] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent bootstrapping tablet: real 0.137s	user 0.015s	sys 0.001s
I20260709 14:50:15.851120  8263 raft_consensus.cc:515] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:15.883294  7924 raft_consensus.cc:2468] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 1.
I20260709 14:50:15.884620  7972 tablet_bootstrap.cc:654] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed: Neither blocks nor log segments found. Creating new log.
W20260709 14:50:15.887737  8337 log.cc:927] Time spent T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 14:50:15.892418  8291 raft_consensus.cc:2749] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:50:15.892385  7974 raft_consensus.cc:359] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:15.906255  7974 raft_consensus.cc:385] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:15.906617  7974 raft_consensus.cc:740] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Initialized, Role: FOLLOWER
I20260709 14:50:15.924225  8263 leader_election.cc:290] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:50:15.916182  7974 consensus_queue.cc:260] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:15.914259  8266 raft_consensus.cc:493] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:50:15.939765  8266 raft_consensus.cc:515] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:15.945715  8266 leader_election.cc:290] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:50:15.951054  7971 tablet_bootstrap.cc:492] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac: No bootstrap required, opened a new log
I20260709 14:50:15.951674  7971 ts_tablet_manager.cc:1403] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent bootstrapping tablet: real 0.216s	user 0.013s	sys 0.036s
I20260709 14:50:15.963805  8319 consensus_queue.cc:1048] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:50:15.968902  7974 ts_tablet_manager.cc:1434] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent starting tablet: real 0.133s	user 0.010s	sys 0.000s
I20260709 14:50:15.978538  7974 tablet_bootstrap.cc:492] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0: Bootstrap starting.
W20260709 14:50:16.027141  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 139394us
I20260709 14:50:16.041456  7972 tablet_bootstrap.cc:492] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed: No bootstrap required, opened a new log
I20260709 14:50:16.043687  7972 ts_tablet_manager.cc:1403] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent bootstrapping tablet: real 0.263s	user 0.012s	sys 0.006s
I20260709 14:50:16.051324  7971 raft_consensus.cc:359] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:16.055585  7971 raft_consensus.cc:385] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:16.056241  7971 raft_consensus.cc:740] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Initialized, Role: FOLLOWER
I20260709 14:50:16.057076  7971 consensus_queue.cc:260] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:50:16.068157  7725 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 14:50:16.049954  8298 raft_consensus.cc:493] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:50:16.071672  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 79481.3us
I20260709 14:50:16.105055  7972 raft_consensus.cc:359] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:16.106485  7972 raft_consensus.cc:385] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:16.106950  7972 raft_consensus.cc:740] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Initialized, Role: FOLLOWER
I20260709 14:50:16.107856  7972 consensus_queue.cc:260] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:16.108944  7974 tablet_bootstrap.cc:654] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:16.110844  7972 ts_tablet_manager.cc:1434] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent starting tablet: real 0.067s	user 0.009s	sys 0.000s
I20260709 14:50:16.112433  7972 tablet_bootstrap.cc:492] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed: Bootstrap starting.
I20260709 14:50:16.082309  8298 raft_consensus.cc:515] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:16.131356  7744 leader_election.cc:304] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:16.149281  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:50:16.149958  7774 raft_consensus.cc:3060] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:16.139555  8319 raft_consensus.cc:2804] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:50:16.151254  8319 raft_consensus.cc:697] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:50:16.152293  8319 consensus_queue.cc:237] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:16.165926  8353 consensus_queue.cc:1048] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 14:50:16.170469  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:50:16.171505  7849 raft_consensus.cc:3060] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:16.193389  8343 raft_consensus.cc:493] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:50:16.194921  8343 raft_consensus.cc:515] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:16.171064  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:50:16.197989  8298 leader_election.cc:290] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:16.206080  7849 raft_consensus.cc:2468] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 1.
I20260709 14:50:16.197085  8343 leader_election.cc:290] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:16.197999  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:50:16.216848  7775 raft_consensus.cc:2468] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 0.
I20260709 14:50:16.217195  7972 tablet_bootstrap.cc:654] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed: Neither blocks nor log segments found. Creating new log.
W20260709 14:50:16.208029  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 69281.4us
W20260709 14:50:16.254233  7894 leader_election.cc:343] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:16.255715  7894 leader_election.cc:304] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:50:16.262866  7971 ts_tablet_manager.cc:1434] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent starting tablet: real 0.311s	user 0.008s	sys 0.010s
I20260709 14:50:16.264685  8345 raft_consensus.cc:2804] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:50:16.275581  8352 raft_consensus.cc:493] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:50:16.276144  8352 raft_consensus.cc:515] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:16.278733  8345 raft_consensus.cc:697] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:50:16.278872  8352 leader_election.cc:290] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:16.302335  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:50:16.303144  7776 raft_consensus.cc:2468] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 0.
I20260709 14:50:16.280652  8345 consensus_queue.cc:237] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:16.327204  7774 raft_consensus.cc:2468] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 1.
I20260709 14:50:16.328233  7893 leader_election.cc:304] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:50:16.334208  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 79606.8us
I20260709 14:50:16.335582  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:50:16.336728  7849 raft_consensus.cc:2468] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 0.
W20260709 14:50:16.340144  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 84522.4us
I20260709 14:50:16.342690  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:50:16.409154  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:50:16.410100  8266 raft_consensus.cc:493] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:50:16.410662  8266 raft_consensus.cc:515] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:16.358489  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:50:16.419245  7819 leader_election.cc:304] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:50:16.358454  8347 raft_consensus.cc:2804] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:50:16.431165  8291 raft_consensus.cc:2804] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:50:16.434506  8291 raft_consensus.cc:493] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:50:16.436846  8291 raft_consensus.cc:3060] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:16.410356  7923 raft_consensus.cc:2468] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 0.
I20260709 14:50:16.431834  8347 raft_consensus.cc:493] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:50:16.450307  7745 leader_election.cc:304] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:50:16.445720  8347 raft_consensus.cc:3060] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:16.461911  8359 raft_consensus.cc:2804] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:50:16.466483  8359 raft_consensus.cc:493] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:50:16.471906  8359 raft_consensus.cc:3060] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:16.473483  7972 tablet_bootstrap.cc:492] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed: No bootstrap required, opened a new log
I20260709 14:50:16.474067  7972 ts_tablet_manager.cc:1403] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent bootstrapping tablet: real 0.362s	user 0.014s	sys 0.025s
I20260709 14:50:16.466526  8266 leader_election.cc:290] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:50:16.493264  8347 raft_consensus.cc:515] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:16.496348  7850 raft_consensus.cc:3060] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:16.497979  8291 raft_consensus.cc:515] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:16.502370  7971 tablet_bootstrap.cc:492] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac: Bootstrap starting.
I20260709 14:50:16.505471  7974 tablet_bootstrap.cc:492] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0: No bootstrap required, opened a new log
I20260709 14:50:16.506047  7974 ts_tablet_manager.cc:1403] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent bootstrapping tablet: real 0.528s	user 0.072s	sys 0.066s
I20260709 14:50:16.504585  7972 raft_consensus.cc:359] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:16.512027  7972 raft_consensus.cc:385] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:16.512329  7972 raft_consensus.cc:740] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Initialized, Role: FOLLOWER
I20260709 14:50:16.513456  7972 consensus_queue.cc:260] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:16.518649  7972 ts_tablet_manager.cc:1434] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent starting tablet: real 0.044s	user 0.001s	sys 0.008s
I20260709 14:50:16.511557  8291 leader_election.cc:290] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 1 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:16.500247  8359 raft_consensus.cc:515] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:16.514699  8347 leader_election.cc:290] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:50:16.526206  7971 tablet_bootstrap.cc:654] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:16.527336  7974 raft_consensus.cc:359] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:16.530818  7974 raft_consensus.cc:385] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:16.531348  7974 raft_consensus.cc:740] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Initialized, Role: FOLLOWER
I20260709 14:50:16.532162  7974 consensus_queue.cc:260] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:16.536512  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:50:16.537618  7974 ts_tablet_manager.cc:1434] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent starting tablet: real 0.031s	user 0.009s	sys 0.000s
W20260709 14:50:16.544600  7894 leader_election.cc:343] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:16.546382  7972 tablet_bootstrap.cc:492] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed: Bootstrap starting.
W20260709 14:50:16.547399  7744 leader_election.cc:343] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:16.540179  8358 consensus_queue.cc:1048] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 14:50:16.539042  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:50:16.556923  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:50:16.557170  7894 leader_election.cc:343] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:16.570838  7974 tablet_bootstrap.cc:492] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0: Bootstrap starting.
I20260709 14:50:16.575757  8359 leader_election.cc:290] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:16.578042  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:50:16.583243  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:50:16.585415  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:50:16.586251  7923 raft_consensus.cc:3060] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:16.586575  7777 raft_consensus.cc:3060] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:16.592592  7971 tablet_bootstrap.cc:492] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac: No bootstrap required, opened a new log
I20260709 14:50:16.593926  7971 ts_tablet_manager.cc:1403] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent bootstrapping tablet: real 0.092s	user 0.021s	sys 0.016s
W20260709 14:50:16.598227  7745 consensus_peers.cc:597] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed -> Peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Couldn't send request to peer 3876b8ee8d744cb18e91d97aae93b1ac. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:50:16.601579  7673 catalog_manager.cc:5697] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 0 to 1, leader changed from <none> to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 1 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:50:16.612718  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:50:16.613796  7847 raft_consensus.cc:2393] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 1: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
W20260709 14:50:16.615060  7745 leader_election.cc:343] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:16.615574  7745 leader_election.cc:304] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:16.615350  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:50:16.621711  8362 consensus_queue.cc:1048] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 14:50:16.604218  7673 catalog_manager.cc:5697] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 0 to 1, leader changed from <none> to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 1 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:50:16.623235  8358 raft_consensus.cc:2749] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 14:50:16.636827  7893 leader_election.cc:343] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:16.637483  7971 raft_consensus.cc:359] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:16.639045  7971 raft_consensus.cc:385] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:16.637152  7974 tablet_bootstrap.cc:654] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:16.639380  7971 raft_consensus.cc:740] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Initialized, Role: FOLLOWER
I20260709 14:50:16.639295  7893 leader_election.cc:304] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:16.640806  7971 consensus_queue.cc:260] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:50:16.643589  7745 consensus_peers.cc:597] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed -> Peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Couldn't send request to peer 3876b8ee8d744cb18e91d97aae93b1ac. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:50:16.643334  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:50:16.644312  7775 raft_consensus.cc:2393] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 1: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:50:16.644893  8347 raft_consensus.cc:2749] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:50:16.647344  7972 tablet_bootstrap.cc:654] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:16.650871  7777 raft_consensus.cc:2468] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 1.
I20260709 14:50:16.654256  7971 ts_tablet_manager.cc:1434] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent starting tablet: real 0.060s	user 0.006s	sys 0.002s
I20260709 14:50:16.659658  7971 tablet_bootstrap.cc:492] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac: Bootstrap starting.
I20260709 14:50:16.652384  7923 raft_consensus.cc:2468] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 1.
I20260709 14:50:16.670956  7819 leader_election.cc:304] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:50:16.671708  8356 raft_consensus.cc:493] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:50:16.672664  8356 raft_consensus.cc:515] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:16.673275  8291 raft_consensus.cc:2749] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 14:50:16.675993  8356 leader_election.cc:290] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:16.666196  7893 leader_election.cc:304] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:16.684580  8347 raft_consensus.cc:2804] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:50:16.685277  8347 raft_consensus.cc:697] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:50:16.686580  8347 consensus_queue.cc:237] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:16.688069  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:50:16.691031  7744 leader_election.cc:304] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:16.693126  8362 raft_consensus.cc:2804] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:50:16.693686  8362 raft_consensus.cc:697] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:50:16.694370  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:50:16.694433  8362 consensus_queue.cc:237] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:50:16.695808  7744 leader_election.cc:343] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785): Illegal state: must be running to vote when last-logged opid is not known
W20260709 14:50:16.700196  7745 consensus_peers.cc:597] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed -> Peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Couldn't send request to peer 3876b8ee8d744cb18e91d97aae93b1ac. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 14:50:16.702381  7745 leader_election.cc:343] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:16.702912  7745 leader_election.cc:304] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:16.705760  8342 raft_consensus.cc:2749] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:50:16.713138  7972 tablet_bootstrap.cc:492] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed: No bootstrap required, opened a new log
I20260709 14:50:16.713837  7972 ts_tablet_manager.cc:1403] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent bootstrapping tablet: real 0.183s	user 0.008s	sys 0.009s
I20260709 14:50:16.715214  7974 tablet_bootstrap.cc:492] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0: No bootstrap required, opened a new log
I20260709 14:50:16.715783  7974 ts_tablet_manager.cc:1403] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0: Time spent bootstrapping tablet: real 0.147s	user 0.019s	sys 0.000s
I20260709 14:50:16.717104  7972 raft_consensus.cc:359] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:16.718094  7972 raft_consensus.cc:385] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:16.718391  7972 raft_consensus.cc:740] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Initialized, Role: FOLLOWER
I20260709 14:50:16.719377  7972 consensus_queue.cc:260] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:16.721961  7972 ts_tablet_manager.cc:1434] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.003s
I20260709 14:50:16.722630  7974 raft_consensus.cc:359] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:16.731287  7974 raft_consensus.cc:385] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:16.733570  7974 raft_consensus.cc:740] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Initialized, Role: FOLLOWER
I20260709 14:50:16.734378  7974 consensus_queue.cc:260] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:16.723249  7972 tablet_bootstrap.cc:492] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed: Bootstrap starting.
I20260709 14:50:16.725589  7676 catalog_manager.cc:5697] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 1 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:50:16.729161  7971 tablet_bootstrap.cc:654] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:16.730382  8345 consensus_queue.cc:1048] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 14:50:16.749542  7974 ts_tablet_manager.cc:1434] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0: Time spent starting tablet: real 0.033s	user 0.008s	sys 0.000s
I20260709 14:50:16.791525  7674 catalog_manager.cc:5697] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 0 to 1, leader changed from <none> to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 1 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:50:16.803153  7849 raft_consensus.cc:3060] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:16.803474  7974 tablet_bootstrap.cc:492] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0: Bootstrap starting.
I20260709 14:50:16.815866  7676 catalog_manager.cc:5697] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 1 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:50:16.836611  7972 tablet_bootstrap.cc:654] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:16.839834  8345 raft_consensus.cc:493] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:50:16.840445  8345 raft_consensus.cc:515] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:16.845422  8345 leader_election.cc:290] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:50:16.845853  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:50:16.846547  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:50:16.847416  7779 raft_consensus.cc:2468] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 0.
I20260709 14:50:16.850070  7893 leader_election.cc:304] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:50:16.851186  8345 raft_consensus.cc:2804] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:50:16.851680  8345 raft_consensus.cc:493] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:50:16.852020  8345 raft_consensus.cc:3060] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:16.852842  7974 tablet_bootstrap.cc:654] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0: Neither blocks nor log segments found. Creating new log.
W20260709 14:50:16.854879  7894 leader_election.cc:343] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:16.861660  8342 consensus_queue.cc:1048] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:50:16.867127  8347 consensus_queue.cc:1048] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:50:16.907516  7971 tablet_bootstrap.cc:492] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac: No bootstrap required, opened a new log
I20260709 14:50:16.908183  7971 ts_tablet_manager.cc:1403] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent bootstrapping tablet: real 0.249s	user 0.043s	sys 0.048s
I20260709 14:50:16.911755  7971 raft_consensus.cc:359] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:16.912606  7971 raft_consensus.cc:385] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:16.912963  7971 raft_consensus.cc:740] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Initialized, Role: FOLLOWER
I20260709 14:50:16.914115  7971 consensus_queue.cc:260] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:16.932839  7849 raft_consensus.cc:3060] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:16.934463  8345 raft_consensus.cc:515] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:16.938452  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
W20260709 14:50:16.940073  7894 leader_election.cc:343] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:16.940111  7972 tablet_bootstrap.cc:492] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed: No bootstrap required, opened a new log
I20260709 14:50:16.941032  7972 ts_tablet_manager.cc:1403] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent bootstrapping tablet: real 0.218s	user 0.014s	sys 0.001s
I20260709 14:50:16.947014  8347 raft_consensus.cc:493] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:50:16.947731  8347 raft_consensus.cc:515] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:16.951783  8345 leader_election.cc:290] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:50:16.948024  7972 raft_consensus.cc:359] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:16.954057  8347 leader_election.cc:290] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:50:16.957381  7974 tablet_bootstrap.cc:492] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0: No bootstrap required, opened a new log
I20260709 14:50:16.957978  7974 ts_tablet_manager.cc:1403] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0: Time spent bootstrapping tablet: real 0.155s	user 0.039s	sys 0.052s
I20260709 14:50:16.943290  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:50:16.954001  7972 raft_consensus.cc:385] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:16.959630  7972 raft_consensus.cc:740] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Initialized, Role: FOLLOWER
I20260709 14:50:16.952873  7971 ts_tablet_manager.cc:1434] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent starting tablet: real 0.044s	user 0.012s	sys 0.000s
I20260709 14:50:16.956347  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:50:16.961457  7971 tablet_bootstrap.cc:492] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac: Bootstrap starting.
W20260709 14:50:16.962198  7894 leader_election.cc:343] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:16.961910  7974 raft_consensus.cc:359] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:16.963670  7974 raft_consensus.cc:385] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:16.964598  7974 raft_consensus.cc:740] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Initialized, Role: FOLLOWER
I20260709 14:50:16.965526  7974 consensus_queue.cc:260] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:16.959619  7779 raft_consensus.cc:3060] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:16.968292  7974 ts_tablet_manager.cc:1434] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 14:50:16.969462  7971 tablet_bootstrap.cc:654] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:16.969991  7974 tablet_bootstrap.cc:492] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0: Bootstrap starting.
I20260709 14:50:16.973392  7972 consensus_queue.cc:260] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:16.974854  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:50:16.975488  7777 raft_consensus.cc:2468] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 0.
I20260709 14:50:16.976682  7972 ts_tablet_manager.cc:1434] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent starting tablet: real 0.035s	user 0.009s	sys 0.000s
I20260709 14:50:16.984694  7974 tablet_bootstrap.cc:654] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:16.985123  7893 leader_election.cc:304] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:16.986511  8347 raft_consensus.cc:2804] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:50:16.986954  8347 raft_consensus.cc:493] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:50:16.987305  8347 raft_consensus.cc:3060] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:16.988377  7971 tablet_bootstrap.cc:492] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac: No bootstrap required, opened a new log
I20260709 14:50:16.988888  7972 tablet_bootstrap.cc:492] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed: Bootstrap starting.
I20260709 14:50:16.989750  7971 ts_tablet_manager.cc:1403] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent bootstrapping tablet: real 0.029s	user 0.021s	sys 0.000s
I20260709 14:50:16.993098  7971 raft_consensus.cc:359] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:16.994415  7971 raft_consensus.cc:385] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:16.994781  7971 raft_consensus.cc:740] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Initialized, Role: FOLLOWER
I20260709 14:50:16.995770  7971 consensus_queue.cc:260] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:16.996510  7972 tablet_bootstrap.cc:654] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:16.998361  7971 ts_tablet_manager.cc:1434] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.005s
I20260709 14:50:16.999581  7971 tablet_bootstrap.cc:492] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac: Bootstrap starting.
I20260709 14:50:17.006386  7971 tablet_bootstrap.cc:654] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:17.010344  7974 tablet_bootstrap.cc:492] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0: No bootstrap required, opened a new log
I20260709 14:50:17.011204  7974 ts_tablet_manager.cc:1403] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent bootstrapping tablet: real 0.041s	user 0.014s	sys 0.003s
I20260709 14:50:17.010447  7779 raft_consensus.cc:2468] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 1.
I20260709 14:50:17.015436  7974 raft_consensus.cc:359] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:17.016361  7974 raft_consensus.cc:385] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:17.016695  7974 raft_consensus.cc:740] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Initialized, Role: FOLLOWER
I20260709 14:50:17.019428  7972 tablet_bootstrap.cc:492] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed: No bootstrap required, opened a new log
I20260709 14:50:17.016579  7893 leader_election.cc:304] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:17.020053  7972 ts_tablet_manager.cc:1403] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent bootstrapping tablet: real 0.031s	user 0.013s	sys 0.004s
I20260709 14:50:17.020390  8345 raft_consensus.cc:2804] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:50:17.020932  8345 raft_consensus.cc:697] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:50:17.021782  8345 consensus_queue.cc:237] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:17.024174  8342 raft_consensus.cc:493] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:50:17.023461  7972 raft_consensus.cc:359] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:17.024833  8342 raft_consensus.cc:515] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:17.025182  7974 consensus_queue.cc:260] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:17.024848  7972 raft_consensus.cc:385] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:17.026587  7972 raft_consensus.cc:740] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Initialized, Role: FOLLOWER
I20260709 14:50:17.027802  8342 leader_election.cc:290] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:17.028649  7974 ts_tablet_manager.cc:1434] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.002s
I20260709 14:50:17.029985  7974 tablet_bootstrap.cc:492] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0: Bootstrap starting.
I20260709 14:50:17.034737  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:50:17.040321  7745 leader_election.cc:343] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:17.055687  7972 consensus_queue.cc:260] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:17.060375  8342 raft_consensus.cc:493] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:50:17.061229  8342 raft_consensus.cc:515] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:17.063192  7971 tablet_bootstrap.cc:492] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac: No bootstrap required, opened a new log
I20260709 14:50:17.064594  7971 ts_tablet_manager.cc:1403] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent bootstrapping tablet: real 0.065s	user 0.016s	sys 0.011s
I20260709 14:50:17.063807  8342 leader_election.cc:290] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:17.064997  7972 ts_tablet_manager.cc:1434] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent starting tablet: real 0.045s	user 0.006s	sys 0.005s
I20260709 14:50:17.067615  7972 tablet_bootstrap.cc:492] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed: Bootstrap starting.
I20260709 14:50:17.070894  7971 raft_consensus.cc:359] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:17.074416  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:50:17.074862  7971 raft_consensus.cc:385] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:17.076232  7971 raft_consensus.cc:740] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Initialized, Role: FOLLOWER
I20260709 14:50:17.078158  7971 consensus_queue.cc:260] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:17.084569  8347 raft_consensus.cc:515] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:17.088351  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:50:17.089156  7850 raft_consensus.cc:3060] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Advancing to term 1
W20260709 14:50:17.090816  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 74328.6us
I20260709 14:50:17.037053  7974 tablet_bootstrap.cc:654] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:17.094699  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:50:17.096623  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:50:17.106171  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:50:17.106941  7777 raft_consensus.cc:3060] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Advancing to term 1
W20260709 14:50:17.110579  7744 leader_election.cc:343] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:17.111157  7744 leader_election.cc:304] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:17.115736  7777 raft_consensus.cc:2468] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 1.
I20260709 14:50:17.118342  7972 tablet_bootstrap.cc:654] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed: Neither blocks nor log segments found. Creating new log.
W20260709 14:50:17.118649  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 44867.8us
I20260709 14:50:17.118978  7971 ts_tablet_manager.cc:1434] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent starting tablet: real 0.053s	user 0.007s	sys 0.000s
I20260709 14:50:17.120880  7971 tablet_bootstrap.cc:492] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac: Bootstrap starting.
I20260709 14:50:17.129487  8347 leader_election.cc:290] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:50:17.132440  7974 tablet_bootstrap.cc:492] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0: No bootstrap required, opened a new log
I20260709 14:50:17.133100  7971 tablet_bootstrap.cc:654] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:17.133409  7974 ts_tablet_manager.cc:1403] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent bootstrapping tablet: real 0.104s	user 0.014s	sys 0.001s
I20260709 14:50:17.134994  8342 raft_consensus.cc:2749] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:50:17.139943  7974 raft_consensus.cc:359] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:17.140852  7974 raft_consensus.cc:385] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:17.141173  7974 raft_consensus.cc:740] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Initialized, Role: FOLLOWER
I20260709 14:50:17.141966  7974 consensus_queue.cc:260] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:50:17.135126  7744 leader_election.cc:343] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785): Illegal state: must be running to vote when last-logged opid is not known
W20260709 14:50:17.144461  7745 leader_election.cc:343] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:17.147806  7745 leader_election.cc:304] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:17.147142  7673 catalog_manager.cc:5697] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 1 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:50:17.151378  7974 ts_tablet_manager.cc:1434] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.001s
I20260709 14:50:17.154238  7972 tablet_bootstrap.cc:492] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed: No bootstrap required, opened a new log
I20260709 14:50:17.154819  8362 raft_consensus.cc:2749] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:50:17.158535  7972 ts_tablet_manager.cc:1403] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent bootstrapping tablet: real 0.091s	user 0.010s	sys 0.007s
W20260709 14:50:17.160985  7894 consensus_peers.cc:597] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Couldn't send request to peer 3876b8ee8d744cb18e91d97aae93b1ac. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:50:17.162940  7971 tablet_bootstrap.cc:492] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac: No bootstrap required, opened a new log
I20260709 14:50:17.163878  7971 ts_tablet_manager.cc:1403] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent bootstrapping tablet: real 0.043s	user 0.018s	sys 0.003s
I20260709 14:50:17.165786  7972 raft_consensus.cc:359] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:17.166623  7972 raft_consensus.cc:385] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:17.166918  7972 raft_consensus.cc:740] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Initialized, Role: FOLLOWER
I20260709 14:50:17.152609  7974 tablet_bootstrap.cc:492] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0: Bootstrap starting.
I20260709 14:50:17.168020  7971 raft_consensus.cc:359] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:17.168859  7971 raft_consensus.cc:385] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:17.169368  7971 raft_consensus.cc:740] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Initialized, Role: FOLLOWER
I20260709 14:50:17.158558  7850 raft_consensus.cc:2468] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 1.
I20260709 14:50:17.169968  7893 leader_election.cc:304] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:50:17.170266  7971 consensus_queue.cc:260] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:17.171468  8345 raft_consensus.cc:2804] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:50:17.172083  8345 raft_consensus.cc:697] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:50:17.173676  7971 ts_tablet_manager.cc:1434] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.005s
I20260709 14:50:17.173003  8345 consensus_queue.cc:237] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:17.175179  7971 tablet_bootstrap.cc:492] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac: Bootstrap starting.
I20260709 14:50:17.188282  7974 tablet_bootstrap.cc:654] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:17.181490  7972 consensus_queue.cc:260] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:17.198594  7971 tablet_bootstrap.cc:654] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:17.199815  7972 ts_tablet_manager.cc:1434] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent starting tablet: real 0.041s	user 0.012s	sys 0.000s
I20260709 14:50:17.205906  7972 tablet_bootstrap.cc:492] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed: Bootstrap starting.
I20260709 14:50:17.215427  7971 tablet_bootstrap.cc:492] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac: No bootstrap required, opened a new log
I20260709 14:50:17.216123  7971 ts_tablet_manager.cc:1403] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent bootstrapping tablet: real 0.041s	user 0.016s	sys 0.001s
I20260709 14:50:17.215225  7673 catalog_manager.cc:5697] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 1 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:50:17.215427  7974 tablet_bootstrap.cc:492] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0: No bootstrap required, opened a new log
I20260709 14:50:17.218365  7974 ts_tablet_manager.cc:1403] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0: Time spent bootstrapping tablet: real 0.066s	user 0.013s	sys 0.001s
I20260709 14:50:17.219915  7971 raft_consensus.cc:359] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:17.221019  7971 raft_consensus.cc:385] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:17.221529  7971 raft_consensus.cc:740] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Initialized, Role: FOLLOWER
I20260709 14:50:17.222682  7971 consensus_queue.cc:260] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:17.222676  7974 raft_consensus.cc:359] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:17.230890  7974 raft_consensus.cc:385] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:17.231206  7974 raft_consensus.cc:740] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Initialized, Role: FOLLOWER
I20260709 14:50:17.232664  7971 ts_tablet_manager.cc:1434] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 14:50:17.232252  7974 consensus_queue.cc:260] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:17.234233  7971 tablet_bootstrap.cc:492] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac: Bootstrap starting.
I20260709 14:50:17.235890  8362 consensus_queue.cc:1048] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:50:17.235932  7974 ts_tablet_manager.cc:1434] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 14:50:17.236403  8358 raft_consensus.cc:493] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:50:17.239621  8355 raft_consensus.cc:493] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:50:17.241325  8355 raft_consensus.cc:515] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:17.244256  8355 leader_election.cc:290] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:17.245076  7974 tablet_bootstrap.cc:492] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0: Bootstrap starting.
I20260709 14:50:17.240248  8358 raft_consensus.cc:515] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:17.259308  8266 raft_consensus.cc:493] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:50:17.260213  8266 raft_consensus.cc:515] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:17.260622  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:50:17.263373  8266 leader_election.cc:290] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:50:17.268587  8358 leader_election.cc:290] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:17.269544  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:50:17.285120  7894 leader_election.cc:343] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Illegal state: must be running to vote when last-logged opid is not known
W20260709 14:50:17.289510  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 58665us
W20260709 14:50:17.324365  7725 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 14:50:17.333902  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:50:17.334949  7925 raft_consensus.cc:2468] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 0.
I20260709 14:50:17.334965  7847 raft_consensus.cc:3060] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:17.346412  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:50:17.325388  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:50:17.349221  7779 raft_consensus.cc:2393] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 1: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
W20260709 14:50:17.380577  7745 leader_election.cc:343] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:17.382058  7972 tablet_bootstrap.cc:654] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:17.395284  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:50:17.410173  7779 raft_consensus.cc:2468] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 0.
I20260709 14:50:17.412079  7974 tablet_bootstrap.cc:654] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:17.412809  7971 tablet_bootstrap.cc:654] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:17.425448  8401 consensus_queue.cc:1048] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:50:17.426569  7972 tablet_bootstrap.cc:492] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed: No bootstrap required, opened a new log
I20260709 14:50:17.427264  7972 ts_tablet_manager.cc:1403] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent bootstrapping tablet: real 0.222s	user 0.016s	sys 0.002s
I20260709 14:50:17.404445  8402 raft_consensus.cc:493] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:50:17.430056  8402 raft_consensus.cc:515] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:17.440186  7972 raft_consensus.cc:359] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:17.441185  7972 raft_consensus.cc:385] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:17.441515  7972 raft_consensus.cc:740] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Initialized, Role: FOLLOWER
I20260709 14:50:17.442258  7972 consensus_queue.cc:260] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:17.443953  7974 tablet_bootstrap.cc:492] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0: No bootstrap required, opened a new log
I20260709 14:50:17.444923  7974 ts_tablet_manager.cc:1403] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent bootstrapping tablet: real 0.200s	user 0.020s	sys 0.004s
I20260709 14:50:17.449257  7819 leader_election.cc:304] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:50:17.450199  8355 raft_consensus.cc:3060] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:17.453074  8402 leader_election.cc:290] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:17.453462  7972 ts_tablet_manager.cc:1434] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent starting tablet: real 0.026s	user 0.008s	sys 0.000s
I20260709 14:50:17.454653  7972 tablet_bootstrap.cc:492] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed: Bootstrap starting.
I20260709 14:50:17.454396  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:50:17.455857  7745 leader_election.cc:343] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:17.459502  8355 raft_consensus.cc:2749] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:50:17.462366  7971 tablet_bootstrap.cc:492] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac: No bootstrap required, opened a new log
I20260709 14:50:17.466572  7971 ts_tablet_manager.cc:1403] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent bootstrapping tablet: real 0.233s	user 0.045s	sys 0.034s
W20260709 14:50:17.467988  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 70167.2us
I20260709 14:50:17.469426  8345 consensus_queue.cc:1048] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:50:17.472539  8363 raft_consensus.cc:493] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:50:17.473070  8363 raft_consensus.cc:515] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:17.473362  7974 raft_consensus.cc:359] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:17.474260  7974 raft_consensus.cc:385] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:17.474577  7974 raft_consensus.cc:740] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Initialized, Role: FOLLOWER
I20260709 14:50:17.475512  7974 consensus_queue.cc:260] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:17.476622  8363 leader_election.cc:290] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:50:17.477468  7974 ts_tablet_manager.cc:1434] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.000s
I20260709 14:50:17.478757  7974 tablet_bootstrap.cc:492] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0: Bootstrap starting.
I20260709 14:50:17.484728  7972 tablet_bootstrap.cc:654] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:17.488307  7971 raft_consensus.cc:359] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:17.491014  8266 raft_consensus.cc:493] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:50:17.491837  8266 raft_consensus.cc:515] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:17.492923  7974 tablet_bootstrap.cc:654] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:17.482687  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:50:17.498919  8266 leader_election.cc:290] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:50:17.502247  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:50:17.504649  7971 raft_consensus.cc:385] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:17.505393  7971 raft_consensus.cc:740] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Initialized, Role: FOLLOWER
W20260709 14:50:17.507038  7894 leader_election.cc:343] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:17.510063  7971 consensus_queue.cc:260] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:50:17.510537  7894 leader_election.cc:343] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:17.513944  7971 ts_tablet_manager.cc:1434] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent starting tablet: real 0.047s	user 0.009s	sys 0.000s
I20260709 14:50:17.515705  7744 leader_election.cc:304] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:17.517012  8405 raft_consensus.cc:2804] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:50:17.517599  8405 raft_consensus.cc:493] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:50:17.517796  7974 tablet_bootstrap.cc:492] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0: No bootstrap required, opened a new log
I20260709 14:50:17.518281  8405 raft_consensus.cc:3060] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:17.518574  7974 ts_tablet_manager.cc:1403] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent bootstrapping tablet: real 0.040s	user 0.013s	sys 0.006s
I20260709 14:50:17.522068  7974 raft_consensus.cc:359] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:17.522881  7974 raft_consensus.cc:385] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:17.523159  7974 raft_consensus.cc:740] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Initialized, Role: FOLLOWER
I20260709 14:50:17.523938  7974 consensus_queue.cc:260] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:17.528067  7972 tablet_bootstrap.cc:492] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed: No bootstrap required, opened a new log
I20260709 14:50:17.528684  7972 ts_tablet_manager.cc:1403] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent bootstrapping tablet: real 0.074s	user 0.011s	sys 0.011s
I20260709 14:50:17.529489  7971 tablet_bootstrap.cc:492] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac: Bootstrap starting.
I20260709 14:50:17.532383  7972 raft_consensus.cc:359] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:17.533428  7972 raft_consensus.cc:385] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:17.533854  7972 raft_consensus.cc:740] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Initialized, Role: FOLLOWER
I20260709 14:50:17.534544  7972 consensus_queue.cc:260] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:17.526430  7974 ts_tablet_manager.cc:1434] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 14:50:17.538430  7971 tablet_bootstrap.cc:654] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:17.539206  7972 ts_tablet_manager.cc:1434] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 14:50:17.540464  7972 tablet_bootstrap.cc:492] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed: Bootstrap starting.
I20260709 14:50:17.547390  7972 tablet_bootstrap.cc:654] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:17.549898  7893 leader_election.cc:304] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:17.550943  8266 raft_consensus.cc:2804] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:50:17.551380  8266 raft_consensus.cc:493] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:50:17.551729  8266 raft_consensus.cc:3060] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:17.549834  7974 tablet_bootstrap.cc:492] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0: Bootstrap starting.
I20260709 14:50:17.559934  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:50:17.560781  7921 raft_consensus.cc:2468] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 0.
I20260709 14:50:17.565649  7974 tablet_bootstrap.cc:654] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:17.569607  8266 raft_consensus.cc:515] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:17.572067  8266 leader_election.cc:290] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:50:17.573518  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
W20260709 14:50:17.575274  7894 leader_election.cc:343] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:17.576604  8405 raft_consensus.cc:515] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:17.585743  7847 raft_consensus.cc:3060] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:17.598654  7974 tablet_bootstrap.cc:492] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0: No bootstrap required, opened a new log
I20260709 14:50:17.589331  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:50:17.590839  8405 leader_election.cc:290] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:17.599298  7974 ts_tablet_manager.cc:1403] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent bootstrapping tablet: real 0.050s	user 0.009s	sys 0.012s
W20260709 14:50:17.601926  7745 leader_election.cc:343] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:17.603282  7974 raft_consensus.cc:359] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:17.603936  7974 raft_consensus.cc:385] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:17.604121  7974 raft_consensus.cc:740] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Initialized, Role: FOLLOWER
I20260709 14:50:17.604704  7974 consensus_queue.cc:260] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:17.608441  7972 tablet_bootstrap.cc:492] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed: No bootstrap required, opened a new log
I20260709 14:50:17.609025  7971 tablet_bootstrap.cc:492] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac: No bootstrap required, opened a new log
I20260709 14:50:17.616293  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:50:17.617082  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:50:17.618753  7971 ts_tablet_manager.cc:1403] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent bootstrapping tablet: real 0.090s	user 0.030s	sys 0.003s
I20260709 14:50:17.609118  7972 ts_tablet_manager.cc:1403] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent bootstrapping tablet: real 0.069s	user 0.013s	sys 0.010s
I20260709 14:50:17.618989  7775 raft_consensus.cc:2468] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 0.
I20260709 14:50:17.614403  7974 ts_tablet_manager.cc:1434] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 14:50:17.619194  7772 raft_consensus.cc:2393] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 1: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:50:17.610394  8266 consensus_queue.cc:1048] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 14:50:17.615243  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:50:17.623822  7777 raft_consensus.cc:2468] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 0.
I20260709 14:50:17.628521  7974 tablet_bootstrap.cc:492] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0: Bootstrap starting.
I20260709 14:50:17.625836  8411 consensus_queue.cc:1048] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 14:50:17.624855  8355 raft_consensus.cc:493] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:50:17.633149  8355 raft_consensus.cc:515] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:17.642993  7972 raft_consensus.cc:359] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:17.643858  7972 raft_consensus.cc:385] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:17.644157  7972 raft_consensus.cc:740] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Initialized, Role: FOLLOWER
I20260709 14:50:17.645553  8347 raft_consensus.cc:493] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:50:17.641180  7971 raft_consensus.cc:359] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:17.647763  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:50:17.656689  8347 raft_consensus.cc:515] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:17.656988  7972 consensus_queue.cc:260] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:17.645587  8355 leader_election.cc:290] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:17.651839  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:50:17.652515  7974 tablet_bootstrap.cc:654] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:17.656721  7971 raft_consensus.cc:385] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:17.659176  7971 raft_consensus.cc:740] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Initialized, Role: FOLLOWER
I20260709 14:50:17.664294  8347 leader_election.cc:290] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:50:17.665105  7775 raft_consensus.cc:2468] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 1.
I20260709 14:50:17.665392  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:50:17.666394  7928 raft_consensus.cc:2393] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 1: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:50:17.663586  7971 consensus_queue.cc:260] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:17.673466  7893 leader_election.cc:304] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:17.677006  7893 leader_election.cc:304] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:17.679042  7971 ts_tablet_manager.cc:1434] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent starting tablet: real 0.060s	user 0.007s	sys 0.001s
I20260709 14:50:17.682862  7972 ts_tablet_manager.cc:1434] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent starting tablet: real 0.063s	user 0.007s	sys 0.001s
I20260709 14:50:17.700625  7971 tablet_bootstrap.cc:492] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac: Bootstrap starting.
I20260709 14:50:17.703140  7972 tablet_bootstrap.cc:492] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed: Bootstrap starting.
I20260709 14:50:17.687363  8363 raft_consensus.cc:2804] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:50:17.690464  8266 raft_consensus.cc:2749] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 14:50:17.707190  8363 raft_consensus.cc:493] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:50:17.707509  8421 raft_consensus.cc:493] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:50:17.707772  8363 raft_consensus.cc:3060] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:17.708070  8421 raft_consensus.cc:515] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:17.721474  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:50:17.683373  8411 consensus_queue.cc:1048] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.021s
I20260709 14:50:17.718282  7893 leader_election.cc:304] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:17.736033  8345 raft_consensus.cc:2804] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:50:17.736527  8345 raft_consensus.cc:493] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:50:17.736876  8345 raft_consensus.cc:3060] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:17.739511  7744 leader_election.cc:304] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:17.747419  8402 raft_consensus.cc:2804] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 14:50:17.803994  7894 leader_election.cc:343] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:17.805735  8421 leader_election.cc:290] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:50:17.797600  8402 raft_consensus.cc:493] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:50:17.805780  8422 raft_consensus.cc:493] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:50:17.807952  8362 raft_consensus.cc:493] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:50:17.818655  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 128842us
I20260709 14:50:17.813871  8402 raft_consensus.cc:3060] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:17.814425  8422 raft_consensus.cc:515] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:17.816537  8362 raft_consensus.cc:515] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:17.843621  7819 leader_election.cc:304] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:50:17.838644  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:50:17.885020  7972 tablet_bootstrap.cc:654] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:17.868357  8361 raft_consensus.cc:2804] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 14:50:17.892733  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 174459us
W20260709 14:50:17.898715  7894 leader_election.cc:343] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:17.905079  8362 leader_election.cc:290] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:17.889690  8361 raft_consensus.cc:493] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:50:17.922407  7971 tablet_bootstrap.cc:654] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:17.924283  7974 tablet_bootstrap.cc:492] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0: No bootstrap required, opened a new log
I20260709 14:50:17.924796  7974 ts_tablet_manager.cc:1403] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0: Time spent bootstrapping tablet: real 0.297s	user 0.013s	sys 0.010s
I20260709 14:50:17.911988  8358 raft_consensus.cc:493] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:50:17.923637  8361 raft_consensus.cc:3060] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:17.943547  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:50:17.948865  8345 raft_consensus.cc:515] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:50:17.961673  7745 leader_election.cc:343] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:17.953197  8363 raft_consensus.cc:515] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:17.978237  8363 leader_election.cc:290] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:50:17.985813  7974 raft_consensus.cc:359] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:17.986781  7974 raft_consensus.cc:385] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:17.987087  7974 raft_consensus.cc:740] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Initialized, Role: FOLLOWER
I20260709 14:50:17.939703  8358 raft_consensus.cc:515] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:17.997167  7974 consensus_queue.cc:260] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:17.962718  8351 raft_consensus.cc:493] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:50:18.015116  8358 leader_election.cc:290] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:18.016456  8423 raft_consensus.cc:493] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:50:18.017182  8423 raft_consensus.cc:515] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:18.027007  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
W20260709 14:50:18.030937  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 73612.2us
I20260709 14:50:18.036434  7974 ts_tablet_manager.cc:1434] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0: Time spent starting tablet: real 0.111s	user 0.009s	sys 0.001s
I20260709 14:50:18.057193  7744 leader_election.cc:304] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:18.004323  8351 raft_consensus.cc:515] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:18.030895  7923 raft_consensus.cc:2468] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 0.
I20260709 14:50:18.072892  8362 raft_consensus.cc:2749] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 14:50:18.105430  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:50:18.106200  7927 raft_consensus.cc:2468] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 0.
W20260709 14:50:18.114850  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 75247.3us
W20260709 14:50:18.115294  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 45247.2us
I20260709 14:50:18.115974  7972 tablet_bootstrap.cc:492] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed: No bootstrap required, opened a new log
I20260709 14:50:18.117024  7972 ts_tablet_manager.cc:1403] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent bootstrapping tablet: real 0.426s	user 0.012s	sys 0.026s
I20260709 14:50:18.130831  8402 raft_consensus.cc:515] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:18.133031  8402 leader_election.cc:290] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:18.138455  8423 leader_election.cc:290] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:18.164448  7972 raft_consensus.cc:359] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:18.170177  7972 raft_consensus.cc:385] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:18.170928  7972 raft_consensus.cc:740] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Initialized, Role: FOLLOWER
I20260709 14:50:18.172056  7972 consensus_queue.cc:260] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:18.166055  7971 tablet_bootstrap.cc:492] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac: No bootstrap required, opened a new log
I20260709 14:50:18.174041  7971 ts_tablet_manager.cc:1403] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent bootstrapping tablet: real 0.474s	user 0.016s	sys 0.018s
W20260709 14:50:18.176947  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 46900.8us
I20260709 14:50:18.187875  7971 raft_consensus.cc:359] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:18.178369  8351 leader_election.cc:290] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:18.191854  7971 raft_consensus.cc:385] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:18.194808  7971 raft_consensus.cc:740] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Initialized, Role: FOLLOWER
I20260709 14:50:18.214828  8345 leader_election.cc:290] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:50:18.190500  8361 raft_consensus.cc:515] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:18.221874  7972 ts_tablet_manager.cc:1434] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent starting tablet: real 0.104s	user 0.007s	sys 0.004s
I20260709 14:50:18.223374  7845 raft_consensus.cc:1240] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 1. Current term is 2. Ops: []
I20260709 14:50:18.230016  7971 consensus_queue.cc:260] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:18.239298  8361 leader_election.cc:290] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 2 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:18.239974  7971 ts_tablet_manager.cc:1434] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent starting tablet: real 0.065s	user 0.004s	sys 0.004s
I20260709 14:50:18.241976  7974 tablet_bootstrap.cc:492] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0: Bootstrap starting.
I20260709 14:50:18.242211  7744 leader_election.cc:304] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:18.243352  7744 leader_election.cc:304] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:50:18.243852  8401 raft_consensus.cc:2804] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:50:18.252138  8401 raft_consensus.cc:493] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:50:18.260241  7971 tablet_bootstrap.cc:492] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac: Bootstrap starting.
I20260709 14:50:18.261746  7972 tablet_bootstrap.cc:492] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed: Bootstrap starting.
I20260709 14:50:18.257807  8362 raft_consensus.cc:2804] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:50:18.262981  8362 raft_consensus.cc:493] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:50:18.263392  8362 raft_consensus.cc:3060] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:18.252661  8401 raft_consensus.cc:3060] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:18.264264  8422 leader_election.cc:290] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:50:18.290060  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:50:18.290395  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:50:18.289901  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:50:18.292855  7777 raft_consensus.cc:2468] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 0.
I20260709 14:50:18.308589  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:50:18.309435  7771 raft_consensus.cc:3060] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:18.334131  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:50:18.335249  7924 raft_consensus.cc:3060] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:18.345638  8422 consensus_queue.cc:1059] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 14:50:18.358577  8422 raft_consensus.cc:3055] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 14:50:18.359025  8422 raft_consensus.cc:740] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:50:18.354212  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
W20260709 14:50:18.372038  7894 leader_election.cc:343] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:18.373958  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:50:18.375005  7777 raft_consensus.cc:3060] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:18.375540  7972 tablet_bootstrap.cc:654] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:18.402508  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
W20260709 14:50:18.406451  7894 leader_election.cc:343] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:18.408913  7971 tablet_bootstrap.cc:654] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:18.414307  7924 raft_consensus.cc:2468] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 1.
I20260709 14:50:18.404875  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:50:18.424749  7974 tablet_bootstrap.cc:654] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:18.480425  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
W20260709 14:50:18.419816  7893 leader_election.cc:343] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:18.484474  7893 leader_election.cc:304] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:50:18.485937  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 81693.5us
I20260709 14:50:18.486873  7893 leader_election.cc:304] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:18.489341  7777 raft_consensus.cc:2468] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 1.
I20260709 14:50:18.489691  8362 raft_consensus.cc:515] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:18.490427  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:50:18.490499  7771 raft_consensus.cc:2468] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 1.
I20260709 14:50:18.481509  7778 raft_consensus.cc:2393] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 1: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:50:18.501835  8437 raft_consensus.cc:2749] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:50:18.507369  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:50:18.513278  8424 consensus_queue.cc:1048] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 14:50:18.517413  7776 raft_consensus.cc:2393] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 1: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:50:18.521874  7893 leader_election.cc:304] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:18.503095  8345 raft_consensus.cc:2804] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:50:18.529042  8345 raft_consensus.cc:493] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:50:18.529639  8345 raft_consensus.cc:3060] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:18.527230  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:50:18.534650  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:50:18.522782  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:50:18.539059  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:50:18.539721  8435 raft_consensus.cc:493] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:50:18.544589  7924 raft_consensus.cc:2393] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 1: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:50:18.544821  8362 leader_election.cc:290] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:18.545154  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:50:18.434437  8401 raft_consensus.cc:515] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:18.531931  7774 raft_consensus.cc:2393] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 1: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
W20260709 14:50:18.557940  7725 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 14:50:18.428814  8422 consensus_queue.cc:260] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:18.577744  8401 leader_election.cc:290] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:18.561975  7848 raft_consensus.cc:3060] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:18.553001  8435 raft_consensus.cc:515] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:18.579200  7925 raft_consensus.cc:2393] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 1: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:50:18.552650  8443 raft_consensus.cc:2804] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:50:18.590132  8435 leader_election.cc:290] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:50:18.553898  8345 raft_consensus.cc:515] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:18.593632  8443 raft_consensus.cc:697] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:50:18.598241  7744 leader_election.cc:304] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:50:18.599787  7972 tablet_bootstrap.cc:492] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed: No bootstrap required, opened a new log
I20260709 14:50:18.600564  7972 ts_tablet_manager.cc:1403] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent bootstrapping tablet: real 0.360s	user 0.062s	sys 0.043s
I20260709 14:50:18.602231  8431 raft_consensus.cc:2804] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:50:18.602926  8431 raft_consensus.cc:697] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:50:18.604784  8345 leader_election.cc:290] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:50:18.594818  8443 consensus_queue.cc:237] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:18.614960  7971 tablet_bootstrap.cc:492] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac: No bootstrap required, opened a new log
I20260709 14:50:18.615549  7971 ts_tablet_manager.cc:1403] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent bootstrapping tablet: real 0.356s	user 0.026s	sys 0.034s
I20260709 14:50:18.616559  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
W20260709 14:50:18.625716  7894 leader_election.cc:343] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:18.625744  7893 leader_election.cc:304] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:18.631461  7893 leader_election.cc:304] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:18.632718  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:50:18.637099  7770 raft_consensus.cc:3060] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:18.632723  8411 raft_consensus.cc:2804] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:50:18.633318  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:50:18.639606  8411 raft_consensus.cc:697] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:50:18.622983  7848 raft_consensus.cc:2468] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 1.
I20260709 14:50:18.660562  8411 consensus_queue.cc:237] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:18.640455  7920 raft_consensus.cc:3060] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Advancing to term 1
W20260709 14:50:18.668766  7745 leader_election.cc:343] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:18.651347  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:50:18.668068  7893 leader_election.cc:343] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:18.603770  8431 consensus_queue.cc:237] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:18.686437  7972 raft_consensus.cc:359] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:18.705273  7972 raft_consensus.cc:385] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:18.705639  7972 raft_consensus.cc:740] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Initialized, Role: FOLLOWER
I20260709 14:50:18.714526  7972 consensus_queue.cc:260] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:50:18.716977  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 90405.2us
I20260709 14:50:18.676141  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:50:18.684541  8432 raft_consensus.cc:493] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:50:18.710758  7971 raft_consensus.cc:359] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:18.726226  7971 raft_consensus.cc:385] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:18.726617  7971 raft_consensus.cc:740] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Initialized, Role: FOLLOWER
I20260709 14:50:18.727350  7971 consensus_queue.cc:260] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:18.682778  8422 raft_consensus.cc:3060] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:18.729410  7972 ts_tablet_manager.cc:1434] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent starting tablet: real 0.128s	user 0.012s	sys 0.000s
W20260709 14:50:18.730170  7894 leader_election.cc:343] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:18.735095  7894 leader_election.cc:304] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:18.730180  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:50:18.734476  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:50:18.748970  7926 raft_consensus.cc:3060] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:18.738615  8430 raft_consensus.cc:2749] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:50:18.761376  7972 tablet_bootstrap.cc:492] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed: Bootstrap starting.
I20260709 14:50:18.734306  8432 raft_consensus.cc:515] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:18.769680  8432 leader_election.cc:290] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:18.764108  7845 raft_consensus.cc:3060] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:18.772464  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:50:18.747856  8361 raft_consensus.cc:493] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:50:18.800163  7971 ts_tablet_manager.cc:1434] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent starting tablet: real 0.184s	user 0.012s	sys 0.009s
I20260709 14:50:18.808583  7770 raft_consensus.cc:2468] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 1.
W20260709 14:50:18.811915  7744 leader_election.cc:343] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785): Illegal state: must be running to vote when last-logged opid is not known
W20260709 14:50:18.815231  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 92067.4us
I20260709 14:50:18.816450  7819 leader_election.cc:304] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:50:18.817947  7971 tablet_bootstrap.cc:492] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac: Bootstrap starting.
I20260709 14:50:18.819346  7819 leader_election.cc:304] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:50:18.824295  7920 raft_consensus.cc:2468] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 1.
I20260709 14:50:18.825507  8448 raft_consensus.cc:3060] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:18.825670  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:50:18.825536  8421 raft_consensus.cc:2749] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:50:18.835027  7893 leader_election.cc:304] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:50:18.836179  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:50:18.836483  8443 raft_consensus.cc:2804] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:50:18.837337  8443 raft_consensus.cc:697] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:50:18.838231  8443 consensus_queue.cc:237] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:18.793695  8361 raft_consensus.cc:515] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:50:18.848379  7745 leader_election.cc:343] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:18.847067  7926 raft_consensus.cc:2468] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 1.
I20260709 14:50:18.851186  7854 raft_consensus.cc:3060] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:18.852600  7974 tablet_bootstrap.cc:492] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0: No bootstrap required, opened a new log
I20260709 14:50:18.853185  7974 ts_tablet_manager.cc:1403] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent bootstrapping tablet: real 0.612s	user 0.044s	sys 0.060s
I20260709 14:50:18.859112  8459 raft_consensus.cc:2749] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:50:18.860405  8361 leader_election.cc:290] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:18.869954  7921 raft_consensus.cc:2468] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 2.
I20260709 14:50:18.872387  7974 raft_consensus.cc:359] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:18.876472  7974 raft_consensus.cc:385] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:18.876981  7974 raft_consensus.cc:740] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Initialized, Role: FOLLOWER
I20260709 14:50:18.874626  8448 raft_consensus.cc:2749] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:50:18.880772  7974 consensus_queue.cc:260] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:18.888574  8422 raft_consensus.cc:493] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:50:18.889010  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:50:18.889547  8422 raft_consensus.cc:515] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:18.890535  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:50:18.889958  7778 raft_consensus.cc:2393] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 1: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:50:18.898541  7845 raft_consensus.cc:2468] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 1.
I20260709 14:50:18.903216  7854 raft_consensus.cc:2468] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 1.
I20260709 14:50:18.903966  8422 leader_election.cc:290] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:50:18.909307  7745 leader_election.cc:343] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:18.913318  7745 leader_election.cc:304] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:18.917977  7972 tablet_bootstrap.cc:654] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:18.919997  8405 raft_consensus.cc:2749] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:50:18.921775  7744 leader_election.cc:304] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:18.923017  8405 raft_consensus.cc:2804] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:50:18.923594  8405 raft_consensus.cc:697] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:50:18.924469  7974 ts_tablet_manager.cc:1434] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent starting tablet: real 0.071s	user 0.008s	sys 0.000s
I20260709 14:50:18.924572  8405 consensus_queue.cc:237] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:18.925987  7974 tablet_bootstrap.cc:492] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0: Bootstrap starting.
I20260709 14:50:18.934549  7971 tablet_bootstrap.cc:654] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:18.933998  7673 catalog_manager.cc:5697] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 0 to 1, leader changed from <none> to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 1 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:50:18.937283  7744 leader_election.cc:304] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:50:18.939610  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:50:18.942269  8432 raft_consensus.cc:2804] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Leader election won for term 1
W20260709 14:50:18.942607  7894 leader_election.cc:343] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:18.943006  8432 raft_consensus.cc:697] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:50:18.944068  8432 consensus_queue.cc:237] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:18.947918  7974 tablet_bootstrap.cc:654] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:18.954594  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
W20260709 14:50:18.960152  7893 leader_election.cc:343] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:18.962146  7893 leader_election.cc:304] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:18.963210  8422 raft_consensus.cc:2749] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 14:50:18.974534  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 54987.5us
I20260709 14:50:18.978183  7971 tablet_bootstrap.cc:492] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac: No bootstrap required, opened a new log
I20260709 14:50:18.980298  7819 leader_election.cc:304] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:50:18.989102  8460 raft_consensus.cc:2804] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:50:18.989902  8460 raft_consensus.cc:697] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:50:18.991138  8460 consensus_queue.cc:237] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:19.000502  7974 tablet_bootstrap.cc:492] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0: No bootstrap required, opened a new log
I20260709 14:50:19.001374  7974 ts_tablet_manager.cc:1403] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent bootstrapping tablet: real 0.076s	user 0.015s	sys 0.002s
I20260709 14:50:18.982120  7971 ts_tablet_manager.cc:1403] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent bootstrapping tablet: real 0.171s	user 0.015s	sys 0.006s
I20260709 14:50:19.011591  7974 raft_consensus.cc:359] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:19.012400  7974 raft_consensus.cc:385] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:19.012672  7974 raft_consensus.cc:740] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Initialized, Role: FOLLOWER
I20260709 14:50:19.008144  7819 leader_election.cc:304] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:50:19.022059  7974 consensus_queue.cc:260] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:19.026093  8459 raft_consensus.cc:2749] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:50:19.047199  7971 raft_consensus.cc:359] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:19.048637  7971 raft_consensus.cc:385] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:19.049378  7971 raft_consensus.cc:740] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Initialized, Role: FOLLOWER
I20260709 14:50:19.050779  7974 ts_tablet_manager.cc:1434] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent starting tablet: real 0.049s	user 0.009s	sys 0.000s
I20260709 14:50:19.052040  7974 tablet_bootstrap.cc:492] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0: Bootstrap starting.
I20260709 14:50:19.055084  7972 tablet_bootstrap.cc:492] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed: No bootstrap required, opened a new log
I20260709 14:50:19.056155  7972 ts_tablet_manager.cc:1403] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent bootstrapping tablet: real 0.309s	user 0.028s	sys 0.008s
I20260709 14:50:19.057440  7971 consensus_queue.cc:260] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:19.065655  7971 ts_tablet_manager.cc:1434] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent starting tablet: real 0.063s	user 0.005s	sys 0.004s
I20260709 14:50:19.066991  7676 catalog_manager.cc:5697] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 1 to 2, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 2 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:50:19.074533  7974 tablet_bootstrap.cc:654] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:19.068944  7675 catalog_manager.cc:5697] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 1 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:50:19.076937  7675 catalog_manager.cc:5697] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 1 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:50:19.074519  7972 raft_consensus.cc:359] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:19.078967  7675 catalog_manager.cc:5697] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 1 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:50:19.080327  7972 raft_consensus.cc:385] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:19.081064  7972 raft_consensus.cc:740] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Initialized, Role: FOLLOWER
I20260709 14:50:19.078074  7971 tablet_bootstrap.cc:492] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac: Bootstrap starting.
I20260709 14:50:19.088392  7972 consensus_queue.cc:260] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:19.091738  7972 ts_tablet_manager.cc:1434] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent starting tablet: real 0.035s	user 0.009s	sys 0.000s
I20260709 14:50:19.093180  7972 tablet_bootstrap.cc:492] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed: Bootstrap starting.
I20260709 14:50:19.097535  7971 tablet_bootstrap.cc:654] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:19.114063  7974 tablet_bootstrap.cc:492] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0: No bootstrap required, opened a new log
I20260709 14:50:19.114638  7974 ts_tablet_manager.cc:1403] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0: Time spent bootstrapping tablet: real 0.063s	user 0.014s	sys 0.006s
I20260709 14:50:19.118250  7974 raft_consensus.cc:359] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:19.119065  7974 raft_consensus.cc:385] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:19.119585  7974 raft_consensus.cc:740] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Initialized, Role: FOLLOWER
I20260709 14:50:19.118834  7972 tablet_bootstrap.cc:654] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:19.129338  7971 tablet_bootstrap.cc:492] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac: No bootstrap required, opened a new log
I20260709 14:50:19.136222  7971 ts_tablet_manager.cc:1403] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent bootstrapping tablet: real 0.061s	user 0.021s	sys 0.012s
I20260709 14:50:19.132881  7974 consensus_queue.cc:260] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:19.159184  8405 raft_consensus.cc:493] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:50:19.160094  8405 raft_consensus.cc:515] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:19.164575  7971 raft_consensus.cc:359] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:19.166080  7971 raft_consensus.cc:385] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:19.166417  7971 raft_consensus.cc:740] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Initialized, Role: FOLLOWER
I20260709 14:50:19.167177  7971 consensus_queue.cc:260] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:19.170514  7971 ts_tablet_manager.cc:1434] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent starting tablet: real 0.034s	user 0.021s	sys 0.001s
I20260709 14:50:19.172899  7971 tablet_bootstrap.cc:492] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac: Bootstrap starting.
I20260709 14:50:19.173681  7974 ts_tablet_manager.cc:1434] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0: Time spent starting tablet: real 0.059s	user 0.007s	sys 0.004s
I20260709 14:50:19.197409  8405 leader_election.cc:290] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:19.203860  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:50:19.210897  7924 raft_consensus.cc:2468] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 0.
I20260709 14:50:19.213124  7744 leader_election.cc:304] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:50:19.214810  8444 raft_consensus.cc:2804] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:50:19.215368  8444 raft_consensus.cc:493] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:50:19.215849  8444 raft_consensus.cc:3060] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:19.204241  8405 raft_consensus.cc:493] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:50:19.214841  7848 raft_consensus.cc:3060] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:19.217626  8405 raft_consensus.cc:515] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:19.203657  8422 raft_consensus.cc:493] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:50:19.218794  8422 raft_consensus.cc:515] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:19.234800  7845 raft_consensus.cc:3060] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:19.206394  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:50:19.238261  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:50:19.249943  7745 leader_election.cc:343] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Illegal state: must be running to vote when last-logged opid is not known
W20260709 14:50:19.252748  7745 leader_election.cc:343] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:19.246286  8421 consensus_queue.cc:1048] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 14:50:19.268577  8345 consensus_queue.cc:1048] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 14:50:19.274750  8421 consensus_queue.cc:1048] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 14:50:19.265102  8405 leader_election.cc:290] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:19.287927  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:50:19.288695  7772 raft_consensus.cc:2468] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 0.
I20260709 14:50:19.289933  7972 tablet_bootstrap.cc:492] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed: No bootstrap required, opened a new log
I20260709 14:50:19.290522  7972 ts_tablet_manager.cc:1403] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent bootstrapping tablet: real 0.198s	user 0.038s	sys 0.025s
I20260709 14:50:19.293310  8345 consensus_queue.cc:1048] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:50:19.294899  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:50:19.295725  7921 raft_consensus.cc:2468] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 0.
I20260709 14:50:19.304207  7972 raft_consensus.cc:359] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:19.271598  8444 raft_consensus.cc:515] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:19.305126  7972 raft_consensus.cc:385] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:19.308949  7972 raft_consensus.cc:740] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Initialized, Role: FOLLOWER
I20260709 14:50:19.309803  7972 consensus_queue.cc:260] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:19.318168  7972 ts_tablet_manager.cc:1434] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.000s
I20260709 14:50:19.320241  7972 tablet_bootstrap.cc:492] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed: Bootstrap starting.
I20260709 14:50:19.295768  7893 leader_election.cc:304] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:50:19.322510  8345 raft_consensus.cc:2804] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:50:19.323180  8345 raft_consensus.cc:493] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:50:19.323611  8345 raft_consensus.cc:3060] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:19.325318  7971 tablet_bootstrap.cc:654] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:19.331456  7744 leader_election.cc:304] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:19.330089  7676 catalog_manager.cc:5697] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 0 to 1, leader changed from <none> to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 1 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:50:19.342221  7676 catalog_manager.cc:5697] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 0 to 1, leader changed from <none> to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 1 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:50:19.336144  8460 raft_consensus.cc:493] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:50:19.347002  8431 raft_consensus.cc:2804] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:50:19.354910  8422 leader_election.cc:290] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:50:19.341974  8430 consensus_queue.cc:1048] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.019s
I20260709 14:50:19.363478  8431 raft_consensus.cc:493] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:50:19.358301  8460 raft_consensus.cc:515] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:19.383498  8431 raft_consensus.cc:3060] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:19.398252  8356 consensus_queue.cc:1048] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.020s
I20260709 14:50:19.414397  8444 leader_election.cc:290] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:19.430480  8400 consensus_queue.cc:1048] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 14:50:19.454140  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:50:19.442871  8421 raft_consensus.cc:493] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:50:19.468816  8345 raft_consensus.cc:515] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:19.446369  8445 consensus_queue.cc:1048] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.024s
I20260709 14:50:19.475365  8345 leader_election.cc:290] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:50:19.470706  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:50:19.478472  7926 raft_consensus.cc:3060] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:19.490968  7927 raft_consensus.cc:1275] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:50:19.491549  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:50:19.470984  8421 raft_consensus.cc:515] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:19.494380  7972 tablet_bootstrap.cc:654] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed: Neither blocks nor log segments found. Creating new log.
W20260709 14:50:19.496696  7894 leader_election.cc:343] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:19.501073  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:50:19.501935  7774 raft_consensus.cc:3060] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:19.519384  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:50:19.528658  7894 leader_election.cc:343] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Illegal state: must be running to vote when last-logged opid is not known
W20260709 14:50:19.544833  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 47639.9us
W20260709 14:50:19.546020  7745 leader_election.cc:343] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:19.548086  7778 raft_consensus.cc:3060] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:19.603143  7971 tablet_bootstrap.cc:492] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac: No bootstrap required, opened a new log
I20260709 14:50:19.566847  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:50:19.604051  7971 ts_tablet_manager.cc:1403] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent bootstrapping tablet: real 0.431s	user 0.017s	sys 0.017s
I20260709 14:50:19.604924  7926 raft_consensus.cc:2468] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 1.
I20260709 14:50:19.563058  7774 raft_consensus.cc:2468] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 1.
I20260709 14:50:19.596390  8421 leader_election.cc:290] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:50:19.553846  8483 consensus_queue.cc:1048] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.048s
I20260709 14:50:19.603425  8460 leader_election.cc:290] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:19.638055  7893 leader_election.cc:304] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:19.614372  7770 raft_consensus.cc:2468] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 1.
I20260709 14:50:19.644600  8444 raft_consensus.cc:493] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:50:19.657047  7971 raft_consensus.cc:359] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:19.657886  7971 raft_consensus.cc:385] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:19.658178  7971 raft_consensus.cc:740] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Initialized, Role: FOLLOWER
I20260709 14:50:19.658934  7971 consensus_queue.cc:260] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:19.648267  8484 raft_consensus.cc:2804] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:50:19.670945  7971 ts_tablet_manager.cc:1434] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent starting tablet: real 0.064s	user 0.009s	sys 0.000s
I20260709 14:50:19.654902  8444 raft_consensus.cc:515] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:19.667505  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:50:19.672029  8484 raft_consensus.cc:697] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
W20260709 14:50:19.730270  8493 log.cc:927] Time spent T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 14:50:19.740432  7744 leader_election.cc:304] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:19.741104  8484 consensus_queue.cc:237] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:19.746498  7778 raft_consensus.cc:1275] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:50:19.747542  8483 raft_consensus.cc:493] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:50:19.748114  8483 raft_consensus.cc:515] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:19.752619  8444 leader_election.cc:290] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:19.754753  8494 raft_consensus.cc:2804] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:50:19.755826  8494 raft_consensus.cc:697] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:50:19.756292  8431 raft_consensus.cc:515] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:19.758492  8483 leader_election.cc:290] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:19.759478  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:50:19.760254  7845 raft_consensus.cc:2468] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 1.
I20260709 14:50:19.760572  8431 leader_election.cc:290] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:50:19.762519  7725 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 14:50:19.765743  8345 consensus_queue.cc:1048] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 14:50:19.769579  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:50:19.756844  8494 consensus_queue.cc:237] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:19.789141  8482 consensus_queue.cc:1048] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:50:19.815735  7893 leader_election.cc:304] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:50:19.823482  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:50:19.824288  7924 raft_consensus.cc:2468] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 0.
I20260709 14:50:19.826907  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:50:19.827495  7927 raft_consensus.cc:3060] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:19.817848  8430 raft_consensus.cc:2804] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 14:50:19.829788  8503 raft_consensus.cc:493] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:50:19.832924  8503 raft_consensus.cc:515] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:19.836025  8503 leader_election.cc:290] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:19.845279  7972 tablet_bootstrap.cc:492] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed: No bootstrap required, opened a new log
I20260709 14:50:19.848698  7972 ts_tablet_manager.cc:1403] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent bootstrapping tablet: real 0.529s	user 0.021s	sys 0.011s
I20260709 14:50:19.852782  7819 leader_election.cc:304] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:50:19.860894  7927 raft_consensus.cc:2468] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 1.
I20260709 14:50:19.864568  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:50:19.831017  8430 raft_consensus.cc:493] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 14:50:19.898800  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 47111.5us
I20260709 14:50:19.873064  8430 raft_consensus.cc:3060] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:19.908427  7971 tablet_bootstrap.cc:492] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac: Bootstrap starting.
I20260709 14:50:19.908563  7744 leader_election.cc:304] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:50:19.920727  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:50:19.940315  7972 raft_consensus.cc:359] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:19.941025  7971 tablet_bootstrap.cc:654] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:19.941646  7972 raft_consensus.cc:385] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:19.942005  7972 raft_consensus.cc:740] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Initialized, Role: FOLLOWER
I20260709 14:50:19.942682  7972 consensus_queue.cc:260] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:19.918982  8431 raft_consensus.cc:2804] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:50:19.946017  8431 raft_consensus.cc:493] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:50:19.951309  8431 raft_consensus.cc:3060] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:19.958607  7972 ts_tablet_manager.cc:1434] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent starting tablet: real 0.110s	user 0.009s	sys 0.000s
I20260709 14:50:19.957955  8488 raft_consensus.cc:2749] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 14:50:19.958815  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 46101.8us
W20260709 14:50:20.014659  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 50849.1us
I20260709 14:50:20.040331  8431 raft_consensus.cc:515] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:20.059705  8431 leader_election.cc:290] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:20.062664  7744 leader_election.cc:304] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:50:20.065572  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:50:20.069527  8430 raft_consensus.cc:515] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:20.071893  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:50:20.073679  7849 raft_consensus.cc:3060] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:20.073988  8503 consensus_queue.cc:1048] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:50:20.074952  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:50:20.075662  7845 raft_consensus.cc:3060] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:20.075686  8503 raft_consensus.cc:2804] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:50:20.079938  8503 raft_consensus.cc:697] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:50:20.081086  8503 consensus_queue.cc:237] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:20.082700  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:50:20.088155  7845 raft_consensus.cc:2468] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 2.
I20260709 14:50:20.089885  7894 leader_election.cc:304] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:50:20.091390  8505 raft_consensus.cc:2804] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:50:20.092221  8505 raft_consensus.cc:697] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:50:20.072064  8430 leader_election.cc:290] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 2 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:50:20.093178  8505 consensus_queue.cc:237] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:20.114701  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:50:20.129004  7819 leader_election.cc:304] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:50:20.132908  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:50:20.134239  7777 raft_consensus.cc:3060] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Advancing to term 2
W20260709 14:50:20.145156  7745 leader_election.cc:343] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:20.150784  7971 tablet_bootstrap.cc:492] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac: No bootstrap required, opened a new log
I20260709 14:50:20.151470  7971 ts_tablet_manager.cc:1403] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent bootstrapping tablet: real 0.243s	user 0.028s	sys 0.000s
I20260709 14:50:20.162169  8445 consensus_queue.cc:1048] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:50:20.164788  7971 raft_consensus.cc:359] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:20.168635  7971 raft_consensus.cc:385] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:20.169801  7971 raft_consensus.cc:740] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Initialized, Role: FOLLOWER
I20260709 14:50:20.171038  7971 consensus_queue.cc:260] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:50:20.166966  7745 leader_election.cc:343] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:50:20.166044  8445 raft_consensus.cc:493] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:50:20.175441  7971 ts_tablet_manager.cc:1434] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.000s
I20260709 14:50:20.192312  7971 tablet_bootstrap.cc:492] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac: Bootstrap starting.
I20260709 14:50:20.169828  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:50:20.198040  7744 leader_election.cc:304] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:50:20.200589  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 45494.6us
I20260709 14:50:20.200774  8428 consensus_queue.cc:1048] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 14:50:20.191509  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:50:20.204847  8482 raft_consensus.cc:493] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:50:20.206897  7922 raft_consensus.cc:3060] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:20.272743  8356 raft_consensus.cc:2749] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 14:50:20.189786  8445 raft_consensus.cc:515] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:20.290992  8513 raft_consensus.cc:2749] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:50:20.285192  8482 raft_consensus.cc:515] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:50:20.442618  8523 log.cc:927] Time spent T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.101s	user 0.000s	sys 0.002s
W20260709 14:50:20.519521  8520 log.cc:927] Time spent T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 14:50:20.446712  7845 raft_consensus.cc:3060] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:20.531657  7971 tablet_bootstrap.cc:654] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:20.441787  7777 raft_consensus.cc:2468] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 2.
I20260709 14:50:20.569496  8445 leader_election.cc:290] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:20.570802  8482 leader_election.cc:290] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:50:20.863130  7894 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.034s	sys 0.030s
W20260709 14:50:20.865090  7894 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.586s	user 0.034s	sys 0.030s
W20260709 14:50:20.883776  7920 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.592s	user 0.064s	sys 0.104s
W20260709 14:50:20.887180  7920 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.597s	user 0.064s	sys 0.105s
W20260709 14:50:20.892678  7922 consensus_meta.cc:287] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent flushing consensus metadata: real 0.599s	user 0.007s	sys 0.004s
I20260709 14:50:20.915323  7971 tablet_bootstrap.cc:492] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac: No bootstrap required, opened a new log
I20260709 14:50:20.916889  7971 ts_tablet_manager.cc:1403] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent bootstrapping tablet: real 0.725s	user 0.024s	sys 0.026s
I20260709 14:50:20.903975  7922 raft_consensus.cc:2468] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 1.
I20260709 14:50:20.933012  8498 raft_consensus.cc:493] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:50:20.933693  8498 raft_consensus.cc:515] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:20.936105  7971 raft_consensus.cc:359] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:20.938182  7971 raft_consensus.cc:385] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:20.939265  7971 raft_consensus.cc:740] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Initialized, Role: FOLLOWER
I20260709 14:50:20.940207  7971 consensus_queue.cc:260] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:20.945732  7971 ts_tablet_manager.cc:1434] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent starting tablet: real 0.028s	user 0.009s	sys 0.000s
I20260709 14:50:21.019243  7845 raft_consensus.cc:2468] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 1.
W20260709 14:50:21.140399  8517 log.cc:927] Time spent T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.979s	user 0.016s	sys 0.013s
I20260709 14:50:21.161973  8422 raft_consensus.cc:493] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:50:21.162678  8422 raft_consensus.cc:515] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:21.164911  8422 leader_election.cc:290] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:50:21.183348  7744 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.984s	user 0.032s	sys 0.018s
W20260709 14:50:21.184051  7744 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.985s	user 0.033s	sys 0.018s
W20260709 14:50:21.184739  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 986749us
I20260709 14:50:21.197805  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:50:21.198858  7927 raft_consensus.cc:2393] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 1: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:50:21.209600  8362 raft_consensus.cc:493] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:50:21.210359  8362 raft_consensus.cc:515] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:21.212631  8362 leader_election.cc:290] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:21.219548  8443 raft_consensus.cc:493] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:50:21.220292  8443 raft_consensus.cc:515] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:21.220980  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:50:21.221581  7854 raft_consensus.cc:1275] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 14:50:21.221901  7771 raft_consensus.cc:2393] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 1: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:50:21.227313  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:50:21.230623  8527 raft_consensus.cc:493] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:50:21.231642  8527 raft_consensus.cc:515] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:21.237741  8443 leader_election.cc:290] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:50:21.241714  7894 consensus_peers.cc:597] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Couldn't send request to peer 3876b8ee8d744cb18e91d97aae93b1ac. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:50:21.245204  8345 consensus_queue.cc:1048] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:50:21.247920  8527 leader_election.cc:290] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:21.252628  8422 raft_consensus.cc:493] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:50:21.253291  8422 raft_consensus.cc:515] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:21.254386  8443 raft_consensus.cc:493] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:50:21.254913  8443 raft_consensus.cc:515] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:21.255421  8422 leader_election.cc:290] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:50:21.260531  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:50:21.261345  7921 raft_consensus.cc:2468] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 0.
I20260709 14:50:21.263063  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:50:21.265386  7971 tablet_bootstrap.cc:492] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac: Bootstrap starting.
W20260709 14:50:21.274945  7745 consensus_peers.cc:597] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed -> Peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Couldn't send request to peer 3876b8ee8d744cb18e91d97aae93b1ac. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:50:21.274102  7772 raft_consensus.cc:1275] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 14:50:21.269433  8443 leader_election.cc:290] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:50:21.287259  7971 tablet_bootstrap.cc:654] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:21.306321  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:50:21.307474  8529 raft_consensus.cc:493] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:50:21.306339  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 46280.7us
I20260709 14:50:21.310309  7845 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 437) took 1157 ms. Trace:
I20260709 14:50:21.311407  7845 rpcz_store.cc:276] 0709 14:50:20.152820 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:50:20.153743 (+   923us) service_pool.cc:224] Handling call
0709 14:50:21.310095 (+1156352us) spinlock_profiling.cc:243] Waited 171 ms on lock 0x7b540020eed4. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae922fa 00007fb68fe53b17 00007fb6893ce6d4 00007fb6893ce662 00007fb6893ce591 00007fb6893ce50c 00007fb6893cd7c2 00007fb6891c948c 00007fb6891c88c6 00007fb6891c826f
0709 14:50:21.310209 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":394050944}
I20260709 14:50:21.316968  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:50:21.308319  8529 raft_consensus.cc:515] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:21.318977  8503 raft_consensus.cc:493] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:50:21.319706  8503 raft_consensus.cc:515] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:21.320395  8529 leader_election.cc:290] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:21.322470  8503 leader_election.cc:290] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:21.328696  8345 raft_consensus.cc:493] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:50:21.329322  8345 raft_consensus.cc:515] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:21.329888  7676 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54364 (request call id 102) took 1518 ms. Trace:
I20260709 14:50:21.330384  7676 rpcz_store.cc:276] 0709 14:50:19.811353 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:50:19.811545 (+   192us) service_pool.cc:224] Handling call
0709 14:50:21.329762 (+1518217us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":152292,"reported_tablets":1}
I20260709 14:50:21.331352  8345 leader_election.cc:290] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:50:21.331773  7744 leader_election.cc:304] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:50:21.332546  7846 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 202) took 1481 ms. Trace:
I20260709 14:50:21.336591  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:50:21.332721  7971 tablet_bootstrap.cc:492] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac: No bootstrap required, opened a new log
I20260709 14:50:21.340639  7971 ts_tablet_manager.cc:1403] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent bootstrapping tablet: real 0.075s	user 0.015s	sys 0.000s
I20260709 14:50:21.343351  7971 raft_consensus.cc:359] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:21.344098  7971 raft_consensus.cc:385] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:21.344381  7971 raft_consensus.cc:740] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Initialized, Role: FOLLOWER
I20260709 14:50:21.333052  8512 raft_consensus.cc:2804] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:50:21.346155  8512 raft_consensus.cc:697] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:50:21.346814  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:50:21.347440  8512 consensus_queue.cc:237] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:21.348204  7854 raft_consensus.cc:2468] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 0.
I20260709 14:50:21.348961  8345 raft_consensus.cc:493] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:50:21.349617  8345 raft_consensus.cc:515] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:21.352063  8345 leader_election.cc:290] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:50:21.333020  7846 rpcz_store.cc:276] 0709 14:50:19.851097 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:50:19.863226 (+ 12129us) service_pool.cc:224] Handling call
0709 14:50:19.914193 (+ 50967us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:50:19.939679 (+ 25486us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:50:19.939710 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:50:19.959542 (+ 19832us) log.cc:844] Serialized 26 byte log entry
0709 14:50:20.089962 (+130420us) raft_consensus.cc:1645] Marking committed up to 1
0709 14:50:20.090574 (+   612us) log.cc:844] Serialized 14 byte log entry
0709 14:50:20.090818 (+   244us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:50:20.091152 (+   334us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:50:21.139891 (+1048739us) spinlock_profiling.cc:243] Waited 18.8 ms on lock 0x7b24002662e8. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb687c29db1 00007fb687c279c4 00007fb687c25acb 00007fb687de0dc9 00007fb687de0a55 00007fb687de009d 00007fb68aa1210e 00007fb68aa2988c 00007fb68aa28bb6 00007fb68aa287d8 00007fb68aa32221
0709 14:50:21.332177 (+192286us) raft_consensus.cc:1685] finished
0709 14:50:21.332289 (+   112us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:50:21.332446 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":172,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":38,"raft.queue_time_us":4766,"raft.run_cpu_time_us":270,"raft.run_wall_time_us":2626,"spinlock_wait_cycles":43236608,"thread_start_us":126808,"threads_started":1,"wal-append.queue_time_us":127800}
I20260709 14:50:21.356434  8436 consensus_queue.cc:1048] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:50:21.359874  7919 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38532 (request call id 462) took 1217 ms. Trace:
I20260709 14:50:21.360495  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:50:21.360469  7919 rpcz_store.cc:276] 0709 14:50:20.142977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:50:20.144217 (+  1240us) service_pool.cc:224] Handling call
0709 14:50:21.358674 (+1214457us) spinlock_profiling.cc:243] Waited 7.21 ms on lock 0x7b5800200198. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb687c29db1 00007fb687d69b71 00007fb687d69a22 00007fb690c82c09 00007fb68fddcee0 00007fb68fea60ab 00007fb68fea6131 00007fb68fe67fc0 00007fb68fe52929 00007fb68fe523d2 00007fb6893c9bd4
0709 14:50:21.359044 (+   370us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:50:21.359287 (+   243us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:50:21.359324 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:50:21.359474 (+   150us) raft_consensus.cc:1645] Marking committed up to 1
0709 14:50:21.359531 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:50:21.359602 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:50:21.359751 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16590208}
I20260709 14:50:21.375734  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:50:21.377203  7744 leader_election.cc:304] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:50:21.378536  7851 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49948 (request call id 445) took 1125 ms. Trace:
I20260709 14:50:21.379530  8534 raft_consensus.cc:2804] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:50:21.385972  8534 raft_consensus.cc:493] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:50:21.386482  8534 raft_consensus.cc:3060] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:21.385866  7851 rpcz_store.cc:276] 0709 14:50:20.253199 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:50:20.258371 (+  5172us) service_pool.cc:224] Handling call
0709 14:50:20.790613 (+532242us) spinlock_profiling.cc:243] Waited 6.3 ms on lock 0x7b5800026198. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb687c29db1 00007fb687d69b71 00007fb687d69a22 00007fb690c82c09 00007fb68fddcee0 00007fb68fea60ab 00007fb68fea6131 00007fb68fe67fc0 00007fb68fe52929 00007fb68fe523d2 00007fb6893c9bd4
0709 14:50:20.791048 (+   435us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:50:20.791474 (+   426us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:50:20.791503 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:50:20.792008 (+   505us) log.cc:844] Serialized 26 byte log entry
0709 14:50:20.892170 (+100162us) raft_consensus.cc:1645] Marking committed up to 0
0709 14:50:21.356440 (+464270us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:50:21.356542 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:50:21.377667 (+ 21125us) spinlock_profiling.cc:243] Waited 433 ms on lock 0x7b54002b5d20. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae03dbe 00007fb68ae0e930 00007fb68ae0e8d8 00007fb68ae0e858 00007fb68ae0e813 00007fb68ae0da9c 00007fb690cf9626 00007fb690cf3dd8 00007fb68ae4a7cb 00007fb68ae4d2c0
0709 14:50:21.378166 (+   499us) raft_consensus.cc:1685] finished
0709 14:50:21.378206 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:50:21.378375 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1885,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":111,"spinlock_wait_cycles":1009484800,"thread_start_us":94567,"threads_started":1,"wal-append.queue_time_us":108616}
I20260709 14:50:21.380342  8537 consensus_queue.cc:1048] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:50:21.390713  8539 consensus_queue.cc:1048] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:50:21.393911  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:50:21.395639  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:50:21.395908  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:50:21.399454  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:50:21.402531  8534 raft_consensus.cc:515] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:21.404107  7775 raft_consensus.cc:2393] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 1: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:50:21.406307  8534 leader_election.cc:290] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:21.409469  8448 raft_consensus.cc:493] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:50:21.410539  8448 raft_consensus.cc:515] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:21.418284  8448 leader_election.cc:290] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:50:21.436558  8533 log.cc:927] Time spent T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.142s	user 0.004s	sys 0.000s
I20260709 14:50:21.442027  7850 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49948 (request call id 449) took 1125 ms. Trace:
I20260709 14:50:21.442528  7850 rpcz_store.cc:276] 0709 14:50:20.316518 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:50:20.547029 (+230511us) service_pool.cc:224] Handling call
0709 14:50:20.547381 (+   352us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:50:21.237767 (+690386us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:50:21.237815 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:50:21.238540 (+   725us) log.cc:844] Serialized 26 byte log entry
0709 14:50:21.285640 (+ 47100us) raft_consensus.cc:1645] Marking committed up to 1
0709 14:50:21.286032 (+   392us) log.cc:844] Serialized 14 byte log entry
0709 14:50:21.286646 (+   614us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:50:21.429472 (+142826us) spinlock_profiling.cc:243] Waited 690 ms on lock 0x7b54001414d4. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae8ee01 00007fb68ae8d83e 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2 00007fb6891c948c 00007fb6891c88c6
0709 14:50:21.429529 (+    57us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:50:21.436221 (+  6692us) spinlock_profiling.cc:243] Waited 19.3 ms on lock 0x7b2400266408. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb687c29db1 00007fb687c279c4 00007fb687c25acb 00007fb687de0dc9 00007fb687de0a55 00007fb687de009d 00007fb68aa1210e 00007fb68aa2988c 00007fb68aa28bb6 00007fb68aa287d8 00007fb68aa32221
0709 14:50:21.441718 (+  5497us) raft_consensus.cc:1685] finished
0709 14:50:21.441759 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:50:21.441954 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":149,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":1785,"raft.run_cpu_time_us":203,"raft.run_wall_time_us":203,"spinlock_wait_cycles":1631192576,"thread_start_us":46442,"threads_started":1,"wal-append.queue_time_us":47020}
I20260709 14:50:21.462940  7770 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37136 (request call id 242) took 1337 ms. Trace:
I20260709 14:50:21.462972  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:50:21.463546  7770 rpcz_store.cc:276] 0709 14:50:20.125071 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:50:20.127878 (+  2807us) service_pool.cc:224] Handling call
0709 14:50:21.461987 (+1334109us) spinlock_profiling.cc:243] Waited 2.62 ms on lock 0x7b5800002a98. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb687c29db1 00007fb687d69b71 00007fb687d69a22 00007fb690c82c09 00007fb68fddcee0 00007fb68fea60ab 00007fb68fea6131 00007fb68fe67fc0 00007fb68fe52929 00007fb68fe523d2 00007fb6893c9bd4
0709 14:50:21.462260 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:50:21.462488 (+   228us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:50:21.462522 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:50:21.462569 (+    47us) raft_consensus.cc:1645] Marking committed up to 1
0709 14:50:21.462604 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:50:21.462666 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:50:21.462805 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6030592}
I20260709 14:50:21.464799  7675 catalog_manager.cc:5697] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 0 to 1, leader changed from <none> to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 1 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
W20260709 14:50:21.473011  7725 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 14:50:21.477653  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:50:21.478535  7846 raft_consensus.cc:2468] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 0.
I20260709 14:50:21.482465  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:50:21.485379  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:50:21.486996  8498 leader_election.cc:290] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:50:21.490689  7971 consensus_queue.cc:260] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:21.498270  7971 ts_tablet_manager.cc:1434] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent starting tablet: real 0.157s	user 0.004s	sys 0.008s
I20260709 14:50:21.499706  7971 tablet_bootstrap.cc:492] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac: Bootstrap starting.
I20260709 14:50:21.500680  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:50:21.501737  7851 raft_consensus.cc:2468] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 0.
I20260709 14:50:21.503314  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:50:21.504027  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 139677us
W20260709 14:50:21.507112  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 131457us
I20260709 14:50:21.507436  8443 raft_consensus.cc:493] T 9441e831627143a991a1556dcdce71e3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:50:21.508064  8422 raft_consensus.cc:493] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:50:21.508684  8422 raft_consensus.cc:515] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:21.509829  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:50:21.510562  7851 raft_consensus.cc:3060] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:21.518770  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:50:21.524255  7893 leader_election.cc:304] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:21.511116  8422 leader_election.cc:290] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:50:21.528559  7894 leader_election.cc:304] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:50:21.531963  7893 leader_election.cc:304] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:21.546500  8498 raft_consensus.cc:2749] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 14:50:21.530418  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:50:21.556066  7893 leader_election.cc:304] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:21.532630  8485 raft_consensus.cc:2749] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 14:50:21.508124  8443 raft_consensus.cc:515] T 9441e831627143a991a1556dcdce71e3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:21.534197  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:50:21.577108  7893 leader_election.cc:304] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:21.533699  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:50:21.538689  8422 raft_consensus.cc:2804] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:50:21.599089  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:50:21.593636  8498 raft_consensus.cc:2749] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 14:50:21.600294  8422 raft_consensus.cc:493] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 14:50:21.615067  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 49631.5us
I20260709 14:50:21.605086  8345 raft_consensus.cc:2749] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 14:50:21.603693  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:50:21.613338  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:50:21.614234  8422 raft_consensus.cc:3060] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 0 FOLLOWER]: Advancing to term 1
W20260709 14:50:21.620746  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 43744.3us
I20260709 14:50:21.632017  7819 leader_election.cc:304] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:50:21.635329  8549 raft_consensus.cc:2749] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:50:21.651434  7851 raft_consensus.cc:2468] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 1.
I20260709 14:50:21.653009  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:50:21.653347  8443 leader_election.cc:290] T 9441e831627143a991a1556dcdce71e3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:50:21.666527  7893 leader_election.cc:304] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:21.640676  8484 consensus_queue.cc:1048] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.028s
I20260709 14:50:21.681695  7971 tablet_bootstrap.cc:654] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:21.681751  7893 leader_election.cc:304] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:21.670121  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:50:21.712016  8484 raft_consensus.cc:2749] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 14:50:21.704309  8551 raft_consensus.cc:2749] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 14:50:21.718891  7851 raft_consensus.cc:3060] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:21.720716  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:50:21.737571  8498 raft_consensus.cc:493] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:50:21.738320  8498 raft_consensus.cc:515] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:21.734567  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9441e831627143a991a1556dcdce71e3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:50:21.746565  8422 raft_consensus.cc:515] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:21.749094  7921 raft_consensus.cc:2393] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 1: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:50:21.755190  8498 leader_election.cc:290] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:50:21.749641  8422 leader_election.cc:290] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:50:21.759650  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:50:21.760846  7852 raft_consensus.cc:2393] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 1: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:50:21.746665  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9441e831627143a991a1556dcdce71e3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:50:21.762838  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:50:21.790011  7971 tablet_bootstrap.cc:492] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac: No bootstrap required, opened a new log
I20260709 14:50:21.791339  7971 ts_tablet_manager.cc:1403] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent bootstrapping tablet: real 0.292s	user 0.017s	sys 0.005s
I20260709 14:50:21.835335  7971 raft_consensus.cc:359] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:21.836340  7971 raft_consensus.cc:385] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:21.836736  7971 raft_consensus.cc:740] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Initialized, Role: FOLLOWER
I20260709 14:50:21.835594  8558 raft_consensus.cc:493] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:50:21.837633  7971 consensus_queue.cc:260] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:21.837738  8558 raft_consensus.cc:515] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:21.842592  8558 leader_election.cc:290] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:21.842809  7893 leader_election.cc:304] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:21.847366  7675 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54344 (request call id 117) took 1730 ms. Trace:
I20260709 14:50:21.843739  8422 raft_consensus.cc:2749] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 14:50:21.847884  7675 rpcz_store.cc:276] 0709 14:50:20.116486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:50:20.116663 (+   177us) service_pool.cc:224] Handling call
0709 14:50:21.847285 (+1730622us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 14:50:21.483411 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 14:50:21.484075 (+   664us) write_op.cc:432] Acquiring schema lock in shared mode
0709 14:50:21.484111 (+    36us) write_op.cc:435] Acquired schema lock
0709 14:50:21.484133 (+    22us) tablet.cc:662] Decoding operations
0709 14:50:21.484520 (+   387us) write_op.cc:620] Acquiring the partition lock for write op
0709 14:50:21.484604 (+    84us) write_op.cc:641] Partition lock acquired for write op
0709 14:50:21.484635 (+    31us) tablet.cc:685] Acquiring locks for 1 operations
0709 14:50:21.484871 (+   236us) tablet.cc:701] Row locks acquired
0709 14:50:21.484891 (+    20us) write_op.cc:260] PREPARE: finished
0709 14:50:21.485040 (+   149us) write_op.cc:270] Start()
0709 14:50:21.485165 (+   125us) write_op.cc:276] Timestamp: P: 1783608621484992 usec, L: 0
0709 14:50:21.485192 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 14:50:21.486200 (+  1008us) log.cc:844] Serialized 537 byte log entry
0709 14:50:21.654175 (+167975us) op_driver.cc:464] REPLICATION: finished
0709 14:50:21.708542 (+ 54367us) write_op.cc:301] APPLY: starting
0709 14:50:21.708638 (+    96us) tablet.cc:1367] starting BulkCheckPresence
0709 14:50:21.708759 (+   121us) tablet.cc:1370] finished BulkCheckPresence
0709 14:50:21.708962 (+   203us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 14:50:21.709346 (+   384us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 14:50:21.734211 (+ 24865us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 14:50:21.734270 (+    59us) write_op.cc:312] APPLY: finished
0709 14:50:21.754465 (+ 20195us) log.cc:844] Serialized 22 byte log entry
0709 14:50:21.754695 (+   230us) write_op.cc:489] Releasing partition, row and schema locks
0709 14:50:21.754980 (+   285us) write_op.cc:454] Released schema lock
0709 14:50:21.755042 (+    62us) write_op.cc:341] FINISH: Updating metrics
0709 14:50:21.755418 (+   376us) write_op.cc:489] Releasing partition, row and schema locks
0709 14:50:21.755442 (+    24us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":5,"child_traces":[["op",{"apply.queue_time_us":49505,"apply.run_cpu_time_us":3133,"apply.run_wall_time_us":46887,"num_ops":1,"prepare.queue_time_us":15597,"prepare.run_cpu_time_us":13322,"prepare.run_wall_time_us":13431,"raft.queue_time_us":121582,"raft.run_cpu_time_us":13573,"raft.run_wall_time_us":86240,"replication_time_us":150999,"thread_start_us":164947,"threads_started":4,"wal-append.queue_time_us":10584}]]}
I20260709 14:50:21.858615  7893 leader_election.cc:304] T 9441e831627143a991a1556dcdce71e3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:21.859688  8430 raft_consensus.cc:2749] T 9441e831627143a991a1556dcdce71e3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 14:50:21.867383  7673 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54350 (request call id 106) took 1686 ms. Trace:
I20260709 14:50:21.867901  7673 rpcz_store.cc:276] 0709 14:50:20.180799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:50:20.180943 (+   144us) service_pool.cc:224] Handling call
0709 14:50:21.867319 (+1686376us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1194423,"reported_tablets":5}
I20260709 14:50:21.873940  7971 ts_tablet_manager.cc:1434] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent starting tablet: real 0.082s	user 0.008s	sys 0.005s
I20260709 14:50:21.875221  7971 tablet_bootstrap.cc:492] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac: Bootstrap starting.
I20260709 14:50:21.882243  7971 tablet_bootstrap.cc:654] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac: Neither blocks nor log segments found. Creating new log.
I20260709 14:50:21.883616  7674 catalog_manager.cc:5697] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 1 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:50:21.885725  7674 catalog_manager.cc:5697] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 0 to 2, leader changed from <none> to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 2 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
W20260709 14:50:21.887086  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 246465us
I20260709 14:50:21.891872  8537 raft_consensus.cc:493] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:50:21.894574  8537 raft_consensus.cc:515] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:21.898064  8537 leader_election.cc:290] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:21.902840  7819 leader_election.cc:304] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:50:21.904996  8549 raft_consensus.cc:2749] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 14:50:21.913348  7819 leader_election.cc:304] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:50:21.917625  8549 raft_consensus.cc:2749] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 14:50:21.919641  7971 tablet_bootstrap.cc:492] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac: No bootstrap required, opened a new log
I20260709 14:50:21.920439  7971 ts_tablet_manager.cc:1403] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent bootstrapping tablet: real 0.045s	user 0.014s	sys 0.007s
I20260709 14:50:21.923559  7971 raft_consensus.cc:359] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:21.924292  7971 raft_consensus.cc:385] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:50:21.924575  7971 raft_consensus.cc:740] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Initialized, Role: FOLLOWER
I20260709 14:50:21.935698  7971 consensus_queue.cc:260] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:21.937099  7745 leader_election.cc:304] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:21.937816  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:50:21.938720  7971 ts_tablet_manager.cc:1434] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.004s
I20260709 14:50:21.938715  8534 raft_consensus.cc:2749] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 14:50:21.940554  8549 raft_consensus.cc:493] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:50:21.941107  8549 raft_consensus.cc:515] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:21.943709  8549 leader_election.cc:290] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:50:21.941983  7745 consensus_peers.cc:597] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed -> Peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Couldn't send request to peer 3876b8ee8d744cb18e91d97aae93b1ac. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:50:21.945530  7745 leader_election.cc:304] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:50:21.946278  8405 raft_consensus.cc:2804] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 14:50:21.946712  8405 raft_consensus.cc:493] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:50:21.947198  8405 raft_consensus.cc:3060] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:21.946744  7745 leader_election.cc:304] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:21.955508  8405 raft_consensus.cc:515] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:21.956549  8537 raft_consensus.cc:2749] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 14:50:21.958132  8405 leader_election.cc:290] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 2 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:21.960951  7745 leader_election.cc:304] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:50:21.962958  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:50:21.964018  7775 raft_consensus.cc:2468] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 2.
I20260709 14:50:21.965178  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783e4874513449ef9084b833f188a6d3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:50:21.966451  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:50:21.967015  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:50:21.965628  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:50:21.967834  7775 raft_consensus.cc:2393] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 1: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:50:21.968466  8537 raft_consensus.cc:2804] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:50:21.969038  8537 raft_consensus.cc:697] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:50:21.970240  8537 consensus_queue.cc:237] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:21.999233  7674 catalog_manager.cc:5697] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 1 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:50:22.011015  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783e4874513449ef9084b833f188a6d3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:50:22.020447  7893 leader_election.cc:304] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:22.021385  8422 raft_consensus.cc:2804] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 14:50:22.021766  8422 raft_consensus.cc:493] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:50:22.022118  8422 raft_consensus.cc:3060] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:50:22.023948  7893 leader_election.cc:304] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:22.025208  8443 raft_consensus.cc:2749] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 14:50:22.027195  8405 consensus_queue.cc:1048] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:50:22.034072  8422 raft_consensus.cc:515] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:22.037523  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:50:22.050716  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:50:22.054224  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:50:22.057667  8422 leader_election.cc:290] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 3 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:50:22.058598  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:50:22.061061  7676 catalog_manager.cc:5697] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 0 to 1, leader changed from <none> to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 1 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:50:22.068746  7819 leader_election.cc:304] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:50:22.069749  8558 raft_consensus.cc:2749] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 14:50:22.072734  7819 leader_election.cc:304] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:50:22.073650  8558 raft_consensus.cc:2749] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 14:50:22.078292  8513 raft_consensus.cc:493] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:50:22.078933  8513 raft_consensus.cc:515] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:22.081768  8513 leader_election.cc:290] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:22.084856  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:50:22.088589  7744 leader_election.cc:304] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:22.089504  8537 raft_consensus.cc:2749] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 14:50:22.090881  7744 leader_election.cc:304] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:22.091724  8405 raft_consensus.cc:2749] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 14:50:22.093896  7775 raft_consensus.cc:1240] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 1. Current term is 2. Ops: []
I20260709 14:50:22.095289  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:50:22.099656  7893 leader_election.cc:304] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:22.103243  8498 consensus_queue.cc:1059] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:50:22.119314  8498 raft_consensus.cc:2749] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 14:50:22.120118  8498 raft_consensus.cc:3055] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 14:50:22.120455  8498 raft_consensus.cc:740] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:50:22.104166  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:50:22.129498  7673 catalog_manager.cc:5697] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 0 to 1, leader changed from <none> to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 1 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:50:22.131546  7819 leader_election.cc:304] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:50:22.132143  8498 consensus_queue.cc:260] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:22.132782  8558 raft_consensus.cc:2749] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:50:22.136304  8498 raft_consensus.cc:3060] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:22.157614  8534 consensus_queue.cc:1048] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 14:50:22.195132  7924 raft_consensus.cc:1240] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 2. Current term is 3. Ops: []
I20260709 14:50:22.199996  8513 consensus_queue.cc:1059] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 14:50:22.201548  8513 raft_consensus.cc:3055] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 LEADER]: Stepping down as leader of term 2
I20260709 14:50:22.202204  8513 raft_consensus.cc:740] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:50:22.203208  8513 consensus_queue.cc:260] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:22.204591  8513 raft_consensus.cc:3060] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:50:22.259892  7854 raft_consensus.cc:3060] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:22.307492  8513 raft_consensus.cc:493] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:50:22.308154  8513 raft_consensus.cc:515] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:22.310469  8513 leader_election.cc:290] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:22.320690  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:50:22.323920  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:50:22.330097  7819 leader_election.cc:304] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:50:22.331056  8513 raft_consensus.cc:2749] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 14:50:22.366997  7949 debug-util.cc:398] Leaking SignalData structure 0x7b080018f740 after lost signal to thread 6552
W20260709 14:50:22.368266  7949 debug-util.cc:398] Leaking SignalData structure 0x7b08000950e0 after lost signal to thread 7711
W20260709 14:50:22.369306  7949 debug-util.cc:398] Leaking SignalData structure 0x7b08002df460 after lost signal to thread 7803
W20260709 14:50:22.370481  7949 debug-util.cc:398] Leaking SignalData structure 0x7b08002dec20 after lost signal to thread 7878
W20260709 14:50:22.371723  7949 debug-util.cc:398] Leaking SignalData structure 0x7b08002c2620 after lost signal to thread 7952
I20260709 14:50:22.394526  7852 raft_consensus.cc:3060] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:50:22.421002  8405 consensus_queue.cc:1048] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 14:50:22.450793  8405 consensus_queue.cc:1048] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:50:23.370826  8558 raft_consensus.cc:493] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:50:23.371948  8558 raft_consensus.cc:515] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:23.374874  8558 leader_election.cc:290] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:23.376070  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:50:23.376271  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:50:23.377514  7779 raft_consensus.cc:2393] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 2: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:50:23.377532  7926 raft_consensus.cc:2468] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 2.
I20260709 14:50:23.379928  7819 leader_election.cc:304] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:50:23.381125  8558 raft_consensus.cc:2804] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 14:50:23.381681  8558 raft_consensus.cc:493] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:50:23.382112  8558 raft_consensus.cc:3060] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:23.394421  8558 raft_consensus.cc:515] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:23.396735  8558 leader_election.cc:290] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 2 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:23.399060  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:50:23.399999  7779 raft_consensus.cc:2393] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 2: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:50:23.401394  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:50:23.410681  7926 raft_consensus.cc:2468] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 2.
I20260709 14:50:23.412074  7819 leader_election.cc:304] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:50:23.412786  8558 raft_consensus.cc:2804] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:50:23.413360  8558 raft_consensus.cc:697] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:50:23.414449  8558 consensus_queue.cc:237] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:23.430625  7675 catalog_manager.cc:5697] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 1 to 2, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 2 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:50:23.494073  6549 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 14:50:23.596021  8586 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 14:50:23.634407  8587 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 14:50:23.642773  6549 server_base.cc:1061] running on GCE node
W20260709 14:50:23.644338  8589 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 14:50:23.647815  6549 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 14:50:23.648104  6549 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 14:50:23.649235  6549 hybrid_clock.cc:648] HybridClock initialized: now 1783608623649211 us; error 0 us; skew 500 ppm
I20260709 14:50:23.650127  6549 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 14:50:23.656090  8534 raft_consensus.cc:493] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:50:23.656915  8534 raft_consensus.cc:515] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:23.661166  8534 leader_election.cc:290] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:23.663825  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:50:23.676482  7854 raft_consensus.cc:2468] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 3.
I20260709 14:50:23.670975  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:50:23.678396  7922 raft_consensus.cc:2393] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 3: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:50:23.678666  7745 leader_election.cc:304] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:50:23.679796  8356 raft_consensus.cc:2804] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 14:50:23.680220  8356 raft_consensus.cc:493] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:50:23.680706  8356 raft_consensus.cc:3060] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:50:23.696266  8356 raft_consensus.cc:515] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:23.699783  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:50:23.701143  8356 leader_election.cc:290] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:23.702286  6549 webserver.cc:533] Webserver started at http://127.6.101.68:34967/ using document root <none> and password file <none>
I20260709 14:50:23.703301  6549 fs_manager.cc:362] Metadata directory not provided
I20260709 14:50:23.703207  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:50:23.705168  6549 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 14:50:23.705526  7922 raft_consensus.cc:2393] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 3: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:50:23.705978  6549 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 14:50:23.708114  6549 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783608571892863-6549-0/minicluster-data/ts-3-root/instance:
uuid: "9418391fa82a42c79c6cad13ba91d964"
format_stamp: "Formatted at 2026-07-09 14:50:23 on dist-test-slave-lv34"
I20260709 14:50:23.711642  7854 raft_consensus.cc:2468] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 3.
I20260709 14:50:23.713467  7745 leader_election.cc:304] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:50:23.714567  8577 raft_consensus.cc:2804] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Leader election won for term 3
I20260709 14:50:23.715286  8577 raft_consensus.cc:697] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:50:23.716367  8577 consensus_queue.cc:237] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:23.738430  6549 fs_manager.cc:696] Time spent creating directory manager: real 0.029s	user 0.010s	sys 0.013s
I20260709 14:50:23.741014  7675 catalog_manager.cc:5697] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 2 to 3, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 3 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:50:23.757074  8595 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 14:50:23.758492  6549 fs_manager.cc:730] Time spent opening block manager: real 0.017s	user 0.003s	sys 0.001s
I20260709 14:50:23.758970  6549 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783608571892863-6549-0/minicluster-data/ts-3-root
uuid: "9418391fa82a42c79c6cad13ba91d964"
format_stamp: "Formatted at 2026-07-09 14:50:23 on dist-test-slave-lv34"
I20260709 14:50:23.759402  6549 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783608571892863-6549-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783608571892863-6549-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783608571892863-6549-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 14:50:23.800628  8579 raft_consensus.cc:493] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:50:23.801614  8579 raft_consensus.cc:515] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:23.802301  6549 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 14:50:23.805373  6549 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 14:50:23.806610  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:50:23.813832  8579 leader_election.cc:290] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:50:23.814909  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:50:23.815857  7846 raft_consensus.cc:2468] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 3.
I20260709 14:50:23.817678  7894 leader_election.cc:304] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:50:23.819083  8579 raft_consensus.cc:2804] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 14:50:23.819619  8579 raft_consensus.cc:493] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:50:23.820042  8579 raft_consensus.cc:3060] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:50:23.824815  7779 raft_consensus.cc:1275] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:50:23.815800  6549 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 14:50:23.829010  8558 consensus_queue.cc:1048] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:50:23.835372  8579 raft_consensus.cc:515] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:23.837719  8579 leader_election.cc:290] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 4 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:50:23.839406  6549 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 14:50:23.839921  6549 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.001s	user 0.001s	sys 0.000s
I20260709 14:50:23.839774  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:50:23.840281  6549 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 14:50:23.840454  7846 raft_consensus.cc:3060] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:50:23.840588  6549 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 14:50:23.844329  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:50:23.851781  7846 raft_consensus.cc:2468] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 4.
I20260709 14:50:23.854911  7894 leader_election.cc:304] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:50:23.862528  8443 raft_consensus.cc:2804] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 14:50:23.863297  8443 raft_consensus.cc:697] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:50:23.865003  8443 consensus_queue.cc:237] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:23.900772  7676 catalog_manager.cc:5697] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 3 to 4, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 4 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:50:23.938279  7926 raft_consensus.cc:1275] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:50:23.943142  8549 consensus_queue.cc:1048] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 14:50:24.175246  7846 raft_consensus.cc:1240] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 3. Current term is 4. Ops: []
I20260709 14:50:24.178172  8405 consensus_queue.cc:1059] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 14:50:24.179195  8405 raft_consensus.cc:3055] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 LEADER]: Stepping down as leader of term 3
I20260709 14:50:24.179563  8405 raft_consensus.cc:740] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:50:24.184484  8405 consensus_queue.cc:260] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:24.186199  8405 raft_consensus.cc:3060] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:50:24.218343  6549 rpc_server.cc:307] RPC server started. Bound to: 127.6.101.68:42321
I20260709 14:50:24.218577  8664 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.101.68:42321 every 8 connection(s)
I20260709 14:50:24.271993  6549 auto_leader_rebalancer-test.cc:446] add a tserver: 9418391fa82a42c79c6cad13ba91d964
I20260709 14:50:24.272313  7775 raft_consensus.cc:1275] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 14:50:24.272898  7775 pending_rounds.cc:85] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed: Aborting all ops after (but not including) 2
I20260709 14:50:24.273077  7775 pending_rounds.cc:107] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 14:50:24.273398  7775 raft_consensus.cc:2889] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:50:24.280170  8443 consensus_queue.cc:1048] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 14:50:24.328187  7846 raft_consensus.cc:1275] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 14:50:24.342254  8580 consensus_queue.cc:1048] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 14:50:24.498240  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 145705us
I20260709 14:50:24.523960  8665 heartbeater.cc:344] Connected to a master server at 127.6.101.126:38743
I20260709 14:50:24.524931  8665 heartbeater.cc:461] Registering TS with master...
I20260709 14:50:24.526423  8665 heartbeater.cc:507] Master 127.6.101.126:38743 requested a full tablet report, sending...
I20260709 14:50:24.531574  7676 ts_manager.cc:194] Registered new tserver with Master: 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68:42321)
I20260709 14:50:24.541633  7676 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51352
I20260709 14:50:24.909540  7846 consensus_queue.cc:237] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } attrs { replace: true } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: NON_VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: true } }
I20260709 14:50:24.949458  7928 raft_consensus.cc:1275] T a18d29d52d304c87b930d4fb5eaf50b1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 14:50:24.953351  7770 raft_consensus.cc:1275] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 14:50:24.957549  8674 consensus_queue.cc:1048] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 14:50:24.968333  8674 consensus_queue.cc:1048] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
W20260709 14:50:25.018596  7817 consensus_peers.cc:597] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68:42321): Couldn't send request to peer 9418391fa82a42c79c6cad13ba91d964. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a18d29d52d304c87b930d4fb5eaf50b1. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:50:25.036149  8676 raft_consensus.cc:2955] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } attrs { replace: true } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: NON_VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: true } } }
I20260709 14:50:25.064327  7922 raft_consensus.cc:2955] T a18d29d52d304c87b930d4fb5eaf50b1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } attrs { replace: true } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: NON_VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: true } } }
I20260709 14:50:25.098589  7779 raft_consensus.cc:2955] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } attrs { replace: true } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: NON_VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: true } } }
I20260709 14:50:25.096876  7675 catalog_manager.cc:5697] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: config changed from index -1 to 2, NON_VOTER 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68) added. New cstate: current_term: 1 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: NON_VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 14:50:25.186066  7779 consensus_queue.cc:237] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } attrs { replace: true } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: NON_VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: true } }
I20260709 14:50:25.196754  7922 raft_consensus.cc:1275] T 9ce9c0ef2db24c13a8b1402f21819458 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 14:50:25.198913  8679 consensus_queue.cc:1048] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 14:50:25.199852  7852 raft_consensus.cc:1275] T 9ce9c0ef2db24c13a8b1402f21819458 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 14:50:25.202210  8679 consensus_queue.cc:1048] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 14:50:25.220760  8356 raft_consensus.cc:2955] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } attrs { replace: true } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: NON_VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: true } } }
I20260709 14:50:25.223711  7922 raft_consensus.cc:2955] T 9ce9c0ef2db24c13a8b1402f21819458 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } attrs { replace: true } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: NON_VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: true } } }
I20260709 14:50:25.234434  7851 raft_consensus.cc:2955] T 9ce9c0ef2db24c13a8b1402f21819458 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } attrs { replace: true } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: NON_VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: true } } }
I20260709 14:50:25.250245  7673 catalog_manager.cc:5697] T 9ce9c0ef2db24c13a8b1402f21819458 P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: config changed from index -1 to 2, NON_VOTER 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68) added. New cstate: current_term: 1 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } attrs { replace: true } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: NON_VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: true } } }
W20260709 14:50:25.272182  7742 consensus_peers.cc:597] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed -> Peer 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68:42321): Couldn't send request to peer 9418391fa82a42c79c6cad13ba91d964. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9ce9c0ef2db24c13a8b1402f21819458. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:50:25.302515  7922 consensus_queue.cc:237] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } attrs { replace: true } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: NON_VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: true } }
I20260709 14:50:25.339620  7852 raft_consensus.cc:1275] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 14:50:25.349179  7779 raft_consensus.cc:1275] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 14:50:25.350524  8579 consensus_queue.cc:1048] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 14:50:25.353214  8443 consensus_queue.cc:1048] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 14:50:25.367779  7891 consensus_peers.cc:597] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68:42321): Couldn't send request to peer 9418391fa82a42c79c6cad13ba91d964. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ae1f7722fdea49e0b5e9c5d96633eaf9. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:50:25.375136  8580 raft_consensus.cc:2955] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } attrs { replace: true } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: NON_VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: true } } }
I20260709 14:50:25.378734  7846 raft_consensus.cc:2955] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } attrs { replace: true } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: NON_VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: true } } }
I20260709 14:50:25.385046  7779 raft_consensus.cc:2955] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } attrs { replace: true } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: NON_VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: true } } }
I20260709 14:50:25.400852  7673 catalog_manager.cc:5697] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: config changed from index -1 to 2, NON_VOTER 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68) added. New cstate: current_term: 1 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } attrs { replace: true } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: NON_VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: true } } }
I20260709 14:50:25.434432  8701 ts_tablet_manager.cc:933] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964: Initiating tablet copy from peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:50:25.419875  7846 consensus_queue.cc:237] T 9441e831627143a991a1556dcdce71e3 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } attrs { replace: true } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: NON_VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: true } }
I20260709 14:50:25.457693  7922 raft_consensus.cc:1275] T 9441e831627143a991a1556dcdce71e3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 14:50:25.459734  8701 tablet_copy_client.cc:323] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964: tablet copy: Beginning tablet copy session from remote peer at address 127.6.101.66:34529
I20260709 14:50:25.463626  8675 consensus_queue.cc:1048] T 9441e831627143a991a1556dcdce71e3 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 14:50:25.481582  7817 consensus_peers.cc:597] T 9441e831627143a991a1556dcdce71e3 P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68:42321): Couldn't send request to peer 9418391fa82a42c79c6cad13ba91d964. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9441e831627143a991a1556dcdce71e3. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:50:25.507323  7779 raft_consensus.cc:1275] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 14:50:25.516471  8675 consensus_queue.cc:1048] T 9441e831627143a991a1556dcdce71e3 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 14:50:25.531579  8676 raft_consensus.cc:2955] T 9441e831627143a991a1556dcdce71e3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } attrs { replace: true } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: NON_VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: true } } }
I20260709 14:50:25.545876  7864 tablet_copy_service.cc:140] P 3876b8ee8d744cb18e91d97aae93b1ac: Received BeginTabletCopySession request for tablet a18d29d52d304c87b930d4fb5eaf50b1 from peer 9418391fa82a42c79c6cad13ba91d964 ({username='slave'} at 127.0.0.1:41650)
I20260709 14:50:25.546597  7864 tablet_copy_service.cc:161] P 3876b8ee8d744cb18e91d97aae93b1ac: Beginning new tablet copy session on tablet a18d29d52d304c87b930d4fb5eaf50b1 from peer 9418391fa82a42c79c6cad13ba91d964 at {username='slave'} at 127.0.0.1:41650: session id = 9418391fa82a42c79c6cad13ba91d964-a18d29d52d304c87b930d4fb5eaf50b1
I20260709 14:50:25.551473  7928 raft_consensus.cc:2955] T 9441e831627143a991a1556dcdce71e3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } attrs { replace: true } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: NON_VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: true } } }
I20260709 14:50:25.554792  8665 heartbeater.cc:499] Master 127.6.101.126:38743 was elected leader, sending a full tablet report...
I20260709 14:50:25.570739  7864 tablet_copy_source_session.cc:215] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 14:50:25.583360  8701 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a18d29d52d304c87b930d4fb5eaf50b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:25.599282  7779 raft_consensus.cc:2955] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } attrs { replace: true } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: NON_VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: true } } }
W20260709 14:50:25.631506  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 81312.6us
I20260709 14:50:25.646751  7676 catalog_manager.cc:5697] T 9441e831627143a991a1556dcdce71e3 P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: config changed from index -1 to 2, NON_VOTER 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68) added. New cstate: current_term: 1 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } attrs { replace: true } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: NON_VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: true } } }
I20260709 14:50:25.695160  8701 tablet_copy_client.cc:806] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964: tablet copy: Starting download of 0 data blocks...
I20260709 14:50:25.697118  8701 tablet_copy_client.cc:670] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964: tablet copy: Starting download of 1 WAL segments...
I20260709 14:50:25.708585  8701 tablet_copy_client.cc:538] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 14:50:25.730279  8710 ts_tablet_manager.cc:933] T 9ce9c0ef2db24c13a8b1402f21819458 P 9418391fa82a42c79c6cad13ba91d964: Initiating tablet copy from peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587)
I20260709 14:50:25.750706  8701 tablet_bootstrap.cc:492] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964: Bootstrap starting.
I20260709 14:50:25.765627  8710 tablet_copy_client.cc:323] T 9ce9c0ef2db24c13a8b1402f21819458 P 9418391fa82a42c79c6cad13ba91d964: tablet copy: Beginning tablet copy session from remote peer at address 127.6.101.65:40587
I20260709 14:50:25.811584  8701 tablet_bootstrap.cc:492] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 14:50:25.812822  8701 tablet_bootstrap.cc:492] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964: Bootstrap complete.
I20260709 14:50:25.815017  8701 ts_tablet_manager.cc:1403] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964: Time spent bootstrapping tablet: real 0.065s	user 0.025s	sys 0.017s
I20260709 14:50:25.818343  8701 raft_consensus.cc:359] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } attrs { replace: true } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: NON_VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: true } }
I20260709 14:50:25.819657  8701 raft_consensus.cc:740] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9418391fa82a42c79c6cad13ba91d964, State: Initialized, Role: LEARNER
I20260709 14:50:25.820461  8701 consensus_queue.cc:260] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } attrs { replace: true } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: NON_VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: true } }
I20260709 14:50:25.832350  7789 tablet_copy_service.cc:140] P 1de5e20126fa4d8ca0793d19c7b847ed: Received BeginTabletCopySession request for tablet 9ce9c0ef2db24c13a8b1402f21819458 from peer 9418391fa82a42c79c6cad13ba91d964 ({username='slave'} at 127.0.0.1:47054)
I20260709 14:50:25.833443  7789 tablet_copy_service.cc:161] P 1de5e20126fa4d8ca0793d19c7b847ed: Beginning new tablet copy session on tablet 9ce9c0ef2db24c13a8b1402f21819458 from peer 9418391fa82a42c79c6cad13ba91d964 at {username='slave'} at 127.0.0.1:47054: session id = 9418391fa82a42c79c6cad13ba91d964-9ce9c0ef2db24c13a8b1402f21819458
I20260709 14:50:25.844463  8714 ts_tablet_manager.cc:933] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 9418391fa82a42c79c6cad13ba91d964: Initiating tablet copy from peer 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:25.852485  7789 tablet_copy_source_session.cc:215] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 14:50:25.863883  8710 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ce9c0ef2db24c13a8b1402f21819458. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:25.882048  8714 tablet_copy_client.cc:323] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 9418391fa82a42c79c6cad13ba91d964: tablet copy: Beginning tablet copy session from remote peer at address 127.6.101.67:40785
I20260709 14:50:25.932826  8710 tablet_copy_client.cc:806] T 9ce9c0ef2db24c13a8b1402f21819458 P 9418391fa82a42c79c6cad13ba91d964: tablet copy: Starting download of 0 data blocks...
I20260709 14:50:25.933845  8710 tablet_copy_client.cc:670] T 9ce9c0ef2db24c13a8b1402f21819458 P 9418391fa82a42c79c6cad13ba91d964: tablet copy: Starting download of 1 WAL segments...
I20260709 14:50:25.929641  8701 ts_tablet_manager.cc:1434] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964: Time spent starting tablet: real 0.114s	user 0.013s	sys 0.015s
I20260709 14:50:25.953070  7864 tablet_copy_service.cc:342] P 3876b8ee8d744cb18e91d97aae93b1ac: Request end of tablet copy session 9418391fa82a42c79c6cad13ba91d964-a18d29d52d304c87b930d4fb5eaf50b1 received from {username='slave'} at 127.0.0.1:41650
I20260709 14:50:25.953668  7864 tablet_copy_service.cc:434] P 3876b8ee8d744cb18e91d97aae93b1ac: ending tablet copy session 9418391fa82a42c79c6cad13ba91d964-a18d29d52d304c87b930d4fb5eaf50b1 on tablet a18d29d52d304c87b930d4fb5eaf50b1 with peer 9418391fa82a42c79c6cad13ba91d964
I20260709 14:50:25.971968  7938 tablet_copy_service.cc:140] P 1e9289592458429bbddb19c2e7b7b7b0: Received BeginTabletCopySession request for tablet ae1f7722fdea49e0b5e9c5d96633eaf9 from peer 9418391fa82a42c79c6cad13ba91d964 ({username='slave'} at 127.0.0.1:48672)
I20260709 14:50:25.972687  7938 tablet_copy_service.cc:161] P 1e9289592458429bbddb19c2e7b7b7b0: Beginning new tablet copy session on tablet ae1f7722fdea49e0b5e9c5d96633eaf9 from peer 9418391fa82a42c79c6cad13ba91d964 at {username='slave'} at 127.0.0.1:48672: session id = 9418391fa82a42c79c6cad13ba91d964-ae1f7722fdea49e0b5e9c5d96633eaf9
I20260709 14:50:25.978350  8710 tablet_copy_client.cc:538] T 9ce9c0ef2db24c13a8b1402f21819458 P 9418391fa82a42c79c6cad13ba91d964: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 14:50:25.998153  7938 tablet_copy_source_session.cc:215] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1e9289592458429bbddb19c2e7b7b7b0: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 14:50:25.999948  8710 tablet_bootstrap.cc:492] T 9ce9c0ef2db24c13a8b1402f21819458 P 9418391fa82a42c79c6cad13ba91d964: Bootstrap starting.
I20260709 14:50:26.004364  8714 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae1f7722fdea49e0b5e9c5d96633eaf9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:26.039108  8710 tablet_bootstrap.cc:492] T 9ce9c0ef2db24c13a8b1402f21819458 P 9418391fa82a42c79c6cad13ba91d964: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 14:50:26.040339  8710 tablet_bootstrap.cc:492] T 9ce9c0ef2db24c13a8b1402f21819458 P 9418391fa82a42c79c6cad13ba91d964: Bootstrap complete.
I20260709 14:50:26.041158  8710 ts_tablet_manager.cc:1403] T 9ce9c0ef2db24c13a8b1402f21819458 P 9418391fa82a42c79c6cad13ba91d964: Time spent bootstrapping tablet: real 0.041s	user 0.023s	sys 0.012s
I20260709 14:50:26.050192  8710 raft_consensus.cc:359] T 9ce9c0ef2db24c13a8b1402f21819458 P 9418391fa82a42c79c6cad13ba91d964 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } attrs { replace: true } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: NON_VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: true } }
I20260709 14:50:26.051347  8710 raft_consensus.cc:740] T 9ce9c0ef2db24c13a8b1402f21819458 P 9418391fa82a42c79c6cad13ba91d964 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9418391fa82a42c79c6cad13ba91d964, State: Initialized, Role: LEARNER
I20260709 14:50:26.051610  8714 tablet_copy_client.cc:806] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 9418391fa82a42c79c6cad13ba91d964: tablet copy: Starting download of 0 data blocks...
I20260709 14:50:26.052460  8714 tablet_copy_client.cc:670] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 9418391fa82a42c79c6cad13ba91d964: tablet copy: Starting download of 1 WAL segments...
I20260709 14:50:26.052073  8710 consensus_queue.cc:260] T 9ce9c0ef2db24c13a8b1402f21819458 P 9418391fa82a42c79c6cad13ba91d964 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } attrs { replace: true } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: NON_VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: true } }
I20260709 14:50:26.056876  8714 tablet_copy_client.cc:538] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 9418391fa82a42c79c6cad13ba91d964: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 14:50:26.064850  8701 ts_tablet_manager.cc:933] T 9441e831627143a991a1556dcdce71e3 P 9418391fa82a42c79c6cad13ba91d964: Initiating tablet copy from peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:50:26.059754  8710 ts_tablet_manager.cc:1434] T 9ce9c0ef2db24c13a8b1402f21819458 P 9418391fa82a42c79c6cad13ba91d964: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.002s
I20260709 14:50:26.077508  8714 tablet_bootstrap.cc:492] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 9418391fa82a42c79c6cad13ba91d964: Bootstrap starting.
I20260709 14:50:26.091154  7789 tablet_copy_service.cc:342] P 1de5e20126fa4d8ca0793d19c7b847ed: Request end of tablet copy session 9418391fa82a42c79c6cad13ba91d964-9ce9c0ef2db24c13a8b1402f21819458 received from {username='slave'} at 127.0.0.1:47054
I20260709 14:50:26.091900  7789 tablet_copy_service.cc:434] P 1de5e20126fa4d8ca0793d19c7b847ed: ending tablet copy session 9418391fa82a42c79c6cad13ba91d964-9ce9c0ef2db24c13a8b1402f21819458 on tablet 9ce9c0ef2db24c13a8b1402f21819458 with peer 9418391fa82a42c79c6cad13ba91d964
I20260709 14:50:26.095754  8701 tablet_copy_client.cc:323] T 9441e831627143a991a1556dcdce71e3 P 9418391fa82a42c79c6cad13ba91d964: tablet copy: Beginning tablet copy session from remote peer at address 127.6.101.66:34529
I20260709 14:50:26.097929  7864 tablet_copy_service.cc:140] P 3876b8ee8d744cb18e91d97aae93b1ac: Received BeginTabletCopySession request for tablet 9441e831627143a991a1556dcdce71e3 from peer 9418391fa82a42c79c6cad13ba91d964 ({username='slave'} at 127.0.0.1:41650)
I20260709 14:50:26.100435  7864 tablet_copy_service.cc:161] P 3876b8ee8d744cb18e91d97aae93b1ac: Beginning new tablet copy session on tablet 9441e831627143a991a1556dcdce71e3 from peer 9418391fa82a42c79c6cad13ba91d964 at {username='slave'} at 127.0.0.1:41650: session id = 9418391fa82a42c79c6cad13ba91d964-9441e831627143a991a1556dcdce71e3
I20260709 14:50:26.112241  7864 tablet_copy_source_session.cc:215] T 9441e831627143a991a1556dcdce71e3 P 3876b8ee8d744cb18e91d97aae93b1ac: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 14:50:26.121984  8701 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9441e831627143a991a1556dcdce71e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:50:26.145807  8714 tablet_bootstrap.cc:492] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 9418391fa82a42c79c6cad13ba91d964: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 14:50:26.153435  8714 tablet_bootstrap.cc:492] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 9418391fa82a42c79c6cad13ba91d964: Bootstrap complete.
I20260709 14:50:26.159585  8714 ts_tablet_manager.cc:1403] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 9418391fa82a42c79c6cad13ba91d964: Time spent bootstrapping tablet: real 0.082s	user 0.034s	sys 0.016s
I20260709 14:50:26.163738  8714 raft_consensus.cc:359] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 9418391fa82a42c79c6cad13ba91d964 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } attrs { replace: true } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: NON_VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: true } }
I20260709 14:50:26.165642  8714 raft_consensus.cc:740] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 9418391fa82a42c79c6cad13ba91d964 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9418391fa82a42c79c6cad13ba91d964, State: Initialized, Role: LEARNER
I20260709 14:50:26.166503  8714 consensus_queue.cc:260] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 9418391fa82a42c79c6cad13ba91d964 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } attrs { replace: true } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: NON_VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: true } }
I20260709 14:50:26.165171  8701 tablet_copy_client.cc:806] T 9441e831627143a991a1556dcdce71e3 P 9418391fa82a42c79c6cad13ba91d964: tablet copy: Starting download of 0 data blocks...
I20260709 14:50:26.168210  8701 tablet_copy_client.cc:670] T 9441e831627143a991a1556dcdce71e3 P 9418391fa82a42c79c6cad13ba91d964: tablet copy: Starting download of 1 WAL segments...
I20260709 14:50:26.188211  8701 tablet_copy_client.cc:538] T 9441e831627143a991a1556dcdce71e3 P 9418391fa82a42c79c6cad13ba91d964: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 14:50:26.206858  8714 ts_tablet_manager.cc:1434] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 9418391fa82a42c79c6cad13ba91d964: Time spent starting tablet: real 0.047s	user 0.006s	sys 0.001s
I20260709 14:50:26.214521  7938 tablet_copy_service.cc:342] P 1e9289592458429bbddb19c2e7b7b7b0: Request end of tablet copy session 9418391fa82a42c79c6cad13ba91d964-ae1f7722fdea49e0b5e9c5d96633eaf9 received from {username='slave'} at 127.0.0.1:48672
I20260709 14:50:26.215263  7938 tablet_copy_service.cc:434] P 1e9289592458429bbddb19c2e7b7b7b0: ending tablet copy session 9418391fa82a42c79c6cad13ba91d964-ae1f7722fdea49e0b5e9c5d96633eaf9 on tablet ae1f7722fdea49e0b5e9c5d96633eaf9 with peer 9418391fa82a42c79c6cad13ba91d964
I20260709 14:50:26.223209  8701 tablet_bootstrap.cc:492] T 9441e831627143a991a1556dcdce71e3 P 9418391fa82a42c79c6cad13ba91d964: Bootstrap starting.
I20260709 14:50:26.260623  8640 raft_consensus.cc:1217] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 14:50:26.262007  8701 tablet_bootstrap.cc:492] T 9441e831627143a991a1556dcdce71e3 P 9418391fa82a42c79c6cad13ba91d964: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 14:50:26.263182  8701 tablet_bootstrap.cc:492] T 9441e831627143a991a1556dcdce71e3 P 9418391fa82a42c79c6cad13ba91d964: Bootstrap complete.
I20260709 14:50:26.263970  8701 ts_tablet_manager.cc:1403] T 9441e831627143a991a1556dcdce71e3 P 9418391fa82a42c79c6cad13ba91d964: Time spent bootstrapping tablet: real 0.041s	user 0.019s	sys 0.012s
I20260709 14:50:26.267184  8701 raft_consensus.cc:359] T 9441e831627143a991a1556dcdce71e3 P 9418391fa82a42c79c6cad13ba91d964 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } attrs { replace: true } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: NON_VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: true } }
I20260709 14:50:26.268362  8701 raft_consensus.cc:740] T 9441e831627143a991a1556dcdce71e3 P 9418391fa82a42c79c6cad13ba91d964 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9418391fa82a42c79c6cad13ba91d964, State: Initialized, Role: LEARNER
I20260709 14:50:26.278630  8701 consensus_queue.cc:260] T 9441e831627143a991a1556dcdce71e3 P 9418391fa82a42c79c6cad13ba91d964 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } attrs { replace: true } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: NON_VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: true } }
I20260709 14:50:26.281319  8701 ts_tablet_manager.cc:1434] T 9441e831627143a991a1556dcdce71e3 P 9418391fa82a42c79c6cad13ba91d964: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.003s
I20260709 14:50:26.291999  7864 tablet_copy_service.cc:342] P 3876b8ee8d744cb18e91d97aae93b1ac: Request end of tablet copy session 9418391fa82a42c79c6cad13ba91d964-9441e831627143a991a1556dcdce71e3 received from {username='slave'} at 127.0.0.1:41650
I20260709 14:50:26.292498  7864 tablet_copy_service.cc:434] P 3876b8ee8d744cb18e91d97aae93b1ac: ending tablet copy session 9418391fa82a42c79c6cad13ba91d964-9441e831627143a991a1556dcdce71e3 on tablet 9441e831627143a991a1556dcdce71e3 with peer 9418391fa82a42c79c6cad13ba91d964
I20260709 14:50:26.300474  8640 raft_consensus.cc:1217] T 9ce9c0ef2db24c13a8b1402f21819458 P 9418391fa82a42c79c6cad13ba91d964 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 14:50:26.373165  8640 raft_consensus.cc:1217] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 9418391fa82a42c79c6cad13ba91d964 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 14:50:26.580680  8640 raft_consensus.cc:1217] T 9441e831627143a991a1556dcdce71e3 P 9418391fa82a42c79c6cad13ba91d964 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 14:50:26.643716  8676 raft_consensus.cc:1064] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac: attempting to promote NON_VOTER 9418391fa82a42c79c6cad13ba91d964 to VOTER
I20260709 14:50:26.647383  8676 consensus_queue.cc:237] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } attrs { replace: true } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:50:26.662674  8640 raft_consensus.cc:1275] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 [term 1 LEARNER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 14:50:26.668784  7926 raft_consensus.cc:1275] T a18d29d52d304c87b930d4fb5eaf50b1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 14:50:26.671120  7771 raft_consensus.cc:1275] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 14:50:26.673110  8549 consensus_queue.cc:1048] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 14:50:26.674721  8675 consensus_queue.cc:1048] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 14:50:26.676995  8675 consensus_queue.cc:1048] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 14:50:26.753018  8679 raft_consensus.cc:1064] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed: attempting to promote NON_VOTER 9418391fa82a42c79c6cad13ba91d964 to VOTER
I20260709 14:50:26.755972  8679 consensus_queue.cc:237] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } attrs { replace: true } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:50:26.800581  8640 raft_consensus.cc:1275] T 9ce9c0ef2db24c13a8b1402f21819458 P 9418391fa82a42c79c6cad13ba91d964 [term 1 LEARNER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 14:50:26.797503  8724 raft_consensus.cc:2955] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } attrs { replace: true } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } } }
I20260709 14:50:26.805881  7926 raft_consensus.cc:1275] T 9ce9c0ef2db24c13a8b1402f21819458 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 14:50:26.811508  8673 consensus_queue.cc:1048] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 14:50:26.817945  8708 consensus_queue.cc:1048] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 14:50:26.862692  7852 raft_consensus.cc:1275] T 9ce9c0ef2db24c13a8b1402f21819458 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 14:50:26.863308  8730 raft_consensus.cc:2955] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } attrs { replace: true } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } } }
I20260709 14:50:26.866127  8640 raft_consensus.cc:2955] T 9ce9c0ef2db24c13a8b1402f21819458 P 9418391fa82a42c79c6cad13ba91d964 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } attrs { replace: true } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } } }
I20260709 14:50:26.886334  7926 raft_consensus.cc:2955] T a18d29d52d304c87b930d4fb5eaf50b1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } attrs { replace: true } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } } }
I20260709 14:50:26.891521  8639 raft_consensus.cc:2955] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } attrs { replace: true } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } } }
I20260709 14:50:26.936749  7673 catalog_manager.cc:5697] T a18d29d52d304c87b930d4fb5eaf50b1 P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: config changed from index 2 to 3, 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } attrs { replace: true } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } } }
W20260709 14:50:26.949975  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 57334.4us
I20260709 14:50:26.957222  8679 consensus_queue.cc:1048] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 14:50:26.961102  7920 raft_consensus.cc:2955] T 9ce9c0ef2db24c13a8b1402f21819458 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } attrs { replace: true } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } } }
I20260709 14:50:26.967638  8443 raft_consensus.cc:1064] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1e9289592458429bbddb19c2e7b7b7b0: attempting to promote NON_VOTER 9418391fa82a42c79c6cad13ba91d964 to VOTER
I20260709 14:50:26.970391  8443 consensus_queue.cc:237] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } attrs { replace: true } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:50:26.979928  7772 raft_consensus.cc:2955] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } attrs { replace: true } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } } }
I20260709 14:50:26.987859  7851 raft_consensus.cc:2955] T 9ce9c0ef2db24c13a8b1402f21819458 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } attrs { replace: true } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } } }
I20260709 14:50:27.019999  7674 catalog_manager.cc:5697] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: config changed from index 2 to 3, 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 14:50:27.030791  8640 raft_consensus.cc:1275] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 9418391fa82a42c79c6cad13ba91d964 [term 1 LEARNER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 14:50:27.032572  8579 consensus_queue.cc:1048] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 14:50:27.032599  7852 raft_consensus.cc:1275] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 14:50:27.038458  8726 consensus_queue.cc:1048] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 14:50:27.038880  7777 raft_consensus.cc:1275] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 14:50:27.048982  8676 raft_consensus.cc:1064] T 9441e831627143a991a1556dcdce71e3 P 3876b8ee8d744cb18e91d97aae93b1ac: attempting to promote NON_VOTER 9418391fa82a42c79c6cad13ba91d964 to VOTER
I20260709 14:50:27.058197  8719 consensus_queue.cc:1048] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 14:50:27.052228  8676 consensus_queue.cc:237] T 9441e831627143a991a1556dcdce71e3 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } attrs { replace: true } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:50:27.101810  7777 consensus_queue.cc:237] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:50:27.104054  7851 consensus_queue.cc:237] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:50:27.137710  8639 raft_consensus.cc:1275] T 9ce9c0ef2db24c13a8b1402f21819458 P 9418391fa82a42c79c6cad13ba91d964 [term 1 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 14:50:27.139165  7920 raft_consensus.cc:1275] T 9ce9c0ef2db24c13a8b1402f21819458 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 14:50:27.140270  8730 consensus_queue.cc:1048] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 14:50:27.141705  8733 consensus_queue.cc:1048] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 14:50:27.150440  8730 raft_consensus.cc:2955] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } } }
I20260709 14:50:27.153349  8639 raft_consensus.cc:2955] T 9ce9c0ef2db24c13a8b1402f21819458 P 9418391fa82a42c79c6cad13ba91d964 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } } }
I20260709 14:50:27.215677  8638 raft_consensus.cc:1275] T 9441e831627143a991a1556dcdce71e3 P 9418391fa82a42c79c6cad13ba91d964 [term 1 LEARNER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 14:50:27.220216  8640 raft_consensus.cc:1275] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 [term 1 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 14:50:27.223518  8724 consensus_queue.cc:1048] T 9441e831627143a991a1556dcdce71e3 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 14:50:27.224406  8675 consensus_queue.cc:1048] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 14:50:27.256101  7928 raft_consensus.cc:1275] T 9441e831627143a991a1556dcdce71e3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 14:50:27.263960  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 70223us
I20260709 14:50:27.264710  8675 consensus_queue.cc:1048] T 9441e831627143a991a1556dcdce71e3 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
W20260709 14:50:27.272521  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 67394.7us
I20260709 14:50:27.277186  7928 raft_consensus.cc:2955] T 9ce9c0ef2db24c13a8b1402f21819458 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } } }
I20260709 14:50:27.259552  7676 catalog_manager.cc:5697] T 9ce9c0ef2db24c13a8b1402f21819458 P 9418391fa82a42c79c6cad13ba91d964 reported cstate change: config changed from index 3 to 4, VOTER 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) evicted. New cstate: current_term: 1 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } } }
I20260709 14:50:27.346140  7775 raft_consensus.cc:1275] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 14:50:27.251874  8719 raft_consensus.cc:2955] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } attrs { replace: true } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } } }
W20260709 14:50:27.393839  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 78979.5us
W20260709 14:50:27.399744  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 89176.7us
I20260709 14:50:27.408505  7663 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9ce9c0ef2db24c13a8b1402f21819458 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 14:50:27.387471  8676 consensus_queue.cc:1048] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.023s
W20260709 14:50:27.889846  7663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 597912us
I20260709 14:50:27.382273  8724 raft_consensus.cc:2955] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } } }
I20260709 14:50:27.396765  7845 raft_consensus.cc:2955] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } attrs { replace: true } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } } }
W20260709 14:50:27.554023  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 159246us
W20260709 14:50:27.649081  8750 log.cc:927] Time spent T 9441e831627143a991a1556dcdce71e3 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.098s	user 0.002s	sys 0.000s
W20260709 14:50:27.659601  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 289445us
W20260709 14:50:27.769739  8745 log.cc:927] Time spent T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.090s	user 0.000s	sys 0.005s
I20260709 14:50:27.855069  8638 raft_consensus.cc:2955] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 9418391fa82a42c79c6cad13ba91d964 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } attrs { replace: true } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } } }
I20260709 14:50:28.075872  8640 raft_consensus.cc:2955] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } } }
W20260709 14:50:28.082533  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 66653.4us
I20260709 14:50:28.091131  7772 raft_consensus.cc:1275] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 14:50:28.092736  7674 catalog_manager.cc:5697] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: config changed from index 2 to 3, 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 14:50:28.134246  7664 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a18d29d52d304c87b930d4fb5eaf50b1 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 14:50:28.134521  7840 tablet_service.cc:1558] Processing DeleteTablet for tablet 9ce9c0ef2db24c13a8b1402f21819458 with delete_type TABLET_DATA_TOMBSTONED (TS 3876b8ee8d744cb18e91d97aae93b1ac not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49940
I20260709 14:50:28.135691  8770 raft_consensus.cc:2955] T 9441e831627143a991a1556dcdce71e3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } attrs { replace: true } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } } }
I20260709 14:50:28.149376  8639 raft_consensus.cc:2955] T 9441e831627143a991a1556dcdce71e3 P 9418391fa82a42c79c6cad13ba91d964 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } attrs { replace: true } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } } }
I20260709 14:50:28.153018  7922 consensus_queue.cc:237] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:50:28.184687  8637 raft_consensus.cc:1275] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 9418391fa82a42c79c6cad13ba91d964 [term 1 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 14:50:28.185914  7850 raft_consensus.cc:1275] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 14:50:28.187319  8443 consensus_queue.cc:1048] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 14:50:28.194013  8443 consensus_queue.cc:1048] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 14:50:28.231089  8775 tablet_replica.cc:333] T 9ce9c0ef2db24c13a8b1402f21819458 P 3876b8ee8d744cb18e91d97aae93b1ac: stopping tablet replica
I20260709 14:50:28.182104  7775 raft_consensus.cc:2955] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } } }
I20260709 14:50:28.233843  8676 consensus_queue.cc:1048] T 9441e831627143a991a1556dcdce71e3 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 14:50:28.246982  7673 catalog_manager.cc:5697] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: config changed from index 3 to 4, VOTER 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) evicted. New cstate: current_term: 1 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 14:50:28.287321  8765 raft_consensus.cc:2955] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } } }
I20260709 14:50:28.298099  7922 raft_consensus.cc:2955] T 9441e831627143a991a1556dcdce71e3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } attrs { replace: true } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } } }
I20260709 14:50:28.304128  8775 raft_consensus.cc:2243] T 9ce9c0ef2db24c13a8b1402f21819458 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 14:50:28.326226  7852 raft_consensus.cc:2955] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } } }
I20260709 14:50:28.327620  8775 raft_consensus.cc:2272] T 9ce9c0ef2db24c13a8b1402f21819458 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:50:28.331434  8775 ts_tablet_manager.cc:1916] T 9ce9c0ef2db24c13a8b1402f21819458 P 3876b8ee8d744cb18e91d97aae93b1ac: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 14:50:28.358546  7917 tablet_service.cc:1558] Processing DeleteTablet for tablet a18d29d52d304c87b930d4fb5eaf50b1 with delete_type TABLET_DATA_TOMBSTONED (TS 1e9289592458429bbddb19c2e7b7b7b0 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:38512
I20260709 14:50:28.342773  7777 raft_consensus.cc:2955] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } attrs { replace: true } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } } }
I20260709 14:50:28.392578  8637 raft_consensus.cc:2955] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 9418391fa82a42c79c6cad13ba91d964 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } } }
I20260709 14:50:28.400535  7673 catalog_manager.cc:5697] T 9441e831627143a991a1556dcdce71e3 P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: config changed from index 2 to 3, 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } attrs { replace: true } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } } }
I20260709 14:50:28.414855  7663 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ae1f7722fdea49e0b5e9c5d96633eaf9 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 14:50:28.458760  7771 raft_consensus.cc:2955] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } attrs { replace: true } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } } }
I20260709 14:50:28.467314  8777 tablet_replica.cc:333] T a18d29d52d304c87b930d4fb5eaf50b1 P 1e9289592458429bbddb19c2e7b7b7b0: stopping tablet replica
I20260709 14:50:28.469759  8777 raft_consensus.cc:2243] T a18d29d52d304c87b930d4fb5eaf50b1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 14:50:28.471807  8777 raft_consensus.cc:2272] T a18d29d52d304c87b930d4fb5eaf50b1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 14:50:28.487852  8768 raft_consensus.cc:670] T a18d29d52d304c87b930d4fb5eaf50b1 P 1e9289592458429bbddb19c2e7b7b7b0: failed to trigger leader election: Illegal state: RaftConsensus is not running: State = Stopped
I20260709 14:50:28.491763  8777 ts_tablet_manager.cc:1916] T a18d29d52d304c87b930d4fb5eaf50b1 P 1e9289592458429bbddb19c2e7b7b7b0: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 14:50:28.473625  8775 ts_tablet_manager.cc:1929] T 9ce9c0ef2db24c13a8b1402f21819458 P 3876b8ee8d744cb18e91d97aae93b1ac: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 14:50:28.480917  7676 catalog_manager.cc:5697] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: config changed from index 3 to 4, VOTER 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) evicted. New cstate: current_term: 1 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } } }
I20260709 14:50:28.547606  8775 log.cc:1199] T 9ce9c0ef2db24c13a8b1402f21819458 P 3876b8ee8d744cb18e91d97aae93b1ac: Deleting WAL directory at /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783608571892863-6549-0/minicluster-data/ts-1-root/wals/9ce9c0ef2db24c13a8b1402f21819458
I20260709 14:50:28.556661  7664 catalog_manager.cc:5028] TS 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): tablet 9ce9c0ef2db24c13a8b1402f21819458 (table test-workload [id=123c9602cdc6471dbcd54044281f090f]) successfully deleted
I20260709 14:50:28.584688  8777 ts_tablet_manager.cc:1929] T a18d29d52d304c87b930d4fb5eaf50b1 P 1e9289592458429bbddb19c2e7b7b7b0: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 14:50:28.587148  7764 tablet_service.cc:1558] Processing DeleteTablet for tablet ae1f7722fdea49e0b5e9c5d96633eaf9 with delete_type TABLET_DATA_TOMBSTONED (TS 1de5e20126fa4d8ca0793d19c7b847ed not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:37122
I20260709 14:50:28.599515  8777 log.cc:1199] T a18d29d52d304c87b930d4fb5eaf50b1 P 1e9289592458429bbddb19c2e7b7b7b0: Deleting WAL directory at /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783608571892863-6549-0/minicluster-data/ts-2-root/wals/a18d29d52d304c87b930d4fb5eaf50b1
I20260709 14:50:28.602600  7663 catalog_manager.cc:5028] TS 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785): tablet a18d29d52d304c87b930d4fb5eaf50b1 (table test-workload [id=123c9602cdc6471dbcd54044281f090f]) successfully deleted
I20260709 14:50:28.606748  8779 tablet_replica.cc:333] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1de5e20126fa4d8ca0793d19c7b847ed: stopping tablet replica
I20260709 14:50:28.607640  8779 raft_consensus.cc:2243] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 14:50:28.609174  8779 raft_consensus.cc:2272] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:50:28.614023  8779 ts_tablet_manager.cc:1916] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1de5e20126fa4d8ca0793d19c7b847ed: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 14:50:28.636531  8779 ts_tablet_manager.cc:1929] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1de5e20126fa4d8ca0793d19c7b847ed: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 14:50:28.637235  8779 log.cc:1199] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1de5e20126fa4d8ca0793d19c7b847ed: Deleting WAL directory at /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783608571892863-6549-0/minicluster-data/ts-0-root/wals/ae1f7722fdea49e0b5e9c5d96633eaf9
I20260709 14:50:28.639860  7663 catalog_manager.cc:5028] TS 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): tablet ae1f7722fdea49e0b5e9c5d96633eaf9 (table test-workload [id=123c9602cdc6471dbcd54044281f090f]) successfully deleted
I20260709 14:50:28.780022  7852 consensus_queue.cc:237] T 9441e831627143a991a1556dcdce71e3 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:50:28.793776  8637 raft_consensus.cc:1275] T 9441e831627143a991a1556dcdce71e3 P 9418391fa82a42c79c6cad13ba91d964 [term 1 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 14:50:28.795835  8724 consensus_queue.cc:1048] T 9441e831627143a991a1556dcdce71e3 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 14:50:28.811548  8762 raft_consensus.cc:2955] T 9441e831627143a991a1556dcdce71e3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } } }
I20260709 14:50:28.825820  7770 raft_consensus.cc:1275] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 14:50:28.835983  8637 raft_consensus.cc:2955] T 9441e831627143a991a1556dcdce71e3 P 9418391fa82a42c79c6cad13ba91d964 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } } }
I20260709 14:50:28.849594  7664 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9441e831627143a991a1556dcdce71e3 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 14:50:28.864782  8675 consensus_queue.cc:1048] T 9441e831627143a991a1556dcdce71e3 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 14:50:28.875404  7771 raft_consensus.cc:2955] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } } }
I20260709 14:50:28.891925  7676 catalog_manager.cc:5697] T 9441e831627143a991a1556dcdce71e3 P 9418391fa82a42c79c6cad13ba91d964 reported cstate change: config changed from index 3 to 4, VOTER 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) evicted. New cstate: current_term: 1 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } } }
I20260709 14:50:28.953317  7917 tablet_service.cc:1558] Processing DeleteTablet for tablet 9441e831627143a991a1556dcdce71e3 with delete_type TABLET_DATA_TOMBSTONED (TS 1e9289592458429bbddb19c2e7b7b7b0 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:38512
I20260709 14:50:28.954783  8777 tablet_replica.cc:333] T 9441e831627143a991a1556dcdce71e3 P 1e9289592458429bbddb19c2e7b7b7b0: stopping tablet replica
I20260709 14:50:28.956189  8777 raft_consensus.cc:2243] T 9441e831627143a991a1556dcdce71e3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 14:50:28.957185  8777 raft_consensus.cc:2272] T 9441e831627143a991a1556dcdce71e3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:50:28.967203  8777 ts_tablet_manager.cc:1916] T 9441e831627143a991a1556dcdce71e3 P 1e9289592458429bbddb19c2e7b7b7b0: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 14:50:29.030413  8777 ts_tablet_manager.cc:1929] T 9441e831627143a991a1556dcdce71e3 P 1e9289592458429bbddb19c2e7b7b7b0: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 14:50:29.032771  8777 log.cc:1199] T 9441e831627143a991a1556dcdce71e3 P 1e9289592458429bbddb19c2e7b7b7b0: Deleting WAL directory at /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783608571892863-6549-0/minicluster-data/ts-2-root/wals/9441e831627143a991a1556dcdce71e3
I20260709 14:50:29.047554  7663 catalog_manager.cc:5028] TS 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785): tablet 9441e831627143a991a1556dcdce71e3 (table test-workload [id=123c9602cdc6471dbcd54044281f090f]) successfully deleted
I20260709 14:50:29.872669  6549 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 14:50:29.983340  7770 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775"
dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
mode: GRACEFUL
new_leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
 from {username='slave'} at 127.0.0.1:47068
I20260709 14:50:29.984184  7770 raft_consensus.cc:606] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Received request to transfer leadership to TS 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:50:29.989312  7770 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b"
dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
mode: GRACEFUL
new_leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:47068
I20260709 14:50:29.989985  7770 raft_consensus.cc:606] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Received request to transfer leadership to TS 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:29.993096  7771 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268"
dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
mode: GRACEFUL
new_leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:47068
I20260709 14:50:29.993739  7771 raft_consensus.cc:606] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 LEADER]: Received request to transfer leadership to TS 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:29.998072  7771 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "939996e77ee64e9fab21aef50758b706"
dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
mode: GRACEFUL
new_leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:47068
I20260709 14:50:29.998711  7771 raft_consensus.cc:606] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Received request to transfer leadership to TS 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:30.003906  7771 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258"
dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
mode: GRACEFUL
new_leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:47068
I20260709 14:50:30.004688  7771 raft_consensus.cc:606] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Received request to transfer leadership to TS 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:30.007238  6549 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 14:50:30.009370  6549 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 14:50:30.057646  8708 raft_consensus.cc:993] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed: : Instructing follower 3876b8ee8d744cb18e91d97aae93b1ac to start an election
I20260709 14:50:30.058275  8766 raft_consensus.cc:1081] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Signalling peer 3876b8ee8d744cb18e91d97aae93b1ac to start an election
I20260709 14:50:30.060268  7853 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b"
dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:49948
I20260709 14:50:30.061000  7853 raft_consensus.cc:493] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:50:30.061483  7853 raft_consensus.cc:3060] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:30.068156  7853 raft_consensus.cc:515] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:30.070183  7853 leader_election.cc:290] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 2 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:30.071278  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:50:30.072152  7771 raft_consensus.cc:3055] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Stepping down as leader of term 1
I20260709 14:50:30.072472  7771 raft_consensus.cc:740] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:50:30.072482  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:50:30.073323  7920 raft_consensus.cc:3060] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:30.073272  7771 consensus_queue.cc:260] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:30.074604  7771 raft_consensus.cc:3060] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:30.083735  7771 raft_consensus.cc:2468] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 2.
I20260709 14:50:30.087666  8708 raft_consensus.cc:993] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed: : Instructing follower 3876b8ee8d744cb18e91d97aae93b1ac to start an election
I20260709 14:50:30.089043  8708 raft_consensus.cc:1081] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Signalling peer 3876b8ee8d744cb18e91d97aae93b1ac to start an election
I20260709 14:50:30.089579  7819 leader_election.cc:304] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:50:30.090344  7920 raft_consensus.cc:2468] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 2.
I20260709 14:50:30.090632  8724 raft_consensus.cc:2804] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:50:30.091187  8724 raft_consensus.cc:697] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:50:30.092317  8724 consensus_queue.cc:237] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:30.093605  7852 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "939996e77ee64e9fab21aef50758b706"
dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:49948
I20260709 14:50:30.094307  7852 raft_consensus.cc:493] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:50:30.094652  7852 raft_consensus.cc:3060] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:30.102839  7852 raft_consensus.cc:515] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:30.104967  7852 leader_election.cc:290] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 2 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:30.106350  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:50:30.107259  7771 raft_consensus.cc:3055] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Stepping down as leader of term 1
I20260709 14:50:30.108572  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:50:30.109750  7920 raft_consensus.cc:3060] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:30.111228  7675 catalog_manager.cc:5697] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 1 to 2, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 2 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:50:30.109174  7771 raft_consensus.cc:740] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:50:30.115855  7771 consensus_queue.cc:260] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:30.117591  7771 raft_consensus.cc:3060] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:30.126367  7771 raft_consensus.cc:2468] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 2.
I20260709 14:50:30.128042  7819 leader_election.cc:304] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:50:30.129220  8724 raft_consensus.cc:2804] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:50:30.129947  8724 raft_consensus.cc:697] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:50:30.136070  8724 consensus_queue.cc:237] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:30.146849  7920 raft_consensus.cc:2468] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 2.
I20260709 14:50:30.173978  8746 raft_consensus.cc:993] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed: : Instructing follower 1e9289592458429bbddb19c2e7b7b7b0 to start an election
I20260709 14:50:30.174584  8746 raft_consensus.cc:1081] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Signalling peer 1e9289592458429bbddb19c2e7b7b7b0 to start an election
I20260709 14:50:30.176887  7920 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
 from {username='slave'} at 127.0.0.1:38532
I20260709 14:50:30.177568  7920 raft_consensus.cc:493] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:50:30.177907  7920 raft_consensus.cc:3060] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:30.187347  7920 raft_consensus.cc:515] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:30.189709  7920 leader_election.cc:290] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 2 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:50:30.191113  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:50:30.191733  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:50:30.191812  7771 raft_consensus.cc:3055] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Stepping down as leader of term 1
I20260709 14:50:30.192384  7853 raft_consensus.cc:3060] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:30.192305  7771 raft_consensus.cc:740] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:50:30.193397  7771 consensus_queue.cc:260] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:30.194981  7771 raft_consensus.cc:3060] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:30.201783  7853 raft_consensus.cc:2468] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 2.
I20260709 14:50:30.203729  7894 leader_election.cc:304] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:50:30.207058  7675 catalog_manager.cc:5697] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 1 to 2, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 2 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:50:30.211416  8780 raft_consensus.cc:2804] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:50:30.212175  8780 raft_consensus.cc:697] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:50:30.213203  8780 consensus_queue.cc:237] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:30.214072  7771 raft_consensus.cc:2468] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 2.
I20260709 14:50:30.233827  7675 catalog_manager.cc:5697] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 1 to 2, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 2 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:50:30.313845  8673 raft_consensus.cc:993] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed: : Instructing follower 3876b8ee8d744cb18e91d97aae93b1ac to start an election
I20260709 14:50:30.314541  8766 raft_consensus.cc:1081] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Signalling peer 3876b8ee8d744cb18e91d97aae93b1ac to start an election
I20260709 14:50:30.316454  7853 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258"
dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:49948
I20260709 14:50:30.317138  7853 raft_consensus.cc:493] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:50:30.317564  7853 raft_consensus.cc:3060] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:30.324482  7853 raft_consensus.cc:515] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:30.329968  7853 leader_election.cc:290] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 2 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:30.332666  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:50:30.334136  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:50:30.335430  7920 raft_consensus.cc:3060] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:30.335059  7771 raft_consensus.cc:3055] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Stepping down as leader of term 1
I20260709 14:50:30.337630  7771 raft_consensus.cc:740] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:50:30.338503  7771 consensus_queue.cc:260] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:30.340864  7771 raft_consensus.cc:3060] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:30.361213  7771 raft_consensus.cc:2468] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 2.
I20260709 14:50:30.353550  7920 raft_consensus.cc:2468] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 2.
I20260709 14:50:30.366034  7819 leader_election.cc:304] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:50:30.367117  8787 raft_consensus.cc:2804] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:50:30.368078  8787 raft_consensus.cc:697] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:50:30.369338  8787 consensus_queue.cc:237] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:30.384853  7675 catalog_manager.cc:5697] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 1 to 2, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 2 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:50:30.415747  8746 raft_consensus.cc:993] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed: : Instructing follower 3876b8ee8d744cb18e91d97aae93b1ac to start an election
I20260709 14:50:30.416421  8673 raft_consensus.cc:1081] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 LEADER]: Signalling peer 3876b8ee8d744cb18e91d97aae93b1ac to start an election
I20260709 14:50:30.419013  7853 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268"
dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:49948
I20260709 14:50:30.419603  7853 raft_consensus.cc:493] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:50:30.419935  7853 raft_consensus.cc:3060] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:50:30.427803  7853 raft_consensus.cc:515] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:30.430025  7853 leader_election.cc:290] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 3 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:30.431900  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:50:30.432968  7926 raft_consensus.cc:3060] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:50:30.436729  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:50:30.437614  7770 raft_consensus.cc:3055] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 LEADER]: Stepping down as leader of term 2
I20260709 14:50:30.437988  7770 raft_consensus.cc:740] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:50:30.439127  7770 consensus_queue.cc:260] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:30.440809  7770 raft_consensus.cc:3060] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:50:30.445809  7926 raft_consensus.cc:2468] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 3.
I20260709 14:50:30.450114  7819 leader_election.cc:304] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:50:30.452294  8787 raft_consensus.cc:2804] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Leader election won for term 3
I20260709 14:50:30.452955  8787 raft_consensus.cc:697] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:50:30.454245  7770 raft_consensus.cc:2468] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 3.
I20260709 14:50:30.454785  8787 consensus_queue.cc:237] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:30.478258  7675 catalog_manager.cc:5697] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 2 to 3, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 3 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:50:30.512790  7920 raft_consensus.cc:1275] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:50:30.534610  8675 consensus_queue.cc:1048] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 14:50:30.539050  7770 raft_consensus.cc:1275] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:50:30.559512  8787 consensus_queue.cc:1048] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 14:50:30.616323  7770 raft_consensus.cc:1275] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:50:30.619210  8787 consensus_queue.cc:1048] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 14:50:30.629782  7845 raft_consensus.cc:1275] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:50:30.631687  8780 consensus_queue.cc:1048] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 14:50:30.636550  7926 raft_consensus.cc:1275] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:50:30.639405  8797 consensus_queue.cc:1048] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 14:50:30.721733  7770 raft_consensus.cc:1275] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:50:30.724881  8719 consensus_queue.cc:1048] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 14:50:30.893805  7926 raft_consensus.cc:1275] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:50:30.895390  8797 consensus_queue.cc:1048] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 14:50:30.931289  7920 raft_consensus.cc:1275] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 14:50:30.934979  8787 consensus_queue.cc:1048] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 14:50:30.942183  7770 raft_consensus.cc:1275] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:50:30.944880  8787 consensus_queue.cc:1048] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 14:50:30.978746  7770 raft_consensus.cc:1275] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 14:50:30.980523  8787 consensus_queue.cc:1048] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 14:50:31.010589  6549 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 14:50:31.118152  6549 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 14:50:31.201076  7770 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b"
dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
mode: GRACEFUL
new_leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
 from {username='slave'} at 127.0.0.1:47068
I20260709 14:50:31.201934  7770 raft_consensus.cc:606] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Received request to transfer leadership to TS 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:50:31.206082  7770 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129"
dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
mode: GRACEFUL
new_leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:47068
I20260709 14:50:31.206733  7770 raft_consensus.cc:606] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Received request to transfer leadership to TS 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:31.210469  7770 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a"
dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
mode: GRACEFUL
new_leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:47068
I20260709 14:50:31.211066  7770 raft_consensus.cc:606] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Received request to transfer leadership to TS 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:31.215339  7771 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92"
dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
mode: GRACEFUL
new_leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:47068
I20260709 14:50:31.216104  7771 raft_consensus.cc:606] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Received request to transfer leadership to TS 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:31.250571  7920 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ae1f7722fdea49e0b5e9c5d96633eaf9"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
mode: GRACEFUL
new_leader_uuid: "9418391fa82a42c79c6cad13ba91d964"
 from {username='slave'} at 127.0.0.1:48676
I20260709 14:50:31.251227  7920 raft_consensus.cc:606] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 LEADER]: Received request to transfer leadership to TS 9418391fa82a42c79c6cad13ba91d964
I20260709 14:50:31.267586  7853 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9"
dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
mode: GRACEFUL
new_leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
 from {username='slave'} at 127.0.0.1:41662
I20260709 14:50:31.268432  7853 raft_consensus.cc:606] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 LEADER]: Received request to transfer leadership to TS 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:50:31.271483  7771 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674"
dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
mode: GRACEFUL
new_leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
 from {username='slave'} at 127.0.0.1:47068
I20260709 14:50:31.272060  7771 raft_consensus.cc:606] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Received request to transfer leadership to TS 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:50:31.273214  6549 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 7
I20260709 14:50:31.274649  6549 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 14:50:31.291579  8708 raft_consensus.cc:993] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed: : Instructing follower 3876b8ee8d744cb18e91d97aae93b1ac to start an election
I20260709 14:50:31.292204  8708 raft_consensus.cc:1081] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Signalling peer 3876b8ee8d744cb18e91d97aae93b1ac to start an election
I20260709 14:50:31.294775  7853 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129"
dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:49948
I20260709 14:50:31.301578  7853 raft_consensus.cc:493] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:50:31.302052  7853 raft_consensus.cc:3060] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:31.320827  7853 raft_consensus.cc:515] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:31.324285  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:50:31.324416  7853 leader_election.cc:290] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 2 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:31.325304  7771 raft_consensus.cc:3055] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Stepping down as leader of term 1
I20260709 14:50:31.325367  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:50:31.326119  7920 raft_consensus.cc:3060] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:31.325914  7771 raft_consensus.cc:740] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:50:31.327375  7771 consensus_queue.cc:260] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:31.329025  7771 raft_consensus.cc:3060] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:31.334177  7920 raft_consensus.cc:2468] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 2.
I20260709 14:50:31.336477  7819 leader_election.cc:304] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:50:31.337534  8795 raft_consensus.cc:2804] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:50:31.338068  8795 raft_consensus.cc:697] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:50:31.338943  8795 consensus_queue.cc:237] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:31.342644  7771 raft_consensus.cc:2468] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 2.
I20260709 14:50:31.359433  7674 catalog_manager.cc:5697] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 1 to 2, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 2 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:50:31.362504  8708 raft_consensus.cc:993] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed: : Instructing follower 3876b8ee8d744cb18e91d97aae93b1ac to start an election
I20260709 14:50:31.365950  8708 raft_consensus.cc:1081] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Signalling peer 3876b8ee8d744cb18e91d97aae93b1ac to start an election
I20260709 14:50:31.368669  7852 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92"
dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:49948
I20260709 14:50:31.369519  7852 raft_consensus.cc:493] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:50:31.369982  7852 raft_consensus.cc:3060] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:31.377942  7852 raft_consensus.cc:515] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:31.379895  7852 leader_election.cc:290] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 2 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:31.380712  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:50:31.380980  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:50:31.381417  7771 raft_consensus.cc:3055] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Stepping down as leader of term 1
I20260709 14:50:31.381609  7920 raft_consensus.cc:3060] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:31.382261  7771 raft_consensus.cc:740] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:50:31.383190  7771 consensus_queue.cc:260] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:31.384392  7771 raft_consensus.cc:3060] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:31.389667  7920 raft_consensus.cc:2468] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 2.
I20260709 14:50:31.391002  7819 leader_election.cc:304] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:50:31.391710  8797 raft_consensus.cc:2804] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:50:31.392133  8797 raft_consensus.cc:697] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:50:31.392851  8797 consensus_queue.cc:237] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:31.396386  7771 raft_consensus.cc:2468] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 2.
I20260709 14:50:31.405992  7674 catalog_manager.cc:5697] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 1 to 2, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 2 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:50:31.442067  8673 raft_consensus.cc:993] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed: : Instructing follower 3876b8ee8d744cb18e91d97aae93b1ac to start an election
I20260709 14:50:31.442641  8673 raft_consensus.cc:1081] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Signalling peer 3876b8ee8d744cb18e91d97aae93b1ac to start an election
I20260709 14:50:31.444957  7853 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a"
dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:49948
I20260709 14:50:31.445654  7853 raft_consensus.cc:493] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:50:31.445981  7853 raft_consensus.cc:3060] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:31.452438  7853 raft_consensus.cc:515] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:31.454587  7853 leader_election.cc:290] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 2 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:31.457026  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:50:31.457795  7920 raft_consensus.cc:3060] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:31.458547  8719 raft_consensus.cc:993] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1e9289592458429bbddb19c2e7b7b7b0: : Instructing follower 9418391fa82a42c79c6cad13ba91d964 to start an election
I20260709 14:50:31.459137  8719 raft_consensus.cc:1081] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 LEADER]: Signalling peer 9418391fa82a42c79c6cad13ba91d964 to start an election
I20260709 14:50:31.460824  8637 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ae1f7722fdea49e0b5e9c5d96633eaf9"
dest_uuid: "9418391fa82a42c79c6cad13ba91d964"
 from {username='slave'} at 127.0.0.1:44364
I20260709 14:50:31.461556  8637 raft_consensus.cc:493] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 9418391fa82a42c79c6cad13ba91d964 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:50:31.461987  8637 raft_consensus.cc:3060] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 9418391fa82a42c79c6cad13ba91d964 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:31.462253  8708 raft_consensus.cc:993] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed: : Instructing follower 1e9289592458429bbddb19c2e7b7b7b0 to start an election
I20260709 14:50:31.462761  8708 raft_consensus.cc:1081] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Signalling peer 1e9289592458429bbddb19c2e7b7b7b0 to start an election
I20260709 14:50:31.464848  7926 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
 from {username='slave'} at 127.0.0.1:38532
I20260709 14:50:31.465816  7926 raft_consensus.cc:493] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:50:31.466212  7926 raft_consensus.cc:3060] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:31.472045  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:50:31.473330  7770 raft_consensus.cc:3055] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Stepping down as leader of term 1
I20260709 14:50:31.473703  7770 raft_consensus.cc:740] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:50:31.474455  8637 raft_consensus.cc:515] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 9418391fa82a42c79c6cad13ba91d964 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:50:31.479370  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1f7722fdea49e0b5e9c5d96633eaf9" candidate_uuid: "9418391fa82a42c79c6cad13ba91d964" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:50:31.479988  8637 leader_election.cc:290] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 9418391fa82a42c79c6cad13ba91d964 [CANDIDATE]: Term 2 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:31.480116  7925 raft_consensus.cc:3055] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 14:50:31.480614  7925 raft_consensus.cc:740] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:50:31.474611  7770 consensus_queue.cc:260] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:31.481664  7925 consensus_queue.cc:260] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:50:31.483075  7925 raft_consensus.cc:3060] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:31.484508  7920 raft_consensus.cc:2468] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 2.
I20260709 14:50:31.486976  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1f7722fdea49e0b5e9c5d96633eaf9" candidate_uuid: "9418391fa82a42c79c6cad13ba91d964" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:50:31.487421  7819 leader_election.cc:304] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:50:31.487965  7853 raft_consensus.cc:3060] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:31.489073  8797 raft_consensus.cc:2804] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:50:31.489705  8797 raft_consensus.cc:697] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:50:31.490782  8797 consensus_queue.cc:237] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:31.493727  7770 raft_consensus.cc:3060] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:31.495519  7926 raft_consensus.cc:515] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:31.508989  7853 raft_consensus.cc:2468] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9418391fa82a42c79c6cad13ba91d964 in term 2.
I20260709 14:50:31.510447  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:50:31.512290  7845 raft_consensus.cc:3060] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:31.521019  7845 raft_consensus.cc:2468] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 2.
I20260709 14:50:31.522650  7894 leader_election.cc:304] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:50:31.524762  8795 raft_consensus.cc:993] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac: : Instructing follower 1e9289592458429bbddb19c2e7b7b7b0 to start an election
I20260709 14:50:31.525463  8795 raft_consensus.cc:1081] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 LEADER]: Signalling peer 1e9289592458429bbddb19c2e7b7b7b0 to start an election
I20260709 14:50:31.525947  8719 raft_consensus.cc:2804] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:50:31.526594  8719 raft_consensus.cc:697] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:50:31.527060  8599 leader_election.cc:304] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 9418391fa82a42c79c6cad13ba91d964 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac, 9418391fa82a42c79c6cad13ba91d964; no voters: 
I20260709 14:50:31.527388  8719 consensus_queue.cc:237] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:31.529516  7770 raft_consensus.cc:2468] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 2.
I20260709 14:50:31.536899  8821 raft_consensus.cc:2804] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 9418391fa82a42c79c6cad13ba91d964 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:50:31.539981  7924 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
 from {username='slave'} at 127.0.0.1:38516
I20260709 14:50:31.540680  7924 raft_consensus.cc:493] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:50:31.543898  7924 raft_consensus.cc:3060] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:31.547087  8821 raft_consensus.cc:697] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 9418391fa82a42c79c6cad13ba91d964 [term 2 LEADER]: Becoming Leader. State: Replica: 9418391fa82a42c79c6cad13ba91d964, State: Running, Role: LEADER
I20260709 14:50:31.548313  8821 consensus_queue.cc:237] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 9418391fa82a42c79c6cad13ba91d964 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:50:31.523795  7925 raft_consensus.cc:2468] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9418391fa82a42c79c6cad13ba91d964 in term 2.
I20260709 14:50:31.549765  7926 leader_election.cc:290] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 2 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:50:31.555378  7674 catalog_manager.cc:5697] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 1 to 2, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 2 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:50:31.604820  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:50:31.605571  7779 raft_consensus.cc:3055] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Stepping down as leader of term 1
I20260709 14:50:31.605870  7779 raft_consensus.cc:740] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:50:31.606621  7779 consensus_queue.cc:260] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:31.607848  7779 raft_consensus.cc:3060] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:31.626933  7924 raft_consensus.cc:515] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:31.632349  7779 raft_consensus.cc:2468] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 2.
I20260709 14:50:31.651746  7674 catalog_manager.cc:5697] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 1 to 2, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 2 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:50:31.653420  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:50:31.654191  7845 raft_consensus.cc:3055] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 LEADER]: Stepping down as leader of term 1
I20260709 14:50:31.654516  7845 raft_consensus.cc:740] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:50:31.655997  7845 consensus_queue.cc:260] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:31.661289  7845 raft_consensus.cc:3060] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:31.676159  7924 leader_election.cc:290] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 2 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:50:31.678889  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:50:31.679883  7770 raft_consensus.cc:3060] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:31.681666  7845 raft_consensus.cc:2468] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 2.
I20260709 14:50:31.680526  7674 catalog_manager.cc:5697] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 9418391fa82a42c79c6cad13ba91d964 reported cstate change: term changed from 1 to 2, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68). New cstate: current_term: 2 leader_uuid: "9418391fa82a42c79c6cad13ba91d964" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 14:50:31.684753  8708 raft_consensus.cc:993] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed: : Instructing follower 1e9289592458429bbddb19c2e7b7b7b0 to start an election
I20260709 14:50:31.685935  8708 raft_consensus.cc:1081] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Signalling peer 1e9289592458429bbddb19c2e7b7b7b0 to start an election
I20260709 14:50:31.686365  7894 leader_election.cc:304] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:50:31.687713  8719 raft_consensus.cc:2804] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:50:31.688135  7770 raft_consensus.cc:2468] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 2.
I20260709 14:50:31.688371  8719 raft_consensus.cc:697] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:50:31.689466  8719 consensus_queue.cc:237] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:31.706359  7925 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
 from {username='slave'} at 127.0.0.1:38532
I20260709 14:50:31.707028  7925 raft_consensus.cc:493] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:50:31.707391  7925 raft_consensus.cc:3060] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:31.720342  7925 raft_consensus.cc:515] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:31.726977  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:50:31.728034  7845 raft_consensus.cc:3060] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:31.734103  7925 leader_election.cc:290] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 2 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:50:31.754369  7845 raft_consensus.cc:2468] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 2.
I20260709 14:50:31.756454  7894 leader_election.cc:304] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:50:31.759259  8805 raft_consensus.cc:2804] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:50:31.759860  8805 raft_consensus.cc:697] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:50:31.760751  8805 consensus_queue.cc:237] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:50:31.781052  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 75529.2us
W20260709 14:50:31.799060  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 89135.3us
I20260709 14:50:31.804199  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:50:31.805029  7770 raft_consensus.cc:3055] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Stepping down as leader of term 1
I20260709 14:50:31.805411  7770 raft_consensus.cc:740] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:50:31.806335  7770 consensus_queue.cc:260] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:31.807327  7770 raft_consensus.cc:3060] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:31.810024  7853 raft_consensus.cc:1240] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 1. Current term is 2. Ops: []
I20260709 14:50:31.821628  7770 raft_consensus.cc:2468] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 2.
I20260709 14:50:31.830678  7674 catalog_manager.cc:5697] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 1 to 2, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 2 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:50:31.832648  7771 raft_consensus.cc:1275] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:50:31.839758  7924 raft_consensus.cc:1275] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:50:31.855800  8797 consensus_queue.cc:1048] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 14:50:31.857971  7674 catalog_manager.cc:5697] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 1 to 2, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 2 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:50:31.862092  8797 consensus_queue.cc:1048] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 14:50:31.878271  7926 raft_consensus.cc:1275] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:50:31.884563  8797 consensus_queue.cc:1048] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 14:50:31.894724  7925 raft_consensus.cc:1275] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:50:31.914608  8826 consensus_queue.cc:1048] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 14:50:31.938818  7845 raft_consensus.cc:1275] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Refusing update from remote peer 9418391fa82a42c79c6cad13ba91d964: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 14:50:31.941488  8821 consensus_queue.cc:1048] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 9418391fa82a42c79c6cad13ba91d964 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 14:50:31.958026  7779 raft_consensus.cc:1275] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:50:31.965451  8805 consensus_queue.cc:1048] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 14:50:31.984948  7922 raft_consensus.cc:1275] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Refusing update from remote peer 9418391fa82a42c79c6cad13ba91d964: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 14:50:31.994354  8821 consensus_queue.cc:1048] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 9418391fa82a42c79c6cad13ba91d964 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 14:50:32.037204  7853 raft_consensus.cc:1275] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:50:32.040230  8829 consensus_queue.cc:1048] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 14:50:32.077049  7779 raft_consensus.cc:1275] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:50:32.079540  7779 raft_consensus.cc:1275] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:50:32.089319  8829 consensus_queue.cc:1048] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 14:50:32.090189  7770 raft_consensus.cc:1275] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:50:32.112416  8797 consensus_queue.cc:1048] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 14:50:32.153836  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 44479us
I20260709 14:50:32.110358  8795 consensus_queue.cc:1048] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.042s
W20260709 14:50:32.186084  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 54303.3us
I20260709 14:50:32.192531  7845 raft_consensus.cc:1275] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:50:32.210028  8719 consensus_queue.cc:1048] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 14:50:32.211709  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 65813.8us
I20260709 14:50:32.255908  7777 raft_consensus.cc:1275] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:50:32.265746  8829 consensus_queue.cc:1048] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 14:50:32.275553  6549 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 14:50:32.351230  7846 raft_consensus.cc:1275] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:50:32.354389  8849 consensus_queue.cc:1048] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 14:50:32.380385  6549 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 14:50:32.465680  7920 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
mode: GRACEFUL
new_leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:48676
I20260709 14:50:32.466197  7920 raft_consensus.cc:606] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 LEADER]: Received request to transfer leadership to TS 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:50:32.469221  7772 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f"
dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
mode: GRACEFUL
new_leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
 from {username='slave'} at 127.0.0.1:47068
I20260709 14:50:32.470005  7772 raft_consensus.cc:606] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Received request to transfer leadership to TS 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:50:32.473701  7772 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d"
dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
mode: GRACEFUL
new_leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:47068
I20260709 14:50:32.474395  7772 raft_consensus.cc:606] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Received request to transfer leadership to TS 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:32.478516  7846 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "939996e77ee64e9fab21aef50758b706"
dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
mode: GRACEFUL
new_leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
 from {username='slave'} at 127.0.0.1:41662
I20260709 14:50:32.479249  7846 raft_consensus.cc:606] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 LEADER]: Received request to transfer leadership to TS 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:50:32.482049  7772 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927"
dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
mode: GRACEFUL
new_leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:47068
I20260709 14:50:32.482615  7772 raft_consensus.cc:606] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Received request to transfer leadership to TS 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:32.485647  7772 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9ce9c0ef2db24c13a8b1402f21819458"
dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
mode: GRACEFUL
new_leader_uuid: "9418391fa82a42c79c6cad13ba91d964"
 from {username='slave'} at 127.0.0.1:47068
I20260709 14:50:32.486248  7772 raft_consensus.cc:606] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Received request to transfer leadership to TS 9418391fa82a42c79c6cad13ba91d964
I20260709 14:50:32.487556  6549 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 14:50:32.488683  6549 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 14:50:32.580560  8746 raft_consensus.cc:993] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed: : Instructing follower 3876b8ee8d744cb18e91d97aae93b1ac to start an election
I20260709 14:50:32.581425  8746 raft_consensus.cc:1081] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Signalling peer 3876b8ee8d744cb18e91d97aae93b1ac to start an election
I20260709 14:50:32.585134  7846 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927"
dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:49948
I20260709 14:50:32.585955  7846 raft_consensus.cc:493] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:50:32.586359  7846 raft_consensus.cc:3060] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:32.606895  7846 raft_consensus.cc:515] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:32.613476  7846 leader_election.cc:290] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 2 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:32.623721  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:50:32.624434  7925 raft_consensus.cc:3060] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:32.636530  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:50:32.637418  7775 raft_consensus.cc:3055] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Stepping down as leader of term 1
I20260709 14:50:32.638027  7775 raft_consensus.cc:740] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:50:32.638926  7775 consensus_queue.cc:260] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:32.640245  7775 raft_consensus.cc:3060] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:32.649564  7775 raft_consensus.cc:2468] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 2.
I20260709 14:50:32.674641  7925 raft_consensus.cc:2468] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 2.
I20260709 14:50:32.695760  7819 leader_election.cc:304] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:50:32.697443  8852 raft_consensus.cc:2804] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:50:32.698032  8852 raft_consensus.cc:697] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:50:32.698942  8852 consensus_queue.cc:237] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:32.710810  8708 raft_consensus.cc:993] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed: : Instructing follower 9418391fa82a42c79c6cad13ba91d964 to start an election
I20260709 14:50:32.711418  8854 raft_consensus.cc:1081] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Signalling peer 9418391fa82a42c79c6cad13ba91d964 to start an election
I20260709 14:50:32.713591  8637 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9ce9c0ef2db24c13a8b1402f21819458"
dest_uuid: "9418391fa82a42c79c6cad13ba91d964"
 from {username='slave'} at 127.0.0.1:44352
I20260709 14:50:32.714249  8637 raft_consensus.cc:493] T 9ce9c0ef2db24c13a8b1402f21819458 P 9418391fa82a42c79c6cad13ba91d964 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:50:32.714615  8637 raft_consensus.cc:3060] T 9ce9c0ef2db24c13a8b1402f21819458 P 9418391fa82a42c79c6cad13ba91d964 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:32.723564  8637 raft_consensus.cc:515] T 9ce9c0ef2db24c13a8b1402f21819458 P 9418391fa82a42c79c6cad13ba91d964 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:50:32.736256  8637 leader_election.cc:290] T 9ce9c0ef2db24c13a8b1402f21819458 P 9418391fa82a42c79c6cad13ba91d964 [CANDIDATE]: Term 2 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:32.736927  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce9c0ef2db24c13a8b1402f21819458" candidate_uuid: "9418391fa82a42c79c6cad13ba91d964" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:50:32.740756  7920 raft_consensus.cc:3060] T 9ce9c0ef2db24c13a8b1402f21819458 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:32.746629  8853 raft_consensus.cc:993] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac: : Instructing follower 1e9289592458429bbddb19c2e7b7b7b0 to start an election
I20260709 14:50:32.747252  8853 raft_consensus.cc:1081] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 LEADER]: Signalling peer 1e9289592458429bbddb19c2e7b7b7b0 to start an election
I20260709 14:50:32.752115  7920 raft_consensus.cc:2468] T 9ce9c0ef2db24c13a8b1402f21819458 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9418391fa82a42c79c6cad13ba91d964 in term 2.
I20260709 14:50:32.753196  7926 raft_consensus.cc:1240] T 9ce9c0ef2db24c13a8b1402f21819458 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 1. Current term is 2. Ops: []
I20260709 14:50:32.753888  8598 leader_election.cc:304] T 9ce9c0ef2db24c13a8b1402f21819458 P 9418391fa82a42c79c6cad13ba91d964 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 9418391fa82a42c79c6cad13ba91d964; no voters: 
I20260709 14:50:32.754792  8859 raft_consensus.cc:2804] T 9ce9c0ef2db24c13a8b1402f21819458 P 9418391fa82a42c79c6cad13ba91d964 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:50:32.755219  8859 raft_consensus.cc:697] T 9ce9c0ef2db24c13a8b1402f21819458 P 9418391fa82a42c79c6cad13ba91d964 [term 2 LEADER]: Becoming Leader. State: Replica: 9418391fa82a42c79c6cad13ba91d964, State: Running, Role: LEADER
I20260709 14:50:32.755946  8859 consensus_queue.cc:237] T 9ce9c0ef2db24c13a8b1402f21819458 P 9418391fa82a42c79c6cad13ba91d964 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:50:32.768793  7675 catalog_manager.cc:5697] T 9ce9c0ef2db24c13a8b1402f21819458 P 9418391fa82a42c79c6cad13ba91d964 reported cstate change: term changed from 1 to 2, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68). New cstate: current_term: 2 leader_uuid: "9418391fa82a42c79c6cad13ba91d964" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 14:50:32.781075  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce9c0ef2db24c13a8b1402f21819458" candidate_uuid: "9418391fa82a42c79c6cad13ba91d964" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:50:32.781772  7779 raft_consensus.cc:3055] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Stepping down as leader of term 1
I20260709 14:50:32.782084  7779 raft_consensus.cc:740] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:50:32.782778  7779 consensus_queue.cc:260] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:50:32.784130  7779 raft_consensus.cc:3060] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:32.789129  7920 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "939996e77ee64e9fab21aef50758b706"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
 from {username='slave'} at 127.0.0.1:38516
I20260709 14:50:32.789897  7920 raft_consensus.cc:493] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:50:32.790269  7920 raft_consensus.cc:3060] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:50:32.791316  7673 catalog_manager.cc:5697] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 1 to 2, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 2 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:50:32.807394  7779 raft_consensus.cc:2468] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9418391fa82a42c79c6cad13ba91d964 in term 2.
I20260709 14:50:32.812502  7920 raft_consensus.cc:515] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:32.818013  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:50:32.818820  7850 raft_consensus.cc:3055] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 LEADER]: Stepping down as leader of term 2
I20260709 14:50:32.819134  7850 raft_consensus.cc:740] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:50:32.819916  7850 consensus_queue.cc:260] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:32.821035  7850 raft_consensus.cc:3060] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:50:32.831471  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:50:32.818006  7920 leader_election.cc:290] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 3 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:50:32.834229  7779 raft_consensus.cc:3060] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:50:32.836333  7850 raft_consensus.cc:2468] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 3.
W20260709 14:50:32.872653  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 45737.2us
W20260709 14:50:32.875435  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 46097.6us
W20260709 14:50:32.892153  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 61155.5us
I20260709 14:50:32.892493  7779 raft_consensus.cc:2468] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 3.
I20260709 14:50:32.896886  7894 leader_election.cc:304] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:50:32.928325  8829 raft_consensus.cc:2804] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 14:50:32.934262  8829 raft_consensus.cc:697] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:50:32.940001  8854 raft_consensus.cc:993] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed: : Instructing follower 1e9289592458429bbddb19c2e7b7b7b0 to start an election
I20260709 14:50:32.941083  8673 raft_consensus.cc:1081] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Signalling peer 1e9289592458429bbddb19c2e7b7b7b0 to start an election
I20260709 14:50:32.936002  8829 consensus_queue.cc:237] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:50:32.945073  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 48897.2us
I20260709 14:50:32.964123  8854 raft_consensus.cc:993] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed: : Instructing follower 3876b8ee8d744cb18e91d97aae93b1ac to start an election
I20260709 14:50:32.965101  8708 raft_consensus.cc:1081] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Signalling peer 3876b8ee8d744cb18e91d97aae93b1ac to start an election
I20260709 14:50:32.976444  7924 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
 from {username='slave'} at 127.0.0.1:38532
I20260709 14:50:32.977739  7924 raft_consensus.cc:493] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:50:32.978294  7924 raft_consensus.cc:3060] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:32.993172  7846 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d"
dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:49948
I20260709 14:50:32.995527  7846 raft_consensus.cc:493] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:50:32.996075  7846 raft_consensus.cc:3060] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:33.003911  7924 raft_consensus.cc:515] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:33.001888  7673 catalog_manager.cc:5697] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 2 to 3, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 3 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:50:33.015791  7924 leader_election.cc:290] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 2 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:50:33.019452  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:50:33.020506  7851 raft_consensus.cc:3060] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:33.036185  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:50:33.037161  7779 raft_consensus.cc:3055] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Stepping down as leader of term 1
I20260709 14:50:33.037597  7779 raft_consensus.cc:740] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:50:33.039314  7779 consensus_queue.cc:260] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:33.056890  7779 raft_consensus.cc:3060] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:33.070183  8849 raft_consensus.cc:993] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0: : Instructing follower 1de5e20126fa4d8ca0793d19c7b847ed to start an election
I20260709 14:50:33.074177  8848 raft_consensus.cc:1081] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 LEADER]: Signalling peer 1de5e20126fa4d8ca0793d19c7b847ed to start an election
I20260709 14:50:33.075117  7851 raft_consensus.cc:2468] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 2.
I20260709 14:50:33.077641  7846 raft_consensus.cc:515] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:33.088573  7846 leader_election.cc:290] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 2 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:33.090492  7894 leader_election.cc:304] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:50:33.102267  7779 raft_consensus.cc:2468] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 2.
I20260709 14:50:33.115061  8871 raft_consensus.cc:2804] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:50:33.116465  8871 raft_consensus.cc:697] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:50:33.120394  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
W20260709 14:50:33.120664  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 50390.6us
I20260709 14:50:33.121654  7779 raft_consensus.cc:3055] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Stepping down as leader of term 1
I20260709 14:50:33.123200  7779 raft_consensus.cc:740] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:50:33.122207  8871 consensus_queue.cc:237] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:33.123776  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:50:33.124403  7924 raft_consensus.cc:3060] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:33.124958  7779 consensus_queue.cc:260] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:33.126366  7779 raft_consensus.cc:3060] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:33.127826  7777 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b"
dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:37144
I20260709 14:50:33.128468  7777 raft_consensus.cc:493] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:50:33.128808  7777 raft_consensus.cc:3060] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:50:33.133690  7779 raft_consensus.cc:2468] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 2.
I20260709 14:50:33.133987  7924 raft_consensus.cc:2468] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 2.
I20260709 14:50:33.140223  7777 raft_consensus.cc:515] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:33.142056  7777 leader_election.cc:290] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:33.147313  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:50:33.148130  7924 raft_consensus.cc:3055] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 14:50:33.148625  7924 raft_consensus.cc:740] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:50:33.149646  7924 consensus_queue.cc:260] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:33.160020  7924 raft_consensus.cc:3060] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:50:33.162834  7819 leader_election.cc:304] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:50:33.164281  8851 raft_consensus.cc:2804] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:50:33.164834  8851 raft_consensus.cc:697] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:50:33.165851  8851 consensus_queue.cc:237] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:33.166054  7673 catalog_manager.cc:5697] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 1 to 2, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 2 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:50:33.170625  7924 raft_consensus.cc:2468] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 3.
I20260709 14:50:33.173841  7744 leader_election.cc:304] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:50:33.175244  8746 raft_consensus.cc:2804] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Leader election won for term 3
I20260709 14:50:33.175868  8746 raft_consensus.cc:697] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:50:33.176748  8746 consensus_queue.cc:237] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:33.181957  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:50:33.182818  7851 raft_consensus.cc:3060] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:50:33.193712  7851 raft_consensus.cc:2468] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 3.
I20260709 14:50:33.211970  7673 catalog_manager.cc:5697] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 2 to 3, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 3 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:50:33.223309  7924 raft_consensus.cc:1275] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:50:33.223170  7675 catalog_manager.cc:5697] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 1 to 2, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 2 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:50:33.252168  8851 consensus_queue.cc:1048] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 14:50:33.254539  7779 raft_consensus.cc:1275] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Refusing update from remote peer 9418391fa82a42c79c6cad13ba91d964: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 14:50:33.257787  8859 consensus_queue.cc:1048] T 9ce9c0ef2db24c13a8b1402f21819458 P 9418391fa82a42c79c6cad13ba91d964 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 14:50:33.307850  7925 raft_consensus.cc:1275] T 9ce9c0ef2db24c13a8b1402f21819458 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Refusing update from remote peer 9418391fa82a42c79c6cad13ba91d964: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 14:50:33.310601  8876 consensus_queue.cc:1048] T 9ce9c0ef2db24c13a8b1402f21819458 P 9418391fa82a42c79c6cad13ba91d964 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 14:50:33.368078  7779 raft_consensus.cc:1275] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:50:33.377360  8853 consensus_queue.cc:1048] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 14:50:33.469180  7775 raft_consensus.cc:1275] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 14:50:33.472939  8868 consensus_queue.cc:1048] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 14:50:33.487836  7846 raft_consensus.cc:1275] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 14:50:33.490093  6549 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 14:50:33.491655  8870 consensus_queue.cc:1048] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 14:50:33.543169  7846 raft_consensus.cc:1275] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:50:33.546381  8870 consensus_queue.cc:1048] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 14:50:33.565218  7924 raft_consensus.cc:1275] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 14:50:33.567477  8866 consensus_queue.cc:1048] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 14:50:33.592639  6549 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 14:50:33.615115  7850 raft_consensus.cc:1275] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 14:50:33.603058  7925 raft_consensus.cc:1275] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:50:33.638546  8851 consensus_queue.cc:1048] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 14:50:33.641573  8854 consensus_queue.cc:1048] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 14:50:33.673609  7779 raft_consensus.cc:1275] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:50:33.677424  8871 consensus_queue.cc:1048] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 14:50:33.710798  7779 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c"
dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
mode: GRACEFUL
new_leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:47068
I20260709 14:50:33.711580  7779 raft_consensus.cc:606] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Received request to transfer leadership to TS 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:33.718477  7850 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3"
dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
mode: GRACEFUL
new_leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
 from {username='slave'} at 127.0.0.1:41662
I20260709 14:50:33.719318  7850 raft_consensus.cc:606] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 LEADER]: Received request to transfer leadership to TS 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:50:33.723783  7772 raft_consensus.cc:1275] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:50:33.747572  7846 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a18d29d52d304c87b930d4fb5eaf50b1"
dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
mode: GRACEFUL
new_leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:41662
I20260709 14:50:33.748298  7846 raft_consensus.cc:606] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 LEADER]: Received request to transfer leadership to TS 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:50:33.754808  7924 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
mode: GRACEFUL
new_leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:48676
I20260709 14:50:33.755488  7924 raft_consensus.cc:606] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 LEADER]: Received request to transfer leadership to TS 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:50:33.757412  6549 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 14:50:33.760754  8853 consensus_queue.cc:1048] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 14:50:33.762454  6549 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 14:50:33.833371  8870 raft_consensus.cc:993] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0: : Instructing follower 1de5e20126fa4d8ca0793d19c7b847ed to start an election
I20260709 14:50:33.834023  8868 raft_consensus.cc:1081] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 LEADER]: Signalling peer 1de5e20126fa4d8ca0793d19c7b847ed to start an election
I20260709 14:50:33.837598  8797 raft_consensus.cc:993] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac: : Instructing follower 1de5e20126fa4d8ca0793d19c7b847ed to start an election
I20260709 14:50:33.838310  8890 raft_consensus.cc:1081] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 LEADER]: Signalling peer 1de5e20126fa4d8ca0793d19c7b847ed to start an election
I20260709 14:50:33.846247  7779 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca"
dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:37144
I20260709 14:50:33.847409  7779 raft_consensus.cc:493] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:50:33.847900  7779 raft_consensus.cc:3060] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:50:33.853152  7771 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a18d29d52d304c87b930d4fb5eaf50b1"
dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:37136
I20260709 14:50:33.854013  7771 raft_consensus.cc:493] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:50:33.854414  7771 raft_consensus.cc:3060] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:33.863276  7771 raft_consensus.cc:515] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:50:33.867553  7771 leader_election.cc:290] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 2 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68:42321)
I20260709 14:50:33.868369  8637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18d29d52d304c87b930d4fb5eaf50b1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "9418391fa82a42c79c6cad13ba91d964"
I20260709 14:50:33.869065  8637 raft_consensus.cc:3060] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:33.871183  7779 raft_consensus.cc:515] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:33.873422  7779 leader_election.cc:290] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:33.875010  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:50:33.875788  7846 raft_consensus.cc:3060] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:50:33.875097  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18d29d52d304c87b930d4fb5eaf50b1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:50:33.876683  7851 raft_consensus.cc:3055] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 LEADER]: Stepping down as leader of term 1
I20260709 14:50:33.878528  7851 raft_consensus.cc:740] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:50:33.879730  8637 raft_consensus.cc:2468] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 2.
I20260709 14:50:33.880950  7851 consensus_queue.cc:260] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:50:33.881285  7742 leader_election.cc:304] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 9418391fa82a42c79c6cad13ba91d964; no voters: 
I20260709 14:50:33.882360  8673 raft_consensus.cc:2804] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:50:33.882807  8673 raft_consensus.cc:697] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:50:33.883949  8673 consensus_queue.cc:237] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:50:33.888856  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:50:33.889751  7925 raft_consensus.cc:3055] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 14:50:33.890137  7925 raft_consensus.cc:740] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:50:33.890599  7846 raft_consensus.cc:2468] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 5.
I20260709 14:50:33.892177  7745 leader_election.cc:304] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:50:33.893177  8854 raft_consensus.cc:2804] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader election won for term 5
I20260709 14:50:33.893736  8854 raft_consensus.cc:697] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:50:33.894217  7925 consensus_queue.cc:260] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:33.894766  8854 consensus_queue.cc:237] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:33.896338  7851 raft_consensus.cc:3060] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:33.899523  7925 raft_consensus.cc:3060] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:50:33.928926  7673 catalog_manager.cc:5697] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 1 to 2, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 2 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 14:50:33.929821  7851 raft_consensus.cc:2468] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 2.
I20260709 14:50:33.948401  7925 raft_consensus.cc:2468] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 5.
I20260709 14:50:33.998238  8890 raft_consensus.cc:993] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac: : Instructing follower 1e9289592458429bbddb19c2e7b7b7b0 to start an election
I20260709 14:50:33.998891  8890 raft_consensus.cc:1081] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 LEADER]: Signalling peer 1e9289592458429bbddb19c2e7b7b7b0 to start an election
I20260709 14:50:34.004303  7925 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
 from {username='slave'} at 127.0.0.1:38516
I20260709 14:50:34.005008  7925 raft_consensus.cc:493] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:50:34.005488  7925 raft_consensus.cc:3060] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:34.015986  7925 raft_consensus.cc:515] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:34.019042  7925 leader_election.cc:290] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 2 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:50:34.020175  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:50:34.020574  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:50:34.021370  7851 raft_consensus.cc:3055] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 LEADER]: Stepping down as leader of term 1
I20260709 14:50:34.021723  7851 raft_consensus.cc:740] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:50:34.022192  7771 raft_consensus.cc:3060] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:34.023658  7851 consensus_queue.cc:260] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:34.026160  7851 raft_consensus.cc:3060] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:34.031893  8673 raft_consensus.cc:993] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed: : Instructing follower 3876b8ee8d744cb18e91d97aae93b1ac to start an election
I20260709 14:50:34.032507  8673 raft_consensus.cc:1081] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Signalling peer 3876b8ee8d744cb18e91d97aae93b1ac to start an election
I20260709 14:50:34.037176  7846 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c"
dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:49948
I20260709 14:50:34.037981  7846 raft_consensus.cc:493] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:50:34.038604  7846 raft_consensus.cc:3060] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:34.044863  7851 raft_consensus.cc:2468] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 2.
I20260709 14:50:34.042927  7673 catalog_manager.cc:5697] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 4 to 5, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 5 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:50:34.046542  7894 leader_election.cc:304] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:50:34.047443  8848 raft_consensus.cc:2804] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:50:34.047936  8848 raft_consensus.cc:697] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:50:34.048837  8848 consensus_queue.cc:237] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:34.055164  7771 raft_consensus.cc:2468] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 2.
I20260709 14:50:34.070287  7846 raft_consensus.cc:515] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:34.073938  7846 leader_election.cc:290] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 2 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:34.074209  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:50:34.074944  7771 raft_consensus.cc:3055] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Stepping down as leader of term 1
I20260709 14:50:34.075292  7771 raft_consensus.cc:740] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:50:34.076138  7771 consensus_queue.cc:260] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:34.076936  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:50:34.077593  7771 raft_consensus.cc:3060] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:34.078663  7673 catalog_manager.cc:5697] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 1 to 2, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 2 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:50:34.085804  7771 raft_consensus.cc:2468] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 2.
I20260709 14:50:34.077674  7925 raft_consensus.cc:3060] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:34.095036  7819 leader_election.cc:304] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:50:34.100522  8853 raft_consensus.cc:2804] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:50:34.103451  7925 raft_consensus.cc:2468] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 2.
I20260709 14:50:34.108512  8853 raft_consensus.cc:697] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:50:34.109601  8853 consensus_queue.cc:237] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:34.131415  7673 catalog_manager.cc:5697] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 1 to 2, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 2 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:50:34.282133  7851 raft_consensus.cc:1275] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 14:50:34.284163  8854 consensus_queue.cc:1048] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 14:50:34.323010  8637 raft_consensus.cc:1275] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 [term 2 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 14:50:34.325371  8708 consensus_queue.cc:1048] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 14:50:34.440001  7850 raft_consensus.cc:1275] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:50:34.441883  8909 consensus_queue.cc:1048] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 14:50:34.457540  7850 raft_consensus.cc:1275] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 14:50:34.463048  7772 raft_consensus.cc:1275] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:50:34.465418  8854 consensus_queue.cc:1048] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 14:50:34.468663  8909 consensus_queue.cc:1048] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 14:50:34.504603  7925 raft_consensus.cc:1275] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 14:50:34.508285  8854 consensus_queue.cc:1048] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 14:50:34.647151  7772 raft_consensus.cc:1275] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:50:34.648643  8797 consensus_queue.cc:1048] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 14:50:34.686946  7925 raft_consensus.cc:1275] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:50:34.699730  8890 consensus_queue.cc:1048] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 14:50:34.763890  6549 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 14:50:34.814057  6549 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 14:50:34.864699  7771 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16"
dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
mode: GRACEFUL
new_leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:47068
I20260709 14:50:34.865329  7771 raft_consensus.cc:606] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Received request to transfer leadership to TS 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:34.867985  7771 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072"
dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
mode: GRACEFUL
new_leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:47068
I20260709 14:50:34.868592  7771 raft_consensus.cc:606] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Received request to transfer leadership to TS 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:34.871343  7851 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c"
dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
mode: GRACEFUL
new_leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
 from {username='slave'} at 127.0.0.1:41662
I20260709 14:50:34.871809  7851 raft_consensus.cc:606] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 LEADER]: Received request to transfer leadership to TS 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:50:34.874809  7851 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ad8e261558b942c6b42c841689082c10"
dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
mode: GRACEFUL
new_leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:41662
I20260709 14:50:34.875401  7851 raft_consensus.cc:606] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 LEADER]: Received request to transfer leadership to TS 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:50:34.878796  7922 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
mode: GRACEFUL
new_leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:48676
I20260709 14:50:34.879388  7922 raft_consensus.cc:606] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 LEADER]: Received request to transfer leadership to TS 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:50:34.880683  6549 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 14:50:34.882597  6549 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 14:50:35.037117  8917 raft_consensus.cc:993] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0: : Instructing follower 1de5e20126fa4d8ca0793d19c7b847ed to start an election
I20260709 14:50:35.037798  8868 raft_consensus.cc:1081] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 LEADER]: Signalling peer 1de5e20126fa4d8ca0793d19c7b847ed to start an election
I20260709 14:50:35.039803  7771 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1"
dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:37144
I20260709 14:50:35.040376  7771 raft_consensus.cc:493] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:50:35.040656  7771 raft_consensus.cc:3060] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:35.047708  7771 raft_consensus.cc:515] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:35.049655  7771 leader_election.cc:290] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 2 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:35.050695  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:50:35.050680  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:50:35.051445  7846 raft_consensus.cc:3060] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:35.051569  7922 raft_consensus.cc:3055] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 14:50:35.051990  7922 raft_consensus.cc:740] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:50:35.052758  7922 consensus_queue.cc:260] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:35.053772  7922 raft_consensus.cc:3060] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:35.057600  7846 raft_consensus.cc:2468] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 2.
I20260709 14:50:35.059158  7745 leader_election.cc:304] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:50:35.059510  7922 raft_consensus.cc:2468] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 2.
I20260709 14:50:35.059991  8708 raft_consensus.cc:2804] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:50:35.060468  8708 raft_consensus.cc:697] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:50:35.061461  8708 consensus_queue.cc:237] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:35.075675  7674 catalog_manager.cc:5697] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 1 to 2, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 2 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:50:35.188267  8853 raft_consensus.cc:993] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac: : Instructing follower 1de5e20126fa4d8ca0793d19c7b847ed to start an election
I20260709 14:50:35.188844  8797 raft_consensus.cc:1081] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 LEADER]: Signalling peer 1de5e20126fa4d8ca0793d19c7b847ed to start an election
I20260709 14:50:35.190817  7772 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ad8e261558b942c6b42c841689082c10"
dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:37136
I20260709 14:50:35.191483  7772 raft_consensus.cc:493] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:50:35.191927  7772 raft_consensus.cc:3060] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:35.199931  7772 raft_consensus.cc:515] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:35.201798  7772 leader_election.cc:290] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 2 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:35.202853  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:50:35.203433  7851 raft_consensus.cc:3055] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 LEADER]: Stepping down as leader of term 1
I20260709 14:50:35.203738  7851 raft_consensus.cc:740] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:50:35.203653  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:50:35.204548  7922 raft_consensus.cc:3060] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:35.204854  7851 consensus_queue.cc:260] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:35.206387  7851 raft_consensus.cc:3060] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:35.207056  8708 raft_consensus.cc:993] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed: : Instructing follower 3876b8ee8d744cb18e91d97aae93b1ac to start an election
I20260709 14:50:35.207605  8866 raft_consensus.cc:1081] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Signalling peer 3876b8ee8d744cb18e91d97aae93b1ac to start an election
I20260709 14:50:35.210064  7846 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072"
dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:49948
I20260709 14:50:35.210712  7846 raft_consensus.cc:493] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:50:35.211081  7846 raft_consensus.cc:3060] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:35.214722  7851 raft_consensus.cc:2468] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 2.
I20260709 14:50:35.219281  7922 raft_consensus.cc:2468] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 2.
I20260709 14:50:35.217883  7745 leader_election.cc:304] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:50:35.221182  8708 raft_consensus.cc:2804] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:50:35.221814  8708 raft_consensus.cc:697] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:50:35.222337  7846 raft_consensus.cc:515] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:35.222690  8708 consensus_queue.cc:237] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:35.224500  7846 leader_election.cc:290] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 2 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:35.225849  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:50:35.226612  7922 raft_consensus.cc:3060] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:35.233656  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:50:35.234570  7772 raft_consensus.cc:3055] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Stepping down as leader of term 1
I20260709 14:50:35.237637  7772 raft_consensus.cc:740] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:50:35.238559  7772 consensus_queue.cc:260] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:35.239823  7772 raft_consensus.cc:3060] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:35.237074  7922 raft_consensus.cc:2468] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 2.
I20260709 14:50:35.241603  7674 catalog_manager.cc:5697] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 1 to 2, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 2 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:50:35.242318  7819 leader_election.cc:304] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:50:35.243368  8853 raft_consensus.cc:2804] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:50:35.243892  8853 raft_consensus.cc:697] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:50:35.244787  8853 consensus_queue.cc:237] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:35.246654  7772 raft_consensus.cc:2468] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 2.
I20260709 14:50:35.259150  7674 catalog_manager.cc:5697] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 1 to 2, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 2 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:50:35.282239  8890 raft_consensus.cc:993] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac: : Instructing follower 1e9289592458429bbddb19c2e7b7b7b0 to start an election
I20260709 14:50:35.282848  8853 raft_consensus.cc:1081] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 LEADER]: Signalling peer 1e9289592458429bbddb19c2e7b7b7b0 to start an election
I20260709 14:50:35.284868  7925 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
 from {username='slave'} at 127.0.0.1:38516
I20260709 14:50:35.285539  7925 raft_consensus.cc:493] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:50:35.285948  7925 raft_consensus.cc:3060] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:50:35.294505  7925 raft_consensus.cc:515] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:35.297681  7925 leader_election.cc:290] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 3 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:50:35.297636  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:50:35.297991  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:50:35.298643  7846 raft_consensus.cc:3055] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 LEADER]: Stepping down as leader of term 2
I20260709 14:50:35.298629  7772 raft_consensus.cc:3060] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:50:35.307765  7772 raft_consensus.cc:2468] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 3.
I20260709 14:50:35.299147  7846 raft_consensus.cc:740] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:50:35.308861  7846 consensus_queue.cc:260] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:35.309927  7846 raft_consensus.cc:3060] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:50:35.314014  8708 raft_consensus.cc:993] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed: : Instructing follower 3876b8ee8d744cb18e91d97aae93b1ac to start an election
I20260709 14:50:35.314656  8866 raft_consensus.cc:1081] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Signalling peer 3876b8ee8d744cb18e91d97aae93b1ac to start an election
I20260709 14:50:35.314525  7893 leader_election.cc:304] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:50:35.315718  8917 raft_consensus.cc:2804] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 14:50:35.316262  8917 raft_consensus.cc:697] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:50:35.317160  7851 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16"
dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:49948
I20260709 14:50:35.317474  8917 consensus_queue.cc:237] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:35.318048  7851 raft_consensus.cc:493] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:50:35.318434  7851 raft_consensus.cc:3060] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:35.316176  7846 raft_consensus.cc:2468] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 3.
I20260709 14:50:35.329439  7851 raft_consensus.cc:515] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:35.332491  7851 leader_election.cc:290] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 2 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:35.333595  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:50:35.332666  7674 catalog_manager.cc:5697] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 2 to 3, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 3 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:50:35.334390  7772 raft_consensus.cc:3055] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Stepping down as leader of term 1
I20260709 14:50:35.334879  7772 raft_consensus.cc:740] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:50:35.335976  7772 consensus_queue.cc:260] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:35.334026  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:50:35.337471  7772 raft_consensus.cc:3060] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:35.337741  7925 raft_consensus.cc:3060] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:35.346315  7925 raft_consensus.cc:2468] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 2.
I20260709 14:50:35.347664  7772 raft_consensus.cc:2468] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 2.
I20260709 14:50:35.348227  7819 leader_election.cc:304] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:50:35.350423  8853 raft_consensus.cc:2804] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:50:35.351125  8853 raft_consensus.cc:697] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:50:35.352866  8853 consensus_queue.cc:237] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:35.368178  7674 catalog_manager.cc:5697] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 1 to 2, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 2 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:50:35.513953  7922 raft_consensus.cc:1275] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:50:35.516024  8866 consensus_queue.cc:1048] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 14:50:35.529313  7846 raft_consensus.cc:1275] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:50:35.534017  8927 consensus_queue.cc:1048] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 14:50:35.702906  7922 raft_consensus.cc:1275] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:50:35.704569  8890 consensus_queue.cc:1048] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 14:50:35.711058  7925 raft_consensus.cc:1275] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:50:35.713778  8866 consensus_queue.cc:1048] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 14:50:35.729832  7771 raft_consensus.cc:1275] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:50:35.734280  8890 consensus_queue.cc:1048] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 14:50:35.739948  7851 raft_consensus.cc:1275] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:50:35.751236  7775 raft_consensus.cc:1275] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 14:50:35.752558  8927 consensus_queue.cc:1048] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 14:50:35.758338  8909 consensus_queue.cc:1048] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 14:50:35.790845  7851 raft_consensus.cc:1275] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 14:50:35.795020  8868 consensus_queue.cc:1048] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 14:50:35.877754  7925 raft_consensus.cc:1275] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:50:35.879540  8890 consensus_queue.cc:1048] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 14:50:35.883667  6549 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 14:50:35.906409  7775 raft_consensus.cc:1275] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:50:35.914403  8797 consensus_queue.cc:1048] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 14:50:35.996388  6549 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 14:50:36.040896  7924 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
mode: GRACEFUL
new_leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:48676
I20260709 14:50:36.041733  7924 raft_consensus.cc:606] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 LEADER]: Received request to transfer leadership to TS 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:50:36.044975  7771 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa"
dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
mode: GRACEFUL
new_leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:47068
I20260709 14:50:36.045749  7771 raft_consensus.cc:606] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Received request to transfer leadership to TS 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:36.049664  7771 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f"
dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
mode: GRACEFUL
new_leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:47068
I20260709 14:50:36.050319  7771 raft_consensus.cc:606] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Received request to transfer leadership to TS 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:36.053201  7851 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01"
dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
mode: GRACEFUL
new_leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
 from {username='slave'} at 127.0.0.1:41662
I20260709 14:50:36.054001  7851 raft_consensus.cc:606] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 LEADER]: Received request to transfer leadership to TS 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:50:36.060796  7851 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9441e831627143a991a1556dcdce71e3"
dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
mode: GRACEFUL
new_leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:41662
I20260709 14:50:36.061503  7851 raft_consensus.cc:606] T 9441e831627143a991a1556dcdce71e3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 LEADER]: Received request to transfer leadership to TS 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:50:36.062892  6549 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 14:50:36.064651  6549 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 14:50:36.185506  8853 raft_consensus.cc:993] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac: : Instructing follower 1e9289592458429bbddb19c2e7b7b7b0 to start an election
I20260709 14:50:36.186239  8853 raft_consensus.cc:1081] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 LEADER]: Signalling peer 1e9289592458429bbddb19c2e7b7b7b0 to start an election
I20260709 14:50:36.189013  7924 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
 from {username='slave'} at 127.0.0.1:38516
I20260709 14:50:36.189939  7924 raft_consensus.cc:493] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:50:36.190398  7924 raft_consensus.cc:3060] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:36.203619  7924 raft_consensus.cc:515] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:36.205673  7924 leader_election.cc:290] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 2 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:50:36.208686  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:50:36.209542  7850 raft_consensus.cc:3055] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 LEADER]: Stepping down as leader of term 1
I20260709 14:50:36.209868  7850 raft_consensus.cc:740] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:50:36.210675  7850 consensus_queue.cc:260] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:36.212000  7850 raft_consensus.cc:3060] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:36.221928  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:50:36.222811  7771 raft_consensus.cc:3060] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:36.224229  7850 raft_consensus.cc:2468] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 2.
I20260709 14:50:36.226095  7894 leader_election.cc:304] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:50:36.227630  8909 raft_consensus.cc:2804] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:50:36.228233  8909 raft_consensus.cc:697] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:50:36.229475  8909 consensus_queue.cc:237] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:36.232491  7771 raft_consensus.cc:2468] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 2.
I20260709 14:50:36.244818  7675 catalog_manager.cc:5697] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 1 to 2, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 2 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:50:36.345028  8927 raft_consensus.cc:993] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed: : Instructing follower 3876b8ee8d744cb18e91d97aae93b1ac to start an election
I20260709 14:50:36.345697  8866 raft_consensus.cc:1081] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Signalling peer 3876b8ee8d744cb18e91d97aae93b1ac to start an election
I20260709 14:50:36.347606  7850 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa"
dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:49948
I20260709 14:50:36.348104  7850 raft_consensus.cc:493] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:50:36.348351  7850 raft_consensus.cc:3060] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:36.356089  8797 raft_consensus.cc:993] T 9441e831627143a991a1556dcdce71e3 P 3876b8ee8d744cb18e91d97aae93b1ac: : Instructing follower 1de5e20126fa4d8ca0793d19c7b847ed to start an election
I20260709 14:50:36.356333  7850 raft_consensus.cc:515] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:36.357411  8853 raft_consensus.cc:1081] T 9441e831627143a991a1556dcdce71e3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 LEADER]: Signalling peer 1de5e20126fa4d8ca0793d19c7b847ed to start an election
I20260709 14:50:36.358764  7850 leader_election.cc:290] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 2 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:36.359815  7779 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9441e831627143a991a1556dcdce71e3"
dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:37136
I20260709 14:50:36.360487  7779 raft_consensus.cc:493] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:50:36.360839  7779 raft_consensus.cc:3060] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:36.361744  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:50:36.362454  7925 raft_consensus.cc:3060] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:36.363560  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:50:36.363801  8917 raft_consensus.cc:993] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0: : Instructing follower 1de5e20126fa4d8ca0793d19c7b847ed to start an election
I20260709 14:50:36.364192  7771 raft_consensus.cc:3055] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Stepping down as leader of term 1
I20260709 14:50:36.364579  7771 raft_consensus.cc:740] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:50:36.365645  7771 consensus_queue.cc:260] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:36.369187  7771 raft_consensus.cc:3060] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:36.372336  7779 raft_consensus.cc:515] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:50:36.365312  8868 raft_consensus.cc:1081] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 LEADER]: Signalling peer 1de5e20126fa4d8ca0793d19c7b847ed to start an election
I20260709 14:50:36.376777  7779 leader_election.cc:290] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 2 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68:42321)
I20260709 14:50:36.377804  8637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9441e831627143a991a1556dcdce71e3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "9418391fa82a42c79c6cad13ba91d964"
I20260709 14:50:36.378770  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9441e831627143a991a1556dcdce71e3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:50:36.379010  8637 raft_consensus.cc:3060] T 9441e831627143a991a1556dcdce71e3 P 9418391fa82a42c79c6cad13ba91d964 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:36.379572  7846 raft_consensus.cc:3055] T 9441e831627143a991a1556dcdce71e3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 LEADER]: Stepping down as leader of term 1
I20260709 14:50:36.380180  7846 raft_consensus.cc:740] T 9441e831627143a991a1556dcdce71e3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:50:36.381052  7846 consensus_queue.cc:260] T 9441e831627143a991a1556dcdce71e3 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:50:36.382400  7846 raft_consensus.cc:3060] T 9441e831627143a991a1556dcdce71e3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:36.384479  7779 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86"
dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:37144
I20260709 14:50:36.385299  7779 raft_consensus.cc:493] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:50:36.385717  7779 raft_consensus.cc:3060] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:36.392215  7846 raft_consensus.cc:2468] T 9441e831627143a991a1556dcdce71e3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 2.
I20260709 14:50:36.393046  8637 raft_consensus.cc:2468] T 9441e831627143a991a1556dcdce71e3 P 9418391fa82a42c79c6cad13ba91d964 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 2.
I20260709 14:50:36.395154  7742 leader_election.cc:304] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 9418391fa82a42c79c6cad13ba91d964; no voters: 
I20260709 14:50:36.395169  7771 raft_consensus.cc:2468] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 2.
I20260709 14:50:36.398802  8866 raft_consensus.cc:2804] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:50:36.399401  8866 raft_consensus.cc:697] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:50:36.400328  8866 consensus_queue.cc:237] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:50:36.400990  7779 raft_consensus.cc:515] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:36.403658  7819 leader_election.cc:304] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:50:36.405103  8797 raft_consensus.cc:2804] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:50:36.405678  8797 raft_consensus.cc:697] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:50:36.406354  7779 leader_election.cc:290] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 2 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:36.406560  8797 consensus_queue.cc:237] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:36.407555  7925 raft_consensus.cc:2468] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 2.
I20260709 14:50:36.408704  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:50:36.409641  7924 raft_consensus.cc:3055] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 14:50:36.410017  7924 raft_consensus.cc:740] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:50:36.411444  7924 consensus_queue.cc:260] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:36.413228  7924 raft_consensus.cc:3060] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:36.414590  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:50:36.424542  7850 raft_consensus.cc:3060] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:36.432399  7675 catalog_manager.cc:5697] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 1 to 2, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 2 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:50:36.442891  7673 catalog_manager.cc:5697] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 1 to 2, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 2 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 14:50:36.454334  7924 raft_consensus.cc:2468] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 2.
I20260709 14:50:36.461416  7850 raft_consensus.cc:2468] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 2.
I20260709 14:50:36.462528  7744 leader_election.cc:304] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:50:36.468128  8866 raft_consensus.cc:2804] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:50:36.480466  8866 raft_consensus.cc:697] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:50:36.481774  8866 consensus_queue.cc:237] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:36.508405  7673 catalog_manager.cc:5697] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 1 to 2, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 2 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:50:36.539516  8673 raft_consensus.cc:993] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed: : Instructing follower 3876b8ee8d744cb18e91d97aae93b1ac to start an election
I20260709 14:50:36.540081  8673 raft_consensus.cc:1081] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Signalling peer 3876b8ee8d744cb18e91d97aae93b1ac to start an election
I20260709 14:50:36.542112  7846 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f"
dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:49948
I20260709 14:50:36.542797  7846 raft_consensus.cc:493] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:50:36.543161  7846 raft_consensus.cc:3060] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:36.550452  7846 raft_consensus.cc:515] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:36.553398  7846 leader_election.cc:290] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 2 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:36.554286  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:50:36.554512  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:50:36.555011  7779 raft_consensus.cc:3055] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Stepping down as leader of term 1
I20260709 14:50:36.555152  7924 raft_consensus.cc:3060] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:36.555442  7779 raft_consensus.cc:740] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:50:36.557844  7779 consensus_queue.cc:260] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:36.559547  7779 raft_consensus.cc:3060] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:36.564765  7924 raft_consensus.cc:2468] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 2.
I20260709 14:50:36.568176  7819 leader_election.cc:304] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:50:36.569301  8853 raft_consensus.cc:2804] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:50:36.569187  7779 raft_consensus.cc:2468] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 2.
I20260709 14:50:36.570606  8853 raft_consensus.cc:697] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:50:36.571677  8853 consensus_queue.cc:237] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:36.583878  7673 catalog_manager.cc:5697] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 1 to 2, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 2 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:50:36.649077  7771 raft_consensus.cc:1275] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:50:36.651053  8945 consensus_queue.cc:1048] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 14:50:36.665647  7850 raft_consensus.cc:1275] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:50:36.667469  8945 consensus_queue.cc:1048] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 14:50:36.787806  7771 raft_consensus.cc:1275] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:50:36.789697  8853 consensus_queue.cc:1048] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 14:50:36.806783  7924 raft_consensus.cc:1275] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:50:36.811436  8943 consensus_queue.cc:1048] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 14:50:36.842281  7846 raft_consensus.cc:1275] T 9441e831627143a991a1556dcdce71e3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 14:50:36.844125  8673 consensus_queue.cc:1048] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 14:50:36.861393  8637 raft_consensus.cc:1275] T 9441e831627143a991a1556dcdce71e3 P 9418391fa82a42c79c6cad13ba91d964 [term 2 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 14:50:36.864168  8866 consensus_queue.cc:1048] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 14:50:36.876940  7850 raft_consensus.cc:1275] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:50:36.878723  8673 consensus_queue.cc:1048] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 14:50:36.906850  7924 raft_consensus.cc:1275] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:50:36.919450  8948 consensus_queue.cc:1048] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 14:50:36.964700  7922 raft_consensus.cc:1275] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:50:36.966730  8943 consensus_queue.cc:1048] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 14:50:36.982492  7771 raft_consensus.cc:1275] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:50:36.986265  8944 consensus_queue.cc:1048] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 14:50:37.066102  6549 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 14:50:37.146731  6549 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 14:50:37.214148  7851 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072"
dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
mode: GRACEFUL
new_leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
 from {username='slave'} at 127.0.0.1:41662
I20260709 14:50:37.215605  7851 raft_consensus.cc:606] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 LEADER]: Received request to transfer leadership to TS 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:50:37.219071  7771 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9c563cc7cfbe4d59be4ffc5cf847ce56"
dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
mode: GRACEFUL
new_leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:47068
I20260709 14:50:37.219776  7771 raft_consensus.cc:606] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Received request to transfer leadership to TS 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:37.223126  7924 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
mode: GRACEFUL
new_leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:48676
I20260709 14:50:37.223790  7924 raft_consensus.cc:606] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 LEADER]: Received request to transfer leadership to TS 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:50:37.226643  7771 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf"
dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
mode: GRACEFUL
new_leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:47068
I20260709 14:50:37.227792  7771 raft_consensus.cc:606] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Received request to transfer leadership to TS 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:37.231140  7850 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258"
dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
mode: GRACEFUL
new_leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:41662
I20260709 14:50:37.231870  7850 raft_consensus.cc:606] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 LEADER]: Received request to transfer leadership to TS 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:50:37.233341  6549 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 14:50:37.234751  6549 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 14:50:37.411563  8944 raft_consensus.cc:993] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac: : Instructing follower 1de5e20126fa4d8ca0793d19c7b847ed to start an election
I20260709 14:50:37.412194  8944 raft_consensus.cc:1081] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 LEADER]: Signalling peer 1de5e20126fa4d8ca0793d19c7b847ed to start an election
I20260709 14:50:37.414084  7771 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258"
dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:37136
I20260709 14:50:37.414683  7771 raft_consensus.cc:493] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:50:37.415030  7771 raft_consensus.cc:3060] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:50:37.417682  8965 raft_consensus.cc:993] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0: : Instructing follower 1de5e20126fa4d8ca0793d19c7b847ed to start an election
I20260709 14:50:37.418241  8945 raft_consensus.cc:1081] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 LEADER]: Signalling peer 1de5e20126fa4d8ca0793d19c7b847ed to start an election
I20260709 14:50:37.420288  7772 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c"
dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:37144
I20260709 14:50:37.420931  7772 raft_consensus.cc:493] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:50:37.421427  7772 raft_consensus.cc:3060] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:37.422461  7771 raft_consensus.cc:515] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:37.425472  7771 leader_election.cc:290] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:37.426090  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:50:37.426748  7850 raft_consensus.cc:3055] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 LEADER]: Stepping down as leader of term 2
I20260709 14:50:37.426968  7850 raft_consensus.cc:740] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:50:37.427557  7850 consensus_queue.cc:260] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:37.428769  7850 raft_consensus.cc:3060] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:50:37.428916  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:50:37.429622  7924 raft_consensus.cc:3060] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:50:37.431690  7772 raft_consensus.cc:515] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:37.435174  7772 leader_election.cc:290] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 2 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:37.437363  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:50:37.438025  7924 raft_consensus.cc:2468] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 3.
I20260709 14:50:37.438155  7846 raft_consensus.cc:3060] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:37.438823  7850 raft_consensus.cc:2468] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 3.
I20260709 14:50:37.440202  7745 leader_election.cc:304] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:50:37.441093  8927 raft_consensus.cc:2804] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Leader election won for term 3
I20260709 14:50:37.441901  8927 raft_consensus.cc:697] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:50:37.441627  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:50:37.442816  8927 consensus_queue.cc:237] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:37.444471  7924 raft_consensus.cc:3055] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 14:50:37.444849  7924 raft_consensus.cc:740] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:50:37.445792  7924 consensus_queue.cc:260] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:37.447181  7846 raft_consensus.cc:2468] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 2.
I20260709 14:50:37.446970  7924 raft_consensus.cc:3060] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:37.449331  7745 leader_election.cc:304] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:50:37.450467  8948 raft_consensus.cc:2804] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:50:37.451202  8948 raft_consensus.cc:697] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:50:37.452348  8948 consensus_queue.cc:237] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:37.526036  7924 raft_consensus.cc:2468] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 2.
I20260709 14:50:37.530131  7674 catalog_manager.cc:5697] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 2 to 3, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 3 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:50:37.554911  8948 raft_consensus.cc:993] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed: : Instructing follower 3876b8ee8d744cb18e91d97aae93b1ac to start an election
I20260709 14:50:37.555477  8948 raft_consensus.cc:1081] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Signalling peer 3876b8ee8d744cb18e91d97aae93b1ac to start an election
I20260709 14:50:37.588416  8944 raft_consensus.cc:993] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac: : Instructing follower 1e9289592458429bbddb19c2e7b7b7b0 to start an election
I20260709 14:50:37.589215  8970 raft_consensus.cc:1081] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 LEADER]: Signalling peer 1e9289592458429bbddb19c2e7b7b7b0 to start an election
I20260709 14:50:37.591239  7922 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
 from {username='slave'} at 127.0.0.1:38516
I20260709 14:50:37.591900  7922 raft_consensus.cc:493] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:50:37.592252  7922 raft_consensus.cc:3060] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:50:37.588228  7850 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9c563cc7cfbe4d59be4ffc5cf847ce56"
dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:49948
I20260709 14:50:37.593943  7850 raft_consensus.cc:493] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:50:37.594568  7850 raft_consensus.cc:3060] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:37.600116  7922 raft_consensus.cc:515] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:37.604034  7850 raft_consensus.cc:515] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:37.608848  7922 leader_election.cc:290] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 3 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:50:37.612645  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:50:37.621156  7775 raft_consensus.cc:3060] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:50:37.614684  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:50:37.623271  7846 raft_consensus.cc:3055] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 LEADER]: Stepping down as leader of term 2
I20260709 14:50:37.623688  7846 raft_consensus.cc:740] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:50:37.624560  7846 consensus_queue.cc:260] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:37.626017  7846 raft_consensus.cc:3060] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:50:37.628821  7850 leader_election.cc:290] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 2 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:37.638687  7775 raft_consensus.cc:2468] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 3.
I20260709 14:50:37.640230  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c563cc7cfbe4d59be4ffc5cf847ce56" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:50:37.642446  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c563cc7cfbe4d59be4ffc5cf847ce56" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:50:37.648808  7771 raft_consensus.cc:3055] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Stepping down as leader of term 1
I20260709 14:50:37.648957  7922 raft_consensus.cc:3060] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:37.649318  7771 raft_consensus.cc:740] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:50:37.650391  7771 consensus_queue.cc:260] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:37.651649  7771 raft_consensus.cc:3060] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:37.669934  7893 leader_election.cc:304] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:50:37.671133  8945 raft_consensus.cc:2804] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 14:50:37.672647  7922 raft_consensus.cc:2468] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 2.
I20260709 14:50:37.678627  8945 raft_consensus.cc:697] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:50:37.680701  8945 consensus_queue.cc:237] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:37.684926  7846 raft_consensus.cc:2468] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 3.
I20260709 14:50:37.710211  7771 raft_consensus.cc:2468] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 2.
I20260709 14:50:37.709781  7819 leader_election.cc:304] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:50:37.709734  7675 catalog_manager.cc:5697] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 2 to 3, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 3 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:50:37.719502  8853 raft_consensus.cc:2804] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:50:37.720357  8853 raft_consensus.cc:697] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:50:37.724229  8853 consensus_queue.cc:237] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:37.739686  8966 raft_consensus.cc:993] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed: : Instructing follower 3876b8ee8d744cb18e91d97aae93b1ac to start an election
I20260709 14:50:37.740144  8948 raft_consensus.cc:1081] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Signalling peer 3876b8ee8d744cb18e91d97aae93b1ac to start an election
I20260709 14:50:37.745347  7851 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf"
dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:49948
I20260709 14:50:37.746089  7851 raft_consensus.cc:493] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:50:37.746439  7851 raft_consensus.cc:3060] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:37.751976  7675 catalog_manager.cc:5697] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 1 to 2, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 2 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:50:37.765479  7851 raft_consensus.cc:515] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:37.767771  7851 leader_election.cc:290] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 2 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:37.768612  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:50:37.769445  7771 raft_consensus.cc:3055] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Stepping down as leader of term 1
I20260709 14:50:37.769836  7771 raft_consensus.cc:740] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:50:37.770231  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:50:37.770942  7924 raft_consensus.cc:3060] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:37.770936  7771 consensus_queue.cc:260] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:37.772608  7771 raft_consensus.cc:3060] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:37.779397  7924 raft_consensus.cc:2468] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 2.
I20260709 14:50:37.782567  7819 leader_election.cc:304] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:50:37.783142  7771 raft_consensus.cc:2468] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 2.
I20260709 14:50:37.783492  8943 raft_consensus.cc:2804] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:50:37.784070  8943 raft_consensus.cc:697] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:50:37.783876  7675 catalog_manager.cc:5697] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 1 to 2, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 2 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:50:37.785089  8943 consensus_queue.cc:237] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:37.805935  7675 catalog_manager.cc:5697] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 1 to 2, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 2 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:50:37.845326  7851 raft_consensus.cc:1275] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 14:50:37.846882  8948 consensus_queue.cc:1048] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 14:50:37.860749  7924 raft_consensus.cc:1275] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 14:50:37.862681  8866 consensus_queue.cc:1048] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 14:50:37.867012  7851 raft_consensus.cc:1275] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:50:37.889566  8966 consensus_queue.cc:1048] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 14:50:37.917083  7924 raft_consensus.cc:1275] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:50:37.919806  8966 consensus_queue.cc:1048] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 14:50:38.192776  7775 raft_consensus.cc:1275] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:50:38.194545  8943 consensus_queue.cc:1048] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 14:50:38.200378  7771 raft_consensus.cc:1275] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 14:50:38.204022  8909 consensus_queue.cc:1048] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 14:50:38.210222  7924 raft_consensus.cc:1275] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:50:38.213203  8944 consensus_queue.cc:1048] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 14:50:38.235420  7851 raft_consensus.cc:1275] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 14:50:38.236780  6549 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 14:50:38.245201  8909 consensus_queue.cc:1048] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 14:50:38.302320  7925 raft_consensus.cc:1275] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:50:38.314980  7775 raft_consensus.cc:1275] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:50:38.314893  8944 consensus_queue.cc:1048] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 14:50:38.323894  8943 consensus_queue.cc:1048] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 14:50:38.422973  6549 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 14:50:38.479940  7775 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828"
dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
mode: GRACEFUL
new_leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:47068
I20260709 14:50:38.481010  7775 raft_consensus.cc:606] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Received request to transfer leadership to TS 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:38.484086  7846 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268"
dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
mode: GRACEFUL
new_leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
 from {username='slave'} at 127.0.0.1:41662
I20260709 14:50:38.484608  7846 raft_consensus.cc:606] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 LEADER]: Received request to transfer leadership to TS 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:50:38.487737  7924 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "939996e77ee64e9fab21aef50758b706"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
mode: GRACEFUL
new_leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:48676
I20260709 14:50:38.488401  7924 raft_consensus.cc:606] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 LEADER]: Received request to transfer leadership to TS 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:50:38.491787  7771 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01"
dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
mode: GRACEFUL
new_leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:47068
I20260709 14:50:38.492779  7771 raft_consensus.cc:606] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Received request to transfer leadership to TS 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:38.495656  7846 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c"
dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
mode: GRACEFUL
new_leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:41662
I20260709 14:50:38.496378  7846 raft_consensus.cc:606] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 LEADER]: Received request to transfer leadership to TS 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:50:38.497735  6549 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 14:50:38.499747  6549 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 14:50:38.604413  8927 raft_consensus.cc:993] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed: : Instructing follower 3876b8ee8d744cb18e91d97aae93b1ac to start an election
I20260709 14:50:38.605113  8966 raft_consensus.cc:1081] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Signalling peer 3876b8ee8d744cb18e91d97aae93b1ac to start an election
I20260709 14:50:38.608027  7850 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01"
dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:49948
I20260709 14:50:38.608749  7850 raft_consensus.cc:493] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:50:38.609133  7850 raft_consensus.cc:3060] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:38.614938  7850 raft_consensus.cc:515] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:38.616677  7850 leader_election.cc:290] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 2 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:38.617746  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:50:38.618270  7771 raft_consensus.cc:3055] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Stepping down as leader of term 1
I20260709 14:50:38.618602  7771 raft_consensus.cc:740] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:50:38.618666  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:50:38.619247  7925 raft_consensus.cc:3060] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:38.619583  7771 consensus_queue.cc:260] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:38.620844  7771 raft_consensus.cc:3060] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:38.626534  7925 raft_consensus.cc:2468] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 2.
I20260709 14:50:38.628139  7771 raft_consensus.cc:2468] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 2.
I20260709 14:50:38.628490  8927 raft_consensus.cc:993] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed: : Instructing follower 3876b8ee8d744cb18e91d97aae93b1ac to start an election
I20260709 14:50:38.628455  7819 leader_election.cc:304] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:50:38.629437  8966 raft_consensus.cc:1081] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Signalling peer 3876b8ee8d744cb18e91d97aae93b1ac to start an election
I20260709 14:50:38.630339  8969 raft_consensus.cc:2804] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:50:38.630928  8969 raft_consensus.cc:697] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:50:38.631860  8969 consensus_queue.cc:237] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:38.634732  7851 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828"
dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:49948
I20260709 14:50:38.635535  7851 raft_consensus.cc:493] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:50:38.635984  7851 raft_consensus.cc:3060] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:38.643203  7851 raft_consensus.cc:515] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:38.645618  7851 leader_election.cc:290] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 2 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:38.645416  7675 catalog_manager.cc:5697] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 1 to 2, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 2 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:50:38.647660  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:50:38.647969  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:50:38.648546  7925 raft_consensus.cc:3060] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:38.648584  7771 raft_consensus.cc:3055] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Stepping down as leader of term 1
I20260709 14:50:38.649417  7771 raft_consensus.cc:740] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:50:38.650954  7771 consensus_queue.cc:260] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:38.655441  7771 raft_consensus.cc:3060] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:38.659958  7925 raft_consensus.cc:2468] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 2.
I20260709 14:50:38.662256  7819 leader_election.cc:304] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:50:38.663484  8944 raft_consensus.cc:2804] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:50:38.664132  8944 raft_consensus.cc:697] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:50:38.665338  8944 consensus_queue.cc:237] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:38.667874  7771 raft_consensus.cc:2468] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 2.
I20260709 14:50:38.688215  8969 raft_consensus.cc:993] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac: : Instructing follower 1de5e20126fa4d8ca0793d19c7b847ed to start an election
I20260709 14:50:38.689229  8970 raft_consensus.cc:1081] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 LEADER]: Signalling peer 1de5e20126fa4d8ca0793d19c7b847ed to start an election
I20260709 14:50:38.694494  7775 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c"
dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:37136
I20260709 14:50:38.695231  7775 raft_consensus.cc:493] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:50:38.695647  7775 raft_consensus.cc:3060] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:38.699477  8944 raft_consensus.cc:993] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac: : Instructing follower 1e9289592458429bbddb19c2e7b7b7b0 to start an election
I20260709 14:50:38.700227  8944 raft_consensus.cc:1081] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 LEADER]: Signalling peer 1e9289592458429bbddb19c2e7b7b7b0 to start an election
I20260709 14:50:38.699909  7675 catalog_manager.cc:5697] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 1 to 2, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 2 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:50:38.705147  7925 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
 from {username='slave'} at 127.0.0.1:38516
I20260709 14:50:38.706001  7925 raft_consensus.cc:493] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:50:38.706573  7925 raft_consensus.cc:3060] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:50:38.711580  7775 raft_consensus.cc:515] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:38.716751  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:50:38.717438  7851 raft_consensus.cc:3055] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 LEADER]: Stepping down as leader of term 1
I20260709 14:50:38.717752  7851 raft_consensus.cc:740] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:50:38.718487  7851 consensus_queue.cc:260] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:38.718976  7925 raft_consensus.cc:515] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:38.719553  7851 raft_consensus.cc:3060] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:38.721457  7775 leader_election.cc:290] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 2 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:38.722898  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:50:38.723722  7924 raft_consensus.cc:3060] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:38.728449  7925 leader_election.cc:290] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 4 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:50:38.730729  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:50:38.731474  7846 raft_consensus.cc:3055] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 LEADER]: Stepping down as leader of term 3
I20260709 14:50:38.731791  7846 raft_consensus.cc:740] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:50:38.732674  7846 consensus_queue.cc:260] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:38.733862  7846 raft_consensus.cc:3060] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:50:38.736845  7924 raft_consensus.cc:2468] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 2.
I20260709 14:50:38.737788  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:50:38.738503  7775 raft_consensus.cc:3060] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:50:38.738557  7744 leader_election.cc:304] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:50:38.739827  8966 raft_consensus.cc:2804] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:50:38.740365  8966 raft_consensus.cc:697] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:50:38.741544  8966 consensus_queue.cc:237] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:38.747490  7775 raft_consensus.cc:2468] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 4.
I20260709 14:50:38.749157  7893 leader_election.cc:304] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:50:38.750674  8965 raft_consensus.cc:2804] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 14:50:38.751257  8965 raft_consensus.cc:697] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:50:38.751304  7846 raft_consensus.cc:2468] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 4.
I20260709 14:50:38.752579  8965 consensus_queue.cc:237] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:38.755292  7851 raft_consensus.cc:2468] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 2.
I20260709 14:50:38.759778  7675 catalog_manager.cc:5697] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 1 to 2, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 2 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:50:38.772092  7676 catalog_manager.cc:5697] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 3 to 4, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 4 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:50:38.938314  8945 raft_consensus.cc:993] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0: : Instructing follower 1de5e20126fa4d8ca0793d19c7b847ed to start an election
I20260709 14:50:38.938817  8945 raft_consensus.cc:1081] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 LEADER]: Signalling peer 1de5e20126fa4d8ca0793d19c7b847ed to start an election
I20260709 14:50:38.941015  7775 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "939996e77ee64e9fab21aef50758b706"
dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:37144
I20260709 14:50:38.941769  7775 raft_consensus.cc:493] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:50:38.942232  7775 raft_consensus.cc:3060] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:50:38.951211  7775 raft_consensus.cc:515] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:38.953698  7775 leader_election.cc:290] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:38.954814  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:50:38.954818  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:50:38.955667  7851 raft_consensus.cc:3060] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:50:38.955683  7925 raft_consensus.cc:3055] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 14:50:38.956168  7925 raft_consensus.cc:740] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:50:38.957011  7925 consensus_queue.cc:260] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:38.959102  7925 raft_consensus.cc:3060] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:50:38.967614  7851 raft_consensus.cc:2468] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 4.
I20260709 14:50:38.969051  7745 leader_election.cc:304] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:50:38.969933  8927 raft_consensus.cc:2804] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader election won for term 4
I20260709 14:50:38.969892  7925 raft_consensus.cc:2468] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 4.
I20260709 14:50:38.970727  8927 raft_consensus.cc:697] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:50:38.971719  8927 consensus_queue.cc:237] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:38.984613  7676 catalog_manager.cc:5697] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 3 to 4, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 4 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:50:39.081712  7775 raft_consensus.cc:1275] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:50:39.084115  8969 consensus_queue.cc:1048] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 14:50:39.090852  7925 raft_consensus.cc:1275] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:50:39.092386  8969 consensus_queue.cc:1048] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 14:50:39.105883  7925 raft_consensus.cc:1275] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:50:39.107839  8969 consensus_queue.cc:1048] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 14:50:39.108178  7775 raft_consensus.cc:1275] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:50:39.110314  8969 consensus_queue.cc:1048] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 14:50:39.259910  7924 raft_consensus.cc:1275] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:50:39.261631  8966 consensus_queue.cc:1048] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 14:50:39.262743  7772 raft_consensus.cc:1275] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 14:50:39.264494  8945 consensus_queue.cc:1048] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 14:50:39.287137  7851 raft_consensus.cc:1275] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 14:50:39.289983  8965 consensus_queue.cc:1048] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 14:50:39.305331  7850 raft_consensus.cc:1275] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:50:39.307945  8966 consensus_queue.cc:1048] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 14:50:39.379139  7925 raft_consensus.cc:1275] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 14:50:39.383139  9008 consensus_queue.cc:1048] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 14:50:39.399667  7851 raft_consensus.cc:1275] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 14:50:39.403587  9009 consensus_queue.cc:1048] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 14:50:39.501109  6549 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 14:50:39.671474  6549 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 14:50:39.716786  7851 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b"
dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
mode: GRACEFUL
new_leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
 from {username='slave'} at 127.0.0.1:41662
I20260709 14:50:39.717417  7851 raft_consensus.cc:606] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 LEADER]: Received request to transfer leadership to TS 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:50:39.720788  7779 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "939996e77ee64e9fab21aef50758b706"
dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
mode: GRACEFUL
new_leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:47068
I20260709 14:50:39.725629  7779 raft_consensus.cc:606] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 LEADER]: Received request to transfer leadership to TS 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:39.729050  7924 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
mode: GRACEFUL
new_leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:48676
I20260709 14:50:39.729846  7924 raft_consensus.cc:606] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 LEADER]: Received request to transfer leadership to TS 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:50:39.735148  7772 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c"
dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
mode: GRACEFUL
new_leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:47068
I20260709 14:50:39.736032  7772 raft_consensus.cc:606] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 LEADER]: Received request to transfer leadership to TS 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:39.739132  7851 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff"
dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
mode: GRACEFUL
new_leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:41662
I20260709 14:50:39.739683  7851 raft_consensus.cc:606] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 LEADER]: Received request to transfer leadership to TS 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:50:39.741824  6549 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 14:50:39.743865  6549 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 14:50:39.746991  8969 raft_consensus.cc:993] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac: : Instructing follower 1e9289592458429bbddb19c2e7b7b7b0 to start an election
I20260709 14:50:39.747548  8969 raft_consensus.cc:1081] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 LEADER]: Signalling peer 1e9289592458429bbddb19c2e7b7b7b0 to start an election
I20260709 14:50:39.750412  7924 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
 from {username='slave'} at 127.0.0.1:38516
I20260709 14:50:39.751194  7924 raft_consensus.cc:493] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:50:39.751600  7924 raft_consensus.cc:3060] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:50:39.760340  7924 raft_consensus.cc:515] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:39.762817  7924 leader_election.cc:290] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 3 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:50:39.763904  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:50:39.763958  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:50:39.764887  7851 raft_consensus.cc:3055] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 LEADER]: Stepping down as leader of term 2
I20260709 14:50:39.764842  7772 raft_consensus.cc:3060] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:50:39.765877  7851 raft_consensus.cc:740] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:50:39.767014  7851 consensus_queue.cc:260] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:39.768097  7851 raft_consensus.cc:3060] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:50:39.775008  7772 raft_consensus.cc:2468] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 3.
I20260709 14:50:39.776117  7851 raft_consensus.cc:2468] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 3.
I20260709 14:50:39.777556  7893 leader_election.cc:304] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:50:39.778955  8909 raft_consensus.cc:2804] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 14:50:39.779541  8909 raft_consensus.cc:697] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:50:39.780378  8909 consensus_queue.cc:237] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:39.795083  7674 catalog_manager.cc:5697] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 2 to 3, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 3 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:50:39.815270  9009 raft_consensus.cc:993] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed: : Instructing follower 3876b8ee8d744cb18e91d97aae93b1ac to start an election
I20260709 14:50:39.815819  8927 raft_consensus.cc:1081] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 LEADER]: Signalling peer 3876b8ee8d744cb18e91d97aae93b1ac to start an election
I20260709 14:50:39.817950  7851 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "939996e77ee64e9fab21aef50758b706"
dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:49948
I20260709 14:50:39.818573  7851 raft_consensus.cc:493] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:50:39.818887  7851 raft_consensus.cc:3060] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:50:39.827724  7851 raft_consensus.cc:515] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:39.830005  7851 leader_election.cc:290] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 5 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:39.831113  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:50:39.832137  7924 raft_consensus.cc:3060] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:50:39.839665  7924 raft_consensus.cc:2468] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 5.
I20260709 14:50:39.840345  7925 raft_consensus.cc:1240] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 4. Current term is 5. Ops: []
I20260709 14:50:39.841562  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:50:39.843150  9008 consensus_queue.cc:1059] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 14:50:39.847431  7819 leader_election.cc:304] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:50:39.842238  7772 raft_consensus.cc:3055] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 LEADER]: Stepping down as leader of term 4
I20260709 14:50:39.848927  7772 raft_consensus.cc:740] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:50:39.848394  8969 raft_consensus.cc:2804] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader election won for term 5
I20260709 14:50:39.850879  8969 raft_consensus.cc:697] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:50:39.852088  8945 raft_consensus.cc:993] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0: : Instructing follower 1de5e20126fa4d8ca0793d19c7b847ed to start an election
I20260709 14:50:39.852650  8965 raft_consensus.cc:1081] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 LEADER]: Signalling peer 1de5e20126fa4d8ca0793d19c7b847ed to start an election
I20260709 14:50:39.852515  8969 consensus_queue.cc:237] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:39.854614  7779 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375"
dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:37144
I20260709 14:50:39.855203  7779 raft_consensus.cc:493] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:50:39.855537  7779 raft_consensus.cc:3060] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:39.854657  7772 consensus_queue.cc:260] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:39.856547  7772 raft_consensus.cc:3060] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:50:39.864491  7779 raft_consensus.cc:515] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:39.865381  7772 raft_consensus.cc:2468] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 5.
W20260709 14:50:39.865950  8927 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
I20260709 14:50:39.870018  7779 leader_election.cc:290] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 2 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:39.870151  7674 catalog_manager.cc:5697] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 4 to 5, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 5 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:50:39.871438  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:50:39.872197  7924 raft_consensus.cc:3055] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 14:50:39.872524  7924 raft_consensus.cc:740] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:50:39.873382  7924 consensus_queue.cc:260] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:39.874341  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:50:39.874758  7924 raft_consensus.cc:3060] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:39.875037  7851 raft_consensus.cc:3060] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:39.888366  7851 raft_consensus.cc:2468] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 2.
I20260709 14:50:39.890477  7924 raft_consensus.cc:2468] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 2.
I20260709 14:50:39.891676  7745 leader_election.cc:304] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:50:39.892616  9008 raft_consensus.cc:2804] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:50:39.893335  9008 raft_consensus.cc:697] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:50:39.894557  9008 consensus_queue.cc:237] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:39.913230  9009 raft_consensus.cc:993] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed: : Instructing follower 3876b8ee8d744cb18e91d97aae93b1ac to start an election
I20260709 14:50:39.912273  7674 catalog_manager.cc:5697] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 1 to 2, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 2 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:50:39.914003  9021 raft_consensus.cc:1081] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 LEADER]: Signalling peer 3876b8ee8d744cb18e91d97aae93b1ac to start an election
I20260709 14:50:39.916666  7846 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c"
dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:49948
I20260709 14:50:39.917447  7846 raft_consensus.cc:493] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:50:39.917825  7846 raft_consensus.cc:3060] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:50:39.927464  7846 raft_consensus.cc:515] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:39.929677  7846 leader_election.cc:290] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 3 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:39.930789  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:50:39.931381  7772 raft_consensus.cc:3055] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 LEADER]: Stepping down as leader of term 2
I20260709 14:50:39.931728  7772 raft_consensus.cc:740] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:50:39.931860  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:50:39.932711  7924 raft_consensus.cc:3060] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:50:39.932433  7772 consensus_queue.cc:260] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:39.933609  7772 raft_consensus.cc:3060] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:50:39.944407  7924 raft_consensus.cc:2468] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 3.
I20260709 14:50:39.946022  7819 leader_election.cc:304] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:50:39.947378  8969 raft_consensus.cc:2804] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Leader election won for term 3
I20260709 14:50:39.948001  8969 raft_consensus.cc:697] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:50:39.948988  8969 consensus_queue.cc:237] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:39.953604  7772 raft_consensus.cc:2468] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 3.
I20260709 14:50:39.962191  7674 catalog_manager.cc:5697] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 2 to 3, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 3 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:50:40.155557  8853 raft_consensus.cc:993] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac: : Instructing follower 1de5e20126fa4d8ca0793d19c7b847ed to start an election
I20260709 14:50:40.156104  8853 raft_consensus.cc:1081] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 LEADER]: Signalling peer 1de5e20126fa4d8ca0793d19c7b847ed to start an election
I20260709 14:50:40.159910  7772 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff"
dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:37136
I20260709 14:50:40.160772  7772 raft_consensus.cc:493] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:50:40.161293  7772 raft_consensus.cc:3060] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:40.168246  7772 raft_consensus.cc:515] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:40.170445  7772 leader_election.cc:290] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 2 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:40.171926  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:50:40.171916  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:50:40.172772  7924 raft_consensus.cc:3060] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:40.172865  7850 raft_consensus.cc:3055] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 LEADER]: Stepping down as leader of term 1
I20260709 14:50:40.173513  7850 raft_consensus.cc:740] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:50:40.174525  7850 consensus_queue.cc:260] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:40.175619  7850 raft_consensus.cc:3060] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:40.180759  7924 raft_consensus.cc:2468] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 2.
I20260709 14:50:40.182372  7744 leader_election.cc:304] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:50:40.183755  9021 raft_consensus.cc:2804] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:50:40.184281  9021 raft_consensus.cc:697] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:50:40.185096  9021 consensus_queue.cc:237] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:40.186371  7850 raft_consensus.cc:2468] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 2.
I20260709 14:50:40.192366  7850 raft_consensus.cc:1275] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 14:50:40.194199  8909 consensus_queue.cc:1048] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 14:50:40.199558  7674 catalog_manager.cc:5697] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 1 to 2, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 2 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:50:40.220173  7772 raft_consensus.cc:1275] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 14:50:40.227715  8945 consensus_queue.cc:1048] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 14:50:40.254597  7924 raft_consensus.cc:1275] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 14:50:40.256397  8969 consensus_queue.cc:1048] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 14:50:40.280107  7772 raft_consensus.cc:1275] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 14:50:40.294188  8853 consensus_queue.cc:1048] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 14:50:40.313395  7922 raft_consensus.cc:1275] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:50:40.315724  9021 consensus_queue.cc:1048] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 14:50:40.338023  7850 raft_consensus.cc:1275] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:50:40.339880  9009 consensus_queue.cc:1048] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 14:50:40.418740  7922 raft_consensus.cc:1275] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 14:50:40.421792  9031 consensus_queue.cc:1048] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 14:50:40.445560  7779 raft_consensus.cc:1275] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 14:50:40.447376  9031 consensus_queue.cc:1048] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 14:50:40.577121  7850 raft_consensus.cc:1275] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:50:40.579470  9009 consensus_queue.cc:1048] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 14:50:40.596415  7922 raft_consensus.cc:1275] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:50:40.598603  9009 consensus_queue.cc:1048] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 14:50:40.745484  6549 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 14:50:41.050506  6549 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 14:50:41.094578  7850 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828"
dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
mode: GRACEFUL
new_leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:41662
I20260709 14:50:41.095887  7850 raft_consensus.cc:606] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 LEADER]: Received request to transfer leadership to TS 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:50:41.100262  7926 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
mode: GRACEFUL
new_leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:48676
I20260709 14:50:41.100814  7926 raft_consensus.cc:606] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 LEADER]: Received request to transfer leadership to TS 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:50:41.103943  7772 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff"
dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
mode: GRACEFUL
new_leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:47068
I20260709 14:50:41.104723  7772 raft_consensus.cc:606] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 LEADER]: Received request to transfer leadership to TS 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:41.109628  7850 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d"
dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
mode: GRACEFUL
new_leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
 from {username='slave'} at 127.0.0.1:41662
I20260709 14:50:41.110256  7850 raft_consensus.cc:606] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 LEADER]: Received request to transfer leadership to TS 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:50:41.113202  7772 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258"
dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
mode: GRACEFUL
new_leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:47068
I20260709 14:50:41.114039  7772 raft_consensus.cc:606] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 LEADER]: Received request to transfer leadership to TS 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:41.115561  6549 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 14:50:41.116957  6549 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 14:50:41.186126  8853 raft_consensus.cc:993] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac: : Instructing follower 1e9289592458429bbddb19c2e7b7b7b0 to start an election
I20260709 14:50:41.186892  9031 raft_consensus.cc:1081] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 LEADER]: Signalling peer 1e9289592458429bbddb19c2e7b7b7b0 to start an election
I20260709 14:50:41.189164  7926 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
 from {username='slave'} at 127.0.0.1:38516
I20260709 14:50:41.189957  7926 raft_consensus.cc:493] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:50:41.190438  7926 raft_consensus.cc:3060] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:50:41.204391  7926 raft_consensus.cc:515] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:41.207438  7926 leader_election.cc:290] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 3 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:50:41.208258  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:50:41.211442  7850 raft_consensus.cc:3055] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 LEADER]: Stepping down as leader of term 2
I20260709 14:50:41.211987  7850 raft_consensus.cc:740] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:50:41.214078  7850 consensus_queue.cc:260] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:41.215322  7850 raft_consensus.cc:3060] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:50:41.218227  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:50:41.218997  7779 raft_consensus.cc:3060] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:50:41.227031  7779 raft_consensus.cc:2468] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 3.
I20260709 14:50:41.228500  7893 leader_election.cc:304] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:50:41.228832  7850 raft_consensus.cc:2468] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 3.
I20260709 14:50:41.229311  8909 raft_consensus.cc:2804] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 14:50:41.229920  8909 raft_consensus.cc:697] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:50:41.230672  8909 consensus_queue.cc:237] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:41.247177  7674 catalog_manager.cc:5697] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 2 to 3, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 3 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:50:41.303184  9021 raft_consensus.cc:993] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed: : Instructing follower 3876b8ee8d744cb18e91d97aae93b1ac to start an election
I20260709 14:50:41.303665  9021 raft_consensus.cc:1081] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 LEADER]: Signalling peer 3876b8ee8d744cb18e91d97aae93b1ac to start an election
I20260709 14:50:41.305425  7851 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258"
dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:49948
I20260709 14:50:41.305996  7851 raft_consensus.cc:493] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:50:41.306423  7851 raft_consensus.cc:3060] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:50:41.313017  7851 raft_consensus.cc:515] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:41.314919  7851 leader_election.cc:290] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 4 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:41.315943  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:50:41.316069  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:50:41.316813  7926 raft_consensus.cc:3060] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:50:41.316926  7772 raft_consensus.cc:3055] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 LEADER]: Stepping down as leader of term 3
I20260709 14:50:41.317466  7772 raft_consensus.cc:740] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:50:41.318193  7772 consensus_queue.cc:260] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:41.319309  7772 raft_consensus.cc:3060] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:50:41.324180  7926 raft_consensus.cc:2468] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 4.
I20260709 14:50:41.325692  7819 leader_election.cc:304] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:50:41.326179  7772 raft_consensus.cc:2468] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 4.
I20260709 14:50:41.326640  8853 raft_consensus.cc:2804] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Leader election won for term 4
I20260709 14:50:41.327327  8853 raft_consensus.cc:697] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:50:41.328121  8853 consensus_queue.cc:237] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:41.342826  7674 catalog_manager.cc:5697] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 3 to 4, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 4 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:50:41.345938  9044 raft_consensus.cc:993] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac: : Instructing follower 1de5e20126fa4d8ca0793d19c7b847ed to start an election
I20260709 14:50:41.349776  9044 raft_consensus.cc:1081] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 LEADER]: Signalling peer 1de5e20126fa4d8ca0793d19c7b847ed to start an election
I20260709 14:50:41.352165  7772 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828"
dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:37136
I20260709 14:50:41.353017  7772 raft_consensus.cc:493] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:50:41.353454  7772 raft_consensus.cc:3060] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:50:41.362439  7772 raft_consensus.cc:515] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:41.365444  7772 leader_election.cc:290] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:41.367779  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:50:41.368479  7922 raft_consensus.cc:3060] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:50:41.369642  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:50:41.370361  7851 raft_consensus.cc:3055] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 LEADER]: Stepping down as leader of term 2
I20260709 14:50:41.370707  7851 raft_consensus.cc:740] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:50:41.371580  7851 consensus_queue.cc:260] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:41.373116  7851 raft_consensus.cc:3060] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:50:41.377864  7922 raft_consensus.cc:2468] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 3.
I20260709 14:50:41.379918  7744 leader_election.cc:304] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:50:41.380753  9021 raft_consensus.cc:2804] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Leader election won for term 3
I20260709 14:50:41.381290  9021 raft_consensus.cc:697] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:50:41.382493  7851 raft_consensus.cc:2468] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 3.
I20260709 14:50:41.382400  9021 consensus_queue.cc:237] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:41.397979  7674 catalog_manager.cc:5697] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 2 to 3, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 3 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:50:41.444222  9009 raft_consensus.cc:993] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed: : Instructing follower 3876b8ee8d744cb18e91d97aae93b1ac to start an election
I20260709 14:50:41.444811  9021 raft_consensus.cc:1081] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 LEADER]: Signalling peer 3876b8ee8d744cb18e91d97aae93b1ac to start an election
I20260709 14:50:41.447016  7851 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff"
dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:49948
I20260709 14:50:41.447638  7851 raft_consensus.cc:493] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:50:41.447944  7851 raft_consensus.cc:3060] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:50:41.455374  7851 raft_consensus.cc:515] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:41.457599  7851 leader_election.cc:290] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 3 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:41.459204  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:50:41.460203  7772 raft_consensus.cc:3055] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 LEADER]: Stepping down as leader of term 2
I20260709 14:50:41.460654  7772 raft_consensus.cc:740] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:50:41.461524  7772 consensus_queue.cc:260] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:41.462831  7772 raft_consensus.cc:3060] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:50:41.459288  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:50:41.469439  7926 raft_consensus.cc:3060] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:50:41.475459  7772 raft_consensus.cc:2468] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 3.
I20260709 14:50:41.476934  7819 leader_election.cc:304] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:50:41.477511  7926 raft_consensus.cc:2468] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 3.
I20260709 14:50:41.477738  9044 raft_consensus.cc:2804] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Leader election won for term 3
I20260709 14:50:41.478525  9044 raft_consensus.cc:697] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:50:41.479408  9044 consensus_queue.cc:237] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:41.496173  7674 catalog_manager.cc:5697] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 2 to 3, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 3 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:50:41.585548  8945 raft_consensus.cc:993] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0: : Instructing follower 1de5e20126fa4d8ca0793d19c7b847ed to start an election
I20260709 14:50:41.586046  8909 raft_consensus.cc:1081] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 LEADER]: Signalling peer 1de5e20126fa4d8ca0793d19c7b847ed to start an election
I20260709 14:50:41.587553  7779 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3"
dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:37144
I20260709 14:50:41.588063  7779 raft_consensus.cc:493] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:50:41.588395  7779 raft_consensus.cc:3060] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:50:41.595969  7779 raft_consensus.cc:515] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:41.598170  7779 leader_election.cc:290] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:41.598984  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:50:41.599334  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:50:41.599607  7851 raft_consensus.cc:3060] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:50:41.599839  7926 raft_consensus.cc:3055] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 14:50:41.600157  7926 raft_consensus.cc:740] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:50:41.601115  7926 consensus_queue.cc:260] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:41.602399  7926 raft_consensus.cc:3060] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:50:41.607896  7851 raft_consensus.cc:2468] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 3.
I20260709 14:50:41.609411  7745 leader_election.cc:304] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:50:41.609532  7926 raft_consensus.cc:2468] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 3.
I20260709 14:50:41.610307  9021 raft_consensus.cc:2804] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Leader election won for term 3
I20260709 14:50:41.610816  9021 raft_consensus.cc:697] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:50:41.611644  9021 consensus_queue.cc:237] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:41.624778  7674 catalog_manager.cc:5697] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 2 to 3, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 3 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:50:41.795517  7851 raft_consensus.cc:1275] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 14:50:41.797281  8945 consensus_queue.cc:1048] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 14:50:41.811295  7779 raft_consensus.cc:1275] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 14:50:41.813006  9044 consensus_queue.cc:1048] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 14:50:41.820838  7926 raft_consensus.cc:1275] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 14:50:41.823216  8927 consensus_queue.cc:1048] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 14:50:41.837702  7779 raft_consensus.cc:1275] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 14:50:41.841095  8909 consensus_queue.cc:1048] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 14:50:41.855124  7926 raft_consensus.cc:1275] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 14:50:41.857878  9044 consensus_queue.cc:1048] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 14:50:41.892259  7922 raft_consensus.cc:1275] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 14:50:41.894127  7851 raft_consensus.cc:1275] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 14:50:41.897185  9021 consensus_queue.cc:1048] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 14:50:41.901348  9044 consensus_queue.cc:1048] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 14:50:41.967397  7779 raft_consensus.cc:1275] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 14:50:41.969357  9044 consensus_queue.cc:1048] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 14:50:42.035414  7926 raft_consensus.cc:1275] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 14:50:42.036934  8927 consensus_queue.cc:1048] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 14:50:42.057559  7851 raft_consensus.cc:1275] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 14:50:42.059051  9021 consensus_queue.cc:1048] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 14:50:42.118052  6549 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 14:50:42.684005  6549 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 14:50:42.730031  7779 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6"
dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
mode: GRACEFUL
new_leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:47068
I20260709 14:50:42.730805  7779 raft_consensus.cc:606] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Received request to transfer leadership to TS 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:42.734730  7851 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9"
dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
mode: GRACEFUL
new_leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
 from {username='slave'} at 127.0.0.1:41662
I20260709 14:50:42.735348  7851 raft_consensus.cc:606] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 LEADER]: Received request to transfer leadership to TS 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:50:42.739317  7926 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
mode: GRACEFUL
new_leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:48676
I20260709 14:50:42.740103  7926 raft_consensus.cc:606] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 LEADER]: Received request to transfer leadership to TS 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:50:42.745457  7779 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a"
dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
mode: GRACEFUL
new_leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:47068
I20260709 14:50:42.748821  7779 raft_consensus.cc:606] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Received request to transfer leadership to TS 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:42.761445  9067 raft_consensus.cc:993] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0: : Instructing follower 1de5e20126fa4d8ca0793d19c7b847ed to start an election
I20260709 14:50:42.762568  9048 raft_consensus.cc:1081] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 LEADER]: Signalling peer 1de5e20126fa4d8ca0793d19c7b847ed to start an election
I20260709 14:50:42.763918  7851 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258"
dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
mode: GRACEFUL
new_leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:41662
I20260709 14:50:42.764861  7851 raft_consensus.cc:606] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 LEADER]: Received request to transfer leadership to TS 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:50:42.766331  6549 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 14:50:42.767938  7775 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d"
dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:37144
I20260709 14:50:42.768635  7775 raft_consensus.cc:493] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:50:42.769045  7775 raft_consensus.cc:3060] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:50:42.769066  6549 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 14:50:42.777892  7775 raft_consensus.cc:515] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:42.781287  7775 leader_election.cc:290] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:42.783699  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:50:42.784550  7851 raft_consensus.cc:3060] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:50:42.784524  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:50:42.786271  7922 raft_consensus.cc:3055] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 14:50:42.786614  7922 raft_consensus.cc:740] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:50:42.787569  7922 consensus_queue.cc:260] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:42.788888  7922 raft_consensus.cc:3060] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:50:42.793219  7851 raft_consensus.cc:2468] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 4.
I20260709 14:50:42.795012  7745 leader_election.cc:304] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:50:42.795377  7922 raft_consensus.cc:2468] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 4.
I20260709 14:50:42.795936  9021 raft_consensus.cc:2804] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader election won for term 4
I20260709 14:50:42.798197  9021 raft_consensus.cc:697] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:50:42.799118  9021 consensus_queue.cc:237] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:42.809653  7674 catalog_manager.cc:5697] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 3 to 4, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 4 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:50:42.861150  8927 raft_consensus.cc:993] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed: : Instructing follower 3876b8ee8d744cb18e91d97aae93b1ac to start an election
I20260709 14:50:42.865669  8927 raft_consensus.cc:1081] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Signalling peer 3876b8ee8d744cb18e91d97aae93b1ac to start an election
I20260709 14:50:42.864498  9044 raft_consensus.cc:993] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac: : Instructing follower 1e9289592458429bbddb19c2e7b7b7b0 to start an election
I20260709 14:50:42.866520  9058 raft_consensus.cc:1081] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 LEADER]: Signalling peer 1e9289592458429bbddb19c2e7b7b7b0 to start an election
I20260709 14:50:42.867811  7850 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a"
dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:49948
I20260709 14:50:42.868460  7850 raft_consensus.cc:493] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:50:42.868605  7922 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
 from {username='slave'} at 127.0.0.1:38516
I20260709 14:50:42.868814  7850 raft_consensus.cc:3060] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:42.869405  7922 raft_consensus.cc:493] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:50:42.869853  7922 raft_consensus.cc:3060] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:42.876850  7850 raft_consensus.cc:515] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:42.877345  7922 raft_consensus.cc:515] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:42.878914  7850 leader_election.cc:290] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 2 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:42.879673  7922 leader_election.cc:290] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 2 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:50:42.880523  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:50:42.880754  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:50:42.881165  7926 raft_consensus.cc:3060] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:42.881582  7850 raft_consensus.cc:3055] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 LEADER]: Stepping down as leader of term 1
I20260709 14:50:42.881785  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:50:42.881981  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:50:42.881943  7850 raft_consensus.cc:740] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:50:42.882562  7775 raft_consensus.cc:3060] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:42.882856  7771 raft_consensus.cc:3055] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Stepping down as leader of term 1
I20260709 14:50:42.883215  7771 raft_consensus.cc:740] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:50:42.883966  7771 consensus_queue.cc:260] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:42.885712  7771 raft_consensus.cc:3060] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:42.893767  7771 raft_consensus.cc:2468] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 2.
I20260709 14:50:42.893551  7775 raft_consensus.cc:2468] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 2.
I20260709 14:50:42.894461  7850 consensus_queue.cc:260] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:42.895880  7850 raft_consensus.cc:3060] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:42.896907  7893 leader_election.cc:304] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:50:42.898276  9048 raft_consensus.cc:2804] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:50:42.898967  9048 raft_consensus.cc:697] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:50:42.900034  9048 consensus_queue.cc:237] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:42.899899  7819 leader_election.cc:304] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:50:42.901281  7926 raft_consensus.cc:2468] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 2.
I20260709 14:50:42.902406  9044 raft_consensus.cc:2804] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:50:42.906708  9044 raft_consensus.cc:697] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:50:42.907773  9044 consensus_queue.cc:237] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:42.918395  7850 raft_consensus.cc:2468] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 2.
I20260709 14:50:42.934345  7674 catalog_manager.cc:5697] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 1 to 2, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 2 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:50:42.949227  7676 catalog_manager.cc:5697] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 1 to 2, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 2 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:50:43.039594  9044 raft_consensus.cc:993] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac: : Instructing follower 1de5e20126fa4d8ca0793d19c7b847ed to start an election
I20260709 14:50:43.041342  9058 raft_consensus.cc:1081] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 LEADER]: Signalling peer 1de5e20126fa4d8ca0793d19c7b847ed to start an election
I20260709 14:50:43.073568  7779 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258"
dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:37136
I20260709 14:50:43.075982  7779 raft_consensus.cc:493] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:50:43.078728  7779 raft_consensus.cc:3060] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:50:43.120159  9021 raft_consensus.cc:993] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed: : Instructing follower 3876b8ee8d744cb18e91d97aae93b1ac to start an election
I20260709 14:50:43.120925  9021 raft_consensus.cc:1081] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Signalling peer 3876b8ee8d744cb18e91d97aae93b1ac to start an election
I20260709 14:50:43.130085  7851 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6"
dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:49948
I20260709 14:50:43.131230  7851 raft_consensus.cc:493] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:50:43.132809  7851 raft_consensus.cc:3060] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:43.137755  7779 raft_consensus.cc:515] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:43.167069  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:50:43.168428  7922 raft_consensus.cc:3060] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:50:43.168823  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:50:43.169773  7852 raft_consensus.cc:3055] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 LEADER]: Stepping down as leader of term 4
I20260709 14:50:43.170148  7852 raft_consensus.cc:740] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:50:43.171490  7852 consensus_queue.cc:260] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:43.189283  7852 raft_consensus.cc:3060] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:50:43.164950  7779 leader_election.cc:290] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:43.197544  7851 raft_consensus.cc:515] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:43.200664  7851 leader_election.cc:290] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 2 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:43.202289  7922 raft_consensus.cc:2468] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 5.
I20260709 14:50:43.205909  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:50:43.206524  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:50:43.206777  7779 raft_consensus.cc:3055] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Stepping down as leader of term 1
I20260709 14:50:43.207262  7779 raft_consensus.cc:740] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:50:43.207423  7926 raft_consensus.cc:3060] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:43.208864  7779 consensus_queue.cc:260] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:43.205909  7744 leader_election.cc:304] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:50:43.210834  7779 raft_consensus.cc:3060] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:43.212626  9021 raft_consensus.cc:2804] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader election won for term 5
I20260709 14:50:43.218175  7852 raft_consensus.cc:2468] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 5.
I20260709 14:50:43.222848  7779 raft_consensus.cc:2468] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 2.
I20260709 14:50:43.223785  9021 raft_consensus.cc:697] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:50:43.225188  9021 consensus_queue.cc:237] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:43.227674  7819 leader_election.cc:304] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:50:43.229499  9077 raft_consensus.cc:2804] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:50:43.232843  7926 raft_consensus.cc:2468] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 2.
I20260709 14:50:43.234865  9077 raft_consensus.cc:697] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:50:43.236315  9077 consensus_queue.cc:237] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:43.250358  7676 catalog_manager.cc:5697] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 4 to 5, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 5 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:50:43.256892  7674 catalog_manager.cc:5697] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 1 to 2, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 2 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:50:43.343308  7779 raft_consensus.cc:1275] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:50:43.346737  8853 consensus_queue.cc:1048] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 14:50:43.348124  7924 raft_consensus.cc:1275] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 14:50:43.350589  8927 consensus_queue.cc:1048] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 14:50:43.371354  7852 raft_consensus.cc:1275] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:50:43.371738  7922 raft_consensus.cc:1275] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:50:43.374034  8909 consensus_queue.cc:1048] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 14:50:43.386909  7852 raft_consensus.cc:1275] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 14:50:43.391717  9077 consensus_queue.cc:1048] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 14:50:43.398102  9066 consensus_queue.cc:1048] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 14:50:43.457736  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 78712.2us
I20260709 14:50:43.466533  7779 raft_consensus.cc:1275] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:50:43.500093  9085 consensus_queue.cc:1048] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 14:50:43.623610  7920 raft_consensus.cc:1275] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 14:50:43.625191  9066 consensus_queue.cc:1048] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 14:50:43.639755  7851 raft_consensus.cc:1275] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 14:50:43.641438  9064 consensus_queue.cc:1048] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 14:50:43.723966  7920 raft_consensus.cc:1275] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:50:43.725630  9077 consensus_queue.cc:1048] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 14:50:43.741122  7779 raft_consensus.cc:1275] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:50:43.750313  9077 consensus_queue.cc:1048] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 14:50:43.782310  6549 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 14:50:44.839347  6549 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 14:50:44.884987  7920 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
mode: GRACEFUL
new_leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:48676
I20260709 14:50:44.885628  7920 raft_consensus.cc:606] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 LEADER]: Received request to transfer leadership to TS 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:50:44.889000  7779 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04"
dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
mode: GRACEFUL
new_leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:47068
I20260709 14:50:44.889832  7779 raft_consensus.cc:606] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Received request to transfer leadership to TS 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:44.893496  7779 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621"
dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
mode: GRACEFUL
new_leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:47068
I20260709 14:50:44.894073  7779 raft_consensus.cc:606] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Received request to transfer leadership to TS 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:44.897856  7851 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9c563cc7cfbe4d59be4ffc5cf847ce56"
dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
mode: GRACEFUL
new_leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
 from {username='slave'} at 127.0.0.1:41662
I20260709 14:50:44.899362  7851 raft_consensus.cc:606] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 LEADER]: Received request to transfer leadership to TS 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:50:44.903084  7852 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf"
dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
mode: GRACEFUL
new_leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:41662
I20260709 14:50:44.903657  7852 raft_consensus.cc:606] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 LEADER]: Received request to transfer leadership to TS 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:50:44.904847  6549 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 14:50:44.907032  6549 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 14:50:44.992105  8909 raft_consensus.cc:993] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0: : Instructing follower 1de5e20126fa4d8ca0793d19c7b847ed to start an election
I20260709 14:50:44.993017  9098 raft_consensus.cc:1081] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 LEADER]: Signalling peer 1de5e20126fa4d8ca0793d19c7b847ed to start an election
I20260709 14:50:44.995271  7772 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775"
dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:37144
I20260709 14:50:44.995923  7772 raft_consensus.cc:493] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:50:44.996263  7772 raft_consensus.cc:3060] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:50:45.004185  7772 raft_consensus.cc:515] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:45.006052  7772 leader_election.cc:290] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:45.007300  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:50:45.007300  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:50:45.008204  7920 raft_consensus.cc:3055] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 14:50:45.008647  7852 raft_consensus.cc:3060] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:50:45.009123  7920 raft_consensus.cc:740] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:50:45.011726  7920 consensus_queue.cc:260] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:45.013173  7920 raft_consensus.cc:3060] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:50:45.019110  7852 raft_consensus.cc:2468] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 3.
I20260709 14:50:45.021422  7745 leader_election.cc:304] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:50:45.022295  9066 raft_consensus.cc:2804] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Leader election won for term 3
I20260709 14:50:45.024856  7920 raft_consensus.cc:2468] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 3.
I20260709 14:50:45.024202  9066 raft_consensus.cc:697] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:50:45.027694  9066 consensus_queue.cc:237] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:45.034570  9077 raft_consensus.cc:993] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac: : Instructing follower 1e9289592458429bbddb19c2e7b7b7b0 to start an election
I20260709 14:50:45.035183  9077 raft_consensus.cc:1081] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 LEADER]: Signalling peer 1e9289592458429bbddb19c2e7b7b7b0 to start an election
I20260709 14:50:45.037675  7920 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9c563cc7cfbe4d59be4ffc5cf847ce56"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
 from {username='slave'} at 127.0.0.1:38516
I20260709 14:50:45.038219  7920 raft_consensus.cc:493] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:50:45.038539  7920 raft_consensus.cc:3060] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:50:45.048661  7676 catalog_manager.cc:5697] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 2 to 3, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 3 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:50:45.049463  7920 raft_consensus.cc:515] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:45.052408  7920 leader_election.cc:290] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 3 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:50:45.052315  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c563cc7cfbe4d59be4ffc5cf847ce56" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:50:45.054020  7779 raft_consensus.cc:3060] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:50:45.054330  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c563cc7cfbe4d59be4ffc5cf847ce56" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:50:45.055058  7852 raft_consensus.cc:3055] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 LEADER]: Stepping down as leader of term 2
I20260709 14:50:45.055368  7852 raft_consensus.cc:740] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:50:45.056412  7852 consensus_queue.cc:260] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:45.057844  7852 raft_consensus.cc:3060] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:50:45.064724  7779 raft_consensus.cc:2468] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 3.
I20260709 14:50:45.067248  7893 leader_election.cc:304] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:50:45.068143  8909 raft_consensus.cc:2804] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 14:50:45.068665  8909 raft_consensus.cc:697] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:50:45.069547  8909 consensus_queue.cc:237] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:45.075349  7852 raft_consensus.cc:2468] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 3.
I20260709 14:50:45.089521  7676 catalog_manager.cc:5697] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 2 to 3, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 3 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:50:45.260763  8853 raft_consensus.cc:993] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac: : Instructing follower 1de5e20126fa4d8ca0793d19c7b847ed to start an election
I20260709 14:50:45.261426  8853 raft_consensus.cc:1081] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 LEADER]: Signalling peer 1de5e20126fa4d8ca0793d19c7b847ed to start an election
I20260709 14:50:45.263602  7779 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf"
dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:37136
I20260709 14:50:45.264150  7779 raft_consensus.cc:493] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:50:45.264454  7779 raft_consensus.cc:3060] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:50:45.270867  7779 raft_consensus.cc:515] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:45.272992  7779 leader_election.cc:290] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:45.273478  9066 raft_consensus.cc:993] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed: : Instructing follower 3876b8ee8d744cb18e91d97aae93b1ac to start an election
I20260709 14:50:45.274281  9066 raft_consensus.cc:1081] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Signalling peer 3876b8ee8d744cb18e91d97aae93b1ac to start an election
I20260709 14:50:45.274206  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:50:45.275027  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:50:45.275215  7852 raft_consensus.cc:3055] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 LEADER]: Stepping down as leader of term 2
I20260709 14:50:45.275679  7852 raft_consensus.cc:740] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:50:45.275668  7922 raft_consensus.cc:3060] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:50:45.276598  7846 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04"
dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:49948
I20260709 14:50:45.277199  7846 raft_consensus.cc:493] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:50:45.277566  7846 raft_consensus.cc:3060] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:45.278143  7852 consensus_queue.cc:260] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:45.279954  7852 raft_consensus.cc:3060] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:50:45.289014  7852 raft_consensus.cc:2468] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 3.
I20260709 14:50:45.289752  7846 raft_consensus.cc:515] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:45.291569  7745 leader_election.cc:304] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:50:45.291846  7846 leader_election.cc:290] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 2 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:45.292279  7922 raft_consensus.cc:2468] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 3.
I20260709 14:50:45.292584  9066 raft_consensus.cc:2804] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Leader election won for term 3
I20260709 14:50:45.294576  9066 raft_consensus.cc:697] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:50:45.295761  9066 consensus_queue.cc:237] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:45.298557  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:50:45.299412  7925 raft_consensus.cc:3060] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:45.300541  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:50:45.301211  7779 raft_consensus.cc:3055] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Stepping down as leader of term 1
I20260709 14:50:45.301605  7779 raft_consensus.cc:740] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:50:45.302475  7779 consensus_queue.cc:260] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:45.303851  7779 raft_consensus.cc:3060] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:45.306622  9097 raft_consensus.cc:993] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed: : Instructing follower 3876b8ee8d744cb18e91d97aae93b1ac to start an election
I20260709 14:50:45.307256  9097 raft_consensus.cc:1081] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Signalling peer 3876b8ee8d744cb18e91d97aae93b1ac to start an election
I20260709 14:50:45.309725  7852 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621"
dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:49948
I20260709 14:50:45.310380  7852 raft_consensus.cc:493] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:50:45.310740  7852 raft_consensus.cc:3060] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:45.314813  7925 raft_consensus.cc:2468] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 2.
I20260709 14:50:45.314517  7676 catalog_manager.cc:5697] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 2 to 3, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 3 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:50:45.314867  7779 raft_consensus.cc:2468] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 2.
I20260709 14:50:45.316926  7819 leader_election.cc:304] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:50:45.318075  8853 raft_consensus.cc:2804] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:50:45.318696  8853 raft_consensus.cc:697] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:50:45.319643  8853 consensus_queue.cc:237] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:45.327263  7852 raft_consensus.cc:515] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:45.329679  7852 leader_election.cc:290] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 2 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:45.330642  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:50:45.330960  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:50:45.331323  7779 raft_consensus.cc:3055] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Stepping down as leader of term 1
I20260709 14:50:45.331722  7779 raft_consensus.cc:740] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:50:45.331786  7925 raft_consensus.cc:3060] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:45.332892  7779 consensus_queue.cc:260] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:45.334252  7779 raft_consensus.cc:3060] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:45.341194  7925 raft_consensus.cc:2468] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 2.
I20260709 14:50:45.340889  7676 catalog_manager.cc:5697] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 1 to 2, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 2 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:50:45.342674  7819 leader_election.cc:304] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:50:45.343637  8853 raft_consensus.cc:2804] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:50:45.342397  7779 raft_consensus.cc:2468] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 2.
I20260709 14:50:45.344165  8853 raft_consensus.cc:697] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:50:45.345114  8853 consensus_queue.cc:237] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:45.376830  7676 catalog_manager.cc:5697] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 1 to 2, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 2 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:50:45.592995  7852 raft_consensus.cc:1275] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 14:50:45.594548  9064 consensus_queue.cc:1048] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 14:50:45.598738  7851 raft_consensus.cc:1275] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 14:50:45.600455  9098 consensus_queue.cc:1048] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 14:50:45.613364  7925 raft_consensus.cc:1275] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 14:50:45.617666  9066 consensus_queue.cc:1048] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 14:50:45.635699  7779 raft_consensus.cc:1275] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 14:50:45.643393  9112 consensus_queue.cc:1048] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 14:50:45.697861  7925 raft_consensus.cc:1275] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 14:50:45.699724  9066 consensus_queue.cc:1048] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 14:50:45.712360  7846 raft_consensus.cc:1275] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 14:50:45.714188  9097 consensus_queue.cc:1048] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 14:50:45.741760  7925 raft_consensus.cc:1275] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:50:45.744016  9077 consensus_queue.cc:1048] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 14:50:45.759155  7779 raft_consensus.cc:1275] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:50:45.761344  8853 consensus_queue.cc:1048] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 14:50:45.842268  7925 raft_consensus.cc:1275] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:50:45.843672  9077 consensus_queue.cc:1048] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 14:50:45.857975  7775 raft_consensus.cc:1275] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:50:45.859956  9122 consensus_queue.cc:1048] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 14:50:45.908164  6549 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 14:50:46.966055  6549 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 14:50:47.011719  7846 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f"
dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
mode: GRACEFUL
new_leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:41662
I20260709 14:50:47.012419  7846 raft_consensus.cc:606] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 LEADER]: Received request to transfer leadership to TS 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:50:47.015779  7925 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
mode: GRACEFUL
new_leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:48676
I20260709 14:50:47.016404  7925 raft_consensus.cc:606] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 LEADER]: Received request to transfer leadership to TS 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:50:47.019878  7779 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375"
dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
mode: GRACEFUL
new_leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:47068
I20260709 14:50:47.020488  7779 raft_consensus.cc:606] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 LEADER]: Received request to transfer leadership to TS 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:47.023973  7846 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff"
dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
mode: GRACEFUL
new_leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
 from {username='slave'} at 127.0.0.1:41662
I20260709 14:50:47.024621  7846 raft_consensus.cc:606] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 LEADER]: Received request to transfer leadership to TS 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:50:47.027993  7779 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c"
dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
mode: GRACEFUL
new_leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:47068
I20260709 14:50:47.028589  7779 raft_consensus.cc:606] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 LEADER]: Received request to transfer leadership to TS 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:47.029970  6549 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 14:50:47.031795  6549 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 14:50:47.113911  9125 raft_consensus.cc:993] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac: : Instructing follower 1de5e20126fa4d8ca0793d19c7b847ed to start an election
I20260709 14:50:47.114488  9122 raft_consensus.cc:1081] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 LEADER]: Signalling peer 1de5e20126fa4d8ca0793d19c7b847ed to start an election
I20260709 14:50:47.116506  7779 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f"
dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:37136
I20260709 14:50:47.117321  7779 raft_consensus.cc:493] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:50:47.117738  7779 raft_consensus.cc:3060] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:50:47.124234  7779 raft_consensus.cc:515] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:47.126250  7779 leader_election.cc:290] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:47.127283  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:50:47.127760  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:50:47.128007  7851 raft_consensus.cc:3055] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 LEADER]: Stepping down as leader of term 2
I20260709 14:50:47.128415  7920 raft_consensus.cc:3060] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:50:47.128389  7851 raft_consensus.cc:740] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:50:47.129896  7851 consensus_queue.cc:260] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:47.131068  7851 raft_consensus.cc:3060] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:50:47.137342  7920 raft_consensus.cc:2468] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 3.
I20260709 14:50:47.138185  7851 raft_consensus.cc:2468] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 3.
I20260709 14:50:47.138854  7744 leader_election.cc:304] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:50:47.139871  9097 raft_consensus.cc:2804] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Leader election won for term 3
I20260709 14:50:47.140403  9097 raft_consensus.cc:697] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:50:47.141360  9097 consensus_queue.cc:237] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:47.159170  7675 catalog_manager.cc:5697] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 2 to 3, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 3 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:50:47.208225  9117 raft_consensus.cc:993] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed: : Instructing follower 3876b8ee8d744cb18e91d97aae93b1ac to start an election
I20260709 14:50:47.208783  9117 raft_consensus.cc:1081] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 LEADER]: Signalling peer 3876b8ee8d744cb18e91d97aae93b1ac to start an election
I20260709 14:50:47.212883  7851 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375"
dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:49948
I20260709 14:50:47.213899  7851 raft_consensus.cc:493] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:50:47.214911  7851 raft_consensus.cc:3060] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:50:47.222431  9125 raft_consensus.cc:993] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac: : Instructing follower 1e9289592458429bbddb19c2e7b7b7b0 to start an election
I20260709 14:50:47.223122  9125 raft_consensus.cc:1081] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 LEADER]: Signalling peer 1e9289592458429bbddb19c2e7b7b7b0 to start an election
I20260709 14:50:47.224094  7851 raft_consensus.cc:515] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:47.225081  7920 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
 from {username='slave'} at 127.0.0.1:38516
I20260709 14:50:47.225826  7920 raft_consensus.cc:493] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:50:47.226218  7920 raft_consensus.cc:3060] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:50:47.226679  7851 leader_election.cc:290] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 3 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:47.228616  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:50:47.229368  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:50:47.229403  7775 raft_consensus.cc:3055] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 LEADER]: Stepping down as leader of term 2
I20260709 14:50:47.231523  7775 raft_consensus.cc:740] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:50:47.231626  7925 raft_consensus.cc:3060] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:50:47.232826  7775 consensus_queue.cc:260] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:47.238035  7920 raft_consensus.cc:515] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:47.239316  7775 raft_consensus.cc:3060] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:50:47.240679  7925 raft_consensus.cc:2468] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 3.
I20260709 14:50:47.241029  7920 leader_election.cc:290] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 4 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:50:47.243877  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:50:47.244660  7779 raft_consensus.cc:3060] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:50:47.248940  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:50:47.249823  7846 raft_consensus.cc:3055] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 LEADER]: Stepping down as leader of term 3
I20260709 14:50:47.250211  7846 raft_consensus.cc:740] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:50:47.250737  7819 leader_election.cc:304] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:50:47.253496  9125 raft_consensus.cc:2804] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Leader election won for term 3
I20260709 14:50:47.254966  7775 raft_consensus.cc:2468] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 3.
I20260709 14:50:47.259963  7846 consensus_queue.cc:260] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:47.261595  7846 raft_consensus.cc:3060] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:50:47.270423  7846 raft_consensus.cc:2468] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 4.
I20260709 14:50:47.271680  7894 leader_election.cc:304] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:50:47.272744  9085 raft_consensus.cc:2804] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 14:50:47.273379  9085 raft_consensus.cc:697] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:50:47.274271  9085 consensus_queue.cc:237] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:47.281270  7779 raft_consensus.cc:2468] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 4.
I20260709 14:50:47.283768  9125 raft_consensus.cc:697] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:50:47.284885  9125 consensus_queue.cc:237] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:47.305583  7675 catalog_manager.cc:5697] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 3 to 4, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 4 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:50:47.346688  9097 raft_consensus.cc:993] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed: : Instructing follower 3876b8ee8d744cb18e91d97aae93b1ac to start an election
I20260709 14:50:47.348206  9139 raft_consensus.cc:1081] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 LEADER]: Signalling peer 3876b8ee8d744cb18e91d97aae93b1ac to start an election
I20260709 14:50:47.354545  7850 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c"
dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:49948
I20260709 14:50:47.355126  7850 raft_consensus.cc:493] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:50:47.355497  7850 raft_consensus.cc:3060] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:50:47.366870  7850 raft_consensus.cc:515] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:47.369059  7850 leader_election.cc:290] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 3 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:47.370620  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:50:47.371627  7925 raft_consensus.cc:3060] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:50:47.372241  7675 catalog_manager.cc:5697] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 2 to 3, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 3 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:50:47.384667  7925 raft_consensus.cc:2468] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 3.
I20260709 14:50:47.384996  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:50:47.385672  7779 raft_consensus.cc:3055] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 LEADER]: Stepping down as leader of term 2
I20260709 14:50:47.386001  7779 raft_consensus.cc:740] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:50:47.386811  7779 consensus_queue.cc:260] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:47.387591  7819 leader_election.cc:304] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:50:47.388056  7779 raft_consensus.cc:3060] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:50:47.388682  9122 raft_consensus.cc:2804] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Leader election won for term 3
I20260709 14:50:47.389272  9122 raft_consensus.cc:697] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:50:47.390384  7925 raft_consensus.cc:1240] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 2. Current term is 3. Ops: []
I20260709 14:50:47.390211  9122 consensus_queue.cc:237] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:47.397535  7779 raft_consensus.cc:2468] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 3.
I20260709 14:50:47.404923  7675 catalog_manager.cc:5697] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 2 to 3, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 3 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:50:47.464824  9085 raft_consensus.cc:993] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0: : Instructing follower 1de5e20126fa4d8ca0793d19c7b847ed to start an election
I20260709 14:50:47.465411  9098 raft_consensus.cc:1081] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 LEADER]: Signalling peer 1de5e20126fa4d8ca0793d19c7b847ed to start an election
I20260709 14:50:47.467114  7779 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072"
dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:37144
I20260709 14:50:47.467599  7779 raft_consensus.cc:493] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:50:47.467892  7779 raft_consensus.cc:3060] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:50:47.472945  7779 raft_consensus.cc:515] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:47.474550  7779 leader_election.cc:290] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:47.475899  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:50:47.475899  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:50:47.476845  7925 raft_consensus.cc:3055] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 14:50:47.477013  7850 raft_consensus.cc:3060] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:50:47.477162  7925 raft_consensus.cc:740] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:50:47.478498  7925 consensus_queue.cc:260] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:47.479821  7925 raft_consensus.cc:3060] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:50:47.484680  7850 raft_consensus.cc:2468] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 4.
I20260709 14:50:47.488336  7745 leader_election.cc:304] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:50:47.488584  7925 raft_consensus.cc:2468] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 4.
I20260709 14:50:47.489431  9136 raft_consensus.cc:2804] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader election won for term 4
I20260709 14:50:47.489913  9136 raft_consensus.cc:697] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:50:47.491051  9136 consensus_queue.cc:237] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:47.504792  7675 catalog_manager.cc:5697] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 3 to 4, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 4 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:50:47.582633  7850 raft_consensus.cc:1275] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 14:50:47.584239  9140 consensus_queue.cc:1048] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 14:50:47.598266  7922 raft_consensus.cc:1275] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 14:50:47.601306  9139 consensus_queue.cc:1048] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 14:50:47.713762  7779 raft_consensus.cc:1275] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 14:50:47.715405  9125 consensus_queue.cc:1048] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 14:50:47.732594  7922 raft_consensus.cc:1275] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 14:50:47.735146  9131 consensus_queue.cc:1048] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 14:50:47.747566  7850 raft_consensus.cc:1275] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 14:50:47.750655  9085 consensus_queue.cc:1048] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 14:50:47.770506  7779 raft_consensus.cc:1275] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 14:50:47.772509  9112 consensus_queue.cc:1048] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 14:50:47.790834  7920 raft_consensus.cc:1275] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 14:50:47.792611  9125 consensus_queue.cc:1048] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 14:50:47.808458  7775 raft_consensus.cc:1275] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 14:50:47.810752  9125 consensus_queue.cc:1048] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 14:50:48.033632  6549 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 14:50:48.111865  7851 raft_consensus.cc:1275] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 14:50:48.113945  7920 raft_consensus.cc:1275] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 14:50:48.113858  9136 consensus_queue.cc:1048] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 14:50:48.115445  9139 consensus_queue.cc:1048] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 14:50:49.080669  6549 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 14:50:49.136474  7779 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775"
dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
mode: GRACEFUL
new_leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:47068
I20260709 14:50:49.138507  7779 raft_consensus.cc:606] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 LEADER]: Received request to transfer leadership to TS 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:49.146885  7850 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c"
dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
mode: GRACEFUL
new_leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
 from {username='slave'} at 127.0.0.1:41662
I20260709 14:50:49.148285  7850 raft_consensus.cc:606] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 LEADER]: Received request to transfer leadership to TS 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:50:49.153632  7779 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf"
dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
mode: GRACEFUL
new_leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:47068
I20260709 14:50:49.154357  7779 raft_consensus.cc:606] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 LEADER]: Received request to transfer leadership to TS 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:49.157351  7925 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
mode: GRACEFUL
new_leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:48676
I20260709 14:50:49.158603  7925 raft_consensus.cc:606] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 LEADER]: Received request to transfer leadership to TS 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:50:49.163635  7850 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c"
dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
mode: GRACEFUL
new_leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:41662
I20260709 14:50:49.164465  7850 raft_consensus.cc:606] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 LEADER]: Received request to transfer leadership to TS 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:50:49.166785  6549 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 14:50:49.170190  6549 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 14:50:49.412940  9158 raft_consensus.cc:993] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac: : Instructing follower 1de5e20126fa4d8ca0793d19c7b847ed to start an election
I20260709 14:50:49.413698  9158 raft_consensus.cc:1081] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 LEADER]: Signalling peer 1de5e20126fa4d8ca0793d19c7b847ed to start an election
I20260709 14:50:49.417024  7775 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c"
dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:37136
I20260709 14:50:49.418725  7775 raft_consensus.cc:493] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:50:49.419883  7775 raft_consensus.cc:3060] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:49.428692  7775 raft_consensus.cc:515] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:49.430469  7775 leader_election.cc:290] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 2 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:49.431675  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:50:49.431831  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:50:49.432556  7850 raft_consensus.cc:3055] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 LEADER]: Stepping down as leader of term 1
I20260709 14:50:49.432581  7920 raft_consensus.cc:3060] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:49.433033  7850 raft_consensus.cc:740] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:50:49.434111  7850 consensus_queue.cc:260] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:49.435424  7850 raft_consensus.cc:3060] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:49.440295  7920 raft_consensus.cc:2468] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 2.
I20260709 14:50:49.441756  7744 leader_election.cc:304] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:50:49.442363  7850 raft_consensus.cc:2468] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 2.
I20260709 14:50:49.442893  9161 raft_consensus.cc:2804] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:50:49.444187  9161 raft_consensus.cc:697] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:50:49.445178  9161 consensus_queue.cc:237] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:49.459949  7676 catalog_manager.cc:5697] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 1 to 2, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 2 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:50:49.476953  9161 raft_consensus.cc:993] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed: : Instructing follower 3876b8ee8d744cb18e91d97aae93b1ac to start an election
I20260709 14:50:49.477603  9160 raft_consensus.cc:1081] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 LEADER]: Signalling peer 3876b8ee8d744cb18e91d97aae93b1ac to start an election
I20260709 14:50:49.479521  7850 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775"
dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:49948
I20260709 14:50:49.480108  7850 raft_consensus.cc:493] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:50:49.480466  7850 raft_consensus.cc:3060] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:50:49.485316  7850 raft_consensus.cc:515] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:49.487232  7850 leader_election.cc:290] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 4 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:49.488277  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:50:49.489032  7775 raft_consensus.cc:3055] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 LEADER]: Stepping down as leader of term 3
I20260709 14:50:49.489382  7775 raft_consensus.cc:740] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:50:49.490211  7775 consensus_queue.cc:260] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:49.490690  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:50:49.491195  7920 raft_consensus.cc:3060] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:50:49.491570  7775 raft_consensus.cc:3060] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:50:49.500048  7775 raft_consensus.cc:2468] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 4.
I20260709 14:50:49.501510  7819 leader_election.cc:304] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:50:49.502278  9131 raft_consensus.cc:2804] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Leader election won for term 4
I20260709 14:50:49.502362  7920 raft_consensus.cc:2468] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 4.
I20260709 14:50:49.502776  9131 raft_consensus.cc:697] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:50:49.503790  9131 consensus_queue.cc:237] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:49.522881  7676 catalog_manager.cc:5697] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 3 to 4, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 4 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:50:49.628873  9158 raft_consensus.cc:993] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac: : Instructing follower 1e9289592458429bbddb19c2e7b7b7b0 to start an election
I20260709 14:50:49.629554  9122 raft_consensus.cc:1081] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 LEADER]: Signalling peer 1e9289592458429bbddb19c2e7b7b7b0 to start an election
I20260709 14:50:49.631906  7922 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
 from {username='slave'} at 127.0.0.1:38516
I20260709 14:50:49.632551  7922 raft_consensus.cc:493] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:50:49.632863  7922 raft_consensus.cc:3060] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:50:49.642050  7922 raft_consensus.cc:515] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:49.644650  7922 leader_election.cc:290] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 4 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:50:49.645642  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:50:49.645596  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:50:49.646651  7851 raft_consensus.cc:3055] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 LEADER]: Stepping down as leader of term 3
I20260709 14:50:49.646766  7775 raft_consensus.cc:3060] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:50:49.646960  7851 raft_consensus.cc:740] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:50:49.648952  7851 consensus_queue.cc:260] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:49.650384  7851 raft_consensus.cc:3060] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:50:49.656404  7775 raft_consensus.cc:2468] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 4.
I20260709 14:50:49.658565  7893 leader_election.cc:304] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:50:49.659759  9151 raft_consensus.cc:2804] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 14:50:49.660363  9151 raft_consensus.cc:697] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:50:49.661101  7851 raft_consensus.cc:2468] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 4.
I20260709 14:50:49.661327  9151 consensus_queue.cc:237] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:49.674593  9161 raft_consensus.cc:993] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed: : Instructing follower 3876b8ee8d744cb18e91d97aae93b1ac to start an election
I20260709 14:50:49.675441  9160 raft_consensus.cc:1081] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 LEADER]: Signalling peer 3876b8ee8d744cb18e91d97aae93b1ac to start an election
I20260709 14:50:49.676779  7676 catalog_manager.cc:5697] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 3 to 4, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 4 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:50:49.677750  7851 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf"
dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:49948
I20260709 14:50:49.678617  7851 raft_consensus.cc:493] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:50:49.679458  7851 raft_consensus.cc:3060] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:50:49.688143  7851 raft_consensus.cc:515] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:49.693480  7851 leader_election.cc:290] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 4 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:49.695334  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:50:49.696089  7775 raft_consensus.cc:3055] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 LEADER]: Stepping down as leader of term 3
I20260709 14:50:49.696414  7775 raft_consensus.cc:740] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:50:49.696815  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:50:49.697664  7920 raft_consensus.cc:3060] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:50:49.697751  7775 consensus_queue.cc:260] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:49.699426  7775 raft_consensus.cc:3060] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:50:49.706086  7920 raft_consensus.cc:2468] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 4.
I20260709 14:50:49.707430  7819 leader_election.cc:304] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:50:49.708459  9122 raft_consensus.cc:2804] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Leader election won for term 4
I20260709 14:50:49.709306  9122 raft_consensus.cc:697] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:50:49.709538  7775 raft_consensus.cc:2468] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 4.
I20260709 14:50:49.710523  9122 consensus_queue.cc:237] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:49.722831  7676 catalog_manager.cc:5697] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 3 to 4, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 4 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:50:49.738232  9112 raft_consensus.cc:993] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0: : Instructing follower 1de5e20126fa4d8ca0793d19c7b847ed to start an election
I20260709 14:50:49.738819  9151 raft_consensus.cc:1081] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 LEADER]: Signalling peer 1de5e20126fa4d8ca0793d19c7b847ed to start an election
I20260709 14:50:49.741273  7775 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3"
dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:37144
I20260709 14:50:49.742028  7775 raft_consensus.cc:493] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:50:49.742367  7775 raft_consensus.cc:3060] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:49.748034  7775 raft_consensus.cc:515] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:49.749812  7775 leader_election.cc:290] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 2 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:49.751780  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:50:49.751125  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:50:49.752694  7920 raft_consensus.cc:3055] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 14:50:49.752769  7851 raft_consensus.cc:3060] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:49.753077  7920 raft_consensus.cc:740] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:50:49.754601  7920 consensus_queue.cc:260] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:49.755532  7920 raft_consensus.cc:3060] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:49.760078  7851 raft_consensus.cc:2468] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 2.
I20260709 14:50:49.761291  7920 raft_consensus.cc:2468] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 2.
I20260709 14:50:49.764192  7745 leader_election.cc:304] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:50:49.765851  9155 raft_consensus.cc:2804] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:50:49.766449  9155 raft_consensus.cc:697] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:50:49.767412  9155 consensus_queue.cc:237] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:49.784989  7676 catalog_manager.cc:5697] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 1 to 2, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 2 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:50:49.897884  7920 raft_consensus.cc:1275] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:50:49.899576  9155 consensus_queue.cc:1048] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 14:50:49.917743  7850 raft_consensus.cc:1275] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:50:49.919910  9161 consensus_queue.cc:1048] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 14:50:49.975728  7772 raft_consensus.cc:1275] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 14:50:49.977681  9131 consensus_queue.cc:1048] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 14:50:50.007926  7922 raft_consensus.cc:1275] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 14:50:50.011972  9131 consensus_queue.cc:1048] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 14:50:50.080704  7850 raft_consensus.cc:1275] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 14:50:50.083514  9112 consensus_queue.cc:1048] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 14:50:50.115056  7775 raft_consensus.cc:1275] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 14:50:50.130828  9122 consensus_queue.cc:1048] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 14:50:50.171468  6549 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 14:50:50.192010  7925 raft_consensus.cc:1275] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:50:50.195393  7775 raft_consensus.cc:1275] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 14:50:50.198014  9112 consensus_queue.cc:1048] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 14:50:50.200703  9155 consensus_queue.cc:1048] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 14:50:50.220755  7920 raft_consensus.cc:1275] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 14:50:50.233846  9131 consensus_queue.cc:1048] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 14:50:50.238047  7850 raft_consensus.cc:1275] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:50:50.242637  9155 consensus_queue.cc:1048] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 14:50:51.290058  6549 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 14:50:51.334599  7771 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b"
dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
mode: GRACEFUL
new_leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:47068
I20260709 14:50:51.335434  7771 raft_consensus.cc:606] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 LEADER]: Received request to transfer leadership to TS 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:51.338644  7846 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16"
dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
mode: GRACEFUL
new_leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:41662
I20260709 14:50:51.339388  7846 raft_consensus.cc:606] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 LEADER]: Received request to transfer leadership to TS 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:50:51.342944  7771 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ad8e261558b942c6b42c841689082c10"
dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
mode: GRACEFUL
new_leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:47068
I20260709 14:50:51.343737  7771 raft_consensus.cc:606] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 LEADER]: Received request to transfer leadership to TS 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:51.347394  7920 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
mode: GRACEFUL
new_leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:48676
I20260709 14:50:51.348193  7920 raft_consensus.cc:606] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 LEADER]: Received request to transfer leadership to TS 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:50:51.351359  7846 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea"
dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
mode: GRACEFUL
new_leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
 from {username='slave'} at 127.0.0.1:41662
I20260709 14:50:51.351981  7846 raft_consensus.cc:606] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 LEADER]: Received request to transfer leadership to TS 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:50:51.353281  6549 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 14:50:51.354840  6549 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 14:50:51.595197  9162 raft_consensus.cc:993] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0: : Instructing follower 1de5e20126fa4d8ca0793d19c7b847ed to start an election
I20260709 14:50:51.595826  9112 raft_consensus.cc:1081] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 LEADER]: Signalling peer 1de5e20126fa4d8ca0793d19c7b847ed to start an election
I20260709 14:50:51.597735  7775 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9"
dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:37144
I20260709 14:50:51.598438  7775 raft_consensus.cc:493] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:50:51.598764  7775 raft_consensus.cc:3060] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:50:51.605016  7775 raft_consensus.cc:515] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:51.607019  7775 leader_election.cc:290] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:51.608036  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:50:51.608086  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:50:51.608798  7920 raft_consensus.cc:3055] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 14:50:51.609182  7920 raft_consensus.cc:740] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:50:51.609090  7846 raft_consensus.cc:3060] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:50:51.610301  7920 consensus_queue.cc:260] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:51.612880  7920 raft_consensus.cc:3060] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:50:51.616052  9161 raft_consensus.cc:993] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed: : Instructing follower 3876b8ee8d744cb18e91d97aae93b1ac to start an election
I20260709 14:50:51.616838  9160 raft_consensus.cc:1081] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 LEADER]: Signalling peer 3876b8ee8d744cb18e91d97aae93b1ac to start an election
I20260709 14:50:51.618053  7846 raft_consensus.cc:2468] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 3.
I20260709 14:50:51.620051  7846 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ad8e261558b942c6b42c841689082c10"
dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:49948
I20260709 14:50:51.620345  7745 leader_election.cc:304] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:50:51.620761  7846 raft_consensus.cc:493] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:50:51.621237  7846 raft_consensus.cc:3060] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:50:51.621327  7920 raft_consensus.cc:2468] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 3.
I20260709 14:50:51.621393  9160 raft_consensus.cc:2804] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Leader election won for term 3
I20260709 14:50:51.622671  9160 raft_consensus.cc:697] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:50:51.623631  9160 consensus_queue.cc:237] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:51.633095  7846 raft_consensus.cc:515] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:51.636581  7846 leader_election.cc:290] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 3 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:51.637794  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:50:51.638572  7920 raft_consensus.cc:3060] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:50:51.640480  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:50:51.641196  7771 raft_consensus.cc:3055] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 LEADER]: Stepping down as leader of term 2
I20260709 14:50:51.641538  7771 raft_consensus.cc:740] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:50:51.642429  7771 consensus_queue.cc:260] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:51.643926  7771 raft_consensus.cc:3060] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:50:51.654073  7920 raft_consensus.cc:2468] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 3.
I20260709 14:50:51.655115  7675 catalog_manager.cc:5697] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 2 to 3, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 3 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:50:51.657262  7819 leader_election.cc:304] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:50:51.658504  9131 raft_consensus.cc:2804] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Leader election won for term 3
I20260709 14:50:51.656950  7771 raft_consensus.cc:2468] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 3.
I20260709 14:50:51.659058  9131 raft_consensus.cc:697] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:50:51.660131  9131 consensus_queue.cc:237] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:51.675315  7676 catalog_manager.cc:5697] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 2 to 3, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 3 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:50:51.693847  9187 raft_consensus.cc:993] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed: : Instructing follower 3876b8ee8d744cb18e91d97aae93b1ac to start an election
I20260709 14:50:51.694309  9160 raft_consensus.cc:1081] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 LEADER]: Signalling peer 3876b8ee8d744cb18e91d97aae93b1ac to start an election
I20260709 14:50:51.696056  7850 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b"
dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:49948
I20260709 14:50:51.696655  7850 raft_consensus.cc:493] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:50:51.697029  7850 raft_consensus.cc:3060] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:50:51.702931  7850 raft_consensus.cc:515] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:51.704562  7850 leader_election.cc:290] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 4 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:51.705823  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:50:51.706079  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:50:51.706496  7771 raft_consensus.cc:3055] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 LEADER]: Stepping down as leader of term 3
I20260709 14:50:51.706548  7920 raft_consensus.cc:3060] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:50:51.706948  7771 raft_consensus.cc:740] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:50:51.707826  7771 consensus_queue.cc:260] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:51.709100  7771 raft_consensus.cc:3060] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:50:51.716704  7771 raft_consensus.cc:2468] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 4.
I20260709 14:50:51.717880  7819 leader_election.cc:304] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:50:51.718770  9131 raft_consensus.cc:2804] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Leader election won for term 4
I20260709 14:50:51.718670  7920 raft_consensus.cc:2468] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 4.
I20260709 14:50:51.719458  9131 raft_consensus.cc:697] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:50:51.720261  9131 consensus_queue.cc:237] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:51.734445  7676 catalog_manager.cc:5697] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 3 to 4, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 4 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:50:51.758049  9122 raft_consensus.cc:993] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac: : Instructing follower 1de5e20126fa4d8ca0793d19c7b847ed to start an election
I20260709 14:50:51.758738  9158 raft_consensus.cc:1081] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 LEADER]: Signalling peer 1de5e20126fa4d8ca0793d19c7b847ed to start an election
I20260709 14:50:51.761317  7771 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16"
dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:37136
I20260709 14:50:51.762084  7771 raft_consensus.cc:493] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:50:51.762494  7771 raft_consensus.cc:3060] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:50:51.770480  7771 raft_consensus.cc:515] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:51.772512  7771 leader_election.cc:290] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:51.773466  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:50:51.774112  7850 raft_consensus.cc:3055] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 LEADER]: Stepping down as leader of term 2
I20260709 14:50:51.774418  7850 raft_consensus.cc:740] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:50:51.774746  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:50:51.775173  7850 consensus_queue.cc:260] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:51.775631  7920 raft_consensus.cc:3060] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:50:51.777864  7850 raft_consensus.cc:3060] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:50:51.782120  7920 raft_consensus.cc:2468] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 3.
I20260709 14:50:51.784420  7850 raft_consensus.cc:2468] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 3.
I20260709 14:50:51.784999  7744 leader_election.cc:304] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:50:51.785977  9187 raft_consensus.cc:2804] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Leader election won for term 3
I20260709 14:50:51.789371  9187 raft_consensus.cc:697] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:50:51.790726  9187 consensus_queue.cc:237] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:51.803995  7676 catalog_manager.cc:5697] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 2 to 3, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 3 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:50:51.819411  9158 raft_consensus.cc:993] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac: : Instructing follower 1e9289592458429bbddb19c2e7b7b7b0 to start an election
I20260709 14:50:51.819901  9122 raft_consensus.cc:1081] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 LEADER]: Signalling peer 1e9289592458429bbddb19c2e7b7b7b0 to start an election
I20260709 14:50:51.821802  7920 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
 from {username='slave'} at 127.0.0.1:38516
I20260709 14:50:51.822338  7920 raft_consensus.cc:493] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:50:51.822630  7920 raft_consensus.cc:3060] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:51.828969  7920 raft_consensus.cc:515] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:51.830914  7920 leader_election.cc:290] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 2 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:50:51.832545  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:50:51.832403  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:50:51.833294  7772 raft_consensus.cc:3060] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:51.833369  7850 raft_consensus.cc:3055] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 LEADER]: Stepping down as leader of term 1
I20260709 14:50:51.833783  7850 raft_consensus.cc:740] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:50:51.834636  7850 consensus_queue.cc:260] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:51.835848  7850 raft_consensus.cc:3060] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:51.842281  7772 raft_consensus.cc:2468] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 2.
I20260709 14:50:51.843853  7893 leader_election.cc:304] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:50:51.844398  7850 raft_consensus.cc:2468] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 2.
I20260709 14:50:51.844827  9162 raft_consensus.cc:2804] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:50:51.845346  9162 raft_consensus.cc:697] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:50:51.846236  9162 consensus_queue.cc:237] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:51.859686  7676 catalog_manager.cc:5697] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 1 to 2, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 2 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:50:52.060878  7922 raft_consensus.cc:1275] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 14:50:52.062381  9187 consensus_queue.cc:1048] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 14:50:52.068089  7920 raft_consensus.cc:1275] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 14:50:52.070123  9158 consensus_queue.cc:1048] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 14:50:52.086190  7850 raft_consensus.cc:1275] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 14:50:52.098627  9160 consensus_queue.cc:1048] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 14:50:52.131644  7771 raft_consensus.cc:1275] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 14:50:52.133440  7924 raft_consensus.cc:1275] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 14:50:52.140184  9158 consensus_queue.cc:1048] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 14:50:52.141052  9131 consensus_queue.cc:1048] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 14:50:52.157648  7771 raft_consensus.cc:1275] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 14:50:52.163833  9122 consensus_queue.cc:1048] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 14:50:52.246896  7922 raft_consensus.cc:1275] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 14:50:52.249549  9187 consensus_queue.cc:1048] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 14:50:52.258361  7779 raft_consensus.cc:1275] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:50:52.261341  9162 consensus_queue.cc:1048] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 14:50:52.270237  7850 raft_consensus.cc:1275] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 14:50:52.273958  9161 consensus_queue.cc:1048] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 14:50:52.297317  7850 raft_consensus.cc:1275] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:50:52.299912  9205 consensus_queue.cc:1048] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 14:50:52.355999  6549 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 14:50:53.190658  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 93350.8us
W20260709 14:50:53.220842  8598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 106623us
I20260709 14:50:53.410820  6549 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 14:50:53.467070  7846 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04"
dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
mode: GRACEFUL
new_leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:41662
I20260709 14:50:53.467944  7846 raft_consensus.cc:606] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 LEADER]: Received request to transfer leadership to TS 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:50:53.471843  7922 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
mode: GRACEFUL
new_leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:48676
I20260709 14:50:53.472734  7922 raft_consensus.cc:606] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 LEADER]: Received request to transfer leadership to TS 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:50:53.476996  7846 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a"
dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
mode: GRACEFUL
new_leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
 from {username='slave'} at 127.0.0.1:41662
I20260709 14:50:53.477695  7846 raft_consensus.cc:606] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 LEADER]: Received request to transfer leadership to TS 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:50:53.481228  7777 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c"
dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
mode: GRACEFUL
new_leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:47068
I20260709 14:50:53.481863  7777 raft_consensus.cc:606] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 LEADER]: Received request to transfer leadership to TS 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:53.485194  7777 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3"
dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
mode: GRACEFUL
new_leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:47068
I20260709 14:50:53.486081  7777 raft_consensus.cc:606] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Received request to transfer leadership to TS 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:53.488561  6549 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 14:50:53.490428  6549 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 14:50:53.495460  9220 raft_consensus.cc:993] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac: : Instructing follower 1e9289592458429bbddb19c2e7b7b7b0 to start an election
I20260709 14:50:53.496544  9122 raft_consensus.cc:1081] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 LEADER]: Signalling peer 1e9289592458429bbddb19c2e7b7b7b0 to start an election
I20260709 14:50:53.498561  7925 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
 from {username='slave'} at 127.0.0.1:38516
I20260709 14:50:53.499306  7925 raft_consensus.cc:493] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:50:53.499804  7925 raft_consensus.cc:3060] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:50:53.509150  9223 raft_consensus.cc:993] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0: : Instructing follower 1de5e20126fa4d8ca0793d19c7b847ed to start an election
I20260709 14:50:53.508730  7925 raft_consensus.cc:515] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:53.509877  9223 raft_consensus.cc:1081] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 LEADER]: Signalling peer 1de5e20126fa4d8ca0793d19c7b847ed to start an election
I20260709 14:50:53.511806  7777 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b"
dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:37144
I20260709 14:50:53.512053  7925 leader_election.cc:290] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 3 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:50:53.512606  7777 raft_consensus.cc:493] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:50:53.513113  7777 raft_consensus.cc:3060] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:50:53.513468  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:50:53.514199  7775 raft_consensus.cc:3060] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:50:53.519091  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:50:53.520234  7846 raft_consensus.cc:3055] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 LEADER]: Stepping down as leader of term 2
I20260709 14:50:53.520707  7846 raft_consensus.cc:740] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:50:53.520731  7777 raft_consensus.cc:515] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:53.522015  7775 raft_consensus.cc:2468] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 3.
I20260709 14:50:53.521986  7846 consensus_queue.cc:260] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:53.523550  7846 raft_consensus.cc:3060] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:50:53.523708  7893 leader_election.cc:304] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:50:53.524760  9223 raft_consensus.cc:2804] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 14:50:53.524776  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:50:53.524928  7777 leader_election.cc:290] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:53.525565  7850 raft_consensus.cc:3060] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:50:53.528034  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:50:53.528738  7922 raft_consensus.cc:3055] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 14:50:53.529016  7922 raft_consensus.cc:740] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:50:53.529789  7922 consensus_queue.cc:260] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:53.530864  7922 raft_consensus.cc:3060] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:50:53.531708  7846 raft_consensus.cc:2468] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 3.
I20260709 14:50:53.525430  9223 raft_consensus.cc:697] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:50:53.533109  9223 consensus_queue.cc:237] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:53.534134  7850 raft_consensus.cc:2468] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 4.
I20260709 14:50:53.535526  7745 leader_election.cc:304] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:50:53.536603  9222 raft_consensus.cc:2804] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader election won for term 4
I20260709 14:50:53.537276  9222 raft_consensus.cc:697] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:50:53.537967  7922 raft_consensus.cc:2468] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 4.
I20260709 14:50:53.538514  9222 consensus_queue.cc:237] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:53.549870  7675 catalog_manager.cc:5697] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 2 to 3, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 3 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:50:53.553478  7676 catalog_manager.cc:5697] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 3 to 4, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 4 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:50:53.831823  9222 raft_consensus.cc:993] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed: : Instructing follower 3876b8ee8d744cb18e91d97aae93b1ac to start an election
I20260709 14:50:53.832427  9187 raft_consensus.cc:1081] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Signalling peer 3876b8ee8d744cb18e91d97aae93b1ac to start an election
I20260709 14:50:53.834496  7846 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3"
dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:49948
I20260709 14:50:53.835000  7846 raft_consensus.cc:493] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:50:53.835274  7846 raft_consensus.cc:3060] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:53.841946  7846 raft_consensus.cc:515] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:53.844129  7846 leader_election.cc:290] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 2 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:53.847708  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:50:53.848285  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:50:53.848495  7777 raft_consensus.cc:3055] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Stepping down as leader of term 1
I20260709 14:50:53.848820  7777 raft_consensus.cc:740] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:50:53.848867  7924 raft_consensus.cc:3060] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:53.849783  7777 consensus_queue.cc:260] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:53.851215  7777 raft_consensus.cc:3060] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:53.861477  7777 raft_consensus.cc:2468] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 2.
I20260709 14:50:53.861477  7924 raft_consensus.cc:2468] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 2.
I20260709 14:50:53.865088  7819 leader_election.cc:304] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:50:53.868908  9221 raft_consensus.cc:2804] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:50:53.869657  9221 raft_consensus.cc:697] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:50:53.870718  9221 consensus_queue.cc:237] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:53.894228  7676 catalog_manager.cc:5697] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 1 to 2, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 2 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:50:53.915604  7851 raft_consensus.cc:1275] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 14:50:53.917541  9214 consensus_queue.cc:1048] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 14:50:53.919581  7777 raft_consensus.cc:1275] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 14:50:53.921010  9214 consensus_queue.cc:1048] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 14:50:53.983189  7851 raft_consensus.cc:1275] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 14:50:53.987098  9218 raft_consensus.cc:993] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed: : Instructing follower 3876b8ee8d744cb18e91d97aae93b1ac to start an election
I20260709 14:50:53.987942  9187 raft_consensus.cc:1081] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 LEADER]: Signalling peer 3876b8ee8d744cb18e91d97aae93b1ac to start an election
I20260709 14:50:53.992693  9187 consensus_queue.cc:1048] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 14:50:53.995182  7851 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c"
dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:49948
I20260709 14:50:53.995793  7851 raft_consensus.cc:493] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:50:53.996145  7851 raft_consensus.cc:3060] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:50:54.000403  9221 raft_consensus.cc:993] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac: : Instructing follower 1de5e20126fa4d8ca0793d19c7b847ed to start an election
I20260709 14:50:54.000973  9122 raft_consensus.cc:1081] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 LEADER]: Signalling peer 1de5e20126fa4d8ca0793d19c7b847ed to start an election
I20260709 14:50:54.002714  7775 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04"
dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:37136
I20260709 14:50:54.003360  7775 raft_consensus.cc:493] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:50:54.003768  7775 raft_consensus.cc:3060] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:50:54.012558  7775 raft_consensus.cc:515] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:54.016649  7775 leader_election.cc:290] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:54.018460  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:50:54.019088  7846 raft_consensus.cc:3055] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 LEADER]: Stepping down as leader of term 2
I20260709 14:50:54.019346  7846 raft_consensus.cc:740] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:50:54.020231  7925 raft_consensus.cc:1275] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 14:50:54.020395  7846 consensus_queue.cc:260] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:54.021704  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:50:54.021996  7846 raft_consensus.cc:3060] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:50:54.022424  7920 raft_consensus.cc:3060] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:50:54.005609  7851 raft_consensus.cc:515] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:54.028286  7851 leader_election.cc:290] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 3 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:54.029304  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:50:54.030299  7925 raft_consensus.cc:3060] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:50:54.034578  9222 consensus_queue.cc:1048] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 14:50:54.029666  7846 raft_consensus.cc:2468] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 3.
I20260709 14:50:54.038602  7745 leader_election.cc:304] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:50:54.040863  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:50:54.042588  7775 raft_consensus.cc:3055] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 LEADER]: Stepping down as leader of term 2
I20260709 14:50:54.043229  7775 raft_consensus.cc:740] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:50:54.039710  9222 raft_consensus.cc:2804] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Leader election won for term 3
I20260709 14:50:54.047271  9222 raft_consensus.cc:697] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:50:54.047477  7920 raft_consensus.cc:2468] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 3.
I20260709 14:50:54.050189  7925 raft_consensus.cc:2468] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 3.
I20260709 14:50:54.048353  9222 consensus_queue.cc:237] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:54.056980  7819 leader_election.cc:304] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:50:54.060060  9122 raft_consensus.cc:2804] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Leader election won for term 3
I20260709 14:50:54.050597  7775 consensus_queue.cc:260] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:54.060968  9122 raft_consensus.cc:697] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:50:54.062572  7775 raft_consensus.cc:3060] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:50:54.062680  9122 consensus_queue.cc:237] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:54.073865  7775 raft_consensus.cc:2468] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 3.
I20260709 14:50:54.076967  7676 catalog_manager.cc:5697] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 2 to 3, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 3 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:50:54.082281  7675 catalog_manager.cc:5697] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 2 to 3, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 3 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:50:54.313181  7925 raft_consensus.cc:1275] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:50:54.314996  9221 consensus_queue.cc:1048] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 14:50:54.327208  7775 raft_consensus.cc:1275] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:50:54.329480  9122 consensus_queue.cc:1048] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 14:50:54.441952  7851 raft_consensus.cc:1275] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 14:50:54.443449  9187 consensus_queue.cc:1048] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 14:50:54.455145  7925 raft_consensus.cc:1275] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 14:50:54.462831  9222 consensus_queue.cc:1048] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 14:50:54.478405  7925 raft_consensus.cc:1275] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 14:50:54.482532  9122 consensus_queue.cc:1048] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 14:50:54.491823  6549 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 14:50:54.508543  7777 raft_consensus.cc:1275] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 14:50:54.510722  9221 consensus_queue.cc:1048] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 14:50:55.561480  6549 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 14:50:55.604939  7851 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775"
dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
mode: GRACEFUL
new_leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
 from {username='slave'} at 127.0.0.1:41662
I20260709 14:50:55.605628  7851 raft_consensus.cc:606] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 LEADER]: Received request to transfer leadership to TS 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:50:55.610050  7775 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86"
dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
mode: GRACEFUL
new_leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:47068
I20260709 14:50:55.610829  7775 raft_consensus.cc:606] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 LEADER]: Received request to transfer leadership to TS 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:55.614184  7922 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "783e4874513449ef9084b833f188a6d3"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
mode: GRACEFUL
new_leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:48676
I20260709 14:50:55.615020  7922 raft_consensus.cc:606] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 LEADER]: Received request to transfer leadership to TS 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:50:55.619089  7779 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072"
dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
mode: GRACEFUL
new_leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:47068
I20260709 14:50:55.619835  7779 raft_consensus.cc:606] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 LEADER]: Received request to transfer leadership to TS 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:55.622917  7851 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c"
dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
mode: GRACEFUL
new_leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:41662
I20260709 14:50:55.623584  7851 raft_consensus.cc:606] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 LEADER]: Received request to transfer leadership to TS 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:50:55.625062  6549 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 14:50:55.627118  6549 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 14:50:55.763345  9218 raft_consensus.cc:993] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed: : Instructing follower 3876b8ee8d744cb18e91d97aae93b1ac to start an election
I20260709 14:50:55.763958  9222 raft_consensus.cc:1081] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 LEADER]: Signalling peer 3876b8ee8d744cb18e91d97aae93b1ac to start an election
I20260709 14:50:55.765955  7850 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86"
dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:49948
I20260709 14:50:55.766479  7850 raft_consensus.cc:493] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:50:55.766752  7850 raft_consensus.cc:3060] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:50:55.775528  7850 raft_consensus.cc:515] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:55.779523  7850 leader_election.cc:290] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 3 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:55.782282  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:50:55.782470  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:50:55.783071  7922 raft_consensus.cc:3060] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:50:55.783205  7775 raft_consensus.cc:3055] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 LEADER]: Stepping down as leader of term 2
I20260709 14:50:55.783584  7775 raft_consensus.cc:740] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:50:55.784443  7775 consensus_queue.cc:260] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:55.785841  7775 raft_consensus.cc:3060] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:50:55.800625  7775 raft_consensus.cc:2468] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 3.
I20260709 14:50:55.804311  7819 leader_election.cc:304] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:50:55.805506  9122 raft_consensus.cc:2804] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Leader election won for term 3
I20260709 14:50:55.805537  7922 raft_consensus.cc:2468] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 3.
I20260709 14:50:55.812048  9122 raft_consensus.cc:697] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:50:55.813474  9122 consensus_queue.cc:237] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:55.833916  7675 catalog_manager.cc:5697] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 2 to 3, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 3 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:50:55.929056  9222 raft_consensus.cc:993] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed: : Instructing follower 3876b8ee8d744cb18e91d97aae93b1ac to start an election
I20260709 14:50:55.929675  9218 raft_consensus.cc:1081] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 LEADER]: Signalling peer 3876b8ee8d744cb18e91d97aae93b1ac to start an election
I20260709 14:50:55.931802  7850 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072"
dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:49948
I20260709 14:50:55.932539  7850 raft_consensus.cc:493] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:50:55.934365  7850 raft_consensus.cc:3060] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:50:55.942900  7850 raft_consensus.cc:515] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:55.944780  7850 leader_election.cc:290] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 5 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:55.945598  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:50:55.945917  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:50:55.946300  7779 raft_consensus.cc:3055] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 LEADER]: Stepping down as leader of term 4
I20260709 14:50:55.946681  7779 raft_consensus.cc:740] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:50:55.946669  7925 raft_consensus.cc:3060] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:50:55.948479  7779 consensus_queue.cc:260] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:55.950016  7779 raft_consensus.cc:3060] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:50:55.954790  7925 raft_consensus.cc:2468] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 5.
I20260709 14:50:55.958160  7779 raft_consensus.cc:2468] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 5.
I20260709 14:50:55.958230  7819 leader_election.cc:304] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:50:55.959285  9250 raft_consensus.cc:2804] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader election won for term 5
I20260709 14:50:55.959849  9250 raft_consensus.cc:697] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:50:55.960948  9250 consensus_queue.cc:237] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:55.973610  7675 catalog_manager.cc:5697] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 4 to 5, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 5 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:50:56.082978  9122 raft_consensus.cc:993] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac: : Instructing follower 1e9289592458429bbddb19c2e7b7b7b0 to start an election
I20260709 14:50:56.083614  9250 raft_consensus.cc:1081] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 LEADER]: Signalling peer 1e9289592458429bbddb19c2e7b7b7b0 to start an election
I20260709 14:50:56.085477  7925 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
 from {username='slave'} at 127.0.0.1:38516
I20260709 14:50:56.086149  7925 raft_consensus.cc:493] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:50:56.086504  7925 raft_consensus.cc:3060] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:50:56.093542  7925 raft_consensus.cc:515] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:56.096591  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:50:56.096872  7925 leader_election.cc:290] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 5 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:50:56.097397  7779 raft_consensus.cc:3060] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:50:56.099838  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:50:56.100659  7850 raft_consensus.cc:3055] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 LEADER]: Stepping down as leader of term 4
I20260709 14:50:56.101008  7850 raft_consensus.cc:740] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:50:56.102044  7850 consensus_queue.cc:260] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:56.103508  7850 raft_consensus.cc:3060] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:50:56.106480  7779 raft_consensus.cc:2468] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 5.
I20260709 14:50:56.107758  7893 leader_election.cc:304] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:50:56.108517  9242 raft_consensus.cc:2804] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 14:50:56.109005  9242 raft_consensus.cc:697] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:50:56.109882  9242 consensus_queue.cc:237] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:56.111006  7850 raft_consensus.cc:2468] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 5.
I20260709 14:50:56.123631  7675 catalog_manager.cc:5697] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 4 to 5, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 5 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:50:56.132944  9223 raft_consensus.cc:993] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0: : Instructing follower 1de5e20126fa4d8ca0793d19c7b847ed to start an election
I20260709 14:50:56.133769  9242 raft_consensus.cc:1081] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 LEADER]: Signalling peer 1de5e20126fa4d8ca0793d19c7b847ed to start an election
I20260709 14:50:56.136737  7779 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "783e4874513449ef9084b833f188a6d3"
dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:37144
I20260709 14:50:56.138027  7779 raft_consensus.cc:493] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:50:56.139165  7779 raft_consensus.cc:3060] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:56.146410  7779 raft_consensus.cc:515] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:56.150549  7779 leader_election.cc:290] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 2 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:56.151280  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783e4874513449ef9084b833f188a6d3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:50:56.152073  7850 raft_consensus.cc:3060] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:56.153390  9122 raft_consensus.cc:993] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac: : Instructing follower 1de5e20126fa4d8ca0793d19c7b847ed to start an election
I20260709 14:50:56.153932  9122 raft_consensus.cc:1081] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 LEADER]: Signalling peer 1de5e20126fa4d8ca0793d19c7b847ed to start an election
I20260709 14:50:56.155236  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783e4874513449ef9084b833f188a6d3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:50:56.156035  7922 raft_consensus.cc:3055] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 14:50:56.156404  7922 raft_consensus.cc:740] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:50:56.157385  7922 consensus_queue.cc:260] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:56.158599  7922 raft_consensus.cc:3060] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:56.161456  7772 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c"
dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:37136
I20260709 14:50:56.162259  7772 raft_consensus.cc:493] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:50:56.162662  7772 raft_consensus.cc:3060] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:50:56.167436  7850 raft_consensus.cc:2468] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 2.
I20260709 14:50:56.170238  7745 leader_election.cc:304] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:50:56.171486  9258 raft_consensus.cc:2804] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:50:56.172067  9258 raft_consensus.cc:697] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:50:56.173069  9258 consensus_queue.cc:237] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:56.183981  7772 raft_consensus.cc:515] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:56.187209  7772 leader_election.cc:290] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:56.188972  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:50:56.189886  7852 raft_consensus.cc:3055] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 LEADER]: Stepping down as leader of term 3
I20260709 14:50:56.190271  7852 raft_consensus.cc:740] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:50:56.191155  7852 consensus_queue.cc:260] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:56.193691  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:50:56.194411  7925 raft_consensus.cc:3060] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:50:56.195150  7922 raft_consensus.cc:2468] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 2.
I20260709 14:50:56.192564  7852 raft_consensus.cc:3060] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:50:56.202325  7675 catalog_manager.cc:5697] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 1 to 2, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 2 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:50:56.204165  7925 raft_consensus.cc:2468] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 4.
I20260709 14:50:56.211174  7744 leader_election.cc:304] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:50:56.210798  7852 raft_consensus.cc:2468] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 4.
I20260709 14:50:56.212234  9258 raft_consensus.cc:2804] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader election won for term 4
I20260709 14:50:56.214747  9258 raft_consensus.cc:697] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:50:56.215867  9258 consensus_queue.cc:237] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:56.236018  7675 catalog_manager.cc:5697] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 3 to 4, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 4 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:50:56.372361  7771 raft_consensus.cc:1275] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 14:50:56.374107  9250 consensus_queue.cc:1048] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 14:50:56.379297  7925 raft_consensus.cc:1275] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 14:50:56.380990  9250 consensus_queue.cc:1048] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 14:50:56.404848  7920 raft_consensus.cc:1275] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 14:50:56.412741  9247 consensus_queue.cc:1048] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 14:50:56.413527  7772 raft_consensus.cc:1275] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 14:50:56.419229  9247 consensus_queue.cc:1048] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 14:50:56.613555  7920 raft_consensus.cc:1275] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:50:56.615108  9258 consensus_queue.cc:1048] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 14:50:56.628185  6549 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 14:50:56.630832  7772 raft_consensus.cc:1275] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 14:50:56.635669  9223 consensus_queue.cc:1048] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 14:50:56.639212  7846 raft_consensus.cc:1275] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:50:56.643247  9218 consensus_queue.cc:1048] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 14:50:56.698599  7851 raft_consensus.cc:1275] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 14:50:56.717141  9272 consensus_queue.cc:1048] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 14:50:56.734316  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 49424.3us
I20260709 14:50:56.737671  7851 raft_consensus.cc:1275] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 14:50:56.739519  9277 consensus_queue.cc:1048] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 14:50:56.751880  7925 raft_consensus.cc:1275] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 14:50:56.756592  9272 consensus_queue.cc:1048] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 14:50:57.716789  6549 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 14:50:57.767565  7852 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b"
dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
mode: GRACEFUL
new_leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:41662
I20260709 14:50:57.768359  7852 raft_consensus.cc:606] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 LEADER]: Received request to transfer leadership to TS 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:50:57.772083  7771 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04"
dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
mode: GRACEFUL
new_leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:47068
I20260709 14:50:57.772846  7771 raft_consensus.cc:606] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 LEADER]: Received request to transfer leadership to TS 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:57.777544  7771 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f"
dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
mode: GRACEFUL
new_leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:47068
I20260709 14:50:57.778513  7771 raft_consensus.cc:606] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Received request to transfer leadership to TS 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:57.781949  7852 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "939996e77ee64e9fab21aef50758b706"
dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
mode: GRACEFUL
new_leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
 from {username='slave'} at 127.0.0.1:41662
I20260709 14:50:57.782632  7852 raft_consensus.cc:606] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 LEADER]: Received request to transfer leadership to TS 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:50:57.785475  7920 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
mode: GRACEFUL
new_leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:48676
I20260709 14:50:57.785992  7920 raft_consensus.cc:606] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 LEADER]: Received request to transfer leadership to TS 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:50:57.787416  6549 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 14:50:57.789364  6549 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 14:50:57.959592  9271 raft_consensus.cc:993] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed: : Instructing follower 3876b8ee8d744cb18e91d97aae93b1ac to start an election
I20260709 14:50:57.960553  9271 raft_consensus.cc:1081] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Signalling peer 3876b8ee8d744cb18e91d97aae93b1ac to start an election
I20260709 14:50:57.962792  7846 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f"
dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:49948
I20260709 14:50:57.963510  7846 raft_consensus.cc:493] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:50:57.963909  7846 raft_consensus.cc:3060] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:57.972952  7846 raft_consensus.cc:515] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:57.975389  7846 leader_election.cc:290] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 2 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:57.976213  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:50:57.977039  7772 raft_consensus.cc:3055] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Stepping down as leader of term 1
I20260709 14:50:57.977485  7772 raft_consensus.cc:740] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:50:57.979620  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:50:57.981387  7920 raft_consensus.cc:3060] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:57.978382  7772 consensus_queue.cc:260] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:57.983196  7772 raft_consensus.cc:3060] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:50:57.992887  7920 raft_consensus.cc:2468] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 2.
I20260709 14:50:57.997195  7772 raft_consensus.cc:2468] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 2.
I20260709 14:50:58.000094  7819 leader_election.cc:304] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:50:58.001176  9247 raft_consensus.cc:2804] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:50:58.005821  9247 raft_consensus.cc:697] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:50:58.006939  9247 consensus_queue.cc:237] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:58.018186  9122 raft_consensus.cc:993] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac: : Instructing follower 1de5e20126fa4d8ca0793d19c7b847ed to start an election
I20260709 14:50:58.018893  9281 raft_consensus.cc:1081] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 LEADER]: Signalling peer 1de5e20126fa4d8ca0793d19c7b847ed to start an election
I20260709 14:50:58.021399  7771 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b"
dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:37136
I20260709 14:50:58.021936  7771 raft_consensus.cc:493] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:50:58.022235  7771 raft_consensus.cc:3060] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:50:58.028734  7771 raft_consensus.cc:515] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:58.030481  7676 catalog_manager.cc:5697] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 1 to 2, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 2 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:50:58.032078  7771 leader_election.cc:290] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:58.032814  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:50:58.033469  7846 raft_consensus.cc:3055] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 LEADER]: Stepping down as leader of term 4
I20260709 14:50:58.033571  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:50:58.033856  7846 raft_consensus.cc:740] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:50:58.034196  7925 raft_consensus.cc:3060] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:50:58.034725  7846 consensus_queue.cc:260] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:58.036207  7846 raft_consensus.cc:3060] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:50:58.041846  7925 raft_consensus.cc:2468] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 5.
I20260709 14:50:58.043670  7744 leader_election.cc:304] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:50:58.044617  9271 raft_consensus.cc:2804] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader election won for term 5
I20260709 14:50:58.045152  9271 raft_consensus.cc:697] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:50:58.046139  9271 consensus_queue.cc:237] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:58.048322  7846 raft_consensus.cc:2468] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 5.
I20260709 14:50:58.057147  9218 raft_consensus.cc:993] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed: : Instructing follower 3876b8ee8d744cb18e91d97aae93b1ac to start an election
I20260709 14:50:58.057685  9218 raft_consensus.cc:1081] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 LEADER]: Signalling peer 3876b8ee8d744cb18e91d97aae93b1ac to start an election
I20260709 14:50:58.059734  7846 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04"
dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:49948
I20260709 14:50:58.060323  7846 raft_consensus.cc:493] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:50:58.060751  7846 raft_consensus.cc:3060] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:50:58.063664  7676 catalog_manager.cc:5697] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 4 to 5, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 5 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:50:58.072225  7846 raft_consensus.cc:515] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:58.082864  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:50:58.083864  7772 raft_consensus.cc:3055] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 LEADER]: Stepping down as leader of term 3
I20260709 14:50:58.075567  7846 leader_election.cc:290] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 4 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:58.085294  7772 raft_consensus.cc:740] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:50:58.086457  7772 consensus_queue.cc:260] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:58.087975  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:50:58.089145  7925 raft_consensus.cc:3060] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:50:58.087915  7772 raft_consensus.cc:3060] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:50:58.100442  7772 raft_consensus.cc:2468] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 4.
I20260709 14:50:58.105176  7819 leader_election.cc:304] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:50:58.106585  9122 raft_consensus.cc:2804] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Leader election won for term 4
I20260709 14:50:58.107180  9122 raft_consensus.cc:697] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:50:58.108777  9122 consensus_queue.cc:237] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:58.115367  7925 raft_consensus.cc:2468] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 4.
I20260709 14:50:58.124857  7676 catalog_manager.cc:5697] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 3 to 4, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 4 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:50:58.273216  9122 raft_consensus.cc:993] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac: : Instructing follower 1e9289592458429bbddb19c2e7b7b7b0 to start an election
I20260709 14:50:58.273793  9122 raft_consensus.cc:1081] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 LEADER]: Signalling peer 1e9289592458429bbddb19c2e7b7b7b0 to start an election
I20260709 14:50:58.276969  7925 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "939996e77ee64e9fab21aef50758b706"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
 from {username='slave'} at 127.0.0.1:38516
I20260709 14:50:58.277733  7925 raft_consensus.cc:493] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:50:58.278082  7925 raft_consensus.cc:3060] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:50:58.284574  7925 raft_consensus.cc:515] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:58.286705  7925 leader_election.cc:290] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:50:58.287804  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: true dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:50:58.288551  7772 raft_consensus.cc:3060] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:50:58.288851  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: true dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:50:58.290319  7852 raft_consensus.cc:3055] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 LEADER]: Stepping down as leader of term 5
I20260709 14:50:58.292546  7852 raft_consensus.cc:740] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:50:58.293572  7852 consensus_queue.cc:260] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:58.294713  7852 raft_consensus.cc:3060] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:50:58.296537  7772 raft_consensus.cc:2468] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 6.
I20260709 14:50:58.298039  7893 leader_election.cc:304] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:50:58.298844  9242 raft_consensus.cc:2804] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 14:50:58.299412  9242 raft_consensus.cc:697] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:50:58.300563  9242 consensus_queue.cc:237] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:58.304831  7852 raft_consensus.cc:2468] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 6.
I20260709 14:50:58.316253  7676 catalog_manager.cc:5697] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 5 to 6, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 6 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:50:58.394673  9242 raft_consensus.cc:993] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0: : Instructing follower 1de5e20126fa4d8ca0793d19c7b847ed to start an election
I20260709 14:50:58.395318  9276 raft_consensus.cc:1081] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 LEADER]: Signalling peer 1de5e20126fa4d8ca0793d19c7b847ed to start an election
I20260709 14:50:58.396968  7772 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9"
dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:37144
I20260709 14:50:58.397493  7772 raft_consensus.cc:493] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:50:58.397769  7772 raft_consensus.cc:3060] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:50:58.402727  7772 raft_consensus.cc:515] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:58.404553  7772 leader_election.cc:290] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:50:58.405500  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:50:58.405936  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:50:58.406230  7852 raft_consensus.cc:3060] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:50:58.406601  7925 raft_consensus.cc:3055] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 14:50:58.406905  7925 raft_consensus.cc:740] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:50:58.407732  7925 consensus_queue.cc:260] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:58.408972  7925 raft_consensus.cc:3060] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:50:58.414620  7852 raft_consensus.cc:2468] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 3.
I20260709 14:50:58.416103  7745 leader_election.cc:304] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:50:58.416291  7925 raft_consensus.cc:2468] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 3.
I20260709 14:50:58.417145  9218 raft_consensus.cc:2804] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Leader election won for term 3
I20260709 14:50:58.417652  9218 raft_consensus.cc:697] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:50:58.418527  9218 consensus_queue.cc:237] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:50:58.430498  7676 catalog_manager.cc:5697] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 2 to 3, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 3 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:50:58.456099  7852 raft_consensus.cc:1275] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 14:50:58.457571  9271 consensus_queue.cc:1048] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 14:50:58.479779  7922 raft_consensus.cc:1275] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 14:50:58.487008  9271 consensus_queue.cc:1048] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 14:50:58.505861  7925 raft_consensus.cc:1275] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:50:58.510249  9281 consensus_queue.cc:1048] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 14:50:58.523344  7922 raft_consensus.cc:1275] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 14:50:58.525585  9122 consensus_queue.cc:1048] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 14:50:58.536630  7775 raft_consensus.cc:1275] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 14:50:58.537171  7772 raft_consensus.cc:1275] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:50:58.539950  9122 consensus_queue.cc:1048] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 14:50:58.541543  9122 consensus_queue.cc:1048] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 14:50:58.772354  7852 raft_consensus.cc:1275] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 14:50:58.774068  9303 consensus_queue.cc:1048] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 14:50:58.788240  7775 raft_consensus.cc:1275] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 14:50:58.793156  6549 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 14:50:58.793728  9303 consensus_queue.cc:1048] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 14:50:58.894225  7846 raft_consensus.cc:1275] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 14:50:58.896202  9218 consensus_queue.cc:1048] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 14:50:58.915225  7925 raft_consensus.cc:1275] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 14:50:58.918231  9307 consensus_queue.cc:1048] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 14:50:59.855724  6549 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 14:50:59.902871  7772 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16"
dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
mode: GRACEFUL
new_leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:47068
I20260709 14:50:59.903474  7772 raft_consensus.cc:606] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 LEADER]: Received request to transfer leadership to TS 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:59.907001  7846 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375"
dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
mode: GRACEFUL
new_leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:41662
I20260709 14:50:59.907601  7846 raft_consensus.cc:606] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 LEADER]: Received request to transfer leadership to TS 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:50:59.911314  7852 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92"
dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
mode: GRACEFUL
new_leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
 from {username='slave'} at 127.0.0.1:41662
I20260709 14:50:59.912127  7852 raft_consensus.cc:606] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 LEADER]: Received request to transfer leadership to TS 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:50:59.915817  7925 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
mode: GRACEFUL
new_leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:48676
I20260709 14:50:59.916474  7925 raft_consensus.cc:606] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 LEADER]: Received request to transfer leadership to TS 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:50:59.920221  7772 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c"
dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
mode: GRACEFUL
new_leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:47068
I20260709 14:50:59.921593  7772 raft_consensus.cc:606] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 LEADER]: Received request to transfer leadership to TS 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:50:59.923065  6549 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 14:50:59.924551  6549 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 14:51:00.012033  9298 raft_consensus.cc:993] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac: : Instructing follower 1e9289592458429bbddb19c2e7b7b7b0 to start an election
I20260709 14:51:00.013782  9298 raft_consensus.cc:1081] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 LEADER]: Signalling peer 1e9289592458429bbddb19c2e7b7b7b0 to start an election
I20260709 14:51:00.015699  7922 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
 from {username='slave'} at 127.0.0.1:38516
I20260709 14:51:00.016515  7922 raft_consensus.cc:493] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:51:00.016916  7922 raft_consensus.cc:3060] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:51:00.025524  7922 raft_consensus.cc:515] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:00.027823  7922 leader_election.cc:290] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 3 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:00.029763  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:00.030529  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:00.031266  7851 raft_consensus.cc:3055] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 LEADER]: Stepping down as leader of term 2
I20260709 14:51:00.031584  7851 raft_consensus.cc:740] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:51:00.030613  7772 raft_consensus.cc:3060] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:51:00.032660  7851 consensus_queue.cc:260] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:00.034406  7851 raft_consensus.cc:3060] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:51:00.042529  7772 raft_consensus.cc:2468] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 3.
I20260709 14:51:00.044833  7893 leader_election.cc:304] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:51:00.045835  9312 raft_consensus.cc:2804] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 14:51:00.046309  9312 raft_consensus.cc:697] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:00.047317  7851 raft_consensus.cc:2468] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 3.
I20260709 14:51:00.047420  9312 consensus_queue.cc:237] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:00.061328  7674 catalog_manager.cc:5697] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 2 to 3, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 3 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:51:00.072121  9313 raft_consensus.cc:993] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac: : Instructing follower 1de5e20126fa4d8ca0793d19c7b847ed to start an election
I20260709 14:51:00.073391  9298 raft_consensus.cc:1081] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 LEADER]: Signalling peer 1de5e20126fa4d8ca0793d19c7b847ed to start an election
I20260709 14:51:00.075591  7775 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375"
dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:37136
I20260709 14:51:00.076287  7775 raft_consensus.cc:493] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:51:00.076713  7775 raft_consensus.cc:3060] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:51:00.084153  7775 raft_consensus.cc:515] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:00.086499  7775 leader_election.cc:290] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:00.087518  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:00.088356  7925 raft_consensus.cc:3060] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:51:00.088223  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:00.089728  7851 raft_consensus.cc:3055] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 LEADER]: Stepping down as leader of term 3
I20260709 14:51:00.090056  7851 raft_consensus.cc:740] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:51:00.091109  7851 consensus_queue.cc:260] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:00.092114  7851 raft_consensus.cc:3060] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:51:00.096661  7925 raft_consensus.cc:2468] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 4.
I20260709 14:51:00.098865  7851 raft_consensus.cc:2468] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 4.
I20260709 14:51:00.099004  7744 leader_election.cc:304] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:51:00.100566  9307 raft_consensus.cc:2804] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader election won for term 4
I20260709 14:51:00.102249  9307 raft_consensus.cc:697] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:51:00.103459  9307 consensus_queue.cc:237] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:00.107137  9276 raft_consensus.cc:993] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0: : Instructing follower 1de5e20126fa4d8ca0793d19c7b847ed to start an election
I20260709 14:51:00.107743  9276 raft_consensus.cc:1081] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 LEADER]: Signalling peer 1de5e20126fa4d8ca0793d19c7b847ed to start an election
I20260709 14:51:00.114249  7775 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674"
dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:37144
I20260709 14:51:00.114904  7775 raft_consensus.cc:493] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:51:00.115255  7775 raft_consensus.cc:3060] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:51:00.122284  7674 catalog_manager.cc:5697] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 3 to 4, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 4 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:51:00.126358  7775 raft_consensus.cc:515] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:00.133998  7775 leader_election.cc:290] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:00.138428  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:00.139092  7922 raft_consensus.cc:3055] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 14:51:00.139372  7922 raft_consensus.cc:740] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:00.140197  7922 consensus_queue.cc:260] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:00.141005  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:00.141547  7922 raft_consensus.cc:3060] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:51:00.141700  7851 raft_consensus.cc:3060] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:51:00.184065  7922 raft_consensus.cc:2468] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 3.
I20260709 14:51:01.322075  9323 raft_consensus.cc:493] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:51:01.322908  9323 raft_consensus.cc:515] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:01.325896  9323 leader_election.cc:290] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:01.326588  9323 raft_consensus.cc:493] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:01.327113  9323 raft_consensus.cc:515] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:01.334622  9323 leader_election.cc:290] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:01.404054  9324 raft_consensus.cc:493] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:01.404886  9324 raft_consensus.cc:515] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:01.408612  9324 leader_election.cc:290] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:01.598660  9324 raft_consensus.cc:493] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:01.599455  9324 raft_consensus.cc:515] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:01.494381  9323 raft_consensus.cc:493] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
W20260709 14:51:01.527915  7708 debug-util.cc:398] Leaking SignalData structure 0x7b08001c3ba0 after lost signal to thread 6552
I20260709 14:51:01.601627  9323 raft_consensus.cc:515] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:01.603843  9323 leader_election.cc:290] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:01.604427  9323 raft_consensus.cc:493] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:51:01.605041  9323 raft_consensus.cc:515] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:01.653002  9325 raft_consensus.cc:493] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:01.758562  9324 leader_election.cc:290] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:01.777880  9325 raft_consensus.cc:515] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:01.778152  9324 raft_consensus.cc:493] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:51:01.779188  9323 leader_election.cc:290] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:01.779078  9324 raft_consensus.cc:515] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:01.779872  9323 raft_consensus.cc:493] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:01.780325  9325 leader_election.cc:290] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:01.780563  9323 raft_consensus.cc:515] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:01.781433  9324 leader_election.cc:290] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:01.782708  9323 leader_election.cc:290] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:01.795302  7676 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54350 (request call id 339) took 1603 ms. Trace:
I20260709 14:51:01.795950  7676 rpcz_store.cc:276] 0709 14:51:00.191574 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:00.191760 (+   186us) service_pool.cc:224] Handling call
0709 14:51:01.795174 (+1603414us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":0}
I20260709 14:51:01.800876  7778 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 1666) took 1535 ms. Trace:
I20260709 14:51:01.801388  7778 rpcz_store.cc:276] 0709 14:51:00.265913 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:00.266134 (+   221us) service_pool.cc:224] Handling call
0709 14:51:01.798524 (+1532390us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:51:01.800295 (+  1771us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:51:01.800328 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:51:01.800368 (+    40us) raft_consensus.cc:1645] Marking committed up to 2
0709 14:51:01.800393 (+    25us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:01.800450 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:51:01.800651 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6912}
W20260709 14:51:01.819571  7851 consensus_meta.cc:287] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent flushing consensus metadata: real 1.572s	user 0.023s	sys 0.014s
I20260709 14:51:01.822425  9326 raft_consensus.cc:493] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:51:01.823206  9326 raft_consensus.cc:515] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:01.826880  9326 leader_election.cc:290] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:01.829003  9327 raft_consensus.cc:493] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:51:01.829705  9326 raft_consensus.cc:493] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:51:01.829793  9327 raft_consensus.cc:515] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:01.832603  9326 raft_consensus.cc:515] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:01.835281  9326 leader_election.cc:290] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:01.835713  9276 raft_consensus.cc:493] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:51:01.835881  9326 raft_consensus.cc:493] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:51:01.836330  9326 raft_consensus.cc:515] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:01.836283  9276 raft_consensus.cc:515] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:01.838496  9276 leader_election.cc:290] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:01.838934  9326 leader_election.cc:290] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:01.839084  9276 raft_consensus.cc:493] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:51:01.839450  9326 raft_consensus.cc:493] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:51:01.839742  9276 raft_consensus.cc:515] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:01.832562  9327 leader_election.cc:290] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:01.842118  9276 leader_election.cc:290] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:01.842633  9276 raft_consensus.cc:493] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:51:01.843077  9327 raft_consensus.cc:493] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:51:01.843207  9242 raft_consensus.cc:493] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:51:01.843875  9242 raft_consensus.cc:515] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:01.843101  9276 raft_consensus.cc:515] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:01.846174  9242 leader_election.cc:290] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:01.846531  9325 raft_consensus.cc:493] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:01.846745  9242 raft_consensus.cc:493] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:51:01.843792  9327 raft_consensus.cc:515] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:01.848181  9323 raft_consensus.cc:493] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:51:01.848801  9323 raft_consensus.cc:515] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:01.851675  7772 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37136 (request call id 1638) took 1612 ms. Trace:
I20260709 14:51:01.852162  7772 rpcz_store.cc:276] 0709 14:51:00.239239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:00.239534 (+   295us) service_pool.cc:224] Handling call
0709 14:51:01.851099 (+1611565us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:51:01.851313 (+   214us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:51:01.851338 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:51:01.851393 (+    55us) raft_consensus.cc:1645] Marking committed up to 3
0709 14:51:01.851422 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:01.851478 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:51:01.851603 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4480}
I20260709 14:51:01.851658  9323 leader_election.cc:290] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:01.854157  9327 leader_election.cc:290] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:01.854773  9327 raft_consensus.cc:493] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:51:01.854911  9323 raft_consensus.cc:493] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:51:01.862149  9323 raft_consensus.cc:515] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:01.847450  9242 raft_consensus.cc:515] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:01.864622  9242 leader_election.cc:290] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:01.865412  9242 raft_consensus.cc:493] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:51:01.865906  9242 raft_consensus.cc:515] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:01.867933  9242 leader_election.cc:290] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:01.869828  9329 raft_consensus.cc:493] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:51:01.855401  9327 raft_consensus.cc:515] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:01.846872  9276 leader_election.cc:290] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:01.847447  9330 raft_consensus.cc:493] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:51:01.855512  9324 raft_consensus.cc:493] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:01.839923  9326 raft_consensus.cc:515] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:01.847345  9325 raft_consensus.cc:515] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:01.870311  9323 leader_election.cc:290] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:01.878396  9323 raft_consensus.cc:493] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:51:01.870635  9329 raft_consensus.cc:515] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:51:01.873159  9330 raft_consensus.cc:515] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:01.875393  9326 leader_election.cc:290] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:01.877426  9325 leader_election.cc:290] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:01.883898  9325 raft_consensus.cc:493] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:01.884742  9330 leader_election.cc:290] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:01.884590  9325 raft_consensus.cc:515] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:01.885531  9331 raft_consensus.cc:493] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:51:01.885865  9335 raft_consensus.cc:493] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:01.873391  9324 raft_consensus.cc:515] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:01.880992  9333 raft_consensus.cc:493] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:51:01.888049  9335 raft_consensus.cc:515] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:01.888782  9333 raft_consensus.cc:515] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:01.887147  9334 raft_consensus.cc:493] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:51:01.890121  9324 leader_election.cc:290] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:01.890064  9334 raft_consensus.cc:515] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:01.887929  9331 raft_consensus.cc:515] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:01.893402  9336 raft_consensus.cc:493] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:51:01.890121  7770 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37136 (request call id 1640) took 1649 ms. Trace:
I20260709 14:51:01.895321  7770 rpcz_store.cc:276] 0709 14:51:00.240272 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:00.240515 (+   243us) service_pool.cc:224] Handling call
0709 14:51:01.889396 (+1648881us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:51:01.889593 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:51:01.889621 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:51:01.889665 (+    44us) raft_consensus.cc:1645] Marking committed up to 2
0709 14:51:01.889695 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:01.889751 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:51:01.889899 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4480}
I20260709 14:51:01.887558  9325 leader_election.cc:290] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:01.872687  9327 leader_election.cc:290] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:01.896471  9324 raft_consensus.cc:493] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:51:01.897083  9325 raft_consensus.cc:493] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:01.897465  9324 raft_consensus.cc:515] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:01.900064  9337 raft_consensus.cc:493] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:01.897902  9325 raft_consensus.cc:515] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:01.900782  9337 raft_consensus.cc:515] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:01.878962  9323 raft_consensus.cc:515] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:01.906886  9335 leader_election.cc:290] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:01.907397  9334 leader_election.cc:290] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:01.908139  9329 leader_election.cc:290] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:01.912019  9329 raft_consensus.cc:493] T 9441e831627143a991a1556dcdce71e3 P 9418391fa82a42c79c6cad13ba91d964 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:51:01.908775  9324 leader_election.cc:290] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:01.912398  9331 leader_election.cc:290] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:01.912860  9337 leader_election.cc:290] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:01.912705  9329 raft_consensus.cc:515] T 9441e831627143a991a1556dcdce71e3 P 9418391fa82a42c79c6cad13ba91d964 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:51:01.911279  9335 raft_consensus.cc:493] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:01.914812  9335 raft_consensus.cc:515] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:01.915899  9331 raft_consensus.cc:493] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:01.916421  9337 raft_consensus.cc:493] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
W20260709 14:51:01.918457  7708 debug-util.cc:398] Leaking SignalData structure 0x7b0800034380 after lost signal to thread 7711
I20260709 14:51:01.918763  9337 raft_consensus.cc:515] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:01.913700  9324 raft_consensus.cc:493] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:01.914037  9334 raft_consensus.cc:493] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:51:01.919780  9324 raft_consensus.cc:515] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:01.919970  9334 raft_consensus.cc:515] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:01.922405  9329 leader_election.cc:290] T 9441e831627143a991a1556dcdce71e3 P 9418391fa82a42c79c6cad13ba91d964 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:01.917761  9335 leader_election.cc:290] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:01.922178  9337 leader_election.cc:290] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:01.916738  9331 raft_consensus.cc:515] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:01.899655  9336 raft_consensus.cc:515] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:01.923970  9334 leader_election.cc:290] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:01.922151  9324 leader_election.cc:290] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:01.925442  9331 leader_election.cc:290] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:01.925565  9336 leader_election.cc:290] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:01.927953  9336 raft_consensus.cc:493] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:01.928478  9336 raft_consensus.cc:515] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:01.928843  7851 raft_consensus.cc:2468] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 3.
W20260709 14:51:01.929711  7851 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 2306) took 1795 ms (client timeout 1946 ms). Trace:
W20260709 14:51:01.930091  7851 rpcz_store.cc:269] 0709 14:51:00.134347 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:00.140728 (+  6381us) service_pool.cc:224] Handling call
0709 14:51:01.928775 (+1788047us) spinlock_profiling.cc:243] Waited 105 ms on lock 0x7b2c00149c68. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68913e291 00007fb6891590ca 00007fb68ae874ad 00007fb68ae93573 00007fb68ae922af 00007fb68fe53b17 00007fb6893ce6d4 00007fb6893ce662 00007fb6893ce591 00007fb6893ce50c 00007fb6893cd7c2
0709 14:51:01.929627 (+   852us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":241781632}
I20260709 14:51:01.930866  9336 leader_election.cc:290] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:01.933208  9330 raft_consensus.cc:493] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:51:01.933846  9330 raft_consensus.cc:515] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:01.935814  9330 leader_election.cc:290] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:01.936359  9276 raft_consensus.cc:493] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:51:01.937049  9276 raft_consensus.cc:515] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:01.938547  9332 raft_consensus.cc:493] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:51:01.939311  9276 leader_election.cc:290] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:01.939150  9332 raft_consensus.cc:515] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:01.941970  9332 leader_election.cc:290] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:01.944180  9326 raft_consensus.cc:493] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:51:01.944770  9326 raft_consensus.cc:515] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:01.946592  9326 leader_election.cc:290] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:01.947775  9332 raft_consensus.cc:493] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:51:01.948292  9332 raft_consensus.cc:515] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:01.948876  9340 raft_consensus.cc:493] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:51:01.948982  9328 raft_consensus.cc:493] T 9ce9c0ef2db24c13a8b1402f21819458 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9418391fa82a42c79c6cad13ba91d964)
I20260709 14:51:01.949445  9340 raft_consensus.cc:515] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:01.949857  9328 raft_consensus.cc:515] T 9ce9c0ef2db24c13a8b1402f21819458 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:51:01.950402  9332 leader_election.cc:290] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:01.950976  9332 raft_consensus.cc:493] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:51:01.951790  9340 leader_election.cc:290] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:01.952507  9326 raft_consensus.cc:493] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:51:01.953284  9242 raft_consensus.cc:493] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9418391fa82a42c79c6cad13ba91d964)
I20260709 14:51:01.962303  9326 raft_consensus.cc:515] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:01.962574  9242 raft_consensus.cc:515] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:51:01.964597  9326 leader_election.cc:290] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:01.965806  9242 leader_election.cc:290] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68:42321)
W20260709 14:51:02.086357  7745 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 1.946s (SENT) [suppressed 6 similar messages]
I20260709 14:51:01.954162  9322 raft_consensus.cc:493] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:51:02.124421  9322 raft_consensus.cc:515] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:02.127924  9322 leader_election.cc:290] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:01.953442  9327 raft_consensus.cc:493] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:51:02.235390  9327 raft_consensus.cc:515] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:01.953109  9328 leader_election.cc:290] T 9ce9c0ef2db24c13a8b1402f21819458 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68:42321)
I20260709 14:51:01.951488  9332 raft_consensus.cc:515] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:01.961345  7776 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 1663) took 1720 ms. Trace:
I20260709 14:51:02.237949  7776 rpcz_store.cc:276] 0709 14:51:00.241111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:00.264224 (+ 23113us) service_pool.cc:224] Handling call
0709 14:51:01.960578 (+1696354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:51:01.960807 (+   229us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:51:01.960838 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:51:01.960883 (+    45us) raft_consensus.cc:1645] Marking committed up to 4
0709 14:51:01.960922 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:01.960983 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:51:01.961135 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4352}
I20260709 14:51:02.140605  9336 raft_consensus.cc:493] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:02.239943  9332 leader_election.cc:290] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:02.242465  9327 leader_election.cc:290] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:02.240659  9336 raft_consensus.cc:515] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:02.280440  9336 leader_election.cc:290] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:02.221472  9326 raft_consensus.cc:493] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:51:01.955502  9341 raft_consensus.cc:493] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:51:02.442389  7925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38516 (request call id 1608) took 2212 ms. Trace:
I20260709 14:51:02.444020  9326 raft_consensus.cc:515] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:02.444248  9341 raft_consensus.cc:515] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:02.444186  7925 rpcz_store.cc:276] 0709 14:51:00.230079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:00.230249 (+   170us) service_pool.cc:224] Handling call
0709 14:51:02.441784 (+2211535us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:51:02.441991 (+   207us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:51:02.442029 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:51:02.442077 (+    48us) raft_consensus.cc:1645] Marking committed up to 2
0709 14:51:02.442105 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:02.442155 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:51:02.442289 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 14:51:02.446539  9326 leader_election.cc:290] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:02.447398  9341 leader_election.cc:290] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:02.455541  9341 raft_consensus.cc:493] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:02.456378  9341 raft_consensus.cc:515] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:02.459681  9341 leader_election.cc:290] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:02.462493  7744 leader_election.cc:304] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:51:02.463996  9343 raft_consensus.cc:2804] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Leader election won for term 3
I20260709 14:51:02.465101  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18d29d52d304c87b930d4fb5eaf50b1" candidate_uuid: "9418391fa82a42c79c6cad13ba91d964" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:02.465373  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9441e831627143a991a1556dcdce71e3" candidate_uuid: "9418391fa82a42c79c6cad13ba91d964" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:02.466522  9343 raft_consensus.cc:697] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:51:02.469012  9343 consensus_queue.cc:237] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:02.482972  8639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1f7722fdea49e0b5e9c5d96633eaf9" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9418391fa82a42c79c6cad13ba91d964" is_pre_election: true
I20260709 14:51:02.485422  9307 raft_consensus.cc:493] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:02.486204  9307 raft_consensus.cc:515] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:02.488739  9307 leader_election.cc:290] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:02.489006  9313 raft_consensus.cc:493] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:02.489835  9313 raft_consensus.cc:515] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:02.492295  9313 leader_election.cc:290] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:02.492846  9313 raft_consensus.cc:493] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:51:02.497504  7771 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37136 (request call id 1637) took 2310 ms. Trace:
I20260709 14:51:02.499446  9328 raft_consensus.cc:493] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:02.500329  9328 raft_consensus.cc:515] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:02.504498  9242 raft_consensus.cc:493] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:51:02.508185  9242 raft_consensus.cc:515] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:02.511134  6549 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 14:51:02.483181  7774 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 1664) took 2218 ms. Trace:
I20260709 14:51:02.498024  7771 rpcz_store.cc:276] 0709 14:51:00.186752 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:00.192752 (+  6000us) service_pool.cc:224] Handling call
0709 14:51:02.496896 (+2304144us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:51:02.497107 (+   211us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:51:02.497129 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:51:02.497178 (+    49us) raft_consensus.cc:1645] Marking committed up to 4
0709 14:51:02.497209 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:02.497286 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:51:02.497425 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5376}
I20260709 14:51:02.528880  9340 raft_consensus.cc:493] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:51:02.536734  9340 raft_consensus.cc:515] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:02.540082  9340 leader_election.cc:290] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:02.540458  9325 leader_election.cc:290] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:02.510289  9328 leader_election.cc:290] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:02.511400  9341 raft_consensus.cc:493] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:51:02.543681  9341 raft_consensus.cc:515] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:02.545925  9341 leader_election.cc:290] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:02.546319  9323 leader_election.cc:290] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:02.488618  9298 raft_consensus.cc:493] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:51:02.547636  9298 raft_consensus.cc:515] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:02.548998  7777 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37136 (request call id 1639) took 2309 ms. Trace:
I20260709 14:51:02.549836  9298 leader_election.cc:290] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:02.549554  7777 rpcz_store.cc:276] 0709 14:51:00.239745 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:00.240497 (+   752us) service_pool.cc:224] Handling call
0709 14:51:02.548419 (+2307922us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:51:02.548642 (+   223us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:51:02.548668 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:51:02.548718 (+    50us) raft_consensus.cc:1645] Marking committed up to 3
0709 14:51:02.548750 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:02.548807 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:51:02.548923 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":39168}
I20260709 14:51:02.536360  7775 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 1661) took 2392 ms. Trace:
I20260709 14:51:02.553184  9242 leader_election.cc:290] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:02.552052  7775 rpcz_store.cc:276] 0709 14:51:00.143466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:00.184642 (+ 41176us) service_pool.cc:224] Handling call
0709 14:51:02.535823 (+2351181us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:51:02.535999 (+   176us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:51:02.536025 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:51:02.536066 (+    41us) raft_consensus.cc:1645] Marking committed up to 3
0709 14:51:02.536110 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:02.536170 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:51:02.536290 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 14:51:02.555896  9322 raft_consensus.cc:493] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:51:02.556478  9322 raft_consensus.cc:515] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:02.558465  9242 raft_consensus.cc:493] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:51:02.559155  9242 raft_consensus.cc:515] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:02.561452  9325 raft_consensus.cc:493] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:51:02.562175  9325 raft_consensus.cc:515] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:02.563004  9348 raft_consensus.cc:493] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:02.563704  9242 leader_election.cc:290] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:02.563582  9348 raft_consensus.cc:515] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:02.564704  9325 leader_election.cc:290] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:02.566004  9348 leader_election.cc:290] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:02.560990  9272 raft_consensus.cc:493] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:51:02.566180  9322 leader_election.cc:290] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:02.566672  9272 raft_consensus.cc:515] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:02.567063  9341 raft_consensus.cc:493] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:51:02.567778  9341 raft_consensus.cc:515] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:02.568678  9272 leader_election.cc:290] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:02.570806  9349 raft_consensus.cc:493] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:51:02.571408  9242 raft_consensus.cc:493] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:51:02.572834  9242 raft_consensus.cc:515] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:02.580193  9346 raft_consensus.cc:493] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:51:02.583087  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:02.574015  9341 leader_election.cc:290] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:02.572304  9349 raft_consensus.cc:515] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:02.581278  9352 raft_consensus.cc:493] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:51:02.581609  9242 leader_election.cc:290] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:02.576835  9348 raft_consensus.cc:493] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:02.530896  9313 raft_consensus.cc:515] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:02.585304  9350 raft_consensus.cc:493] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:02.550330  9310 raft_consensus.cc:493] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:02.591536  7777 raft_consensus.cc:1275] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 14:51:02.600205  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:02.601173  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:02.601998  7771 raft_consensus.cc:2468] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 2.
I20260709 14:51:02.602708  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783e4874513449ef9084b833f188a6d3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:02.582022  9347 raft_consensus.cc:493] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:51:02.583237  9346 raft_consensus.cc:515] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:02.608204  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:02.601980  9333 leader_election.cc:290] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:02.530728  7774 rpcz_store.cc:276] 0709 14:51:00.264562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:00.265193 (+   631us) service_pool.cc:224] Handling call
0709 14:51:02.482303 (+2217110us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:51:02.482591 (+   288us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:51:02.482621 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:51:02.482683 (+    62us) raft_consensus.cc:1645] Marking committed up to 1
0709 14:51:02.482715 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:02.482784 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:51:02.482950 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7424}
I20260709 14:51:02.613780  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:02.612164  8637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce9c0ef2db24c13a8b1402f21819458" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9418391fa82a42c79c6cad13ba91d964" is_pre_election: true
I20260709 14:51:02.614887  7772 raft_consensus.cc:2468] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 2.
I20260709 14:51:02.599669  9310 raft_consensus.cc:515] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:02.616451  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:02.617542  9310 leader_election.cc:290] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:02.606935  9347 raft_consensus.cc:515] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:02.618173  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:02.620111  9347 leader_election.cc:290] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:02.619894  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:02.602560  9348 raft_consensus.cc:515] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:02.618187  9313 leader_election.cc:290] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:02.617563  9298 raft_consensus.cc:493] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:02.641887  9298 raft_consensus.cc:515] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:02.629931  9354 raft_consensus.cc:493] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:51:02.619805  9346 leader_election.cc:290] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:51:02.631114  7745 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.008s	sys 0.011s
W20260709 14:51:02.643976  7745 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.557s	user 0.009s	sys 0.011s
W20260709 14:51:02.644327  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 557984us
I20260709 14:51:02.599562  9350 raft_consensus.cc:515] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:02.642365  7846 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49948 (request call id 2307) took 2414 ms. Trace:
I20260709 14:51:02.618247  9310 raft_consensus.cc:493] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:02.645944  7846 rpcz_store.cc:276] 0709 14:51:00.228410 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:02.641384 (+2412974us) service_pool.cc:224] Handling call
0709 14:51:02.641831 (+   447us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:51:02.642026 (+   195us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:51:02.642052 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:51:02.642094 (+    42us) raft_consensus.cc:1645] Marking committed up to 3
0709 14:51:02.642122 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:02.642173 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:51:02.642300 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 14:51:02.630020  7772 raft_consensus.cc:2468] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 2.
I20260709 14:51:02.662572  7922 raft_consensus.cc:1275] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 14:51:02.665045  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:02.666225  7772 raft_consensus.cc:2468] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 3.
I20260709 14:51:02.643280  9351 raft_consensus.cc:493] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:02.672012  7851 raft_consensus.cc:1275] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 14:51:02.674147  7773 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 1665) took 2409 ms. Trace:
I20260709 14:51:02.676252  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:02.677142  7922 raft_consensus.cc:2468] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 2.
I20260709 14:51:02.643345  9354 raft_consensus.cc:515] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:02.683197  7779 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 1662) took 2498 ms. Trace:
I20260709 14:51:02.687495  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
W20260709 14:51:02.690308  7708 debug-util.cc:398] Leaking SignalData structure 0x7b08000f7ea0 after lost signal to thread 7803
W20260709 14:51:02.692065  7708 debug-util.cc:398] Leaking SignalData structure 0x7b08000ede40 after lost signal to thread 7878
W20260709 14:51:02.692942  7708 debug-util.cc:398] Leaking SignalData structure 0x7b080020a020 after lost signal to thread 7879
W20260709 14:51:02.694366  7708 debug-util.cc:398] Leaking SignalData structure 0x7b08000b4dc0 after lost signal to thread 7952
W20260709 14:51:02.695942  7708 debug-util.cc:398] Leaking SignalData structure 0x7b080014d6e0 after lost signal to thread 8664
I20260709 14:51:02.683768  7779 rpcz_store.cc:276] 0709 14:51:00.185160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:00.185308 (+   148us) service_pool.cc:224] Handling call
0709 14:51:02.682454 (+2497146us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:51:02.682780 (+   326us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:51:02.682808 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:51:02.682856 (+    48us) raft_consensus.cc:1645] Marking committed up to 5
0709 14:51:02.682903 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:02.682967 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:51:02.683123 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 14:51:02.666162  9310 raft_consensus.cc:515] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:02.705037  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:02.706449  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:02.701612  7676 catalog_manager.cc:5697] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 2 to 3, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 3 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:51:02.689018  9354 leader_election.cc:290] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:02.712167  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:02.712258  9310 leader_election.cc:290] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:02.713028  7845 raft_consensus.cc:2468] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 1.
I20260709 14:51:02.603302  9352 raft_consensus.cc:515] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:02.674731  7773 rpcz_store.cc:276] 0709 14:51:00.265003 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:00.265492 (+   489us) service_pool.cc:224] Handling call
0709 14:51:02.661451 (+2395959us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:51:02.671534 (+ 10083us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:51:02.672109 (+   575us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:51:02.673690 (+  1581us) raft_consensus.cc:1645] Marking committed up to 3
0709 14:51:02.673736 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:02.673814 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:51:02.673947 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4480}
I20260709 14:51:02.720775  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:02.725822  7846 raft_consensus.cc:2468] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 2.
I20260709 14:51:02.722870  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:02.724542  9352 leader_election.cc:290] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:02.728595  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:02.729354  7846 raft_consensus.cc:2468] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 1.
I20260709 14:51:02.731269  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:02.731861  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:02.732734  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:02.734069  7924 raft_consensus.cc:2468] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 2.
I20260709 14:51:02.736836  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:02.736618  9313 raft_consensus.cc:493] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:02.739066  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:02.675065  9298 leader_election.cc:290] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:02.741710  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:02.739085  9313 raft_consensus.cc:515] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:02.742714  9347 raft_consensus.cc:493] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:02.743570  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:02.744055  9357 raft_consensus.cc:493] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:02.744829  7922 raft_consensus.cc:2468] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 2.
I20260709 14:51:02.744571  9357 raft_consensus.cc:515] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:02.747216  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:02.748272  9310 raft_consensus.cc:493] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:02.754137  9310 raft_consensus.cc:515] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:02.756505  9310 leader_election.cc:290] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:02.756132  9347 raft_consensus.cc:515] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:02.748291  9346 raft_consensus.cc:493] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:51:02.757411  9346 raft_consensus.cc:515] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:02.754014  9348 leader_election.cc:290] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:02.762683  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:02.762979  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:02.760828  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:02.764281  7846 raft_consensus.cc:2468] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 1.
I20260709 14:51:02.707244  9351 raft_consensus.cc:515] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:02.771941  9313 leader_election.cc:290] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:02.774650  9346 leader_election.cc:290] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:02.741715  9350 leader_election.cc:290] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:02.763476  9347 leader_election.cc:290] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:02.780174  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:02.781188  7779 raft_consensus.cc:2468] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 2.
I20260709 14:51:02.783386  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:02.783797  9357 leader_election.cc:290] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:02.784363  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:02.786099  7845 raft_consensus.cc:2468] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 1.
I20260709 14:51:02.785356  9351 leader_election.cc:290] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:02.782030  9353 raft_consensus.cc:493] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:51:02.767197  9349 leader_election.cc:290] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:02.788931  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:02.789615  7845 raft_consensus.cc:2468] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 2.
I20260709 14:51:02.787210  9353 raft_consensus.cc:515] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:02.790093  9357 raft_consensus.cc:493] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9418391fa82a42c79c6cad13ba91d964)
I20260709 14:51:02.788729  9351 raft_consensus.cc:493] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:02.792047  9357 raft_consensus.cc:515] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:51:02.793371  9347 raft_consensus.cc:493] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:51:02.794061  9347 raft_consensus.cc:515] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:02.794430  9351 raft_consensus.cc:515] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:02.795043  9350 raft_consensus.cc:493] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:51:02.796622  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:02.796968  9350 raft_consensus.cc:515] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:51:02.797441  7772 raft_consensus.cc:2468] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 2.
I20260709 14:51:02.798159  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18d29d52d304c87b930d4fb5eaf50b1" candidate_uuid: "9418391fa82a42c79c6cad13ba91d964" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:02.797046  9347 leader_election.cc:290] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:02.799715  9350 leader_election.cc:290] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68:42321)
I20260709 14:51:02.799072  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9441e831627143a991a1556dcdce71e3" candidate_uuid: "9418391fa82a42c79c6cad13ba91d964" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:02.802577  9357 leader_election.cc:290] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785), 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68:42321)
I20260709 14:51:02.803016  7851 raft_consensus.cc:2468] T 9441e831627143a991a1556dcdce71e3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9418391fa82a42c79c6cad13ba91d964 in term 2.
I20260709 14:51:02.803784  9351 leader_election.cc:290] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:02.803695  8599 leader_election.cc:304] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9418391fa82a42c79c6cad13ba91d964; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:02.805858  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:02.798435  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:02.806526  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783e4874513449ef9084b833f188a6d3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:02.806761  7779 raft_consensus.cc:2468] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 2.
I20260709 14:51:02.807385  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:02.809173  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:02.809917  7845 raft_consensus.cc:2468] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 4.
I20260709 14:51:02.810662  9201 raft_consensus.cc:2749] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 14:51:02.812693  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:02.815064  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:02.815655  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:02.817509  7850 raft_consensus.cc:2468] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 3.
I20260709 14:51:02.811937  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:02.820887  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:02.821789  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:02.829085  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:02.831943  9353 leader_election.cc:290] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:02.832007  8599 leader_election.cc:304] T 9441e831627143a991a1556dcdce71e3 P 9418391fa82a42c79c6cad13ba91d964 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac, 9418391fa82a42c79c6cad13ba91d964; no voters: 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:51:02.833180  9201 raft_consensus.cc:2804] T 9441e831627143a991a1556dcdce71e3 P 9418391fa82a42c79c6cad13ba91d964 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 14:51:02.833688  9201 raft_consensus.cc:493] T 9441e831627143a991a1556dcdce71e3 P 9418391fa82a42c79c6cad13ba91d964 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:51:02.834067  9201 raft_consensus.cc:3060] T 9441e831627143a991a1556dcdce71e3 P 9418391fa82a42c79c6cad13ba91d964 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:51:02.833878  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:02.834573  7924 raft_consensus.cc:2468] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 5.
I20260709 14:51:02.836130  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:02.836702  7924 raft_consensus.cc:2468] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 2.
I20260709 14:51:02.837862  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:02.838784  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c563cc7cfbe4d59be4ffc5cf847ce56" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:02.839295  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:02.840116  7925 raft_consensus.cc:2468] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 2.
I20260709 14:51:02.840399  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:02.840668  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:02.841399  7928 raft_consensus.cc:2468] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 4.
I20260709 14:51:02.841831  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:02.842562  7925 raft_consensus.cc:2468] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 2.
I20260709 14:51:02.842800  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:02.844316  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258d6c2dda954bf5b65930fde8ecb9f3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:02.845400  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:02.846093  7925 raft_consensus.cc:2468] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 2.
I20260709 14:51:02.846813  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:02.847277  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:02.848284  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:02.845763  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:02.850366  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:02.850931  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:02.851585  7923 raft_consensus.cc:2468] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 3.
I20260709 14:51:02.851994  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:02.852380  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:02.852679  7850 raft_consensus.cc:2468] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 5.
I20260709 14:51:02.851610  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:02.856928  7927 raft_consensus.cc:2468] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 2.
I20260709 14:51:02.857151  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:02.857918  7923 raft_consensus.cc:2468] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 3.
I20260709 14:51:02.860076  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:02.861622  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:02.847318  9201 raft_consensus.cc:515] T 9441e831627143a991a1556dcdce71e3 P 9418391fa82a42c79c6cad13ba91d964 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:51:02.862870  7854 raft_consensus.cc:2468] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 1.
I20260709 14:51:02.863049  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:02.863629  7920 raft_consensus.cc:2468] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 3.
I20260709 14:51:02.862131  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:02.842389  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:02.872678  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9441e831627143a991a1556dcdce71e3" candidate_uuid: "9418391fa82a42c79c6cad13ba91d964" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:02.873183  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:02.877390  9201 leader_election.cc:290] T 9441e831627143a991a1556dcdce71e3 P 9418391fa82a42c79c6cad13ba91d964 [CANDIDATE]: Term 3 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:02.874840  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:02.876443  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:02.878588  7847 raft_consensus.cc:3060] T 9441e831627143a991a1556dcdce71e3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:51:02.878639  7849 raft_consensus.cc:2468] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 4.
I20260709 14:51:02.877023  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:02.878032  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:02.880779  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:02.882061  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:02.883155  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:02.884531  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:02.886400  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:02.888546  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:02.887446  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:02.889400  7852 raft_consensus.cc:2468] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 6.
I20260709 14:51:02.889621  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:02.890911  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:02.891292  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:02.892361  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:02.892616  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:02.894188  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:02.894292  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:02.895159  7850 raft_consensus.cc:2468] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 4.
I20260709 14:51:02.895365  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:02.890372  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:02.896140  7851 raft_consensus.cc:2468] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 3.
I20260709 14:51:02.897526  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:02.898599  7847 raft_consensus.cc:2468] T 9441e831627143a991a1556dcdce71e3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9418391fa82a42c79c6cad13ba91d964 in term 3.
I20260709 14:51:02.898545  7850 raft_consensus.cc:2376] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 3. Re-sending same reply.
I20260709 14:51:02.902244  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:02.902484  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:02.899900  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:02.900007  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:02.902968  7852 raft_consensus.cc:2468] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 4.
I20260709 14:51:02.901954  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:02.903349  7848 raft_consensus.cc:2468] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 3.
I20260709 14:51:02.903967  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:02.903754  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:02.911166  7849 raft_consensus.cc:2468] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 3.
I20260709 14:51:02.901787  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:02.911816  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:02.914340  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258d6c2dda954bf5b65930fde8ecb9f3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:02.915390  7846 raft_consensus.cc:2468] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 1.
I20260709 14:51:02.918342  8599 leader_election.cc:304] T 9441e831627143a991a1556dcdce71e3 P 9418391fa82a42c79c6cad13ba91d964 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac, 9418391fa82a42c79c6cad13ba91d964; no voters: 
I20260709 14:51:02.918460  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:02.919950  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:02.920482  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:02.920781  7779 raft_consensus.cc:2468] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 2.
I20260709 14:51:02.921453  9201 raft_consensus.cc:2804] T 9441e831627143a991a1556dcdce71e3 P 9418391fa82a42c79c6cad13ba91d964 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 14:51:02.922041  9201 raft_consensus.cc:697] T 9441e831627143a991a1556dcdce71e3 P 9418391fa82a42c79c6cad13ba91d964 [term 3 LEADER]: Becoming Leader. State: Replica: 9418391fa82a42c79c6cad13ba91d964, State: Running, Role: LEADER
I20260709 14:51:02.923193  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:02.922995  9201 consensus_queue.cc:237] T 9441e831627143a991a1556dcdce71e3 P 9418391fa82a42c79c6cad13ba91d964 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:51:02.923929  7777 raft_consensus.cc:2468] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 5.
I20260709 14:51:02.925287  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:02.925585  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:02.926092  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c563cc7cfbe4d59be4ffc5cf847ce56" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:02.926313  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:02.926864  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:02.927004  7853 raft_consensus.cc:2468] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 3.
I20260709 14:51:02.927042  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce9c0ef2db24c13a8b1402f21819458" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:02.927282  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:02.932976  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:02.935462  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:02.936926  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:02.937582  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:02.938421  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:02.939967  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:02.941805  7846 raft_consensus.cc:1240] T 9441e831627143a991a1556dcdce71e3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 2. Current term is 3. Ops: []
I20260709 14:51:02.958797  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:02.941916  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:02.960856  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:02.953630  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:02.962314  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:02.942134  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:02.967003  7920 raft_consensus.cc:2468] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 3.
I20260709 14:51:02.964089  9272 consensus_queue.cc:1048] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 14:51:02.952909  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:02.963829  7745 leader_election.cc:304] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:02.970238  7745 leader_election.cc:304] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:02.953375  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:02.943667  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:02.943260  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1f7722fdea49e0b5e9c5d96633eaf9" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:02.943032  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:02.947562  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:02.944492  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:02.973600  9272 raft_consensus.cc:2804] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 14:51:02.936995  7845 raft_consensus.cc:1275] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 14:51:02.974056  9272 raft_consensus.cc:493] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:02.974669  9272 raft_consensus.cc:3060] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:51:02.938766  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:02.942454  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:02.976467  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:02.972504  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:02.978303  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:02.979128  7745 leader_election.cc:304] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:02.942123  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:02.981266  9343 raft_consensus.cc:2804] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 14:51:02.984983  9343 raft_consensus.cc:493] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:02.985555  9343 raft_consensus.cc:3060] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:51:02.983770  9336 raft_consensus.cc:2804] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 14:51:02.990945  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:02.997730  9336 raft_consensus.cc:493] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:03.005219  7745 leader_election.cc:304] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:03.005841  9336 raft_consensus.cc:3060] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:51:03.006772  9333 raft_consensus.cc:2804] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 14:51:03.007246  9333 raft_consensus.cc:493] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:03.007642  9333 raft_consensus.cc:3060] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:51:03.006943  7774 raft_consensus.cc:2468] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 4.
I20260709 14:51:03.010129  8637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18d29d52d304c87b930d4fb5eaf50b1" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9418391fa82a42c79c6cad13ba91d964" is_pre_election: true
I20260709 14:51:03.007102  8639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1f7722fdea49e0b5e9c5d96633eaf9" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9418391fa82a42c79c6cad13ba91d964" is_pre_election: true
I20260709 14:51:03.006815  7745 leader_election.cc:304] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:03.023854  9272 raft_consensus.cc:515] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:03.026333  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:03.027123  7922 raft_consensus.cc:2468] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 4.
I20260709 14:51:03.023136  7674 catalog_manager.cc:5697] T 9441e831627143a991a1556dcdce71e3 P 9418391fa82a42c79c6cad13ba91d964 reported cstate change: term changed from 2 to 3, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68). New cstate: current_term: 3 leader_uuid: "9418391fa82a42c79c6cad13ba91d964" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 14:51:03.034139  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:03.034286  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:03.035192  7774 raft_consensus.cc:2468] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 2.
I20260709 14:51:03.034632  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:03.036022  7779 raft_consensus.cc:2468] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 2.
I20260709 14:51:03.037104  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:03.037698  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:03.039041  9272 leader_election.cc:290] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 2 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:03.046931  9242 consensus_queue.cc:1048] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 14:51:03.047950  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783e4874513449ef9084b833f188a6d3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:03.046372  7893 leader_election.cc:304] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:51:03.050258  9242 raft_consensus.cc:2804] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 14:51:03.050698  9242 raft_consensus.cc:493] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:51:03.051071  9242 raft_consensus.cc:3060] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:51:03.051733  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:03.057310  8637 raft_consensus.cc:1240] T 9441e831627143a991a1556dcdce71e3 P 9418391fa82a42c79c6cad13ba91d964 [term 3 LEADER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 2. Current term is 3. Ops: []
I20260709 14:51:03.059789  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:03.063450  9345 raft_consensus.cc:2804] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 14:51:03.064666  9345 raft_consensus.cc:493] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:03.065033  9345 raft_consensus.cc:3060] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:51:03.065729  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:03.068895  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:03.067414  9272 consensus_queue.cc:1059] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 14:51:03.095286  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:03.095944  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:03.097540  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:03.099092  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:03.099359  7846 raft_consensus.cc:1275] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 14:51:03.100689  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783e4874513449ef9084b833f188a6d3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:03.099332  9343 raft_consensus.cc:515] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:03.102883  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258d6c2dda954bf5b65930fde8ecb9f3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:03.103209  9343 leader_election.cc:290] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:03.104393  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:03.106151  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:03.107148  9333 raft_consensus.cc:515] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:03.109637  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:03.109469  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:03.112149  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:03.112331  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
W20260709 14:51:03.112655  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 62065.4us
I20260709 14:51:03.109516  9272 consensus_queue.cc:1243] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer 9418391fa82a42c79c6cad13ba91d964 log is divergent from this leader: its last log entry 3.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 14:51:03.113463  7893 leader_election.cc:304] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:51:03.112855  7777 raft_consensus.cc:2468] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 3.
I20260709 14:51:03.114576  9242 raft_consensus.cc:515] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:03.115486  7893 leader_election.cc:304] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:51:03.117270  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258d6c2dda954bf5b65930fde8ecb9f3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:03.119026  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18d29d52d304c87b930d4fb5eaf50b1" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:03.119324  7893 leader_election.cc:304] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:51:03.119375  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:03.120223  9242 leader_election.cc:290] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 3 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:03.120573  9362 raft_consensus.cc:2804] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 14:51:03.068356  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:03.120671  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:03.122588  7893 leader_election.cc:304] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:51:03.123025  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9441e831627143a991a1556dcdce71e3" candidate_uuid: "9418391fa82a42c79c6cad13ba91d964" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:03.125123  9242 raft_consensus.cc:2804] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 14:51:03.121099  9362 raft_consensus.cc:493] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:51:03.126541  9242 raft_consensus.cc:493] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:51:03.126595  9362 raft_consensus.cc:3060] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:51:03.116482  9325 raft_consensus.cc:3055] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 LEADER]: Stepping down as leader of term 2
I20260709 14:51:03.127550  9325 raft_consensus.cc:740] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:51:03.128494  9325 consensus_queue.cc:260] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:51:03.129151  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:03.129631  7924 raft_consensus.cc:1240] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 2. Current term is 3. Ops: []
I20260709 14:51:03.129825  9325 raft_consensus.cc:3060] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:51:03.131248  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:03.122179  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:03.127152  9242 raft_consensus.cc:3060] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:51:03.141728  9272 consensus_queue.cc:1048] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 14:51:03.142961  7744 leader_election.cc:304] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:03.121912  9322 raft_consensus.cc:2804] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 14:51:03.124473  9349 raft_consensus.cc:2804] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 14:51:03.149917  7893 leader_election.cc:304] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:51:03.150645  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:03.156857  9272 raft_consensus.cc:2804] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 14:51:03.145689  9333 leader_election.cc:290] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 2 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:51:03.158496  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 128012us
I20260709 14:51:03.159981  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:03.153893  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c563cc7cfbe4d59be4ffc5cf847ce56" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:03.161595  9328 raft_consensus.cc:2804] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 14:51:03.178194  9328 raft_consensus.cc:493] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:51:03.178916  9328 raft_consensus.cc:3060] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:51:03.152565  9322 raft_consensus.cc:493] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:51:03.164083  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:03.189539  9322 raft_consensus.cc:3060] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:51:03.159900  9272 raft_consensus.cc:493] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:51:03.155464  9349 raft_consensus.cc:493] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:51:03.191258  9272 raft_consensus.cc:3060] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:51:03.190480  7745 leader_election.cc:304] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:03.173548  9336 raft_consensus.cc:515] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:03.182942  9242 raft_consensus.cc:515] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:03.184310  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c563cc7cfbe4d59be4ffc5cf847ce56" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:03.187023  9345 raft_consensus.cc:515] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:03.188730  9362 raft_consensus.cc:515] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:03.191489  7893 leader_election.cc:304] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
W20260709 14:51:03.193645  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 50804.5us
I20260709 14:51:03.193785  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:03.191761  9349 raft_consensus.cc:3060] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:51:03.201453  9242 leader_election.cc:290] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 3 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:03.207515  7893 leader_election.cc:304] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:51:03.206954  7745 leader_election.cc:304] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:03.209137  7744 leader_election.cc:304] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:03.211042  9272 raft_consensus.cc:515] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:03.202718  9271 raft_consensus.cc:2804] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 14:51:03.213205  9323 raft_consensus.cc:2804] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 14:51:03.213466  9369 raft_consensus.cc:2804] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 14:51:03.212544  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:03.213989  9369 raft_consensus.cc:493] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:51:03.213837  9323 raft_consensus.cc:493] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:03.214669  9323 raft_consensus.cc:3060] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:51:03.213303  9271 raft_consensus.cc:493] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:03.215219  7745 leader_election.cc:304] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:03.218046  7893 leader_election.cc:304] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:51:03.219046  7744 leader_election.cc:304] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:03.220775  9272 leader_election.cc:290] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:03.220115  7893 leader_election.cc:304] T 9ce9c0ef2db24c13a8b1402f21819458 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 9418391fa82a42c79c6cad13ba91d964
I20260709 14:51:03.223376  9307 raft_consensus.cc:2804] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 14:51:03.224040  9307 raft_consensus.cc:493] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:51:03.224184  7744 leader_election.cc:304] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:03.220577  9271 raft_consensus.cc:3060] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:51:03.228852  9272 raft_consensus.cc:2804] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 14:51:03.229501  9272 raft_consensus.cc:493] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:03.230285  9272 raft_consensus.cc:3060] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:51:03.206344  9365 raft_consensus.cc:2804] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 14:51:03.234690  9242 raft_consensus.cc:2749] T 9ce9c0ef2db24c13a8b1402f21819458 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 14:51:03.224681  9307 raft_consensus.cc:3060] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:51:03.243063  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:03.246728  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:03.248152  7745 leader_election.cc:304] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:03.225939  9341 raft_consensus.cc:2804] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 14:51:03.218310  9369 raft_consensus.cc:3060] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:51:03.244614  9333 raft_consensus.cc:2804] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 14:51:03.372728  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 150210us
I20260709 14:51:03.251147  9341 raft_consensus.cc:493] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:51:03.237994  9365 raft_consensus.cc:493] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:51:03.237424  9367 raft_consensus.cc:2749] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 14:51:03.372449  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 120358us
I20260709 14:51:03.420608  7745 leader_election.cc:304] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:03.421550  9365 raft_consensus.cc:3060] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:51:03.400267  9362 leader_election.cc:290] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 4 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:03.404201  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:03.405560  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:03.405961  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1f7722fdea49e0b5e9c5d96633eaf9" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:03.406889  9333 raft_consensus.cc:493] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:51:03.417222  9341 raft_consensus.cc:3060] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:51:03.380698  9336 leader_election.cc:290] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 2 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:03.404006  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:03.440042  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:03.436489  9333 raft_consensus.cc:3060] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:51:03.450476  9328 raft_consensus.cc:515] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:03.452479  9343 raft_consensus.cc:2804] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 14:51:03.453879  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 45396.3us
I20260709 14:51:03.451160  7745 leader_election.cc:304] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:03.436124  7928 raft_consensus.cc:1240] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 3. Current term is 4. Ops: []
I20260709 14:51:03.451220  9345 leader_election.cc:290] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:03.453189  9343 raft_consensus.cc:493] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:03.464968  9343 raft_consensus.cc:3060] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:51:03.464071  9328 leader_election.cc:290] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 3 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:03.499241  7850 raft_consensus.cc:1275] T 9441e831627143a991a1556dcdce71e3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Refusing update from remote peer 9418391fa82a42c79c6cad13ba91d964: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 14:51:03.500025  9336 raft_consensus.cc:493] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:51:03.501165  9336 raft_consensus.cc:515] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:03.502352  9201 consensus_queue.cc:1048] T 9441e831627143a991a1556dcdce71e3 P 9418391fa82a42c79c6cad13ba91d964 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 14:51:03.499553  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 48646.9us
I20260709 14:51:03.512475  7745 leader_election.cc:304] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:03.506412  9372 raft_consensus.cc:2804] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 14:51:03.514245  9372 raft_consensus.cc:493] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:03.517517  9376 raft_consensus.cc:2804] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 14:51:03.518319  9376 raft_consensus.cc:493] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:03.518471  9336 leader_election.cc:290] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:03.518936  9376 raft_consensus.cc:3060] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:51:03.515271  9372 raft_consensus.cc:3060] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:51:03.488476  9369 raft_consensus.cc:515] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:03.525648  7926 raft_consensus.cc:1240] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 5. Current term is 6. Ops: []
W20260709 14:51:03.527850  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 70011.6us
I20260709 14:51:03.519754  9271 raft_consensus.cc:515] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:03.532047  7745 leader_election.cc:304] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:03.534399  9349 raft_consensus.cc:515] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:03.538774  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 314502us
I20260709 14:51:03.548947  9307 raft_consensus.cc:515] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:03.552994  9369 leader_election.cc:290] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:03.526726  9322 raft_consensus.cc:515] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:03.569617  7922 raft_consensus.cc:1240] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 2. Current term is 3. Ops: []
I20260709 14:51:03.571429  9378 raft_consensus.cc:2804] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 14:51:03.572088  9378 raft_consensus.cc:493] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:03.572510  9378 raft_consensus.cc:3060] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:51:03.587839  7893 leader_election.cc:304] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:51:03.589763  9323 raft_consensus.cc:515] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:03.602249  7924 raft_consensus.cc:1240] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 2. Current term is 3. Ops: []
I20260709 14:51:03.597807  9307 leader_election.cc:290] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:03.606052  9371 raft_consensus.cc:2804] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 14:51:03.621743  6549 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 14:51:03.602586  9333 raft_consensus.cc:515] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:03.617973  9272 raft_consensus.cc:515] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:03.619393  9371 raft_consensus.cc:493] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:51:03.633975  9371 raft_consensus.cc:3060] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:51:03.621122  9349 leader_election.cc:290] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 3 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:03.628906  9365 raft_consensus.cc:515] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:03.648924  9272 leader_election.cc:290] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:03.649895  9271 leader_election.cc:290] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 2 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:03.655018  7928 raft_consensus.cc:1240] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 2. Current term is 3. Ops: []
I20260709 14:51:03.659097  9365 leader_election.cc:290] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 3 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:03.665403  9322 leader_election.cc:290] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 3 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:03.666888  9341 raft_consensus.cc:515] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:03.667793  9323 leader_election.cc:290] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:03.672637  9341 leader_election.cc:290] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 3 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:51:03.677980  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 62041.2us
I20260709 14:51:03.684559  7819 leader_election.cc:304] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:03.686088  7744 leader_election.cc:304] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:03.687529  9272 raft_consensus.cc:2804] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 14:51:03.688288  9272 raft_consensus.cc:493] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting leader election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:51:03.688807  9272 raft_consensus.cc:3060] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:51:03.670729  9333 leader_election.cc:290] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:03.702777  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:03.703352  7744 leader_election.cc:304] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:03.703729  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:03.704756  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:03.705457  9272 raft_consensus.cc:515] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:03.707474  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:03.707753  9333 raft_consensus.cc:2804] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 14:51:03.712512  9333 raft_consensus.cc:493] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:51:03.713028  9333 raft_consensus.cc:3060] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:51:03.712666  9272 leader_election.cc:290] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:03.694284  9375 consensus_queue.cc:1048] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.107s
I20260709 14:51:03.717891  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:03.730340  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:03.736168  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:03.709367  7744 leader_election.cc:304] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:03.709631  9298 raft_consensus.cc:2804] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 14:51:03.710047  7893 leader_election.cc:304] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:51:03.724882  9333 raft_consensus.cc:515] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:03.743733  9298 raft_consensus.cc:493] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 14:51:03.761803  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 120799us
I20260709 14:51:03.765476  9341 raft_consensus.cc:2804] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 14:51:03.766057  9341 raft_consensus.cc:493] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:51:03.766610  9341 raft_consensus.cc:3060] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:51:03.766903  9343 raft_consensus.cc:515] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:03.760684  9272 raft_consensus.cc:2749] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 14:51:03.767448  9333 leader_election.cc:290] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:03.753592  9371 raft_consensus.cc:515] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:03.781384  9371 leader_election.cc:290] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 5 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:03.772198  9376 raft_consensus.cc:515] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:03.759335  9298 raft_consensus.cc:3060] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Advancing to term 4
W20260709 14:51:03.785126  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 75905.5us
I20260709 14:51:03.769577  9343 leader_election.cc:290] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:03.796072  9376 leader_election.cc:290] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:03.796348  7744 leader_election.cc:304] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:03.802675  9372 raft_consensus.cc:515] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:03.813350  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:03.813659  9376 raft_consensus.cc:2804] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 14:51:03.814316  9376 raft_consensus.cc:493] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:51:03.813380  7744 leader_election.cc:304] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:03.820792  7744 leader_election.cc:304] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:03.821746  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:03.824204  7744 leader_election.cc:304] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:03.824579  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:03.825397  9333 raft_consensus.cc:2804] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 14:51:03.825901  9333 raft_consensus.cc:493] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting leader election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:51:03.826283  9333 raft_consensus.cc:3060] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:51:03.827085  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:03.828413  9375 raft_consensus.cc:2804] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 14:51:03.828925  9375 raft_consensus.cc:493] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:51:03.829347  9375 raft_consensus.cc:3060] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:51:03.829668  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:03.831630  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:03.814900  9376 raft_consensus.cc:3060] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:51:03.832450  9341 raft_consensus.cc:515] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:03.810398  9378 raft_consensus.cc:515] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:03.835956  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:03.836265  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:03.838541  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:03.845089  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:03.846400  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:03.864014  9376 raft_consensus.cc:515] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:03.869405  9343 raft_consensus.cc:2804] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 14:51:03.869992  9343 raft_consensus.cc:493] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:51:03.870414  9343 raft_consensus.cc:3060] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:51:03.872587  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:03.873586  7845 raft_consensus.cc:3060] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:51:03.873967  9372 leader_election.cc:290] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:03.870009  7744 leader_election.cc:304] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:03.876896  7744 leader_election.cc:304] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:03.878171  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258d6c2dda954bf5b65930fde8ecb9f3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:03.880481  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:03.881733  7924 raft_consensus.cc:2393] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 3: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:51:03.881639  9376 leader_election.cc:290] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:03.882826  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:03.883008  9333 raft_consensus.cc:515] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:03.884223  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:03.869293  9341 leader_election.cc:290] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 3 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:03.885622  9378 leader_election.cc:290] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 2 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:03.888968  9323 raft_consensus.cc:2749] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 14:51:03.890064  9378 raft_consensus.cc:2749] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 14:51:03.892043  9375 raft_consensus.cc:515] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:03.861094  9298 raft_consensus.cc:515] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:03.895781  9333 leader_election.cc:290] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:03.903023  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:03.907094  9375 leader_election.cc:290] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:03.913775  7852 raft_consensus.cc:1240] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 14:51:03.915331  7744 leader_election.cc:304] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:03.928658  7744 leader_election.cc:304] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:03.930757  9375 raft_consensus.cc:2804] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 14:51:03.929553  9378 raft_consensus.cc:2749] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 14:51:03.931231  9375 raft_consensus.cc:493] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting leader election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:51:03.915756  9298 leader_election.cc:290] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 4 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:03.931728  9375 raft_consensus.cc:3060] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:51:03.935458  7744 leader_election.cc:304] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:03.939611  9333 raft_consensus.cc:2804] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 14:51:03.940264  9333 raft_consensus.cc:493] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:51:03.940732  9333 raft_consensus.cc:3060] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:51:03.937999  7845 raft_consensus.cc:2468] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 4.
I20260709 14:51:03.946492  7819 leader_election.cc:304] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:03.946750  7774 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044"
dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
mode: GRACEFUL
new_leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:47068
I20260709 14:51:03.947618  9298 raft_consensus.cc:2804] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 14:51:03.947726  7774 raft_consensus.cc:606] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Received request to transfer leadership to TS 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:03.948137  9298 raft_consensus.cc:493] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:51:03.948632  9298 raft_consensus.cc:3060] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:51:03.938364  9343 raft_consensus.cc:515] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:03.953485  9388 consensus_queue.cc:1059] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 14:51:03.954706  7894 leader_election.cc:304] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:51:03.955533  9353 raft_consensus.cc:3055] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 LEADER]: Stepping down as leader of term 2
I20260709 14:51:03.956288  9353 raft_consensus.cc:740] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:51:03.958364  9341 raft_consensus.cc:2804] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 14:51:03.957933  9353 consensus_queue.cc:260] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:03.958945  9341 raft_consensus.cc:493] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:51:03.959223  9343 leader_election.cc:290] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:03.959483  9341 raft_consensus.cc:3060] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:51:03.961329  9298 raft_consensus.cc:515] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:03.964769  7924 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
mode: GRACEFUL
new_leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:48676
I20260709 14:51:03.965387  9353 raft_consensus.cc:3060] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:51:03.965720  9298 leader_election.cc:290] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 5 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:03.965912  7924 raft_consensus.cc:606] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 LEADER]: Received request to transfer leadership to TS 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:51:03.965852  7894 leader_election.cc:304] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:03.973531  9371 raft_consensus.cc:2749] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 14:51:03.974762  7744 leader_election.cc:304] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:03.975296  7819 leader_election.cc:304] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 9418391fa82a42c79c6cad13ba91d964
I20260709 14:51:03.975688  9378 raft_consensus.cc:2804] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 14:51:03.976311  9378 raft_consensus.cc:493] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting leader election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:51:03.976759  9378 raft_consensus.cc:3060] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:51:03.979907  9388 raft_consensus.cc:2749] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 14:51:03.980795  9388 consensus_queue.cc:1059] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 14:51:03.982398  9298 raft_consensus.cc:3055] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 LEADER]: Stepping down as leader of term 3
I20260709 14:51:03.982951  9298 raft_consensus.cc:740] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:51:03.984020  9298 consensus_queue.cc:260] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:03.986886  9378 raft_consensus.cc:515] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:03.988509  9298 raft_consensus.cc:3060] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:51:03.981942  7894 leader_election.cc:304] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:51:03.990198  9378 leader_election.cc:290] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:03.990418  7894 leader_election.cc:304] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:03.991456  9322 raft_consensus.cc:2804] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 14:51:03.991935  9322 raft_consensus.cc:493] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:51:03.991859  9388 consensus_queue.cc:1059] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 14:51:03.992764  9371 raft_consensus.cc:2749] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 14:51:03.992516  9322 raft_consensus.cc:3060] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:51:03.992534  7894 leader_election.cc:304] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:03.996011  9371 raft_consensus.cc:2749] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 14:51:03.998562  9388 raft_consensus.cc:3055] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 LEADER]: Stepping down as leader of term 5
I20260709 14:51:03.999065  9388 raft_consensus.cc:740] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:51:03.999449  7744 leader_election.cc:304] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:51:04.000078  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:03.997969  7894 leader_election.cc:304] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:51:04.001232  9388 consensus_queue.cc:260] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:04.002352  9371 raft_consensus.cc:2804] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 14:51:04.002488  9388 raft_consensus.cc:3060] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:51:04.002882  9371 raft_consensus.cc:493] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:51:04.003299  9371 raft_consensus.cc:3060] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:51:04.008344  9333 raft_consensus.cc:515] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:04.009495  9341 raft_consensus.cc:515] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:04.010723  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
W20260709 14:51:04.013985  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:04.011420  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:04.012346  9378 raft_consensus.cc:2749] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 14:51:04.015132  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:04.019320  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:04.022624  9333 leader_election.cc:290] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:04.015029  7744 leader_election.cc:304] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:04.024981  7745 leader_election.cc:304] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:04.024868  9343 raft_consensus.cc:2749] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 14:51:04.028941  7852 raft_consensus.cc:2468] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 3.
I20260709 14:51:04.026566  9376 consensus_queue.cc:1059] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 14:51:04.008231  9375 raft_consensus.cc:515] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:04.023308  7894 leader_election.cc:304] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:04.032961  7744 leader_election.cc:304] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:04.026126  9371 raft_consensus.cc:515] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:04.034242  9343 raft_consensus.cc:3060] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:51:04.036340  9369 raft_consensus.cc:2749] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 14:51:04.038559  7894 leader_election.cc:304] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:51:04.040511  9371 leader_election.cc:290] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 4 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:04.040596  7849 raft_consensus.cc:2468] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 4.
I20260709 14:51:04.041528  9365 raft_consensus.cc:2804] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 14:51:04.042122  9365 raft_consensus.cc:493] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:51:04.034731  9341 leader_election.cc:290] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 2 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:04.032209  9376 raft_consensus.cc:3055] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 LEADER]: Stepping down as leader of term 3
I20260709 14:51:04.043282  9376 raft_consensus.cc:740] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:51:04.043650  9375 leader_election.cc:290] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:04.044394  9376 consensus_queue.cc:260] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:04.045219  7894 leader_election.cc:304] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:04.045850  9376 raft_consensus.cc:3060] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:51:04.046391  9371 raft_consensus.cc:2749] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 14:51:04.010586  9322 raft_consensus.cc:515] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:04.042452  7893 leader_election.cc:304] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:51:04.042587  9365 raft_consensus.cc:3060] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:51:04.048772  7745 leader_election.cc:304] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:04.049226  9322 leader_election.cc:290] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 5 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:04.050438  9307 raft_consensus.cc:2804] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Leader election won for term 3
I20260709 14:51:04.051015  9307 raft_consensus.cc:697] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:51:04.051131  9323 raft_consensus.cc:993] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed: : Instructing follower 3876b8ee8d744cb18e91d97aae93b1ac to start an election
I20260709 14:51:04.028072  9378 raft_consensus.cc:2804] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader election won for term 4
I20260709 14:51:04.051882  9323 raft_consensus.cc:1081] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Signalling peer 3876b8ee8d744cb18e91d97aae93b1ac to start an election
I20260709 14:51:04.052044  9378 raft_consensus.cc:697] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:51:04.052397  9307 consensus_queue.cc:237] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:04.053195  9378 consensus_queue.cc:237] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:04.055440  9349 raft_consensus.cc:2804] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 14:51:04.055948  9349 raft_consensus.cc:493] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:51:04.056347  9349 raft_consensus.cc:3060] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:51:04.053330  7852 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6"
dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
mode: GRACEFUL
new_leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
 from {username='slave'} at 127.0.0.1:41662
I20260709 14:51:04.057377  7852 raft_consensus.cc:606] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 LEADER]: Received request to transfer leadership to TS 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:04.058300  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:04.058960  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:04.059625  7846 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044"
dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:49948
I20260709 14:51:04.060374  7846 raft_consensus.cc:493] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:51:04.060771  7846 raft_consensus.cc:3060] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:51:04.061199  7894 leader_election.cc:304] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:04.063575  9322 raft_consensus.cc:2749] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 14:51:04.064417  7745 leader_election.cc:304] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:04.065397  9323 raft_consensus.cc:2804] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader election won for term 4
I20260709 14:51:04.066027  9323 raft_consensus.cc:697] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:51:04.067368  9323 consensus_queue.cc:237] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:04.067741  9349 raft_consensus.cc:515] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:04.078742  7894 leader_election.cc:304] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:04.079401  7846 raft_consensus.cc:515] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:04.082445  7846 leader_election.cc:290] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 2 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:04.082705  7774 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9"
dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
mode: GRACEFUL
new_leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:47068
I20260709 14:51:04.088660  7774 raft_consensus.cc:606] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 LEADER]: Received request to transfer leadership to TS 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:04.084767  9322 raft_consensus.cc:2749] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 14:51:04.092942  7774 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258"
dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
mode: GRACEFUL
new_leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:47068
I20260709 14:51:04.086884  7894 leader_election.cc:304] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:04.087103  9365 raft_consensus.cc:515] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:04.093884  7774 raft_consensus.cc:606] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 LEADER]: Received request to transfer leadership to TS 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:04.095813  6549 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 14:51:04.096253  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:04.097673  9365 leader_election.cc:290] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:04.098114  6549 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 14:51:04.104609  9322 raft_consensus.cc:2749] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 14:51:04.108253  7894 leader_election.cc:304] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:51:04.110281  9349 leader_election.cc:290] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 3 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:04.105439  9343 raft_consensus.cc:2749] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 14:51:04.114722  9365 raft_consensus.cc:2804] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 14:51:04.118454  7924 raft_consensus.cc:1275] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 14:51:04.117476  9365 raft_consensus.cc:493] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:04.120021  9365 raft_consensus.cc:3060] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:51:04.124876  7819 leader_election.cc:304] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:04.126438  9298 raft_consensus.cc:2749] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 14:51:04.126499  7894 leader_election.cc:304] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:04.127977  7819 leader_election.cc:304] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:04.128276  7894 leader_election.cc:304] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:51:04.130276  7894 leader_election.cc:304] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:04.130579  9298 raft_consensus.cc:2749] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 14:51:04.131625  9322 raft_consensus.cc:2804] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 14:51:04.133172  7676 catalog_manager.cc:5697] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 2 to 3, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 3 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:51:04.130182  9349 raft_consensus.cc:2749] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 14:51:04.133010  7819 leader_election.cc:304] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:04.136354  7894 leader_election.cc:304] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:04.136531  9298 raft_consensus.cc:2749] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 14:51:04.137454  9349 raft_consensus.cc:2749] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 14:51:04.135125  9369 raft_consensus.cc:2749] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 14:51:04.136281  7676 catalog_manager.cc:5697] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 3 to 4, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 4 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:51:04.138842  7819 leader_election.cc:304] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:04.135318  9322 raft_consensus.cc:493] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:04.140036  9322 raft_consensus.cc:3060] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:51:04.141831  7894 leader_election.cc:304] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:04.142622  9298 raft_consensus.cc:2749] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 14:51:04.143054  9349 raft_consensus.cc:2749] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 14:51:04.133713  9365 raft_consensus.cc:515] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:04.153100  7894 leader_election.cc:304] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:04.156502  9322 raft_consensus.cc:515] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:04.154961  9349 raft_consensus.cc:2749] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 14:51:04.169945  9365 leader_election.cc:290] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 5 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:04.177469  7894 leader_election.cc:304] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:04.183135  9369 raft_consensus.cc:2749] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 14:51:04.186424  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:04.187769  7894 leader_election.cc:304] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:04.189193  9369 raft_consensus.cc:2749] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 14:51:04.191351  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:04.193405  7928 raft_consensus.cc:1240] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 14:51:04.193941  7819 leader_election.cc:304] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:04.195194  7819 leader_election.cc:304] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:04.195874  9388 raft_consensus.cc:2749] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 14:51:04.196377  7819 leader_election.cc:304] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:04.187711  9322 leader_election.cc:290] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 4 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:04.197188  9388 raft_consensus.cc:2749] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 14:51:04.197968  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:04.195688  9298 raft_consensus.cc:2749] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 14:51:04.204102  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:04.204962  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:04.205689  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:04.205729  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:04.206889  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:04.207487  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:04.206140  7920 raft_consensus.cc:2393] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 3: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:51:04.207646  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:04.208977  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:04.209899  7919 raft_consensus.cc:2393] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 6: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:51:04.209734  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:04.210824  7894 leader_election.cc:304] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:04.210976  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:04.211630  9322 raft_consensus.cc:2749] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 14:51:04.207101  7819 leader_election.cc:304] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:04.212235  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:04.212724  9298 raft_consensus.cc:2749] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 14:51:04.213660  7894 leader_election.cc:304] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac, 9418391fa82a42c79c6cad13ba91d964
I20260709 14:51:04.214605  9322 raft_consensus.cc:2749] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 14:51:04.215891  7819 leader_election.cc:304] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:04.216629  7894 leader_election.cc:304] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:04.218138  9322 raft_consensus.cc:2749] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 14:51:04.219230  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:04.219682  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:04.220013  9298 raft_consensus.cc:2749] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 14:51:04.220633  7923 raft_consensus.cc:2393] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 3: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:51:04.220022  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:04.221634  7894 leader_election.cc:304] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:04.222234  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258d6c2dda954bf5b65930fde8ecb9f3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:04.224066  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:04.225368  9322 raft_consensus.cc:2749] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 14:51:04.223229  7819 leader_election.cc:304] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:04.223870  9343 raft_consensus.cc:493] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:51:04.226095  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:04.227016  7923 raft_consensus.cc:2393] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 3: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:51:04.226671  9343 raft_consensus.cc:515] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:04.228466  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:04.229075  9322 consensus_queue.cc:1048] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 14:51:04.229054  9343 leader_election.cc:290] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:04.232236  9298 raft_consensus.cc:2749] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 14:51:04.233901  7819 leader_election.cc:304] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:04.231637  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:04.238430  7923 raft_consensus.cc:2393] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 4: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:51:04.239125  7775 raft_consensus.cc:1240] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 2. Current term is 3. Ops: []
I20260709 14:51:04.239991  9298 raft_consensus.cc:2749] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 14:51:04.240388  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:04.241086  9298 raft_consensus.cc:493] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:04.241750  9298 raft_consensus.cc:515] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:04.241086  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:04.243707  7776 raft_consensus.cc:1240] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 1. Current term is 2. Ops: []
I20260709 14:51:04.244140  9298 leader_election.cc:290] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:04.244726  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:04.247517  7819 leader_election.cc:304] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:04.250152  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:04.251736  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:04.240509  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:04.250289  9298 raft_consensus.cc:2764] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 14:51:04.248885  7776 raft_consensus.cc:1240] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 3. Current term is 4. Ops: []
I20260709 14:51:04.253372  7819 leader_election.cc:304] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:04.255290  7775 raft_consensus.cc:1240] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 1. Current term is 2. Ops: []
I20260709 14:51:04.256950  9298 raft_consensus.cc:2749] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 14:51:04.255388  7770 raft_consensus.cc:1240] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 1. Current term is 2. Ops: []
I20260709 14:51:04.258621  7777 raft_consensus.cc:1240] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 2. Current term is 3. Ops: []
I20260709 14:51:04.257450  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:04.255847  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:04.256542  7774 raft_consensus.cc:1240] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 LEADER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 14:51:04.261116  7819 leader_election.cc:304] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 9418391fa82a42c79c6cad13ba91d964
I20260709 14:51:04.255630  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:04.262485  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:04.263264  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:04.265215  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:04.266460  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:04.267714  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:04.268874  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:04.270061  7770 raft_consensus.cc:1240] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 1. Current term is 2. Ops: []
I20260709 14:51:04.270969  7775 raft_consensus.cc:1240] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 6. Current term is 7. Ops: []
I20260709 14:51:04.271787  9298 raft_consensus.cc:2749] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 14:51:04.272562  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:04.273094  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:04.262759  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:04.271894  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:04.273976  7775 raft_consensus.cc:2410] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 14:51:04.270867  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:04.275647  7771 raft_consensus.cc:1240] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 1. Current term is 2. Ops: []
I20260709 14:51:04.276916  7819 leader_election.cc:304] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:04.277881  9298 raft_consensus.cc:2749] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 14:51:04.276681  7773 raft_consensus.cc:1240] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 4. Current term is 5. Ops: []
I20260709 14:51:04.278424  7772 raft_consensus.cc:2393] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 6: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:51:04.273998  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:04.271886  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:04.279423  7819 leader_election.cc:304] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:04.279870  7773 raft_consensus.cc:1240] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 2. Current term is 3. Ops: []
I20260709 14:51:04.280426  9298 raft_consensus.cc:2749] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 14:51:04.277858  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:04.281775  7819 leader_election.cc:304] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:04.274971  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:04.279873  7777 raft_consensus.cc:3055] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Stepping down as leader of term 1
I20260709 14:51:04.282735  7777 raft_consensus.cc:740] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:51:04.281929  7776 raft_consensus.cc:1240] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 3. Current term is 4. Ops: []
I20260709 14:51:04.282671  9298 raft_consensus.cc:2749] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 14:51:04.282850  7775 raft_consensus.cc:1275] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Refusing update from remote peer 9418391fa82a42c79c6cad13ba91d964: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 14:51:04.284144  7777 consensus_queue.cc:260] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:04.286345  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:04.285686  7819 leader_election.cc:304] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:04.287003  7777 raft_consensus.cc:3060] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:51:04.287570  9298 raft_consensus.cc:2749] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 14:51:04.287647  7923 raft_consensus.cc:1240] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 3. Current term is 4. Ops: []
I20260709 14:51:04.289359  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:04.289848  7819 leader_election.cc:304] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:04.290918  9298 raft_consensus.cc:2749] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 14:51:04.291509  7846 raft_consensus.cc:2468] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 6.
I20260709 14:51:04.289810  7771 raft_consensus.cc:1240] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 4. Current term is 5. Ops: []
I20260709 14:51:04.301385  7923 raft_consensus.cc:1240] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 1. Current term is 2. Ops: []
I20260709 14:51:04.302114  7779 raft_consensus.cc:1240] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 2. Current term is 3. Ops: []
I20260709 14:51:04.293157  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:04.294834  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:04.304216  7923 raft_consensus.cc:1240] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 4. Current term is 5. Ops: []
I20260709 14:51:04.305862  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:04.295651  7778 raft_consensus.cc:1240] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 5. Current term is 6. Ops: []
I20260709 14:51:04.297313  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:04.299999  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:04.300240  7676 catalog_manager.cc:5697] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 3 to 4, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 4 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:51:04.309206  9322 consensus_queue.cc:1059] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 14:51:04.310721  9369 raft_consensus.cc:3055] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 14:51:04.311182  9369 raft_consensus.cc:740] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:04.314420  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:04.317404  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:04.312413  9369 consensus_queue.cc:260] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:04.321020  9369 raft_consensus.cc:3060] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:51:04.324497  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:04.329282  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:04.331974  9349 consensus_queue.cc:1059] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 14:51:04.333638  7777 raft_consensus.cc:2468] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 2.
I20260709 14:51:04.333739  9322 raft_consensus.cc:3055] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 14:51:04.303004  7819 leader_election.cc:304] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:04.336546  7893 leader_election.cc:304] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:04.338523  9349 raft_consensus.cc:2749] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 14:51:04.338320  7922 raft_consensus.cc:1240] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 2. Current term is 3. Ops: []
I20260709 14:51:04.332587  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:04.341123  7922 raft_consensus.cc:1240] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 2. Current term is 3. Ops: []
I20260709 14:51:04.341034  7849 raft_consensus.cc:1240] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 14:51:04.341231  7923 raft_consensus.cc:1240] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 2. Current term is 3. Ops: []
I20260709 14:51:04.343169  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:04.342109  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:04.346560  7846 raft_consensus.cc:2393] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 4: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:51:04.347259  7922 raft_consensus.cc:1240] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 2. Current term is 3. Ops: []
I20260709 14:51:04.334671  9322 raft_consensus.cc:740] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:04.348660  9298 raft_consensus.cc:2749] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 14:51:04.348953  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 46076.1us
I20260709 14:51:04.347965  7893 leader_election.cc:304] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:04.350203  7819 leader_election.cc:304] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:04.350831  9349 raft_consensus.cc:2749] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 14:51:04.351568  9298 raft_consensus.cc:2749] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 14:51:04.352903  7819 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:04.353521  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:04.354074  7923 raft_consensus.cc:1240] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 2. Current term is 3. Ops: []
I20260709 14:51:04.354171  9298 consensus_queue.cc:1059] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 14:51:04.354526  7922 raft_consensus.cc:2393] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 4: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:51:04.354599  9388 consensus_queue.cc:1059] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 14:51:04.355584  9353 raft_consensus.cc:3055] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 LEADER]: Stepping down as leader of term 2
I20260709 14:51:04.356093  9353 raft_consensus.cc:740] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:51:04.357203  9353 consensus_queue.cc:260] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:04.359283  9353 raft_consensus.cc:3060] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:51:04.350131  9322 consensus_queue.cc:260] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:04.376005  9397 raft_consensus.cc:493] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:04.376295  9322 raft_consensus.cc:3060] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:51:04.380805  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:04.381695  7924 raft_consensus.cc:2393] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 5: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:51:04.383311  7744 leader_election.cc:304] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:04.384497  9323 raft_consensus.cc:2749] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 14:51:04.377772  9398 consensus_queue.cc:1059] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 14:51:04.385674  9349 consensus_queue.cc:1059] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 14:51:04.387332  9365 raft_consensus.cc:3055] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 14:51:04.387876  9365 raft_consensus.cc:740] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:04.389040  9365 consensus_queue.cc:260] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:04.389599  7744 leader_election.cc:304] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:04.390717  9349 consensus_queue.cc:1059] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 14:51:04.391132  9371 consensus_queue.cc:1059] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 14:51:04.392202  9349 raft_consensus.cc:3055] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 14:51:04.392488  9371 raft_consensus.cc:3055] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 14:51:04.392652  9349 raft_consensus.cc:740] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:04.378633  9397 raft_consensus.cc:515] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:04.393636  9323 raft_consensus.cc:2749] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 14:51:04.392975  9371 raft_consensus.cc:740] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:04.391275  9365 raft_consensus.cc:3060] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:51:04.392980  7744 leader_election.cc:304] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:04.395174  7893 leader_election.cc:304] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:04.403681  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:04.404031  9371 consensus_queue.cc:260] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:04.405418  7922 raft_consensus.cc:1240] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 4. Current term is 5. Ops: []
I20260709 14:51:04.405869  9323 raft_consensus.cc:2749] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 14:51:04.408380  9397 leader_election.cc:290] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:04.410192  9397 raft_consensus.cc:3055] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 LEADER]: Stepping down as leader of term 2
I20260709 14:51:04.401129  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:04.411049  9371 raft_consensus.cc:3060] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:51:04.414691  7924 raft_consensus.cc:3060] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:51:04.414266  9397 raft_consensus.cc:740] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:51:04.398236  7894 leader_election.cc:304] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:04.413319  9323 consensus_queue.cc:1059] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 14:51:04.417892  7744 leader_election.cc:304] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:04.418787  7893 leader_election.cc:304] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:04.419610  9369 raft_consensus.cc:2749] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 14:51:04.420495  9397 consensus_queue.cc:260] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:04.422099  9298 raft_consensus.cc:3055] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 LEADER]: Stepping down as leader of term 2
I20260709 14:51:04.422575  9298 raft_consensus.cc:740] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:51:04.423559  9298 consensus_queue.cc:260] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:04.424526  9298 raft_consensus.cc:3060] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:51:04.426785  7894 leader_election.cc:304] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:04.428064  9365 raft_consensus.cc:2749] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 14:51:04.428481  9343 raft_consensus.cc:3055] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 LEADER]: Stepping down as leader of term 4
I20260709 14:51:04.429025  9343 raft_consensus.cc:740] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:51:04.429402  9369 raft_consensus.cc:2749] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 14:51:04.430249  9343 consensus_queue.cc:260] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:04.431326  9365 consensus_queue.cc:1059] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 14:51:04.432569  9365 consensus_queue.cc:1059] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 14:51:04.433926  9365 consensus_queue.cc:1243] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer 1de5e20126fa4d8ca0793d19c7b847ed log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 14:51:04.416584  9349 consensus_queue.cc:260] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:04.434831  9379 raft_consensus.cc:3055] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 14:51:04.435299  7924 raft_consensus.cc:2468] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 2.
I20260709 14:51:04.435444  9379 raft_consensus.cc:740] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:04.436429  9379 consensus_queue.cc:260] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:04.437944  9322 raft_consensus.cc:3055] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 14:51:04.438499  9343 raft_consensus.cc:3060] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:51:04.440405  9379 raft_consensus.cc:3060] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:51:04.438740  9349 raft_consensus.cc:3060] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Advancing to term 2
W20260709 14:51:04.441656  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 80665.6us
I20260709 14:51:04.445422  9323 raft_consensus.cc:2749] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 14:51:04.445761  9369 raft_consensus.cc:2749] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 14:51:04.447726  7849 raft_consensus.cc:1240] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 4. Current term is 5. Ops: []
I20260709 14:51:04.448204  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:04.447644  9397 raft_consensus.cc:3060] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:51:04.394342  9400 raft_consensus.cc:493] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:04.442905  7894 leader_election.cc:304] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:04.459113  7744 leader_election.cc:304] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:04.438467  9322 raft_consensus.cc:740] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:04.453689  9400 raft_consensus.cc:515] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:04.460822  9322 consensus_queue.cc:260] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:04.462172  9322 raft_consensus.cc:3060] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:51:04.471113  9400 leader_election.cc:290] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:04.475183  7894 leader_election.cc:304] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:04.476687  9323 raft_consensus.cc:2749] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 14:51:04.479089  9365 raft_consensus.cc:2749] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 14:51:04.485219  7894 leader_election.cc:304] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:04.486017  9307 raft_consensus.cc:993] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed: : Instructing follower 3876b8ee8d744cb18e91d97aae93b1ac to start an election
I20260709 14:51:04.476557  9322 raft_consensus.cc:2804] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 14:51:04.486793  9307 raft_consensus.cc:993] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed: : Instructing follower 3876b8ee8d744cb18e91d97aae93b1ac to start an election
I20260709 14:51:04.486641  9365 raft_consensus.cc:2749] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 14:51:04.487293  9307 raft_consensus.cc:1081] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 LEADER]: Signalling peer 3876b8ee8d744cb18e91d97aae93b1ac to start an election
I20260709 14:51:04.487217  9322 raft_consensus.cc:697] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:04.488276  9397 raft_consensus.cc:493] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:04.489209  9397 raft_consensus.cc:515] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:04.491788  9397 leader_election.cc:290] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:04.492542  9397 raft_consensus.cc:493] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:04.493180  9397 raft_consensus.cc:515] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:04.489686  9322 consensus_queue.cc:237] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:04.495406  9397 leader_election.cc:290] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:04.496423  9399 consensus_queue.cc:1059] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 14:51:04.496856  9398 consensus_queue.cc:1059] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 14:51:04.497920  9399 raft_consensus.cc:3055] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 LEADER]: Stepping down as leader of term 2
I20260709 14:51:04.498240  9397 raft_consensus.cc:3055] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 LEADER]: Stepping down as leader of term 2
I20260709 14:51:04.488387  9307 raft_consensus.cc:1081] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 LEADER]: Signalling peer 3876b8ee8d744cb18e91d97aae93b1ac to start an election
I20260709 14:51:04.498876  9397 raft_consensus.cc:740] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:51:04.498332  9399 raft_consensus.cc:740] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:51:04.500735  9399 consensus_queue.cc:260] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:04.499078  7744 leader_election.cc:304] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:04.502535  9399 raft_consensus.cc:3060] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:51:04.503296  9298 consensus_queue.cc:1059] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 14:51:04.504362  9388 raft_consensus.cc:3055] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 LEADER]: Stepping down as leader of term 2
I20260709 14:51:04.504733  9388 raft_consensus.cc:740] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:51:04.505323  9398 consensus_queue.cc:1059] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 14:51:04.505676  9388 consensus_queue.cc:260] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:04.506901  9398 consensus_queue.cc:1059] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 14:51:04.507853  9396 raft_consensus.cc:3055] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 LEADER]: Stepping down as leader of term 2
I20260709 14:51:04.507227  9388 raft_consensus.cc:3060] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:51:04.508145  9398 raft_consensus.cc:3055] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 LEADER]: Stepping down as leader of term 2
I20260709 14:51:04.508931  9398 raft_consensus.cc:740] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:51:04.508221  9396 raft_consensus.cc:740] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:51:04.502804  9397 consensus_queue.cc:260] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:04.510790  9396 consensus_queue.cc:260] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:04.509840  9398 consensus_queue.cc:260] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:04.512460  9398 raft_consensus.cc:3060] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:51:04.512732  9396 raft_consensus.cc:3060] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:51:04.511844  9397 raft_consensus.cc:3060] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:51:04.524248  7676 catalog_manager.cc:5697] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 5 to 6, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 6 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:51:04.529942  7847 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258"
dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:49948
I20260709 14:51:04.530870  7847 raft_consensus.cc:493] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:51:04.531306  7847 raft_consensus.cc:3060] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:51:04.539705  7847 raft_consensus.cc:515] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:04.487330  7894 leader_election.cc:304] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:04.542280  7854 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9"
dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:49948
I20260709 14:51:04.542757  7850 raft_consensus.cc:1275] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 14:51:04.542971  7854 raft_consensus.cc:493] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:51:04.543795  7854 raft_consensus.cc:3060] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:51:04.544979  7847 leader_election.cc:290] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 6 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:04.548584  9322 raft_consensus.cc:2749] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 14:51:04.548769  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 49841.9us
I20260709 14:51:04.549868  9307 raft_consensus.cc:2749] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 14:51:04.549909  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 62649.9us
I20260709 14:51:04.553455  9372 consensus_queue.cc:1048] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 14:51:04.553570  7854 raft_consensus.cc:515] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:04.555163  7744 leader_election.cc:304] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:04.558772  9372 raft_consensus.cc:2749] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 14:51:04.558825  7847 raft_consensus.cc:1275] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 14:51:04.560714  7744 leader_election.cc:304] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:04.562418  7854 leader_election.cc:290] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 4 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:04.563088  9307 raft_consensus.cc:2749] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 14:51:04.564618  9372 consensus_queue.cc:1048] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 14:51:04.567790  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:04.568418  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:04.569413  7922 raft_consensus.cc:2468] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 3.
I20260709 14:51:04.571281  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:04.572154  7922 raft_consensus.cc:2468] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 2.
I20260709 14:51:04.565663  7819 leader_election.cc:304] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:04.566330  7744 leader_election.cc:304] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:04.566351  9399 consensus_queue.cc:1059] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 14:51:04.574539  9372 raft_consensus.cc:2749] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 14:51:04.575002  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:04.576063  7744 leader_election.cc:304] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:04.577005  9388 raft_consensus.cc:2804] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:51:04.577766  9388 raft_consensus.cc:697] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:51:04.578263  9398 raft_consensus.cc:3055] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 LEADER]: Stepping down as leader of term 4
I20260709 14:51:04.578826  9398 raft_consensus.cc:740] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:51:04.579007  9388 consensus_queue.cc:237] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:04.579850  9398 consensus_queue.cc:260] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:04.581121  9398 raft_consensus.cc:3060] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:51:04.583739  9372 raft_consensus.cc:2749] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 14:51:04.577674  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: true dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:04.586441  7922 raft_consensus.cc:3060] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:51:04.589354  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:04.585417  7744 leader_election.cc:304] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:04.590031  7923 raft_consensus.cc:3060] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:51:04.593856  9372 raft_consensus.cc:2749] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 14:51:04.596833  7744 leader_election.cc:304] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:04.598155  9400 raft_consensus.cc:493] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:04.598850  9400 raft_consensus.cc:515] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:04.602039  9400 leader_election.cc:290] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:04.602847  7922 raft_consensus.cc:2468] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 6.
I20260709 14:51:04.604012  9400 raft_consensus.cc:493] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:04.604816  9400 raft_consensus.cc:515] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:04.605675  9307 raft_consensus.cc:2749] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 14:51:04.605361  7923 raft_consensus.cc:2468] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 4.
I20260709 14:51:04.605366  9399 raft_consensus.cc:493] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:04.608134  9399 raft_consensus.cc:515] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:04.608732  7744 leader_election.cc:304] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:04.609833  9400 leader_election.cc:290] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:04.610023  9307 raft_consensus.cc:2749] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 14:51:04.611976  7744 leader_election.cc:304] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:04.613047  9307 raft_consensus.cc:2749] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 14:51:04.613760  7744 leader_election.cc:304] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:04.615584  7744 leader_election.cc:304] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:04.616542  9399 leader_election.cc:290] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:04.617066  9343 raft_consensus.cc:2749] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 14:51:04.618099  7819 leader_election.cc:304] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:04.618831  7744 leader_election.cc:304] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:04.619306  7819 leader_election.cc:304] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:04.620381  9343 raft_consensus.cc:2749] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 14:51:04.614797  9307 raft_consensus.cc:2749] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 14:51:04.621142  9398 raft_consensus.cc:2804] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 14:51:04.621502  9396 raft_consensus.cc:2804] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 14:51:04.622720  7744 leader_election.cc:304] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:04.621487  7819 leader_election.cc:304] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:04.623631  9396 raft_consensus.cc:493] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:04.624281  9396 raft_consensus.cc:3060] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:51:04.624432  9399 raft_consensus.cc:2804] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader election won for term 6
I20260709 14:51:04.623391  9398 raft_consensus.cc:493] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:04.625154  9399 raft_consensus.cc:697] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:51:04.624449  7819 leader_election.cc:304] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:04.626521  9397 raft_consensus.cc:2804] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Leader election won for term 4
I20260709 14:51:04.625074  9307 raft_consensus.cc:2749] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 14:51:04.626313  9399 consensus_queue.cc:237] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:04.627072  9397 raft_consensus.cc:697] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:51:04.628089  9397 consensus_queue.cc:237] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:04.625315  7744 leader_election.cc:304] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:04.629428  9353 raft_consensus.cc:493] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:51:04.631079  9372 raft_consensus.cc:2749] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 14:51:04.631220  9353 raft_consensus.cc:515] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:04.634727  9353 leader_election.cc:290] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:04.635124  7744 leader_election.cc:304] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:04.638166  9372 raft_consensus.cc:2749] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 14:51:04.643064  7744 leader_election.cc:304] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:04.644662  7850 raft_consensus.cc:1275] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 14:51:04.645931  7744 leader_election.cc:304] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:04.646258  9307 raft_consensus.cc:2749] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 14:51:04.646903  9378 raft_consensus.cc:2749] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 14:51:04.648648  9378 consensus_queue.cc:1059] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 14:51:04.648931  9396 raft_consensus.cc:515] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:04.650319  9307 raft_consensus.cc:3055] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 LEADER]: Stepping down as leader of term 3
I20260709 14:51:04.650794  9307 raft_consensus.cc:740] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:51:04.625754  9398 raft_consensus.cc:3060] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:51:04.651885  9307 consensus_queue.cc:260] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:04.654186  9307 raft_consensus.cc:3060] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:51:04.658803  9376 consensus_queue.cc:1059] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 14:51:04.660396  9323 raft_consensus.cc:3055] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Stepping down as leader of term 1
I20260709 14:51:04.660866  9323 raft_consensus.cc:740] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:51:04.658001  7676 catalog_manager.cc:5697] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 1 to 2, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 2 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:51:04.671105  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:04.662298  9323 consensus_queue.cc:260] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:04.673678  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:04.674403  7923 raft_consensus.cc:2468] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 3.
I20260709 14:51:04.674909  9376 consensus_queue.cc:1059] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 14:51:04.676445  9376 raft_consensus.cc:3055] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 LEADER]: Stepping down as leader of term 4
I20260709 14:51:04.680267  9372 consensus_queue.cc:1048] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 14:51:04.680866  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:04.683135  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:04.683972  7923 raft_consensus.cc:2393] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 6: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:51:04.684123  9396 leader_election.cc:290] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 2 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:04.676537  9398 raft_consensus.cc:515] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:04.676896  9376 raft_consensus.cc:740] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:51:04.698030  9376 consensus_queue.cc:260] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:04.699818  9376 raft_consensus.cc:3060] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:51:04.700830  7744 leader_election.cc:304] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:04.701893  9375 raft_consensus.cc:2749] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 14:51:04.693943  9323 raft_consensus.cc:3060] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:51:04.706140  9398 leader_election.cc:290] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 3 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:04.712464  7893 leader_election.cc:304] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:04.713960  9379 raft_consensus.cc:2749] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 14:51:04.726809  9349 consensus_queue.cc:1059] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 14:51:04.727821  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:04.728241  9349 raft_consensus.cc:3055] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 14:51:04.728853  9349 raft_consensus.cc:740] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:04.729962  9349 consensus_queue.cc:260] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:04.731932  9349 raft_consensus.cc:3060] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:51:04.735737  7893 leader_election.cc:304] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:04.737440  9322 raft_consensus.cc:2749] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 14:51:04.742259  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:04.742434  7674 catalog_manager.cc:5697] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 3 to 4, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 4 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:51:04.744387  7923 raft_consensus.cc:2468] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 2.
I20260709 14:51:04.742693  7893 leader_election.cc:304] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:04.743597  7819 leader_election.cc:304] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:04.746145  9379 raft_consensus.cc:2749] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 14:51:04.747225  7819 leader_election.cc:304] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:04.748656  9399 raft_consensus.cc:2804] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 14:51:04.749176  9399 raft_consensus.cc:493] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:04.749590  9399 raft_consensus.cc:3060] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:51:04.749491  9398 raft_consensus.cc:2804] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:51:04.749665  9322 consensus_queue.cc:1059] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 14:51:04.750600  9398 raft_consensus.cc:697] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:51:04.751675  9398 consensus_queue.cc:237] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:04.751578  9322 raft_consensus.cc:3055] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 14:51:04.753919  9322 raft_consensus.cc:740] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:04.754930  9322 consensus_queue.cc:260] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:04.756146  9322 raft_consensus.cc:3060] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:51:04.748360  9379 consensus_queue.cc:1059] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 14:51:04.758792  9365 raft_consensus.cc:3055] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 14:51:04.759730  9365 raft_consensus.cc:740] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:04.761065  9365 consensus_queue.cc:260] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:04.762372  9369 consensus_queue.cc:1059] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 14:51:04.762964  9365 raft_consensus.cc:3060] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:51:04.763681  9369 raft_consensus.cc:3055] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 14:51:04.764122  9369 raft_consensus.cc:740] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:04.765156  9369 consensus_queue.cc:260] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:04.767239  9369 raft_consensus.cc:3060] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:51:04.768637  9201 consensus_queue.cc:1048] T 9441e831627143a991a1556dcdce71e3 P 9418391fa82a42c79c6cad13ba91d964 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 14:51:04.745235  7674 catalog_manager.cc:5697] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 5 to 6, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 6 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:51:04.775105  7847 raft_consensus.cc:1240] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 LEADER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 3. Current term is 4. Ops: []
I20260709 14:51:04.776984  7847 raft_consensus.cc:1240] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 LEADER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 5. Current term is 6. Ops: []
I20260709 14:51:04.780031  9399 raft_consensus.cc:515] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:04.782124  7922 raft_consensus.cc:2468] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 3.
I20260709 14:51:04.782829  9399 leader_election.cc:290] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 3 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:04.762446  7893 leader_election.cc:304] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:04.790406  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:04.790921  9376 consensus_queue.cc:1059] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 14:51:04.791234  7893 leader_election.cc:304] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:04.791770  9376 consensus_queue.cc:1243] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer 3876b8ee8d744cb18e91d97aae93b1ac log is divergent from this leader: its last log entry 6.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 14:51:04.792270  9376 raft_consensus.cc:3055] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 LEADER]: Stepping down as leader of term 5
I20260709 14:51:04.792604  9376 raft_consensus.cc:740] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:51:04.793463  9379 raft_consensus.cc:2749] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 14:51:04.794389  9379 raft_consensus.cc:2749] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 14:51:04.796308  9376 consensus_queue.cc:260] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:04.797214  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:04.798959  9372 consensus_queue.cc:1059] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 14:51:04.793001  7893 leader_election.cc:304] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:04.802009  9372 consensus_queue.cc:1243] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer 3876b8ee8d744cb18e91d97aae93b1ac log is divergent from this leader: its last log entry 4.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 14:51:04.802644  7893 leader_election.cc:304] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:04.802688  9343 raft_consensus.cc:3055] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 LEADER]: Stepping down as leader of term 3
I20260709 14:51:04.804737  9343 raft_consensus.cc:740] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
W20260709 14:51:04.804951  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:04.805298  7819 leader_election.cc:304] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:04.806183  9398 raft_consensus.cc:2749] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 14:51:04.806643  9343 consensus_queue.cc:260] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:04.807989  9343 raft_consensus.cc:3060] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:51:04.808244  7923 raft_consensus.cc:2468] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 3.
I20260709 14:51:04.797861  9376 raft_consensus.cc:3060] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:51:04.807212  7819 leader_election.cc:304] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:04.812255  9399 raft_consensus.cc:2749] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 14:51:04.813439  9379 raft_consensus.cc:2749] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 14:51:04.814093  9399 consensus_queue.cc:1059] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 14:51:04.814478  9379 raft_consensus.cc:2749] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 14:51:04.816176  9397 consensus_queue.cc:1059] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 14:51:04.817000  7893 leader_election.cc:304] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:04.817814  9388 raft_consensus.cc:3055] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 LEADER]: Stepping down as leader of term 2
I20260709 14:51:04.818529  9388 raft_consensus.cc:740] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:51:04.818774  9369 raft_consensus.cc:2749] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 14:51:04.820379  9349 consensus_queue.cc:1059] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 14:51:04.821141  9388 consensus_queue.cc:260] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:04.822029  9349 raft_consensus.cc:3055] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 14:51:04.822484  9349 raft_consensus.cc:740] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:04.823530  9349 consensus_queue.cc:260] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:04.824368  9323 raft_consensus.cc:493] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:04.824884  9349 raft_consensus.cc:3060] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:51:04.824999  9323 raft_consensus.cc:515] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:04.827222  9398 raft_consensus.cc:3055] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 LEADER]: Stepping down as leader of term 3
I20260709 14:51:04.827998  9307 raft_consensus.cc:493] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9418391fa82a42c79c6cad13ba91d964)
I20260709 14:51:04.828370  9398 raft_consensus.cc:740] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:51:04.830529  9398 consensus_queue.cc:260] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:04.833065  7922 raft_consensus.cc:1275] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 14:51:04.834172  7922 pending_rounds.cc:85] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0: Aborting all ops after (but not including) 2
I20260709 14:51:04.834420  7922 pending_rounds.cc:107] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 14:51:04.834512  7926 raft_consensus.cc:1275] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 14:51:04.834707  7922 raft_consensus.cc:2889] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:51:04.834838  7924 raft_consensus.cc:1275] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 14:51:04.833310  9323 leader_election.cc:290] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:04.836220  9398 raft_consensus.cc:3060] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:51:04.833169  7923 raft_consensus.cc:1240] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 5. Current term is 6. Ops: []
I20260709 14:51:04.839452  9388 raft_consensus.cc:3060] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:51:04.844651  7675 catalog_manager.cc:5697] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 1 to 2, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 2 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:51:04.828652  9307 raft_consensus.cc:515] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:51:04.841789  7819 leader_election.cc:304] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:04.852191  9397 raft_consensus.cc:2804] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Leader election won for term 3
I20260709 14:51:04.852787  9397 raft_consensus.cc:697] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:51:04.853861  9397 consensus_queue.cc:237] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:04.858943  8637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce9c0ef2db24c13a8b1402f21819458" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9418391fa82a42c79c6cad13ba91d964" is_pre_election: true
W20260709 14:51:04.860476  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:04.864995  7819 leader_election.cc:304] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:04.869104  7773 raft_consensus.cc:1240] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 4. Current term is 5. Ops: []
I20260709 14:51:04.871567  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:04.852108  9307 leader_election.cc:290] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785), 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68:42321)
I20260709 14:51:04.874567  7773 raft_consensus.cc:1240] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 2. Current term is 3. Ops: []
I20260709 14:51:04.876708  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:04.877532  9399 raft_consensus.cc:2804] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Leader election won for term 3
I20260709 14:51:04.878175  7773 raft_consensus.cc:2393] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 2: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:51:04.878357  9399 raft_consensus.cc:697] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:51:04.881564  7777 raft_consensus.cc:1240] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 2. Current term is 3. Ops: []
I20260709 14:51:04.880352  9399 consensus_queue.cc:237] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:04.887758  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:04.888876  7771 raft_consensus.cc:2393] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 3: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:51:04.889211  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:04.890235  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:04.890268  7778 raft_consensus.cc:2393] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 2: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:51:04.896533  7773 raft_consensus.cc:1240] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 2. Current term is 3. Ops: []
I20260709 14:51:04.905652  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:04.906176  7676 catalog_manager.cc:5697] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 2 to 3, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 3 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:51:04.920138  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: true dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:04.924506  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:04.925678  7779 raft_consensus.cc:2393] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 5: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:51:04.926218  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:04.927184  7777 raft_consensus.cc:2393] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 3: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:51:04.927829  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:04.928826  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:04.929701  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:04.931429  7773 raft_consensus.cc:2468] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 6.
I20260709 14:51:04.929673  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:04.933825  7779 raft_consensus.cc:2393] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 2: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:51:04.929857  7771 raft_consensus.cc:2393] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 7: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:51:04.938076  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:04.939265  7771 raft_consensus.cc:2393] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 3: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:51:04.939407  7778 raft_consensus.cc:2468] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 4.
I20260709 14:51:04.940892  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:04.941674  7778 raft_consensus.cc:2393] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 3: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:51:04.942282  7923 raft_consensus.cc:1240] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 5. Current term is 6. Ops: []
I20260709 14:51:04.955825  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:04.957468  7676 catalog_manager.cc:5697] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 2 to 3, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 3 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:51:04.959851  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce9c0ef2db24c13a8b1402f21819458" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:04.963603  9376 consensus_queue.cc:1048] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 14:51:04.963871  9333 consensus_queue.cc:1048] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 14:51:04.965144  9376 consensus_queue.cc:1059] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 14:51:04.966651  9376 raft_consensus.cc:3055] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 LEADER]: Stepping down as leader of term 5
I20260709 14:51:04.967026  9376 raft_consensus.cc:740] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:51:04.971987  7744 leader_election.cc:304] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:04.972906  7819 leader_election.cc:304] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:04.962250  9307 consensus_queue.cc:1048] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 14:51:04.973881  9323 raft_consensus.cc:2749] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 14:51:04.979866  7819 leader_election.cc:304] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:04.981477  7744 leader_election.cc:304] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 9418391fa82a42c79c6cad13ba91d964
I20260709 14:51:04.967983  9376 consensus_queue.cc:260] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:04.983552  9399 raft_consensus.cc:3060] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:51:04.983451  9397 raft_consensus.cc:2749] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 14:51:04.983747  9323 raft_consensus.cc:2749] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 14:51:04.988701  7819 leader_election.cc:304] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:04.989606  9397 raft_consensus.cc:2749] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 14:51:04.992717  7819 leader_election.cc:304] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:04.993588  9397 raft_consensus.cc:3060] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:51:04.994848  7819 leader_election.cc:304] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:04.995765  9388 raft_consensus.cc:3060] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:51:05.000073  7819 leader_election.cc:304] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:05.002061  9398 raft_consensus.cc:3060] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:51:04.985862  9376 raft_consensus.cc:3060] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:51:05.014159  7771 raft_consensus.cc:1275] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 14:51:05.019793  7779 raft_consensus.cc:1275] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:51:05.029734  9322 consensus_queue.cc:1048] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 14:51:05.030216  9400 consensus_queue.cc:1048] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 14:51:05.043991  9398 raft_consensus.cc:2749] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 14:51:05.044858  9397 raft_consensus.cc:2749] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 14:51:05.029522  9388 raft_consensus.cc:2749] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 14:51:05.058092  7854 raft_consensus.cc:1275] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 14:51:05.062503  9365 consensus_queue.cc:1048] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 14:51:05.067853  7923 raft_consensus.cc:1275] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 14:51:05.070216  9397 consensus_queue.cc:1048] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 14:51:05.070567  7926 raft_consensus.cc:1275] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:51:05.074509  9397 consensus_queue.cc:1048] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 14:51:05.080013  9399 raft_consensus.cc:2749] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 14:51:05.087996  7778 raft_consensus.cc:1275] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 14:51:05.110155  6549 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 14:51:05.135778  9399 consensus_queue.cc:1048] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 14:51:05.183203  7771 raft_consensus.cc:1275] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 14:51:05.165324  7924 raft_consensus.cc:1275] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 14:51:05.193945  7778 raft_consensus.cc:1275] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:51:05.196415  9400 consensus_queue.cc:1048] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 14:51:05.210846  9400 consensus_queue.cc:1048] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 14:51:05.228310  9399 consensus_queue.cc:1048] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 14:51:05.237344  7924 raft_consensus.cc:1275] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:51:05.265542  9399 consensus_queue.cc:1048] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 14:51:05.263875  9323 raft_consensus.cc:493] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:05.292021  9323 raft_consensus.cc:515] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:05.296864  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:05.297950  7849 raft_consensus.cc:2468] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 4.
I20260709 14:51:05.299862  7745 leader_election.cc:304] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:05.301579  9376 raft_consensus.cc:2804] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 14:51:05.302199  9376 raft_consensus.cc:493] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:05.302587  9376 raft_consensus.cc:3060] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:51:05.305222  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:05.310496  7773 raft_consensus.cc:1275] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 14:51:05.313678  9400 consensus_queue.cc:1048] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 14:51:05.306042  7923 raft_consensus.cc:2468] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 4.
I20260709 14:51:05.301832  9323 leader_election.cc:290] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:05.367277  7771 raft_consensus.cc:1275] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 14:51:05.376454  9398 consensus_queue.cc:1048] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 14:51:05.408536  7919 raft_consensus.cc:1275] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 14:51:05.410976  9378 raft_consensus.cc:493] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:51:05.414527  9376 raft_consensus.cc:515] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:05.421815  9378 raft_consensus.cc:515] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:05.424445  9378 leader_election.cc:290] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:05.428900  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:05.413165  9398 consensus_queue.cc:1048] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 14:51:05.438179  7924 raft_consensus.cc:2393] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 3: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:51:05.427201  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:05.444293  7849 raft_consensus.cc:2468] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 3.
I20260709 14:51:05.443418  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:05.427340  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:05.446250  7846 raft_consensus.cc:3060] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:51:05.446086  7924 raft_consensus.cc:3060] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:51:05.425055  9376 leader_election.cc:290] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:05.459944  7846 raft_consensus.cc:2468] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 5.
I20260709 14:51:05.458992  7745 leader_election.cc:304] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:05.464861  7745 leader_election.cc:304] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:05.468109  9333 raft_consensus.cc:2804] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader election won for term 5
I20260709 14:51:05.468689  9333 raft_consensus.cc:697] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:51:05.467116  9375 raft_consensus.cc:2804] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 14:51:05.481844  9375 raft_consensus.cc:493] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:51:05.482429  9375 raft_consensus.cc:3060] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:51:05.481871  9333 consensus_queue.cc:237] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:05.487073  7922 raft_consensus.cc:1275] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 14:51:05.492275  9353 consensus_queue.cc:1048] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 14:51:05.499117  7924 raft_consensus.cc:2468] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 5.
I20260709 14:51:05.534384  9375 raft_consensus.cc:515] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:05.560557  7675 catalog_manager.cc:5697] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:51:05.567049  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:05.567898  7923 raft_consensus.cc:2393] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 3: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:51:05.570132  9375 leader_election.cc:290] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:05.570297  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:05.581296  9349 raft_consensus.cc:493] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:05.581974  9349 raft_consensus.cc:515] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:05.586335  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258d6c2dda954bf5b65930fde8ecb9f3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:05.587249  7849 raft_consensus.cc:2468] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 1.
I20260709 14:51:05.588847  7894 leader_election.cc:304] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:05.589916  9369 raft_consensus.cc:2804] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 14:51:05.592204  9349 leader_election.cc:290] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:05.590353  9369 raft_consensus.cc:493] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:05.599289  9369 raft_consensus.cc:3060] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:51:05.592701  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258d6c2dda954bf5b65930fde8ecb9f3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:05.604058  7771 raft_consensus.cc:2468] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 2.
I20260709 14:51:05.592864  9397 raft_consensus.cc:493] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:05.607393  9397 raft_consensus.cc:515] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:05.621680  9369 raft_consensus.cc:515] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:05.624782  9369 leader_election.cc:290] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 3 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:05.633790  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258d6c2dda954bf5b65930fde8ecb9f3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:05.634920  7771 raft_consensus.cc:3060] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:51:05.643249  9397 leader_election.cc:290] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:05.665686  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258d6c2dda954bf5b65930fde8ecb9f3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:05.666465  7849 raft_consensus.cc:3060] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Advancing to term 3
I20260709 14:51:05.671092  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:05.672206  7778 raft_consensus.cc:2468] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 3.
I20260709 14:51:05.676882  7819 leader_election.cc:304] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:05.686383  9400 raft_consensus.cc:2804] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 14:51:05.686996  9400 raft_consensus.cc:493] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:05.734421  9400 raft_consensus.cc:3060] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:51:05.801608  7849 raft_consensus.cc:2468] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 3.
I20260709 14:51:05.801632  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:05.802728  7922 raft_consensus.cc:2468] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 3.
I20260709 14:51:05.801808  9353 raft_consensus.cc:493] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:05.803692  9353 raft_consensus.cc:515] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:05.805905  9307 raft_consensus.cc:493] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:05.806754  9307 raft_consensus.cc:515] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:05.808415  9353 leader_election.cc:290] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:05.811897  9307 leader_election.cc:290] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:05.797027  9376 raft_consensus.cc:493] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:05.814178  9376 raft_consensus.cc:515] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:05.802604  7846 raft_consensus.cc:2468] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 3.
I20260709 14:51:05.821226  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:05.826053  7778 raft_consensus.cc:2468] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 3.
I20260709 14:51:05.823452  9397 raft_consensus.cc:493] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:51:05.827376  9397 raft_consensus.cc:515] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:05.829728  9397 leader_election.cc:290] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:05.831248  9369 raft_consensus.cc:493] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:05.831933  9369 raft_consensus.cc:515] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:05.834065  9369 leader_election.cc:290] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:05.843302  7894 leader_election.cc:304] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:05.844353  9365 raft_consensus.cc:2804] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 14:51:05.844894  9365 raft_consensus.cc:697] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:05.846189  9365 consensus_queue.cc:237] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:05.847208  9353 raft_consensus.cc:493] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:05.847833  9353 raft_consensus.cc:515] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:05.850126  9353 leader_election.cc:290] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:05.853338  9323 raft_consensus.cc:493] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:05.854244  9323 raft_consensus.cc:515] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:05.857916  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:05.858706  9323 leader_election.cc:290] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:05.838294  9376 leader_election.cc:290] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:51:05.863831  8598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 45511us
I20260709 14:51:05.858883  7846 raft_consensus.cc:2468] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 1.
I20260709 14:51:05.865746  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:05.866725  7778 raft_consensus.cc:2468] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 2.
I20260709 14:51:05.839980  9400 raft_consensus.cc:515] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:05.875108  9400 leader_election.cc:290] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 4 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:05.888028  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:05.921644  7778 raft_consensus.cc:2468] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 5.
I20260709 14:51:05.824018  7771 raft_consensus.cc:2468] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 3.
I20260709 14:51:05.894636  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:05.922741  7922 raft_consensus.cc:2468] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 3.
I20260709 14:51:05.896191  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:05.884305  7673 catalog_manager.cc:5697] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:51:05.897156  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:05.923645  7919 raft_consensus.cc:2468] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 3.
I20260709 14:51:05.924059  7779 raft_consensus.cc:2393] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 2: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:51:05.897559  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:05.925150  7923 raft_consensus.cc:2468] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 5.
I20260709 14:51:05.899196  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:05.901665  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:05.902124  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:05.903750  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:05.926760  7926 raft_consensus.cc:2468] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 2.
I20260709 14:51:05.907470  7894 leader_election.cc:304] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:05.913364  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:05.928650  7854 raft_consensus.cc:2468] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 5.
I20260709 14:51:05.915958  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:05.926754  7921 raft_consensus.cc:2468] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 2.
I20260709 14:51:05.930833  7851 raft_consensus.cc:2468] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 1.
I20260709 14:51:05.926816  7924 raft_consensus.cc:2393] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 5: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:51:05.907208  9398 raft_consensus.cc:493] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:05.927199  7846 raft_consensus.cc:2468] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 3.
I20260709 14:51:05.932806  9398 raft_consensus.cc:515] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:05.932673  8598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 53228.4us
I20260709 14:51:05.936029  9398 leader_election.cc:290] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:05.937697  7819 leader_election.cc:304] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:05.940414  7745 leader_election.cc:304] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:05.941529  9375 raft_consensus.cc:2804] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Leader election won for term 3
I20260709 14:51:05.942276  9375 raft_consensus.cc:697] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:51:05.943670  9375 consensus_queue.cc:237] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:05.942097  9333 raft_consensus.cc:493] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:05.951140  9333 raft_consensus.cc:515] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:05.952653  9398 raft_consensus.cc:2804] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 14:51:05.960559  9398 raft_consensus.cc:493] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:05.961220  9398 raft_consensus.cc:3060] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:51:05.954295  7819 leader_election.cc:304] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
W20260709 14:51:05.956955  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 49590us
I20260709 14:51:05.957086  9443 raft_consensus.cc:2804] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 14:51:05.965157  9443 raft_consensus.cc:493] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:05.968305  9443 raft_consensus.cc:3060] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:51:05.969774  9353 raft_consensus.cc:2804] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 14:51:05.974174  9365 raft_consensus.cc:493] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:05.974373  9353 raft_consensus.cc:493] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:51:05.975032  9353 raft_consensus.cc:3060] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:51:05.981376  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:05.982311  7771 raft_consensus.cc:3060] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:51:05.975015  9365 raft_consensus.cc:515] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:05.988590  7745 leader_election.cc:304] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:05.990345  9376 raft_consensus.cc:2804] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 14:51:05.990718  7771 raft_consensus.cc:2468] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 4.
I20260709 14:51:05.991007  9397 raft_consensus.cc:493] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:05.991591  9376 raft_consensus.cc:493] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:05.991771  9397 raft_consensus.cc:515] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:05.992544  9376 raft_consensus.cc:3060] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:51:05.994464  9397 leader_election.cc:290] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:05.995076  9307 raft_consensus.cc:493] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:05.996299  7745 leader_election.cc:304] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:05.996165  9307 raft_consensus.cc:515] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:05.994987  9365 leader_election.cc:290] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:05.997411  9372 raft_consensus.cc:2804] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 14:51:06.000051  9372 raft_consensus.cc:493] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:06.000648  9372 raft_consensus.cc:3060] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:51:05.999518  9307 leader_election.cc:290] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:06.002866  7745 leader_election.cc:304] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:06.003697  9333 leader_election.cc:290] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:06.004388  9333 raft_consensus.cc:2804] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 14:51:06.004787  9333 raft_consensus.cc:493] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:06.006287  9397 raft_consensus.cc:493] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:06.010171  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:06.011176  9397 raft_consensus.cc:515] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:06.011588  7926 raft_consensus.cc:2468] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 3.
I20260709 14:51:06.012468  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:06.009356  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:06.013644  7771 raft_consensus.cc:2468] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 3.
I20260709 14:51:06.014206  7924 raft_consensus.cc:3060] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:51:06.015446  7673 catalog_manager.cc:5697] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 2 to 3, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 3 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:51:06.016539  9397 leader_election.cc:290] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:06.021705  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:06.022625  7919 raft_consensus.cc:2468] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 4.
I20260709 14:51:06.023372  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:06.023852  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:06.024333  7846 raft_consensus.cc:2468] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 3.
I20260709 14:51:06.024508  7922 raft_consensus.cc:2468] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 2.
I20260709 14:51:06.027105  9443 raft_consensus.cc:515] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:06.029677  9443 leader_election.cc:290] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 3 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:06.030211  9333 raft_consensus.cc:3060] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:51:06.031543  7924 raft_consensus.cc:2468] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 4.
I20260709 14:51:06.035961  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:06.036561  7846 raft_consensus.cc:3060] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Advancing to term 3
I20260709 14:51:06.037321  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:06.042290  9369 raft_consensus.cc:493] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:06.043022  9369 raft_consensus.cc:515] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:06.043569  7744 leader_election.cc:304] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:51:06.044914  7744 leader_election.cc:304] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:51:06.046185  7894 leader_election.cc:304] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:06.047250  9375 raft_consensus.cc:2804] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 14:51:06.047879  9375 raft_consensus.cc:493] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:06.047165  9307 raft_consensus.cc:2804] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 14:51:06.050045  7846 raft_consensus.cc:2468] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 3.
I20260709 14:51:06.050262  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:06.055882  7771 raft_consensus.cc:3060] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:51:06.056293  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:06.058635  7894 leader_election.cc:304] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:06.060006  9349 raft_consensus.cc:2804] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 14:51:06.060603  9349 raft_consensus.cc:697] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:06.048532  9307 raft_consensus.cc:493] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:06.048377  9375 raft_consensus.cc:3060] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:51:06.016543  9353 raft_consensus.cc:515] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:06.053725  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:06.063265  7779 raft_consensus.cc:2468] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 7.
I20260709 14:51:06.061669  9349 consensus_queue.cc:237] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:06.062618  9307 raft_consensus.cc:3060] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:51:06.048485  9369 leader_election.cc:290] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:06.063795  9443 raft_consensus.cc:2804] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 14:51:06.066982  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 58361.7us
I20260709 14:51:06.066207  7893 leader_election.cc:304] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:51:06.068759  7771 raft_consensus.cc:2468] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 3.
I20260709 14:51:06.068522  9443 raft_consensus.cc:493] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:06.068379  9397 raft_consensus.cc:493] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:06.070580  9443 raft_consensus.cc:3060] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:51:06.071823  9353 leader_election.cc:290] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 5 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:06.069487  9369 raft_consensus.cc:2804] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 14:51:06.073036  9369 raft_consensus.cc:493] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:06.073477  9369 raft_consensus.cc:3060] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 14:51:06.070775  9397 raft_consensus.cc:515] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:06.078470  9398 raft_consensus.cc:515] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:06.079749  9397 leader_election.cc:290] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:06.083429  9376 raft_consensus.cc:515] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:06.073887  9333 raft_consensus.cc:515] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:06.086568  9397 raft_consensus.cc:493] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:06.087288  9397 raft_consensus.cc:515] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:06.089058  9444 raft_consensus.cc:493] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:51:06.089452  9333 leader_election.cc:290] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:06.089957  9397 leader_election.cc:290] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:06.089807  9444 raft_consensus.cc:515] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:06.093148  9444 leader_election.cc:290] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:06.097288  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:06.097724  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:06.113157  7924 raft_consensus.cc:3060] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:51:06.103881  9376 leader_election.cc:290] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:06.106721  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:06.120595  7922 raft_consensus.cc:3060] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:51:06.122613  9369 raft_consensus.cc:515] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:06.128798  9307 raft_consensus.cc:515] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:06.099076  9398 leader_election.cc:290] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 4 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:06.131160  9353 raft_consensus.cc:493] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:06.131850  9353 raft_consensus.cc:515] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:06.133777  9400 raft_consensus.cc:493] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:06.134109  9397 raft_consensus.cc:493] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:06.134353  9400 raft_consensus.cc:515] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:06.134802  9397 raft_consensus.cc:515] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:06.134140  9353 leader_election.cc:290] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:06.137737  9400 leader_election.cc:290] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:06.143278  7926 raft_consensus.cc:1275] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 14:51:06.110898  7771 raft_consensus.cc:2393] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 4: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:51:06.148716  7922 raft_consensus.cc:2468] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 6.
I20260709 14:51:06.111656  7819 leader_election.cc:304] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:06.150174  7744 leader_election.cc:304] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:51:06.151072  7819 leader_election.cc:304] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:06.049216  9372 raft_consensus.cc:515] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:06.155678  7819 leader_election.cc:304] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
W20260709 14:51:06.156812  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 90312.9us
I20260709 14:51:06.165716  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:06.166121  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:06.166466  7924 raft_consensus.cc:2468] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 4.
I20260709 14:51:06.166967  7854 raft_consensus.cc:2468] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 1.
I20260709 14:51:06.167510  7851 raft_consensus.cc:1275] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 14:51:06.167994  9343 raft_consensus.cc:493] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:06.168548  9343 raft_consensus.cc:515] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:06.169364  9369 leader_election.cc:290] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:06.137104  9397 leader_election.cc:290] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:06.178188  9397 raft_consensus.cc:2804] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 14:51:06.178622  9397 raft_consensus.cc:493] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:06.178965  9397 raft_consensus.cc:3060] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:51:06.154016  9400 raft_consensus.cc:2764] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 14:51:06.182440  9353 raft_consensus.cc:2804] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Leader election won for term 4
I20260709 14:51:06.183804  9353 raft_consensus.cc:697] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:51:06.184619  9372 leader_election.cc:290] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:06.177752  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:06.097529  9448 raft_consensus.cc:493] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:51:06.185976  7771 raft_consensus.cc:3060] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Advancing to term 8
I20260709 14:51:06.187577  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:06.176545  9343 leader_election.cc:290] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:06.188351  7926 raft_consensus.cc:2468] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 6.
I20260709 14:51:06.169701  9307 leader_election.cc:290] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:06.170333  9323 raft_consensus.cc:2804] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader election won for term 6
I20260709 14:51:06.189862  9323 raft_consensus.cc:697] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:51:06.186470  9448 raft_consensus.cc:515] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:06.171510  7673 catalog_manager.cc:5697] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:51:06.192943  6549 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 14:51:06.194054  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:06.194978  7847 raft_consensus.cc:3060] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:51:06.196107  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:06.194135  7744 leader_election.cc:304] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:51:06.198203  7851 raft_consensus.cc:2468] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 4.
I20260709 14:51:06.203686  7744 leader_election.cc:304] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:51:06.206139  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:06.207110  7922 raft_consensus.cc:3060] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:51:06.213465  7846 raft_consensus.cc:2468] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 3.
I20260709 14:51:06.216542  7894 leader_election.cc:304] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:51:06.217669  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:06.224697  9307 raft_consensus.cc:2804] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader election won for term 4
I20260709 14:51:06.221483  7924 raft_consensus.cc:3060] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:51:06.225607  9307 raft_consensus.cc:697] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:51:06.241207  9307 consensus_queue.cc:237] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:06.241612  9353 consensus_queue.cc:237] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:06.209450  9343 raft_consensus.cc:2804] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 14:51:06.245819  9343 raft_consensus.cc:493] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:06.246358  9343 raft_consensus.cc:3060] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:51:06.197640  9444 raft_consensus.cc:493] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:06.257927  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:06.258764  7854 raft_consensus.cc:3060] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Advancing to term 8
I20260709 14:51:06.261122  7771 raft_consensus.cc:2468] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 8.
I20260709 14:51:06.154738  9333 consensus_queue.cc:1048] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.072s
I20260709 14:51:06.131862  9375 raft_consensus.cc:515] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:06.267290  7847 raft_consensus.cc:2468] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 4.
I20260709 14:51:06.271041  7924 raft_consensus.cc:2468] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 3.
I20260709 14:51:06.266323  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:06.279253  7851 raft_consensus.cc:3060] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:51:06.282624  7922 raft_consensus.cc:2468] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 5.
I20260709 14:51:06.285979  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:06.286676  7846 raft_consensus.cc:3060] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Advancing to term 5
W20260709 14:51:06.273734  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 57318.2us
I20260709 14:51:06.209110  9443 raft_consensus.cc:515] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:06.292135  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:06.308451  7846 raft_consensus.cc:2468] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 5.
I20260709 14:51:06.190872  9323 consensus_queue.cc:237] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:06.318341  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:06.319011  7846 raft_consensus.cc:3060] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Advancing to term 3
I20260709 14:51:06.317962  7854 raft_consensus.cc:2468] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 8.
I20260709 14:51:06.277999  9349 raft_consensus.cc:493] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:06.281661  9365 raft_consensus.cc:2804] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 14:51:06.273135  9444 raft_consensus.cc:515] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:06.330430  7846 raft_consensus.cc:2468] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 3.
I20260709 14:51:06.332801  9365 raft_consensus.cc:493] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:51:06.336364  9453 raft_consensus.cc:493] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:06.339012  9448 leader_election.cc:290] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:06.358139  7893 leader_election.cc:304] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:51:06.351303  9369 raft_consensus.cc:493] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:06.346511  9454 raft_consensus.cc:493] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:06.334847  9349 raft_consensus.cc:515] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:06.372365  9349 leader_election.cc:290] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:06.375751  9349 raft_consensus.cc:493] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:06.382083  9349 raft_consensus.cc:515] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:06.387090  9349 leader_election.cc:290] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:06.355850  9365 raft_consensus.cc:3060] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:51:06.388738  9349 raft_consensus.cc:2804] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 14:51:06.389231  9349 raft_consensus.cc:697] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:06.387878  7673 catalog_manager.cc:5697] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:51:06.382874  9378 consensus_queue.cc:1048] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 14:51:06.380964  9343 raft_consensus.cc:515] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:06.388093  7854 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51"
dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
mode: GRACEFUL
new_leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
 from {username='slave'} at 127.0.0.1:41662
I20260709 14:51:06.391633  7854 raft_consensus.cc:606] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 LEADER]: Received request to transfer leadership to TS 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:06.358737  9453 raft_consensus.cc:515] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:06.395519  9343 leader_election.cc:290] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:06.395912  9453 leader_election.cc:290] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:06.390081  9349 consensus_queue.cc:237] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:06.380265  9372 raft_consensus.cc:493] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:06.379765  9444 leader_election.cc:290] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:51:06.408708  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 119228us
I20260709 14:51:06.413733  7922 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "939996e77ee64e9fab21aef50758b706"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
mode: GRACEFUL
new_leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:48676
I20260709 14:51:06.430104  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:06.430833  7847 raft_consensus.cc:2468] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 3.
I20260709 14:51:06.402119  9369 raft_consensus.cc:515] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:06.435137  9460 raft_consensus.cc:493] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:51:06.435768  9369 leader_election.cc:290] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:06.412875  9372 raft_consensus.cc:515] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:06.435802  9460 raft_consensus.cc:515] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:06.440282  9460 leader_election.cc:290] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:06.441982  9443 leader_election.cc:290] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 4 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:06.442912  9397 raft_consensus.cc:515] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:06.451500  7852 raft_consensus.cc:1275] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 14:51:06.409945  9454 raft_consensus.cc:515] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:06.456247  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:06.457679  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:06.458496  7779 raft_consensus.cc:2393] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 4: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:51:06.458976  9397 leader_election.cc:290] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 4 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:06.460238  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:06.460744  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:06.461109  7772 raft_consensus.cc:2393] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 5: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:51:06.461624  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:06.462033  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:06.462059  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:06.462599  7777 raft_consensus.cc:3060] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:51:06.462762  7776 raft_consensus.cc:2468] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 5.
I20260709 14:51:06.463886  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:06.464315  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:06.465312  7774 raft_consensus.cc:3060] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:51:06.457011  7771 raft_consensus.cc:2468] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 4.
I20260709 14:51:06.462306  7775 raft_consensus.cc:2468] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 3.
I20260709 14:51:06.462358  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:06.465611  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:06.470053  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:06.472067  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:06.472496  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:06.472745  7773 raft_consensus.cc:2468] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 3.
I20260709 14:51:06.473124  7926 raft_consensus.cc:2393] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 5: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:51:06.474450  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:06.474953  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:06.475304  7919 raft_consensus.cc:2468] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 4.
I20260709 14:51:06.477267  7770 raft_consensus.cc:2368] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 2. Current term is 3.
I20260709 14:51:06.473225  7923 raft_consensus.cc:2468] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 3.
I20260709 14:51:06.478510  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:06.479420  7845 raft_consensus.cc:2468] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 5.
I20260709 14:51:06.480999  9454 leader_election.cc:290] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:06.481422  7772 raft_consensus.cc:2368] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 4. Current term is 5.
I20260709 14:51:06.482937  7771 raft_consensus.cc:2468] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 3.
I20260709 14:51:06.475864  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:06.484568  7925 raft_consensus.cc:2468] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 5.
I20260709 14:51:06.486395  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:06.487229  7923 raft_consensus.cc:3060] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:51:06.489718  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:06.490536  7854 raft_consensus.cc:2468] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 5.
I20260709 14:51:06.467624  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:06.494369  7851 raft_consensus.cc:2468] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 6.
I20260709 14:51:06.464735  7776 raft_consensus.cc:2468] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 3.
I20260709 14:51:06.500051  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:06.507578  7926 raft_consensus.cc:2468] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 5.
I20260709 14:51:06.485028  7777 raft_consensus.cc:2468] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 4.
I20260709 14:51:06.482074  9372 leader_election.cc:290] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:06.509946  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:06.509004  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:06.510998  7926 raft_consensus.cc:2468] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 3.
I20260709 14:51:06.512710  7920 raft_consensus.cc:2368] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 4. Current term is 5.
I20260709 14:51:06.503778  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:06.516767  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:06.518041  7928 raft_consensus.cc:3060] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:51:06.464048  7744 leader_election.cc:304] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:51:06.513675  7923 raft_consensus.cc:2468] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 4.
W20260709 14:51:06.519182  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 55241.3us
W20260709 14:51:06.516103  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 161718us
I20260709 14:51:06.521616  7922 raft_consensus.cc:606] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 LEADER]: Received request to transfer leadership to TS 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:51:06.525517  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:06.526666  7923 raft_consensus.cc:2468] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 3.
I20260709 14:51:06.449074  9365 raft_consensus.cc:515] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:06.516088  9375 leader_election.cc:290] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:06.533653  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:06.518939  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:06.527788  9461 raft_consensus.cc:493] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:06.524267  9372 raft_consensus.cc:2804] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Leader election won for term 3
I20260709 14:51:06.529944  7744 leader_election.cc:304] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:51:06.545801  7851 raft_consensus.cc:2468] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 3.
I20260709 14:51:06.549873  7819 leader_election.cc:304] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:06.551002  7819 leader_election.cc:304] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:06.547859  7924 raft_consensus.cc:2468] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 4.
I20260709 14:51:06.552330  7819 leader_election.cc:304] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:06.555454  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:06.556161  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:06.556458  7847 raft_consensus.cc:2468] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 3.
I20260709 14:51:06.556840  7851 raft_consensus.cc:3060] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:51:06.569855  7894 leader_election.cc:304] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:06.527024  7921 raft_consensus.cc:2468] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 2.
I20260709 14:51:06.573788  7819 leader_election.cc:304] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:06.574949  7819 leader_election.cc:304] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:06.569870  7851 raft_consensus.cc:2468] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 4.
W20260709 14:51:06.577049  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 48217.1us
I20260709 14:51:06.554528  9461 raft_consensus.cc:515] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:06.584547  9461 leader_election.cc:290] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:06.586051  9398 raft_consensus.cc:2804] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 14:51:06.586645  9398 raft_consensus.cc:493] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:06.587131  9398 raft_consensus.cc:3060] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:51:06.587809  7774 raft_consensus.cc:2468] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 4.
I20260709 14:51:06.588723  9400 raft_consensus.cc:2804] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 14:51:06.589188  9400 raft_consensus.cc:493] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:06.589561  9400 raft_consensus.cc:3060] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:51:06.560863  9453 raft_consensus.cc:2804] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 14:51:06.590935  9453 raft_consensus.cc:493] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:06.591300  9453 raft_consensus.cc:3060] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:51:06.597151  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:06.598055  7925 raft_consensus.cc:2468] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 3.
I20260709 14:51:06.598940  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:06.600245  7923 raft_consensus.cc:3060] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:51:06.604596  7928 raft_consensus.cc:2468] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 4.
I20260709 14:51:06.575330  7894 leader_election.cc:304] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:06.553839  9397 raft_consensus.cc:2804] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 14:51:06.609313  7819 leader_election.cc:400] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 4 pre-election: Vote denied by peer 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785) with higher term. Message: Invalid argument: T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 4. Current term is 5.
I20260709 14:51:06.609623  9456 raft_consensus.cc:2804] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader election won for term 5
I20260709 14:51:06.610742  9451 raft_consensus.cc:993] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac: : Instructing follower 1e9289592458429bbddb19c2e7b7b7b0 to start an election
I20260709 14:51:06.611187  9461 raft_consensus.cc:2804] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 14:51:06.594084  9465 raft_consensus.cc:2804] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 14:51:06.617654  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 86412.7us
I20260709 14:51:06.619083  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:06.656981  7771 raft_consensus.cc:2468] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 5.
I20260709 14:51:06.616963  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:06.621449  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:06.622179  7894 leader_election.cc:304] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:06.658408  7777 raft_consensus.cc:2468] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 4.
I20260709 14:51:06.658532  7778 raft_consensus.cc:2468] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 3.
I20260709 14:51:06.660602  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:06.620872  7923 raft_consensus.cc:2468] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 3.
I20260709 14:51:06.574714  9454 raft_consensus.cc:2804] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 14:51:06.554819  7919 raft_consensus.cc:2468] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 2.
I20260709 14:51:06.630122  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:06.628804  7928 raft_consensus.cc:1240] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 3. Current term is 4. Ops: []
I20260709 14:51:06.576973  9323 raft_consensus.cc:493] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:06.615980  7819 leader_election.cc:403] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
W20260709 14:51:06.673362  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 79464.7us
I20260709 14:51:06.654160  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:06.664182  7894 leader_election.cc:304] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:06.682685  9449 raft_consensus.cc:2749] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785) with higher term. Message: Invalid argument: T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 4. Current term is 5.
I20260709 14:51:06.684871  9452 raft_consensus.cc:1081] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 LEADER]: Signalling peer 1e9289592458429bbddb19c2e7b7b7b0 to start an election
I20260709 14:51:06.672151  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:06.688076  9462 raft_consensus.cc:493] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:06.655891  9465 raft_consensus.cc:493] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:06.689610  9465 raft_consensus.cc:3060] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:51:06.665797  7772 raft_consensus.cc:2393] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 3: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:51:06.668393  7775 raft_consensus.cc:2468] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 2.
I20260709 14:51:06.626350  9397 raft_consensus.cc:493] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:06.650274  9461 raft_consensus.cc:493] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:06.674304  7819 leader_election.cc:304] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:06.712149  7819 leader_election.cc:304] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:06.698357  7894 leader_election.cc:304] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:06.717564  7772 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3"
dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
mode: GRACEFUL
new_leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:47068
I20260709 14:51:06.718344  7772 raft_consensus.cc:606] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 LEADER]: Received request to transfer leadership to TS 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:06.654098  9369 consensus_queue.cc:1048] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.064s
I20260709 14:51:06.690722  9349 raft_consensus.cc:2804] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 14:51:06.662874  9454 raft_consensus.cc:493] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:06.737221  7894 leader_election.cc:304] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
W20260709 14:51:06.742954  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 50915.3us
I20260709 14:51:06.670593  9456 raft_consensus.cc:697] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:51:06.710741  9444 raft_consensus.cc:2804] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 14:51:06.714433  9461 raft_consensus.cc:3060] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:51:06.716157  9448 raft_consensus.cc:2804] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Leader election won for term 4
I20260709 14:51:06.711076  9397 raft_consensus.cc:3060] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:51:06.688755  9462 raft_consensus.cc:515] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:06.717485  9372 raft_consensus.cc:697] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:51:06.762939  7744 leader_election.cc:304] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:51:06.744993  9379 raft_consensus.cc:2804] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 14:51:06.705377  9323 raft_consensus.cc:515] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:06.778468  9448 raft_consensus.cc:697] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:51:06.751866  9454 raft_consensus.cc:3060] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:51:06.796113  9448 consensus_queue.cc:237] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:06.749413  9349 raft_consensus.cc:493] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 14:51:06.780768  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 104872us
I20260709 14:51:06.781824  7777 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1"
dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
mode: GRACEFUL
new_leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
 from {username='slave'} at 127.0.0.1:47068
I20260709 14:51:06.715945  9400 raft_consensus.cc:515] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:06.756124  9444 raft_consensus.cc:493] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 14:51:06.787851  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 50777us
I20260709 14:51:06.802387  7779 raft_consensus.cc:2468] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 5.
I20260709 14:51:06.818225  7777 raft_consensus.cc:606] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 LEADER]: Received request to transfer leadership to TS 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:06.765444  9353 raft_consensus.cc:2804] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 14:51:06.788144  9379 raft_consensus.cc:493] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:51:06.822921  9349 raft_consensus.cc:3060] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:51:06.773728  9456 consensus_queue.cc:237] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:06.824672  9353 raft_consensus.cc:493] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:06.819053  9375 raft_consensus.cc:2804] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 14:51:06.820542  9365 leader_election.cc:290] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 4 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:06.820782  9451 raft_consensus.cc:493] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:06.831554  9461 raft_consensus.cc:515] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:06.838611  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 97363us
I20260709 14:51:06.828078  9459 raft_consensus.cc:2804] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 14:51:06.838371  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:06.836470  7674 catalog_manager.cc:5697] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:51:06.862751  7926 raft_consensus.cc:3060] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Advancing to term 7
W20260709 14:51:06.773108  9466 log.cc:927] Time spent T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 14:51:06.846971  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:06.866556  7845 raft_consensus.cc:2468] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 2.
I20260709 14:51:06.849431  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:06.831913  9379 raft_consensus.cc:3060] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:51:06.823823  9444 raft_consensus.cc:3060] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:51:06.798127  9323 leader_election.cc:290] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:06.837122  9462 leader_election.cc:290] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:06.864538  7819 leader_election.cc:304] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:06.845147  9353 raft_consensus.cc:3060] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:51:06.874631  9372 consensus_queue.cc:237] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:06.866614  9451 raft_consensus.cc:515] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:06.852715  9375 raft_consensus.cc:493] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:06.878525  9400 leader_election.cc:290] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 6 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:06.833039  9454 raft_consensus.cc:515] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:06.798933  9398 raft_consensus.cc:515] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:06.885653  9459 raft_consensus.cc:697] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:06.887622  7819 leader_election.cc:304] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:06.899570  7847 raft_consensus.cc:2468] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 4.
I20260709 14:51:06.897504  7920 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
 from {username='slave'} at 127.0.0.1:38516
I20260709 14:51:06.914165  7920 raft_consensus.cc:493] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:51:06.914608  7920 raft_consensus.cc:3060] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:51:06.919358  7777 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c"
dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
mode: GRACEFUL
new_leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
 from {username='slave'} at 127.0.0.1:47068
I20260709 14:51:06.890690  9375 raft_consensus.cc:3060] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:51:06.928056  7819 leader_election.cc:400] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 2 pre-election: Vote denied by peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587) with higher term. Message: Invalid argument: T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 2. Current term is 3.
I20260709 14:51:06.928946  7819 leader_election.cc:403] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 14:51:06.895402  9454 leader_election.cc:290] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 5 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:06.934099  7819 leader_election.cc:400] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 4 pre-election: Vote denied by peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587) with higher term. Message: Invalid argument: T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 4. Current term is 5.
I20260709 14:51:06.897656  9398 leader_election.cc:290] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 4 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:06.929416  7777 raft_consensus.cc:606] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Received request to transfer leadership to TS 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:06.890295  9451 leader_election.cc:290] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:06.917487  9452 raft_consensus.cc:2804] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 14:51:06.901804  9459 consensus_queue.cc:237] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:06.931063  9400 raft_consensus.cc:2804] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 14:51:06.936578  9448 raft_consensus.cc:3060] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Advancing to term 3
I20260709 14:51:06.969182  9400 raft_consensus.cc:493] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:06.969772  9400 raft_consensus.cc:3060] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:51:06.937669  7894 leader_election.cc:304] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:06.972246  7894 leader_election.cc:304] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:06.972261  7777 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674"
dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
mode: GRACEFUL
new_leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
 from {username='slave'} at 127.0.0.1:47068
I20260709 14:51:06.973021  7777 raft_consensus.cc:606] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 LEADER]: Received request to transfer leadership to TS 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:06.979329  7819 leader_election.cc:304] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:06.981856  7847 raft_consensus.cc:1275] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 14:51:06.983922  7819 leader_election.cc:304] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:06.985584  7926 raft_consensus.cc:2468] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 7.
I20260709 14:51:06.987711  9479 raft_consensus.cc:2804] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 14:51:06.987730  9475 raft_consensus.cc:2804] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Leader election won for term 4
I20260709 14:51:06.991578  9451 raft_consensus.cc:2804] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader election won for term 5
I20260709 14:51:06.988456  9479 raft_consensus.cc:493] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:06.994798  9479 raft_consensus.cc:3060] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:51:06.993891  9451 raft_consensus.cc:697] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:51:06.998405  7920 raft_consensus.cc:515] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:07.001089  7920 leader_election.cc:290] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 4 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:07.000801  9451 consensus_queue.cc:237] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:06.987924  9482 raft_consensus.cc:2804] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 14:51:07.009835  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:07.012633  7847 raft_consensus.cc:3055] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 LEADER]: Stepping down as leader of term 3
I20260709 14:51:07.013031  7847 raft_consensus.cc:740] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:51:07.012785  7771 raft_consensus.cc:1275] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 14:51:07.014179  7847 consensus_queue.cc:260] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:07.015636  7675 catalog_manager.cc:5697] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:51:07.017329  7744 leader_election.cc:304] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:51:07.017606  7847 raft_consensus.cc:3060] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:51:07.022843  7926 raft_consensus.cc:1240] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 3. Current term is 4. Ops: []
I20260709 14:51:07.025740  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:07.025962  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:07.026611  7928 raft_consensus.cc:3060] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:51:07.024942  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:07.029663  7926 raft_consensus.cc:3060] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:51:07.032816  7744 leader_election.cc:304] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:51:07.011808  9475 raft_consensus.cc:697] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:51:07.030445  9378 raft_consensus.cc:2804] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Leader election won for term 3
I20260709 14:51:07.038781  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:07.038471  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:07.039660  7779 raft_consensus.cc:2393] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 5: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:51:07.039606  7778 raft_consensus.cc:3060] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:51:07.034265  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:07.041978  7775 raft_consensus.cc:1275] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 14:51:07.046732  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:07.047294  7775 raft_consensus.cc:3060] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:51:07.044147  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:07.044677  7773 raft_consensus.cc:1275] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 14:51:07.039177  9333 consensus_queue.cc:1059] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 14:51:07.045583  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:07.044047  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:07.051848  7770 raft_consensus.cc:2393] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 4: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:51:07.051697  7772 raft_consensus.cc:3060] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:51:07.058159  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:07.059499  7770 raft_consensus.cc:3060] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:51:07.058270  9484 consensus_queue.cc:1048] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.052s
I20260709 14:51:07.063462  9353 raft_consensus.cc:515] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:07.016013  9397 raft_consensus.cc:515] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:07.044052  9474 raft_consensus.cc:2804] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader election won for term 7
I20260709 14:51:07.071038  9353 leader_election.cc:290] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 4 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:07.038453  9482 raft_consensus.cc:697] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:07.069639  7921 raft_consensus.cc:2393] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 7: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:51:07.055632  9461 leader_election.cc:290] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 5 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:07.052084  9378 raft_consensus.cc:697] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:51:07.090641  7776 raft_consensus.cc:1275] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 14:51:07.082544  7926 raft_consensus.cc:2468] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 6.
W20260709 14:51:07.128554  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 81375.2us
I20260709 14:51:07.157431  7770 raft_consensus.cc:2468] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 5.
I20260709 14:51:07.122623  7927 raft_consensus.cc:2468] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 5.
I20260709 14:51:07.093336  7928 raft_consensus.cc:2468] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 4.
W20260709 14:51:07.123113  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 54018.4us
I20260709 14:51:07.177433  7847 raft_consensus.cc:2468] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 4.
I20260709 14:51:07.139582  7778 raft_consensus.cc:2468] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 6.
I20260709 14:51:07.188154  7775 raft_consensus.cc:2468] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 4.
I20260709 14:51:07.183938  7819 leader_election.cc:304] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:07.195500  7819 leader_election.cc:304] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
W20260709 14:51:07.157924  9360 log.cc:927] Time spent T 00000000000000000000000000000000 P 133636659113430cb53b321cb0b1d9ee: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 14:51:07.144090  9376 raft_consensus.cc:993] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed: : Instructing follower 3876b8ee8d744cb18e91d97aae93b1ac to start an election
I20260709 14:51:07.145457  9480 raft_consensus.cc:993] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed: : Instructing follower 1e9289592458429bbddb19c2e7b7b7b0 to start an election
I20260709 14:51:07.202836  7819 leader_election.cc:304] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:07.220388  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:07.207620  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:07.221205  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:07.221545  7847 raft_consensus.cc:3060] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:51:07.221953  7849 raft_consensus.cc:2393] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 4: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:51:07.221118  7852 raft_consensus.cc:3060] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:51:07.085646  9475 consensus_queue.cc:237] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:07.158006  9474 raft_consensus.cc:697] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:51:07.220572  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:07.206326  7894 leader_election.cc:304] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:07.195446  9449 raft_consensus.cc:2804] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader election won for term 5
I20260709 14:51:07.230050  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:07.232000  7849 raft_consensus.cc:2468] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 5.
I20260709 14:51:07.233665  7847 raft_consensus.cc:2468] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 5.
I20260709 14:51:07.084666  9349 raft_consensus.cc:515] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:07.234540  9369 raft_consensus.cc:2804] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 14:51:07.213292  9451 raft_consensus.cc:2804] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Leader election won for term 4
I20260709 14:51:07.231359  9449 raft_consensus.cc:697] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:51:07.239821  9485 raft_consensus.cc:2804] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader election won for term 6
I20260709 14:51:07.091180  9379 raft_consensus.cc:515] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:07.236136  6549 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 14:51:07.275411  6549 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 14:51:07.246362  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:07.238023  7894 leader_election.cc:304] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:07.247745  9397 leader_election.cc:290] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 4 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:07.231870  9456 raft_consensus.cc:1081] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 LEADER]: Signalling peer 3876b8ee8d744cb18e91d97aae93b1ac to start an election
I20260709 14:51:07.260900  7852 raft_consensus.cc:2468] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 7.
I20260709 14:51:07.262827  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:07.289736  7775 raft_consensus.cc:2368] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 4. Current term is 5.
W20260709 14:51:07.241936  9453 consensus_meta.cc:287] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent flushing consensus metadata: real 0.650s	user 0.009s	sys 0.005s
I20260709 14:51:07.265980  7745 leader_election.cc:304] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:07.242076  9376 raft_consensus.cc:1081] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 LEADER]: Signalling peer 1e9289592458429bbddb19c2e7b7b7b0 to start an election
I20260709 14:51:07.280683  9448 raft_consensus.cc:2749] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587) with higher term. Message: Invalid argument: T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 2. Current term is 3.
I20260709 14:51:07.300593  7852 raft_consensus.cc:1240] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 3. Current term is 4. Ops: []
I20260709 14:51:07.242137  9375 raft_consensus.cc:515] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:07.266058  9369 raft_consensus.cc:697] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:07.285100  9451 raft_consensus.cc:697] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:51:07.316948  9400 raft_consensus.cc:515] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:07.317795  9465 consensus_meta.cc:287] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0: Time spent flushing consensus metadata: real 0.628s	user 0.012s	sys 0.002s
I20260709 14:51:07.317817  7852 raft_consensus.cc:1275] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 14:51:07.315285  7846 raft_consensus.cc:2468] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 3.
I20260709 14:51:07.286314  9365 raft_consensus.cc:2804] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 14:51:07.299063  9323 raft_consensus.cc:2804] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 14:51:07.320672  9398 consensus_queue.cc:1048] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
I20260709 14:51:07.330137  7848 raft_consensus.cc:1275] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 14:51:07.333750  7777 raft_consensus.cc:2393] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 4: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:51:07.265079  9482 consensus_queue.cc:237] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:07.284081  9378 consensus_queue.cc:237] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:07.346163  9491 log.cc:927] Time spent T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.070s	user 0.002s	sys 0.005s
I20260709 14:51:07.330327  9485 raft_consensus.cc:697] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:51:07.334425  9323 raft_consensus.cc:493] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:07.298471  9453 raft_consensus.cc:515] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:07.303278  9474 consensus_queue.cc:237] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:07.350797  7848 raft_consensus.cc:1275] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 14:51:07.356357  9323 raft_consensus.cc:3060] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:51:07.354452  9449 consensus_queue.cc:237] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:07.340709  9365 raft_consensus.cc:697] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:07.368408  7772 raft_consensus.cc:2468] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 4.
I20260709 14:51:07.352715  9397 raft_consensus.cc:493] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:51:07.331485  9465 raft_consensus.cc:515] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:07.339234  9451 consensus_queue.cc:237] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:07.395519  9397 raft_consensus.cc:515] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:51:07.364485  9485 consensus_queue.cc:237] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:07.412369  9397 leader_election.cc:290] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68:42321)
I20260709 14:51:07.414397  9453 leader_election.cc:290] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 4 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:07.419788  9365 consensus_queue.cc:237] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:07.421469  9443 raft_consensus.cc:493] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:51:07.395865  9461 raft_consensus.cc:493] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:51:07.366122  9369 consensus_queue.cc:237] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:07.422070  9443 raft_consensus.cc:515] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:07.443943  9400 leader_election.cc:290] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 4 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:07.425092  9349 leader_election.cc:290] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:07.457123  8637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18d29d52d304c87b930d4fb5eaf50b1" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9418391fa82a42c79c6cad13ba91d964" is_pre_election: true
I20260709 14:51:07.442711  9379 leader_election.cc:290] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 3 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:07.431715  9461 raft_consensus.cc:515] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:07.464948  9375 leader_election.cc:290] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:07.490545  9465 leader_election.cc:290] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:07.610306  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:51:07.626211  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 436656us
W20260709 14:51:07.517843  9479 consensus_meta.cc:287] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent flushing consensus metadata: real 0.519s	user 0.014s	sys 0.000s
W20260709 14:51:07.629038  9444 consensus_meta.cc:287] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent flushing consensus metadata: real 0.713s	user 0.013s	sys 0.000s
I20260709 14:51:07.614420  9471 raft_consensus.cc:3055] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 LEADER]: Stepping down as leader of term 3
I20260709 14:51:07.644050  7673 catalog_manager.cc:5697] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:51:07.494975  9443 leader_election.cc:290] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:07.570595  9323 raft_consensus.cc:515] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:07.643298  9452 raft_consensus.cc:493] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:07.664518  9471 raft_consensus.cc:740] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:51:07.669606  9460 raft_consensus.cc:493] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:51:07.644421  9479 raft_consensus.cc:515] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:07.657464  9444 raft_consensus.cc:515] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:07.674193  9452 raft_consensus.cc:3060] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:51:07.677021  9461 leader_election.cc:290] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:07.727607  9379 raft_consensus.cc:493] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:51:07.728454  9379 raft_consensus.cc:515] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:07.731563  9323 leader_election.cc:290] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:07.732084  9379 leader_election.cc:290] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:07.721321  9462 raft_consensus.cc:493] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:07.684868  9460 raft_consensus.cc:515] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:07.751410  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 105872us
I20260709 14:51:07.757292  9462 raft_consensus.cc:515] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:07.746793  9471 consensus_queue.cc:260] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:07.846977  9460 leader_election.cc:290] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:51:07.982945  9449 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.537s	user 0.002s	sys 0.046s
W20260709 14:51:07.927661  7819 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.595s	user 0.015s	sys 0.008s
W20260709 14:51:07.951310  7845 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.657s	user 0.068s	sys 0.138s
W20260709 14:51:07.839778  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 47072.2us
W20260709 14:51:08.000382  7745 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.690s	user 0.020s	sys 0.031s
W20260709 14:51:08.051046  9449 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.598s	user 0.002s	sys 0.048s
I20260709 14:51:08.040127  9443 raft_consensus.cc:493] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
W20260709 14:51:08.051872  7742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:51:08.281111  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 233583us
W20260709 14:51:07.950156  7818 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.604s	user 0.024s	sys 0.030s
W20260709 14:51:08.286397  7818 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.954s	user 0.027s	sys 0.032s
W20260709 14:51:08.044396  7819 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.712s	user 0.015s	sys 0.012s
W20260709 14:51:08.286978  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 955093us
I20260709 14:51:08.287858  7819 leader_election.cc:400] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 4 election: Vote denied by peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587) with higher term. Message: Invalid argument: T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 4. Current term is 5.
I20260709 14:51:08.288170  7819 leader_election.cc:403] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
W20260709 14:51:08.045984  7745 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.754s	user 0.023s	sys 0.032s
W20260709 14:51:08.288738  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 996748us
W20260709 14:51:08.052263  7845 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.750s	user 0.098s	sys 0.188s
I20260709 14:51:07.850921  7675 catalog_manager.cc:5697] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 2 to 4, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 4 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
W20260709 14:51:08.082121  8598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 52460.3us
W20260709 14:51:08.294322  7745 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:08.102017  9465 raft_consensus.cc:493] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
W20260709 14:51:08.105715  7894 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.828s	user 0.016s	sys 0.047s
W20260709 14:51:08.296316  7894 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.018s	user 0.017s	sys 0.048s
I20260709 14:51:08.005502  9458 raft_consensus.cc:493] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:07.824618  9475 raft_consensus.cc:493] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:51:08.040817  9479 leader_election.cc:290] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 3 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:07.953378  9487 raft_consensus.cc:493] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:51:08.096591  9471 raft_consensus.cc:3060] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:51:07.882766  9484 consensus_queue.cc:1048] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.238s
I20260709 14:51:08.112993  9365 raft_consensus.cc:493] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:51:08.120489  9372 raft_consensus.cc:493] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:08.025069  9495 raft_consensus.cc:493] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:51:08.142979  9456 raft_consensus.cc:493] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:08.099810  9460 raft_consensus.cc:493] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
W20260709 14:51:08.176780  9451 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.701s	user 0.017s	sys 0.010s
I20260709 14:51:08.310776  9449 raft_consensus.cc:2749] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587) with higher term. Message: Invalid argument: T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 4. Current term is 5.
W20260709 14:51:08.173877  9480 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.743s	user 0.011s	sys 0.042s
W20260709 14:51:08.208114  9459 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.809s	user 0.011s	sys 0.066s
W20260709 14:51:08.209256  9494 log.cc:927] Time spent T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 14:51:08.157157  9452 raft_consensus.cc:515] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:08.220805  9353 raft_consensus.cc:493] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:08.202797  9444 leader_election.cc:290] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 4 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:08.276990  6549 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 14:51:08.294402  7675 catalog_manager.cc:5697] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
W20260709 14:51:08.347396  9459 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.952s	user 0.012s	sys 0.066s
I20260709 14:51:08.250864  9501 raft_consensus.cc:493] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:51:08.298108  9378 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.726s	user 0.000s	sys 0.053s
W20260709 14:51:08.284600  9483 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.742s	user 0.016s	sys 0.017s
W20260709 14:51:08.179672  9474 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.003s	sys 0.013s
I20260709 14:51:08.328222  9487 raft_consensus.cc:515] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:08.344398  9480 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.943s	user 0.012s	sys 0.042s
W20260709 14:51:08.340118  9451 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.866s	user 0.017s	sys 0.010s
I20260709 14:51:08.310209  9475 raft_consensus.cc:515] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:08.327548  9496 raft_consensus.cc:493] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:08.357589  7675 catalog_manager.cc:5697] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
W20260709 14:51:08.280567  9369 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.662s	user 0.007s	sys 0.012s
I20260709 14:51:08.342460  9460 raft_consensus.cc:515] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:08.298044  9443 raft_consensus.cc:515] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:08.371490  9474 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.713s	user 0.004s	sys 0.013s
W20260709 14:51:08.367678  9378 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.795s	user 0.002s	sys 0.059s
I20260709 14:51:08.381649  9448 raft_consensus.cc:493] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:08.393659  9448 raft_consensus.cc:515] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:08.367410  9444 raft_consensus.cc:493] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:51:08.342643  9479 consensus_queue.cc:1048] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 14:51:08.328102  9372 raft_consensus.cc:515] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:08.338328  9458 raft_consensus.cc:515] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:08.310480  9465 raft_consensus.cc:515] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:08.369633  9483 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.841s	user 0.016s	sys 0.021s
I20260709 14:51:08.320494  9365 raft_consensus.cc:515] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:08.344766  9456 raft_consensus.cc:515] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:08.446846  9487 leader_election.cc:290] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:08.447255  9456 leader_election.cc:290] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:08.448163  9372 leader_election.cc:290] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:51:08.380317  9369 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.759s	user 0.007s	sys 0.012s
I20260709 14:51:08.342658  9495 raft_consensus.cc:515] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:08.450909  9475 leader_election.cc:290] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:08.363205  9353 raft_consensus.cc:515] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:08.451288  9495 leader_election.cc:290] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:08.452872  9353 leader_election.cc:290] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:08.452872  9460 leader_election.cc:290] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:08.451321  9462 leader_election.cc:290] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:08.455814  7845 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 1810) took 1247 ms. Trace:
I20260709 14:51:08.456518  9448 leader_election.cc:290] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:08.387115  9496 raft_consensus.cc:515] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:08.459530  9496 leader_election.cc:290] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:08.456530  7845 rpcz_store.cc:276] 0709 14:51:07.208407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:07.208672 (+   265us) service_pool.cc:224] Handling call
0709 14:51:07.209036 (+   364us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:51:07.216758 (+  7722us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:51:07.216787 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:51:07.242080 (+ 25293us) log.cc:844] Serialized 26 byte log entry
0709 14:51:08.455176 (+1213096us) spinlock_profiling.cc:243] Waited 37.6 ms on lock 0x7b540004b8a0. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf8090 00007fb68ae056b8 00007fb68ae8e92b 00007fb68ae8d83e 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2 00007fb6891c948c
0709 14:51:08.455260 (+    84us) raft_consensus.cc:1645] Marking committed up to 1
0709 14:51:08.455317 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:08.455399 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:51:08.455465 (+    66us) raft_consensus.cc:1685] finished
0709 14:51:08.455479 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:51:08.455734 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":932,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":8435,"spinlock_wait_cycles":86404992,"thread_start_us":999316,"threads_started":1,"wal-append.queue_time_us":932009}
I20260709 14:51:08.376456  9459 raft_consensus.cc:493] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:08.395149  7850 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49948 (request call id 2512) took 1161 ms. Trace:
I20260709 14:51:08.462121  7850 rpcz_store.cc:276] 0709 14:51:07.227469 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:07.235130 (+  7661us) service_pool.cc:224] Handling call
0709 14:51:07.235552 (+   422us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 14:51:07.240130 (+  4578us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:51:07.240181 (+    51us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 14:51:07.240924 (+   743us) log.cc:844] Serialized 52 byte log entry
0709 14:51:07.626671 (+385747us) raft_consensus.cc:1645] Marking committed up to 2
0709 14:51:07.626718 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:07.626881 (+   163us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:51:08.388107 (+761226us) raft_consensus.cc:1685] finished
0709 14:51:08.388133 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:51:08.388325 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":15976,"raft.run_cpu_time_us":294,"raft.run_wall_time_us":2554,"thread_start_us":276137,"threads_started":1,"wal-append.queue_time_us":547479}
I20260709 14:51:08.386070  9451 raft_consensus.cc:493] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:08.462154  9459 raft_consensus.cc:515] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:08.464809  9451 raft_consensus.cc:515] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:08.466336  9365 leader_election.cc:290] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:08.466993  9451 leader_election.cc:290] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:08.468750  9465 leader_election.cc:290] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:51:08.469930  9503 log.cc:927] Time spent T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.089s	user 0.000s	sys 0.001s
I20260709 14:51:08.412323  9474 raft_consensus.cc:493] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:08.471984  9474 raft_consensus.cc:515] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:08.468807  9443 leader_election.cc:290] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:08.351657  9502 consensus_queue.cc:1048] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 14:51:08.474573  9474 leader_election.cc:290] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:08.412982  9444 raft_consensus.cc:515] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:08.483839  9444 leader_election.cc:290] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:51:08.449452  9514 log.cc:927] Time spent T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 14:51:08.461053  9452 leader_election.cc:290] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 5 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:08.487700  9482 raft_consensus.cc:493] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:08.487914  9369 raft_consensus.cc:493] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:51:08.488415  9482 raft_consensus.cc:515] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:08.489040  9369 raft_consensus.cc:515] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:08.491637  9369 leader_election.cc:290] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:08.499588  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:08.506008  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:08.508755  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:08.509637  7926 raft_consensus.cc:3060] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:51:08.370272  9501 raft_consensus.cc:515] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:08.514112  7920 raft_consensus.cc:1275] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 14:51:08.512633  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:08.516721  7779 raft_consensus.cc:3060] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:51:08.513697  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18d29d52d304c87b930d4fb5eaf50b1" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:08.536339  7928 raft_consensus.cc:3060] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:51:08.544198  7926 raft_consensus.cc:2468] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 4.
I20260709 14:51:08.546927  7779 raft_consensus.cc:2468] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 4.
I20260709 14:51:08.574759  7926 raft_consensus.cc:1240] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 5. Current term is 6. Ops: []
I20260709 14:51:08.509963  9378 raft_consensus.cc:493] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:08.514775  9452 raft_consensus.cc:493] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:08.561339  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:08.610190  7928 raft_consensus.cc:2468] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 4.
I20260709 14:51:08.524926  9474 raft_consensus.cc:493] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:08.659080  9474 raft_consensus.cc:515] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:08.620215  9476 raft_consensus.cc:493] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:08.645746  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:08.645846  7921 raft_consensus.cc:2393] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 4: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:51:08.646802  9462 raft_consensus.cc:493] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:08.649328  9523 raft_consensus.cc:493] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:08.651160  9459 leader_election.cc:290] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:08.651646  9480 raft_consensus.cc:493] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:08.653467  9482 leader_election.cc:290] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:08.654783  9471 raft_consensus.cc:493] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:08.624573  9458 leader_election.cc:290] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:51:08.624612  9510 log.cc:927] Time spent T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 14:51:08.658058  9452 raft_consensus.cc:515] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:08.647171  9501 leader_election.cc:290] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:08.620179  9456 raft_consensus.cc:493] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:08.647084  9372 raft_consensus.cc:493] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:08.661422  9378 raft_consensus.cc:515] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:08.647233  9451 raft_consensus.cc:493] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:08.668344  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:51:08.643348  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 351541us
I20260709 14:51:08.670158  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:08.561782  9369 raft_consensus.cc:493] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:51:08.672314  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:08.861059  7845 raft_consensus.cc:3060] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:51:08.767690  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:08.860121  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:08.862296  7850 raft_consensus.cc:2393] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 4: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:51:08.769132  7853 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3"
dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:49948
I20260709 14:51:08.863489  7853 raft_consensus.cc:493] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:51:08.863900  7853 raft_consensus.cc:3060] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:51:08.792095  7848 raft_consensus.cc:1275] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 14:51:08.862473  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c563cc7cfbe4d59be4ffc5cf847ce56" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:08.866631  7847 raft_consensus.cc:2468] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 3.
I20260709 14:51:08.866459  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:08.868464  7920 raft_consensus.cc:2393] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 6: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:51:08.876225  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:08.877209  7854 raft_consensus.cc:2368] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 3. Current term is 4.
I20260709 14:51:08.887428  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:08.896620  7847 raft_consensus.cc:2468] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 4.
I20260709 14:51:08.898358  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783e4874513449ef9084b833f188a6d3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:08.899282  7847 raft_consensus.cc:2468] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 2.
I20260709 14:51:08.900849  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:08.902510  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:08.662863  7776 raft_consensus.cc:3060] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Advancing to term 4
W20260709 14:51:08.911181  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 238839us
I20260709 14:51:08.908432  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:08.912135  7850 raft_consensus.cc:3060] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:51:08.904806  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:08.914731  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:08.915683  7926 raft_consensus.cc:1275] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 14:51:08.662680  9496 raft_consensus.cc:493] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:08.814205  9365 raft_consensus.cc:493] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:08.813529  9461 raft_consensus.cc:493] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:51:08.806187  9475 raft_consensus.cc:493] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:08.813695  9520 raft_consensus.cc:493] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:08.662770  9476 raft_consensus.cc:515] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:08.814028  9465 raft_consensus.cc:493] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:08.813205  9379 raft_consensus.cc:493] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:51:08.768078  9526 consensus_queue.cc:1048] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.183s
I20260709 14:51:08.879770  9451 raft_consensus.cc:515] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:08.680613  9448 raft_consensus.cc:493] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:08.926275  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:08.931341  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:08.813846  9443 raft_consensus.cc:493] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:51:08.813707  9444 raft_consensus.cc:493] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:51:08.937019  7845 raft_consensus.cc:2468] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 6.
I20260709 14:51:08.739358  9474 leader_election.cc:290] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:08.814622  9516 consensus_queue.cc:1048] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.135s
I20260709 14:51:08.814388  9460 raft_consensus.cc:493] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:08.918756  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:51:08.969959  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 167813us
W20260709 14:51:09.320111  7744 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.101.67:40785 timed out after 2.076s (SENT)
I20260709 14:51:08.800761  9479 raft_consensus.cc:493] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:09.325147  9444 raft_consensus.cc:515] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:08.918437  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:08.950495  9496 raft_consensus.cc:515] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:09.082916  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:09.006716  7927 raft_consensus.cc:1275] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 14:51:09.347851  7742 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.629s	user 0.018s	sys 0.010s
W20260709 14:51:09.348300  7742 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.629s	user 0.018s	sys 0.010s
W20260709 14:51:09.348551  7742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.68:42321, user_credentials={real_user=slave}} blocked reactor thread for 678355us
I20260709 14:51:08.881860  9372 raft_consensus.cc:515] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:09.300976  9353 raft_consensus.cc:493] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
W20260709 14:51:09.052359  7774 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37136 (request call id 1758) took 2016 ms (client timeout 2100 ms). Trace:
I20260709 14:51:09.337841  9460 raft_consensus.cc:515] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:08.713800  9462 raft_consensus.cc:515] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:08.877051  9480 raft_consensus.cc:515] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:08.881953  9369 raft_consensus.cc:515] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:09.052557  9501 raft_consensus.cc:493] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:51:09.142668  9451 leader_election.cc:290] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:09.059283  9476 leader_election.cc:290] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:09.057574  9378 leader_election.cc:290] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:51:09.010998  9521 log.cc:927] Time spent T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 14:51:09.111380  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:08.877627  9471 raft_consensus.cc:515] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:08.881610  9456 raft_consensus.cc:515] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:08.960790  9360 log.cc:927] Time spent T 00000000000000000000000000000000 P 133636659113430cb53b321cb0b1d9ee: Append to log took a long time: real 0.298s	user 0.001s	sys 0.001s
I20260709 14:51:08.982012  9465 raft_consensus.cc:515] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:08.982048  9379 raft_consensus.cc:515] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:09.177875  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:08.968979  9520 raft_consensus.cc:515] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:08.965055  9475 raft_consensus.cc:515] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:09.147687  7928 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
 from {username='slave'} at 127.0.0.1:38532
I20260709 14:51:09.203075  9533 raft_consensus.cc:493] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:09.211309  7673 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54350 (request call id 360) took 2216 ms. Trace:
I20260709 14:51:09.380903  9456 leader_election.cc:290] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:09.085382  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:08.956401  9461 raft_consensus.cc:515] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:09.080406  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c563cc7cfbe4d59be4ffc5cf847ce56" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:09.402143  7779 raft_consensus.cc:2468] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 3.
I20260709 14:51:09.079414  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:09.070135  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:09.077522  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:08.954548  9365 raft_consensus.cc:515] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:09.235802  9449 raft_consensus.cc:493] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:09.184073  9535 raft_consensus.cc:493] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:09.374444  9378 raft_consensus.cc:493] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:09.292908  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:51:09.302978  7852 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.000s	sys 0.016s
I20260709 14:51:09.219398  7676 catalog_manager.cc:5697] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 3 to 4, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 4 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:51:08.926430  9500 raft_consensus.cc:493] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:51:09.328809  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:08.760869  9519 consensus_queue.cc:1048] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.240s
I20260709 14:51:09.339351  7894 leader_election.cc:400] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 3 election: Vote denied by peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529) with higher term. Message: Invalid argument: T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 3. Current term is 4.
I20260709 14:51:09.342723  7853 raft_consensus.cc:515] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:09.429868  7847 raft_consensus.cc:2468] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 1.
I20260709 14:51:09.301047  9526 raft_consensus.cc:493] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:09.005438  7846 raft_consensus.cc:1275] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 14:51:09.433709  7894 leader_election.cc:403] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
W20260709 14:51:09.428186  7852 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.636s	user 0.000s	sys 0.016s
I20260709 14:51:09.300701  9487 raft_consensus.cc:493] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:51:09.327195  9474 raft_consensus.cc:493] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:09.358404  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:09.362440  7924 raft_consensus.cc:1275] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 14:51:09.307361  9448 raft_consensus.cc:515] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:09.363564  9353 raft_consensus.cc:515] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:09.357213  7774 rpcz_store.cc:269] 0709 14:51:07.036317 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:07.043808 (+  7491us) service_pool.cc:224] Handling call
0709 14:51:09.051974 (+2008166us) spinlock_profiling.cc:243] Waited 1.35 s on lock 0x7b54002de6d4. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae922fa 00007fb68fe53b17 00007fb6893ce6d4 00007fb6893ce662 00007fb6893ce591 00007fb6893ce50c 00007fb6893cd7c2 00007fb6891c948c 00007fb6891c88c6 00007fb6891c826f
0709 14:51:09.052219 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3112445184}
I20260709 14:51:09.378027  9463 raft_consensus.cc:493] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:09.380089  9480 leader_election.cc:290] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:09.382926  7922 raft_consensus.cc:2393] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 4: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:51:09.383564  7850 raft_consensus.cc:2468] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 3.
I20260709 14:51:09.389381  7927 raft_consensus.cc:1275] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 14:51:09.389825  7920 raft_consensus.cc:1240] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 LEADER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 14:51:09.060444  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:09.404008  7772 raft_consensus.cc:2410] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 14:51:09.347339  9479 raft_consensus.cc:515] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:08.879081  9523 raft_consensus.cc:515] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:09.418952  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:09.367298  9501 raft_consensus.cc:515] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:09.354434  9443 raft_consensus.cc:515] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:09.435345  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 96230.8us
I20260709 14:51:09.430152  7676 catalog_manager.cc:5697] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 3 to 4, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 4 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:51:09.433888  7851 raft_consensus.cc:2468] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 5.
I20260709 14:51:09.501549  7853 leader_election.cc:290] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 3 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:09.442390  6549 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 14:51:09.782402  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 462440us
I20260709 14:51:09.963403  7849 raft_consensus.cc:2393] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 4: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:51:09.961508  7847 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 1819) took 1191 ms. Trace:
I20260709 14:51:09.429347  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:09.969614  7854 raft_consensus.cc:2393] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 4: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:51:09.962631  7894 leader_election.cc:304] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
W20260709 14:51:09.911661  7819 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.026s	sys 0.034s
I20260709 14:51:09.973551  7854 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 2542) took 1165 ms. Trace:
I20260709 14:51:09.973311  7852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 1825) took 1201 ms. Trace:
W20260709 14:51:09.973728  7819 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.581s	user 0.029s	sys 0.035s
I20260709 14:51:09.976079  7846 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49948 (request call id 2534) took 1309 ms. Trace:
I20260709 14:51:09.977802  7676 catalog_manager.cc:5697] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 3 to 4, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 4 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
W20260709 14:51:09.978747  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 585859us
I20260709 14:51:09.974293  7854 rpcz_store.cc:276] 0709 14:51:08.808374 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:09.428661 (+620287us) service_pool.cc:224] Handling call
0709 14:51:09.973483 (+544822us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 14:51:09.976563  7846 rpcz_store.cc:276] 0709 14:51:08.666983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:08.669121 (+  2138us) service_pool.cc:224] Handling call
0709 14:51:08.669614 (+   493us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:51:09.434660 (+765046us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:09.975726 (+541066us) spinlock_profiling.cc:243] Waited 334 ms on lock 0x7b54003b3654. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae8ee01 00007fb68ae8d83e 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2 00007fb6891c948c 00007fb6891c88c6
0709 14:51:09.975998 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":768035200}
I20260709 14:51:09.975147  7852 rpcz_store.cc:276] 0709 14:51:08.771980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:09.972252 (+1200272us) service_pool.cc:224] Handling call
0709 14:51:09.972585 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:51:09.972949 (+   364us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:51:09.972975 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:51:09.973016 (+    41us) raft_consensus.cc:1645] Marking committed up to 2
0709 14:51:09.973048 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:09.973105 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:51:09.973227 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 14:51:09.973191  7894 leader_election.cc:304] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:09.990684  7849 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49946 (request call id 1829) took 1217 ms. Trace:
I20260709 14:51:09.990049  7853 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:49948 (request call id 2527) took 1299 ms. Trace:
I20260709 14:51:09.981695  7676 catalog_manager.cc:5697] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:51:09.733610  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:09.984437  7850 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49946 (request call id 1827) took 1198 ms. Trace:
I20260709 14:51:09.991915  7853 rpcz_store.cc:276] 0709 14:51:08.664754 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:08.666702 (+  1948us) service_pool.cc:224] Handling call
0709 14:51:09.964236 (+1297534us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 14:51:09.999503  7850 rpcz_store.cc:276] 0709 14:51:08.772542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:08.908029 (+135487us) service_pool.cc:224] Handling call
0709 14:51:09.970820 (+1062791us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 14:51:09.991170  7849 rpcz_store.cc:276] 0709 14:51:08.783102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:09.418363 (+635261us) service_pool.cc:224] Handling call
0709 14:51:09.990603 (+572240us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 14:51:09.830242  7776 consensus_meta.cc:287] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent flushing consensus metadata: real 0.880s	user 0.007s	sys 0.008s
I20260709 14:51:10.000979  7853 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41650 (request call id 92) took 1184 ms. Trace:
I20260709 14:51:10.013971  7853 rpcz_store.cc:276] 0709 14:51:08.816509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:09.999966 (+1183457us) service_pool.cc:224] Handling call
0709 14:51:10.000379 (+   413us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:51:10.000590 (+   211us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:51:10.000614 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:51:10.000665 (+    51us) raft_consensus.cc:1645] Marking committed up to 6
0709 14:51:10.000712 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:10.000771 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:51:10.000909 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 14:51:10.015684  7851 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 2537) took 1347 ms. Trace:
I20260709 14:51:10.010568  7926 raft_consensus.cc:2393] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 6: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:51:09.501180  9369 leader_election.cc:290] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:10.016150  7851 rpcz_store.cc:276] 0709 14:51:08.667821 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:08.668052 (+   231us) service_pool.cc:224] Handling call
0709 14:51:10.014381 (+1346329us) spinlock_profiling.cc:243] Waited 574 ms on lock 0x7b54000d4654. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae922fa 00007fb68fe53b17 00007fb6893ce6d4 00007fb6893ce662 00007fb6893ce591 00007fb6893ce50c 00007fb6893cd7c2 00007fb6891c948c 00007fb6891c88c6 00007fb6891c826f
0709 14:51:10.015626 (+  1245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1321313536}
I20260709 14:51:09.818729  9475 leader_election.cc:290] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:09.968418  7847 rpcz_store.cc:276] 0709 14:51:08.770150 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:09.475400 (+705250us) service_pool.cc:224] Handling call
0709 14:51:09.960702 (+485302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:51:09.961081 (+   379us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:51:09.961109 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:51:09.961165 (+    56us) raft_consensus.cc:1645] Marking committed up to 3
0709 14:51:09.961200 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:09.961296 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:51:09.961438 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 14:51:09.640707  9444 leader_election.cc:290] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:09.736981  9542 raft_consensus.cc:493] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:51:09.811750  9461 leader_election.cc:290] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:09.500365  9525 raft_consensus.cc:493] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:51:09.641028  9488 raft_consensus.cc:2749] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529) with higher term. Message: Invalid argument: T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 3. Current term is 4.
I20260709 14:51:09.820236  9471 leader_election.cc:290] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:09.525949  9469 raft_consensus.cc:493] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:09.497558  9452 leader_election.cc:290] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:09.972440  9365 leader_election.cc:290] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:09.502087  9530 raft_consensus.cc:493] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:51:09.971832  9529 raft_consensus.cc:493] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:09.739701  9372 leader_election.cc:290] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:09.501616  7921 raft_consensus.cc:2468] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 5.
I20260709 14:51:09.837329  9496 leader_election.cc:290] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:09.973323  9462 leader_election.cc:290] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:09.972211  9379 leader_election.cc:290] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:09.809444  9520 leader_election.cc:290] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:09.443722  9378 raft_consensus.cc:515] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:10.085589  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
W20260709 14:51:10.086375  8598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 88509.9us
I20260709 14:51:10.002313  9516 raft_consensus.cc:2804] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 14:51:09.427429  9449 raft_consensus.cc:515] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:10.095471  7852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 1830) took 1279 ms. Trace:
I20260709 14:51:10.095054  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:09.479527  9500 raft_consensus.cc:515] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:09.984385  9487 raft_consensus.cc:515] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:09.432529  9535 raft_consensus.cc:515] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:10.014524  9484 raft_consensus.cc:2804] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 14:51:09.984828  9474 raft_consensus.cc:515] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:10.013916  7776 raft_consensus.cc:2468] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 4.
I20260709 14:51:09.475128  9526 raft_consensus.cc:515] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:10.027585  9456 raft_consensus.cc:493] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:51:09.433741  9533 raft_consensus.cc:515] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:10.113875  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 121461us
I20260709 14:51:10.172078  9516 raft_consensus.cc:493] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:51:10.093439  7919 raft_consensus.cc:1275] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 14:51:10.025769  9541 raft_consensus.cc:493] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:51:10.103502  9465 leader_election.cc:290] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:51:10.137959  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 164862us
I20260709 14:51:10.122784  7920 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "939996e77ee64e9fab21aef50758b706"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
mode: GRACEFUL
new_leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:48676
I20260709 14:51:10.225327  7920 raft_consensus.cc:606] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 LEADER]: Received request to transfer leadership to TS 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:51:10.227180  7894 leader_election.cc:304] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:09.391563  7673 rpcz_store.cc:276] 0709 14:51:06.994900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:06.995165 (+   265us) service_pool.cc:224] Handling call
0709 14:51:09.211137 (+2215972us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 14:51:08.351892 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 14:51:08.465723 (+113831us) write_op.cc:432] Acquiring schema lock in shared mode
0709 14:51:08.465766 (+    43us) write_op.cc:435] Acquired schema lock
0709 14:51:08.465789 (+    23us) tablet.cc:662] Decoding operations
0709 14:51:08.466184 (+   395us) write_op.cc:620] Acquiring the partition lock for write op
0709 14:51:08.466277 (+    93us) write_op.cc:641] Partition lock acquired for write op
0709 14:51:08.466314 (+    37us) tablet.cc:685] Acquiring locks for 1 operations
0709 14:51:08.466523 (+   209us) tablet.cc:701] Row locks acquired
0709 14:51:08.466543 (+    20us) write_op.cc:260] PREPARE: finished
0709 14:51:08.466747 (+   204us) write_op.cc:270] Start()
0709 14:51:08.466864 (+   117us) write_op.cc:276] Timestamp: P: 1783608668466676 usec, L: 0
0709 14:51:08.466886 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 14:51:08.467730 (+   844us) log.cc:844] Serialized 538 byte log entry
0709 14:51:08.658499 (+190769us) op_driver.cc:464] REPLICATION: finished
0709 14:51:08.810309 (+151810us) write_op.cc:301] APPLY: starting
0709 14:51:08.810404 (+    95us) tablet.cc:1367] starting BulkCheckPresence
0709 14:51:08.810519 (+   115us) tablet.cc:1370] finished BulkCheckPresence
0709 14:51:08.810688 (+   169us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 14:51:08.810974 (+   286us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 14:51:08.811183 (+   209us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 14:51:08.811230 (+    47us) write_op.cc:312] APPLY: finished
0709 14:51:08.811446 (+   216us) log.cc:844] Serialized 23 byte log entry
0709 14:51:08.811626 (+   180us) write_op.cc:489] Releasing partition, row and schema locks
0709 14:51:08.811707 (+    81us) write_op.cc:454] Released schema lock
0709 14:51:08.811745 (+    38us) write_op.cc:341] FINISH: Updating metrics
0709 14:51:08.812350 (+   605us) write_op.cc:489] Releasing partition, row and schema locks
0709 14:51:08.812394 (+    44us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":71582,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":151475,"apply.run_cpu_time_us":1834,"apply.run_wall_time_us":1833,"num_ops":1,"prepare.queue_time_us":650894,"prepare.run_cpu_time_us":3688,"prepare.run_wall_time_us":129980,"replication_time_us":191403,"thread_start_us":608163,"threads_started":2}]]}
I20260709 14:51:10.160459  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:10.096308  9460 leader_election.cc:290] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:10.175312  7852 rpcz_store.cc:276] 0709 14:51:08.815818 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:10.002404 (+1186586us) service_pool.cc:224] Handling call
0709 14:51:10.016781 (+ 14377us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:51:10.017023 (+   242us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:51:10.017047 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:51:10.017088 (+    41us) raft_consensus.cc:1645] Marking committed up to 5
0709 14:51:10.017124 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:10.017175 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:51:10.095185 (+ 78010us) spinlock_profiling.cc:243] Waited 14 ms on lock 0x7b54000d4650. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae8d8ad 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2 00007fb6891c948c 00007fb6891c88c6 00007fb6891c826f
0709 14:51:10.095376 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":32181120}
W20260709 14:51:10.215866  7776 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37136 (request call id 1770) took 1703 ms (client timeout 2163 ms). Trace:
W20260709 14:51:10.238385  7776 rpcz_store.cc:269] 0709 14:51:08.512818 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:08.524946 (+ 12128us) service_pool.cc:224] Handling call
0709 14:51:10.210305 (+1685359us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 14:51:10.198143  9484 raft_consensus.cc:493] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:51:10.240054  9479 leader_election.cc:290] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:10.181699  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c563cc7cfbe4d59be4ffc5cf847ce56" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:10.241072  9501 leader_election.cc:290] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:10.194331  7778 raft_consensus.cc:3060] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:51:10.243010  9378 leader_election.cc:290] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:10.159500  9452 raft_consensus.cc:493] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:10.201645  9517 raft_consensus.cc:493] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:10.220119  9516 raft_consensus.cc:3060] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:51:10.140329  9471 raft_consensus.cc:493] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:51:10.092567  9542 raft_consensus.cc:515] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:10.165870  9372 raft_consensus.cc:493] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:51:10.021790  9480 raft_consensus.cc:493] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:51:10.172963  9475 raft_consensus.cc:493] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:51:10.171365  9530 raft_consensus.cc:515] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:10.211378  7742 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.849s	user 0.007s	sys 0.004s
I20260709 14:51:10.161104  9529 raft_consensus.cc:515] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:10.168219  9547 consensus_queue.cc:1048] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.051s
I20260709 14:51:10.213743  7848 raft_consensus.cc:2468] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 3.
W20260709 14:51:10.208356  7923 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.875s	user 0.000s	sys 0.029s
W20260709 14:51:10.266372  7923 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.933s	user 0.000s	sys 0.030s
I20260709 14:51:10.216976  7819 leader_election.cc:304] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:10.222867  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:10.113701  9525 raft_consensus.cc:515] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:10.209800  9532 raft_consensus.cc:493] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:51:10.160334  9469 raft_consensus.cc:515] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:10.236112  9533 leader_election.cc:290] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:10.213202  9456 raft_consensus.cc:515] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:10.012926  9463 raft_consensus.cc:515] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:10.251336  7778 raft_consensus.cc:2468] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 5.
I20260709 14:51:10.251083  7846 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 1828) took 1478 ms. Trace:
I20260709 14:51:10.244503  9452 raft_consensus.cc:515] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:10.249805  7894 leader_election.cc:304] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:10.298640  7846 rpcz_store.cc:276] 0709 14:51:08.772836 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:09.988652 (+1215816us) service_pool.cc:224] Handling call
0709 14:51:09.988923 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:51:10.206077 (+217154us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:51:10.206114 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:51:10.206167 (+    53us) raft_consensus.cc:1645] Marking committed up to 2
0709 14:51:10.206202 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:10.250786 (+ 44584us) spinlock_profiling.cc:243] Waited 210 ms on lock 0x7b54003809d4. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae8ee01 00007fb68ae8d83e 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2 00007fb6891c948c 00007fb6891c88c6
0709 14:51:10.250841 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:51:10.251013 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15015,"raft.queue_time_us":7356,"raft.run_cpu_time_us":196,"raft.run_wall_time_us":12660,"spinlock_wait_cycles":483865856}
W20260709 14:51:10.256930  7742 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.894s	user 0.007s	sys 0.004s
I20260709 14:51:10.263572  7921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38532 (request call id 2368) took 1403 ms. Trace:
I20260709 14:51:10.264773  7919 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38516 (request call id 1742) took 1763 ms. Trace:
W20260709 14:51:10.267201  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 50345.7us
I20260709 14:51:10.304335  7845 raft_consensus.cc:2468] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 4.
I20260709 14:51:10.275676  7926 raft_consensus.cc:2393] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 4: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:51:10.245854  9517 raft_consensus.cc:515] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:10.269829  9475 raft_consensus.cc:515] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:10.278820  7848 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49946 (request call id 1824) took 1507 ms (client timeout 1767 ms). Trace:
I20260709 14:51:10.279080  9523 leader_election.cc:290] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:10.270849  9372 raft_consensus.cc:515] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:10.272851  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
W20260709 14:51:10.256691  9548 log.cc:927] Time spent T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 14:51:10.240187  9449 leader_election.cc:290] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:10.252059  9484 raft_consensus.cc:3060] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:51:10.289160  7675 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54344 (request call id 361) took 2623 ms. Trace:
I20260709 14:51:10.238786  9535 leader_election.cc:290] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:51:10.303073  7742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:10.306607  7819 leader_election.cc:304] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 9418391fa82a42c79c6cad13ba91d964
I20260709 14:51:10.281723  9539 raft_consensus.cc:2804] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Leader election won for term 4
I20260709 14:51:10.296401  9443 leader_election.cc:290] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:10.304749  9487 leader_election.cc:290] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:51:10.378675  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 72176us
I20260709 14:51:10.269610  9480 raft_consensus.cc:515] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:10.304061  7919 rpcz_store.cc:276] 0709 14:51:08.501045 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:08.503254 (+  2209us) service_pool.cc:224] Handling call
0709 14:51:09.207135 (+703881us) spinlock_profiling.cc:243] Waited 34.8 ms on lock 0x7b5800200198. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb687c29db1 00007fb687d69b71 00007fb687d69a22 00007fb690c82c09 00007fb68fddcee0 00007fb68fea60ab 00007fb68fea6131 00007fb68fe67fc0 00007fb68fe52929 00007fb68fe523d2 00007fb6893c9bd4
0709 14:51:09.207541 (+   406us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:51:10.223124 (+1015583us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:10.264376 (+ 41252us) spinlock_profiling.cc:243] Waited 807 ms on lock 0x7b5400451ad4. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae8ee01 00007fb68ae8d83e 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2 00007fb6891c948c 00007fb6891c88c6
0709 14:51:10.264591 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1936883328}
I20260709 14:51:10.295680  9500 leader_election.cc:290] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:10.261162  9471 raft_consensus.cc:515] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:10.295888  9448 leader_election.cc:290] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:10.358135  9469 leader_election.cc:290] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:10.291227  9542 leader_election.cc:290] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:10.293186  9456 leader_election.cc:290] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:10.259982  9550 raft_consensus.cc:2804] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 14:51:10.392244  9550 raft_consensus.cc:493] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:51:10.393090  9550 raft_consensus.cc:3060] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:51:10.365795  7920 raft_consensus.cc:2393] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 3: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:51:10.394925  9530 leader_election.cc:290] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:10.366073  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:10.395725  7926 raft_consensus.cc:2468] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 4.
I20260709 14:51:10.396334  9452 leader_election.cc:290] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:10.385077  9539 raft_consensus.cc:697] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:51:10.399700  9463 leader_election.cc:290] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:51:10.360100  7848 rpcz_store.cc:269] 0709 14:51:08.771696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:08.886916 (+115220us) service_pool.cc:224] Handling call
0709 14:51:10.278636 (+1391720us) spinlock_profiling.cc:243] Waited 911 ms on lock 0x7b5400442fd4. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae922fa 00007fb68fe53b17 00007fb6893ce6d4 00007fb6893ce662 00007fb6893ce591 00007fb6893ce50c 00007fb6893cd7c2 00007fb6891c948c 00007fb6891c88c6 00007fb6891c826f
0709 14:51:10.278744 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2094843136}
I20260709 14:51:10.384842  9535 raft_consensus.cc:493] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:51:10.383724  7776 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375"
dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
mode: GRACEFUL
new_leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
 from {username='slave'} at 127.0.0.1:47068
I20260709 14:51:10.318405  9534 consensus_queue.cc:1059] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.058s
I20260709 14:51:10.387733  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258d6c2dda954bf5b65930fde8ecb9f3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:10.370846  7675 rpcz_store.cc:276] 0709 14:51:07.666132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:07.666352 (+   220us) service_pool.cc:224] Handling call
0709 14:51:10.289038 (+2622686us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 14:51:08.468317 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 14:51:08.468848 (+   531us) write_op.cc:432] Acquiring schema lock in shared mode
0709 14:51:08.468879 (+    31us) write_op.cc:435] Acquired schema lock
0709 14:51:08.468892 (+    13us) tablet.cc:662] Decoding operations
0709 14:51:08.491790 (+ 22898us) write_op.cc:620] Acquiring the partition lock for write op
0709 14:51:08.491844 (+    54us) write_op.cc:641] Partition lock acquired for write op
0709 14:51:08.491870 (+    26us) tablet.cc:685] Acquiring locks for 3 operations
0709 14:51:08.492193 (+   323us) tablet.cc:701] Row locks acquired
0709 14:51:08.492207 (+    14us) write_op.cc:260] PREPARE: finished
0709 14:51:08.492368 (+   161us) write_op.cc:270] Start()
0709 14:51:08.492466 (+    98us) write_op.cc:276] Timestamp: P: 1783608668492310 usec, L: 0
0709 14:51:08.492482 (+    16us) op_driver.cc:348] REPLICATION: starting
0709 14:51:08.577467 (+ 84985us) log.cc:844] Serialized 1308 byte log entry
0709 14:51:10.081814 (+1504347us) op_driver.cc:464] REPLICATION: finished
0709 14:51:10.262081 (+180267us) write_op.cc:301] APPLY: starting
0709 14:51:10.262203 (+   122us) tablet.cc:1367] starting BulkCheckPresence
0709 14:51:10.262375 (+   172us) tablet.cc:1370] finished BulkCheckPresence
0709 14:51:10.262504 (+   129us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 14:51:10.263051 (+   547us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 14:51:10.263304 (+   253us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 14:51:10.263347 (+    43us) write_op.cc:312] APPLY: finished
0709 14:51:10.263628 (+   281us) log.cc:844] Serialized 35 byte log entry
0709 14:51:10.263926 (+   298us) write_op.cc:489] Releasing partition, row and schema locks
0709 14:51:10.264039 (+   113us) write_op.cc:454] Released schema lock
0709 14:51:10.264080 (+    41us) write_op.cc:341] FINISH: Updating metrics
0709 14:51:10.264585 (+   505us) write_op.cc:489] Releasing partition, row and schema locks
0709 14:51:10.264622 (+    37us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":170691,"apply.run_cpu_time_us":2477,"apply.run_wall_time_us":2476,"num_ops":3,"prepare.queue_time_us":60051,"prepare.run_cpu_time_us":3517,"prepare.run_wall_time_us":152851,"replication_time_us":1589135,"thread_start_us":146038,"threads_started":1}]]}
I20260709 14:51:10.247534  9541 raft_consensus.cc:515] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:10.400053  9529 leader_election.cc:290] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:10.380105  7819 leader_election.cc:304] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:10.297796  9532 raft_consensus.cc:515] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:51:10.392357  9525 leader_election.cc:290] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:10.404098  9372 leader_election.cc:290] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:10.408460  9526 leader_election.cc:290] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:10.407387  7776 raft_consensus.cc:606] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 LEADER]: Received request to transfer leadership to TS 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:10.408497  9534 raft_consensus.cc:3055] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 LEADER]: Stepping down as leader of term 5
I20260709 14:51:10.382066  9449 raft_consensus.cc:2749] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 14:51:10.419862  9532 leader_election.cc:290] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:10.424132  9534 raft_consensus.cc:740] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:51:10.424569  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:10.417954  7923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38532 (request call id 2381) took 1405 ms. Trace:
I20260709 14:51:10.401690  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:10.409183  9535 raft_consensus.cc:515] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:10.426584  9479 raft_consensus.cc:2804] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 14:51:10.302053  7921 rpcz_store.cc:276] 0709 14:51:08.860198 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:08.863189 (+  2991us) service_pool.cc:224] Handling call
0709 14:51:10.263354 (+1400165us) spinlock_profiling.cc:243] Waited 154 ms on lock 0x7b540041cdd4. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae922fa 00007fb68fe53b17 00007fb6893ce6d4 00007fb6893ce662 00007fb6893ce591 00007fb6893ce50c 00007fb6893cd7c2 00007fb6891c948c 00007fb6891c88c6 00007fb6891c826f
0709 14:51:10.263477 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":354618752}
I20260709 14:51:10.417825  7928 raft_consensus.cc:493] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:51:10.425909  7924 raft_consensus.cc:2393] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 6: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
W20260709 14:51:10.424853  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 175166us
I20260709 14:51:10.429317  7928 raft_consensus.cc:3060] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:51:10.426944  9534 consensus_queue.cc:260] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:10.428853  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18d29d52d304c87b930d4fb5eaf50b1" candidate_uuid: "9418391fa82a42c79c6cad13ba91d964" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:10.431022  9534 raft_consensus.cc:3060] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:51:10.431125  7848 raft_consensus.cc:2468] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9418391fa82a42c79c6cad13ba91d964 in term 2.
I20260709 14:51:10.431156  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18d29d52d304c87b930d4fb5eaf50b1" candidate_uuid: "9418391fa82a42c79c6cad13ba91d964" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:10.400508  9475 leader_election.cc:290] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:10.428813  7819 leader_election.cc:304] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:10.437512  7928 raft_consensus.cc:515] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:10.438890  7894 leader_election.cc:304] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:10.413998  9500 raft_consensus.cc:2804] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Leader election won for term 4
I20260709 14:51:10.444806  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:10.445041  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:10.445772  7776 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a18d29d52d304c87b930d4fb5eaf50b1"
dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
mode: GRACEFUL
new_leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:47068
I20260709 14:51:10.431787  9479 raft_consensus.cc:697] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
W20260709 14:51:10.446730  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:10.442785  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:10.443070  7846 raft_consensus.cc:1275] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 14:51:10.442008  7819 leader_election.cc:304] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:10.451860  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:10.425388  7923 rpcz_store.cc:276] 0709 14:51:09.012976 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:09.013338 (+   362us) service_pool.cc:224] Handling call
0709 14:51:09.013751 (+   413us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:51:09.014019 (+   268us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 14:51:09.332662 (+318643us) log.cc:844] Serialized 14 byte log entry
0709 14:51:10.268590 (+935928us) log.cc:844] Serialized 14 byte log entry
0709 14:51:10.417344 (+148754us) spinlock_profiling.cc:243] Waited 8.31 ms on lock 0x7b1800241420. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb690c69de1 00007fb690c765b1 00007fb687d1bc0a 00007fb69145b219 00007fb687da3a40 00007fb687d9e4e4 00007fb687d9e455 00007fb68ae86060 00007fb68ae98716 00007fb68aea9287 00007fb68aea9208
0709 14:51:10.417537 (+   193us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:51:10.417588 (+    51us) raft_consensus.cc:1645] Marking committed up to 4
0709 14:51:10.417638 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:10.417741 (+   103us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:51:10.417900 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":147827,"prepare.queue_time_us":613409,"prepare.run_cpu_time_us":87,"prepare.run_wall_time_us":91,"raft.queue_time_us":151299,"raft.run_cpu_time_us":202,"raft.run_wall_time_us":203,"spinlock_wait_cycles":19121408,"thread_start_us":1223051,"threads_started":2,"wal-append.queue_time_us":975722}
I20260709 14:51:10.458823  7854 raft_consensus.cc:2468] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 4.
I20260709 14:51:10.445628  9379 raft_consensus.cc:2804] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 14:51:10.446717  7776 raft_consensus.cc:606] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 LEADER]: Received request to transfer leadership to TS 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:10.449117  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:10.466050  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:10.466348  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:10.468705  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c563cc7cfbe4d59be4ffc5cf847ce56" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:10.470636  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:10.471437  7922 raft_consensus.cc:2468] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 4.
I20260709 14:51:10.472913  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:10.474741  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:10.475669  7922 raft_consensus.cc:2468] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 6.
I20260709 14:51:10.474704  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:10.476958  7778 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37136 (request call id 1781) took 1394 ms. Trace:
I20260709 14:51:10.477600  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:10.480814  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:10.467025  7920 raft_consensus.cc:2468] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 2.
I20260709 14:51:10.478783  7778 rpcz_store.cc:276] 0709 14:51:09.082764 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:09.084994 (+  2230us) service_pool.cc:224] Handling call
0709 14:51:10.476787 (+1391793us) spinlock_profiling.cc:243] Waited 797 ms on lock 0x7b54002549d4. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae922fa 00007fb68fe53b17 00007fb6893ce6d4 00007fb6893ce662 00007fb6893ce591 00007fb6893ce50c 00007fb6893cd7c2 00007fb6891c948c 00007fb6891c88c6 00007fb6891c826f
0709 14:51:10.476904 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1833043200}
W20260709 14:51:10.486490  7845 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49946 (request call id 1821) took 1715 ms (client timeout 2227 ms). Trace:
W20260709 14:51:10.487210  7845 rpcz_store.cc:269] 0709 14:51:08.770865 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:09.328234 (+557369us) service_pool.cc:224] Handling call
0709 14:51:10.486123 (+1157889us) spinlock_profiling.cc:243] Waited 344 ms on lock 0x7b5400320354. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae922fa 00007fb68fe53b17 00007fb6893ce6d4 00007fb6893ce662 00007fb6893ce591 00007fb6893ce50c 00007fb6893cd7c2 00007fb6891c948c 00007fb6891c88c6 00007fb6891c826f
0709 14:51:10.486394 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":791011200}
I20260709 14:51:10.488320  8599 leader_election.cc:304] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac, 9418391fa82a42c79c6cad13ba91d964; no voters: 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:51:10.488879  9353 leader_election.cc:290] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:51:10.496050  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 54114.7us
I20260709 14:51:10.448029  9547 raft_consensus.cc:2804] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 14:51:10.503486  7819 leader_election.cc:304] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:10.504573  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:10.496495  7850 raft_consensus.cc:1240] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 4. Current term is 5. Ops: []
I20260709 14:51:10.477494  9379 raft_consensus.cc:493] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:51:10.491735  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:10.541862  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:10.463346  9500 raft_consensus.cc:697] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:51:10.556034  7845 raft_consensus.cc:2468] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 5.
W20260709 14:51:10.550171  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 46821.2us
W20260709 14:51:10.535331  8599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 47254.4us
I20260709 14:51:10.460963  9479 consensus_queue.cc:237] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:10.556577  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:10.538501  7894 leader_election.cc:304] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:10.509433  9452 raft_consensus.cc:2749] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 14:51:10.561906  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:10.565117  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:10.536995  9547 raft_consensus.cc:493] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:10.568790  7894 leader_election.cc:304] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:10.572362  7777 raft_consensus.cc:2468] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 3.
I20260709 14:51:10.564836  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:10.578807  7778 raft_consensus.cc:1275] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 14:51:10.584383  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:10.585419  7850 raft_consensus.cc:2468] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 5.
I20260709 14:51:10.557490  9476 raft_consensus.cc:2804] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader election won for term 5
I20260709 14:51:10.400187  9539 consensus_queue.cc:237] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:10.555603  9379 raft_consensus.cc:3060] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:51:10.586357  7894 leader_election.cc:304] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:10.549564  9461 consensus_queue.cc:1048] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 14:51:10.596827  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:10.575830  9547 raft_consensus.cc:3060] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:51:10.576248  9535 leader_election.cc:290] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:10.580840  9460 raft_consensus.cc:2804] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 14:51:10.612921  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:10.582479  9531 raft_consensus.cc:2804] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 14:51:10.609736  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:10.610357  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:10.610984  7924 raft_consensus.cc:1275] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 14:51:10.612528  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:10.613349  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:10.559024  9559 raft_consensus.cc:2804] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 14:51:10.615981  7920 raft_consensus.cc:2468] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 3.
I20260709 14:51:10.587653  9443 consensus_queue.cc:1059] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 14:51:10.617947  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:10.618649  7926 raft_consensus.cc:3060] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:51:10.611910  9465 raft_consensus.cc:2804] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 14:51:10.604497  9501 consensus_queue.cc:1048] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 14:51:10.621837  9465 raft_consensus.cc:493] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:51:10.622417  9465 raft_consensus.cc:3060] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:51:10.575664  9372 consensus_queue.cc:1048] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.038s
I20260709 14:51:10.613603  9460 raft_consensus.cc:493] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:51:10.627182  9460 raft_consensus.cc:3060] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:51:10.629834  9541 leader_election.cc:290] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:10.618162  9443 raft_consensus.cc:3055] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 14:51:10.608601  7819 connection.cc:256] RPC call timeout handler was delayed by -1.7202890930000194s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1776s for a response
I20260709 14:51:10.650452  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:10.655563  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:10.616168  9476 raft_consensus.cc:697] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:51:10.644140  9443 raft_consensus.cc:740] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:10.635726  9559 raft_consensus.cc:493] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:51:10.737228  9559 raft_consensus.cc:3060] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:51:10.616746  9531 raft_consensus.cc:493] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:51:10.662061  9448 raft_consensus.cc:493] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:51:10.738281  9480 leader_election.cc:290] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:10.642253  9500 consensus_queue.cc:237] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:10.741546  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:10.741145  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
W20260709 14:51:10.759218  7742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:10.748849  7926 raft_consensus.cc:2468] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 3.
I20260709 14:51:10.862747  7927 raft_consensus.cc:2393] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 6: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:51:10.861152  7923 raft_consensus.cc:2468] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 5.
I20260709 14:51:10.864466  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:10.865331  7923 raft_consensus.cc:2468] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 4.
I20260709 14:51:10.929078  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:10.663192  9525 raft_consensus.cc:493] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:51:10.930078  7926 raft_consensus.cc:2468] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 3.
I20260709 14:51:10.932152  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:10.930650  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c563cc7cfbe4d59be4ffc5cf847ce56" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:10.938836  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:10.939235  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:10.943102  7849 raft_consensus.cc:2393] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 3: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:51:10.943812  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258d6c2dda954bf5b65930fde8ecb9f3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:10.944525  7849 raft_consensus.cc:1275] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 14:51:10.944968  7851 raft_consensus.cc:2410] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 14:51:10.812759  9487 raft_consensus.cc:493] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:51:10.949374  9552 raft_consensus.cc:493] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:51:10.948990  9487 raft_consensus.cc:515] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:10.950273  9552 raft_consensus.cc:515] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:10.951768  9487 leader_election.cc:290] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:10.934480  9443 consensus_queue.cc:260] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:10.952893  9552 leader_election.cc:290] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:10.953732  9443 raft_consensus.cc:3060] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:51:10.964051  9547 raft_consensus.cc:515] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:10.964872  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:10.740092  7921 raft_consensus.cc:1275] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 14:51:10.662072  9516 raft_consensus.cc:515] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:10.955948  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:10.867154  9531 raft_consensus.cc:3060] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:51:10.977885  7850 raft_consensus.cc:1240] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 3. Current term is 4. Ops: []
I20260709 14:51:10.977165  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
W20260709 14:51:10.937600  9550 consensus_meta.cc:287] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0: Time spent flushing consensus metadata: real 0.525s	user 0.005s	sys 0.010s
I20260709 14:51:10.928208  9475 raft_consensus.cc:493] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:51:10.981431  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:10.982079  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:10.984836  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:10.988397  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:51:10.989034  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:10.937325  9452 raft_consensus.cc:493] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
W20260709 14:51:10.982368  9484 consensus_meta.cc:287] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent flushing consensus metadata: real 0.600s	user 0.009s	sys 0.004s
I20260709 14:51:10.928663  9448 raft_consensus.cc:515] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:11.004276  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:11.012123  7926 raft_consensus.cc:2393] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 4: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:51:11.004244  7927 raft_consensus.cc:2393] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 6: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:51:11.013934  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:10.980578  9372 raft_consensus.cc:493] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:51:10.775467  9476 consensus_queue.cc:237] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:10.967168  9525 raft_consensus.cc:515] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:10.993675  9475 raft_consensus.cc:515] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:11.026991  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:10.985829  9550 raft_consensus.cc:515] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:11.026823  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:11.033129  7850 raft_consensus.cc:2468] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 6.
W20260709 14:51:11.016062  9534 consensus_meta.cc:287] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent flushing consensus metadata: real 0.575s	user 0.007s	sys 0.005s
I20260709 14:51:10.996256  9379 raft_consensus.cc:515] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:11.041798  7849 raft_consensus.cc:2410] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for term 6 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 14:51:11.043588  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:11.007594  9452 raft_consensus.cc:515] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:11.046499  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:11.017014  9484 raft_consensus.cc:515] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:11.058405  7927 raft_consensus.cc:2393] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 4: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:51:11.058207  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:11.060786  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:11.061883  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:11.065025  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:11.067313  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:11.067828  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:11.025425  9372 raft_consensus.cc:515] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:11.069185  7925 raft_consensus.cc:2468] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 4.
I20260709 14:51:11.070315  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:11.071671  7925 raft_consensus.cc:2468] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 4.
I20260709 14:51:11.074311  9550 leader_election.cc:290] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 2 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:11.076161  9484 leader_election.cc:290] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 3 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:11.076021  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:11.076859  9452 leader_election.cc:290] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:11.078418  9516 leader_election.cc:290] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 5 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:11.096843  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:11.083278  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:11.072712  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:11.102296  7778 raft_consensus.cc:2368] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 3. Current term is 4.
I20260709 14:51:11.102026  7850 raft_consensus.cc:2376] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 6. Re-sending same reply.
I20260709 14:51:11.104019  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:11.104895  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:11.105520  7779 raft_consensus.cc:3060] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:51:11.105897  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:11.107086  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:11.108409  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783e4874513449ef9084b833f188a6d3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:11.108624  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:11.111737  9547 leader_election.cc:290] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 4 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:11.055681  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:11.113585  9517 leader_election.cc:290] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:11.114346  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:11.117691  7774 raft_consensus.cc:2393] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 6: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:51:11.119237  9525 leader_election.cc:290] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:11.101748  9534 raft_consensus.cc:493] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:51:11.124173  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:11.122143  9534 raft_consensus.cc:515] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:11.128641  9379 leader_election.cc:290] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 4 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:11.129822  7776 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3"
dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
mode: GRACEFUL
new_leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
 from {username='slave'} at 127.0.0.1:47068
I20260709 14:51:11.130612  7776 raft_consensus.cc:606] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 LEADER]: Received request to transfer leadership to TS 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:11.120746  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c563cc7cfbe4d59be4ffc5cf847ce56" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:11.131726  7853 raft_consensus.cc:2393] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 4: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:51:11.132740  7779 raft_consensus.cc:2468] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 6.
I20260709 14:51:11.133837  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:11.134581  7776 raft_consensus.cc:3060] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Advancing to term 3
W20260709 14:51:11.130196  9562 log.cc:927] Time spent T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
I20260709 14:51:11.136619  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:11.139407  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:11.143746  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:11.116055  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:11.151124  7776 raft_consensus.cc:2468] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 3.
I20260709 14:51:11.149052  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:11.154716  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:11.155742  7845 raft_consensus.cc:2468] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 5.
I20260709 14:51:11.157192  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:11.157696  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:11.160898  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:11.161767  7779 raft_consensus.cc:2393] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 4: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:51:11.063237  9465 raft_consensus.cc:515] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:11.135818  9449 raft_consensus.cc:493] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:51:11.167753  7776 raft_consensus.cc:1240] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 4. Current term is 5. Ops: []
I20260709 14:51:11.176136  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:11.180186  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:11.184695  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:11.205580  7925 raft_consensus.cc:2393] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 6: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:51:11.160454  7921 raft_consensus.cc:2468] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 4.
W20260709 14:51:11.218813  9460 consensus_meta.cc:287] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0: Time spent flushing consensus metadata: real 0.591s	user 0.011s	sys 0.002s
I20260709 14:51:11.219568  9460 raft_consensus.cc:515] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:11.178969  9449 raft_consensus.cc:515] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:11.237697  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:11.224928  7928 leader_election.cc:290] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:11.221865  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:11.254451  7676 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54364 (request call id 332) took 2461 ms. Trace:
I20260709 14:51:11.297727  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:11.296530  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:11.239131  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:11.303503  7846 raft_consensus.cc:2468] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 4.
I20260709 14:51:11.304451  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:11.305295  7773 raft_consensus.cc:2468] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 4.
I20260709 14:51:11.267524  9559 raft_consensus.cc:515] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:51:11.303370  7854 raft_consensus.cc:2468] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 2.
I20260709 14:51:11.307343  8637 raft_consensus.cc:1240] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 [term 3 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 2. Current term is 3. Ops: []
I20260709 14:51:11.310734  7928 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:38532 (request call id 2385) took 2148 ms. Trace:
I20260709 14:51:11.311883  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:11.312667  7920 raft_consensus.cc:2393] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 6: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:51:11.303035  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:11.320456  7846 raft_consensus.cc:1240] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 2. Current term is 3. Ops: []
I20260709 14:51:11.311367  7928 rpcz_store.cc:276] 0709 14:51:09.147182 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:09.147512 (+   330us) service_pool.cc:224] Handling call
0709 14:51:10.628335 (+1480823us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b54000f9e54. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae85a3d 00007fb68fe55cd0 00007fb6893da254 00007fb6893da1e2 00007fb6893da111 00007fb6893da08c 00007fb6893d9342 00007fb6891c948c 00007fb6891c88c6 00007fb6891c826f
0709 14:51:11.224776 (+596441us) spinlock_profiling.cc:243] Waited 7.4 ms on lock 0x7b4c0026f700. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68915aa20 00007fb68916ba29 00007fb68916c13f 00007fb6891302ab 00007fb68915df3c 00007fb68915e3fe 00007fb6893eb88b 00007fb68adea495 00007fb68ae3b30f 00007fb68ae85a55 00007fb68fe55cd0
0709 14:51:11.293988 (+ 69212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2377798784}
I20260709 14:51:11.306440  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:11.297655  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
W20260709 14:51:11.272541  9569 log.cc:927] Time spent T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.126s	user 0.000s	sys 0.003s
I20260709 14:51:11.328636  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:11.328193  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:11.329777  7775 raft_consensus.cc:2468] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 2.
I20260709 14:51:11.330504  7923 raft_consensus.cc:2393] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 5: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:51:11.327000  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:11.219962  9372 leader_election.cc:290] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:11.328197  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:11.223675  9471 leader_election.cc:290] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:11.218983  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:11.333485  7770 raft_consensus.cc:2410] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 14:51:11.333864  7924 raft_consensus.cc:1275] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 14:51:11.306317  9474 leader_election.cc:290] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:11.337949  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:11.342075  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783e4874513449ef9084b833f188a6d3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:11.345131  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:11.347112  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:11.349643  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:11.331287  7773 raft_consensus.cc:2468] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 5.
I20260709 14:51:11.350943  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:11.357007  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18d29d52d304c87b930d4fb5eaf50b1" candidate_uuid: "9418391fa82a42c79c6cad13ba91d964" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:11.357663  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:11.358529  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:11.359566  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:11.360591  7770 raft_consensus.cc:3055] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 LEADER]: Stepping down as leader of term 5
I20260709 14:51:11.360939  7770 raft_consensus.cc:740] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:51:11.363799  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:11.223788  9531 raft_consensus.cc:515] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:11.353506  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:11.369572  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:11.370657  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
W20260709 14:51:11.363250  9571 log.cc:927] Time spent T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 14:51:11.387889  7926 raft_consensus.cc:2393] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 5: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:51:11.388407  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:11.338264  9465 leader_election.cc:290] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:51:11.386098  7742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:11.367892  7770 consensus_queue.cc:260] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:11.394762  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:11.395838  7770 raft_consensus.cc:3060] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:51:11.389879  7778 raft_consensus.cc:2393] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 4: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:51:11.402216  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:11.423158  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:11.424227  7771 raft_consensus.cc:2468] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 6.
I20260709 14:51:11.297108  7676 rpcz_store.cc:276] 0709 14:51:08.792851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:08.793058 (+   207us) service_pool.cc:224] Handling call
0709 14:51:11.254299 (+2461241us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 14:51:10.304269 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 14:51:10.399672 (+ 95403us) write_op.cc:432] Acquiring schema lock in shared mode
0709 14:51:10.399715 (+    43us) write_op.cc:435] Acquired schema lock
0709 14:51:10.399727 (+    12us) tablet.cc:662] Decoding operations
0709 14:51:10.458749 (+ 59022us) write_op.cc:620] Acquiring the partition lock for write op
0709 14:51:10.476402 (+ 17653us) write_op.cc:641] Partition lock acquired for write op
0709 14:51:10.476447 (+    45us) tablet.cc:685] Acquiring locks for 4 operations
0709 14:51:10.489091 (+ 12644us) tablet.cc:701] Row locks acquired
0709 14:51:10.489110 (+    19us) write_op.cc:260] PREPARE: finished
0709 14:51:10.489338 (+   228us) write_op.cc:270] Start()
0709 14:51:10.489472 (+   134us) write_op.cc:276] Timestamp: P: 1783608670489232 usec, L: 0
0709 14:51:10.489488 (+    16us) op_driver.cc:348] REPLICATION: starting
0709 14:51:10.629115 (+139627us) log.cc:844] Serialized 1694 byte log entry
0709 14:51:10.632645 (+  3530us) op_driver.cc:464] REPLICATION: finished
0709 14:51:10.633151 (+   506us) write_op.cc:301] APPLY: starting
0709 14:51:10.633286 (+   135us) tablet.cc:1367] starting BulkCheckPresence
0709 14:51:10.633504 (+   218us) tablet.cc:1370] finished BulkCheckPresence
0709 14:51:10.633635 (+   131us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 14:51:10.634698 (+  1063us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 14:51:10.635151 (+   453us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 14:51:10.635198 (+    47us) write_op.cc:312] APPLY: finished
0709 14:51:10.651965 (+ 16767us) log.cc:844] Serialized 41 byte log entry
0709 14:51:10.683830 (+ 31865us) write_op.cc:489] Releasing partition, row and schema locks
0709 14:51:10.736404 (+ 52574us) write_op.cc:454] Released schema lock
0709 14:51:10.742133 (+  5729us) write_op.cc:341] FINISH: Updating metrics
0709 14:51:10.866938 (+124805us) write_op.cc:489] Releasing partition, row and schema locks
0709 14:51:10.928305 (+ 61367us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":393105,"reported_tablets":5,"child_traces":[["op",{"apply.queue_time_us":290,"apply.run_cpu_time_us":4192,"apply.run_wall_time_us":191307,"num_ops":4,"prepare.queue_time_us":247253,"prepare.run_cpu_time_us":23693,"prepare.run_wall_time_us":344464,"replication_time_us":143003,"thread_start_us":147776,"threads_started":1}]]}
I20260709 14:51:11.391549  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:11.426379  7775 raft_consensus.cc:2468] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 4.
I20260709 14:51:11.429781  9475 leader_election.cc:290] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:11.439452  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:11.440835  7850 raft_consensus.cc:3060] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:51:11.351511  9559 leader_election.cc:290] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 [CANDIDATE]: Term 3 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:51:11.465937  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:11.474109  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:11.476550  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:11.478873  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:11.483551  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783e4874513449ef9084b833f188a6d3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:11.479517  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:11.484843  7779 raft_consensus.cc:2468] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 4.
I20260709 14:51:11.497967  7894 leader_election.cc:304] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:11.477042  7850 raft_consensus.cc:2468] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 6.
I20260709 14:51:11.500505  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:11.502491  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:11.509642  7779 raft_consensus.cc:1275] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 14:51:11.513731  7770 raft_consensus.cc:2468] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 6.
I20260709 14:51:11.514031  7894 leader_election.cc:304] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:11.517650  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:11.518843  7771 raft_consensus.cc:1275] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 14:51:11.519392  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:11.522928  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:11.523797  7853 raft_consensus.cc:2393] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 4: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:51:11.525532  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:11.527665  7819 leader_election.cc:304] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:11.527702  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:11.529505  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:11.531069  7853 raft_consensus.cc:1275] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 14:51:11.531821  7847 raft_consensus.cc:2410] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for term 6 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 14:51:11.531513  7894 leader_election.cc:304] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:11.538995  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:11.531561  9479 raft_consensus.cc:2804] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 14:51:11.542047  9479 raft_consensus.cc:493] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:51:11.542495  9479 raft_consensus.cc:3060] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:51:11.562381  7819 leader_election.cc:304] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:11.520982  9516 raft_consensus.cc:2804] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 14:51:11.578154  9531 leader_election.cc:290] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 5 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:11.585083  9451 raft_consensus.cc:2749] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 14:51:11.588297  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:11.605085  7819 leader_election.cc:304] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed
W20260709 14:51:11.607326  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 70603.1us
I20260709 14:51:11.536757  9353 raft_consensus.cc:2749] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 14:51:11.610020  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 142860us
I20260709 14:51:11.555380  9365 raft_consensus.cc:2804] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 14:51:11.609285  7894 leader_election.cc:304] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:11.615522  7819 leader_election.cc:304] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:51:11.528680  9550 consensus_queue.cc:1059] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.079s
I20260709 14:51:11.588608  9516 raft_consensus.cc:493] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 14:51:11.620209  8598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 220912us
I20260709 14:51:11.613586  9365 raft_consensus.cc:493] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:51:11.625751  9365 raft_consensus.cc:3060] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:51:11.620252  9541 consensus_queue.cc:1048] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 14:51:11.619975  9500 raft_consensus.cc:2804] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 14:51:11.628533  9500 raft_consensus.cc:493] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:51:11.629050  9500 raft_consensus.cc:3060] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:51:11.635911  7819 leader_election.cc:304] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:51:11.640249  7819 leader_election.cc:304] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:11.569079  9476 consensus_queue.cc:1048] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.051s
I20260709 14:51:11.646389  7819 leader_election.cc:304] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:11.621973  9516 raft_consensus.cc:3060] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:51:11.651774  9475 raft_consensus.cc:2764] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 14:51:11.652145  9525 raft_consensus.cc:2749] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 14:51:11.641157  9379 raft_consensus.cc:2804] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 14:51:11.651790  9353 raft_consensus.cc:2804] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 14:51:11.656136  9547 raft_consensus.cc:2804] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 14:51:11.697597  9584 consensus_queue.cc:1048] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.083s
I20260709 14:51:11.744148  9547 raft_consensus.cc:493] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:51:11.746740  9525 consensus_queue.cc:1048] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 14:51:11.746876  9574 log.cc:927] Time spent T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
W20260709 14:51:11.750249  9577 log.cc:927] Time spent T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 14:51:11.745028  9547 raft_consensus.cc:3060] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:51:11.787149  9353 raft_consensus.cc:493] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:51:11.787808  9353 raft_consensus.cc:3060] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:51:11.791069  9379 raft_consensus.cc:697] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
W20260709 14:51:11.808791  7745 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:51:11.890733  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 278193us
W20260709 14:51:11.892545  7743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:51:11.893602  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 240214us
W20260709 14:51:11.898893  8598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 48567.8us
W20260709 14:51:11.925493  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 272049us
I20260709 14:51:11.792678  9379 consensus_queue.cc:237] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:11.933612  7819 leader_election.cc:304] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:11.937947  7819 leader_election.cc:304] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:11.970712  9487 raft_consensus.cc:2804] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 14:51:11.971205  9487 raft_consensus.cc:493] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:51:11.971552  9487 raft_consensus.cc:3060] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:51:11.969015  9534 leader_election.cc:290] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:51:11.993773  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:11.932801  9550 raft_consensus.cc:493] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:12.000491  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
W20260709 14:51:12.022251  7919 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38532 (request call id 2405) took 1559 ms (client timeout 1781 ms). Trace:
I20260709 14:51:12.005695  9475 consensus_queue.cc:1048] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 14:51:12.001078  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:11.969269  9480 consensus_queue.cc:1048] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.052s
I20260709 14:51:12.000144  9479 raft_consensus.cc:515] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:12.010246  9365 raft_consensus.cc:515] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:11.921870  9471 consensus_queue.cc:1048] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.095s
W20260709 14:51:12.026597  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:12.022019  9591 consensus_queue.cc:1048] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 14:51:12.027498  9365 leader_election.cc:290] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 5 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:51:12.022737  7919 rpcz_store.cc:269] 0709 14:51:10.462754 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:10.477230 (+ 14476us) service_pool.cc:224] Handling call
0709 14:51:11.237147 (+759917us) spinlock_profiling.cc:243] Waited 32.7 ms on lock 0x7b5800200198. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb687c29db1 00007fb687d69e9c 00007fb687d69a5b 00007fb690c82c09 00007fb68fddcee0 00007fb68fea60ab 00007fb68fea6131 00007fb68fe540a0 00007fb68fe53984 00007fb6893ce6d4 00007fb6893ce662
0709 14:51:12.000349 (+763202us) spinlock_profiling.cc:243] Waited 15 ms on lock 0x7b5800200198. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb687c29db1 00007fb687d69b71 00007fb687d69eee 000000000037fce9 00007fb68fddd1e0 00007fb68fea60c4 00007fb68fea6131 00007fb68fe540a0 00007fb68fe53984 00007fb6893ce6d4 00007fb6893ce662
0709 14:51:12.022163 (+ 21814us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":109793408}
I20260709 14:51:11.962288  9533 raft_consensus.cc:2804] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Leader election won for term 3
I20260709 14:51:12.029564  9533 raft_consensus.cc:697] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:51:12.041433  8637 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44352 (request call id 139) took 1110 ms. Trace:
I20260709 14:51:12.041947  8637 rpcz_store.cc:276] 0709 14:51:10.931389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:10.931575 (+   186us) service_pool.cc:224] Handling call
0709 14:51:10.931897 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:51:11.307752 (+375855us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:12.040974 (+733222us) spinlock_profiling.cc:243] Waited 375 ms on lock 0x7b54005a0354. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae8ee01 00007fb68ae8d83e 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2 00007fb6891c948c 00007fb6891c88c6
0709 14:51:12.041212 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":863115136}
I20260709 14:51:12.043119  9583 raft_consensus.cc:3055] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 14:51:12.043706  9583 raft_consensus.cc:740] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:12.046175  9533 consensus_queue.cc:237] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:11.944958  9541 raft_consensus.cc:493] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9418391fa82a42c79c6cad13ba91d964)
I20260709 14:51:12.049698  9372 consensus_queue.cc:1048] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.007s
W20260709 14:51:12.056138  9573 log.cc:927] Time spent T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.633s	user 0.007s	sys 0.015s
I20260709 14:51:12.057595  9448 leader_election.cc:290] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:12.059659  7848 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a"
dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
mode: GRACEFUL
new_leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
 from {username='slave'} at 127.0.0.1:41662
I20260709 14:51:12.060447  7848 raft_consensus.cc:606] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 LEADER]: Received request to transfer leadership to TS 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:12.061625  9487 raft_consensus.cc:515] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:12.062127  7819 leader_election.cc:304] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:12.062453  9479 leader_election.cc:290] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 3 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:12.063771  9451 raft_consensus.cc:2804] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 14:51:12.064162  9451 raft_consensus.cc:493] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:12.065017  9451 raft_consensus.cc:3060] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:51:12.065824  9449 leader_election.cc:290] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:11.991796  9590 raft_consensus.cc:493] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:51:12.055480  7745 leader_election.cc:304] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:12.064796  9487 leader_election.cc:290] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 4 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:12.071100  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:51:12.070766  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 179055us
I20260709 14:51:12.072678  9517 raft_consensus.cc:993] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed: : Instructing follower 1e9289592458429bbddb19c2e7b7b7b0 to start an election
I20260709 14:51:12.073138  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258d6c2dda954bf5b65930fde8ecb9f3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:12.075281  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:12.077138  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:12.079418  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:12.079399  9547 raft_consensus.cc:515] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:12.080476  7848 raft_consensus.cc:2393] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 3: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:51:12.076916  9516 raft_consensus.cc:515] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:12.087807  9484 consensus_queue.cc:1048] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 14:51:12.064957  9460 leader_election.cc:290] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 5 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:12.037992  9550 raft_consensus.cc:515] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:12.088871  7776 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674"
dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
mode: GRACEFUL
new_leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
 from {username='slave'} at 127.0.0.1:47068
I20260709 14:51:12.045032  9583 consensus_queue.cc:260] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:12.090265  7776 raft_consensus.cc:606] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Received request to transfer leadership to TS 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:12.090698  7776 raft_consensus.cc:614] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 14:51:12.084309  7675 catalog_manager.cc:5697] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:51:12.094765  6549 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 14:51:12.096944  6549 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 14:51:12.092900  9353 raft_consensus.cc:515] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:12.093911  9583 raft_consensus.cc:3060] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:51:12.081938  9547 leader_election.cc:290] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 4 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:12.095371  7675 catalog_manager.cc:5697] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 1 to 3, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 3 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:51:12.106446  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:12.115388  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:12.115922  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:12.068868  9541 raft_consensus.cc:515] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:51:12.117076  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:12.128998  7675 catalog_manager.cc:5697] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:51:12.136368  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c563cc7cfbe4d59be4ffc5cf847ce56" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:12.138386  9484 raft_consensus.cc:493] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:51:12.139091  9484 raft_consensus.cc:515] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:12.141324  9484 leader_election.cc:290] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:12.136478  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:12.144184  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:12.145040  7925 raft_consensus.cc:2393] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 3: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:51:12.144901  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:12.145720  7924 raft_consensus.cc:2468] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 3.
I20260709 14:51:12.147023  7924 raft_consensus.cc:1275] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 14:51:12.144263  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:12.147754  7927 raft_consensus.cc:2468] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 3.
I20260709 14:51:12.148466  7924 raft_consensus.cc:1275] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 14:51:12.148828  7924 pending_rounds.cc:85] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0: Aborting all ops after (but not including) 3
I20260709 14:51:12.142673  8637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce9c0ef2db24c13a8b1402f21819458" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9418391fa82a42c79c6cad13ba91d964" is_pre_election: true
I20260709 14:51:12.144904  7923 raft_consensus.cc:2468] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 3.
I20260709 14:51:12.142818  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:12.150426  7925 raft_consensus.cc:1275] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 14:51:12.149046  7924 pending_rounds.cc:107] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 14:51:12.152094  7924 raft_consensus.cc:2889] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 14:51:12.153303  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 230907us
I20260709 14:51:12.121176  9550 leader_election.cc:290] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:12.081990  9500 raft_consensus.cc:515] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:12.158758  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 103191us
I20260709 14:51:12.132755  9460 raft_consensus.cc:493] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:12.161010  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:12.143091  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:12.165603  7745 leader_election.cc:304] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:12.167507  7920 raft_consensus.cc:2393] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 5: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:51:12.150149  9541 leader_election.cc:290] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785), 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68:42321)
I20260709 14:51:12.178017  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:12.178339  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:12.178687  7926 raft_consensus.cc:3060] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:51:12.178936  7923 raft_consensus.cc:3060] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:51:12.116900  9589 consensus_queue.cc:1059] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.070s
I20260709 14:51:12.198649  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:12.199505  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:12.200191  7744 leader_election.cc:304] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:12.207593  7926 raft_consensus.cc:2468] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 4.
I20260709 14:51:12.071642  9590 raft_consensus.cc:515] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:12.210834  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 45296.9us
I20260709 14:51:12.214618  7923 raft_consensus.cc:2468] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 4.
I20260709 14:51:12.196341  9372 raft_consensus.cc:1081] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 LEADER]: Signalling peer 1e9289592458429bbddb19c2e7b7b7b0 to start an election
I20260709 14:51:12.199119  9353 leader_election.cc:290] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 7 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:12.196208  9533 raft_consensus.cc:493] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:12.193928  9604 raft_consensus.cc:2804] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader election won for term 6
I20260709 14:51:12.203730  7921 raft_consensus.cc:2468] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 3.
I20260709 14:51:12.214257  9541 raft_consensus.cc:2804] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 14:51:12.230506  7744 leader_election.cc:304] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:12.194202  9460 raft_consensus.cc:515] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:12.232967  9533 raft_consensus.cc:515] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:12.321213  9533 leader_election.cc:290] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:51:12.328104  9601 log.cc:927] Time spent T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.174s	user 0.001s	sys 0.000s
W20260709 14:51:12.302963  9575 log.cc:927] Time spent T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 14:51:12.228377  9599 raft_consensus.cc:2749] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 14:51:12.309705  9541 raft_consensus.cc:493] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:12.322919  9500 leader_election.cc:290] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 5 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:12.344871  9443 raft_consensus.cc:493] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:51:12.361102  9541 raft_consensus.cc:3060] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:51:12.364930  9480 raft_consensus.cc:2749] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 14:51:12.404064  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:12.419091  9590 leader_election.cc:290] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:12.424407  9471 raft_consensus.cc:3055] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 LEADER]: Stepping down as leader of term 2
I20260709 14:51:12.424964  9471 raft_consensus.cc:740] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
W20260709 14:51:12.429778  9607 log.cc:927] Time spent T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.118s	user 0.000s	sys 0.001s
I20260709 14:51:12.415091  9550 raft_consensus.cc:493] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:12.437804  9550 raft_consensus.cc:515] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:12.389812  9443 raft_consensus.cc:515] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:12.445001  9550 leader_election.cc:290] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:12.445906  9460 leader_election.cc:290] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:51:12.463912  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 234275us
W20260709 14:51:12.503468  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 139764us
I20260709 14:51:12.454124  9500 raft_consensus.cc:493] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
W20260709 14:51:12.524312  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 358989us
W20260709 14:51:12.526511  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 296106us
I20260709 14:51:12.526968  7928 raft_consensus.cc:2468] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 4.
I20260709 14:51:12.527136  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:12.528378  7922 raft_consensus.cc:3060] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:51:12.528831  7744 leader_election.cc:304] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:12.531081  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:12.531903  7927 raft_consensus.cc:2468] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 6.
I20260709 14:51:12.536972  7744 leader_election.cc:304] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:12.538749  7744 leader_election.cc:304] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:51:12.538811  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 74009us
I20260709 14:51:12.542704  7744 leader_election.cc:304] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:12.545009  7744 leader_election.cc:304] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:12.548120  7744 leader_election.cc:304] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:12.552102  7744 leader_election.cc:304] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:12.553817  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:12.558435  7927 raft_consensus.cc:3060] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:51:12.535892  9378 raft_consensus.cc:2749] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 14:51:12.561399  7744 leader_election.cc:304] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:12.544248  9517 raft_consensus.cc:2749] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 14:51:12.515808  9500 raft_consensus.cc:515] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:12.547540  9372 raft_consensus.cc:2804] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 14:51:12.547348  9599 raft_consensus.cc:2804] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 14:51:12.538878  9451 raft_consensus.cc:515] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:12.573737  7744 leader_election.cc:304] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:51:12.574848  7744 leader_election.cc:304] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:51:12.576030  9451 leader_election.cc:290] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 4 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:12.576550  9516 leader_election.cc:290] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:12.570075  9620 raft_consensus.cc:3060] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Advancing to term 4
W20260709 14:51:12.568240  9616 log.cc:927] Time spent T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.099s	user 0.000s	sys 0.002s
I20260709 14:51:12.580490  9614 raft_consensus.cc:2804] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 14:51:12.581099  9614 raft_consensus.cc:493] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting leader election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:51:12.581532  9614 raft_consensus.cc:3060] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:51:12.510859  9471 consensus_queue.cc:260] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:51:12.582434  7854 raft_consensus.cc:1240] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 3. Current term is 4. Ops: []
I20260709 14:51:12.583086  9471 raft_consensus.cc:3060] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:51:12.576889  9584 raft_consensus.cc:2804] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 14:51:12.585042  9584 raft_consensus.cc:493] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting leader election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:51:12.585556  9584 raft_consensus.cc:3060] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:51:12.555124  9600 raft_consensus.cc:2749] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 14:51:12.589932  7819 leader_election.cc:304] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:12.591563  9599 raft_consensus.cc:493] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting leader election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:51:12.592213  9599 raft_consensus.cc:3060] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:51:12.575831  7744 leader_election.cc:304] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:12.594419  7744 leader_election.cc:304] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:12.595753  7744 leader_election.cc:304] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
W20260709 14:51:12.573794  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:12.555001  9474 raft_consensus.cc:2749] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 14:51:12.603199  7744 leader_election.cc:304] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:12.594496  9372 raft_consensus.cc:493] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:12.688884  7927 raft_consensus.cc:2468] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 5.
I20260709 14:51:12.690584  7922 raft_consensus.cc:2468] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 7.
I20260709 14:51:12.603935  7819 leader_election.cc:304] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:12.609906  9451 raft_consensus.cc:2804] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 14:51:12.695756  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:12.606112  9600 raft_consensus.cc:2749] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 14:51:12.594455  9480 raft_consensus.cc:2749] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 14:51:12.602771  9378 raft_consensus.cc:2749] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 14:51:12.671326  7775 raft_consensus.cc:1275] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 14:51:12.667044  9589 raft_consensus.cc:2749] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 14:51:12.605826  9533 consensus_queue.cc:1048] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
W20260709 14:51:12.691996  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 89471.7us
I20260709 14:51:12.668493  9517 raft_consensus.cc:2804] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 14:51:12.674077  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 133084us
I20260709 14:51:12.703315  9353 raft_consensus.cc:2804] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 14:51:12.718129  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:12.676576  9449 raft_consensus.cc:493] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
W20260709 14:51:12.729727  7846 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.023s	sys 0.012s
W20260709 14:51:12.730098  7846 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.515s	user 0.023s	sys 0.012s
I20260709 14:51:12.696673  9372 raft_consensus.cc:3060] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:51:12.725172  7745 leader_election.cc:304] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:12.698954  9451 raft_consensus.cc:493] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:51:12.728368  7778 raft_consensus.cc:1275] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 14:51:12.701762  9620 raft_consensus.cc:2749] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 14:51:12.735098  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:12.746562  7775 raft_consensus.cc:2468] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 2.
I20260709 14:51:12.743336  7745 leader_election.cc:304] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:12.719241  9500 leader_election.cc:290] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:12.751472  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:12.757611  7775 raft_consensus.cc:2468] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 2.
I20260709 14:51:12.755362  7745 leader_election.cc:304] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:12.723676  9517 raft_consensus.cc:493] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting leader election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:51:12.701077  9541 raft_consensus.cc:515] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:12.768877  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:12.727047  9353 raft_consensus.cc:493] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:51:12.769932  7778 raft_consensus.cc:2468] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 5.
I20260709 14:51:12.778967  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:12.748251  9451 raft_consensus.cc:3060] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:51:12.782254  7776 raft_consensus.cc:1275] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 14:51:12.739928  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:12.749904  9598 raft_consensus.cc:2749] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 14:51:12.730593  9474 consensus_queue.cc:1059] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.044s
I20260709 14:51:12.733700  9584 raft_consensus.cc:515] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:12.780444  9353 raft_consensus.cc:3060] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:51:12.810248  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:12.805157  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:12.772185  9517 raft_consensus.cc:3060] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:51:12.752722  9604 raft_consensus.cc:697] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
W20260709 14:51:12.804224  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 82311.2us
I20260709 14:51:12.738364  9449 raft_consensus.cc:515] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:51:12.834903  9449 leader_election.cc:290] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68:42321)
I20260709 14:51:12.781128  9620 raft_consensus.cc:2749] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 14:51:12.810894  7775 raft_consensus.cc:2468] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 4.
I20260709 14:51:12.814460  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:12.839426  7778 raft_consensus.cc:2393] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 6: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:51:12.820495  7774 raft_consensus.cc:3055] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 LEADER]: Stepping down as leader of term 2
I20260709 14:51:12.840077  7774 raft_consensus.cc:740] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:51:12.840380  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:12.840927  7774 consensus_queue.cc:260] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:12.841195  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:12.842172  7774 raft_consensus.cc:3060] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:51:12.843719  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:12.809507  9589 raft_consensus.cc:2749] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 14:51:12.822491  9618 log.cc:927] Time spent T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.112s	user 0.000s	sys 0.001s
I20260709 14:51:12.846680  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c563cc7cfbe4d59be4ffc5cf847ce56" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:12.845142  7771 raft_consensus.cc:1240] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 4. Current term is 5. Ops: []
I20260709 14:51:12.830926  9604 consensus_queue.cc:237] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:12.848079  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:12.848181  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:12.845041  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:12.846740  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:12.849888  7778 raft_consensus.cc:2468] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 6.
I20260709 14:51:12.831854  9541 leader_election.cc:290] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:12.850955  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:12.851125  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:12.852144  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:12.850984  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:12.854893  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
W20260709 14:51:12.858785  9623 log.cc:927] Time spent T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 14:51:12.813845  7819 leader_election.cc:304] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:12.808804  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
W20260709 14:51:12.862005  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 106725us
W20260709 14:51:12.862941  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 49286.2us
I20260709 14:51:12.852397  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:12.788273  9583 consensus_queue.cc:1059] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.050s
I20260709 14:51:12.868343  7745 leader_election.cc:304] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:12.866806  7775 raft_consensus.cc:2468] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 6.
I20260709 14:51:12.871753  7774 raft_consensus.cc:2468] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 3.
I20260709 14:51:12.875901  7745 leader_election.cc:304] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:12.882455  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:12.884397  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:12.886143  9443 leader_election.cc:290] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:12.889482  9620 raft_consensus.cc:2749] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 14:51:12.869370  9449 raft_consensus.cc:2804] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 14:51:12.876276  9471 raft_consensus.cc:2749] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 14:51:12.878840  7819 leader_election.cc:304] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:12.897361  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:12.897583  7774 raft_consensus.cc:1275] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 14:51:12.904938  7819 leader_election.cc:304] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:12.910135  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:12.903093  7745 leader_election.cc:304] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:12.912828  7745 leader_election.cc:304] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:12.913208  9630 raft_consensus.cc:2804] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Leader election won for term 4
I20260709 14:51:12.902212  9632 raft_consensus.cc:493] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9418391fa82a42c79c6cad13ba91d964)
I20260709 14:51:12.914238  9632 raft_consensus.cc:515] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:51:12.914526  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18d29d52d304c87b930d4fb5eaf50b1" candidate_uuid: "9418391fa82a42c79c6cad13ba91d964" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:12.915004  9487 raft_consensus.cc:2804] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Leader election won for term 4
I20260709 14:51:12.916826  9620 raft_consensus.cc:2749] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 14:51:12.917440  9632 leader_election.cc:290] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68:42321)
I20260709 14:51:12.918154  8637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9441e831627143a991a1556dcdce71e3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9418391fa82a42c79c6cad13ba91d964" is_pre_election: true
I20260709 14:51:12.897785  9449 raft_consensus.cc:493] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:51:12.930325  9471 raft_consensus.cc:2749] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 14:51:12.871819  9599 raft_consensus.cc:515] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:12.962620  7772 raft_consensus.cc:1240] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 14:51:12.933833  7745 leader_election.cc:304] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:12.872730  9448 consensus_queue.cc:1048] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 14:51:12.935508  7774 raft_consensus.cc:2468] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9418391fa82a42c79c6cad13ba91d964 in term 3.
I20260709 14:51:12.919380  7819 leader_election.cc:304] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:12.967141  7745 leader_election.cc:304] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:51:12.967247  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 48082.1us
I20260709 14:51:12.942818  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
W20260709 14:51:12.954083  9622 log.cc:927] Time spent T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.149s	user 0.004s	sys 0.001s
I20260709 14:51:12.961277  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:12.908715  9584 leader_election.cc:290] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:12.968927  7775 raft_consensus.cc:2468] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 5.
I20260709 14:51:12.967298  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:12.974228  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:12.975474  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:12.976326  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:12.976712  7774 raft_consensus.cc:2468] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 4.
I20260709 14:51:12.977384  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:12.978163  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:12.979377  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:12.982120  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:12.955503  9449 raft_consensus.cc:3060] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:51:12.895910  9631 consensus_queue.cc:1048] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.085s
I20260709 14:51:12.982947  7819 leader_election.cc:304] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:12.987474  7745 leader_election.cc:304] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:12.987684  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:12.988593  7771 raft_consensus.cc:2468] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 6.
I20260709 14:51:12.990896  7774 raft_consensus.cc:1275] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 14:51:12.962311  9599 leader_election.cc:290] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:12.992902  7774 raft_consensus.cc:1275] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 14:51:12.921452  9614 raft_consensus.cc:515] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:12.978348  9500 raft_consensus.cc:2804] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 14:51:12.974283  9598 raft_consensus.cc:2749] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 14:51:12.978577  9471 raft_consensus.cc:2749] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 14:51:13.004192  9487 raft_consensus.cc:697] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:51:13.005570  9487 consensus_queue.cc:237] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:13.007596  9631 raft_consensus.cc:2804] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 14:51:13.008383  9631 raft_consensus.cc:493] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:13.008800  9631 raft_consensus.cc:3060] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Advancing to term 7
W20260709 14:51:13.008925  9480 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
W20260709 14:51:13.014866  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:13.001425  9500 raft_consensus.cc:493] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
W20260709 14:51:13.027932  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:51:13.018275  9633 log.cc:927] Time spent T 00000000000000000000000000000000 P 133636659113430cb53b321cb0b1d9ee: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 14:51:13.045537  7774 raft_consensus.cc:1275] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 14:51:13.043848  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:13.040699  7779 raft_consensus.cc:1240] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 4. Current term is 5. Ops: []
I20260709 14:51:13.046083  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:13.047065  7771 raft_consensus.cc:2393] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 3: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:51:13.047787  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783e4874513449ef9084b833f188a6d3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:13.049333  7772 raft_consensus.cc:2393] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 5: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:51:13.036402  9547 raft_consensus.cc:993] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac: : Instructing follower 1e9289592458429bbddb19c2e7b7b7b0 to start an election
I20260709 14:51:13.002269  9599 raft_consensus.cc:2749] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 14:51:13.049633  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:13.050441  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:13.050902  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:13.051072  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:13.018329  9500 raft_consensus.cc:3060] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:51:13.066603  7771 raft_consensus.cc:2368] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 3. Current term is 4.
I20260709 14:51:13.059304  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:13.000288  9517 raft_consensus.cc:515] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:13.068989  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:13.071097  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:13.056707  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:13.072029  7925 raft_consensus.cc:2468] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 4.
I20260709 14:51:13.073975  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:13.074718  7778 raft_consensus.cc:2376] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 3. Re-sending same reply.
I20260709 14:51:13.077593  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:13.079385  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:13.036612  9372 raft_consensus.cc:515] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:13.086345  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:13.088744  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:13.094084  7777 raft_consensus.cc:1240] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 4. Current term is 5. Ops: []
I20260709 14:51:13.097110  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:13.099776  6549 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 14:51:13.102227  9628 log.cc:927] Time spent T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.292s	user 0.001s	sys 0.001s
I20260709 14:51:13.072664  9637 raft_consensus.cc:1081] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 LEADER]: Signalling peer 1e9289592458429bbddb19c2e7b7b7b0 to start an election
W20260709 14:51:13.116091  7743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:13.074548  9630 raft_consensus.cc:697] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
W20260709 14:51:13.220237  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 237391us
I20260709 14:51:13.318735  8637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18d29d52d304c87b930d4fb5eaf50b1" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9418391fa82a42c79c6cad13ba91d964" is_pre_election: true
I20260709 14:51:13.218529  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:13.166589  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:13.345569  8637 raft_consensus.cc:2393] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 3: Already voted for candidate 9418391fa82a42c79c6cad13ba91d964 in this term.
W20260709 14:51:13.186722  8598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 224130us
I20260709 14:51:13.354377  7924 raft_consensus.cc:1240] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 4. Current term is 5. Ops: []
I20260709 14:51:13.354682  7925 raft_consensus.cc:1240] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 6. Current term is 7. Ops: [4.4-6.5]
W20260709 14:51:13.172904  9639 log.cc:927] Time spent T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260709 14:51:13.356442  7928 raft_consensus.cc:1240] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 14:51:13.357949  7924 raft_consensus.cc:1240] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 3. Current term is 4. Ops: []
I20260709 14:51:13.358124  7922 raft_consensus.cc:1240] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 4. Current term is 5. Ops: []
I20260709 14:51:13.359928  7819 leader_election.cc:304] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
W20260709 14:51:13.182005  9642 log.cc:927] Time spent T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 14:51:13.360441  7927 raft_consensus.cc:1240] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 4. Current term is 5. Ops: []
I20260709 14:51:13.362780  7819 leader_election.cc:304] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:13.360973  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:13.285878  9533 raft_consensus.cc:493] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:13.361485  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce9c0ef2db24c13a8b1402f21819458" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:13.218950  7773 raft_consensus.cc:1240] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 5. Current term is 6. Ops: []
I20260709 14:51:13.164165  9550 raft_consensus.cc:3055] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 14:51:13.364622  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:13.365516  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:13.365206  7927 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
 from {username='slave'} at 127.0.0.1:38532
I20260709 14:51:13.243230  9614 leader_election.cc:290] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:13.366070  7928 raft_consensus.cc:1240] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 14:51:13.366477  7924 raft_consensus.cc:1240] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 14:51:13.347165  9517 leader_election.cc:290] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:13.238057  9353 raft_consensus.cc:515] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:13.212450  9451 raft_consensus.cc:515] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:13.332710  9631 raft_consensus.cc:515] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:13.449185  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:13.451814  9372 leader_election.cc:290] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:13.378593  9487 raft_consensus.cc:2804] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader election won for term 5
I20260709 14:51:13.452598  9644 raft_consensus.cc:2804] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader election won for term 7
I20260709 14:51:13.456822  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:13.479614  7852 raft_consensus.cc:2468] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 7.
I20260709 14:51:13.381047  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:13.452500  9630 consensus_queue.cc:237] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:13.481726  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:13.504235  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:13.531844  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:13.367892  9533 raft_consensus.cc:515] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:13.605060  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
W20260709 14:51:13.556195  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:13.626329  7924 raft_consensus.cc:1240] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 2. Current term is 3. Ops: []
I20260709 14:51:13.631482  7924 raft_consensus.cc:1240] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 3. Current term is 4. Ops: []
I20260709 14:51:13.531682  7920 raft_consensus.cc:1240] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 2. Current term is 3. Ops: []
I20260709 14:51:13.483019  7852 raft_consensus.cc:1275] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 14:51:13.450609  7893 leader_election.cc:304] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:51:13.627686  9500 consensus_meta.cc:287] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent flushing consensus metadata: real 0.548s	user 0.011s	sys 0.000s
I20260709 14:51:13.628139  7928 raft_consensus.cc:1240] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 1. Current term is 2. Ops: []
I20260709 14:51:13.629566  7926 raft_consensus.cc:1240] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 4. Current term is 5. Ops: []
W20260709 14:51:13.633733  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 183239us
I20260709 14:51:13.610888  7851 raft_consensus.cc:1240] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 3. Current term is 4. Ops: []
I20260709 14:51:13.640553  9500 raft_consensus.cc:515] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:13.650125  7893 leader_election.cc:304] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:13.530478  7919 raft_consensus.cc:1240] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 2. Current term is 3. Ops: []
I20260709 14:51:13.479229  9550 raft_consensus.cc:740] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:13.476689  9487 raft_consensus.cc:697] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:51:13.667631  7893 leader_election.cc:304] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:13.651604  9516 raft_consensus.cc:2749] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 14:51:13.707052  7927 raft_consensus.cc:493] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:51:13.708184  7927 raft_consensus.cc:3060] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:51:13.722463  7927 raft_consensus.cc:515] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:13.653652  9353 leader_election.cc:290] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 4 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:13.696842  9644 raft_consensus.cc:697] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:51:13.664490  9451 leader_election.cc:290] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 4 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:13.717869  9631 leader_election.cc:290] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 7 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:13.735064  9590 raft_consensus.cc:2749] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 14:51:13.749640  9533 leader_election.cc:290] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:13.751149  9550 consensus_queue.cc:260] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:13.752462  9550 raft_consensus.cc:3060] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:51:13.754068  9500 leader_election.cc:290] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 4 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:13.755232  9487 consensus_queue.cc:237] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:13.762471  9449 consensus_meta.cc:287] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent flushing consensus metadata: real 0.769s	user 0.013s	sys 0.001s
I20260709 14:51:13.763023  9449 raft_consensus.cc:515] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:13.729840  9516 raft_consensus.cc:2749] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 14:51:13.739030  9644 consensus_queue.cc:237] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:13.734424  9637 raft_consensus.cc:493] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:51:13.777359  9449 leader_election.cc:290] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 4 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:13.777849  9637 raft_consensus.cc:515] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:13.780194  9637 leader_election.cc:290] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:51:13.826514  7743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:51:13.833779  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 286869us
W20260709 14:51:13.834705  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:51:13.834025  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 471222us
I20260709 14:51:13.889485  9637 raft_consensus.cc:493] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:13.911561  7819 leader_election.cc:304] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:13.918954  9658 raft_consensus.cc:2804] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Leader election won for term 4
I20260709 14:51:13.919957  9658 raft_consensus.cc:697] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:51:13.926126  7921 raft_consensus.cc:1240] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 5. Current term is 6. Ops: []
I20260709 14:51:13.931574  7894 leader_election.cc:304] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
W20260709 14:51:13.935756  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 268032us
I20260709 14:51:13.942811  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18d29d52d304c87b930d4fb5eaf50b1" candidate_uuid: "9418391fa82a42c79c6cad13ba91d964" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:13.944900  7773 raft_consensus.cc:2376] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9418391fa82a42c79c6cad13ba91d964 in term 3. Re-sending same reply.
I20260709 14:51:13.892577  9637 raft_consensus.cc:515] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:13.960803  7927 leader_election.cc:290] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 4 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:13.963150  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:13.963639  7772 raft_consensus.cc:1275] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 14:51:13.988444  8598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 204109us
I20260709 14:51:13.974766  9658 consensus_queue.cc:237] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:13.977895  9378 raft_consensus.cc:493] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:13.993191  9378 raft_consensus.cc:515] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:13.997715  9378 leader_election.cc:290] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:14.000015  9637 leader_election.cc:290] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:14.000895  7893 leader_election.cc:304] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:51:14.023000  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 107433us
I20260709 14:51:13.991999  8598 leader_election.cc:304] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 9418391fa82a42c79c6cad13ba91d964; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:14.022828  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:14.033562  7772 raft_consensus.cc:3060] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:51:14.034500  7777 raft_consensus.cc:1275] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 14:51:14.033735  9657 raft_consensus.cc:2804] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 14:51:14.038415  9657 raft_consensus.cc:493] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:51:14.039091  9657 raft_consensus.cc:3060] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 14:51:14.037303  9559 raft_consensus.cc:2804] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 14:51:14.046044  9443 consensus_queue.cc:1048] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 14:51:14.048372  9659 raft_consensus.cc:2749] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 14:51:14.045822  9559 raft_consensus.cc:697] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 [term 3 LEADER]: Becoming Leader. State: Replica: 9418391fa82a42c79c6cad13ba91d964, State: Running, Role: LEADER
W20260709 14:51:14.046505  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 45941.3us
I20260709 14:51:14.053380  7772 raft_consensus.cc:2468] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 4.
I20260709 14:51:14.053440  7893 leader_election.cc:304] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:14.053289  9559 consensus_queue.cc:237] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:51:14.058916  9656 raft_consensus.cc:2749] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 14:51:14.062448  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:14.063567  7854 raft_consensus.cc:3055] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 LEADER]: Stepping down as leader of term 3
I20260709 14:51:14.063769  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:14.064055  7854 raft_consensus.cc:740] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:51:14.064837  7777 raft_consensus.cc:2468] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 4.
W20260709 14:51:14.065444  8598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 73873.9us
I20260709 14:51:14.066112  7854 consensus_queue.cc:260] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:14.069500  7854 raft_consensus.cc:3060] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:51:14.069835  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:14.075356  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:14.073575  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:14.071005  7676 catalog_manager.cc:5697] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:51:14.076330  7776 raft_consensus.cc:2376] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 3. Re-sending same reply.
I20260709 14:51:14.078191  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783e4874513449ef9084b833f188a6d3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:14.078464  7675 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54344 (request call id 362) took 2045 ms. Trace:
W20260709 14:51:14.085780  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:14.065052  7893 leader_election.cc:304] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:14.075605  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:14.109557  7777 raft_consensus.cc:2468] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 6.
I20260709 14:51:14.079429  7675 rpcz_store.cc:276] 0709 14:51:12.032347 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:12.033084 (+   737us) service_pool.cc:224] Handling call
0709 14:51:14.055954 (+2022870us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 14:51:12.544589 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 14:51:12.709747 (+165158us) write_op.cc:432] Acquiring schema lock in shared mode
0709 14:51:12.717098 (+  7351us) write_op.cc:435] Acquired schema lock
0709 14:51:12.719281 (+  2183us) tablet.cc:662] Decoding operations
0709 14:51:12.822551 (+103270us) write_op.cc:620] Acquiring the partition lock for write op
0709 14:51:12.822616 (+    65us) write_op.cc:641] Partition lock acquired for write op
0709 14:51:12.822648 (+    32us) tablet.cc:685] Acquiring locks for 3 operations
0709 14:51:12.822991 (+   343us) tablet.cc:701] Row locks acquired
0709 14:51:12.823008 (+    17us) write_op.cc:260] PREPARE: finished
0709 14:51:12.823174 (+   166us) write_op.cc:270] Start()
0709 14:51:12.823284 (+   110us) write_op.cc:276] Timestamp: P: 1783608672823122 usec, L: 0
0709 14:51:12.823305 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 14:51:12.824197 (+   892us) log.cc:844] Serialized 1308 byte log entry
0709 14:51:13.259698 (+435501us) op_driver.cc:464] REPLICATION: finished
0709 14:51:13.501389 (+241691us) write_op.cc:301] APPLY: starting
0709 14:51:13.505593 (+  4204us) tablet.cc:1367] starting BulkCheckPresence
0709 14:51:13.548213 (+ 42620us) tablet.cc:1370] finished BulkCheckPresence
0709 14:51:13.617380 (+ 69167us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 14:51:13.627618 (+ 10238us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 14:51:13.627853 (+   235us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 14:51:13.627898 (+    45us) write_op.cc:312] APPLY: finished
0709 14:51:13.628171 (+   273us) log.cc:844] Serialized 35 byte log entry
0709 14:51:13.628393 (+   222us) write_op.cc:489] Releasing partition, row and schema locks
0709 14:51:13.628547 (+   154us) write_op.cc:454] Released schema lock
0709 14:51:13.628601 (+    54us) write_op.cc:341] FINISH: Updating metrics
0709 14:51:13.629045 (+   444us) write_op.cc:489] Releasing partition, row and schema locks
0709 14:51:13.629144 (+    99us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":27970,"reported_tablets":7,"child_traces":[["op",{"apply.queue_time_us":191142,"apply.run_cpu_time_us":2956,"apply.run_wall_time_us":169312,"num_ops":3,"prepare.queue_time_us":357177,"prepare.run_cpu_time_us":8264,"prepare.run_wall_time_us":314722,"raft.queue_time_us":147857,"raft.run_cpu_time_us":7375,"raft.run_wall_time_us":106808,"replication_time_us":436199,"thread_start_us":456992,"threads_started":4,"wal-append.queue_time_us":70566}]]}
I20260709 14:51:14.124579  9656 raft_consensus.cc:2749] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 14:51:14.137163  9590 raft_consensus.cc:493] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:51:14.141440  9516 raft_consensus.cc:493] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:51:14.130760  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18d29d52d304c87b930d4fb5eaf50b1" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
W20260709 14:51:14.142379  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 77540.5us
I20260709 14:51:14.156049  9590 raft_consensus.cc:515] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:14.158805  9590 leader_election.cc:290] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:14.160423  9516 raft_consensus.cc:515] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:14.163075  9516 leader_election.cc:290] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:14.166867  7673 catalog_manager.cc:5697] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 reported cstate change: term changed from 2 to 3, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68). New cstate: current_term: 3 leader_uuid: "9418391fa82a42c79c6cad13ba91d964" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 14:51:14.174715  7773 raft_consensus.cc:2393] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 3: Already voted for candidate 9418391fa82a42c79c6cad13ba91d964 in this term.
I20260709 14:51:14.174714  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:14.174997  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:14.185273  9516 raft_consensus.cc:493] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:14.186203  7893 leader_election.cc:304] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:14.190062  9590 raft_consensus.cc:2804] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 14:51:14.190753  9590 raft_consensus.cc:493] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:51:14.190814  9378 raft_consensus.cc:493] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:51:14.195116  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:14.198607  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783e4874513449ef9084b833f188a6d3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:14.204149  7927 raft_consensus.cc:2393] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 3: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:51:14.192328  9378 raft_consensus.cc:515] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:14.208698  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:14.209687  7772 raft_consensus.cc:2468] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 4.
I20260709 14:51:14.210594  9378 leader_election.cc:290] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:14.211009  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:14.212134  7773 raft_consensus.cc:3060] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:51:14.191291  9590 raft_consensus.cc:3060] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:51:14.168247  7854 raft_consensus.cc:2410] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 14:51:14.226810  7772 raft_consensus.cc:3055] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 LEADER]: Stepping down as leader of term 3
I20260709 14:51:14.227396  7772 raft_consensus.cc:740] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:51:14.227454  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:14.228866  7772 consensus_queue.cc:260] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:14.230537  7772 raft_consensus.cc:3060] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:51:14.231217  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
W20260709 14:51:14.235823  7819 connection.cc:256] RPC call timeout handler was delayed by -1.3926942519999557s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2218s for a response
I20260709 14:51:14.186455  9516 raft_consensus.cc:515] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:14.244840  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:14.220019  9657 raft_consensus.cc:515] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:14.273547  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:51:14.287623  7743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:14.297386  9657 leader_election.cc:290] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:51:14.300253  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 55140.5us
I20260709 14:51:14.299597  7928 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
 from {username='slave'} at 127.0.0.1:38516
I20260709 14:51:14.303123  7928 raft_consensus.cc:493] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:51:14.303567  7928 raft_consensus.cc:3060] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:51:14.311254  7772 raft_consensus.cc:1275] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 14:51:14.313050  7744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:51:14.319551  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 77083.1us
W20260709 14:51:14.322921  7819 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.101.65:40587 timed out after 1.920s (SENT) [suppressed 50 similar messages]
W20260709 14:51:14.324182  7819 connection.cc:256] RPC call timeout handler was delayed by -1.2306942520000348s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2398s for a response
I20260709 14:51:14.323563  9590 raft_consensus.cc:515] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:14.328503  7922 raft_consensus.cc:2468] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 4.
I20260709 14:51:14.303141  7773 raft_consensus.cc:2468] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 7.
I20260709 14:51:14.334607  9516 leader_election.cc:290] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:14.331470  9659 consensus_queue.cc:1048] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
W20260709 14:51:14.356628  7743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:14.362205  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:14.364528  7928 raft_consensus.cc:515] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:14.378655  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 45965.3us
I20260709 14:51:14.381616  7928 leader_election.cc:290] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 5 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:14.380602  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:14.382167  9659 consensus_queue.cc:1048] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 14:51:14.388140  7925 raft_consensus.cc:2468] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 4.
I20260709 14:51:14.391201  9378 raft_consensus.cc:493] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:14.392228  9378 raft_consensus.cc:515] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:14.394418  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:14.396014  7921 raft_consensus.cc:3060] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:51:14.383620  7893 leader_election.cc:304] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:14.398185  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:14.401345  9378 leader_election.cc:290] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:14.402675  9378 raft_consensus.cc:493] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:51:14.403578  9378 raft_consensus.cc:515] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:14.398814  9659 raft_consensus.cc:2749] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 14:51:14.384868  9590 leader_election.cc:290] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 5 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:14.411585  9644 raft_consensus.cc:493] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:51:14.412571  9644 raft_consensus.cc:515] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:14.416226  9644 leader_election.cc:290] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:14.422247  7893 leader_election.cc:304] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:14.423565  9657 raft_consensus.cc:2749] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 14:51:14.432054  9658 raft_consensus.cc:493] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:51:14.432690  9658 raft_consensus.cc:515] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:14.434641  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:14.435220  9644 raft_consensus.cc:493] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:51:14.437132  7744 leader_election.cc:336] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785): Timed out: RequestConsensusVote RPC to 127.6.101.67:40785 timed out after 1.583s (SENT)
I20260709 14:51:14.438057  7744 leader_election.cc:304] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:14.437578  9644 raft_consensus.cc:515] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:14.448892  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:14.449755  9658 leader_election.cc:290] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:14.450556  9644 leader_election.cc:290] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:14.448068  7893 leader_election.cc:304] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:14.454758  7848 raft_consensus.cc:1240] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 3. Current term is 4. Ops: []
I20260709 14:51:14.455819  9516 raft_consensus.cc:2749] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 14:51:14.457820  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:14.458036  7848 raft_consensus.cc:1240] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 LEADER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 4. Current term is 5. Ops: []
I20260709 14:51:14.466131  7925 raft_consensus.cc:2393] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 5: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:51:14.479260  9679 raft_consensus.cc:2749] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 14:51:14.482350  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:14.483098  7848 raft_consensus.cc:1240] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 LEADER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 3. Current term is 4. Ops: []
I20260709 14:51:14.483358  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9441e831627143a991a1556dcdce71e3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:14.484709  7845 raft_consensus.cc:1240] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 LEADER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 6. Current term is 7. Ops: []
I20260709 14:51:14.485725  7849 raft_consensus.cc:1240] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 LEADER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 3. Current term is 4. Ops: []
I20260709 14:51:14.485924  7893 leader_election.cc:304] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:14.486821  7846 raft_consensus.cc:1240] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 3. Current term is 4. Ops: []
I20260709 14:51:14.487654  7893 leader_election.cc:304] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:14.484769  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:14.488575  9516 raft_consensus.cc:2749] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 14:51:14.482517  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:14.489145  7893 leader_election.cc:304] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:14.460261  9378 leader_election.cc:290] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:14.492388  9657 raft_consensus.cc:2804] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 14:51:14.497874  9657 raft_consensus.cc:493] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:51:14.498353  9657 raft_consensus.cc:3060] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:51:14.497301  7893 leader_election.cc:304] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:14.504016  9590 raft_consensus.cc:2749] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 14:51:14.504724  7893 leader_election.cc:304] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:14.500746  9516 raft_consensus.cc:2749] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 14:51:14.507359  7921 raft_consensus.cc:2468] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 7.
I20260709 14:51:14.515213  7848 raft_consensus.cc:3060] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:51:14.521387  9378 raft_consensus.cc:493] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:51:14.523211  9378 raft_consensus.cc:515] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:14.536247  7852 raft_consensus.cc:1240] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 3. Current term is 4. Ops: []
I20260709 14:51:14.537472  9590 raft_consensus.cc:2749] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 14:51:14.539529  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:14.541913  9679 raft_consensus.cc:493] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:14.552366  9679 raft_consensus.cc:515] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:14.553323  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:14.558300  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:14.554876  9679 leader_election.cc:290] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:14.559937  9679 raft_consensus.cc:493] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:14.560534  9679 raft_consensus.cc:515] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:14.563064  9679 leader_election.cc:290] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:14.578474  9378 leader_election.cc:290] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:14.576282  7676 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54364 (request call id 333) took 3035 ms. Trace:
I20260709 14:51:14.581984  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:14.582358  7773 raft_consensus.cc:1275] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Refusing update from remote peer 9418391fa82a42c79c6cad13ba91d964: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 14:51:14.584473  9661 consensus_queue.cc:1048] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 14:51:14.581810  7676 rpcz_store.cc:276] 0709 14:51:11.541205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:11.564806 (+ 23601us) service_pool.cc:224] Handling call
0709 14:51:14.576147 (+3011341us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 14:51:14.280421 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 14:51:14.333975 (+ 53554us) write_op.cc:432] Acquiring schema lock in shared mode
0709 14:51:14.334042 (+    67us) write_op.cc:435] Acquired schema lock
0709 14:51:14.334066 (+    24us) tablet.cc:662] Decoding operations
0709 14:51:14.334619 (+   553us) write_op.cc:620] Acquiring the partition lock for write op
0709 14:51:14.334722 (+   103us) write_op.cc:641] Partition lock acquired for write op
0709 14:51:14.334759 (+    37us) tablet.cc:685] Acquiring locks for 1 operations
0709 14:51:14.335161 (+   402us) tablet.cc:701] Row locks acquired
0709 14:51:14.335216 (+    55us) write_op.cc:260] PREPARE: finished
0709 14:51:14.335454 (+   238us) write_op.cc:270] Start()
0709 14:51:14.335665 (+   211us) write_op.cc:276] Timestamp: P: 1783608674335373 usec, L: 0
0709 14:51:14.335690 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 14:51:14.336693 (+  1003us) log.cc:844] Serialized 538 byte log entry
0709 14:51:14.383390 (+ 46697us) op_driver.cc:464] REPLICATION: finished
0709 14:51:14.545684 (+162294us) write_op.cc:301] APPLY: starting
0709 14:51:14.557283 (+ 11599us) tablet.cc:1367] starting BulkCheckPresence
0709 14:51:14.560472 (+  3189us) tablet.cc:1370] finished BulkCheckPresence
0709 14:51:14.560634 (+   162us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 14:51:14.560967 (+   333us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 14:51:14.561333 (+   366us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 14:51:14.561375 (+    42us) write_op.cc:312] APPLY: finished
0709 14:51:14.561679 (+   304us) log.cc:844] Serialized 23 byte log entry
0709 14:51:14.562158 (+   479us) write_op.cc:489] Releasing partition, row and schema locks
0709 14:51:14.562245 (+    87us) write_op.cc:454] Released schema lock
0709 14:51:14.562323 (+    78us) write_op.cc:341] FINISH: Updating metrics
0709 14:51:14.562813 (+   490us) write_op.cc:489] Releasing partition, row and schema locks
0709 14:51:14.562840 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":11553,"reported_tablets":10,"child_traces":[["op",{"apply.queue_time_us":150685,"apply.run_cpu_time_us":2780,"apply.run_wall_time_us":21270,"num_ops":1,"prepare.queue_time_us":160653,"prepare.run_cpu_time_us":4789,"prepare.run_wall_time_us":80909,"replication_time_us":47451,"thread_start_us":180128,"threads_started":2}]]}
I20260709 14:51:14.545053  9657 raft_consensus.cc:515] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:14.580858  7675 catalog_manager.cc:5697] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 4 to 6, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 6 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
W20260709 14:51:14.604600  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 99715.4us
I20260709 14:51:14.697680  9679 raft_consensus.cc:493] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:14.750694  9679 raft_consensus.cc:515] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:14.751183  7893 leader_election.cc:304] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:14.752609  9550 raft_consensus.cc:2749] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 14:51:14.624974  7846 raft_consensus.cc:1240] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 3. Current term is 4. Ops: []
I20260709 14:51:14.740972  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258d6c2dda954bf5b65930fde8ecb9f3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:14.738778  7850 raft_consensus.cc:1275] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 14:51:14.750746  9644 consensus_queue.cc:1048] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 14:51:14.739508  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:14.755648  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:14.756083  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:14.756517  7850 raft_consensus.cc:3055] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 LEADER]: Stepping down as leader of term 4
I20260709 14:51:14.756918  7850 raft_consensus.cc:740] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:51:14.739162  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:14.738905  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:14.754648  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:14.610942  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c563cc7cfbe4d59be4ffc5cf847ce56" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:14.623453  6549 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 14:51:14.643258  9378 raft_consensus.cc:493] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:14.722597  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:14.757879  7850 consensus_queue.cc:260] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:14.776382  7850 raft_consensus.cc:3060] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:51:14.775435  9378 raft_consensus.cc:515] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:14.758616  7893 leader_election.cc:304] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:14.761027  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:51:14.759421  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:14.781488  7893 leader_election.cc:304] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:14.759876  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:14.784024  7854 raft_consensus.cc:2410] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 14:51:14.758471  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9441e831627143a991a1556dcdce71e3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:14.757215  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:14.768222  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c563cc7cfbe4d59be4ffc5cf847ce56" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:14.754700  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
W20260709 14:51:14.789975  7743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:14.681032  7848 raft_consensus.cc:1275] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Refusing update from remote peer 9418391fa82a42c79c6cad13ba91d964: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 14:51:14.646020  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:14.782495  9659 raft_consensus.cc:2804] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 14:51:14.781798  9550 raft_consensus.cc:2804] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 14:51:14.788910  9679 leader_election.cc:290] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:14.813838  7893 leader_election.cc:304] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:14.812891  7674 catalog_manager.cc:5697] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 4 to 5, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 5 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
W20260709 14:51:14.825584  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:14.797803  9659 raft_consensus.cc:493] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:51:14.811441  9550 raft_consensus.cc:493] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:51:14.742473  9657 leader_election.cc:290] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 5 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:14.796212  9658 consensus_queue.cc:1048] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 14:51:14.794765  9516 consensus_queue.cc:1048] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 14:51:14.793741  9603 consensus_queue.cc:1048] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 14:51:14.830026  9559 consensus_queue.cc:1048] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 14:51:14.834105  9378 leader_election.cc:290] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:14.834559  7819 leader_election.cc:304] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:14.827600  7674 catalog_manager.cc:5697] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 4 to 5, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 5 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:51:14.843266  9658 raft_consensus.cc:2804] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 14:51:14.843751  9658 raft_consensus.cc:493] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:14.844107  9658 raft_consensus.cc:3060] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:51:14.831173  9550 raft_consensus.cc:3060] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:51:14.829432  9659 raft_consensus.cc:3060] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:51:14.828138  9590 raft_consensus.cc:3060] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Advancing to term 5
W20260709 14:51:14.847889  7744 leader_election.cc:336] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785): Timed out: RequestConsensusVote RPC to 127.6.101.67:40785 timed out after 1.976s (SENT)
I20260709 14:51:14.851996  7744 leader_election.cc:304] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:14.854849  9378 raft_consensus.cc:2749] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 14:51:14.833221  9679 raft_consensus.cc:493] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:14.858749  9679 raft_consensus.cc:515] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:14.846141  7674 catalog_manager.cc:5697] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:51:14.863401  7674 catalog_manager.cc:5697] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:51:14.870420  7674 catalog_manager.cc:5697] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:51:14.872686  9590 raft_consensus.cc:2749] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 14:51:14.865674  9630 consensus_queue.cc:1048] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.017s
I20260709 14:51:14.874157  7893 leader_election.cc:304] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:14.893858  7850 raft_consensus.cc:2468] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 5.
I20260709 14:51:14.882329  7674 catalog_manager.cc:5697] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 6 to 7, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 7 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:51:14.896921  7674 catalog_manager.cc:5697] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 3 to 4, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 4 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
W20260709 14:51:14.901348  7743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:51:14.906443  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 80017.5us
I20260709 14:51:14.902328  9603 raft_consensus.cc:2749] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 14:51:14.897523  9679 leader_election.cc:290] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:14.920142  7894 leader_election.cc:304] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:14.921311  9691 raft_consensus.cc:2804] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 14:51:14.921494  7893 leader_election.cc:304] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:14.922235  9691 raft_consensus.cc:697] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:14.922605  9516 raft_consensus.cc:2749] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 14:51:14.923916  9378 raft_consensus.cc:493] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:14.924481  9378 raft_consensus.cc:515] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:14.923549  9691 consensus_queue.cc:237] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:14.926414  9550 raft_consensus.cc:515] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:14.927367  9378 leader_election.cc:290] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:51:14.928975  7744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:14.923112  7893 leader_election.cc:304] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:14.876874  9658 raft_consensus.cc:515] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:14.940303  9516 raft_consensus.cc:2749] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 14:51:14.924853  9689 raft_consensus.cc:493] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:14.942938  9689 raft_consensus.cc:515] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:14.944268  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 99871.2us
I20260709 14:51:14.946414  7674 catalog_manager.cc:5697] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 5 to 6, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 6 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
W20260709 14:51:14.949015  8599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 103883us
I20260709 14:51:14.950352  7893 leader_election.cc:304] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:14.952299  7893 leader_election.cc:400] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 3 election: Vote denied by peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587) with higher term. Message: Invalid argument: T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 3. Current term is 4.
I20260709 14:51:14.954270  7674 catalog_manager.cc:5697] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 3 to 4, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 4 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:51:14.957350  9657 raft_consensus.cc:2749] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 14:51:14.960878  7850 raft_consensus.cc:1240] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 2. Current term is 3. Ops: []
I20260709 14:51:14.962213  7674 catalog_manager.cc:5697] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:51:14.973925  7893 leader_election.cc:304] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:14.976204  9630 consensus_queue.cc:1059] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 14:51:14.981684  9657 raft_consensus.cc:2749] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 14:51:14.979247  7674 catalog_manager.cc:5697] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 3 to 4, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 4 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:51:14.985562  9658 leader_election.cc:290] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 3 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:14.986768  7674 catalog_manager.cc:5697] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 4 to 5, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 5 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:51:14.987622  9659 raft_consensus.cc:515] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:14.980731  9644 raft_consensus.cc:3055] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 LEADER]: Stepping down as leader of term 4
I20260709 14:51:14.989557  9644 raft_consensus.cc:740] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:51:14.990628  9644 consensus_queue.cc:260] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:14.993508  9550 leader_election.cc:290] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:14.995545  9659 leader_election.cc:290] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 7 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:14.996501  9550 consensus_queue.cc:1059] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 14:51:14.997195  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:14.997895  9689 leader_election.cc:290] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:14.998142  9659 raft_consensus.cc:3055] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 14:51:14.998735  9659 raft_consensus.cc:740] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:14.999375  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:15.001142  7893 leader_election.cc:304] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:14.997222  9644 raft_consensus.cc:3060] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:51:15.002627  7819 leader_election.cc:304] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:15.005812  9692 raft_consensus.cc:3060] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:51:14.999707  9659 consensus_queue.cc:260] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:15.018977  9689 raft_consensus.cc:493] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:15.038993  7893 leader_election.cc:304] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:15.006910  9691 raft_consensus.cc:2749] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 14:51:15.042361  7819 leader_election.cc:304] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:15.039095  9689 raft_consensus.cc:515] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:15.047541  9689 leader_election.cc:290] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:15.066462  9691 raft_consensus.cc:2749] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 14:51:15.064913  9644 raft_consensus.cc:2749] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 14:51:15.068773  9691 raft_consensus.cc:493] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:15.069443  9691 raft_consensus.cc:515] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:15.059127  9659 raft_consensus.cc:3060] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:51:15.086971  9691 leader_election.cc:290] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:15.065311  9692 raft_consensus.cc:2749] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 14:51:15.094540  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:15.105960  7772 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "783e4874513449ef9084b833f188a6d3"
dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
mode: GRACEFUL
new_leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:47068
I20260709 14:51:15.107290  7772 raft_consensus.cc:606] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 LEADER]: Received request to transfer leadership to TS 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:15.115036  7772 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01"
dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
mode: GRACEFUL
new_leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:47068
I20260709 14:51:15.116122  7772 raft_consensus.cc:606] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 LEADER]: Received request to transfer leadership to TS 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:15.121181  7772 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca"
dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
mode: GRACEFUL
new_leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:47068
I20260709 14:51:15.122191  7772 raft_consensus.cc:606] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 LEADER]: Received request to transfer leadership to TS 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:15.124420  9689 raft_consensus.cc:493] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:15.125118  9689 raft_consensus.cc:515] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:15.130965  9689 leader_election.cc:290] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:15.131814  7773 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3"
dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
mode: GRACEFUL
new_leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:47068
I20260709 14:51:15.133006  7773 raft_consensus.cc:606] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Received request to transfer leadership to TS 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:15.133534  7773 raft_consensus.cc:614] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 14:51:15.137988  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 95812.2us
I20260709 14:51:15.140237  7921 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
mode: GRACEFUL
new_leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:48676
I20260709 14:51:15.141119  7921 raft_consensus.cc:606] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 LEADER]: Received request to transfer leadership to TS 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:51:15.142277  7819 leader_election.cc:304] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:15.146664  7744 leader_election.cc:304] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:15.147682  9679 raft_consensus.cc:2749] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 14:51:15.148788  9692 raft_consensus.cc:2749] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 14:51:15.149998  7773 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c"
dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
mode: GRACEFUL
new_leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
 from {username='slave'} at 127.0.0.1:47068
I20260709 14:51:15.151171  7773 raft_consensus.cc:606] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Received request to transfer leadership to TS 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:15.151624  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:15.151696  7773 raft_consensus.cc:614] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 14:51:15.154788  7819 leader_election.cc:304] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:15.161890  9692 raft_consensus.cc:3060] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:51:15.168251  9679 consensus_queue.cc:1059] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 14:51:15.169926  9378 consensus_queue.cc:1059] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 14:51:15.170415  9679 raft_consensus.cc:3055] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 LEADER]: Stepping down as leader of term 4
I20260709 14:51:15.171069  9679 raft_consensus.cc:740] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:51:15.155501  6549 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 14:51:15.171284  9685 raft_consensus.cc:3055] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 LEADER]: Stepping down as leader of term 6
I20260709 14:51:15.171973  9685 raft_consensus.cc:740] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:51:15.173801  6549 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 14:51:15.172924  9685 consensus_queue.cc:260] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:15.175396  9685 raft_consensus.cc:3060] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:51:15.187480  9692 raft_consensus.cc:2749] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 14:51:15.193166  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:15.193516  7928 raft_consensus.cc:1275] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 14:51:15.195140  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:15.196460  9659 raft_consensus.cc:493] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:15.197186  9659 raft_consensus.cc:515] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:15.199543  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:15.200708  7921 raft_consensus.cc:3060] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Advancing to term 6
W20260709 14:51:15.201181  7743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:15.202878  7674 catalog_manager.cc:5697] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 4 to 5, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 5 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:51:15.204594  9679 consensus_queue.cc:260] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:15.158501  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:15.155055  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:15.205623  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:15.205755  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c563cc7cfbe4d59be4ffc5cf847ce56" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:15.206195  9659 leader_election.cc:290] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:15.206961  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
W20260709 14:51:15.232978  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 51757.7us
I20260709 14:51:15.234665  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:15.235215  9644 consensus_queue.cc:1048] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 14:51:15.235972  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:15.236243  9658 consensus_queue.cc:1048] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 14:51:15.207414  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:15.238394  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:15.239079  7925 raft_consensus.cc:2468] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 3.
I20260709 14:51:15.240231  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:15.208041  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258d6c2dda954bf5b65930fde8ecb9f3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:15.243113  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
W20260709 14:51:15.248023  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:15.208348  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce9c0ef2db24c13a8b1402f21819458" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:15.208552  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:15.232920  7920 raft_consensus.cc:2468] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 4.
I20260709 14:51:15.250383  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:15.250784  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:15.251646  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:15.251920  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:15.252758  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:15.252995  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
W20260709 14:51:15.253706  7742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:15.211133  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:15.211751  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:15.186177  9378 consensus_queue.cc:1059] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 14:51:15.233095  9679 raft_consensus.cc:3060] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:51:15.226604  9689 consensus_queue.cc:1059] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 14:51:15.208796  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:15.255926  7922 raft_consensus.cc:2393] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 4: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
W20260709 14:51:15.201390  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:15.157281  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783e4874513449ef9084b833f188a6d3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:15.265813  9659 raft_consensus.cc:493] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:15.266589  9659 raft_consensus.cc:515] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:15.267421  7923 raft_consensus.cc:2468] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 5.
I20260709 14:51:15.270641  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:15.270995  9644 consensus_queue.cc:1059] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 14:51:15.272993  9659 leader_election.cc:290] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:15.272689  9658 raft_consensus.cc:3055] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 LEADER]: Stepping down as leader of term 4
I20260709 14:51:15.273840  9658 raft_consensus.cc:740] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:51:15.275413  9658 consensus_queue.cc:260] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:15.282167  9658 raft_consensus.cc:3060] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:51:15.287312  9698 raft_consensus.cc:3055] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 LEADER]: Stepping down as leader of term 4
I20260709 14:51:15.287197  9644 consensus_queue.cc:1059] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 14:51:15.288007  9698 raft_consensus.cc:740] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:51:15.289476  9692 raft_consensus.cc:3055] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 LEADER]: Stepping down as leader of term 4
W20260709 14:51:15.289340  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 104548us
I20260709 14:51:15.292243  9644 consensus_queue.cc:1059] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 14:51:15.292820  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:15.294427  9630 raft_consensus.cc:3055] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 LEADER]: Stepping down as leader of term 5
I20260709 14:51:15.294694  9685 raft_consensus.cc:3055] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 LEADER]: Stepping down as leader of term 4
I20260709 14:51:15.294504  9689 consensus_queue.cc:1059] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 14:51:15.295205  9630 raft_consensus.cc:740] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:51:15.295498  9685 raft_consensus.cc:740] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:51:15.296981  9630 consensus_queue.cc:260] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:15.294925  9378 consensus_queue.cc:1059] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 14:51:15.298184  9685 consensus_queue.cc:260] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:15.299362  9378 raft_consensus.cc:3055] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 LEADER]: Stepping down as leader of term 3
I20260709 14:51:15.300770  9378 raft_consensus.cc:740] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:51:15.300982  9685 raft_consensus.cc:3060] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:51:15.301972  9378 consensus_queue.cc:260] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:15.304003  9378 raft_consensus.cc:3060] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:51:15.306807  9696 raft_consensus.cc:3055] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 LEADER]: Stepping down as leader of term 4
I20260709 14:51:15.290165  9692 raft_consensus.cc:740] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:51:15.308039  9630 raft_consensus.cc:3060] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:51:15.310302  9644 consensus_queue.cc:1048] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 14:51:15.311676  9692 consensus_queue.cc:260] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:15.307474  9696 raft_consensus.cc:740] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:51:15.313480  9698 consensus_queue.cc:260] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:15.314564  9692 raft_consensus.cc:3060] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:51:15.320785  7921 raft_consensus.cc:2410] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for term 6 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 14:51:15.326764  9698 raft_consensus.cc:3060] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:51:15.296561  9689 consensus_queue.cc:1059] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 14:51:15.321836  9696 consensus_queue.cc:260] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:15.331019  9689 raft_consensus.cc:3055] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 LEADER]: Stepping down as leader of term 5
I20260709 14:51:15.336817  9689 raft_consensus.cc:740] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:51:15.337984  9689 consensus_queue.cc:260] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:15.342815  9689 raft_consensus.cc:3060] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:51:15.411408  9696 raft_consensus.cc:3060] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Advancing to term 5
W20260709 14:51:15.426756  7743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:15.428406  9699 consensus_queue.cc:1059] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 14:51:15.430322  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 123788us
I20260709 14:51:15.431548  7819 leader_election.cc:304] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:15.435377  7819 leader_election.cc:304] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:15.458236  9697 consensus_queue.cc:1059] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 14:51:15.464162  9644 raft_consensus.cc:2804] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 14:51:15.464785  9644 raft_consensus.cc:493] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:15.465662  9659 raft_consensus.cc:493] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:51:15.466336  9659 raft_consensus.cc:515] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:15.470098  9659 leader_election.cc:290] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:15.473881  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:15.475225  7845 raft_consensus.cc:2393] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 4: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:51:15.444702  9630 raft_consensus.cc:2804] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Leader election won for term 4
I20260709 14:51:15.478003  9630 raft_consensus.cc:697] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:51:15.479218  9630 consensus_queue.cc:237] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:15.487591  9679 raft_consensus.cc:3055] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 LEADER]: Stepping down as leader of term 3
I20260709 14:51:15.488559  9679 raft_consensus.cc:740] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:51:15.494820  9679 consensus_queue.cc:260] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:15.496553  7853 raft_consensus.cc:1275] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 14:51:15.465173  9644 raft_consensus.cc:3060] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:51:15.505200  9657 consensus_queue.cc:1048] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 14:51:15.515187  9658 raft_consensus.cc:493] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:15.524260  7819 leader_election.cc:304] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:15.516237  9658 raft_consensus.cc:515] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:15.560707  7745 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:15.565460  9658 leader_election.cc:290] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:15.562266  9692 raft_consensus.cc:3060] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Advancing to term 5
W20260709 14:51:15.582836  7742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:15.565189  9644 raft_consensus.cc:515] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:15.591087  7850 raft_consensus.cc:1240] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 4. Current term is 5. Ops: []
I20260709 14:51:15.591228  9644 leader_election.cc:290] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 5 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:51:15.598398  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 153008us
I20260709 14:51:15.602415  9685 raft_consensus.cc:3055] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 LEADER]: Stepping down as leader of term 2
I20260709 14:51:15.609157  9685 raft_consensus.cc:740] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
W20260709 14:51:15.615259  7745 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:51:15.624482  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:15.627832  9550 consensus_queue.cc:1059] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 14:51:15.626688  9685 consensus_queue.cc:260] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:15.633028  9685 raft_consensus.cc:3060] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Advancing to term 3
W20260709 14:51:15.635382  7745 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:51:15.637410  7743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:15.640827  9692 raft_consensus.cc:2749] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 14:51:15.646656  9679 raft_consensus.cc:3060] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:51:15.649753  7819 leader_election.cc:304] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
W20260709 14:51:15.650008  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 318866us
I20260709 14:51:15.651518  9692 raft_consensus.cc:3060] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Advancing to term 5
W20260709 14:51:15.662041  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:51:15.662390  9704 log.cc:927] Time spent T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.065s	user 0.003s	sys 0.003s
I20260709 14:51:15.665627  9691 raft_consensus.cc:3055] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 14:51:15.666692  9691 raft_consensus.cc:740] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:15.667870  9691 consensus_queue.cc:260] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:15.662602  7819 leader_election.cc:304] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:15.669957  9691 raft_consensus.cc:3060] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:51:15.670769  9706 raft_consensus.cc:2804] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 14:51:15.671264  9706 raft_consensus.cc:493] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:15.671684  9706 raft_consensus.cc:3060] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:51:15.685897  9697 consensus_queue.cc:1059] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 14:51:15.686277  9703 consensus_queue.cc:1059] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 14:51:15.687590  9697 raft_consensus.cc:3055] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Stepping down as leader of term 1
I20260709 14:51:15.688141  9697 raft_consensus.cc:740] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:51:15.687629  9703 raft_consensus.cc:3055] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 LEADER]: Stepping down as leader of term 4
I20260709 14:51:15.689179  9703 raft_consensus.cc:740] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:51:15.689558  9697 consensus_queue.cc:260] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:15.690217  9703 consensus_queue.cc:260] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:15.691793  9703 raft_consensus.cc:3060] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:51:15.692143  9702 consensus_queue.cc:1059] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 14:51:15.693998  9699 raft_consensus.cc:3055] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 LEADER]: Stepping down as leader of term 5
I20260709 14:51:15.694792  9699 raft_consensus.cc:740] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:51:15.696020  9699 consensus_queue.cc:260] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:15.693982  7819 leader_election.cc:304] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 9418391fa82a42c79c6cad13ba91d964
I20260709 14:51:15.701316  9699 raft_consensus.cc:3060] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:51:15.691582  9697 raft_consensus.cc:3060] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:51:15.685135  9685 consensus_queue.cc:1059] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 14:51:15.715739  7819 leader_election.cc:304] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:15.714768  9705 raft_consensus.cc:2749] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 14:51:15.712963  7674 catalog_manager.cc:5697] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 3 to 4, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 4 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
W20260709 14:51:15.726014  7742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:15.735293  9630 raft_consensus.cc:2804] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 14:51:15.739058  9630 raft_consensus.cc:493] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:15.739650  9630 raft_consensus.cc:3060] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:51:15.722891  9550 raft_consensus.cc:493] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
W20260709 14:51:15.749215  7745 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:51:15.751662  7745 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:15.751842  9644 consensus_queue.cc:1048] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 14:51:15.753412  9702 raft_consensus.cc:3055] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 LEADER]: Stepping down as leader of term 2
I20260709 14:51:15.754074  9702 raft_consensus.cc:740] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:51:15.755923  9702 consensus_queue.cc:260] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:15.767268  9692 raft_consensus.cc:2749] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 14:51:15.770530  7819 leader_election.cc:304] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:15.750965  9550 raft_consensus.cc:515] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:15.806756  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 79609.6us
I20260709 14:51:15.791059  9679 consensus_queue.cc:1048] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.016s
I20260709 14:51:15.732084  9706 raft_consensus.cc:515] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:15.776377  9692 raft_consensus.cc:2804] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader election won for term 7
I20260709 14:51:15.814666  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
W20260709 14:51:15.828979  7743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:15.815779  7925 raft_consensus.cc:1275] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 14:51:15.817114  7921 raft_consensus.cc:1240] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 5. Current term is 6. Ops: []
I20260709 14:51:15.828819  9692 raft_consensus.cc:697] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:51:15.817704  7924 raft_consensus.cc:1275] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 14:51:15.818146  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:15.819096  7922 raft_consensus.cc:1275] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 14:51:15.819248  7928 raft_consensus.cc:1240] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 4. Current term is 5. Ops: []
I20260709 14:51:15.837455  7919 raft_consensus.cc:2393] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 2: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:51:15.841760  7744 leader_election.cc:304] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:51:15.772732  9630 raft_consensus.cc:515] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:15.829107  9702 raft_consensus.cc:3060] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:51:15.872761  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:51:15.847288  7819 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:15.847755  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:15.848434  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:15.849685  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:15.851783  9685 consensus_queue.cc:1059] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 14:51:15.852662  9703 consensus_queue.cc:1059] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 14:51:15.853492  9699 consensus_queue.cc:1059] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 14:51:15.856247  7851 raft_consensus.cc:1240] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 6. Current term is 7. Ops: []
I20260709 14:51:15.844484  9692 consensus_queue.cc:237] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:15.844780  9697 raft_consensus.cc:2804] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 14:51:15.856307  9550 leader_election.cc:290] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:15.853524  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:15.954604  7924 raft_consensus.cc:2468] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 6.
W20260709 14:51:15.953759  7742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:51:15.958715  8599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 105635us
I20260709 14:51:15.959177  7923 raft_consensus.cc:2468] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 4.
W20260709 14:51:15.953058  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:15.958581  7744 leader_election.cc:304] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:51:15.971496  9705 raft_consensus.cc:493] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:51:15.972338  9705 raft_consensus.cc:515] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:15.973788  9703 raft_consensus.cc:3055] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 LEADER]: Stepping down as leader of term 3
I20260709 14:51:15.974385  9703 raft_consensus.cc:740] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:51:15.975447  9703 consensus_queue.cc:260] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:15.969681  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:15.977595  9701 raft_consensus.cc:493] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:15.978761  9689 raft_consensus.cc:3055] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 LEADER]: Stepping down as leader of term 3
I20260709 14:51:15.978345  9701 raft_consensus.cc:515] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:15.979286  9689 raft_consensus.cc:740] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:51:15.980320  9689 consensus_queue.cc:260] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:15.981537  9378 raft_consensus.cc:993] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed: : Instructing follower 3876b8ee8d744cb18e91d97aae93b1ac to start an election
I20260709 14:51:15.975474  9705 leader_election.cc:290] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:15.982522  9701 leader_election.cc:290] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:15.976879  9703 raft_consensus.cc:3060] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:51:15.971697  7928 raft_consensus.cc:2393] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 6: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
W20260709 14:51:15.999358  7742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:15.993108  9699 raft_consensus.cc:3055] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 LEADER]: Stepping down as leader of term 3
I20260709 14:51:16.000665  9699 raft_consensus.cc:740] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
W20260709 14:51:16.007740  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 49244.7us
I20260709 14:51:15.958209  9697 raft_consensus.cc:493] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:16.027434  7744 leader_election.cc:304] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 9418391fa82a42c79c6cad13ba91d964
I20260709 14:51:16.012135  9699 consensus_queue.cc:260] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:16.027778  9706 leader_election.cc:290] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 7 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:16.020203  7819 leader_election.cc:304] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:16.026360  7922 raft_consensus.cc:2468] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 3.
I20260709 14:51:16.015232  9697 raft_consensus.cc:3060] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Advancing to term 3
W20260709 14:51:16.029809  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 59418.2us
I20260709 14:51:15.982545  9378 raft_consensus.cc:1081] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 LEADER]: Signalling peer 3876b8ee8d744cb18e91d97aae93b1ac to start an election
I20260709 14:51:16.031118  9550 raft_consensus.cc:493] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:16.029445  9689 raft_consensus.cc:3060] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:51:16.022126  9679 raft_consensus.cc:2804] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 14:51:16.032905  9699 raft_consensus.cc:3060] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Advancing to term 4
W20260709 14:51:16.040377  7742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:16.011786  7919 raft_consensus.cc:2468] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 5.
I20260709 14:51:16.043951  9679 raft_consensus.cc:493] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:16.041560  9685 raft_consensus.cc:2749] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 14:51:16.053962  7893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:51:16.054790  7742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:16.059724  9679 raft_consensus.cc:3060] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:51:16.061931  9630 leader_election.cc:290] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 5 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:16.047031  9657 consensus_queue.cc:1059] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
W20260709 14:51:16.071996  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 44654.7us
I20260709 14:51:16.041940  9706 raft_consensus.cc:3060] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:51:16.078378  7744 leader_election.cc:304] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:16.063858  9713 raft_consensus.cc:493] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:16.090840  7819 leader_election.cc:304] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:16.044858  9550 raft_consensus.cc:515] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:16.094094  9713 raft_consensus.cc:515] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:16.115805  9713 leader_election.cc:290] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:51:16.116989  7742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:51:16.117286  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:16.090040  9685 raft_consensus.cc:2749] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 14:51:16.127048  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 53606.2us
I20260709 14:51:16.128705  7744 leader_election.cc:304] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:16.125562  9705 raft_consensus.cc:2749] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 14:51:16.167758  7744 leader_election.cc:304] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:16.164881  7819 leader_election.cc:304] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:16.165959  9685 raft_consensus.cc:2749] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 14:51:16.172334  7744 leader_election.cc:304] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:51:16.140820  9659 raft_consensus.cc:493] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:51:16.155611  7745 leader_election.cc:304] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:16.187314  9659 raft_consensus.cc:515] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:16.189724  9550 leader_election.cc:290] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:16.190402  9659 leader_election.cc:290] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:16.191908  9698 raft_consensus.cc:2804] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader election won for term 5
I20260709 14:51:16.192553  9698 raft_consensus.cc:697] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:51:16.183679  9378 consensus_queue.cc:1059] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 14:51:16.205546  9685 raft_consensus.cc:493] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:16.205644  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:16.206156  9685 raft_consensus.cc:515] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:16.208523  9685 leader_election.cc:290] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:16.208688  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:16.193185  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:16.209817  7772 raft_consensus.cc:2468] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 5.
I20260709 14:51:16.210425  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:16.210697  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c563cc7cfbe4d59be4ffc5cf847ce56" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:16.211232  7775 raft_consensus.cc:2393] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 5: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:51:16.194118  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:16.175681  6549 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 14:51:16.195003  7778 pending_rounds.cc:85] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed: Aborting all ops after (but not including) 2
I20260709 14:51:16.203095  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:16.216380  7845 raft_consensus.cc:2468] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 3.
I20260709 14:51:16.197641  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
W20260709 14:51:16.217809  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 53010.9us
I20260709 14:51:16.218989  7819 leader_election.cc:304] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:16.226413  7777 raft_consensus.cc:2368] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 6. Current term is 7.
I20260709 14:51:16.227430  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:51:16.230635  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 75085.3us
I20260709 14:51:16.232678  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:16.234594  7845 raft_consensus.cc:2393] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 4: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:51:16.204495  9378 raft_consensus.cc:3055] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 LEADER]: Stepping down as leader of term 3
I20260709 14:51:16.213994  7778 pending_rounds.cc:107] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 14:51:16.195187  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:16.213135  7776 raft_consensus.cc:2468] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 4.
I20260709 14:51:16.241334  7774 raft_consensus.cc:3060] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:51:16.241194  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:16.240782  9378 raft_consensus.cc:740] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:51:16.238874  7778 raft_consensus.cc:2889] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:51:16.195394  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:16.251499  7773 raft_consensus.cc:2393] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 5: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:51:16.220978  9705 raft_consensus.cc:2749] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 14:51:16.254112  7770 raft_consensus.cc:2393] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 5: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:51:16.255403  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:16.257591  9702 consensus_queue.cc:1048] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 14:51:16.193607  9698 consensus_queue.cc:237] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:16.249471  9378 consensus_queue.cc:260] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:16.262938  7770 raft_consensus.cc:3060] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:51:16.192610  9701 raft_consensus.cc:2749] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 14:51:16.240872  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:16.292177  7775 raft_consensus.cc:3060] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:51:16.232966  9550 raft_consensus.cc:493] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:16.237106  9696 raft_consensus.cc:2749] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 14:51:16.299418  9711 raft_consensus.cc:493] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:51:16.300117  9711 raft_consensus.cc:515] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:16.302012  9720 raft_consensus.cc:493] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:51:16.302588  9720 raft_consensus.cc:515] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:16.304529  9719 raft_consensus.cc:493] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:16.305408  9719 raft_consensus.cc:515] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:16.303278  9700 raft_consensus.cc:2749] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 14:51:16.308266  9713 raft_consensus.cc:3055] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 14:51:16.308835  9713 raft_consensus.cc:740] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:16.309890  9713 consensus_queue.cc:260] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:16.311269  9713 raft_consensus.cc:3060] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:51:16.313215  7779 raft_consensus.cc:2468] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 2.
I20260709 14:51:16.298985  9550 raft_consensus.cc:515] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:16.342890  9657 raft_consensus.cc:493] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:16.343519  9657 raft_consensus.cc:515] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:16.370819  9724 raft_consensus.cc:493] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:16.371527  9724 raft_consensus.cc:515] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:16.416558  7776 raft_consensus.cc:1240] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 14:51:16.418323  9657 leader_election.cc:290] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:16.419997  9719 leader_election.cc:290] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:16.420763  9711 leader_election.cc:290] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:16.423614  9703 raft_consensus.cc:493] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:16.424220  9703 raft_consensus.cc:515] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:16.425966  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 194109us
I20260709 14:51:16.427047  7745 leader_election.cc:304] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:16.439033  9698 raft_consensus.cc:2749] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 14:51:16.468261  7745 leader_election.cc:304] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:16.469561  9698 raft_consensus.cc:2749] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 14:51:16.469982  7893 leader_election.cc:304] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:16.470157  7745 leader_election.cc:304] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:16.471138  9698 raft_consensus.cc:2749] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 14:51:16.471722  7745 leader_election.cc:304] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:16.471884  7893 leader_election.cc:304] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:16.472668  9698 raft_consensus.cc:2749] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 14:51:16.473570  9719 raft_consensus.cc:2749] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 14:51:16.474207  9711 raft_consensus.cc:2749] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 14:51:16.473820  9378 raft_consensus.cc:3060] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Advancing to term 4
W20260709 14:51:16.481657  7893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:51:16.483140  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 119645us
I20260709 14:51:16.484289  7894 leader_election.cc:304] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
W20260709 14:51:16.489063  7744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:16.472100  7676 catalog_manager.cc:5697] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 4 to 7, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 7 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:51:16.505540  7745 leader_election.cc:304] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:16.506809  9719 raft_consensus.cc:2804] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 14:51:16.514896  7922 raft_consensus.cc:1240] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 7. Current term is 8. Ops: []
I20260709 14:51:16.503881  9706 raft_consensus.cc:2749] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 14:51:16.526587  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:16.527135  7893 leader_election.cc:304] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:16.527379  7924 raft_consensus.cc:2468] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 4.
I20260709 14:51:16.528820  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:16.504509  9699 raft_consensus.cc:493] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:16.475152  9697 raft_consensus.cc:515] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:16.510317  9657 raft_consensus.cc:493] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:16.510586  9698 raft_consensus.cc:493] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9418391fa82a42c79c6cad13ba91d964)
W20260709 14:51:16.545378  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 326527us
W20260709 14:51:16.542320  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:16.546626  7819 leader_election.cc:304] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:16.520927  9719 raft_consensus.cc:493] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:16.548005  7774 raft_consensus.cc:2468] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 4.
I20260709 14:51:16.518901  9550 leader_election.cc:290] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:16.548962  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:16.558518  7777 raft_consensus.cc:2468] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 4.
I20260709 14:51:16.559790  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:16.555662  9719 raft_consensus.cc:3060] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:51:16.549682  9699 raft_consensus.cc:515] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:16.567404  7774 raft_consensus.cc:2468] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 6.
I20260709 14:51:16.528479  9720 leader_election.cc:290] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:16.543967  9630 raft_consensus.cc:493] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:16.573596  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:16.576001  7777 raft_consensus.cc:3060] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:51:16.576418  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:16.577438  7845 raft_consensus.cc:2468] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 5.
I20260709 14:51:16.585749  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:16.586539  7774 raft_consensus.cc:2468] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 2.
I20260709 14:51:16.587016  7893 leader_election.cc:400] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 election: Vote denied by peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587) with higher term. Message: Invalid argument: T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 6. Current term is 7.
I20260709 14:51:16.587352  7893 leader_election.cc:403] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 14:51:16.587476  7819 leader_election.cc:304] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:16.554873  9659 raft_consensus.cc:493] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:16.594208  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:16.595439  7774 raft_consensus.cc:2468] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 4.
I20260709 14:51:16.589445  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:16.597731  7771 raft_consensus.cc:1240] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 2. Current term is 3. Ops: []
I20260709 14:51:16.547717  9732 raft_consensus.cc:2749] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 14:51:16.585486  9679 consensus_meta.cc:287] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent flushing consensus metadata: real 0.524s	user 0.019s	sys 0.014s
I20260709 14:51:16.602022  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:16.602842  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:16.573793  9706 raft_consensus.cc:2749] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 14:51:16.604172  7774 raft_consensus.cc:2393] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 6: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:51:16.573683  9550 raft_consensus.cc:493] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:16.604560  7845 raft_consensus.cc:2393] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 4: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:51:16.610457  7893 leader_election.cc:304] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:16.613561  9550 raft_consensus.cc:515] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:16.614792  7893 leader_election.cc:304] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:16.554857  9698 raft_consensus.cc:515] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:51:16.589923  9724 leader_election.cc:290] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:16.549849  9657 raft_consensus.cc:515] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:16.626761  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:16.632093  7770 raft_consensus.cc:2468] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 5.
I20260709 14:51:16.638868  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:16.639731  7770 raft_consensus.cc:2468] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 4.
I20260709 14:51:16.605151  9691 raft_consensus.cc:2749] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587) with higher term. Message: Invalid argument: T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 6. Current term is 7.
I20260709 14:51:16.634706  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:16.595088  9630 raft_consensus.cc:515] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:16.641810  9644 consensus_queue.cc:1048] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 14:51:16.642400  9697 leader_election.cc:290] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:16.645694  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:16.617527  9692 raft_consensus.cc:3060] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:51:16.602077  9659 raft_consensus.cc:515] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:16.660571  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:16.682019  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:16.657490  7774 raft_consensus.cc:3060] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:51:16.605990  9679 raft_consensus.cc:515] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:16.750016  7742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:16.762491  7770 raft_consensus.cc:2393] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 6: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:51:16.763967  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
W20260709 14:51:16.763015  7742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:16.682852  7819 leader_election.cc:304] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
W20260709 14:51:16.764122  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 258741us
I20260709 14:51:16.763797  7776 raft_consensus.cc:2468] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 4.
I20260709 14:51:16.638630  9658 consensus_queue.cc:1048] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.101s
I20260709 14:51:16.764247  7775 raft_consensus.cc:2468] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 5.
I20260709 14:51:16.775699  7745 leader_election.cc:304] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 3876b8ee8d744cb18e91d97aae93b1ac, 9418391fa82a42c79c6cad13ba91d964
I20260709 14:51:16.776588  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
W20260709 14:51:16.767134  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 84594.1us
I20260709 14:51:16.721235  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:16.777931  7819 leader_election.cc:304] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:16.778272  7851 raft_consensus.cc:2468] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 3.
I20260709 14:51:16.764794  7779 raft_consensus.cc:2468] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 5.
I20260709 14:51:16.779723  7819 leader_election.cc:304] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:16.754114  9550 leader_election.cc:290] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:16.774709  9728 raft_consensus.cc:2804] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 14:51:16.781734  9550 raft_consensus.cc:493] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:51:16.781934  9705 raft_consensus.cc:2804] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 14:51:16.782349  9705 raft_consensus.cc:493] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:16.781751  9728 raft_consensus.cc:493] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:16.783773  9728 raft_consensus.cc:3060] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:51:16.744408  9697 raft_consensus.cc:2749] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 14:51:16.750499  9696 raft_consensus.cc:493] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:16.786543  9696 raft_consensus.cc:515] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:16.787886  9699 leader_election.cc:290] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:16.750372  9685 raft_consensus.cc:493] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:16.774772  9702 raft_consensus.cc:493] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:16.786142  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:16.782294  9550 raft_consensus.cc:515] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:16.739209  9691 raft_consensus.cc:493] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:51:16.782793  9705 raft_consensus.cc:3060] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:51:16.787178  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:16.647070  9724 raft_consensus.cc:2804] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 14:51:16.648416  9703 leader_election.cc:290] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:16.698879  9732 raft_consensus.cc:3060] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:51:16.789147  9696 leader_election.cc:290] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:16.789659  9685 raft_consensus.cc:515] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:16.799175  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:16.814620  7775 raft_consensus.cc:2468] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 4.
I20260709 14:51:16.795629  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:16.792619  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:16.802897  8637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18d29d52d304c87b930d4fb5eaf50b1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9418391fa82a42c79c6cad13ba91d964" is_pre_election: true
I20260709 14:51:16.804888  7778 raft_consensus.cc:3060] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:51:16.647693  9706 consensus_queue.cc:1048] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.169s
I20260709 14:51:16.828833  7774 raft_consensus.cc:2468] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 6.
I20260709 14:51:16.846968  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:16.824604  7772 raft_consensus.cc:2393] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 5: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:51:16.816504  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:16.867867  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:16.873055  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:16.874502  9692 raft_consensus.cc:2749] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 14:51:16.792160  7773 raft_consensus.cc:2393] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 3: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:51:16.806715  9738 raft_consensus.cc:493] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:51:16.795934  9550 leader_election.cc:290] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:51:16.823139  9713 consensus_meta.cc:287] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent flushing consensus metadata: real 0.511s	user 0.023s	sys 0.026s
I20260709 14:51:16.798949  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:16.882223  9630 leader_election.cc:290] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:16.797950  9725 raft_consensus.cc:2749] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 14:51:16.891193  7771 raft_consensus.cc:2410] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 14:51:16.890322  7776 raft_consensus.cc:2468] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 6.
I20260709 14:51:16.894141  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:16.910319  7774 raft_consensus.cc:2468] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 5.
I20260709 14:51:16.790539  9657 leader_election.cc:290] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:16.800813  9698 leader_election.cc:290] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68:42321)
I20260709 14:51:16.896612  7777 raft_consensus.cc:2468] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 7.
I20260709 14:51:16.805591  9378 raft_consensus.cc:493] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:16.903517  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:16.809147  9724 raft_consensus.cc:493] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:51:16.915902  7775 raft_consensus.cc:2410] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 14:51:16.802068  9691 raft_consensus.cc:515] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:16.806730  9721 raft_consensus.cc:493] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:16.720181  9644 consensus_queue.cc:1059] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.175s
I20260709 14:51:16.908692  7845 raft_consensus.cc:2468] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 5.
I20260709 14:51:16.904747  7853 raft_consensus.cc:2410] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 14:51:16.924615  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:16.928900  7770 raft_consensus.cc:2468] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 4.
I20260709 14:51:16.930109  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
W20260709 14:51:16.933436  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 128676us
I20260709 14:51:16.938493  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:16.939658  7770 raft_consensus.cc:2410] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 14:51:16.941416  7778 raft_consensus.cc:2468] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 5.
I20260709 14:51:16.808831  9719 raft_consensus.cc:515] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:16.945363  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:16.946499  7772 raft_consensus.cc:2468] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 4.
I20260709 14:51:16.950340  7894 leader_election.cc:304] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:16.915233  9692 raft_consensus.cc:493] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:16.920077  9724 raft_consensus.cc:3060] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Advancing to term 5
W20260709 14:51:16.958463  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 177634us
I20260709 14:51:16.926012  9630 raft_consensus.cc:2804] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Leader election won for term 3
I20260709 14:51:16.963761  7819 leader_election.cc:304] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:16.960968  7770 raft_consensus.cc:1240] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 4. Current term is 5. Ops: []
I20260709 14:51:16.932874  9698 raft_consensus.cc:493] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:16.791287  9702 raft_consensus.cc:515] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:16.969370  7776 raft_consensus.cc:1275] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 14:51:17.015075  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 61105us
I20260709 14:51:16.949021  9644 raft_consensus.cc:3055] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 LEADER]: Stepping down as leader of term 4
I20260709 14:51:16.980031  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:17.021353  7771 raft_consensus.cc:1275] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 14:51:17.021872  7776 raft_consensus.cc:1240] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 14:51:16.983397  7770 raft_consensus.cc:1240] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 14:51:17.019227  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:17.020527  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:17.019843  7779 raft_consensus.cc:1240] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 4. Current term is 5. Ops: []
W20260709 14:51:16.983676  7745 leader_election.cc:336] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 1.847s (SENT)
I20260709 14:51:17.024823  7745 leader_election.cc:304] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:16.962477  9657 raft_consensus.cc:2804] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 14:51:16.934197  9378 raft_consensus.cc:515] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:17.027594  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:17.028385  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:17.032238  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:17.037935  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:16.924227  9738 raft_consensus.cc:515] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:16.981207  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:17.043768  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:17.043893  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:17.027626  9698 raft_consensus.cc:515] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:17.044930  9696 raft_consensus.cc:2749] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 14:51:17.059084  9725 raft_consensus.cc:493] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:17.064996  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:17.064882  9725 raft_consensus.cc:515] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:17.049975  7894 leader_election.cc:304] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:17.066454  9742 raft_consensus.cc:2804] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 14:51:17.066993  9742 raft_consensus.cc:493] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:17.067369  9742 raft_consensus.cc:3060] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:51:17.050587  7774 raft_consensus.cc:1240] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 14:51:17.021129  9644 raft_consensus.cc:740] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:51:16.967016  9692 raft_consensus.cc:515] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:17.061655  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 78044.4us
I20260709 14:51:16.944487  9721 raft_consensus.cc:515] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:17.030084  9728 raft_consensus.cc:515] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:17.134792  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:51:17.159680  7744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:17.205356  7779 raft_consensus.cc:1240] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 14:51:17.214150  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:17.053802  9658 raft_consensus.cc:2804] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader election won for term 5
I20260709 14:51:17.074021  7773 raft_consensus.cc:2468] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 4.
I20260709 14:51:17.218577  9550 raft_consensus.cc:493] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
W20260709 14:51:17.172029  7742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:17.094321  9719 leader_election.cc:290] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 5 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:17.219895  9550 raft_consensus.cc:515] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:17.188284  9732 raft_consensus.cc:2749] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 14:51:17.222942  9550 leader_election.cc:290] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:17.134071  9738 leader_election.cc:290] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:51:17.094664  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 480061us
I20260709 14:51:17.218060  9658 raft_consensus.cc:697] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:51:17.224548  7893 leader_election.cc:304] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:17.153894  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:17.168265  7854 raft_consensus.cc:2468] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 5.
I20260709 14:51:17.225057  9658 consensus_queue.cc:237] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:17.226128  9745 raft_consensus.cc:493] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:17.095798  7894 leader_election.cc:304] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:17.067478  9725 leader_election.cc:290] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:17.101752  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:17.227538  7849 raft_consensus.cc:2410] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for term 6 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 14:51:17.227660  9550 raft_consensus.cc:3060] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Advancing to term 5
W20260709 14:51:17.210023  8598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 170627us
I20260709 14:51:17.228093  7893 leader_election.cc:304] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:17.229668  9738 raft_consensus.cc:2804] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 14:51:17.230309  9738 raft_consensus.cc:493] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:17.230664  9738 raft_consensus.cc:3060] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Advancing to term 6
W20260709 14:51:17.231024  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 135319us
I20260709 14:51:17.034169  9657 raft_consensus.cc:493] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:17.219065  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:17.259554  7893 leader_election.cc:304] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:17.267199  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:17.268702  7852 raft_consensus.cc:2393] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 4: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:51:17.063831  9706 raft_consensus.cc:493] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:17.157624  9630 raft_consensus.cc:697] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:51:17.277475  7893 leader_election.cc:304] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:17.160912  9679 leader_election.cc:290] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:17.134298  9698 leader_election.cc:290] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:17.133176  9691 leader_election.cc:290] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:17.153362  9659 leader_election.cc:290] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:17.097337  9378 leader_election.cc:290] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:17.284391  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:17.134205  9702 leader_election.cc:290] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:17.287453  7846 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca"
dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:49948
I20260709 14:51:17.284608  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:17.296640  7854 raft_consensus.cc:2468] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 5.
I20260709 14:51:17.259117  9732 raft_consensus.cc:2804] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 14:51:17.259439  9657 raft_consensus.cc:3060] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:51:17.285493  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:17.297164  7853 raft_consensus.cc:3060] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Advancing to term 5
I20260709 14:51:17.298137  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:17.300225  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:17.223088  9644 consensus_queue.cc:260] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:17.303445  9744 consensus_queue.cc:1059] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.045s
I20260709 14:51:17.308477  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:17.227202  9745 raft_consensus.cc:515] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:17.317272  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:17.285890  9720 raft_consensus.cc:2804] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 14:51:17.306829  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 95365.6us
W20260709 14:51:17.324441  7745 leader_election.cc:336] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 1.506s (SENT)
I20260709 14:51:17.325266  7745 leader_election.cc:304] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:17.327780  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:17.305775  9732 raft_consensus.cc:493] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:51:17.311028  9691 raft_consensus.cc:2804] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 14:51:17.285454  9706 raft_consensus.cc:515] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:17.344691  7848 raft_consensus.cc:1240] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 14:51:17.310178  9724 raft_consensus.cc:515] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:17.348579  7852 raft_consensus.cc:1275] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 14:51:17.352173  9728 leader_election.cc:290] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 7 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:17.354143  9721 leader_election.cc:290] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:17.310496  9685 leader_election.cc:290] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:17.339741  9720 raft_consensus.cc:697] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
W20260709 14:51:17.372947  9705 consensus_meta.cc:287] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent flushing consensus metadata: real 0.571s	user 0.013s	sys 0.000s
I20260709 14:51:17.387796  9724 leader_election.cc:290] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 5 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:17.388120  9705 raft_consensus.cc:515] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:17.389897  7773 raft_consensus.cc:1275] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 14:51:17.355247  9711 raft_consensus.cc:493] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:17.390893  9705 leader_election.cc:290] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 5 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:17.390792  9711 raft_consensus.cc:515] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:17.333619  9644 raft_consensus.cc:3060] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:51:17.352977  9749 raft_consensus.cc:493] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:17.396545  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:17.382017  7894 leader_election.cc:304] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:17.381701  9679 raft_consensus.cc:493] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:17.385651  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18d29d52d304c87b930d4fb5eaf50b1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:17.397469  7848 raft_consensus.cc:2468] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 3.
I20260709 14:51:17.398906  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:51:17.399610  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 122264us
I20260709 14:51:17.401232  7893 leader_election.cc:304] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:17.384212  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:17.390221  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:17.375784  9732 raft_consensus.cc:3060] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:51:17.372692  9742 raft_consensus.cc:515] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:17.402583  7852 raft_consensus.cc:2468] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 5.
I20260709 14:51:17.378432  7853 raft_consensus.cc:2468] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 5.
I20260709 14:51:17.399725  7848 raft_consensus.cc:2468] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 5.
I20260709 14:51:17.406136  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:17.407132  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:17.375324  9691 raft_consensus.cc:493] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:51:17.430593  7778 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 1910) took 1008 ms. Trace:
I20260709 14:51:17.429014  7774 raft_consensus.cc:1275] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 14:51:17.434201  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:17.435237  7846 raft_consensus.cc:493] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:51:17.435772  7846 raft_consensus.cc:3060] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Advancing to term 8
W20260709 14:51:17.408331  8598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 178033us
I20260709 14:51:17.414278  7772 raft_consensus.cc:1275] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 14:51:17.424556  7745 leader_election.cc:336] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 2.183s (SENT)
I20260709 14:51:17.438920  7745 leader_election.cc:304] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:17.431406  7778 rpcz_store.cc:276] 0709 14:51:16.422061 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:16.948345 (+526284us) service_pool.cc:224] Handling call
0709 14:51:16.948788 (+   443us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:51:16.949295 (+   507us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:51:16.949327 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:51:17.014577 (+ 65250us) log.cc:844] Serialized 26 byte log entry
0709 14:51:17.252272 (+237695us) raft_consensus.cc:1645] Marking committed up to 5
0709 14:51:17.429629 (+177357us) log.cc:844] Serialized 14 byte log entry
0709 14:51:17.430028 (+   399us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:17.430146 (+   118us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:51:17.430202 (+    56us) raft_consensus.cc:1685] finished
0709 14:51:17.430214 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:51:17.430405 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":462,"raft.run_cpu_time_us":315,"raft.run_wall_time_us":13273,"thread_start_us":336872,"threads_started":2,"wal-append.queue_time_us":249521}
I20260709 14:51:17.457489  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:17.459051  7923 raft_consensus.cc:2393] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 8: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:51:17.490041  9740 raft_consensus.cc:3055] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 14:51:17.490698  9740 raft_consensus.cc:740] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:17.492851  7922 raft_consensus.cc:1240] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 4. Current term is 5. Ops: []
I20260709 14:51:17.494411  7928 raft_consensus.cc:1275] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 14:51:17.411551  9679 raft_consensus.cc:515] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:17.408186  9749 raft_consensus.cc:515] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:17.384956  9630 consensus_queue.cc:237] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:17.495524  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:17.592454  7925 raft_consensus.cc:3060] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Advancing to term 5
W20260709 14:51:17.593395  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:17.595255  9711 leader_election.cc:290] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:17.595404  9702 raft_consensus.cc:493] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:17.387797  9720 consensus_queue.cc:237] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:17.596143  9702 raft_consensus.cc:515] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:17.436326  9659 raft_consensus.cc:2804] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 14:51:17.619336  9725 raft_consensus.cc:493] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:17.559922  7819 leader_election.cc:304] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:17.620365  9725 raft_consensus.cc:515] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:17.622161  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 62390.7us
I20260709 14:51:17.623445  7819 leader_election.cc:304] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:17.624126  9725 leader_election.cc:290] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:17.434819  9691 raft_consensus.cc:3060] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:51:17.628310  7773 raft_consensus.cc:1275] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 14:51:17.628921  9698 raft_consensus.cc:493] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:17.596979  7846 raft_consensus.cc:515] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:17.599148  6549 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 14:51:17.502311  7924 raft_consensus.cc:1240] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 5. Current term is 6. Ops: []
I20260709 14:51:17.623598  9706 leader_election.cc:290] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:17.563212  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
W20260709 14:51:17.625555  8598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 185099us
W20260709 14:51:17.545231  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 144142us
I20260709 14:51:17.617908  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:17.494740  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:17.627666  9658 raft_consensus.cc:2804] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 14:51:17.434499  9378 raft_consensus.cc:2749] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 14:51:17.577839  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 153398us
I20260709 14:51:17.554272  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:17.636059  7893 leader_election.cc:304] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:17.636610  7923 raft_consensus.cc:1275] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 14:51:17.629509  9698 raft_consensus.cc:515] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:17.496206  9685 raft_consensus.cc:2749] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 14:51:17.625046  7819 leader_election.cc:304] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:17.669057  9749 leader_election.cc:290] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:17.668614  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:17.668735  9702 leader_election.cc:290] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:17.668881  9745 leader_election.cc:290] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:17.671459  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c563cc7cfbe4d59be4ffc5cf847ce56" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:17.671794  9550 raft_consensus.cc:2749] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 14:51:17.584776  9752 log.cc:927] Time spent T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 14:51:17.677304  9658 raft_consensus.cc:493] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:51:17.681460  7846 leader_election.cc:290] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 8 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:17.559659  9721 raft_consensus.cc:493] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:17.564697  9738 raft_consensus.cc:515] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:17.735354  7770 raft_consensus.cc:3060] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:51:17.711360  7845 raft_consensus.cc:2468] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 5.
I20260709 14:51:17.628072  9705 raft_consensus.cc:2804] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 14:51:17.870884  8598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 181039us
I20260709 14:51:17.620298  9659 raft_consensus.cc:493] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 14:51:17.780237  7744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:17.507735  9692 leader_election.cc:290] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:17.723475  7925 raft_consensus.cc:2468] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 5.
I20260709 14:51:17.872872  7777 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37136 (request call id 1862) took 1323 ms. Trace:
I20260709 14:51:17.752386  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:17.871047  7778 raft_consensus.cc:2468] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 6.
I20260709 14:51:17.890841  7853 raft_consensus.cc:2468] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 5.
W20260709 14:51:17.870491  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 245562us
I20260709 14:51:17.891812  7819 leader_election.cc:304] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:17.868515  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:17.873827  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:51:17.789638  7742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:51:17.876307  7745 leader_election.cc:336] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 2.018s (SENT)
I20260709 14:51:17.681896  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:17.894080  7851 raft_consensus.cc:2468] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 5.
I20260709 14:51:17.545118  9757 raft_consensus.cc:2804] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 14:51:17.894474  7745 leader_election.cc:304] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:17.877352  9706 raft_consensus.cc:3060] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:51:17.837162  9691 raft_consensus.cc:515] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:17.900506  9740 consensus_queue.cc:260] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:17.901584  9702 raft_consensus.cc:2749] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 14:51:17.901961  9732 raft_consensus.cc:515] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:17.902573  9702 raft_consensus.cc:493] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:17.878088  9658 raft_consensus.cc:3060] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Advancing to term 6
W20260709 14:51:17.903489  9756 log.cc:927] Time spent T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.357s	user 0.000s	sys 0.004s
I20260709 14:51:17.904933  7776 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37136 (request call id 1876) took 1121 ms. Trace:
I20260709 14:51:17.905350  7776 rpcz_store.cc:276] 0709 14:51:16.783309 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:17.184019 (+400710us) service_pool.cc:224] Handling call
0709 14:51:17.184571 (+   552us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:51:17.197862 (+ 13291us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:51:17.197908 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:51:17.206272 (+  8364us) log.cc:844] Serialized 26 byte log entry
0709 14:51:17.333856 (+127584us) raft_consensus.cc:1645] Marking committed up to 1
0709 14:51:17.333907 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:17.334102 (+   195us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:51:17.891671 (+557569us) spinlock_profiling.cc:243] Waited 1.15 ms on lock 0x7b4400022b4c. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb687c29db1 00007fb687cc7c85 00007fb687cc86a2 00007fb68aa3a1db 00007fb68aa35aaf 00007fb68aa2986e 00007fb68aa28bb6 00007fb68aa287d8 00007fb68aa32221 00007fb68aa321d9 00007fb68aa32169
0709 14:51:17.904577 (+ 12906us) raft_consensus.cc:1685] finished
0709 14:51:17.904603 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:51:17.904858 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12522,"raft.queue_time_us":15351,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":165,"spinlock_wait_cycles":2638080,"thread_start_us":59094,"threads_started":1,"wal-append.queue_time_us":196329}
I20260709 14:51:17.897559  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:17.907521  7849 raft_consensus.cc:2468] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 6.
I20260709 14:51:17.896782  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:17.909152  7848 raft_consensus.cc:3060] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:51:17.902127  9740 raft_consensus.cc:3060] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:51:17.889976  9659 raft_consensus.cc:3060] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:51:17.910386  7920 raft_consensus.cc:1240] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 4. Current term is 5. Ops: []
I20260709 14:51:17.916508  7819 leader_election.cc:304] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
W20260709 14:51:17.916689  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 280770us
I20260709 14:51:17.901118  7745 leader_election.cc:304] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:17.919607  7745 leader_election.cc:304] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:17.920362  7770 raft_consensus.cc:2468] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 5.
W20260709 14:51:17.831866  9657 consensus_meta.cc:287] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0: Time spent flushing consensus metadata: real 0.516s	user 0.009s	sys 0.003s
I20260709 14:51:17.892617  7777 rpcz_store.cc:276] 0709 14:51:16.549370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:16.965497 (+416127us) service_pool.cc:224] Handling call
0709 14:51:17.181611 (+216114us) spinlock_profiling.cc:243] Waited 3.19 ms on lock 0x7b5800002a98. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb687c29db1 00007fb687d69b71 00007fb687d69a22 00007fb690c82c09 00007fb68fddcee0 00007fb68fea60ab 00007fb68fea6131 00007fb68fe67fc0 00007fb68fe52929 00007fb68fe523d2 00007fb6893c9bd4
0709 14:51:17.181976 (+   365us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:51:17.190434 (+  8458us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:51:17.190498 (+    64us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:51:17.211709 (+ 21211us) log.cc:844] Serialized 26 byte log entry
0709 14:51:17.510700 (+298991us) raft_consensus.cc:1645] Marking committed up to 3
0709 14:51:17.618241 (+107541us) log.cc:844] Serialized 14 byte log entry
0709 14:51:17.872467 (+254226us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:17.872543 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:51:17.872587 (+    44us) raft_consensus.cc:1685] finished
0709 14:51:17.872669 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:51:17.872799 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12631,"prepare.queue_time_us":170043,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":30,"raft.queue_time_us":7502,"raft.run_cpu_time_us":438,"raft.run_wall_time_us":45027,"spinlock_wait_cycles":7433856,"thread_start_us":300250,"threads_started":2,"wal-append.queue_time_us":332827}
I20260709 14:51:17.881785  9705 raft_consensus.cc:493] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:51:17.918324  7893 leader_election.cc:304] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:17.913174  9725 raft_consensus.cc:493] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:17.915329  9692 raft_consensus.cc:2764] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 14:51:17.922080  7819 leader_election.cc:304] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:17.918349  7894 leader_election.cc:304] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:17.584468  9742 leader_election.cc:290] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 4 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:17.917487  9745 raft_consensus.cc:2749] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 14:51:17.899672  9744 raft_consensus.cc:493] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:17.906567  9738 leader_election.cc:290] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:17.912788  9757 raft_consensus.cc:493] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:51:17.933015  7893 leader_election.cc:304] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:17.903380  9702 raft_consensus.cc:515] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:17.884783  9721 raft_consensus.cc:515] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:17.924062  9550 raft_consensus.cc:2804] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 14:51:17.923334  9685 raft_consensus.cc:2749] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 14:51:17.936343  9724 raft_consensus.cc:2804] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 14:51:17.974908  9724 raft_consensus.cc:493] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:17.975410  9724 raft_consensus.cc:3060] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:51:17.938287  7921 raft_consensus.cc:1240] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 2. Current term is 3. Ops: []
I20260709 14:51:17.951573  7848 raft_consensus.cc:2468] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 4.
I20260709 14:51:17.958425  9742 raft_consensus.cc:2804] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 14:51:17.959762  9728 raft_consensus.cc:2804] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 14:51:17.938337  9725 raft_consensus.cc:515] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:17.962400  9685 raft_consensus.cc:2749] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 14:51:17.940631  9719 raft_consensus.cc:2804] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 14:51:17.942067  9744 raft_consensus.cc:515] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:17.990203  9742 raft_consensus.cc:697] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:17.995514  9719 raft_consensus.cc:697] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:17.996629  9719 consensus_queue.cc:237] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:17.990983  9728 raft_consensus.cc:493] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:18.001222  9728 raft_consensus.cc:3060] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:51:17.993060  9725 leader_election.cc:290] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:17.962908  9679 leader_election.cc:290] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:17.964596  7819 leader_election.cc:304] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:17.965291  9550 raft_consensus.cc:697] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:17.929286  9657 raft_consensus.cc:515] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:17.969424  9644 consensus_meta.cc:287] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent flushing consensus metadata: real 0.565s	user 0.008s	sys 0.004s
I20260709 14:51:17.970959  9732 leader_election.cc:290] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 3 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:17.972100  7893 leader_election.cc:304] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:17.972909  9702 leader_election.cc:290] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:17.994962  9742 consensus_queue.cc:237] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:18.019225  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 47243.8us
I20260709 14:51:18.020174  7893 leader_election.cc:304] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:17.974171  9691 leader_election.cc:290] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 5 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:17.994851  9744 leader_election.cc:290] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:51:18.010826  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 91334.1us
W20260709 14:51:18.012713  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 48248.6us
I20260709 14:51:18.013566  9692 raft_consensus.cc:2749] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 14:51:18.031592  7819 leader_election.cc:304] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:17.955112  9757 raft_consensus.cc:3060] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:51:17.992740  9721 leader_election.cc:290] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:17.933554  9705 raft_consensus.cc:3060] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Advancing to term 2
W20260709 14:51:18.027475  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 109192us
I20260709 14:51:18.029268  7893 leader_election.cc:304] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:18.042811  9738 raft_consensus.cc:2749] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 14:51:18.043849  7893 leader_election.cc:304] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:18.047132  9741 raft_consensus.cc:2749] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 14:51:18.048983  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:18.049799  7923 raft_consensus.cc:2468] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 6.
I20260709 14:51:18.045886  9659 raft_consensus.cc:515] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:18.052431  9659 leader_election.cc:290] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:18.052754  7923 raft_consensus.cc:1240] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 4. Current term is 5. Ops: []
I20260709 14:51:18.054193  9657 leader_election.cc:290] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:18.035310  9711 raft_consensus.cc:2804] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 14:51:18.055439  9711 raft_consensus.cc:493] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:18.055814  9711 raft_consensus.cc:3060] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:51:18.062577  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:18.017385  9550 consensus_queue.cc:237] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:18.031352  9720 raft_consensus.cc:2804] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 14:51:18.069654  7921 raft_consensus.cc:3060] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:51:18.072821  9692 raft_consensus.cc:493] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:18.032986  7745 leader_election.cc:304] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:18.069054  7919 raft_consensus.cc:2468] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 7.
I20260709 14:51:18.049420  7893 leader_election.cc:304] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:18.079967  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:18.081123  7845 raft_consensus.cc:3060] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:51:18.090629  9720 raft_consensus.cc:697] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:18.092252  9720 consensus_queue.cc:237] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:18.102350  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:18.087412  7845 raft_consensus.cc:2468] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 6.
I20260709 14:51:18.094581  9698 leader_election.cc:290] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:18.096745  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
W20260709 14:51:18.110199  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 77364.6us
I20260709 14:51:18.073563  9692 raft_consensus.cc:515] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:18.066351  9706 raft_consensus.cc:2749] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 14:51:18.087284  7893 leader_election.cc:304] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:18.117698  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:18.118523  7847 raft_consensus.cc:3060] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:51:18.108270  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:18.126909  7893 leader_election.cc:304] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:18.111541  7745 leader_election.cc:304] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:18.114040  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:18.128743  7893 leader_election.cc:304] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:18.133039  9719 consensus_queue.cc:1048] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 14:51:18.137737  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:18.138648  7852 raft_consensus.cc:3060] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:51:18.141125  7893 leader_election.cc:304] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:18.142678  9758 raft_consensus.cc:2804] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 14:51:18.143126  9758 raft_consensus.cc:493] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:51:18.143977  9758 raft_consensus.cc:3060] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:51:18.145572  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:18.146282  7777 raft_consensus.cc:2468] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 4.
I20260709 14:51:18.147341  9692 leader_election.cc:290] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:18.148739  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:18.152094  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:18.152837  7777 raft_consensus.cc:2468] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 3.
I20260709 14:51:18.088490  9740 raft_consensus.cc:2804] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 14:51:18.125784  9378 raft_consensus.cc:2749] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 14:51:18.112414  9644 raft_consensus.cc:2749] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 14:51:18.129624  9691 raft_consensus.cc:3060] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:51:18.153770  9740 raft_consensus.cc:697] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:18.162546  9740 consensus_queue.cc:237] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:18.154651  7744 leader_election.cc:304] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:51:18.167188  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 135673us
I20260709 14:51:18.168954  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:18.171478  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:18.141723  9698 raft_consensus.cc:2749] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 14:51:18.172643  7778 raft_consensus.cc:2468] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 5.
I20260709 14:51:18.172645  9741 raft_consensus.cc:2804] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 14:51:18.174604  9741 raft_consensus.cc:493] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:51:18.175208  9741 raft_consensus.cc:3060] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:51:18.178265  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:18.168105  7819 leader_election.cc:304] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:18.179113  7779 raft_consensus.cc:3060] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:51:18.186754  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:18.187636  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:18.188769  7777 raft_consensus.cc:2468] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 5.
I20260709 14:51:18.189884  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:18.181659  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:18.191464  7772 raft_consensus.cc:2468] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 4.
I20260709 14:51:18.204277  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:18.205435  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:18.206926  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:18.215090  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:18.216014  7778 raft_consensus.cc:2468] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 5.
I20260709 14:51:18.181211  9679 raft_consensus.cc:493] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:18.176601  9378 raft_consensus.cc:2749] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 14:51:18.219481  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:18.221738  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
W20260709 14:51:18.224217  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 56203.4us
I20260709 14:51:18.225021  7772 raft_consensus.cc:3060] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:51:18.212469  7771 raft_consensus.cc:2468] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 5.
I20260709 14:51:18.229452  9766 raft_consensus.cc:493] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:18.230109  9766 raft_consensus.cc:515] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:18.232165  7770 raft_consensus.cc:2410] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 14:51:18.153100  9702 consensus_queue.cc:1059] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.058s
I20260709 14:51:18.174880  9711 raft_consensus.cc:515] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:18.158548  9658 raft_consensus.cc:515] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:18.233523  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:18.208292  9698 raft_consensus.cc:493] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:18.236843  7850 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 2643) took 1218 ms. Trace:
I20260709 14:51:18.233419  9679 raft_consensus.cc:515] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:18.195573  9685 consensus_queue.cc:1048] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.038s
I20260709 14:51:18.187176  9725 consensus_queue.cc:1059] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 14:51:18.153208  9758 raft_consensus.cc:515] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:18.246672  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:18.205969  9630 raft_consensus.cc:3060] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:51:18.158512  9728 raft_consensus.cc:515] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:18.249601  7745 leader_election.cc:336] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 2.102s (SENT)
I20260709 14:51:18.294514  7745 leader_election.cc:304] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:18.245859  9702 raft_consensus.cc:3055] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 LEADER]: Stepping down as leader of term 7
I20260709 14:51:18.295564  9702 raft_consensus.cc:740] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:51:18.256345  9766 leader_election.cc:290] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:18.258297  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:18.168951  9724 raft_consensus.cc:515] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:18.262874  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:18.272096  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:18.280334  7850 rpcz_store.cc:276] 0709 14:51:17.018793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:17.018919 (+   126us) service_pool.cc:224] Handling call
0709 14:51:18.233966 (+1215047us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b54001405d4. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae922fa 00007fb68fe53b17 00007fb6893ce6d4 00007fb6893ce662 00007fb6893ce591 00007fb6893ce50c 00007fb6893cd7c2 00007fb6891c948c 00007fb6891c88c6 00007fb6891c826f
0709 14:51:18.236767 (+  2801us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2684109696}
I20260709 14:51:18.283366  7852 raft_consensus.cc:2468] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 6.
I20260709 14:51:18.234774  7819 leader_election.cc:304] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:18.300129  9705 raft_consensus.cc:515] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:18.292551  7778 raft_consensus.cc:2468] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 3.
I20260709 14:51:18.297094  7776 raft_consensus.cc:3060] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:51:18.297197  7894 leader_election.cc:304] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:18.298573  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:18.314852  7775 raft_consensus.cc:2468] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 6.
I20260709 14:51:18.305953  7771 raft_consensus.cc:3060] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:51:18.312942  7779 raft_consensus.cc:2468] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 5.
I20260709 14:51:18.311836  9766 raft_consensus.cc:493] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:51:18.323473  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 73951.3us
W20260709 14:51:18.330756  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 96168.1us
I20260709 14:51:18.331949  9711 leader_election.cc:290] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 7 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:18.287261  9698 raft_consensus.cc:515] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:18.333470  9702 consensus_queue.cc:260] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:18.335202  9658 leader_election.cc:290] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 6 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:18.339444  9728 leader_election.cc:290] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 6 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:18.313834  9705 leader_election.cc:290] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 2 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:18.328375  9766 raft_consensus.cc:515] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:18.345055  9758 leader_election.cc:290] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 4 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:18.313931  7773 raft_consensus.cc:3060] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:51:18.352021  7676 catalog_manager.cc:5697] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 4 to 5, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 5 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:51:18.321979  9644 raft_consensus.cc:2749] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 14:51:18.319166  9774 raft_consensus.cc:493] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:18.376091  7772 raft_consensus.cc:2468] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 4.
I20260709 14:51:18.347754  9702 raft_consensus.cc:3060] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Advancing to term 8
I20260709 14:51:18.348191  9659 raft_consensus.cc:2804] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 14:51:18.379558  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 49642.1us
I20260709 14:51:18.384992  7894 leader_election.cc:304] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:18.366842  9679 leader_election.cc:290] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:18.415513  7776 raft_consensus.cc:2468] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 6.
I20260709 14:51:18.355563  9705 consensus_queue.cc:1059] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 14:51:18.428320  9776 raft_consensus.cc:493] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:18.429090  9776 raft_consensus.cc:515] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:18.430310  9724 leader_election.cc:290] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 5 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:18.394939  9719 raft_consensus.cc:493] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:18.375348  9728 consensus_queue.cc:1048] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 14:51:18.434631  9719 raft_consensus.cc:515] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:18.434267  9776 leader_election.cc:290] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:18.384733  9749 raft_consensus.cc:493] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:18.436230  9749 raft_consensus.cc:515] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:18.395819  9706 consensus_queue.cc:1059] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.051s
W20260709 14:51:18.438265  9770 log.cc:927] Time spent T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 14:51:18.438750  9698 leader_election.cc:290] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:18.439353  9749 leader_election.cc:290] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:18.439607  9698 raft_consensus.cc:2749] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 14:51:18.376974  9774 raft_consensus.cc:515] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:18.440912  9691 raft_consensus.cc:2749] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 14:51:18.394243  9692 consensus_queue.cc:1059] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.042s
I20260709 14:51:18.429853  9766 leader_election.cc:290] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:18.382678  9659 raft_consensus.cc:493] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:18.433831  9657 raft_consensus.cc:2749] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 14:51:18.450570  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 67304.7us
W20260709 14:51:18.455351  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 259687us
I20260709 14:51:18.452380  9738 raft_consensus.cc:2804] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 14:51:18.458070  7894 leader_election.cc:304] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:18.464476  7894 leader_election.cc:304] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:18.474299  7923 raft_consensus.cc:1275] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 14:51:18.457192  9659 raft_consensus.cc:3060] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:51:18.461349  9738 raft_consensus.cc:493] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:18.477576  7894 leader_election.cc:304] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:18.477968  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:18.483296  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:18.485612  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:18.483532  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:18.487950  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:18.490368  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:18.482040  7675 catalog_manager.cc:5697] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 2 to 3, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 3 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:51:18.470227  9720 raft_consensus.cc:2804] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 14:51:18.495644  7924 raft_consensus.cc:2468] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 7.
I20260709 14:51:18.506819  7928 raft_consensus.cc:2393] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 3: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:51:18.495713  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c563cc7cfbe4d59be4ffc5cf847ce56" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:18.496121  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:18.476277  9724 raft_consensus.cc:2804] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 14:51:18.522352  7851 raft_consensus.cc:1240] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 5. Current term is 6. Ops: []
I20260709 14:51:18.522874  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:18.524380  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:18.525269  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783e4874513449ef9084b833f188a6d3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:18.525933  7853 raft_consensus.cc:2468] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 3.
I20260709 14:51:18.527240  9630 raft_consensus.cc:2749] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 14:51:18.528069  7849 raft_consensus.cc:3060] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:51:18.528270  9720 raft_consensus.cc:697] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:18.502862  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:18.529847  9720 consensus_queue.cc:237] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:18.530544  7848 raft_consensus.cc:2393] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 4: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:51:18.496806  7675 catalog_manager.cc:5697] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 4 to 5, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 5 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:51:18.532025  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:18.493021  7921 raft_consensus.cc:2410] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 14:51:18.520541  7926 raft_consensus.cc:2393] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 6: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:51:18.522090  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783e4874513449ef9084b833f188a6d3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:18.536422  7928 raft_consensus.cc:2468] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 3.
I20260709 14:51:18.500330  7847 raft_consensus.cc:2468] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 6.
I20260709 14:51:18.499521  7771 raft_consensus.cc:2468] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 6.
I20260709 14:51:18.536935  7894 leader_election.cc:304] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:18.493989  9738 raft_consensus.cc:3060] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Advancing to term 7
W20260709 14:51:18.547586  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 122698us
I20260709 14:51:18.504099  9740 raft_consensus.cc:2804] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 14:51:18.503188  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:18.550731  7848 raft_consensus.cc:1275] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 14:51:18.553128  7745 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:18.520462  9744 raft_consensus.cc:493] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:18.543779  9685 raft_consensus.cc:493] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:51:18.560061  9685 raft_consensus.cc:515] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:18.561472  9728 consensus_queue.cc:1048] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 14:51:18.562673  9685 leader_election.cc:290] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:18.563113  9728 consensus_queue.cc:1048] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 14:51:18.564603  9728 consensus_queue.cc:1048] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 14:51:18.545493  9724 raft_consensus.cc:697] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:18.555510  9630 consensus_queue.cc:1059] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.010s
I20260709 14:51:18.565675  9774 leader_election.cc:290] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:18.566512  9630 raft_consensus.cc:3055] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 LEADER]: Stepping down as leader of term 5
I20260709 14:51:18.567037  9630 raft_consensus.cc:740] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:51:18.567474  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:18.544884  9719 leader_election.cc:290] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:18.570634  9741 raft_consensus.cc:515] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:18.522157  9780 raft_consensus.cc:493] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:18.573797  9780 raft_consensus.cc:515] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:18.576273  9780 leader_election.cc:290] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:18.545202  9550 raft_consensus.cc:493] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:18.577340  9550 raft_consensus.cc:515] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:18.578907  7773 raft_consensus.cc:2468] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 6.
I20260709 14:51:18.580292  7849 raft_consensus.cc:2468] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 7.
I20260709 14:51:18.566210  9724 consensus_queue.cc:237] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:18.556895  7819 leader_election.cc:304] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:18.594336  9740 raft_consensus.cc:697] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:18.583179  9744 raft_consensus.cc:515] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:18.595574  9740 consensus_queue.cc:237] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:18.596140  9706 raft_consensus.cc:3055] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 LEADER]: Stepping down as leader of term 4
I20260709 14:51:18.596689  9706 raft_consensus.cc:740] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:51:18.596781  9744 leader_election.cc:290] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:18.597719  9706 consensus_queue.cc:260] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:18.598517  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:18.599635  7921 raft_consensus.cc:2393] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 7: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:51:18.600289  9706 raft_consensus.cc:3060] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:51:18.600574  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:18.601356  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:18.601583  7925 raft_consensus.cc:2468] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 4.
I20260709 14:51:18.602777  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:18.603433  7928 raft_consensus.cc:2468] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 3.
I20260709 14:51:18.604661  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:18.605189  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:18.554563  9776 raft_consensus.cc:2804] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 14:51:18.609467  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:18.614614  7771 raft_consensus.cc:3060] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:51:18.612787  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:18.616866  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:18.617130  7775 raft_consensus.cc:3060] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:51:18.617413  7774 raft_consensus.cc:1275] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 14:51:18.617763  7926 raft_consensus.cc:2393] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 5: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:51:18.605477  7923 raft_consensus.cc:2468] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 6.
I20260709 14:51:18.618791  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:18.583030  9679 raft_consensus.cc:3055] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 LEADER]: Stepping down as leader of term 6
W20260709 14:51:18.609913  9757 consensus_meta.cc:287] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent flushing consensus metadata: real 0.509s	user 0.012s	sys 0.002s
I20260709 14:51:18.639122  9787 raft_consensus.cc:493] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:18.639423  9757 raft_consensus.cc:515] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:18.639845  9787 raft_consensus.cc:515] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:18.640671  7924 raft_consensus.cc:2468] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 4.
I20260709 14:51:18.573140  9741 leader_election.cc:290] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 4 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:18.645793  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783e4874513449ef9084b833f188a6d3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:18.646704  7779 raft_consensus.cc:2468] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 3.
I20260709 14:51:18.647204  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:18.647699  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258d6c2dda954bf5b65930fde8ecb9f3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:18.629709  9679 raft_consensus.cc:740] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:51:18.649593  7925 raft_consensus.cc:1240] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 6. Current term is 7. Ops: []
I20260709 14:51:18.567862  9630 consensus_queue.cc:260] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:18.650542  9679 consensus_queue.cc:260] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:18.661978  7920 raft_consensus.cc:2468] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 5.
I20260709 14:51:18.663038  7771 raft_consensus.cc:2468] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 7.
I20260709 14:51:18.647333  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:18.612972  9780 raft_consensus.cc:2804] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 14:51:18.677008  7926 raft_consensus.cc:2410] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 14:51:18.651719  9679 raft_consensus.cc:3060] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:51:18.614248  9776 raft_consensus.cc:493] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:18.634864  7819 leader_election.cc:304] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:18.690683  9702 raft_consensus.cc:493] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:51:18.693360  9702 raft_consensus.cc:515] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:18.695910  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 61184.3us
I20260709 14:51:18.694407  9711 consensus_queue.cc:1059] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 14:51:18.677845  9685 raft_consensus.cc:493] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:51:18.737685  9685 raft_consensus.cc:515] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:18.746557  9738 raft_consensus.cc:515] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:18.749040  9659 raft_consensus.cc:515] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:18.677862  9780 raft_consensus.cc:493] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:18.709617  9728 raft_consensus.cc:2804] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader election won for term 5
I20260709 14:51:18.700676  9783 raft_consensus.cc:493] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:51:18.555728  9705 consensus_queue.cc:1048] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.130s
I20260709 14:51:18.758054  9728 raft_consensus.cc:697] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
W20260709 14:51:18.729498  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 59679.6us
I20260709 14:51:18.691974  9776 raft_consensus.cc:3060] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:51:18.758147  9783 raft_consensus.cc:515] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:18.757753  9780 raft_consensus.cc:3060] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:51:18.757854  9774 raft_consensus.cc:493] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:18.776126  9774 raft_consensus.cc:515] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:18.780251  7927 raft_consensus.cc:2393] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 6: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:51:18.792482  7775 raft_consensus.cc:2468] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 5.
I20260709 14:51:18.804976  9745 raft_consensus.cc:3055] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 LEADER]: Stepping down as leader of term 4
I20260709 14:51:18.805610  9745 raft_consensus.cc:740] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:51:18.811071  9749 raft_consensus.cc:3055] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 LEADER]: Stepping down as leader of term 6
I20260709 14:51:18.811631  9749 raft_consensus.cc:740] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:51:18.806582  9745 consensus_queue.cc:260] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:18.813722  9745 raft_consensus.cc:3060] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:51:18.812551  9749 consensus_queue.cc:260] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:18.866410  9749 raft_consensus.cc:3060] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Advancing to term 7
W20260709 14:51:18.825412  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:18.805721  9728 consensus_queue.cc:237] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:18.878235  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:18.879581  7849 raft_consensus.cc:2393] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 4: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:51:18.881639  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:18.888520  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:18.889595  7772 raft_consensus.cc:3060] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:51:18.898689  7744 leader_election.cc:304] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:51:18.875479  9630 raft_consensus.cc:3060] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:51:18.883824  9766 raft_consensus.cc:493] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:18.883778  9725 raft_consensus.cc:493] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:51:18.884349  9378 raft_consensus.cc:493] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:51:18.938803  7772 raft_consensus.cc:2468] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 5.
I20260709 14:51:18.940557  7778 raft_consensus.cc:2468] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 4.
W20260709 14:51:18.963109  7742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:18.973564  9788 raft_consensus.cc:493] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:18.975342  9788 raft_consensus.cc:515] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:18.902565  9698 consensus_queue.cc:1048] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.045s
I20260709 14:51:18.935837  9725 raft_consensus.cc:515] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:18.947681  9378 raft_consensus.cc:515] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:18.933615  9766 raft_consensus.cc:515] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:18.990104  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 91897.7us
I20260709 14:51:19.090461  9550 leader_election.cc:290] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:18.998831  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:19.086690  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:19.092571  7779 raft_consensus.cc:2468] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 5.
I20260709 14:51:19.092609  9776 raft_consensus.cc:515] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:19.097615  9776 leader_election.cc:290] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 4 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:19.107188  7893 leader_election.cc:304] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:18.927465  9702 leader_election.cc:290] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:19.101218  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:19.101999  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:19.111618  7846 raft_consensus.cc:2468] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 5.
W20260709 14:51:19.105842  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 342143us
I20260709 14:51:19.114130  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
W20260709 14:51:19.107285  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:19.098855  9774 leader_election.cc:290] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:19.094699  9788 leader_election.cc:290] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:19.124770  7893 leader_election.cc:304] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:19.131575  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:19.090871  7744 leader_election.cc:304] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:19.115163  7771 raft_consensus.cc:2468] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 5.
I20260709 14:51:19.116170  7848 raft_consensus.cc:2468] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 8.
I20260709 14:51:19.118342  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
W20260709 14:51:19.135236  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 44486.3us
I20260709 14:51:18.998427  9698 raft_consensus.cc:2804] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 14:51:19.122300  7845 raft_consensus.cc:1275] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 14:51:19.089396  9685 leader_election.cc:290] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:19.134084  7777 raft_consensus.cc:2468] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 8.
I20260709 14:51:19.135196  7774 raft_consensus.cc:2468] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 5.
I20260709 14:51:19.166467  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:19.167332  7849 raft_consensus.cc:2468] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 7.
W20260709 14:51:19.169795  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:19.124027  9757 leader_election.cc:290] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 4 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:19.126019  9742 raft_consensus.cc:3055] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 14:51:19.137588  9776 raft_consensus.cc:2804] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 14:51:19.111967  9721 consensus_queue.cc:1048] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.046s
I20260709 14:51:19.150240  9698 raft_consensus.cc:493] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 14:51:19.192958  9794 log.cc:927] Time spent T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.097s	user 0.000s	sys 0.003s
W20260709 14:51:19.198163  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 73497.8us
I20260709 14:51:19.156481  9774 raft_consensus.cc:2749] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 14:51:19.161015  9783 leader_election.cc:290] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:19.207966  7893 leader_election.cc:304] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:19.212801  7893 leader_election.cc:304] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:19.203747  7770 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 1954) took 1008 ms. Trace:
I20260709 14:51:19.204380  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783e4874513449ef9084b833f188a6d3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:19.204619  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:19.179622  9758 raft_consensus.cc:2749] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 14:51:19.216648  7924 raft_consensus.cc:2468] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 5.
I20260709 14:51:19.217993  9740 raft_consensus.cc:2749] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 14:51:19.221837  9378 leader_election.cc:290] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:19.223536  9725 leader_election.cc:290] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:19.224466  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:19.225270  7923 raft_consensus.cc:2468] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 5.
I20260709 14:51:19.226012  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:19.214298  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:19.227649  7926 raft_consensus.cc:2393] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 6: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:51:19.214942  7927 raft_consensus.cc:1240] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 4. Current term is 5. Ops: []
W20260709 14:51:19.226812  7745 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:19.230407  7745 leader_election.cc:304] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:19.231859  7745 leader_election.cc:304] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:19.218160  7924 raft_consensus.cc:1275] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 14:51:19.233636  9706 raft_consensus.cc:493] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:19.234572  9706 raft_consensus.cc:515] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:19.235864  7745 leader_election.cc:304] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:19.158977  9780 raft_consensus.cc:515] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:19.215452  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:19.238953  7922 raft_consensus.cc:2468] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 5.
I20260709 14:51:19.239797  9740 raft_consensus.cc:2749] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 14:51:19.226858  7921 raft_consensus.cc:2393] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 8: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:51:19.215734  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:19.241359  9774 raft_consensus.cc:2764] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 14:51:19.237757  9706 leader_election.cc:290] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:19.177407  9742 raft_consensus.cc:740] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:19.243498  7893 leader_election.cc:304] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:19.243839  7845 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044"
dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
mode: GRACEFUL
new_leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
 from {username='slave'} at 127.0.0.1:41662
I20260709 14:51:19.208570  7744 leader_election.cc:304] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:51:19.244657  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783e4874513449ef9084b833f188a6d3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:19.242419  9774 raft_consensus.cc:2764] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 14:51:19.245209  7845 raft_consensus.cc:606] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 LEADER]: Received request to transfer leadership to TS 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:19.244021  9742 consensus_queue.cc:260] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:19.248272  9742 raft_consensus.cc:3060] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:51:19.248670  9738 leader_election.cc:290] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 7 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:19.215076  7925 raft_consensus.cc:1240] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 4. Current term is 5. Ops: []
I20260709 14:51:19.253646  7745 leader_election.cc:304] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:19.239187  9780 leader_election.cc:290] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 7 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:19.213795  7770 rpcz_store.cc:276] 0709 14:51:18.194896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:18.304758 (+109862us) service_pool.cc:224] Handling call
0709 14:51:18.305278 (+   520us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 14:51:18.543770 (+238492us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:51:18.543804 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 14:51:18.555964 (+ 12160us) log.cc:844] Serialized 52 byte log entry
0709 14:51:18.897380 (+341416us) raft_consensus.cc:1645] Marking committed up to 4
0709 14:51:18.974175 (+ 76795us) log.cc:844] Serialized 14 byte log entry
0709 14:51:19.203067 (+228892us) log.cc:844] Serialized 14 byte log entry
0709 14:51:19.203399 (+   332us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:19.203488 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:51:19.203535 (+    47us) raft_consensus.cc:1685] finished
0709 14:51:19.203545 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:51:19.203684 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19166,"prepare.queue_time_us":219473,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":8878,"raft.queue_time_us":249462,"raft.run_cpu_time_us":404,"raft.run_wall_time_us":5602,"spinlock_wait_cycles":24251264,"thread_start_us":705033,"threads_started":4,"wal-append.queue_time_us":499794}
W20260709 14:51:19.260895  8599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 122274us
W20260709 14:51:19.261294  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 52813.5us
I20260709 14:51:19.262583  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:19.263775  7744 leader_election.cc:304] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:19.214260  7854 raft_consensus.cc:3060] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:51:19.266357  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:19.269074  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:19.198258  9776 raft_consensus.cc:493] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:51:19.270524  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:19.274437  7846 raft_consensus.cc:2393] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 7: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:51:19.204492  9698 raft_consensus.cc:3060] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Advancing to term 8
I20260709 14:51:19.276497  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:19.267290  7893 leader_election.cc:304] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:19.277463  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:19.280997  7922 raft_consensus.cc:2393] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 6: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:51:19.278228  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:19.281656  7893 leader_election.cc:304] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:19.282816  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:19.283625  7893 leader_election.cc:304] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:19.277810  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:19.286335  9378 raft_consensus.cc:2804] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 14:51:19.286926  9378 raft_consensus.cc:493] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting leader election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:51:19.287308  9378 raft_consensus.cc:3060] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:51:19.287355  7744 leader_election.cc:304] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:51:19.290380  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:19.291404  7847 raft_consensus.cc:2468] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 6.
I20260709 14:51:19.292990  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:19.293958  7847 raft_consensus.cc:2410] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 14:51:19.267611  9685 raft_consensus.cc:2749] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 14:51:19.296487  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:19.296737  9725 raft_consensus.cc:2804] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 14:51:19.285167  9550 raft_consensus.cc:2749] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 14:51:19.297601  9725 raft_consensus.cc:493] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:19.298033  9725 raft_consensus.cc:3060] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:51:19.298914  9732 raft_consensus.cc:2804] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 14:51:19.299618  9732 raft_consensus.cc:493] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:19.300364  9732 raft_consensus.cc:3060] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:51:19.281996  7845 raft_consensus.cc:2468] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 4.
I20260709 14:51:19.299011  7928 raft_consensus.cc:2393] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 2: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:51:19.306928  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258d6c2dda954bf5b65930fde8ecb9f3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:19.308138  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:19.308959  7847 raft_consensus.cc:2468] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 4.
I20260709 14:51:19.267851  9783 raft_consensus.cc:2804] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 14:51:19.313915  9783 raft_consensus.cc:493] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:19.314404  9783 raft_consensus.cc:3060] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:51:19.310546  7893 leader_election.cc:304] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:19.311029  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:19.311568  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:19.317319  7928 raft_consensus.cc:2468] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 4.
I20260709 14:51:19.298898  9659 leader_election.cc:290] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:19.312517  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:19.271871  9774 raft_consensus.cc:2749] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 14:51:19.273479  9720 raft_consensus.cc:2804] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 14:51:19.312517  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:19.325881  7922 raft_consensus.cc:2468] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 4.
I20260709 14:51:19.327149  9720 raft_consensus.cc:493] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:51:19.327880  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:19.318910  7847 raft_consensus.cc:2410] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 14:51:19.312783  9767 raft_consensus.cc:2749] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 14:51:19.275820  9776 raft_consensus.cc:3060] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:51:19.317477  7894 leader_election.cc:304] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
W20260709 14:51:19.330293  8598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 110087us
I20260709 14:51:19.330844  7894 leader_election.cc:304] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:19.318413  7893 leader_election.cc:304] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:19.324404  9758 raft_consensus.cc:2749] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 14:51:19.327757  9720 raft_consensus.cc:3060] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:51:19.320950  9378 raft_consensus.cc:515] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:19.333608  7854 raft_consensus.cc:2468] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 4.
I20260709 14:51:19.334003  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18d29d52d304c87b930d4fb5eaf50b1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:51:19.335219  7744 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.101.67:40785 timed out after 1.721s (SENT) [suppressed 31 similar messages]
I20260709 14:51:19.338174  7893 leader_election.cc:304] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:19.342023  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:19.343580  7770 raft_consensus.cc:1275] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 14:51:19.345497  7894 leader_election.cc:304] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:19.354001  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:19.345293  9378 leader_election.cc:290] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:19.340704  9767 raft_consensus.cc:2749] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 14:51:19.359503  9758 raft_consensus.cc:2749] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 14:51:19.340891  9659 raft_consensus.cc:2804] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 14:51:19.337604  9740 raft_consensus.cc:2804] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 14:51:19.361308  9766 leader_election.cc:290] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:19.361860  9740 raft_consensus.cc:697] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:19.363364  9740 consensus_queue.cc:237] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:19.363969  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:19.358645  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:19.358392  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:19.379173  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:19.384927  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:19.385919  7771 raft_consensus.cc:2468] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 4.
I20260709 14:51:19.387473  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:19.389830  7776 raft_consensus.cc:2468] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 4.
I20260709 14:51:19.390110  7771 raft_consensus.cc:1240] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 4. Current term is 5. Ops: []
I20260709 14:51:19.391943  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:19.392629  7847 raft_consensus.cc:1240] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 4. Current term is 5. Ops: []
I20260709 14:51:19.400843  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:19.401937  7779 raft_consensus.cc:2468] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 4.
I20260709 14:51:19.400830  7845 raft_consensus.cc:2393] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 4: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:51:19.400173  7777 raft_consensus.cc:2468] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 2.
I20260709 14:51:19.403730  7851 raft_consensus.cc:1240] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 5. Current term is 6. Ops: []
I20260709 14:51:19.405679  7771 raft_consensus.cc:1240] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 14:51:19.406503  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:19.398185  9630 raft_consensus.cc:493] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:19.367790  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:19.408449  9630 raft_consensus.cc:515] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:19.361327  9659 raft_consensus.cc:697] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:19.412580  9630 leader_election.cc:290] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:19.413666  9659 consensus_queue.cc:237] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:19.408190  7848 raft_consensus.cc:2468] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 4.
I20260709 14:51:19.419179  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:19.400954  9657 raft_consensus.cc:2804] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 14:51:19.420651  9657 raft_consensus.cc:493] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 14:51:19.421196  7742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:19.421116  9657 raft_consensus.cc:3060] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:51:19.419656  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
W20260709 14:51:19.425412  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:19.427243  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:19.434450  7848 raft_consensus.cc:2393] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 6: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:51:19.434551  7851 raft_consensus.cc:2393] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 7: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:51:19.428113  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:19.435931  7854 raft_consensus.cc:1240] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 14:51:19.434796  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:19.436369  7893 leader_election.cc:304] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:19.436751  7845 raft_consensus.cc:2468] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 5.
I20260709 14:51:19.438678  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:19.439606  7845 raft_consensus.cc:2468] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 5.
W20260709 14:51:19.427192  9803 log.cc:927] Time spent T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260709 14:51:19.438951  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:19.444370  7921 raft_consensus.cc:2468] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 6.
I20260709 14:51:19.439488  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:19.451030  7819 leader_election.cc:304] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
W20260709 14:51:19.470713  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 72055.8us
I20260709 14:51:19.472496  7845 raft_consensus.cc:1275] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 14:51:19.476125  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:19.432895  7774 raft_consensus.cc:2468] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 6.
I20260709 14:51:19.477089  7849 raft_consensus.cc:2468] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 2.
I20260709 14:51:19.482103  7894 leader_election.cc:304] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:19.488463  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:19.489558  7851 raft_consensus.cc:3060] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:51:19.495038  7845 raft_consensus.cc:1275] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 14:51:19.507071  7894 leader_election.cc:304] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:19.486492  9741 consensus_queue.cc:1048] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.010s
I20260709 14:51:19.487267  9720 raft_consensus.cc:515] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:19.511626  7845 raft_consensus.cc:1275] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 14:51:19.498687  9776 raft_consensus.cc:515] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:19.499200  9706 consensus_queue.cc:1048] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 14:51:19.517616  9692 consensus_queue.cc:1059] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 14:51:19.476353  9767 raft_consensus.cc:2804] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 14:51:19.498746  9705 raft_consensus.cc:993] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac: : Instructing follower 1e9289592458429bbddb19c2e7b7b7b0 to start an election
I20260709 14:51:19.518667  9706 raft_consensus.cc:3055] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 LEADER]: Stepping down as leader of term 4
I20260709 14:51:19.476445  9749 raft_consensus.cc:2749] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 14:51:19.519279  9706 raft_consensus.cc:740] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:51:19.518736  9767 raft_consensus.cc:493] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:19.520087  9767 raft_consensus.cc:3060] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:51:19.504980  9783 raft_consensus.cc:515] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:19.471025  9630 raft_consensus.cc:493] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:19.530018  9630 raft_consensus.cc:515] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:19.531549  9783 leader_election.cc:290] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:19.532496  9630 leader_election.cc:290] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:19.512460  9745 consensus_queue.cc:1048] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 14:51:19.520558  9706 consensus_queue.cc:260] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:19.526469  9738 raft_consensus.cc:2804] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 14:51:19.535884  9706 raft_consensus.cc:3060] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:51:19.535552  9738 raft_consensus.cc:493] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:19.527204  9758 consensus_queue.cc:1048] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 14:51:19.528331  7893 leader_election.cc:304] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:19.519287  9705 raft_consensus.cc:1081] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 LEADER]: Signalling peer 1e9289592458429bbddb19c2e7b7b7b0 to start an election
I20260709 14:51:19.537964  7894 leader_election.cc:304] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:19.541126  7925 raft_consensus.cc:2468] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 4.
I20260709 14:51:19.541457  7893 leader_election.cc:304] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:19.542060  7819 leader_election.cc:304] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:51:19.536784  9738 raft_consensus.cc:3060] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Advancing to term 8
W20260709 14:51:19.550518  8598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 73816.5us
I20260709 14:51:19.549757  9550 raft_consensus.cc:2804] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 14:51:19.554593  9550 raft_consensus.cc:697] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:19.540659  9630 consensus_queue.cc:1059] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.009s
I20260709 14:51:19.555738  9550 consensus_queue.cc:237] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:19.556610  7745 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:19.552650  7893 leader_election.cc:304] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:19.545310  9741 raft_consensus.cc:2804] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 14:51:19.548772  9742 raft_consensus.cc:2804] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 14:51:19.548321  9749 raft_consensus.cc:2804] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader election won for term 7
I20260709 14:51:19.550236  9659 consensus_queue.cc:1059] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 14:51:19.552814  9744 consensus_queue.cc:1048] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 14:51:19.556430  9630 raft_consensus.cc:3055] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 LEADER]: Stepping down as leader of term 4
I20260709 14:51:19.556624  9786 raft_consensus.cc:2804] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 14:51:19.586165  9808 log.cc:927] Time spent T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 14:51:19.546756  9745 consensus_queue.cc:1059] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 14:51:19.598455  7819 leader_election.cc:304] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:19.560398  9782 raft_consensus.cc:493] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:51:19.615438  7851 raft_consensus.cc:2468] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 6.
I20260709 14:51:19.614094  9742 raft_consensus.cc:697] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:19.595268  9757 raft_consensus.cc:2804] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 14:51:19.593905  9741 raft_consensus.cc:697] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:19.605659  9786 raft_consensus.cc:493] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:19.601666  9630 raft_consensus.cc:740] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:51:19.579443  9732 raft_consensus.cc:515] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:19.613215  9659 consensus_queue.cc:1243] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer 3876b8ee8d744cb18e91d97aae93b1ac log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 14:51:19.639557  9786 raft_consensus.cc:3060] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:51:19.611855  9725 raft_consensus.cc:515] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:19.665911  9698 raft_consensus.cc:515] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:19.624056  9782 raft_consensus.cc:515] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:19.666173  9720 leader_election.cc:290] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 4 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:51:19.719380  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 167794us
W20260709 14:51:19.723560  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 162406us
I20260709 14:51:19.714447  9749 raft_consensus.cc:697] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
W20260709 14:51:19.676601  9810 log.cc:927] Time spent T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 14:51:19.730206  7770 raft_consensus.cc:2393] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 5: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:51:19.730569  7744 leader_election.cc:304] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:51:19.665167  9757 raft_consensus.cc:697] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:19.732715  7776 raft_consensus.cc:1240] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 7. Current term is 8. Ops: [5.5-7.6]
I20260709 14:51:19.692037  9814 raft_consensus.cc:2749] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 14:51:19.734534  9378 raft_consensus.cc:2804] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 14:51:19.741689  9378 raft_consensus.cc:493] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:19.742406  9378 raft_consensus.cc:3060] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:51:19.737049  7894 leader_election.cc:304] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:19.743285  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:19.744567  7744 leader_election.cc:304] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:51:19.746284  7744 leader_election.cc:304] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:19.749950  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:19.717650  9783 raft_consensus.cc:493] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:19.680121  9776 leader_election.cc:290] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 5 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:19.686800  7773 raft_consensus.cc:2468] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 8.
I20260709 14:51:19.741595  9740 consensus_queue.cc:1048] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 14:51:19.686415  9630 consensus_queue.cc:260] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:19.751466  7847 raft_consensus.cc:1275] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 14:51:19.752274  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:19.801970  7775 raft_consensus.cc:3060] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:51:19.752481  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:19.753507  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:19.761852  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783e4874513449ef9084b833f188a6d3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:19.750933  7846 raft_consensus.cc:2393] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 4: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:51:19.753140  7845 raft_consensus.cc:1275] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 14:51:19.785095  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:19.814610  7779 raft_consensus.cc:2393] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 4: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:51:19.816251  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:19.689373  9742 consensus_queue.cc:237] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:19.777232  9378 raft_consensus.cc:515] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:19.818569  7774 raft_consensus.cc:3060] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:51:19.753091  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:19.825461  7771 raft_consensus.cc:2468] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 7.
I20260709 14:51:19.826829  7771 raft_consensus.cc:1275] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 14:51:19.828226  7771 raft_consensus.cc:1275] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 14:51:19.758826  7777 raft_consensus.cc:2468] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 4.
I20260709 14:51:19.760110  9757 consensus_queue.cc:237] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:19.775732  9749 consensus_queue.cc:237] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:19.772949  9732 leader_election.cc:290] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:19.765204  9784 raft_consensus.cc:2804] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader election won for term 5
I20260709 14:51:19.774655  9698 leader_election.cc:290] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:19.812333  9774 raft_consensus.cc:493] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
W20260709 14:51:19.822611  7742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:19.823167  9725 leader_election.cc:290] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:19.759316  9720 raft_consensus.cc:2804] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 14:51:19.762073  9659 raft_consensus.cc:493] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:51:19.785111  9809 log.cc:927] Time spent T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.082s	user 0.004s	sys 0.000s
W20260709 14:51:19.821552  9804 log.cc:927] Time spent T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.259s	user 0.000s	sys 0.002s
I20260709 14:51:19.831488  7777 raft_consensus.cc:1275] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 14:51:19.831363  7775 raft_consensus.cc:2468] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 6.
I20260709 14:51:19.680750  9741 consensus_queue.cc:237] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:19.833083  9378 leader_election.cc:290] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:19.833575  7771 raft_consensus.cc:1275] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 14:51:19.846611  7774 raft_consensus.cc:2468] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 7.
I20260709 14:51:19.777408  9787 leader_election.cc:290] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:19.816591  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:19.857120  7779 raft_consensus.cc:1275] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 14:51:19.751250  9744 consensus_queue.cc:1048] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.082s
I20260709 14:51:19.876786  7777 raft_consensus.cc:1275] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 14:51:19.877381  9815 log.cc:927] Time spent T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.202s	user 0.002s	sys 0.000s
W20260709 14:51:19.865326  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 87532.3us
I20260709 14:51:19.800048  9783 raft_consensus.cc:515] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:19.832909  9766 raft_consensus.cc:2804] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 14:51:19.750788  9816 consensus_queue.cc:1048] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.113s
I20260709 14:51:19.850096  9630 raft_consensus.cc:3060] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:51:19.868455  9698 raft_consensus.cc:493] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:19.871906  9720 raft_consensus.cc:697] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:19.901110  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:51:19.907913  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:19.857069  9774 raft_consensus.cc:515] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:19.868861  9659 raft_consensus.cc:515] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:19.930562  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 332248us
I20260709 14:51:19.931542  7819 leader_election.cc:304] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:19.944481  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:19.897712  9784 raft_consensus.cc:697] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:51:19.939180  7819 leader_election.cc:304] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:19.891690  9657 raft_consensus.cc:515] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:19.962687  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:19.963616  7921 raft_consensus.cc:2393] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 5: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:51:19.964795  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:19.965718  7922 raft_consensus.cc:2468] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 5.
I20260709 14:51:19.965921  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:19.964795  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:19.966995  7928 raft_consensus.cc:2393] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 6: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:51:19.967058  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:19.969003  7921 raft_consensus.cc:2410] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 14:51:19.969568  7924 raft_consensus.cc:2393] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 3: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:51:19.970110  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:19.971648  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:19.973829  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:19.974628  7926 raft_consensus.cc:2468] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 3.
I20260709 14:51:19.974740  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:19.975384  7919 raft_consensus.cc:2468] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 6.
I20260709 14:51:19.975692  9738 raft_consensus.cc:515] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:19.976110  9711 consensus_queue.cc:1048] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 14:51:19.970476  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:19.942423  9788 raft_consensus.cc:493] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:19.979413  7928 raft_consensus.cc:3060] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:51:19.981714  7819 leader_election.cc:304] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:19.987234  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:19.988283  7921 raft_consensus.cc:2468] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 2.
I20260709 14:51:19.989704  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:19.990306  7921 raft_consensus.cc:3060] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:51:19.992049  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:19.954952  9658 raft_consensus.cc:2804] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 14:51:19.998669  7819 leader_election.cc:304] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:19.988076  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:19.999713  7819 leader_election.cc:304] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:19.992678  7770 raft_consensus.cc:3060] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:51:19.993918  7920 raft_consensus.cc:1240] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 14:51:19.993400  7744 leader_election.cc:304] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:51:19.995570  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:19.909955  9698 raft_consensus.cc:515] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:20.002107  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:20.001793  7923 raft_consensus.cc:2468] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 3.
I20260709 14:51:20.003922  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:20.004752  7927 raft_consensus.cc:3060] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 14:51:20.000252  7924 raft_consensus.cc:3060] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:51:20.006891  7819 leader_election.cc:304] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:20.009977  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:20.009011  7893 leader_election.cc:304] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:19.977540  9724 raft_consensus.cc:493] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:19.978556  9780 raft_consensus.cc:2804] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 14:51:19.977475  9782 leader_election.cc:290] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:20.015729  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783e4874513449ef9084b833f188a6d3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:19.999558  9658 raft_consensus.cc:493] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:20.014629  7819 leader_election.cc:304] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:20.036475  7770 raft_consensus.cc:2468] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 6.
I20260709 14:51:20.025022  7921 raft_consensus.cc:2468] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 7.
I20260709 14:51:20.023128  7773 raft_consensus.cc:1240] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 14:51:20.020218  7744 leader_election.cc:304] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:20.000769  9814 raft_consensus.cc:2804] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 14:51:20.011339  9740 raft_consensus.cc:493] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:19.998378  9788 raft_consensus.cc:515] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:20.001788  9705 consensus_queue.cc:1059] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 14:51:20.016899  9728 raft_consensus.cc:2804] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 14:51:20.045876  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:20.046270  7745 leader_election.cc:304] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:20.066018  7745 leader_election.cc:304] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:20.047260  7744 leader_election.cc:304] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:51:19.999202  9745 consensus_queue.cc:1048] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 14:51:20.021605  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:20.071672  9378 raft_consensus.cc:2804] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 14:51:20.071872  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:20.072327  9378 raft_consensus.cc:493] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting leader election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:51:20.072731  9378 raft_consensus.cc:3060] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:51:20.052620  7928 raft_consensus.cc:2468] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 5.
I20260709 14:51:20.054133  9659 leader_election.cc:290] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:20.058175  9698 leader_election.cc:290] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:20.048527  9738 leader_election.cc:290] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:20.024919  9780 raft_consensus.cc:493] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:20.040051  7893 leader_election.cc:304] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:20.075094  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:20.074246  7927 raft_consensus.cc:2468] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 8.
I20260709 14:51:20.070927  7744 leader_election.cc:304] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:51:20.073690  7923 raft_consensus.cc:2393] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 7: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:51:20.074210  7745 leader_election.cc:304] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:20.074656  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:20.035846  9658 raft_consensus.cc:3060] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:51:20.080389  7928 raft_consensus.cc:1240] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 7. Current term is 8. Ops: [5.5-7.6]
I20260709 14:51:20.016211  9767 raft_consensus.cc:515] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:20.081779  7744 leader_election.cc:304] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:20.084419  7927 raft_consensus.cc:1240] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 4. Current term is 5. Ops: [3.2-4.3]
W20260709 14:51:20.087235  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 47420.5us
I20260709 14:51:20.059612  7773 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16"
dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
mode: GRACEFUL
new_leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
 from {username='slave'} at 127.0.0.1:47068
I20260709 14:51:20.081812  9780 raft_consensus.cc:3060] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:51:20.086421  9698 raft_consensus.cc:2804] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 14:51:20.088902  9659 raft_consensus.cc:2804] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 14:51:20.089399  9698 raft_consensus.cc:493] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting leader election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:51:20.090034  9698 raft_consensus.cc:3060] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:51:20.088223  9823 consensus_queue.cc:1048] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.102s
I20260709 14:51:20.088168  9817 raft_consensus.cc:2804] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 14:51:20.063558  9740 raft_consensus.cc:515] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:20.095569  9817 raft_consensus.cc:493] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:20.096135  9817 raft_consensus.cc:3060] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:51:20.097203  9738 consensus_queue.cc:1048] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 14:51:20.097508  9740 leader_election.cc:290] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:20.099062  7893 leader_election.cc:304] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:20.048143  9814 raft_consensus.cc:493] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:51:20.082234  9787 raft_consensus.cc:2749] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 14:51:20.031059  9724 raft_consensus.cc:515] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:20.109486  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:20.073226  9728 raft_consensus.cc:493] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:20.076171  9725 raft_consensus.cc:2749] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 14:51:20.130203  7926 raft_consensus.cc:1240] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 3. Current term is 4. Ops: []
I20260709 14:51:20.021020  9720 consensus_queue.cc:237] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:20.088506  9811 raft_consensus.cc:2804] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader election won for term 6
W20260709 14:51:20.152741  8599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 45893.9us
W20260709 14:51:20.153615  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 54658.1us
I20260709 14:51:20.153725  9378 raft_consensus.cc:515] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:20.105917  9744 consensus_queue.cc:1048] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 14:51:20.164523  7924 raft_consensus.cc:2468] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 5.
I20260709 14:51:20.098069  9830 raft_consensus.cc:2804] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 14:51:20.166847  7893 leader_election.cc:304] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:20.106407  9783 leader_election.cc:290] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:20.130991  9728 raft_consensus.cc:3060] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:51:20.129784  7773 raft_consensus.cc:606] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Received request to transfer leadership to TS 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:20.179186  7922 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
 from {username='slave'} at 127.0.0.1:38516
I20260709 14:51:20.105943  9659 raft_consensus.cc:697] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:20.176012  7923 raft_consensus.cc:1240] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 4. Current term is 5. Ops: []
I20260709 14:51:20.108450  9816 consensus_queue.cc:1048] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.067s
I20260709 14:51:20.180090  7922 raft_consensus.cc:493] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:51:20.176544  9378 leader_election.cc:290] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:20.161418  9741 raft_consensus.cc:2804] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 14:51:20.082821  9786 raft_consensus.cc:515] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:20.155220  9832 consensus_queue.cc:1048] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.110s
I20260709 14:51:20.162663  9787 raft_consensus.cc:3060] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:51:20.186172  7922 raft_consensus.cc:3060] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:51:20.106922  9814 raft_consensus.cc:3060] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:51:20.187152  9378 raft_consensus.cc:493] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:20.166869  9732 raft_consensus.cc:2749] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 14:51:20.174597  9828 raft_consensus.cc:3060] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:51:20.177338  9774 leader_election.cc:290] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:20.173669  9811 raft_consensus.cc:697] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
W20260709 14:51:20.193706  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 112015us
I20260709 14:51:20.179055  9830 raft_consensus.cc:493] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:20.182096  7773 raft_consensus.cc:614] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 14:51:20.061491  9784 consensus_queue.cc:237] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:20.193567  9378 raft_consensus.cc:515] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:20.188899  9738 raft_consensus.cc:2749] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 14:51:20.172916  9758 consensus_queue.cc:1048] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 14:51:20.184762  9783 raft_consensus.cc:2749] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 14:51:20.172808  9757 consensus_queue.cc:1048] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 14:51:20.187024  9725 raft_consensus.cc:493] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:20.201421  7744 leader_election.cc:304] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:51:20.204342  9724 leader_election.cc:290] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:20.209323  9825 raft_consensus.cc:2804] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 14:51:20.210085  9788 leader_election.cc:290] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:20.192422  9657 leader_election.cc:290] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:20.204113  9659 consensus_queue.cc:237] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:20.262439  9378 leader_election.cc:290] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:51:20.281654  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 80405.7us
I20260709 14:51:20.196097  9741 raft_consensus.cc:697] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
W20260709 14:51:20.284024  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 209914us
I20260709 14:51:20.302192  7744 leader_election.cc:304] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:51:20.318269  9378 raft_consensus.cc:2804] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 14:51:20.318710  9378 raft_consensus.cc:493] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting leader election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:51:20.199688  9830 raft_consensus.cc:3060] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:51:20.317183  7819 leader_election.cc:304] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:20.318886  7744 leader_election.cc:304] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:51:20.319041  9378 raft_consensus.cc:3060] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:51:20.322973  7744 leader_election.cc:304] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:51:20.323906  7744 leader_election.cc:304] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:51:20.324183  9721 raft_consensus.cc:3055] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 14:51:20.324720  9721 raft_consensus.cc:740] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:20.325495  9774 raft_consensus.cc:2804] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader election won for term 7
I20260709 14:51:20.327178  7744 leader_election.cc:304] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:51:20.316244  9788 raft_consensus.cc:493] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:20.331193  7819 leader_election.cc:304] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:20.333992  7745 leader_election.cc:304] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:20.312391  9825 raft_consensus.cc:493] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 14:51:20.349424  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:20.355067  7922 raft_consensus.cc:515] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:20.320637  9783 raft_consensus.cc:493] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:20.298300  9725 raft_consensus.cc:515] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:20.295722  9698 raft_consensus.cc:515] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:20.320061  9749 raft_consensus.cc:493] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:20.360538  7819 leader_election.cc:304] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:20.311790  9837 raft_consensus.cc:2804] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 14:51:20.338120  9706 raft_consensus.cc:2804] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader election won for term 5
I20260709 14:51:20.336787  9705 raft_consensus.cc:2764] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 14:51:20.373149  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:20.373471  7775 raft_consensus.cc:1275] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 14:51:20.393648  7922 leader_election.cc:290] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 3 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:20.394662  7770 raft_consensus.cc:2468] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 2.
I20260709 14:51:20.394956  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:20.395727  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:20.395839  7775 raft_consensus.cc:2468] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 6.
W20260709 14:51:20.395519  7742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:20.421866  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:20.335961  9788 raft_consensus.cc:515] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:20.397050  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
W20260709 14:51:20.426461  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:20.396669  7770 raft_consensus.cc:3060] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:51:20.354604  9825 raft_consensus.cc:3060] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:51:20.375264  9749 raft_consensus.cc:515] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:20.371585  9721 consensus_queue.cc:260] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:20.365525  9767 leader_election.cc:290] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 4 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:20.449810  9378 raft_consensus.cc:515] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:20.397336  9837 raft_consensus.cc:493] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:20.466315  7770 raft_consensus.cc:2468] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 4.
I20260709 14:51:20.393077  9774 raft_consensus.cc:697] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:51:20.456559  9706 raft_consensus.cc:697] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:51:20.474682  9378 leader_election.cc:290] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:20.357621  9842 raft_consensus.cc:2804] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader election won for term 5
I20260709 14:51:20.372531  9783 raft_consensus.cc:515] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:20.450085  9630 raft_consensus.cc:2804] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:51:20.455832  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:20.488072  9378 raft_consensus.cc:2804] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader election won for term 5
I20260709 14:51:20.492354  9378 raft_consensus.cc:697] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:51:20.496320  9378 consensus_queue.cc:237] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:20.501793  9835 log.cc:927] Time spent T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.296s	user 0.002s	sys 0.000s
I20260709 14:51:20.472312  9721 raft_consensus.cc:3060] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:51:20.516469  9630 raft_consensus.cc:697] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:51:20.527019  9630 consensus_queue.cc:237] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:20.531672  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:20.469329  9837 raft_consensus.cc:3060] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:51:20.483628  9786 leader_election.cc:290] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 9 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:20.503456  9843 consensus_queue.cc:1059] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.049s
I20260709 14:51:20.544148  9843 raft_consensus.cc:3055] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 LEADER]: Stepping down as leader of term 4
I20260709 14:51:20.544700  9843 raft_consensus.cc:740] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:51:20.545696  9843 consensus_queue.cc:260] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:20.547142  9843 raft_consensus.cc:3060] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:51:20.428800  9741 consensus_queue.cc:237] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:20.553332  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:20.560185  7778 raft_consensus.cc:2468] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 4.
I20260709 14:51:20.516703  7773 raft_consensus.cc:3060] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Advancing to term 8
I20260709 14:51:20.367998  9811 consensus_queue.cc:237] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:20.569964  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:20.574015  7778 raft_consensus.cc:2393] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 7: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:51:20.587980  7776 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37136 (request call id 1903) took 1204 ms. Trace:
I20260709 14:51:20.588497  7776 rpcz_store.cc:276] 0709 14:51:19.383519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:19.390762 (+  7243us) service_pool.cc:224] Handling call
0709 14:51:19.391156 (+   394us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 14:51:19.736070 (+344914us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:20.587633 (+851563us) spinlock_profiling.cc:243] Waited 341 ms on lock 0x7b54003e5654. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae8ee01 00007fb68ae8d83e 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2 00007fb6891c948c 00007fb6891c88c6
0709 14:51:20.587894 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":784997632}
I20260709 14:51:20.593425  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
W20260709 14:51:20.596726  9780 consensus_meta.cc:287] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent flushing consensus metadata: real 0.507s	user 0.012s	sys 0.004s
I20260709 14:51:20.609535  7776 raft_consensus.cc:1275] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 14:51:20.632272  9766 raft_consensus.cc:493] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:20.632947  9766 raft_consensus.cc:3060] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:51:20.602175  9719 raft_consensus.cc:493] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:20.654210  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:20.594110  9728 raft_consensus.cc:515] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:20.571818  9774 consensus_queue.cc:237] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:20.698963  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:20.680749  7846 raft_consensus.cc:1275] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 14:51:20.611245  9706 consensus_queue.cc:237] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:20.709115  7776 raft_consensus.cc:1240] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 14:51:20.710455  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:20.712949  7776 raft_consensus.cc:1240] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 6. Current term is 7. Ops: []
I20260709 14:51:20.635831  9725 leader_election.cc:290] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:20.605818  9749 leader_election.cc:290] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:20.706104  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:20.752319  7777 raft_consensus.cc:1240] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 5. Current term is 6. Ops: []
I20260709 14:51:20.680989  9705 raft_consensus.cc:493] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:20.748203  7776 raft_consensus.cc:1240] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 3. Current term is 4. Ops: []
I20260709 14:51:20.675873  9745 raft_consensus.cc:493] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:20.692768  9788 leader_election.cc:290] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:20.616698  9698 leader_election.cc:290] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:20.751296  9692 raft_consensus.cc:3055] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 LEADER]: Stepping down as leader of term 2
W20260709 14:51:20.756688  9838 log.cc:927] Time spent T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.232s	user 0.002s	sys 0.000s
I20260709 14:51:20.752378  7846 raft_consensus.cc:3060] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Advancing to term 8
I20260709 14:51:20.684141  9819 raft_consensus.cc:493] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:20.617074  9849 raft_consensus.cc:2749] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 14:51:20.617202  9850 raft_consensus.cc:2804] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader election won for term 8
W20260709 14:51:20.771456  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:20.623260  9780 raft_consensus.cc:515] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:20.789608  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:20.794868  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:20.703281  9719 raft_consensus.cc:515] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:20.764356  9692 raft_consensus.cc:740] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:51:20.764776  9745 raft_consensus.cc:515] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:20.767681  9705 raft_consensus.cc:515] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:20.802983  7846 raft_consensus.cc:2468] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 8.
I20260709 14:51:20.837479  7771 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 1983) took 1080 ms. Trace:
I20260709 14:51:20.802193  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:51:20.813997  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:20.767518  9783 leader_election.cc:290] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:20.794870  9845 raft_consensus.cc:493] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:51:20.875478  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:20.871220  7771 rpcz_store.cc:276] 0709 14:51:19.756935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:19.881000 (+124065us) service_pool.cc:224] Handling call
0709 14:51:19.881469 (+   469us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:51:20.032815 (+151346us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:51:20.032851 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:51:20.032899 (+    48us) raft_consensus.cc:1645] Marking committed up to 3
0709 14:51:20.032940 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:20.837176 (+804236us) spinlock_profiling.cc:243] Waited 151 ms on lock 0x7b540003aa54. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae8ee01 00007fb68ae8d83e 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2 00007fb6891c948c 00007fb6891c88c6
0709 14:51:20.837221 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:51:20.837408 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":347435392}
I20260709 14:51:20.872676  7850 raft_consensus.cc:2468] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 6.
I20260709 14:51:20.883858  7846 raft_consensus.cc:1275] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 14:51:20.796480  9698 raft_consensus.cc:493] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:20.835208  9850 raft_consensus.cc:697] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:51:20.865319  9720 raft_consensus.cc:493] T 9ce9c0ef2db24c13a8b1402f21819458 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9418391fa82a42c79c6cad13ba91d964)
W20260709 14:51:20.910167  9658 consensus_meta.cc:287] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent flushing consensus metadata: real 0.831s	user 0.017s	sys 0.000s
I20260709 14:51:20.910868  9658 raft_consensus.cc:515] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:20.909994  9812 raft_consensus.cc:3055] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 LEADER]: Stepping down as leader of term 4
I20260709 14:51:20.834681  9819 raft_consensus.cc:515] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:20.953632  7742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:20.963289  7920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38532 (request call id 2517) took 1001 ms. Trace:
I20260709 14:51:20.964125  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:20.900748  9698 raft_consensus.cc:515] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:20.963824  7920 rpcz_store.cc:276] 0709 14:51:19.962268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:19.962479 (+   211us) service_pool.cc:224] Handling call
0709 14:51:19.962802 (+   323us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:51:20.001020 (+ 38218us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:20.962896 (+961876us) spinlock_profiling.cc:243] Waited 30.9 ms on lock 0x7b5400451ad4. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae8ee01 00007fb68ae8d83e 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2 00007fb6891c948c 00007fb6891c88c6
0709 14:51:20.963198 (+   302us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":71015168}
I20260709 14:51:20.940045  9658 leader_election.cc:290] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 6 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:20.919205  9720 raft_consensus.cc:515] T 9ce9c0ef2db24c13a8b1402f21819458 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
W20260709 14:51:20.983806  9787 consensus_meta.cc:287] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent flushing consensus metadata: real 0.788s	user 0.012s	sys 0.003s
I20260709 14:51:20.984618  9787 raft_consensus.cc:2749] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 14:51:20.989466  9550 raft_consensus.cc:493] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:20.990168  9550 raft_consensus.cc:515] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:20.992169  9828 consensus_meta.cc:287] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent flushing consensus metadata: real 0.782s	user 0.011s	sys 0.000s
I20260709 14:51:20.956504  9812 raft_consensus.cc:740] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:51:20.956197  9728 leader_election.cc:290] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 5 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:20.932111  9692 consensus_queue.cc:260] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:20.992801  9828 raft_consensus.cc:2749] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 14:51:21.010107  7779 raft_consensus.cc:2468] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 7.
I20260709 14:51:21.002286  9725 raft_consensus.cc:493] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:51:21.053872  9814 consensus_meta.cc:287] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent flushing consensus metadata: real 0.855s	user 0.011s	sys 0.004s
I20260709 14:51:21.054564  9814 raft_consensus.cc:515] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:20.877379  9845 raft_consensus.cc:515] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:21.055526  9843 consensus_meta.cc:287] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent flushing consensus metadata: real 0.506s	user 0.011s	sys 0.005s
I20260709 14:51:21.076575  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:21.055791  9692 raft_consensus.cc:3060] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:51:21.078258  7849 raft_consensus.cc:3060] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Advancing to term 9
W20260709 14:51:21.066413  9825 consensus_meta.cc:287] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent flushing consensus metadata: real 0.603s	user 0.009s	sys 0.005s
W20260709 14:51:21.066630  7774 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.637s	user 0.029s	sys 0.053s
W20260709 14:51:21.081560  7774 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.652s	user 0.029s	sys 0.053s
I20260709 14:51:21.107225  7846 raft_consensus.cc:1275] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 14:51:21.108175  7775 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.678s	user 0.048s	sys 0.065s
W20260709 14:51:21.109472  7775 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.680s	user 0.048s	sys 0.065s
I20260709 14:51:21.111243  7849 raft_consensus.cc:2468] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 9.
I20260709 14:51:21.114939  7849 raft_consensus.cc:1275] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 14:51:21.066211  9725 raft_consensus.cc:515] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:21.152936  9817 consensus_meta.cc:287] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent flushing consensus metadata: real 1.056s	user 0.014s	sys 0.002s
I20260709 14:51:21.024694  9850 consensus_queue.cc:237] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:21.189585  9833 log.cc:927] Time spent T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.994s	user 0.013s	sys 0.004s
I20260709 14:51:21.196419  7772 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 1984) took 1407 ms. Trace:
I20260709 14:51:21.198678  7852 raft_consensus.cc:1275] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 14:51:21.199524  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:21.203928  7853 raft_consensus.cc:3055] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 LEADER]: Stepping down as leader of term 2
I20260709 14:51:21.208165  7853 raft_consensus.cc:740] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:51:21.202575  9787 raft_consensus.cc:493] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:21.197276  7772 rpcz_store.cc:276] 0709 14:51:19.789487 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:19.885232 (+ 95745us) service_pool.cc:224] Handling call
0709 14:51:19.885709 (+   477us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 14:51:19.893099 (+  7390us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:51:19.893129 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 14:51:19.903557 (+ 10428us) log.cc:844] Serialized 52 byte log entry
0709 14:51:19.988412 (+ 84855us) raft_consensus.cc:1645] Marking committed up to 2
0709 14:51:19.988527 (+   115us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:19.988616 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:51:20.976159 (+987543us) spinlock_profiling.cc:243] Waited 1.91 ms on lock 0x7b4400022b4c. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb687c29db1 00007fb687cc7c85 00007fb687cc86a2 00007fb68aa3a1db 00007fb68aa35aaf 00007fb68aa2986e 00007fb68aa28bb6 00007fb68aa287d8 00007fb68aa32221 00007fb68aa321d9 00007fb68aa32169
0709 14:51:21.191691 (+215532us) raft_consensus.cc:1685] finished
0709 14:51:21.191720 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:51:21.196334 (+  4614us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7523,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":90,"spinlock_wait_cycles":4400000,"thread_start_us":37979,"threads_started":1,"wal-append.queue_time_us":154633}
I20260709 14:51:21.078440  9812 consensus_queue.cc:260] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:21.201406  7893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:21.220389  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:21.221226  7924 raft_consensus.cc:3060] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:51:21.221051  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:21.223272  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:21.225018  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:21.211971  9745 leader_election.cc:290] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:21.227784  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
W20260709 14:51:21.228910  9837 consensus_meta.cc:287] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent flushing consensus metadata: real 0.678s	user 0.006s	sys 0.006s
I20260709 14:51:21.229786  9845 leader_election.cc:290] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:51:21.229967  9830 consensus_meta.cc:287] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent flushing consensus metadata: real 0.866s	user 0.009s	sys 0.005s
I20260709 14:51:21.094954  9825 raft_consensus.cc:515] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:21.196651  9720 leader_election.cc:290] T 9ce9c0ef2db24c13a8b1402f21819458 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68:42321)
I20260709 14:51:21.220750  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:21.231805  7924 raft_consensus.cc:2468] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 4.
I20260709 14:51:21.239674  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:21.241621  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:21.253113  7923 raft_consensus.cc:2393] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 5: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:51:21.245419  9837 raft_consensus.cc:515] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:21.255894  9837 leader_election.cc:290] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:21.257630  8637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce9c0ef2db24c13a8b1402f21819458" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9418391fa82a42c79c6cad13ba91d964" is_pre_election: true
I20260709 14:51:21.211180  7853 consensus_queue.cc:260] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:21.259543  7853 raft_consensus.cc:3060] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:51:21.202658  9780 leader_election.cc:290] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 6 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:21.225816  7852 raft_consensus.cc:1240] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 4. Current term is 5. Ops: []
I20260709 14:51:21.181527  9817 raft_consensus.cc:515] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:21.245903  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:21.204421  9719 leader_election.cc:290] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:51:21.247238  7773 consensus_meta.cc:287] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent flushing consensus metadata: real 0.663s	user 0.008s	sys 0.004s
I20260709 14:51:21.280383  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:21.256834  9550 leader_election.cc:290] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:21.287503  7771 raft_consensus.cc:3060] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:51:21.288852  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:21.293447  7776 raft_consensus.cc:3060] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:51:21.250855  9845 raft_consensus.cc:493] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:21.320428  7776 raft_consensus.cc:2468] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 9.
I20260709 14:51:21.313057  9817 leader_election.cc:290] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 5 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:21.269596  9698 leader_election.cc:290] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:21.303020  7771 raft_consensus.cc:2468] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 3.
I20260709 14:51:21.278573  9812 raft_consensus.cc:3060] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:51:21.253564  9830 raft_consensus.cc:515] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:21.295141  7773 raft_consensus.cc:2468] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 8.
I20260709 14:51:21.287770  9849 consensus_queue.cc:1059] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.084s
I20260709 14:51:21.344375  9845 raft_consensus.cc:515] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:21.339913  7675 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54350 (request call id 366) took 2982 ms. Trace:
I20260709 14:51:21.339982  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c563cc7cfbe4d59be4ffc5cf847ce56" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:21.408830  7846 raft_consensus.cc:2410] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 14:51:21.230751  9787 raft_consensus.cc:515] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:21.350350  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce9c0ef2db24c13a8b1402f21819458" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:21.352478  9705 leader_election.cc:290] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:21.413023  7776 raft_consensus.cc:1275] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 14:51:21.387780  7773 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37144 (request call id 1994) took 1014 ms. Trace:
I20260709 14:51:21.438532  7894 leader_election.cc:304] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:51:21.443463  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:21.444331  7676 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54344 (request call id 366) took 3310 ms. Trace:
I20260709 14:51:21.322739  7853 raft_consensus.cc:2468] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 3.
W20260709 14:51:21.403262  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:21.382861  9814 leader_election.cc:290] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 6 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:51:21.448359  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:21.485476  9826 raft_consensus.cc:2749] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 14:51:21.486233  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 47938.5us
I20260709 14:51:21.429180  9819 leader_election.cc:290] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:21.404482  7675 rpcz_store.cc:276] 0709 14:51:18.357145 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:18.357324 (+   179us) service_pool.cc:224] Handling call
0709 14:51:21.339834 (+2982510us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 14:51:18.690715 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 14:51:18.693358 (+  2643us) write_op.cc:432] Acquiring schema lock in shared mode
0709 14:51:18.693419 (+    61us) write_op.cc:435] Acquired schema lock
0709 14:51:18.693442 (+    23us) tablet.cc:662] Decoding operations
0709 14:51:18.694058 (+   616us) write_op.cc:620] Acquiring the partition lock for write op
0709 14:51:18.694115 (+    57us) write_op.cc:641] Partition lock acquired for write op
0709 14:51:18.694140 (+    25us) tablet.cc:685] Acquiring locks for 2 operations
0709 14:51:18.700183 (+  6043us) tablet.cc:701] Row locks acquired
0709 14:51:18.700207 (+    24us) write_op.cc:260] PREPARE: finished
0709 14:51:18.737538 (+ 37331us) write_op.cc:270] Start()
0709 14:51:18.737687 (+   149us) write_op.cc:276] Timestamp: P: 1783608678713658 usec, L: 0
0709 14:51:18.737710 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 14:51:18.988826 (+251116us) log.cc:844] Serialized 919 byte log entry
0709 14:51:19.076550 (+ 87724us) spinlock_profiling.cc:243] Waited 63.3 ms on lock 0x7b5400349f20. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf8090 00007fb68ae056b8 00007fb68ae052fa 00007fb68ae89965 00007fb68ae89e09 00007fb68e8c4581 00007fb68e8c3d58 00007fb68e8c89f1 00007fb68e8c89a9 00007fb68e8c8939 00007fb68e8c8901
0709 14:51:19.406728 (+330178us) op_driver.cc:464] REPLICATION: finished
0709 14:51:19.496142 (+ 89414us) write_op.cc:301] APPLY: starting
0709 14:51:19.496251 (+   109us) tablet.cc:1367] starting BulkCheckPresence
0709 14:51:19.496383 (+   132us) tablet.cc:1370] finished BulkCheckPresence
0709 14:51:19.496403 (+    20us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 14:51:19.496800 (+   397us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 14:51:19.497025 (+   225us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 14:51:19.497071 (+    46us) write_op.cc:312] APPLY: finished
0709 14:51:19.497381 (+   310us) log.cc:844] Serialized 29 byte log entry
0709 14:51:19.497679 (+   298us) write_op.cc:489] Releasing partition, row and schema locks
0709 14:51:19.497787 (+   108us) write_op.cc:454] Released schema lock
0709 14:51:19.497832 (+    45us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":82866,"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":67154,"apply.run_cpu_time_us":2093,"apply.run_wall_time_us":10212,"mutex_wait_us":20832,"num_ops":2,"prepare.queue_time_us":142509,"prepare.run_cpu_time_us":18526,"prepare.run_wall_time_us":386152,"replication_time_us":663014,"spinlock_wait_cycles":145687424,"thread_start_us":118352,"threads_started":1}]]}
I20260709 14:51:21.360394  7771 raft_consensus.cc:1275] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 14:51:21.492901  7894 leader_election.cc:304] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:21.523087  7771 raft_consensus.cc:1275] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 14:51:21.445113  7676 rpcz_store.cc:276] 0709 14:51:18.134139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:18.134339 (+   200us) service_pool.cc:224] Handling call
0709 14:51:21.444251 (+3309912us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 14:51:18.524646 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 14:51:18.525359 (+   713us) write_op.cc:432] Acquiring schema lock in shared mode
0709 14:51:18.525399 (+    40us) write_op.cc:435] Acquired schema lock
0709 14:51:18.525416 (+    17us) tablet.cc:662] Decoding operations
0709 14:51:18.525766 (+   350us) write_op.cc:620] Acquiring the partition lock for write op
0709 14:51:18.525820 (+    54us) write_op.cc:641] Partition lock acquired for write op
0709 14:51:18.525850 (+    30us) tablet.cc:685] Acquiring locks for 1 operations
0709 14:51:18.526028 (+   178us) tablet.cc:701] Row locks acquired
0709 14:51:18.526045 (+    17us) write_op.cc:260] PREPARE: finished
0709 14:51:18.526202 (+   157us) write_op.cc:270] Start()
0709 14:51:18.526326 (+   124us) write_op.cc:276] Timestamp: P: 1783608678526143 usec, L: 0
0709 14:51:18.526347 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 14:51:18.527149 (+   802us) log.cc:844] Serialized 538 byte log entry
0709 14:51:19.209409 (+682260us) op_driver.cc:464] REPLICATION: finished
0709 14:51:19.404001 (+194592us) write_op.cc:301] APPLY: starting
0709 14:51:19.404104 (+   103us) tablet.cc:1367] starting BulkCheckPresence
0709 14:51:19.404209 (+   105us) tablet.cc:1370] finished BulkCheckPresence
0709 14:51:19.406412 (+  2203us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 14:51:19.408225 (+  1813us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 14:51:19.408670 (+   445us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 14:51:19.408736 (+    66us) write_op.cc:312] APPLY: finished
0709 14:51:19.408960 (+   224us) log.cc:844] Serialized 23 byte log entry
0709 14:51:19.409152 (+   192us) write_op.cc:489] Releasing partition, row and schema locks
0709 14:51:19.409234 (+    82us) write_op.cc:454] Released schema lock
0709 14:51:19.434260 (+ 25026us) write_op.cc:341] FINISH: Updating metrics
0709 14:51:19.492559 (+ 58299us) write_op.cc:489] Releasing partition, row and schema locks
0709 14:51:19.492595 (+    36us) write_op.cc:454] Released schema lock
0709 14:51:19.552671 (+ 60076us) write_op.cc:489] Releasing partition, row and schema locks
0709 14:51:19.561773 (+  9102us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":955131,"reported_tablets":11,"child_traces":[["op",{"apply.queue_time_us":194138,"apply.run_cpu_time_us":3111,"apply.run_wall_time_us":88599,"num_ops":1,"prepare.queue_time_us":158694,"prepare.run_cpu_time_us":30331,"prepare.run_wall_time_us":146957,"raft.queue_time_us":299773,"raft.run_cpu_time_us":42100,"raft.run_wall_time_us":334772,"replication_time_us":682824,"thread_start_us":394935,"threads_started":4,"wal-append.queue_time_us":444247,"wal-append.run_cpu_time_us":17313,"wal-append.run_wall_time_us":1531252}]]}
W20260709 14:51:21.526212  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:51:21.531240  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:51:21.535563  7742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:21.539763  9744 consensus_queue.cc:1048] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 14:51:21.541507  9832 raft_consensus.cc:2804] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 14:51:21.542404  9832 raft_consensus.cc:697] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:21.543323  9832 consensus_queue.cc:237] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:21.532353  7894 leader_election.cc:304] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
W20260709 14:51:21.547804  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:21.557957  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:21.472489  9725 leader_election.cc:290] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:51:21.548696  7819 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.180s	user 0.000s	sys 0.075s
I20260709 14:51:21.529294  9826 consensus_queue.cc:1048] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.048s
I20260709 14:51:21.566924  9830 leader_election.cc:290] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 5 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:51:21.574954  7819 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.207s	user 0.000s	sys 0.075s
I20260709 14:51:21.615355  7776 raft_consensus.cc:1275] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 14:51:21.700134  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 1.33985e+06us
W20260709 14:51:21.602516  7919 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.322s	user 0.006s	sys 0.055s
W20260709 14:51:21.702759  7919 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.423s	user 0.006s	sys 0.062s
I20260709 14:51:21.679806  9719 raft_consensus.cc:493] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:51:21.441093  7773 rpcz_store.cc:276] 0709 14:51:20.371976 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:20.374418 (+  2442us) service_pool.cc:224] Handling call
0709 14:51:21.386334 (+1011916us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 14:51:21.703917  9783 raft_consensus.cc:493] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9418391fa82a42c79c6cad13ba91d964)
I20260709 14:51:21.703588  9719 raft_consensus.cc:515] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:21.704594  9783 raft_consensus.cc:515] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
W20260709 14:51:21.563911  9784 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.032s	user 0.026s	sys 0.022s
I20260709 14:51:21.706504  9849 raft_consensus.cc:3055] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 LEADER]: Stepping down as leader of term 5
I20260709 14:51:21.707002  9849 raft_consensus.cc:740] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
W20260709 14:51:21.708581  9659 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.150s	user 0.024s	sys 0.030s
W20260709 14:51:21.709496  9659 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.151s	user 0.025s	sys 0.030s
I20260709 14:51:21.709969  9860 raft_consensus.cc:493] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:21.710610  9860 raft_consensus.cc:515] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:21.711648  7774 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.001s	sys 0.001s
W20260709 14:51:21.712064  7774 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.540s	user 0.001s	sys 0.001s
I20260709 14:51:21.651584  9820 raft_consensus.cc:493] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:21.713042  9820 raft_consensus.cc:515] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:21.713752  9842 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.121s	user 0.010s	sys 0.039s
W20260709 14:51:21.712039  9741 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.975s	user 0.010s	sys 0.036s
W20260709 14:51:21.714690  9842 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.147s	user 0.010s	sys 0.039s
W20260709 14:51:21.715184  9741 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.012s	user 0.011s	sys 0.036s
I20260709 14:51:21.715420  9837 raft_consensus.cc:493] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:21.716382  9837 raft_consensus.cc:515] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:21.715319  9865 raft_consensus.cc:493] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
W20260709 14:51:21.626550  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 45242.8us
I20260709 14:51:21.566277  9744 raft_consensus.cc:2804] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 14:51:21.702087  7819 leader_election.cc:304] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
W20260709 14:51:21.731179  7770 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.261s	user 0.010s	sys 0.033s
W20260709 14:51:21.784782  7770 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.315s	user 0.010s	sys 0.033s
W20260709 14:51:21.735078  7847 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.840s	user 0.003s	sys 0.013s
W20260709 14:51:21.786607  7847 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.892s	user 0.003s	sys 0.014s
W20260709 14:51:21.742442  7854 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.985s	user 0.013s	sys 0.025s
W20260709 14:51:21.787218  7854 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.030s	user 0.013s	sys 0.025s
I20260709 14:51:21.788087  7854 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 2076) took 1032 ms. Trace:
I20260709 14:51:21.788599  7854 rpcz_store.cc:276] 0709 14:51:20.755542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:20.755694 (+   152us) service_pool.cc:224] Handling call
0709 14:51:20.756079 (+   385us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:51:20.756456 (+   377us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:51:20.756484 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:51:20.757037 (+   553us) log.cc:844] Serialized 26 byte log entry
0709 14:51:21.787618 (+1030581us) raft_consensus.cc:1645] Marking committed up to 4
0709 14:51:21.787664 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:21.787737 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:51:21.787807 (+    70us) raft_consensus.cc:1685] finished
0709 14:51:21.787820 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:51:21.788005 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8191,"raft.run_cpu_time_us":182,"raft.run_wall_time_us":17714,"thread_start_us":1030158,"threads_started":1,"wal-append.queue_time_us":962023}
W20260709 14:51:21.759411  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:21.720072  7894 leader_election.cc:304] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
W20260709 14:51:21.731758  9378 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.137s	user 0.013s	sys 0.038s
W20260709 14:51:22.059792  7778 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.364s	user 0.015s	sys 0.048s
W20260709 14:51:21.633051  9721 consensus_meta.cc:287] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent flushing consensus metadata: real 1.099s	user 0.016s	sys 0.000s
I20260709 14:51:22.091735  9732 raft_consensus.cc:2804] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 14:51:21.653883  9766 consensus_meta.cc:287] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent flushing consensus metadata: real 1.020s	user 0.016s	sys 0.001s
I20260709 14:51:21.620749  9767 raft_consensus.cc:493] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:22.092814  9732 raft_consensus.cc:697] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:21.726325  9820 leader_election.cc:290] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:21.876659  8637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce9c0ef2db24c13a8b1402f21819458" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9418391fa82a42c79c6cad13ba91d964" is_pre_election: true
I20260709 14:51:22.093938  9767 raft_consensus.cc:515] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:21.893908  7745 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.538s	user 0.005s	sys 0.028s
W20260709 14:51:21.675010  9692 consensus_meta.cc:287] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent flushing consensus metadata: real 0.581s	user 0.012s	sys 0.000s
W20260709 14:51:21.934852  7845 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.155s	user 0.019s	sys 0.024s
W20260709 14:51:21.887554  9776 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.714s	user 0.009s	sys 0.025s
I20260709 14:51:22.095387  7846 raft_consensus.cc:2468] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 3.
W20260709 14:51:22.095695  9776 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.935s	user 0.011s	sys 0.031s
W20260709 14:51:21.743327  9784 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.211s	user 0.032s	sys 0.023s
W20260709 14:51:22.095175  7845 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.316s	user 0.034s	sys 0.025s
W20260709 14:51:22.051784  7852 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.685s	user 0.011s	sys 0.010s
I20260709 14:51:21.877151  7847 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 2071) took 1176 ms. Trace:
W20260709 14:51:22.094839  7745 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.739s	user 0.014s	sys 0.040s
W20260709 14:51:21.772312  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 70361.6us
W20260709 14:51:22.090334  9378 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.495s	user 0.023s	sys 0.042s
W20260709 14:51:21.932468  7742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:51:21.911988  9706 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.853s	user 0.009s	sys 0.014s
W20260709 14:51:22.009043  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:22.098268  7847 rpcz_store.cc:276] 0709 14:51:20.700874 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:20.701271 (+   397us) service_pool.cc:224] Handling call
0709 14:51:20.701714 (+   443us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:51:20.893923 (+192209us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:51:20.893957 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:51:20.894493 (+   536us) log.cc:844] Serialized 26 byte log entry
0709 14:51:21.787131 (+892638us) raft_consensus.cc:1645] Marking committed up to 5
0709 14:51:21.787183 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:21.830288 (+ 43105us) spinlock_profiling.cc:243] Waited 192 ms on lock 0x7b54001419d4. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae8ee01 00007fb68ae8d83e 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2 00007fb6891c948c 00007fb6891c88c6
0709 14:51:21.830344 (+    56us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:51:21.830392 (+    48us) raft_consensus.cc:1685] finished
0709 14:51:21.830404 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:51:21.877058 (+ 46654us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":84978,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":147,"spinlock_wait_cycles":441088896,"thread_start_us":892258,"threads_started":1,"wal-append.queue_time_us":840737}
W20260709 14:51:22.115644  7772 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.725s	user 0.018s	sys 0.023s
W20260709 14:51:22.116211  7772 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.729s	user 0.018s	sys 0.023s
I20260709 14:51:21.723757  9825 leader_election.cc:290] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:51:21.861994  9867 log.cc:927] Time spent T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
W20260709 14:51:22.059644  7893 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.813s	user 0.004s	sys 0.017s
W20260709 14:51:21.722412  7775 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.000s	sys 0.004s
W20260709 14:51:22.091533  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 371561us
W20260709 14:51:22.098434  7818 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.330s	user 0.011s	sys 0.014s
W20260709 14:51:22.091614  7778 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.396s	user 0.015s	sys 0.049s
W20260709 14:51:22.097389  7852 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.730s	user 0.014s	sys 0.010s
W20260709 14:51:22.099815  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 1.77711e+06us
W20260709 14:51:22.009043  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:51:21.721737  7851 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.976s	user 0.014s	sys 0.024s
I20260709 14:51:21.716866  9845 leader_election.cc:290] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:21.778291  9698 raft_consensus.cc:493] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:21.726913  9787 leader_election.cc:290] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:51:21.730466  9782 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.897s	user 0.011s	sys 0.026s
I20260709 14:51:22.094515  9732 consensus_queue.cc:237] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:21.719758  9865 raft_consensus.cc:515] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:22.030777  9826 raft_consensus.cc:493] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:21.776355  9659 raft_consensus.cc:493] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:51:22.135587  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:21.724452  9860 leader_election.cc:290] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:51:22.319828  7779 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.620s	user 0.007s	sys 0.009s
W20260709 14:51:22.343987  7777 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.980s	user 0.004s	sys 0.020s
W20260709 14:51:22.382393  7779 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.683s	user 0.008s	sys 0.009s
W20260709 14:51:22.361227  7775 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.149s	user 0.014s	sys 0.027s
W20260709 14:51:22.361486  7893 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.115s	user 0.007s	sys 0.034s
W20260709 14:51:22.122561  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:51:22.358872  7818 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.590s	user 0.013s	sys 0.030s
W20260709 14:51:22.383679  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 1.13895e+06us
W20260709 14:51:22.359395  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:22.360945  7745 leader_election.cc:304] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:51:22.187577  9855 log.cc:927] Time spent T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
W20260709 14:51:22.097957  9811 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.128s	user 0.001s	sys 0.029s
I20260709 14:51:21.729916  9744 raft_consensus.cc:493] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 14:51:22.091647  9742 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.609s	user 0.040s	sys 0.075s
W20260709 14:51:22.091533  9812 consensus_meta.cc:287] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent flushing consensus metadata: real 0.721s	user 0.011s	sys 0.011s
W20260709 14:51:22.006618  9630 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.121s	user 0.015s	sys 0.026s
I20260709 14:51:21.717304  9854 raft_consensus.cc:493] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:21.719012  9837 leader_election.cc:290] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:51:22.228185  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 128199us
I20260709 14:51:21.771298  9741 raft_consensus.cc:493] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:51:22.409476  9744 raft_consensus.cc:3060] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:51:22.417541  9873 raft_consensus.cc:493] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:22.417435  9741 raft_consensus.cc:515] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:22.418162  9873 raft_consensus.cc:515] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:22.418694  9865 leader_election.cc:290] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:22.384584  9826 raft_consensus.cc:515] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:22.419800  9741 leader_election.cc:290] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:22.380988  7774 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 1999) took 2006 ms. Trace:
W20260709 14:51:22.382454  7777 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.018s	user 0.005s	sys 0.020s
I20260709 14:51:22.388065  9659 raft_consensus.cc:515] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:21.771883  9830 raft_consensus.cc:2804] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader election won for term 6
I20260709 14:51:22.422210  9825 raft_consensus.cc:2749] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 14:51:22.420440  9741 consensus_queue.cc:1048] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 14:51:22.387679  7745 leader_election.cc:304] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:22.423744  9659 leader_election.cc:290] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:22.424114  7745 leader_election.cc:304] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:22.376909  9698 raft_consensus.cc:515] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:21.733430  9719 leader_election.cc:290] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:21.930428  9850 raft_consensus.cc:493] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:22.425688  7745 leader_election.cc:304] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:22.426286  9850 raft_consensus.cc:515] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:22.421501  7819 leader_election.cc:304] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:22.427047  9698 leader_election.cc:290] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:21.862881  9783 leader_election.cc:290] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785), 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68:42321)
I20260709 14:51:22.429039  9860 raft_consensus.cc:2749] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 14:51:22.421533  7774 rpcz_store.cc:276] 0709 14:51:20.373995 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:20.374200 (+   205us) service_pool.cc:224] Handling call
0709 14:51:20.428955 (+ 54755us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:51:21.084472 (+655517us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:51:21.084514 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:51:21.096771 (+ 12257us) log.cc:844] Serialized 26 byte log entry
0709 14:51:21.713061 (+616290us) raft_consensus.cc:1645] Marking committed up to 4
0709 14:51:21.713124 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:21.713229 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:51:22.380489 (+667260us) raft_consensus.cc:1685] finished
0709 14:51:22.380526 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:51:22.380776 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":274060,"raft.run_cpu_time_us":186,"raft.run_wall_time_us":28551,"thread_start_us":1195492,"threads_started":2,"wal-append.queue_time_us":899960}
I20260709 14:51:22.429868  9860 raft_consensus.cc:3060] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:51:21.741583  9842 raft_consensus.cc:697] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:51:22.428697  9787 raft_consensus.cc:2749] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 14:51:22.329515  7919 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.626s	user 0.012s	sys 0.027s
W20260709 14:51:22.395610  9811 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.433s	user 0.009s	sys 0.037s
W20260709 14:51:22.434862  7919 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.731s	user 0.013s	sys 0.028s
I20260709 14:51:22.435895  9811 raft_consensus.cc:2764] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader election decision vote started in defunct term 8: won
I20260709 14:51:22.436061  7919 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38516 (request call id 1890) took 2279 ms. Trace:
W20260709 14:51:22.436625  7849 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.206s	user 0.023s	sys 0.024s
W20260709 14:51:22.439047  7849 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.209s	user 0.024s	sys 0.024s
I20260709 14:51:22.428463  9850 leader_election.cc:290] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:51:22.434551  9856 log.cc:927] Time spent T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.204s	user 0.000s	sys 0.001s
I20260709 14:51:22.379944  9820 consensus_queue.cc:1048] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.062s
W20260709 14:51:22.389681  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:21.991465  9828 raft_consensus.cc:493] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
W20260709 14:51:22.374899  9774 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.198s	user 0.009s	sys 0.029s
W20260709 14:51:22.490446  9774 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.321s	user 0.009s	sys 0.029s
I20260709 14:51:22.491707  7845 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 2072) took 1789 ms. Trace:
I20260709 14:51:22.492201  7845 rpcz_store.cc:276] 0709 14:51:20.702373 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:20.702594 (+   221us) service_pool.cc:224] Handling call
0709 14:51:20.703082 (+   488us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:51:20.703462 (+   380us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:51:20.703489 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:51:20.704062 (+   573us) log.cc:844] Serialized 26 byte log entry
0709 14:51:20.985622 (+281560us) spinlock_profiling.cc:243] Waited 10.7 ms on lock 0x7b4800002dd8. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68fdb7aa1 00007fb68fdaeb37 00007fb68fdae9ca 00007fb68fea626f 00007fb68fea5f37 00007fb68feba55c 00007fb68feba508 00007fb68feba488 00007fb68feba443 00007fb68feb96ec 00007fb68ede3a96
0709 14:51:22.097439 (+1111817us) raft_consensus.cc:1645] Marking committed up to 4
0709 14:51:22.097500 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:22.097593 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:51:22.491297 (+393704us) raft_consensus.cc:1685] finished
0709 14:51:22.491320 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:51:22.491613 (+   293us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":52235,"raft.run_cpu_time_us":4127,"raft.run_wall_time_us":222046,"spinlock_wait_cycles":24609024,"thread_start_us":1317944,"threads_started":1,"wal-append.queue_time_us":1663515}
I20260709 14:51:22.495769  7779 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 2007) took 1216 ms. Trace:
I20260709 14:51:22.496411  7779 rpcz_store.cc:276] 0709 14:51:21.279504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:21.279737 (+   233us) service_pool.cc:224] Handling call
0709 14:51:21.280128 (+   391us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:51:21.280547 (+   419us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:51:21.280579 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:51:21.281119 (+   540us) log.cc:844] Serialized 26 byte log entry
0709 14:51:22.383053 (+1101934us) raft_consensus.cc:1645] Marking committed up to 4
0709 14:51:22.383147 (+    94us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:22.383234 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:51:22.495479 (+112245us) raft_consensus.cc:1685] finished
0709 14:51:22.495504 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:51:22.495671 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27293,"raft.queue_time_us":89355,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":105,"thread_start_us":683353,"threads_started":1,"wal-append.queue_time_us":1173914}
I20260709 14:51:22.436620  7919 rpcz_store.cc:276] 0709 14:51:20.156778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:20.162083 (+  5305us) service_pool.cc:224] Handling call
0709 14:51:20.188026 (+ 25943us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:51:20.190521 (+  2495us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 14:51:20.279989 (+ 89468us) log.cc:844] Serialized 14 byte log entry
0709 14:51:22.435410 (+2155421us) log.cc:844] Serialized 14 byte log entry
0709 14:51:22.435654 (+   244us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:51:22.435713 (+    59us) raft_consensus.cc:1645] Marking committed up to 6
0709 14:51:22.435766 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:22.435851 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:51:22.435995 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":919489,"prepare.run_cpu_time_us":135,"prepare.run_wall_time_us":135,"raft.queue_time_us":25847,"raft.run_cpu_time_us":497,"raft.run_wall_time_us":10293,"thread_start_us":2243449,"threads_started":3,"wal-append.queue_time_us":1754159}
W20260709 14:51:22.499845  7742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:51:22.360323  9782 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.532s	user 0.031s	sys 0.059s
W20260709 14:51:22.409564  7743 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.897s	user 0.010s	sys 0.030s
I20260709 14:51:22.339145  9767 leader_election.cc:290] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:51:22.409605  9742 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.927s	user 0.044s	sys 0.086s
W20260709 14:51:22.409888  9630 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.524s	user 0.020s	sys 0.040s
I20260709 14:51:22.416217  9812 raft_consensus.cc:493] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:22.415904  9854 raft_consensus.cc:515] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:22.409509  9550 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.755s	user 0.011s	sys 0.022s
W20260709 14:51:22.521044  7770 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.004s	sys 0.013s
W20260709 14:51:22.521572  7770 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.523s	user 0.005s	sys 0.013s
I20260709 14:51:22.416833  9691 raft_consensus.cc:493] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:22.421301  9826 leader_election.cc:290] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:51:22.359928  7851 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.614s	user 0.031s	sys 0.032s
W20260709 14:51:22.145723  9832 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.001s	sys 0.013s
I20260709 14:51:22.432258  7745 leader_election.cc:304] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:22.093768  9766 raft_consensus.cc:515] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:22.530793  9766 leader_election.cc:290] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:22.375454  9721 consensus_queue.cc:1048] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.062s
I20260709 14:51:22.401578  9858 raft_consensus.cc:493] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:22.533686  9858 raft_consensus.cc:515] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:22.536324  9858 leader_election.cc:290] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:22.479123  9811 raft_consensus.cc:493] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:22.537312  9811 raft_consensus.cc:515] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:22.539696  9811 leader_election.cc:290] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:22.481676  7777 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 2009) took 1201 ms. Trace:
I20260709 14:51:22.540400  7777 rpcz_store.cc:276] 0709 14:51:21.280247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:21.282399 (+  2152us) service_pool.cc:224] Handling call
0709 14:51:21.288786 (+  6387us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 14:51:21.289373 (+   587us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:51:21.289452 (+    79us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 14:51:21.290325 (+   873us) log.cc:844] Serialized 52 byte log entry
0709 14:51:22.421900 (+1131575us) raft_consensus.cc:1645] Marking committed up to 2
0709 14:51:22.421950 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:22.422042 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:51:22.481400 (+ 59358us) raft_consensus.cc:1685] finished
0709 14:51:22.481430 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:51:22.481605 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":95801,"raft.run_cpu_time_us":518,"raft.run_wall_time_us":45637,"thread_start_us":1057701,"threads_started":1,"wal-append.queue_time_us":1151290}
I20260709 14:51:22.481971  9828 raft_consensus.cc:515] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:22.485344  7850 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 2098) took 1147 ms. Trace:
I20260709 14:51:22.543964  7850 rpcz_store.cc:276] 0709 14:51:21.337770 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:21.350975 (+ 13205us) service_pool.cc:224] Handling call
0709 14:51:21.351284 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:51:22.421906 (+1070622us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 14:51:22.421938 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:51:22.421985 (+    47us) raft_consensus.cc:1645] Marking committed up to 3
0709 14:51:22.422025 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:22.484924 (+ 62899us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b54003b3b54. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae8ee01 00007fb68ae8d83e 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2 00007fb6891c948c 00007fb6891c88c6
0709 14:51:22.484986 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:51:22.485229 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7919,"raft.queue_time_us":21615,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":138,"spinlock_wait_cycles":2443364096}
I20260709 14:51:22.489833  7772 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 2006) took 1211 ms. Trace:
W20260709 14:51:22.121491  9706 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.059s	user 0.015s	sys 0.015s
W20260709 14:51:22.501394  7743 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.989s	user 0.011s	sys 0.030s
I20260709 14:51:22.546060  7772 rpcz_store.cc:276] 0709 14:51:21.278864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:21.279120 (+   256us) service_pool.cc:224] Handling call
0709 14:51:21.279556 (+   436us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 14:51:21.316486 (+ 36930us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:51:21.316632 (+   146us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 14:51:21.328586 (+ 11954us) log.cc:844] Serialized 52 byte log entry
0709 14:51:22.339032 (+1010446us) raft_consensus.cc:1645] Marking committed up to 3
0709 14:51:22.339124 (+    92us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:22.339254 (+   130us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:51:22.489612 (+150358us) raft_consensus.cc:1685] finished
0709 14:51:22.489630 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:51:22.489767 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":145332,"raft.run_cpu_time_us":212,"raft.run_wall_time_us":44635,"thread_start_us":728913,"threads_started":1,"wal-append.queue_time_us":1122693}
I20260709 14:51:22.430944  9873 leader_election.cc:290] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:51:22.525931  8598 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.006s	sys 0.012s
W20260709 14:51:22.552779  8598 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.551s	user 0.006s	sys 0.013s
W20260709 14:51:22.519850  9550 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.866s	user 0.011s	sys 0.022s
W20260709 14:51:22.555589  8598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 554311us
I20260709 14:51:22.553505  7852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 2096) took 1216 ms. Trace:
I20260709 14:51:22.569545  7848 raft_consensus.cc:1240] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 LEADER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
W20260709 14:51:22.528680  9832 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.898s	user 0.010s	sys 0.016s
W20260709 14:51:22.588584  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 156461us
I20260709 14:51:22.589792  7745 leader_election.cc:304] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 3876b8ee8d744cb18e91d97aae93b1ac, 9418391fa82a42c79c6cad13ba91d964
W20260709 14:51:22.526166  8597 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.004s	sys 0.013s
I20260709 14:51:22.588651  7849 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 2094) took 1439 ms. Trace:
I20260709 14:51:22.434582  9842 consensus_queue.cc:237] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:22.499449  9744 raft_consensus.cc:515] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:22.550845  9691 raft_consensus.cc:515] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:22.604427  9691 leader_election.cc:290] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:22.600471  9766 raft_consensus.cc:2749] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 14:51:22.519274  9812 raft_consensus.cc:515] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:22.557746  7852 rpcz_store.cc:276] 0709 14:51:21.337095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:21.340109 (+  3014us) service_pool.cc:224] Handling call
0709 14:51:21.340407 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:51:21.340644 (+   237us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 14:51:22.359468 (+1018824us) log.cc:844] Serialized 14 byte log entry
0709 14:51:22.553094 (+193626us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:51:22.553155 (+    61us) raft_consensus.cc:1645] Marking committed up to 4
0709 14:51:22.553202 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:22.553300 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:51:22.553452 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":377655,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":27,"raft.queue_time_us":1788,"thread_start_us":1185737,"threads_started":2}
W20260709 14:51:22.607682  7744 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.005s	sys 0.018s
W20260709 14:51:22.608083  7744 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.517s	user 0.005s	sys 0.018s
W20260709 14:51:22.594535  8597 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.653s	user 0.005s	sys 0.013s
W20260709 14:51:22.608368  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 517607us
I20260709 14:51:22.611538  7745 leader_election.cc:304] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:22.500845  9849 consensus_queue.cc:260] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:22.601333  9828 leader_election.cc:290] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:22.616561  7745 leader_election.cc:304] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:22.621342  7745 leader_election.cc:304] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:22.625797  9854 leader_election.cc:290] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:22.622589  9774 raft_consensus.cc:3060] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:51:22.627651  9849 raft_consensus.cc:3060] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:51:22.631078  9744 leader_election.cc:290] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 7 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:22.617451  9766 raft_consensus.cc:2804] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 14:51:22.635416  9766 raft_consensus.cc:493] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:22.635838  9766 raft_consensus.cc:3060] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:51:22.639050  9812 leader_election.cc:290] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:22.613178  7778 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37136 (request call id 1905) took 2219 ms. Trace:
I20260709 14:51:22.609797  9884 raft_consensus.cc:2749] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 14:51:22.640271  7778 rpcz_store.cc:276] 0709 14:51:20.394001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:20.677899 (+283898us) service_pool.cc:224] Handling call
0709 14:51:20.679247 (+  1348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:51:20.679494 (+   247us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 14:51:22.368002 (+1688508us) log.cc:844] Serialized 14 byte log entry
0709 14:51:22.612721 (+244719us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:51:22.612819 (+    98us) raft_consensus.cc:1645] Marking committed up to 3
0709 14:51:22.612871 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:22.612940 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:51:22.613072 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3601,"prepare.queue_time_us":1757262,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":3697,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":139,"thread_start_us":1903738,"threads_started":2}
I20260709 14:51:22.649348  7775 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 2000) took 2274 ms. Trace:
W20260709 14:51:22.657089  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 270861us
I20260709 14:51:22.658428  7893 leader_election.cc:304] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:22.660485  7893 leader_election.cc:304] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:51:22.662832  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 241461us
I20260709 14:51:22.652809  7775 rpcz_store.cc:276] 0709 14:51:20.374579 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:20.397491 (+ 22912us) service_pool.cc:224] Handling call
0709 14:51:20.397854 (+   363us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 14:51:21.110715 (+712861us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:51:21.110745 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 14:51:21.206370 (+ 95625us) log.cc:844] Serialized 52 byte log entry
0709 14:51:22.383197 (+1176827us) raft_consensus.cc:1645] Marking committed up to 5
0709 14:51:22.647694 (+264497us) log.cc:844] Serialized 14 byte log entry
0709 14:51:22.648838 (+  1144us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:22.648960 (+   122us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:51:22.649005 (+    45us) raft_consensus.cc:1685] finished
0709 14:51:22.649017 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:51:22.649218 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":115839,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":55,"raft.queue_time_us":215877,"raft.run_cpu_time_us":302,"raft.run_wall_time_us":24938,"thread_start_us":2089196,"threads_started":3,"wal-append.queue_time_us":510648}
W20260709 14:51:22.668747  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:51:22.670424  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 49228.7us
I20260709 14:51:22.671319  7893 leader_election.cc:304] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:51:22.652848  8596 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.593s	user 0.006s	sys 0.017s
W20260709 14:51:22.682619  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:22.673040  7745 leader_election.cc:304] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
W20260709 14:51:22.674468  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 288331us
W20260709 14:51:22.678445  7742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:22.679016  7893 leader_election.cc:304] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:22.678396  9776 raft_consensus.cc:2749] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 14:51:22.678627  7819 leader_election.cc:304] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:22.700352  7745 leader_election.cc:304] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:22.690893  7848 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 2083) took 1761 ms. Trace:
I20260709 14:51:22.701850  7848 rpcz_store.cc:276] 0709 14:51:20.930125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:20.931931 (+  1806us) service_pool.cc:224] Handling call
0709 14:51:20.935728 (+  3797us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:51:22.591592 (+1655864us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:22.689006 (+ 97414us) spinlock_profiling.cc:243] Waited 1.63 s on lock 0x7b54000d5a54. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae8ee01 00007fb68ae8d83e 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2 00007fb6891c948c 00007fb6891c88c6
0709 14:51:22.690790 (+  1784us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3756978560}
I20260709 14:51:22.669943  9550 raft_consensus.cc:2804] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 14:51:22.709283  7745 connection.cc:256] RPC call timeout handler was delayed by -1.378429006000033s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1563s for a response
W20260709 14:51:22.680061  8596 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.629s	user 0.007s	sys 0.017s
I20260709 14:51:22.680200  9820 raft_consensus.cc:2804] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 14:51:22.664625  9828 raft_consensus.cc:493] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:22.672628  9825 raft_consensus.cc:493] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:22.679615  9811 raft_consensus.cc:493] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:22.679881  9830 raft_consensus.cc:697] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:51:22.750257  7851 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 2075) took 2005 ms. Trace:
I20260709 14:51:22.685985  9873 raft_consensus.cc:493] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:22.687891  9884 raft_consensus.cc:2749] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 14:51:22.670809  9744 consensus_queue.cc:1048] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.052s
I20260709 14:51:22.695585  9692 raft_consensus.cc:493] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:22.702956  9732 raft_consensus.cc:2804] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 14:51:22.722571  7745 connection.cc:256] RPC call timeout handler was delayed by -1.2371290060000319s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17200000000000001s for a response
I20260709 14:51:22.751273  7851 rpcz_store.cc:276] 0709 14:51:20.744582 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:20.744743 (+   161us) service_pool.cc:224] Handling call
0709 14:51:20.745108 (+   365us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:51:20.745406 (+   298us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 14:51:22.524670 (+1779264us) log.cc:844] Serialized 14 byte log entry
0709 14:51:22.749788 (+225118us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:51:22.749867 (+    79us) raft_consensus.cc:1645] Marking committed up to 4
0709 14:51:22.749934 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:22.750024 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:51:22.750174 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4757,"prepare.queue_time_us":972489,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"thread_start_us":1998497,"threads_started":3}
W20260709 14:51:22.762844  7745 connection.cc:256] RPC call timeout handler was delayed by -1.2224340259999735s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1765s for a response
I20260709 14:51:22.704546  9784 raft_consensus.cc:2764] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 14:51:22.750368  7893 leader_election.cc:304] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:22.711735  9854 raft_consensus.cc:2749] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 14:51:22.727574  9820 raft_consensus.cc:493] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 14:51:22.763263  7745 connection.cc:256] RPC call timeout handler was delayed by -1.1911581419999493s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2194s for a response
W20260709 14:51:22.779053  7745 connection.cc:256] RPC call timeout handler was delayed by -1.1576340259999824s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1837s for a response
W20260709 14:51:22.779542  7745 connection.cc:256] RPC call timeout handler was delayed by -1.1441540849999683s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16890000000000002s for a response
W20260709 14:51:22.779934  7745 connection.cc:256] RPC call timeout handler was delayed by -1.046043821000012s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20920000000000002s for a response
I20260709 14:51:22.723372  9859 raft_consensus.cc:493] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:22.760483  7894 leader_election.cc:304] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:22.737146  9550 raft_consensus.cc:697] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:22.710798  9691 consensus_queue.cc:1059] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.046s
W20260709 14:51:22.772212  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 44135.6us
I20260709 14:51:22.731534  9898 raft_consensus.cc:2804] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 14:51:22.785034  7893 leader_election.cc:304] T 9ce9c0ef2db24c13a8b1402f21819458 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 9418391fa82a42c79c6cad13ba91d964
I20260709 14:51:22.787900  9757 raft_consensus.cc:2804] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 14:51:22.772782  9905 consensus_queue.cc:1059] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 14:51:22.790808  9884 raft_consensus.cc:493] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:22.594740  7849 rpcz_store.cc:276] 0709 14:51:21.149878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:21.206442 (+ 56564us) service_pool.cc:224] Handling call
0709 14:51:21.229968 (+ 23526us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:51:21.230181 (+   213us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 14:51:22.439672 (+1209491us) log.cc:844] Serialized 14 byte log entry
0709 14:51:22.588215 (+148543us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:51:22.588287 (+    72us) raft_consensus.cc:1645] Marking committed up to 5
0709 14:51:22.588333 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:22.588423 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:51:22.588583 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":487923,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":29,"raft.queue_time_us":19867,"thread_start_us":1337294,"threads_started":2}
I20260709 14:51:22.791900  9832 raft_consensus.cc:2804] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 14:51:22.792389  9732 raft_consensus.cc:697] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:22.729657  9782 consensus_queue.cc:1048] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 14:51:22.753743  9811 raft_consensus.cc:515] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:22.816155  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:22.818475  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783e4874513449ef9084b833f188a6d3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:22.838550  9884 raft_consensus.cc:515] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:22.846145  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:22.847766  9910 raft_consensus.cc:493] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:22.848546  9884 leader_election.cc:290] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:22.818666  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:22.850126  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:22.850512  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:22.850963  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783e4874513449ef9084b833f188a6d3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:22.851900  9550 consensus_queue.cc:237] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:22.853449  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
W20260709 14:51:22.853808  9896 log.cc:927] Time spent T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 14:51:22.854310  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:22.854949  7774 raft_consensus.cc:3060] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Advancing to term 6
W20260709 14:51:22.855388  9897 log.cc:927] Time spent T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
I20260709 14:51:22.761060  9873 raft_consensus.cc:515] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:22.822799  9742 raft_consensus.cc:3055] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 14:51:22.866390  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:22.867254  7854 raft_consensus.cc:2468] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 6.
W20260709 14:51:22.867938  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:22.830027  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:22.833415  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:22.750078  9825 raft_consensus.cc:515] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:22.742367  9828 raft_consensus.cc:515] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:22.770666  9842 raft_consensus.cc:493] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:51:22.793175  9858 consensus_queue.cc:1059] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.070s
I20260709 14:51:22.838303  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:22.835554  9784 raft_consensus.cc:493] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:22.883493  7846 raft_consensus.cc:2393] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 4: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:51:22.784543  9820 raft_consensus.cc:3060] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:51:22.839321  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:22.783098  9767 raft_consensus.cc:493] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:22.857220  7776 raft_consensus.cc:1240] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 3. Current term is 4. Ops: []
I20260709 14:51:22.891515  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:22.821830  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:22.859565  7771 raft_consensus.cc:2393] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 6: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
W20260709 14:51:22.860379  7745 leader_election.cc:336] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 1.563s (SENT)
I20260709 14:51:22.860675  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:22.893015  7853 raft_consensus.cc:2468] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 4.
I20260709 14:51:22.893533  7850 raft_consensus.cc:2468] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 4.
W20260709 14:51:22.894229  7745 leader_election.cc:336] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 1.720s (SENT)
I20260709 14:51:22.894579  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:22.847759  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:22.895521  7853 raft_consensus.cc:2393] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 5: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:51:22.871420  9911 raft_consensus.cc:493] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:22.897090  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:22.777727  9630 consensus_queue.cc:1059] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.091s
I20260709 14:51:22.864450  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
W20260709 14:51:22.864807  9901 log.cc:927] Time spent T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
W20260709 14:51:22.898749  9892 log.cc:927] Time spent T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.189s	user 0.001s	sys 0.001s
I20260709 14:51:22.865487  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:22.898195  7676 catalog_manager.cc:5697] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 6 to 8, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 8 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:51:22.900282  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:22.770066  9692 raft_consensus.cc:515] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:22.900593  7676 catalog_manager.cc:5697] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 3 to 4, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 4 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:51:22.902072  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:22.902613  9692 leader_election.cc:290] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:22.897861  9811 leader_election.cc:290] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:22.903532  7770 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 2002) took 2528 ms. Trace:
I20260709 14:51:22.902941  7853 raft_consensus.cc:2468] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 3.
I20260709 14:51:22.903996  7770 rpcz_store.cc:276] 0709 14:51:20.375268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:20.467322 (+ 92054us) service_pool.cc:224] Handling call
0709 14:51:20.467755 (+   433us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:51:21.785389 (+1317634us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:51:21.785437 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:51:21.839476 (+ 54039us) log.cc:844] Serialized 26 byte log entry
0709 14:51:22.522024 (+682548us) raft_consensus.cc:1645] Marking committed up to 4
0709 14:51:22.553541 (+ 31517us) log.cc:844] Serialized 14 byte log entry
0709 14:51:22.600133 (+ 46592us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:22.600222 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:51:22.903266 (+303044us) raft_consensus.cc:1685] finished
0709 14:51:22.903288 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:51:22.903452 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46125,"prepare.queue_time_us":28551,"prepare.run_cpu_time_us":97,"prepare.run_wall_time_us":13648,"raft.queue_time_us":335632,"raft.run_cpu_time_us":367,"raft.run_wall_time_us":5861,"thread_start_us":1839663,"threads_started":2,"wal-append.queue_time_us":756717}
I20260709 14:51:22.906572  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:22.907073  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:22.868626  7775 raft_consensus.cc:2468] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 4.
I20260709 14:51:22.857975  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:22.908787  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:22.869196  7772 raft_consensus.cc:2468] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 6.
I20260709 14:51:22.868165  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:22.802196  9898 raft_consensus.cc:493] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:22.894666  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:22.916882  9898 raft_consensus.cc:3060] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:51:22.917266  7850 raft_consensus.cc:2468] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 5.
I20260709 14:51:22.918542  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:22.866510  9742 raft_consensus.cc:740] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:22.919699  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:22.920544  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:22.920228  9742 consensus_queue.cc:260] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:22.920656  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:22.836084  9832 raft_consensus.cc:493] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:22.898661  7773 raft_consensus.cc:2468] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 6.
I20260709 14:51:22.883554  7779 raft_consensus.cc:3060] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:51:22.870730  9757 raft_consensus.cc:697] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:22.921739  9732 consensus_queue.cc:237] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:22.922508  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:22.923517  7846 raft_consensus.cc:2468] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 5.
I20260709 14:51:22.857748  9909 raft_consensus.cc:3055] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 LEADER]: Stepping down as leader of term 7
I20260709 14:51:22.886730  7774 raft_consensus.cc:2468] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 6.
I20260709 14:51:22.892513  7776 raft_consensus.cc:2393] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 5: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:51:22.861954  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:51:22.897760  9894 log.cc:927] Time spent T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.177s	user 0.000s	sys 0.001s
I20260709 14:51:22.909529  7775 raft_consensus.cc:2468] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 4.
I20260709 14:51:22.909132  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:22.869860  7852 raft_consensus.cc:2393] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 5: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:51:22.796458  9859 raft_consensus.cc:515] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:22.911069  7771 raft_consensus.cc:2410] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 14:51:22.907459  7853 raft_consensus.cc:2468] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 3.
I20260709 14:51:22.911701  7847 raft_consensus.cc:2468] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 4.
I20260709 14:51:22.921514  9832 raft_consensus.cc:3060] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 14:51:22.923303  9757 consensus_queue.cc:237] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:22.848449  9910 raft_consensus.cc:515] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:22.925185  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:22.917757  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:22.920269  7850 raft_consensus.cc:2468] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 7.
I20260709 14:51:22.922302  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:22.885535  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:22.866725  9884 raft_consensus.cc:493] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:22.903568  7676 catalog_manager.cc:5697] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 4 to 5, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 5 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:51:22.974694  7772 raft_consensus.cc:1240] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 2. Current term is 3. Ops: []
I20260709 14:51:22.974820  7676 catalog_manager.cc:5697] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 4 to 5, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 5 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:51:22.977814  7849 raft_consensus.cc:2393] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 5: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:51:22.921947  9854 raft_consensus.cc:493] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:22.857520  9706 consensus_queue.cc:1059] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.054s
I20260709 14:51:22.961390  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:22.988893  7847 raft_consensus.cc:2393] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 6: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:51:22.962136  7776 raft_consensus.cc:1275] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 14:51:22.938566  7745 leader_election.cc:336] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 1.999s (SENT)
I20260709 14:51:22.956643  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:22.956965  7845 raft_consensus.cc:2468] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 6.
I20260709 14:51:22.921537  9742 raft_consensus.cc:3060] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:51:22.958925  7778 raft_consensus.cc:1240] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 3. Current term is 4. Ops: []
I20260709 14:51:22.960481  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:22.955646  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:22.954341  9911 raft_consensus.cc:515] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:23.010340  7773 raft_consensus.cc:2468] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 7.
I20260709 14:51:22.859759  9860 raft_consensus.cc:2749] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 14:51:22.965005  7779 raft_consensus.cc:2468] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 5.
I20260709 14:51:23.012365  9911 leader_election.cc:290] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:22.882405  9721 raft_consensus.cc:2749] T 9ce9c0ef2db24c13a8b1402f21819458 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 14:51:22.979202  7819 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:22.976627  7676 catalog_manager.cc:5697] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 4 to 6, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 6 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:51:22.926409  9767 raft_consensus.cc:515] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:22.952651  7851 raft_consensus.cc:2393] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 5: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:51:22.981516  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
W20260709 14:51:22.984048  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 168735us
I20260709 14:51:23.016827  7774 raft_consensus.cc:2468] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 6.
I20260709 14:51:22.887135  9741 raft_consensus.cc:493] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:22.956888  9825 leader_election.cc:290] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:51:22.992050  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 53566.4us
I20260709 14:51:22.958835  9899 raft_consensus.cc:3055] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 LEADER]: Stepping down as leader of term 5
I20260709 14:51:22.892994  9784 raft_consensus.cc:515] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:22.957726  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:23.035755  7852 raft_consensus.cc:2393] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 6: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:51:22.998317  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:22.959790  9630 raft_consensus.cc:3055] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 LEADER]: Stepping down as leader of term 6
I20260709 14:51:23.000273  7854 raft_consensus.cc:2468] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 1.
W20260709 14:51:22.964051  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 177228us
I20260709 14:51:22.953755  9909 raft_consensus.cc:740] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:51:23.014206  7676 catalog_manager.cc:5697] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 3 to 5, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 5 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:51:22.998181  9854 raft_consensus.cc:515] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:22.958747  9859 leader_election.cc:290] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:22.892509  9842 raft_consensus.cc:515] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:23.051287  9630 raft_consensus.cc:740] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
W20260709 14:51:23.054075  7819 connection.cc:256] RPC call timeout handler was delayed by -1.2698187690000395s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1688s for a response
W20260709 14:51:23.054626  7819 connection.cc:256] RPC call timeout handler was delayed by -1.2581187690000206s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17010000000000003s for a response
W20260709 14:51:23.054936  7819 connection.cc:256] RPC call timeout handler was delayed by -1.241018768999993s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17200000000000001s for a response
W20260709 14:51:23.055210  7819 connection.cc:256] RPC call timeout handler was delayed by -1.1321187690000443s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1841s for a response
I20260709 14:51:23.052700  7676 catalog_manager.cc:5697] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 6 to 7, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 7 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:51:23.064858  7819 leader_election.cc:304] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:23.040493  7894 leader_election.cc:304] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:23.044082  9782 consensus_queue.cc:1048] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 14:51:23.031528  9899 raft_consensus.cc:740] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:51:23.031919  9721 consensus_queue.cc:1048] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 14:51:23.032294  9741 raft_consensus.cc:515] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:22.883518  9830 consensus_queue.cc:237] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:23.079107  7819 leader_election.cc:304] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
W20260709 14:51:23.099126  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:23.076995  7777 raft_consensus.cc:2468] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 6.
I20260709 14:51:23.066708  7676 catalog_manager.cc:5697] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 5 to 6, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 6 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:51:22.989316  9884 raft_consensus.cc:515] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:23.052412  9630 consensus_queue.cc:260] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:23.064162  9858 raft_consensus.cc:493] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:23.070920  9912 raft_consensus.cc:493] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:51:23.078110  9812 raft_consensus.cc:2749] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 14:51:23.043761  9902 consensus_queue.cc:1048] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.087s
I20260709 14:51:23.149199  9859 raft_consensus.cc:493] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:51:23.159457  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 119100us
I20260709 14:51:23.159969  7770 raft_consensus.cc:2468] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 6.
I20260709 14:51:23.169487  7676 catalog_manager.cc:5697] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 2 to 4, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 4 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:51:23.174970  9859 raft_consensus.cc:515] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:23.175943  9917 raft_consensus.cc:2804] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 14:51:23.176769  9917 raft_consensus.cc:493] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:23.177156  9917 raft_consensus.cc:3060] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:51:23.138098  9811 raft_consensus.cc:2749] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 14:51:23.223920  9706 raft_consensus.cc:493] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:23.150352  9912 raft_consensus.cc:515] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:23.150146  9858 raft_consensus.cc:515] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:23.253865  9899 consensus_queue.cc:260] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:23.290313  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 109558us
I20260709 14:51:23.296182  7852 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e"
dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
mode: GRACEFUL
new_leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:41662
I20260709 14:51:23.047277  9909 consensus_queue.cc:260] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:23.297210  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 276957us
W20260709 14:51:23.298460  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 219482us
I20260709 14:51:23.302021  7852 raft_consensus.cc:606] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Received request to transfer leadership to TS 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:51:23.171870  7676 catalog_manager.cc:5697] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 5 to 7, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 7 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
W20260709 14:51:23.304613  7742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:23.315565  7852 raft_consensus.cc:614] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 14:51:23.318586  7676 catalog_manager.cc:5697] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 4 to 6, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 6 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:51:23.320798  7819 leader_election.cc:304] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:23.320593  7676 catalog_manager.cc:5697] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 4 to 6, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 6 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:51:23.322341  7676 catalog_manager.cc:5697] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 2 to 4, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 4 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:51:23.324317  7676 catalog_manager.cc:5697] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 3 to 4, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 4 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:51:23.326049  7676 catalog_manager.cc:5697] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 4 to 5, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 5 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:51:23.327699  7676 catalog_manager.cc:5697] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 4 to 6, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 6 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
W20260709 14:51:23.288564  9766 consensus_meta.cc:287] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent flushing consensus metadata: real 0.646s	user 0.014s	sys 0.000s
I20260709 14:51:23.336582  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:23.339986  7847 raft_consensus.cc:2468] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 3.
I20260709 14:51:23.339015  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:23.343101  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:23.288584  9630 raft_consensus.cc:3060] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:51:23.335799  7819 leader_election.cc:304] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:23.346467  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:23.350759  7852 raft_consensus.cc:2393] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 6: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:51:23.351696  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:23.353771  7852 raft_consensus.cc:3060] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:51:23.289583  9767 leader_election.cc:290] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:23.299417  9849 raft_consensus.cc:493] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:23.250564  9706 raft_consensus.cc:515] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:23.302351  9873 leader_election.cc:290] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:23.361694  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:23.338837  9811 raft_consensus.cc:2749] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 14:51:23.386333  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:23.406795  7845 raft_consensus.cc:2468] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 5.
I20260709 14:51:23.407900  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:23.349571  9550 raft_consensus.cc:493] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:51:23.424556  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 75094.3us
I20260709 14:51:23.427812  7849 raft_consensus.cc:1275] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 14:51:23.340891  9911 consensus_queue.cc:1059] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.075s
I20260709 14:51:23.429628  7852 raft_consensus.cc:2468] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 7.
I20260709 14:51:23.379657  9860 raft_consensus.cc:493] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:23.434417  7852 raft_consensus.cc:1275] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 14:51:23.411890  9873 raft_consensus.cc:2749] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 14:51:23.345207  9766 raft_consensus.cc:515] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:23.423384  9767 raft_consensus.cc:493] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:51:23.482254  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 57016.6us
I20260709 14:51:23.383369  9849 raft_consensus.cc:515] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:23.432152  9910 leader_election.cc:290] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:23.446372  9741 leader_election.cc:290] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:51:23.678881  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:23.426707  9550 raft_consensus.cc:515] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:23.449965  9860 raft_consensus.cc:515] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:23.500087  9767 raft_consensus.cc:515] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:23.719148  9920 log.cc:927] Time spent T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.337s	user 0.000s	sys 0.001s
W20260709 14:51:23.724159  9919 log.cc:927] Time spent T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.309s	user 0.001s	sys 0.000s
W20260709 14:51:23.742432  9922 log.cc:927] Time spent T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.291s	user 0.000s	sys 0.001s
I20260709 14:51:23.747414  9706 leader_election.cc:290] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:51:23.749066  9923 log.cc:927] Time spent T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
W20260709 14:51:23.764333  9774 consensus_meta.cc:287] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent flushing consensus metadata: real 1.137s	user 0.016s	sys 0.000s
W20260709 14:51:23.813676  9742 consensus_meta.cc:287] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent flushing consensus metadata: real 0.804s	user 0.009s	sys 0.004s
I20260709 14:51:23.760897  9854 leader_election.cc:290] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:51:23.833385  9924 log.cc:927] Time spent T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.136s	user 0.001s	sys 0.000s
I20260709 14:51:23.846344  9550 leader_election.cc:290] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:51:23.851468  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:23.822814  9774 raft_consensus.cc:2749] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 14:51:23.857542  9917 consensus_meta.cc:287] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent flushing consensus metadata: real 0.680s	user 0.009s	sys 0.003s
W20260709 14:51:23.978044  7676 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.005s	sys 0.012s
W20260709 14:51:23.987210  7676 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.559s	user 0.006s	sys 0.013s
I20260709 14:51:24.022922  9849 leader_election.cc:290] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:51:24.031296  9898 consensus_meta.cc:287] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent flushing consensus metadata: real 1.113s	user 0.008s	sys 0.005s
I20260709 14:51:24.038457  9767 leader_election.cc:290] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:51:24.040905  7819 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.686s	user 0.014s	sys 0.006s
W20260709 14:51:24.041428  7819 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.687s	user 0.014s	sys 0.007s
W20260709 14:51:24.078258  7893 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.004s	sys 0.009s
W20260709 14:51:24.078900  7893 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.543s	user 0.005s	sys 0.009s
W20260709 14:51:23.994796  7742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:23.997531  9917 raft_consensus.cc:515] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:24.166989  9849 raft_consensus.cc:493] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9418391fa82a42c79c6cad13ba91d964)
I20260709 14:51:24.167941  9849 raft_consensus.cc:515] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
W20260709 14:51:24.175568  9832 consensus_meta.cc:287] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent flushing consensus metadata: real 1.194s	user 0.013s	sys 0.000s
I20260709 14:51:24.032184  9898 raft_consensus.cc:515] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:24.179567  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 844381us
I20260709 14:51:24.184294  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:24.196414  7852 raft_consensus.cc:2393] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 6: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:51:24.197638  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:24.198483  9774 raft_consensus.cc:493] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:24.199013  7928 raft_consensus.cc:2410] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 14:51:24.199189  9774 raft_consensus.cc:515] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:24.200371  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:24.200134  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce9c0ef2db24c13a8b1402f21819458" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:24.201197  7926 raft_consensus.cc:1240] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 14:51:24.218890  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:24.220738  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:24.201926  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:24.223366  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:24.227146  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:24.228760  7927 raft_consensus.cc:2410] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 14:51:24.202929  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:24.230080  7924 raft_consensus.cc:2468] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 5.
I20260709 14:51:24.231336  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:24.232316  7924 raft_consensus.cc:3060] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Advancing to term 6
W20260709 14:51:24.215838  7854 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 2723) took 1392 ms (client timeout 1851 ms). Trace:
I20260709 14:51:24.215715  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:24.205060  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:24.233795  7921 raft_consensus.cc:2410] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
W20260709 14:51:24.233963  7854 rpcz_store.cc:269] 0709 14:51:22.823462 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:22.867913 (+ 44451us) service_pool.cc:224] Handling call
0709 14:51:24.215570 (+1347657us) spinlock_profiling.cc:243] Waited 90.1 ms on lock 0x7b54000951d4. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae922fa 00007fb68fe53b17 00007fb6893ce6d4 00007fb6893ce662 00007fb6893ce591 00007fb6893ce50c 00007fb6893cd7c2 00007fb6891c948c 00007fb6891c88c6 00007fb6891c826f
0709 14:51:24.215688 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":207277440}
I20260709 14:51:24.233901  7920 raft_consensus.cc:3060] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:51:24.202240  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:24.238852  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:24.239495  7928 raft_consensus.cc:3060] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:51:24.238375  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:24.242226  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:24.244532  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:24.244702  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:24.242480  7926 raft_consensus.cc:2468] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 6.
I20260709 14:51:24.247081  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:24.247352  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:24.251510  7851 raft_consensus.cc:1240] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 14:51:24.194207  9858 leader_election.cc:290] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:24.209362  9550 raft_consensus.cc:493] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:24.221211  9905 raft_consensus.cc:3055] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 LEADER]: Stepping down as leader of term 3
W20260709 14:51:24.242537  9820 consensus_meta.cc:287] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0: Time spent flushing consensus metadata: real 1.291s	user 0.013s	sys 0.002s
I20260709 14:51:24.207732  9732 raft_consensus.cc:493] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:51:24.207386  9659 raft_consensus.cc:493] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:24.209441  9776 raft_consensus.cc:493] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:51:24.212596  7919 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48672 (request call id 188) took 1379 ms. Trace:
I20260709 14:51:24.209043  9691 raft_consensus.cc:493] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:24.262192  9849 leader_election.cc:290] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68:42321)
I20260709 14:51:24.264097  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:24.259754  7924 raft_consensus.cc:2468] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 6.
I20260709 14:51:24.271176  9898 leader_election.cc:290] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 5 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:24.237994  9832 raft_consensus.cc:515] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:24.275276  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:24.275744  7928 raft_consensus.cc:2468] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 6.
I20260709 14:51:24.276090  8637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9441e831627143a991a1556dcdce71e3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9418391fa82a42c79c6cad13ba91d964" is_pre_election: true
I20260709 14:51:24.252063  9811 raft_consensus.cc:493] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
W20260709 14:51:24.279986  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 50631us
I20260709 14:51:24.286990  7920 raft_consensus.cc:2468] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 4.
I20260709 14:51:24.269963  9917 leader_election.cc:290] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 4 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:24.265681  9905 raft_consensus.cc:740] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:51:24.306893  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:24.301927  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:24.302380  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:24.301230  7923 raft_consensus.cc:2393] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 5: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:51:24.313695  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:24.282469  9860 leader_election.cc:290] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:24.326151  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:24.330307  9766 leader_election.cc:290] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:24.328032  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:24.327245  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:24.328018  9936 raft_consensus.cc:493] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:24.273953  9550 raft_consensus.cc:515] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:24.328763  9913 consensus_queue.cc:1059] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 14:51:24.309862  9811 raft_consensus.cc:515] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:24.282944  9659 raft_consensus.cc:515] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:24.278726  9820 raft_consensus.cc:515] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:24.280761  9732 raft_consensus.cc:515] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:24.295724  9691 raft_consensus.cc:515] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:24.334535  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:24.340571  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
W20260709 14:51:24.331735  9942 log.cc:927] Time spent T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 14:51:24.340667  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:24.313067  9706 raft_consensus.cc:493] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9418391fa82a42c79c6cad13ba91d964)
I20260709 14:51:24.285144  9776 raft_consensus.cc:515] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:24.345861  9905 consensus_queue.cc:260] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:24.343762  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:24.359812  7922 raft_consensus.cc:2393] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 3: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:51:24.346342  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:24.413343  7927 raft_consensus.cc:2376] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 4. Re-sending same reply.
I20260709 14:51:24.347157  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:24.415429  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:24.413393  7924 raft_consensus.cc:2468] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 5.
I20260709 14:51:24.435230  7923 raft_consensus.cc:2393] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 6: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:51:24.415127  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:24.437542  7925 raft_consensus.cc:2393] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 6: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
W20260709 14:51:24.349646  9927 log.cc:927] Time spent T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 14:51:24.349084  9820 leader_election.cc:290] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 3 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:24.350677  9811 leader_election.cc:290] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:24.345391  9913 consensus_queue.cc:1059] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.103s
I20260709 14:51:24.351864  9832 leader_election.cc:290] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:24.344666  9830 raft_consensus.cc:3055] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 LEADER]: Stepping down as leader of term 4
W20260709 14:51:24.355252  9630 consensus_meta.cc:287] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent flushing consensus metadata: real 1.003s	user 0.005s	sys 0.009s
I20260709 14:51:24.353552  9659 leader_election.cc:290] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:24.383777  9706 raft_consensus.cc:515] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:51:24.448810  9732 leader_election.cc:290] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:24.425820  9905 raft_consensus.cc:3060] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:51:24.396389  9828 leader_election.cc:290] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:24.428162  9912 leader_election.cc:290] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:24.343047  9936 raft_consensus.cc:515] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:24.533979  9936 leader_election.cc:290] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:51:24.482048  9947 log.cc:927] Time spent T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.142s	user 0.001s	sys 0.000s
I20260709 14:51:24.480078  9784 leader_election.cc:290] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:24.473935  9830 raft_consensus.cc:740] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
W20260709 14:51:24.478499  9948 log.cc:927] Time spent T 00000000000000000000000000000000 P 133636659113430cb53b321cb0b1d9ee: Append to log took a long time: real 0.052s	user 0.002s	sys 0.000s
I20260709 14:51:24.537124  9830 consensus_queue.cc:260] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:24.538729  9830 raft_consensus.cc:3060] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:51:24.482587  9912 raft_consensus.cc:3055] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 LEADER]: Stepping down as leader of term 3
I20260709 14:51:24.543395  9912 raft_consensus.cc:740] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:51:24.544597  9912 consensus_queue.cc:260] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:24.482234  9776 leader_election.cc:290] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:51:24.638727  7742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:51:24.307421  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:24.679454  7853 pending_rounds.cc:85] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting all ops after (but not including) 3
I20260709 14:51:24.683709  7921 raft_consensus.cc:2393] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 7: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
W20260709 14:51:24.696898  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 385967us
I20260709 14:51:24.683650  7846 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 2123) took 1323 ms. Trace:
I20260709 14:51:24.446748  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:24.709843  7894 leader_election.cc:304] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:24.710922  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:24.712142  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:24.281767  7919 rpcz_store.cc:276] 0709 14:51:22.833215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:22.839983 (+  6768us) service_pool.cc:224] Handling call
0709 14:51:22.883888 (+ 43905us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:51:23.032721 (+148833us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:51:23.034240 (+  1519us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:51:23.064307 (+ 30067us) raft_consensus.cc:1645] Marking committed up to 5
0709 14:51:23.068359 (+  4052us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:24.212161 (+1143802us) spinlock_profiling.cc:243] Waited 131 ms on lock 0x7b540025cbd4. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae8ee01 00007fb68ae8d83e 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2 00007fb6891c948c 00007fb6891c88c6
0709 14:51:24.212243 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:51:24.212489 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":302265088}
I20260709 14:51:24.727101  8637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18d29d52d304c87b930d4fb5eaf50b1" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9418391fa82a42c79c6cad13ba91d964" is_pre_election: true
I20260709 14:51:24.481105  9706 leader_election.cc:290] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68:42321)
I20260709 14:51:24.718324  9784 raft_consensus.cc:493] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:24.721879  9776 raft_consensus.cc:493] T 9ce9c0ef2db24c13a8b1402f21819458 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9418391fa82a42c79c6cad13ba91d964)
I20260709 14:51:24.681059  7853 pending_rounds.cc:107] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 14:51:24.723366  9550 leader_election.cc:290] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:24.724278  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:24.723429  7924 raft_consensus.cc:1275] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 14:51:24.722033  7847 raft_consensus.cc:2468] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 7.
W20260709 14:51:24.748435  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 49409.4us
I20260709 14:51:24.749698  9691 leader_election.cc:290] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:24.701660  7846 rpcz_store.cc:276] 0709 14:51:23.359795 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:24.191032 (+831237us) service_pool.cc:224] Handling call
0709 14:51:24.191418 (+   386us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:51:24.191615 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 14:51:24.192838 (+  1223us) log.cc:844] Serialized 14 byte log entry
0709 14:51:24.682140 (+489302us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:51:24.682316 (+   176us) raft_consensus.cc:1645] Marking committed up to 5
0709 14:51:24.682551 (+   235us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:24.682758 (+   207us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:51:24.683117 (+   359us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":48798,"prepare.queue_time_us":1241,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":46,"raft.queue_time_us":63476,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":5982,"spinlock_wait_cycles":5504,"thread_start_us":439250,"threads_started":3,"wal-append.queue_time_us":79284}
I20260709 14:51:24.728917  7919 raft_consensus.cc:1240] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 LEADER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 14:51:24.733898  7848 raft_consensus.cc:3055] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 LEADER]: Stepping down as leader of term 6
I20260709 14:51:24.756359  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:24.758303  7848 raft_consensus.cc:740] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:51:24.734717  7853 raft_consensus.cc:2889] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:51:24.764835  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:24.769740  9828 raft_consensus.cc:493] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:24.770009  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 9 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:24.770915  9828 raft_consensus.cc:515] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:24.772125  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:24.774112  7854 raft_consensus.cc:2468] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 5.
I20260709 14:51:24.748620  9930 raft_consensus.cc:493] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9418391fa82a42c79c6cad13ba91d964)
I20260709 14:51:24.781898  9766 raft_consensus.cc:493] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:24.783353  9766 raft_consensus.cc:515] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:24.783175  9930 raft_consensus.cc:515] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:51:24.784942  7926 raft_consensus.cc:1240] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 7. Current term is 8. Ops: []
I20260709 14:51:24.787883  9784 raft_consensus.cc:515] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:24.789446  7819 leader_election.cc:304] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:24.792387  9784 leader_election.cc:290] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:24.793215  7921 raft_consensus.cc:1240] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 2. Current term is 4. Ops: []
I20260709 14:51:24.794881  7920 raft_consensus.cc:2468] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 5.
I20260709 14:51:24.797740  9776 raft_consensus.cc:515] T 9ce9c0ef2db24c13a8b1402f21819458 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
W20260709 14:51:24.786809  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 103292us
I20260709 14:51:24.808109  7848 consensus_queue.cc:260] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:24.804970  7851 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 2122) took 1451 ms. Trace:
I20260709 14:51:24.810904  7848 raft_consensus.cc:3060] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:51:24.810828  9776 leader_election.cc:290] T 9ce9c0ef2db24c13a8b1402f21819458 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68:42321)
I20260709 14:51:24.811473  7851 rpcz_store.cc:276] 0709 14:51:23.353141 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:23.496772 (+143631us) service_pool.cc:224] Handling call
0709 14:51:23.541684 (+ 44912us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:51:24.252089 (+710405us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:24.804246 (+552157us) spinlock_profiling.cc:243] Waited 554 ms on lock 0x7b54000d4b54. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae8ee01 00007fb68ae8d83e 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2 00007fb6891c948c 00007fb6891c88c6
0709 14:51:24.804716 (+   470us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1274349312}
I20260709 14:51:24.826367  7846 raft_consensus.cc:2468] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 5.
I20260709 14:51:24.798710  7919 raft_consensus.cc:1275] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 3 index: 3. (term mismatch)
I20260709 14:51:24.811009  9859 leader_election.cc:290] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:24.832508  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
W20260709 14:51:24.829864  7852 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.517s	user 0.014s	sys 0.022s
I20260709 14:51:24.830998  7919 pending_rounds.cc:85] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0: Aborting all ops after (but not including) 2
I20260709 14:51:24.845052  8637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1f7722fdea49e0b5e9c5d96633eaf9" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9418391fa82a42c79c6cad13ba91d964" is_pre_election: true
I20260709 14:51:24.843743  7919 pending_rounds.cc:107] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0: Aborting uncommitted NO_OP operation due to leader change: 4.3
W20260709 14:51:24.851933  9744 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.857s	user 0.052s	sys 0.056s
I20260709 14:51:24.852250  8639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce9c0ef2db24c13a8b1402f21819458" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9418391fa82a42c79c6cad13ba91d964" is_pre_election: true
W20260709 14:51:24.864470  9744 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.946s	user 0.052s	sys 0.056s
I20260709 14:51:24.860131  7925 raft_consensus.cc:1240] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 3. Current term is 4. Ops: []
I20260709 14:51:24.863693  7852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 2127) took 1410 ms. Trace:
I20260709 14:51:24.869997  9828 leader_election.cc:290] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:24.868917  7852 rpcz_store.cc:276] 0709 14:51:23.453309 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:24.287533 (+834224us) service_pool.cc:224] Handling call
0709 14:51:24.287940 (+   407us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:51:24.288165 (+   225us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 14:51:24.300015 (+ 11850us) log.cc:844] Serialized 14 byte log entry
0709 14:51:24.862895 (+562880us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:51:24.863021 (+   126us) raft_consensus.cc:1645] Marking committed up to 5
0709 14:51:24.863199 (+   178us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:24.863342 (+   143us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:51:24.863570 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":11578,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":59,"raft.queue_time_us":2906,"raft.run_cpu_time_us":229,"raft.run_wall_time_us":345,"thread_start_us":542291,"threads_started":1}
I20260709 14:51:24.876286  9842 leader_election.cc:290] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:24.880167  7852 raft_consensus.cc:1240] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 4. Current term is 5. Ops: []
I20260709 14:51:24.839872  9930 leader_election.cc:290] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785), 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68:42321)
I20260709 14:51:24.844940  9954 raft_consensus.cc:2804] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader election won for term 6
I20260709 14:51:24.877664  7854 raft_consensus.cc:3060] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:51:24.864630  7894 leader_election.cc:304] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:24.891886  7894 leader_election.cc:304] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:24.893735  7819 leader_election.cc:304] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:24.893955  9757 raft_consensus.cc:2804] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 14:51:24.894697  9757 raft_consensus.cc:493] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 14:51:24.894804  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 51711.4us
I20260709 14:51:24.895550  9858 raft_consensus.cc:2804] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader election won for term 6
I20260709 14:51:24.896353  9858 raft_consensus.cc:697] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:51:24.895260  9757 raft_consensus.cc:3060] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:51:24.857699  7919 raft_consensus.cc:2889] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 14:51:24.908329  7777 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37136 (request call id 1928) took 2046 ms (client timeout 2202 ms). Trace:
I20260709 14:51:24.872337  9766 leader_election.cc:290] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:24.854283  9909 raft_consensus.cc:3060] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Advancing to term 8
W20260709 14:51:24.909865  7777 rpcz_store.cc:269] 0709 14:51:22.860410 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:22.920293 (+ 59883us) service_pool.cc:224] Handling call
0709 14:51:24.906828 (+1986535us) spinlock_profiling.cc:243] Waited 95.8 ms on lock 0x7b54002558d4. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae922fa 00007fb68fe53b17 00007fb6893ce6d4 00007fb6893ce662 00007fb6893ce591 00007fb6893ce50c 00007fb6893cd7c2 00007fb6891c948c 00007fb6891c88c6 00007fb6891c826f
0709 14:51:24.907127 (+   299us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":220264704}
I20260709 14:51:24.925426  7854 raft_consensus.cc:2468] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 4.
I20260709 14:51:24.904500  9954 raft_consensus.cc:697] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:51:24.931238  9954 consensus_queue.cc:237] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:24.943528  9929 raft_consensus.cc:2804] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 14:51:24.946412  9929 raft_consensus.cc:697] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
W20260709 14:51:24.955116  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:51:24.957106  7770 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37136 (request call id 1934) took 2056 ms (client timeout 1504 ms). Trace:
W20260709 14:51:24.957839  7770 rpcz_store.cc:269] 0709 14:51:22.900286 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:22.906634 (+  6348us) service_pool.cc:224] Handling call
0709 14:51:24.956563 (+2049929us) spinlock_profiling.cc:243] Waited 252 ms on lock 0x7b5400324454. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae922fa 00007fb68fe53b17 00007fb6893ce6d4 00007fb6893ce662 00007fb6893ce591 00007fb6893ce50c 00007fb6893cd7c2 00007fb6891c948c 00007fb6891c88c6 00007fb6891c826f
0709 14:51:24.956818 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":579604352}
I20260709 14:51:24.953235  7849 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 2103) took 1659 ms. Trace:
I20260709 14:51:24.970037  7849 rpcz_store.cc:276] 0709 14:51:23.293443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:23.293672 (+   229us) service_pool.cc:224] Handling call
0709 14:51:23.342071 (+ 48399us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:51:23.428368 (+ 86297us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:24.952721 (+1524353us) spinlock_profiling.cc:243] Waited 85.3 ms on lock 0x7b5400095bd4. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae8ee01 00007fb68ae8d83e 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2 00007fb6891c948c 00007fb6891c88c6
0709 14:51:24.953013 (+   292us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":196198656}
I20260709 14:51:24.976432  9774 leader_election.cc:290] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:51:24.984344  9908 log.cc:927] Time spent T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 2.065s	user 0.019s	sys 0.055s
I20260709 14:51:24.987048  7851 raft_consensus.cc:1275] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 14:51:24.996235  9929 consensus_queue.cc:237] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:24.996907  9912 raft_consensus.cc:3060] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:51:24.972860  7849 raft_consensus.cc:1275] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 14:51:25.052071  9757 raft_consensus.cc:515] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:25.053443  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 2.02983e+06us
W20260709 14:51:25.075026  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 57131.6us
I20260709 14:51:24.954334  9858 consensus_queue.cc:237] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:25.080696  7742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:25.077404  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
W20260709 14:51:25.081573  7744 connection.cc:256] RPC call timeout handler was delayed by -1.6850063080000837s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15400000000000003s for a response
I20260709 14:51:25.083628  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
W20260709 14:51:25.111035  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:25.122262  7845 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 2119) took 1793 ms. Trace:
W20260709 14:51:25.126295  7744 connection.cc:256] RPC call timeout handler was delayed by -1.6679261170000927s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1622s for a response
I20260709 14:51:25.147783  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:25.160386  7924 raft_consensus.cc:1240] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 2. Current term is 3. Ops: []
I20260709 14:51:25.130859  7853 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 2128) took 1471 ms. Trace:
I20260709 14:51:25.159592  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:25.147574  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
W20260709 14:51:25.222888  7744 connection.cc:256] RPC call timeout handler was delayed by -1.5026011660000904s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2243s for a response
I20260709 14:51:25.129101  7921 raft_consensus.cc:1275] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 14:51:25.146556  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
W20260709 14:51:25.228133  7744 connection.cc:256] RPC call timeout handler was delayed by -1.4051063080000858s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18510000000000001s for a response
W20260709 14:51:25.226266  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:51:25.229146  7744 connection.cc:256] RPC call timeout handler was delayed by -1.3088063080000438s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1958s for a response
I20260709 14:51:25.154253  7850 raft_consensus.cc:1275] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 14:51:25.150919  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
W20260709 14:51:25.132295  7847 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49946 (request call id 2110) took 1807 ms (client timeout 2216 ms). Trace:
I20260709 14:51:25.148319  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
W20260709 14:51:25.231392  7744 connection.cc:256] RPC call timeout handler was delayed by -1.1198063080000793s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21680000000000002s for a response
I20260709 14:51:25.150111  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258d6c2dda954bf5b65930fde8ecb9f3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:25.232980  7850 pending_rounds.cc:85] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting all ops after (but not including) 4
W20260709 14:51:25.232838  7744 connection.cc:256] RPC call timeout handler was delayed by -1.0523063080000838s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2243s for a response
I20260709 14:51:25.233567  7850 pending_rounds.cc:107] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting uncommitted NO_OP operation due to leader change: 5.5
I20260709 14:51:25.234186  7922 raft_consensus.cc:2393] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 8: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
W20260709 14:51:25.234541  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:25.167753  9774 raft_consensus.cc:493] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:51:25.232331  7847 rpcz_store.cc:269] 0709 14:51:23.324981 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:23.340630 (+ 15649us) service_pool.cc:224] Handling call
0709 14:51:25.131949 (+1791319us) spinlock_profiling.cc:243] Waited 1.37 s on lock 0x7b54003b4a54. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae922fa 00007fb68fe53b17 00007fb6893ce6d4 00007fb6893ce662 00007fb6893ce591 00007fb6893ce50c 00007fb6893cd7c2 00007fb6891c948c 00007fb6891c88c6 00007fb6891c826f
0709 14:51:25.132154 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3156590336}
W20260709 14:51:25.133759  7745 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 2.194s (SENT) [suppressed 19 similar messages]
W20260709 14:51:25.239169  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 105463us
I20260709 14:51:25.130955  7919 raft_consensus.cc:3060] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:51:25.233911  7850 raft_consensus.cc:2889] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:51:25.133108  9899 raft_consensus.cc:3060] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Advancing to term 6
W20260709 14:51:25.243669  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:25.160257  7894 leader_election.cc:304] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:25.130519  9757 leader_election.cc:290] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:25.145366  9884 leader_election.cc:290] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:25.247303  7850 pending_rounds.cc:107] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting uncommitted NO_OP operation due to leader change: 7.6
I20260709 14:51:25.244374  9766 raft_consensus.cc:493] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:51:25.216317  7853 rpcz_store.cc:276] 0709 14:51:23.659921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:24.288629 (+628708us) service_pool.cc:224] Handling call
0709 14:51:24.289451 (+   822us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:51:24.791031 (+501580us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:51:24.791095 (+    64us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:51:24.791940 (+   845us) log.cc:844] Serialized 26 byte log entry
0709 14:51:24.823575 (+ 31635us) raft_consensus.cc:1645] Marking committed up to 3
0709 14:51:24.823621 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:25.126937 (+303316us) spinlock_profiling.cc:243] Waited 389 ms on lock 0x7b54003b3b54. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae8ee01 00007fb68ae8d83e 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2 00007fb6891c948c 00007fb6891c88c6
0709 14:51:25.126991 (+    54us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:51:25.127054 (+    63us) raft_consensus.cc:1685] finished
0709 14:51:25.127071 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:51:25.130753 (+  3682us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":893668608,"thread_start_us":30910,"threads_started":1,"wal-append.queue_time_us":114015}
I20260709 14:51:25.248520  7850 raft_consensus.cc:2889] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:51:25.208873  7845 rpcz_store.cc:276] 0709 14:51:23.328231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:23.444086 (+115855us) service_pool.cc:224] Handling call
0709 14:51:24.945832 (+1501746us) spinlock_profiling.cc:243] Waited 2.57 ms on lock 0x7b5800026198. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb687c29db1 00007fb687d69b71 00007fb687d69a22 00007fb690c82c09 00007fb68fddcee0 00007fb68fea60ab 00007fb68fea6131 00007fb68fe67fc0 00007fb68fe52929 00007fb68fe523d2 00007fb6893c9bd4
0709 14:51:24.946388 (+   556us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:51:24.958697 (+ 12309us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:51:24.958735 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:51:24.959431 (+   696us) log.cc:844] Serialized 26 byte log entry
0709 14:51:25.121446 (+162015us) raft_consensus.cc:1645] Marking committed up to 3
0709 14:51:25.121510 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:25.121603 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:51:25.121668 (+    65us) raft_consensus.cc:1685] finished
0709 14:51:25.121684 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:51:25.122014 (+   330us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10805,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":159,"spinlock_wait_cycles":5901056,"thread_start_us":161343,"threads_started":1,"wal-append.queue_time_us":154100}
I20260709 14:51:25.247534  9828 raft_consensus.cc:493] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:51:25.255270  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 95303.2us
I20260709 14:51:25.135840  9903 consensus_queue.cc:1048] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.114s
I20260709 14:51:25.273960  9757 raft_consensus.cc:2804] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 14:51:25.275025  9757 raft_consensus.cc:493] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:51:25.275935  9757 raft_consensus.cc:3060] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Advancing to term 6
W20260709 14:51:25.282816  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:25.256596  9774 raft_consensus.cc:515] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:25.285403  9913 raft_consensus.cc:493] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:25.286402  9913 raft_consensus.cc:515] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:25.293427  7846 raft_consensus.cc:1275] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 14:51:25.294430  7846 pending_rounds.cc:85] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting all ops after (but not including) 2
I20260709 14:51:25.300650  7846 pending_rounds.cc:107] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 14:51:25.301165  7846 raft_consensus.cc:2889] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:51:25.287232  9774 leader_election.cc:290] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:25.291371  9828 raft_consensus.cc:515] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:25.270970  9766 raft_consensus.cc:515] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:25.326589  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:25.349865  7924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38516 (request call id 1912) took 1048 ms. Trace:
I20260709 14:51:25.350534  7924 rpcz_store.cc:276] 0709 14:51:24.294464 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:24.784960 (+490496us) service_pool.cc:224] Handling call
0709 14:51:25.159892 (+374932us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:51:25.227573 (+ 67681us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:25.341869 (+114296us) spinlock_profiling.cc:243] Waited 331 ms on lock 0x7b54001e4e50. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae8d8ad 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2 00007fb6891c948c 00007fb6891c88c6 00007fb6891c826f
0709 14:51:25.342801 (+   932us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":761630976}
I20260709 14:51:25.355602  7848 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49948 (request call id 2726) took 2531 ms. Trace:
I20260709 14:51:25.342275  7894 leader_election.cc:304] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:25.356076  7848 rpcz_store.cc:276] 0709 14:51:22.824212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:22.976891 (+152679us) service_pool.cc:224] Handling call
0709 14:51:23.019704 (+ 42813us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:51:25.176919 (+2157215us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 14:51:25.176994 (+    75us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:51:25.177041 (+    47us) raft_consensus.cc:1645] Marking committed up to 4
0709 14:51:25.177098 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:25.355241 (+178143us) spinlock_profiling.cc:243] Waited 1.68 s on lock 0x7b540011fb54. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae8ee01 00007fb68ae8d83e 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2 00007fb6891c948c 00007fb6891c88c6
0709 14:51:25.355291 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:51:25.355494 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9902,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":481,"spinlock_wait_cycles":3864092416}
W20260709 14:51:25.368788  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 50295.4us
I20260709 14:51:25.373756  7675 catalog_manager.cc:5697] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 4 to 5, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 5 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:51:25.378738  9902 consensus_queue.cc:1059] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.058s
I20260709 14:51:25.379917  7675 catalog_manager.cc:5697] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:51:25.381819  7744 leader_election.cc:304] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 9418391fa82a42c79c6cad13ba91d964
I20260709 14:51:25.382583  9774 raft_consensus.cc:493] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:25.383363  9774 raft_consensus.cc:515] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:25.385890  9784 raft_consensus.cc:2749] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 14:51:25.384261  7675 catalog_manager.cc:5697] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:51:25.387041  9774 leader_election.cc:290] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:25.388617  9774 raft_consensus.cc:493] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
W20260709 14:51:25.389889  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:25.390780  9782 raft_consensus.cc:2804] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 14:51:25.391371  9782 raft_consensus.cc:493] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:25.389688  7675 catalog_manager.cc:5697] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 7 to 8, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 8 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
W20260709 14:51:25.390002  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 57876.4us
I20260709 14:51:25.391574  9659 raft_consensus.cc:3055] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 14:51:25.395514  9659 raft_consensus.cc:740] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:25.398381  9659 consensus_queue.cc:260] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:25.400161  9659 raft_consensus.cc:3060] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:51:25.401427  9774 raft_consensus.cc:515] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:25.410748  7850 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49948 (request call id 2729) took 2585 ms. Trace:
I20260709 14:51:25.411463  7850 rpcz_store.cc:276] 0709 14:51:22.825016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:22.988813 (+163797us) service_pool.cc:224] Handling call
0709 14:51:22.989223 (+   410us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:51:25.251388 (+2262165us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:25.372592 (+121204us) spinlock_profiling.cc:243] Waited 2.16 s on lock 0x7b540020dad4. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae8ee01 00007fb68ae8d83e 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2 00007fb6891c948c 00007fb6891c88c6
0709 14:51:25.410643 (+ 38051us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4978016512}
I20260709 14:51:25.408052  7744 leader_election.cc:304] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:51:25.391763  9782 raft_consensus.cc:3060] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:51:25.412992  9913 leader_election.cc:290] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:25.418478  9884 raft_consensus.cc:493] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:25.435179  9858 raft_consensus.cc:493] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:25.482559  9858 raft_consensus.cc:515] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:25.442972  7676 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54364 (request call id 337) took 2631 ms. Trace:
I20260709 14:51:25.487533  9936 raft_consensus.cc:493] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:25.443887  7894 leader_election.cc:304] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
W20260709 14:51:25.445214  9964 log.cc:927] Time spent T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 14:51:25.488703  9936 raft_consensus.cc:515] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:25.491153  9782 raft_consensus.cc:515] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:25.447052  9766 leader_election.cc:290] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:25.447220  9972 raft_consensus.cc:493] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:25.492606  7854 raft_consensus.cc:1275] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 5. (term mismatch)
I20260709 14:51:25.492863  9972 raft_consensus.cc:515] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:25.494323  7854 pending_rounds.cc:85] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting all ops after (but not including) 4
I20260709 14:51:25.450176  9757 raft_consensus.cc:515] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:25.494764  7854 pending_rounds.cc:107] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting uncommitted NO_OP operation due to leader change: 5.5
I20260709 14:51:25.436020  7675 catalog_manager.cc:5697] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 4 to 5, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 5 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:51:25.451830  9774 leader_election.cc:290] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:25.455283  7744 leader_election.cc:304] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
W20260709 14:51:25.467345  9971 log.cc:927] Time spent T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 14:51:25.473908  9828 leader_election.cc:290] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:25.491824  9936 leader_election.cc:290] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:25.445688  9903 consensus_queue.cc:1059] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 14:51:25.452282  9784 raft_consensus.cc:2804] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 14:51:25.495064  7854 raft_consensus.cc:2889] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 14:51:25.493826  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 50181.5us
I20260709 14:51:25.493897  9659 raft_consensus.cc:2804] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 14:51:25.504217  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 49073.1us
I20260709 14:51:25.510159  9858 leader_election.cc:290] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:25.505095  9784 raft_consensus.cc:493] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting leader election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:51:25.486248  7676 rpcz_store.cc:276] 0709 14:51:22.811084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:22.811300 (+   216us) service_pool.cc:224] Handling call
0709 14:51:25.442651 (+2631351us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 14:51:24.190421 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 14:51:24.191120 (+   699us) write_op.cc:432] Acquiring schema lock in shared mode
0709 14:51:24.191163 (+    43us) write_op.cc:435] Acquired schema lock
0709 14:51:24.191184 (+    21us) tablet.cc:662] Decoding operations
0709 14:51:24.247353 (+ 56169us) write_op.cc:620] Acquiring the partition lock for write op
0709 14:51:24.258259 (+ 10906us) write_op.cc:641] Partition lock acquired for write op
0709 14:51:24.261237 (+  2978us) tablet.cc:685] Acquiring locks for 16 operations
0709 14:51:24.264530 (+  3293us) tablet.cc:701] Row locks acquired
0709 14:51:24.264554 (+    24us) write_op.cc:260] PREPARE: finished
0709 14:51:24.269990 (+  5436us) write_op.cc:270] Start()
0709 14:51:24.270149 (+   159us) write_op.cc:276] Timestamp: P: 1783608684269871 usec, L: 0
0709 14:51:24.270172 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 14:51:24.271321 (+  1149us) log.cc:844] Serialized 6314 byte log entry
0709 14:51:24.553952 (+282631us) op_driver.cc:464] REPLICATION: finished
0709 14:51:24.574049 (+ 20097us) write_op.cc:301] APPLY: starting
0709 14:51:24.574144 (+    95us) tablet.cc:1367] starting BulkCheckPresence
0709 14:51:24.574647 (+   503us) tablet.cc:1370] finished BulkCheckPresence
0709 14:51:24.574845 (+   198us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 14:51:24.594196 (+ 19351us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 14:51:24.594571 (+   375us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=16
0709 14:51:24.594625 (+    54us) write_op.cc:312] APPLY: finished
0709 14:51:24.595075 (+   450us) log.cc:844] Serialized 113 byte log entry
0709 14:51:24.596099 (+  1024us) write_op.cc:489] Releasing partition, row and schema locks
0709 14:51:24.596293 (+   194us) write_op.cc:454] Released schema lock
0709 14:51:24.596374 (+    81us) write_op.cc:341] FINISH: Updating metrics
0709 14:51:24.596801 (+   427us) write_op.cc:489] Releasing partition, row and schema locks
0709 14:51:24.596829 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":68,"reported_tablets":23,"child_traces":[["op",{"apply.queue_time_us":19707,"apply.run_cpu_time_us":5729,"apply.run_wall_time_us":22759,"num_ops":16,"prepare.queue_time_us":762038,"prepare.run_cpu_time_us":19785,"prepare.run_wall_time_us":145326,"raft.queue_time_us":15763,"raft.run_cpu_time_us":3476,"raft.run_wall_time_us":20308,"replication_time_us":283517,"thread_start_us":658116,"threads_started":4,"wal-append.queue_time_us":74247}]]}
I20260709 14:51:25.511471  9774 raft_consensus.cc:493] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9418391fa82a42c79c6cad13ba91d964)
I20260709 14:51:25.511650  9929 raft_consensus.cc:3055] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 14:51:25.512291  9774 raft_consensus.cc:515] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:51:25.513011  9929 raft_consensus.cc:740] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:25.515039  9828 raft_consensus.cc:2804] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 14:51:25.514303  9929 consensus_queue.cc:260] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:25.509155  9659 raft_consensus.cc:697] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:25.516944  9659 consensus_queue.cc:237] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:25.517789  9757 leader_election.cc:290] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:25.519567  7744 leader_election.cc:304] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:51:25.508962  9884 raft_consensus.cc:515] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:25.522629  9774 leader_election.cc:290] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68:42321)
I20260709 14:51:25.520742  9766 raft_consensus.cc:2804] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader election won for term 4
I20260709 14:51:25.523617  9766 raft_consensus.cc:697] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:51:25.525069  9766 consensus_queue.cc:237] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:25.511435  9784 raft_consensus.cc:3060] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:51:25.527204  8639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18d29d52d304c87b930d4fb5eaf50b1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9418391fa82a42c79c6cad13ba91d964" is_pre_election: true
I20260709 14:51:25.515597  9828 raft_consensus.cc:493] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:25.529843  9828 raft_consensus.cc:3060] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:51:25.522995  9884 leader_election.cc:290] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:25.538239  9884 raft_consensus.cc:493] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:51:25.535383  7745 connection.cc:256] RPC call timeout handler was delayed by -1.1797258889999966s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15080000000000002s for a response
I20260709 14:51:25.547057  9884 raft_consensus.cc:515] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:25.550859  9903 consensus_queue.cc:1048] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 14:51:25.553001  9774 consensus_queue.cc:1048] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 14:51:25.554561  9929 raft_consensus.cc:3060] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:51:25.558187  7894 leader_election.cc:304] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:25.558555  9902 consensus_queue.cc:1048] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 14:51:25.539455  7745 connection.cc:256] RPC call timeout handler was delayed by -1.1770258889999923s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1511s for a response
W20260709 14:51:25.560695  7745 connection.cc:256] RPC call timeout handler was delayed by -1.1680258889999777s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1521s for a response
W20260709 14:51:25.561108  7745 connection.cc:256] RPC call timeout handler was delayed by -1.1509258890000638s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15400000000000003s for a response
W20260709 14:51:25.561524  7745 connection.cc:256] RPC call timeout handler was delayed by -1.1266258890000245s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1567s for a response
W20260709 14:51:25.561816  7745 connection.cc:256] RPC call timeout handler was delayed by -1.0510258890000159s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16510000000000002s for a response
I20260709 14:51:25.562884  9884 leader_election.cc:290] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:25.565274  7745 leader_election.cc:304] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:25.566555  9884 raft_consensus.cc:2804] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 14:51:25.567189  9884 raft_consensus.cc:493] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:25.567716  9884 raft_consensus.cc:3060] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:51:25.566666  7919 raft_consensus.cc:2468] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 7.
I20260709 14:51:25.560408  9972 leader_election.cc:290] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:25.577967  7745 leader_election.cc:304] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:25.579021  9902 consensus_queue.cc:1048] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 14:51:25.579836  9921 raft_consensus.cc:2764] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 14:51:25.582484  9744 consensus_queue.cc:1048] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 14:51:25.585348  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:25.585587  9972 raft_consensus.cc:2804] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 14:51:25.586208  9972 raft_consensus.cc:493] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:25.586632  9972 raft_consensus.cc:3060] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:51:25.586925  9903 consensus_queue.cc:1048] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 14:51:25.591444  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:25.595002  9972 raft_consensus.cc:515] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:25.614363  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:25.595361  9782 leader_election.cc:290] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:25.628793  7744 leader_election.cc:304] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
W20260709 14:51:25.639711  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:51:25.640286  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:25.644763  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:25.645885  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:25.646168  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:25.647862  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:25.636888  9784 raft_consensus.cc:515] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:25.658015  7744 leader_election.cc:304] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:51:25.665652  9974 raft_consensus.cc:2804] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader election won for term 4
I20260709 14:51:25.666786  9974 raft_consensus.cc:697] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:51:25.668102  9974 consensus_queue.cc:237] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:25.674371  7745 leader_election.cc:304] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:25.676496  9774 raft_consensus.cc:2749] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 14:51:25.655419  9884 raft_consensus.cc:515] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:25.704675  9884 leader_election.cc:290] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:25.706959  9774 consensus_queue.cc:1048] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 14:51:25.681085  9972 leader_election.cc:290] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:25.659026  9766 raft_consensus.cc:2804] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 14:51:25.774716  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:51:25.777333  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 117292us
I20260709 14:51:25.778849  7745 leader_election.cc:304] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:25.780251  9972 raft_consensus.cc:2804] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 14:51:25.780511  7745 leader_election.cc:304] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:25.780840  9972 raft_consensus.cc:493] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:25.781598  9774 raft_consensus.cc:2804] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 14:51:25.781944  9972 raft_consensus.cc:3060] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:51:25.782141  9774 raft_consensus.cc:493] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting leader election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:51:25.782078  9858 raft_consensus.cc:493] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:25.783000  9774 raft_consensus.cc:3060] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:51:25.783200  9858 raft_consensus.cc:515] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:25.785748  9858 leader_election.cc:290] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:25.763512  9828 raft_consensus.cc:515] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:25.796407  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:25.749490  9766 raft_consensus.cc:493] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:25.810267  9828 leader_election.cc:290] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:25.810242  9972 raft_consensus.cc:515] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:25.777299  9784 leader_election.cc:290] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:25.813282  9972 leader_election.cc:290] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:25.816027  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:25.816776  7854 raft_consensus.cc:3060] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:51:25.818569  7744 leader_election.cc:304] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:25.821560  9784 raft_consensus.cc:2804] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader election won for term 7
I20260709 14:51:25.822352  9784 raft_consensus.cc:697] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:51:25.822885  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c563cc7cfbe4d59be4ffc5cf847ce56" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:25.823612  9784 consensus_queue.cc:237] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:25.836339  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:25.824827  7745 leader_election.cc:304] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:25.838217  7854 raft_consensus.cc:2468] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 6.
W20260709 14:51:25.849439  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:51:25.851308  7819 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:25.852928  7777 raft_consensus.cc:1240] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 4. Current term is 5. Ops: []
W20260709 14:51:25.854691  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:25.829475  9766 raft_consensus.cc:3060] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:51:25.887645  7770 raft_consensus.cc:1275] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 14:51:25.866230  9899 raft_consensus.cc:493] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:25.897969  9899 raft_consensus.cc:515] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:25.901827  7894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:25.902505  9782 raft_consensus.cc:493] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:25.903357  9903 raft_consensus.cc:493] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:25.904001  9903 raft_consensus.cc:515] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:25.903334  9782 raft_consensus.cc:515] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:25.886914  9757 raft_consensus.cc:493] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:25.908331  9903 leader_election.cc:290] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:25.909165  9782 leader_election.cc:290] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:25.908735  9757 raft_consensus.cc:515] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:25.912453  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783e4874513449ef9084b833f188a6d3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:25.914543  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:25.915401  7921 raft_consensus.cc:2468] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 5.
I20260709 14:51:25.919603  7777 raft_consensus.cc:1275] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 14:51:25.864853  9858 raft_consensus.cc:493] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:25.867408  9972 raft_consensus.cc:2804] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 14:51:25.927147  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 102504us
I20260709 14:51:25.932075  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:25.894076  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:25.941552  7745 leader_election.cc:304] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:25.943114  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:25.946442  9954 raft_consensus.cc:493] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:25.925184  9757 leader_election.cc:290] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:25.934240  7774 raft_consensus.cc:2468] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 3.
I20260709 14:51:25.947616  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:25.950114  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:25.931815  9972 raft_consensus.cc:493] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:25.943557  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:25.952989  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:25.955358  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:25.959584  7921 raft_consensus.cc:2393] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 6: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:51:25.959753  7924 raft_consensus.cc:2410] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260709 14:51:25.956079  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:25.965641  9974 raft_consensus.cc:2804] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 14:51:25.966217  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c563cc7cfbe4d59be4ffc5cf847ce56" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:25.966653  7777 raft_consensus.cc:2393] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 7: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:51:25.966375  9774 raft_consensus.cc:515] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:25.966989  7925 raft_consensus.cc:2468] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 5.
I20260709 14:51:25.985525  7927 raft_consensus.cc:1240] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 3. Current term is 4. Ops: []
W20260709 14:51:25.987731  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 62657us
I20260709 14:51:25.939953  9858 raft_consensus.cc:515] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:25.991694  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:25.950531  9899 leader_election.cc:290] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:25.961561  9972 raft_consensus.cc:3060] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:51:25.993461  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:25.995609  7819 leader_election.cc:304] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:26.002142  7847 raft_consensus.cc:3060] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:51:25.966346  9974 raft_consensus.cc:493] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:26.017705  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:26.018618  7774 raft_consensus.cc:2468] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 5.
I20260709 14:51:26.016695  9766 raft_consensus.cc:515] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:26.001113  9913 raft_consensus.cc:493] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:26.022419  9766 leader_election.cc:290] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:26.022234  9913 raft_consensus.cc:515] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:26.024773  9913 leader_election.cc:290] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:25.947368  9954 raft_consensus.cc:515] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:26.009871  9936 consensus_queue.cc:1059] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.030s
W20260709 14:51:26.010463  9985 log.cc:927] Time spent T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.148s	user 0.000s	sys 0.002s
I20260709 14:51:26.044514  9899 raft_consensus.cc:2749] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 14:51:26.010964  9974 raft_consensus.cc:3060] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Advancing to term 4
W20260709 14:51:26.045890  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 50585.5us
I20260709 14:51:26.067878  9858 leader_election.cc:290] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:26.070240  9954 leader_election.cc:290] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:26.073820  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:26.074005  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:26.074546  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
W20260709 14:51:26.167603  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:51:26.168104  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:26.172833  7847 raft_consensus.cc:2468] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 6.
I20260709 14:51:26.075165  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:26.179733  7770 raft_consensus.cc:2468] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 4.
W20260709 14:51:26.184340  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 242934us
I20260709 14:51:26.185549  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:26.185650  7745 leader_election.cc:304] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:26.187561  7778 raft_consensus.cc:2393] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 6: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:51:26.190299  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:26.193666  7771 raft_consensus.cc:2468] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 3.
I20260709 14:51:26.203608  9774 leader_election.cc:290] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:26.205742  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:26.206954  7779 raft_consensus.cc:3060] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Advancing to term 7
W20260709 14:51:26.211144  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:26.203464  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1f7722fdea49e0b5e9c5d96633eaf9" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:26.226046  7778 raft_consensus.cc:1240] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 6. Current term is 7. Ops: []
I20260709 14:51:26.229846  7745 leader_election.cc:304] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:26.163578  9974 raft_consensus.cc:515] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:26.243505  7819 leader_election.cc:304] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
W20260709 14:51:26.245616  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:26.239250  9954 raft_consensus.cc:3055] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 LEADER]: Stepping down as leader of term 3
I20260709 14:51:26.255774  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:26.268970  7778 raft_consensus.cc:2393] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 6: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:51:26.274320  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:26.275070  7853 raft_consensus.cc:3060] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:51:26.275655  7845 raft_consensus.cc:1275] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 14:51:26.278141  9858 raft_consensus.cc:2804] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 14:51:26.279625  7778 raft_consensus.cc:1240] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 3. Current term is 4. Ops: []
W20260709 14:51:26.279927  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 50769.4us
I20260709 14:51:26.280887  7745 leader_election.cc:304] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:26.257985  9784 raft_consensus.cc:2749] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 14:51:26.268332  9766 raft_consensus.cc:2804] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 14:51:26.262243  9954 raft_consensus.cc:740] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:51:26.289700  9828 raft_consensus.cc:2804] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 14:51:26.329468  7779 raft_consensus.cc:2468] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 7.
I20260709 14:51:26.287293  9858 raft_consensus.cc:493] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:26.328153  7819 leader_election.cc:304] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:26.342173  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:51:26.342559  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 51594.1us
I20260709 14:51:26.346170  7845 raft_consensus.cc:2410] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 14:51:26.347502  7778 raft_consensus.cc:1240] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 14:51:26.347038  9995 raft_consensus.cc:2764] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 14:51:26.323908  9828 raft_consensus.cc:493] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:26.352386  9828 raft_consensus.cc:3060] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Advancing to term 8
I20260709 14:51:26.347429  9992 raft_consensus.cc:493] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:26.354872  9992 raft_consensus.cc:515] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:26.356993  7894 leader_election.cc:304] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:26.357909  9903 raft_consensus.cc:2804] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 14:51:26.358515  9903 raft_consensus.cc:697] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:26.340654  9858 raft_consensus.cc:3060] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:51:26.369757  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 9 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:26.380458  7819 leader_election.cc:304] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:26.383961  7919 raft_consensus.cc:1240] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 6. Current term is 7. Ops: []
I20260709 14:51:26.385710  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:26.386493  7849 raft_consensus.cc:2468] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 5.
W20260709 14:51:26.390002  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:26.398753  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:26.400108  7854 raft_consensus.cc:2410] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 14:51:26.405485  7853 raft_consensus.cc:2468] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 6.
I20260709 14:51:26.413075  9972 raft_consensus.cc:515] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:26.415984  9972 leader_election.cc:290] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:26.417819  7771 raft_consensus.cc:1275] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 14:51:26.430650  9828 raft_consensus.cc:515] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:26.352440  9954 consensus_queue.cc:260] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:26.433485  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 93055.7us
I20260709 14:51:26.434857  7745 leader_election.cc:304] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:26.436293  7745 leader_election.cc:304] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:26.445670  9974 leader_election.cc:290] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:51:26.534073  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:51:26.480469  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:51:26.501150  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 64948.6us
W20260709 14:51:26.553164  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:26.572844  7745 leader_election.cc:304] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:26.465863  7771 raft_consensus.cc:1275] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 14:51:26.559613  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:26.409723  9994 raft_consensus.cc:2804] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 14:51:26.461509  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 57749us
I20260709 14:51:26.447861  7819 leader_election.cc:304] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:26.434227  9828 leader_election.cc:290] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:26.636767  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:26.645298  7779 raft_consensus.cc:1240] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 4. Current term is 5. Ops: []
W20260709 14:51:26.636132  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 212599us
W20260709 14:51:26.638794  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 66073.6us
I20260709 14:51:26.494189  9774 raft_consensus.cc:2749] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 14:51:26.648309  7771 raft_consensus.cc:2468] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 5.
I20260709 14:51:26.651774  7745 leader_election.cc:304] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:26.505877  9784 raft_consensus.cc:2804] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 14:51:26.495091  9766 raft_consensus.cc:493] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:26.666910  9766 raft_consensus.cc:3060] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:51:26.673986  9995 raft_consensus.cc:493] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:51:26.674811  9995 raft_consensus.cc:515] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:26.646143  7894 leader_election.cc:304] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
W20260709 14:51:26.645113  9996 log.cc:927] Time spent T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.301s	user 0.000s	sys 0.001s
I20260709 14:51:26.577657  9954 raft_consensus.cc:3060] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:51:26.578159  9994 raft_consensus.cc:493] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:26.658089  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:26.646415  9972 raft_consensus.cc:2749] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 14:51:26.681133  7774 raft_consensus.cc:1240] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 5. Current term is 6. Ops: []
I20260709 14:51:26.637912 10004 raft_consensus.cc:2764] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 14:51:26.446717  9903 consensus_queue.cc:237] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:26.686661  7819 leader_election.cc:304] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:26.691449  9757 consensus_queue.cc:1048] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 14:51:26.693575  7745 leader_election.cc:304] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:26.695290  9858 raft_consensus.cc:515] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:26.695066  9884 raft_consensus.cc:2749] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 14:51:26.703456  7779 raft_consensus.cc:1240] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 3. Current term is 4. Ops: []
I20260709 14:51:26.705607  7771 raft_consensus.cc:1275] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 14:51:26.706866  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:26.707356  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:26.708055  7774 raft_consensus.cc:3060] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:51:26.708256  9858 leader_election.cc:290] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 5 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:26.709350  7771 raft_consensus.cc:2393] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 3: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:51:26.687755  9994 raft_consensus.cc:3060] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:51:26.716213  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:26.716938  7776 raft_consensus.cc:2468] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 7.
I20260709 14:51:26.717621  9972 raft_consensus.cc:2749] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 14:51:26.718456 10006 log.cc:927] Time spent T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.072s	user 0.004s	sys 0.000s
I20260709 14:51:26.728088  9992 leader_election.cc:290] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:26.729280  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:26.683301  9995 leader_election.cc:290] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:26.706849  9936 raft_consensus.cc:2749] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 14:51:26.730227  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:26.727097  9741 raft_consensus.cc:2804] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 14:51:26.730973  7771 raft_consensus.cc:3060] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Advancing to term 8
I20260709 14:51:26.731274  9741 raft_consensus.cc:697] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:26.731822  7772 raft_consensus.cc:1275] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 14:51:26.732379  9741 consensus_queue.cc:237] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:26.732975  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce9c0ef2db24c13a8b1402f21819458" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:26.729485  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:26.735882  7779 raft_consensus.cc:2393] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 6: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:51:26.726059  7774 raft_consensus.cc:2468] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 4.
I20260709 14:51:26.729527  7745 leader_election.cc:304] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:26.756389  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
W20260709 14:51:26.733438 10012 log.cc:927] Time spent T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.159s	user 0.000s	sys 0.002s
I20260709 14:51:26.761224  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:26.757586  7772 raft_consensus.cc:2468] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 2.
I20260709 14:51:26.765411  7774 raft_consensus.cc:2376] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 7. Re-sending same reply.
I20260709 14:51:26.762135  7776 raft_consensus.cc:2468] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 5.
I20260709 14:51:26.764449  7819 leader_election.cc:304] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
W20260709 14:51:26.766559  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:26.768334  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:26.772805  7779 raft_consensus.cc:2468] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 5.
I20260709 14:51:26.771874  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:26.775141  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:26.775139  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
W20260709 14:51:26.777755  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 69438.4us
I20260709 14:51:26.778940  7772 raft_consensus.cc:2393] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 6: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:51:26.760519  7773 raft_consensus.cc:2468] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 3.
W20260709 14:51:26.792727  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:26.808399  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
W20260709 14:51:26.811378  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:51:26.889897  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:26.889997  7779 raft_consensus.cc:2410] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 14:51:26.800499  9899 raft_consensus.cc:2749] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 14:51:26.887586  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:26.912659  7772 raft_consensus.cc:2393] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 6: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:51:26.771421  9974 raft_consensus.cc:2804] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 14:51:26.835522  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:26.891780  7894 leader_election.cc:304] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:26.918258  9974 raft_consensus.cc:493] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
W20260709 14:51:27.001775  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 237472us
I20260709 14:51:26.992728  7771 raft_consensus.cc:2468] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 8.
W20260709 14:51:26.951094  7745 leader_election.cc:336] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 1.689s (SENT)
I20260709 14:51:27.085053  7745 leader_election.cc:304] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:26.922967  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
W20260709 14:51:27.064038  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:27.075278  7675 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54344 (request call id 367) took 2439 ms. Trace:
I20260709 14:51:26.969391  7894 leader_election.cc:304] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
W20260709 14:51:26.940336  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:26.923801  9659 raft_consensus.cc:2804] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 14:51:27.088770  9774 raft_consensus.cc:2749] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 14:51:26.992084  9757 raft_consensus.cc:493] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:27.091786  9757 raft_consensus.cc:515] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:27.092201  9899 consensus_queue.cc:1048] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 14:51:27.092967  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 123660us
I20260709 14:51:27.090368  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:27.090853  9954 consensus_queue.cc:1059] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 14:51:27.100721  9954 raft_consensus.cc:3055] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 LEADER]: Stepping down as leader of term 2
I20260709 14:51:27.101145  9954 raft_consensus.cc:740] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
W20260709 14:51:27.090226  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 139178us
W20260709 14:51:27.094764  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:51:27.111349  7745 leader_election.cc:336] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 1.765s (SENT)
I20260709 14:51:27.088049  7675 rpcz_store.cc:276] 0709 14:51:24.636837 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:24.637696 (+   859us) service_pool.cc:224] Handling call
0709 14:51:27.075177 (+2437481us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 14:51:25.665782 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 14:51:25.666800 (+  1018us) write_op.cc:432] Acquiring schema lock in shared mode
0709 14:51:25.666864 (+    64us) write_op.cc:435] Acquired schema lock
0709 14:51:25.666955 (+    91us) tablet.cc:662] Decoding operations
0709 14:51:25.667887 (+   932us) write_op.cc:620] Acquiring the partition lock for write op
0709 14:51:25.667966 (+    79us) write_op.cc:641] Partition lock acquired for write op
0709 14:51:25.667999 (+    33us) tablet.cc:685] Acquiring locks for 5 operations
0709 14:51:25.668754 (+   755us) tablet.cc:701] Row locks acquired
0709 14:51:25.668812 (+    58us) write_op.cc:260] PREPARE: finished
0709 14:51:25.669041 (+   229us) write_op.cc:270] Start()
0709 14:51:25.669217 (+   176us) write_op.cc:276] Timestamp: P: 1783608685668956 usec, L: 0
0709 14:51:25.669899 (+   682us) op_driver.cc:348] REPLICATION: starting
0709 14:51:25.702057 (+ 32158us) log.cc:844] Serialized 2079 byte log entry
0709 14:51:25.946515 (+244458us) op_driver.cc:464] REPLICATION: finished
0709 14:51:26.239143 (+292628us) write_op.cc:301] APPLY: starting
0709 14:51:26.245046 (+  5903us) tablet.cc:1367] starting BulkCheckPresence
0709 14:51:26.248342 (+  3296us) tablet.cc:1370] finished BulkCheckPresence
0709 14:51:26.253774 (+  5432us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 14:51:26.362253 (+108479us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 14:51:26.376729 (+ 14476us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 14:51:26.376791 (+    62us) write_op.cc:312] APPLY: finished
0709 14:51:26.441279 (+ 64488us) log.cc:844] Serialized 47 byte log entry
0709 14:51:26.441513 (+   234us) write_op.cc:489] Releasing partition, row and schema locks
0709 14:51:26.441623 (+   110us) write_op.cc:454] Released schema lock
0709 14:51:26.441683 (+    60us) write_op.cc:341] FINISH: Updating metrics
0709 14:51:26.442181 (+   498us) write_op.cc:489] Releasing partition, row and schema locks
0709 14:51:26.442211 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":214683,"reported_tablets":18,"child_traces":[["op",{"apply.queue_time_us":254234,"apply.run_cpu_time_us":6410,"apply.run_wall_time_us":215237,"num_ops":5,"prepare.queue_time_us":112898,"prepare.run_cpu_time_us":10765,"prepare.run_wall_time_us":74265,"raft.queue_time_us":143410,"raft.run_cpu_time_us":10209,"raft.run_wall_time_us":104847,"replication_time_us":276401,"thread_start_us":273705,"threads_started":4,"wal-append.queue_time_us":75939}]]}
I20260709 14:51:27.093693  9659 raft_consensus.cc:493] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:27.097189  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:27.136629  7776 raft_consensus.cc:2468] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 7.
I20260709 14:51:27.098652  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:27.099788  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:27.146320  7774 raft_consensus.cc:2393] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 7: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:51:27.094480  7819 leader_election.cc:304] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:26.922088  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
W20260709 14:51:27.159837  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 65498.2us
I20260709 14:51:27.160271  7775 raft_consensus.cc:3060] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:51:27.094405  9757 leader_election.cc:290] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:51:27.162026  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:27.165184  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:27.169229  7852 raft_consensus.cc:1275] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 14:51:27.181106  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:27.209367  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:27.213064  7776 raft_consensus.cc:2468] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 5.
I20260709 14:51:27.214290  7770 raft_consensus.cc:1275] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 14:51:27.159525  9659 raft_consensus.cc:3060] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:51:27.096546  9903 raft_consensus.cc:2804] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 14:51:27.216785  7770 raft_consensus.cc:1275] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 14:51:27.219081  7770 raft_consensus.cc:1275] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 14:51:27.222332  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:26.920545  9995 raft_consensus.cc:493] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:27.223230  7777 raft_consensus.cc:2468] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 4.
I20260709 14:51:27.226202  7819 leader_election.cc:304] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:27.168228  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:27.203967  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 9 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
W20260709 14:51:27.247985  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 136636us
W20260709 14:51:27.250876  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 84804.6us
I20260709 14:51:26.922426  9974 raft_consensus.cc:3060] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:51:27.038744  9784 raft_consensus.cc:493] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:27.282372  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:27.213127  7778 raft_consensus.cc:2468] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 5.
I20260709 14:51:27.082983  9921 raft_consensus.cc:493] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:27.204236  9936 raft_consensus.cc:2804] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 14:51:27.282249  9995 raft_consensus.cc:515] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:27.426472  9995 leader_election.cc:290] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:27.316437  9784 raft_consensus.cc:3060] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:51:27.403657  9921 raft_consensus.cc:515] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:27.432298  9921 leader_election.cc:290] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:27.281703  9774 raft_consensus.cc:493] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:27.030189  9766 raft_consensus.cc:515] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:27.508502  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 303886us
I20260709 14:51:27.363287  9899 raft_consensus.cc:2804] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader election won for term 5
I20260709 14:51:27.363559  9936 raft_consensus.cc:493] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:27.034554  9994 raft_consensus.cc:515] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:27.493415  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
W20260709 14:51:27.629550  8599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 213941us
W20260709 14:51:27.632987  7745 leader_election.cc:336] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 1.837s (SENT)
I20260709 14:51:27.521821  9903 raft_consensus.cc:697] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:27.523633  9774 raft_consensus.cc:515] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:27.252854  9954 consensus_queue.cc:260] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:27.707562  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:27.550791  9936 raft_consensus.cc:3060] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Advancing to term 8
I20260709 14:51:27.663792  7847 raft_consensus.cc:1240] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 6. Current term is 7. Ops: []
I20260709 14:51:27.745394  7819 leader_election.cc:304] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
W20260709 14:51:28.038275  7894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:51:28.032981  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 400076us
W20260709 14:51:27.953559 10031 log.cc:927] Time spent T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.426s	user 0.001s	sys 0.000s
W20260709 14:51:27.951005 10026 log.cc:927] Time spent T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.354s	user 0.000s	sys 0.002s
W20260709 14:51:27.952454 10030 log.cc:927] Time spent T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.378s	user 0.001s	sys 0.000s
I20260709 14:51:27.678108  7773 raft_consensus.cc:3060] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:51:27.598006  9899 raft_consensus.cc:697] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:51:27.809139  7674 catalog_manager.cc:5697] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 2 to 5. New cstate: current_term: 5 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:51:28.078110  7674 catalog_manager.cc:5697] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:51:28.118645  7674 catalog_manager.cc:5697] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 5 to 6, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 6 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
W20260709 14:51:28.174795  7775 consensus_meta.cc:287] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent flushing consensus metadata: real 1.008s	user 0.013s	sys 0.004s
I20260709 14:51:28.175571  7775 raft_consensus.cc:2468] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 6.
I20260709 14:51:28.176600  7775 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37144 (request call id 2074) took 1460 ms. Trace:
I20260709 14:51:28.173913  7674 catalog_manager.cc:5697] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 2 to 5, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 5 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:51:28.177121  7775 rpcz_store.cc:276] 0709 14:51:26.716527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:26.918712 (+202185us) service_pool.cc:224] Handling call
0709 14:51:28.176465 (+1257753us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 14:51:28.203786  7674 catalog_manager.cc:5697] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 5 to 7, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 7 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:51:28.214779  7674 catalog_manager.cc:5697] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 1 to 2, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 2 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:51:28.195748  9766 leader_election.cc:290] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:51:28.236740  7892 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.502s	user 0.020s	sys 0.068s
W20260709 14:51:28.240403  7854 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.689s	user 0.009s	sys 0.017s
I20260709 14:51:28.209618 10021 raft_consensus.cc:493] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:51:28.219512  9994 leader_election.cc:290] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 7 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:28.255190  7847 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 2199) took 1044 ms. Trace:
I20260709 14:51:28.243260  7674 catalog_manager.cc:5697] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 6 to 7, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 7 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
W20260709 14:51:28.267813 10032 log.cc:927] Time spent T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.184s	user 0.000s	sys 0.002s
W20260709 14:51:28.272024 10038 log.cc:927] Time spent T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.213s	user 0.000s	sys 0.001s
W20260709 14:51:28.277196  7745 leader_election.cc:336] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 1.967s (SENT)
I20260709 14:51:28.280812 10021 raft_consensus.cc:515] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:28.294595  7853 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.797s	user 0.016s	sys 0.058s
W20260709 14:51:28.281111  7893 connection.cc:256] RPC call timeout handler was delayed by -1.2347518200000422s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1789s for a response
W20260709 14:51:28.330925  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:51:28.331058  7893 connection.cc:256] RPC call timeout handler was delayed by -1.2054328649999206s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2513s for a response
W20260709 14:51:28.331579  7853 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.832s	user 0.029s	sys 0.079s
W20260709 14:51:28.331807  7893 connection.cc:256] RPC call timeout handler was delayed by -1.1483470670000315s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.188s for a response
W20260709 14:51:28.333082  7854 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.805s	user 0.010s	sys 0.018s
I20260709 14:51:28.330047  7745 leader_election.cc:304] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:51:28.332980  7893 leader_election.cc:336] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Timed out: RequestConsensusVote RPC to 127.6.101.65:40587 timed out after 1.613s (SENT)
I20260709 14:51:28.314183  7846 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 2194) took 1192 ms. Trace:
I20260709 14:51:28.334519  7893 leader_election.cc:304] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:28.334074  7854 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 2198) took 1176 ms. Trace:
I20260709 14:51:28.335605  7854 rpcz_store.cc:276] 0709 14:51:27.158062 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:27.158271 (+   209us) service_pool.cc:224] Handling call
0709 14:51:27.158663 (+   392us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:51:27.158930 (+   267us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 14:51:27.527520 (+368590us) log.cc:844] Serialized 14 byte log entry
0709 14:51:28.333617 (+806097us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:51:28.333677 (+    60us) raft_consensus.cc:1645] Marking committed up to 3
0709 14:51:28.333767 (+    90us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:28.333835 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:51:28.334007 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":674698,"prepare.run_cpu_time_us":282,"prepare.run_wall_time_us":282,"thread_start_us":1102519,"threads_started":2}
I20260709 14:51:28.330127  7847 rpcz_store.cc:276] 0709 14:51:27.211318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:27.211705 (+   387us) service_pool.cc:224] Handling call
0709 14:51:27.214845 (+  3140us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:51:28.038956 (+824111us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:28.254828 (+215872us) spinlock_profiling.cc:243] Waited 449 ms on lock 0x7b540020d5d4. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae8ee01 00007fb68ae8d83e 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2 00007fb6891c948c 00007fb6891c88c6
0709 14:51:28.255099 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1031838464}
I20260709 14:51:28.334666  7846 rpcz_store.cc:276] 0709 14:51:27.121703 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:27.164855 (+ 43152us) service_pool.cc:224] Handling call
0709 14:51:27.207281 (+ 42426us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:51:27.207622 (+   341us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 14:51:27.628499 (+420877us) log.cc:844] Serialized 14 byte log entry
0709 14:51:28.161685 (+533186us) spinlock_profiling.cc:243] Waited 61.2 ms on lock 0x7b180040cba0. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb690c69de1 00007fb690c765b1 00007fb687da13f3 00007fb687da37c1 00007fb687da3779 00007fb687da3709 00007fb687da36d1 00007fb687da29cd 0000000000396ad4 0000000000396919 00007fb687d8483a
0709 14:51:28.313453 (+151768us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:51:28.313549 (+    96us) raft_consensus.cc:1645] Marking committed up to 5
0709 14:51:28.313632 (+    83us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:28.313752 (+   120us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:51:28.313987 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12712,"prepare.queue_time_us":747013,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":69,"spinlock_wait_cycles":140777344,"thread_start_us":589045,"threads_started":2}
I20260709 14:51:28.283794  9995 raft_consensus.cc:2804] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 14:51:28.233274  9903 consensus_queue.cc:237] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:28.321759  9659 consensus_meta.cc:287] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent flushing consensus metadata: real 1.106s	user 0.012s	sys 0.005s
W20260709 14:51:28.353744  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 76583.5us
I20260709 14:51:28.367018  7674 catalog_manager.cc:5697] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
W20260709 14:51:28.374634  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:51:28.374794  7893 connection.cc:256] RPC call timeout handler was delayed by -1.0263328649999721s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.27120000000000005s for a response
W20260709 14:51:28.375136  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:51:28.375168  7893 connection.cc:256] RPC call timeout handler was delayed by -1.0254328649999707s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.27130000000000004s for a response
I20260709 14:51:28.345860  9766 raft_consensus.cc:2749] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 14:51:28.239646  9899 consensus_queue.cc:237] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:28.372316  9974 consensus_meta.cc:287] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent flushing consensus metadata: real 0.696s	user 0.009s	sys 0.004s
I20260709 14:51:28.363958  9995 raft_consensus.cc:493] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:28.396433  9995 raft_consensus.cc:3060] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:51:28.370777  9741 raft_consensus.cc:2749] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 14:51:28.408707  7771 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47054 (request call id 122) took 1002 ms. Trace:
I20260709 14:51:28.389281 10035 raft_consensus.cc:493] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:28.370487  9659 raft_consensus.cc:515] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:28.409231  7771 rpcz_store.cc:276] 0709 14:51:27.406820 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:28.385856 (+979036us) service_pool.cc:224] Handling call
0709 14:51:28.396977 (+ 11121us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:51:28.408151 (+ 11174us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:51:28.408187 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:51:28.408370 (+   183us) raft_consensus.cc:1645] Marking committed up to 6
0709 14:51:28.408437 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:28.408506 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:51:28.408641 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 14:51:28.393056  9774 leader_election.cc:290] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:51:28.428036  7893 leader_election.cc:336] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Timed out: RequestConsensusVote RPC to 127.6.101.65:40587 timed out after 1.613s (SENT)
I20260709 14:51:28.428987  7893 leader_election.cc:304] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:28.410701  9994 raft_consensus.cc:493] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:28.441092  7852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 2201) took 1181 ms. Trace:
I20260709 14:51:28.442178  7852 rpcz_store.cc:276] 0709 14:51:27.259308 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:28.439566 (+1180258us) service_pool.cc:224] Handling call
0709 14:51:28.440102 (+   536us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:51:28.440627 (+   525us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:51:28.440661 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:51:28.440719 (+    58us) raft_consensus.cc:1645] Marking committed up to 7
0709 14:51:28.440760 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:28.440832 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:51:28.440996 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 14:51:28.396679  9974 raft_consensus.cc:515] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:28.420254  9766 raft_consensus.cc:493] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:28.458459  7852 raft_consensus.cc:1240] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 4. Current term is 5. Ops: []
W20260709 14:51:28.461412  7893 leader_election.cc:336] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Timed out: RequestConsensusVote RPC to 127.6.101.65:40587 timed out after 1.789s (SENT)
W20260709 14:51:28.462520  7893 leader_election.cc:336] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Timed out: RequestConsensusVote RPC to 127.6.101.65:40587 timed out after 1.854s (SENT)
W20260709 14:51:28.468073  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 892556us
W20260709 14:51:28.471874  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:28.473171  7776 raft_consensus.cc:1240] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 1. Current term is 2. Ops: []
I20260709 14:51:28.445434 10042 raft_consensus.cc:2749] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 14:51:28.483713  7893 leader_election.cc:336] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Timed out: RequestConsensusVote RPC to 127.6.101.65:40587 timed out after 1.880s (SENT)
I20260709 14:51:28.508529  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:28.510316  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:28.511618  7925 raft_consensus.cc:2393] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 5: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:51:28.515887  7770 raft_consensus.cc:1240] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 5. Current term is 6. Ops: []
I20260709 14:51:28.517879  7772 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 2068) took 1803 ms. Trace:
I20260709 14:51:28.518436  7770 raft_consensus.cc:1240] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 6. Current term is 7. Ops: []
I20260709 14:51:28.518451  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783e4874513449ef9084b833f188a6d3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:28.520098  7771 raft_consensus.cc:2410] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 14:51:28.424782 10035 raft_consensus.cc:515] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:28.519137  7772 rpcz_store.cc:276] 0709 14:51:26.714773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:27.234984 (+520211us) service_pool.cc:224] Handling call
0709 14:51:27.719966 (+484982us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:51:27.755259 (+ 35293us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 14:51:28.240775 (+485516us) log.cc:844] Serialized 14 byte log entry
0709 14:51:28.516858 (+276083us) log.cc:844] Serialized 14 byte log entry
0709 14:51:28.517300 (+   442us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:51:28.517383 (+    83us) raft_consensus.cc:1645] Marking committed up to 4
0709 14:51:28.517464 (+    81us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:28.517546 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:51:28.517747 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":585696,"prepare.run_cpu_time_us":141,"prepare.run_wall_time_us":149,"raft.queue_time_us":168,"thread_start_us":545157,"threads_started":2}
I20260709 14:51:28.522151  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:28.525209  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:28.531934  7778 raft_consensus.cc:1240] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 LEADER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 7. Current term is 8. Ops: [5.5-7.6]
I20260709 14:51:28.449049  9994 raft_consensus.cc:515] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:28.534536  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:28.537403  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:28.538465  7770 raft_consensus.cc:2393] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 5: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:51:28.466207  9766 raft_consensus.cc:515] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:28.540221  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:28.566300  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:28.549940  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:28.568229  7770 raft_consensus.cc:2468] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 2.
I20260709 14:51:28.570724  7778 raft_consensus.cc:1240] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 5. Current term is 6. Ops: []
I20260709 14:51:28.576437  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:28.577173  7846 raft_consensus.cc:2468] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 5.
W20260709 14:51:28.599969  7894 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.023s	sys 0.019s
I20260709 14:51:28.567525  7926 raft_consensus.cc:2468] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 5.
I20260709 14:51:28.602383  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
W20260709 14:51:28.605145  7894 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.512s	user 0.023s	sys 0.019s
I20260709 14:51:28.604157  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
W20260709 14:51:28.598966 10040 log.cc:927] Time spent T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.223s	user 0.002s	sys 0.000s
I20260709 14:51:28.574615  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:28.610802  7819 leader_election.cc:304] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:28.566500 10053 raft_consensus.cc:493] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
W20260709 14:51:28.614272  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 64319.5us
I20260709 14:51:28.615006  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:28.597463 10021 leader_election.cc:290] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:28.615777  7772 raft_consensus.cc:2468] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 6.
I20260709 14:51:28.625649  7923 raft_consensus.cc:1275] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 14:51:28.619582  7819 leader_election.cc:304] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:28.625746  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:28.628315  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:28.629390  7770 raft_consensus.cc:2393] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 5: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:51:28.632615  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:28.634286  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:28.635025  7927 raft_consensus.cc:2468] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 7.
W20260709 14:51:28.636479 10052 log.cc:927] Time spent T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
W20260709 14:51:28.625825  9936 consensus_meta.cc:287] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent flushing consensus metadata: real 0.567s	user 0.011s	sys 0.004s
I20260709 14:51:28.637979  9936 raft_consensus.cc:515] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:28.640666  9936 leader_election.cc:290] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 8 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:28.641641 10056 raft_consensus.cc:2804] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader election won for term 6
I20260709 14:51:28.635620  7849 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 2193) took 1517 ms. Trace:
I20260709 14:51:28.644465  7923 raft_consensus.cc:1240] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 LEADER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 14:51:28.645730  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:28.647205  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:28.647858  7922 raft_consensus.cc:3060] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Advancing to term 6
W20260709 14:51:28.648082  9784 consensus_meta.cc:287] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent flushing consensus metadata: real 1.220s	user 0.012s	sys 0.003s
I20260709 14:51:28.648542  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:28.616384 10053 raft_consensus.cc:515] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:28.649926  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:28.651089  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:28.632710  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:28.650879  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:28.652382  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:28.652822  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:28.653357  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:28.654007  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:28.654572  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:28.655135  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:28.655435  7924 raft_consensus.cc:2410] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 14:51:28.651634  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:28.656572  7919 raft_consensus.cc:2468] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 6.
I20260709 14:51:28.658566  7919 raft_consensus.cc:1275] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 14:51:28.652671  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:28.660384  7919 raft_consensus.cc:1275] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 14:51:28.650856  7893 leader_election.cc:336] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Timed out: RequestConsensusVote RPC to 127.6.101.65:40587 timed out after 1.958s (SENT)
I20260709 14:51:28.661156  7921 raft_consensus.cc:1275] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 14:51:28.661634  7893 leader_election.cc:304] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:28.650971 10053 leader_election.cc:290] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:28.648569  9784 raft_consensus.cc:515] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:28.664606  7893 leader_election.cc:336] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Timed out: RequestConsensusVote RPC to 127.6.101.65:40587 timed out after 2.161s (SENT)
I20260709 14:51:28.665143  7893 leader_election.cc:304] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:28.666218  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:28.666270 10021 raft_consensus.cc:2749] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 14:51:28.666939  7893 leader_election.cc:336] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Timed out: RequestConsensusVote RPC to 127.6.101.65:40587 timed out after 2.216s (SENT)
I20260709 14:51:28.672299  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:28.672567  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:28.673211  7848 raft_consensus.cc:2468] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 5.
I20260709 14:51:28.674602  7848 raft_consensus.cc:1275] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 14:51:28.673091  7893 leader_election.cc:336] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Timed out: RequestConsensusVote RPC to 127.6.101.65:40587 timed out after 2.256s (SENT)
I20260709 14:51:28.675801  7893 leader_election.cc:304] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:28.676592  7845 raft_consensus.cc:1275] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 14:51:28.676968  7926 raft_consensus.cc:3060] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:51:28.653018  7920 raft_consensus.cc:3060] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:51:28.665503 10054 raft_consensus.cc:2749] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 14:51:28.686223  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:28.698282  9974 leader_election.cc:290] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 2 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:28.656922  9994 leader_election.cc:290] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:28.699402  7770 raft_consensus.cc:1240] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 14:51:28.665091  9784 leader_election.cc:290] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:51:28.705065  7893 leader_election.cc:336] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Timed out: RequestConsensusVote RPC to 127.6.101.65:40587 timed out after 2.149s (SENT)
I20260709 14:51:28.704222  9954 raft_consensus.cc:3060] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:51:28.708811  7770 raft_consensus.cc:1240] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 LEADER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 3. Current term is 4. Ops: []
I20260709 14:51:28.691931 10049 raft_consensus.cc:2804] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 14:51:28.698304 10054 raft_consensus.cc:2749] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 14:51:28.707916  7773 consensus_meta.cc:287] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent flushing consensus metadata: real 0.581s	user 0.005s	sys 0.010s
I20260709 14:51:28.642325  7849 rpcz_store.cc:276] 0709 14:51:27.117751 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:27.117882 (+   131us) service_pool.cc:224] Handling call
0709 14:51:27.219864 (+101982us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:51:27.220101 (+   237us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 14:51:27.842120 (+622019us) log.cc:844] Serialized 14 byte log entry
0709 14:51:28.633659 (+791539us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:51:28.633879 (+   220us) raft_consensus.cc:1645] Marking committed up to 5
0709 14:51:28.634222 (+   343us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:28.634592 (+   370us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:51:28.635262 (+   670us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":96551,"prepare.queue_time_us":941881,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":34,"raft.queue_time_us":54613,"raft.run_cpu_time_us":189,"raft.run_wall_time_us":8085,"thread_start_us":1177847,"threads_started":3,"wal-append.queue_time_us":679785}
I20260709 14:51:28.720798  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:28.729106  7770 raft_consensus.cc:2410] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
W20260709 14:51:28.739672  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:51:28.740258  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:51:28.740617  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:51:28.740903  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:51:28.741358  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:28.743176  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c563cc7cfbe4d59be4ffc5cf847ce56" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:28.744377  7776 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 2073) took 2028 ms. Trace:
I20260709 14:51:28.744861  7776 rpcz_store.cc:276] 0709 14:51:26.716259 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:27.213982 (+497723us) service_pool.cc:224] Handling call
0709 14:51:27.214313 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:51:28.474454 (+1260141us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:28.744058 (+269604us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b540014f0d4. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae8ee01 00007fb68ae8d83e 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2 00007fb6891c948c 00007fb6891c88c6
0709 14:51:28.744297 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2890544512}
I20260709 14:51:28.720937 10049 raft_consensus.cc:493] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:28.711550 10033 consensus_queue.cc:1048] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 14:51:28.725806  7773 raft_consensus.cc:2468] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 6.
I20260709 14:51:28.757176  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18d29d52d304c87b930d4fb5eaf50b1" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
W20260709 14:51:28.758683  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 139240us
I20260709 14:51:28.748256  9994 raft_consensus.cc:493] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:28.765144  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:28.765769  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:28.766675  7770 raft_consensus.cc:2393] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 4: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:51:28.749437 10053 raft_consensus.cc:493] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:28.758386 10049 raft_consensus.cc:3060] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:51:28.768803  7894 leader_election.cc:304] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:28.751395  9776 consensus_queue.cc:1059] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.018s
I20260709 14:51:28.769466  9994 raft_consensus.cc:515] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:28.779870  9994 leader_election.cc:290] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:28.754937  9757 consensus_queue.cc:1048] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 14:51:28.781359 10046 consensus_queue.cc:1048] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.024s
W20260709 14:51:28.783783 10047 log.cc:927] Time spent T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.183s	user 0.004s	sys 0.000s
I20260709 14:51:28.783595 10048 consensus_queue.cc:1059] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 14:51:28.785543 10035 leader_election.cc:290] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:28.789574  9766 leader_election.cc:290] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:28.789829  7853 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 2192) took 1680 ms. Trace:
I20260709 14:51:28.790378  7853 rpcz_store.cc:276] 0709 14:51:27.109882 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:27.110001 (+   119us) service_pool.cc:224] Handling call
0709 14:51:27.110366 (+   365us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:51:27.164466 (+ 54100us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:51:27.164507 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:51:27.252684 (+ 88177us) log.cc:844] Serialized 26 byte log entry
0709 14:51:28.332740 (+1080056us) raft_consensus.cc:1645] Marking committed up to 4
0709 14:51:28.332790 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:28.332880 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:51:28.782885 (+450005us) spinlock_profiling.cc:243] Waited 2.27 ms on lock 0x7b4400022b4c. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb687c29db1 00007fb687cc7c85 00007fb687cc86a2 00007fb68aa3a1db 00007fb68aa35aaf 00007fb68aa2986e 00007fb68aa28bb6 00007fb68aa287d8 00007fb68aa32221 00007fb68aa321d9 00007fb68aa32169
0709 14:51:28.789483 (+  6598us) raft_consensus.cc:1685] finished
0709 14:51:28.789507 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:51:28.789756 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1249,"raft.queue_time_us":48607,"raft.run_cpu_time_us":190,"raft.run_wall_time_us":45705,"spinlock_wait_cycles":5217024,"thread_start_us":834576,"threads_started":1,"wal-append.queue_time_us":1099593}
I20260709 14:51:28.791785  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:28.798671  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:28.780896  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:28.804344  7922 raft_consensus.cc:2468] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 6.
I20260709 14:51:28.776929  9659 leader_election.cc:290] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:28.806468 10056 raft_consensus.cc:697] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:51:28.806787  7770 raft_consensus.cc:1240] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 LEADER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 6. Current term is 7. Ops: []
I20260709 14:51:28.808341  9776 raft_consensus.cc:3055] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 14:51:28.810197  7926 raft_consensus.cc:2468] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 7.
I20260709 14:51:28.811898  7920 raft_consensus.cc:2410] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 14:51:28.764559  7773 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37144 (request call id 2081) took 2043 ms (client timeout 2283 ms). Trace:
I20260709 14:51:28.813426  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:28.812028 10054 raft_consensus.cc:2804] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 14:51:28.814332  9776 raft_consensus.cc:740] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:28.832162  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:28.831949  9776 consensus_queue.cc:260] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:28.816123 10054 raft_consensus.cc:493] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:28.836488  9776 raft_consensus.cc:3060] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:51:28.836839 10054 raft_consensus.cc:3060] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:51:28.821110  9903 consensus_queue.cc:1048] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 14:51:28.821276  9757 consensus_queue.cc:1048] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
I20260709 14:51:28.841565  9766 raft_consensus.cc:493] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:28.842257  9766 raft_consensus.cc:515] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:28.834250  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:28.884976  9766 leader_election.cc:290] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:28.794224 10053 raft_consensus.cc:515] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:28.814697 10055 log.cc:927] Time spent T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.127s	user 0.000s	sys 0.002s
I20260709 14:51:28.820773 10021 consensus_queue.cc:1059] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.068s
W20260709 14:51:28.814502 10051 log.cc:927] Time spent T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.207s	user 0.001s	sys 0.001s
I20260709 14:51:28.820966 10042 consensus_queue.cc:1059] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.069s
W20260709 14:51:28.823192 10060 log.cc:927] Time spent T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.127s	user 0.003s	sys 0.000s
I20260709 14:51:28.901772  7770 raft_consensus.cc:2468] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 5.
W20260709 14:51:28.905637  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:28.909759  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
W20260709 14:51:28.910609  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 85947.3us
I20260709 14:51:28.911195  7778 raft_consensus.cc:1275] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 14:51:28.816469 10048 raft_consensus.cc:3055] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 14:51:28.912778  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:28.915198  7776 raft_consensus.cc:2393] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 6: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:51:28.910650  7775 raft_consensus.cc:2376] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 4. Re-sending same reply.
I20260709 14:51:28.916332  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:28.916927  7779 raft_consensus.cc:3055] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 LEADER]: Stepping down as leader of term 5
I20260709 14:51:28.917416  7779 raft_consensus.cc:740] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:51:28.916186  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
W20260709 14:51:28.919193  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:28.919492  7771 raft_consensus.cc:2468] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 5.
I20260709 14:51:28.921197  7851 raft_consensus.cc:2368] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 5. Current term is 6.
W20260709 14:51:28.921618  7745 leader_election.cc:336] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 2.092s (SENT)
I20260709 14:51:28.923101  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce9c0ef2db24c13a8b1402f21819458" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
W20260709 14:51:28.814726  7773 rpcz_store.cc:269] 0709 14:51:26.719675 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:26.861437 (+141762us) service_pool.cc:224] Handling call
0709 14:51:27.406895 (+545458us) spinlock_profiling.cc:243] Waited 78.5 ms on lock 0x7b5800002a98. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb687c29db1 00007fb687d69b71 00007fb687d69a22 00007fb690c82c09 00007fb68fddcee0 00007fb68fea60ab 00007fb68fea6131 00007fb68fe540a0 00007fb68fe53984 00007fb6893ce6d4 00007fb6893ce662
0709 14:51:28.762904 (+1356009us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":180534016}
I20260709 14:51:28.928750  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:28.932626  7846 raft_consensus.cc:2410] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 14:51:28.822726 10046 consensus_queue.cc:1059] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.096s
W20260709 14:51:28.933357  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 113156us
I20260709 14:51:28.935573  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:51:28.924806  9995 consensus_meta.cc:287] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent flushing consensus metadata: real 0.508s	user 0.012s	sys 0.001s
I20260709 14:51:28.914637 10048 raft_consensus.cc:740] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:28.940110  7779 consensus_queue.cc:260] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:28.958472  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
W20260709 14:51:28.958575  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 47112.2us
I20260709 14:51:28.960861  7846 raft_consensus.cc:2393] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 5: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:51:28.959440  9995 raft_consensus.cc:515] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:28.961900 10067 log.cc:927] Time spent T 00000000000000000000000000000000 P 133636659113430cb53b321cb0b1d9ee: Append to log took a long time: real 0.092s	user 0.002s	sys 0.000s
I20260709 14:51:28.964010  7847 raft_consensus.cc:1240] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 6. Current term is 7. Ops: []
I20260709 14:51:28.816987 10056 consensus_queue.cc:237] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:28.966957  7779 raft_consensus.cc:3060] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Advancing to term 6
W20260709 14:51:28.971158 10062 log.cc:927] Time spent T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.268s	user 0.001s	sys 0.002s
I20260709 14:51:28.971751 10053 leader_election.cc:290] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:51:28.972808  7745 leader_election.cc:336] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 2.194s (SENT)
I20260709 14:51:28.967140  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:28.973804  7745 leader_election.cc:304] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:28.974135  7846 raft_consensus.cc:2468] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 4.
I20260709 14:51:28.985582  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:28.991945 10048 consensus_queue.cc:260] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:28.992848  7894 leader_election.cc:304] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:28.995563  9741 raft_consensus.cc:2804] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 14:51:28.996075  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:28.997043  7853 raft_consensus.cc:2410] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 14:51:28.998044  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:28.998704  7849 raft_consensus.cc:2468] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 6.
I20260709 14:51:28.997884  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:28.999840  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:28.996155 10042 consensus_queue.cc:1048] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.005s
I20260709 14:51:28.999650  9659 raft_consensus.cc:3055] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 14:51:29.001767  9659 raft_consensus.cc:740] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:29.000679  7851 raft_consensus.cc:2410] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 14:51:29.002858  9659 consensus_queue.cc:260] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:28.995565  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258d6c2dda954bf5b65930fde8ecb9f3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:28.963728  9995 leader_election.cc:290] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 7 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:28.976409  9766 raft_consensus.cc:2749] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 14:51:29.017856  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 51184.5us
I20260709 14:51:29.018500  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:29.020242  7853 raft_consensus.cc:2468] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 5.
I20260709 14:51:29.017926  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:29.023293  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9441e831627143a991a1556dcdce71e3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:29.027240  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c563cc7cfbe4d59be4ffc5cf847ce56" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:29.028774  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:29.038655  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:29.039403  7854 raft_consensus.cc:2410] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 14:51:29.046473  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:28.996151  9741 raft_consensus.cc:493] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:29.027063 10035 consensus_queue.cc:1059] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 14:51:29.053989  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:29.055276  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:29.056463  7845 raft_consensus.cc:1275] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 14:51:29.057871  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:29.059155  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:29.060096  7845 raft_consensus.cc:2393] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 7: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:51:29.061447  7850 raft_consensus.cc:2393] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 6: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:51:29.061810  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:29.062794  7845 raft_consensus.cc:3060] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:51:29.063483  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:29.062754  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18d29d52d304c87b930d4fb5eaf50b1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:29.066717  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:29.067965  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783e4874513449ef9084b833f188a6d3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:29.052078  9741 raft_consensus.cc:3060] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:51:29.068789  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:29.070283  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:29.071630  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:29.075923  7853 raft_consensus.cc:2393] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 7: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
W20260709 14:51:29.076154  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:29.076718  7852 raft_consensus.cc:2368] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 5. Current term is 6.
I20260709 14:51:29.077039  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:29.018911 10073 consensus_queue.cc:1048] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.048s
I20260709 14:51:29.081857  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:29.082057  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:29.082473  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:29.099745  7851 raft_consensus.cc:2393] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 8: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:51:29.090591  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:29.088590 10054 raft_consensus.cc:515] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:29.080950 10046 consensus_queue.cc:1048] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 14:51:29.109493  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:29.111079  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:29.116268 10048 raft_consensus.cc:3060] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:51:29.075129 10049 raft_consensus.cc:515] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:29.117749  7848 raft_consensus.cc:2393] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 7: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:51:29.119252 10049 leader_election.cc:290] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 7 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:29.121908  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:29.118952 10033 raft_consensus.cc:3055] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 14:51:29.123457 10033 raft_consensus.cc:740] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:29.124529 10033 consensus_queue.cc:260] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:29.126221  9936 raft_consensus.cc:493] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:29.122901  7854 raft_consensus.cc:3060] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:51:29.126418 10033 raft_consensus.cc:3060] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:51:29.137106  9784 raft_consensus.cc:493] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:29.137781 10072 raft_consensus.cc:3055] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 14:51:29.152313 10072 raft_consensus.cc:740] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:29.152313  9784 raft_consensus.cc:515] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:29.154001 10072 consensus_queue.cc:260] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:29.155599 10072 raft_consensus.cc:3060] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:51:29.155936  7848 pending_rounds.cc:85] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting all ops after (but not including) 3
I20260709 14:51:29.156507  7848 pending_rounds.cc:107] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 14:51:29.156783  7848 raft_consensus.cc:2889] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:51:29.138504  9659 raft_consensus.cc:3060] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:51:29.127007  9936 raft_consensus.cc:515] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:29.147312  7845 raft_consensus.cc:2468] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 4.
I20260709 14:51:29.151538  7852 raft_consensus.cc:1240] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 14:51:29.161559  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:29.162612  7845 raft_consensus.cc:2410] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 14:51:29.163757  7853 raft_consensus.cc:1275] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 14:51:29.163712  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9441e831627143a991a1556dcdce71e3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:29.169798  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:29.169999  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:29.171767  7845 raft_consensus.cc:2393] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 5: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:51:29.174065  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:29.176463  9936 leader_election.cc:290] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:29.179147  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:29.181219  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:29.182751  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:29.183964  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:29.184904  7853 raft_consensus.cc:2393] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 5: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:51:29.178781  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:29.186460  7845 raft_consensus.cc:2468] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 5.
I20260709 14:51:29.187161  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:29.187565  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:29.188606  7846 raft_consensus.cc:2468] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 8.
I20260709 14:51:29.189349  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:29.163364  9784 leader_election.cc:290] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:29.192500  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:29.193513  7849 raft_consensus.cc:2393] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 7: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:51:29.170359 10054 leader_election.cc:290] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:29.199329  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:29.201079  7853 raft_consensus.cc:2393] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 7: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:51:29.168852  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:29.201749  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:29.203171  7852 raft_consensus.cc:2410] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 14:51:29.203354  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:29.204423  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:29.204873  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:29.205665  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:29.206393  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18d29d52d304c87b930d4fb5eaf50b1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:29.200251  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:29.207996  7845 raft_consensus.cc:2376] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 4. Re-sending same reply.
I20260709 14:51:29.206734  7846 raft_consensus.cc:2410] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 14:51:29.209822  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:29.210873  7850 raft_consensus.cc:2468] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 6.
I20260709 14:51:29.210027  7854 raft_consensus.cc:2468] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 5.
W20260709 14:51:29.219095  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:51:29.219790  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:51:29.220302  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:51:29.221010  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:51:29.227669  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 178958us
I20260709 14:51:29.231050  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258d6c2dda954bf5b65930fde8ecb9f3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:29.233948  7852 raft_consensus.cc:2393] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 6: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:51:29.196523  9741 raft_consensus.cc:515] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:29.271571  7744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:51:29.272251  7744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:51:29.273444  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 202340us
W20260709 14:51:29.325063  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:29.336436  9659 consensus_queue.cc:1059] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 14:51:29.341063  9659 raft_consensus.cc:3055] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 14:51:29.353716  9659 raft_consensus.cc:740] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:29.371434  9659 consensus_queue.cc:260] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:29.379362 10080 consensus_queue.cc:1048] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 14:51:29.382063  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
W20260709 14:51:29.388054  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:51:29.388777  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:29.391353  7845 raft_consensus.cc:1240] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 6. Current term is 7. Ops: []
I20260709 14:51:29.393779  7845 raft_consensus.cc:1240] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 7. Current term is 8. Ops: []
I20260709 14:51:29.386281  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:29.395948  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:29.396821  7845 raft_consensus.cc:3060] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:51:29.397568  7847 raft_consensus.cc:2393] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 7: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:51:29.395849  7850 raft_consensus.cc:2468] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 7.
W20260709 14:51:29.436959  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:29.458350  9903 consensus_queue.cc:1059] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 14:51:29.459405  9903 raft_consensus.cc:3055] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 14:51:29.459810  9903 raft_consensus.cc:740] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:29.462533  9659 raft_consensus.cc:3060] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:51:29.465234  7851 raft_consensus.cc:1240] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 3. Current term is 4. Ops: []
I20260709 14:51:29.470633  7851 raft_consensus.cc:1240] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 4. Current term is 5. Ops: []
I20260709 14:51:29.469440  7845 raft_consensus.cc:2468] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 6.
I20260709 14:51:29.461118  9903 consensus_queue.cc:260] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:29.475522  7894 leader_election.cc:304] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:29.478938  7847 raft_consensus.cc:1275] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 14:51:29.475004  9903 raft_consensus.cc:3060] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:51:29.481796  9784 raft_consensus.cc:493] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:29.494957  9784 raft_consensus.cc:515] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:29.498207  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:29.483999  7893 leader_election.cc:304] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:29.484086 10073 consensus_queue.cc:1059] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 14:51:29.501204  9929 consensus_queue.cc:1048] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 14:51:29.502511 10073 raft_consensus.cc:3055] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 14:51:29.503016 10073 raft_consensus.cc:740] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:29.500856 10048 raft_consensus.cc:2804] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 14:51:29.500859  7893 leader_election.cc:304] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:51:29.505889  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:29.468745  9741 leader_election.cc:290] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:29.517671  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:29.520605  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:29.509369 10048 raft_consensus.cc:493] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:29.475560 10042 consensus_queue.cc:1059] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 14:51:29.508842 10080 raft_consensus.cc:2804] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 14:51:29.534413  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:29.536657  7847 raft_consensus.cc:3060] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:51:29.535393 10080 raft_consensus.cc:493] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:29.538535 10080 raft_consensus.cc:3060] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 14:51:29.527927 10046 raft_consensus.cc:2804] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 14:51:29.539480 10046 raft_consensus.cc:493] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:29.540030 10046 raft_consensus.cc:3060] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:51:29.526501 10048 raft_consensus.cc:3060] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:51:29.501223 10033 consensus_queue.cc:1048] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.041s
I20260709 14:51:29.533191 10042 raft_consensus.cc:3055] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 14:51:29.572067  9766 raft_consensus.cc:493] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:29.596161  7847 raft_consensus.cc:2468] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 6.
I20260709 14:51:29.596681  7894 leader_election.cc:304] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
W20260709 14:51:29.598179  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 97411.8us
I20260709 14:51:29.599129  7893 leader_election.cc:304] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:29.549086  9784 leader_election.cc:290] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:29.605085  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:29.597563  9766 raft_consensus.cc:515] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:29.533353 10073 consensus_queue.cc:260] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:29.624397 10011 raft_consensus.cc:2749] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 14:51:29.594144 10042 raft_consensus.cc:740] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
W20260709 14:51:29.643045  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:51:29.652093  7744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:51:29.628551  7745 leader_election.cc:336] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 1.584s (SENT)
W20260709 14:51:29.663594  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 62421.3us
I20260709 14:51:29.665784  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:29.602865 10033 raft_consensus.cc:2804] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 14:51:29.676725  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:29.679524  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:29.674297  9757 consensus_queue.cc:1048] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.008s
I20260709 14:51:29.681933  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:29.687357  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:29.688359  7854 raft_consensus.cc:2376] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 5. Re-sending same reply.
I20260709 14:51:29.689234  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:29.697654 10073 raft_consensus.cc:3060] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 14:51:29.703940  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:29.706751  7850 raft_consensus.cc:1275] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 14:51:29.707305  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:29.708148  9766 leader_election.cc:290] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:29.711566  7848 raft_consensus.cc:1275] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 14:51:29.714570  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:29.717221  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:29.718678  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:29.718195  7854 raft_consensus.cc:2393] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 8: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
W20260709 14:51:29.720062  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:51:29.720551  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:29.719349  7851 raft_consensus.cc:2468] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 5.
I20260709 14:51:29.726537 10057 consensus_queue.cc:1048] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 14:51:29.730424  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:29.732208  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:29.695393 10033 raft_consensus.cc:697] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
W20260709 14:51:29.735095  7745 leader_election.cc:336] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 1.691s (SENT)
I20260709 14:51:29.738202 10072 consensus_queue.cc:1048] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 14:51:29.738626 10035 consensus_queue.cc:1059] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 14:51:29.708952 10042 consensus_queue.cc:260] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:29.740866 10042 raft_consensus.cc:3060] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:51:29.746060  7894 leader_election.cc:304] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:29.753216 10033 consensus_queue.cc:237] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:29.753849  7893 leader_election.cc:304] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:29.755398  9659 raft_consensus.cc:3055] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 14:51:29.756906  9659 raft_consensus.cc:740] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:29.757522  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:29.758559  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:29.759434  7893 leader_election.cc:304] T 9ce9c0ef2db24c13a8b1402f21819458 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 9418391fa82a42c79c6cad13ba91d964
I20260709 14:51:29.762473  9903 raft_consensus.cc:2749] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 14:51:29.768623  7893 leader_election.cc:304] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:29.716137 10048 raft_consensus.cc:515] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:29.762473 10054 raft_consensus.cc:2804] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 14:51:29.761551 10080 raft_consensus.cc:515] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:29.773087  9903 raft_consensus.cc:2749] T 9ce9c0ef2db24c13a8b1402f21819458 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 14:51:29.800031 10080 leader_election.cc:290] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:29.802949  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:29.803830  7775 raft_consensus.cc:2468] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 5.
I20260709 14:51:29.803908  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:29.804316 10054 raft_consensus.cc:697] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:29.779961  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 9 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:29.775475  9659 consensus_queue.cc:260] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:29.782475  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:29.781090  9784 consensus_queue.cc:1048] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 14:51:29.783828  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:29.805542  7774 raft_consensus.cc:2468] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 3.
I20260709 14:51:29.805953  7773 raft_consensus.cc:2468] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 6.
I20260709 14:51:29.805266 10054 consensus_queue.cc:237] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:29.787541  7772 raft_consensus.cc:1275] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 14:51:29.784816  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 9 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:29.788844  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:29.806928  7924 raft_consensus.cc:2468] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 8.
I20260709 14:51:29.780917 10046 raft_consensus.cc:515] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:29.791340  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:29.807994  7776 raft_consensus.cc:2393] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 4: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:51:29.793541  7922 raft_consensus.cc:1275] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 14:51:29.794817  7771 raft_consensus.cc:1275] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 14:51:29.796422  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:29.803144 10074 raft_consensus.cc:2749] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 14:51:29.783473  7927 raft_consensus.cc:1240] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 5. Current term is 6. Ops: []
I20260709 14:51:29.811094  7925 raft_consensus.cc:2468] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 4.
I20260709 14:51:29.789641  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:29.814204  7744 leader_election.cc:304] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:29.819448  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:29.821730  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:29.822623  7771 raft_consensus.cc:2468] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 4.
I20260709 14:51:29.826404  9659 raft_consensus.cc:3060] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:51:29.829934  7926 raft_consensus.cc:1275] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 14:51:29.832616  7744 leader_election.cc:304] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:29.825528 10046 leader_election.cc:290] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:29.834468  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:29.836593  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:29.830030  9784 raft_consensus.cc:2749] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 14:51:29.838418  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:29.839267  7927 raft_consensus.cc:2393] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 6: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:51:29.839206  7922 raft_consensus.cc:2468] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 4.
I20260709 14:51:29.841709  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:29.839460  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:29.846688  7849 raft_consensus.cc:3060] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Advancing to term 8
I20260709 14:51:29.847859  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:29.847756  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:29.848305  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:29.848948  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:29.850744  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:29.851428  7923 raft_consensus.cc:2468] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 6.
I20260709 14:51:29.855822  7676 catalog_manager.cc:5697] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 3 to 4, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 4 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:51:29.839776  9766 raft_consensus.cc:2804] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 14:51:29.862802  7922 raft_consensus.cc:2468] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 5.
I20260709 14:51:29.864277  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:29.865513  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:29.869879  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
W20260709 14:51:29.870884  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:29.872697  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:29.874969  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:29.872962  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:29.873809  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:29.878142  7920 raft_consensus.cc:2468] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 3.
I20260709 14:51:29.880003  7925 raft_consensus.cc:2393] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 8: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:51:29.881515  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:29.881616  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:29.882452  7846 raft_consensus.cc:3060] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:51:29.884853  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:29.891384 10094 consensus_queue.cc:1048] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 14:51:29.891911  7745 leader_election.cc:336] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 1.801s (SENT)
I20260709 14:51:29.895851  7745 leader_election.cc:304] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 3876b8ee8d744cb18e91d97aae93b1ac, 9418391fa82a42c79c6cad13ba91d964
W20260709 14:51:29.897675  7745 leader_election.cc:336] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 1.802s (SENT)
I20260709 14:51:29.898021  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:29.898902  7920 raft_consensus.cc:2468] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 3.
I20260709 14:51:29.900154  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:29.900395  7745 leader_election.cc:304] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:29.903154  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:29.904937  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
W20260709 14:51:29.909768  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:51:29.910378  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:29.911063  7926 raft_consensus.cc:2468] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 7.
W20260709 14:51:29.912461  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 71865.4us
I20260709 14:51:29.913807  7744 leader_election.cc:304] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:51:29.875000  9766 raft_consensus.cc:493] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:29.874150 10048 leader_election.cc:290] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:29.908597  7925 raft_consensus.cc:2468] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 4.
I20260709 14:51:29.923620  7923 raft_consensus.cc:2468] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 7.
I20260709 14:51:29.935674  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:29.941807  7676 catalog_manager.cc:5697] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
W20260709 14:51:29.955098  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 84640.4us
I20260709 14:51:29.991955  7846 raft_consensus.cc:2468] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 6.
I20260709 14:51:29.992383  7923 raft_consensus.cc:1275] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 14:51:29.994467  7676 catalog_manager.cc:5697] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 5 to 6, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 6 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
W20260709 14:51:29.995540  7819 connection.cc:256] RPC call timeout handler was delayed by -4.68096544399998s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.251s for a response
I20260709 14:51:29.996474  7676 catalog_manager.cc:5697] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 2 to 3, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 3 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:51:29.997753  7922 raft_consensus.cc:2468] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 6.
I20260709 14:51:29.892349  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:30.005110  7920 raft_consensus.cc:2468] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 7.
W20260709 14:51:30.009068  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:29.924540  9766 raft_consensus.cc:3060] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:51:30.015427  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:30.012003  7919 raft_consensus.cc:2393] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 6: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:51:30.036343  7923 raft_consensus.cc:1240] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 5. Current term is 6. Ops: []
W20260709 14:51:30.036932  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:30.017613  7676 catalog_manager.cc:5697] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 7 to 9, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 9 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:51:29.892915  9784 consensus_queue.cc:1048] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.106s
I20260709 14:51:30.038306  7894 leader_election.cc:304] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
W20260709 14:51:30.039261  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:30.001855 10049 raft_consensus.cc:493] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
W20260709 14:51:30.049875  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:30.070467  7849 raft_consensus.cc:2468] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 8.
W20260709 14:51:30.057889  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 144164us
I20260709 14:51:30.031019 10093 raft_consensus.cc:2749] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 14:51:30.076819  7819 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:30.065084  7927 raft_consensus.cc:2468] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 8.
I20260709 14:51:30.070950  7674 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54350 (request call id 367) took 4305 ms. Trace:
I20260709 14:51:30.055917 10094 raft_consensus.cc:2749] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 14:51:30.072479  7744 leader_election.cc:304] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:30.059203  7924 raft_consensus.cc:2468] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 2.
I20260709 14:51:30.073784  7894 leader_election.cc:304] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
W20260709 14:51:30.086652 10091 log.cc:927] Time spent T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
I20260709 14:51:30.088606  9784 raft_consensus.cc:2804] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 14:51:30.089713 10090 log.cc:927] Time spent T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 14:51:30.065575  7676 catalog_manager.cc:5697] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 2 to 4, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 4 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
W20260709 14:51:30.117487  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 43800.6us
I20260709 14:51:30.071532 10073 raft_consensus.cc:2804] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 14:51:30.115497  7819 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:30.116587  7744 leader_election.cc:304] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:51:30.075234 10049 raft_consensus.cc:515] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:30.123153  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 222823us
I20260709 14:51:30.109194  7674 rpcz_store.cc:276] 0709 14:51:25.760534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:25.760802 (+   268us) service_pool.cc:224] Handling call
0709 14:51:25.794955 (+ 34153us) spinlock_profiling.cc:243] Waited 28.6 ms on lock 0x7b54000d0610. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb687c29db1 00007fb687d69b71 00007fb687d6a0b2 00007fb690ce3a89 00007fb690c7bda6 00007fb690c4d088 00007fb690d4b37e 00007fb68f20c2a4 00007fb68f20c232 00007fb68f20c161 00007fb68f20c0dc
0709 14:51:30.065865 (+4270910us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 14:51:28.637857 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 14:51:28.638540 (+   683us) write_op.cc:432] Acquiring schema lock in shared mode
0709 14:51:28.638588 (+    48us) write_op.cc:435] Acquired schema lock
0709 14:51:28.638613 (+    25us) tablet.cc:662] Decoding operations
0709 14:51:28.639824 (+  1211us) write_op.cc:620] Acquiring the partition lock for write op
0709 14:51:28.639906 (+    82us) write_op.cc:641] Partition lock acquired for write op
0709 14:51:28.639939 (+    33us) tablet.cc:685] Acquiring locks for 8 operations
0709 14:51:28.641022 (+  1083us) tablet.cc:701] Row locks acquired
0709 14:51:28.641041 (+    19us) write_op.cc:260] PREPARE: finished
0709 14:51:28.641310 (+   269us) write_op.cc:270] Start()
0709 14:51:28.641432 (+   122us) write_op.cc:276] Timestamp: P: 1783608688641212 usec, L: 0
0709 14:51:28.641453 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 14:51:28.675713 (+ 34260us) log.cc:844] Serialized 3234 byte log entry
0709 14:51:29.074960 (+399247us) op_driver.cc:464] REPLICATION: finished
0709 14:51:29.378661 (+303701us) write_op.cc:301] APPLY: starting
0709 14:51:29.378787 (+   126us) tablet.cc:1367] starting BulkCheckPresence
0709 14:51:29.379045 (+   258us) tablet.cc:1370] finished BulkCheckPresence
0709 14:51:29.379233 (+   188us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 14:51:29.380266 (+  1033us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 14:51:29.380565 (+   299us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=8
0709 14:51:29.380616 (+    51us) write_op.cc:312] APPLY: finished
0709 14:51:29.433311 (+ 52695us) log.cc:844] Serialized 65 byte log entry
0709 14:51:29.449382 (+ 16071us) write_op.cc:489] Releasing partition, row and schema locks
0709 14:51:29.451752 (+  2370us) write_op.cc:454] Released schema lock
0709 14:51:29.451813 (+    61us) write_op.cc:341] FINISH: Updating metrics
0709 14:51:29.452670 (+   857us) write_op.cc:489] Releasing partition, row and schema locks
0709 14:51:29.452697 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":28251,"reported_tablets":31,"spinlock_wait_cycles":65857408,"child_traces":[["op",{"apply.queue_time_us":303325,"apply.run_cpu_time_us":4721,"apply.run_wall_time_us":73977,"num_ops":8,"prepare.queue_time_us":156301,"prepare.run_cpu_time_us":25981,"prepare.run_wall_time_us":126373,"raft.queue_time_us":109265,"raft.run_cpu_time_us":20545,"raft.run_wall_time_us":248212,"replication_time_us":433135,"thread_start_us":517009,"threads_started":4,"wal-append.queue_time_us":121614}]]}
I20260709 14:51:30.134367  7745 leader_election.cc:304] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:51:30.135385  7819 connection.cc:256] RPC call timeout handler was delayed by -4.0923654439999382s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3164s for a response
W20260709 14:51:30.136354  7819 connection.cc:256] RPC call timeout handler was delayed by -4.0806654440000329s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.31770000000000004s for a response
W20260709 14:51:30.137162  7819 connection.cc:256] RPC call timeout handler was delayed by -3.4203450189999103s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1587s for a response
W20260709 14:51:30.137602  7819 connection.cc:256] RPC call timeout handler was delayed by -3.400545018999992s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16090000000000002s for a response
W20260709 14:51:30.137967  7819 connection.cc:256] RPC call timeout handler was delayed by -3.400545018999992s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16090000000000002s for a response
W20260709 14:51:30.138331  7819 connection.cc:256] RPC call timeout handler was delayed by -3.3213450189999776s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16970000000000002s for a response
W20260709 14:51:30.138756  7819 connection.cc:256] RPC call timeout handler was delayed by -3.3213450189999776s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16970000000000002s for a response
W20260709 14:51:30.139122  7819 connection.cc:256] RPC call timeout handler was delayed by -3.2772450189999063s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1746s for a response
W20260709 14:51:30.140390  7819 connection.cc:256] RPC call timeout handler was delayed by -3.2772450189999063s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1746s for a response
W20260709 14:51:30.140936  7819 connection.cc:256] RPC call timeout handler was delayed by -3.2376450189999559s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17900000000000002s for a response
W20260709 14:51:30.145126  7819 connection.cc:256] RPC call timeout handler was delayed by -3.2376450189999559s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17900000000000002s for a response
W20260709 14:51:30.145864  7819 connection.cc:256] RPC call timeout handler was delayed by -3.225945018999937s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18030000000000002s for a response
W20260709 14:51:30.146313  7819 connection.cc:256] RPC call timeout handler was delayed by -3.225945018999937s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18030000000000002s for a response
W20260709 14:51:30.146709  7819 connection.cc:256] RPC call timeout handler was delayed by -3.1773450189999721s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1857s for a response
W20260709 14:51:30.147280  7819 connection.cc:256] RPC call timeout handler was delayed by -3.1773450189999721s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1857s for a response
W20260709 14:51:30.147862  7819 connection.cc:256] RPC call timeout handler was delayed by -3.1620450189999474s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1874s for a response
W20260709 14:51:30.148460  7819 connection.cc:256] RPC call timeout handler was delayed by -3.1620450189999474s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1874s for a response
W20260709 14:51:30.149113  7819 connection.cc:256] RPC call timeout handler was delayed by -3.1314450189998979s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1908s for a response
W20260709 14:51:30.149719  7819 connection.cc:256] RPC call timeout handler was delayed by -3.0072450189999245s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2046s for a response
I20260709 14:51:30.144376 10094 raft_consensus.cc:2804] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 14:51:30.150352  7819 connection.cc:256] RPC call timeout handler was delayed by -3.0072450189999245s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2046s for a response
I20260709 14:51:30.150471 10094 raft_consensus.cc:493] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 14:51:30.150926  7819 connection.cc:256] RPC call timeout handler was delayed by -2.99824501899991s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2056s for a response
I20260709 14:51:30.151333 10094 raft_consensus.cc:3060] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Advancing to term 7
W20260709 14:51:30.151335  7819 connection.cc:256] RPC call timeout handler was delayed by -2.99824501899991s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2056s for a response
W20260709 14:51:30.151782  7819 connection.cc:256] RPC call timeout handler was delayed by -2.7372450189999427s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.23460000000000003s for a response
W20260709 14:51:30.152163  7819 connection.cc:256] RPC call timeout handler was delayed by -2.7372450189999427s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.23460000000000003s for a response
W20260709 14:51:30.152531  7819 connection.cc:256] RPC call timeout handler was delayed by -2.6454450189999079s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24480000000000002s for a response
W20260709 14:51:30.152825  7819 connection.cc:256] RPC call timeout handler was delayed by -2.6454450189999079s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24480000000000002s for a response
I20260709 14:51:30.153913  7846 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf"
dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
mode: GRACEFUL
new_leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
 from {username='slave'} at 127.0.0.1:41662
I20260709 14:51:30.154723  7846 raft_consensus.cc:606] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 LEADER]: Received request to transfer leadership to TS 1e9289592458429bbddb19c2e7b7b7b0
W20260709 14:51:30.157557  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:30.117110  9784 raft_consensus.cc:493] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Starting leader election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:51:30.125358 10074 raft_consensus.cc:2804] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 14:51:30.124626 10093 raft_consensus.cc:2749] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 14:51:30.144408 10073 raft_consensus.cc:697] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:30.176434  7819 leader_election.cc:304] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:30.170411  9784 raft_consensus.cc:3060] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Advancing to term 8
I20260709 14:51:30.173019 10098 consensus_queue.cc:1048] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
W20260709 14:51:30.187121  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:51:30.195688  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:30.178727 10074 raft_consensus.cc:697] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
W20260709 14:51:30.204205  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 72034.3us
W20260709 14:51:30.208156  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 73896.7us
I20260709 14:51:30.208695  7744 leader_election.cc:304] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:51:30.185599 10099 raft_consensus.cc:2749] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 14:51:30.214684  7745 leader_election.cc:304] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:30.207144 10093 raft_consensus.cc:2749] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 14:51:30.232972 10074 consensus_queue.cc:237] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:30.195791 10098 consensus_queue.cc:1048] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 14:51:30.197481 10097 consensus_queue.cc:1048] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.055s
I20260709 14:51:30.258734 10097 raft_consensus.cc:2749] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 14:51:30.261907  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 47338.4us
I20260709 14:51:30.263115  7745 leader_election.cc:304] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:30.236759 10094 raft_consensus.cc:515] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:30.267140  7745 leader_election.cc:304] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:51:30.266597  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 57979.1us
I20260709 14:51:30.261740 10106 consensus_queue.cc:1048] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 14:51:30.269555  7745 leader_election.cc:304] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:30.271260  7745 leader_election.cc:304] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:30.268558  7744 leader_election.cc:304] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:30.261930 10093 raft_consensus.cc:2804] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader election won for term 6
I20260709 14:51:30.273588 10049 leader_election.cc:290] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:30.275878 10057 raft_consensus.cc:493] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:51:30.276077 10093 raft_consensus.cc:697] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:51:30.276484 10057 raft_consensus.cc:515] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:30.277338 10093 consensus_queue.cc:237] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:30.277997 10099 consensus_queue.cc:1059] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 14:51:30.278931 10099 raft_consensus.cc:3055] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 LEADER]: Stepping down as leader of term 7
I20260709 14:51:30.279312 10099 raft_consensus.cc:740] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:51:30.280323 10099 consensus_queue.cc:260] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:30.279009 10057 leader_election.cc:290] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:30.261976 10073 consensus_queue.cc:237] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:30.294356 10099 raft_consensus.cc:3060] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Advancing to term 8
I20260709 14:51:30.272158  9766 raft_consensus.cc:515] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:30.308159  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:30.284765 10108 raft_consensus.cc:2749] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 14:51:30.284184 10097 raft_consensus.cc:2749] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 14:51:30.325830  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 54665.1us
I20260709 14:51:30.294346 10109 raft_consensus.cc:2749] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 14:51:30.323577 10095 log.cc:927] Time spent T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.233s	user 0.004s	sys 0.006s
I20260709 14:51:30.338311  7745 leader_election.cc:304] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:51:30.339780  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 71280.6us
I20260709 14:51:30.330134 10048 raft_consensus.cc:493] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:30.334441 10107 raft_consensus.cc:2749] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 14:51:30.345477  7745 leader_election.cc:304] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:30.339462 10049 consensus_queue.cc:1048] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 14:51:30.340116 10108 raft_consensus.cc:2804] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader election won for term 7
I20260709 14:51:30.343251 10048 raft_consensus.cc:515] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:30.358832  7819 leader_election.cc:304] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:30.346426  9784 raft_consensus.cc:515] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:30.363679  7819 leader_election.cc:304] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:30.363679  9784 leader_election.cc:290] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:30.348526  9766 leader_election.cc:290] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:30.374430 10049 raft_consensus.cc:2804] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 14:51:30.375236 10049 raft_consensus.cc:493] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:30.375679 10049 raft_consensus.cc:3060] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Advancing to term 6
W20260709 14:51:30.378552 10092 log.cc:927] Time spent T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.286s	user 0.005s	sys 0.000s
I20260709 14:51:30.380183 10108 raft_consensus.cc:697] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:51:30.406237 10114 raft_consensus.cc:2804] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 14:51:30.407030 10114 raft_consensus.cc:493] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:30.407437 10114 raft_consensus.cc:3060] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:51:30.407897 10094 leader_election.cc:290] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:30.409931 10107 raft_consensus.cc:493] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:30.410486 10107 raft_consensus.cc:515] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:30.347052 10103 raft_consensus.cc:2749] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 14:51:30.416657 10107 leader_election.cc:290] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:30.418059 10108 consensus_queue.cc:237] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:30.419651  7745 leader_election.cc:304] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:51:30.425172  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 83907.5us
W20260709 14:51:30.425199  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:30.426735  7744 leader_election.cc:304] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:51:30.427846  7744 leader_election.cc:304] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:51:30.428851 10093 raft_consensus.cc:2804] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 14:51:30.430670 10093 raft_consensus.cc:493] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:30.431075 10093 raft_consensus.cc:3060] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:51:30.446681  9741 raft_consensus.cc:493] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:30.448565  9741 raft_consensus.cc:515] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:30.453526  7744 leader_election.cc:304] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:51:30.438856  9929 raft_consensus.cc:493] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:30.455148  9929 raft_consensus.cc:515] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:30.462715  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:30.464959  7845 raft_consensus.cc:1275] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 14:51:30.470501  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 50971.4us
I20260709 14:51:30.472834  7745 leader_election.cc:304] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:51:30.476259  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:30.478621 10104 raft_consensus.cc:2804] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 14:51:30.486258 10104 raft_consensus.cc:493] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:51:30.486764 10104 raft_consensus.cc:3060] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:51:30.463794 10098 raft_consensus.cc:2804] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 14:51:30.490211 10098 raft_consensus.cc:493] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:30.490626 10098 raft_consensus.cc:3060] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:51:30.494843  9741 leader_election.cc:290] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:30.496755 10104 raft_consensus.cc:515] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:30.499456 10104 leader_election.cc:290] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 6 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:30.509217 10113 raft_consensus.cc:2749] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 14:51:30.501811  9929 leader_election.cc:290] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:30.505470 10103 raft_consensus.cc:2804] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader election won for term 7
I20260709 14:51:30.525944  7854 raft_consensus.cc:1275] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 14:51:30.505793  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:30.480551 10048 leader_election.cc:290] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:30.474499  7744 leader_election.cc:304] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
W20260709 14:51:30.531237  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 167640us
I20260709 14:51:30.534920  7819 leader_election.cc:304] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 9418391fa82a42c79c6cad13ba91d964
W20260709 14:51:30.537803  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 63385.7us
W20260709 14:51:30.539460  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 67563.6us
I20260709 14:51:30.539774  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:30.540154  7745 leader_election.cc:304] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:30.540853  7776 raft_consensus.cc:3060] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:51:30.545215  7819 leader_election.cc:304] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:30.548218  7745 leader_election.cc:304] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:51:30.550592  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:30.552086  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:30.552124  7778 raft_consensus.cc:1240] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 7. Current term is 8. Ops: []
I20260709 14:51:30.553707  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:30.554227  7771 raft_consensus.cc:2376] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 8. Re-sending same reply.
I20260709 14:51:30.536861  9784 raft_consensus.cc:2749] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 14:51:30.542114 10104 raft_consensus.cc:2749] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 14:51:30.544970 10107 raft_consensus.cc:2804] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:51:30.561053  7745 leader_election.cc:304] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:30.553467 10113 raft_consensus.cc:3060] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:51:30.543109 10103 raft_consensus.cc:697] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:51:30.568069  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:30.570919  7847 raft_consensus.cc:2468] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 5.
W20260709 14:51:30.571698  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:30.578145  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:30.578552  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:30.579084  7854 raft_consensus.cc:2468] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 3.
I20260709 14:51:30.584635  7894 leader_election.cc:304] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:30.569001 10094 raft_consensus.cc:493] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:30.572328 10108 raft_consensus.cc:2749] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 14:51:30.575763 10106 raft_consensus.cc:2749] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 14:51:30.592558  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:30.550513 10114 raft_consensus.cc:515] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:30.591236 10120 raft_consensus.cc:2804] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 14:51:30.615263  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:30.610802  7776 raft_consensus.cc:2468] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 6.
I20260709 14:51:30.575456 10107 raft_consensus.cc:697] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:51:30.575338  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:30.621973  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:30.624393  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:30.629383  7777 raft_consensus.cc:2393] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 7: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:51:30.583593 10021 consensus_queue.cc:1048] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.045s
I20260709 14:51:30.609649 10046 raft_consensus.cc:2804] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 14:51:30.643522  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:30.589125 10073 consensus_queue.cc:1048] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.047s
I20260709 14:51:30.589464 10104 consensus_queue.cc:1048] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 14:51:30.618736 10094 raft_consensus.cc:515] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:30.644546  7776 raft_consensus.cc:2393] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 6: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:51:30.619719 10120 raft_consensus.cc:493] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 14:51:30.645663  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 84722.9us
I20260709 14:51:30.678988  7894 leader_election.cc:304] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:30.749636  7745 leader_election.cc:304] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:51:30.716037  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:30.750138  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:30.751742  7745 leader_election.cc:304] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 3876b8ee8d744cb18e91d97aae93b1ac, 9418391fa82a42c79c6cad13ba91d964
W20260709 14:51:30.751228  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 72371.8us
I20260709 14:51:30.744963  7777 raft_consensus.cc:2376] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 6. Re-sending same reply.
I20260709 14:51:30.763644  7745 leader_election.cc:304] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
W20260709 14:51:30.702008 10118 log.cc:927] Time spent T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
I20260709 14:51:30.774334  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:30.781484  7745 leader_election.cc:304] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:30.783396  7745 leader_election.cc:304] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:30.784586  7745 leader_election.cc:304] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:30.765844  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:30.776467  7775 raft_consensus.cc:2410] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 14:51:30.692776 10108 raft_consensus.cc:493] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:30.746281 10046 raft_consensus.cc:493] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:30.764891 10097 raft_consensus.cc:2749] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 14:51:30.751289 10120 raft_consensus.cc:3060] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:51:30.777511 10109 raft_consensus.cc:2749] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 14:51:30.765327 10048 raft_consensus.cc:2804] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 14:51:30.798352  7745 leader_election.cc:304] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:51:30.800472  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:30.801530  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:30.717023 10049 raft_consensus.cc:515] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:30.810887 10094 leader_election.cc:290] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:30.811168 10049 leader_election.cc:290] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 6 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:30.815074 10113 raft_consensus.cc:2749] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 14:51:30.816243 10127 raft_consensus.cc:2749] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 14:51:30.829023  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:30.829895  7776 raft_consensus.cc:3060] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Advancing to term 6
I20260709 14:51:30.794410 10046 raft_consensus.cc:3060] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:51:30.788271 10114 leader_election.cc:290] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:51:30.832582 10121 log.cc:927] Time spent T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
I20260709 14:51:30.791363  9784 raft_consensus.cc:2804] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader election won for term 4
I20260709 14:51:30.833374  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:30.841171  7775 raft_consensus.cc:2393] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 8: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:51:30.833653 10093 raft_consensus.cc:515] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:30.720927 10107 consensus_queue.cc:237] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:30.836665  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 287051us
I20260709 14:51:30.873880  7819 leader_election.cc:304] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:30.876053  7819 leader_election.cc:304] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:30.792867 10106 raft_consensus.cc:2804] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 14:51:30.836795 10113 raft_consensus.cc:2749] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 14:51:30.818297 10125 raft_consensus.cc:2749] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 14:51:30.796379 10108 raft_consensus.cc:515] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:30.863952 10114 raft_consensus.cc:493] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9418391fa82a42c79c6cad13ba91d964)
I20260709 14:51:30.689580 10103 consensus_queue.cc:237] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:30.794472  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:30.804659 10048 raft_consensus.cc:493] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:30.914438  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:30.928278  7775 raft_consensus.cc:2468] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 5.
I20260709 14:51:30.835568  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:30.918220  7776 raft_consensus.cc:2468] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 6.
W20260709 14:51:30.922176  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:30.903805 10106 raft_consensus.cc:493] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:30.934547  7770 raft_consensus.cc:2393] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 6: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
W20260709 14:51:30.933211  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 134970us
I20260709 14:51:30.932415  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:30.910007 10049 raft_consensus.cc:2764] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 14:51:30.939931  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:30.903702  9784 raft_consensus.cc:697] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:51:30.954897  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:30.958508  7775 raft_consensus.cc:2393] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 5: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:51:30.957062  7770 raft_consensus.cc:2468] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 4.
W20260709 14:51:30.940016 10121 log.cc:927] Time spent T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 14:51:30.963279  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:30.932268 10048 raft_consensus.cc:3060] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:51:30.966521  7775 raft_consensus.cc:2393] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 7: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:51:30.967355  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:30.969336  7745 leader_election.cc:304] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:30.939844 10106 raft_consensus.cc:3060] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:51:30.938964  7773 raft_consensus.cc:3060] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:51:30.975905  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:30.976796  7745 leader_election.cc:304] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:30.981474  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:30.982205  7776 raft_consensus.cc:2376] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 6. Re-sending same reply.
I20260709 14:51:30.985647  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:30.927937 10123 consensus_queue.cc:1059] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.062s
I20260709 14:51:30.975455 10094 raft_consensus.cc:2749] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 14:51:30.989048  7745 leader_election.cc:304] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:30.934908 10114 raft_consensus.cc:515] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:51:31.012621  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:31.013829  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:31.086433  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:31.098562  7925 raft_consensus.cc:2393] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 6: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
W20260709 14:51:31.086795  8599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 52674.9us
I20260709 14:51:31.092763  7893 leader_election.cc:304] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:51:30.991838  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 115878us
I20260709 14:51:30.979259  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:31.098896  7920 raft_consensus.cc:3060] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 14:51:31.100668  7775 raft_consensus.cc:2393] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 8: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:51:31.073601  7675 catalog_manager.cc:5697] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 3 to 4, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 4 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:51:31.065970  7773 raft_consensus.cc:2468] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 6.
I20260709 14:51:30.993189  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:31.087510  7921 raft_consensus.cc:1240] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 LEADER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 7. Current term is 8. Ops: [7.7-7.7]
W20260709 14:51:31.086433  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:31.074586  7676 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54364 (request call id 338) took 5324 ms. Trace:
W20260709 14:51:31.024137  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:30.995711  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:31.004412  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
W20260709 14:51:31.106988  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 118108us
I20260709 14:51:31.107471  7776 raft_consensus.cc:2393] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 6: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
W20260709 14:51:30.989617  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 79085.1us
I20260709 14:51:31.012101  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:31.113922  7928 raft_consensus.cc:3060] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:51:31.102357  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:31.105818  7819 leader_election.cc:304] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:31.107647  7745 leader_election.cc:304] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:31.118160  7819 leader_election.cc:304] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:31.107708  7676 rpcz_store.cc:276] 0709 14:51:25.750238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:25.751409 (+  1171us) service_pool.cc:224] Handling call
0709 14:51:31.074486 (+5323077us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 14:51:30.244349 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 14:51:30.302357 (+ 58008us) write_op.cc:432] Acquiring schema lock in shared mode
0709 14:51:30.302404 (+    47us) write_op.cc:435] Acquired schema lock
0709 14:51:30.302423 (+    19us) tablet.cc:662] Decoding operations
0709 14:51:30.348289 (+ 45866us) write_op.cc:620] Acquiring the partition lock for write op
0709 14:51:30.348391 (+   102us) write_op.cc:641] Partition lock acquired for write op
0709 14:51:30.348423 (+    32us) tablet.cc:685] Acquiring locks for 6 operations
0709 14:51:30.348987 (+   564us) tablet.cc:701] Row locks acquired
0709 14:51:30.349013 (+    26us) write_op.cc:260] PREPARE: finished
0709 14:51:30.349207 (+   194us) write_op.cc:270] Start()
0709 14:51:30.349396 (+   189us) write_op.cc:276] Timestamp: P: 1783608690349142 usec, L: 0
0709 14:51:30.349419 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 14:51:30.350252 (+   833us) log.cc:844] Serialized 2460 byte log entry
0709 14:51:30.591460 (+241208us) op_driver.cc:464] REPLICATION: finished
0709 14:51:30.780367 (+188907us) write_op.cc:301] APPLY: starting
0709 14:51:30.780456 (+    89us) tablet.cc:1367] starting BulkCheckPresence
0709 14:51:30.780645 (+   189us) tablet.cc:1370] finished BulkCheckPresence
0709 14:51:30.780767 (+   122us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 14:51:30.812438 (+ 31671us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 14:51:30.812670 (+   232us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 14:51:30.812716 (+    46us) write_op.cc:312] APPLY: finished
0709 14:51:30.813029 (+   313us) log.cc:844] Serialized 53 byte log entry
0709 14:51:30.813259 (+   230us) write_op.cc:489] Releasing partition, row and schema locks
0709 14:51:30.813372 (+   113us) write_op.cc:454] Released schema lock
0709 14:51:30.813414 (+    42us) write_op.cc:341] FINISH: Updating metrics
0709 14:51:30.813863 (+   449us) write_op.cc:489] Releasing partition, row and schema locks
0709 14:51:30.813892 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":153810,"reported_tablets":28,"child_traces":[["op",{"apply.queue_time_us":188629,"apply.run_cpu_time_us":3124,"apply.run_wall_time_us":33467,"num_ops":6,"prepare.queue_time_us":80152,"prepare.run_cpu_time_us":4993,"prepare.run_wall_time_us":134189,"replication_time_us":241778,"thread_start_us":109523,"threads_started":2}]]}
I20260709 14:51:31.122080 10123 raft_consensus.cc:2804] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 14:51:31.129201  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:31.122601  7745 leader_election.cc:304] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:31.124536  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
W20260709 14:51:31.083348 10131 log.cc:927] Time spent T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.267s	user 0.003s	sys 0.000s
W20260709 14:51:31.080036 10126 log.cc:927] Time spent T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.264s	user 0.000s	sys 0.001s
I20260709 14:51:31.137135  7853 raft_consensus.cc:1275] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 14:51:31.034511 10117 raft_consensus.cc:2804] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 14:51:31.147764  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:31.123894  7675 catalog_manager.cc:5697] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 6 to 7, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 7 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:51:31.126868  7845 raft_consensus.cc:1275] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 14:51:31.156543  7675 catalog_manager.cc:5697] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 3 to 4, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 4 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:51:31.158088  7675 catalog_manager.cc:5697] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 5 to 6, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 6 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:51:31.127260  7819 leader_election.cc:304] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
W20260709 14:51:31.014570 10129 log.cc:927] Time spent T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 14:51:31.126269  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:31.168460  7771 raft_consensus.cc:2468] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 7.
I20260709 14:51:31.035329 10049 raft_consensus.cc:3055] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 LEADER]: Stepping down as leader of term 5
I20260709 14:51:31.139140  7745 leader_election.cc:304] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:51:31.139750  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 47114.7us
I20260709 14:51:31.161484  7819 leader_election.cc:304] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:31.081562 10108 leader_election.cc:290] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:31.141407 10136 raft_consensus.cc:2749] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 14:51:31.171103 10094 raft_consensus.cc:2749] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 14:51:31.129532 10123 raft_consensus.cc:493] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:31.100407 10093 leader_election.cc:290] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:31.171052  7920 raft_consensus.cc:2468] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 8.
I20260709 14:51:31.185127  7773 raft_consensus.cc:2468] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 7.
I20260709 14:51:31.188442  7928 raft_consensus.cc:2468] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 7.
W20260709 14:51:31.138197  9766 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.010s	sys 0.016s
I20260709 14:51:31.125890 10104 raft_consensus.cc:2804] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader election won for term 5
I20260709 14:51:31.126925 10127 raft_consensus.cc:2749] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 14:51:31.034488 10135 raft_consensus.cc:2749] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 14:51:31.194728  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 56186.3us
I20260709 14:51:31.215579  7745 leader_election.cc:304] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:31.196687  7893 leader_election.cc:304] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:31.218178  7745 leader_election.cc:304] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:31.160580 10117 raft_consensus.cc:493] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:31.224282  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:31.226562  7776 raft_consensus.cc:2468] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 7.
I20260709 14:51:31.001427 10130 consensus_queue.cc:1048] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.248s
I20260709 14:51:31.179046 10099 raft_consensus.cc:2804] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 14:51:30.996385  9784 consensus_queue.cc:237] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:31.217018  9766 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.613s	user 0.011s	sys 0.016s
I20260709 14:51:31.230932  7893 leader_election.cc:304] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:31.180598 10049 raft_consensus.cc:740] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:51:31.178346 10011 raft_consensus.cc:2804] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 14:51:31.238837  7745 leader_election.cc:304] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:31.247874  7745 leader_election.cc:304] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:31.224809 10108 raft_consensus.cc:2749] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 14:51:31.228577 10117 raft_consensus.cc:3060] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:51:31.216094 10123 raft_consensus.cc:3060] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Advancing to term 4
W20260709 14:51:31.225685 10098 consensus_meta.cc:287] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent flushing consensus metadata: real 0.735s	user 0.011s	sys 0.004s
I20260709 14:51:31.256680  7893 leader_election.cc:304] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:31.232111 10113 raft_consensus.cc:2804] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader election won for term 5
I20260709 14:51:31.240216  7773 raft_consensus.cc:1275] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 14:51:31.237484 10099 raft_consensus.cc:493] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:31.241686 10093 raft_consensus.cc:2749] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 14:51:31.253749 10146 log.cc:927] Time spent T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.128s	user 0.000s	sys 0.001s
I20260709 14:51:31.249958 10080 raft_consensus.cc:2804] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 14:51:31.289403  7745 leader_election.cc:304] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:31.244619 10097 consensus_queue.cc:1048] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 14:51:31.303560  7893 leader_election.cc:304] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:31.247105 10136 consensus_queue.cc:1048] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.051s
I20260709 14:51:31.276948  9766 raft_consensus.cc:2764] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 14:51:31.265623 10135 raft_consensus.cc:2749] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 14:51:31.278909  9929 raft_consensus.cc:2749] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 14:51:31.263571 10042 consensus_queue.cc:1048] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 14:51:31.296231 10099 raft_consensus.cc:3060] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:51:31.302630  9741 raft_consensus.cc:2749] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 14:51:31.286405  9776 consensus_queue.cc:1048] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 14:51:31.277963 10046 raft_consensus.cc:515] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:31.299554 10011 raft_consensus.cc:697] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:31.315558  7893 leader_election.cc:304] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:31.289191 10098 raft_consensus.cc:515] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:31.320711 10125 raft_consensus.cc:2749] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 14:51:31.320483 10080 raft_consensus.cc:697] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
W20260709 14:51:31.354813  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:31.355908  7893 leader_election.cc:304] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:51:31.361440 10149 log.cc:927] Time spent T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 14:51:31.330844  7745 leader_election.cc:304] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:51:31.388361  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 226970us
I20260709 14:51:31.389887  7819 leader_election.cc:304] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:31.398972  7772 raft_consensus.cc:1240] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 LEADER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 6. Current term is 7. Ops: []
I20260709 14:51:31.399816  7777 raft_consensus.cc:2368] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 3. Current term is 4.
I20260709 14:51:31.363251  9929 raft_consensus.cc:2749] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 14:51:31.405128  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 165185us
I20260709 14:51:31.322201 10049 consensus_queue.cc:260] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:31.372408 10074 raft_consensus.cc:2749] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 14:51:31.385134 10114 leader_election.cc:290] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785), 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68:42321)
W20260709 14:51:31.421597 10142 log.cc:927] Time spent T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.070s	user 0.001s	sys 0.001s
I20260709 14:51:31.423346 10048 raft_consensus.cc:515] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:31.424283 10080 consensus_queue.cc:237] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:31.427925 10099 raft_consensus.cc:515] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:31.394614  9766 raft_consensus.cc:2749] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 14:51:31.396162 10130 raft_consensus.cc:2804] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader election won for term 7
W20260709 14:51:31.431159  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 75331.3us
I20260709 14:51:31.446852  7893 leader_election.cc:304] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:31.465334  7893 leader_election.cc:304] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:31.409417 10103 raft_consensus.cc:493] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:31.421640  8639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce9c0ef2db24c13a8b1402f21819458" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9418391fa82a42c79c6cad13ba91d964" is_pre_election: true
I20260709 14:51:31.437987  9929 raft_consensus.cc:2749] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 14:51:31.481865  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:31.485006 10164 raft_consensus.cc:2749] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 14:51:31.485383 10103 raft_consensus.cc:515] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:31.489975 10150 log.cc:927] Time spent T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 14:51:31.464376 10042 raft_consensus.cc:2749] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 14:51:31.483300 10130 raft_consensus.cc:697] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:51:31.439489 10104 raft_consensus.cc:697] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
W20260709 14:51:31.506865  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 117058us
I20260709 14:51:31.509292  7819 leader_election.cc:304] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:31.492872 10158 consensus_queue.cc:1048] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.067s
W20260709 14:51:31.551937 10120 consensus_meta.cc:287] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent flushing consensus metadata: real 0.718s	user 0.009s	sys 0.007s
I20260709 14:51:31.552464 10120 raft_consensus.cc:515] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:31.554279 10104 consensus_queue.cc:237] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:31.556663 10120 leader_election.cc:290] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 9 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:51:31.560534  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 80260.4us
I20260709 14:51:31.563735  7893 leader_election.cc:304] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:31.565119  9929 raft_consensus.cc:2749] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 14:51:31.567690 10164 consensus_queue.cc:1048] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 14:51:31.578351  9757 raft_consensus.cc:493] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:31.579173  9757 raft_consensus.cc:515] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:31.581856  9757 leader_election.cc:290] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:31.581640 10164 raft_consensus.cc:493] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:31.583353 10164 raft_consensus.cc:515] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:31.499917 10130 consensus_queue.cc:237] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:31.593675 10098 leader_election.cc:290] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:51:31.559432 10106 consensus_meta.cc:287] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent flushing consensus metadata: real 0.540s	user 0.003s	sys 0.009s
I20260709 14:51:31.594637 10106 raft_consensus.cc:515] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:31.595516  7777 pending_rounds.cc:85] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed: Aborting all ops after (but not including) 3
I20260709 14:51:31.595952  7777 pending_rounds.cc:107] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 14:51:31.596215  7777 raft_consensus.cc:2889] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:51:31.600109  7776 raft_consensus.cc:1240] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 6. Current term is 7. Ops: []
I20260709 14:51:31.602808  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:31.556934 10161 raft_consensus.cc:2804] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 14:51:31.620456  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:31.617390 10161 raft_consensus.cc:493] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:31.609354  7776 raft_consensus.cc:1275] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 14:51:31.623682  7776 raft_consensus.cc:1275] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 14:51:31.625455  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783e4874513449ef9084b833f188a6d3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:31.626924  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:31.628618  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:31.629971  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce9c0ef2db24c13a8b1402f21819458" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:31.637643  7919 raft_consensus.cc:3060] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:51:31.638510  7920 raft_consensus.cc:1275] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 14:51:31.597131 10106 leader_election.cc:290] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:31.480315 10011 consensus_queue.cc:237] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:31.637760  7776 raft_consensus.cc:3055] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 LEADER]: Stepping down as leader of term 7
I20260709 14:51:31.642357  7776 raft_consensus.cc:740] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
W20260709 14:51:31.649750  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:31.622169 10161 raft_consensus.cc:3060] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:51:31.604293  9766 raft_consensus.cc:493] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9418391fa82a42c79c6cad13ba91d964)
I20260709 14:51:31.639688 10103 leader_election.cc:290] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:51:31.694947  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 183395us
W20260709 14:51:31.695349  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:31.644568  7776 consensus_queue.cc:260] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:31.701751  7776 raft_consensus.cc:3060] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Advancing to term 8
I20260709 14:51:31.701632  7819 leader_election.cc:304] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:31.643983 10046 leader_election.cc:290] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:31.663702 10099 leader_election.cc:290] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 5 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:31.670359  9757 raft_consensus.cc:493] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:31.691677 10164 leader_election.cc:290] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:31.716748  7919 raft_consensus.cc:2468] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 7.
I20260709 14:51:31.717640 10154 consensus_queue.cc:1059] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.076s
I20260709 14:51:31.718745 10154 consensus_queue.cc:1243] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer 1e9289592458429bbddb19c2e7b7b7b0 log is divergent from this leader: its last log entry 4.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 14:51:31.718109 10170 raft_consensus.cc:2804] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader election won for term 7
I20260709 14:51:31.726423  7772 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 2114) took 1165 ms. Trace:
I20260709 14:51:31.726922  7772 rpcz_store.cc:276] 0709 14:51:30.561137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:30.561314 (+   177us) service_pool.cc:224] Handling call
0709 14:51:30.616578 (+ 55264us) spinlock_profiling.cc:243] Waited 8.11 ms on lock 0x7b5800002a98. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb687c29db1 00007fb687d69b71 00007fb687d69a22 00007fb690c82c09 00007fb68fddcee0 00007fb68fea60ab 00007fb68fea6131 00007fb68fe67fc0 00007fb68fe52929 00007fb68fe523d2 00007fb6893c9bd4
0709 14:51:30.616749 (+   171us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:51:31.399698 (+782949us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:31.726126 (+326428us) spinlock_profiling.cc:243] Waited 782 ms on lock 0x7b5400325354. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae8ee01 00007fb68ae8d83e 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2 00007fb6891c948c 00007fb6891c88c6
0709 14:51:31.726353 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1817147136}
W20260709 14:51:31.728281 10174 log.cc:927] Time spent T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.128s	user 0.000s	sys 0.001s
I20260709 14:51:31.728704  7772 raft_consensus.cc:1275] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 14:51:31.730691  7772 raft_consensus.cc:1240] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 14:51:31.732169  7772 raft_consensus.cc:1240] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 7. Current term is 8. Ops: []
I20260709 14:51:31.740294  7772 raft_consensus.cc:1240] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 6. Current term is 7. Ops: []
I20260709 14:51:31.746660  7776 raft_consensus.cc:1275] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 7. (term mismatch)
W20260709 14:51:31.770331  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:31.746949  7772 raft_consensus.cc:1240] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 5. Current term is 6. Ops: []
I20260709 14:51:31.781390  7776 pending_rounds.cc:85] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed: Aborting all ops after (but not including) 6
I20260709 14:51:31.781885  7776 pending_rounds.cc:107] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260709 14:51:31.782163  7776 raft_consensus.cc:2889] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:51:31.742213 10104 raft_consensus.cc:2804] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader election won for term 8
I20260709 14:51:31.706681  9766 raft_consensus.cc:515] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
W20260709 14:51:31.850711  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 145385us
I20260709 14:51:31.741222 10170 raft_consensus.cc:697] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:51:31.865828  7819 leader_election.cc:304] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:31.723410  9757 raft_consensus.cc:515] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:31.741521 10099 consensus_queue.cc:1059] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.113s
W20260709 14:51:31.880911  7745 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:31.804065 10113 raft_consensus.cc:697] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
W20260709 14:51:31.871724 10123 consensus_meta.cc:287] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent flushing consensus metadata: real 0.584s	user 0.010s	sys 0.004s
I20260709 14:51:31.866469 10104 raft_consensus.cc:697] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
W20260709 14:51:31.986519  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:51:32.074608  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:32.011513 10175 raft_consensus.cc:3055] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 LEADER]: Stepping down as leader of term 5
I20260709 14:51:31.984944 10168 consensus_queue.cc:1059] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.169s
I20260709 14:51:31.916620 10103 raft_consensus.cc:493] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:32.011018 10141 raft_consensus.cc:493] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:31.985659 10123 raft_consensus.cc:515] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:32.122931 10117 consensus_meta.cc:287] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent flushing consensus metadata: real 0.845s	user 0.005s	sys 0.009s
I20260709 14:51:32.108045 10094 raft_consensus.cc:493] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
W20260709 14:51:32.160920 10177 log.cc:927] Time spent T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.205s	user 0.001s	sys 0.003s
I20260709 14:51:32.140837 10141 raft_consensus.cc:515] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:32.154007 10172 log.cc:927] Time spent T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 14:51:32.125888 10175 raft_consensus.cc:740] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
W20260709 14:51:32.193120  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:32.172844 10021 raft_consensus.cc:493] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:51:32.214236  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 348526us
I20260709 14:51:32.146476 10103 raft_consensus.cc:515] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:32.179365 10098 raft_consensus.cc:493] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:32.184947 10173 raft_consensus.cc:2749] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 14:51:32.176229 10094 raft_consensus.cc:515] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:32.104235 10170 consensus_queue.cc:237] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:32.166615 10117 raft_consensus.cc:515] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:32.260969  7819 leader_election.cc:304] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:32.227154 10021 raft_consensus.cc:515] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:32.264117  7775 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 2137) took 1521 ms. Trace:
I20260709 14:51:32.264588  7775 rpcz_store.cc:276] 0709 14:51:30.743285 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:31.254907 (+511622us) service_pool.cc:224] Handling call
0709 14:51:31.255297 (+   390us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:51:31.435175 (+179878us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:51:31.435212 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:51:31.442015 (+  6803us) log.cc:844] Serialized 26 byte log entry
0709 14:51:31.607938 (+165923us) raft_consensus.cc:1645] Marking committed up to 2
0709 14:51:31.607978 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:31.608129 (+   151us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:51:32.263754 (+655625us) raft_consensus.cc:1685] finished
0709 14:51:32.263779 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:51:32.263953 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":22280,"raft.run_cpu_time_us":241,"raft.run_wall_time_us":11767,"thread_start_us":338036,"threads_started":2,"wal-append.queue_time_us":305447}
I20260709 14:51:32.239678 10183 raft_consensus.cc:3055] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 LEADER]: Stepping down as leader of term 6
W20260709 14:51:32.274752  7743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:32.240753 10132 raft_consensus.cc:493] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:32.233098 10098 raft_consensus.cc:515] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:32.289222  7819 leader_election.cc:304] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:32.269778  9766 leader_election.cc:290] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68:42321)
I20260709 14:51:32.275378 10183 raft_consensus.cc:740] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
W20260709 14:51:32.281632 10163 log.cc:927] Time spent T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
I20260709 14:51:32.278416 10099 raft_consensus.cc:2749] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 14:51:32.282320 10167 log.cc:927] Time spent T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.323s	user 0.004s	sys 0.004s
I20260709 14:51:32.215924 10113 consensus_queue.cc:237] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:32.281373 10182 raft_consensus.cc:493] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:32.281955 10132 raft_consensus.cc:515] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:32.315953  7819 leader_election.cc:304] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:32.320122 10098 leader_election.cc:290] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:32.320963 10193 consensus_queue.cc:1059] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 14:51:32.315779 10155 log.cc:927] Time spent T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.176s	user 0.001s	sys 0.000s
I20260709 14:51:32.335035  7777 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 2141) took 1555 ms. Trace:
I20260709 14:51:32.326391 10183 consensus_queue.cc:260] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:32.306190 10175 consensus_queue.cc:260] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:32.329468  7773 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 2138) took 1585 ms. Trace:
I20260709 14:51:32.345022  7773 rpcz_store.cc:276] 0709 14:51:30.743610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:31.300535 (+556925us) service_pool.cc:224] Handling call
0709 14:51:31.323413 (+ 22878us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:51:31.323876 (+   463us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:51:31.323909 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:51:31.331712 (+  7803us) log.cc:844] Serialized 26 byte log entry
0709 14:51:31.476566 (+144854us) raft_consensus.cc:1645] Marking committed up to 2
0709 14:51:31.476620 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:31.476724 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:51:32.328822 (+852098us) raft_consensus.cc:1685] finished
0709 14:51:32.328849 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:51:32.329355 (+   506us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":891,"raft.run_cpu_time_us":216,"raft.run_wall_time_us":12286,"thread_start_us":113658,"threads_started":1,"wal-append.queue_time_us":364159}
I20260709 14:51:32.305414 10173 raft_consensus.cc:2804] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 14:51:32.315595 10123 leader_election.cc:290] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 4 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:32.331990  9757 leader_election.cc:290] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:32.304998 10048 leader_election.cc:290] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 5 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:51:32.325700 10187 log.cc:927] Time spent T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 14:51:32.336764  7777 rpcz_store.cc:276] 0709 14:51:30.779807 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:31.594984 (+815177us) service_pool.cc:224] Handling call
0709 14:51:31.595329 (+   345us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:51:31.597016 (+  1687us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:51:31.597045 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:51:31.602302 (+  5257us) log.cc:844] Serialized 26 byte log entry
0709 14:51:31.741637 (+139335us) raft_consensus.cc:1645] Marking committed up to 3
0709 14:51:31.741670 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:31.741729 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:51:32.334815 (+593086us) raft_consensus.cc:1685] finished
0709 14:51:32.334832 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:51:32.334968 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":102013,"threads_started":1,"wal-append.queue_time_us":565447}
W20260709 14:51:32.347110  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:32.263317 10104 consensus_queue.cc:237] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:32.359469  7819 leader_election.cc:304] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:32.366777  7819 leader_election.cc:304] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:32.368795 10117 leader_election.cc:290] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 5 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:32.369285 10193 raft_consensus.cc:2804] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 14:51:32.369841 10193 raft_consensus.cc:493] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:32.369979 10117 raft_consensus.cc:2749] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 14:51:32.370951  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:32.376024  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:32.376801  7846 raft_consensus.cc:3060] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Advancing to term 5
I20260709 14:51:32.353794 10175 raft_consensus.cc:3060] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:51:32.352849 10183 raft_consensus.cc:3060] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:51:32.385938  7819 leader_election.cc:304] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:32.388468  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:32.391984  7819 leader_election.cc:304] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:32.392669  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:32.393195 10123 raft_consensus.cc:2749] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 14:51:32.393654  7852 raft_consensus.cc:3060] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:51:32.393918  7819 leader_election.cc:304] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 9418391fa82a42c79c6cad13ba91d964
I20260709 14:51:32.355269 10173 raft_consensus.cc:493] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:32.353377 10141 leader_election.cc:290] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:32.347265 10186 raft_consensus.cc:2749] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 14:51:32.397759  7846 raft_consensus.cc:2468] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 5.
I20260709 14:51:32.399044  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:32.382948 10193 raft_consensus.cc:3060] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Advancing to term 7
W20260709 14:51:32.407799 10159 log.cc:927] Time spent T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.911s	user 0.008s	sys 0.005s
I20260709 14:51:32.310957 10182 raft_consensus.cc:515] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:32.408792 10021 leader_election.cc:290] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:32.412514  8639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9441e831627143a991a1556dcdce71e3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9418391fa82a42c79c6cad13ba91d964" is_pre_election: true
I20260709 14:51:32.408951 10094 leader_election.cc:290] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:32.397768 10164 raft_consensus.cc:493] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:32.395629  9757 raft_consensus.cc:493] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:32.398734 10173 raft_consensus.cc:3060] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:51:32.419838  7770 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 2122) took 1818 ms. Trace:
I20260709 14:51:32.423125 10103 leader_election.cc:290] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:51:32.462328  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 68491.7us
I20260709 14:51:32.579440 10189 raft_consensus.cc:493] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:51:32.399712 10011 raft_consensus.cc:493] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:32.581182 10156 raft_consensus.cc:493] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:32.581595 10099 raft_consensus.cc:3055] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 LEADER]: Stepping down as leader of term 5
I20260709 14:51:32.436604 10123 raft_consensus.cc:2749] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 14:51:32.586869  7772 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47054 (request call id 132) took 1467 ms. Trace:
I20260709 14:51:32.589140 10170 raft_consensus.cc:2749] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 14:51:32.589864 10049 raft_consensus.cc:3060] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Advancing to term 6
W20260709 14:51:32.591596 10144 log.cc:927] Time spent T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 1.254s	user 0.007s	sys 0.015s
W20260709 14:51:32.579542  7893 leader_election.cc:336] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Timed out: RequestConsensusVote RPC to 127.6.101.65:40587 timed out after 2.712s (SENT)
I20260709 14:51:32.723618  7893 leader_election.cc:304] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:32.723814  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:32.626243 10140 raft_consensus.cc:493] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:32.626855 10132 leader_election.cc:290] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:32.631279 10193 raft_consensus.cc:515] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:32.633453  7852 raft_consensus.cc:2468] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 6.
I20260709 14:51:32.643801  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:32.661064  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:32.728396  7776 raft_consensus.cc:2468] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 6.
I20260709 14:51:32.668005  7744 leader_election.cc:304] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
W20260709 14:51:32.730057  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 62139.2us
I20260709 14:51:32.730933  7744 leader_election.cc:304] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:51:32.696115  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:32.700672  7819 leader_election.cc:304] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:32.705376 10191 raft_consensus.cc:493] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:51:32.696950 10164 raft_consensus.cc:515] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:32.700886  9757 raft_consensus.cc:515] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:32.720992 10098 raft_consensus.cc:493] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
W20260709 14:51:32.701155 10150 log.cc:927] Time spent T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 14:51:32.675282 10113 raft_consensus.cc:493] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
W20260709 14:51:32.704521 10161 consensus_meta.cc:287] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent flushing consensus metadata: real 1.009s	user 0.010s	sys 0.012s
I20260709 14:51:32.709650 10182 leader_election.cc:290] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:32.744721  9757 leader_election.cc:290] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:32.696112  7770 rpcz_store.cc:276] 0709 14:51:30.601990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:31.190034 (+588044us) service_pool.cc:224] Handling call
0709 14:51:31.198710 (+  8676us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:51:31.199175 (+   465us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 14:51:31.228267 (+ 29092us) log.cc:844] Serialized 14 byte log entry
0709 14:51:31.478886 (+250619us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:51:31.558210 (+ 79324us) log.cc:844] Serialized 26 byte log entry
0709 14:51:31.558756 (+   546us) raft_consensus.cc:1645] Marking committed up to 5
0709 14:51:31.588035 (+ 29279us) log.cc:844] Serialized 14 byte log entry
0709 14:51:31.588294 (+   259us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:31.588380 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:51:31.731819 (+143439us) spinlock_profiling.cc:243] Waited 4.55 ms on lock 0x7b18001c7620. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb690c69de1 00007fb690c765b1 00007fb687da1522 00007fb687da37c1 00007fb687da3779 00007fb687da3709 00007fb687da36d1 00007fb687da29cd 0000000000396ad4 0000000000396919 00007fb687d8483a
0709 14:51:32.278281 (+546462us) spinlock_profiling.cc:243] Waited 6 ms on lock 0x7b18001c7620. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb690c69de1 00007fb690c765b1 00007fb687da1522 00007fb687da37c1 00007fb687da3779 00007fb687da3709 00007fb687da36d1 00007fb687da29cd 0000000000396ad4 0000000000396919 00007fb687d8483a
0709 14:51:32.419248 (+140967us) raft_consensus.cc:1685] finished
0709 14:51:32.419282 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:51:32.419720 (+   438us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":50363,"prepare.queue_time_us":752091,"prepare.run_cpu_time_us":115,"prepare.run_wall_time_us":2301,"raft.queue_time_us":1100,"raft.run_cpu_time_us":551,"raft.run_wall_time_us":16911,"spinlock_wait_cycles":24263296,"thread_start_us":205390,"threads_started":1,"wal-append.queue_time_us":721154}
I20260709 14:51:32.715435 10189 raft_consensus.cc:515] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:32.747767 10189 leader_election.cc:290] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:32.717227 10099 raft_consensus.cc:740] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:51:32.717357  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:32.741304 10183 raft_consensus.cc:2749] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 14:51:32.719169 10011 raft_consensus.cc:515] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:32.717753  7845 raft_consensus.cc:1275] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 14:51:32.751806  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:32.717590  7772 rpcz_store.cc:276] 0709 14:51:31.119590 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:31.809063 (+689473us) service_pool.cc:224] Handling call
0709 14:51:31.829855 (+ 20792us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:51:32.124129 (+294274us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:51:32.124182 (+    53us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:51:32.124271 (+    89us) raft_consensus.cc:1645] Marking committed up to 6
0709 14:51:32.124331 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:32.586573 (+462242us) spinlock_profiling.cc:243] Waited 88.8 ms on lock 0x7b5400323f54. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae8ee01 00007fb68ae8d83e 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2 00007fb6891c948c 00007fb6891c88c6
0709 14:51:32.586625 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:51:32.586791 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":204300544}
I20260709 14:51:32.684547 10094 raft_consensus.cc:493] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:32.520431  9776 raft_consensus.cc:493] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:51:32.695968 10042 raft_consensus.cc:493] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:32.734144  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:32.734057  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:32.771242  7776 raft_consensus.cc:2468] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 7.
W20260709 14:51:32.734560  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 155081us
W20260709 14:51:32.763767  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 63272.2us
I20260709 14:51:32.741540  7851 raft_consensus.cc:1275] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 7. (term mismatch)
I20260709 14:51:32.743896  9929 raft_consensus.cc:2749] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 14:51:32.748411 10098 raft_consensus.cc:515] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:32.716279  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:32.754944  7772 raft_consensus.cc:1275] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 14:51:32.776865  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
W20260709 14:51:32.760154  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:51:32.744776 10200 log.cc:927] Time spent T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 14:51:32.738075  7853 raft_consensus.cc:1240] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 6. Current term is 7. Ops: []
I20260709 14:51:32.772643  7851 pending_rounds.cc:85] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting all ops after (but not including) 6
W20260709 14:51:32.781302  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:32.782197  7851 pending_rounds.cc:107] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260709 14:51:32.782491  7851 raft_consensus.cc:2889] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:51:32.773036  7819 leader_election.cc:304] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:32.774612  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
W20260709 14:51:32.775792  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:32.775816  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:32.776405  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:32.777635  7926 raft_consensus.cc:2468] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 5.
I20260709 14:51:32.780126  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:32.775362  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:32.753328  9766 raft_consensus.cc:2804] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader election won for term 7
I20260709 14:51:32.777561  7920 raft_consensus.cc:1275] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 14:51:32.778384  7922 raft_consensus.cc:1275] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 14:51:32.740504 10106 raft_consensus.cc:2804] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader election won for term 8
W20260709 14:51:32.778455  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:32.786700  7819 leader_election.cc:304] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:32.783825  7924 raft_consensus.cc:2468] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 6.
I20260709 14:51:32.788869  7928 raft_consensus.cc:1275] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:51:32.796209  7819 leader_election.cc:304] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:32.798292  7819 leader_election.cc:304] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:32.799055 10183 raft_consensus.cc:2749] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 14:51:32.799539 10123 consensus_queue.cc:1048] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 14:51:32.800197 10175 raft_consensus.cc:2804] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 14:51:32.804677 10175 raft_consensus.cc:493] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:32.805142 10175 raft_consensus.cc:3060] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Advancing to term 4
W20260709 14:51:32.785418 10166 log.cc:927] Time spent T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.165s	user 0.000s	sys 0.001s
I20260709 14:51:32.810189  7819 leader_election.cc:304] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
W20260709 14:51:32.812774  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:51:32.791237  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 54980.3us
I20260709 14:51:32.811911  7919 raft_consensus.cc:3060] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:51:32.749907 10099 consensus_queue.cc:260] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:32.743994 10113 raft_consensus.cc:515] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:32.816870  7819 leader_election.cc:304] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:32.829042  7819 leader_election.cc:304] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:32.722359 10156 raft_consensus.cc:515] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:32.744357 10161 raft_consensus.cc:515] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:32.771144 10094 raft_consensus.cc:515] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:32.835675  7819 leader_election.cc:304] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:32.795361 10104 raft_consensus.cc:2804] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 14:51:32.782789 10042 raft_consensus.cc:515] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:32.776225  9776 raft_consensus.cc:515] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:32.855988  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:32.814234 10123 raft_consensus.cc:2804] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 14:51:32.857587  7923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38532 (request call id 2628) took 1829 ms. Trace:
W20260709 14:51:32.866791  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 64916.1us
I20260709 14:51:32.830528 10120 raft_consensus.cc:2804] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 14:51:32.753811 10191 raft_consensus.cc:515] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:32.872651  7923 rpcz_store.cc:276] 0709 14:51:31.008667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:31.008812 (+   145us) service_pool.cc:224] Handling call
0709 14:51:31.009283 (+   471us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:51:31.009825 (+   542us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:51:31.009858 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:51:31.010600 (+   742us) log.cc:844] Serialized 26 byte log entry
0709 14:51:31.215383 (+204783us) raft_consensus.cc:1645] Marking committed up to 3
0709 14:51:31.215443 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:31.215520 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:51:32.590531 (+1375011us) spinlock_profiling.cc:243] Waited 2.84 ms on lock 0x7b4400022b4c. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb687c29db1 00007fb687cc7c85 00007fb687cc86a2 00007fb68aa3a1db 00007fb68aa35aaf 00007fb68aa2986e 00007fb68aa28bb6 00007fb68aa287d8 00007fb68aa32221 00007fb68aa321d9 00007fb68aa32169
0709 14:51:32.832294 (+241763us) raft_consensus.cc:1685] finished
0709 14:51:32.832319 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:51:32.838452 (+  6133us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4372,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":130,"spinlock_wait_cycles":6532864,"thread_start_us":204307,"threads_started":1,"wal-append.queue_time_us":268408}
I20260709 14:51:32.874476  7777 raft_consensus.cc:3060] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:51:32.878141  7919 raft_consensus.cc:2468] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 4.
I20260709 14:51:32.874722  7894 leader_election.cc:304] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:32.837174 10168 raft_consensus.cc:493] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:51:32.879521  7743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:32.812352 10183 consensus_queue.cc:1048] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.053s
I20260709 14:51:32.812548 10021 consensus_queue.cc:1059] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 14:51:32.836318 10011 leader_election.cc:290] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:32.833981 10196 raft_consensus.cc:2749] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 14:51:32.884209 10120 raft_consensus.cc:493] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:32.752166 10140 raft_consensus.cc:515] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:32.881139 10193 leader_election.cc:290] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 7 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:51:32.898809 10201 log.cc:927] Time spent T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 14:51:32.872618 10123 raft_consensus.cc:493] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:32.899300 10168 raft_consensus.cc:515] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:32.837042  9741 consensus_queue.cc:1048] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.052s
I20260709 14:51:32.830892 10189 consensus_queue.cc:1048] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.050s
I20260709 14:51:32.871567 10106 raft_consensus.cc:697] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:51:32.880071 10099 raft_consensus.cc:3060] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:51:32.859160 10104 raft_consensus.cc:493] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:32.901930  9766 raft_consensus.cc:697] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:51:32.900714 10048 raft_consensus.cc:2804] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 14:51:32.923946  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 90398.1us
I20260709 14:51:32.900723 10183 raft_consensus.cc:2749] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 14:51:32.908601 10120 raft_consensus.cc:3060] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:51:32.965572 10214 raft_consensus.cc:493] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
W20260709 14:51:32.930727  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 95245.2us
W20260709 14:51:32.937289  7745 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 1.561s (SENT) [suppressed 70 similar messages]
I20260709 14:51:32.957192  7744 leader_election.cc:304] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 9418391fa82a42c79c6cad13ba91d964
I20260709 14:51:32.925289 10123 raft_consensus.cc:3060] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:51:32.959779 10164 leader_election.cc:290] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:32.960417 10161 leader_election.cc:290] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 6 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:32.960027 10106 consensus_queue.cc:237] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:32.902384 10173 raft_consensus.cc:515] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:32.974155  7819 leader_election.cc:304] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
W20260709 14:51:32.978276  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 56824.9us
I20260709 14:51:32.951714 10104 raft_consensus.cc:3060] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:51:32.980643  7779 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 2135) took 2261 ms. Trace:
W20260709 14:51:32.983623  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 176895us
I20260709 14:51:32.966475 10214 raft_consensus.cc:515] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:32.994158 10221 raft_consensus.cc:493] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:32.994323 10164 consensus_queue.cc:1048] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 14:51:32.995273 10214 leader_election.cc:290] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:32.987088 10183 raft_consensus.cc:2749] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 14:51:32.976257 10048 raft_consensus.cc:697] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:32.988605  7894 leader_election.cc:304] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:32.989308  7819 leader_election.cc:304] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:32.987182 10021 consensus_queue.cc:1048] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 14:51:32.991853  7779 rpcz_store.cc:276] 0709 14:51:30.719440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:31.253801 (+534361us) service_pool.cc:224] Handling call
0709 14:51:31.287280 (+ 33479us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 14:51:31.287629 (+   349us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:51:31.287670 (+    41us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 14:51:31.303118 (+ 15448us) log.cc:844] Serialized 52 byte log entry
0709 14:51:31.458329 (+155211us) raft_consensus.cc:1645] Marking committed up to 5
0709 14:51:31.464021 (+  5692us) log.cc:844] Serialized 14 byte log entry
0709 14:51:31.559946 (+ 95925us) log.cc:844] Serialized 14 byte log entry
0709 14:51:31.560200 (+   254us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:31.560289 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:51:32.353554 (+793265us) spinlock_profiling.cc:243] Waited 1.98 ms on lock 0x7b18003acfc0. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb690c69de1 00007fb690c765b1 00007fb687da13f3 00007fb687da37c1 00007fb687da3779 00007fb687da3709 00007fb687da36d1 00007fb687da29cd 0000000000396ad4 0000000000396919 00007fb687d8483a
0709 14:51:32.426146 (+ 72592us) spinlock_profiling.cc:243] Waited 5.38 ms on lock 0x7b18003acfc0. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb690c69de1 00007fb690c765b1 00007fb687da13f3 00007fb687da37c1 00007fb687da3779 00007fb687da3709 00007fb687da36d1 00007fb687da29cd 0000000000396ad4 0000000000396919 00007fb687d8483a
0709 14:51:32.977599 (+551453us) raft_consensus.cc:1685] finished
0709 14:51:32.977629 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:51:32.980572 (+  2943us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":60046,"prepare.queue_time_us":24018,"prepare.run_cpu_time_us":172,"prepare.run_wall_time_us":15987,"raft.queue_time_us":38391,"raft.run_cpu_time_us":469,"raft.run_wall_time_us":26496,"spinlock_wait_cycles":16939136,"thread_start_us":120213,"threads_started":1,"wal-append.queue_time_us":182882}
I20260709 14:51:32.975389 10132 raft_consensus.cc:493] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:51:32.996034 10205 raft_consensus.cc:493] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:33.005295  7819 leader_election.cc:304] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:33.002321  7854 raft_consensus.cc:1240] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 2. Current term is 3. Ops: []
I20260709 14:51:33.003676 10021 consensus_queue.cc:1243] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer 3876b8ee8d744cb18e91d97aae93b1ac log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 14:51:32.991245 10098 leader_election.cc:290] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:33.020169  7845 pending_rounds.cc:85] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting all ops after (but not including) 3
I20260709 14:51:33.020506  7845 pending_rounds.cc:107] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 14:51:33.020798  7845 raft_consensus.cc:2889] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:51:33.022907  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:33.023697  7852 raft_consensus.cc:2468] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 7.
I20260709 14:51:33.020810  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c563cc7cfbe4d59be4ffc5cf847ce56" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:33.019909  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:33.025691  7851 raft_consensus.cc:2468] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 1.
I20260709 14:51:33.027910  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:33.028612  7850 raft_consensus.cc:2468] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 4.
I20260709 14:51:33.004617 10156 leader_election.cc:290] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:51:33.063076  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 64763.8us
I20260709 14:51:33.006986 10193 raft_consensus.cc:2804] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 14:51:33.059139  7848 raft_consensus.cc:2393] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 6: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
W20260709 14:51:33.066969  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 129781us
I20260709 14:51:33.012707 10214 raft_consensus.cc:2804] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 14:51:32.999326 10011 consensus_queue.cc:1048] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
W20260709 14:51:33.078125 10203 log.cc:927] Time spent T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.223s	user 0.000s	sys 0.002s
I20260709 14:51:33.035215 10098 raft_consensus.cc:2749] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 14:51:33.035926 10094 leader_election.cc:290] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:32.995294 10221 raft_consensus.cc:515] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:33.036677 10211 raft_consensus.cc:2804] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 14:51:33.037875 10208 raft_consensus.cc:493] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:51:33.096778 10178 log.cc:927] Time spent T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 1.238s	user 0.015s	sys 0.000s
I20260709 14:51:33.011765 10132 raft_consensus.cc:515] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:33.068296 10186 raft_consensus.cc:493] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:33.068789 10193 raft_consensus.cc:493] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:33.035450 10161 consensus_queue.cc:1059] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 14:51:33.072827  9776 leader_election.cc:290] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:33.065548 10215 consensus_queue.cc:1059] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 14:51:33.071566 10214 raft_consensus.cc:493] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:33.059334 10021 consensus_queue.cc:1048] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 14:51:33.111158 10193 raft_consensus.cc:3060] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Advancing to term 8
I20260709 14:51:33.034545  9766 consensus_queue.cc:237] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:33.143570 10207 log.cc:927] Time spent T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.183s	user 0.002s	sys 0.000s
W20260709 14:51:33.144579 10206 log.cc:927] Time spent T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.150s	user 0.001s	sys 0.000s
I20260709 14:51:33.148017 10218 raft_consensus.cc:493] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:33.125839 10214 raft_consensus.cc:3060] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Advancing to term 8
I20260709 14:51:33.117100 10098 raft_consensus.cc:493] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
W20260709 14:51:33.159085  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:33.209594 10224 raft_consensus.cc:493] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:33.134286 10183 raft_consensus.cc:493] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:33.032630 10205 raft_consensus.cc:515] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:33.094177 10048 consensus_queue.cc:237] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:33.240600  7777 raft_consensus.cc:2468] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 5.
I20260709 14:51:33.135161 10191 leader_election.cc:290] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:33.167238 10098 raft_consensus.cc:515] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:33.229355 10120 raft_consensus.cc:515] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:33.265018 10104 raft_consensus.cc:515] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:33.267037  7774 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 2133) took 2571 ms. Trace:
I20260709 14:51:33.299449 10098 leader_election.cc:290] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:33.302240 10120 leader_election.cc:290] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 5 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:51:33.307603  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:33.310742  7853 pending_rounds.cc:85] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting all ops after (but not including) 4
I20260709 14:51:33.316190  7853 pending_rounds.cc:107] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 14:51:33.316596  7853 raft_consensus.cc:2889] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:51:33.317656  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:33.311694  7847 raft_consensus.cc:1240] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 14:51:33.311843  7848 raft_consensus.cc:1240] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 14:51:33.210606 10224 raft_consensus.cc:515] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:33.312722  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:33.296674  7774 rpcz_store.cc:276] 0709 14:51:30.695279 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:31.249820 (+554541us) service_pool.cc:224] Handling call
0709 14:51:31.250258 (+   438us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:51:31.330279 (+ 80021us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:51:31.330314 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:51:31.334599 (+  4285us) log.cc:844] Serialized 26 byte log entry
0709 14:51:31.469108 (+134509us) raft_consensus.cc:1645] Marking committed up to 3
0709 14:51:31.534066 (+ 64958us) log.cc:844] Serialized 14 byte log entry
0709 14:51:31.534428 (+   362us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:31.730644 (+196216us) spinlock_profiling.cc:243] Waited 3.88 ms on lock 0x7b480006c3d8. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68fdb7aa1 00007fb68fdaeb37 00007fb68fdae9ca 00007fb68fea626f 00007fb68fea5f37 00007fb68feba55c 00007fb68feba508 00007fb68feba488 00007fb68feba443 00007fb68feb96ec 00007fb68ede3a96
0709 14:51:33.211342 (+1480698us) spinlock_profiling.cc:243] Waited 69.4 ms on lock 0x7b5400324e54. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae8ee01 00007fb68ae8d83e 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2 00007fb6891c948c 00007fb6891c88c6
0709 14:51:33.211461 (+   119us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:51:33.266693 (+ 55232us) raft_consensus.cc:1685] finished
0709 14:51:33.266713 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:51:33.266962 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12973,"prepare.queue_time_us":71165,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":49,"raft.queue_time_us":12731,"raft.run_cpu_time_us":2667,"raft.run_wall_time_us":400578,"spinlock_wait_cycles":172240000,"thread_start_us":96337,"threads_started":1,"wal-append.queue_time_us":249766,"wal-append.run_cpu_time_us":2850,"wal-append.run_wall_time_us":1117667}
W20260709 14:51:33.321264  7743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:33.313526  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:33.217983 10140 leader_election.cc:290] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:33.123011 10208 raft_consensus.cc:515] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:33.319617  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:33.130340 10186 raft_consensus.cc:515] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:33.269506 10183 raft_consensus.cc:515] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:33.317772 10173 leader_election.cc:290] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 3 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:33.289690 10168 leader_election.cc:290] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:33.376878 10123 raft_consensus.cc:515] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:33.391614 10123 leader_election.cc:290] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 7 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:33.397603 10216 raft_consensus.cc:493] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:33.398751 10216 raft_consensus.cc:515] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:33.402985  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:33.403997  7848 raft_consensus.cc:2393] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 3: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
W20260709 14:51:33.404757  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:33.443372  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:33.445183  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:33.446789  7848 raft_consensus.cc:2410] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 14:51:33.443427  7778 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 2128) took 2757 ms. Trace:
I20260709 14:51:33.455642  7852 raft_consensus.cc:1275] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 14:51:33.338878 10208 leader_election.cc:290] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:33.460203  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:33.461381  7847 raft_consensus.cc:1240] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 5. Current term is 6. Ops: []
I20260709 14:51:33.371137 10221 leader_election.cc:290] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:33.212001 10218 raft_consensus.cc:515] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:33.551771  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:33.552068  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:34.072093  7850 raft_consensus.cc:3060] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:51:33.539916  7849 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 2327) took 2124 ms. Trace:
W20260709 14:51:33.716899  7845 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.687s	user 0.035s	sys 0.046s
W20260709 14:51:33.941546  9659 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.821s	user 0.014s	sys 0.017s
W20260709 14:51:33.957959  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:51:33.710934  7744 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.724s	user 0.021s	sys 0.036s
W20260709 14:51:34.075133  7744 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.089s	user 0.032s	sys 0.058s
W20260709 14:51:34.076099  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 1.11901e+06us
W20260709 14:51:34.073698  9659 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.958s	user 0.018s	sys 0.019s
I20260709 14:51:33.531072  7854 raft_consensus.cc:1240] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 7. Current term is 8. Ops: [7.7-7.7]
W20260709 14:51:33.767618  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:51:34.073307  7845 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.050s	user 0.051s	sys 0.064s
W20260709 14:51:34.083308  7893 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.799s	user 0.003s	sys 0.011s
W20260709 14:51:33.782653  7743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:51:33.538697  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:33.453022  7778 rpcz_store.cc:276] 0709 14:51:30.637362 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:31.201836 (+564474us) service_pool.cc:224] Handling call
0709 14:51:31.202194 (+   358us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:51:31.410907 (+208713us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:51:31.410943 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:51:31.429839 (+ 18896us) log.cc:844] Serialized 26 byte log entry
0709 14:51:31.705727 (+275888us) raft_consensus.cc:1645] Marking committed up to 6
0709 14:51:31.729663 (+ 23936us) log.cc:844] Serialized 14 byte log entry
0709 14:51:31.739415 (+  9752us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:33.366147 (+1626732us) spinlock_profiling.cc:243] Waited 96.6 ms on lock 0x7b54002de6d4. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae8ee01 00007fb68ae8d83e 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2 00007fb6891c948c 00007fb6891c88c6
0709 14:51:33.366230 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:51:33.366311 (+    81us) raft_consensus.cc:1685] finished
0709 14:51:33.372815 (+  6504us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:51:33.394340 (+ 21525us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9346,"prepare.queue_time_us":18904,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":45,"raft.queue_time_us":20364,"raft.run_cpu_time_us":432,"raft.run_wall_time_us":5916,"spinlock_wait_cycles":222131584,"thread_start_us":380253,"threads_started":2,"wal-append.queue_time_us":331386,"wal-append.run_cpu_time_us":10143,"wal-append.run_wall_time_us":1502936}
W20260709 14:51:34.083693  7893 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.800s	user 0.003s	sys 0.011s
I20260709 14:51:33.373157 10098 raft_consensus.cc:493] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:51:34.093990  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 810240us
I20260709 14:51:34.102567  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783e4874513449ef9084b833f188a6d3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:34.087392  7744 leader_election.cc:304] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:51:34.114277  7852 raft_consensus.cc:2468] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 4.
W20260709 14:51:33.913421 10106 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.830s	user 0.023s	sys 0.054s
I20260709 14:51:34.121809  7744 leader_election.cc:304] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
W20260709 14:51:33.910120 10175 consensus_meta.cc:287] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent flushing consensus metadata: real 1.105s	user 0.009s	sys 0.005s
I20260709 14:51:34.084906  7846 raft_consensus.cc:1240] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 14:51:34.130075  7846 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff"
dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
mode: GRACEFUL
new_leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:41662
I20260709 14:51:34.131153  7846 raft_consensus.cc:606] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Received request to transfer leadership to TS 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:51:34.131665  7846 raft_consensus.cc:614] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 14:51:34.105123  9784 consensus_queue.cc:1048] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 14:51:34.105697  7851 raft_consensus.cc:2393] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 4: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:51:34.072860  7849 rpcz_store.cc:276] 0709 14:51:31.415824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:31.418404 (+  2580us) service_pool.cc:224] Handling call
0709 14:51:31.418737 (+   333us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:51:31.521273 (+102536us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:51:31.521320 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:51:31.541221 (+ 19901us) log.cc:844] Serialized 26 byte log entry
0709 14:51:33.530009 (+1988788us) spinlock_profiling.cc:243] Waited 1.5 ms on lock 0x7b180040d740. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb690c69de1 00007fb690c765b1 00007fb68aa364bc 00007fb687d8448b 00007fb690bdeab9 00007fb687da069b 00007fb687d9e93f 00007fb687da0c02 00007fb68aa2820b 00007fb68aa2dd23 00007fb68aa2e0d1
0709 14:51:33.530180 (+   171us) raft_consensus.cc:1645] Marking committed up to 6
0709 14:51:33.530217 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:33.530289 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:51:33.530334 (+    45us) raft_consensus.cc:1685] finished
0709 14:51:33.530344 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:51:33.539725 (+  9381us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9724,"raft.queue_time_us":143430,"raft.run_cpu_time_us":257,"raft.run_wall_time_us":17453,"spinlock_wait_cycles":3443584,"thread_start_us":130918,"threads_started":2,"wal-append.queue_time_us":119572,"wal-append.run_cpu_time_us":2467,"wal-append.run_wall_time_us":1038649}
I20260709 14:51:34.134099  7852 raft_consensus.cc:1240] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 4. Current term is 5. Ops: [4.4-4.4]
W20260709 14:51:33.974948 10211 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.814s	user 0.017s	sys 0.015s
I20260709 14:51:34.049199 10202 raft_consensus.cc:493] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:34.103914  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:33.547837 10208 raft_consensus.cc:493] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:33.579728 10132 leader_election.cc:290] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:33.953397 10073 raft_consensus.cc:493] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:34.144825  9659 raft_consensus.cc:493] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:51:34.154127  9659 raft_consensus.cc:515] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:34.066335 10216 leader_election.cc:290] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:51:34.147471  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:33.967525 10205 leader_election.cc:290] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:34.138382  7852 raft_consensus.cc:3060] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [term 1 FOLLOWER]: Advancing to term 2
W20260709 14:51:34.084048 10215 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.773s	user 0.003s	sys 0.008s
I20260709 14:51:34.066278 10224 leader_election.cc:290] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:51:34.129148 10106 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.046s	user 0.025s	sys 0.057s
I20260709 14:51:33.631484 10127 raft_consensus.cc:493] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:34.174537  9659 leader_election.cc:290] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:34.148464 10109 raft_consensus.cc:2804] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader election won for term 7
I20260709 14:51:34.124742 10098 raft_consensus.cc:515] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:34.142832 10175 raft_consensus.cc:515] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:34.182394 10216 raft_consensus.cc:2804] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 14:51:34.105880 10117 raft_consensus.cc:2749] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 14:51:34.141417 10211 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.007s	user 0.021s	sys 0.017s
I20260709 14:51:34.100102 10154 raft_consensus.cc:493] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:34.180263 10183 leader_election.cc:290] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:34.156358 10208 raft_consensus.cc:515] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:34.172465 10202 raft_consensus.cc:515] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:34.171464 10073 raft_consensus.cc:515] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:34.225204 10215 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.014s	user 0.004s	sys 0.009s
W20260709 14:51:34.256748  7853 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.897s	user 0.043s	sys 0.075s
I20260709 14:51:34.261230  7852 raft_consensus.cc:1275] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 14:51:34.265452  7853 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.917s	user 0.043s	sys 0.075s
I20260709 14:51:34.235035 10216 raft_consensus.cc:493] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 14:51:34.225751 10161 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.088s	user 0.060s	sys 0.040s
W20260709 14:51:34.273952  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 152240us
I20260709 14:51:34.275689  7744 leader_election.cc:304] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:51:34.246227 10211 raft_consensus.cc:697] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:34.281553  6549 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 14:51:34.289037  7744 leader_election.cc:304] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
W20260709 14:51:34.276335 10161 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.142s	user 0.060s	sys 0.041s
I20260709 14:51:34.234146 10127 raft_consensus.cc:515] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:34.264540 10109 raft_consensus.cc:697] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:51:34.263900 10224 raft_consensus.cc:493] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:34.275089 10216 raft_consensus.cc:3060] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:51:34.274129 10215 raft_consensus.cc:493] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:34.312875  7893 leader_election.cc:304] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:34.261014 10154 raft_consensus.cc:515] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:34.322794  7849 raft_consensus.cc:1275] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 6. (term mismatch)
W20260709 14:51:34.323128 10214 consensus_meta.cc:287] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent flushing consensus metadata: real 1.112s	user 0.013s	sys 0.000s
I20260709 14:51:34.323236  7849 pending_rounds.cc:85] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting all ops after (but not including) 5
I20260709 14:51:34.323688  7849 pending_rounds.cc:107] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting uncommitted NO_OP operation due to leader change: 6.6
I20260709 14:51:34.283375 10205 consensus_queue.cc:1048] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 14:51:34.324174  7849 raft_consensus.cc:2889] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:51:34.322234 10240 raft_consensus.cc:493] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:34.292544 10106 raft_consensus.cc:2804] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 14:51:34.285483 10235 raft_consensus.cc:493] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:34.298355 10234 raft_consensus.cc:493] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:34.328776 10240 raft_consensus.cc:515] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:34.337188 10226 raft_consensus.cc:2804] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 14:51:34.357185  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 1.28766e+06us
I20260709 14:51:34.338369  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:34.359128  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:34.339372  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:34.339977  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258d6c2dda954bf5b65930fde8ecb9f3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:34.341409  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:34.283092  9784 consensus_queue.cc:1048] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 14:51:34.310921 10221 raft_consensus.cc:2804] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader election won for term 4
I20260709 14:51:34.345743  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:34.366833  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:34.330698 10106 raft_consensus.cc:493] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:34.347991  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:34.374346  7928 raft_consensus.cc:2468] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 8.
W20260709 14:51:34.325498  8596 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.038s	sys 0.061s
I20260709 14:51:34.377722 10109 consensus_queue.cc:237] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:34.383591  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:34.384222 10238 raft_consensus.cc:493] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:34.385134 10238 raft_consensus.cc:515] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:34.386222 10239 raft_consensus.cc:493] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:34.386976 10239 raft_consensus.cc:515] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:34.387939 10117 raft_consensus.cc:493] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:34.388779 10073 leader_election.cc:290] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:34.326581 10215 raft_consensus.cc:515] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:34.331589 10183 raft_consensus.cc:493] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:34.389788 10183 raft_consensus.cc:515] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:34.391130 10215 leader_election.cc:290] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:34.300680 10229 consensus_queue.cc:1048] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.077s
I20260709 14:51:34.347198  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:34.392302  7921 raft_consensus.cc:2468] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 7.
I20260709 14:51:34.392719 10183 leader_election.cc:290] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:34.361482 10234 raft_consensus.cc:515] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:34.384406  7778 raft_consensus.cc:2468] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 8.
W20260709 14:51:34.394249 10228 log.cc:927] Time spent T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
W20260709 14:51:34.394842 10099 consensus_meta.cc:287] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent flushing consensus metadata: real 1.443s	user 0.009s	sys 0.007s
I20260709 14:51:34.396289 10234 leader_election.cc:290] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:34.397205  7845 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 2368) took 1377 ms. Trace:
I20260709 14:51:34.399573 10239 leader_election.cc:290] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:34.352283  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:34.402084 10175 leader_election.cc:290] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 4 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:34.402757 10175 raft_consensus.cc:493] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:34.403306 10175 raft_consensus.cc:515] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:34.401858 10246 raft_consensus.cc:493] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:34.404444 10246 raft_consensus.cc:515] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:34.335489 10161 raft_consensus.cc:493] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
W20260709 14:51:34.372138  7777 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37144 (request call id 2157) took 1729 ms (client timeout 1921 ms). Trace:
I20260709 14:51:34.323639 10214 raft_consensus.cc:515] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:34.381098  7770 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 2165) took 1717 ms. Trace:
I20260709 14:51:34.418644  7850 raft_consensus.cc:2468] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 7.
I20260709 14:51:34.419009  7770 rpcz_store.cc:276] 0709 14:51:32.663986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:32.748403 (+ 84417us) service_pool.cc:224] Handling call
0709 14:51:32.748715 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:51:32.871648 (+122933us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:51:32.871680 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:51:32.871724 (+    44us) raft_consensus.cc:1645] Marking committed up to 2
0709 14:51:32.871764 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:34.380787 (+1509023us) spinlock_profiling.cc:243] Waited 123 ms on lock 0x7b5400221354. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae8ee01 00007fb68ae8d83e 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2 00007fb6891c948c 00007fb6891c88c6
0709 14:51:34.380838 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:51:34.381028 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":282185600}
W20260709 14:51:34.383878  8596 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.662s	user 0.039s	sys 0.062s
I20260709 14:51:34.388578 10117 raft_consensus.cc:515] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:34.323833 10154 leader_election.cc:290] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:34.384992 10054 raft_consensus.cc:3055] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 14:51:34.384603  9766 raft_consensus.cc:493] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:34.379999  7923 raft_consensus.cc:1275] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 14:51:34.406697  7777 rpcz_store.cc:269] 0709 14:51:32.642972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:32.643366 (+   394us) service_pool.cc:224] Handling call
0709 14:51:34.371917 (+1728551us) spinlock_profiling.cc:243] Waited 146 ms on lock 0x7b54002b7fd4. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae922fa 00007fb68fe53b17 00007fb6893ce6d4 00007fb6893ce662 00007fb6893ce591 00007fb6893ce50c 00007fb6893cd7c2 00007fb6891c948c 00007fb6891c88c6 00007fb6891c826f
0709 14:51:34.372064 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":336872192}
I20260709 14:51:34.368705 10202 leader_election.cc:290] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:34.371035 10240 leader_election.cc:290] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:34.397709  7845 rpcz_store.cc:276] 0709 14:51:33.019395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:33.019493 (+    98us) service_pool.cc:224] Handling call
0709 14:51:33.019948 (+   455us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 14:51:33.022187 (+  2239us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:51:33.022215 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 14:51:33.022914 (+   699us) log.cc:844] Serialized 52 byte log entry
0709 14:51:34.083465 (+1060551us) raft_consensus.cc:1645] Marking committed up to 3
0709 14:51:34.083526 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:34.083610 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:51:34.396426 (+312816us) raft_consensus.cc:1685] finished
0709 14:51:34.396463 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:51:34.397102 (+   639us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":157,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":7248,"spinlock_wait_cycles":56448,"thread_start_us":1060165,"threads_started":1,"wal-append.queue_time_us":1227525}
I20260709 14:51:34.405606 10161 raft_consensus.cc:515] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:34.314988 10224 raft_consensus.cc:515] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:34.438514  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 61715.3us
W20260709 14:51:34.372133 10193 consensus_meta.cc:287] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent flushing consensus metadata: real 1.221s	user 0.009s	sys 0.005s
I20260709 14:51:34.460137  7850 raft_consensus.cc:1275] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 14:51:34.460665  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:34.460119  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9441e831627143a991a1556dcdce71e3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:34.481884  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:34.462976  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:34.482549  7776 raft_consensus.cc:3060] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:51:34.376189 10226 raft_consensus.cc:493] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:34.371148 10042 leader_election.cc:290] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:34.406298 10106 raft_consensus.cc:3060] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:51:34.381589  7922 raft_consensus.cc:1275] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 14:51:34.475495  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:34.491174  7845 raft_consensus.cc:2393] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 3: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
W20260709 14:51:34.374492  7745 connection.cc:256] RPC call timeout handler was delayed by -1.2542868380000982s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1922s for a response
I20260709 14:51:34.476467  7771 raft_consensus.cc:1275] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 14:51:34.477012  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:34.477669  7772 raft_consensus.cc:1275] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 14:51:34.397210 10098 leader_election.cc:290] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:34.406128 10221 raft_consensus.cc:697] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:51:34.480429  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:34.388783 10238 leader_election.cc:290] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:34.465274 10242 raft_consensus.cc:493] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:34.486692  7847 raft_consensus.cc:2393] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 7: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:51:34.470583 10218 leader_election.cc:290] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:34.471518 10054 raft_consensus.cc:740] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:34.535506  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:51:34.538341  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 46181.8us
I20260709 14:51:34.498018 10241 consensus_queue.cc:1048] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.051s
I20260709 14:51:34.480898 10244 raft_consensus.cc:493] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:34.371770 10211 consensus_queue.cc:237] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:34.355373 10235 raft_consensus.cc:515] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:34.542263  7851 raft_consensus.cc:2393] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 7: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:51:34.544482 10154 raft_consensus.cc:493] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:34.544806  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:34.544943 10249 raft_consensus.cc:493] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:34.489426 10226 raft_consensus.cc:3060] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Advancing to term 7
W20260709 14:51:34.546198  7743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:34.547087  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:51:34.558346  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:34.560119  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:34.560788  7847 raft_consensus.cc:2468] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 5.
I20260709 14:51:34.561705  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:34.548197  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:34.550211  7776 raft_consensus.cc:2468] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 7.
W20260709 14:51:34.551213  7745 connection.cc:256] RPC call timeout handler was delayed by -1.1183868380001059s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2073s for a response
I20260709 14:51:34.563212  7771 raft_consensus.cc:3060] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:51:34.564795  7745 leader_election.cc:304] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:34.538501  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:34.489161 10240 raft_consensus.cc:493] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:34.556286  7850 raft_consensus.cc:2468] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 6.
I20260709 14:51:34.565758  7777 raft_consensus.cc:2468] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 6.
I20260709 14:51:34.557302  7845 raft_consensus.cc:2393] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 8: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:51:34.566980  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:34.567191  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:34.557909  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
W20260709 14:51:34.543869 10237 log.cc:927] Time spent T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.128s	user 0.002s	sys 0.000s
I20260709 14:51:34.567938  7776 raft_consensus.cc:3060] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:51:34.567849  7845 raft_consensus.cc:2393] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 6: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:51:34.572620  7772 raft_consensus.cc:2393] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 6: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:51:34.481966  9766 raft_consensus.cc:515] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:34.573627  7745 leader_election.cc:304] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:34.487780 10193 raft_consensus.cc:515] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:34.574630  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:34.575320  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:34.579715  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:34.585227  7851 raft_consensus.cc:2468] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 7.
I20260709 14:51:34.581471  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:34.582067  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:34.586396  7745 leader_election.cc:304] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:34.586550  7845 raft_consensus.cc:2468] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 8.
I20260709 14:51:34.587464  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:34.587647  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258d6c2dda954bf5b65930fde8ecb9f3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:34.584659  7777 raft_consensus.cc:2393] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 7: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:51:34.587571  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:34.585992  7776 raft_consensus.cc:2468] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 3.
I20260709 14:51:34.555476 10214 leader_election.cc:290] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 8 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:34.590608  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:34.588140  7850 raft_consensus.cc:2468] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 9.
I20260709 14:51:34.592883  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:34.598232  7777 raft_consensus.cc:2468] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 6.
I20260709 14:51:34.598804  7776 raft_consensus.cc:3060] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:51:34.599393  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:34.589787 10153 consensus_queue.cc:1048] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 14:51:34.559130 10208 leader_election.cc:290] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:34.555787 10113 leader_election.cc:290] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:34.554309 10244 raft_consensus.cc:515] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:34.608107  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:34.573477 10109 raft_consensus.cc:2749] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 14:51:34.613517  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:34.614181  7776 raft_consensus.cc:2468] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 7.
I20260709 14:51:34.617033  7851 raft_consensus.cc:2393] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 5: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:51:34.617828  7745 leader_election.cc:304] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
W20260709 14:51:34.615717  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 127443us
I20260709 14:51:34.545595 10242 raft_consensus.cc:515] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:34.619280  7845 raft_consensus.cc:2468] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 3.
I20260709 14:51:34.587908 10103 raft_consensus.cc:2749] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 14:51:34.604745 10229 raft_consensus.cc:2749] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 14:51:34.574265 10218 consensus_queue.cc:1059] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 14:51:34.581051 10238 consensus_queue.cc:1059] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 14:51:34.624603  9784 raft_consensus.cc:2804] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 14:51:34.625221  7771 raft_consensus.cc:2468] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 5.
I20260709 14:51:34.625396 10246 leader_election.cc:290] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:34.649801 10244 leader_election.cc:290] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:34.651603 10175 leader_election.cc:290] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:34.608018 10127 leader_election.cc:290] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:34.558490 10054 consensus_queue.cc:260] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:34.629377 10247 log.cc:927] Time spent T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.136s	user 0.001s	sys 0.003s
I20260709 14:51:34.631834 10216 raft_consensus.cc:515] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:34.619946 10161 leader_election.cc:290] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:34.581117 10240 raft_consensus.cc:515] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:34.569765 10154 raft_consensus.cc:515] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:34.623451  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:34.634073  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:34.635547  7850 raft_consensus.cc:1240] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 5. Current term is 6. Ops: []
I20260709 14:51:34.674953  7777 raft_consensus.cc:3060] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:51:34.620576 10221 consensus_queue.cc:237] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:34.637125  9766 leader_election.cc:290] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:34.638952  7851 raft_consensus.cc:1275] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 14:51:34.639169  7853 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49948 (request call id 2826) took 1329 ms. Trace:
I20260709 14:51:34.622498 10113 consensus_queue.cc:1059] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.018s
W20260709 14:51:34.640992  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:34.646135 10238 raft_consensus.cc:3055] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 LEADER]: Stepping down as leader of term 5
I20260709 14:51:34.638196  7772 raft_consensus.cc:2468] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 6.
I20260709 14:51:34.643036  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:34.637835 10109 consensus_queue.cc:1059] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 14:51:34.639923 10205 consensus_queue.cc:1059] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 14:51:34.675572  7776 raft_consensus.cc:2468] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 8.
I20260709 14:51:34.642343  9784 raft_consensus.cc:493] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
W20260709 14:51:34.691166  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:34.690522  7853 rpcz_store.cc:276] 0709 14:51:33.309853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:33.310050 (+   197us) service_pool.cc:224] Handling call
0709 14:51:33.310497 (+   447us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:51:33.317354 (+  6857us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:51:33.317385 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:51:33.318002 (+   617us) log.cc:844] Serialized 26 byte log entry
0709 14:51:34.268019 (+950017us) raft_consensus.cc:1645] Marking committed up to 4
0709 14:51:34.268070 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:34.268162 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:51:34.638951 (+370789us) raft_consensus.cc:1685] finished
0709 14:51:34.638972 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:51:34.639111 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":919047,"threads_started":1,"wal-append.queue_time_us":1011216}
I20260709 14:51:34.646533 10186 leader_election.cc:290] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:34.636941 10235 leader_election.cc:290] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:34.580840 10249 raft_consensus.cc:515] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:34.709218  7771 raft_consensus.cc:3060] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:51:35.039449  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:34.694201 10238 raft_consensus.cc:740] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:51:35.040908  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:34.693298 10117 leader_election.cc:290] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:34.704738  7849 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49948 (request call id 2845) took 1227 ms. Trace:
I20260709 14:51:34.695760  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:35.042559  7849 rpcz_store.cc:276] 0709 14:51:33.477789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:34.133657 (+655868us) service_pool.cc:224] Handling call
0709 14:51:34.134008 (+   351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:51:34.324833 (+190825us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:34.704436 (+379603us) spinlock_profiling.cc:243] Waited 188 ms on lock 0x7b54000d4654. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae8ee01 00007fb68ae8d83e 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2 00007fb6891c948c 00007fb6891c88c6
0709 14:51:34.704664 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":433278336}
I20260709 14:51:35.044222  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:51:34.755869  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:35.044482  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
W20260709 14:51:35.046150 10251 log.cc:927] Time spent T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.342s	user 0.000s	sys 0.001s
I20260709 14:51:35.040400  7926 raft_consensus.cc:2393] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 7: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:51:35.041827  7921 raft_consensus.cc:2368] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 6. Current term is 7.
I20260709 14:51:34.876055  7851 raft_consensus.cc:1240] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 5. Current term is 6. Ops: []
I20260709 14:51:35.047700  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c563cc7cfbe4d59be4ffc5cf847ce56" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:34.696179  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:35.045650  7849 raft_consensus.cc:2393] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 5: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:51:34.695277  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:34.714923  7847 raft_consensus.cc:2468] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 4.
I20260709 14:51:34.694949  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:35.052937  7920 raft_consensus.cc:2376] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 7. Re-sending same reply.
W20260709 14:51:34.975894  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:34.988960  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:51:35.055061  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:34.875388  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:35.054992  7850 raft_consensus.cc:2468] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 6.
I20260709 14:51:34.833266  7777 raft_consensus.cc:2468] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 6.
I20260709 14:51:34.704229  7779 raft_consensus.cc:1240] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 5. Current term is 6. Ops: []
I20260709 14:51:35.054075  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:51:35.053203  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 362984us
I20260709 14:51:35.062621  7921 raft_consensus.cc:1240] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 14:51:35.068647  7853 raft_consensus.cc:2393] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 6: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:51:35.070073  7926 raft_consensus.cc:1240] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 14:51:35.077214  7771 raft_consensus.cc:2468] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 4.
I20260709 14:51:35.081440  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:35.082685  7771 raft_consensus.cc:2468] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 7.
I20260709 14:51:35.083417  7925 raft_consensus.cc:1240] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 7. Current term is 8. Ops: []
I20260709 14:51:35.084236  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:35.085057  7771 raft_consensus.cc:2468] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 9.
I20260709 14:51:35.086313  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:35.087037  7771 raft_consensus.cc:2468] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 5.
I20260709 14:51:35.087988  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:35.088609  7926 raft_consensus.cc:1240] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 6. Current term is 7. Ops: [5.4-6.5]
W20260709 14:51:35.124925  7743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:35.134275  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:35.136668  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:35.140472  7776 raft_consensus.cc:2468] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 6.
I20260709 14:51:35.147358  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
W20260709 14:51:35.194160  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:51:34.874404 10254 log.cc:927] Time spent T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.183s	user 0.000s	sys 0.001s
I20260709 14:51:35.230741  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:35.231208 10154 leader_election.cc:290] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:35.231709  7850 raft_consensus.cc:2393] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 9: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:51:35.233620  7777 raft_consensus.cc:2468] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 8.
I20260709 14:51:35.234805  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c563cc7cfbe4d59be4ffc5cf847ce56" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:35.236120  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:34.702970 10073 raft_consensus.cc:493] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:51:35.237725  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:35.239876  9766 raft_consensus.cc:3055] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 LEADER]: Stepping down as leader of term 5
I20260709 14:51:35.240209  7776 raft_consensus.cc:1240] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 LEADER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 14:51:35.233090  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:35.246716  7850 raft_consensus.cc:2468] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 7.
I20260709 14:51:35.058684  9784 raft_consensus.cc:3060] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:51:34.715190 10252 raft_consensus.cc:493] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:35.263679 10216 leader_election.cc:290] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:35.264971  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:35.282254  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:35.032763 10224 leader_election.cc:290] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:35.058424 10161 raft_consensus.cc:493] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:34.806957 10230 raft_consensus.cc:493] T 9ce9c0ef2db24c13a8b1402f21819458 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9418391fa82a42c79c6cad13ba91d964)
W20260709 14:51:35.289000  7919 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.039s	sys 0.049s
W20260709 14:51:35.289580  7919 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.563s	user 0.039s	sys 0.049s
I20260709 14:51:35.248265 10153 raft_consensus.cc:493] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:35.249620  9766 raft_consensus.cc:740] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:51:35.252974 10127 raft_consensus.cc:493] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:35.303980  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 9 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:35.307091  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:35.307818  7850 raft_consensus.cc:2468] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 6.
I20260709 14:51:35.308669  7847 raft_consensus.cc:1240] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 4. Current term is 5. Ops: []
I20260709 14:51:35.309813  7848 raft_consensus.cc:1240] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 3. Current term is 4. Ops: []
I20260709 14:51:35.099531 10229 consensus_queue.cc:1048] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.197s
I20260709 14:51:35.255213 10193 leader_election.cc:290] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 8 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:35.317706  7848 raft_consensus.cc:1240] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 7. Current term is 8. Ops: []
I20260709 14:51:35.237849 10073 raft_consensus.cc:515] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:35.329905  7854 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49948 (request call id 2832) took 1928 ms. Trace:
I20260709 14:51:35.332165  7854 rpcz_store.cc:276] 0709 14:51:33.401892 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:33.402103 (+   211us) service_pool.cc:224] Handling call
0709 14:51:33.530821 (+128718us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:51:34.097521 (+566700us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:35.329629 (+1232108us) spinlock_profiling.cc:243] Waited 128 ms on lock 0x7b54003b4a50. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae8d8ad 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2 00007fb6891c948c 00007fb6891c88c6 00007fb6891c826f
0709 14:51:35.329825 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":294930816}
W20260709 14:51:35.324052 10211 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.659s	user 0.050s	sys 0.055s
I20260709 14:51:35.335258  7854 raft_consensus.cc:1240] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 6. Current term is 7. Ops: []
I20260709 14:51:35.329034  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:35.041230 10238 consensus_queue.cc:260] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:35.343652 10211 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.679s	user 0.050s	sys 0.055s
I20260709 14:51:35.347151  7924 raft_consensus.cc:1240] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 LEADER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 5. Current term is 6. Ops: []
I20260709 14:51:35.347378 10049 raft_consensus.cc:3055] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 LEADER]: Stepping down as leader of term 7
I20260709 14:51:35.347764 10049 raft_consensus.cc:740] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:51:35.302147 10224 raft_consensus.cc:493] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9418391fa82a42c79c6cad13ba91d964)
I20260709 14:51:35.349155 10224 raft_consensus.cc:515] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:51:35.351514  7852 raft_consensus.cc:1240] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 6. Current term is 7. Ops: []
I20260709 14:51:35.352082 10224 leader_election.cc:290] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68:42321)
I20260709 14:51:35.358045  7919 raft_consensus.cc:1275] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 14:51:35.364131  7925 raft_consensus.cc:3060] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:51:35.302578 10230 raft_consensus.cc:515] T 9ce9c0ef2db24c13a8b1402f21819458 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:51:35.293936 10161 raft_consensus.cc:515] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:35.312709 10153 raft_consensus.cc:515] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:35.322995 10127 raft_consensus.cc:515] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:35.349036 10049 consensus_queue.cc:260] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:35.421829 10049 raft_consensus.cc:3060] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Advancing to term 8
I20260709 14:51:35.401925 10240 leader_election.cc:290] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:35.313875 10252 raft_consensus.cc:515] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:35.486806 10252 leader_election.cc:290] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:35.486512 10153 leader_election.cc:290] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:35.493005 10249 leader_election.cc:290] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:35.533722 10161 leader_election.cc:290] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:35.524714 10238 raft_consensus.cc:3060] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Advancing to term 6
W20260709 14:51:35.565781 10226 consensus_meta.cc:287] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent flushing consensus metadata: real 0.987s	user 0.006s	sys 0.009s
I20260709 14:51:35.566905 10226 raft_consensus.cc:515] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:35.570075 10226 leader_election.cc:290] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 7 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:35.616255  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:35.618597  7771 raft_consensus.cc:2468] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 8.
I20260709 14:51:35.621074  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:35.623303  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:35.625586  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
W20260709 14:51:35.626480  7743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:51:35.801600  7743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:35.661049  7776 raft_consensus.cc:2468] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 6.
W20260709 14:51:35.686712  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:51:35.803084  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:51:35.803897  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:51:35.687901  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:35.704664  7850 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 2386) took 1007 ms. Trace:
I20260709 14:51:35.806828  7850 rpcz_store.cc:276] 0709 14:51:34.697229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:35.336846 (+639617us) service_pool.cc:224] Handling call
0709 14:51:35.703361 (+366515us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:51:35.703967 (+   606us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:51:35.704023 (+    56us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:51:35.704090 (+    67us) raft_consensus.cc:1645] Marking committed up to 3
0709 14:51:35.704146 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:35.704218 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:51:35.704378 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 14:51:35.720670  7852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 2390) took 1003 ms. Trace:
I20260709 14:51:35.809409  7852 rpcz_store.cc:276] 0709 14:51:34.717220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:35.352823 (+635603us) service_pool.cc:224] Handling call
0709 14:51:35.353200 (+   377us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:51:35.719970 (+366770us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:51:35.720019 (+    49us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:51:35.720083 (+    64us) raft_consensus.cc:1645] Marking committed up to 4
0709 14:51:35.720120 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:35.720202 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:51:35.720484 (+   282us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 14:51:35.811841  7852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 2392) took 1094 ms. Trace:
I20260709 14:51:35.812215  7852 rpcz_store.cc:276] 0709 14:51:34.717754 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:35.810457 (+1092703us) service_pool.cc:224] Handling call
0709 14:51:35.811041 (+   584us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:51:35.811460 (+   419us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:51:35.811484 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:51:35.811541 (+    57us) raft_consensus.cc:1645] Marking committed up to 3
0709 14:51:35.811594 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:35.811644 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:51:35.811761 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 14:51:35.739614  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:35.744794  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:35.745437  7928 raft_consensus.cc:1240] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 5. Current term is 7. Ops: []
I20260709 14:51:35.744939  7922 raft_consensus.cc:1240] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 LEADER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 14:51:35.816036  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:35.750267  7920 raft_consensus.cc:1240] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 5. Current term is 6. Ops: [3.3-5.4]
I20260709 14:51:35.817488  7850 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 2391) took 1100 ms. Trace:
I20260709 14:51:35.753868  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:35.757717  7921 raft_consensus.cc:1275] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 14:51:35.769222  8596 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.013s	sys 0.055s
I20260709 14:51:35.820341  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
W20260709 14:51:35.820946  8596 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.591s	user 0.014s	sys 0.055s
I20260709 14:51:35.814394  7919 raft_consensus.cc:2393] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 4: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:51:35.818125  7850 rpcz_store.cc:276] 0709 14:51:34.717513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:35.808273 (+1090760us) service_pool.cc:224] Handling call
0709 14:51:35.808849 (+   576us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:51:35.816986 (+  8137us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:51:35.817015 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:51:35.817097 (+    82us) raft_consensus.cc:1645] Marking committed up to 6
0709 14:51:35.817183 (+    86us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:35.817267 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:51:35.817406 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 14:51:35.823010  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
W20260709 14:51:35.820364  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:35.821700  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:35.826510  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:35.826934  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:35.827970  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:35.828620  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:35.832293  7927 raft_consensus.cc:2468] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 4.
I20260709 14:51:35.830096  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:35.839231  7921 raft_consensus.cc:1275] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 14:51:35.840384  7919 raft_consensus.cc:2468] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 6.
I20260709 14:51:35.841512  7927 raft_consensus.cc:1240] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 5. Current term is 6. Ops: []
I20260709 14:51:35.842157  7921 raft_consensus.cc:1275] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 14:51:35.806869  7847 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 2379) took 1111 ms. Trace:
I20260709 14:51:35.365582  9766 consensus_queue.cc:260] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:35.858325  7925 raft_consensus.cc:2410] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 14:51:35.813395  7771 raft_consensus.cc:2468] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 7.
I20260709 14:51:35.482075 10073 leader_election.cc:290] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:51:35.897575  8599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 80185.4us
I20260709 14:51:35.900416 10104 leader_election.cc:290] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 6 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:35.931149  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:35.919755  7847 rpcz_store.cc:276] 0709 14:51:34.695624 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:35.311767 (+616143us) service_pool.cc:224] Handling call
0709 14:51:35.312152 (+   385us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:51:35.312951 (+   799us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:51:35.312987 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:51:35.313765 (+   778us) log.cc:844] Serialized 26 byte log entry
0709 14:51:35.795932 (+482167us) raft_consensus.cc:1645] Marking committed up to 6
0709 14:51:35.796011 (+    79us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:35.796099 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:51:35.806475 (+ 10376us) raft_consensus.cc:1685] finished
0709 14:51:35.806492 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:51:35.806702 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2437,"raft.run_cpu_time_us":240,"raft.run_wall_time_us":8969,"thread_start_us":93203,"threads_started":1,"wal-append.queue_time_us":460993}
I20260709 14:51:35.933745  7919 raft_consensus.cc:2410] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 14:51:35.937098  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:35.941442  9766 raft_consensus.cc:3060] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:51:35.946491  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
W20260709 14:51:35.947588 10049 consensus_meta.cc:287] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent flushing consensus metadata: real 0.525s	user 0.003s	sys 0.016s
I20260709 14:51:35.948374  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:35.950359  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:35.951359  7894 leader_election.cc:304] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:35.955084 10165 raft_consensus.cc:2804] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 14:51:35.955749 10165 raft_consensus.cc:493] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:35.956197 10165 raft_consensus.cc:3060] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 14:51:35.951893  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:35.960444  7924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38532 (request call id 2657) took 1617 ms. Trace:
I20260709 14:51:35.961472  7924 rpcz_store.cc:276] 0709 14:51:34.342529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:34.343090 (+   561us) service_pool.cc:224] Handling call
0709 14:51:34.343429 (+   339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:51:35.347725 (+1004296us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:35.959891 (+612166us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b5400451fd4. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae8ee01 00007fb68ae8d83e 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2 00007fb6891c948c 00007fb6891c88c6
0709 14:51:35.960218 (+   327us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2307962112}
I20260709 14:51:35.965865 10103 raft_consensus.cc:3055] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 LEADER]: Stepping down as leader of term 8
I20260709 14:51:35.966861 10103 raft_consensus.cc:740] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:51:35.969832 10230 leader_election.cc:290] T 9ce9c0ef2db24c13a8b1402f21819458 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68:42321)
W20260709 14:51:35.970995  9784 consensus_meta.cc:287] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent flushing consensus metadata: real 0.694s	user 0.002s	sys 0.015s
I20260709 14:51:35.971591  9784 raft_consensus.cc:515] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:35.932577  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
W20260709 14:51:35.976890  7745 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.740s	user 0.023s	sys 0.032s
W20260709 14:51:35.984143  7745 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.747s	user 0.023s	sys 0.033s
I20260709 14:51:35.981637  7894 leader_election.cc:304] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:35.996608  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
W20260709 14:51:36.011283  8598 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.659s	user 0.018s	sys 0.016s
I20260709 14:51:35.968771 10103 consensus_queue.cc:260] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:36.015070 10127 leader_election.cc:290] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:36.013478 10132 raft_consensus.cc:2804] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 14:51:36.015321  8598 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.683s	user 0.019s	sys 0.017s
I20260709 14:51:36.016842 10132 raft_consensus.cc:493] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 14:51:36.018040  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 62369.6us
I20260709 14:51:36.019065 10132 raft_consensus.cc:3060] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:51:36.020083 10221 raft_consensus.cc:493] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:51:36.014890  7772 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37136 (request call id 2000) took 1530 ms (client timeout 1985 ms). Trace:
W20260709 14:51:36.024641  7772 rpcz_store.cc:269] 0709 14:51:34.484118 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:34.586938 (+102820us) service_pool.cc:224] Handling call
0709 14:51:36.014232 (+1427294us) spinlock_profiling.cc:243] Waited 48.8 ms on lock 0x7b5400002154. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae922fa 00007fb68fe53b17 00007fb6893ce6d4 00007fb6893ce662 00007fb6893ce591 00007fb6893ce50c 00007fb6893cd7c2 00007fb6891c948c 00007fb6891c88c6 00007fb6891c826f
0709 14:51:36.014522 (+   290us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":112186112}
I20260709 14:51:36.026314  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:36.027814  7772 raft_consensus.cc:2376] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 5. Re-sending same reply.
I20260709 14:51:36.027755  7779 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37136 (request call id 1991) took 1555 ms. Trace:
W20260709 14:51:36.024385  8598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 691960us
I20260709 14:51:36.023550 10221 raft_consensus.cc:515] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:36.032214  7771 raft_consensus.cc:2468] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 6.
W20260709 14:51:36.038710  7745 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:36.032644  7779 rpcz_store.cc:276] 0709 14:51:34.471778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:34.471898 (+   120us) service_pool.cc:224] Handling call
0709 14:51:34.490144 (+ 18246us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:51:35.067879 (+577735us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:36.027054 (+959175us) spinlock_profiling.cc:243] Waited 214 ms on lock 0x7b54002b61d4. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae8ee01 00007fb68ae8d83e 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2 00007fb6891c948c 00007fb6891c88c6
0709 14:51:36.027503 (+   449us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":491987840}
I20260709 14:51:36.049748  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:36.049342  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
W20260709 14:51:36.054201  7743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:36.053990  7894 leader_election.cc:304] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:36.055006 10103 raft_consensus.cc:3060] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:51:36.066651 10189 raft_consensus.cc:2804] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 14:51:36.061676 10196 raft_consensus.cc:3055] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 LEADER]: Stepping down as leader of term 6
I20260709 14:51:36.066972  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c563cc7cfbe4d59be4ffc5cf847ce56" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:36.069329 10189 raft_consensus.cc:493] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:36.073092 10189 raft_consensus.cc:3060] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:51:36.074808  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:36.076519  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:36.069612 10196 raft_consensus.cc:740] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
W20260709 14:51:36.069970 10106 consensus_meta.cc:287] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent flushing consensus metadata: real 1.484s	user 0.018s	sys 0.008s
I20260709 14:51:36.085923 10196 consensus_queue.cc:260] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:36.086916  6549 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 14:51:36.087792 10196 raft_consensus.cc:3060] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Advancing to term 7
W20260709 14:51:36.091109  7743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:36.095005 10242 leader_election.cc:290] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:36.096859 10132 raft_consensus.cc:515] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:36.100251 10132 leader_election.cc:290] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 3 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:36.101941 10221 leader_election.cc:290] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:36.104120  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 9 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:36.105976  7775 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37136 (request call id 1990) took 1635 ms. Trace:
I20260709 14:51:36.118748  8639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce9c0ef2db24c13a8b1402f21819458" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9418391fa82a42c79c6cad13ba91d964" is_pre_election: true
I20260709 14:51:36.106457  7775 rpcz_store.cc:276] 0709 14:51:34.470970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:34.471226 (+   256us) service_pool.cc:224] Handling call
0709 14:51:36.103659 (+1632433us) spinlock_profiling.cc:243] Waited 4.21 ms on lock 0x7b5800002a98. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb687c29db1 00007fb687d69b71 00007fb687d69a22 00007fb690c82c09 00007fb68fddcee0 00007fb68fea60ab 00007fb68fea6131 00007fb68fe540a0 00007fb68fe53984 00007fb6893ce6d4 00007fb6893ce662
0709 14:51:36.105889 (+  2230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9677056}
I20260709 14:51:36.094440 10106 raft_consensus.cc:515] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:36.137354  7777 raft_consensus.cc:2393] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 7: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:51:36.138724  9776 raft_consensus.cc:493] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:36.140291  7776 raft_consensus.cc:1275] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 14:51:36.141317  7776 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37136 (request call id 2009) took 1570 ms. Trace:
I20260709 14:51:36.139928 10218 raft_consensus.cc:3055] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 LEADER]: Stepping down as leader of term 4
I20260709 14:51:36.142144 10221 consensus_queue.cc:1048] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 14:51:36.143309 10218 raft_consensus.cc:740] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:51:36.145851 10106 leader_election.cc:290] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:36.150787 10054 raft_consensus.cc:3060] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:51:36.151667 10165 raft_consensus.cc:515] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:36.145462  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:36.152928  7776 rpcz_store.cc:276] 0709 14:51:34.570611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:36.139383 (+1568772us) service_pool.cc:224] Handling call
0709 14:51:36.139870 (+   487us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:51:36.140880 (+  1010us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:36.141098 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 14:51:36.157385  7854 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 2388) took 1441 ms. Trace:
I20260709 14:51:36.158171  7854 rpcz_store.cc:276] 0709 14:51:34.716612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:35.344065 (+627453us) service_pool.cc:224] Handling call
0709 14:51:35.344442 (+   377us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:51:35.730092 (+385650us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:51:35.730151 (+    59us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:51:35.730232 (+    81us) raft_consensus.cc:1645] Marking committed up to 4
0709 14:51:35.730286 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:36.155351 (+425065us) spinlock_profiling.cc:243] Waited 385 ms on lock 0x7b54000d4b54. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae8ee01 00007fb68ae8d83e 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2 00007fb6891c948c 00007fb6891c88c6
0709 14:51:36.155409 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:51:36.157003 (+  1594us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":884812544}
I20260709 14:51:36.162285 10141 consensus_queue.cc:1059] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 14:51:36.162665 10042 consensus_queue.cc:1059] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 14:51:36.165186  9929 raft_consensus.cc:3055] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 14:51:36.165705  9929 raft_consensus.cc:740] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:36.165942  7771 raft_consensus.cc:1240] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 5. Current term is 6. Ops: [3.3-5.4]
I20260709 14:51:36.166791  7771 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37136 (request call id 1998) took 1683 ms. Trace:
I20260709 14:51:36.166853  9929 consensus_queue.cc:260] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:36.167996  8639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18d29d52d304c87b930d4fb5eaf50b1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9418391fa82a42c79c6cad13ba91d964" is_pre_election: true
I20260709 14:51:36.168339  9929 raft_consensus.cc:3060] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:51:36.169000  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:36.169412  7894 leader_election.cc:304] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:36.142259  7745 leader_election.cc:304] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 3876b8ee8d744cb18e91d97aae93b1ac, 9418391fa82a42c79c6cad13ba91d964
I20260709 14:51:36.172366  7920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38516 (request call id 1969) took 1337 ms. Trace:
I20260709 14:51:36.172477 10106 raft_consensus.cc:493] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9418391fa82a42c79c6cad13ba91d964)
I20260709 14:51:36.173477  7920 rpcz_store.cc:276] 0709 14:51:34.834519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:35.067433 (+232914us) service_pool.cc:224] Handling call
0709 14:51:35.067770 (+   337us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 14:51:35.818013 (+750243us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:36.171915 (+353902us) spinlock_profiling.cc:243] Waited 682 ms on lock 0x7b540025dad4. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae8ee01 00007fb68ae8d83e 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2 00007fb6891c948c 00007fb6891c88c6
0709 14:51:36.172284 (+   369us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1567764352}
I20260709 14:51:36.175500  7774 raft_consensus.cc:2410] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 14:51:36.167220  7771 rpcz_store.cc:276] 0709 14:51:34.483488 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:36.124121 (+1640633us) service_pool.cc:224] Handling call
0709 14:51:36.165528 (+ 41407us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 14:51:36.166429 (+   901us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:36.166683 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 14:51:36.177922  7774 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37136 (request call id 1988) took 1757 ms (client timeout 1523 ms). Trace:
I20260709 14:51:36.181026  7777 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37144 (request call id 2170) took 1492 ms. Trace:
I20260709 14:51:36.181370  7775 raft_consensus.cc:1240] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 6. Current term is 7. Ops: []
I20260709 14:51:36.181964  7777 rpcz_store.cc:276] 0709 14:51:34.688226 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:35.235841 (+547615us) service_pool.cc:224] Handling call
0709 14:51:36.180650 (+944809us) spinlock_profiling.cc:243] Waited 900 ms on lock 0x7b54001211d4. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae922fa 00007fb68fe53b17 00007fb6893ce6d4 00007fb6893ce662 00007fb6893ce591 00007fb6893ce50c 00007fb6893cd7c2 00007fb6891c948c 00007fb6891c88c6 00007fb6891c826f
0709 14:51:36.180936 (+   286us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2070288128}
I20260709 14:51:36.183301  7775 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37136 (request call id 2004) took 1698 ms. Trace:
I20260709 14:51:36.184514 10205 raft_consensus.cc:3055] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 LEADER]: Stepping down as leader of term 4
I20260709 14:51:36.184816  7928 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38516 (request call id 1971) took 1282 ms. Trace:
I20260709 14:51:36.185002 10205 raft_consensus.cc:740] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
W20260709 14:51:36.185613  7743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:36.186956  7845 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 2854) took 1725 ms. Trace:
I20260709 14:51:36.187618  7845 rpcz_store.cc:276] 0709 14:51:34.461319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:34.587429 (+126110us) service_pool.cc:224] Handling call
0709 14:51:36.186362 (+1598933us) spinlock_profiling.cc:243] Waited 31 ms on lock 0x7b54002cabd4. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae922fa 00007fb68fe53b17 00007fb6893ce6d4 00007fb6893ce662 00007fb6893ce591 00007fb6893ce50c 00007fb6893cd7c2 00007fb6891c948c 00007fb6891c88c6 00007fb6891c826f
0709 14:51:36.186611 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":71320448}
I20260709 14:51:36.144810 10218 consensus_queue.cc:260] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:36.190825  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:36.192010  7848 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 2382) took 1495 ms. Trace:
W20260709 14:51:36.192682  7773 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37136 (request call id 1992) took 1720 ms (client timeout 1617 ms). Trace:
I20260709 14:51:36.139863  9776 raft_consensus.cc:515] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:36.179153  7774 rpcz_store.cc:269] 0709 14:51:34.420575 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:34.420874 (+   299us) service_pool.cc:224] Handling call
0709 14:51:36.168693 (+1747819us) spinlock_profiling.cc:243] Waited 4.88 ms on lock 0x7b5800002a98. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb687c29db1 00007fb687d69b71 00007fb687d69eee 000000000037fce9 00007fb68fddd1e0 00007fb68fea60c4 00007fb68fea6131 00007fb68fe540a0 00007fb68fe53984 00007fb6893ce6d4 00007fb6893ce662
0709 14:51:36.177851 (+  9158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11242496}
I20260709 14:51:36.188877 10242 raft_consensus.cc:493] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:36.195883 10242 raft_consensus.cc:515] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:36.196972 10182 raft_consensus.cc:2749] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 14:51:36.185389  7928 rpcz_store.cc:276] 0709 14:51:34.902645 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:35.067051 (+164406us) service_pool.cc:224] Handling call
0709 14:51:35.067459 (+   408us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:51:35.814135 (+746676us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:36.184418 (+370283us) spinlock_profiling.cc:243] Waited 674 ms on lock 0x7b540041e1d4. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae8ee01 00007fb68ae8d83e 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2 00007fb6891c948c 00007fb6891c88c6
0709 14:51:36.184720 (+   302us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1550477056}
W20260709 14:51:36.194629  7773 rpcz_store.cc:269] 0709 14:51:34.472204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:34.472321 (+   117us) service_pool.cc:224] Handling call
0709 14:51:36.190202 (+1717881us) spinlock_profiling.cc:243] Waited 3.16 ms on lock 0x7b5800002a98. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb687c29db1 00007fb687d69b71 00007fb687d69a22 00007fb690c82c09 00007fb68fddcee0 00007fb68fea60ab 00007fb68fea6131 00007fb68fe540a0 00007fb68fe53984 00007fb6893ce6d4 00007fb6893ce662
0709 14:51:36.192494 (+  2292us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7256960}
I20260709 14:51:36.192502  7848 rpcz_store.cc:276] 0709 14:51:34.696326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:35.320563 (+624237us) service_pool.cc:224] Handling call
0709 14:51:36.189478 (+868915us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:51:36.189967 (+   489us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:51:36.189996 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:51:36.190080 (+    84us) raft_consensus.cc:1645] Marking committed up to 2
0709 14:51:36.190135 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:36.190223 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:51:36.191570 (+  1347us) spinlock_profiling.cc:243] Waited 868 ms on lock 0x7b54002cabd0. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae8d8ad 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2 00007fb6891c948c 00007fb6891c88c6 00007fb6891c826f
0709 14:51:36.191742 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1997385472}
I20260709 14:51:36.183743  7775 rpcz_store.cc:276] 0709 14:51:34.485071 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:36.134232 (+1649161us) service_pool.cc:224] Handling call
0709 14:51:36.180885 (+ 46653us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:51:36.182114 (+  1229us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:36.183012 (+   898us) spinlock_profiling.cc:243] Waited 44.2 ms on lock 0x7b54001211d0. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae8d8ad 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2 00007fb6891c948c 00007fb6891c88c6 00007fb6891c826f
0709 14:51:36.183206 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":101545856}
W20260709 14:51:36.189088  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:36.206068  7772 raft_consensus.cc:2468] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 9.
I20260709 14:51:36.208113  7774 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47054 (request call id 134) took 1549 ms. Trace:
I20260709 14:51:36.210059  7774 rpcz_store.cc:276] 0709 14:51:34.655910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:36.195702 (+1539792us) service_pool.cc:224] Handling call
0709 14:51:36.196386 (+   684us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:51:36.196866 (+   480us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:51:36.196898 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:51:36.196981 (+    83us) raft_consensus.cc:1645] Marking committed up to 6
0709 14:51:36.197027 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:36.197084 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:51:36.197954 (+   870us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 14:51:36.211944  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:36.197108  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:36.207370 10242 leader_election.cc:290] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:36.218773  7775 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 2168) took 1555 ms. Trace:
I20260709 14:51:36.219429  7775 rpcz_store.cc:276] 0709 14:51:34.663724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:36.204038 (+1540314us) service_pool.cc:224] Handling call
0709 14:51:36.217734 (+ 13696us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:51:36.218147 (+   413us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:51:36.218316 (+   169us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:51:36.218374 (+    58us) raft_consensus.cc:1645] Marking committed up to 6
0709 14:51:36.218417 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:36.218486 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:51:36.218646 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 14:51:36.220764  7773 raft_consensus.cc:1240] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 6. Current term is 7. Ops: []
I20260709 14:51:36.228196  7674 catalog_manager.cc:5697] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 5 to 6, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 6 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
W20260709 14:51:36.229763  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 88354.2us
I20260709 14:51:36.230240  7773 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 2169) took 1560 ms. Trace:
I20260709 14:51:36.230675  7773 rpcz_store.cc:276] 0709 14:51:34.669558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:36.212151 (+1542593us) service_pool.cc:224] Handling call
0709 14:51:36.220485 (+  8334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:51:36.229928 (+  9443us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:36.230174 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 14:51:36.236152  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:36.236289  9766 raft_consensus.cc:493] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:36.221855 10205 consensus_queue.cc:260] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:36.237411  9766 raft_consensus.cc:515] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:36.239006 10205 raft_consensus.cc:3060] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:51:36.222994  9776 leader_election.cc:290] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:36.240741  9766 leader_election.cc:290] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:36.221972 10202 raft_consensus.cc:2804] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 14:51:36.241590 10202 raft_consensus.cc:493] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:36.242127 10202 raft_consensus.cc:3060] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:51:36.244915  7774 raft_consensus.cc:1240] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 4. Current term is 5. Ops: []
I20260709 14:51:36.246642  7774 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 2175) took 1542 ms. Trace:
I20260709 14:51:36.247291  7774 rpcz_store.cc:276] 0709 14:51:34.703778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:36.243932 (+1540154us) service_pool.cc:224] Handling call
0709 14:51:36.244602 (+   670us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:51:36.246115 (+  1513us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:36.246364 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 14:51:36.224169  7776 raft_consensus.cc:1240] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 LEADER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 14:51:36.195919  9784 leader_election.cc:290] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:36.179520 10106 raft_consensus.cc:515] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
W20260709 14:51:36.227454  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:36.228809  7779 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 2173) took 1525 ms. Trace:
I20260709 14:51:36.259403  7779 rpcz_store.cc:276] 0709 14:51:34.703259 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:36.209579 (+1506320us) service_pool.cc:224] Handling call
0709 14:51:36.226805 (+ 17226us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:51:36.228081 (+  1276us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:51:36.228243 (+   162us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:51:36.228357 (+   114us) raft_consensus.cc:1645] Marking committed up to 7
0709 14:51:36.228412 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:36.228509 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:51:36.228700 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 14:51:36.262179  7776 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37136 (request call id 2012) took 1668 ms. Trace:
I20260709 14:51:36.263341 10242 raft_consensus.cc:493] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:36.223803 10057 raft_consensus.cc:3055] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 14:51:36.264235 10242 raft_consensus.cc:515] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:36.264679 10057 raft_consensus.cc:740] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:36.263438  7776 rpcz_store.cc:276] 0709 14:51:34.593342 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:36.153958 (+1560616us) service_pool.cc:224] Handling call
0709 14:51:36.223719 (+ 69761us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:51:36.261627 (+ 37908us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:36.262071 (+   444us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 14:51:36.264879  7744 leader_election.cc:304] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:51:36.277413  7771 raft_consensus.cc:1240] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 LEADER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 7. Current term is 8. Ops: []
W20260709 14:51:36.289538  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:51:36.290786  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:36.252333  7778 raft_consensus.cc:2468] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 6.
I20260709 14:51:36.232582  7745 leader_election.cc:304] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:36.258354  7773 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 2184) took 1013 ms. Trace:
W20260709 14:51:36.222898  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 58161.2us
I20260709 14:51:36.299070  7771 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37136 (request call id 2013) took 1692 ms. Trace:
I20260709 14:51:36.299750  7771 rpcz_store.cc:276] 0709 14:51:34.606804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:36.176900 (+1570096us) service_pool.cc:224] Handling call
0709 14:51:36.215878 (+ 38978us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:51:36.278481 (+ 62603us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:36.298959 (+ 20478us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 14:51:36.299716  7773 rpcz_store.cc:276] 0709 14:51:35.244602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:36.231803 (+987201us) service_pool.cc:224] Handling call
0709 14:51:36.232423 (+   620us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:51:36.232889 (+   466us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:51:36.232913 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:51:36.232976 (+    63us) raft_consensus.cc:1645] Marking committed up to 4
0709 14:51:36.233113 (+   137us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:36.233175 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:51:36.258275 (+ 25100us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 14:51:36.268556 10218 raft_consensus.cc:3060] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Advancing to term 5
W20260709 14:51:36.319895  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:51:36.323477  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 58899.1us
I20260709 14:51:36.320031 10189 raft_consensus.cc:515] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:36.325713  8639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce9c0ef2db24c13a8b1402f21819458" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9418391fa82a42c79c6cad13ba91d964" is_pre_election: true
I20260709 14:51:36.326617 10098 raft_consensus.cc:2804] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 14:51:36.327263 10098 raft_consensus.cc:493] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:36.327698 10098 raft_consensus.cc:3060] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:51:36.328157 10189 leader_election.cc:290] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 5 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:36.266244 10057 consensus_queue.cc:260] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:36.330050  7777 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47054 (request call id 133) took 1685 ms. Trace:
I20260709 14:51:36.330677  7777 rpcz_store.cc:276] 0709 14:51:34.644945 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:36.182945 (+1538000us) service_pool.cc:224] Handling call
0709 14:51:36.183659 (+   714us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:51:36.320947 (+137288us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:51:36.320985 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:51:36.321032 (+    47us) raft_consensus.cc:1645] Marking committed up to 5
0709 14:51:36.328268 (+  7236us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:36.329687 (+  1419us) spinlock_profiling.cc:243] Waited 84.9 ms on lock 0x7b54002fba54. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae8ee01 00007fb68ae8d83e 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2 00007fb6891c948c 00007fb6891c88c6
0709 14:51:36.329740 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:51:36.329934 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":195276160}
W20260709 14:51:36.331362  7819 connection.cc:256] RPC call timeout handler was delayed by -1.5904382339999756s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1643s for a response
W20260709 14:51:36.331956  7819 connection.cc:256] RPC call timeout handler was delayed by -1.5904382339999756s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1643s for a response
W20260709 14:51:36.332468  7819 connection.cc:256] RPC call timeout handler was delayed by -1.5004382339999438s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1743s for a response
W20260709 14:51:36.332805  7819 connection.cc:256] RPC call timeout handler was delayed by -1.5004382339999438s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1743s for a response
W20260709 14:51:36.333303  7778 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37136 (request call id 1987) took 1949 ms (client timeout 1643 ms). Trace:
W20260709 14:51:36.333943  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:36.334836 10104 raft_consensus.cc:493] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:36.335520 10104 raft_consensus.cc:515] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:36.338433 10104 leader_election.cc:290] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:36.339411  7922 raft_consensus.cc:2468] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 7.
W20260709 14:51:36.333885  7778 rpcz_store.cc:269] 0709 14:51:34.419875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:34.458585 (+ 38710us) service_pool.cc:224] Handling call
0709 14:51:36.066614 (+1608029us) spinlock_profiling.cc:243] Waited 4.13 ms on lock 0x7b5800002a98. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb687c29db1 00007fb687d69b71 00007fb687d69eee 000000000037fce9 00007fb68fddd1e0 00007fb68fea60c4 00007fb68fea6131 00007fb68fe540a0 00007fb68fe53984 00007fb6893ce6d4 00007fb6893ce662
0709 14:51:36.324566 (+257952us) spinlock_profiling.cc:243] Waited 130 ms on lock 0x7b5400221d54. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae922fa 00007fb68fe53b17 00007fb6893ce6d4 00007fb6893ce662 00007fb6893ce591 00007fb6893ce50c 00007fb6893cd7c2 00007fb6891c948c 00007fb6891c88c6 00007fb6891c826f
0709 14:51:36.333135 (+  8569us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":308984320}
I20260709 14:51:36.344604  7675 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54344 (request call id 368) took 7188 ms. Trace:
I20260709 14:51:36.350430  7779 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 2185) took 1105 ms. Trace:
I20260709 14:51:36.351089  7779 rpcz_store.cc:276] 0709 14:51:35.244929 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:36.260867 (+1015938us) service_pool.cc:224] Handling call
0709 14:51:36.349428 (+ 88561us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:51:36.349925 (+   497us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:51:36.349957 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:51:36.350031 (+    74us) raft_consensus.cc:1645] Marking committed up to 6
0709 14:51:36.350070 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:36.350145 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:51:36.350330 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 14:51:36.345342  7674 catalog_manager.cc:5697] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 4 to 6, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 6 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:51:36.321534  9784 raft_consensus.cc:2749] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 14:51:36.317282 10106 leader_election.cc:290] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785), 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68:42321)
I20260709 14:51:36.353674  7674 catalog_manager.cc:5697] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 4 to 5, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 5 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:51:36.357491  7777 raft_consensus.cc:1240] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 5. Current term is 6. Ops: []
I20260709 14:51:36.359349 10242 leader_election.cc:290] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:36.315577 10165 leader_election.cc:290] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:36.379302  7773 raft_consensus.cc:1240] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 2. Current term is 3. Ops: []
W20260709 14:51:36.379137  7893 connection.cc:256] RPC call timeout handler was delayed by -1.5305200209999157s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1746s for a response
I20260709 14:51:36.388459  7744 leader_election.cc:304] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
W20260709 14:51:36.390422  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:36.346495  7675 rpcz_store.cc:276] 0709 14:51:29.156217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:29.156798 (+   581us) service_pool.cc:224] Handling call
0709 14:51:29.527612 (+370814us) spinlock_profiling.cc:243] Waited 140 ms on lock 0x7b54003499d4. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf8090 00007fb68ae96f3a 00007fb690c4d1cc 00007fb690d4b37e 00007fb68f20c2a4 00007fb68f20c232 00007fb68f20c161 00007fb68f20c0dc 00007fb68f20b392 00007fb6891c948c 00007fb6891c88c6
0709 14:51:36.344363 (+6816751us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 14:51:31.662519 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 14:51:31.720171 (+ 57652us) write_op.cc:432] Acquiring schema lock in shared mode
0709 14:51:31.720231 (+    60us) write_op.cc:435] Acquired schema lock
0709 14:51:31.720251 (+    20us) tablet.cc:662] Decoding operations
0709 14:51:31.720881 (+   630us) write_op.cc:620] Acquiring the partition lock for write op
0709 14:51:31.720937 (+    56us) write_op.cc:641] Partition lock acquired for write op
0709 14:51:31.720966 (+    29us) tablet.cc:685] Acquiring locks for 4 operations
0709 14:51:31.856143 (+135177us) tablet.cc:701] Row locks acquired
0709 14:51:31.856195 (+    52us) write_op.cc:260] PREPARE: finished
0709 14:51:32.125324 (+269129us) write_op.cc:270] Start()
0709 14:51:32.132003 (+  6679us) write_op.cc:276] Timestamp: P: 1783608692121335 usec, L: 0
0709 14:51:32.141692 (+  9689us) op_driver.cc:348] REPLICATION: starting
0709 14:51:32.275217 (+133525us) log.cc:844] Serialized 1690 byte log entry
0709 14:51:32.676318 (+401101us) op_driver.cc:464] REPLICATION: finished
0709 14:51:32.850237 (+173919us) write_op.cc:301] APPLY: starting
0709 14:51:32.866355 (+ 16118us) tablet.cc:1367] starting BulkCheckPresence
0709 14:51:32.898139 (+ 31784us) tablet.cc:1370] finished BulkCheckPresence
0709 14:51:32.915615 (+ 17476us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 14:51:32.987762 (+ 72147us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 14:51:32.988007 (+   245us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 14:51:32.988066 (+    59us) write_op.cc:312] APPLY: finished
0709 14:51:32.988337 (+   271us) log.cc:844] Serialized 41 byte log entry
0709 14:51:32.989919 (+  1582us) write_op.cc:489] Releasing partition, row and schema locks
0709 14:51:32.990039 (+   120us) write_op.cc:454] Released schema lock
0709 14:51:32.990089 (+    50us) write_op.cc:341] FINISH: Updating metrics
0709 14:51:33.000574 (+ 10485us) write_op.cc:489] Releasing partition, row and schema locks
0709 14:51:33.003355 (+  2781us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":298952,"reported_tablets":16,"spinlock_wait_cycles":322784640,"child_traces":[["op",{"apply.queue_time_us":135806,"apply.run_cpu_time_us":4028,"apply.run_wall_time_us":163107,"num_ops":4,"prepare.queue_time_us":466197,"prepare.run_cpu_time_us":25740,"prepare.run_wall_time_us":719899,"raft.queue_time_us":243822,"raft.run_cpu_time_us":9942,"raft.run_wall_time_us":109189,"replication_time_us":485501,"thread_start_us":571429,"threads_started":4,"wal-append.queue_time_us":107390,"wal-append.run_cpu_time_us":14910,"wal-append.run_wall_time_us":1611425}]]}
W20260709 14:51:36.395640  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 163258us
W20260709 14:51:36.394671  7819 leader_election.cc:336] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785): Timed out: RequestConsensusVote RPC to 127.6.101.67:40785 timed out after 1.504s (SENT)
I20260709 14:51:36.394057  7674 catalog_manager.cc:5697] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 4 to 6, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 6 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
W20260709 14:51:36.398236  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 76929.7us
W20260709 14:51:36.415901  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:36.418113 10208 consensus_queue.cc:1048] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 14:51:36.417032  7745 leader_election.cc:304] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:36.426654  7772 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 2182) took 1182 ms. Trace:
I20260709 14:51:36.427454  7777 raft_consensus.cc:1275] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 14:51:36.397276 10221 consensus_queue.cc:1048] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.026s
I20260709 14:51:36.419135 10106 raft_consensus.cc:2804] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 14:51:36.434237 10209 raft_consensus.cc:2749] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 14:51:36.435036 10272 log.cc:927] Time spent T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.134s	user 0.004s	sys 0.000s
I20260709 14:51:36.434391 10106 raft_consensus.cc:493] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:36.434016  7923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38516 (request call id 1974) took 1397 ms. Trace:
I20260709 14:51:36.427232  7772 rpcz_store.cc:276] 0709 14:51:35.243979 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:36.216157 (+972178us) service_pool.cc:224] Handling call
0709 14:51:36.217995 (+  1838us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:51:36.231431 (+ 13436us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:51:36.231473 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:51:36.232202 (+   729us) log.cc:844] Serialized 26 byte log entry
0709 14:51:36.309571 (+ 77369us) raft_consensus.cc:1645] Marking committed up to 3
0709 14:51:36.309619 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:36.309693 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:51:36.426355 (+116662us) raft_consensus.cc:1685] finished
0709 14:51:36.426381 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:51:36.426576 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12537,"raft.queue_time_us":14953,"raft.run_cpu_time_us":562,"raft.run_wall_time_us":562,"thread_start_us":76757,"threads_started":1,"wal-append.queue_time_us":106651}
I20260709 14:51:36.439621 10106 raft_consensus.cc:3060] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Advancing to term 8
I20260709 14:51:36.440387  7923 rpcz_store.cc:276] 0709 14:51:35.021700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:35.061676 (+ 39976us) service_pool.cc:224] Handling call
0709 14:51:36.185415 (+1123739us) spinlock_profiling.cc:243] Waited 19 ms on lock 0x7b5800200198. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb687c29db1 00007fb687d69b71 00007fb687d69a22 00007fb690c82c09 00007fb68fddcee0 00007fb68fea60ab 00007fb68fea6131 00007fb68fe67fc0 00007fb68fe52929 00007fb68fe523d2 00007fb6893c9bd4
0709 14:51:36.185904 (+   489us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:51:36.218243 (+ 32339us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:51:36.218267 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:51:36.218945 (+   678us) log.cc:844] Serialized 26 byte log entry
0709 14:51:36.318622 (+ 99677us) raft_consensus.cc:1645] Marking committed up to 4
0709 14:51:36.318659 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:36.318726 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:51:36.400752 (+ 82026us) raft_consensus.cc:1685] finished
0709 14:51:36.400771 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:51:36.419135 (+ 18364us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28477,"raft.queue_time_us":32977,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":128,"spinlock_wait_cycles":43597696,"thread_start_us":99176,"threads_started":1,"wal-append.queue_time_us":172451}
I20260709 14:51:36.448720  7745 leader_election.cc:304] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:51:36.457540  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 79158.4us
I20260709 14:51:36.453915 10103 consensus_queue.cc:1059] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 14:51:36.464087  7894 leader_election.cc:304] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:36.472625 10241 raft_consensus.cc:2804] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 14:51:36.473348 10241 raft_consensus.cc:493] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:51:36.473608 10185 consensus_queue.cc:1059] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 14:51:36.475615 10185 raft_consensus.cc:3055] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 14:51:36.476176 10185 raft_consensus.cc:740] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:36.477429 10185 consensus_queue.cc:260] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:36.487120  7894 leader_election.cc:304] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
W20260709 14:51:36.525724  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 77122.9us
W20260709 14:51:36.528091  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 65661.8us
W20260709 14:51:36.529817  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 132201us
I20260709 14:51:36.489689 10209 raft_consensus.cc:2749] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 14:51:36.529301  7775 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 2183) took 1285 ms. Trace:
W20260709 14:51:36.530881  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 44136.2us
W20260709 14:51:36.534785  7893 connection.cc:256] RPC call timeout handler was delayed by -1.391920020999919s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19s for a response
W20260709 14:51:36.535454  7893 connection.cc:256] RPC call timeout handler was delayed by -1.3595200209999803s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1936s for a response
W20260709 14:51:36.535797  7893 connection.cc:256] RPC call timeout handler was delayed by -1.2596200209999324s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20470000000000002s for a response
I20260709 14:51:36.523473 10241 raft_consensus.cc:3060] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 14:51:36.532196 10103 consensus_queue.cc:1243] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer 1e9289592458429bbddb19c2e7b7b7b0 log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 14:51:36.530856 10185 raft_consensus.cc:3060] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Advancing to term 6
W20260709 14:51:36.544406  7893 connection.cc:256] RPC call timeout handler was delayed by -1.1642200210000055s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21530000000000002s for a response
W20260709 14:51:36.549299  7893 connection.cc:256] RPC call timeout handler was delayed by -1.1561200209999924s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2162s for a response
W20260709 14:51:36.550453  7893 connection.cc:256] RPC call timeout handler was delayed by -1.1003200209999022s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22240000000000004s for a response
W20260709 14:51:36.550879  7893 connection.cc:256] RPC call timeout handler was delayed by -1.0841200209999897s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2242s for a response
I20260709 14:51:36.531721  7775 rpcz_store.cc:276] 0709 14:51:35.244301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:36.220595 (+976294us) service_pool.cc:224] Handling call
0709 14:51:36.221144 (+   549us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 14:51:36.239288 (+ 18144us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:51:36.239325 (+    37us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 14:51:36.256410 (+ 17085us) log.cc:844] Serialized 52 byte log entry
0709 14:51:36.401273 (+144863us) raft_consensus.cc:1645] Marking committed up to 5
0709 14:51:36.527577 (+126304us) log.cc:844] Serialized 14 byte log entry
0709 14:51:36.528364 (+   787us) log.cc:844] Serialized 14 byte log entry
0709 14:51:36.528877 (+   513us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:36.528964 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:51:36.529004 (+    40us) raft_consensus.cc:1685] finished
0709 14:51:36.529016 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:51:36.529181 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":64489,"prepare.run_cpu_time_us":2554,"prepare.run_wall_time_us":7740,"raft.queue_time_us":736,"raft.run_cpu_time_us":376,"raft.run_wall_time_us":380,"spinlock_wait_cycles":47872,"thread_start_us":245439,"threads_started":2,"wal-append.queue_time_us":173650}
I20260709 14:51:36.553678 10057 raft_consensus.cc:3060] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:51:36.555500 10208 raft_consensus.cc:3055] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 LEADER]: Stepping down as leader of term 5
I20260709 14:51:36.556084 10208 raft_consensus.cc:740] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:51:36.536652 10165 raft_consensus.cc:2804] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 14:51:36.557233 10208 consensus_queue.cc:260] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:36.595726  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 64425us
I20260709 14:51:36.598140  7745 leader_election.cc:304] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
W20260709 14:51:36.600597  7819 leader_election.cc:336] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785): Timed out: RequestConsensusVote RPC to 127.6.101.67:40785 timed out after 1.559s (SENT)
W20260709 14:51:36.600828  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 51725.9us
I20260709 14:51:36.607802  7745 leader_election.cc:304] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:36.596381 10165 raft_consensus.cc:493] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:36.611289 10165 raft_consensus.cc:3060] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Advancing to term 7
W20260709 14:51:36.613643  7743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:51:36.614459  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:36.605630 10098 raft_consensus.cc:515] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:36.617511 10202 raft_consensus.cc:515] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:36.622587 10208 raft_consensus.cc:3060] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:51:36.605911 10106 raft_consensus.cc:515] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:36.620194 10221 raft_consensus.cc:2804] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 14:51:36.630666 10221 raft_consensus.cc:493] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:36.631212 10221 raft_consensus.cc:3060] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Advancing to term 6
W20260709 14:51:36.632863  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:36.634541 10192 consensus_queue.cc:1059] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 14:51:36.637434 10192 raft_consensus.cc:3055] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 14:51:36.635196 10048 consensus_queue.cc:1059] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 14:51:36.643997 10048 raft_consensus.cc:3055] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 14:51:36.644611 10048 raft_consensus.cc:740] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:36.646627 10048 consensus_queue.cc:260] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:36.648010  9784 raft_consensus.cc:2804] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 14:51:36.639199 10189 consensus_queue.cc:1059] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 14:51:36.648528  9784 raft_consensus.cc:493] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:36.649111 10192 raft_consensus.cc:740] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:36.650972 10202 leader_election.cc:290] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 7 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:36.647526 10106 leader_election.cc:290] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:36.649003  9784 raft_consensus.cc:3060] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:51:36.661616  7770 raft_consensus.cc:2410] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
W20260709 14:51:36.663398  7770 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37136 (request call id 1989) took 2236 ms (client timeout 2224 ms). Trace:
W20260709 14:51:36.663826  7770 rpcz_store.cc:269] 0709 14:51:34.427350 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:34.470213 (+ 42863us) service_pool.cc:224] Handling call
0709 14:51:36.196709 (+1726496us) spinlock_profiling.cc:243] Waited 2.8 ms on lock 0x7b5800002a98. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb687c29db1 00007fb687d69b71 00007fb687d69a22 00007fb690c82c09 00007fb68fddcee0 00007fb68fea60ab 00007fb68fea6131 00007fb68fe540a0 00007fb68fe53984 00007fb6893ce6d4 00007fb6893ce662
0709 14:51:36.663071 (+466362us) spinlock_profiling.cc:243] Waited 424 ms on lock 0x7b5400222c54. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae922fa 00007fb68fe53b17 00007fb6893ce6d4 00007fb6893ce662 00007fb6893ce591 00007fb6893ce50c 00007fb6893cd7c2 00007fb6891c948c 00007fb6891c88c6 00007fb6891c826f
0709 14:51:36.663275 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":981054592}
I20260709 14:51:36.657368 10189 raft_consensus.cc:3055] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 14:51:36.665469 10189 raft_consensus.cc:740] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:36.666705 10189 consensus_queue.cc:260] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:36.668406 10189 raft_consensus.cc:3060] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:51:36.628759  7893 leader_election.cc:304] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:51:36.670897  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 63247.6us
W20260709 14:51:36.675086  7743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:36.675925  7771 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 2189) took 1068 ms. Trace:
I20260709 14:51:36.657109 10048 raft_consensus.cc:3060] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 14:51:36.682317 10042 raft_consensus.cc:2804] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 14:51:36.682883 10042 raft_consensus.cc:493] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:36.683259 10042 raft_consensus.cc:3060] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Advancing to term 8
W20260709 14:51:36.689837  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:36.686942  7745 leader_election.cc:304] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:51:36.691886  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 143197us
W20260709 14:51:36.692366  7819 connection.cc:256] RPC call timeout handler was delayed by -1.4743382340000153s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17720000000000002s for a response
W20260709 14:51:36.692611  7819 connection.cc:256] RPC call timeout handler was delayed by -1.4743382340000153s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17720000000000002s for a response
W20260709 14:51:36.694293  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:36.676563  7771 rpcz_store.cc:276] 0709 14:51:35.607444 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:36.300966 (+693522us) service_pool.cc:224] Handling call
0709 14:51:36.320690 (+ 19724us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:51:36.399326 (+ 78636us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 14:51:36.529957 (+130631us) log.cc:844] Serialized 14 byte log entry
0709 14:51:36.674293 (+144336us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:51:36.674368 (+    75us) raft_consensus.cc:1645] Marking committed up to 3
0709 14:51:36.674429 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:36.675678 (+  1249us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:51:36.675844 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":37440,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":45,"raft.queue_time_us":8053,"thread_start_us":190381,"threads_started":2}
W20260709 14:51:36.696722  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 75017.4us
W20260709 14:51:36.698765  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:36.701339 10106 raft_consensus.cc:3060] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Advancing to term 8
W20260709 14:51:36.704839  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:51:36.709519  7742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:36.713819  7893 leader_election.cc:304] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:36.716480 10042 raft_consensus.cc:515] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:36.720896  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:36.630185 10185 consensus_queue.cc:1059] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.064s
I20260709 14:51:36.720307 10164 raft_consensus.cc:2749] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 14:51:36.716787  7893 leader_election.cc:304] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:36.720564 10098 leader_election.cc:290] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:36.720158  7779 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 2196) took 1109 ms. Trace:
I20260709 14:51:36.734624  7848 raft_consensus.cc:1240] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 7. Current term is 8. Ops: []
I20260709 14:51:36.650415 10192 consensus_queue.cc:260] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:36.751441  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 64612.3us
I20260709 14:51:36.753984  7779 rpcz_store.cc:276] 0709 14:51:35.610918 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:36.352203 (+741285us) service_pool.cc:224] Handling call
0709 14:51:36.352761 (+   558us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 14:51:36.369617 (+ 16856us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:51:36.369643 (+    26us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 14:51:36.400251 (+ 30608us) log.cc:844] Serialized 52 byte log entry
0709 14:51:36.617607 (+217356us) raft_consensus.cc:1645] Marking committed up to 4
0709 14:51:36.629659 (+ 12052us) log.cc:844] Serialized 14 byte log entry
0709 14:51:36.631684 (+  2025us) log.cc:844] Serialized 14 byte log entry
0709 14:51:36.632162 (+   478us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:36.632251 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:51:36.719872 (+ 87621us) raft_consensus.cc:1685] finished
0709 14:51:36.719894 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:51:36.720078 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":931,"prepare.queue_time_us":14126,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":77,"raft.queue_time_us":1186,"raft.run_cpu_time_us":328,"raft.run_wall_time_us":333,"thread_start_us":180859,"threads_started":1,"wal-append.queue_time_us":257257}
W20260709 14:51:36.771189  7819 connection.cc:256] RPC call timeout handler was delayed by -1.4392382339999585s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1811s for a response
I20260709 14:51:36.761312 10202 raft_consensus.cc:3060] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Advancing to term 6
W20260709 14:51:36.771193  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:51:36.772387  7819 connection.cc:256] RPC call timeout handler was delayed by -1.4392382339999585s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1811s for a response
W20260709 14:51:36.773145  7819 connection.cc:256] RPC call timeout handler was delayed by -1.2826382339999327s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1985s for a response
W20260709 14:51:36.773552  7819 connection.cc:256] RPC call timeout handler was delayed by -1.2826382339999327s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1985s for a response
W20260709 14:51:36.774174  7819 connection.cc:256] RPC call timeout handler was delayed by -1.2718382340000289s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19970000000000002s for a response
W20260709 14:51:36.774508  7819 connection.cc:256] RPC call timeout handler was delayed by -1.1143382340000016s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21720000000000003s for a response
W20260709 14:51:36.773514  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 56857us
W20260709 14:51:36.774796  7819 connection.cc:256] RPC call timeout handler was delayed by -1.1143382340000016s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21720000000000003s for a response
W20260709 14:51:36.775102  7819 connection.cc:256] RPC call timeout handler was delayed by -1.0936382339999682s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2195s for a response
W20260709 14:51:36.775317  7819 connection.cc:256] RPC call timeout handler was delayed by -1.087338233999958s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2202s for a response
W20260709 14:51:36.775532  7819 connection.cc:256] RPC call timeout handler was delayed by -1.067538233999926s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22240000000000004s for a response
W20260709 14:51:36.775740  7819 connection.cc:256] RPC call timeout handler was delayed by -1.067538233999926s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22240000000000004s for a response
W20260709 14:51:36.775997  7819 connection.cc:256] RPC call timeout handler was delayed by -1.0630382340000324s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22290000000000001s for a response
W20260709 14:51:36.776229  7819 connection.cc:256] RPC call timeout handler was delayed by -1.0630382340000324s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22290000000000001s for a response
W20260709 14:51:36.776396  7819 connection.cc:256] RPC call timeout handler was delayed by -1.0225382339999669s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22740000000000002s for a response
W20260709 14:51:36.776552  7819 connection.cc:256] RPC call timeout handler was delayed by -1.0142428719999543s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17270000000000002s for a response
W20260709 14:51:36.776716  7819 connection.cc:256] RPC call timeout handler was delayed by -1.0142428719999543s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17270000000000002s for a response
I20260709 14:51:36.771912 10242 raft_consensus.cc:493] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:36.779392 10242 raft_consensus.cc:515] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:36.788477 10196 raft_consensus.cc:493] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:36.788635  7771 raft_consensus.cc:1240] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 6. Current term is 7. Ops: []
I20260709 14:51:36.789225 10196 raft_consensus.cc:515] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:36.789974  7776 raft_consensus.cc:1240] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 6. Current term is 7. Ops: []
I20260709 14:51:36.791647 10196 leader_election.cc:290] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:36.789160  7774 raft_consensus.cc:1240] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 3. Current term is 4. Ops: []
I20260709 14:51:36.793107  9784 raft_consensus.cc:515] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:36.780685 10241 raft_consensus.cc:515] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:36.796061  9784 leader_election.cc:290] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:36.797816 10165 raft_consensus.cc:515] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:36.798810 10106 raft_consensus.cc:2749] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 14:51:36.800837 10165 leader_election.cc:290] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 7 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:36.802399 10057 raft_consensus.cc:3055] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 14:51:36.796061 10241 leader_election.cc:290] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:36.803069 10057 raft_consensus.cc:740] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:36.805526 10057 consensus_queue.cc:260] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:36.806973 10057 raft_consensus.cc:3060] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:51:36.806732 10221 raft_consensus.cc:515] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:36.787801 10192 raft_consensus.cc:3060] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:51:36.811120  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:36.809489 10242 leader_election.cc:290] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:36.811456  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:36.815353  7853 raft_consensus.cc:3060] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:51:36.811837  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:36.818230  7848 raft_consensus.cc:2393] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 5: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:51:36.811168  7745 leader_election.cc:304] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
W20260709 14:51:36.819792  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 45078.8us
I20260709 14:51:36.820631  7745 leader_election.cc:304] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:36.822994 10202 raft_consensus.cc:2749] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 14:51:36.824110  7893 leader_election.cc:304] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:51:36.825405  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:36.826015  7893 leader_election.cc:304] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:36.826859 10221 leader_election.cc:290] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:36.827051 10241 raft_consensus.cc:3060] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Advancing to term 5
W20260709 14:51:36.830255  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:36.827507  7819 leader_election.cc:304] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:36.827666  7893 leader_election.cc:304] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:36.825320 10202 raft_consensus.cc:2804] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 14:51:36.834173  7745 leader_election.cc:304] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:36.835155  7853 raft_consensus.cc:2468] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 7.
I20260709 14:51:36.835325  7779 raft_consensus.cc:1240] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 4. Current term is 5. Ops: []
I20260709 14:51:36.837524  9784 raft_consensus.cc:2804] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 14:51:36.838048 10106 raft_consensus.cc:2804] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 14:51:36.839854 10042 leader_election.cc:290] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:36.842078  7774 raft_consensus.cc:1240] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 6. Current term is 7. Ops: []
I20260709 14:51:36.843436  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:36.848227  9784 raft_consensus.cc:493] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:36.850399  7772 raft_consensus.cc:2468] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 5.
I20260709 14:51:36.853595  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:36.854537  7774 raft_consensus.cc:2468] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 6.
I20260709 14:51:36.850891 10242 raft_consensus.cc:2804] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 14:51:36.861265 10242 raft_consensus.cc:493] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:36.861855  9784 raft_consensus.cc:3060] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Advancing to term 8
I20260709 14:51:36.846130 10202 raft_consensus.cc:493] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:36.861734 10242 raft_consensus.cc:3060] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:51:36.863500 10164 raft_consensus.cc:2804] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 14:51:36.871258  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
W20260709 14:51:36.875459  7894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:36.864120 10098 raft_consensus.cc:2804] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 14:51:36.878250  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:36.894595  7854 raft_consensus.cc:3060] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:51:36.894989  7846 raft_consensus.cc:3060] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Advancing to term 8
W20260709 14:51:36.879542  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 45476.6us
W20260709 14:51:36.885427  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:36.882225 10202 raft_consensus.cc:3060] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:51:36.882602  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce9c0ef2db24c13a8b1402f21819458" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:36.848521 10106 raft_consensus.cc:493] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:36.921720 10106 raft_consensus.cc:3060] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:51:36.924325 10196 consensus_queue.cc:1048] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 14:51:36.904588 10098 raft_consensus.cc:493] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:36.925480 10098 raft_consensus.cc:3060] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:51:36.925963  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:36.926797  7772 raft_consensus.cc:3060] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:51:36.928531  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:36.881417 10241 raft_consensus.cc:2749] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 14:51:36.929689  7849 raft_consensus.cc:2410] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 14:51:36.905488  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 77930.1us
I20260709 14:51:36.909389  7846 raft_consensus.cc:2468] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 8.
I20260709 14:51:36.894392 10164 raft_consensus.cc:493] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 14:51:36.914803  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:36.930682  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:36.938777  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:36.942276  7745 leader_election.cc:304] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:36.935328 10164 raft_consensus.cc:3060] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 14:51:36.957577  7852 raft_consensus.cc:3060] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:51:36.958328  9784 raft_consensus.cc:515] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:36.959082  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:36.961688  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:36.963129 10221 consensus_queue.cc:1048] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 14:51:36.963321 10209 consensus_queue.cc:1048] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 14:51:36.963254 10196 consensus_queue.cc:1048] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 14:51:36.965616  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:36.947818 10218 raft_consensus.cc:2749] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 14:51:36.970851  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:36.971378  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:36.971812  7928 raft_consensus.cc:2393] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 7: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:51:36.972613  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258d6c2dda954bf5b65930fde8ecb9f3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:36.972718  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:36.973656  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:36.972649  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:36.972975  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:36.960963  9784 leader_election.cc:290] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:36.977725  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:36.977378  7772 raft_consensus.cc:2468] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 7.
W20260709 14:51:36.978129  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:36.963485  7745 leader_election.cc:304] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
W20260709 14:51:36.981658  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 55759.5us
I20260709 14:51:36.981201  7854 raft_consensus.cc:2468] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 3.
I20260709 14:51:36.982236  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:36.984540  7852 raft_consensus.cc:2468] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 5.
I20260709 14:51:36.974453  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:36.986127  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:36.993901  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:36.993939  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:36.995265  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:36.997686  7926 raft_consensus.cc:2393] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 7: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
W20260709 14:51:37.002344  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:37.003914  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:37.009977  7819 leader_election.cc:304] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:37.012595  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:37.009989  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:37.015496  7849 raft_consensus.cc:3060] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:51:37.017509  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
W20260709 14:51:37.017500  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 54077.7us
I20260709 14:51:37.007725  9784 raft_consensus.cc:2804] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 14:51:37.022632  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:37.022809  7850 raft_consensus.cc:3060] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Advancing to term 8
I20260709 14:51:37.024333  9784 raft_consensus.cc:493] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:37.031741  9784 raft_consensus.cc:3060] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:51:37.033089  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
W20260709 14:51:37.034188  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:37.034267  7854 raft_consensus.cc:3060] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:51:37.035375  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
W20260709 14:51:37.038687  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 90602.9us
I20260709 14:51:37.015949 10294 raft_consensus.cc:493] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:37.051064  7819 leader_election.cc:304] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:37.061956  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:37.062422  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:37.066217  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:37.066495  9784 raft_consensus.cc:515] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:37.067239  7776 raft_consensus.cc:2393] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 7: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:51:37.068276  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:37.069370  9784 leader_election.cc:290] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:37.070350 10242 raft_consensus.cc:515] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:37.053397 10294 raft_consensus.cc:515] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:37.082331  7853 raft_consensus.cc:1240] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 8. Current term is 9. Ops: []
I20260709 14:51:37.091782  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:37.092427  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258d6c2dda954bf5b65930fde8ecb9f3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:37.107421  7928 raft_consensus.cc:2468] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 6.
I20260709 14:51:37.112973  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:37.102805  7775 raft_consensus.cc:2468] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 3.
I20260709 14:51:37.118446  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:37.120265  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:37.061928  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:37.119540  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
W20260709 14:51:37.131834  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:37.132465  7854 raft_consensus.cc:2468] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 7.
I20260709 14:51:37.133700  7921 raft_consensus.cc:2468] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 8.
I20260709 14:51:37.086274 10294 leader_election.cc:290] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:37.073184 10242 leader_election.cc:290] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 9 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:37.090387 10057 consensus_queue.cc:1059] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 14:51:37.135810  7894 leader_election.cc:304] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:37.141007  7850 raft_consensus.cc:2468] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 8.
I20260709 14:51:37.135713  7893 leader_election.cc:304] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:51:37.142582  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 115926us
I20260709 14:51:37.091149 10196 raft_consensus.cc:2804] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 14:51:37.076804  9784 raft_consensus.cc:493] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:37.146303  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:37.069020 10106 raft_consensus.cc:515] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:37.154062  6549 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 14:51:37.162235 10098 raft_consensus.cc:515] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:37.168042 10098 leader_election.cc:290] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 10 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:37.164757  7849 raft_consensus.cc:2468] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 7.
W20260709 14:51:37.168637  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 56330.4us
I20260709 14:51:37.168916 10054 raft_consensus.cc:3055] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 14:51:37.169512 10054 raft_consensus.cc:740] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:37.170930 10054 consensus_queue.cc:260] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:37.172721 10054 raft_consensus.cc:3060] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 14:51:37.174676  9784 raft_consensus.cc:515] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:37.153549 10221 raft_consensus.cc:493] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:37.182308 10221 raft_consensus.cc:515] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:37.183102  9784 leader_election.cc:290] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:37.175873  7894 leader_election.cc:304] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:37.184952  7894 leader_election.cc:304] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:37.176843 10042 raft_consensus.cc:2804] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 14:51:37.178122  7743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:37.186671 10057 raft_consensus.cc:2804] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 14:51:37.187291 10106 leader_election.cc:290] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:51:37.183557  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:37.188283 10048 raft_consensus.cc:2804] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 14:51:37.189483 10048 raft_consensus.cc:697] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:37.190883  7819 leader_election.cc:304] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:37.192391  7819 leader_election.cc:304] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:37.194190 10242 raft_consensus.cc:2804] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Leader election won for term 3
I20260709 14:51:37.169394 10165 raft_consensus.cc:2804] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 14:51:37.150986 10196 raft_consensus.cc:493] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:37.190828 10048 consensus_queue.cc:237] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:37.187423 10042 raft_consensus.cc:697] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:37.196563  7894 leader_election.cc:304] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:37.187318 10057 raft_consensus.cc:697] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
W20260709 14:51:37.219846  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:37.197129 10202 raft_consensus.cc:515] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:37.201037  7893 leader_election.cc:304] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:51:37.208674  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:51:37.209147  7742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:37.149503 10295 raft_consensus.cc:2804] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader election won for term 7
I20260709 14:51:37.210906 10165 raft_consensus.cc:493] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:51:37.213889 10196 raft_consensus.cc:3060] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Advancing to term 7
W20260709 14:51:37.230721  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:37.214725 10242 raft_consensus.cc:697] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:51:37.222199 10294 raft_consensus.cc:2804] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 14:51:37.230690  7894 leader_election.cc:304] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:37.236634  7819 leader_election.cc:304] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:37.237226 10189 raft_consensus.cc:2749] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 14:51:37.222437 10185 raft_consensus.cc:2804] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 14:51:37.245448  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:51:37.241972  8598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 90035us
W20260709 14:51:37.246411  7745 leader_election.cc:336] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 1.506s (SENT)
I20260709 14:51:37.247160  7745 leader_election.cc:304] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:51:37.248057  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:37.234113 10165 raft_consensus.cc:3060] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:51:37.229131 10295 raft_consensus.cc:697] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:51:37.252189 10242 consensus_queue.cc:237] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:37.252346 10295 consensus_queue.cc:237] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:37.256629 10221 leader_election.cc:290] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:37.237576 10042 consensus_queue.cc:237] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:37.265421 10185 raft_consensus.cc:697] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:37.266690 10185 consensus_queue.cc:237] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:37.267009 10057 consensus_queue.cc:237] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:37.243227 10294 raft_consensus.cc:493] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:37.269727 10294 raft_consensus.cc:3060] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Advancing to term 7
W20260709 14:51:37.280915  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 44374.4us
I20260709 14:51:37.281965  7819 leader_election.cc:304] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:37.283121  7819 leader_election.cc:304] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:37.285014  7893 leader_election.cc:304] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:51:37.297086  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 66482.6us
W20260709 14:51:37.308585  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:37.271306 10192 raft_consensus.cc:2804] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 14:51:37.333110  7819 leader_election.cc:304] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:37.336357  7894 leader_election.cc:304] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:37.338193  7894 leader_election.cc:304] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:37.298689 10241 raft_consensus.cc:3060] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Advancing to term 7
W20260709 14:51:37.323522  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:37.302295 10221 raft_consensus.cc:2749] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 14:51:37.346203  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 102527us
W20260709 14:51:37.348182  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 76148.3us
I20260709 14:51:37.341883 10042 raft_consensus.cc:2804] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 14:51:37.345762 10054 raft_consensus.cc:2804] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 14:51:37.372371  7819 leader_election.cc:304] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:37.379918 10308 raft_consensus.cc:2804] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader election won for term 6
I20260709 14:51:37.380606 10308 raft_consensus.cc:697] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:51:37.382391  7893 leader_election.cc:304] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:37.382143 10308 consensus_queue.cc:237] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:37.364517 10192 raft_consensus.cc:697] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:37.385655  9929 raft_consensus.cc:2804] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 14:51:37.386168  9929 raft_consensus.cc:493] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:51:37.386520  9929 raft_consensus.cc:3060] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:51:37.386590 10192 consensus_queue.cc:237] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:37.374845 10042 raft_consensus.cc:697] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:37.390501 10042 consensus_queue.cc:237] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:37.364781 10242 raft_consensus.cc:2804] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader election won for term 7
I20260709 14:51:37.339694 10189 consensus_queue.cc:1059] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 14:51:37.394387 10189 raft_consensus.cc:3055] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 14:51:37.394824 10189 raft_consensus.cc:740] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:37.400110  9929 raft_consensus.cc:515] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:37.402691 10196 raft_consensus.cc:515] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:37.396162 10189 consensus_queue.cc:260] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:37.393190 10242 raft_consensus.cc:697] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
W20260709 14:51:37.403769  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:37.404558 10189 raft_consensus.cc:3060] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Advancing to term 9
W20260709 14:51:37.406136  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:37.404793 10242 consensus_queue.cc:237] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:37.413064  7894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:51:37.414913  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 62763.6us
I20260709 14:51:37.375504 10312 raft_consensus.cc:2804] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 14:51:37.426103  7894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:37.414535 10054 raft_consensus.cc:697] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
W20260709 14:51:37.429108  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:51:37.427585  7745 leader_election.cc:336] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 1.650s (SENT)
I20260709 14:51:37.475679  7819 leader_election.cc:304] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:37.425711 10312 raft_consensus.cc:493] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
W20260709 14:51:37.480834  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:37.426117 10304 raft_consensus.cc:2804] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader election won for term 5
I20260709 14:51:37.433140 10202 leader_election.cc:290] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 9 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:51:37.497355  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 75187.6us
W20260709 14:51:37.499699  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 74755.7us
W20260709 14:51:37.500005  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:51:37.516698 10298 log.cc:927] Time spent T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.175s	user 0.001s	sys 0.000s
W20260709 14:51:37.522024 10311 log.cc:927] Time spent T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 14:51:37.505262 10295 raft_consensus.cc:2804] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 14:51:37.514693 10302 raft_consensus.cc:2804] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Leader election won for term 4
I20260709 14:51:37.506309  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
W20260709 14:51:37.526522  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:37.484874 10312 raft_consensus.cc:3060] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:51:37.499574 10196 leader_election.cc:290] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 7 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:37.522505 10054 consensus_queue.cc:237] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:37.531451 10304 raft_consensus.cc:697] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:51:37.535202 10295 raft_consensus.cc:493] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:37.543713 10294 raft_consensus.cc:515] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:37.541738  7819 leader_election.cc:304] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:37.545466 10057 consensus_queue.cc:1059] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 14:51:37.568749 10165 raft_consensus.cc:515] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:37.547564 10302 raft_consensus.cc:697] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:51:37.581532  7852 raft_consensus.cc:1240] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 6. Current term is 7. Ops: []
I20260709 14:51:37.582348 10294 leader_election.cc:290] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 7 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:37.583220 10165 leader_election.cc:290] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:51:37.575088 10164 consensus_meta.cc:287] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent flushing consensus metadata: real 0.620s	user 0.014s	sys 0.002s
I20260709 14:51:37.582819 10302 consensus_queue.cc:237] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:37.579454 10307 consensus_queue.cc:1048] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 14:51:37.584930  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 51921.4us
I20260709 14:51:37.584038 10164 raft_consensus.cc:515] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:37.581492 10057 raft_consensus.cc:3055] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 14:51:37.619202  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 145272us
I20260709 14:51:37.580312 10295 raft_consensus.cc:3060] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:51:37.628371  7819 leader_election.cc:304] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:37.608672 10241 raft_consensus.cc:2749] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 14:51:37.635952  7894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:37.638187  7819 leader_election.cc:304] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:37.619707 10057 raft_consensus.cc:740] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:37.614869 10313 raft_consensus.cc:2804] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 14:51:37.653223  7847 raft_consensus.cc:1240] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 6. Current term is 7. Ops: []
I20260709 14:51:37.641698 10196 raft_consensus.cc:2804] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 14:51:37.638804 10294 raft_consensus.cc:2804] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 14:51:37.651324 10315 consensus_queue.cc:1059] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 14:51:37.667522  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:37.666246  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:37.661494 10196 raft_consensus.cc:493] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:37.682348  7819 leader_election.cc:304] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:37.683864 10057 consensus_queue.cc:260] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:37.686205 10057 raft_consensus.cc:3060] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:51:37.675808 10294 raft_consensus.cc:493] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:37.690137 10294 raft_consensus.cc:3060] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Advancing to term 7
W20260709 14:51:37.693388  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:51:37.694096  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:51:37.696401 10305 log.cc:927] Time spent T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.220s	user 0.003s	sys 0.002s
I20260709 14:51:37.704247  7846 raft_consensus.cc:2393] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 6: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:51:37.652123 10313 raft_consensus.cc:493] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
W20260709 14:51:37.718676  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:37.639674 10312 raft_consensus.cc:515] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:37.694195 10196 raft_consensus.cc:3060] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Advancing to term 9
W20260709 14:51:37.737322  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:51:37.764386  7743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:37.718207 10313 raft_consensus.cc:3060] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:51:37.800100  7846 raft_consensus.cc:1275] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 14:51:37.798609 10106 raft_consensus.cc:493] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:37.732489 10242 raft_consensus.cc:2804] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 14:51:37.788321 10315 consensus_queue.cc:1243] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer 1de5e20126fa4d8ca0793d19c7b847ed log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
W20260709 14:51:37.815984  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 166415us
I20260709 14:51:37.701390 10304 consensus_queue.cc:237] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:37.810286 10106 raft_consensus.cc:515] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:37.798866 10221 raft_consensus.cc:493] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
W20260709 14:51:37.836009  7742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:37.812731 10165 raft_consensus.cc:493] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:37.815428 10242 raft_consensus.cc:493] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
W20260709 14:51:37.880815  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:51:37.906160  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:51:37.923959  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 82865.1us
W20260709 14:51:37.948029  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 156651us
I20260709 14:51:37.827221 10223 raft_consensus.cc:493] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
W20260709 14:51:37.949653  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:51:37.957293  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 98420.2us
I20260709 14:51:37.919355 10242 raft_consensus.cc:3060] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:51:37.860916 10164 leader_election.cc:290] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:51:37.959210  7744 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.101.67:40785 timed out after 2.213s (SENT) [suppressed 23 similar messages]
W20260709 14:51:38.014907  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 55737.4us
I20260709 14:51:37.849398 10221 raft_consensus.cc:515] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:38.018090  8598 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.769s	user 0.017s	sys 0.038s
W20260709 14:51:38.018923  8598 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.770s	user 0.017s	sys 0.038s
W20260709 14:51:38.019302  8598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 770432us
I20260709 14:51:37.952769 10330 raft_consensus.cc:493] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:51:37.919078 10165 raft_consensus.cc:515] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:38.030632 10330 raft_consensus.cc:515] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:38.031368 10295 raft_consensus.cc:515] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:38.033627 10330 leader_election.cc:290] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:51:38.034312 10316 log.cc:927] Time spent T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.552s	user 0.003s	sys 0.000s
W20260709 14:51:38.033488  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 68944.7us
I20260709 14:51:37.949514 10315 consensus_queue.cc:1059] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.062s
I20260709 14:51:38.038991  7893 leader_election.cc:304] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:51:38.045075  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 72597.9us
I20260709 14:51:37.966861 10223 raft_consensus.cc:515] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:38.040475  9929 leader_election.cc:290] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 9 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:38.065837  7893 leader_election.cc:304] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:51:38.067946 10325 log.cc:927] Time spent T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.224s	user 0.000s	sys 0.002s
W20260709 14:51:38.068468 10327 log.cc:927] Time spent T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 14:51:38.070132 10307 consensus_queue.cc:1059] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 14:51:38.072393 10307 raft_consensus.cc:493] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:38.072911 10331 consensus_queue.cc:1059] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 14:51:38.054314 10042 consensus_queue.cc:1059] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 14:51:38.078197 10202 raft_consensus.cc:3055] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 14:51:38.092555 10307 raft_consensus.cc:515] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:38.070828 10341 raft_consensus.cc:2764] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 14:51:38.079070 10312 leader_election.cc:290] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 9 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:38.097103 10202 raft_consensus.cc:740] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
W20260709 14:51:38.097599 10326 log.cc:927] Time spent T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.249s	user 0.001s	sys 0.001s
I20260709 14:51:38.048506 10313 raft_consensus.cc:515] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:38.097640 10339 raft_consensus.cc:493] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:51:38.116847  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:38.124354  7845 raft_consensus.cc:1240] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 5. Current term is 6. Ops: []
I20260709 14:51:38.123670  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
W20260709 14:51:38.127430  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 61711.5us
I20260709 14:51:38.128433  7893 leader_election.cc:304] T 9ce9c0ef2db24c13a8b1402f21819458 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 9418391fa82a42c79c6cad13ba91d964
I20260709 14:51:38.130556  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:38.131407  7846 raft_consensus.cc:2468] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 8.
W20260709 14:51:38.133677  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:38.138968  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:38.124264 10189 raft_consensus.cc:2804] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 14:51:38.126098 10054 consensus_queue.cc:1059] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
W20260709 14:51:38.175772  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:38.115280 10334 consensus_queue.cc:1048] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.060s
I20260709 14:51:38.162099 10295 leader_election.cc:290] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 10 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:38.162581 10315 raft_consensus.cc:3055] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 LEADER]: Stepping down as leader of term 5
W20260709 14:51:38.180522 10337 log.cc:927] Time spent T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 14:51:38.180958  7849 raft_consensus.cc:2393] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 9: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:51:38.162794 10189 raft_consensus.cc:493] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:38.190836 10342 raft_consensus.cc:493] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:38.191995 10342 raft_consensus.cc:515] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:38.168553 10333 consensus_queue.cc:1048] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.152s
I20260709 14:51:38.194803 10342 leader_election.cc:290] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:38.196375 10342 raft_consensus.cc:493] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:38.197038 10342 raft_consensus.cc:515] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:38.187676  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 150761us
I20260709 14:51:38.123136 10339 raft_consensus.cc:515] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:38.198496  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:38.200526 10339 leader_election.cc:290] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:38.200713  7819 leader_election.cc:304] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:38.201941 10302 consensus_queue.cc:1059] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 14:51:38.197382 10340 raft_consensus.cc:493] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:38.202292 10313 leader_election.cc:290] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 6 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:51:38.187871  7743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:38.188305 10315 raft_consensus.cc:740] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:51:38.202916 10340 raft_consensus.cc:515] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:38.191171 10189 raft_consensus.cc:3060] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:51:38.204845 10315 consensus_queue.cc:260] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:38.205879 10223 leader_election.cc:290] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:38.206175 10315 raft_consensus.cc:3060] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:51:38.207458 10106 leader_election.cc:290] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:38.208439 10340 leader_election.cc:290] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:38.140445 10202 consensus_queue.cc:260] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:38.209666 10295 raft_consensus.cc:3055] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 LEADER]: Stepping down as leader of term 6
I20260709 14:51:38.210110 10295 raft_consensus.cc:740] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:51:38.210597 10202 raft_consensus.cc:3060] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Advancing to term 7
W20260709 14:51:38.179450 10328 log.cc:927] Time spent T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.115s	user 0.000s	sys 0.001s
I20260709 14:51:38.213637 10343 raft_consensus.cc:3055] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 14:51:38.215445 10343 raft_consensus.cc:740] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:38.202813 10346 raft_consensus.cc:2804] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader election won for term 6
I20260709 14:51:38.216012 10307 leader_election.cc:290] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:38.226964 10165 leader_election.cc:290] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:38.230554 10312 raft_consensus.cc:3055] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 LEADER]: Stepping down as leader of term 5
I20260709 14:51:38.231091 10312 raft_consensus.cc:740] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:51:38.234406 10042 raft_consensus.cc:3055] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 14:51:38.234887 10294 consensus_meta.cc:287] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent flushing consensus metadata: real 0.544s	user 0.010s	sys 0.003s
I20260709 14:51:38.235383 10294 raft_consensus.cc:515] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:38.234906 10042 raft_consensus.cc:740] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:38.239567 10042 consensus_queue.cc:260] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:38.237198 10348 raft_consensus.cc:493] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:38.219858 10106 raft_consensus.cc:493] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:38.241556 10348 raft_consensus.cc:515] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:38.242158 10106 raft_consensus.cc:515] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:38.235219 10312 consensus_queue.cc:260] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:38.244326 10312 raft_consensus.cc:3060] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:51:38.211056 10295 consensus_queue.cc:260] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:38.245488 10346 raft_consensus.cc:697] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:51:38.254413 10343 consensus_queue.cc:260] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:38.272197 10196 consensus_meta.cc:287] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent flushing consensus metadata: real 0.532s	user 0.007s	sys 0.006s
I20260709 14:51:38.220393 10340 raft_consensus.cc:493] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:38.272939 10196 raft_consensus.cc:515] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:38.273524 10340 raft_consensus.cc:515] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:38.277952 10321 raft_consensus.cc:2749] T 9ce9c0ef2db24c13a8b1402f21819458 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 14:51:38.272825 10057 consensus_meta.cc:287] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent flushing consensus metadata: real 0.586s	user 0.012s	sys 0.003s
W20260709 14:51:38.280174  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:51:38.298110  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:38.300649 10339 raft_consensus.cc:493] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:38.301680 10339 raft_consensus.cc:515] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:38.307721 10308 raft_consensus.cc:3055] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 LEADER]: Stepping down as leader of term 6
I20260709 14:51:38.308451 10308 raft_consensus.cc:740] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:51:38.309593 10308 consensus_queue.cc:260] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:38.310887 10308 raft_consensus.cc:3060] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:51:38.254230 10346 consensus_queue.cc:237] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:38.326957 10221 leader_election.cc:290] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:38.312459 10242 raft_consensus.cc:515] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:38.328387  7853 raft_consensus.cc:1240] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 6. Current term is 7. Ops: []
I20260709 14:51:38.332388 10242 leader_election.cc:290] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 7 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:51:38.336014  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 207679us
I20260709 14:51:38.339181  7674 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54350 (request call id 368) took 7750 ms. Trace:
I20260709 14:51:38.341449 10221 raft_consensus.cc:493] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:38.346765 10343 raft_consensus.cc:3060] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Advancing to term 7
W20260709 14:51:38.347992  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:38.291706  7819 leader_election.cc:304] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:38.348912 10294 leader_election.cc:290] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 7 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:38.341558 10042 raft_consensus.cc:3060] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:51:38.337020 10295 raft_consensus.cc:3060] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:51:38.354923 10340 leader_election.cc:290] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:38.363272 10340 raft_consensus.cc:493] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:38.358776 10221 raft_consensus.cc:515] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:38.363868 10340 raft_consensus.cc:515] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:38.366385 10221 leader_election.cc:290] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:51:38.368467  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 149821us
I20260709 14:51:38.369222 10304 raft_consensus.cc:2804] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 14:51:38.369693 10304 raft_consensus.cc:493] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:38.370095 10304 raft_consensus.cc:3060] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:51:38.370271 10106 leader_election.cc:290] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:38.371157 10196 leader_election.cc:290] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 9 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:38.371963 10339 leader_election.cc:290] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:38.373332 10339 raft_consensus.cc:493] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:38.373984 10339 raft_consensus.cc:515] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:38.375372  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:38.377486 10340 leader_election.cc:290] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:38.354554  7674 rpcz_store.cc:276] 0709 14:51:30.588710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:30.593367 (+  4657us) service_pool.cc:224] Handling call
0709 14:51:30.689815 (+ 96448us) spinlock_profiling.cc:243] Waited 48.1 ms on lock 0x7b54003499d4. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf8090 00007fb68ae96f3a 00007fb690c4d1cc 00007fb690d4b37e 00007fb68f20c2a4 00007fb68f20c232 00007fb68f20c161 00007fb68f20c0dc 00007fb68f20b392 00007fb6891c948c 00007fb6891c88c6
0709 14:51:38.333212 (+7643397us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 14:51:36.847604 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 14:51:36.853641 (+  6037us) write_op.cc:432] Acquiring schema lock in shared mode
0709 14:51:36.853703 (+    62us) write_op.cc:435] Acquired schema lock
0709 14:51:36.853716 (+    13us) tablet.cc:662] Decoding operations
0709 14:51:36.854548 (+   832us) write_op.cc:620] Acquiring the partition lock for write op
0709 14:51:36.854633 (+    85us) write_op.cc:641] Partition lock acquired for write op
0709 14:51:36.854664 (+    31us) tablet.cc:685] Acquiring locks for 4 operations
0709 14:51:36.855263 (+   599us) tablet.cc:701] Row locks acquired
0709 14:51:36.855321 (+    58us) write_op.cc:260] PREPARE: finished
0709 14:51:36.855608 (+   287us) write_op.cc:270] Start()
0709 14:51:36.855807 (+   199us) write_op.cc:276] Timestamp: P: 1783608696855468 usec, L: 0
0709 14:51:36.855824 (+    17us) op_driver.cc:348] REPLICATION: starting
0709 14:51:36.856792 (+   968us) log.cc:844] Serialized 1694 byte log entry
0709 14:51:37.298085 (+441293us) op_driver.cc:464] REPLICATION: finished
0709 14:51:37.550755 (+252670us) write_op.cc:301] APPLY: starting
0709 14:51:37.550894 (+   139us) tablet.cc:1367] starting BulkCheckPresence
0709 14:51:37.551102 (+   208us) tablet.cc:1370] finished BulkCheckPresence
0709 14:51:37.564252 (+ 13150us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 14:51:37.565000 (+   748us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 14:51:37.565452 (+   452us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 14:51:37.565518 (+    66us) write_op.cc:312] APPLY: finished
0709 14:51:37.576331 (+ 10813us) log.cc:844] Serialized 41 byte log entry
0709 14:51:37.576609 (+   278us) write_op.cc:489] Releasing partition, row and schema locks
0709 14:51:37.576839 (+   230us) write_op.cc:454] Released schema lock
0709 14:51:37.576935 (+    96us) write_op.cc:341] FINISH: Updating metrics
0709 14:51:37.577703 (+   768us) write_op.cc:489] Releasing partition, row and schema locks
0709 14:51:37.577740 (+    37us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":179093,"reported_tablets":20,"spinlock_wait_cycles":110538112,"child_traces":[["op",{"apply.queue_time_us":236284,"apply.run_cpu_time_us":5003,"apply.run_wall_time_us":26936,"num_ops":4,"prepare.queue_time_us":214069,"prepare.run_cpu_time_us":23626,"prepare.run_wall_time_us":130436,"raft.queue_time_us":234236,"raft.run_cpu_time_us":8307,"raft.run_wall_time_us":126025,"replication_time_us":442009,"thread_start_us":436289,"threads_started":4,"wal-append.queue_time_us":172445}]]}
I20260709 14:51:38.386924  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:38.355082 10348 leader_election.cc:290] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:38.397177 10189 raft_consensus.cc:515] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:38.393962  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:51:38.403978  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 44151.5us
W20260709 14:51:38.405388  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:38.409138  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:38.406075  7893 leader_election.cc:304] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:38.416965  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:38.416132  7894 leader_election.cc:304] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:38.422096  7846 raft_consensus.cc:1275] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 14:51:38.400426 10189 leader_election.cc:290] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 7 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:38.425403 10348 raft_consensus.cc:2749] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 14:51:38.425926  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:38.426666  7847 raft_consensus.cc:2468] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 4.
I20260709 14:51:38.430496  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:38.431519  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:38.433813  7926 raft_consensus.cc:1240] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 LEADER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 14:51:38.434046  7928 raft_consensus.cc:1240] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 LEADER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 4. Current term is 5. Ops: [4.3-4.3]
W20260709 14:51:38.434857  7742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:38.436740  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:38.438207  7852 raft_consensus.cc:2410] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for term 5 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 14:51:38.438345  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:38.440762  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:38.483580  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:38.483182  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:38.492509  7923 raft_consensus.cc:2393] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 6: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:51:38.441104  7921 raft_consensus.cc:1240] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 LEADER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 14:51:38.491729  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:38.493803  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:38.449455  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:38.437496 10340 raft_consensus.cc:493] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:38.489531 10342 leader_election.cc:290] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:38.501056  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:38.501878 10344 consensus_queue.cc:1059] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 14:51:38.500510  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:38.490446 10304 raft_consensus.cc:515] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:38.503118 10344 raft_consensus.cc:3055] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 14:51:38.503079  7923 raft_consensus.cc:2468] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 5.
I20260709 14:51:38.503796 10344 raft_consensus.cc:740] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:38.505507 10304 leader_election.cc:290] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 4 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:38.505154 10344 consensus_queue.cc:260] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:38.506912  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:38.507725 10344 raft_consensus.cc:3060] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:51:38.508322 10339 leader_election.cc:290] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:38.508903 10048 consensus_queue.cc:1059] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 14:51:38.511021 10042 raft_consensus.cc:3055] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 14:51:38.511457 10042 raft_consensus.cc:740] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:38.512319 10042 consensus_queue.cc:260] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:38.478905  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:38.513757  7848 raft_consensus.cc:2376] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 7. Re-sending same reply.
I20260709 14:51:38.498456 10340 raft_consensus.cc:515] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:38.517621  7851 raft_consensus.cc:1240] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 8. Current term is 9. Ops: []
I20260709 14:51:38.454870  7675 catalog_manager.cc:5697] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 3 to 6, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 6 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:51:38.526502  7850 raft_consensus.cc:2468] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 7.
I20260709 14:51:38.530638  7853 raft_consensus.cc:2468] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 8.
I20260709 14:51:38.530794  7675 catalog_manager.cc:5697] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:51:38.449638 10189 raft_consensus.cc:2804] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 14:51:38.537184  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:38.537514  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:38.539091  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:38.539889  7927 raft_consensus.cc:3060] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:51:38.537161  7675 catalog_manager.cc:5697] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 7 to 8, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 8 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:51:38.523312 10340 leader_election.cc:290] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:38.546933  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:38.548509  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783e4874513449ef9084b833f188a6d3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:38.549419  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce9c0ef2db24c13a8b1402f21819458" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:38.552963  7919 raft_consensus.cc:1240] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 4. Current term is 5. Ops: []
I20260709 14:51:38.553666  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:38.554520  7921 raft_consensus.cc:2393] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 8: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:51:38.560842  7919 raft_consensus.cc:1240] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 LEADER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 7. Current term is 8. Ops: []
I20260709 14:51:38.562250  7927 raft_consensus.cc:2468] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 6.
I20260709 14:51:38.548383  7926 raft_consensus.cc:1275] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 14:51:38.564337  7928 raft_consensus.cc:2410] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
W20260709 14:51:38.575769  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:51:38.577924  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:38.538283 10189 raft_consensus.cc:493] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:51:38.583168  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:38.586835  7923 raft_consensus.cc:2468] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 5.
I20260709 14:51:38.587275  7919 raft_consensus.cc:2393] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 8: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:51:38.593264  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:38.594420  7921 raft_consensus.cc:2393] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 9: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:51:38.583738 10189 raft_consensus.cc:3060] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:51:38.603247  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:38.604408  7928 raft_consensus.cc:1240] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 LEADER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 14:51:38.605566  7851 raft_consensus.cc:1275] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 14:51:38.605945  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:38.566107  7675 catalog_manager.cc:5697] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 4 to 6, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 6 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:51:38.607194  7853 raft_consensus.cc:1240] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 8. Current term is 9. Ops: []
I20260709 14:51:38.608667  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:38.608474  7675 catalog_manager.cc:5697] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 6 to 7, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 7 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:51:38.611944  7846 raft_consensus.cc:1240] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 14:51:38.617621  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:38.619472  7923 raft_consensus.cc:1275] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 14:51:38.620894  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:38.610921  7675 catalog_manager.cc:5697] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 7 to 8, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 8 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:51:38.625209  7675 catalog_manager.cc:5697] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 5 to 6, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 6 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:51:38.629961 10340 raft_consensus.cc:493] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:38.632050  7675 catalog_manager.cc:5697] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:51:38.634594  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
W20260709 14:51:38.636461  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:38.637617  7675 catalog_manager.cc:5697] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:51:38.614945 10042 raft_consensus.cc:3060] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:51:38.643023  7921 raft_consensus.cc:2468] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 7.
I20260709 14:51:38.643865  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:38.644117  7854 raft_consensus.cc:1275] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 14:51:38.645130  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:38.619498 10354 raft_consensus.cc:493] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:38.646499  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:38.646073  7848 raft_consensus.cc:2410] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 14:51:38.640868  7675 catalog_manager.cc:5697] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 7 to 8, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 8 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:51:38.647650  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:38.648983  7846 raft_consensus.cc:3060] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Advancing to term 7
W20260709 14:51:38.650255  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:38.632700 10340 raft_consensus.cc:515] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:38.651414  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:38.646382 10354 raft_consensus.cc:515] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:38.655606  7854 raft_consensus.cc:1240] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 LEADER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 5. Current term is 6. Ops: []
I20260709 14:51:38.657557  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:38.652908 10340 leader_election.cc:290] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:38.665004  7846 raft_consensus.cc:2410] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 14:51:38.666419  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:38.667158  7854 raft_consensus.cc:1275] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 14:51:38.666451  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18d29d52d304c87b930d4fb5eaf50b1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:38.685748  7928 raft_consensus.cc:2468] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 9.
I20260709 14:51:38.689234  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:38.690613  7926 raft_consensus.cc:2468] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 4.
I20260709 14:51:38.701781  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:38.706166  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:38.690023 10354 leader_election.cc:290] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:38.734539  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:38.672945 10189 raft_consensus.cc:515] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:38.742372  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:38.743507  7928 raft_consensus.cc:2468] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 5.
I20260709 14:51:38.747170  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:38.747747  7854 raft_consensus.cc:1240] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 14:51:38.751755  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:38.753911  7922 raft_consensus.cc:1240] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 14:51:38.755138  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:38.756182  7928 raft_consensus.cc:2376] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 6. Re-sending same reply.
I20260709 14:51:38.749789 10354 raft_consensus.cc:493] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:38.760751 10344 consensus_queue.cc:1048] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 14:51:38.775754 10354 raft_consensus.cc:515] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:38.761372  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:38.758759 10329 raft_consensus.cc:493] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:38.778966 10354 leader_election.cc:290] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:38.778455 10329 raft_consensus.cc:515] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:38.781342 10329 leader_election.cc:290] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:38.783356  7928 raft_consensus.cc:2393] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 6: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
W20260709 14:51:38.783877  7743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:38.793165  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:38.794186  7846 raft_consensus.cc:2393] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 7: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:51:38.794521  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:38.795058  7852 raft_consensus.cc:1240] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 14:51:38.795451  7845 raft_consensus.cc:2410] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 14:51:38.796269  7847 raft_consensus.cc:1275] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 14:51:38.796674  7847 pending_rounds.cc:85] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting all ops after (but not including) 1
I20260709 14:51:38.796947  7847 pending_rounds.cc:107] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 14:51:38.795277  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783e4874513449ef9084b833f188a6d3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:38.797328  7847 raft_consensus.cc:2889] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:51:38.799630  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:38.799813  7851 raft_consensus.cc:1275] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 14:51:38.800956  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:38.801831  7851 raft_consensus.cc:1275] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 14:51:38.802349  7851 pending_rounds.cc:85] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting all ops after (but not including) 4
I20260709 14:51:38.802615  7851 pending_rounds.cc:107] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 14:51:38.778236 10189 leader_election.cc:290] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 9 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:38.805768  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:38.815412  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:38.816120  7845 raft_consensus.cc:3060] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:51:38.813728  7847 raft_consensus.cc:1240] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 14:51:38.818289  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:38.819147  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:38.819598  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:38.819888  7922 raft_consensus.cc:2468] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 9.
I20260709 14:51:38.820075  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:38.820346  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:38.819175  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:38.820812  7927 raft_consensus.cc:2468] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 3.
I20260709 14:51:38.820188  7921 raft_consensus.cc:2468] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 7.
I20260709 14:51:38.819511  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:38.821890  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:38.822152  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:38.822597  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:38.822795  7921 raft_consensus.cc:2468] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 6.
I20260709 14:51:38.823132  7927 raft_consensus.cc:2468] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 5.
I20260709 14:51:38.823781  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:38.824070  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:38.826066  7927 raft_consensus.cc:2468] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 6.
I20260709 14:51:38.826174  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:38.824782  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:38.826298  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c563cc7cfbe4d59be4ffc5cf847ce56" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:38.824433  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce9c0ef2db24c13a8b1402f21819458" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:38.827018  7923 raft_consensus.cc:2393] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 8: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:51:38.827557  7849 raft_consensus.cc:1275] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 14:51:38.826987  7928 raft_consensus.cc:2468] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 6.
I20260709 14:51:38.827956  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:51:38.828285 10358 log.cc:927] Time spent T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.091s	user 0.000s	sys 0.006s
I20260709 14:51:38.828584  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:38.820608  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:38.827967  7849 pending_rounds.cc:85] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting all ops after (but not including) 4
I20260709 14:51:38.829061  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:38.829608  7919 raft_consensus.cc:2393] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 8: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:51:38.829795  7923 raft_consensus.cc:2468] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 7.
I20260709 14:51:38.829145  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:38.829607  7849 pending_rounds.cc:107] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 14:51:38.830567  7849 raft_consensus.cc:2889] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:51:38.830593  7850 raft_consensus.cc:2468] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 4.
I20260709 14:51:38.829861  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:38.831235  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:38.831851  7923 raft_consensus.cc:2468] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 7.
I20260709 14:51:38.831916  7852 raft_consensus.cc:2393] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 10: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:51:38.831948  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:38.826298  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:38.832053  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:38.802847  7851 raft_consensus.cc:2889] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:51:38.830709  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:38.823041  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:38.834628  7849 raft_consensus.cc:2393] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 9: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:51:38.875329  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783e4874513449ef9084b833f188a6d3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
W20260709 14:51:38.859041  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:38.880728  7923 raft_consensus.cc:2376] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 5. Re-sending same reply.
I20260709 14:51:38.881548  7846 raft_consensus.cc:2393] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 8: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:51:38.882349  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:38.883576  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:38.891031  7919 raft_consensus.cc:2468] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 8.
I20260709 14:51:38.890475  7779 raft_consensus.cc:2468] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 6.
I20260709 14:51:38.898022  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:38.898640  7778 raft_consensus.cc:1275] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 14:51:38.899112  7778 pending_rounds.cc:85] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed: Aborting all ops after (but not including) 3
I20260709 14:51:38.899336  7778 pending_rounds.cc:107] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 14:51:38.899245  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:38.899652  7778 raft_consensus.cc:2889] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:51:38.899857  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:38.900856  7775 raft_consensus.cc:2393] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 9: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:51:38.865751 10354 raft_consensus.cc:493] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:38.882398  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:38.902753  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
W20260709 14:51:38.914629  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:38.905676  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
W20260709 14:51:38.915149  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:51:38.915477  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:38.915676  7776 raft_consensus.cc:2393] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 8: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:51:38.901183  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:38.906024  7772 raft_consensus.cc:1240] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 9. Current term is 10. Ops: []
W20260709 14:51:38.915786  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:38.906294  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:38.917436  7773 raft_consensus.cc:3060] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:51:38.906559  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:38.923316 10339 raft_consensus.cc:493] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:38.909660  7894 leader_election.cc:304] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:38.923208 10340 raft_consensus.cc:493] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:38.923985 10339 raft_consensus.cc:515] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:38.924522 10340 raft_consensus.cc:515] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:38.921648  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18d29d52d304c87b930d4fb5eaf50b1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:38.913024  7849 raft_consensus.cc:2393] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 7: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:51:38.899854  7779 raft_consensus.cc:3060] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Advancing to term 8
I20260709 14:51:38.930217  7893 leader_election.cc:304] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:38.923235  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:38.935778  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:38.938910  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:38.936766  7849 raft_consensus.cc:2468] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 9.
I20260709 14:51:38.934289  7770 raft_consensus.cc:2468] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 8.
I20260709 14:51:38.941923  7845 raft_consensus.cc:2468] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 5.
I20260709 14:51:38.934981  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258d6c2dda954bf5b65930fde8ecb9f3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:38.943717  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:38.942934  7773 raft_consensus.cc:2468] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 7.
I20260709 14:51:38.945463  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:38.946441  7775 raft_consensus.cc:2468] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 7.
I20260709 14:51:38.947846  7846 raft_consensus.cc:2393] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 4: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:51:38.949206  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:38.950170  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783e4874513449ef9084b833f188a6d3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:38.949823  7847 raft_consensus.cc:1240] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 7. Current term is 8. Ops: []
I20260709 14:51:38.950528  7770 raft_consensus.cc:2468] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 3.
I20260709 14:51:38.949322  7772 raft_consensus.cc:2468] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 5.
I20260709 14:51:38.952906  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:38.951493  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:38.953233  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:38.953768  7776 raft_consensus.cc:2468] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 7.
I20260709 14:51:38.954802  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:38.957579  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:38.958899  7771 raft_consensus.cc:3060] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Advancing to term 7
W20260709 14:51:38.961361  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:38.962044  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:38.963456  7852 raft_consensus.cc:2393] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 7: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:51:38.925673 10343 raft_consensus.cc:493] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:38.970575  7778 raft_consensus.cc:2468] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 6.
I20260709 14:51:38.972718  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:38.974169  7849 raft_consensus.cc:3060] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Advancing to term 9
W20260709 14:51:38.975507  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:38.978543  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:38.943814 10334 raft_consensus.cc:2749] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 14:51:38.926635 10344 consensus_queue.cc:1059] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 14:51:38.981916  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:38.948660 10335 raft_consensus.cc:2804] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 14:51:38.985304  7926 raft_consensus.cc:2468] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 7.
I20260709 14:51:38.986059  7776 raft_consensus.cc:1240] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 7. Current term is 8. Ops: []
I20260709 14:51:38.902856 10354 raft_consensus.cc:515] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:39.009457  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:38.988314  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:38.990562  7775 raft_consensus.cc:1275] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 14:51:39.010768  7852 raft_consensus.cc:2468] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 8.
I20260709 14:51:38.937287 10189 consensus_queue.cc:1059] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 14:51:38.980186  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:39.012125  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:39.002749  7849 raft_consensus.cc:2468] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 9.
I20260709 14:51:39.012348  7845 raft_consensus.cc:2410] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 14:51:39.005414  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:38.988572 10042 raft_consensus.cc:493] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:38.938265 10348 consensus_queue.cc:1048] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.044s
I20260709 14:51:39.026558  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:39.014091  7850 raft_consensus.cc:2393] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 6: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:51:38.977432 10329 consensus_queue.cc:1048] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 14:51:39.023711  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:38.985292 10343 raft_consensus.cc:515] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:39.021788  7775 raft_consensus.cc:3055] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 LEADER]: Stepping down as leader of term 7
I20260709 14:51:39.037708  7775 raft_consensus.cc:740] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:51:38.982613 10353 consensus_queue.cc:1059] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 14:51:39.006016 10335 raft_consensus.cc:493] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:51:39.045569  7770 raft_consensus.cc:3055] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 LEADER]: Stepping down as leader of term 6
I20260709 14:51:39.038658  7775 consensus_queue.cc:260] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:39.048105  7770 raft_consensus.cc:740] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:51:39.054085  7775 raft_consensus.cc:3060] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Advancing to term 8
I20260709 14:51:39.054904  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:39.055701  7848 raft_consensus.cc:2468] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 5.
I20260709 14:51:39.054312  7777 raft_consensus.cc:1240] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 4. Current term is 5. Ops: []
I20260709 14:51:39.058360  7776 raft_consensus.cc:3055] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 LEADER]: Stepping down as leader of term 2
W20260709 14:51:39.059695  7742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:51:39.060269  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:39.058899  7776 raft_consensus.cc:740] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:51:39.063758 10339 leader_election.cc:290] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:51:39.065476  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:39.073232  7775 raft_consensus.cc:1275] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 14:51:39.032603 10042 raft_consensus.cc:515] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:39.075523 10342 raft_consensus.cc:3055] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 14:51:39.077023  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:39.084125  7774 raft_consensus.cc:2468] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 9.
I20260709 14:51:39.080228  7779 raft_consensus.cc:2468] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 8.
I20260709 14:51:39.049893 10335 raft_consensus.cc:3060] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 14:51:39.104256  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:39.083351  7770 consensus_queue.cc:260] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:39.108255  7848 raft_consensus.cc:2468] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 6.
I20260709 14:51:39.105232  7771 raft_consensus.cc:2468] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 7.
I20260709 14:51:39.112030  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c563cc7cfbe4d59be4ffc5cf847ce56" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:51:39.113830  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:39.079293 10342 raft_consensus.cc:740] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:39.117147  7770 raft_consensus.cc:3060] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:51:39.119477  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:39.120000  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:39.120585  7853 raft_consensus.cc:2468] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 8.
I20260709 14:51:39.121136  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:39.121604  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:39.122061  7854 raft_consensus.cc:2393] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 9: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:51:39.122336  7852 raft_consensus.cc:2393] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 9: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:51:39.122952  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:39.124405  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:39.125272  7845 raft_consensus.cc:2393] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 8: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:51:39.127796 10354 leader_election.cc:290] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:39.123095  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:39.136096  7847 raft_consensus.cc:2393] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 7: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:51:39.115619  7776 consensus_queue.cc:260] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:39.159442  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:39.160759  7850 raft_consensus.cc:2393] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 7: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:51:39.180907  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:51:39.186280  7743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:39.148327  7770 raft_consensus.cc:1275] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 14:51:39.190497  7770 pending_rounds.cc:85] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed: Aborting all ops after (but not including) 4
I20260709 14:51:39.190963  7770 pending_rounds.cc:107] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 14:51:39.191445  7770 raft_consensus.cc:2889] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:51:39.156805 10354 raft_consensus.cc:493] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:39.157946 10340 leader_election.cc:290] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:51:39.208611  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 272128us
W20260709 14:51:39.216675  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:39.156021 10339 consensus_queue.cc:1059] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.052s
W20260709 14:51:39.223870  7743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:51:39.236429  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 270626us
I20260709 14:51:39.260015  6549 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 14:51:39.262566  7819 connection.cc:256] RPC call timeout handler was delayed by -2.904424314000039s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1947s for a response
W20260709 14:51:39.263414  7819 connection.cc:256] RPC call timeout handler was delayed by -2.8666243139999779s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19890000000000002s for a response
I20260709 14:51:39.209638 10354 raft_consensus.cc:515] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:39.229578 10348 consensus_queue.cc:1059] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 14:51:39.259166 10339 consensus_queue.cc:1243] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Peer 1e9289592458429bbddb19c2e7b7b7b0 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 14:51:39.282670 10344 raft_consensus.cc:3055] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 14:51:39.331765  7744 leader_election.cc:304] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:39.259513 10334 consensus_queue.cc:1048] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 14:51:39.344156 10048 consensus_queue.cc:1048] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 14:51:39.284807 10042 leader_election.cc:290] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:39.229709 10342 consensus_queue.cc:260] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:39.340565 10344 raft_consensus.cc:740] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
W20260709 14:51:39.382256  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:51:39.386181  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:51:39.399049  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 122047us
I20260709 14:51:39.340212 10339 consensus_queue.cc:1059] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
W20260709 14:51:39.403681  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:39.389638 10353 consensus_queue.cc:1243] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer 1e9289592458429bbddb19c2e7b7b7b0 log is divergent from this leader: its last log entry 5.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 14:51:39.397451 10342 raft_consensus.cc:3060] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:51:39.416296 10339 consensus_queue.cc:1048] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 14:51:39.413606  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 152256us
W20260709 14:51:39.422896  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:39.425138  7894 leader_election.cc:304] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
W20260709 14:51:39.432874  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 134639us
I20260709 14:51:39.440985  7776 raft_consensus.cc:3060] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Advancing to term 3
W20260709 14:51:39.447747  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:51:39.449098  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 117459us
W20260709 14:51:39.450340  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:39.450680  7744 leader_election.cc:304] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:51:39.465418  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:39.421525 10353 consensus_queue.cc:1048] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 14:51:39.473876 10353 consensus_queue.cc:1048] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 14:51:39.475661 10353 raft_consensus.cc:2749] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 14:51:39.476414 10353 consensus_queue.cc:1059] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 14:51:39.416354 10344 consensus_queue.cc:260] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:39.478394 10344 raft_consensus.cc:3060] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:51:39.462687 10377 raft_consensus.cc:2749] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 14:51:39.490008 10335 raft_consensus.cc:515] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:39.498448 10354 leader_election.cc:290] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:39.458420 10370 consensus_queue.cc:1059] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.160s
I20260709 14:51:39.501616 10379 raft_consensus.cc:2804] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 14:51:39.526031  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 69166.3us
I20260709 14:51:39.505906  7776 raft_consensus.cc:1275] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 14:51:39.527900  7745 leader_election.cc:304] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:39.527913  7776 pending_rounds.cc:85] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed: Aborting all ops after (but not including) 1
I20260709 14:51:39.528721  7776 pending_rounds.cc:107] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 14:51:39.529049  7776 raft_consensus.cc:2889] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 14:51:39.532994  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:39.498605 10343 leader_election.cc:290] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:51:39.536437  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 111720us
I20260709 14:51:39.519375 10379 raft_consensus.cc:493] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:39.535898 10370 consensus_queue.cc:1243] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer 1e9289592458429bbddb19c2e7b7b7b0 log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 14:51:39.546507  7894 leader_election.cc:304] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:39.535151 10339 raft_consensus.cc:493] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:51:39.552735  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 102228us
I20260709 14:51:39.541857 10379 raft_consensus.cc:3060] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Advancing to term 9
W20260709 14:51:39.579334  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:39.584815  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:39.585644  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:39.584769  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:39.587077  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:39.587908  7847 raft_consensus.cc:2468] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 8.
I20260709 14:51:39.588593  7849 raft_consensus.cc:1240] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 3. Current term is 4. Ops: []
I20260709 14:51:39.588438 10388 raft_consensus.cc:2804] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 14:51:39.592484  7744 leader_election.cc:304] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:39.596114  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:39.596930  7928 raft_consensus.cc:2393] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 9: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:51:39.593343  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:39.597721  7923 raft_consensus.cc:2393] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 4: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:51:39.598033  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:39.599728  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:39.600093  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:51:39.600922  7819 leader_election.cc:336] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785): Timed out: RequestConsensusVote RPC to 127.6.101.67:40785 timed out after 1.997s (SENT)
I20260709 14:51:39.601469  7819 leader_election.cc:304] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:39.602021  7849 raft_consensus.cc:1275] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 14:51:39.603158  7919 raft_consensus.cc:2393] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 6: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:51:39.603160  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:39.604667  7745 leader_election.cc:304] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 3876b8ee8d744cb18e91d97aae93b1ac, 9418391fa82a42c79c6cad13ba91d964
I20260709 14:51:39.603695  7744 leader_election.cc:304] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:39.561264 10370 raft_consensus.cc:2804] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 14:51:39.609743  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:39.610056  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:39.612013  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:39.618836  7854 raft_consensus.cc:1240] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 9. Current term is 10. Ops: []
I20260709 14:51:39.620886  7745 leader_election.cc:304] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:39.609822 10370 raft_consensus.cc:493] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:39.632938  7745 leader_election.cc:304] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:39.555781 10371 consensus_queue.cc:1059] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.057s
I20260709 14:51:39.558897 10339 raft_consensus.cc:515] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:39.652112  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:39.650108 10370 raft_consensus.cc:3060] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Advancing to term 5
W20260709 14:51:39.661561  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 57976.7us
I20260709 14:51:39.654891  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
W20260709 14:51:39.617391 10390 log.cc:927] Time spent T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.130s	user 0.006s	sys 0.000s
I20260709 14:51:39.652818  7920 raft_consensus.cc:1275] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 14:51:39.653889  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:39.660116  7923 raft_consensus.cc:1275] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 14:51:39.618636 10369 raft_consensus.cc:2749] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 14:51:39.600389 10377 consensus_queue.cc:1048] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.059s
I20260709 14:51:39.637791 10388 raft_consensus.cc:697] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
W20260709 14:51:39.673420  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:39.662838  7744 leader_election.cc:304] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:39.670601  7923 raft_consensus.cc:1275] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 14:51:39.676537  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:39.658721 10397 raft_consensus.cc:2749] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 14:51:39.702137  7919 raft_consensus.cc:2468] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 6.
I20260709 14:51:39.630496 10392 consensus_queue.cc:1048] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.086s
I20260709 14:51:39.667088 10312 raft_consensus.cc:493] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:51:39.706974  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 44222.5us
W20260709 14:51:39.704546  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 71682.2us
I20260709 14:51:39.713357  7928 raft_consensus.cc:2468] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 7.
I20260709 14:51:39.705781  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:39.665227 10339 leader_election.cc:290] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:39.717777 10340 raft_consensus.cc:3055] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 LEADER]: Stepping down as leader of term 4
I20260709 14:51:39.718395 10340 raft_consensus.cc:740] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:51:39.719411 10340 consensus_queue.cc:260] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:39.720789 10340 raft_consensus.cc:3060] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:51:39.721498 10312 raft_consensus.cc:515] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:39.708671 10369 raft_consensus.cc:3060] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Advancing to term 4
W20260709 14:51:39.749872  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 155719us
I20260709 14:51:39.705535 10396 raft_consensus.cc:2749] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 14:51:39.666143 10384 consensus_queue.cc:1048] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.097s
I20260709 14:51:39.753541  7925 raft_consensus.cc:1275] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 14:51:39.754568 10380 log.cc:927] Time spent T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.271s	user 0.001s	sys 0.001s
I20260709 14:51:39.755348  7925 raft_consensus.cc:1275] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 14:51:39.757831  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258d6c2dda954bf5b65930fde8ecb9f3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:39.758435 10312 leader_election.cc:290] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:39.759805  7853 raft_consensus.cc:1240] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 6. Current term is 7. Ops: []
I20260709 14:51:39.762131  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:39.763861 10354 raft_consensus.cc:3055] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 LEADER]: Stepping down as leader of term 7
I20260709 14:51:39.729959 10388 consensus_queue.cc:237] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:39.745141  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:39.706096 10335 leader_election.cc:290] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:39.751515 10403 raft_consensus.cc:2804] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 14:51:39.766762  7921 raft_consensus.cc:2468] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 10.
I20260709 14:51:39.764375 10354 raft_consensus.cc:740] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
W20260709 14:51:39.771674  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 61624.7us
I20260709 14:51:39.772449  7924 raft_consensus.cc:2468] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 7.
I20260709 14:51:39.777379 10403 raft_consensus.cc:493] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:39.778328 10403 raft_consensus.cc:3060] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:51:39.778988 10334 raft_consensus.cc:3055] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 14:51:39.779523 10334 raft_consensus.cc:740] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:39.780668 10334 consensus_queue.cc:260] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:39.777401 10354 consensus_queue.cc:260] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:39.785965 10334 raft_consensus.cc:3060] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:51:39.782255 10295 raft_consensus.cc:2749] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 14:51:39.782665 10404 raft_consensus.cc:493] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:51:39.775494  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:39.788959  7744 leader_election.cc:304] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:51:39.790548  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:51:39.796478  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:39.775909  7745 leader_election.cc:304] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:39.789883  7894 leader_election.cc:304] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:39.802631 10407 raft_consensus.cc:2804] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader election won for term 7
I20260709 14:51:39.806574 10394 raft_consensus.cc:2804] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader election won for term 9
I20260709 14:51:39.807256 10394 raft_consensus.cc:697] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
W20260709 14:51:39.808499  7819 leader_election.cc:336] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785): Timed out: RequestConsensusVote RPC to 127.6.101.67:40785 timed out after 2.195s (SENT)
I20260709 14:51:39.808316 10394 consensus_queue.cc:237] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:39.788326 10404 raft_consensus.cc:515] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:39.813297 10381 raft_consensus.cc:2804] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 14:51:39.798810 10354 raft_consensus.cc:3060] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Advancing to term 8
W20260709 14:51:39.816664  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:39.813880 10381 raft_consensus.cc:493] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:39.839660 10381 raft_consensus.cc:3060] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:51:39.838207 10407 raft_consensus.cc:697] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:51:39.809726 10335 consensus_queue.cc:1059] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.014s
W20260709 14:51:39.840613  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 51760.2us
I20260709 14:51:39.847847  7744 leader_election.cc:304] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:51:39.848233  7819 leader_election.cc:336] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785): Timed out: RequestConsensusVote RPC to 127.6.101.67:40785 timed out after 2.202s (SENT)
I20260709 14:51:39.850342  7744 leader_election.cc:304] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:51:39.843254  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 67413.7us
I20260709 14:51:39.837991 10192 consensus_queue.cc:1048] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 14:51:39.858819  7924 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "258d6c2dda954bf5b65930fde8ecb9f3"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
mode: GRACEFUL
new_leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:48676
I20260709 14:51:39.860085  7924 raft_consensus.cc:606] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 LEADER]: Received request to transfer leadership to TS 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:51:39.861164 10379 raft_consensus.cc:515] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:39.869923 10407 consensus_queue.cc:237] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:39.859050  7819 connection.cc:256] RPC call timeout handler was delayed by -2.7928243140000859s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20710000000000003s for a response
W20260709 14:51:39.874111  7819 leader_election.cc:336] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785): Timed out: RequestConsensusVote RPC to 127.6.101.67:40785 timed out after 2.274s (SENT)
W20260709 14:51:39.875636  7819 connection.cc:256] RPC call timeout handler was delayed by -2.729824313999984s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2141s for a response
W20260709 14:51:39.876289  7819 connection.cc:256] RPC call timeout handler was delayed by -2.6956243140000424s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21789999999999998s for a response
I20260709 14:51:39.876397  7924 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
mode: GRACEFUL
new_leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:48676
I20260709 14:51:39.877210  7924 raft_consensus.cc:606] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 LEADER]: Received request to transfer leadership to TS 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:51:39.845211 10377 raft_consensus.cc:2804] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 14:51:39.878544 10377 raft_consensus.cc:493] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:39.878953 10377 raft_consensus.cc:3060] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:51:39.879071 10295 raft_consensus.cc:493] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:39.879851 10295 raft_consensus.cc:515] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:39.882668 10295 leader_election.cc:290] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:39.852636  7745 leader_election.cc:304] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
W20260709 14:51:39.883580  7819 connection.cc:256] RPC call timeout handler was delayed by -1.5887128809999922s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15900000000000003s for a response
W20260709 14:51:39.892246  7819 connection.cc:256] RPC call timeout handler was delayed by -1.5635128810000651s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16180000000000003s for a response
W20260709 14:51:39.893081  7819 connection.cc:256] RPC call timeout handler was delayed by -1.4951128810000682s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1694s for a response
I20260709 14:51:39.889650 10353 raft_consensus.cc:2804] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 14:51:39.890147 10404 leader_election.cc:290] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:39.869463 10379 leader_election.cc:290] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 9 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:39.891486  7745 leader_election.cc:304] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:39.887799  7924 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
mode: GRACEFUL
new_leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:48676
W20260709 14:51:39.899019  7819 connection.cc:256] RPC call timeout handler was delayed by -1.4528128809999998s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17410000000000003s for a response
W20260709 14:51:39.898262  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 44935.4us
I20260709 14:51:39.909951  7924 raft_consensus.cc:606] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Received request to transfer leadership to TS 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:51:39.910476  7924 raft_consensus.cc:614] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 14:51:39.909955  7819 connection.cc:256] RPC call timeout handler was delayed by -1.4141128810000509s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1784s for a response
W20260709 14:51:39.914382  7819 connection.cc:256] RPC call timeout handler was delayed by -1.3097128809999958s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19s for a response
W20260709 14:51:39.914798  7819 connection.cc:256] RPC call timeout handler was delayed by -1.3043128809999871s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1906s for a response
W20260709 14:51:39.915132  7819 connection.cc:256] RPC call timeout handler was delayed by -1.2719128810000484s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1942s for a response
W20260709 14:51:39.915426  7819 connection.cc:256] RPC call timeout handler was delayed by -1.2602128810000295s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1955s for a response
W20260709 14:51:39.915694  7819 connection.cc:256] RPC call timeout handler was delayed by -1.2467128810000077s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.197s for a response
W20260709 14:51:39.916316  7819 connection.cc:256] RPC call timeout handler was delayed by -1.2413128809999989s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1976s for a response
W20260709 14:51:39.901742  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 51483.7us
I20260709 14:51:39.903405  7926 raft_consensus.cc:2468] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 9.
I20260709 14:51:39.902423  7922 raft_consensus.cc:2468] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 7.
W20260709 14:51:39.915809  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:39.865994 10344 raft_consensus.cc:3055] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 14:51:39.938344 10344 raft_consensus.cc:740] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:39.938745  7854 raft_consensus.cc:1275] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 14:51:39.917594 10354 raft_consensus.cc:2804] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 14:51:39.940071 10354 raft_consensus.cc:493] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:39.940601 10354 raft_consensus.cc:3060] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Advancing to term 9
W20260709 14:51:39.916775  7819 connection.cc:256] RPC call timeout handler was delayed by -1.2359128809999902s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19820000000000002s for a response
W20260709 14:51:39.944941  7819 connection.cc:256] RPC call timeout handler was delayed by -1.2017128810000486s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.202s for a response
W20260709 14:51:39.945483  7819 connection.cc:256] RPC call timeout handler was delayed by -1.04961288100003s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2189s for a response
I20260709 14:51:39.945626 10379 consensus_queue.cc:1048] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 14:51:39.936100  7744 leader_election.cc:304] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:51:39.949054  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:39.949991 10404 consensus_queue.cc:1048] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 14:51:39.852824 10368 consensus_queue.cc:1059] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.109s
I20260709 14:51:39.954331 10369 raft_consensus.cc:2749] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 14:51:39.954568 10368 raft_consensus.cc:3055] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 14:51:39.955611 10368 raft_consensus.cc:740] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:39.956676 10404 consensus_queue.cc:1048] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 14:51:39.959949  7926 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ad8e261558b942c6b42c841689082c10"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
mode: GRACEFUL
new_leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:48676
I20260709 14:51:39.961045  7926 raft_consensus.cc:606] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Received request to transfer leadership to TS 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:51:39.961759  7926 raft_consensus.cc:614] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 14:51:39.852114 10396 raft_consensus.cc:2749] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 14:51:39.916548 10406 log.cc:927] Time spent T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 14:51:39.965876  7926 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
mode: GRACEFUL
new_leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:48676
I20260709 14:51:39.966918  7926 raft_consensus.cc:606] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 LEADER]: Received request to transfer leadership to TS 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:51:39.968339  7850 raft_consensus.cc:1240] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 4. Current term is 5. Ops: []
I20260709 14:51:39.969079  6549 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 14:51:39.851684 10409 raft_consensus.cc:2749] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 14:51:39.939404 10344 consensus_queue.cc:260] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:39.971714 10344 raft_consensus.cc:3060] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:51:39.973321 10404 consensus_queue.cc:1048] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 14:51:39.979161 10377 raft_consensus.cc:515] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:39.995791  7893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:39.939822  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:39.998409  7846 raft_consensus.cc:3060] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Advancing to term 9
W20260709 14:51:40.002156  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 66164.9us
I20260709 14:51:40.008469  6549 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 14:51:39.902415 10353 raft_consensus.cc:493] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:39.905859 10295 raft_consensus.cc:493] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:51:40.017129  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:51:40.026422  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:40.010347 10342 consensus_queue.cc:1059] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.016s
I20260709 14:51:40.020107 10377 leader_election.cc:290] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:40.021718  7675 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54364 (request call id 339) took 3199 ms. Trace:
I20260709 14:51:40.023573  7744 leader_election.cc:304] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:40.033586  7846 raft_consensus.cc:2468] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 9.
I20260709 14:51:40.010749 10339 raft_consensus.cc:2764] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 14:51:40.022404  7676 catalog_manager.cc:5697] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 6 to 7, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 7 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:51:40.032250  7675 rpcz_store.cc:276] 0709 14:51:36.813676 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:36.813880 (+   204us) service_pool.cc:224] Handling call
0709 14:51:40.012951 (+3199071us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 14:51:38.760752 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 14:51:38.761354 (+   602us) write_op.cc:432] Acquiring schema lock in shared mode
0709 14:51:38.761395 (+    41us) write_op.cc:435] Acquired schema lock
0709 14:51:38.761415 (+    20us) tablet.cc:662] Decoding operations
0709 14:51:38.762938 (+  1523us) write_op.cc:620] Acquiring the partition lock for write op
0709 14:51:38.763293 (+   355us) write_op.cc:641] Partition lock acquired for write op
0709 14:51:38.763341 (+    48us) tablet.cc:685] Acquiring locks for 10 operations
0709 14:51:38.764706 (+  1365us) tablet.cc:701] Row locks acquired
0709 14:51:38.764733 (+    27us) write_op.cc:260] PREPARE: finished
0709 14:51:38.764951 (+   218us) write_op.cc:270] Start()
0709 14:51:38.765098 (+   147us) write_op.cc:276] Timestamp: P: 1783608698764872 usec, L: 0
0709 14:51:38.765122 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 14:51:38.773318 (+  8196us) log.cc:844] Serialized 4000 byte log entry
0709 14:51:39.425789 (+652471us) op_driver.cc:464] REPLICATION: finished
0709 14:51:39.658341 (+232552us) write_op.cc:301] APPLY: starting
0709 14:51:39.662400 (+  4059us) tablet.cc:1367] starting BulkCheckPresence
0709 14:51:39.706963 (+ 44563us) tablet.cc:1370] finished BulkCheckPresence
0709 14:51:39.731100 (+ 24137us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 14:51:39.876492 (+145392us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 14:51:39.876807 (+   315us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=10
0709 14:51:39.876862 (+    55us) write_op.cc:312] APPLY: finished
0709 14:51:39.877342 (+   480us) log.cc:844] Serialized 77 byte log entry
0709 14:51:39.878402 (+  1060us) write_op.cc:489] Releasing partition, row and schema locks
0709 14:51:39.887267 (+  8865us) write_op.cc:454] Released schema lock
0709 14:51:39.887332 (+    65us) write_op.cc:341] FINISH: Updating metrics
0709 14:51:39.911745 (+ 24413us) write_op.cc:489] Releasing partition, row and schema locks
0709 14:51:39.917426 (+  5681us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":31,"child_traces":[["op",{"apply.queue_time_us":191424,"apply.run_cpu_time_us":12667,"apply.run_wall_time_us":251517,"num_ops":10,"prepare.queue_time_us":106493,"prepare.run_cpu_time_us":39606,"prepare.run_wall_time_us":267074,"raft.queue_time_us":229736,"raft.run_cpu_time_us":13919,"raft.run_wall_time_us":154367,"replication_time_us":643710,"thread_start_us":579175,"threads_started":4,"wal-append.queue_time_us":352622}]]}
I20260709 14:51:40.038293  7676 catalog_manager.cc:5697] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 6 to 7, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 7 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:51:39.956801 10368 consensus_queue.cc:260] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:40.043797 10368 raft_consensus.cc:3060] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:51:40.043124  7676 catalog_manager.cc:5697] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 5 to 6, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 6 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:51:40.045809  7676 catalog_manager.cc:5697] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 3 to 4, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 4 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:51:40.016438 10353 raft_consensus.cc:3060] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:51:40.050055  7676 catalog_manager.cc:5697] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 1 to 2, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 2 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:51:39.983335 10354 raft_consensus.cc:515] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:40.054340  7744 leader_election.cc:304] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:40.056289 10377 raft_consensus.cc:2804] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader election won for term 6
I20260709 14:51:40.057286 10377 raft_consensus.cc:697] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:51:40.058940 10377 consensus_queue.cc:237] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:40.052271  7676 catalog_manager.cc:5697] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 2 to 4, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 4 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:51:40.065795 10339 raft_consensus.cc:2749] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 14:51:40.065158 10369 consensus_queue.cc:1059] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 14:51:40.068797 10369 raft_consensus.cc:3055] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 LEADER]: Stepping down as leader of term 8
I20260709 14:51:40.069260 10369 raft_consensus.cc:740] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:51:40.070602 10369 consensus_queue.cc:260] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:40.071203  7894 leader_election.cc:304] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:40.072028 10369 raft_consensus.cc:3060] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:51:40.073519 10395 raft_consensus.cc:2804] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 14:51:40.074281 10395 raft_consensus.cc:697] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:40.074474 10398 raft_consensus.cc:493] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:40.075459 10398 raft_consensus.cc:515] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:40.075752 10395 consensus_queue.cc:237] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:40.077847  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:40.079950 10379 raft_consensus.cc:493] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:40.080613 10379 raft_consensus.cc:515] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:40.084830  7744 leader_election.cc:304] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:40.074483  7819 leader_election.cc:304] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:40.065068 10370 raft_consensus.cc:515] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:40.093869  7676 catalog_manager.cc:5697] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 6 to 7, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 7 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:51:40.118940  7744 leader_election.cc:304] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:40.031530 10295 raft_consensus.cc:515] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:40.128168  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 53755.5us
I20260709 14:51:40.139583  7819 leader_election.cc:304] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:40.115653 10404 raft_consensus.cc:2749] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 14:51:40.137863  7744 leader_election.cc:304] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:40.149747 10354 leader_election.cc:290] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:40.150451 10370 leader_election.cc:290] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:40.150933 10312 raft_consensus.cc:2749] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 14:51:40.123385 10339 raft_consensus.cc:2749] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 14:51:40.160048  7744 leader_election.cc:304] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:40.145426 10340 raft_consensus.cc:2749] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 14:51:40.154433 10409 raft_consensus.cc:2804] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 14:51:40.169997 10409 raft_consensus.cc:493] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:40.170867 10409 raft_consensus.cc:3060] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:51:40.174574 10295 leader_election.cc:290] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:40.176643  7819 leader_election.cc:304] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:40.180584 10192 raft_consensus.cc:3055] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 14:51:40.181505 10192 raft_consensus.cc:740] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:40.060243 10403 raft_consensus.cc:515] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:40.186748  7744 leader_election.cc:304] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:40.179883  7819 leader_election.cc:304] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:40.203446  7819 leader_election.cc:304] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:40.208215  7744 leader_election.cc:304] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:40.215193  7744 leader_election.cc:304] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:40.217080 10404 raft_consensus.cc:2749] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 14:51:40.217149 10340 raft_consensus.cc:2804] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 14:51:40.218765 10340 raft_consensus.cc:493] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:40.219228 10340 raft_consensus.cc:3060] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:51:40.221477 10339 raft_consensus.cc:3060] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:51:40.224603  7744 leader_election.cc:304] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 9418391fa82a42c79c6cad13ba91d964
I20260709 14:51:40.226758  7744 leader_election.cc:304] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:40.229049  7744 leader_election.cc:304] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:51:40.223279 10312 raft_consensus.cc:2749] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 14:51:40.227820 10396 raft_consensus.cc:2804] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 14:51:40.231992 10396 raft_consensus.cc:493] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:40.232590 10396 raft_consensus.cc:3060] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:51:40.233502 10392 raft_consensus.cc:2804] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 14:51:40.234136 10392 raft_consensus.cc:493] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:40.234503 10392 raft_consensus.cc:3060] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Advancing to term 8
I20260709 14:51:40.233625 10371 raft_consensus.cc:2804] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 14:51:40.234932 10379 leader_election.cc:290] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:40.234953 10384 raft_consensus.cc:493] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9418391fa82a42c79c6cad13ba91d964)
I20260709 14:51:40.238018 10384 raft_consensus.cc:515] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:51:40.234488  7744 leader_election.cc:304] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:40.193921 10354 raft_consensus.cc:2804] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 14:51:40.235258 10371 raft_consensus.cc:493] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:40.249576  7819 leader_election.cc:304] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:40.212248 10295 raft_consensus.cc:2749] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 14:51:40.242043 10407 raft_consensus.cc:2749] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 14:51:40.242551 10335 raft_consensus.cc:493] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:51:40.250586 10371 raft_consensus.cc:3060] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:51:40.244091 10354 raft_consensus.cc:493] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:40.252884 10397 raft_consensus.cc:2804] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader election won for term 5
I20260709 14:51:40.251538 10342 raft_consensus.cc:493] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:51:40.299187  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 56052.8us
I20260709 14:51:40.303145  7819 leader_election.cc:304] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:40.272464 10312 raft_consensus.cc:2749] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 14:51:40.307247 10384 leader_election.cc:290] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68:42321)
I20260709 14:51:40.307904 10342 raft_consensus.cc:515] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:40.281148 10398 leader_election.cc:290] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:40.271487  7744 leader_election.cc:304] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:40.283779 10354 raft_consensus.cc:3060] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:51:40.283838 10394 raft_consensus.cc:493] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:51:40.319447  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 67711.6us
I20260709 14:51:40.314145 10342 leader_election.cc:290] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:40.320433 10407 raft_consensus.cc:2749] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 14:51:40.320631  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 49251.3us
I20260709 14:51:40.322110  7819 leader_election.cc:304] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
W20260709 14:51:40.323529  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:40.324265  7744 leader_election.cc:304] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:51:40.325016  7893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:40.307442 10397 raft_consensus.cc:697] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:51:40.308935 10295 raft_consensus.cc:2749] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 14:51:40.301471 10335 raft_consensus.cc:515] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:40.360425  7819 leader_election.cc:304] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:40.366647  7852 raft_consensus.cc:1240] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 4. Current term is 5. Ops: []
I20260709 14:51:40.367440  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:40.371882  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:40.373322  7853 raft_consensus.cc:2468] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 9.
I20260709 14:51:40.370590  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:40.373778  7927 raft_consensus.cc:2468] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 4.
I20260709 14:51:40.328446  8639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9441e831627143a991a1556dcdce71e3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9418391fa82a42c79c6cad13ba91d964" is_pre_election: true
I20260709 14:51:40.369095  7893 leader_election.cc:304] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:40.375008 10397 consensus_queue.cc:237] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:40.376222  7819 leader_election.cc:304] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
W20260709 14:51:40.371181  8598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 183941us
I20260709 14:51:40.374171  7846 raft_consensus.cc:2468] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 7.
I20260709 14:51:40.359206 10312 raft_consensus.cc:2749] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 14:51:40.425287  7819 leader_election.cc:304] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:40.377736 10405 raft_consensus.cc:2749] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 14:51:40.428782  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:40.440733  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:40.440955  7775 raft_consensus.cc:2410] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
W20260709 14:51:40.430305  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 66875.2us
I20260709 14:51:40.442845  7774 raft_consensus.cc:1240] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 7. Current term is 8. Ops: [7.6-7.6]
W20260709 14:51:40.378504 10418 log.cc:927] Time spent T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 14:51:40.357374 10384 raft_consensus.cc:2804] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 14:51:40.377504 10404 raft_consensus.cc:2749] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 14:51:40.436347  7771 raft_consensus.cc:1240] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 14:51:40.437175  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:40.437333  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:40.444180  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:40.444355  7893 leader_election.cc:304] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:40.432709  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:40.318668 10381 raft_consensus.cc:515] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:40.441572  7770 raft_consensus.cc:2468] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 3.
I20260709 14:51:40.454646  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:40.459599  7777 raft_consensus.cc:2468] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 6.
I20260709 14:51:40.450496  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:40.450619  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:40.425413 10344 raft_consensus.cc:493] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:40.323952 10394 raft_consensus.cc:515] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:40.457345  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:40.459129  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258d6c2dda954bf5b65930fde8ecb9f3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:40.446727 10340 raft_consensus.cc:515] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:40.477643  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:40.478801 10392 raft_consensus.cc:515] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:40.480160 10340 leader_election.cc:290] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:40.481485  7775 raft_consensus.cc:2393] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 6: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:51:40.482259  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:40.452798 10384 raft_consensus.cc:493] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:40.483366 10394 leader_election.cc:290] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:40.483624 10384 raft_consensus.cc:3060] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:51:40.483213 10353 raft_consensus.cc:515] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:40.510289 10339 raft_consensus.cc:2749] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 14:51:40.478685  7777 raft_consensus.cc:2468] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 7.
I20260709 14:51:40.505885  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
W20260709 14:51:40.504364  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 60069.8us
I20260709 14:51:40.503662  7819 leader_election.cc:304] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:51:40.437353 10343 raft_consensus.cc:2749] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 14:51:40.515352  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:40.497743  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:40.514498  7893 leader_election.cc:304] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:40.516615  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:40.516789  7779 raft_consensus.cc:3060] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:51:40.516707  7777 raft_consensus.cc:2468] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 7.
I20260709 14:51:40.519236 10335 leader_election.cc:290] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:40.520483  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
W20260709 14:51:40.522063  7745 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:40.524658  7777 raft_consensus.cc:2393] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 9: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:51:40.527387  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:40.529870  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:40.515342 10403 leader_election.cc:290] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 10 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:40.539186  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:40.539410  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:40.500912  7770 raft_consensus.cc:2468] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 4.
W20260709 14:51:40.543864  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 109239us
I20260709 14:51:40.544942  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:40.545869  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:40.547000  7847 raft_consensus.cc:2468] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 7.
I20260709 14:51:40.548854  7776 raft_consensus.cc:2368] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 6. Current term is 7.
I20260709 14:51:40.551414  7772 raft_consensus.cc:2468] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 6.
I20260709 14:51:40.456394 10295 raft_consensus.cc:2749] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 14:51:40.552323  7779 raft_consensus.cc:2468] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 9.
I20260709 14:51:40.510192 10048 raft_consensus.cc:2804] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 14:51:40.559535  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 45155.6us
I20260709 14:51:40.562542  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:40.563517  7893 leader_election.cc:304] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:40.569499  7777 raft_consensus.cc:2393] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 10: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:51:40.586797  7779 raft_consensus.cc:1240] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 LEADER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 6. Current term is 7. Ops: [6.5-6.5]
W20260709 14:51:40.593896  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:40.503288 10344 raft_consensus.cc:515] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:40.596400  7893 leader_election.cc:304] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:40.560491 10404 raft_consensus.cc:2804] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader election won for term 8
W20260709 14:51:40.597332  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 93797.4us
I20260709 14:51:40.603755  7893 leader_election.cc:304] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:40.522099 10371 raft_consensus.cc:515] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:40.582986 10335 raft_consensus.cc:2804] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 14:51:40.599633  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:40.614038  7778 raft_consensus.cc:2468] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 7.
I20260709 14:51:40.570816 10048 raft_consensus.cc:493] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:40.612282  7779 raft_consensus.cc:1240] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 14:51:40.612054  7776 raft_consensus.cc:1275] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 14:51:40.617511  7776 pending_rounds.cc:85] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed: Aborting all ops after (but not including) 4
I20260709 14:51:40.617808  7776 pending_rounds.cc:107] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 14:51:40.618314  7776 raft_consensus.cc:2889] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:51:40.595714 10377 raft_consensus.cc:493] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:40.623528  7772 raft_consensus.cc:1275] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 14:51:40.624070  7819 leader_election.cc:304] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:40.611971 10386 raft_consensus.cc:2804] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 14:51:40.595089 10393 raft_consensus.cc:493] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:40.487234 10192 consensus_queue.cc:260] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:40.633188  7774 raft_consensus.cc:2393] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 7: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:51:40.634184  7893 leader_election.cc:304] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:51:40.636026 10369 consensus_meta.cc:287] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent flushing consensus metadata: real 0.545s	user 0.016s	sys 0.000s
I20260709 14:51:40.614079 10334 raft_consensus.cc:2804] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 14:51:40.660791  7778 raft_consensus.cc:1240] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 3. Current term is 4. Ops: []
I20260709 14:51:40.631669 10377 raft_consensus.cc:515] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:40.626973 10409 raft_consensus.cc:515] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:40.649441 10386 raft_consensus.cc:493] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 14:51:40.646505  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:51:40.646588  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 95959.6us
I20260709 14:51:40.613315 10335 raft_consensus.cc:493] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:40.621575 10048 raft_consensus.cc:3060] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 14:51:40.662462  7778 raft_consensus.cc:1240] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 5. Current term is 6. Ops: []
I20260709 14:51:40.691092 10409 leader_election.cc:290] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:40.655328 10428 raft_consensus.cc:2804] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 14:51:40.642115 10396 raft_consensus.cc:515] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:40.692730  7778 raft_consensus.cc:1275] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 14:51:40.692879  7772 raft_consensus.cc:1275] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 14:51:40.668128 10348 consensus_queue.cc:1059] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 14:51:40.674569  7771 raft_consensus.cc:2410] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 14:51:40.621353 10295 consensus_queue.cc:1048] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 14:51:40.678622  7894 leader_election.cc:304] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
W20260709 14:51:40.714777  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 177285us
I20260709 14:51:40.666975 10395 raft_consensus.cc:2749] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 14:51:40.614109  7775 raft_consensus.cc:2468] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 7.
I20260709 14:51:40.684684  7893 leader_election.cc:304] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:40.628242 10405 consensus_queue.cc:1048] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 14:51:40.722858 10405 raft_consensus.cc:2804] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader election won for term 6
I20260709 14:51:40.690367 10353 leader_election.cc:290] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:40.629460 10312 consensus_queue.cc:1048] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 14:51:40.693216  7772 pending_rounds.cc:85] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed: Aborting all ops after (but not including) 2
I20260709 14:51:40.732007  7772 pending_rounds.cc:107] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 14:51:40.732615  7772 raft_consensus.cc:2889] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:51:40.683619 10386 raft_consensus.cc:3060] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Advancing to term 6
W20260709 14:51:40.741899  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 63411.3us
I20260709 14:51:40.743752  7778 raft_consensus.cc:1275] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 7. (term mismatch)
I20260709 14:51:40.743522  7894 leader_election.cc:304] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:40.744467  7778 pending_rounds.cc:85] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed: Aborting all ops after (but not including) 6
I20260709 14:51:40.744810  7778 pending_rounds.cc:107] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed: Aborting uncommitted NO_OP operation due to leader change: 8.7
I20260709 14:51:40.745090  7778 raft_consensus.cc:2889] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:51:40.697191 10335 raft_consensus.cc:3060] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Advancing to term 4
W20260709 14:51:40.719544  7745 leader_election.cc:336] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 1.639s (SENT)
W20260709 14:51:40.751106  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 66430.2us
I20260709 14:51:40.721061 10428 raft_consensus.cc:697] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:40.692040 10344 leader_election.cc:290] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:40.723487 10405 raft_consensus.cc:697] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:51:40.659816 10334 raft_consensus.cc:493] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 14:51:40.743656  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:40.764161  7894 leader_election.cc:304] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
W20260709 14:51:40.708954  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 84998.2us
I20260709 14:51:40.707965 10192 raft_consensus.cc:3060] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Advancing to term 5
W20260709 14:51:40.751602  7745 leader_election.cc:336] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 1.674s (SENT)
W20260709 14:51:40.768687  7745 leader_election.cc:336] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 1.734s (SENT)
I20260709 14:51:40.769363  7745 leader_election.cc:304] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:40.752208  7893 leader_election.cc:304] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:40.674772 10379 consensus_queue.cc:1048] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.060s
I20260709 14:51:40.655198 10393 raft_consensus.cc:515] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:40.779815  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:40.780457  7849 raft_consensus.cc:2468] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 7.
I20260709 14:51:40.767697  7819 leader_election.cc:304] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:40.728816 10404 raft_consensus.cc:697] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:51:40.715279 10388 consensus_queue.cc:1048] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 14:51:40.754514 10381 leader_election.cc:290] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 9 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:40.769111 10334 raft_consensus.cc:3060] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 14:51:40.762797 10423 raft_consensus.cc:2804] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 14:51:40.796052  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 43936.8us
I20260709 14:51:40.811369  7893 leader_election.cc:304] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:40.791175 10404 consensus_queue.cc:237] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:40.794929 10431 log.cc:927] Time spent T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 14:51:40.795354  7852 raft_consensus.cc:1275] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 14:51:40.774838 10395 raft_consensus.cc:2804] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 14:51:40.813872  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 46240.1us
I20260709 14:51:40.782516 10353 raft_consensus.cc:3060] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Advancing to term 8
I20260709 14:51:40.819008  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783e4874513449ef9084b833f188a6d3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:40.820555  7846 raft_consensus.cc:2468] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 4.
I20260709 14:51:40.786315 10342 raft_consensus.cc:2804] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 14:51:40.820042 10371 leader_election.cc:290] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:40.788729 10432 raft_consensus.cc:2804] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 14:51:40.801818 10381 raft_consensus.cc:493] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:40.796321 10343 raft_consensus.cc:2804] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 14:51:40.834292  7819 leader_election.cc:304] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:40.810082 10423 raft_consensus.cc:493] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 14:51:40.879302  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 45106.6us
I20260709 14:51:40.875262  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:40.835364 10312 consensus_queue.cc:1048] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 14:51:40.880900  7819 leader_election.cc:304] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:40.819787 10395 raft_consensus.cc:493] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:40.830019 10392 leader_election.cc:290] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:51:40.891036  8598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 112895us
I20260709 14:51:40.891258  7819 leader_election.cc:304] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:40.840040 10383 raft_consensus.cc:2804] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 14:51:40.829130 10342 raft_consensus.cc:493] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:40.887506 10423 raft_consensus.cc:3060] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:51:40.828405 10396 leader_election.cc:290] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:40.898247 10312 raft_consensus.cc:2804] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader election won for term 7
I20260709 14:51:40.928586 10432 raft_consensus.cc:697] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:40.929347 10388 raft_consensus.cc:493] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:40.929674 10344 raft_consensus.cc:493] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:40.896433 10405 consensus_queue.cc:237] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:40.891518 10395 raft_consensus.cc:3060] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 14:51:40.836803 10436 raft_consensus.cc:2804] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader election won for term 7
W20260709 14:51:40.944660  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:51:40.962626  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 71483.9us
I20260709 14:51:40.900821 10377 leader_election.cc:290] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:40.842998 10295 consensus_queue.cc:1048] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.091s
I20260709 14:51:40.902211 10343 raft_consensus.cc:697] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:40.849937 10398 consensus_queue.cc:1048] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.090s
I20260709 14:51:40.837427 10384 raft_consensus.cc:515] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:40.962263  7745 leader_election.cc:336] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 1.751s (SENT)
I20260709 14:51:40.908391 10441 raft_consensus.cc:2804] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader election won for term 10
I20260709 14:51:40.923406 10342 raft_consensus.cc:3060] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 14:51:40.895604 10381 raft_consensus.cc:515] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:40.971406  7819 leader_election.cc:304] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:40.962361 10433 raft_consensus.cc:2804] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader election won for term 7
I20260709 14:51:40.991840  7745 leader_election.cc:304] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:51:41.002588  7745 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:40.965652 10312 raft_consensus.cc:697] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:51:41.011171  7894 leader_election.cc:304] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:41.012370 10379 raft_consensus.cc:2804] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 14:51:41.012831 10379 raft_consensus.cc:493] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:51:41.013266 10379 raft_consensus.cc:3060] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 14:51:41.016389  7770 raft_consensus.cc:2393] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 7: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
W20260709 14:51:41.017643  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 200998us
W20260709 14:51:41.020483  7745 leader_election.cc:336] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 1.859s (SENT)
I20260709 14:51:41.021155  7745 leader_election.cc:304] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:40.990284 10377 raft_consensus.cc:493] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:40.993829 10436 raft_consensus.cc:697] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:51:41.024217  7894 leader_election.cc:304] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:40.977403 10048 raft_consensus.cc:515] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:40.976763 10344 raft_consensus.cc:515] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:41.008893 10396 raft_consensus.cc:2749] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 14:51:40.970032 10388 raft_consensus.cc:515] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:41.007216 10441 raft_consensus.cc:697] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:51:41.059346 10441 consensus_queue.cc:237] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:41.048678 10415 log.cc:927] Time spent T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 14:51:41.048650 10312 consensus_queue.cc:237] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:41.049546 10436 consensus_queue.cc:237] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:40.910254 10428 consensus_queue.cc:237] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:41.070231 10393 leader_election.cc:290] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:41.072651 10384 leader_election.cc:290] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:41.074869 10381 leader_election.cc:290] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:41.055357 10422 raft_consensus.cc:3055] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 14:51:41.055709 10344 leader_election.cc:290] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:51:41.057150 10437 log.cc:927] Time spent T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.147s	user 0.000s	sys 0.001s
I20260709 14:51:41.058149 10048 leader_election.cc:290] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:41.030145 10371 raft_consensus.cc:2749] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 14:51:41.031018 10446 raft_consensus.cc:2804] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader election won for term 9
I20260709 14:51:41.085733 10422 raft_consensus.cc:740] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:41.097520 10422 consensus_queue.cc:260] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:41.099324 10422 raft_consensus.cc:3060] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 14:51:41.033335 10377 raft_consensus.cc:515] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:41.077320 10348 consensus_queue.cc:1048] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 14:51:41.102473 10377 leader_election.cc:290] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:41.103331 10446 raft_consensus.cc:697] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:51:41.103947 10343 consensus_queue.cc:237] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:41.104578 10446 consensus_queue.cc:237] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:41.058171 10432 consensus_queue.cc:237] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:41.025512 10383 raft_consensus.cc:697] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
W20260709 14:51:41.103564 10354 consensus_meta.cc:287] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent flushing consensus metadata: real 0.747s	user 0.009s	sys 0.007s
W20260709 14:51:41.118803  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 94734.2us
I20260709 14:51:41.111307 10423 raft_consensus.cc:515] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:41.147629 10423 leader_election.cc:290] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:51:41.150594  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 125221us
I20260709 14:51:41.170889  7893 leader_election.cc:304] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:41.145767 10388 leader_election.cc:290] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:41.167200 10444 raft_consensus.cc:2804] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 14:51:41.205862  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 233960us
W20260709 14:51:41.218196  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 47400.4us
I20260709 14:51:41.150980 10354 raft_consensus.cc:515] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:41.219347  7893 leader_election.cc:304] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:41.221716  6549 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 14:51:41.118072 10447 consensus_queue.cc:1048] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.105s
I20260709 14:51:41.224180  7745 leader_election.cc:304] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:51:41.231652  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:41.240039  7745 leader_election.cc:304] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:51:41.244822  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 48941.5us
I20260709 14:51:41.217768 10392 raft_consensus.cc:493] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:41.217443 10444 raft_consensus.cc:493] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:41.253330  7773 raft_consensus.cc:2393] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 7: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:51:41.240844 10371 raft_consensus.cc:3060] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Advancing to term 9
W20260709 14:51:41.260418  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:41.246286 10448 raft_consensus.cc:2749] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 14:51:41.280592  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:41.279117 10439 raft_consensus.cc:493] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:41.280845  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:41.253082 10377 raft_consensus.cc:2749] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 14:51:41.281493  7845 raft_consensus.cc:2468] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 5.
I20260709 14:51:41.237109 10342 raft_consensus.cc:515] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:41.316524  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 68009.8us
I20260709 14:51:41.316766  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:41.317435  7847 raft_consensus.cc:3060] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:51:41.319772  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:41.320349  7853 raft_consensus.cc:1275] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 14:51:41.263741 10396 raft_consensus.cc:493] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:41.255733 10444 raft_consensus.cc:3060] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:51:41.318812 10433 raft_consensus.cc:697] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:51:41.332010  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:41.332981  7852 raft_consensus.cc:2410] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 14:51:41.283085 10353 raft_consensus.cc:2749] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 14:51:41.279145 10344 raft_consensus.cc:493] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:41.268065 10450 raft_consensus.cc:2804] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 14:51:41.257735 10392 raft_consensus.cc:515] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:41.350662  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:41.351694  7923 raft_consensus.cc:2410] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 14:51:41.343526  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:41.347436  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:41.348067  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:41.348671  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:41.353682  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:41.354323  7924 raft_consensus.cc:2376] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 7. Re-sending same reply.
I20260709 14:51:41.354606  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:41.347239  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:41.349609  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:41.241122 10383 consensus_queue.cc:237] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:41.352936  7851 raft_consensus.cc:2468] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 6.
I20260709 14:51:41.357990  7926 raft_consensus.cc:2393] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 8: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
W20260709 14:51:41.337025 10334 consensus_meta.cc:287] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0: Time spent flushing consensus metadata: real 0.519s	user 0.009s	sys 0.005s
I20260709 14:51:41.362856  7744 leader_election.cc:304] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:51:41.409878  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 47167.4us
I20260709 14:51:41.354092  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c563cc7cfbe4d59be4ffc5cf847ce56" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
W20260709 14:51:41.386650  7745 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:41.354161  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:41.411883  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:41.403046  7920 raft_consensus.cc:2368] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 9. Current term is 10.
I20260709 14:51:41.317481 10439 raft_consensus.cc:515] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:41.326686 10448 consensus_queue.cc:1048] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.077s
I20260709 14:51:41.330567 10396 raft_consensus.cc:515] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:41.438869  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:41.412415  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:41.408646  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:41.444223  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:41.422567  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:41.447204  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:41.401309  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:41.494803  7925 raft_consensus.cc:2368] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 7. Current term is 8.
I20260709 14:51:41.460680  7894 leader_election.cc:304] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:41.493233  7771 raft_consensus.cc:2468] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 7.
I20260709 14:51:41.493520  7928 raft_consensus.cc:2376] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 7. Re-sending same reply.
I20260709 14:51:41.485402  7921 raft_consensus.cc:2468] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 4.
I20260709 14:51:41.412742  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:41.349331 10450 raft_consensus.cc:493] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:41.498302  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:41.497664  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:41.350669 10451 raft_consensus.cc:493] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:41.492758  7922 raft_consensus.cc:2468] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 6.
I20260709 14:51:41.400960 10343 consensus_queue.cc:1048] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.095s
I20260709 14:51:41.499308  7925 raft_consensus.cc:2468] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 7.
I20260709 14:51:41.492614  7777 raft_consensus.cc:2468] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 7.
I20260709 14:51:41.494067  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
W20260709 14:51:41.408118 10453 log.cc:927] Time spent T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260709 14:51:41.496984  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:41.461584 10334 raft_consensus.cc:515] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:41.498245  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:41.511780  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
W20260709 14:51:41.465204 10335 consensus_meta.cc:287] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0: Time spent flushing consensus metadata: real 0.707s	user 0.011s	sys 0.003s
I20260709 14:51:41.518400  7928 raft_consensus.cc:2410] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 14:51:41.511852  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 9 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:41.524223  7920 raft_consensus.cc:2393] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 8: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:51:41.526790  7928 raft_consensus.cc:1240] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 14:51:41.456233 10353 raft_consensus.cc:2804] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 14:51:41.532325  7921 raft_consensus.cc:1240] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 LEADER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 14:51:41.351358 10344 raft_consensus.cc:515] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:41.403312 10381 consensus_queue.cc:1059] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.119s
I20260709 14:51:41.408646 10388 consensus_queue.cc:1048] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.111s
I20260709 14:51:41.548163  7922 raft_consensus.cc:1240] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 14:51:41.500016 10450 raft_consensus.cc:3060] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:51:41.415779 10048 consensus_queue.cc:1048] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.114s
I20260709 14:51:41.553941  7923 raft_consensus.cc:2368] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 7. Current term is 8.
W20260709 14:51:40.683682 10368 consensus_queue.cc:1175] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" responder_term: 5 status { last_received { term: 4 index: 3 } last_committed_idx: 3 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 4. Current term is 5. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 14:51:41.555483 10454 log.cc:927] Time spent T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 14:51:41.534584 10354 leader_election.cc:290] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:41.541316 10353 raft_consensus.cc:493] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:41.515098 10451 raft_consensus.cc:515] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:41.552423 10348 raft_consensus.cc:2804] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 14:51:41.530632 10335 raft_consensus.cc:515] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:41.602877  7924 raft_consensus.cc:2368] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 3. Current term is 4.
W20260709 14:51:41.610625  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 150107us
I20260709 14:51:41.614478  7894 leader_election.cc:304] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:41.592938 10353 raft_consensus.cc:3060] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:51:41.598134 10348 raft_consensus.cc:493] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:41.607263 10377 raft_consensus.cc:493] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:41.519912 10433 consensus_queue.cc:237] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:41.612036 10354 raft_consensus.cc:493] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
W20260709 14:51:41.636826 10386 consensus_meta.cc:287] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0: Time spent flushing consensus metadata: real 0.880s	user 0.017s	sys 0.000s
I20260709 14:51:41.665222  7847 raft_consensus.cc:2468] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 10.
W20260709 14:51:41.658391 10379 consensus_meta.cc:287] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent flushing consensus metadata: real 0.645s	user 0.012s	sys 0.003s
I20260709 14:51:41.627297 10342 leader_election.cc:290] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:41.642421 10348 raft_consensus.cc:3060] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:51:41.687387  7819 leader_election.cc:304] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:41.680697 10472 raft_consensus.cc:493] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:41.695838  7819 leader_election.cc:304] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:41.668603 10432 raft_consensus.cc:2804] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 14:51:41.700950  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 52024.9us
I20260709 14:51:41.670362 10463 raft_consensus.cc:493] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:41.668432 10354 raft_consensus.cc:515] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:41.741178 10463 raft_consensus.cc:515] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:41.741922 10422 consensus_meta.cc:287] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0: Time spent flushing consensus metadata: real 0.642s	user 0.009s	sys 0.008s
I20260709 14:51:41.743846 10354 leader_election.cc:290] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:41.745726  7928 raft_consensus.cc:1240] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 14:51:41.703756 10432 raft_consensus.cc:493] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:41.746634 10432 raft_consensus.cc:3060] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 14:51:41.705498 10466 consensus_queue.cc:1048] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 14:51:41.706379 10458 raft_consensus.cc:2749] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 14:51:41.650271 10377 raft_consensus.cc:515] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:41.707998 10395 consensus_meta.cc:287] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent flushing consensus metadata: real 0.721s	user 0.012s	sys 0.000s
I20260709 14:51:41.754104 10395 raft_consensus.cc:515] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:41.755584  7927 raft_consensus.cc:2368] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 7. Current term is 8.
I20260709 14:51:41.756788 10395 leader_election.cc:290] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:41.713222  7819 leader_election.cc:304] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
W20260709 14:51:41.762557  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 49448.3us
I20260709 14:51:41.688578 10381 raft_consensus.cc:493] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:41.714787 10344 leader_election.cc:290] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:41.716686 10469 raft_consensus.cc:493] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:41.704699 10455 consensus_queue.cc:1059] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 14:51:41.719663 10335 leader_election.cc:290] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 4 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:41.727102 10348 raft_consensus.cc:515] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:41.738730 10192 consensus_meta.cc:287] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0: Time spent flushing consensus metadata: real 0.961s	user 0.012s	sys 0.002s
I20260709 14:51:41.739605 10334 leader_election.cc:290] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:41.687997 10392 leader_election.cc:290] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:41.740397 10451 leader_election.cc:290] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:41.706871 10436 consensus_queue.cc:1059] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 14:51:41.711762 10405 raft_consensus.cc:2749] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 14:51:41.756804 10377 leader_election.cc:290] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:41.759518 10439 leader_election.cc:290] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:41.769726  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:41.793067  7777 raft_consensus.cc:3060] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:51:41.778290  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783e4874513449ef9084b833f188a6d3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:41.763818  7819 leader_election.cc:304] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:41.780313  7775 raft_consensus.cc:1240] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 4. Current term is 5. Ops: []
I20260709 14:51:41.781714  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:41.797186  7774 raft_consensus.cc:2468] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 9.
I20260709 14:51:41.781929  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:41.800148  7770 raft_consensus.cc:2468] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 5.
I20260709 14:51:41.782213  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:41.783130  7776 raft_consensus.cc:1275] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 14:51:41.783460  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
W20260709 14:51:41.807715  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 44052.4us
I20260709 14:51:41.796332  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:41.801919  7778 raft_consensus.cc:3060] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Advancing to term 8
I20260709 14:51:41.811038  7819 leader_election.cc:304] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:41.820350  7819 leader_election.cc:304] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:41.744472 10371 raft_consensus.cc:2749] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 14:51:41.773329 10436 raft_consensus.cc:3055] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 LEADER]: Stepping down as leader of term 7
I20260709 14:51:41.769177 10348 leader_election.cc:290] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:41.766017 10455 raft_consensus.cc:3055] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 LEADER]: Stepping down as leader of term 7
I20260709 14:51:41.677201 10379 raft_consensus.cc:515] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:41.764169 10441 raft_consensus.cc:2764] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 14:51:41.743846 10463 leader_election.cc:290] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:41.824584  7819 leader_election.cc:304] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:41.834267  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:41.763198 10396 leader_election.cc:290] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:41.673285 10386 raft_consensus.cc:515] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:41.771760 10448 raft_consensus.cc:3055] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 14:51:41.764524 10381 raft_consensus.cc:515] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:41.765156 10469 raft_consensus.cc:515] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:41.822340 10404 raft_consensus.cc:2749] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 14:51:41.843716  7777 raft_consensus.cc:2468] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 9.
I20260709 14:51:41.877504 10448 raft_consensus.cc:740] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:41.859301  7778 raft_consensus.cc:2468] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 8.
I20260709 14:51:41.914781 10448 consensus_queue.cc:260] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:41.916369 10477 raft_consensus.cc:493] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:41.822604 10405 raft_consensus.cc:2804] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 14:51:41.917479 10405 raft_consensus.cc:493] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:41.829598 10458 raft_consensus.cc:2749] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 14:51:41.918020 10473 raft_consensus.cc:493] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:41.918718 10458 raft_consensus.cc:2749] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 14:51:41.918589 10473 raft_consensus.cc:515] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:41.920607  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:41.923441 10469 leader_election.cc:290] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:51:41.924008  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 99539.4us
I20260709 14:51:41.917074 10477 raft_consensus.cc:515] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:41.917912 10405 raft_consensus.cc:3060] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:51:41.934211  7919 raft_consensus.cc:2393] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 8: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:51:41.936807 10379 leader_election.cc:290] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:51:41.849627 10312 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.592s	user 0.024s	sys 0.005s
W20260709 14:51:41.941740 10312 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.692s	user 0.025s	sys 0.005s
I20260709 14:51:41.942353 10353 raft_consensus.cc:515] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:41.945297  7926 raft_consensus.cc:2368] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 5. Current term is 6.
I20260709 14:51:41.829926 10436 raft_consensus.cc:740] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:51:41.945150  7819 leader_election.cc:304] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:41.845206 10455 raft_consensus.cc:740] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:51:41.963577  7819 leader_election.cc:304] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
W20260709 14:51:41.966984 10444 consensus_meta.cc:287] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent flushing consensus metadata: real 0.629s	user 0.022s	sys 0.001s
I20260709 14:51:41.967756 10444 raft_consensus.cc:515] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:41.969396 10465 raft_consensus.cc:2804] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Leader election won for term 4
I20260709 14:51:41.701748 10472 raft_consensus.cc:515] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:41.971055 10441 raft_consensus.cc:2804] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader election won for term 9
I20260709 14:51:41.971709 10441 raft_consensus.cc:697] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
W20260709 14:51:41.974124  7745 leader_election.cc:336] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 2.037s (SENT)
I20260709 14:51:41.975055  7745 leader_election.cc:304] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:41.970412 10465 raft_consensus.cc:697] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:51:41.968576  7819 leader_election.cc:400] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 6 election: Vote denied by peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587) with higher term. Message: Invalid argument: T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 6. Current term is 7.
I20260709 14:51:41.978641  7819 leader_election.cc:403] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
W20260709 14:51:41.981331  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:41.977625 10448 raft_consensus.cc:3060] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:51:41.982537 10469 raft_consensus.cc:2749] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 14:51:41.986033 10464 log.cc:927] Time spent T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.292s	user 0.003s	sys 0.000s
I20260709 14:51:41.974506 10436 consensus_queue.cc:260] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:41.990149 10465 consensus_queue.cc:237] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:41.972867 10441 consensus_queue.cc:237] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:42.000944  7744 leader_election.cc:336] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785): Timed out: RequestConsensusVote RPC to 127.6.101.67:40785 timed out after 1.674s (SENT)
I20260709 14:51:42.004667  7744 leader_election.cc:304] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:41.955566 10386 leader_election.cc:290] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:41.967052 10477 leader_election.cc:290] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:42.005976  7819 leader_election.cc:304] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:42.019608 10477 raft_consensus.cc:2804] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader election won for term 7
I20260709 14:51:42.020393 10477 raft_consensus.cc:697] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:51:42.021565 10477 consensus_queue.cc:237] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:42.012337 10469 raft_consensus.cc:2749] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 14:51:42.004940 10405 raft_consensus.cc:515] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:42.025919 10381 leader_election.cc:290] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:42.027369 10405 leader_election.cc:290] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 7 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:42.037652  7819 leader_election.cc:304] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
W20260709 14:51:42.038136  7745 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:42.003902 10463 raft_consensus.cc:3060] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:51:42.012701 10388 raft_consensus.cc:493] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:41.999154 10450 raft_consensus.cc:515] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:42.049144  7819 leader_election.cc:304] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:42.049364 10405 raft_consensus.cc:2749] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 14:51:42.006419 10404 consensus_queue.cc:1048] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 14:51:42.052726  7819 leader_election.cc:304] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:42.058755  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:42.059095  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:42.060101  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:42.060050  7851 raft_consensus.cc:2410] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 14:51:42.060678  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:42.005018 10312 consensus_queue.cc:1059] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 14:51:42.062436  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:42.064894  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:42.065846  7846 raft_consensus.cc:2468] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 5.
I20260709 14:51:42.066421  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:42.068194  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:42.069957  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:42.071038  7852 raft_consensus.cc:3060] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:51:42.073092  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9441e831627143a991a1556dcdce71e3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:42.067497  7854 raft_consensus.cc:2468] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 7.
I20260709 14:51:42.102770  7850 raft_consensus.cc:1240] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 14:51:42.056298 10295 raft_consensus.cc:2804] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 14:51:42.152283 10444 leader_election.cc:290] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:42.109675 10295 raft_consensus.cc:493] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:42.156589  7852 raft_consensus.cc:2468] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 6.
I20260709 14:51:42.075008 10458 raft_consensus.cc:2804] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 14:51:42.106334 10405 raft_consensus.cc:3055] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 LEADER]: Stepping down as leader of term 8
I20260709 14:51:42.050478 10388 raft_consensus.cc:515] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:42.285468 10466 raft_consensus.cc:493] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:42.286373 10466 raft_consensus.cc:515] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:42.292275  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:42.292580  7894 leader_election.cc:304] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
W20260709 14:51:42.264801 10432 consensus_meta.cc:287] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0: Time spent flushing consensus metadata: real 0.517s	user 0.013s	sys 0.000s
I20260709 14:51:42.281584  7920 raft_consensus.cc:1240] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 14:51:42.318720  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:42.319813  7851 raft_consensus.cc:3060] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:51:42.155110 10396 raft_consensus.cc:493] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:42.259567 10295 raft_consensus.cc:3060] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Advancing to term 8
I20260709 14:51:42.280318 10458 raft_consensus.cc:493] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:42.260361 10312 raft_consensus.cc:493] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:42.267215 10405 raft_consensus.cc:740] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:51:42.320851 10386 raft_consensus.cc:2804] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 14:51:42.334463 10404 raft_consensus.cc:493] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:42.329488 10466 leader_election.cc:290] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:42.349687 10458 raft_consensus.cc:3060] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Advancing to term 8
I20260709 14:51:42.325168 10432 raft_consensus.cc:515] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:42.391997  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:42.370946 10353 leader_election.cc:290] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:42.342908 10396 raft_consensus.cc:515] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:42.361594 10312 raft_consensus.cc:515] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:42.381655 10386 raft_consensus.cc:697] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:42.396811 10477 raft_consensus.cc:493] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:42.437760  7848 raft_consensus.cc:2376] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 5. Re-sending same reply.
I20260709 14:51:42.440236 10432 leader_election.cc:290] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:42.378213 10404 raft_consensus.cc:515] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:42.431281 10450 leader_election.cc:290] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 7 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:42.431936 10388 leader_election.cc:290] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:42.444770 10477 raft_consensus.cc:515] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:42.474686 10477 leader_election.cc:290] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:42.477286 10442 raft_consensus.cc:493] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:42.477946 10442 raft_consensus.cc:515] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:42.483878 10442 leader_election.cc:290] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:42.485913 10386 consensus_queue.cc:237] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:42.498481  7851 raft_consensus.cc:2468] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 10.
I20260709 14:51:42.503576  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:42.454149 10492 raft_consensus.cc:493] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:42.506214  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:42.427914 10405 consensus_queue.cc:260] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:42.511081  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:42.525488  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:42.528157  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:42.532334  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:42.533488  7851 raft_consensus.cc:3060] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Advancing to term 8
I20260709 14:51:42.512967 10446 raft_consensus.cc:493] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:42.539717  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:42.529830 10312 leader_election.cc:290] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:42.559679 10465 raft_consensus.cc:493] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:42.560473 10465 raft_consensus.cc:515] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:42.519846 10492 raft_consensus.cc:515] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:42.570590  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:42.550612 10405 raft_consensus.cc:3060] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:51:42.588747 10404 leader_election.cc:290] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:42.590808 10334 raft_consensus.cc:493] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:42.591437 10334 raft_consensus.cc:515] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:42.592279 10463 consensus_meta.cc:287] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent flushing consensus metadata: real 0.548s	user 0.017s	sys 0.000s
I20260709 14:51:42.592334  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:42.593457 10447 raft_consensus.cc:493] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:42.594022  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:42.594502 10465 leader_election.cc:290] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:42.595440  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:42.594020 10447 raft_consensus.cc:515] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:42.596328  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:42.598516 10447 leader_election.cc:290] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:42.599658  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:42.600122  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:42.601419  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258d6c2dda954bf5b65930fde8ecb9f3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:42.602685 10295 raft_consensus.cc:515] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:42.605507 10295 leader_election.cc:290] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 8 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:42.602691  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:42.607210  7846 raft_consensus.cc:2393] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 9: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:51:42.606846 10455 consensus_queue.cc:260] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:42.608220 10455 raft_consensus.cc:3060] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Advancing to term 8
I20260709 14:51:42.608836  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:42.609272  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:42.609638  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:42.610193  7919 raft_consensus.cc:2393] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 6: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:51:42.610615  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:42.610219  7920 raft_consensus.cc:2468] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 9.
I20260709 14:51:42.612090  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:42.611577  7846 raft_consensus.cc:3060] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:51:42.610608  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:42.614372  7921 raft_consensus.cc:2393] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 8: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:51:42.615469  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:42.616294  7922 raft_consensus.cc:2393] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 8: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:51:42.619314 10492 leader_election.cc:290] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:42.620088  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:42.620716  7921 raft_consensus.cc:3060] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:51:42.613348  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:42.625640  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:42.627014  7923 raft_consensus.cc:1240] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 7. Current term is 8. Ops: []
I20260709 14:51:42.592747 10463 raft_consensus.cc:2749] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587) with higher term. Message: Invalid argument: T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 6. Current term is 7.
I20260709 14:51:42.629609  7850 raft_consensus.cc:2393] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 8: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:51:42.630555  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:42.639781  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:42.631340  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:42.643527  7851 raft_consensus.cc:2468] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 8.
I20260709 14:51:42.632565  7850 raft_consensus.cc:3060] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:51:42.547492 10446 raft_consensus.cc:515] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:42.595779 10396 leader_election.cc:290] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:42.636193  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:42.654951  7921 raft_consensus.cc:2468] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 6.
I20260709 14:51:42.666487  7927 raft_consensus.cc:2393] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 6: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:51:42.659281  7846 raft_consensus.cc:2468] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 6.
I20260709 14:51:42.684490  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:42.684152 10334 leader_election.cc:290] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:42.710845  7923 raft_consensus.cc:1240] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 LEADER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 9. Current term is 10. Ops: []
I20260709 14:51:42.711796  7854 raft_consensus.cc:2468] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 7.
I20260709 14:51:42.711854  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:42.715528  7924 raft_consensus.cc:1240] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 7. Current term is 8. Ops: []
I20260709 14:51:42.722702  7850 raft_consensus.cc:1275] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 14:51:42.684881 10396 raft_consensus.cc:493] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:42.684257 10458 raft_consensus.cc:515] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:42.789726  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:42.820405  7849 raft_consensus.cc:2393] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 8: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:51:42.822085  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c563cc7cfbe4d59be4ffc5cf847ce56" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:42.823536  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:42.824433  7919 raft_consensus.cc:2393] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 7: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:51:42.825282  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:42.826095  7927 raft_consensus.cc:2393] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 7: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:51:42.830401 10446 leader_election.cc:290] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:42.832319  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
W20260709 14:51:42.833727  7926 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38516 (request call id 2048) took 1422 ms (client timeout 1790 ms). Trace:
I20260709 14:51:42.834654  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
W20260709 14:51:42.837893  7926 rpcz_store.cc:269] 0709 14:51:41.410995 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:41.412457 (+  1462us) service_pool.cc:224] Handling call
0709 14:51:42.833473 (+1421016us) spinlock_profiling.cc:243] Waited 447 ms on lock 0x7b540031f1d4. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae922fa 00007fb68fe53b17 00007fb6893ce6d4 00007fb6893ce662 00007fb6893ce591 00007fb6893ce50c 00007fb6893cd7c2 00007fb6891c948c 00007fb6891c88c6 00007fb6891c826f
0709 14:51:42.833633 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1028803328}
I20260709 14:51:42.838951  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:42.839468  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:42.840474 10473 leader_election.cc:290] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:42.834614  7928 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38516 (request call id 2064) took 1385 ms. Trace:
I20260709 14:51:42.841636  7928 rpcz_store.cc:276] 0709 14:51:41.449627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:41.528065 (+ 78438us) service_pool.cc:224] Handling call
0709 14:51:41.745317 (+217252us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:51:41.746542 (+  1225us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:42.834429 (+1087887us) spinlock_profiling.cc:243] Waited 216 ms on lock 0x7b54004524d0. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae8d8ad 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2 00007fb6891c948c 00007fb6891c88c6 00007fb6891c826f
0709 14:51:42.834554 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":497861888}
I20260709 14:51:42.836031  7675 catalog_manager.cc:5697] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 6 to 7, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 7 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:51:42.843261  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:42.844156  7919 raft_consensus.cc:2393] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 7: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:51:42.844285  7675 catalog_manager.cc:5697] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 5 to 7, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 7 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:51:42.846326  7675 catalog_manager.cc:5697] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 6 to 7, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 7 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:51:42.847952  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:42.848785  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:42.839637  7922 raft_consensus.cc:2468] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 8.
I20260709 14:51:42.849937  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:42.837393  7925 raft_consensus.cc:1240] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 14:51:42.848064  7675 catalog_manager.cc:5697] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 7 to 8, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 8 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
W20260709 14:51:42.852108 10483 log.cc:927] Time spent T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.699s	user 0.004s	sys 0.000s
I20260709 14:51:42.853221  7773 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 2279) took 1074 ms. Trace:
I20260709 14:51:42.853611  7773 rpcz_store.cc:276] 0709 14:51:41.778550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:41.778748 (+   198us) service_pool.cc:224] Handling call
0709 14:51:41.814542 (+ 35794us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 14:51:41.827057 (+ 12515us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:51:41.827100 (+    43us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 14:51:41.844041 (+ 16941us) log.cc:844] Serialized 52 byte log entry
0709 14:51:41.999606 (+155565us) raft_consensus.cc:1645] Marking committed up to 4
0709 14:51:42.045558 (+ 45952us) log.cc:844] Serialized 14 byte log entry
0709 14:51:42.056212 (+ 10654us) log.cc:844] Serialized 14 byte log entry
0709 14:51:42.056469 (+   257us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:42.056590 (+   121us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:51:42.838161 (+781571us) spinlock_profiling.cc:243] Waited 10.5 ms on lock 0x7b18003bd280. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb690c69de1 00007fb690c765b1 00007fb687da13f3 00007fb687da37c1 00007fb687da3779 00007fb687da3709 00007fb687da36d1 00007fb687da29cd 0000000000396ad4 0000000000396919 00007fb687d8483a
0709 14:51:42.851952 (+ 13791us) spinlock_profiling.cc:243] Waited 20.9 ms on lock 0x7b20001f9278. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68aa3cb91 00007fb68aa5ea19 00007fb68aa298c3 00007fb68aa28bb6 00007fb68aa287d8 00007fb68aa32221 00007fb68aa321d9 00007fb68aa32169 00007fb68aa32131 00007fb68aa3142d 0000000000396ad4
0709 14:51:42.852990 (+  1038us) raft_consensus.cc:1685] finished
0709 14:51:42.853010 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:51:42.853147 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12253,"prepare.queue_time_us":257714,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":64,"raft.queue_time_us":24526,"raft.run_cpu_time_us":359,"raft.run_wall_time_us":3836,"spinlock_wait_cycles":72528128,"thread_start_us":194015,"threads_started":2,"wal-append.queue_time_us":212924}
I20260709 14:51:42.856038 10396 raft_consensus.cc:515] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:42.857643  7921 raft_consensus.cc:2393] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 4: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:51:42.859249 10396 leader_election.cc:290] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:42.868554 10469 raft_consensus.cc:493] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:42.869163 10469 raft_consensus.cc:515] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:42.859980  7894 leader_election.cc:304] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:42.860293  7927 raft_consensus.cc:1240] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 5. Current term is 6. Ops: []
I20260709 14:51:42.872043  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783e4874513449ef9084b833f188a6d3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:42.872509 10192 raft_consensus.cc:2804] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 14:51:42.872682  7845 raft_consensus.cc:3060] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Advancing to term 6
I20260709 14:51:42.873085 10192 raft_consensus.cc:697] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:42.874091 10192 consensus_queue.cc:237] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:42.861578 10458 leader_election.cc:290] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 8 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:42.878343 10469 leader_election.cc:290] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:42.879022 10469 raft_consensus.cc:493] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:42.879562 10469 raft_consensus.cc:515] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:42.879046 10458 raft_consensus.cc:493] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:42.881688 10472 leader_election.cc:290] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:51:42.886077  7745 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:42.886864 10436 raft_consensus.cc:3060] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Advancing to term 8
W20260709 14:51:42.889350 10488 log.cc:927] Time spent T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.457s	user 0.003s	sys 0.000s
I20260709 14:51:42.890561  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:42.897156  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:42.901612  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:42.895777  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:42.899757  7925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38516 (request call id 2067) took 1449 ms. Trace:
I20260709 14:51:42.893712  7845 raft_consensus.cc:2468] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 6.
I20260709 14:51:42.906661  7923 raft_consensus.cc:1240] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 7. Current term is 8. Ops: []
I20260709 14:51:42.904771  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:42.912406  7851 raft_consensus.cc:3060] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Advancing to term 8
W20260709 14:51:42.914323  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:42.910816  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:42.915587  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:42.912788  7925 rpcz_store.cc:276] 0709 14:51:41.450454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:41.547371 (+ 96917us) service_pool.cc:224] Handling call
0709 14:51:41.656096 (+108725us) spinlock_profiling.cc:243] Waited 960 us on lock 0x7b5800200198. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb687c29db1 00007fb687d69b71 00007fb687d69a22 00007fb690c82c09 00007fb68fddcee0 00007fb68fea60ab 00007fb68fea6131 00007fb68fe67fc0 00007fb68fe52929 00007fb68fe523d2 00007fb6893c9bd4
0709 14:51:42.837111 (+1181015us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:51:42.851280 (+ 14169us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:42.899488 (+ 48208us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b540031f1d0. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae8d8ad 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2 00007fb6891c948c 00007fb6891c88c6 00007fb6891c826f
0709 14:51:42.899671 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2717579520}
W20260709 14:51:42.912501  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:42.914108  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:42.917773  7852 raft_consensus.cc:2393] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 6: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:51:42.908422  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:42.920497  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:42.921447  7924 raft_consensus.cc:1275] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 14:51:42.890976 10469 leader_election.cc:290] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:42.923357  7920 raft_consensus.cc:2393] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 8: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:51:42.928241  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:42.926563  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:42.872823  7894 leader_election.cc:304] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:42.931236  7675 catalog_manager.cc:5697] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 6 to 7, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 7 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
W20260709 14:51:42.933516  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 60839us
I20260709 14:51:42.934106  7924 raft_consensus.cc:2376] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 6. Re-sending same reply.
I20260709 14:51:42.934950  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c563cc7cfbe4d59be4ffc5cf847ce56" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:42.933491  7852 raft_consensus.cc:2468] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 7.
W20260709 14:51:42.936070  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:42.936066  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:42.934451  7675 catalog_manager.cc:5697] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 3 to 4, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 4 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:51:42.825501  6549 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 14:51:42.939028  7675 catalog_manager.cc:5697] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 4 to 5, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 5 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:51:42.941581  7675 catalog_manager.cc:5697] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 2 to 3, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 3 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:51:42.943558  7675 catalog_manager.cc:5697] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 5 to 6, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 6 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:51:42.946996  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:42.948186  7845 raft_consensus.cc:2468] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 7.
I20260709 14:51:42.949551  7919 raft_consensus.cc:2468] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 6.
I20260709 14:51:42.952507  7851 raft_consensus.cc:2468] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 8.
I20260709 14:51:42.956506  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:42.957455  7923 raft_consensus.cc:2393] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 6: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:51:42.957296  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:42.955236  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:42.956732  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c563cc7cfbe4d59be4ffc5cf847ce56" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:42.961951  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:42.955080  7675 catalog_manager.cc:5697] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 6 to 7, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 7 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:51:42.969624  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:42.970997  7676 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54344 (request call id 369) took 5591 ms. Trace:
I20260709 14:51:42.974076  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:42.975652  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:42.976570  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:42.976627  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:42.977716  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:42.975652  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:42.979472  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:42.979149  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:42.981050  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:42.982326  7851 raft_consensus.cc:2393] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 8: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:51:42.982684  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:42.980332  7924 raft_consensus.cc:2393] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 7: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:51:42.985775  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:42.984333  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:42.986847  7921 raft_consensus.cc:2393] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 8: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:51:43.002606  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:42.985864  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:43.003655  7777 raft_consensus.cc:2393] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 8: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:51:42.965782  7675 catalog_manager.cc:5697] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 5 to 6, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 6 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:51:43.003924  7852 raft_consensus.cc:2393] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 6: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:51:42.988145  7846 raft_consensus.cc:1240] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 9. Current term is 10. Ops: []
I20260709 14:51:42.991647  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258d6c2dda954bf5b65930fde8ecb9f3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:42.987787  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:42.995067  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:43.006840  7927 raft_consensus.cc:2468] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 4.
I20260709 14:51:43.007365  7776 raft_consensus.cc:3060] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Advancing to term 8
I20260709 14:51:42.968468 10446 raft_consensus.cc:493] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:42.990567  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:42.999794  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:43.014230  7925 raft_consensus.cc:2393] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 6: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:51:42.881124 10458 raft_consensus.cc:515] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:43.000654  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:43.001725  7849 raft_consensus.cc:1275] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 14:51:43.005316  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:42.996596  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:43.008198  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:43.008291  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258d6c2dda954bf5b65930fde8ecb9f3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:42.968257 10444 raft_consensus.cc:2804] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 14:51:43.017268  7770 raft_consensus.cc:2393] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 4: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:51:43.018131  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:43.017657  7773 raft_consensus.cc:1240] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 9. Current term is 10. Ops: []
I20260709 14:51:42.996480  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:43.002740  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:43.011508  7851 raft_consensus.cc:2468] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 5.
I20260709 14:51:43.016122  7923 raft_consensus.cc:2468] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 7.
I20260709 14:51:43.012262  7675 catalog_manager.cc:5697] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:51:43.016741  7779 raft_consensus.cc:2468] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 4.
I20260709 14:51:43.015350  7849 pending_rounds.cc:85] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting all ops after (but not including) 3
I20260709 14:51:43.021190  7849 pending_rounds.cc:107] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 14:51:43.021603  7849 raft_consensus.cc:2889] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:51:43.019829  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:43.022462  7675 catalog_manager.cc:5697] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 7 to 8, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 8 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
W20260709 14:51:43.023612  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:43.023933  7773 raft_consensus.cc:2468] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 9.
W20260709 14:51:43.024816  7745 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 1.576s (SENT) [suppressed 59 similar messages]
I20260709 14:51:43.025337  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:43.026125  7779 raft_consensus.cc:2468] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 7.
I20260709 14:51:43.029137  7675 catalog_manager.cc:5697] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 6 to 7, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 7 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:51:43.031050  7847 raft_consensus.cc:2410] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 14:51:43.031454  7675 catalog_manager.cc:5697] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 7 to 8, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 8 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:51:43.029909  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c563cc7cfbe4d59be4ffc5cf847ce56" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:43.022078 10446 raft_consensus.cc:515] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:43.034540 10479 raft_consensus.cc:493] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:43.034986  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:43.035182 10479 raft_consensus.cc:515] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:43.035825  7773 raft_consensus.cc:3060] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Advancing to term 6
W20260709 14:51:43.038429  7745 leader_election.cc:336] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 1.715s (SENT)
I20260709 14:51:43.038589 10444 raft_consensus.cc:697] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:43.039759 10444 consensus_queue.cc:237] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:43.034406  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:43.044780  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:43.021134  7851 raft_consensus.cc:1240] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 9. Current term is 10. Ops: []
I20260709 14:51:43.052587  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:43.053491  7771 raft_consensus.cc:2468] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 9.
I20260709 14:51:43.045090  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:43.012423 10381 raft_consensus.cc:493] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:51:43.047484  7745 leader_election.cc:336] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 1.809s (SENT)
I20260709 14:51:43.048343  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258d6c2dda954bf5b65930fde8ecb9f3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:43.051366  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:43.059442  7846 raft_consensus.cc:2376] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 6. Re-sending same reply.
I20260709 14:51:43.059823  7849 raft_consensus.cc:2393] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 7: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:51:43.033054  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:43.064458  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:43.065721  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:43.066612  7777 raft_consensus.cc:3060] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:51:43.071122  7847 raft_consensus.cc:1240] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 5. Current term is 6. Ops: []
I20260709 14:51:43.053807  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
W20260709 14:51:43.078984  7745 leader_election.cc:336] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 2.017s (SENT)
I20260709 14:51:43.079703  7745 leader_election.cc:304] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:43.080111  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9441e831627143a991a1556dcdce71e3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:43.080888  7745 leader_election.cc:304] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:43.081679  7893 leader_election.cc:304] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:43.083009 10344 consensus_queue.cc:1059] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 14:51:43.083666 10334 raft_consensus.cc:2804] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 14:51:43.084262 10472 raft_consensus.cc:3055] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 14:51:43.078971  7894 leader_election.cc:304] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:43.085747 10448 raft_consensus.cc:2804] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 14:51:43.086315 10448 raft_consensus.cc:697] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:43.087200 10448 consensus_queue.cc:237] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:43.088003 10493 log.cc:927] Time spent T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.652s	user 0.000s	sys 0.010s
I20260709 14:51:43.084101 10334 raft_consensus.cc:493] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:43.089982 10334 raft_consensus.cc:3060] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:51:43.089417  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:43.091463  7770 raft_consensus.cc:3060] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Advancing to term 8
I20260709 14:51:43.084630 10472 raft_consensus.cc:740] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:43.094362 10479 leader_election.cc:290] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:43.097908  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:43.098502 10479 raft_consensus.cc:493] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:51:43.101850  7854 raft_consensus.cc:1275] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 6. (term mismatch)
I20260709 14:51:43.084069 10344 consensus_queue.cc:1048] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 14:51:43.102499  7854 pending_rounds.cc:85] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting all ops after (but not including) 5
I20260709 14:51:43.102831  7854 pending_rounds.cc:107] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting uncommitted NO_OP operation due to leader change: 7.6
I20260709 14:51:43.103117  7854 raft_consensus.cc:2889] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:51:43.105544 10469 raft_consensus.cc:2749] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 14:51:43.103772 10479 raft_consensus.cc:515] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:43.107008  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:43.107566  7893 leader_election.cc:304] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:43.107937  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:43.108731  7771 raft_consensus.cc:2468] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 7.
I20260709 14:51:43.108528 10381 raft_consensus.cc:515] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:43.109830  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:43.112236  7776 raft_consensus.cc:2468] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 8.
I20260709 14:51:43.113183  7771 raft_consensus.cc:2468] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 10.
I20260709 14:51:43.094595 10472 consensus_queue.cc:260] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:43.114581  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:43.202909  7776 raft_consensus.cc:2468] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 6.
W20260709 14:51:43.203295  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:43.137144  7773 raft_consensus.cc:2468] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 6.
W20260709 14:51:43.125699  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 44879.4us
I20260709 14:51:42.971624  7676 rpcz_store.cc:276] 0709 14:51:37.380249 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:37.380674 (+   425us) service_pool.cc:224] Handling call
0709 14:51:37.558206 (+177532us) spinlock_profiling.cc:243] Waited 38.1 ms on lock 0x7b54003499d4. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf8090 00007fb68ae96f3a 00007fb690c4d1cc 00007fb690d4b37e 00007fb68f20c2a4 00007fb68f20c232 00007fb68f20c161 00007fb68f20c0dc 00007fb68f20b392 00007fb6891c948c 00007fb6891c88c6
0709 14:51:42.970908 (+5412702us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 14:51:40.402349 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 14:51:40.449397 (+ 47048us) write_op.cc:432] Acquiring schema lock in shared mode
0709 14:51:40.449443 (+    46us) write_op.cc:435] Acquired schema lock
0709 14:51:40.449463 (+    20us) tablet.cc:662] Decoding operations
0709 14:51:40.495055 (+ 45592us) write_op.cc:620] Acquiring the partition lock for write op
0709 14:51:40.495162 (+   107us) write_op.cc:641] Partition lock acquired for write op
0709 14:51:40.495199 (+    37us) tablet.cc:685] Acquiring locks for 7 operations
0709 14:51:40.495900 (+   701us) tablet.cc:701] Row locks acquired
0709 14:51:40.495919 (+    19us) write_op.cc:260] PREPARE: finished
0709 14:51:40.496133 (+   214us) write_op.cc:270] Start()
0709 14:51:40.496261 (+   128us) write_op.cc:276] Timestamp: P: 1783608700496051 usec, L: 0
0709 14:51:40.496282 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 14:51:40.534671 (+ 38389us) log.cc:844] Serialized 2849 byte log entry
0709 14:51:40.926089 (+391418us) op_driver.cc:464] REPLICATION: finished
0709 14:51:41.267574 (+341485us) write_op.cc:301] APPLY: starting
0709 14:51:41.274668 (+  7094us) tablet.cc:1367] starting BulkCheckPresence
0709 14:51:41.274872 (+   204us) tablet.cc:1370] finished BulkCheckPresence
0709 14:51:41.275063 (+   191us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 14:51:41.276153 (+  1090us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 14:51:41.276386 (+   233us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=7
0709 14:51:41.276438 (+    52us) write_op.cc:312] APPLY: finished
0709 14:51:41.276728 (+   290us) log.cc:844] Serialized 59 byte log entry
0709 14:51:41.276921 (+   193us) write_op.cc:489] Releasing partition, row and schema locks
0709 14:51:41.277055 (+   134us) write_op.cc:454] Released schema lock
0709 14:51:41.277101 (+    46us) write_op.cc:341] FINISH: Updating metrics
0709 14:51:41.346253 (+ 69152us) write_op.cc:489] Releasing partition, row and schema locks
0709 14:51:41.405912 (+ 59659us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":20912,"reported_tablets":34,"spinlock_wait_cycles":87633792,"child_traces":[["op",{"apply.queue_time_us":309239,"apply.run_cpu_time_us":9444,"apply.run_wall_time_us":66481,"num_ops":7,"prepare.queue_time_us":148760,"prepare.run_cpu_time_us":8758,"prepare.run_wall_time_us":152258,"replication_time_us":403948,"thread_start_us":260302,"threads_started":2}]]}
I20260709 14:51:43.098385 10458 leader_election.cc:290] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:43.124814  7893 leader_election.cc:304] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:51:43.206591  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 88682.2us
I20260709 14:51:43.207641  7893 leader_election.cc:304] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:43.158797  7770 raft_consensus.cc:2468] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 8.
I20260709 14:51:43.089907  7894 leader_election.cc:304] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:43.123677 10386 raft_consensus.cc:2749] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 14:51:43.126299 10469 raft_consensus.cc:2749] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 14:51:43.108903 10479 leader_election.cc:290] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:43.135751  7777 raft_consensus.cc:2468] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 6.
I20260709 14:51:43.201653  7819 leader_election.cc:304] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:43.207917  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:43.214465  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:43.214787  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:43.209156  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:43.215874  7777 raft_consensus.cc:2468] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 8.
I20260709 14:51:43.216492  7770 raft_consensus.cc:2468] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 5.
I20260709 14:51:43.217334  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:43.212917  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:43.218312  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
W20260709 14:51:43.209824  8598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 105478us
I20260709 14:51:43.215444  7776 raft_consensus.cc:3060] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:51:43.214737  7771 raft_consensus.cc:2468] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 9.
I20260709 14:51:43.228713  7893 leader_election.cc:304] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:43.228801  7819 leader_election.cc:304] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:43.222515 10383 raft_consensus.cc:2804] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 14:51:43.242730  7773 raft_consensus.cc:2468] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 7.
I20260709 14:51:43.232048 10458 raft_consensus.cc:2749] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 14:51:43.228406 10479 raft_consensus.cc:2804] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 14:51:43.245769  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:43.263684  7771 raft_consensus.cc:2393] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 5: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:51:43.251441  7893 leader_election.cc:304] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:43.254536  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783e4874513449ef9084b833f188a6d3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:43.243201  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:43.254993  7770 raft_consensus.cc:2468] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 7.
I20260709 14:51:43.265688  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:43.267146  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:43.267764  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:43.268795  7773 raft_consensus.cc:2393] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 6: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:51:43.269980  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:43.272753  7819 leader_election.cc:400] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 7 election: Vote denied by peer 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785) with higher term. Message: Invalid argument: T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 7. Current term is 8.
I20260709 14:51:43.275003  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:43.270108  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:43.284785  7773 raft_consensus.cc:2393] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 8: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:51:43.286893  7771 raft_consensus.cc:2393] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 6: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:51:43.292114  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:43.293507  7770 raft_consensus.cc:3060] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Advancing to term 8
I20260709 14:51:43.296437  7776 raft_consensus.cc:2468] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 7.
I20260709 14:51:43.247291 10472 raft_consensus.cc:3060] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:51:43.307489  7776 raft_consensus.cc:1240] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 6. Current term is 7. Ops: []
I20260709 14:51:43.247541 10386 raft_consensus.cc:2804] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 14:51:43.309906  7919 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
mode: GRACEFUL
new_leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:48676
I20260709 14:51:43.271310 10393 raft_consensus.cc:2749] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 14:51:43.314692  7771 raft_consensus.cc:1275] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 14:51:43.315744  7776 raft_consensus.cc:1240] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 6. Current term is 7. Ops: []
W20260709 14:51:43.316816  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 44212.5us
I20260709 14:51:43.322467  7819 leader_election.cc:400] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 9 pre-election: Vote denied by peer 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785) with higher term. Message: Invalid argument: T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 9. Current term is 10.
I20260709 14:51:43.271027 10455 raft_consensus.cc:3060] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Advancing to term 8
I20260709 14:51:43.318435  7919 raft_consensus.cc:606] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 LEADER]: Received request to transfer leadership to TS 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:43.305855  7773 raft_consensus.cc:1240] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 8. Current term is 9. Ops: []
I20260709 14:51:43.338817  7771 raft_consensus.cc:1240] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 7. Current term is 8. Ops: []
I20260709 14:51:43.340492  7776 raft_consensus.cc:1275] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 14:51:43.340685  7771 raft_consensus.cc:1240] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 3. Current term is 4. Ops: []
I20260709 14:51:43.337503  7819 leader_election.cc:304] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:43.348219  7771 raft_consensus.cc:1240] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 6. Current term is 7. Ops: []
I20260709 14:51:43.318066 10447 raft_consensus.cc:2749] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 14:51:43.318065 10386 raft_consensus.cc:493] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 14:51:43.350059  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 138273us
I20260709 14:51:43.312490 10446 leader_election.cc:290] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:43.353860 10458 raft_consensus.cc:2749] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 14:51:43.357331  7745 leader_election.cc:304] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:43.349586  7776 raft_consensus.cc:1240] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 4. Current term is 5. Ops: []
I20260709 14:51:43.359723  7776 raft_consensus.cc:1240] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 7. Current term is 8. Ops: []
I20260709 14:51:43.317546 10479 raft_consensus.cc:697] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:43.354329  7771 raft_consensus.cc:1275] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 14:51:43.361878  7771 raft_consensus.cc:1240] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 14:51:43.355311  7819 leader_election.cc:304] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed
W20260709 14:51:43.362160  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 272429us
I20260709 14:51:43.364662  7894 leader_election.cc:304] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:43.366470  7819 leader_election.cc:304] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
W20260709 14:51:43.375880  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:51:43.390317  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:43.390551  7819 leader_election.cc:304] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:43.391155  7771 raft_consensus.cc:1275] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 14:51:43.392704  7771 raft_consensus.cc:1240] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 14:51:43.398842  7771 raft_consensus.cc:1240] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 14:51:43.347687 10381 leader_election.cc:290] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:43.402962  7854 raft_consensus.cc:1275] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
W20260709 14:51:43.403695  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 142884us
I20260709 14:51:43.396832 10383 raft_consensus.cc:697] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:43.404552  7846 raft_consensus.cc:1240] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 6. Current term is 7. Ops: []
I20260709 14:51:43.408939  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:43.420624  7851 raft_consensus.cc:2468] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 5.
I20260709 14:51:43.409088  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c563cc7cfbe4d59be4ffc5cf847ce56" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:43.359475 10386 raft_consensus.cc:3060] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Advancing to term 9
W20260709 14:51:43.410519  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:43.410333  7770 raft_consensus.cc:2468] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 8.
I20260709 14:51:43.428646  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:43.428912  7777 raft_consensus.cc:1240] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 7. Current term is 8. Ops: []
I20260709 14:51:43.429617  7848 raft_consensus.cc:2410] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 14:51:43.393920 10446 raft_consensus.cc:2804] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 14:51:43.397938 10436 raft_consensus.cc:2749] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 14:51:43.405143 10450 raft_consensus.cc:2804] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 14:51:43.437398  7919 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
mode: GRACEFUL
new_leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:48676
I20260709 14:51:43.440346  7919 raft_consensus.cc:606] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Received request to transfer leadership to TS 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:43.440773  7919 raft_consensus.cc:614] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 14:51:43.437619  7819 leader_election.cc:304] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
W20260709 14:51:43.443516  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 192202us
I20260709 14:51:43.445142  7893 leader_election.cc:304] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:43.419095 10458 raft_consensus.cc:2749] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 14:51:43.435580 10507 log.cc:927] Time spent T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.209s	user 0.002s	sys 0.000s
I20260709 14:51:43.437950 10446 raft_consensus.cc:493] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Starting leader election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:51:43.461798  7893 leader_election.cc:304] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:43.462431 10450 raft_consensus.cc:697] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
W20260709 14:51:43.457091 10508 log.cc:927] Time spent T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.230s	user 0.002s	sys 0.000s
I20260709 14:51:43.470845  7893 leader_election.cc:304] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:43.433166 10398 consensus_queue.cc:1059] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 14:51:43.477216  7919 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
mode: GRACEFUL
new_leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:48676
I20260709 14:51:43.478170  7919 raft_consensus.cc:606] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Received request to transfer leadership to TS 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:43.478749  7919 raft_consensus.cc:614] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 14:51:43.485808 10525 raft_consensus.cc:493] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:43.486696 10525 raft_consensus.cc:515] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:43.487497 10512 log.cc:927] Time spent T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260709 14:51:43.456190 10405 raft_consensus.cc:2749] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 14:51:43.486552 10511 log.cc:927] Time spent T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260709 14:51:43.496582  7893 leader_election.cc:304] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:43.468855 10446 raft_consensus.cc:3060] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Advancing to term 8
W20260709 14:51:43.502022  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 52554.8us
I20260709 14:51:43.470305 10473 raft_consensus.cc:2749] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 14:51:43.509747  7819 leader_election.cc:400] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 3 election: Vote denied by peer 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785) with higher term. Message: Invalid argument: T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 3. Current term is 4.
I20260709 14:51:43.452993 10520 consensus_queue.cc:1048] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 14:51:43.464561 10436 consensus_queue.cc:1059] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 14:51:43.456643 10479 consensus_queue.cc:237] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:43.496773 10525 leader_election.cc:290] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:43.463457 10383 consensus_queue.cc:237] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:43.489837 10527 consensus_queue.cc:1059] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 14:51:43.525739  7819 leader_election.cc:400] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 7 election: Vote denied by peer 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785) with higher term. Message: Invalid argument: T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 7. Current term is 8.
I20260709 14:51:43.485694 10526 consensus_queue.cc:1059] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 14:51:43.534689  7850 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 2556) took 1159 ms. Trace:
I20260709 14:51:43.538120  7850 rpcz_store.cc:276] 0709 14:51:42.375541 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:42.724098 (+348557us) service_pool.cc:224] Handling call
0709 14:51:42.724629 (+   531us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:51:42.814329 (+ 89700us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:51:42.814371 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:51:42.815123 (+   752us) log.cc:844] Serialized 26 byte log entry
0709 14:51:42.987161 (+172038us) raft_consensus.cc:1645] Marking committed up to 6
0709 14:51:42.987213 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:42.987296 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:51:43.534404 (+547108us) raft_consensus.cc:1685] finished
0709 14:51:43.534433 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:51:43.534605 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":64493,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":175,"thread_start_us":171552,"threads_started":1,"wal-append.queue_time_us":378811}
I20260709 14:51:43.539951  7893 leader_election.cc:304] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:43.537838  7819 leader_election.cc:304] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
W20260709 14:51:43.541476  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 184283us
I20260709 14:51:43.545083  7819 leader_election.cc:400] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 7 pre-election: Vote denied by peer 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785) with higher term. Message: Invalid argument: T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 7. Current term is 8.
I20260709 14:51:43.524201 10448 raft_consensus.cc:2804] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 14:51:43.545624  7819 leader_election.cc:403] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 14:51:43.547672 10534 raft_consensus.cc:2804] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 14:51:43.548403 10393 raft_consensus.cc:2804] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 14:51:43.559788  7919 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
mode: GRACEFUL
new_leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:48676
I20260709 14:51:43.549515 10531 raft_consensus.cc:3055] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 LEADER]: Stepping down as leader of term 7
I20260709 14:51:43.546892 10528 consensus_queue.cc:1059] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 14:51:43.530032 10473 raft_consensus.cc:2804] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 14:51:43.560809  7919 raft_consensus.cc:606] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Received request to transfer leadership to TS 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:43.566570  7919 raft_consensus.cc:614] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 14:51:43.565886  7924 raft_consensus.cc:1240] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 6. Current term is 7. Ops: []
I20260709 14:51:43.567250  7774 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 2288) took 1777 ms. Trace:
I20260709 14:51:43.568892  7925 raft_consensus.cc:1240] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 3. Current term is 4. Ops: []
I20260709 14:51:43.572041  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:43.572525  7745 leader_election.cc:304] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:43.572876  7920 raft_consensus.cc:2468] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 6.
I20260709 14:51:43.574427  7745 leader_election.cc:304] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:43.576335  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:43.577621  7924 raft_consensus.cc:1275] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 14:51:43.567637  7774 rpcz_store.cc:276] 0709 14:51:41.789841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:41.798141 (+  8300us) service_pool.cc:224] Handling call
0709 14:51:41.798801 (+   660us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:51:41.799490 (+   689us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 14:51:42.437283 (+637793us) spinlock_profiling.cc:243] Waited 7.12 ms on lock 0x7b1800398ec0. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb690c69de1 00007fb690c765b1 00007fb687d83e07 00007fb690bdeab9 00007fb687da069b 00007fb687d9e93f 00007fb687d9e455 00007fb68e8863c7 00007fb68ae989a7 00007fb68aea80bf 00007fb68aea8038
0709 14:51:42.655963 (+218680us) log.cc:844] Serialized 14 byte log entry
0709 14:51:42.999951 (+343988us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:51:43.006503 (+  6552us) log.cc:844] Serialized 26 byte log entry
0709 14:51:43.006736 (+   233us) raft_consensus.cc:1645] Marking committed up to 5
0709 14:51:43.314151 (+307415us) log.cc:844] Serialized 14 byte log entry
0709 14:51:43.433461 (+119310us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:43.433591 (+   130us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:51:43.566983 (+133392us) raft_consensus.cc:1685] finished
0709 14:51:43.567011 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:51:43.567177 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3730,"prepare.queue_time_us":320315,"prepare.run_cpu_time_us":113,"prepare.run_wall_time_us":116,"raft.queue_time_us":209230,"raft.run_cpu_time_us":513,"raft.run_wall_time_us":8220,"spinlock_wait_cycles":16384768,"thread_start_us":882804,"threads_started":4,"wal-append.queue_time_us":485880}
W20260709 14:51:43.578298  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 160011us
I20260709 14:51:43.580699  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:43.556255 10458 raft_consensus.cc:3060] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Advancing to term 8
I20260709 14:51:43.583552  7925 raft_consensus.cc:1275] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 14:51:43.543565 10529 raft_consensus.cc:2749] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 14:51:43.577260 10473 raft_consensus.cc:493] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:43.598430  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:43.614639 10532 raft_consensus.cc:3055] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 LEADER]: Stepping down as leader of term 7
I20260709 14:51:43.591703  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:43.590883  7924 raft_consensus.cc:1275] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 14:51:43.609063  7920 raft_consensus.cc:1275] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 14:51:43.555992 10527 raft_consensus.cc:493] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:43.556715 10448 raft_consensus.cc:493] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:43.563621 10534 raft_consensus.cc:493] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:43.612012  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:43.600665  7923 raft_consensus.cc:1240] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 LEADER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 8. Current term is 9. Ops: []
I20260709 14:51:43.600000 10447 consensus_queue.cc:1059] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 14:51:43.578032 10526 consensus_queue.cc:1243] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer 1e9289592458429bbddb19c2e7b7b7b0 log is divergent from this leader: its last log entry 10.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 14:51:43.561877 10393 raft_consensus.cc:493] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:43.614698  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:43.562784 10531 raft_consensus.cc:740] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:51:43.598694  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:43.632359 10534 raft_consensus.cc:3060] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:51:43.582731 10525 raft_consensus.cc:493] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9418391fa82a42c79c6cad13ba91d964)
W20260709 14:51:43.645489  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:43.645658 10525 raft_consensus.cc:515] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:51:43.647504 10526 raft_consensus.cc:2749] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 14:51:43.531777 10450 consensus_queue.cc:237] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:43.632009  7921 raft_consensus.cc:2468] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 5.
I20260709 14:51:43.634486 10393 raft_consensus.cc:3060] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 14:51:43.634634 10531 consensus_queue.cc:260] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:43.636695 10530 log.cc:927] Time spent T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 14:51:43.631239 10527 raft_consensus.cc:515] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:43.638310  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:43.640503  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:43.622776 10532 raft_consensus.cc:740] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:51:43.620724 10473 raft_consensus.cc:3060] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:51:43.630955 10448 raft_consensus.cc:3060] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:51:43.623260 10528 consensus_queue.cc:1048] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 14:51:43.654603  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:43.683908  7920 raft_consensus.cc:2468] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 6.
W20260709 14:51:43.687134  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 108041us
W20260709 14:51:43.670087  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 125156us
I20260709 14:51:43.717671  7921 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
mode: GRACEFUL
new_leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:48676
I20260709 14:51:43.718426  7921 raft_consensus.cc:606] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 LEADER]: Received request to transfer leadership to TS 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:43.719164  7744 leader_election.cc:304] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:43.720369  7925 raft_consensus.cc:2393] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 8: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:51:43.686017 10519 raft_consensus.cc:2804] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 14:51:43.724728  7819 leader_election.cc:400] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 5 election: Vote denied by peer 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785) with higher term. Message: Invalid argument: T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 5. Current term is 6.
I20260709 14:51:43.721880  7744 leader_election.cc:304] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
W20260709 14:51:43.725780  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 151456us
I20260709 14:51:43.726504  7744 leader_election.cc:304] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:51:43.687131 10455 raft_consensus.cc:2749] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 14:51:43.688704 10542 raft_consensus.cc:3055] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 LEADER]: Stepping down as leader of term 7
I20260709 14:51:43.724704 10519 raft_consensus.cc:493] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:43.731995 10546 raft_consensus.cc:2749] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 14:51:43.733752 10541 raft_consensus.cc:3055] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 LEADER]: Stepping down as leader of term 9
I20260709 14:51:43.744856  7920 raft_consensus.cc:1275] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 14:51:43.714193 10544 raft_consensus.cc:493] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:43.765508 10523 raft_consensus.cc:3055] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 14:51:43.721674 10531 raft_consensus.cc:3060] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Advancing to term 8
I20260709 14:51:43.746295  7745 leader_election.cc:304] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:43.726640 10436 raft_consensus.cc:2749] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785) with higher term. Message: Invalid argument: T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 7. Current term is 8.
I20260709 14:51:43.791090 10519 raft_consensus.cc:3060] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:51:43.770367 10542 raft_consensus.cc:740] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:51:43.797832 10523 raft_consensus.cc:740] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
W20260709 14:51:43.798880  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:43.790561 10541 raft_consensus.cc:740] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:51:43.809763 10546 consensus_queue.cc:1059] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 14:51:43.830945  6549 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 14:51:43.835700  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 101461us
I20260709 14:51:43.836064  6549 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 14:51:43.809914  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 63730.1us
I20260709 14:51:43.837811  7745 leader_election.cc:304] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:43.839615  7745 leader_election.cc:304] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:51:43.886516  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 49726.1us
I20260709 14:51:43.887614  7819 leader_election.cc:304] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:43.826531 10546 raft_consensus.cc:2804] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader election won for term 6
W20260709 14:51:43.868074 10472 consensus_meta.cc:287] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent flushing consensus metadata: real 0.547s	user 0.006s	sys 0.008s
I20260709 14:51:43.826597 10527 leader_election.cc:290] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:43.872911 10526 raft_consensus.cc:2804] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 14:51:43.908923 10545 raft_consensus.cc:493] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:43.910938 10553 raft_consensus.cc:493] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:43.912401  7919 raft_consensus.cc:2468] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 5.
W20260709 14:51:43.918227  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 191832us
I20260709 14:51:43.825662 10528 consensus_queue.cc:1048] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.074s
I20260709 14:51:43.894953 10436 raft_consensus.cc:493] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:43.814440 10550 consensus_queue.cc:1059] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.097s
I20260709 14:51:43.932572 10436 raft_consensus.cc:515] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:43.933323 10535 raft_consensus.cc:2749] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 14:51:43.934927 10535 raft_consensus.cc:3055] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 LEADER]: Stepping down as leader of term 5
I20260709 14:51:43.935354 10535 raft_consensus.cc:740] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:51:43.833526 10386 raft_consensus.cc:515] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:43.936676 10535 consensus_queue.cc:260] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:43.938244 10535 raft_consensus.cc:3060] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:51:43.799455 10544 raft_consensus.cc:515] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:43.939297 10386 leader_election.cc:290] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 9 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:43.937960 10551 raft_consensus.cc:2804] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 14:51:43.914551 10334 consensus_meta.cc:287] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0: Time spent flushing consensus metadata: real 0.824s	user 0.011s	sys 0.007s
I20260709 14:51:43.931656 10563 raft_consensus.cc:3055] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 LEADER]: Stepping down as leader of term 7
I20260709 14:51:43.928771 10541 consensus_queue.cc:260] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:43.930531  7851 raft_consensus.cc:1240] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 6. Current term is 7. Ops: []
I20260709 14:51:43.827476 10523 consensus_queue.cc:260] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:43.944164 10563 raft_consensus.cc:740] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:51:43.957409 10563 consensus_queue.cc:260] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:43.945133 10551 raft_consensus.cc:493] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:43.959851 10551 raft_consensus.cc:3060] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:51:43.816293 10542 consensus_queue.cc:260] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:43.803596 10532 consensus_queue.cc:260] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:43.965878 10532 raft_consensus.cc:3060] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Advancing to term 8
I20260709 14:51:43.885367 10405 consensus_queue.cc:1059] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.043s
I20260709 14:51:43.969385 10450 consensus_queue.cc:1048] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 14:51:43.972128 10450 consensus_queue.cc:1059] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 14:51:43.913580 10526 raft_consensus.cc:493] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:43.915890 10546 raft_consensus.cc:697] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:51:43.951679 10458 raft_consensus.cc:2749] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 14:51:43.935186 10436 leader_election.cc:290] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:43.975442  7744 leader_election.cc:304] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:51:44.038218  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 90183.6us
I20260709 14:51:44.040531  7744 leader_election.cc:304] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:51:43.919557 10527 raft_consensus.cc:2749] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 14:51:44.041893 10521 raft_consensus.cc:2749] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 14:51:44.043686 10562 raft_consensus.cc:2804] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 14:51:44.044432 10562 raft_consensus.cc:493] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:43.959923  7894 leader_election.cc:304] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:43.876972 10534 raft_consensus.cc:515] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:44.056499  7744 leader_election.cc:304] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:51:44.059198  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 99431.2us
I20260709 14:51:43.900826 10548 consensus_queue.cc:1059] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.172s
I20260709 14:51:43.929234 10540 consensus_queue.cc:1059] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.203s
I20260709 14:51:43.928709 10545 raft_consensus.cc:515] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:43.929991 10553 raft_consensus.cc:515] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:43.945901 10334 raft_consensus.cc:515] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:44.417582  7745 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.577s	user 0.005s	sys 0.027s
W20260709 14:51:44.439884  7779 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.019s	sys 0.024s
W20260709 14:51:44.157706  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:44.035038 10526 raft_consensus.cc:3060] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Advancing to term 7
W20260709 14:51:44.444052  7779 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.571s	user 0.019s	sys 0.024s
W20260709 14:51:44.447600  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:44.462779  7779 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 2308) took 1460 ms. Trace:
I20260709 14:51:44.136581  7925 raft_consensus.cc:1240] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 9. Current term is 10. Ops: []
W20260709 14:51:44.437474  7819 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.548s	user 0.008s	sys 0.012s
W20260709 14:51:44.465081  7819 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.576s	user 0.008s	sys 0.012s
W20260709 14:51:44.465606  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 576535us
W20260709 14:51:44.243098  7743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:51:44.466476  7745 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.626s	user 0.006s	sys 0.027s
W20260709 14:51:44.467154  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 627634us
I20260709 14:51:44.467965  7745 leader_election.cc:304] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:51:44.028210 10396 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.771s	user 0.011s	sys 0.005s
I20260709 14:51:44.464003  7779 rpcz_store.cc:276] 0709 14:51:43.002104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:43.026803 (+ 24699us) service_pool.cc:224] Handling call
0709 14:51:43.027160 (+   357us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:51:43.027984 (+   824us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:51:43.028011 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:51:43.028534 (+   523us) log.cc:844] Serialized 26 byte log entry
0709 14:51:43.220927 (+192393us) raft_consensus.cc:1645] Marking committed up to 3
0709 14:51:43.231307 (+ 10380us) log.cc:844] Serialized 14 byte log entry
0709 14:51:43.873275 (+641968us) spinlock_profiling.cc:243] Waited 1.73 ms on lock 0x7b18003d1620. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb690c69de1 00007fb690c765b1 00007fb687d83e07 00007fb690bdeab9 00007fb687da069b 00007fb687d9e93f 00007fb687d9e455 00007fb68ae86060 00007fb68ae98716 00007fb68aea9287 00007fb68aea9208
0709 14:51:44.462210 (+588935us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:44.462387 (+   177us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:51:44.462440 (+    53us) raft_consensus.cc:1685] finished
0709 14:51:44.462529 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:51:44.462700 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31284,"prepare.queue_time_us":5716,"prepare.run_cpu_time_us":91,"prepare.run_wall_time_us":3959,"raft.queue_time_us":220381,"raft.run_cpu_time_us":338,"raft.run_wall_time_us":14491,"spinlock_wait_cycles":3976576,"thread_start_us":772036,"threads_started":2,"wal-append.queue_time_us":306092}
W20260709 14:51:44.471287  7926 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38532 (request call id 2772) took 1548 ms (client timeout 1715 ms). Trace:
W20260709 14:51:44.472237  7926 rpcz_store.cc:269] 0709 14:51:42.922864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:42.969189 (+ 46325us) service_pool.cc:224] Handling call
0709 14:51:44.471034 (+1501845us) spinlock_profiling.cc:243] Waited 864 ms on lock 0x7b54003124d4. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae922fa 00007fb68fe53b17 00007fb6893ce6d4 00007fb6893ce662 00007fb6893ce591 00007fb6893ce50c 00007fb6893cd7c2 00007fb6891c948c 00007fb6891c88c6 00007fb6891c826f
0709 14:51:44.471211 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1986076928}
W20260709 14:51:44.111673 10469 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.718s	user 0.010s	sys 0.037s
I20260709 14:51:44.181308 10533 raft_consensus.cc:993] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0: : Instructing follower 3876b8ee8d744cb18e91d97aae93b1ac to start an election
W20260709 14:51:44.270147 10446 consensus_meta.cc:287] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent flushing consensus metadata: real 0.752s	user 0.011s	sys 0.001s
I20260709 14:51:44.425101 10541 raft_consensus.cc:3060] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Advancing to term 10
W20260709 14:51:44.558105  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 90254.4us
I20260709 14:51:44.120837 10521 raft_consensus.cc:2749] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 14:51:44.243506 10552 raft_consensus.cc:2804] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 14:51:44.146004 10436 raft_consensus.cc:493] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:51:44.044917 10562 raft_consensus.cc:3060] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:51:44.559312  7745 leader_election.cc:304] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:44.417979 10542 raft_consensus.cc:3060] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Advancing to term 8
W20260709 14:51:44.470700 10396 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.216s	user 0.011s	sys 0.010s
I20260709 14:51:44.046722 10192 raft_consensus.cc:3055] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 14:51:44.325584 10405 raft_consensus.cc:3055] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 LEADER]: Stepping down as leader of term 5
I20260709 14:51:44.417272 10563 raft_consensus.cc:3060] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Advancing to term 8
I20260709 14:51:44.414268 10458 raft_consensus.cc:3055] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 LEADER]: Stepping down as leader of term 7
I20260709 14:51:44.567658  7851 raft_consensus.cc:1275] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 14:51:44.568718  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
W20260709 14:51:44.473773 10519 consensus_meta.cc:287] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent flushing consensus metadata: real 0.646s	user 0.010s	sys 0.001s
I20260709 14:51:44.186228 10383 raft_consensus.cc:493] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
W20260709 14:51:44.541347 10469 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.194s	user 0.017s	sys 0.048s
I20260709 14:51:44.537273 10548 consensus_queue.cc:1048] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.071s
I20260709 14:51:44.611423  7854 raft_consensus.cc:3060] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Advancing to term 9
I20260709 14:51:44.176733 10393 raft_consensus.cc:515] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:44.471812 10550 raft_consensus.cc:2749] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 14:51:44.621675  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 62536.9us
I20260709 14:51:44.562901 10544 leader_election.cc:290] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:44.664525  7745 leader_election.cc:304] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:44.610656 10192 raft_consensus.cc:740] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:44.560324 10446 raft_consensus.cc:515] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:44.629901 10545 leader_election.cc:290] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:44.442325 10546 consensus_queue.cc:237] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:44.638705 10553 leader_election.cc:290] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:44.683947  7927 raft_consensus.cc:1240] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 7. Current term is 8. Ops: []
I20260709 14:51:44.627727 10383 raft_consensus.cc:515] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:44.623698 10519 raft_consensus.cc:515] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:44.626286 10521 raft_consensus.cc:2749] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 14:51:44.646631 10561 log.cc:927] Time spent T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.229s	user 0.001s	sys 0.000s
I20260709 14:51:44.647131 10569 raft_consensus.cc:2749] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 14:51:44.649765  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:44.697184  7777 raft_consensus.cc:2468] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 8.
I20260709 14:51:44.650270  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:44.699316  7774 raft_consensus.cc:2468] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 5.
I20260709 14:51:44.649964  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c563cc7cfbe4d59be4ffc5cf847ce56" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:44.654073  7854 raft_consensus.cc:2468] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 9.
W20260709 14:51:44.658041  7744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:44.654078  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:44.700749  7775 raft_consensus.cc:2393] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 7: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:51:44.607860 10405 raft_consensus.cc:740] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:51:44.612555 10458 raft_consensus.cc:740] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:51:44.678659  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:44.606451 10436 raft_consensus.cc:515] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:44.582722 10552 raft_consensus.cc:493] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 14:51:44.701102  7744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:51:44.707319  7744 leader_election.cc:336] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785): Timed out: RequestConsensusVote RPC to 127.6.101.67:40785 timed out after 1.715s (SENT)
I20260709 14:51:44.707803  7744 leader_election.cc:304] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:51:44.708849  7744 leader_election.cc:336] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785): Timed out: RequestConsensusVote RPC to 127.6.101.67:40785 timed out after 1.782s (SENT)
W20260709 14:51:44.709431  7744 leader_election.cc:336] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785): Timed out: RequestConsensusVote RPC to 127.6.101.67:40785 timed out after 1.809s (SENT)
I20260709 14:51:44.709900  7744 leader_election.cc:304] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:44.711362  7744 leader_election.cc:304] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:51:44.677649 10544 raft_consensus.cc:1081] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 LEADER]: Signalling peer 3876b8ee8d744cb18e91d97aae93b1ac to start an election
I20260709 14:51:44.712837  7773 raft_consensus.cc:2393] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 9: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
W20260709 14:51:44.688855 10448 consensus_meta.cc:287] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent flushing consensus metadata: real 0.967s	user 0.013s	sys 0.000s
I20260709 14:51:44.604302 10564 consensus_queue.cc:1048] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.063s
I20260709 14:51:44.614262 10556 consensus_queue.cc:1059] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.606s
I20260709 14:51:44.713402  7774 raft_consensus.cc:1275] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 14:51:44.560678 10555 consensus_queue.cc:1048] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.106s
I20260709 14:51:44.683216 10566 raft_consensus.cc:493] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
W20260709 14:51:44.720804  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 244257us
I20260709 14:51:44.726929 10396 raft_consensus.cc:2804] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 14:51:44.727712 10334 leader_election.cc:290] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:44.718207 10567 raft_consensus.cc:2749] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 14:51:44.729998  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 65594.4us
W20260709 14:51:44.745951  7745 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:44.717546 10552 raft_consensus.cc:3060] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Advancing to term 6
W20260709 14:51:44.746940  7745 connection.cc:256] RPC call timeout handler was delayed by -1.2386137109999709s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1704s for a response
I20260709 14:51:44.752121  7819 leader_election.cc:304] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:44.724665 10521 raft_consensus.cc:2749] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 14:51:44.754449  7745 connection.cc:256] RPC call timeout handler was delayed by -1.1890597020000087s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17390000000000003s for a response
I20260709 14:51:44.731135 10534 leader_election.cc:290] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:51:44.743196 10531 consensus_meta.cc:287] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent flushing consensus metadata: real 0.935s	user 0.013s	sys 0.000s
I20260709 14:51:44.756726  7819 leader_election.cc:304] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:44.761904 10567 raft_consensus.cc:493] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:44.762607 10469 raft_consensus.cc:493] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:44.737341 10529 raft_consensus.cc:2749] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 14:51:44.730041 10448 raft_consensus.cc:515] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:44.740744 10396 raft_consensus.cc:493] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:44.790422  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:44.791281  7775 raft_consensus.cc:1275] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 14:51:44.798801  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:44.790587  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
W20260709 14:51:44.793895  7819 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:44.800304  7777 raft_consensus.cc:2468] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 7.
I20260709 14:51:44.801682  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:44.802663  7777 raft_consensus.cc:2468] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 8.
I20260709 14:51:44.804231  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:44.799750  7775 raft_consensus.cc:2468] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 9.
I20260709 14:51:44.759115 10556 raft_consensus.cc:3055] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 LEADER]: Stepping down as leader of term 3
I20260709 14:51:44.813819  7745 leader_election.cc:304] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:44.729408 10192 consensus_queue.cc:260] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:44.818888 10192 raft_consensus.cc:3060] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:51:44.820123 10448 leader_election.cc:290] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 5 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:44.820969  7925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38516 (request call id 2089) took 1215 ms. Trace:
W20260709 14:51:44.821403  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:51:44.822635 10568 log.cc:927] Time spent T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 14:51:44.823364  7921 raft_consensus.cc:1240] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 4. Current term is 5. Ops: []
I20260709 14:51:44.812166 10396 raft_consensus.cc:3060] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Advancing to term 8
I20260709 14:51:44.821463  7925 rpcz_store.cc:276] 0709 14:51:43.605188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:43.722575 (+117387us) service_pool.cc:224] Handling call
0709 14:51:43.722974 (+   399us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:51:44.464347 (+741373us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:44.820674 (+356327us) spinlock_profiling.cc:243] Waited 413 ms on lock 0x7b54000cce54. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae8ee01 00007fb68ae8d83e 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2 00007fb6891c948c 00007fb6891c88c6
0709 14:51:44.820893 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":950716800}
I20260709 14:51:44.830404  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
W20260709 14:51:44.834743 10560 log.cc:927] Time spent T 00000000000000000000000000000000 P 133636659113430cb53b321cb0b1d9ee: Append to log took a long time: real 0.284s	user 0.002s	sys 0.002s
I20260709 14:51:44.833189 10573 consensus_queue.cc:1048] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 14:51:44.770206 10405 consensus_queue.cc:260] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:44.842562 10405 raft_consensus.cc:3060] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:51:44.845934  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:44.850517  7777 raft_consensus.cc:3060] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Advancing to term 10
W20260709 14:51:44.818171 10473 consensus_meta.cc:287] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent flushing consensus metadata: real 1.095s	user 0.007s	sys 0.007s
I20260709 14:51:44.854188  6549 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 14:51:44.791354 10553 raft_consensus.cc:2804] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 14:51:44.859686  7745 leader_election.cc:304] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:44.811575 10531 raft_consensus.cc:2804] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 14:51:44.767160 10540 consensus_queue.cc:1059] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.085s
I20260709 14:51:44.874337  7777 raft_consensus.cc:2468] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 10.
I20260709 14:51:44.758433 10458 consensus_queue.cc:260] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:44.886554 10446 leader_election.cc:290] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 8 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:44.766013 10545 consensus_queue.cc:1048] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.086s
I20260709 14:51:44.893493 10393 leader_election.cc:290] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:44.881152  7745 leader_election.cc:304] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:51:44.927978  7742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:44.901055 10564 raft_consensus.cc:493] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:51:44.901816 10551 consensus_meta.cc:287] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent flushing consensus metadata: real 0.941s	user 0.008s	sys 0.009s
I20260709 14:51:44.867704 10473 raft_consensus.cc:515] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:44.910504  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:44.816414 10556 raft_consensus.cc:740] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:51:44.912302 10573 raft_consensus.cc:493] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:44.961915 10573 raft_consensus.cc:515] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:44.946538  7743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:44.965718 10473 leader_election.cc:290] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:44.952003 10564 raft_consensus.cc:515] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:44.745882 10566 raft_consensus.cc:515] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:44.969502 10564 leader_election.cc:290] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:44.964866 10573 leader_election.cc:290] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:44.927201 10525 leader_election.cc:290] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68:42321)
I20260709 14:51:44.800275 10567 raft_consensus.cc:515] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:44.970130 10523 raft_consensus.cc:3060] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:51:44.829916 10521 consensus_queue.cc:1048] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.144s
I20260709 14:51:44.812412 10469 raft_consensus.cc:515] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:44.956935 10551 raft_consensus.cc:515] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:44.957484  8639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18d29d52d304c87b930d4fb5eaf50b1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9418391fa82a42c79c6cad13ba91d964" is_pre_election: true
I20260709 14:51:44.959851 10383 leader_election.cc:290] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:44.921907 10540 consensus_queue.cc:1243] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer 1e9289592458429bbddb19c2e7b7b7b0 log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 14:51:44.921581 10531 raft_consensus.cc:493] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:44.911043 10436 leader_election.cc:290] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:44.916750 10585 raft_consensus.cc:493] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:44.925343 10519 leader_election.cc:290] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:44.962180 10556 consensus_queue.cc:260] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:44.980352  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:44.980458 10585 raft_consensus.cc:515] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:44.983469 10585 leader_election.cc:290] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:44.980723 10531 raft_consensus.cc:3060] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:51:44.981235 10556 raft_consensus.cc:3060] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:51:44.859556 10557 raft_consensus.cc:493] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:44.985828 10557 raft_consensus.cc:515] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:44.984277 10551 leader_election.cc:290] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 7 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:44.976985 10567 leader_election.cc:290] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:44.988862  7774 raft_consensus.cc:2468] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 5.
I20260709 14:51:44.909024 10558 raft_consensus.cc:2749] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 14:51:44.865327 10569 raft_consensus.cc:2749] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 14:51:44.870551 10553 raft_consensus.cc:493] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:44.992681 10553 raft_consensus.cc:3060] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Advancing to term 6
W20260709 14:51:44.871539 10535 consensus_meta.cc:287] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent flushing consensus metadata: real 0.927s	user 0.014s	sys 0.000s
I20260709 14:51:44.994167  7775 raft_consensus.cc:1275] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 14:51:44.994727  7775 pending_rounds.cc:85] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed: Aborting all ops after (but not including) 3
I20260709 14:51:44.994987  7775 pending_rounds.cc:107] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 14:51:44.995261  7775 raft_consensus.cc:2889] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:51:44.996544 10531 raft_consensus.cc:515] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:44.979521  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:44.999571 10531 leader_election.cc:290] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 6 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:44.969529 10566 leader_election.cc:290] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:44.979698 10469 leader_election.cc:290] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:44.988517 10557 leader_election.cc:290] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:51:45.030679 10532 consensus_meta.cc:287] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent flushing consensus metadata: real 1.064s	user 0.017s	sys 0.000s
I20260709 14:51:45.019711 10563 raft_consensus.cc:2749] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 14:51:45.047533  7893 leader_election.cc:304] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:45.053158  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:51:45.038228 10522 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.523s	user 0.013s	sys 0.013s
I20260709 14:51:45.059429  7893 leader_election.cc:304] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:45.062203  7853 raft_consensus.cc:1275] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 6. (term mismatch)
I20260709 14:51:45.062719  7853 pending_rounds.cc:85] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting all ops after (but not including) 5
I20260709 14:51:45.062966  7853 pending_rounds.cc:107] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting uncommitted NO_OP operation due to leader change: 7.6
I20260709 14:51:45.063493  7853 raft_consensus.cc:2889] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:51:45.054536  7851 raft_consensus.cc:2468] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 8.
I20260709 14:51:45.070714  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18d29d52d304c87b930d4fb5eaf50b1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:45.013202 10553 raft_consensus.cc:515] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:45.075003  7776 raft_consensus.cc:2468] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 8.
I20260709 14:51:45.067625  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:45.078503  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:45.079694  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:51:45.074277 10526 consensus_meta.cc:287] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent flushing consensus metadata: real 0.591s	user 0.005s	sys 0.008s
I20260709 14:51:45.057914 10551 raft_consensus.cc:493] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:45.083135  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:45.083866  7854 raft_consensus.cc:2376] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 7. Re-sending same reply.
I20260709 14:51:45.076756  7819 leader_election.cc:304] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:45.072021 10585 raft_consensus.cc:493] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:45.094200  7845 raft_consensus.cc:1240] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 7. Current term is 8. Ops: []
W20260709 14:51:45.111613  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 230572us
W20260709 14:51:45.065622 10522 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.558s	user 0.014s	sys 0.014s
I20260709 14:51:45.078581  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:45.073464  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
W20260709 14:51:45.094096  7744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:45.095973 10436 raft_consensus.cc:2804] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 14:51:45.080984 10526 raft_consensus.cc:515] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:45.102139 10580 log.cc:927] Time spent T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.146s	user 0.000s	sys 0.000s
I20260709 14:51:45.101897 10570 raft_consensus.cc:2804] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 14:51:45.106762 10553 leader_election.cc:290] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 6 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:45.107633  7927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38516 (request call id 2081) took 1513 ms. Trace:
I20260709 14:51:45.068914  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:45.074757 10405 raft_consensus.cc:493] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:45.136373  7927 rpcz_store.cc:276] 0709 14:51:43.594137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:43.595401 (+  1264us) service_pool.cc:224] Handling call
0709 14:51:43.595847 (+   446us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:51:44.684429 (+1088582us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:45.106792 (+422363us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b5400174dd4. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae8ee01 00007fb68ae8d83e 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2 00007fb6891c948c 00007fb6891c88c6
0709 14:51:45.107528 (+   736us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2501988224}
I20260709 14:51:45.109906  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:45.111999  7854 raft_consensus.cc:1240] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 14:51:45.074935 10450 raft_consensus.cc:493] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:51:45.078778 10536 raft_consensus.cc:493] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:51:45.039618 10562 raft_consensus.cc:515] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:45.072540  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:51:45.123898  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:45.085347 10544 raft_consensus.cc:2804] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 14:51:45.135718  7845 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a"
dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:49946
I20260709 14:51:45.115139  7851 raft_consensus.cc:1240] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 7. Current term is 8. Ops: []
I20260709 14:51:45.158792  7845 raft_consensus.cc:493] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:51:45.136699  7852 raft_consensus.cc:3060] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:51:45.141476  7745 leader_election.cc:304] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:51:45.127981 10455 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.578s	user 0.057s	sys 0.114s
I20260709 14:51:45.162065  7745 leader_election.cc:304] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:51:45.139823 10541 consensus_meta.cc:287] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent flushing consensus metadata: real 0.583s	user 0.015s	sys 0.000s
I20260709 14:51:45.164386  7745 leader_election.cc:304] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 3876b8ee8d744cb18e91d97aae93b1ac, 9418391fa82a42c79c6cad13ba91d964
I20260709 14:51:45.150138  7853 raft_consensus.cc:1240] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 7. Current term is 8. Ops: []
I20260709 14:51:45.120450  7819 leader_election.cc:304] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:45.154088  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258d6c2dda954bf5b65930fde8ecb9f3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:45.115317 10436 raft_consensus.cc:493] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:45.156283  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:45.153333  7846 raft_consensus.cc:2468] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 3.
I20260709 14:51:45.159258  7845 raft_consensus.cc:3060] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Advancing to term 8
W20260709 14:51:45.112393  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 53126.6us
W20260709 14:51:45.171434  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 51157.9us
I20260709 14:51:45.149581 10570 raft_consensus.cc:697] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:45.155493 10544 raft_consensus.cc:493] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:45.174062 10553 raft_consensus.cc:2749] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 14:51:45.181551 10548 raft_consensus.cc:3055] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 LEADER]: Stepping down as leader of term 6
I20260709 14:51:45.182200 10548 raft_consensus.cc:740] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:51:45.154755 10536 raft_consensus.cc:515] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:45.149187 10405 raft_consensus.cc:515] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:45.187903 10405 leader_election.cc:290] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:45.189188 10526 leader_election.cc:290] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:45.189911 10396 raft_consensus.cc:515] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:45.192391 10396 leader_election.cc:290] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:45.193202 10548 consensus_queue.cc:260] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:45.194140 10562 leader_election.cc:290] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:45.194471 10548 raft_consensus.cc:3060] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Advancing to term 7
W20260709 14:51:45.166102 10455 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.621s	user 0.058s	sys 0.115s
I20260709 14:51:45.172206  7893 leader_election.cc:304] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:45.170235  7779 raft_consensus.cc:1275] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 8. (term mismatch)
I20260709 14:51:45.150610 10450 raft_consensus.cc:515] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:45.136333 10551 raft_consensus.cc:515] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:45.111790 10585 raft_consensus.cc:515] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:45.167312 10522 raft_consensus.cc:2749] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 14:51:45.214784 10450 leader_election.cc:290] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:45.197724 10544 raft_consensus.cc:3060] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 14:51:45.169350 10563 raft_consensus.cc:3060] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:51:45.205782 10526 raft_consensus.cc:493] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:45.187911 10536 leader_election.cc:290] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:45.172251  7819 leader_election.cc:304] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:45.201171  7779 pending_rounds.cc:85] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed: Aborting all ops after (but not including) 7
I20260709 14:51:45.204043  7745 leader_election.cc:304] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:45.210839 10552 raft_consensus.cc:515] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:45.213615 10588 raft_consensus.cc:2749] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 14:51:45.169631 10436 raft_consensus.cc:3060] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Advancing to term 10
W20260709 14:51:45.182205 10579 log.cc:927] Time spent T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 14:51:45.189217 10570 consensus_queue.cc:237] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:45.218376  7676 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51352 (request call id 99) took 1308 ms. Trace:
I20260709 14:51:45.222405 10526 raft_consensus.cc:515] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:45.251340  7676 rpcz_store.cc:276] 0709 14:51:43.909950 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:43.919004 (+  9054us) service_pool.cc:224] Handling call
0709 14:51:45.216483 (+1297479us) spinlock_profiling.cc:243] Waited 96.7 ms on lock 0x7b54003499d4. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf8090 00007fb68ae96f3a 00007fb690c4d1cc 00007fb690d4b37e 00007fb68f20c2a4 00007fb68f20c232 00007fb68f20c161 00007fb68f20c0dc 00007fb68f20b392 00007fb6891c948c 00007fb6891c88c6
0709 14:51:45.218210 (+  1727us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":0,"spinlock_wait_cycles":222387968}
W20260709 14:51:45.252902  7742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:45.223297  7852 raft_consensus.cc:2410] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 14:51:45.254859 10526 leader_election.cc:290] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:51:45.226017  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 53847.1us
I20260709 14:51:45.226390  7779 pending_rounds.cc:107] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed: Aborting uncommitted NO_OP operation due to leader change: 9.8
I20260709 14:51:45.258203  7779 raft_consensus.cc:2889] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 14:51:45.227198  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 50764.8us
I20260709 14:51:45.224864 10551 leader_election.cc:290] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:45.231822 10552 leader_election.cc:290] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:51:45.234624  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 62538.8us
I20260709 14:51:45.263065  7893 leader_election.cc:304] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:51:45.246852  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:45.260659  7745 leader_election.cc:304] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:45.256944  7819 leader_election.cc:304] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:45.272946  7819 leader_election.cc:304] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:45.226158 10455 raft_consensus.cc:2749] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 14:51:45.226819 10522 raft_consensus.cc:2749] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 14:51:45.265331 10552 raft_consensus.cc:2804] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 14:51:45.295598 10588 raft_consensus.cc:493] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:45.295771 10553 raft_consensus.cc:2749] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 14:51:45.295871 10552 raft_consensus.cc:493] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:45.296358 10588 raft_consensus.cc:515] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:45.297135 10552 raft_consensus.cc:3060] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:51:45.274550  7893 leader_election.cc:304] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:45.300455 10588 leader_election.cc:290] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:45.300608 10192 raft_consensus.cc:2804] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 14:51:45.301198 10192 raft_consensus.cc:697] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
W20260709 14:51:45.301630 10533 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.746s	user 0.010s	sys 0.013s
W20260709 14:51:45.250088 10576 log.cc:927] Time spent T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.416s	user 0.001s	sys 0.004s
W20260709 14:51:45.302023 10533 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.746s	user 0.010s	sys 0.013s
I20260709 14:51:45.248597 10583 raft_consensus.cc:493] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:45.241674 10536 raft_consensus.cc:2804] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 14:51:45.293053 10526 raft_consensus.cc:2749] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 14:51:45.310366  7893 leader_election.cc:304] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:45.311002  7819 leader_election.cc:304] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:45.294458  7845 raft_consensus.cc:515] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:45.292407 10551 raft_consensus.cc:2749] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 14:51:45.243669 10585 leader_election.cc:290] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:45.317395  7893 leader_election.cc:304] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:45.319315  7845 leader_election.cc:290] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 8 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:45.320657  7893 leader_election.cc:304] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:45.322667  7893 leader_election.cc:304] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:45.307364 10192 consensus_queue.cc:237] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:45.317760 10556 raft_consensus.cc:2749] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 14:51:45.327216 10571 raft_consensus.cc:2749] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 14:51:45.328169 10533 raft_consensus.cc:2804] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 14:51:45.328624 10533 raft_consensus.cc:493] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:45.328960 10533 raft_consensus.cc:3060] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 14:51:45.314078 10536 raft_consensus.cc:493] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:45.340086 10571 raft_consensus.cc:2804] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 14:51:45.333855 10570 raft_consensus.cc:2804] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 14:51:45.344590  7921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38516 (request call id 2090) took 1739 ms. Trace:
I20260709 14:51:45.314038 10583 raft_consensus.cc:515] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:45.360030  7921 rpcz_store.cc:276] 0709 14:51:43.605500 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:43.769962 (+164462us) service_pool.cc:224] Handling call
0709 14:51:43.770458 (+   496us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:51:44.823852 (+1053394us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:45.344254 (+520402us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b540041c3d4. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae8ee01 00007fb68ae8d83e 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2 00007fb6891c948c 00007fb6891c88c6
0709 14:51:45.344511 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2421015808}
I20260709 14:51:45.359808 10570 raft_consensus.cc:493] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:45.359381 10571 raft_consensus.cc:697] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:45.330030 10585 consensus_queue.cc:1059] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 14:51:45.432286 10571 consensus_queue.cc:237] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:45.369453 10578 consensus_queue.cc:1059] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 14:51:45.395823 10436 raft_consensus.cc:515] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:45.436993 10436 leader_election.cc:290] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 10 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:45.438257  7847 raft_consensus.cc:1240] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 9. Current term is 10. Ops: []
I20260709 14:51:45.343091 10523 consensus_queue.cc:1048] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 14:51:45.343410 10556 consensus_queue.cc:1059] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 14:51:45.440955 10556 raft_consensus.cc:3055] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 LEADER]: Stepping down as leader of term 6
W20260709 14:51:45.441636  7742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:45.441485 10556 raft_consensus.cc:740] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:51:45.445060 10595 consensus_queue.cc:1048] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 14:51:45.445880  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:45.448783  7894 leader_election.cc:304] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:45.449903 10595 raft_consensus.cc:2804] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 14:51:45.450506 10595 raft_consensus.cc:697] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:45.450223 10556 consensus_queue.cc:260] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:45.452111 10595 consensus_queue.cc:237] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:45.341749 10551 consensus_queue.cc:1048] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 14:51:45.400594 10544 raft_consensus.cc:515] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:45.405786  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 45700.4us
I20260709 14:51:45.408787  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:45.409637  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:45.414099  7849 raft_consensus.cc:1275] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 14:51:45.457437 10455 raft_consensus.cc:493] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:45.445066 10570 raft_consensus.cc:3060] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 14:51:45.458314  7819 leader_election.cc:304] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:45.458539 10436 consensus_queue.cc:1048] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 14:51:45.406421  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 46020.7us
I20260709 14:51:45.415905  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:45.338563 10536 raft_consensus.cc:3060] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Advancing to term 11
W20260709 14:51:45.450223 10593 log.cc:927] Time spent T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 14:51:45.418743  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:45.418947 10548 consensus_queue.cc:1059] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 14:51:45.411151  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:45.461594 10578 raft_consensus.cc:2804] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader election won for term 8
I20260709 14:51:45.461968  7924 raft_consensus.cc:2393] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 10: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:51:45.462162 10578 raft_consensus.cc:697] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:51:45.419581 10526 raft_consensus.cc:493] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:45.463120 10578 consensus_queue.cc:237] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:45.463739 10526 raft_consensus.cc:515] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:45.461272 10553 consensus_queue.cc:1048] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 14:51:45.467289 10548 raft_consensus.cc:3055] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 LEADER]: Stepping down as leader of term 4
I20260709 14:51:45.467797 10548 raft_consensus.cc:740] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:51:45.469045 10473 consensus_queue.cc:1059] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 14:51:45.469646 10548 consensus_queue.cc:260] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:45.470505 10473 raft_consensus.cc:3055] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 14:51:45.470711 10450 consensus_queue.cc:1048] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 14:51:45.421387  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:45.471238 10473 raft_consensus.cc:740] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:45.422075 10334 consensus_queue.cc:1059] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 14:51:45.404909 10446 raft_consensus.cc:3055] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 LEADER]: Stepping down as leader of term 8
I20260709 14:51:45.473515 10446 raft_consensus.cc:740] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:51:45.474068  7893 leader_election.cc:304] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:45.473311 10537 raft_consensus.cc:3055] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 14:51:45.416828  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:45.475374 10537 raft_consensus.cc:740] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:45.458317 10455 raft_consensus.cc:515] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:45.476284 10551 raft_consensus.cc:493] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:45.476778 10551 raft_consensus.cc:515] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:45.476847 10537 consensus_queue.cc:260] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:45.474500 10446 consensus_queue.cc:260] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:45.417809  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:45.480022  7893 leader_election.cc:304] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:45.459987 10552 raft_consensus.cc:515] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:45.478606  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:45.482101  7893 leader_election.cc:304] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:51:45.452541 10556 raft_consensus.cc:3060] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:51:45.485997  7819 leader_election.cc:304] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:45.482215  7894 leader_election.cc:304] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:45.488546  7819 leader_election.cc:304] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:45.489974  7819 leader_election.cc:304] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:45.478823 10548 raft_consensus.cc:3060] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:51:45.484272 10582 raft_consensus.cc:3060] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:51:45.496438 10448 raft_consensus.cc:2804] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 14:51:45.496939 10448 raft_consensus.cc:493] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:45.478344 10334 raft_consensus.cc:2804] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 14:51:45.498097  7894 leader_election.cc:304] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:45.500982  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:45.506161  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:45.454751 10563 raft_consensus.cc:2749] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 14:51:45.501665  7924 raft_consensus.cc:1240] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 7. Current term is 8. Ops: []
I20260709 14:51:45.503137 10529 raft_consensus.cc:493] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:45.499656 10436 raft_consensus.cc:2804] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 14:51:45.499521 10566 raft_consensus.cc:2764] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 14:51:45.494124 10531 consensus_queue.cc:1048] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 14:51:45.495671  7819 leader_election.cc:304] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:45.487906 10405 raft_consensus.cc:493] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:45.503908 10448 raft_consensus.cc:3060] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:51:45.500015 10534 consensus_queue.cc:1048] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.092s
I20260709 14:51:45.499261 10537 raft_consensus.cc:3060] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:51:45.503254 10446 raft_consensus.cc:3060] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:51:45.504487 10334 raft_consensus.cc:493] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:45.492054 10574 consensus_queue.cc:1048] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.098s
I20260709 14:51:45.472946 10473 consensus_queue.cc:260] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.3, Last appended by leader: 3, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:45.586635  7772 raft_consensus.cc:1240] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 4. Current term is 5. Ops: []
W20260709 14:51:45.517681  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:51:45.639307  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:45.532832  7779 raft_consensus.cc:1240] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 7. Current term is 8. Ops: []
I20260709 14:51:45.520123  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:45.562742  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:45.592562  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:45.596956  7745 leader_election.cc:304] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 3876b8ee8d744cb18e91d97aae93b1ac, 9418391fa82a42c79c6cad13ba91d964
I20260709 14:51:45.553720  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:45.616954  7776 raft_consensus.cc:1275] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 14:51:45.547863  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
W20260709 14:51:45.591964  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RunLeaderElection -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 51849.7us
I20260709 14:51:45.559413  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
W20260709 14:51:45.564888  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:45.565024  7777 raft_consensus.cc:1240] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 6. Current term is 7. Ops: []
I20260709 14:51:45.587037  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258d6c2dda954bf5b65930fde8ecb9f3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:45.650472  7771 raft_consensus.cc:2393] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 5: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
W20260709 14:51:45.652495  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 55685.2us
I20260709 14:51:45.645949  7775 raft_consensus.cc:2468] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 8.
I20260709 14:51:45.522038  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:45.532095 10479 raft_consensus.cc:2749] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 14:51:45.676057  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:45.677503  7921 raft_consensus.cc:2393] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 8: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:51:45.686488  7745 leader_election.cc:304] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:45.636307 10334 raft_consensus.cc:3060] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:51:45.589427 10524 raft_consensus.cc:2804] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 14:51:45.698762 10458 raft_consensus.cc:3060] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Advancing to term 8
I20260709 14:51:45.705617  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:45.695616  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:45.709334  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:45.719731  7772 raft_consensus.cc:2468] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 8.
I20260709 14:51:45.513878 10436 raft_consensus.cc:493] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:45.590193 10531 raft_consensus.cc:2804] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 14:51:45.509847 10586 raft_consensus.cc:2804] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 14:51:45.621587 10563 raft_consensus.cc:493] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:45.715847  7745 leader_election.cc:304] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:45.648883 10522 raft_consensus.cc:493] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:45.677994 10559 raft_consensus.cc:493] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:45.510607 10529 raft_consensus.cc:515] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:45.667007 10588 raft_consensus.cc:2749] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 14:51:45.662019 10192 consensus_queue.cc:1059] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.082s
I20260709 14:51:45.732170  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:45.510844 10590 consensus_queue.cc:1048] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.219s
I20260709 14:51:45.586254 10405 raft_consensus.cc:515] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:45.588968 10533 raft_consensus.cc:515] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:45.512506 10583 leader_election.cc:290] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:45.705008 10551 leader_election.cc:290] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:45.509104 10570 raft_consensus.cc:515] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:45.728969 10541 raft_consensus.cc:2749] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 14:51:45.717422 10546 raft_consensus.cc:493] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:51:45.734490 10436 raft_consensus.cc:3060] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:51:45.775596  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:45.762138  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:45.733395 10586 raft_consensus.cc:493] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:45.733116 10531 raft_consensus.cc:493] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
W20260709 14:51:45.764833  7744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:45.735152 10524 raft_consensus.cc:697] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:45.776510  7927 raft_consensus.cc:3060] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:51:45.791671  7922 raft_consensus.cc:1240] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 14:51:45.767323 10192 consensus_queue.cc:1243] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Peer 3876b8ee8d744cb18e91d97aae93b1ac log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 14:51:45.741631 10563 raft_consensus.cc:515] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:45.769515 10588 raft_consensus.cc:493] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:45.747430 10559 raft_consensus.cc:515] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:45.782086 10396 raft_consensus.cc:2749] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 14:51:45.820372  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:45.782344 10531 raft_consensus.cc:3060] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:51:45.746157 10522 raft_consensus.cc:515] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:45.797021 10544 leader_election.cc:290] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:45.782755 10586 raft_consensus.cc:3060] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Advancing to term 8
I20260709 14:51:45.781536 10546 raft_consensus.cc:515] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:45.819591 10574 raft_consensus.cc:993] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0: : Instructing follower 3876b8ee8d744cb18e91d97aae93b1ac to start an election
W20260709 14:51:45.836205  7893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:45.841792 10524 consensus_queue.cc:237] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:45.842396 10455 leader_election.cc:290] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:45.843523  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:45.818065 10552 leader_election.cc:290] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 7 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:45.853430  7927 raft_consensus.cc:2468] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 7.
I20260709 14:51:45.856375  7773 raft_consensus.cc:2468] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 9.
I20260709 14:51:45.862473  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:45.863430  7773 raft_consensus.cc:2468] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 10.
I20260709 14:51:45.844558  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:45.864615  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
W20260709 14:51:45.866115  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:45.865818  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:45.872840  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:45.886919 10405 leader_election.cc:290] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:45.899369  7920 raft_consensus.cc:1240] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 LEADER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 14:51:45.906553 10533 leader_election.cc:290] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:45.909286 10570 leader_election.cc:290] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:45.827746 10588 raft_consensus.cc:515] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:45.911931 10588 leader_election.cc:290] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:45.915297 10559 leader_election.cc:290] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:45.918877 10546 leader_election.cc:290] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:51:45.920305 10598 log.cc:927] Time spent T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.118s	user 0.000s	sys 0.001s
I20260709 14:51:45.898758 10529 leader_election.cc:290] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:45.942752 10334 raft_consensus.cc:515] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:45.947288 10334 leader_election.cc:290] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 9 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:45.948693 10552 raft_consensus.cc:1081] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 LEADER]: Signalling peer 3876b8ee8d744cb18e91d97aae93b1ac to start an election
I20260709 14:51:45.950070 10448 raft_consensus.cc:515] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:45.951923 10405 raft_consensus.cc:493] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:45.954487 10586 raft_consensus.cc:515] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:45.874591  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258d6c2dda954bf5b65930fde8ecb9f3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:46.042734  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:46.946947  7774 raft_consensus.cc:3060] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:51:46.045096  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:46.958235  7775 raft_consensus.cc:3060] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Advancing to term 8
I20260709 14:51:46.073359  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:46.516804 10617 raft_consensus.cc:493] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:46.641650 10624 raft_consensus.cc:493] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:51:46.664319  7742 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.929s	user 0.012s	sys 0.036s
I20260709 14:51:46.963104 10624 raft_consensus.cc:515] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:46.676811  7924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38532 (request call id 2794) took 1174 ms. Trace:
I20260709 14:51:46.964457  7924 rpcz_store.cc:276] 0709 14:51:45.502428 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:45.508848 (+  6420us) service_pool.cc:224] Handling call
0709 14:51:45.509754 (+   906us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:51:45.510316 (+   562us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:51:45.510357 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:51:45.511134 (+   777us) log.cc:844] Serialized 26 byte log entry
0709 14:51:45.717979 (+206845us) raft_consensus.cc:1645] Marking committed up to 2
0709 14:51:45.718031 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:45.718117 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:51:46.672807 (+954690us) raft_consensus.cc:1685] finished
0709 14:51:46.672849 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:51:46.676509 (+  3660us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3835,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":170,"thread_start_us":206250,"threads_started":1,"wal-append.queue_time_us":545176}
I20260709 14:51:46.966905 10624 leader_election.cc:290] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:46.963308  7776 raft_consensus.cc:2393] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 5: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:51:46.967731 10624 raft_consensus.cc:493] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:51:46.680342  7923 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.870s	user 0.012s	sys 0.006s
I20260709 14:51:46.968291  7776 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37144 (request call id 2353) took 1376 ms. Trace:
I20260709 14:51:46.044247 10436 raft_consensus.cc:515] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:46.317418 10473 raft_consensus.cc:3060] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 14:51:45.932751 10522 leader_election.cc:290] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:48.364840 10522 raft_consensus.cc:493] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:48.365609 10522 raft_consensus.cc:515] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:48.368166 10522 leader_election.cc:290] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:46.354657 10526 leader_election.cc:290] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:51:46.055887 10536 consensus_meta.cc:287] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0: Time spent flushing consensus metadata: real 0.560s	user 0.011s	sys 0.000s
I20260709 14:51:47.968149 10626 raft_consensus.cc:493] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:48.329124 10627 raft_consensus.cc:493] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9418391fa82a42c79c6cad13ba91d964)
I20260709 14:51:49.417608 10626 raft_consensus.cc:515] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:49.417773 10627 raft_consensus.cc:515] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:51:46.969053 10624 raft_consensus.cc:515] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:48.421676 10630 raft_consensus.cc:493] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:48.445855 10631 raft_consensus.cc:493] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:48.486203 10632 raft_consensus.cc:493] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:48.614173 10633 raft_consensus.cc:493] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:48.618130 10634 raft_consensus.cc:493] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:49.425276 10632 raft_consensus.cc:515] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:49.425534 10633 raft_consensus.cc:515] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:49.426261 10634 raft_consensus.cc:515] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:46.964063  7742 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.229s	user 0.012s	sys 0.038s
W20260709 14:51:46.926838  7744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:51:46.948881  7745 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.211s	user 0.009s	sys 0.003s
W20260709 14:51:49.502177  7745 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 3.764s	user 0.010s	sys 0.005s
W20260709 14:51:49.503454  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 3.78763e+06us
W20260709 14:51:48.171657  7774 consensus_meta.cc:287] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent flushing consensus metadata: real 1.224s	user 0.025s	sys 0.005s
I20260709 14:51:46.979470  7775 raft_consensus.cc:2468] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 8.
I20260709 14:51:48.300388  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
W20260709 14:51:49.535635  7775 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37136 (request call id 2107) took 3843 ms (client timeout 1886 ms). Trace:
I20260709 14:51:49.536698  7772 raft_consensus.cc:2368] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 6. Current term is 7.
W20260709 14:51:49.537593  7772 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37136 (request call id 2101) took 3896 ms (client timeout 1907 ms). Trace:
W20260709 14:51:49.538010  7772 rpcz_store.cc:269] 0709 14:51:45.641190 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:45.868715 (+227525us) service_pool.cc:224] Handling call
0709 14:51:49.537469 (+3668754us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 14:51:48.611382  7779 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37136 (request call id 2106) took 2920 ms (client timeout 2165 ms). Trace:
W20260709 14:51:49.547612  7779 rpcz_store.cc:269] 0709 14:51:45.691800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:48.610832 (+2919032us) service_pool.cc:211] Skipping call since client already timed out
0709 14:51:48.611176 (+   344us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 14:51:49.550366  7779 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 2350) took 3971 ms. Trace:
I20260709 14:51:49.551011  7779 rpcz_store.cc:276] 0709 14:51:45.578588 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:49.548844 (+3970256us) service_pool.cc:224] Handling call
0709 14:51:49.549633 (+   789us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:51:49.549929 (+   296us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:51:49.549956 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:51:49.550028 (+    72us) raft_consensus.cc:1645] Marking committed up to 5
0709 14:51:49.550073 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:49.550143 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:51:49.550267 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 14:51:46.915482  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:49.555269  7777 raft_consensus.cc:3060] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:51:46.940603  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:48.360123  7770 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 2334) took 3708 ms. Trace:
W20260709 14:51:46.898104  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:51:49.566558  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:51:48.180406  7820 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.506s	user 0.037s	sys 0.080s
I20260709 14:51:49.565623  7770 rpcz_store.cc:276] 0709 14:51:44.651375 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:44.651636 (+   261us) service_pool.cc:224] Handling call
0709 14:51:45.402043 (+750407us) spinlock_profiling.cc:243] Waited 1.48 ms on lock 0x7b5800002a98. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb687c29db1 00007fb687d69b71 00007fb687d69a22 00007fb690c82c09 00007fb68fddcee0 00007fb68fea60ab 00007fb68fea6131 00007fb68fe67fc0 00007fb68fe52929 00007fb68fe523d2 00007fb6893c9bd4
0709 14:51:45.402391 (+   348us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:51:45.402938 (+   547us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:51:45.402972 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:51:45.421458 (+ 18486us) log.cc:844] Serialized 26 byte log entry
0709 14:51:45.611428 (+189970us) raft_consensus.cc:1645] Marking committed up to 6
0709 14:51:45.611486 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:45.611619 (+   133us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:51:48.359099 (+2747480us) raft_consensus.cc:1685] finished
0709 14:51:48.359287 (+   188us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:51:48.359742 (+   455us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":442,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":13603,"spinlock_wait_cycles":3401472,"thread_start_us":189421,"threads_started":1,"wal-append.queue_time_us":332087,"wal-append.run_cpu_time_us":25596,"wal-append.run_wall_time_us":2466990}
W20260709 14:51:49.568276  7820 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 3.903s	user 0.039s	sys 0.082s
W20260709 14:51:48.645589  7778 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37136 (request call id 2105) took 2960 ms (client timeout 2236 ms). Trace:
I20260709 14:51:48.750461  6549 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 14:51:49.570433  7778 rpcz_store.cc:269] 0709 14:51:45.684869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:48.645173 (+2960304us) service_pool.cc:211] Skipping call since client already timed out
0709 14:51:48.645380 (+   207us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 14:51:49.573055  7778 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 2354) took 3980 ms. Trace:
I20260709 14:51:49.573580  7778 rpcz_store.cc:276] 0709 14:51:45.592534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:49.571987 (+3979453us) service_pool.cc:224] Handling call
0709 14:51:49.572491 (+   504us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:51:49.572693 (+   202us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:51:49.572718 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:51:49.572761 (+    43us) raft_consensus.cc:1645] Marking committed up to 6
0709 14:51:49.572806 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:49.572861 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:51:49.572987 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 14:51:49.570744  7770 raft_consensus.cc:1275] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 14:51:49.576738  7777 raft_consensus.cc:2468] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 6.
W20260709 14:51:46.684506  7891 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.992s	user 0.006s	sys 0.019s
W20260709 14:51:49.578194  7891 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 3.900s	user 0.008s	sys 0.019s
W20260709 14:51:46.890070  7892 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.238s	user 0.015s	sys 0.010s
W20260709 14:51:49.582195  7892 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 3.943s	user 0.016s	sys 0.010s
W20260709 14:51:46.937222  7893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:51:46.943574  7894 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.298s	user 0.044s	sys 0.042s
W20260709 14:51:46.944736  7919 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.176s	user 0.012s	sys 0.008s
W20260709 14:51:46.968499  7923 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.159s	user 0.014s	sys 0.007s
I20260709 14:51:46.702150  7922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38516 (request call id 2098) took 1291 ms. Trace:
I20260709 14:51:49.601366  7922 rpcz_store.cc:276] 0709 14:51:45.410619 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:45.411613 (+   994us) service_pool.cc:224] Handling call
0709 14:51:45.411966 (+   353us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:51:45.792152 (+380186us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:46.700960 (+908808us) spinlock_profiling.cc:243] Waited 379 ms on lock 0x7b54000cc454. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae8ee01 00007fb68ae8d83e 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2 00007fb6891c948c 00007fb6891c88c6
0709 14:51:46.701823 (+   863us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":872633088}
I20260709 14:51:46.947150  7925 raft_consensus.cc:2393] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 5: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
W20260709 14:51:47.878897  8661 debug-util.cc:398] Leaking SignalData structure 0x7b08002e78e0 after lost signal to thread 6552
W20260709 14:51:49.607906  7919 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 3.841s	user 0.014s	sys 0.009s
W20260709 14:51:49.608562  8661 debug-util.cc:398] Leaking SignalData structure 0x7b08002e7a80 after lost signal to thread 7711
W20260709 14:51:49.605123  7925 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38532 (request call id 2801) took 4081 ms (client timeout 3342 ms). Trace:
I20260709 14:51:46.007248 10405 raft_consensus.cc:515] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:46.053002 10448 leader_election.cc:290] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 9 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:48.321084 10436 leader_election.cc:290] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 9 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:51:48.358289 10524 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.439s	user 0.016s	sys 0.016s
I20260709 14:51:46.062314 10531 raft_consensus.cc:515] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:46.512867 10563 leader_election.cc:290] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:51:46.081265 10571 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.632s	user 0.018s	sys 0.000s
I20260709 14:51:49.644047 10531 leader_election.cc:290] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 6 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:51:49.644980 10571 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 4.195s	user 0.020s	sys 0.000s
W20260709 14:51:46.044493 10582 consensus_meta.cc:287] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent flushing consensus metadata: real 0.548s	user 0.010s	sys 0.001s
I20260709 14:51:49.635577 10405 leader_election.cc:290] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:51:46.968958 10600 log.cc:927] Time spent T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 1.021s	user 0.007s	sys 0.003s
I20260709 14:51:49.631601 10644 raft_consensus.cc:493] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:51:49.235407 10597 log.cc:927] Time spent T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 3.517s	user 0.037s	sys 0.023s
I20260709 14:51:46.962831 10617 raft_consensus.cc:515] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:49.350347  7771 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37136 (request call id 2102) took 3669 ms (client timeout 2328 ms). Trace:
W20260709 14:51:46.988061  7819 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 1.312s	user 0.008s	sys 0.014s
I20260709 14:51:48.376756 10628 raft_consensus.cc:493] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:49.662174 10617 leader_election.cc:290] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:49.663547 10628 raft_consensus.cc:515] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:49.420761 10627 leader_election.cc:290] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68:42321)
I20260709 14:51:49.424816 10630 raft_consensus.cc:515] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:49.665717 10646 raft_consensus.cc:493] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:49.666895 10646 raft_consensus.cc:515] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:49.667538 10630 leader_election.cc:290] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:49.424835 10631 raft_consensus.cc:515] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:49.430562 10536 raft_consensus.cc:515] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:49.432688 10632 leader_election.cc:290] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:49.669339  7921 raft_consensus.cc:2393] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 11: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:51:49.670223 10631 leader_election.cc:290] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:51:49.428916  7949 debug-util.cc:398] Leaking SignalData structure 0x7b08002875a0 after lost signal to thread 6552
W20260709 14:51:49.671414  7921 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38532 (request call id 2802) took 4147 ms (client timeout 2506 ms). Trace:
I20260709 14:51:49.420776 10626 leader_election.cc:290] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:49.432905 10634 leader_election.cc:290] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:49.432839 10624 leader_election.cc:290] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:49.671777 10628 leader_election.cc:290] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:49.435420 10633 leader_election.cc:290] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:51:49.505693  7742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:49.515681  7774 raft_consensus.cc:2468] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 10.
I20260709 14:51:49.504742  7745 leader_election.cc:304] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:49.519200 10635 raft_consensus.cc:493] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9418391fa82a42c79c6cad13ba91d964)
I20260709 14:51:49.523240 10636 raft_consensus.cc:493] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:49.524039  8639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18d29d52d304c87b930d4fb5eaf50b1" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9418391fa82a42c79c6cad13ba91d964" is_pre_election: true
I20260709 14:51:49.533403 10637 raft_consensus.cc:493] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:46.969810  7776 rpcz_store.cc:276] 0709 14:51:45.592154 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:46.065164 (+473010us) service_pool.cc:224] Handling call
0709 14:51:46.968103 (+902939us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 14:51:49.536185  7775 rpcz_store.cc:269] 0709 14:51:45.692241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:46.044709 (+352468us) service_pool.cc:224] Handling call
0709 14:51:49.535463 (+3490754us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 14:51:49.545032  7772 raft_consensus.cc:1275] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 6. (term mismatch)
I20260709 14:51:49.546561 10638 raft_consensus.cc:493] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
W20260709 14:51:49.552778  7744 connection.cc:256] RPC call timeout handler was delayed by -2.5356299080000326s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20190000000000002s for a response
I20260709 14:51:49.685472  7772 pending_rounds.cc:85] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed: Aborting all ops after (but not including) 5
I20260709 14:51:49.563246  7779 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 2351) took 3979 ms. Trace:
I20260709 14:51:49.564064  7773 raft_consensus.cc:3060] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Advancing to term 10
W20260709 14:51:49.685979  7744 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.101.67:40785 timed out after 1.599s (SENT) [suppressed 8 similar messages]
I20260709 14:51:49.685796 10638 raft_consensus.cc:515] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:49.564201  7675 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54350 (request call id 369) took 9442 ms. Trace:
I20260709 14:51:49.577026  7770 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 2352) took 3988 ms. Trace:
W20260709 14:51:49.577342  7777 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37144 (request call id 2356) took 3898 ms (client timeout 2112 ms). Trace:
I20260709 14:51:49.670523 10536 leader_election.cc:290] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 11 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:49.596174  7676 catalog_manager.cc:5697] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 4 to 6, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 6 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
W20260709 14:51:49.612232  7894 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 3.967s	user 0.045s	sys 0.046s
W20260709 14:51:49.609019  7925 rpcz_store.cc:269] 0709 14:51:45.523823 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:45.874305 (+350482us) service_pool.cc:224] Handling call
0709 14:51:49.604996 (+3730691us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 14:51:49.614295  8661 debug-util.cc:398] Leaking SignalData structure 0x7b0800251f40 after lost signal to thread 7803
I20260709 14:51:49.619834  7778 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 2357) took 3940 ms. Trace:
I20260709 14:51:49.629832 10645 raft_consensus.cc:493] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:49.630326  7919 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38532 (request call id 2792) took 4128 ms. Trace:
I20260709 14:51:49.639360 10436 raft_consensus.cc:493] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:51:49.640497 10524 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 3.729s	user 0.018s	sys 0.018s
I20260709 14:51:49.645041 10640 raft_consensus.cc:493] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
W20260709 14:51:49.703840  7744 connection.cc:256] RPC call timeout handler was delayed by -2.2277835930000265s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1805s for a response
I20260709 14:51:49.703536 10640 raft_consensus.cc:515] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:49.646479  7923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38532 (request call id 2793) took 4144 ms. Trace:
W20260709 14:51:49.704295  7744 connection.cc:256] RPC call timeout handler was delayed by -2.0346472669999685s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2506s for a response
I20260709 14:51:49.648504 10582 raft_consensus.cc:2749] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 14:51:49.704633  7744 connection.cc:256] RPC call timeout handler was delayed by -1.716629907999959s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2929s for a response
I20260709 14:51:46.051805 10586 leader_election.cc:290] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 8 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:49.654274 10644 raft_consensus.cc:515] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:49.657857  7771 rpcz_store.cc:269] 0709 14:51:45.680872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:49.349960 (+3669088us) service_pool.cc:211] Skipping call since client already timed out
0709 14:51:49.350148 (+   188us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 14:51:49.657488 10571 raft_consensus.cc:493] T 9ce9c0ef2db24c13a8b1402f21819458 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9418391fa82a42c79c6cad13ba91d964)
W20260709 14:51:49.660322  7893 connection.cc:256] RPC call timeout handler was delayed by -2.7111493659999724s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15000000000000002s for a response
W20260709 14:51:49.711751  7893 connection.cc:256] RPC call timeout handler was delayed by -2.4906493659999569s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17450000000000002s for a response
W20260709 14:51:49.712172  7893 connection.cc:256] RPC call timeout handler was delayed by -2.4627493660000255s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1776s for a response
W20260709 14:51:49.712463  7893 connection.cc:256] RPC call timeout handler was delayed by -2.3808493660000067s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1867s for a response
W20260709 14:51:49.671972  7949 debug-util.cc:398] Leaking SignalData structure 0x7b08002c26c0 after lost signal to thread 7711
W20260709 14:51:49.676360  7819 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 4.000s	user 0.012s	sys 0.014s
W20260709 14:51:49.671862  7921 rpcz_store.cc:269] 0709 14:51:45.524120 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:45.695207 (+171087us) service_pool.cc:224] Handling call
0709 14:51:49.671142 (+3975935us) spinlock_profiling.cc:243] Waited 3.95 s on lock 0x7b540041dcd4. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae922fa 00007fb68fe53b17 00007fb6893ce6d4 00007fb6893ce662 00007fb6893ce591 00007fb6893ce50c 00007fb6893cd7c2 00007fb6891c948c 00007fb6891c88c6 00007fb6891c826f
0709 14:51:49.671323 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9083839232}
I20260709 14:51:49.712745  7773 raft_consensus.cc:2468] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 10.
I20260709 14:51:49.682320 10636 raft_consensus.cc:515] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:49.581346 10641 raft_consensus.cc:493] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:49.689752  7775 raft_consensus.cc:1240] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 9. Current term is 10. Ops: []
I20260709 14:51:49.690716  7770 rpcz_store.cc:276] 0709 14:51:45.589091 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:49.568607 (+3979516us) service_pool.cc:224] Handling call
0709 14:51:49.570228 (+  1621us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:51:49.576729 (+  6501us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:49.576966 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 14:51:49.717275  7775 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37136 (request call id 2103) took 4036 ms. Trace:
W20260709 14:51:49.693634  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:49.686276  7779 rpcz_store.cc:276] 0709 14:51:45.583732 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:49.552651 (+3968919us) service_pool.cc:224] Handling call
0709 14:51:49.553927 (+  1276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:51:49.562523 (+  8596us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:51:49.562581 (+    58us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:51:49.562685 (+   104us) raft_consensus.cc:1645] Marking committed up to 3
0709 14:51:49.562773 (+    88us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:49.562954 (+   181us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:51:49.563143 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9371,"raft.run_cpu_time_us":218,"raft.run_wall_time_us":220,"thread_start_us":7876,"threads_started":1}
I20260709 14:51:49.717725  7775 rpcz_store.cc:276] 0709 14:51:45.681143 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:49.684923 (+4003780us) service_pool.cc:224] Handling call
0709 14:51:49.689554 (+  4631us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:51:49.716805 (+ 27251us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:49.717115 (+   310us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 14:51:49.718497 10636 leader_election.cc:290] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:51:49.702751  8661 debug-util.cc:398] Leaking SignalData structure 0x7b0800048c80 after lost signal to thread 7878
I20260709 14:51:49.695238  7919 rpcz_store.cc:276] 0709 14:51:45.501827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:45.501975 (+   148us) service_pool.cc:224] Handling call
0709 14:51:45.502211 (+   236us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:51:45.502455 (+   244us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 14:51:45.766189 (+263734us) log.cc:844] Serialized 14 byte log entry
0709 14:51:49.629470 (+3863281us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:51:49.629573 (+   103us) raft_consensus.cc:1645] Marking committed up to 5
0709 14:51:49.629614 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:49.629738 (+   124us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:51:49.630191 (+   453us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":284665,"prepare.run_cpu_time_us":147,"prepare.run_wall_time_us":12924,"raft.queue_time_us":21469,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":105,"thread_start_us":4110832,"threads_started":3,"wal-append.queue_time_us":304621,"wal-append.run_cpu_time_us":2542,"wal-append.run_wall_time_us":1002687}
I20260709 14:51:49.705865  7926 raft_consensus.cc:1240] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 6. Current term is 7. Ops: []
I20260709 14:51:49.706265 10624 raft_consensus.cc:2804] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader election won for term 7
W20260709 14:51:49.705070  7744 connection.cc:256] RPC call timeout handler was delayed by -1.3436922189999905s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.33420000000000005s for a response
W20260709 14:51:49.680773  7774 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37144 (request call id 2348) took 4110 ms (client timeout 2005 ms). Trace:
W20260709 14:51:49.719264  8661 debug-util.cc:398] Leaking SignalData structure 0x7b0800227160 after lost signal to thread 7879
W20260709 14:51:49.724887  8661 debug-util.cc:398] Leaking SignalData structure 0x7b0800217640 after lost signal to thread 7952
I20260709 14:51:49.726732  7926 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38516 (request call id 2094) took 4318 ms. Trace:
W20260709 14:51:49.727237  7774 rpcz_store.cc:269] 0709 14:51:45.570273 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:46.042312 (+472039us) service_pool.cc:224] Handling call
0709 14:51:49.678530 (+3636218us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 14:51:49.727722  7926 rpcz_store.cc:276] 0709 14:51:45.408570 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:45.409497 (+   927us) service_pool.cc:224] Handling call
0709 14:51:45.526562 (+117065us) spinlock_profiling.cc:243] Waited 1.46 ms on lock 0x7b5800200198. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb687c29db1 00007fb687d69f8c 00007fb687d69ef6 000000000037fce9 00007fb68fddd1e0 00007fb68fea60c4 00007fb68fea6131 00007fb68fe67fc0 00007fb68fe52929 00007fb68fe523d2 00007fb6893c9bd4
0709 14:51:45.526762 (+   200us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:51:49.724321 (+4197559us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:49.726214 (+  1893us) spinlock_profiling.cc:243] Waited 4.18 s on lock 0x7b5400131fd4. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae8ee01 00007fb68ae8d83e 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2 00007fb6891c948c 00007fb6891c88c6
0709 14:51:49.726576 (+   362us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9614226304}
I20260709 14:51:49.729426  7774 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47054 (request call id 162) took 3948 ms. Trace:
I20260709 14:51:49.729840  7774 rpcz_store.cc:276] 0709 14:51:45.790283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:49.728347 (+3938064us) service_pool.cc:224] Handling call
0709 14:51:49.728799 (+   452us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:51:49.729063 (+   264us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:51:49.729090 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:51:49.729136 (+    46us) raft_consensus.cc:1645] Marking committed up to 6
0709 14:51:49.729170 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:49.729233 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:51:49.729368 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 14:51:49.731168  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:49.732834  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:49.734023  7744 leader_election.cc:304] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
W20260709 14:51:49.726928  8661 debug-util.cc:398] Leaking SignalData structure 0x7b08001c2d00 after lost signal to thread 8664
I20260709 14:51:49.734995  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:49.735661  7774 raft_consensus.cc:3060] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:51:49.740231 10652 raft_consensus.cc:493] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:49.739953 10436 raft_consensus.cc:515] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:49.740926 10652 raft_consensus.cc:515] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:49.742898 10436 leader_election.cc:290] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:49.743305 10638 leader_election.cc:290] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:51:49.744189  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 4.06839e+06us
I20260709 14:51:49.708451  7676 catalog_manager.cc:5697] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 8 to 9, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 9 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:51:49.746889 10640 leader_election.cc:290] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:49.704480  7923 rpcz_store.cc:276] 0709 14:51:45.502132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:45.502265 (+   133us) service_pool.cc:224] Handling call
0709 14:51:45.506289 (+  4024us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:51:45.506534 (+   245us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 14:51:45.809665 (+303131us) log.cc:844] Serialized 14 byte log entry
0709 14:51:49.620718 (+3811053us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:51:49.629211 (+  8493us) raft_consensus.cc:1645] Marking committed up to 2
0709 14:51:49.630899 (+  1688us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:49.646189 (+ 15290us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:51:49.646408 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11917,"prepare.queue_time_us":327248,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":52,"raft.queue_time_us":29147,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":160,"thread_start_us":4085038,"threads_started":3,"wal-append.queue_time_us":261246,"wal-append.run_cpu_time_us":2272,"wal-append.run_wall_time_us":1002642}
I20260709 14:51:49.747229  7676 catalog_manager.cc:5697] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 6 to 7, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 7 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:51:49.748585 10571 raft_consensus.cc:515] T 9ce9c0ef2db24c13a8b1402f21819458 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:51:49.750092 10586 raft_consensus.cc:493] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:49.750792 10586 raft_consensus.cc:515] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:49.685876  7772 pending_rounds.cc:107] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed: Aborting uncommitted NO_OP operation due to leader change: 7.6
W20260709 14:51:49.712849  7893 connection.cc:256] RPC call timeout handler was delayed by -2.2566493660000333s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2005s for a response
I20260709 14:51:49.716799 10641 raft_consensus.cc:515] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:49.687611  7777 rpcz_store.cc:269] 0709 14:51:45.679229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:46.914338 (+1235109us) service_pool.cc:224] Handling call
0709 14:51:49.577235 (+2662897us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 14:51:49.694957  7778 rpcz_store.cc:276] 0709 14:51:45.679668 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:49.574850 (+3895182us) service_pool.cc:224] Handling call
0709 14:51:49.575282 (+   432us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:51:49.575505 (+   223us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 14:51:49.583622 (+  8117us) log.cc:844] Serialized 14 byte log entry
0709 14:51:49.619294 (+ 35672us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:51:49.619371 (+    77us) raft_consensus.cc:1645] Marking committed up to 7
0709 14:51:49.619430 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:49.619510 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:51:49.619688 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":48546,"prepare.run_cpu_time_us":86,"prepare.run_wall_time_us":3065,"raft.queue_time_us":5347,"raft.run_cpu_time_us":326,"raft.run_wall_time_us":793,"thread_start_us":37516,"threads_started":2,"wal-append.queue_time_us":31447}
I20260709 14:51:49.757077  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
W20260709 14:51:49.751418  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:51:49.714560  7949 debug-util.cc:398] Leaking SignalData structure 0x7b08002dedc0 after lost signal to thread 7803
I20260709 14:51:49.758894  7772 raft_consensus.cc:2889] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 14:51:49.759527  7949 debug-util.cc:398] Leaking SignalData structure 0x7b08002b6d80 after lost signal to thread 7878
I20260709 14:51:49.760042  7774 raft_consensus.cc:2468] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 9.
W20260709 14:51:49.701376  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 4.05632e+06us
W20260709 14:51:49.753834  7893 connection.cc:256] RPC call timeout handler was delayed by -2.2080493659999547s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20590000000000003s for a response
W20260709 14:51:49.760315  7949 debug-util.cc:398] Leaking SignalData structure 0x7b08002b6d00 after lost signal to thread 7879
I20260709 14:51:49.757503  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
W20260709 14:51:49.714157  7773 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37136 (request call id 2108) took 4021 ms (client timeout 2119 ms). Trace:
W20260709 14:51:49.762431  7949 debug-util.cc:398] Leaking SignalData structure 0x7b0800143200 after lost signal to thread 7952
I20260709 14:51:49.752014  7676 catalog_manager.cc:5697] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 8 to 9, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 9 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:51:49.757901 10524 raft_consensus.cc:493] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:49.751282 10571 leader_election.cc:290] T 9ce9c0ef2db24c13a8b1402f21819458 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68:42321)
W20260709 14:51:49.761858  7773 rpcz_store.cc:269] 0709 14:51:45.692521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:46.939879 (+1247358us) service_pool.cc:224] Handling call
0709 14:51:49.714064 (+2774185us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 14:51:49.743707 10652 leader_election.cc:290] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:49.765693  7778 raft_consensus.cc:3060] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Advancing to term 8
W20260709 14:51:49.765662  7893 connection.cc:256] RPC call timeout handler was delayed by -2.1603493659999913s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21120000000000003s for a response
I20260709 14:51:49.751107 10644 leader_election.cc:290] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:51:49.773540  7893 connection.cc:256] RPC call timeout handler was delayed by -2.0667493659999536s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22160000000000002s for a response
I20260709 14:51:49.773394  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:49.774389  7774 raft_consensus.cc:3060] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Advancing to term 9
W20260709 14:51:49.765228  7949 debug-util.cc:398] Leaking SignalData structure 0x7b08002caae0 after lost signal to thread 8664
W20260709 14:51:49.776091  7949 debug-util.cc:398] Leaking SignalData structure 0x7b0800174000 after lost signal to thread 8665
I20260709 14:51:49.715839 10617 raft_consensus.cc:493] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
W20260709 14:51:49.776795  7949 debug-util.cc:398] Leaking SignalData structure 0x7b0800130300 after lost signal to thread 10405
I20260709 14:51:49.780304  7676 catalog_manager.cc:5697] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 4 to 5, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 5 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:51:49.799515  7893 leader_election.cc:304] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:49.800629 10649 raft_consensus.cc:493] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:49.801473 10649 raft_consensus.cc:515] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:49.802273 10644 raft_consensus.cc:2749] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 14:51:49.803545  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 69628.2us
W20260709 14:51:49.804262  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 299704us
W20260709 14:51:49.805387  7949 debug-util.cc:398] Leaking SignalData structure 0x7b080038a220 after lost signal to thread 10448
I20260709 14:51:49.686261 10635 raft_consensus.cc:515] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:51:49.755517 10563 raft_consensus.cc:493] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:49.801685 10624 raft_consensus.cc:697] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
W20260709 14:51:49.806613  7949 debug-util.cc:398] Leaking SignalData structure 0x7b0800320980 after lost signal to thread 10531
I20260709 14:51:49.758064 10640 raft_consensus.cc:493] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:49.685292 10637 raft_consensus.cc:515] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:49.814021  7772 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 2349) took 4232 ms. Trace:
W20260709 14:51:49.818888  7949 debug-util.cc:398] Leaking SignalData structure 0x7b08003600e0 after lost signal to thread 10563
I20260709 14:51:49.822208  7774 raft_consensus.cc:2468] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 9.
W20260709 14:51:49.824640  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 52225us
W20260709 14:51:49.826642  7949 debug-util.cc:398] Leaking SignalData structure 0x7b08002f4300 after lost signal to thread 10571
I20260709 14:51:49.826238  7772 rpcz_store.cc:276] 0709 14:51:45.574522 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:49.543519 (+3968997us) service_pool.cc:224] Handling call
0709 14:51:49.544338 (+   819us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:51:49.787061 (+242723us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:49.806929 (+ 19868us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 14:51:49.827210  7949 debug-util.cc:398] Leaking SignalData structure 0x7b080038af20 after lost signal to thread 10582
W20260709 14:51:49.827605  7949 debug-util.cc:398] Leaking SignalData structure 0x7b080038aea0 after lost signal to thread 10586
I20260709 14:51:49.788385  7676 catalog_manager.cc:5697] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 2 to 3, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 3 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:51:49.775671 10646 leader_election.cc:290] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:49.832544  7676 catalog_manager.cc:5697] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:51:49.768103 10636 raft_consensus.cc:493] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:49.841141  7745 leader_election.cc:304] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:49.776595 10436 raft_consensus.cc:493] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:49.809968 10638 raft_consensus.cc:493] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:49.763692 10524 raft_consensus.cc:515] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:49.836899  7676 catalog_manager.cc:5697] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:51:49.845144 10655 raft_consensus.cc:2804] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader election won for term 7
I20260709 14:51:49.827164 10644 raft_consensus.cc:493] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:51:49.858125 10624 consensus_queue.cc:237] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:49.859426 10586 leader_election.cc:290] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:49.687345  7675 rpcz_store.cc:276] 0709 14:51:40.111016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:40.123088 (+ 12072us) service_pool.cc:224] Handling call
0709 14:51:49.553115 (+9430027us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 14:51:43.417895 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 14:51:43.524121 (+106226us) write_op.cc:432] Acquiring schema lock in shared mode
0709 14:51:43.526547 (+  2426us) write_op.cc:435] Acquired schema lock
0709 14:51:43.528856 (+  2309us) tablet.cc:662] Decoding operations
0709 14:51:43.643141 (+114285us) write_op.cc:620] Acquiring the partition lock for write op
0709 14:51:43.643342 (+   201us) write_op.cc:641] Partition lock acquired for write op
0709 14:51:43.643376 (+    34us) tablet.cc:685] Acquiring locks for 15 operations
0709 14:51:43.644451 (+  1075us) tablet.cc:701] Row locks acquired
0709 14:51:43.644472 (+    21us) write_op.cc:260] PREPARE: finished
0709 14:51:43.644650 (+   178us) write_op.cc:270] Start()
0709 14:51:43.644783 (+   133us) write_op.cc:276] Timestamp: P: 1783608703644586 usec, L: 0
0709 14:51:43.644803 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 14:51:43.724922 (+ 80119us) log.cc:844] Serialized 5929 byte log entry
0709 14:51:44.825174 (+1100252us) spinlock_profiling.cc:243] Waited 24.9 ms on lock 0x7b4400022b4c. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb687c29db1 00007fb687cc7c85 00007fb687cc86a2 00007fb68aa3a1db 00007fb68aa35aaf 00007fb68aa2986e 00007fb68aa28bb6 00007fb68aa287d8 00007fb68aa32221 00007fb68aa321d9 00007fb68aa32169
0709 14:51:45.177558 (+352384us) op_driver.cc:464] REPLICATION: finished
0709 14:51:45.359514 (+181956us) write_op.cc:301] APPLY: starting
0709 14:51:45.360830 (+  1316us) tablet.cc:1367] starting BulkCheckPresence
0709 14:51:45.369754 (+  8924us) tablet.cc:1370] finished BulkCheckPresence
0709 14:51:45.369782 (+    28us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 14:51:45.396082 (+ 26300us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 14:51:45.396415 (+   333us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=15
0709 14:51:45.396462 (+    47us) write_op.cc:312] APPLY: finished
0709 14:51:45.397172 (+   710us) log.cc:844] Serialized 107 byte log entry
0709 14:51:45.478854 (+ 81682us) write_op.cc:489] Releasing partition, row and schema locks
0709 14:51:45.483770 (+  4916us) write_op.cc:454] Released schema lock
0709 14:51:45.483859 (+    89us) write_op.cc:341] FINISH: Updating metrics
0709 14:51:45.495791 (+ 11932us) write_op.cc:489] Releasing partition, row and schema locks
0709 14:51:45.495826 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":539533,"reported_tablets":26,"child_traces":[["op",{"apply.queue_time_us":181642,"apply.run_cpu_time_us":9066,"apply.run_wall_time_us":134286,"num_ops":15,"prepare.queue_time_us":293246,"prepare.run_cpu_time_us":96646,"prepare.run_wall_time_us":642124,"raft.queue_time_us":156810,"raft.run_cpu_time_us":45927,"raft.run_wall_time_us":137773,"replication_time_us":1532353,"spinlock_wait_cycles":57300352,"thread_start_us":690038,"threads_started":4,"wal-append.queue_time_us":704552,"wal-append.run_cpu_time_us":18934,"wal-append.run_wall_time_us":1977939}]]}
I20260709 14:51:49.860378  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:49.861528  7845 raft_consensus.cc:2393] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 9: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:51:49.751816 10645 raft_consensus.cc:515] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:49.811301 10617 raft_consensus.cc:515] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:49.862131  7893 leader_election.cc:304] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:49.871093  7773 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47054 (request call id 163) took 4017 ms. Trace:
I20260709 14:51:49.871654  7773 rpcz_store.cc:276] 0709 14:51:45.846178 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:49.809461 (+3963283us) service_pool.cc:224] Handling call
0709 14:51:49.837529 (+ 28068us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:51:49.842484 (+  4955us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:51:49.842523 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:51:49.842579 (+    56us) raft_consensus.cc:1645] Marking committed up to 6
0709 14:51:49.843286 (+   707us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:49.863004 (+ 19718us) spinlock_profiling.cc:243] Waited 4.66 ms on lock 0x7b5400323f54. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae8ee01 00007fb68ae8d83e 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2 00007fb6891c948c 00007fb6891c88c6
0709 14:51:49.863059 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:51:49.863225 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10720512}
W20260709 14:51:49.880002  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 74967.1us
I20260709 14:51:49.851802 10633 raft_consensus.cc:493] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:49.855329 10634 raft_consensus.cc:493] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:49.888597 10651 raft_consensus.cc:493] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:49.891024 10536 raft_consensus.cc:2749] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 14:51:49.859486 10524 leader_election.cc:290] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:49.855758 10638 raft_consensus.cc:515] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:49.910390  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 76248.9us
I20260709 14:51:49.892014 10436 raft_consensus.cc:515] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:49.893003 10637 leader_election.cc:290] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:51:49.894276  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 60359.2us
I20260709 14:51:49.859740 10654 raft_consensus.cc:493] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9418391fa82a42c79c6cad13ba91d964)
I20260709 14:51:49.832711 10563 raft_consensus.cc:515] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:49.841307 10640 raft_consensus.cc:515] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:49.865928 10641 leader_election.cc:290] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:49.891324 10639 raft_consensus.cc:493] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:49.866253 10644 raft_consensus.cc:515] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:49.894665 10649 leader_election.cc:290] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:49.923126  7773 raft_consensus.cc:1240] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 7. Current term is 8. Ops: []
I20260709 14:51:49.866237 10636 raft_consensus.cc:515] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:49.910778  8639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce9c0ef2db24c13a8b1402f21819458" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9418391fa82a42c79c6cad13ba91d964" is_pre_election: true
I20260709 14:51:49.932248  7850 raft_consensus.cc:1240] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 14:51:49.893344 10648 consensus_queue.cc:1059] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.084s
W20260709 14:51:49.941596  8599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 109587us
I20260709 14:51:49.924481 10626 raft_consensus.cc:493] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:51:49.918102 10633 raft_consensus.cc:515] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:49.949424  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:49.950815 10563 leader_election.cc:290] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:49.910666 10651 raft_consensus.cc:515] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:49.953377 10638 leader_election.cc:290] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:49.952690  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:49.922147 10634 raft_consensus.cc:515] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:49.991180  7778 raft_consensus.cc:2468] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 8.
I20260709 14:51:49.993681  7745 leader_election.cc:304] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:49.995332 10660 raft_consensus.cc:2749] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 14:51:49.927551 10524 consensus_queue.cc:1048] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 14:51:49.973287  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:49.937603 10639 raft_consensus.cc:515] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:50.014154  7847 raft_consensus.cc:2393] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 8: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:51:50.014277  7849 raft_consensus.cc:2410] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 14:51:49.976766 10651 leader_election.cc:290] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:49.922148 10654 raft_consensus.cc:515] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:51:50.022871 10635 leader_election.cc:290] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68:42321)
I20260709 14:51:50.026870  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
W20260709 14:51:50.024021  8598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 65840.3us
I20260709 14:51:50.027185  7850 raft_consensus.cc:2393] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 6: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:51:49.956616 10626 raft_consensus.cc:515] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:49.948488 10536 consensus_queue.cc:1048] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.069s
I20260709 14:51:50.008283 10436 leader_election.cc:290] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:50.014667 10638 consensus_queue.cc:1059] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 14:51:50.004500 10634 leader_election.cc:290] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:50.032238  7893 leader_election.cc:304] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:51:50.037565  7845 raft_consensus.cc:3060] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:51:50.045701  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:50.054029  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258d6c2dda954bf5b65930fde8ecb9f3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:50.057451  7776 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 2358) took 4377 ms. Trace:
W20260709 14:51:50.039884  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 45355.8us
W20260709 14:51:50.054930  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 105852us
W20260709 14:51:50.082626  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 67326.4us
I20260709 14:51:50.056775  7745 leader_election.cc:304] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:50.055991  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:51:50.042697 10661 log.cc:927] Time spent T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.130s	user 0.000s	sys 0.003s
I20260709 14:51:50.056708 10649 raft_consensus.cc:3055] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 LEADER]: Stepping down as leader of term 9
I20260709 14:51:50.045467  8639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9441e831627143a991a1556dcdce71e3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9418391fa82a42c79c6cad13ba91d964" is_pre_election: true
I20260709 14:51:50.004683 10645 leader_election.cc:290] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:50.024178 10636 leader_election.cc:290] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:50.048105 10626 leader_election.cc:290] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:50.050145 10640 leader_election.cc:290] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:50.056466 10651 raft_consensus.cc:2804] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 14:51:50.051985 10644 leader_election.cc:290] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:50.054908 10656 raft_consensus.cc:3055] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 LEADER]: Stepping down as leader of term 7
I20260709 14:51:50.049268 10633 leader_election.cc:290] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:50.080178 10655 raft_consensus.cc:697] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:51:50.037226 10639 leader_election.cc:290] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:50.049470 10617 leader_election.cc:290] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:50.074494  7776 rpcz_store.cc:276] 0709 14:51:45.679975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:49.684873 (+4004898us) service_pool.cc:224] Handling call
0709 14:51:49.706863 (+ 21990us) spinlock_profiling.cc:243] Waited 1.66 ms on lock 0x7b5800002a98. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb687c29db1 00007fb687d69b71 00007fb687d69a22 00007fb690c82c09 00007fb68fddcee0 00007fb68fea60ab 00007fb68fea6131 00007fb68fe67fc0 00007fb68fe52929 00007fb68fe523d2 00007fb6893c9bd4
0709 14:51:49.707155 (+   292us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:51:49.813934 (+106779us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:51:49.813966 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:51:49.848210 (+ 34244us) log.cc:844] Serialized 26 byte log entry
0709 14:51:49.947382 (+ 99172us) raft_consensus.cc:1645] Marking committed up to 5
0709 14:51:49.947431 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:49.947520 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:51:50.056778 (+109258us) raft_consensus.cc:1685] finished
0709 14:51:50.056803 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:51:50.057359 (+   556us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4011,"raft.queue_time_us":91723,"raft.run_cpu_time_us":270,"raft.run_wall_time_us":270,"spinlock_wait_cycles":3807616,"thread_start_us":101165,"threads_started":2,"wal-append.queue_time_us":131195}
I20260709 14:51:50.121073 10655 consensus_queue.cc:237] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:50.052870  7925 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
mode: GRACEFUL
new_leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:48676
I20260709 14:51:50.125020  7925 raft_consensus.cc:606] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Received request to transfer leadership to TS 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:51:50.125583  7925 raft_consensus.cc:614] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 14:51:50.126304  8637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce9c0ef2db24c13a8b1402f21819458" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9418391fa82a42c79c6cad13ba91d964" is_pre_election: true
I20260709 14:51:50.037931 10658 raft_consensus.cc:2749] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 14:51:50.051743 10654 leader_election.cc:290] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785), 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68:42321)
I20260709 14:51:50.113401  7893 leader_election.cc:304] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:50.131695 10536 raft_consensus.cc:2749] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 14:51:50.112414  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:50.119282  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:50.134618  7850 raft_consensus.cc:2410] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 14:51:50.103881 10649 raft_consensus.cc:740] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:51:50.039651 10650 consensus_queue.cc:1059] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.072s
I20260709 14:51:50.135425  7846 raft_consensus.cc:2410] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for term 9 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 14:51:50.140688  7925 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
mode: GRACEFUL
new_leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:48676
W20260709 14:51:50.141212  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:50.145818 10675 raft_consensus.cc:2804] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 14:51:50.146698 10675 raft_consensus.cc:493] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:50.147416 10675 raft_consensus.cc:3060] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:51:50.145076  7925 raft_consensus.cc:606] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Received request to transfer leadership to TS 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:50.150213  7925 raft_consensus.cc:614] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 14:51:50.158458 10662 log.cc:927] Time spent T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 14:51:50.158685  7771 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37136 (request call id 2109) took 4465 ms. Trace:
I20260709 14:51:50.159196  7771 rpcz_store.cc:276] 0709 14:51:45.692784 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:49.743556 (+4050772us) service_pool.cc:224] Handling call
0709 14:51:49.744163 (+   607us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:51:49.813683 (+ 69520us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:51:49.813719 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:51:49.861191 (+ 47472us) log.cc:844] Serialized 26 byte log entry
0709 14:51:49.878386 (+ 17195us) raft_consensus.cc:1645] Marking committed up to 6
0709 14:51:49.878444 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:49.878557 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:51:50.041420 (+162863us) spinlock_profiling.cc:243] Waited 6.66 ms on lock 0x7b4400022b4c. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb687c29db1 00007fb687cc7c85 00007fb687cc86a2 00007fb68aa3a1db 00007fb68aa35aaf 00007fb68aa2986e 00007fb68aa28bb6 00007fb68aa287d8 00007fb68aa32221 00007fb68aa321d9 00007fb68aa32169
0709 14:51:50.158182 (+116762us) raft_consensus.cc:1685] finished
0709 14:51:50.158214 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:51:50.158585 (+   371us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":61007,"raft.queue_time_us":150407,"raft.run_cpu_time_us":187,"raft.run_wall_time_us":190,"spinlock_wait_cycles":15310720,"thread_start_us":16583,"threads_started":1,"wal-append.queue_time_us":17010}
I20260709 14:51:50.116098 10651 raft_consensus.cc:493] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 14:51:50.162580 10669 log.cc:927] Time spent T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.104s	user 0.001s	sys 0.001s
I20260709 14:51:50.164357  7846 raft_consensus.cc:1240] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 7. Current term is 8. Ops: []
I20260709 14:51:50.133371 10656 raft_consensus.cc:740] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:51:50.166036  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:50.167546 10656 consensus_queue.cc:260] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:50.169940  7845 raft_consensus.cc:2468] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 7.
I20260709 14:51:50.162827 10651 raft_consensus.cc:3060] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:51:50.173410 10639 raft_consensus.cc:493] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:50.169987  7850 raft_consensus.cc:1275] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 14:51:50.174803  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 64290.5us
I20260709 14:51:50.174403 10639 raft_consensus.cc:515] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:50.177573 10639 leader_election.cc:290] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:50.178226 10639 raft_consensus.cc:493] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:50.178797 10639 raft_consensus.cc:515] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:50.181607 10639 leader_election.cc:290] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:50.182771 10624 raft_consensus.cc:493] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:50.183600 10624 raft_consensus.cc:515] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:50.186259 10624 leader_election.cc:290] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:50.187647  7770 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37136 (request call id 2110) took 4494 ms. Trace:
I20260709 14:51:50.188189  7770 rpcz_store.cc:276] 0709 14:51:45.693069 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:49.717066 (+4023997us) service_pool.cc:224] Handling call
0709 14:51:49.717565 (+   499us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:51:49.831712 (+114147us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:51:49.831746 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:51:49.879289 (+ 47543us) log.cc:844] Serialized 26 byte log entry
0709 14:51:50.015250 (+135961us) raft_consensus.cc:1645] Marking committed up to 4
0709 14:51:50.015289 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:50.015377 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:51:50.187217 (+171840us) raft_consensus.cc:1685] finished
0709 14:51:50.187249 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:51:50.187574 (+   325us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40455,"raft.queue_time_us":81783,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":76,"thread_start_us":187268,"threads_started":2,"wal-append.queue_time_us":161390}
I20260709 14:51:50.191184 10624 raft_consensus.cc:493] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:50.191864 10624 raft_consensus.cc:515] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:50.165134 10649 consensus_queue.cc:260] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:50.165874 10650 raft_consensus.cc:3055] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 14:51:50.194774 10624 leader_election.cc:290] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:51:50.195784  7745 connection.cc:256] RPC call timeout handler was delayed by -3.414826226999935s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15990000000000001s for a response
W20260709 14:51:50.197201  7745 connection.cc:256] RPC call timeout handler was delayed by -3.224926226999969s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18100000000000002s for a response
W20260709 14:51:50.200196  7745 connection.cc:256] RPC call timeout handler was delayed by -3.0476262270000234s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20070000000000002s for a response
W20260709 14:51:50.200948  7745 connection.cc:256] RPC call timeout handler was delayed by -3.0368262270000059s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20190000000000002s for a response
W20260709 14:51:50.201560  7745 connection.cc:256] RPC call timeout handler was delayed by -2.9989527259999704s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1805s for a response
I20260709 14:51:50.196403 10624 raft_consensus.cc:493] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:51:50.202277  7745 connection.cc:256] RPC call timeout handler was delayed by -2.995426226999939s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20650000000000002s for a response
W20260709 14:51:50.202705  7745 connection.cc:256] RPC call timeout handler was delayed by -2.5985262269999794s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2506s for a response
W20260709 14:51:50.203055  7745 connection.cc:256] RPC call timeout handler was delayed by -2.2178262269999323s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2929s for a response
I20260709 14:51:50.203102  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:51:50.203469  7745 connection.cc:256] RPC call timeout handler was delayed by -1.8461262270000134s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.33420000000000005s for a response
W20260709 14:51:50.182868 10663 log.cc:927] Time spent T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.098s	user 0.003s	sys 0.000s
W20260709 14:51:50.206249  8598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 161497us
I20260709 14:51:50.207505  7845 raft_consensus.cc:2468] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 5.
W20260709 14:51:50.186277 10672 log.cc:927] Time spent T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 14:51:50.217948  7925 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
mode: GRACEFUL
new_leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:48676
I20260709 14:51:50.204002 10650 raft_consensus.cc:740] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:50.225539  7852 raft_consensus.cc:1275] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 14:51:50.223536  7893 leader_election.cc:304] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:51:50.219470  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:51:50.226840  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:50.218640  7925 raft_consensus.cc:606] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 LEADER]: Received request to transfer leadership to TS 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:51:50.226199  7852 pending_rounds.cc:85] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting all ops after (but not including) 5
I20260709 14:51:50.228760  7852 pending_rounds.cc:107] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 14:51:50.229178  7852 raft_consensus.cc:2889] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:51:50.230432  7846 raft_consensus.cc:1275] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 14:51:50.238142  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:50.211442 10624 raft_consensus.cc:515] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:50.241544  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:50.245365  7850 raft_consensus.cc:2393] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 8: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:51:50.227485 10536 consensus_queue.cc:1048] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 14:51:50.253123  7775 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37136 (request call id 2112) took 4555 ms. Trace:
I20260709 14:51:50.253659  7775 rpcz_store.cc:276] 0709 14:51:45.693677 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:49.718599 (+4024922us) service_pool.cc:224] Handling call
0709 14:51:49.718965 (+   366us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:51:49.775090 (+ 56125us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:51:49.775133 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:51:49.842203 (+ 67070us) log.cc:844] Serialized 26 byte log entry
0709 14:51:49.936583 (+ 94380us) raft_consensus.cc:1645] Marking committed up to 5
0709 14:51:49.936620 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:49.937076 (+   456us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:51:50.181962 (+244886us) spinlock_profiling.cc:243] Waited 37.4 ms on lock 0x7b240015b198. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb687c29db1 00007fb687c279c4 00007fb687c25acb 00007fb687de0dc9 00007fb687de0a55 00007fb687de009d 00007fb68aa1210e 00007fb68aa2988c 00007fb68aa28bb6 00007fb68aa287d8 00007fb68aa32221
0709 14:51:50.240639 (+ 58677us) raft_consensus.cc:1685] finished
0709 14:51:50.240666 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:51:50.248967 (+  8301us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":48175,"raft.queue_time_us":80763,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":108,"spinlock_wait_cycles":86064000,"thread_start_us":67411,"threads_started":1,"wal-append.queue_time_us":228232}
I20260709 14:51:50.244351 10652 raft_consensus.cc:2804] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 14:51:50.257643 10650 consensus_queue.cc:260] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:50.258949  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:50.259030  7779 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37136 (request call id 2111) took 4565 ms. Trace:
W20260709 14:51:50.262871  7742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:50.257524 10652 raft_consensus.cc:697] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:50.270020  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 11 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
W20260709 14:51:50.270979  7875 debug-util.cc:398] Leaking SignalData structure 0x7b080012e300 after lost signal to thread 6552
I20260709 14:51:50.271258  7777 raft_consensus.cc:2410] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for term 11 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 14:51:50.260093  7779 rpcz_store.cc:276] 0709 14:51:45.693390 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:49.718156 (+4024766us) service_pool.cc:224] Handling call
0709 14:51:49.718741 (+   585us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:51:49.875616 (+156875us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:51:49.875656 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:51:49.876318 (+   662us) log.cc:844] Serialized 26 byte log entry
0709 14:51:49.923461 (+ 47143us) raft_consensus.cc:1645] Marking committed up to 4
0709 14:51:49.923512 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:49.923604 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:51:50.257812 (+334208us) spinlock_profiling.cc:243] Waited 42.2 ms on lock 0x7b240015b198. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb687c29db1 00007fb687c279c4 00007fb687c25acb 00007fb687de0dc9 00007fb687de0a55 00007fb687ddffb0 00007fb68aa56488 00007fb68aa56be8 00007fb68aa2e398 00007fb68aa2976a 00007fb68aa28bb6
0709 14:51:50.258696 (+   884us) raft_consensus.cc:1685] finished
0709 14:51:50.258717 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:51:50.258954 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44813,"raft.queue_time_us":80755,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":81,"spinlock_wait_cycles":97058688,"thread_start_us":158018,"threads_started":2,"wal-append.queue_time_us":123690}
W20260709 14:51:50.272370  7875 debug-util.cc:398] Leaking SignalData structure 0x7b08001ea560 after lost signal to thread 7711
I20260709 14:51:50.272661  7850 raft_consensus.cc:2393] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 6: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
W20260709 14:51:50.272966  7875 debug-util.cc:398] Leaking SignalData structure 0x7b08000ba100 after lost signal to thread 7742
I20260709 14:51:50.259292 10650 raft_consensus.cc:3060] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Advancing to term 10
W20260709 14:51:50.273949  7875 debug-util.cc:398] Leaking SignalData structure 0x7b080014cee0 after lost signal to thread 7744
I20260709 14:51:50.275914  7926 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
mode: GRACEFUL
new_leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:48676
I20260709 14:51:50.276743  7926 raft_consensus.cc:606] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Received request to transfer leadership to TS 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:50.277168  7926 raft_consensus.cc:614] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 14:51:50.280800  7926 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
mode: GRACEFUL
new_leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:48676
I20260709 14:51:50.281596  7926 raft_consensus.cc:606] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Received request to transfer leadership to TS 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:51:50.281968  7926 raft_consensus.cc:614] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 14:51:50.283805  7875 debug-util.cc:398] Leaking SignalData structure 0x7b08001025e0 after lost signal to thread 7745
W20260709 14:51:50.285863  7875 debug-util.cc:398] Leaking SignalData structure 0x7b08000cbd80 after lost signal to thread 7773
W20260709 14:51:50.286262  7875 debug-util.cc:398] Leaking SignalData structure 0x7b08000a6760 after lost signal to thread 7775
W20260709 14:51:50.286516  7875 debug-util.cc:398] Leaking SignalData structure 0x7b08000ada80 after lost signal to thread 7776
W20260709 14:51:50.286731  7875 debug-util.cc:398] Leaking SignalData structure 0x7b0800040540 after lost signal to thread 7777
I20260709 14:51:50.285998  6549 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 14:51:50.287250  7875 debug-util.cc:398] Leaking SignalData structure 0x7b080005d7e0 after lost signal to thread 7803
W20260709 14:51:50.287804  7875 debug-util.cc:398] Leaking SignalData structure 0x7b080005ab80 after lost signal to thread 7804
W20260709 14:51:50.288106  7875 debug-util.cc:398] Leaking SignalData structure 0x7b08002fe2a0 after lost signal to thread 7818
W20260709 14:51:50.288378  7875 debug-util.cc:398] Leaking SignalData structure 0x7b080033f360 after lost signal to thread 7819
W20260709 14:51:50.289808  7875 debug-util.cc:398] Leaking SignalData structure 0x7b08002f6140 after lost signal to thread 7878
I20260709 14:51:50.290661  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:50.291496  7852 raft_consensus.cc:2468] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 10.
I20260709 14:51:50.290699  6549 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 14:51:50.290129  7875 debug-util.cc:398] Leaking SignalData structure 0x7b080034e4c0 after lost signal to thread 7879
W20260709 14:51:50.293776  7875 debug-util.cc:398] Leaking SignalData structure 0x7b0800354ca0 after lost signal to thread 7891
W20260709 14:51:50.294106  7875 debug-util.cc:398] Leaking SignalData structure 0x7b08000e0ac0 after lost signal to thread 7892
W20260709 14:51:50.294385  7875 debug-util.cc:398] Leaking SignalData structure 0x7b0800193140 after lost signal to thread 7893
W20260709 14:51:50.294674  7875 debug-util.cc:398] Leaking SignalData structure 0x7b08002ac820 after lost signal to thread 7894
W20260709 14:51:50.295374  7875 debug-util.cc:398] Leaking SignalData structure 0x7b0800325420 after lost signal to thread 7919
W20260709 14:51:50.295756  7875 debug-util.cc:398] Leaking SignalData structure 0x7b08000b0040 after lost signal to thread 7922
W20260709 14:51:50.296048  7875 debug-util.cc:398] Leaking SignalData structure 0x7b0800318c80 after lost signal to thread 7923
W20260709 14:51:50.296337  7875 debug-util.cc:398] Leaking SignalData structure 0x7b08002ac940 after lost signal to thread 7925
W20260709 14:51:50.297138  7875 debug-util.cc:398] Leaking SignalData structure 0x7b08000bcbe0 after lost signal to thread 7952
W20260709 14:51:50.297487  7875 debug-util.cc:398] Leaking SignalData structure 0x7b080033b320 after lost signal to thread 7953
I20260709 14:51:50.298730  7775 raft_consensus.cc:1240] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 7. Current term is 8. Ops: [7.5-7.5]
W20260709 14:51:50.302114  7875 debug-util.cc:398] Leaking SignalData structure 0x7b0800278ac0 after lost signal to thread 8661
I20260709 14:51:50.303433 10652 consensus_queue.cc:237] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:50.303911  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18d29d52d304c87b930d4fb5eaf50b1" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:50.304149  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:50.304798  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:50.303498  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:50.305799  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:50.304842  7776 raft_consensus.cc:2468] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 10.
I20260709 14:51:50.303918  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:50.307950  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:50.308095  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:50.308507 10656 raft_consensus.cc:3060] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Advancing to term 8
W20260709 14:51:50.308527  7875 debug-util.cc:398] Leaking SignalData structure 0x7b080036e140 after lost signal to thread 8664
I20260709 14:51:50.309144  7776 raft_consensus.cc:2468] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 8.
W20260709 14:51:50.310771  7875 debug-util.cc:398] Leaking SignalData structure 0x7b0800313520 after lost signal to thread 10405
W20260709 14:51:50.311270  7875 debug-util.cc:398] Leaking SignalData structure 0x7b08002d22c0 after lost signal to thread 10436
I20260709 14:51:50.311789  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:50.311940  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:50.313053  7776 raft_consensus.cc:1275] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 14:51:50.313987  7875 debug-util.cc:398] Leaking SignalData structure 0x7b0800342980 after lost signal to thread 10448
W20260709 14:51:50.314514  7875 debug-util.cc:398] Leaking SignalData structure 0x7b08002de800 after lost signal to thread 10524
W20260709 14:51:50.314848  7875 debug-util.cc:398] Leaking SignalData structure 0x7b08002fc180 after lost signal to thread 10531
W20260709 14:51:50.315289  7875 debug-util.cc:398] Leaking SignalData structure 0x7b08002ac2e0 after lost signal to thread 10563
W20260709 14:51:50.315614  7875 debug-util.cc:398] Leaking SignalData structure 0x7b0800171500 after lost signal to thread 10571
W20260709 14:51:50.315990  7875 debug-util.cc:398] Leaking SignalData structure 0x7b0800289560 after lost signal to thread 10582
W20260709 14:51:50.316296  7875 debug-util.cc:398] Leaking SignalData structure 0x7b080033c6c0 after lost signal to thread 10586
W20260709 14:51:50.316974  7875 debug-util.cc:398] Leaking SignalData structure 0x7b080030ce60 after lost signal to thread 10600
I20260709 14:51:50.316259  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:50.316382  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
W20260709 14:51:50.318292  7875 debug-util.cc:398] Leaking SignalData structure 0x7b080023ed40 after lost signal to thread 10617
I20260709 14:51:50.318956  7775 raft_consensus.cc:2393] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 9: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:51:50.317075  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:50.320923  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:50.322827  7779 raft_consensus.cc:3060] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Advancing to term 8
I20260709 14:51:50.323628  7778 raft_consensus.cc:2468] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 8.
I20260709 14:51:50.323532  7771 raft_consensus.cc:3060] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:51:50.323966  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:50.325613  7772 raft_consensus.cc:2468] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 6.
I20260709 14:51:50.327045  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:50.333357  7845 raft_consensus.cc:3060] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:51:50.336442  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:50.337309  7775 raft_consensus.cc:2468] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 8.
I20260709 14:51:50.339155  7893 leader_election.cc:304] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:51:50.359956  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:50.360985  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:50.362120  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:50.362282  7774 raft_consensus.cc:2468] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 8.
I20260709 14:51:50.362476  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:50.361078  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:50.363108  7770 raft_consensus.cc:2468] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 7.
I20260709 14:51:50.361014  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:50.365056  7778 raft_consensus.cc:2468] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 7.
I20260709 14:51:50.363236  7773 raft_consensus.cc:2468] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 6.
I20260709 14:51:50.361044  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:50.361078  7775 raft_consensus.cc:2468] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 9.
I20260709 14:51:50.354324 10624 leader_election.cc:290] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:50.364158  7852 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f"
dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:49946
I20260709 14:51:50.363903  7776 raft_consensus.cc:2468] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 4.
I20260709 14:51:50.346863 10633 raft_consensus.cc:493] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:50.369038  7852 raft_consensus.cc:493] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
W20260709 14:51:50.371479  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:50.371918  7852 raft_consensus.cc:3060] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:51:50.370378  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:50.372678  7777 raft_consensus.cc:2468] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 8.
W20260709 14:51:50.378647  6554 debug-util.cc:398] Leaking SignalData structure 0x7b080000f480 after lost signal to thread 7819
I20260709 14:51:50.378839  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:50.380195  7847 raft_consensus.cc:3060] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:51:50.378522  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:50.381366  7774 raft_consensus.cc:2468] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 6.
I20260709 14:51:50.383229  7893 leader_election.cc:304] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:51:50.386152 10644 raft_consensus.cc:2804] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 14:51:50.369658 10536 raft_consensus.cc:2804] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 14:51:50.387060 10644 raft_consensus.cc:697] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:50.386543  7893 leader_election.cc:304] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:51:50.386509 10524 consensus_queue.cc:1048] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 14:51:50.378906 10633 raft_consensus.cc:515] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:50.388494 10644 consensus_queue.cc:237] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:50.396260 10633 leader_election.cc:290] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:50.397852 10582 raft_consensus.cc:2804] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 14:51:50.405596 10582 raft_consensus.cc:697] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:50.406536 10649 raft_consensus.cc:3060] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:51:50.407032 10582 consensus_queue.cc:237] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:50.382246 10655 consensus_queue.cc:1059] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.043s
I20260709 14:51:50.418530 10624 raft_consensus.cc:3055] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 LEADER]: Stepping down as leader of term 6
I20260709 14:51:50.419209 10624 raft_consensus.cc:740] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:51:50.422495  7771 raft_consensus.cc:2468] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 6.
W20260709 14:51:50.413771  7819 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:50.429438 10524 consensus_queue.cc:1059] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 14:51:50.430178 10640 raft_consensus.cc:493] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:50.431123 10640 raft_consensus.cc:515] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:50.430831 10524 raft_consensus.cc:3055] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 14:51:50.432071 10524 raft_consensus.cc:740] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:50.433905  7849 raft_consensus.cc:1240] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 8. Current term is 9. Ops: []
I20260709 14:51:50.433669 10524 consensus_queue.cc:260] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:50.434072 10640 leader_election.cc:290] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:50.434566 10633 raft_consensus.cc:493] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:50.434971 10645 raft_consensus.cc:493] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:50.435535 10524 raft_consensus.cc:3060] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 14:51:50.435612 10645 raft_consensus.cc:515] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:50.438361 10645 leader_election.cc:290] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:51:50.439016  7819 connection.cc:256] RPC call timeout handler was delayed by -3.6714427790000173s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18480000000000002s for a response
W20260709 14:51:50.440004  7819 connection.cc:256] RPC call timeout handler was delayed by -3.4545427790000076s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2089s for a response
W20260709 14:51:50.440500  7819 connection.cc:256] RPC call timeout handler was delayed by -3.4194427789999509s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21280000000000002s for a response
W20260709 14:51:50.440981  7819 connection.cc:256] RPC call timeout handler was delayed by -3.3168427790000123s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2242s for a response
I20260709 14:51:50.439899  7893 leader_election.cc:304] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:51:50.441447 10645 raft_consensus.cc:493] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:50.450172 10645 raft_consensus.cc:515] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:50.451660  7845 raft_consensus.cc:2410] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 14:51:50.439857 10633 raft_consensus.cc:515] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:50.442106  7847 raft_consensus.cc:2468] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 9.
I20260709 14:51:50.400002 10651 raft_consensus.cc:515] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:50.449361  7819 connection.cc:256] RPC call timeout handler was delayed by -3.2357428100000334s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1507s for a response
I20260709 14:51:50.454058  7852 raft_consensus.cc:515] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:50.457717  7819 connection.cc:256] RPC call timeout handler was delayed by -3.2357428100000334s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1507s for a response
W20260709 14:51:50.458202  7819 connection.cc:256] RPC call timeout handler was delayed by -3.223142810000013s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1521s for a response
W20260709 14:51:50.458513  7819 connection.cc:256] RPC call timeout handler was delayed by -3.223142810000013s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1521s for a response
W20260709 14:51:50.458784  7819 connection.cc:256] RPC call timeout handler was delayed by -3.13144277899994s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24480000000000002s for a response
W20260709 14:51:50.459100  7819 connection.cc:256] RPC call timeout handler was delayed by -3.0935428100000308s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1665s for a response
W20260709 14:51:50.459471  7819 connection.cc:256] RPC call timeout handler was delayed by -3.0935428100000308s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1665s for a response
W20260709 14:51:50.459827  7819 connection.cc:256] RPC call timeout handler was delayed by -3.0638428100000965s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1698s for a response
W20260709 14:51:50.460269  7819 connection.cc:256] RPC call timeout handler was delayed by -3.0638428100000965s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1698s for a response
W20260709 14:51:50.460553  7819 connection.cc:256] RPC call timeout handler was delayed by -3.013442810000015s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1754s for a response
W20260709 14:51:50.460845  7819 connection.cc:256] RPC call timeout handler was delayed by -3.013442810000015s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1754s for a response
W20260709 14:51:50.461115  7819 connection.cc:256] RPC call timeout handler was delayed by -2.9954428100000996s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1774s for a response
W20260709 14:51:50.461431  7819 connection.cc:256] RPC call timeout handler was delayed by -2.9954428100000996s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1774s for a response
W20260709 14:51:50.461691  7819 connection.cc:256] RPC call timeout handler was delayed by -2.8946428100000503s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1886s for a response
W20260709 14:51:50.462002  7819 connection.cc:256] RPC call timeout handler was delayed by -2.8946428100000503s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1886s for a response
W20260709 14:51:50.462286  7819 connection.cc:256] RPC call timeout handler was delayed by -2.8757428100000197s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1907s for a response
W20260709 14:51:50.462488  7819 connection.cc:256] RPC call timeout handler was delayed by -2.8757428100000197s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1907s for a response
W20260709 14:51:50.462677  7819 connection.cc:256] RPC call timeout handler was delayed by -2.8541428100000985s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19310000000000002s for a response
W20260709 14:51:50.462850  7819 connection.cc:256] RPC call timeout handler was delayed by -2.8541428100000985s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19310000000000002s for a response
W20260709 14:51:50.463095  7819 connection.cc:256] RPC call timeout handler was delayed by -2.6849428100000523s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21190000000000003s for a response
W20260709 14:51:50.463284  7819 connection.cc:256] RPC call timeout handler was delayed by -2.6849428100000523s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21190000000000003s for a response
W20260709 14:51:50.463459  7819 connection.cc:256] RPC call timeout handler was delayed by -2.6435428100000991s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21650000000000003s for a response
W20260709 14:51:50.463677  7819 connection.cc:256] RPC call timeout handler was delayed by -2.6435428100000991s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21650000000000003s for a response
W20260709 14:51:50.463934  7819 connection.cc:256] RPC call timeout handler was delayed by -2.6129428100000496s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21989999999999998s for a response
W20260709 14:51:50.480049  7819 connection.cc:256] RPC call timeout handler was delayed by -2.6129428100000496s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21989999999999998s for a response
W20260709 14:51:50.480541  7819 connection.cc:256] RPC call timeout handler was delayed by -2.5796428100001094s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22360000000000002s for a response
W20260709 14:51:50.480877  7819 connection.cc:256] RPC call timeout handler was delayed by -2.5796428100001094s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22360000000000002s for a response
W20260709 14:51:50.481159  7819 connection.cc:256] RPC call timeout handler was delayed by -2.4968428100000892s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2328s for a response
W20260709 14:51:50.481490  7819 connection.cc:256] RPC call timeout handler was delayed by -2.4968428100000892s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2328s for a response
I20260709 14:51:50.453147 10645 leader_election.cc:290] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:50.484920  7852 leader_election.cc:290] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 6 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:50.488189  7847 raft_consensus.cc:1240] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 5. Current term is 6. Ops: []
I20260709 14:51:50.491252  7854 raft_consensus.cc:1275] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 14:51:50.494289  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 68204us
W20260709 14:51:50.495699  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:51:50.499030  7894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:50.499688  7848 raft_consensus.cc:1275] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 14:51:50.487175 10536 raft_consensus.cc:697] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:50.503335  7847 raft_consensus.cc:1275] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 14:51:50.504664  7779 raft_consensus.cc:2468] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 8.
I20260709 14:51:50.504930  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:50.502473  7848 pending_rounds.cc:85] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting all ops after (but not including) 3
I20260709 14:51:50.510214  7848 pending_rounds.cc:107] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 14:51:50.510491  7848 raft_consensus.cc:2889] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:51:50.517520  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:50.518230  7847 raft_consensus.cc:2468] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 7.
I20260709 14:51:50.519233  7819 leader_election.cc:304] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:50.522771  7926 raft_consensus.cc:1240] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 LEADER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 9. Current term is 10. Ops: []
I20260709 14:51:50.524997  7852 raft_consensus.cc:1240] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 7. Current term is 8. Ops: []
I20260709 14:51:50.521986 10633 leader_election.cc:290] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:50.526109  7925 raft_consensus.cc:1240] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 14:51:50.524884  7919 raft_consensus.cc:1240] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 14:51:50.501917 10645 consensus_queue.cc:1059] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.020s
I20260709 14:51:50.516490 10683 raft_consensus.cc:2804] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 14:51:50.525080 10624 consensus_queue.cc:260] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:50.531515 10536 consensus_queue.cc:237] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:50.532615 10624 raft_consensus.cc:3060] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:51:50.535037  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:50.536933  7925 raft_consensus.cc:1240] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 14:51:50.540529  7852 raft_consensus.cc:2410] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 14:51:50.540695 10651 leader_election.cc:290] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 11 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:50.542017  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:50.542191  7850 raft_consensus.cc:1275] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 14:51:50.542774  7850 pending_rounds.cc:85] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting all ops after (but not including) 4
I20260709 14:51:50.543076  7850 pending_rounds.cc:107] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 14:51:50.543308  7850 raft_consensus.cc:2889] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:51:50.543561  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:50.544173  7848 raft_consensus.cc:2468] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 7.
I20260709 14:51:50.544474  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:50.545307  7850 raft_consensus.cc:2393] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 7: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:51:50.542796  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:50.546653  7853 raft_consensus.cc:2468] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 7.
I20260709 14:51:50.547858  7852 raft_consensus.cc:2468] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 6.
I20260709 14:51:50.535943 10640 raft_consensus.cc:3055] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 LEADER]: Stepping down as leader of term 4
I20260709 14:51:50.529083 10675 raft_consensus.cc:515] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:50.549625 10640 raft_consensus.cc:740] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:51:50.550661 10640 consensus_queue.cc:260] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:50.552011 10640 raft_consensus.cc:3060] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:51:50.553839 10675 leader_election.cc:290] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:51:50.561393  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:50.536132 10633 raft_consensus.cc:2804] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 14:51:50.566002  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:50.568799  7926 raft_consensus.cc:2468] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 4.
I20260709 14:51:50.567497  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:50.570744  7919 raft_consensus.cc:3060] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 14:51:50.567649 10633 raft_consensus.cc:493] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:50.538902 10683 raft_consensus.cc:697] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:50.581717 10633 raft_consensus.cc:3060] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:51:50.586995  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:50.590283  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:50.573760 10634 consensus_queue.cc:1059] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 14:51:50.593029 10645 raft_consensus.cc:3055] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 LEADER]: Stepping down as leader of term 7
I20260709 14:51:50.593609 10645 raft_consensus.cc:740] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:51:50.594754 10645 consensus_queue.cc:260] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:50.596355 10645 raft_consensus.cc:3060] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Advancing to term 8
I20260709 14:51:50.598418  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:50.601009  7921 raft_consensus.cc:1275] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 14:51:50.603120  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:50.606287  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:50.607607  7921 raft_consensus.cc:2410] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for term 9 because replica has last-logged OpId of term: 7 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 14:51:50.608806  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:50.609637  7923 raft_consensus.cc:2468] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 8.
I20260709 14:51:50.610572 10683 consensus_queue.cc:237] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:50.577075 10680 log.cc:927] Time spent T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
I20260709 14:51:50.620677  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:50.621990  7819 leader_election.cc:304] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:50.624118  7819 leader_election.cc:304] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:50.625517 10649 raft_consensus.cc:2804] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 14:51:50.626214 10649 raft_consensus.cc:493] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:50.626628 10649 raft_consensus.cc:3060] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:51:50.626999  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:50.627722  7926 raft_consensus.cc:3060] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:51:50.631465  7922 raft_consensus.cc:1240] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 LEADER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 14:51:50.633692  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:50.629540 10645 raft_consensus.cc:2804] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 14:51:50.636088  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:50.636482  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:50.636066 10645 raft_consensus.cc:493] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:50.639508 10645 raft_consensus.cc:3060] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:51:50.636138  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:50.642776  7921 raft_consensus.cc:2368] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 6. Current term is 7.
I20260709 14:51:50.648913  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:50.650081  7922 raft_consensus.cc:2393] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 10: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
W20260709 14:51:50.650517 10681 log.cc:927] Time spent T 00000000000000000000000000000000 P 133636659113430cb53b321cb0b1d9ee: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
I20260709 14:51:50.655030  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:50.655388  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:50.657023  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:50.667066  7919 raft_consensus.cc:2468] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 8.
I20260709 14:51:50.673225  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:50.675585  7925 raft_consensus.cc:1240] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 LEADER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 14:51:50.679772  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:50.683264  7921 raft_consensus.cc:1240] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 LEADER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 14:51:50.685554  7923 raft_consensus.cc:2468] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 5.
I20260709 14:51:50.688226  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:50.691805  7926 raft_consensus.cc:2410] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 14:51:50.702144  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:50.703975  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:50.704984  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c563cc7cfbe4d59be4ffc5cf847ce56" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:50.706125  7923 raft_consensus.cc:2410] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 14:51:50.706065  7819 leader_election.cc:400] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 6 election: Vote denied by peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587) with higher term. Message: Invalid argument: T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 6. Current term is 7.
I20260709 14:51:50.704867  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:50.706983  7819 leader_election.cc:403] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 14:51:50.707301  7926 raft_consensus.cc:2393] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 11: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:51:50.705312  7928 raft_consensus.cc:2468] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 4.
I20260709 14:51:50.713222  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:50.712767 10634 raft_consensus.cc:2749] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587) with higher term. Message: Invalid argument: T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 6. Current term is 7.
I20260709 14:51:50.730257 10633 raft_consensus.cc:515] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:50.731986  7742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:50.731980  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:50.736176  7849 raft_consensus.cc:1240] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 8. Current term is 9. Ops: []
I20260709 14:51:50.739399  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:50.739809  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:50.740343  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:50.741094  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 11 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:50.741081  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:50.742228  7920 raft_consensus.cc:2468] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 5.
I20260709 14:51:50.742167  7919 raft_consensus.cc:2393] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 11: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:51:50.740516  7926 raft_consensus.cc:2410] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 14:51:50.744861  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:50.749788  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:50.748723  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783e4874513449ef9084b833f188a6d3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:50.751777 10633 leader_election.cc:290] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 9 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:50.754994 10649 raft_consensus.cc:515] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:50.792439  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
W20260709 14:51:50.796104  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:50.800176  7920 raft_consensus.cc:1275] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 14:51:50.801208  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
W20260709 14:51:50.807950  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:51:50.810573  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:50.811128 10645 raft_consensus.cc:515] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:50.812855  7923 raft_consensus.cc:2468] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 10.
I20260709 14:51:50.818521  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:50.819339  7921 raft_consensus.cc:2468] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 8.
I20260709 14:51:50.822784  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
W20260709 14:51:50.823132  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 108128us
I20260709 14:51:50.830106  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:50.832248  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:50.835296  7924 raft_consensus.cc:2393] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 8: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:51:50.837694  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:50.839069  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:50.839411  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:50.838269  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:50.840059  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:50.840210  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:50.840850  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:50.841526  7928 raft_consensus.cc:2468] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 8.
I20260709 14:51:50.841598  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:50.842166  7923 raft_consensus.cc:2468] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 8.
I20260709 14:51:50.842759  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:50.843125  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:50.844059  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:50.844684  7922 raft_consensus.cc:2468] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 8.
I20260709 14:51:50.845947 10649 leader_election.cc:290] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 9 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:50.849571  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:50.850781  7919 raft_consensus.cc:2468] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 7.
I20260709 14:51:50.851881  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:50.852443  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:50.852859  7920 raft_consensus.cc:2468] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 4.
I20260709 14:51:50.857790  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:50.847483  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:50.859723  7849 raft_consensus.cc:3055] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 LEADER]: Stepping down as leader of term 9
I20260709 14:51:50.860257  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:50.851915 10645 leader_election.cc:290] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 10 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:50.860220  7849 raft_consensus.cc:740] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:51:50.860234  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:50.861409  7819 leader_election.cc:304] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:50.861651  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:50.859530  7851 raft_consensus.cc:3060] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:51:50.862273  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:50.862335  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:50.863997  7926 raft_consensus.cc:2468] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 7.
I20260709 14:51:50.864588  7919 raft_consensus.cc:2393] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 8: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:51:50.865746  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce9c0ef2db24c13a8b1402f21819458" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:50.866847  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:50.867930  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:50.868844  7921 raft_consensus.cc:2393] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 11: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:51:50.865659  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:50.869035  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:50.874200  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:50.885576  7928 raft_consensus.cc:1240] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 6. Current term is 7. Ops: []
I20260709 14:51:50.884481  7849 consensus_queue.cc:260] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:50.887622  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:50.885193 10645 raft_consensus.cc:2804] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader election won for term 8
I20260709 14:51:50.889653 10645 raft_consensus.cc:697] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:51:50.890789 10645 consensus_queue.cc:237] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:50.887970  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258d6c2dda954bf5b65930fde8ecb9f3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:50.895334  7849 raft_consensus.cc:3060] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:51:50.896350  7924 raft_consensus.cc:2393] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 5: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:51:50.894780  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:50.896742  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:50.897855  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:50.898101  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:50.899061  7925 raft_consensus.cc:2410] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 14:51:50.900754  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:50.897168  7928 raft_consensus.cc:2468] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 8.
I20260709 14:51:50.903575 10582 consensus_queue.cc:1048] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 14:51:50.905406  7849 raft_consensus.cc:1275] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 8. (term mismatch)
W20260709 14:51:50.906984  7743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:50.907822  7923 raft_consensus.cc:1275] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 14:51:50.908313  7923 pending_rounds.cc:85] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0: Aborting all ops after (but not including) 4
I20260709 14:51:50.912235  7923 pending_rounds.cc:107] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 14:51:50.910104  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:50.905930  7849 pending_rounds.cc:85] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting all ops after (but not including) 7
I20260709 14:51:50.913601  7849 pending_rounds.cc:107] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting uncommitted NO_OP operation due to leader change: 9.8
I20260709 14:51:50.913983  7849 raft_consensus.cc:2889] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:51:50.917457  7923 raft_consensus.cc:2889] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:51:50.905773  7894 leader_election.cc:304] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:51:50.922974  7851 raft_consensus.cc:2468] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 11.
W20260709 14:51:50.925180  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:50.925730  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:50.926678  7777 raft_consensus.cc:1240] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 7. Current term is 8. Ops: []
I20260709 14:51:50.928247  7779 raft_consensus.cc:1275] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 14:51:50.928797  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:50.929625  7772 raft_consensus.cc:2468] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 7.
I20260709 14:51:50.927814  7819 leader_election.cc:304] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:50.934896 10649 raft_consensus.cc:2804] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader election won for term 10
I20260709 14:51:50.935618 10649 raft_consensus.cc:697] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:51:50.936820 10649 consensus_queue.cc:237] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:50.942024  7676 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54344 (request call id 370) took 1443 ms. Trace:
I20260709 14:51:50.946399 10582 raft_consensus.cc:2804] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 14:51:50.950274 10582 raft_consensus.cc:493] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:51:50.951122 10582 raft_consensus.cc:3060] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:51:50.952201  7923 raft_consensus.cc:1275] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 14:51:50.954224  7675 catalog_manager.cc:5697] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 6 to 7, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 7 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:51:50.956416  7675 catalog_manager.cc:5697] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 6 to 7, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 7 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:51:50.958709  7675 catalog_manager.cc:5697] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 8 to 9, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 9 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:51:50.950098  7676 rpcz_store.cc:276] 0709 14:51:49.498811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:49.499060 (+   249us) service_pool.cc:224] Handling call
0709 14:51:50.941906 (+1442846us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 14:51:50.102043 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 14:51:50.187298 (+ 85255us) write_op.cc:432] Acquiring schema lock in shared mode
0709 14:51:50.187392 (+    94us) write_op.cc:435] Acquired schema lock
0709 14:51:50.187417 (+    25us) tablet.cc:662] Decoding operations
0709 14:51:50.188569 (+  1152us) write_op.cc:620] Acquiring the partition lock for write op
0709 14:51:50.189109 (+   540us) write_op.cc:641] Partition lock acquired for write op
0709 14:51:50.189157 (+    48us) tablet.cc:685] Acquiring locks for 8 operations
0709 14:51:50.190985 (+  1828us) tablet.cc:701] Row locks acquired
0709 14:51:50.191038 (+    53us) write_op.cc:260] PREPARE: finished
0709 14:51:50.191298 (+   260us) write_op.cc:270] Start()
0709 14:51:50.192102 (+   804us) write_op.cc:276] Timestamp: P: 1783608710191212 usec, L: 0
0709 14:51:50.192130 (+    28us) op_driver.cc:348] REPLICATION: starting
0709 14:51:50.193194 (+  1064us) log.cc:844] Serialized 3234 byte log entry
0709 14:51:50.830981 (+637787us) op_driver.cc:464] REPLICATION: finished
0709 14:51:50.903985 (+ 73004us) spinlock_profiling.cc:243] Waited 3.32 ms on lock 0x7b180016f660. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb690c69de1 00007fb690c765b1 00007fb687da13f3 00007fb687da37c1 00007fb687da3779 00007fb687da3709 00007fb687da36d1 00007fb687da29cd 0000000000396ad4 0000000000396919 00007fb687d8483a
0709 14:51:50.904216 (+   231us) write_op.cc:301] APPLY: starting
0709 14:51:50.904330 (+   114us) tablet.cc:1367] starting BulkCheckPresence
0709 14:51:50.904577 (+   247us) tablet.cc:1370] finished BulkCheckPresence
0709 14:51:50.904615 (+    38us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 14:51:50.909436 (+  4821us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 14:51:50.910184 (+   748us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=8
0709 14:51:50.910457 (+   273us) write_op.cc:312] APPLY: finished
0709 14:51:50.911158 (+   701us) log.cc:844] Serialized 65 byte log entry
0709 14:51:50.911527 (+   369us) write_op.cc:489] Releasing partition, row and schema locks
0709 14:51:50.914354 (+  2827us) write_op.cc:454] Released schema lock
0709 14:51:50.914451 (+    97us) write_op.cc:341] FINISH: Updating metrics
0709 14:51:50.915069 (+   618us) write_op.cc:489] Releasing partition, row and schema locks
0709 14:51:50.915102 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":26836,"reported_tablets":26,"child_traces":[["op",{"apply.queue_time_us":58174,"apply.run_cpu_time_us":5164,"apply.run_wall_time_us":10822,"num_ops":8,"prepare.queue_time_us":205949,"prepare.run_cpu_time_us":38378,"prepare.run_wall_time_us":415345,"raft.queue_time_us":172741,"raft.run_cpu_time_us":8986,"raft.run_wall_time_us":62188,"replication_time_us":636026,"spinlock_wait_cycles":7634304,"thread_start_us":592770,"threads_started":4,"wal-append.queue_time_us":322838}]]}
I20260709 14:51:50.963629  7894 leader_election.cc:304] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:50.960615  7675 catalog_manager.cc:5697] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:51:50.961503 10536 consensus_queue.cc:1048] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 14:51:50.971673  7675 catalog_manager.cc:5697] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 5 to 8. New cstate: current_term: 8 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:51:50.972988  7819 leader_election.cc:304] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 9418391fa82a42c79c6cad13ba91d964
I20260709 14:51:50.976178  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:50.962993 10571 consensus_queue.cc:1048] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 14:51:50.968350 10683 raft_consensus.cc:2749] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 14:51:51.001961  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 45461.9us
I20260709 14:51:51.005766  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce9c0ef2db24c13a8b1402f21819458" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:51.007899  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:51.008569  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:51.005440  7675 catalog_manager.cc:5697] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 5 to 6, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 6 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:51:51.012970  7819 leader_election.cc:304] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:51.012513  7675 catalog_manager.cc:5697] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 9 to 10, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 10 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:51:51.016324  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:51.017194  7772 raft_consensus.cc:2468] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 8.
I20260709 14:51:51.017444  7675 catalog_manager.cc:5697] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 4 to 6, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 6 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:51:51.018814  7777 raft_consensus.cc:1240] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 5. Current term is 6. Ops: []
I20260709 14:51:51.022755  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:51.023581  7779 raft_consensus.cc:2468] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 7.
I20260709 14:51:51.014660 10634 raft_consensus.cc:2749] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 14:51:51.020058  7675 catalog_manager.cc:5697] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:51:51.001003 10582 raft_consensus.cc:515] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:51.039408  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:51.039922  7779 raft_consensus.cc:1275] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 14:51:51.027787 10645 raft_consensus.cc:2804] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 14:51:51.054498  7893 leader_election.cc:304] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:51:51.054435  7777 raft_consensus.cc:1240] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 9. Current term is 10. Ops: []
I20260709 14:51:51.046289 10645 raft_consensus.cc:493] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:51.049890 10571 raft_consensus.cc:493] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:51.068755 10571 raft_consensus.cc:515] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:51.071578 10571 leader_election.cc:290] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:51.059046 10651 consensus_queue.cc:1059] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 14:51:51.058697 10675 raft_consensus.cc:493] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:51.054648 10708 consensus_queue.cc:1048] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 14:51:51.091923 10624 raft_consensus.cc:493] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:51.064997 10645 raft_consensus.cc:3060] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Advancing to term 11
W20260709 14:51:51.086273 10703 log.cc:927] Time spent T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.073s	user 0.002s	sys 0.000s
I20260709 14:51:51.092633 10624 raft_consensus.cc:515] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:51.106077 10675 raft_consensus.cc:515] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:51.113611  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:51.086741 10650 raft_consensus.cc:2804] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 14:51:51.118695 10650 raft_consensus.cc:493] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:51.128075 10650 raft_consensus.cc:3060] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 14:51:51.128758 10624 leader_election.cc:290] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:51.139047 10571 raft_consensus.cc:3055] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 14:51:51.140007 10571 raft_consensus.cc:740] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:51.141083 10571 consensus_queue.cc:260] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:51.146412  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 133524us
I20260709 14:51:51.147341  7819 leader_election.cc:304] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:51.148490 10707 raft_consensus.cc:2804] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 14:51:51.153980 10707 raft_consensus.cc:493] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:51.154366 10707 raft_consensus.cc:3060] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Advancing to term 9
W20260709 14:51:51.157433  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:51.163373 10707 raft_consensus.cc:515] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:51.167588 10633 consensus_queue.cc:1059] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 14:51:51.141003 10650 raft_consensus.cc:515] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:51.171288  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:51.172694  7778 raft_consensus.cc:3060] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:51:51.173591 10640 consensus_queue.cc:1048] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 14:51:51.176743 10633 raft_consensus.cc:3055] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 LEADER]: Stepping down as leader of term 7
I20260709 14:51:51.177629 10633 raft_consensus.cc:740] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:51:51.178776 10633 consensus_queue.cc:260] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:51.168201 10707 leader_election.cc:290] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 9 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:51.180663 10633 raft_consensus.cc:3060] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Advancing to term 8
I20260709 14:51:51.143770 10675 leader_election.cc:290] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:51.185524 10571 raft_consensus.cc:3060] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 14:51:51.194377 10582 leader_election.cc:290] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 5 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:51:51.202035  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 150905us
I20260709 14:51:51.203830  7894 leader_election.cc:304] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:51.204489  7819 leader_election.cc:304] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:51.207753  7778 raft_consensus.cc:2468] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 11.
W20260709 14:51:51.202571 10709 log.cc:927] Time spent T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 14:51:51.205881  7819 leader_election.cc:304] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:51.219265  7819 leader_election.cc:304] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:51.207520 10633 raft_consensus.cc:2804] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 14:51:51.224105 10689 raft_consensus.cc:2804] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 14:51:51.224354 10633 raft_consensus.cc:493] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:51.225049 10689 raft_consensus.cc:493] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:51.225286 10633 raft_consensus.cc:3060] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:51:51.225606 10689 raft_consensus.cc:3060] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:51:51.225706 10645 raft_consensus.cc:515] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:51.216655 10707 raft_consensus.cc:2804] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 14:51:51.228865 10707 raft_consensus.cc:493] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:51.229415 10707 raft_consensus.cc:3060] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Advancing to term 7
W20260709 14:51:51.232909  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:51.221021 10708 raft_consensus.cc:2749] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 14:51:51.221997  7819 leader_election.cc:304] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
W20260709 14:51:51.246874  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 43707.5us
I20260709 14:51:51.248607  7894 leader_election.cc:304] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:51.249725  7819 leader_election.cc:304] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:51.252043  7819 leader_election.cc:304] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:51.253278  7819 leader_election.cc:304] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:51.234469 10650 leader_election.cc:290] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:51.258589 10706 raft_consensus.cc:2804] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 14:51:51.259181 10717 log.cc:927] Time spent T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.092s	user 0.006s	sys 0.000s
I20260709 14:51:51.260649  7819 leader_election.cc:304] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:51.256484 10640 raft_consensus.cc:2804] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 14:51:51.256435 10708 raft_consensus.cc:2749] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 14:51:51.256646 10634 raft_consensus.cc:2804] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 14:51:51.271147  7778 raft_consensus.cc:1240] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 3. Current term is 4. Ops: []
I20260709 14:51:51.276919 10640 raft_consensus.cc:493] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:51.229086 10645 leader_election.cc:290] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 11 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:51.277302 10716 raft_consensus.cc:493] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:51:51.278442  7770 raft_consensus.cc:1275] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 14:51:51.278479 10716 raft_consensus.cc:515] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:51.280134  7774 raft_consensus.cc:1275] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 14:51:51.272470 10706 raft_consensus.cc:493] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:51.281235  7771 raft_consensus.cc:1275] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 14:51:51.277514 10640 raft_consensus.cc:3060] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Advancing to term 8
I20260709 14:51:51.277814  7773 raft_consensus.cc:1275] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 14:51:51.284096 10716 leader_election.cc:290] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:51.285648 10706 raft_consensus.cc:3060] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:51:51.287441 10689 raft_consensus.cc:515] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:51.287851  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:51:51.289227  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:51.289402  7778 raft_consensus.cc:1275] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 14:51:51.290117  7819 leader_election.cc:304] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:51.291980  7819 leader_election.cc:304] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:51.276996 10634 raft_consensus.cc:493] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 14:51:51.313752  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 259373us
I20260709 14:51:51.319690  7893 leader_election.cc:304] T 9ce9c0ef2db24c13a8b1402f21819458 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 9418391fa82a42c79c6cad13ba91d964
I20260709 14:51:51.309357 10645 raft_consensus.cc:2804] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 14:51:51.306388  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:51.293120  7819 leader_election.cc:304] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:51.254384 10649 raft_consensus.cc:2804] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 14:51:51.272879  7894 leader_election.cc:304] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:51.311074 10634 raft_consensus.cc:3060] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Advancing to term 8
I20260709 14:51:51.330749 10689 leader_election.cc:290] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 9 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:51.331640 10704 raft_consensus.cc:2804] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 14:51:51.332351 10704 raft_consensus.cc:493] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 14:51:51.332412  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 59656.1us
I20260709 14:51:51.331730 10683 raft_consensus.cc:2749] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 14:51:51.334471 10704 raft_consensus.cc:3060] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:51:51.323167 10708 raft_consensus.cc:2749] T 9ce9c0ef2db24c13a8b1402f21819458 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 14:51:51.309526 10710 raft_consensus.cc:2804] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 14:51:51.323391  7893 leader_election.cc:304] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:51:51.336109  7819 leader_election.cc:304] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:51.342747 10650 raft_consensus.cc:2804] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 14:51:51.343341 10650 raft_consensus.cc:493] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:51.343779 10650 raft_consensus.cc:3060] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:51:51.322355 10645 raft_consensus.cc:493] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:51.344811 10683 consensus_queue.cc:1059] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 14:51:51.345490 10645 raft_consensus.cc:3060] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:51:51.345844 10683 raft_consensus.cc:3055] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 14:51:51.346243 10683 raft_consensus.cc:740] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:51.347309 10683 consensus_queue.cc:260] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:51.328824 10649 raft_consensus.cc:493] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:51.349704 10649 raft_consensus.cc:3060] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:51:51.349449 10718 consensus_queue.cc:1059] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 14:51:51.351845 10712 raft_consensus.cc:3055] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 14:51:51.352414 10712 raft_consensus.cc:740] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:51.353523 10712 consensus_queue.cc:260] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:51.355408 10710 raft_consensus.cc:493] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:51.356854 10710 raft_consensus.cc:3060] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:51:51.357089 10712 raft_consensus.cc:3060] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:51:51.362038  7893 leader_election.cc:304] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:51:51.348961 10683 raft_consensus.cc:3060] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:51:51.370512  7819 leader_election.cc:304] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:51.367882 10706 raft_consensus.cc:515] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:51.375993  7894 leader_election.cc:304] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:51.377120  7893 leader_election.cc:304] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:51:51.335037 10707 raft_consensus.cc:515] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:51.360458 10640 raft_consensus.cc:515] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:51.380649 10689 raft_consensus.cc:2804] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader election won for term 6
I20260709 14:51:51.380733 10536 raft_consensus.cc:2764] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 14:51:51.385950 10524 consensus_queue.cc:1048] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 14:51:51.393687 10716 raft_consensus.cc:493] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:51.407124 10650 raft_consensus.cc:515] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:51.414237 10716 raft_consensus.cc:515] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:51.395448 10708 raft_consensus.cc:2749] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 14:51:51.381390 10582 consensus_queue.cc:1048] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 14:51:51.387108 10652 consensus_queue.cc:1048] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 14:51:51.422147  6549 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 14:51:51.425683  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 87770.2us
I20260709 14:51:51.429509 10624 consensus_queue.cc:1048] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 14:51:51.429807  7744 leader_election.cc:304] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:51:51.433028 10624 raft_consensus.cc:2804] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 14:51:51.434142 10624 raft_consensus.cc:493] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:51.435563  7744 leader_election.cc:304] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:51:51.387669 10633 raft_consensus.cc:515] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:51.399819 10713 raft_consensus.cc:493] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:51.456686 10706 leader_election.cc:290] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 7 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:51.458621  7744 leader_election.cc:304] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:51:51.462819 10707 leader_election.cc:290] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 7 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:51.416602 10675 raft_consensus.cc:493] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:51:51.475538  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:51:51.481927  7743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:51:51.491393  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 121610us
I20260709 14:51:51.435133 10624 raft_consensus.cc:3060] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:51:51.449451 10651 raft_consensus.cc:2804] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 14:51:51.407405 10649 raft_consensus.cc:515] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:51.496042  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:51.466308 10640 leader_election.cc:290] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 8 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:51:51.497117  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 120146us
W20260709 14:51:51.513368  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:51.498754 10706 raft_consensus.cc:2804] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader election won for term 8
W20260709 14:51:51.521957  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 146081us
I20260709 14:51:51.523450  7894 leader_election.cc:304] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:51:51.505496 10651 raft_consensus.cc:697] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:51.493826 10675 raft_consensus.cc:515] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:51.487658 10713 raft_consensus.cc:515] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:51.536397  7894 leader_election.cc:304] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:51:51.533434 10689 raft_consensus.cc:697] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:51:51.506217 10634 raft_consensus.cc:515] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:51.544582  7894 leader_election.cc:304] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:51:51.533396 10708 raft_consensus.cc:2804] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 14:51:51.545611 10726 log.cc:927] Time spent T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.083s	user 0.002s	sys 0.000s
W20260709 14:51:51.560271  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 101714us
I20260709 14:51:51.532516 10582 consensus_queue.cc:1048] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 14:51:51.530443 10571 consensus_queue.cc:1048] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 14:51:51.539222 10706 raft_consensus.cc:697] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:51:51.555037 10708 raft_consensus.cc:493] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:51.575583  7744 leader_election.cc:304] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 9418391fa82a42c79c6cad13ba91d964
I20260709 14:51:51.568147 10712 raft_consensus.cc:2804] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 14:51:51.576152 10708 raft_consensus.cc:3060] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 14:51:51.545727 10689 consensus_queue.cc:237] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:51.579607 10536 raft_consensus.cc:2804] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 14:51:51.573426 10731 raft_consensus.cc:2804] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 14:51:51.598582 10536 raft_consensus.cc:493] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:51.586687 10650 leader_election.cc:290] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 9 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:51.585507 10712 raft_consensus.cc:493] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:51.593080 10737 raft_consensus.cc:2804] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 14:51:51.629212  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 55071.8us
I20260709 14:51:51.598953 10633 leader_election.cc:290] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 9 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:51.602411 10731 raft_consensus.cc:493] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:51.633443 10731 raft_consensus.cc:3060] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:51:51.625466 10712 raft_consensus.cc:3060] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Advancing to term 8
W20260709 14:51:51.642937  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:51.613912 10536 raft_consensus.cc:3060] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:51:51.582886 10651 consensus_queue.cc:237] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:51.647156  7744 leader_election.cc:304] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:51.656879  7744 leader_election.cc:304] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:51.607071 10652 consensus_queue.cc:1059] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 14:51:51.631898 10737 raft_consensus.cc:493] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:51.661972 10744 consensus_queue.cc:1048] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 14:51:51.663154 10745 consensus_queue.cc:1048] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 14:51:51.665798 10675 leader_election.cc:290] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:51.647761 10716 leader_election.cc:290] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:51.685645 10645 raft_consensus.cc:515] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:51.686337 10675 raft_consensus.cc:3060] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:51:51.686614 10716 raft_consensus.cc:2749] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 14:51:51.667539 10733 log.cc:927] Time spent T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
W20260709 14:51:51.647847 10723 log.cc:927] Time spent T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.178s	user 0.004s	sys 0.000s
I20260709 14:51:51.688565 10645 leader_election.cc:290] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 5 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:51.669142 10624 raft_consensus.cc:515] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:51.632771 10649 leader_election.cc:290] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 9 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:51.629750 10718 consensus_queue.cc:1048] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 14:51:51.714747 10652 raft_consensus.cc:3055] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 14:51:51.715566 10652 raft_consensus.cc:740] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:51.715579 10675 raft_consensus.cc:2749] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 14:51:51.646240 10706 consensus_queue.cc:237] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:51.654495 10735 raft_consensus.cc:2749] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 14:51:51.668432 10634 leader_election.cc:290] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 8 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:51.675894 10737 raft_consensus.cc:3060] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Advancing to term 8
I20260709 14:51:51.678161 10713 leader_election.cc:290] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:51:51.731588  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 187418us
I20260709 14:51:51.713229 10624 leader_election.cc:290] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:51.765380 10745 consensus_queue.cc:1059] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 14:51:51.769382  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:51.775559 10704 raft_consensus.cc:515] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:51.773602 10730 raft_consensus.cc:3055] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 14:51:51.778427 10730 raft_consensus.cc:740] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:51.778112 10582 consensus_queue.cc:1048] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 14:51:51.779448 10730 consensus_queue.cc:260] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:51.780767 10730 raft_consensus.cc:3060] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:51:51.716979 10652 consensus_queue.cc:260] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:51.794632 10704 leader_election.cc:290] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 10 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:51.802155 10652 raft_consensus.cc:3060] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:51:51.802461 10731 raft_consensus.cc:515] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:51.805964 10745 raft_consensus.cc:493] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:51.806663 10745 raft_consensus.cc:515] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:51.808584  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:51.809190 10745 leader_election.cc:290] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:51.811705  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:51.815831  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c563cc7cfbe4d59be4ffc5cf847ce56" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:51.816715  7920 raft_consensus.cc:2468] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 7.
I20260709 14:51:51.817207  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:51.817993  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:51.817799  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:51.818742  7925 raft_consensus.cc:3055] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 14:51:51.818410  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:51.818076  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:51.819111  7925 raft_consensus.cc:740] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:51.808899 10710 raft_consensus.cc:515] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:51.819483  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:51.827260  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:51.821641  7925 consensus_queue.cc:260] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:51.829769  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:51.830312  7925 raft_consensus.cc:3060] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Advancing to term 6
W20260709 14:51:51.831699  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:51:51.832213  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:51.835865  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:51.835706  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:51.836972  7922 raft_consensus.cc:3060] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:51:51.835706  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:51.837725  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:51.838083  7924 raft_consensus.cc:2393] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 9: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:51:51.840969  7851 raft_consensus.cc:1240] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 10. Current term is 11. Ops: []
I20260709 14:51:51.841622 10712 raft_consensus.cc:515] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:51.843605  7849 raft_consensus.cc:1275] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 14:51:51.844302  7849 pending_rounds.cc:85] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting all ops after (but not including) 5
I20260709 14:51:51.846232  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:51.847389  7848 raft_consensus.cc:2393] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 8: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:51:51.844779  7849 pending_rounds.cc:107] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting uncommitted NO_OP operation due to leader change: 7.6
I20260709 14:51:51.848278  7849 raft_consensus.cc:2889] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:51:51.805135 10731 leader_election.cc:290] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:51:51.850404  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 300539us
I20260709 14:51:51.854080  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:51.857437  7921 raft_consensus.cc:2468] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 9.
I20260709 14:51:51.860359  7845 raft_consensus.cc:1240] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 14:51:51.870200  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:51.870772  7848 raft_consensus.cc:1240] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 8. Current term is 9. Ops: []
I20260709 14:51:51.871206  7853 raft_consensus.cc:2410] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 14:51:51.820701 10536 raft_consensus.cc:515] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:51.880467  7854 raft_consensus.cc:1275] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 14:51:51.881392  7851 raft_consensus.cc:1240] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 14:51:51.891049  7854 pending_rounds.cc:85] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting all ops after (but not including) 4
I20260709 14:51:51.891393  7854 pending_rounds.cc:107] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 14:51:51.891649  7854 raft_consensus.cc:2889] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:51:51.883641  7852 raft_consensus.cc:1240] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 5. Current term is 6. Ops: []
I20260709 14:51:51.885084  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
W20260709 14:51:51.888394  7893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:51.811604 10708 raft_consensus.cc:515] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:51.896173  7847 raft_consensus.cc:1275] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 14:51:51.882122  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:51.894667  7845 raft_consensus.cc:2393] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 9: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
W20260709 14:51:51.894855  7893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:51.902101  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
W20260709 14:51:51.906239  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 249464us
I20260709 14:51:51.908278  7744 leader_election.cc:304] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:51.908933  7923 raft_consensus.cc:2393] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 7: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:51:51.910866  7849 raft_consensus.cc:1240] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 14:51:51.911041  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:51.913065  7847 raft_consensus.cc:1240] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 6. Current term is 7. Ops: []
I20260709 14:51:51.914951  7852 raft_consensus.cc:1275] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 14:51:51.917870  7853 raft_consensus.cc:1240] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 14:51:51.848513 10737 raft_consensus.cc:515] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:51.915759  7744 leader_election.cc:304] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:51:51.921770  7849 raft_consensus.cc:1240] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 14:51:51.913296 10731 raft_consensus.cc:2749] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 14:51:51.925184  7674 catalog_manager.cc:5697] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 7 to 8, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 8 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:51:51.926370 10536 leader_election.cc:290] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 7 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:51.929177  7674 catalog_manager.cc:5697] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:51:51.928324 10713 consensus_queue.cc:1048] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 14:51:51.927205 10624 raft_consensus.cc:2804] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 14:51:51.933811 10624 raft_consensus.cc:493] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:51.934226 10624 raft_consensus.cc:3060] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:51:51.936932  7925 raft_consensus.cc:2468] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 6.
I20260709 14:51:51.940218  7674 catalog_manager.cc:5697] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 7 to 8, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 8 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:51:51.944244 10737 leader_election.cc:290] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:51.945909 10710 leader_election.cc:290] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 7 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:51.951143  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:51.949353  7674 catalog_manager.cc:5697] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:51:51.954540  7921 raft_consensus.cc:2393] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 8: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:51:51.959244  7850 raft_consensus.cc:2468] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 5.
I20260709 14:51:51.970438  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:51.974711  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:51.974922  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:51.976702  7775 raft_consensus.cc:1275] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 14:51:51.974069  7922 raft_consensus.cc:2468] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 9.
I20260709 14:51:51.978113  7852 raft_consensus.cc:1240] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 6. Current term is 7. Ops: []
I20260709 14:51:51.976529  7779 raft_consensus.cc:1275] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 14:51:51.983511  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:51.984431  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:51.987314  7773 raft_consensus.cc:2393] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 8: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:51:51.989468  7772 raft_consensus.cc:2410] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 14:51:51.991015  7850 raft_consensus.cc:1240] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 9. Current term is 10. Ops: []
I20260709 14:51:51.991254  7776 raft_consensus.cc:2393] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 5: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
W20260709 14:51:51.994762  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:51.928712 10675 consensus_queue.cc:1048] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 14:51:51.996430  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:52.002579  7854 raft_consensus.cc:3060] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:51:52.008935  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:52.010082  7925 raft_consensus.cc:2393] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 10: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:51:52.009910  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:52.010499  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:52.011031  7919 raft_consensus.cc:2468] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 5.
I20260709 14:51:52.012033  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:52.012954  7928 raft_consensus.cc:2393] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 9: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:51:52.013499  7926 raft_consensus.cc:2393] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 9: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
W20260709 14:51:52.015354  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:52.021607  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:52.022830  7772 raft_consensus.cc:2468] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 8.
I20260709 14:51:52.026163  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:52.026923  7920 raft_consensus.cc:2468] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 10.
I20260709 14:51:52.027230  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:52.028012  7924 raft_consensus.cc:2468] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 8.
I20260709 14:51:51.995819 10747 raft_consensus.cc:493] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:52.029739  7921 raft_consensus.cc:1240] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 14:51:52.030328  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:52.031443  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:51.970041 10730 consensus_queue.cc:1048] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 14:51:52.036149  7927 raft_consensus.cc:3060] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Advancing to term 5
W20260709 14:51:52.036339  7745 leader_election.cc:336] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 1.599s (SENT)
I20260709 14:51:52.038421  7745 leader_election.cc:304] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:52.032804  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:51.996943 10536 consensus_queue.cc:1048] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 14:51:52.054565  7772 raft_consensus.cc:1275] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 14:51:52.065084 10706 consensus_queue.cc:1059] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 14:51:52.066164 10706 raft_consensus.cc:3055] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 LEADER]: Stepping down as leader of term 7
I20260709 14:51:52.066462 10708 leader_election.cc:290] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:52.066519 10706 raft_consensus.cc:740] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
W20260709 14:51:52.068753 10756 log.cc:927] Time spent T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.098s	user 0.000s	sys 0.001s
I20260709 14:51:52.071602 10712 leader_election.cc:290] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:52.068564 10706 consensus_queue.cc:260] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:52.073540  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:52.074427 10706 raft_consensus.cc:3060] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Advancing to term 8
I20260709 14:51:52.075249  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c563cc7cfbe4d59be4ffc5cf847ce56" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:52.075980  7772 raft_consensus.cc:2468] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 7.
I20260709 14:51:52.077397 10742 raft_consensus.cc:493] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:52.072772  7927 raft_consensus.cc:2468] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 5.
I20260709 14:51:52.078220 10704 consensus_queue.cc:1059] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 14:51:52.078159 10742 raft_consensus.cc:515] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:52.079487  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:52.080168  7772 raft_consensus.cc:3060] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:51:52.080837 10742 leader_election.cc:290] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:52.081465 10749 consensus_queue.cc:1059] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 14:51:52.081506 10689 consensus_queue.cc:1059] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 14:51:52.082408 10749 raft_consensus.cc:3055] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 LEADER]: Stepping down as leader of term 6
I20260709 14:51:52.083149 10749 raft_consensus.cc:740] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:51:52.083365 10645 raft_consensus.cc:3055] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 LEADER]: Stepping down as leader of term 10
I20260709 14:51:52.083801 10645 raft_consensus.cc:740] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:51:52.081789 10704 raft_consensus.cc:3055] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 LEADER]: Stepping down as leader of term 7
I20260709 14:51:52.084372 10704 raft_consensus.cc:740] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:51:52.084127 10749 consensus_queue.cc:260] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:52.085498 10749 raft_consensus.cc:3060] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:51:52.085232 10704 consensus_queue.cc:260] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:52.086544 10704 raft_consensus.cc:3060] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Advancing to term 8
I20260709 14:51:52.088595  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:52.090338  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:52.093335  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:52.095840  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:52.111163  7845 raft_consensus.cc:3060] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Advancing to term 8
I20260709 14:51:52.112417  7772 raft_consensus.cc:2468] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 6.
I20260709 14:51:52.088864 10710 raft_consensus.cc:493] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:52.101521  7819 leader_election.cc:304] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:52.083966 10728 raft_consensus.cc:993] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0: : Instructing follower 1de5e20126fa4d8ca0793d19c7b847ed to start an election
I20260709 14:51:52.102177  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:52.105286 10645 consensus_queue.cc:260] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:52.166208  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:52.106570 10748 consensus_queue.cc:1059] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 14:51:52.107331 10650 raft_consensus.cc:493] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:52.123844  7854 raft_consensus.cc:2468] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 7.
I20260709 14:51:52.113791  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:52.165093  7848 raft_consensus.cc:3060] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Advancing to term 8
W20260709 14:51:52.165217  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 55768.2us
I20260709 14:51:52.053198 10713 raft_consensus.cc:2749] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 14:51:52.168763  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:52.166108  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:52.175623  7845 raft_consensus.cc:2468] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 8.
I20260709 14:51:52.180932  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:52.167263  7744 leader_election.cc:304] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:51:52.042071 10747 raft_consensus.cc:515] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:52.188585  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 87521.6us
I20260709 14:51:52.189797  7819 leader_election.cc:304] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:51:52.156278 10536 raft_consensus.cc:493] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:52.194108  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:52.200677  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783e4874513449ef9084b833f188a6d3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:52.202708  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:52.206794  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:52.202732  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:52.207685  7776 raft_consensus.cc:2468] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 9.
I20260709 14:51:52.191735 10742 raft_consensus.cc:2804] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 14:51:52.212203  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:52.213681  7776 raft_consensus.cc:2393] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 6: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:51:52.183564  7744 leader_election.cc:304] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:51:52.192142 10748 consensus_queue.cc:1243] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer 3876b8ee8d744cb18e91d97aae93b1ac log is divergent from this leader: its last log entry 8.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 14:51:52.218202 10737 raft_consensus.cc:2804] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 14:51:52.218734 10737 raft_consensus.cc:493] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:52.219126 10737 raft_consensus.cc:3060] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:51:52.209153 10708 raft_consensus.cc:1081] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 LEADER]: Signalling peer 1de5e20126fa4d8ca0793d19c7b847ed to start an election
I20260709 14:51:52.166626 10710 raft_consensus.cc:515] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:52.176725 10745 consensus_queue.cc:1059] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 14:51:52.201144 10645 raft_consensus.cc:3060] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:51:52.228502  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:52.235457  7772 raft_consensus.cc:1240] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 10. Current term is 11. Ops: []
I20260709 14:51:52.199361 10634 raft_consensus.cc:2804] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 14:51:52.216666 10571 consensus_queue.cc:1048] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 14:51:52.227311  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:52.238385  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:52.243013  7778 raft_consensus.cc:2393] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 9: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:51:52.215548  7744 leader_election.cc:304] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:51:52.239410  7848 raft_consensus.cc:2468] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 8.
I20260709 14:51:52.187638 10650 raft_consensus.cc:515] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:52.227275 10742 raft_consensus.cc:493] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 14:51:52.263026  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 73388.5us
I20260709 14:51:52.264075  7819 leader_election.cc:304] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:52.209481 10536 raft_consensus.cc:515] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:52.210873 10712 consensus_queue.cc:1059] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.047s
W20260709 14:51:52.280216  7745 leader_election.cc:336] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 1.805s (SENT)
I20260709 14:51:52.282177  7745 leader_election.cc:304] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:52.240834 10634 raft_consensus.cc:493] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:52.256026 10713 raft_consensus.cc:2804] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 14:51:52.287889  7745 leader_election.cc:336] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 1.810s (SENT)
I20260709 14:51:52.288578  7745 leader_election.cc:304] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:52.269801 10742 raft_consensus.cc:3060] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:51:52.299796 10650 leader_election.cc:290] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:52.302292 10536 leader_election.cc:290] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:52.306210 10747 leader_election.cc:290] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:52.277874 10746 consensus_queue.cc:1048] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 14:51:52.307264 10752 raft_consensus.cc:3055] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 14:51:52.307735 10752 raft_consensus.cc:740] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:52.275218 10683 consensus_queue.cc:1048] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 14:51:52.308060 10735 raft_consensus.cc:2749] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 14:51:52.309427 10752 consensus_queue.cc:260] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:52.306874 10712 consensus_queue.cc:1048] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 14:51:52.312556 10689 raft_consensus.cc:2749] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 14:51:52.277616 10731 consensus_queue.cc:1059] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 14:51:52.311338 10752 raft_consensus.cc:3060] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:51:52.313751 10731 raft_consensus.cc:3055] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 LEADER]: Stepping down as leader of term 6
I20260709 14:51:52.314183 10731 raft_consensus.cc:740] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:51:52.317052  7894 leader_election.cc:304] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
W20260709 14:51:52.324602  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:52.286098 10634 raft_consensus.cc:3060] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:51:52.275767 10651 consensus_queue.cc:1059] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 14:51:52.332495 10651 raft_consensus.cc:3055] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 14:51:52.333000 10651 raft_consensus.cc:740] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:52.334959 10731 consensus_queue.cc:260] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:52.315075 10675 raft_consensus.cc:2749] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 14:51:52.336805 10731 raft_consensus.cc:3060] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:51:52.322594 10536 consensus_queue.cc:1059] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 14:51:52.337652 10649 raft_consensus.cc:493] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:52.338902 10536 raft_consensus.cc:3055] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 14:51:52.339382 10536 raft_consensus.cc:740] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:52.292353 10713 raft_consensus.cc:493] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:52.340139 10713 raft_consensus.cc:3060] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:51:52.307762 10730 raft_consensus.cc:3055] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 14:51:52.341559 10730 raft_consensus.cc:740] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:52.342756 10730 consensus_queue.cc:260] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:52.344264 10730 raft_consensus.cc:3060] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:51:52.329879 10746 raft_consensus.cc:2804] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 14:51:52.349562 10746 raft_consensus.cc:697] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:52.316037 10745 consensus_queue.cc:1059] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.054s
I20260709 14:51:52.338600 10649 raft_consensus.cc:515] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:52.350893 10746 consensus_queue.cc:237] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:52.322888 10708 consensus_queue.cc:1059] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 14:51:52.354719 10708 raft_consensus.cc:3055] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 14:51:52.340409 10536 consensus_queue.cc:260] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:52.306360 10710 leader_election.cc:290] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:52.281576 10652 consensus_queue.cc:1059] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.048s
I20260709 14:51:52.355386 10708 raft_consensus.cc:740] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:52.354684 10649 leader_election.cc:290] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:51:52.368696  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 82858.8us
I20260709 14:51:52.370007  7744 leader_election.cc:304] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
W20260709 14:51:52.388969  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:52.378335 10675 raft_consensus.cc:2804] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader election won for term 5
I20260709 14:51:52.414115 10708 consensus_queue.cc:260] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:52.415988 10708 raft_consensus.cc:3060] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:51:52.388796 10536 raft_consensus.cc:3060] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Advancing to term 8
W20260709 14:51:52.428272  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 109704us
W20260709 14:51:52.441387  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 71612.8us
I20260709 14:51:52.444574  7926 raft_consensus.cc:1240] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 14:51:52.444909  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:52.458227  7919 raft_consensus.cc:2393] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 8: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
W20260709 14:51:52.462460  7745 leader_election.cc:336] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 2.007s (SENT)
I20260709 14:51:52.463325  7745 leader_election.cc:304] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:52.428670 10675 raft_consensus.cc:697] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:51:52.376359 10651 consensus_queue.cc:260] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:52.459841 10747 raft_consensus.cc:493] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:51:52.491080 10624 consensus_meta.cc:287] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent flushing consensus metadata: real 0.556s	user 0.008s	sys 0.007s
I20260709 14:51:52.485113 10749 raft_consensus.cc:2749] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 14:51:52.526345  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 205896us
W20260709 14:51:52.531378  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 55589.7us
I20260709 14:51:52.532618  7893 leader_election.cc:304] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:51:52.532685  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:51:52.537453  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 273496us
I20260709 14:51:52.538592  7819 leader_election.cc:304] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
W20260709 14:51:52.548378  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 85974.5us
W20260709 14:51:52.549425  7745 leader_election.cc:336] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 2.019s (SENT)
I20260709 14:51:52.550040  7745 leader_election.cc:304] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:52.541572 10651 raft_consensus.cc:3060] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:51:52.529484 10624 raft_consensus.cc:515] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:52.575018  7819 leader_election.cc:304] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:52.551404 10735 raft_consensus.cc:2749] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 14:51:52.527746 10747 raft_consensus.cc:515] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:52.592615  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258d6c2dda954bf5b65930fde8ecb9f3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:52.603071  7776 raft_consensus.cc:2468] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 5.
I20260709 14:51:52.606062  7819 leader_election.cc:304] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:52.590948 10742 raft_consensus.cc:515] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:52.576797 10652 consensus_queue.cc:1059] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 14:51:52.551738 10775 raft_consensus.cc:2749] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 14:51:52.578382 10788 consensus_queue.cc:1059] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 14:51:52.611644 10649 raft_consensus.cc:2749] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 14:51:52.595552 10624 leader_election.cc:290] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:52.596530 10748 raft_consensus.cc:3055] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 14:51:52.596984  7774 raft_consensus.cc:2393] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 9: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:51:52.537149 10650 consensus_queue.cc:1048] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 14:51:52.541932 10571 consensus_queue.cc:1048] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
W20260709 14:51:52.598114 10704 consensus_meta.cc:287] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent flushing consensus metadata: real 0.511s	user 0.015s	sys 0.000s
I20260709 14:51:52.581745 10712 raft_consensus.cc:3055] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 14:51:52.609623 10749 raft_consensus.cc:493] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:51:52.630074  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:51:52.626623  7745 leader_election.cc:336] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 2.065s (SENT)
I20260709 14:51:52.573124 10728 raft_consensus.cc:2749] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 14:51:52.620357  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 77507us
W20260709 14:51:52.617952 10774 log.cc:927] Time spent T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.402s	user 0.000s	sys 0.005s
W20260709 14:51:52.641425  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 108912us
W20260709 14:51:52.618372 10768 log.cc:927] Time spent T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.212s	user 0.002s	sys 0.000s
W20260709 14:51:52.647296  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:52.650141  7745 leader_election.cc:304] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:52.621188 10748 raft_consensus.cc:740] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:52.617110  7819 leader_election.cc:304] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
W20260709 14:51:52.623216 10784 log.cc:927] Time spent T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 14:51:52.570946 10675 consensus_queue.cc:237] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:52.705401 10789 raft_consensus.cc:3055] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 14:51:52.706115 10789 raft_consensus.cc:740] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:52.611042 10710 consensus_queue.cc:1048] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 14:51:52.707091 10789 consensus_queue.cc:260] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:52.690347  7893 leader_election.cc:304] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:52.689975  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:52.714098  7893 leader_election.cc:304] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:52.625824 10712 raft_consensus.cc:740] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:52.694182  7819 leader_election.cc:304] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:52.721467  7819 leader_election.cc:304] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
W20260709 14:51:52.695016  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 52683.9us
I20260709 14:51:52.621229 10634 raft_consensus.cc:515] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:52.649322 10624 raft_consensus.cc:2749] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 14:51:52.624346 10649 raft_consensus.cc:2749] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 14:51:52.708220 10710 consensus_queue.cc:1243] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer 1e9289592458429bbddb19c2e7b7b7b0 log is divergent from this leader: its last log entry 7.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 14:51:52.660992 10704 raft_consensus.cc:2749] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 14:51:52.701227 10777 log.cc:927] Time spent T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 14:51:52.650202 10749 raft_consensus.cc:515] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:52.714720 10789 raft_consensus.cc:3060] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:51:52.652375 10737 raft_consensus.cc:515] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:52.726377 10781 raft_consensus.cc:2749] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 14:51:52.717103 10747 leader_election.cc:290] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:52.742810  7819 leader_election.cc:304] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
W20260709 14:51:52.734520  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:51:52.729298  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 103106us
I20260709 14:51:52.736950 10780 raft_consensus.cc:2749] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 14:51:52.763996  7745 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:52.766273  7819 leader_election.cc:304] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:52.740625  7776 raft_consensus.cc:2468] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 8.
I20260709 14:51:52.764489  7779 raft_consensus.cc:1275] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 14:51:52.769009  7777 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b"
dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:37144
I20260709 14:51:52.770228  7819 leader_election.cc:304] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:52.739140 10742 leader_election.cc:290] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:52.776420  7819 leader_election.cc:304] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
W20260709 14:51:52.782776  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:52.727669 10794 raft_consensus.cc:2749] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 14:51:52.787856  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:52.788969  7849 raft_consensus.cc:2468] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 8.
I20260709 14:51:52.791132  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:52.799226  7849 raft_consensus.cc:2393] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 9: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:51:52.801594  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:52.804327  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:52.805581  7853 raft_consensus.cc:2393] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 9: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:51:52.808101  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:52.809208  7853 raft_consensus.cc:2410] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 14:51:52.811933  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:52.814003  7849 raft_consensus.cc:1240] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 6. Current term is 7. Ops: []
I20260709 14:51:52.815718  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:52.816733  7847 raft_consensus.cc:2393] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 9: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:51:52.768150 10649 raft_consensus.cc:2804] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 14:51:52.766129 10624 raft_consensus.cc:493] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:52.768414 10683 raft_consensus.cc:3055] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 14:51:52.771795 10704 raft_consensus.cc:2804] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader election won for term 9
W20260709 14:51:52.831529  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 89571.5us
I20260709 14:51:52.838416  7777 raft_consensus.cc:493] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:51:52.841358  7777 raft_consensus.cc:3060] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:51:52.840754  7894 leader_election.cc:304] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:51:52.842952  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:52.823685 10710 raft_consensus.cc:2804] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader election won for term 6
I20260709 14:51:52.785713 10791 raft_consensus.cc:493] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:52.828856 10781 raft_consensus.cc:2804] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader election won for term 9
I20260709 14:51:52.851613  7847 raft_consensus.cc:2468] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 5.
I20260709 14:51:52.853011  7894 leader_election.cc:304] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:52.853719 10801 raft_consensus.cc:2804] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 14:51:52.741982 10748 consensus_queue.cc:260] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:52.858997  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c563cc7cfbe4d59be4ffc5cf847ce56" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:52.860211  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:52.862107  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:52.862635  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:52.862854  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:52.861991  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:52.863602  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:52.864298  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9441e831627143a991a1556dcdce71e3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:52.821584 10634 leader_election.cc:290] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 5 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:52.875250  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:51:52.876014  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:52.830895 10649 raft_consensus.cc:493] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:52.908469  7848 raft_consensus.cc:2393] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 5: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:51:52.840504 10683 raft_consensus.cc:740] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:52.883819 10797 raft_consensus.cc:2804] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 14:51:52.884594  7819 service_pool.cc:136] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:49948 dropped due to backpressure: service queue is full with 50 items
W20260709 14:51:52.886653 10783 log.cc:927] Time spent T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
W20260709 14:51:52.887738 10779 log.cc:927] Time spent T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.225s	user 0.000s	sys 0.001s
I20260709 14:51:52.892552  7894 leader_election.cc:304] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:52.909778  7851 raft_consensus.cc:2393] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 8: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:51:52.888762 10704 raft_consensus.cc:697] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:51:52.903985  7845 raft_consensus.cc:2393] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 11: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:51:52.784729 10712 consensus_queue.cc:260] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:52.915102  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:52.908711 10794 raft_consensus.cc:2804] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 14:51:52.929522  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:52.900348 10710 raft_consensus.cc:697] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:51:52.936405  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:52.843313 10624 raft_consensus.cc:515] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:52.919600  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:52.842233 10713 raft_consensus.cc:515] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:52.947535  7853 raft_consensus.cc:2393] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 7: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:51:52.924968  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:52.932394 10792 raft_consensus.cc:493] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:52.928023  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:52.915575 10781 raft_consensus.cc:697] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:51:52.953642 10735 raft_consensus.cc:2749] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 14:51:52.928076 10708 raft_consensus.cc:2804] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 14:51:52.957041 10708 raft_consensus.cc:697] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:52.958340 10794 raft_consensus.cc:697] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:52.914979 10649 raft_consensus.cc:3060] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Advancing to term 8
W20260709 14:51:52.958956 10795 log.cc:927] Time spent T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 14:51:52.960191 10683 consensus_queue.cc:260] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:52.920826 10748 raft_consensus.cc:3060] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:51:52.961694 10683 raft_consensus.cc:3060] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:51:52.919569  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:52.924043  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:52.923684  6549 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 14:51:52.935205  7850 raft_consensus.cc:2410] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 14:51:52.951421  7851 raft_consensus.cc:2393] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 10: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:51:52.953473  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:51:52.953884  7894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:51:52.964190  7894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:52.913223  7777 raft_consensus.cc:515] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:52.914199 10801 raft_consensus.cc:697] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:52.964006  7846 raft_consensus.cc:2468] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 8.
I20260709 14:51:52.914448 10797 raft_consensus.cc:493] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 14:51:52.925549  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 182802us
I20260709 14:51:52.965802  7847 raft_consensus.cc:2410] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 14:51:52.900028 10791 raft_consensus.cc:515] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:52.964651  7894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:52.989437 10571 consensus_queue.cc:1048] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 14:51:52.993060 10731 consensus_meta.cc:287] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent flushing consensus metadata: real 0.631s	user 0.011s	sys 0.000s
I20260709 14:51:52.994194 10794 consensus_queue.cc:237] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:52.995342 10730 consensus_meta.cc:287] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0: Time spent flushing consensus metadata: real 0.650s	user 0.011s	sys 0.006s
I20260709 14:51:52.962040 10704 consensus_queue.cc:237] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:52.971091 10797 raft_consensus.cc:3060] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:51:53.008775 10802 raft_consensus.cc:493] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:53.009617 10802 raft_consensus.cc:515] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:53.012486 10802 leader_election.cc:290] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:53.014816  7893 leader_election.cc:304] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:51:53.015533 10728 raft_consensus.cc:3055] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 14:51:53.016103 10728 raft_consensus.cc:740] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:53.017484 10746 raft_consensus.cc:2804] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 14:51:53.017997 10746 raft_consensus.cc:493] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:53.018419 10746 raft_consensus.cc:3060] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:51:52.965704 10792 raft_consensus.cc:515] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:53.026228 10792 leader_election.cc:290] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:51:53.028676 10805 log.cc:927] Time spent T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 14:51:53.036645  7893 leader_election.cc:304] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:53.040500 10801 consensus_queue.cc:237] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:53.042614 10786 log.cc:927] Time spent T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.353s	user 0.006s	sys 0.000s
I20260709 14:51:53.050455 10710 consensus_queue.cc:237] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:53.031070 10712 raft_consensus.cc:3060] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:51:52.958416 10708 consensus_queue.cc:237] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:53.003188 10749 leader_election.cc:290] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:53.067546 10624 leader_election.cc:290] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:53.074162 10737 leader_election.cc:290] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:51:53.074100  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:53.073518  7777 leader_election.cc:290] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:53.077732 10713 leader_election.cc:290] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:53.080407  7893 leader_election.cc:304] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:51:53.080871 10788 consensus_queue.cc:1048] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 14:51:52.956223 10781 consensus_queue.cc:237] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:53.086494 10803 raft_consensus.cc:493] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:51:53.094725  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:53.095063  7675 catalog_manager.cc:5697] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 9 to 10, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 10 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:51:52.915776  7819 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:49948 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49946 (request call id 2696)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3059)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3060)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3062)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3051)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3066)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3057)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3067)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3041)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3042)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3068)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3070)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3061)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3043)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3044)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3065)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3045)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3054)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3050)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3078)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3047)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3072)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3055)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3073)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3074)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3052)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3075)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3053)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3035)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49946 (request call id 2697)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3037)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3030)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3069)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3071)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3029)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3046)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3076)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3033)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3077)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3049)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49948 (request call id 3038)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49948 (request call id 3039)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49948 (request call id 3048)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 2695)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 2698)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 2699)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 2700)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 2701)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 2702)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 2703)
I20260709 14:51:53.089591 10802 raft_consensus.cc:2749] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 14:51:53.115468 10788 raft_consensus.cc:2804] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 14:51:53.133597  7675 catalog_manager.cc:5697] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 7 to 8, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 8 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:51:53.141714  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:53.142546  7845 raft_consensus.cc:2468] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 5.
I20260709 14:51:53.142562  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:53.143821  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:53.144498  7851 raft_consensus.cc:2468] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 8.
I20260709 14:51:53.155632  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:53.158957  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258d6c2dda954bf5b65930fde8ecb9f3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:53.160255  7854 raft_consensus.cc:2410] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 14:51:53.160115  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:53.161180  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:53.161769  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:53.162227  7847 raft_consensus.cc:2393] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 9: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:51:53.169323  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:53.087637 10803 raft_consensus.cc:515] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:53.141855 10788 raft_consensus.cc:493] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:53.017113 10728 consensus_queue.cc:260] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:53.162617  7770 raft_consensus.cc:2468] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 6.
W20260709 14:51:53.187206  7745 leader_election.cc:336] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 1.515s (SENT)
I20260709 14:51:53.187985  7745 leader_election.cc:304] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:53.192848 10731 raft_consensus.cc:3060] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:51:53.193987 10803 leader_election.cc:290] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:53.197404  7919 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
mode: GRACEFUL
new_leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:48676
I20260709 14:51:53.198163  7919 raft_consensus.cc:606] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 LEADER]: Received request to transfer leadership to TS 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:51:53.205921 10731 raft_consensus.cc:2749] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 14:51:53.136067 10713 consensus_queue.cc:1059] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
W20260709 14:51:53.214275 10778 log.cc:927] Time spent T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.269s	user 0.005s	sys 0.000s
I20260709 14:51:53.210126 10797 raft_consensus.cc:515] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:53.232206 10797 leader_election.cc:290] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 9 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:53.232856 10803 raft_consensus.cc:493] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:53.233397 10803 raft_consensus.cc:515] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:53.234817  7919 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
mode: GRACEFUL
new_leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:48676
I20260709 14:51:53.235442  7919 raft_consensus.cc:606] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Received request to transfer leadership to TS 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:51:53.235787  7919 raft_consensus.cc:614] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 14:51:53.241750 10803 leader_election.cc:290] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:53.246055 10735 raft_consensus.cc:3055] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 LEADER]: Stepping down as leader of term 7
W20260709 14:51:53.246634 10536 consensus_meta.cc:287] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0: Time spent flushing consensus metadata: real 0.806s	user 0.014s	sys 0.000s
I20260709 14:51:53.246702 10735 raft_consensus.cc:740] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:51:53.247730 10735 consensus_queue.cc:260] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:53.177850 10788 raft_consensus.cc:3060] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:51:53.255265  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:53.251499 10582 raft_consensus.cc:493] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:53.257324  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:53.258674  7927 raft_consensus.cc:2393] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 9: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:51:53.249018 10735 raft_consensus.cc:3060] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Advancing to term 8
I20260709 14:51:53.248744 10746 raft_consensus.cc:515] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:53.262633  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:53.265795  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:53.266505  7928 raft_consensus.cc:3060] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:51:53.269609  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:53.251971 10744 raft_consensus.cc:493] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:51:53.275416  7745 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:53.272046  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: true dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:53.271554  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:53.275946  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:53.276780  7847 raft_consensus.cc:2393] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 8: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:51:53.277760  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:53.277925  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:53.278651  7924 raft_consensus.cc:3060] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:51:53.284243  7919 raft_consensus.cc:1240] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 LEADER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 14:51:53.287020  7779 raft_consensus.cc:1275] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 14:51:53.287820  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:53.283918  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:53.288635  7846 raft_consensus.cc:2393] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 5: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:51:53.286221  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:53.289688  7927 raft_consensus.cc:3060] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:51:53.288867  7772 raft_consensus.cc:2468] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 7.
I20260709 14:51:53.297235  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
W20260709 14:51:53.297991  7743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:53.301596  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:53.300081  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:53.262398 10582 raft_consensus.cc:515] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:53.305158  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:53.291944 10536 raft_consensus.cc:493] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:51:53.325049  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:51:53.339341  7745 leader_election.cc:336] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 1.530s (SENT)
I20260709 14:51:53.340238  7745 leader_election.cc:304] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:51:53.369557  7745 leader_election.cc:336] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 2.929s (SENT)
I20260709 14:51:53.371567  7925 raft_consensus.cc:2468] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 9.
I20260709 14:51:53.373670  7744 leader_election.cc:304] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:51:53.374938 10713 raft_consensus.cc:2804] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader election won for term 9
I20260709 14:51:53.375509 10713 raft_consensus.cc:697] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:51:53.376027  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:53.376924  7850 raft_consensus.cc:2393] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 10: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:51:53.278328 10744 raft_consensus.cc:515] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:53.299826 10731 consensus_queue.cc:1059] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.094s
I20260709 14:51:53.376412 10713 consensus_queue.cc:237] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:53.378321  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:53.381659  7927 raft_consensus.cc:2468] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 6.
I20260709 14:51:53.394034  7846 raft_consensus.cc:2468] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 8.
I20260709 14:51:53.406838  7893 leader_election.cc:304] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:51:53.413591  7850 raft_consensus.cc:3060] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:51:53.396312  7921 raft_consensus.cc:2468] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 9.
I20260709 14:51:53.383111  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:53.388880  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:53.416270  7847 raft_consensus.cc:3060] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:51:53.416445  7775 raft_consensus.cc:2468] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 8.
W20260709 14:51:53.413607  7894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:51:53.417491  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 47983.6us
W20260709 14:51:53.419042  7745 leader_election.cc:336] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 1.565s (SENT)
I20260709 14:51:53.419778  7745 leader_election.cc:304] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:51:53.421353  7745 leader_election.cc:336] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 1.598s (SENT)
I20260709 14:51:53.422024  7745 leader_election.cc:304] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:53.423545  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
W20260709 14:51:53.385685 10776 log.cc:927] Time spent T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 14:51:53.426074 10742 raft_consensus.cc:2749] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 14:51:53.394747 10536 raft_consensus.cc:515] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:53.431234 10746 leader_election.cc:290] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:51:53.427657 10818 log.cc:927] Time spent T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.183s	user 0.000s	sys 0.002s
I20260709 14:51:53.433737 10704 raft_consensus.cc:493] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:53.424610  7776 raft_consensus.cc:2468] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 8.
I20260709 14:51:53.383044 10582 leader_election.cc:290] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:53.381161 10744 leader_election.cc:290] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:53.453851 10704 raft_consensus.cc:515] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:53.420966 10731 consensus_queue.cc:1243] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer 1e9289592458429bbddb19c2e7b7b7b0 log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 14:51:53.454895 10536 leader_election.cc:290] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:53.456343 10704 leader_election.cc:290] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:53.442912 10713 raft_consensus.cc:3060] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Advancing to term 8
I20260709 14:51:53.387027 10791 leader_election.cc:290] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:53.367841 10737 raft_consensus.cc:2749] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 14:51:53.450096  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c563cc7cfbe4d59be4ffc5cf847ce56" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:53.448115 10730 raft_consensus.cc:2804] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 14:51:53.382336 10649 raft_consensus.cc:515] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:53.460156  7928 raft_consensus.cc:2468] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 11.
I20260709 14:51:53.461063 10748 raft_consensus.cc:493] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:53.467701 10748 raft_consensus.cc:515] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:53.470240 10748 leader_election.cc:290] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:53.478474  7849 raft_consensus.cc:2393] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 8: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:51:53.479717 10649 leader_election.cc:290] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 8 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:53.466588  7924 raft_consensus.cc:2468] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 9.
I20260709 14:51:53.466030 10730 raft_consensus.cc:493] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 14:51:53.481492  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 57323.9us
I20260709 14:51:53.481603 10730 raft_consensus.cc:3060] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:51:53.493800 10801 consensus_queue.cc:1048] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 14:51:53.494634  7893 leader_election.cc:304] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:51:53.497642  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:53.498821  7852 raft_consensus.cc:2410] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 14:51:53.493817  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:53.499688  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:53.502229  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783e4874513449ef9084b833f188a6d3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:53.502399  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:53.503360  7852 raft_consensus.cc:2468] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 8.
I20260709 14:51:53.500558 10683 raft_consensus.cc:2804] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 14:51:53.505225  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:53.506620  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:53.513021  7744 leader_election.cc:304] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:51:53.513127  7850 raft_consensus.cc:2468] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 4.
I20260709 14:51:53.514065  7675 catalog_manager.cc:5697] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 5 to 6, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 6 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:51:53.514832  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:53.515983  7675 catalog_manager.cc:5697] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 9 to 10, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 10 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:51:53.518563  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:53.512028 10683 raft_consensus.cc:493] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:53.521510 10683 raft_consensus.cc:3060] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 14:51:53.523051 10735 raft_consensus.cc:2804] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader election won for term 6
I20260709 14:51:53.523706 10735 raft_consensus.cc:697] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:51:53.524992 10735 consensus_queue.cc:237] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:53.462845 10788 raft_consensus.cc:515] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:53.530021  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 108783us
W20260709 14:51:53.530805  7745 leader_election.cc:336] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 1.599s (SENT)
I20260709 14:51:53.531170  7745 leader_election.cc:304] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:53.531420  7852 raft_consensus.cc:2393] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 8: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:51:53.532533  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
W20260709 14:51:53.534241  7745 leader_election.cc:336] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 1.611s (SENT)
I20260709 14:51:53.534807  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258d6c2dda954bf5b65930fde8ecb9f3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:53.535347  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:53.535495  7779 raft_consensus.cc:3060] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:51:53.537563  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:53.538417  7846 raft_consensus.cc:2410] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 14:51:53.539280  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:53.539865  7846 raft_consensus.cc:2468] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 6.
I20260709 14:51:53.517204 10737 raft_consensus.cc:493] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:53.533356 10791 raft_consensus.cc:2749] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 14:51:53.541177 10737 raft_consensus.cc:515] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:52.962956  7817 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:49946 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3041)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3042)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3068)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3070)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3061)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3043)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3044)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3065)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3045)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3054)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3050)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3078)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3047)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3072)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3055)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3073)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3074)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3052)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3075)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3053)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3035)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49946 (request call id 2697)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3037)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3030)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3069)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3071)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3029)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3046)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3076)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3033)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3077)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3049)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49948 (request call id 3038)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49948 (request call id 3039)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49948 (request call id 3048)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 2695)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 2698)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 2699)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 2700)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 2701)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 2702)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 2703)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41650 (request call id 267)
I20260709 14:51:53.555869  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:53.557464  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:53.558166  7853 raft_consensus.cc:2468] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 8.
I20260709 14:51:53.559091  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:53.560192  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:53.561401  7744 leader_election.cc:304] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:51:53.562799  7744 leader_election.cc:304] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:51:53.540853  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:53.565335  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:53.566377  7776 raft_consensus.cc:2468] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 4.
I20260709 14:51:53.566437  7846 raft_consensus.cc:2393] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 5: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:51:53.567657  7853 raft_consensus.cc:2410] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 14:51:53.569123  7847 raft_consensus.cc:2468] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 6.
I20260709 14:51:53.570161  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:53.571143  7853 raft_consensus.cc:2393] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 9: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:51:53.573771  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:53.574678  7771 raft_consensus.cc:3060] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:51:53.567605  7852 raft_consensus.cc:2393] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 7: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
W20260709 14:51:53.576371  7745 leader_election.cc:336] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 1.591s (SENT)
I20260709 14:51:53.585757  7893 leader_election.cc:304] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:51:53.588338  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:53.589562  7850 raft_consensus.cc:2393] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 11: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:51:53.590905  7745 leader_election.cc:304] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:53.592361  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:53.593271  7777 raft_consensus.cc:2468] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 8.
I20260709 14:51:53.539675 10788 leader_election.cc:290] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 9 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:51:53.595796  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:53.590348  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:53.598361  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:53.599215  7847 raft_consensus.cc:2468] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 7.
I20260709 14:51:53.604143  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:53.605345  7845 raft_consensus.cc:2410] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
W20260709 14:51:53.609838  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:53.613953  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9441e831627143a991a1556dcdce71e3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:53.615957  7771 raft_consensus.cc:2468] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 9.
I20260709 14:51:53.616904  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:53.618976  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:53.619750  7925 raft_consensus.cc:2468] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 11.
I20260709 14:51:53.620645  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:53.621495  7854 raft_consensus.cc:2393] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 9: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:51:53.622324  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:53.622936  7854 raft_consensus.cc:2468] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 6.
I20260709 14:51:53.623929  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:53.622785  7675 catalog_manager.cc:5697] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 7 to 8, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 8 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:51:53.628690  7674 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54364 (request call id 340) took 4041 ms. Trace:
I20260709 14:51:53.627210  7675 catalog_manager.cc:5697] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:51:53.624414  7854 raft_consensus.cc:3060] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:51:53.633517 10744 raft_consensus.cc:493] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:53.637394 10675 raft_consensus.cc:3055] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 LEADER]: Stepping down as leader of term 7
I20260709 14:51:53.637682 10745 raft_consensus.cc:2804] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 14:51:53.638389 10745 raft_consensus.cc:493] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:53.638832 10624 raft_consensus.cc:2749] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 14:51:53.638756 10745 raft_consensus.cc:3060] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:51:53.557127 10737 leader_election.cc:290] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:53.578922 10791 raft_consensus.cc:2804] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader election won for term 9
I20260709 14:51:53.641952 10791 raft_consensus.cc:697] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:51:53.643340  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:53.644210  7845 raft_consensus.cc:2468] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 9.
W20260709 14:51:53.644712  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 59278.5us
I20260709 14:51:53.629359  7674 rpcz_store.cc:276] 0709 14:51:49.587698 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:49.587936 (+   238us) service_pool.cc:224] Handling call
0709 14:51:53.628519 (+4040583us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 14:51:52.100580 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 14:51:52.101667 (+  1087us) write_op.cc:432] Acquiring schema lock in shared mode
0709 14:51:52.101712 (+    45us) write_op.cc:435] Acquired schema lock
0709 14:51:52.101724 (+    12us) tablet.cc:662] Decoding operations
0709 14:51:52.103941 (+  2217us) write_op.cc:620] Acquiring the partition lock for write op
0709 14:51:52.104001 (+    60us) write_op.cc:641] Partition lock acquired for write op
0709 14:51:52.104036 (+    35us) tablet.cc:685] Acquiring locks for 4 operations
0709 14:51:52.104711 (+   675us) tablet.cc:701] Row locks acquired
0709 14:51:52.104729 (+    18us) write_op.cc:260] PREPARE: finished
0709 14:51:52.104913 (+   184us) write_op.cc:270] Start()
0709 14:51:52.105042 (+   129us) write_op.cc:276] Timestamp: P: 1783608712104848 usec, L: 0
0709 14:51:52.105062 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 14:51:52.244196 (+139134us) log.cc:844] Serialized 1694 byte log entry
0709 14:51:52.561507 (+317311us) op_driver.cc:464] REPLICATION: finished
0709 14:51:52.830315 (+268808us) write_op.cc:301] APPLY: starting
0709 14:51:52.841171 (+ 10856us) tablet.cc:1367] starting BulkCheckPresence
0709 14:51:52.898682 (+ 57511us) tablet.cc:1370] finished BulkCheckPresence
0709 14:51:52.919088 (+ 20406us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 14:51:52.942421 (+ 23333us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 14:51:52.948057 (+  5636us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 14:51:52.948122 (+    65us) write_op.cc:312] APPLY: finished
0709 14:51:52.948472 (+   350us) log.cc:844] Serialized 41 byte log entry
0709 14:51:52.948710 (+   238us) write_op.cc:489] Releasing partition, row and schema locks
0709 14:51:52.948838 (+   128us) write_op.cc:454] Released schema lock
0709 14:51:52.948894 (+    56us) write_op.cc:341] FINISH: Updating metrics
0709 14:51:52.949547 (+   653us) write_op.cc:489] Releasing partition, row and schema locks
0709 14:51:52.949755 (+   208us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":37729,"reported_tablets":36,"child_traces":[["op",{"apply.queue_time_us":216115,"apply.run_cpu_time_us":5119,"apply.run_wall_time_us":126232,"num_ops":4,"prepare.queue_time_us":65768,"prepare.run_cpu_time_us":6640,"prepare.run_wall_time_us":170524,"replication_time_us":430194,"thread_start_us":161423,"threads_started":2}]]}
I20260709 14:51:53.629204  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:53.647580  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258d6c2dda954bf5b65930fde8ecb9f3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:53.648212  7849 raft_consensus.cc:3060] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:51:53.642969 10791 consensus_queue.cc:237] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:53.649608  7852 raft_consensus.cc:2368] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 7. Current term is 8.
I20260709 14:51:53.645957  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783e4874513449ef9084b833f188a6d3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:53.652365  7845 raft_consensus.cc:2468] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 6.
I20260709 14:51:53.653940  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:53.636053 10582 raft_consensus.cc:993] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0: : Instructing follower 1de5e20126fa4d8ca0793d19c7b847ed to start an election
I20260709 14:51:53.660907  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:53.577606 10713 raft_consensus.cc:2749] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 14:51:53.658010  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:53.659420  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:53.654821  7893 leader_election.cc:304] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:51:53.579306 10792 raft_consensus.cc:493] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:53.577386 10824 raft_consensus.cc:2804] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader election won for term 11
I20260709 14:51:53.668013  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:53.670146  7847 raft_consensus.cc:2410] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 14:51:53.592010 10536 raft_consensus.cc:493] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:53.674496  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:53.601686 10704 raft_consensus.cc:493] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:51:53.680140  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 119364us
I20260709 14:51:53.674602  7851 raft_consensus.cc:2410] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 14:51:53.661309  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:53.682669  7845 raft_consensus.cc:2393] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 11: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:51:53.683607  7849 raft_consensus.cc:2410] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 14:51:53.685976  7779 raft_consensus.cc:2468] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 6.
I20260709 14:51:53.637893 10675 raft_consensus.cc:740] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:51:53.681578  7853 raft_consensus.cc:2376] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 4. Re-sending same reply.
I20260709 14:51:53.694321  7854 raft_consensus.cc:2468] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 9.
I20260709 14:51:53.696069  7894 leader_election.cc:304] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:53.700093  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:53.701205  7847 raft_consensus.cc:2410] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 14:51:53.703598  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:53.704852  7854 raft_consensus.cc:3060] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:51:53.706741  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:53.707937  7853 raft_consensus.cc:2393] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 9: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:51:53.709095  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:53.634255 10744 raft_consensus.cc:515] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:53.713070  7845 raft_consensus.cc:2393] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 11: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:51:53.679121 10582 raft_consensus.cc:1081] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 LEADER]: Signalling peer 1de5e20126fa4d8ca0793d19c7b847ed to start an election
I20260709 14:51:53.718014  7854 raft_consensus.cc:2410] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 14:51:53.728343  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:53.696301 10797 raft_consensus.cc:2804] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 14:51:53.725302  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:53.733996  7847 raft_consensus.cc:2393] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 7: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:51:53.723568  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:53.748745  7853 raft_consensus.cc:2468] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 8.
W20260709 14:51:53.753486  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 177188us
I20260709 14:51:53.726425  7894 leader_election.cc:304] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:53.730633  7846 raft_consensus.cc:2393] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 8: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:51:53.718497  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: true dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:53.772122  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:53.773144  7849 raft_consensus.cc:2393] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 9: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:51:53.731024  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:53.772552  7845 raft_consensus.cc:2393] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 9: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:51:53.776772  7845 raft_consensus.cc:1240] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 7. Current term is 8. Ops: []
I20260709 14:51:53.779469  7852 raft_consensus.cc:2393] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 9: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:51:53.690904 10536 raft_consensus.cc:515] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:53.756181  7745 leader_election.cc:336] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 1.721s (SENT)
I20260709 14:51:53.703766 10824 raft_consensus.cc:697] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:51:53.759032  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:53.782403  7745 leader_election.cc:304] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:53.769600  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:53.770767  7854 raft_consensus.cc:1240] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 7. Current term is 8. Ops: []
I20260709 14:51:53.677435 10792 raft_consensus.cc:515] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:53.760473  7743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:53.698770 10704 raft_consensus.cc:515] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:53.784236  7851 raft_consensus.cc:2393] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 9: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:51:53.732122 10814 raft_consensus.cc:493] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:53.731750 10571 raft_consensus.cc:2749] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 14:51:53.733387 10797 raft_consensus.cc:493] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:53.765298 10713 raft_consensus.cc:493] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:51:53.780792 10649 raft_consensus.cc:493] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:53.803392 10789 raft_consensus.cc:493] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:53.803176 10824 consensus_queue.cc:237] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:53.804147 10794 raft_consensus.cc:2749] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 14:51:53.804399  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 78053.4us
W20260709 14:51:53.806921  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:51:53.799243  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 63798.6us
I20260709 14:51:53.811110  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:53.786090 10735 raft_consensus.cc:2749] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 14:51:53.840919  7846 raft_consensus.cc:2468] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 5.
I20260709 14:51:53.845919  7893 leader_election.cc:304] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:51:53.812008 10797 raft_consensus.cc:3060] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:51:53.879796  7849 raft_consensus.cc:1275] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 14:51:53.883213  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:51:53.896611  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 50848.3us
I20260709 14:51:53.897855  7893 leader_election.cc:304] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:53.897284  7853 raft_consensus.cc:2393] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 10: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
W20260709 14:51:53.926801  7745 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:51:53.934231  7745 leader_election.cc:336] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 1.788s (SENT)
I20260709 14:51:53.821798 10649 raft_consensus.cc:515] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:53.935371  7745 leader_election.cc:304] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:51:53.938066  7745 leader_election.cc:336] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 1.818s (SENT)
I20260709 14:51:53.939607  7745 leader_election.cc:304] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 3876b8ee8d744cb18e91d97aae93b1ac, 9418391fa82a42c79c6cad13ba91d964
W20260709 14:51:53.948091  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 50374.3us
W20260709 14:51:53.948802  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 69348.8us
I20260709 14:51:53.798040 10814 raft_consensus.cc:515] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:53.953862  8599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 160680us
I20260709 14:51:53.975806  7893 leader_election.cc:304] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:53.927374 10788 raft_consensus.cc:2804] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 14:51:53.823028 10713 raft_consensus.cc:515] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:53.834968 10789 raft_consensus.cc:515] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:53.839152 10730 raft_consensus.cc:515] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:54.003093  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 53423.4us
W20260709 14:51:53.997751  8598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 63792.4us
I20260709 14:51:53.797938 10675 consensus_queue.cc:260] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:54.011556  7893 leader_election.cc:304] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:54.001600  7850 raft_consensus.cc:1275] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 14:51:53.947100 10735 raft_consensus.cc:2749] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 14:51:53.950021 10624 raft_consensus.cc:2749] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 14:51:53.971976 10801 raft_consensus.cc:2804] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 14:51:54.012885  7850 pending_rounds.cc:85] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting all ops after (but not including) 2
I20260709 14:51:54.021363  7850 pending_rounds.cc:107] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 14:51:54.021777  7850 raft_consensus.cc:2889] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:51:53.996635 10788 raft_consensus.cc:493] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:54.014091 10794 raft_consensus.cc:2749] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 14:51:54.056905  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:54.025043 10801 raft_consensus.cc:493] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:54.065593  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:54.076417  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:54.079897  7850 raft_consensus.cc:2468] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 8.
I20260709 14:51:54.038480 10788 raft_consensus.cc:3060] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:51:54.038714 10689 raft_consensus.cc:493] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:54.124491 10536 leader_election.cc:290] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:54.124925 10827 raft_consensus.cc:493] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:54.125564 10827 raft_consensus.cc:515] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:54.126264 10704 leader_election.cc:290] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:54.128038 10827 leader_election.cc:290] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:51:54.129822  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 111788us
I20260709 14:51:54.131872  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:54.132894  7846 raft_consensus.cc:2468] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 11.
I20260709 14:51:54.076356 10801 raft_consensus.cc:3060] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Advancing to term 9
W20260709 14:51:54.143028  7894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:54.121277 10833 raft_consensus.cc:2804] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 14:51:54.152498  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:51:54.154551  7745 leader_election.cc:336] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 1.937s (SENT)
I20260709 14:51:54.155896  7745 leader_election.cc:304] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:51:54.146807  8599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 124890us
I20260709 14:51:54.123023 10744 leader_election.cc:290] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:51:54.159821  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:54.158999  7853 raft_consensus.cc:2376] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 9. Re-sending same reply.
I20260709 14:51:54.151479 10582 raft_consensus.cc:493] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:54.181728  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:54.182946  7853 raft_consensus.cc:2393] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 9: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:51:54.157269 10803 raft_consensus.cc:493] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:54.164011 10735 raft_consensus.cc:2749] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 LEADER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 14:51:54.185871  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 174451us
I20260709 14:51:54.172201 10792 leader_election.cc:290] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:54.138837 10689 raft_consensus.cc:515] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:54.205022  7893 leader_election.cc:304] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:54.303952 10814 leader_election.cc:290] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:54.208645 10649 leader_election.cc:290] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:54.254057  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:54.290892  7850 raft_consensus.cc:1240] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 6. Current term is 7. Ops: []
I20260709 14:51:54.375933  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
W20260709 14:51:54.376454  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 171532us
I20260709 14:51:54.301172  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:54.375933  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:54.378568  7846 raft_consensus.cc:2393] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 5: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
W20260709 14:51:54.266528  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:54.288975  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:54.321717 10704 raft_consensus.cc:493] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:54.313627  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
W20260709 14:51:54.310153 10837 log.cc:927] Time spent T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.240s	user 0.003s	sys 0.000s
I20260709 14:51:54.244376 10689 leader_election.cc:290] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:54.215729 10735 raft_consensus.cc:493] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:54.199852 10833 raft_consensus.cc:697] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:54.186033 10582 raft_consensus.cc:515] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:54.313207 10744 consensus_queue.cc:1048] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 14:51:54.219236 10834 log.cc:927] Time spent T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 14:51:54.222285  7847 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 2699) took 1282 ms. Trace:
I20260709 14:51:54.217790  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:51:54.285699  7743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:51:54.214052 10826 log.cc:927] Time spent T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.199s	user 0.000s	sys 0.001s
I20260709 14:51:54.268953  7851 raft_consensus.cc:1275] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 14:51:54.436738  7853 raft_consensus.cc:2468] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 7.
I20260709 14:51:54.335970  7774 raft_consensus.cc:1275] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 14:51:54.336414  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:54.439453  7921 raft_consensus.cc:2393] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 9: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:51:54.336784  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
W20260709 14:51:54.245813 10841 log.cc:927] Time spent T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 14:51:54.435125  7847 rpcz_store.cc:276] 0709 14:51:52.939514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:53.785527 (+846013us) service_pool.cc:224] Handling call
0709 14:51:53.786002 (+   475us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:51:53.793688 (+  7686us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:51:53.793728 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:51:53.807800 (+ 14072us) log.cc:844] Serialized 26 byte log entry
0709 14:51:54.077173 (+269373us) raft_consensus.cc:1645] Marking committed up to 3
0709 14:51:54.077223 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:54.077347 (+   124us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:51:54.222006 (+144659us) raft_consensus.cc:1685] finished
0709 14:51:54.222026 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:51:54.222196 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12067,"raft.queue_time_us":7709,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":6084,"thread_start_us":150279,"threads_started":1,"wal-append.queue_time_us":371113}
I20260709 14:51:54.337311  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:54.211680  7845 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 2698) took 1272 ms. Trace:
I20260709 14:51:54.340008  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:54.377070  7919 raft_consensus.cc:2410] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 14:51:54.377545  7849 raft_consensus.cc:2468] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 10.
I20260709 14:51:54.301138  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:54.287878  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:54.453902  7773 raft_consensus.cc:3060] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:51:54.384711  7744 leader_election.cc:304] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
W20260709 14:51:54.333808 10683 consensus_meta.cc:287] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent flushing consensus metadata: real 0.739s	user 0.006s	sys 0.005s
I20260709 14:51:54.401947  7925 raft_consensus.cc:2410] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 14:51:54.200795 10803 raft_consensus.cc:515] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:54.378129  7920 raft_consensus.cc:2376] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 6. Re-sending same reply.
I20260709 14:51:54.407040  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:54.316864 10730 leader_election.cc:290] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 7 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:51:54.460561  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 79344.6us
I20260709 14:51:54.412322  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:54.420368  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:54.422161  7924 raft_consensus.cc:1240] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 10. Current term is 11. Ops: []
I20260709 14:51:54.423237  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
W20260709 14:51:54.427335  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:54.431341  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:54.440531  7928 raft_consensus.cc:2393] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 8: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:51:54.451890  7927 raft_consensus.cc:2393] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 5: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:51:54.458912  7770 raft_consensus.cc:2393] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 8: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:51:54.464485  7850 raft_consensus.cc:2468] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 9.
I20260709 14:51:54.461695  7744 leader_election.cc:304] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:51:54.466734  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:54.416200 10802 raft_consensus.cc:2804] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 14:51:54.451737  7845 rpcz_store.cc:276] 0709 14:51:52.939253 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:53.786447 (+847194us) service_pool.cc:224] Handling call
0709 14:51:53.804531 (+ 18084us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:51:53.824621 (+ 20090us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:51:53.824653 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:51:53.825160 (+   507us) log.cc:844] Serialized 26 byte log entry
0709 14:51:54.083672 (+258512us) raft_consensus.cc:1645] Marking committed up to 6
0709 14:51:54.083722 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:54.083811 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:51:54.211417 (+127606us) raft_consensus.cc:1685] finished
0709 14:51:54.211439 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:51:54.211609 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19673,"raft.queue_time_us":20563,"raft.run_cpu_time_us":228,"raft.run_wall_time_us":23618,"thread_start_us":130740,"threads_started":1,"wal-append.queue_time_us":235025}
I20260709 14:51:54.481134  7774 raft_consensus.cc:1275] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 14:51:54.482357  7774 pending_rounds.cc:85] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed: Aborting all ops after (but not including) 4
I20260709 14:51:54.482594  7774 pending_rounds.cc:107] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 14:51:54.482820  7774 raft_consensus.cc:2889] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:51:54.484691  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:54.468761  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:54.514185  7770 raft_consensus.cc:1275] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 14:51:54.514864  7770 pending_rounds.cc:85] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed: Aborting all ops after (but not including) 4
I20260709 14:51:54.515115  7770 pending_rounds.cc:107] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 14:51:54.515372  7770 raft_consensus.cc:2889] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:51:54.459810 10794 raft_consensus.cc:493] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:54.531628  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
W20260709 14:51:54.496466 10752 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.012s	sys 0.050s
I20260709 14:51:54.483533 10624 raft_consensus.cc:2804] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 14:51:54.477276 10845 raft_consensus.cc:2804] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 14:51:54.416525 10704 raft_consensus.cc:515] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:54.550699 10845 raft_consensus.cc:493] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:54.551316 10845 raft_consensus.cc:3060] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:51:54.552585 10704 leader_election.cc:290] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:51:54.546491 10752 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.625s	user 0.012s	sys 0.050s
I20260709 14:51:54.553722  7778 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 2449) took 1427 ms. Trace:
I20260709 14:51:54.554314 10789 leader_election.cc:290] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:54.555174  7852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 2701) took 1615 ms. Trace:
I20260709 14:51:54.555562  7852 rpcz_store.cc:276] 0709 14:51:52.940047 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:53.786558 (+846511us) service_pool.cc:224] Handling call
0709 14:51:53.786947 (+   389us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:51:53.795336 (+  8389us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:51:53.795379 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:51:53.796010 (+   631us) log.cc:844] Serialized 26 byte log entry
0709 14:51:53.995258 (+199248us) raft_consensus.cc:1645] Marking committed up to 4
0709 14:51:53.995319 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:53.995397 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:51:54.554974 (+559577us) raft_consensus.cc:1685] finished
0709 14:51:54.554993 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:51:54.555121 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":117,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":183,"thread_start_us":198709,"threads_started":1,"wal-append.queue_time_us":277227}
I20260709 14:51:54.468601 10846 raft_consensus.cc:493] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:54.423866 10735 raft_consensus.cc:515] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:54.482177 10745 consensus_meta.cc:287] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent flushing consensus metadata: real 0.843s	user 0.017s	sys 0.000s
I20260709 14:51:54.541700  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:54.542507 10842 raft_consensus.cc:493] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:54.479342 10683 raft_consensus.cc:515] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:54.543933 10833 consensus_queue.cc:237] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:54.571204  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:54.571972  7923 raft_consensus.cc:2468] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 10.
I20260709 14:51:54.545070 10803 leader_election.cc:290] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:54.477280 10731 raft_consensus.cc:493] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:54.524477 10730 raft_consensus.cc:493] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:54.554162  7778 rpcz_store.cc:276] 0709 14:51:53.126019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:53.126352 (+   333us) service_pool.cc:224] Handling call
0709 14:51:53.127884 (+  1532us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:51:53.128901 (+  1017us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:51:53.128931 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:51:53.129602 (+   671us) log.cc:844] Serialized 26 byte log entry
0709 14:51:53.592912 (+463310us) spinlock_profiling.cc:243] Waited 2.49 ms on lock 0x7b1800391f00. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb690c69de1 00007fb690c765b1 00007fb687d83e07 00007fb690bdeab9 00007fb687da069b 00007fb687d9e93f 00007fb687da0c02 00007fb68aa2820b 00007fb68aa2dd23 00007fb68aa2e0d1 00007fb68ae49a0f
0709 14:51:53.723235 (+130323us) raft_consensus.cc:1645] Marking committed up to 8
0709 14:51:53.788373 (+ 65138us) log.cc:844] Serialized 14 byte log entry
0709 14:51:53.788608 (+   235us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:53.788680 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:51:54.553350 (+764670us) raft_consensus.cc:1685] finished
0709 14:51:54.553456 (+   106us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:51:54.553631 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":63880,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":14428,"raft.run_cpu_time_us":317,"raft.run_wall_time_us":24496,"spinlock_wait_cycles":10245888,"thread_start_us":130045,"threads_started":1,"wal-append.queue_time_us":780333}
I20260709 14:51:54.582470  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:54.583714  7778 raft_consensus.cc:2410] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 14:51:54.584295  7771 raft_consensus.cc:3060] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:51:54.587905  7770 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86"
dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:37144
I20260709 14:51:54.588660  7770 raft_consensus.cc:493] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:51:54.589092  7770 raft_consensus.cc:3060] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:51:54.556973  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:54.590147  7849 raft_consensus.cc:2410] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 14:51:54.554703  7848 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 2703) took 1614 ms. Trace:
W20260709 14:51:54.561363  7854 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.607s	user 0.053s	sys 0.086s
I20260709 14:51:54.565286  7919 raft_consensus.cc:2376] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 9. Re-sending same reply.
W20260709 14:51:54.591190  7854 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.637s	user 0.053s	sys 0.086s
I20260709 14:51:54.565977  7852 raft_consensus.cc:1275] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 14:51:54.532114 10802 raft_consensus.cc:697] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:54.577028  7777 raft_consensus.cc:1240] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 LEADER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 10. Current term is 11. Ops: []
I20260709 14:51:54.591001  7848 rpcz_store.cc:276] 0709 14:51:52.940550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:53.788437 (+847887us) service_pool.cc:224] Handling call
0709 14:51:53.788997 (+   560us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:51:53.815920 (+ 26923us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:51:53.815959 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:51:53.817840 (+  1881us) log.cc:844] Serialized 26 byte log entry
0709 14:51:54.014986 (+197146us) raft_consensus.cc:1645] Marking committed up to 5
0709 14:51:54.015029 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:54.015104 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:51:54.309307 (+294203us) spinlock_profiling.cc:243] Waited 84.7 ms on lock 0x7b4400022b4c. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb687c29db1 00007fb687cc7c85 00007fb687cc86a2 00007fb68aa3a1db 00007fb68aa35aaf 00007fb68aa2986e 00007fb68aa28bb6 00007fb68aa287d8 00007fb68aa32221 00007fb68aa321d9 00007fb68aa32169
0709 14:51:54.312381 (+  3074us) spinlock_profiling.cc:243] Waited 23.2 ms on lock 0x7b4800002dd8. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68fdb7aa1 00007fb68fdaeb37 00007fb68fdae9ca 00007fb68fea626f 00007fb68fea5f37 00007fb68feba55c 00007fb68feba508 00007fb68feba488 00007fb68feba443 00007fb68feb96ec 00007fb68ede3a96
0709 14:51:54.554456 (+242075us) raft_consensus.cc:1685] finished
0709 14:51:54.554478 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:51:54.554638 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9223,"raft.queue_time_us":27301,"raft.run_cpu_time_us":3638,"raft.run_wall_time_us":488062,"spinlock_wait_cycles":248166400,"thread_start_us":81272,"threads_started":1,"wal-append.queue_time_us":211108}
I20260709 14:51:54.557777 10624 raft_consensus.cc:493] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:54.592218  7854 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 2700) took 1652 ms. Trace:
I20260709 14:51:54.546957 10794 raft_consensus.cc:515] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:54.609313  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:54.611397  7848 raft_consensus.cc:1275] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 14:51:54.616268  7923 raft_consensus.cc:2368] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 6. Current term is 7.
I20260709 14:51:54.612881  7852 raft_consensus.cc:1240] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 14:51:54.595679  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:54.606371 10803 raft_consensus.cc:493] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:54.631253  7849 raft_consensus.cc:1275] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 14:51:54.612432 10624 raft_consensus.cc:3060] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Advancing to term 12
W20260709 14:51:54.643827  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:54.572952 10745 raft_consensus.cc:515] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:54.657011  7926 raft_consensus.cc:2410] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 14:51:54.658769 10745 leader_election.cc:290] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 9 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:54.660624  7773 raft_consensus.cc:2410] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 14:51:54.653003  7771 raft_consensus.cc:2410] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 14:51:54.661808  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:54.663887  7923 raft_consensus.cc:1275] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 14:51:54.673457 10744 raft_consensus.cc:493] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:54.674099 10744 raft_consensus.cc:515] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:54.569841 10846 raft_consensus.cc:515] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:54.677837  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:54.678697  7849 raft_consensus.cc:2468] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 11.
I20260709 14:51:54.679180 10846 leader_election.cc:290] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:54.679792 10846 consensus_queue.cc:1048] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 14:51:54.682605 10794 leader_election.cc:290] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:54.686373 10683 leader_election.cc:290] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:54.687429 10735 leader_election.cc:290] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:54.629829 10582 leader_election.cc:290] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:51:54.689888  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:51:54.699405  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 114756us
W20260709 14:51:54.703719 10788 consensus_meta.cc:287] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent flushing consensus metadata: real 0.573s	user 0.009s	sys 0.001s
I20260709 14:51:54.704272 10788 raft_consensus.cc:515] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:54.705922 10852 log.cc:927] Time spent T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 14:51:54.575671 10842 raft_consensus.cc:515] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:54.706419  7923 raft_consensus.cc:1275] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 14:51:54.645848 10803 raft_consensus.cc:515] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:54.707845  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c563cc7cfbe4d59be4ffc5cf847ce56" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:54.587380 10731 raft_consensus.cc:515] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:54.708792 10803 leader_election.cc:290] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:54.709568  7919 raft_consensus.cc:1275] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 14:51:54.710279 10731 leader_election.cc:290] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:54.710753  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:54.711022 10802 consensus_queue.cc:237] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:54.636377 10824 raft_consensus.cc:493] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:54.713621 10824 raft_consensus.cc:515] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:54.714978 10842 leader_election.cc:290] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:54.676966 10744 leader_election.cc:290] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:54.715653 10824 leader_election.cc:290] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:54.716982 10858 raft_consensus.cc:493] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:54.717525 10858 raft_consensus.cc:515] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:54.719646 10858 leader_election.cc:290] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:54.705117 10845 raft_consensus.cc:515] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:54.708528  7923 raft_consensus.cc:3060] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 14:51:54.720695 10624 raft_consensus.cc:515] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:54.605458 10730 raft_consensus.cc:515] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:54.731266  7921 raft_consensus.cc:2368] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 4. Current term is 5.
W20260709 14:51:54.733163 10801 consensus_meta.cc:287] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0: Time spent flushing consensus metadata: real 0.576s	user 0.004s	sys 0.008s
I20260709 14:51:54.727754  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:54.729449  7772 raft_consensus.cc:2393] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 12: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
W20260709 14:51:54.733418  7894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:54.723744  7770 raft_consensus.cc:515] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:54.743323  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:54.745450  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:54.746502  7852 raft_consensus.cc:2468] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 5.
I20260709 14:51:54.753726  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:54.757045  7773 raft_consensus.cc:3060] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:51:54.754308  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:54.733793 10801 raft_consensus.cc:515] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:54.761340  7919 raft_consensus.cc:2368] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 8. Current term is 9.
I20260709 14:51:54.761914 10801 leader_election.cc:290] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 9 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:54.763974 10788 leader_election.cc:290] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 5 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:54.738698 10651 consensus_queue.cc:1048] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 14:51:54.768020  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:54.768688  7845 raft_consensus.cc:2468] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 7.
I20260709 14:51:54.771651  7851 raft_consensus.cc:2410] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 14:51:54.778877  7923 raft_consensus.cc:2468] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 8.
I20260709 14:51:54.781008  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:54.781868  7770 leader_election.cc:290] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:54.782407  7923 raft_consensus.cc:2468] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 7.
I20260709 14:51:54.785483  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:54.788668  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:54.792398  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
W20260709 14:51:54.747510 10797 consensus_meta.cc:287] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent flushing consensus metadata: real 0.814s	user 0.014s	sys 0.001s
I20260709 14:51:54.794884  7923 raft_consensus.cc:2368] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 7. Current term is 8.
W20260709 14:51:54.797730  7819 connection.cc:256] RPC call timeout handler was delayed by -1.403452682999955s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1544s for a response
W20260709 14:51:54.799037  7819 connection.cc:256] RPC call timeout handler was delayed by -1.3404526829999668s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16140000000000002s for a response
W20260709 14:51:54.799475  7819 connection.cc:256] RPC call timeout handler was delayed by -1.336852682999961s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16180000000000003s for a response
W20260709 14:51:54.799913  7819 connection.cc:256] RPC call timeout handler was delayed by -1.3179526829999304s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16390000000000002s for a response
W20260709 14:51:54.800411  7819 connection.cc:256] RPC call timeout handler was delayed by -1.3062526829999115s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1652s for a response
I20260709 14:51:54.799340  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c563cc7cfbe4d59be4ffc5cf847ce56" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:54.801730  7770 raft_consensus.cc:3060] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Advancing to term 8
I20260709 14:51:54.734972 10624 leader_election.cc:290] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 12 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:54.741583 10652 consensus_queue.cc:1048] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.056s
I20260709 14:51:54.724028 10845 leader_election.cc:290] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:51:54.823666  7745 leader_election.cc:336] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 2.167s (SENT)
I20260709 14:51:54.824437  7745 leader_election.cc:304] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:54.826752  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:54.796818 10731 raft_consensus.cc:493] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:54.827798  7851 raft_consensus.cc:2468] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 9.
I20260709 14:51:54.805212 10689 raft_consensus.cc:493] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:51:54.826869  7819 connection.cc:256] RPC call timeout handler was delayed by -1.2522526829999379s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17120000000000002s for a response
W20260709 14:51:54.831878  7819 connection.cc:256] RPC call timeout handler was delayed by -1.1541526829998929s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1821s for a response
W20260709 14:51:54.832266  7819 connection.cc:256] RPC call timeout handler was delayed by -1.0659526829999777s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19190000000000002s for a response
W20260709 14:51:54.832535  7819 connection.cc:256] RPC call timeout handler was delayed by -1.0416526829999384s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1946s for a response
I20260709 14:51:54.826752  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:54.816634  7773 raft_consensus.cc:2468] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 7.
I20260709 14:51:54.829860  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:54.837611  7845 raft_consensus.cc:3060] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Advancing to term 8
W20260709 14:51:54.839385  7745 leader_election.cc:336] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Remote error: Service unavailable: RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:49948 dropped due to backpressure: service queue is full with 50 items
I20260709 14:51:54.840044  7745 leader_election.cc:304] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:54.840248  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:54.841470 10624 raft_consensus.cc:2749] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 14:51:54.844803  7743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:54.805625 10797 raft_consensus.cc:515] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:54.852411  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:54.853158  7851 raft_consensus.cc:2468] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 8.
I20260709 14:51:54.854180  7851 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072"
dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
mode: GRACEFUL
new_leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:41662
I20260709 14:51:54.854475 10797 leader_election.cc:290] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:54.854830  7851 raft_consensus.cc:606] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Received request to transfer leadership to TS 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:51:54.855211  7851 raft_consensus.cc:614] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 14:51:54.855542 10824 consensus_queue.cc:1048] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 14:51:54.865885 10742 consensus_queue.cc:1048] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 14:51:54.844051 10731 raft_consensus.cc:515] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:54.844142  7745 leader_election.cc:304] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:54.841643  7773 raft_consensus.cc:2468] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 6.
I20260709 14:51:54.847061  7819 leader_election.cc:304] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:54.849546  7923 raft_consensus.cc:2468] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 8.
W20260709 14:51:54.892632  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 48617.7us
I20260709 14:51:54.895104  7745 leader_election.cc:304] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:54.896526  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:54.897698  7923 raft_consensus.cc:3060] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Advancing to term 12
W20260709 14:51:54.897712  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 50741.8us
I20260709 14:51:54.899250  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:54.900388  7773 raft_consensus.cc:2468] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 9.
I20260709 14:51:54.901288  7819 leader_election.cc:304] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:54.903244  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:54.904469  7773 raft_consensus.cc:2393] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 9: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:51:54.903724  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:54.906708  7851 raft_consensus.cc:2468] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 8.
I20260709 14:51:54.920476  7819 leader_election.cc:304] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:54.920972  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:54.923226  7773 raft_consensus.cc:2468] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 6.
I20260709 14:51:54.925221  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:54.926514  7773 raft_consensus.cc:2468] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 7.
I20260709 14:51:54.929180  7745 leader_election.cc:304] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:54.934520  7745 leader_election.cc:304] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
W20260709 14:51:54.935081  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:54.936486  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:54.938230  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258d6c2dda954bf5b65930fde8ecb9f3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:54.939579  7773 raft_consensus.cc:2393] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 6: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:51:54.939745  7745 leader_election.cc:304] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:54.957086  7923 raft_consensus.cc:2468] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 12.
I20260709 14:51:54.965507  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:54.943850  7745 leader_election.cc:304] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:54.932714  7770 raft_consensus.cc:2468] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 8.
I20260709 14:51:54.851383 10689 raft_consensus.cc:515] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:54.992051  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:55.013159  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:54.992200  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:54.898162 10857 raft_consensus.cc:2749] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 14:51:54.990810 10624 raft_consensus.cc:2804] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 14:51:54.993921 10845 raft_consensus.cc:2749] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 14:51:55.014572  7851 raft_consensus.cc:2468] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 7.
I20260709 14:51:55.014626  7770 raft_consensus.cc:2468] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 8.
W20260709 14:51:55.020630  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 76755.2us
I20260709 14:51:54.927230 10704 raft_consensus.cc:2749] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 14:51:55.047209  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 126887us
I20260709 14:51:55.047322  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:55.017349  7845 raft_consensus.cc:2468] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 8.
I20260709 14:51:54.932391 10649 raft_consensus.cc:2749] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 14:51:54.989432 10827 raft_consensus.cc:2804] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 14:51:54.942366 10858 raft_consensus.cc:493] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:55.026684  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:55.050809  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:55.048942  7745 leader_election.cc:304] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:55.052155  7770 raft_consensus.cc:2468] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 8.
I20260709 14:51:54.942014 10735 raft_consensus.cc:2749] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 14:51:55.049173  7819 leader_election.cc:304] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:55.050722  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:55.023420 10752 raft_consensus.cc:493] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:55.056231  7778 raft_consensus.cc:3060] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:51:55.023443 10571 raft_consensus.cc:493] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:55.054023  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:55.023726 10536 raft_consensus.cc:493] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:55.040275 10791 raft_consensus.cc:2804] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 14:51:55.053118  7745 leader_election.cc:304] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:55.045603 10624 raft_consensus.cc:493] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:55.058907  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:55.075845  7770 raft_consensus.cc:3060] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Advancing to term 8
I20260709 14:51:55.060302  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:55.051889 10827 raft_consensus.cc:493] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:55.061846 10752 raft_consensus.cc:515] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:55.062561 10731 leader_election.cc:290] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:54.989912 10824 consensus_queue.cc:1048] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.060s
I20260709 14:51:55.067405 10649 raft_consensus.cc:2749] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 14:51:55.072438  7745 leader_election.cc:304] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:55.057919 10871 raft_consensus.cc:2749] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 14:51:55.086349 10871 raft_consensus.cc:3060] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:51:55.058790 10858 raft_consensus.cc:515] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:55.066641  7773 raft_consensus.cc:2468] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 6.
I20260709 14:51:55.083578 10827 raft_consensus.cc:3060] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:51:55.096693  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:55.077288  7851 raft_consensus.cc:3060] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:51:55.081350 10857 raft_consensus.cc:2804] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader election won for term 4
I20260709 14:51:55.065126 10730 leader_election.cc:290] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:55.073222 10704 raft_consensus.cc:2749] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 14:51:55.070850 10791 raft_consensus.cc:493] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:55.112706  7778 raft_consensus.cc:2468] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 9.
I20260709 14:51:55.079701 10624 raft_consensus.cc:3060] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:51:55.079459 10536 raft_consensus.cc:515] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:55.125037 10748 raft_consensus.cc:493] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
W20260709 14:51:55.126190  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 53899.3us
I20260709 14:51:55.128835  7745 leader_election.cc:304] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:51:55.101408  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 52334.3us
I20260709 14:51:55.131697  7745 leader_election.cc:304] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:55.131428  7851 raft_consensus.cc:2468] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 5.
W20260709 14:51:55.133823 10853 log.cc:927] Time spent T 00000000000000000000000000000000 P 133636659113430cb53b321cb0b1d9ee: Append to log took a long time: real 0.265s	user 0.001s	sys 0.002s
I20260709 14:51:55.135079 10536 leader_election.cc:290] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:55.135933 10689 leader_election.cc:290] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:55.126128 10748 raft_consensus.cc:515] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:55.134651 10867 log.cc:927] Time spent T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 14:51:55.138773 10748 leader_election.cc:290] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:55.132691  7819 leader_election.cc:304] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:55.114594 10857 raft_consensus.cc:697] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:51:55.142372 10857 consensus_queue.cc:237] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:55.143313  7893 leader_election.cc:304] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:51:55.143930 10824 raft_consensus.cc:2749] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 14:51:55.144348 10536 raft_consensus.cc:2804] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 14:51:55.144513  7893 leader_election.cc:304] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:51:55.123620 10791 raft_consensus.cc:3060] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:51:55.144977 10536 raft_consensus.cc:697] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:55.146174 10536 consensus_queue.cc:237] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:55.071460 10571 raft_consensus.cc:515] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:55.149771 10730 raft_consensus.cc:2804] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 14:51:55.150355 10730 raft_consensus.cc:493] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:55.150717 10730 raft_consensus.cc:3060] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:51:55.151536 10571 leader_election.cc:290] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:55.135540 10752 leader_election.cc:290] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:55.156213  7744 leader_election.cc:304] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:51:55.154318  7893 leader_election.cc:304] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:51:55.158864  7745 leader_election.cc:304] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:55.159240  7893 leader_election.cc:304] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:51:55.161849 10824 raft_consensus.cc:2749] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 14:51:55.161981 10745 raft_consensus.cc:2804] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 14:51:55.158869 10866 log.cc:927] Time spent T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.089s	user 0.000s	sys 0.002s
I20260709 14:51:55.163522  7893 leader_election.cc:304] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:51:55.165621  7893 leader_election.cc:304] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:51:55.158039 10858 leader_election.cc:290] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:55.166914 10731 raft_consensus.cc:2804] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader election won for term 12
I20260709 14:51:55.170621 10842 raft_consensus.cc:2804] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 14:51:55.171154 10744 raft_consensus.cc:2804] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 14:51:55.171933 10744 raft_consensus.cc:493] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:55.172410 10744 raft_consensus.cc:3060] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 14:51:55.163439 10745 raft_consensus.cc:493] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:55.179332 10745 raft_consensus.cc:3060] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:51:55.160358 10752 raft_consensus.cc:2804] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 14:51:55.182365  7745 leader_election.cc:304] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:55.164855 10735 raft_consensus.cc:2804] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 14:51:55.183236 10752 raft_consensus.cc:493] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:55.193585 10752 raft_consensus.cc:3060] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:51:55.188071  7770 raft_consensus.cc:2468] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 8.
I20260709 14:51:55.198042  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:55.192970  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:55.171149 10842 raft_consensus.cc:493] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:55.214797  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:55.216223  7893 leader_election.cc:304] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:51:55.216346  7926 raft_consensus.cc:2368] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 9. Current term is 10.
I20260709 14:51:55.201462 10824 raft_consensus.cc:3060] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:51:55.197185 10735 raft_consensus.cc:493] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:55.209268 10842 raft_consensus.cc:3060] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Advancing to term 10
W20260709 14:51:55.226567  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:55.227950 10624 raft_consensus.cc:515] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:55.230525 10744 raft_consensus.cc:515] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:55.246778  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: true dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:55.291015  7921 raft_consensus.cc:3055] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 14:51:55.291370  7921 raft_consensus.cc:740] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:55.284834  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:55.292176  7921 consensus_queue.cc:260] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:55.249540  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:55.294278  7921 raft_consensus.cc:3060] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:51:55.252905  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:55.256068  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:55.294998  7851 raft_consensus.cc:3060] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:51:55.295083  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:55.257171  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:55.259819  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:55.264582 10713 leader_election.cc:290] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:55.275297  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:55.248406  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:55.301029  7853 raft_consensus.cc:2410] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 14:51:55.250234  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:55.296115  7928 raft_consensus.cc:2393] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 12: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:51:55.296133  7852 raft_consensus.cc:2468] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 4.
I20260709 14:51:55.219408 10802 raft_consensus.cc:2804] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 14:51:55.305099  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:55.306223  7848 raft_consensus.cc:2468] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 9.
W20260709 14:51:55.307471  7894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:55.310595  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:55.311221 10624 leader_election.cc:290] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:55.311792  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:55.311738 10536 raft_consensus.cc:493] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:55.312912  7928 raft_consensus.cc:2468] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 10.
I20260709 14:51:55.313323 10536 raft_consensus.cc:515] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:55.314922  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:55.316102 10744 leader_election.cc:290] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:55.316560  7777 raft_consensus.cc:3060] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:51:55.312422  7921 raft_consensus.cc:2468] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 7.
I20260709 14:51:55.224718 10735 raft_consensus.cc:3060] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:51:55.317268  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:55.318488  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:55.319346  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:55.319429  7928 raft_consensus.cc:2368] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 5. Current term is 6.
I20260709 14:51:55.320369  7921 raft_consensus.cc:2368] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 8. Current term is 9.
I20260709 14:51:55.320992  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:55.321288  7845 raft_consensus.cc:2468] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 9.
I20260709 14:51:55.321414  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:55.322317  7928 raft_consensus.cc:2368] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 10. Current term is 11.
I20260709 14:51:55.323305  7921 raft_consensus.cc:2368] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 10. Current term is 11.
I20260709 14:51:55.324560  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:55.327561  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:55.329478  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258d6c2dda954bf5b65930fde8ecb9f3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:55.324604  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783e4874513449ef9084b833f188a6d3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:55.331135  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:55.333720  7853 raft_consensus.cc:1275] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 14:51:55.334327  7853 pending_rounds.cc:85] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting all ops after (but not including) 4
I20260709 14:51:55.334553  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:55.330034  7921 raft_consensus.cc:2368] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 8. Current term is 9.
I20260709 14:51:55.335510  7928 raft_consensus.cc:2368] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 9. Current term is 10.
I20260709 14:51:55.336187  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:55.341521  7853 pending_rounds.cc:107] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 14:51:55.317888 10731 raft_consensus.cc:697] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:51:55.345173  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:55.316144 10536 leader_election.cc:290] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:55.347256  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:55.342166  7853 raft_consensus.cc:2889] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:51:55.342310  7851 raft_consensus.cc:2468] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 10.
I20260709 14:51:55.343130  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:55.352411  7921 raft_consensus.cc:1240] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 8. Current term is 9. Ops: [3.3-8.5]
I20260709 14:51:55.343905  7894 leader_election.cc:304] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:51:55.354713  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:55.326010 10802 raft_consensus.cc:697] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:55.334467 10871 raft_consensus.cc:2749] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 14:51:55.359261  7777 raft_consensus.cc:2468] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 10.
I20260709 14:51:55.363313  7926 raft_consensus.cc:1240] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 LEADER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 6. Current term is 7. Ops: []
I20260709 14:51:55.365670  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:55.366856  7776 raft_consensus.cc:3060] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:51:55.370107  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:55.307996 10791 raft_consensus.cc:515] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:55.373030  7894 leader_election.cc:304] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:55.384246  7926 raft_consensus.cc:1275] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 14:51:55.394416 10744 raft_consensus.cc:2749] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 14:51:55.369758 10536 raft_consensus.cc:2804] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 14:51:55.401917  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:55.345964 10731 consensus_queue.cc:237] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:55.370815 10788 consensus_queue.cc:1048] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 14:51:55.416438  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:55.402545 10536 raft_consensus.cc:493] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 14:51:55.428385  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:55.432090 10791 leader_election.cc:290] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:55.402695 10827 raft_consensus.cc:515] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:55.439831  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:55.423213 10880 consensus_queue.cc:1048] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 14:51:55.426693  7777 raft_consensus.cc:2468] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 9.
I20260709 14:51:55.436993 10827 leader_election.cc:290] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:55.430238 10536 raft_consensus.cc:3060] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:51:55.458508  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:55.459301  7777 raft_consensus.cc:2468] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 8.
I20260709 14:51:55.462325  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:55.462810 10730 raft_consensus.cc:515] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:55.427693 10802 consensus_queue.cc:237] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:55.463302  7777 raft_consensus.cc:2410] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
W20260709 14:51:55.513525 10884 log.cc:927] Time spent T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 14:51:55.514528 10824 raft_consensus.cc:2749] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 14:51:55.515625  7771 raft_consensus.cc:2468] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 7.
I20260709 14:51:55.471897 10859 consensus_queue.cc:1048] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 14:51:55.507114 10730 leader_election.cc:290] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:51:55.526357  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 66631us
I20260709 14:51:55.529635  7894 leader_election.cc:304] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:55.491801 10752 raft_consensus.cc:515] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:55.518890 10788 raft_consensus.cc:493] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:55.532775  7894 leader_election.cc:304] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:55.532984  7921 raft_consensus.cc:1240] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 6. Current term is 7. Ops: []
I20260709 14:51:55.535444 10752 leader_election.cc:290] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 7 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:55.540215  7894 leader_election.cc:304] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:55.537349 10788 raft_consensus.cc:515] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:55.547534 10788 leader_election.cc:290] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:51:55.548336  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 415846us
I20260709 14:51:55.549448  7819 leader_election.cc:304] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:55.550868  7819 leader_election.cc:304] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:55.550879  7776 raft_consensus.cc:2468] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 9.
I20260709 14:51:55.555229  7819 leader_election.cc:304] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:55.537107 10880 raft_consensus.cc:2804] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 14:51:55.559681  7894 leader_election.cc:304] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:55.548341 10870 raft_consensus.cc:2749] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 14:51:55.584421 10689 raft_consensus.cc:2749] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 14:51:55.574393 10651 raft_consensus.cc:2749] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 14:51:55.584735 10735 raft_consensus.cc:515] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:55.586202  7776 raft_consensus.cc:1240] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 6. Current term is 7. Ops: []
I20260709 14:51:55.553947 10704 raft_consensus.cc:2749] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 14:51:55.591578  7776 raft_consensus.cc:1240] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 6. Current term is 7. Ops: []
I20260709 14:51:55.574111 10873 raft_consensus.cc:2749] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 14:51:55.539870 10730 raft_consensus.cc:2804] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 14:51:55.595746  7819 leader_election.cc:304] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:55.599341 10745 raft_consensus.cc:515] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:55.599855 10842 raft_consensus.cc:515] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:55.602742  7894 leader_election.cc:304] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:55.607044  7819 leader_election.cc:304] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:55.609059  7894 leader_election.cc:304] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:55.604216 10859 raft_consensus.cc:2804] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 14:51:55.614936  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:55.611392 10873 raft_consensus.cc:2804] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 14:51:55.602300 10730 raft_consensus.cc:493] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:51:55.578923 10880 raft_consensus.cc:493] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:55.621776  7777 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 2486) took 1080 ms. Trace:
I20260709 14:51:55.614112 10746 raft_consensus.cc:2804] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 14:51:55.624713  7894 leader_election.cc:304] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:55.622968 10651 raft_consensus.cc:2804] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 14:51:55.626683 10651 raft_consensus.cc:493] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:55.627082 10651 raft_consensus.cc:3060] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 14:51:55.621162 10873 raft_consensus.cc:493] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:55.629860 10873 raft_consensus.cc:3060] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:51:55.619830 10704 raft_consensus.cc:2749] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 14:51:55.635254 10746 raft_consensus.cc:493] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:55.635890 10746 raft_consensus.cc:3060] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:51:55.640190 10748 raft_consensus.cc:2804] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 14:51:55.619719 10859 raft_consensus.cc:493] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:55.642038 10748 raft_consensus.cc:697] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:55.643186 10748 consensus_queue.cc:237] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:55.641805 10859 raft_consensus.cc:3060] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:51:55.645539  7894 leader_election.cc:304] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:55.648545  7894 leader_election.cc:304] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:55.625222  7819 leader_election.cc:304] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:55.650949 10704 raft_consensus.cc:2749] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 14:51:55.617833 10536 raft_consensus.cc:515] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:55.653360 10881 raft_consensus.cc:2804] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 14:51:55.653894 10881 raft_consensus.cc:493] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:51:55.653393 10536 leader_election.cc:290] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 11 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:55.654453 10881 raft_consensus.cc:3060] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:51:55.649348  7894 leader_election.cc:304] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:55.655738 10536 raft_consensus.cc:2804] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 14:51:55.656186 10536 raft_consensus.cc:493] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:51:55.656605 10536 raft_consensus.cc:3060] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:51:55.621810 10730 raft_consensus.cc:3060] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:51:55.623773 10880 raft_consensus.cc:3060] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:51:55.661561  7894 leader_election.cc:304] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:55.663743 10888 raft_consensus.cc:2804] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 14:51:55.664394 10888 raft_consensus.cc:493] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:51:55.665354 10888 raft_consensus.cc:3060] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:51:55.667670 10842 leader_election.cc:290] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:55.668982 10745 leader_election.cc:290] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:55.641829 10735 leader_election.cc:290] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:55.676885  7894 leader_election.cc:304] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:55.680996  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:55.681903  7847 raft_consensus.cc:2468] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 6.
I20260709 14:51:55.686087  7847 raft_consensus.cc:1275] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 14:51:55.686599  7847 pending_rounds.cc:85] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting all ops after (but not including) 2
I20260709 14:51:55.686851  7847 pending_rounds.cc:107] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 14:51:55.687109  7847 raft_consensus.cc:2889] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:51:55.689704  7894 leader_election.cc:304] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:55.694630 10873 raft_consensus.cc:515] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:55.702227  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:55.677471 10860 raft_consensus.cc:2749] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 14:51:55.714788  7847 raft_consensus.cc:3060] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:51:55.689677 10745 raft_consensus.cc:2804] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 14:51:55.719962  7819 leader_election.cc:304] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:55.726014 10873 leader_election.cc:290] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 10 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:55.690321 10842 consensus_queue.cc:1048] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 14:51:55.729517 10689 raft_consensus.cc:2804] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 14:51:55.730278 10689 raft_consensus.cc:493] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:55.730988 10689 raft_consensus.cc:3060] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Advancing to term 8
I20260709 14:51:55.736173  7774 raft_consensus.cc:3060] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:51:55.716555 10788 raft_consensus.cc:2804] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 14:51:55.737782 10788 raft_consensus.cc:493] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:51:55.738274 10788 raft_consensus.cc:3060] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:51:55.717820 10870 consensus_queue.cc:1048] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 14:51:55.716589 10802 consensus_queue.cc:1048] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 14:51:55.721015  7819 leader_election.cc:304] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:55.748140  7847 raft_consensus.cc:2468] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 11.
I20260709 14:51:55.753926  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:55.736517 10536 raft_consensus.cc:515] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:55.749919  7894 leader_election.cc:304] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:55.748502 10745 raft_consensus.cc:697] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:55.765746  7819 leader_election.cc:304] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:55.778209 10873 raft_consensus.cc:2804] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader election won for term 8
I20260709 14:51:55.778975 10873 raft_consensus.cc:697] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:51:55.780786  7774 raft_consensus.cc:1275] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 14:51:55.757699 10870 raft_consensus.cc:2804] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 14:51:55.783923  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:55.784816  7928 raft_consensus.cc:2468] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 10.
I20260709 14:51:55.781937  7774 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37136 (request call id 2177) took 1028 ms. Trace:
I20260709 14:51:55.787642  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:55.771788 10860 raft_consensus.cc:2804] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 14:51:55.788434  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:55.788703  7927 raft_consensus.cc:1240] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 9. Current term is 10. Ops: []
I20260709 14:51:55.788774  7774 rpcz_store.cc:276] 0709 14:51:54.753569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:55.735540 (+981971us) service_pool.cc:224] Handling call
0709 14:51:55.736010 (+   470us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:51:55.781600 (+ 45590us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:55.781860 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 14:51:55.789824  7924 raft_consensus.cc:1240] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 8. Current term is 9. Ops: []
I20260709 14:51:55.794297 10860 raft_consensus.cc:697] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:55.795400 10860 consensus_queue.cc:237] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:55.800068  7774 raft_consensus.cc:1275] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 14:51:55.801235  7774 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37136 (request call id 2180) took 1003 ms. Trace:
I20260709 14:51:55.801857  7774 rpcz_store.cc:276] 0709 14:51:54.797672 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:55.799116 (+1001444us) service_pool.cc:224] Handling call
0709 14:51:55.799635 (+   519us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:51:55.800831 (+  1196us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:55.801159 (+   328us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 14:51:55.802501 10881 raft_consensus.cc:515] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:55.804435  7774 raft_consensus.cc:1240] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 6. Current term is 7. Ops: []
I20260709 14:51:55.806756  7774 raft_consensus.cc:1240] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 8. Current term is 9. Ops: []
I20260709 14:51:55.807984 10651 raft_consensus.cc:515] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:55.808014  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:55.804139 10880 raft_consensus.cc:515] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:55.786788 10870 raft_consensus.cc:493] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:55.819001  7774 raft_consensus.cc:1240] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 6. Current term is 7. Ops: []
I20260709 14:51:55.757876 10888 raft_consensus.cc:515] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:55.783924 10745 consensus_queue.cc:237] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:55.827107 10859 raft_consensus.cc:515] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:55.849783  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:55.852515  7819 leader_election.cc:304] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:55.834227 10870 raft_consensus.cc:3060] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:51:55.780022 10873 consensus_queue.cc:237] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:55.860188 10881 leader_election.cc:290] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 5 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:55.865906 10788 raft_consensus.cc:515] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:55.867280 10859 leader_election.cc:290] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 9 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:55.870436 10730 raft_consensus.cc:515] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:55.873059 10649 raft_consensus.cc:493] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:55.880165 10649 raft_consensus.cc:515] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:55.873169 10730 leader_election.cc:290] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:55.879236 10788 leader_election.cc:290] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 7 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:55.897888  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:55.898808  7845 raft_consensus.cc:3060] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:51:55.902078 10704 raft_consensus.cc:2749] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 14:51:55.904162  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:55.888005 10649 leader_election.cc:290] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:51:55.891700  7743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:55.892449 10746 raft_consensus.cc:515] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:55.950903  7845 raft_consensus.cc:2468] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 10.
W20260709 14:51:55.952514  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 770260us
I20260709 14:51:55.953763  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:55.964977  7847 raft_consensus.cc:3060] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:51:55.903128 10888 leader_election.cc:290] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:55.956730  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:55.965310  7745 leader_election.cc:304] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:55.965974  7852 raft_consensus.cc:3060] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Advancing to term 10
W20260709 14:51:55.967368  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 114947us
I20260709 14:51:55.968750  7819 leader_election.cc:304] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:55.976019  7847 raft_consensus.cc:2468] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 10.
I20260709 14:51:55.938617 10735 raft_consensus.cc:493] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:51:55.995380 10904 log.cc:927] Time spent T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
I20260709 14:51:55.903149 10704 raft_consensus.cc:493] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9418391fa82a42c79c6cad13ba91d964)
I20260709 14:51:56.005566  7852 raft_consensus.cc:2468] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 10.
I20260709 14:51:56.008073  7819 leader_election.cc:304] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:51:55.962687 10859 raft_consensus.cc:493] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:51:56.042312  8599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 169058us
W20260709 14:51:56.024178 10905 log.cc:927] Time spent T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.078s	user 0.002s	sys 0.000s
I20260709 14:51:56.004727 10735 raft_consensus.cc:515] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:56.106154 10904 log.cc:927] Time spent T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 14:51:56.024029 10704 raft_consensus.cc:515] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:51:56.284366 10704 leader_election.cc:290] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68:42321)
W20260709 14:51:56.201833  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 217703us
I20260709 14:51:56.285784  7745 leader_election.cc:304] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:55.959000 10845 raft_consensus.cc:493] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9418391fa82a42c79c6cad13ba91d964)
I20260709 14:51:56.026124 10731 raft_consensus.cc:3060] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Advancing to term 9
W20260709 14:51:56.287175  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 279193us
I20260709 14:51:56.299901  7819 leader_election.cc:304] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:56.272769 10649 raft_consensus.cc:2749] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 14:51:56.305833  7819 leader_election.cc:304] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:56.287648 10728 raft_consensus.cc:3060] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:51:56.274518 10903 raft_consensus.cc:493] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
W20260709 14:51:56.295562 10689 consensus_meta.cc:287] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent flushing consensus metadata: real 0.564s	user 0.016s	sys 0.007s
I20260709 14:51:56.304570 10908 raft_consensus.cc:2764] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 LEADER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 14:51:56.278405 10912 consensus_queue.cc:1059] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 14:51:56.294520 10870 raft_consensus.cc:515] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:56.288906 10859 raft_consensus.cc:515] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:56.301870 10845 raft_consensus.cc:515] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:51:56.325595 10744 raft_consensus.cc:493] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:56.326258 10704 raft_consensus.cc:493] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:56.329631 10689 raft_consensus.cc:515] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:56.321226 10903 raft_consensus.cc:515] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:56.380518 10745 raft_consensus.cc:493] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:56.378794 10735 leader_election.cc:290] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:56.387473 10704 raft_consensus.cc:515] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:56.383195 10744 raft_consensus.cc:515] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:56.402961 10909 log.cc:927] Time spent T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
W20260709 14:51:56.405395 10913 log.cc:927] Time spent T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.110s	user 0.002s	sys 0.000s
I20260709 14:51:56.406963 10870 leader_election.cc:290] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 9 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:51:56.408119 10907 log.cc:927] Time spent T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
W20260709 14:51:56.409087 10910 log.cc:927] Time spent T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 14:51:56.394277 10746 leader_election.cc:290] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 9 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:56.417128 10908 raft_consensus.cc:3055] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 LEADER]: Stepping down as leader of term 10
I20260709 14:51:56.389973 10912 raft_consensus.cc:2749] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 14:51:56.428790 10735 raft_consensus.cc:2749] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 14:51:56.415377 10859 leader_election.cc:290] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:56.371923 10918 raft_consensus.cc:2749] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 14:51:56.384642 10919 consensus_queue.cc:1059] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 14:51:56.433418 10908 raft_consensus.cc:740] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:51:56.432758 10917 raft_consensus.cc:476] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 LEADER]: Not starting pre-election -- already a leader
I20260709 14:51:56.450464 10908 consensus_queue.cc:260] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:56.452402 10908 raft_consensus.cc:3060] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Advancing to term 11
W20260709 14:51:56.488595  7743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:56.496564 10704 leader_election.cc:290] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:56.499028 10689 leader_election.cc:290] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 8 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:51:56.488247  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:56.504037 10536 leader_election.cc:290] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:56.423406 10745 raft_consensus.cc:515] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:56.535691 10744 leader_election.cc:290] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:56.540591 10845 leader_election.cc:290] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68:42321)
W20260709 14:51:56.557124  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 271241us
I20260709 14:51:56.577545 10745 leader_election.cc:290] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:51:56.584007  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 280162us
I20260709 14:51:56.602877  7776 raft_consensus.cc:1240] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 8. Current term is 9. Ops: []
I20260709 14:51:56.603773  7819 leader_election.cc:304] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
W20260709 14:51:56.606439  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 44166.9us
I20260709 14:51:56.607908 10933 raft_consensus.cc:2749] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 14:51:56.609398 10845 raft_consensus.cc:493] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:56.612285 10735 raft_consensus.cc:493] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:56.611905 10845 raft_consensus.cc:515] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:56.613543 10735 raft_consensus.cc:515] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:56.615082  8637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9441e831627143a991a1556dcdce71e3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9418391fa82a42c79c6cad13ba91d964" is_pre_election: true
W20260709 14:51:56.615185  7778 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37144 (request call id 2500) took 1602 ms (client timeout 1855 ms). Trace:
I20260709 14:51:56.617452 10735 leader_election.cc:290] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:56.603098  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:56.621445 10917 raft_consensus.cc:493] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:56.621906  7926 raft_consensus.cc:2393] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 7: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:51:56.627489  7745 leader_election.cc:304] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:56.629814 10927 raft_consensus.cc:2749] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 14:51:56.634490  7926 raft_consensus.cc:1275] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 14:51:56.636268 10735 raft_consensus.cc:493] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9418391fa82a42c79c6cad13ba91d964)
I20260709 14:51:56.584141 10731 raft_consensus.cc:2749] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 14:51:56.642247 10735 raft_consensus.cc:515] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:51:54.610366  7854 rpcz_store.cc:276] 0709 14:51:52.939796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:53.785005 (+845209us) service_pool.cc:224] Handling call
0709 14:51:53.785441 (+   436us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:51:53.785670 (+   229us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 14:51:53.954220 (+168550us) log.cc:844] Serialized 14 byte log entry
0709 14:51:54.591700 (+637480us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:51:54.591766 (+    66us) raft_consensus.cc:1645] Marking committed up to 7
0709 14:51:54.591819 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:54.591897 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:51:54.592150 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2568,"prepare.queue_time_us":208260,"prepare.run_cpu_time_us":107,"prepare.run_wall_time_us":6306,"raft.queue_time_us":844,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":6416,"thread_start_us":788756,"threads_started":2}
I20260709 14:51:56.656752 10735 leader_election.cc:290] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68:42321)
I20260709 14:51:56.649693 10917 raft_consensus.cc:515] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:56.662664 10917 leader_election.cc:290] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:56.651024  7745 leader_election.cc:304] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:56.664834  7819 leader_election.cc:400] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 6 pre-election: Vote denied by peer 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785) with higher term. Message: Invalid argument: T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 6. Current term is 7.
I20260709 14:51:56.665787 10917 raft_consensus.cc:2804] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 14:51:56.666654 10917 raft_consensus.cc:493] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:56.667407 10917 raft_consensus.cc:3060] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:51:56.676949  7745 leader_election.cc:304] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:56.651530  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
W20260709 14:51:56.681322  7770 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37144 (request call id 2519) took 1513 ms (client timeout 1687 ms). Trace:
W20260709 14:51:56.681958  7770 rpcz_store.cc:269] 0709 14:51:55.167805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:56.631408 (+1463603us) service_pool.cc:224] Handling call
0709 14:51:56.681124 (+ 49716us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 14:51:56.645268  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:56.657976  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:56.657344 10731 raft_consensus.cc:493] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:56.680975 10735 raft_consensus.cc:3060] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:51:56.685405 10927 consensus_queue.cc:1048] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 14:51:56.686761  7850 raft_consensus.cc:3060] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Advancing to term 8
W20260709 14:51:56.618178  7778 rpcz_store.cc:269] 0709 14:51:55.012540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:55.040525 (+ 27985us) service_pool.cc:224] Handling call
0709 14:51:56.599543 (+1559018us) spinlock_profiling.cc:243] Waited 3.01 ms on lock 0x7b54002567d4. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae922fa 00007fb68fe53b17 00007fb6893ce6d4 00007fb6893ce662 00007fb6893ce591 00007fb6893ce50c 00007fb6893cd7c2 00007fb6891c948c 00007fb6891c88c6 00007fb6891c826f
0709 14:51:56.614929 (+ 15386us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6942720}
I20260709 14:51:56.692173  7819 leader_election.cc:304] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:55.199678  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:56.694867  7772 raft_consensus.cc:2468] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 7.
W20260709 14:51:56.695830  7772 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37144 (request call id 2505) took 1641 ms (client timeout 1956 ms). Trace:
W20260709 14:51:56.696368  7772 rpcz_store.cc:269] 0709 14:51:55.055373 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:55.199308 (+143935us) service_pool.cc:224] Handling call
0709 14:51:56.695702 (+1496394us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 14:51:56.698488  7771 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37144 (request call id 2507) took 1626 ms (client timeout 1994 ms). Trace:
W20260709 14:51:56.699108  7771 rpcz_store.cc:269] 0709 14:51:55.072533 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:55.259392 (+186859us) service_pool.cc:224] Handling call
0709 14:51:56.697787 (+1438395us) spinlock_profiling.cc:243] Waited 218 ms on lock 0x7b540003aa54. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae922fa 00007fb68fe53b17 00007fb6893ce6d4 00007fb6893ce662 00007fb6893ce591 00007fb6893ce50c 00007fb6893cd7c2 00007fb6891c948c 00007fb6891c88c6 00007fb6891c826f
0709 14:51:56.698235 (+   448us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":501242624}
I20260709 14:51:56.699469  7772 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 2516) took 1561 ms. Trace:
I20260709 14:51:56.700184  7772 rpcz_store.cc:276] 0709 14:51:55.138191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:56.697592 (+1559401us) service_pool.cc:224] Handling call
0709 14:51:56.698594 (+  1002us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:51:56.699052 (+   458us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:51:56.699082 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:51:56.699149 (+    67us) raft_consensus.cc:1645] Marking committed up to 6
0709 14:51:56.699184 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:56.699243 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:51:56.699348 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 14:51:56.700985 10845 leader_election.cc:290] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:56.676769 10675 raft_consensus.cc:3060] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Advancing to term 8
W20260709 14:51:56.704231  7775 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.508s	user 0.034s	sys 0.061s
W20260709 14:51:56.706673  7775 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.511s	user 0.035s	sys 0.061s
I20260709 14:51:56.705545  7771 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47054 (request call id 183) took 1549 ms. Trace:
I20260709 14:51:56.704262  7776 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37136 (request call id 2172) took 1965 ms. Trace:
I20260709 14:51:56.707643  7771 rpcz_store.cc:276] 0709 14:51:55.155796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:56.700230 (+1544434us) service_pool.cc:224] Handling call
0709 14:51:56.700748 (+   518us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:51:56.701072 (+   324us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:51:56.701101 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:51:56.701147 (+    46us) raft_consensus.cc:1645] Marking committed up to 6
0709 14:51:56.701181 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:56.704742 (+  3561us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:51:56.705156 (+   414us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 14:51:56.686168 10731 raft_consensus.cc:515] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:56.708491  7776 rpcz_store.cc:276] 0709 14:51:54.739263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:55.592891 (+853628us) service_pool.cc:224] Handling call
0709 14:51:56.602049 (+1009158us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:51:56.603545 (+  1496us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:56.703909 (+100364us) spinlock_profiling.cc:243] Waited 992 ms on lock 0x7b54002567d0. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae8d8ad 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2 00007fb6891c948c 00007fb6891c88c6 00007fb6891c826f
0709 14:51:56.704152 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2282505600}
I20260709 14:51:56.711511  8637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18d29d52d304c87b930d4fb5eaf50b1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9418391fa82a42c79c6cad13ba91d964" is_pre_election: true
I20260709 14:51:56.712872 10731 leader_election.cc:290] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:56.716744  7775 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 2483) took 2234 ms. Trace:
W20260709 14:51:56.717752  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 70383.4us
I20260709 14:51:56.719003  7894 leader_election.cc:304] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:56.720403  7921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38516 (request call id 2195) took 1949 ms. Trace:
I20260709 14:51:56.716826 10742 raft_consensus.cc:2804] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 14:51:56.704550  7745 leader_election.cc:304] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:56.725302  7922 raft_consensus.cc:2468] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 7.
I20260709 14:51:56.723351  7921 rpcz_store.cc:276] 0709 14:51:54.770968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:55.353565 (+582597us) service_pool.cc:224] Handling call
0709 14:51:55.354411 (+   846us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:51:55.533525 (+179114us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:56.719689 (+1186164us) spinlock_profiling.cc:243] Waited 178 ms on lock 0x7b54001324d4. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae8ee01 00007fb68ae8d83e 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2 00007fb6891c948c 00007fb6891c88c6
0709 14:51:56.720120 (+   431us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":410286336}
I20260709 14:51:56.727700  7926 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "939996e77ee64e9fab21aef50758b706"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
mode: GRACEFUL
new_leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:48676
I20260709 14:51:56.730647  7926 raft_consensus.cc:606] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 LEADER]: Received request to transfer leadership to TS 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:51:56.731654 10858 raft_consensus.cc:2804] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 14:51:56.733597 10712 raft_consensus.cc:493] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:56.735039 10712 raft_consensus.cc:515] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:56.735798  7819 leader_election.cc:400] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 7 election: Vote denied by peer 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785) with higher term. Message: Invalid argument: T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 7. Current term is 8.
I20260709 14:51:56.737418  7819 leader_election.cc:403] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 14:51:56.746048 10845 raft_consensus.cc:2749] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 14:51:56.730463  7745 leader_election.cc:304] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:56.733016 10858 raft_consensus.cc:697] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:56.751063  7850 raft_consensus.cc:2468] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 8.
I20260709 14:51:56.751947 10858 consensus_queue.cc:237] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:56.735476 10927 raft_consensus.cc:493] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:56.753859 10731 raft_consensus.cc:2804] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 14:51:56.754735 10927 raft_consensus.cc:515] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:56.754745 10731 raft_consensus.cc:493] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Starting leader election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:51:56.754957  7926 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
mode: GRACEFUL
new_leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:48676
I20260709 14:51:56.757977 10731 raft_consensus.cc:3060] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Advancing to term 8
I20260709 14:51:56.736815 10742 raft_consensus.cc:493] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:56.759261  7926 raft_consensus.cc:606] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 LEADER]: Received request to transfer leadership to TS 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:51:56.766595  7893 leader_election.cc:304] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:56.771951 10797 raft_consensus.cc:2804] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 14:51:56.772521 10797 raft_consensus.cc:493] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:56.772905 10797 raft_consensus.cc:3060] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:51:56.790108  7773 raft_consensus.cc:2468] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 11.
I20260709 14:51:55.622320  7777 rpcz_store.cc:276] 0709 14:51:54.565616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:55.474358 (+908742us) service_pool.cc:224] Handling call
0709 14:51:55.492964 (+ 18606us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:51:55.493237 (+   273us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 14:51:55.553155 (+ 59918us) log.cc:844] Serialized 14 byte log entry
0709 14:51:55.620627 (+ 67472us) log.cc:844] Serialized 14 byte log entry
0709 14:51:55.620998 (+   371us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:51:55.621061 (+    63us) raft_consensus.cc:1645] Marking committed up to 7
0709 14:51:55.621115 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:55.621186 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:51:55.621690 (+   504us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":93416,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":53,"raft.queue_time_us":984,"raft.run_cpu_time_us":471,"raft.run_wall_time_us":6716,"spinlock_wait_cycles":10428544,"thread_start_us":109998,"threads_started":2}
I20260709 14:51:56.759302 10742 raft_consensus.cc:3060] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:51:56.799062 10927 leader_election.cc:290] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:51:56.837679  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 85156.1us
I20260709 14:51:56.850417 10874 raft_consensus.cc:493] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:56.851099 10874 raft_consensus.cc:515] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:56.860198 10917 raft_consensus.cc:515] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:56.874203  7779 raft_consensus.cc:1275] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 14:51:56.874951  7779 pending_rounds.cc:85] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed: Aborting all ops after (but not including) 4
I20260709 14:51:56.875315  7779 pending_rounds.cc:107] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 14:51:56.876248  7770 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 2512) took 1732 ms. Trace:
I20260709 14:51:56.875677  7779 raft_consensus.cc:2889] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:51:56.879752  7770 rpcz_store.cc:276] 0709 14:51:55.137054 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:56.706259 (+1569205us) service_pool.cc:224] Handling call
0709 14:51:56.713846 (+  7587us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:51:56.724439 (+ 10593us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 14:51:56.826506 (+102067us) log.cc:844] Serialized 14 byte log entry
0709 14:51:56.868739 (+ 42233us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:51:56.868818 (+    79us) raft_consensus.cc:1645] Marking committed up to 5
0709 14:51:56.868879 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:56.868962 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:51:56.869176 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":101951,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":56,"raft.queue_time_us":2009,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":2098,"thread_start_us":142943,"threads_started":2}
I20260709 14:51:56.878574 10735 raft_consensus.cc:2749] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 14:51:56.901461 10936 log.cc:927] Time spent T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.056s	user 0.000s	sys 0.002s
I20260709 14:51:56.904882 10917 leader_election.cc:290] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:51:56.905951  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 50546.9us
I20260709 14:51:56.908007  7745 leader_election.cc:304] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:56.909457 10917 raft_consensus.cc:2804] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 14:51:56.910459 10917 raft_consensus.cc:493] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:56.912638 10917 raft_consensus.cc:3060] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Advancing to term 8
I20260709 14:51:56.919651 10927 raft_consensus.cc:493] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:51:56.920534 10927 raft_consensus.cc:515] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:56.921013  7675 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54350 (request call id 371) took 4162 ms. Trace:
I20260709 14:51:56.923640 10927 leader_election.cc:290] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:56.926605 10917 raft_consensus.cc:515] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:56.922801  7675 rpcz_store.cc:276] 0709 14:51:52.758630 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:52.763071 (+  4441us) service_pool.cc:224] Handling call
0709 14:51:56.920739 (+4157668us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 14:51:53.971535 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 14:51:54.064859 (+ 93324us) write_op.cc:432] Acquiring schema lock in shared mode
0709 14:51:54.074868 (+ 10009us) write_op.cc:435] Acquired schema lock
0709 14:51:54.075959 (+  1091us) tablet.cc:662] Decoding operations
0709 14:51:54.235208 (+159249us) write_op.cc:620] Acquiring the partition lock for write op
0709 14:51:54.275679 (+ 40471us) write_op.cc:641] Partition lock acquired for write op
0709 14:51:54.275752 (+    73us) tablet.cc:685] Acquiring locks for 6 operations
0709 14:51:54.277062 (+  1310us) tablet.cc:701] Row locks acquired
0709 14:51:54.277090 (+    28us) write_op.cc:260] PREPARE: finished
0709 14:51:54.277330 (+   240us) write_op.cc:270] Start()
0709 14:51:54.277709 (+   379us) write_op.cc:276] Timestamp: P: 1783608714277235 usec, L: 0
0709 14:51:54.277736 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 14:51:54.278963 (+  1227us) log.cc:844] Serialized 2464 byte log entry
0709 14:51:55.440153 (+1161190us) op_driver.cc:464] REPLICATION: finished
0709 14:51:55.548497 (+108344us) write_op.cc:301] APPLY: starting
0709 14:51:55.548586 (+    89us) tablet.cc:1367] starting BulkCheckPresence
0709 14:51:55.548758 (+   172us) tablet.cc:1370] finished BulkCheckPresence
0709 14:51:55.548885 (+   127us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 14:51:55.549564 (+   679us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 14:51:55.549770 (+   206us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 14:51:55.549812 (+    42us) write_op.cc:312] APPLY: finished
0709 14:51:55.550061 (+   249us) log.cc:844] Serialized 53 byte log entry
0709 14:51:55.550238 (+   177us) write_op.cc:489] Releasing partition, row and schema locks
0709 14:51:55.550367 (+   129us) write_op.cc:454] Released schema lock
0709 14:51:55.550405 (+    38us) write_op.cc:341] FINISH: Updating metrics
0709 14:51:55.550825 (+   420us) write_op.cc:489] Releasing partition, row and schema locks
0709 14:51:55.550856 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":510935,"reported_tablets":11,"child_traces":[["op",{"apply.queue_time_us":108062,"apply.run_cpu_time_us":2292,"apply.run_wall_time_us":2292,"num_ops":6,"prepare.queue_time_us":262320,"prepare.run_cpu_time_us":41173,"prepare.run_wall_time_us":696142,"raft.queue_time_us":278450,"raft.run_cpu_time_us":11083,"raft.run_wall_time_us":100662,"replication_time_us":1162255,"thread_start_us":754286,"threads_started":4,"wal-append.queue_time_us":540273,"wal-append.run_cpu_time_us":117150,"wal-append.run_wall_time_us":1735473}]]}
I20260709 14:51:56.930835 10903 leader_election.cc:290] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:56.935873 10919 raft_consensus.cc:493] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:56.936139  7778 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 2515) took 1798 ms. Trace:
I20260709 14:51:56.934813 10927 raft_consensus.cc:493] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9418391fa82a42c79c6cad13ba91d964)
I20260709 14:51:56.936800 10919 raft_consensus.cc:515] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:56.938452 10927 raft_consensus.cc:515] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:51:56.939524  7770 raft_consensus.cc:1275] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 14:51:56.936621  7778 rpcz_store.cc:276] 0709 14:51:55.137946 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:56.690587 (+1552641us) service_pool.cc:224] Handling call
0709 14:51:56.691302 (+   715us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:51:56.692060 (+   758us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:51:56.692093 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:51:56.796746 (+104653us) log.cc:844] Serialized 26 byte log entry
0709 14:51:56.855957 (+ 59211us) raft_consensus.cc:1645] Marking committed up to 4
0709 14:51:56.856008 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:56.856279 (+   271us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:51:56.935818 (+ 79539us) raft_consensus.cc:1685] finished
0709 14:51:56.935842 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:51:56.936069 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":969,"raft.run_cpu_time_us":304,"raft.run_wall_time_us":437,"thread_start_us":57933,"threads_started":1,"wal-append.queue_time_us":134371}
I20260709 14:51:56.942502 10927 leader_election.cc:290] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785), 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68:42321)
I20260709 14:51:56.943524 10917 leader_election.cc:290] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:56.943442  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:56.946501  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:56.947417  7778 raft_consensus.cc:2468] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 10.
I20260709 14:51:56.947418  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:56.948545  7777 raft_consensus.cc:3060] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:51:56.954008 10919 leader_election.cc:290] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:56.963506  7778 raft_consensus.cc:1240] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 14:51:56.964552  7744 leader_election.cc:400] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 election: Vote denied by peer 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785) with higher term. Message: Invalid argument: T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 9. Current term is 10.
W20260709 14:51:56.975896  7773 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37144 (request call id 2497) took 2034 ms (client timeout 1955 ms). Trace:
W20260709 14:51:56.979688  7773 rpcz_store.cc:269] 0709 14:51:54.941879 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:55.096317 (+154438us) service_pool.cc:224] Handling call
0709 14:51:56.975320 (+1879003us) spinlock_profiling.cc:243] Waited 1.69 s on lock 0x7b54002dd2d4. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae922fa 00007fb68fe53b17 00007fb6893ce6d4 00007fb6893ce662 00007fb6893ce591 00007fb6893ce50c 00007fb6893cd7c2 00007fb6891c948c 00007fb6891c88c6 00007fb6891c826f
0709 14:51:56.975761 (+   441us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3883760896}
I20260709 14:51:56.981456  7744 leader_election.cc:403] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 14:51:56.984236 10919 raft_consensus.cc:2749] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785) with higher term. Message: Invalid argument: T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 9. Current term is 10.
I20260709 14:51:56.982900  7777 raft_consensus.cc:2468] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 10.
I20260709 14:51:56.984584  7744 leader_election.cc:304] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:51:56.986922 10919 raft_consensus.cc:2764] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 14:51:56.987183  7744 leader_election.cc:304] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:51:56.988713 10919 raft_consensus.cc:2804] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader election won for term 7
I20260709 14:51:56.989684 10919 raft_consensus.cc:697] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:51:56.997398 10919 consensus_queue.cc:237] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:57.022636 10845 raft_consensus.cc:493] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:57.023526 10845 raft_consensus.cc:515] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:57.030544 10845 leader_election.cc:290] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:51:57.051944  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 285736us
W20260709 14:51:57.064555  7745 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:51:57.067005  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 75736us
I20260709 14:51:57.071586  7893 leader_election.cc:304] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:57.073141 10881 raft_consensus.cc:2749] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 14:51:57.084586  7893 leader_election.cc:304] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:57.087757 10881 raft_consensus.cc:2804] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 14:51:57.088609 10881 raft_consensus.cc:697] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:57.092252 10919 consensus_queue.cc:1048] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 14:51:57.090493 10881 consensus_queue.cc:237] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:57.086160  7745 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 1.546s (SENT) [suppressed 76 similar messages]
I20260709 14:51:57.098758 10942 raft_consensus.cc:493] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:57.104106 10942 raft_consensus.cc:515] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:57.107314  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:57.108404  7777 raft_consensus.cc:3060] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Advancing to term 8
I20260709 14:51:57.110318  7773 raft_consensus.cc:1275] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 14:51:57.111076  7771 raft_consensus.cc:1240] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 5. Current term is 6. Ops: []
I20260709 14:51:57.111568  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:57.112509  7773 raft_consensus.cc:3060] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:51:57.108439  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:57.113981  7778 raft_consensus.cc:3060] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:51:57.113365  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:57.115032  7776 raft_consensus.cc:3060] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:51:57.114053  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:57.119076  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:57.119454 10880 leader_election.cc:290] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:57.120800  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:57.121992  7772 raft_consensus.cc:3060] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Advancing to term 9
I20260709 14:51:57.123127 10880 consensus_queue.cc:1059] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 14:51:57.124223 10930 raft_consensus.cc:2749] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785) with higher term. Message: Invalid argument: T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 7. Current term is 8.
I20260709 14:51:57.105322  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:57.128306  8637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce9c0ef2db24c13a8b1402f21819458" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9418391fa82a42c79c6cad13ba91d964" is_pre_election: true
W20260709 14:51:57.126582  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 391225us
I20260709 14:51:57.112602  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:57.134409  7777 raft_consensus.cc:2468] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 8.
I20260709 14:51:57.135864  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:57.136535 10849 raft_consensus.cc:493] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:57.111441 10651 leader_election.cc:290] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:57.138213  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:57.137952 10849 raft_consensus.cc:515] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:57.138970 10651 consensus_queue.cc:1059] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 14:51:57.136691 10906 log.cc:927] Time spent T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 1.241s	user 0.000s	sys 0.004s
I20260709 14:51:57.141415 10849 leader_election.cc:290] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:57.140771 10651 consensus_queue.cc:1059] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 14:51:57.142484  7777 raft_consensus.cc:2468] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 10.
I20260709 14:51:57.143725  7774 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 2511) took 2006 ms. Trace:
I20260709 14:51:57.144769  7819 leader_election.cc:400] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 4 pre-election: Vote denied by peer 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785) with higher term. Message: Invalid argument: T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 4. Current term is 5.
I20260709 14:51:57.145179  7819 leader_election.cc:403] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 14:51:57.147310  7776 raft_consensus.cc:2468] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 7.
I20260709 14:51:57.148559  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:57.149539  7777 raft_consensus.cc:3060] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:51:57.150347  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:57.150710  7778 raft_consensus.cc:2468] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 10.
I20260709 14:51:57.157879  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
W20260709 14:51:57.157948  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 71856us
I20260709 14:51:57.157997  7771 raft_consensus.cc:3060] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:51:57.161226  7778 raft_consensus.cc:3060] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:51:57.163620 10930 raft_consensus.cc:2749] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785) with higher term. Message: Invalid argument: T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 4. Current term is 5.
I20260709 14:51:57.163949  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:57.165890  7819 leader_election.cc:304] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
W20260709 14:51:57.166858  7745 leader_election.cc:336] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 2.027s (SENT)
I20260709 14:51:56.722556  7775 rpcz_store.cc:276] 0709 14:51:54.482562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:54.569551 (+ 86989us) service_pool.cc:224] Handling call
0709 14:51:54.588416 (+ 18865us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:51:54.588675 (+   259us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 14:51:54.615318 (+ 26643us) log.cc:844] Serialized 14 byte log entry
0709 14:51:55.195919 (+580601us) spinlock_profiling.cc:243] Waited 6.14 ms on lock 0x7b18002825e0. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb690c69de1 00007fb690c765b1 00007fb687d83e07 00007fb690bdeab9 00007fb687da069b 00007fb687d9e93f 00007fb687da0c02 00007fb68aa2820b 00007fb68aa2dd23 00007fb68aa2e23a 00007fb68ae98a2a
0709 14:51:56.716042 (+1520123us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:51:56.716178 (+   136us) raft_consensus.cc:1645] Marking committed up to 5
0709 14:51:56.716277 (+    99us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:56.716420 (+   143us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:51:56.716657 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":26459,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":67,"raft.queue_time_us":6935,"raft.run_cpu_time_us":302,"raft.run_wall_time_us":306,"spinlock_wait_cycles":14123264,"thread_start_us":1514304,"threads_started":1,"wal-append.queue_time_us":790715,"wal-append.run_cpu_time_us":2313,"wal-append.run_wall_time_us":1029721}
I20260709 14:51:57.144181  7774 rpcz_store.cc:276] 0709 14:51:55.136678 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:55.836568 (+699890us) service_pool.cc:224] Handling call
0709 14:51:55.837663 (+  1095us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:51:55.840087 (+  2424us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:51:55.840113 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:51:55.840627 (+   514us) log.cc:844] Serialized 26 byte log entry
0709 14:51:55.894151 (+ 53524us) raft_consensus.cc:1645] Marking committed up to 4
0709 14:51:55.894199 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:55.894444 (+   245us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:51:57.135458 (+1241014us) spinlock_profiling.cc:243] Waited 11.2 ms on lock 0x7b4400022b4c. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb687c29db1 00007fb687cc7c85 00007fb687cc86a2 00007fb68aa3a1db 00007fb68aa35aaf 00007fb68aa2986e 00007fb68aa28bb6 00007fb68aa287d8 00007fb68aa32221 00007fb68aa321d9 00007fb68aa32169
0709 14:51:57.142553 (+  7095us) raft_consensus.cc:1685] finished
0709 14:51:57.142577 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:51:57.143435 (+   858us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10798,"raft.run_cpu_time_us":332,"raft.run_wall_time_us":1502,"spinlock_wait_cycles":25654016,"thread_start_us":53125,"threads_started":1,"wal-append.queue_time_us":54143}
I20260709 14:51:57.170162  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:57.170279  7745 leader_election.cc:304] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:57.171401  7770 raft_consensus.cc:3060] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Advancing to term 8
I20260709 14:51:57.171671  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:57.170348  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:57.172255  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:57.172936  7927 raft_consensus.cc:2468] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 10.
I20260709 14:51:57.173867  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:57.175441  7775 raft_consensus.cc:2410] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
W20260709 14:51:57.176173  7745 leader_election.cc:336] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 2.178s (SENT)
I20260709 14:51:57.176776  7745 leader_election.cc:304] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:57.177346  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:57.177553 10930 raft_consensus.cc:3060] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:51:57.180055  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:57.174013 10942 leader_election.cc:290] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:57.173033  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:57.172075 10849 raft_consensus.cc:2749] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 14:51:57.192991  7774 raft_consensus.cc:3060] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:51:57.160768 10880 raft_consensus.cc:3055] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 14:51:57.194257 10880 raft_consensus.cc:740] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
W20260709 14:51:57.178543  7745 leader_election.cc:336] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 2.245s (SENT)
I20260709 14:51:57.195657 10880 consensus_queue.cc:260] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:57.186479  7819 leader_election.cc:304] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:57.198295 10873 raft_consensus.cc:2749] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 14:51:57.200539  7775 raft_consensus.cc:2468] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 9.
I20260709 14:51:57.201176  7819 leader_election.cc:400] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 5 election: Vote denied by peer 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785) with higher term. Message: Invalid argument: T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 5. Current term is 6.
I20260709 14:51:57.201679  7819 leader_election.cc:403] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 14:51:57.185964  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258d6c2dda954bf5b65930fde8ecb9f3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:57.186331  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:57.188781  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:57.214486  7773 raft_consensus.cc:2468] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 10.
I20260709 14:51:57.219911  7776 raft_consensus.cc:1240] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 9. Current term is 10. Ops: []
I20260709 14:51:57.212121 10873 raft_consensus.cc:2749] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785) with higher term. Message: Invalid argument: T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 5. Current term is 6.
I20260709 14:51:57.215943 10735 raft_consensus.cc:2749] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 14:51:57.225368 10880 raft_consensus.cc:3060] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:51:57.229704  7775 raft_consensus.cc:1275] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 14:51:57.229068 10652 raft_consensus.cc:3055] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 14:51:57.233956  7771 raft_consensus.cc:2468] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 11.
I20260709 14:51:57.232481 10652 raft_consensus.cc:740] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:57.236377  7772 raft_consensus.cc:2468] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 9.
I20260709 14:51:57.237994  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:57.238332 10652 consensus_queue.cc:260] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:57.238901  7776 raft_consensus.cc:1275] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 14:51:57.239979 10652 raft_consensus.cc:3060] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:51:57.242399  7771 raft_consensus.cc:1275] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 14:51:57.247385  7779 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 2476) took 2867 ms. Trace:
I20260709 14:51:57.247948  7779 rpcz_store.cc:276] 0709 14:51:54.380128 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:54.405605 (+ 25477us) service_pool.cc:224] Handling call
0709 14:51:54.405983 (+   378us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:51:56.896224 (+2490241us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:57.246955 (+350731us) spinlock_profiling.cc:243] Waited 2.47 s on lock 0x7b540014e1d4. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae8ee01 00007fb68ae8d83e 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2 00007fb6891c948c 00007fb6891c88c6
0709 14:51:57.247290 (+   335us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5674499968}
I20260709 14:51:57.244076  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:57.245291  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:57.246136  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce9c0ef2db24c13a8b1402f21819458" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:57.251113  7744 leader_election.cc:304] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:51:57.254537 10849 raft_consensus.cc:2804] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 14:51:57.255048 10849 raft_consensus.cc:493] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:57.255400 10849 raft_consensus.cc:3060] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Advancing to term 11
W20260709 14:51:57.257576  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 56640.3us
I20260709 14:51:57.258111  7927 raft_consensus.cc:2393] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 9: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:51:57.258888  7819 leader_election.cc:400] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 8 pre-election: Vote denied by peer 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785) with higher term. Message: Invalid argument: T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 8. Current term is 9.
I20260709 14:51:57.259348  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:57.259912  7775 raft_consensus.cc:3055] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 LEADER]: Stepping down as leader of term 4
I20260709 14:51:57.260290  7775 raft_consensus.cc:740] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:51:57.261354  7775 consensus_queue.cc:260] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:57.262193  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:57.263520  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:57.264302  7775 raft_consensus.cc:3060] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:51:57.265448 10849 raft_consensus.cc:515] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:57.267695 10849 leader_election.cc:290] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:57.274109  7775 raft_consensus.cc:1275] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 14:51:57.274744  7775 pending_rounds.cc:85] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed: Aborting all ops after (but not including) 2
I20260709 14:51:57.275023  7775 pending_rounds.cc:107] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 14:51:57.275267  7775 raft_consensus.cc:2889] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:51:57.274109  7773 raft_consensus.cc:1275] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 14:51:57.260922  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:57.261595  7819 leader_election.cc:400] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 10 election: Vote denied by peer 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785) with higher term. Message: Invalid argument: T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 10. Current term is 11.
I20260709 14:51:57.285684  7778 raft_consensus.cc:2468] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 10.
I20260709 14:51:57.288381  7777 raft_consensus.cc:2468] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 12.
I20260709 14:51:57.265090  7925 raft_consensus.cc:1240] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 14:51:57.254382  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:57.294020  7919 raft_consensus.cc:2468] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 8.
I20260709 14:51:57.297209 10849 raft_consensus.cc:493] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:57.297683  7919 raft_consensus.cc:1240] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 6. Current term is 7. Ops: []
I20260709 14:51:57.297880 10849 raft_consensus.cc:515] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:57.300774 10849 leader_election.cc:290] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:57.302491  7927 raft_consensus.cc:1240] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 5. Current term is 6. Ops: []
I20260709 14:51:57.305531  7774 raft_consensus.cc:2468] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 9.
I20260709 14:51:57.306300  7925 raft_consensus.cc:1240] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 9. Current term is 10. Ops: []
I20260709 14:51:57.308269  7925 raft_consensus.cc:1275] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 14:51:57.311983 10731 consensus_meta.cc:287] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent flushing consensus metadata: real 0.553s	user 0.016s	sys 0.004s
I20260709 14:51:57.312592 10731 raft_consensus.cc:515] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:57.315459  7770 raft_consensus.cc:2468] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 8.
W20260709 14:51:57.312764 10797 consensus_meta.cc:287] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent flushing consensus metadata: real 0.539s	user 0.015s	sys 0.005s
I20260709 14:51:57.296243 10930 raft_consensus.cc:2749] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 14:51:57.319700 10797 raft_consensus.cc:515] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:57.320490  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 59111.6us
I20260709 14:51:57.323153 10797 leader_election.cc:290] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:57.324590  7819 leader_election.cc:400] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 10 pre-election: Vote denied by peer 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785) with higher term. Message: Invalid argument: T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 10. Current term is 11.
I20260709 14:51:57.329139  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:57.333768  7928 raft_consensus.cc:2368] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 7. Current term is 8.
I20260709 14:51:57.335521 10880 raft_consensus.cc:493] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:57.329002  7819 leader_election.cc:304] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:57.338055  7920 raft_consensus.cc:2468] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 7.
I20260709 14:51:57.338749 10930 raft_consensus.cc:2749] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 14:51:57.341536 10874 leader_election.cc:290] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:57.315518 10731 leader_election.cc:290] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:57.336897 10880 raft_consensus.cc:515] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:57.347002 10880 leader_election.cc:290] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:57.340229  7819 leader_election.cc:304] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:57.355854 10930 raft_consensus.cc:2749] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 14:51:57.359833 10880 consensus_queue.cc:1048] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 14:51:57.364269 10745 consensus_queue.cc:1059] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 14:51:57.370007  7819 leader_election.cc:304] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:57.371928 10880 raft_consensus.cc:993] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0: : Instructing follower 1de5e20126fa4d8ca0793d19c7b847ed to start an election
I20260709 14:51:57.374143 10930 raft_consensus.cc:2749] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 14:51:57.374848 10880 raft_consensus.cc:3055] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 14:51:57.378358 10748 raft_consensus.cc:1081] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 LEADER]: Signalling peer 1de5e20126fa4d8ca0793d19c7b847ed to start an election
W20260709 14:51:57.387372 10916 log.cc:927] Time spent T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 1.058s	user 0.006s	sys 0.000s
I20260709 14:51:57.377233  7819 leader_election.cc:400] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 9 pre-election: Vote denied by peer 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785) with higher term. Message: Invalid argument: T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 9. Current term is 10.
I20260709 14:51:57.397791 10675 raft_consensus.cc:493] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:57.399154 10675 raft_consensus.cc:515] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:57.399791  7819 leader_election.cc:400] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 8 election: Vote denied by peer 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785) with higher term. Message: Invalid argument: T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 8. Current term is 9.
I20260709 14:51:57.400202  7819 leader_election.cc:403] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 14:51:57.401603  7819 leader_election.cc:304] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:57.402400 10748 raft_consensus.cc:493] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:51:57.401604  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:51:57.404114  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 59258.7us
I20260709 14:51:57.403136 10748 raft_consensus.cc:515] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:57.377179 10880 raft_consensus.cc:740] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:57.402529 10914 raft_consensus.cc:2749] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785) with higher term. Message: Invalid argument: T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 8. Current term is 9.
I20260709 14:51:57.406057 10933 raft_consensus.cc:2749] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 14:51:57.403098 10730 raft_consensus.cc:493] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:57.410876 10930 raft_consensus.cc:2749] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 14:51:57.413975  7923 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
mode: GRACEFUL
new_leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:48676
I20260709 14:51:57.414774  7923 raft_consensus.cc:606] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 LEADER]: Received request to transfer leadership to TS 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:51:57.415320 10730 raft_consensus.cc:515] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:57.417881 10730 leader_election.cc:290] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:57.421144  6549 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 14:51:57.428161  6549 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 14:51:57.428277  7743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:57.428333 10712 leader_election.cc:290] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:57.429486  7852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 2786) took 1673 ms. Trace:
I20260709 14:51:57.430060  7852 rpcz_store.cc:276] 0709 14:51:55.732647 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:56.017888 (+285241us) service_pool.cc:224] Handling call
0709 14:51:56.018574 (+   686us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:51:56.024284 (+  5710us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:51:56.024343 (+    59us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:51:56.025290 (+   947us) log.cc:844] Serialized 26 byte log entry
0709 14:51:57.403311 (+1378021us) spinlock_profiling.cc:243] Waited 8.01 ms on lock 0x7b18003c5920. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb690c69de1 00007fb690c765b1 00007fb68aa364bc 00007fb687d8448b 00007fb690bdeab9 00007fb687da069b 00007fb687d9e93f 00007fb687da0c02 00007fb68aa2820b 00007fb68aa2dd23 00007fb68aa2e0d1
0709 14:51:57.403606 (+   295us) raft_consensus.cc:1645] Marking committed up to 4
0709 14:51:57.403650 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:57.403769 (+   119us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:51:57.403813 (+    44us) raft_consensus.cc:1685] finished
0709 14:51:57.403824 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:51:57.405737 (+  1913us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4997,"raft.queue_time_us":283918,"raft.run_cpu_time_us":289,"raft.run_wall_time_us":8738,"spinlock_wait_cycles":18420608,"thread_start_us":266350,"threads_started":1,"wal-append.queue_time_us":531440}
I20260709 14:51:57.433091  7819 leader_election.cc:304] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:57.434499 10930 raft_consensus.cc:2749] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 14:51:57.435096  7893 leader_election.cc:304] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:57.435470 10873 consensus_queue.cc:1059] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 14:51:57.422303 10748 leader_election.cc:290] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:57.437484 10908 consensus_queue.cc:1048] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 14:51:57.429497 10880 consensus_queue.cc:260] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:57.439870 10914 raft_consensus.cc:493] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:57.437003  7819 leader_election.cc:400] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 8 election: Vote denied by peer 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785) with higher term. Message: Invalid argument: T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 8. Current term is 9.
I20260709 14:51:57.443279 10873 consensus_queue.cc:1243] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer 1e9289592458429bbddb19c2e7b7b7b0 log is divergent from this leader: its last log entry 7.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 14:51:57.437047 10903 consensus_queue.cc:1059] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 14:51:57.446529 10914 raft_consensus.cc:515] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:57.447708 10675 leader_election.cc:290] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:57.446714 10903 consensus_queue.cc:1243] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer 1e9289592458429bbddb19c2e7b7b7b0 log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 14:51:57.450073 10914 leader_election.cc:290] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:57.451277 10748 raft_consensus.cc:2749] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 14:51:57.457602  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 49091us
I20260709 14:51:57.450251 10880 raft_consensus.cc:3060] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:51:57.466290  7893 leader_election.cc:304] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:51:57.467844 10730 raft_consensus.cc:2804] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 14:51:57.468689 10730 raft_consensus.cc:697] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:57.470036 10730 consensus_queue.cc:237] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:57.473567  7894 leader_election.cc:304] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:57.475294 10955 raft_consensus.cc:2804] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 14:51:57.476529 10955 raft_consensus.cc:697] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:57.476595  8637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18d29d52d304c87b930d4fb5eaf50b1" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9418391fa82a42c79c6cad13ba91d964" is_pre_election: true
I20260709 14:51:57.469082  7676 catalog_manager.cc:5697] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:51:57.478356 10675 raft_consensus.cc:493] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:57.477838 10955 consensus_queue.cc:237] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:57.479878  7893 leader_election.cc:304] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:51:57.481387 10748 raft_consensus.cc:2804] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 14:51:57.481875 10748 raft_consensus.cc:493] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:57.482241 10748 raft_consensus.cc:3060] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Advancing to term 11
W20260709 14:51:57.474249  7850 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49946 (request call id 2769) took 1794 ms (client timeout 2136 ms). Trace:
I20260709 14:51:57.484440  7894 leader_election.cc:304] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:51:57.485884 10744 raft_consensus.cc:2804] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 14:51:57.486573 10744 raft_consensus.cc:697] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:57.487669 10744 consensus_queue.cc:237] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:57.489869  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783e4874513449ef9084b833f188a6d3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
W20260709 14:51:57.483613  7850 rpcz_store.cc:269] 0709 14:51:55.680123 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:55.680348 (+   225us) service_pool.cc:224] Handling call
0709 14:51:56.640978 (+960630us) spinlock_profiling.cc:243] Waited 1.97 ms on lock 0x7b5800026198. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb687c29db1 00007fb687d69b71 00007fb687d69a22 00007fb690c82c09 00007fb68fddcee0 00007fb68fea60ab 00007fb68fea6131 00007fb68fe540a0 00007fb68fe53984 00007fb6893ce6d4 00007fb6893ce662
0709 14:51:57.474081 (+833103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4538624}
I20260709 14:51:57.479035 10675 raft_consensus.cc:515] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:57.493574  7744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:57.499135  7893 leader_election.cc:304] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:57.501215 10571 raft_consensus.cc:2804] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 14:51:57.503235  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 66517.3us
I20260709 14:51:57.502147 10571 raft_consensus.cc:697] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:57.509863 10571 consensus_queue.cc:237] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:57.515949 10675 leader_election.cc:290] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:57.506230  7676 catalog_manager.cc:5697] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 5 to 7, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 7 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:51:57.514338  7819 leader_election.cc:304] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
W20260709 14:51:57.517755  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:57.520367  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:57.522472 10903 raft_consensus.cc:2804] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 14:51:57.523105 10903 raft_consensus.cc:493] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:57.523514 10903 raft_consensus.cc:3060] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:51:57.526104 10908 consensus_queue.cc:1059] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 14:51:57.527318 10914 raft_consensus.cc:493] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:57.528064 10914 raft_consensus.cc:515] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:57.528378 10908 raft_consensus.cc:3055] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 LEADER]: Stepping down as leader of term 9
I20260709 14:51:57.529013 10908 raft_consensus.cc:740] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
W20260709 14:51:57.529588 10915 log.cc:927] Time spent T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 1.105s	user 0.005s	sys 0.000s
I20260709 14:51:57.530617 10914 leader_election.cc:290] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:57.532020  7853 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 2774) took 1845 ms. Trace:
I20260709 14:51:57.530202 10908 consensus_queue.cc:260] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:57.533234 10908 raft_consensus.cc:3060] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:51:57.561372 10914 consensus_queue.cc:1059] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 14:51:57.562613 10914 raft_consensus.cc:3055] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 LEADER]: Stepping down as leader of term 8
I20260709 14:51:57.562985 10914 raft_consensus.cc:740] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:51:57.532449  7853 rpcz_store.cc:276] 0709 14:51:55.686394 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:55.686519 (+   125us) service_pool.cc:224] Handling call
0709 14:51:55.901835 (+215316us) spinlock_profiling.cc:243] Waited 6.92 ms on lock 0x7b5800026198. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb687c29db1 00007fb687d69b71 00007fb687d69a22 00007fb690c82c09 00007fb68fddcee0 00007fb68fea60ab 00007fb68fea6131 00007fb68fe67fc0 00007fb68fe52929 00007fb68fe523d2 00007fb6893c9bd4
0709 14:51:55.902125 (+   290us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 14:51:55.953584 (+ 51459us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:51:55.953618 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 14:51:55.954410 (+   792us) log.cc:844] Serialized 52 byte log entry
0709 14:51:56.043494 (+ 89084us) raft_consensus.cc:1645] Marking committed up to 4
0709 14:51:56.306963 (+263469us) log.cc:844] Serialized 14 byte log entry
0709 14:51:56.562224 (+255261us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:51:56.589999 (+ 27775us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:51:57.382325 (+792326us) spinlock_profiling.cc:243] Waited 4.4 ms on lock 0x7b18001cd080. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb690c69de1 00007fb690c765b1 00007fb687da1522 00007fb687da37c1 00007fb687da3779 00007fb687da3709 00007fb687da36d1 00007fb687da29cd 0000000000396ad4 0000000000396919 00007fb687d8483a
0709 14:51:57.528745 (+146420us) spinlock_profiling.cc:243] Waited 1.21 ms on lock 0x7b4400022b4c. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb687c29db1 00007fb687cc7c85 00007fb687cc86a2 00007fb68aa3a1db 00007fb68aa35aaf 00007fb68aa2986e 00007fb68aa28bb6 00007fb68aa287d8 00007fb68aa32221 00007fb68aa321d9 00007fb68aa32169
0709 14:51:57.531659 (+  2914us) raft_consensus.cc:1685] finished
0709 14:51:57.531679 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:51:57.531820 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8325,"prepare.queue_time_us":272542,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":955,"raft.queue_time_us":123248,"raft.run_cpu_time_us":498,"raft.run_wall_time_us":30429,"spinlock_wait_cycles":28808064,"thread_start_us":369345,"threads_started":3,"wal-append.queue_time_us":421468}
I20260709 14:51:57.566794  7924 raft_consensus.cc:1240] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 LEADER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 4. Current term is 5. Ops: []
W20260709 14:51:57.571231  7922 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38516 (request call id 2169) took 3202 ms (client timeout 1508 ms). Trace:
W20260709 14:51:57.572233  7922 rpcz_store.cc:269] 0709 14:51:54.365688 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:54.365887 (+   199us) service_pool.cc:224] Handling call
0709 14:51:57.564894 (+3199007us) spinlock_profiling.cc:243] Waited 2.21 s on lock 0x7b54000cc954. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae922fa 00007fb68fe53b17 00007fb6893ce6d4 00007fb6893ce662 00007fb6893ce591 00007fb6893ce50c 00007fb6893cd7c2 00007fb6891c948c 00007fb6891c88c6 00007fb6891c826f
0709 14:51:57.565232 (+   338us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5073252736}
I20260709 14:51:57.576313  7893 leader_election.cc:304] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:51:57.564538 10914 consensus_queue.cc:260] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:57.590225 10744 raft_consensus.cc:2804] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 14:51:57.590865 10744 raft_consensus.cc:493] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:57.591261 10744 raft_consensus.cc:3060] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:51:57.592923  7850 raft_consensus.cc:1275] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 14:51:57.593218  7851 raft_consensus.cc:1240] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 9. Current term is 10. Ops: []
I20260709 14:51:57.594425  7853 raft_consensus.cc:1275] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 14:51:57.594319  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:57.594923  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:57.595314  7846 raft_consensus.cc:2368] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 10. Current term is 11.
I20260709 14:51:57.598588 10748 raft_consensus.cc:515] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:57.600270 10651 raft_consensus.cc:3055] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 14:51:57.600853 10651 raft_consensus.cc:740] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:57.602231  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:57.601992 10651 consensus_queue.cc:260] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:57.603248  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:57.603091  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:57.605175  7854 raft_consensus.cc:2468] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 8.
I20260709 14:51:57.603150 10651 raft_consensus.cc:3060] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:51:57.603199  7851 raft_consensus.cc:2410] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 14:51:57.604360  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:57.607842  7845 raft_consensus.cc:2368] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 9. Current term is 10.
I20260709 14:51:57.610210  7854 raft_consensus.cc:1275] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 8. (term mismatch)
I20260709 14:51:57.610683  7854 pending_rounds.cc:85] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting all ops after (but not including) 7
I20260709 14:51:57.611042  7854 pending_rounds.cc:107] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting uncommitted NO_OP operation due to leader change: 10.8
I20260709 14:51:57.611323  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: true dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:57.611510 10704 consensus_queue.cc:1059] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 14:51:57.612273  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:57.614135  7845 raft_consensus.cc:2410] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 14:51:57.615741  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:57.625312 10873 raft_consensus.cc:3055] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 LEADER]: Stepping down as leader of term 6
I20260709 14:51:57.625841 10873 raft_consensus.cc:740] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:51:57.626358  7845 raft_consensus.cc:3060] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:51:57.614100 10933 raft_consensus.cc:493] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:57.611325  7854 raft_consensus.cc:2889] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:51:57.630774 10933 raft_consensus.cc:515] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:57.632268  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783e4874513449ef9084b833f188a6d3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:57.617748  7893 leader_election.cc:304] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:57.633682  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:57.614290 10914 raft_consensus.cc:3060] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:51:57.634637  7850 raft_consensus.cc:2393] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 8: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:51:57.635603  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9441e831627143a991a1556dcdce71e3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:51:57.636091 10742 consensus_meta.cc:287] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent flushing consensus metadata: real 0.837s	user 0.021s	sys 0.004s
I20260709 14:51:57.632989  7854 raft_consensus.cc:3060] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Advancing to term 7
W20260709 14:51:57.646019  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 55202.8us
I20260709 14:51:57.626974 10873 consensus_queue.cc:260] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:57.628558 10930 raft_consensus.cc:3055] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 LEADER]: Stepping down as leader of term 8
I20260709 14:51:57.628949  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:57.617468  7851 raft_consensus.cc:3060] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:51:57.648671  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:57.653759  7849 raft_consensus.cc:2468] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 12.
I20260709 14:51:57.624497 10870 raft_consensus.cc:493] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
W20260709 14:51:57.663293  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 73945.2us
I20260709 14:51:57.658178  7848 raft_consensus.cc:2368] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 7. Current term is 8.
I20260709 14:51:57.664013 10870 raft_consensus.cc:515] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:57.655216 10930 raft_consensus.cc:740] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:51:57.658277  7850 raft_consensus.cc:3060] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:51:57.665676  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258d6c2dda954bf5b65930fde8ecb9f3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:57.666508 10930 consensus_queue.cc:260] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:57.661576  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:57.668349 10880 raft_consensus.cc:2804] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 14:51:57.669301 10860 consensus_queue.cc:1059] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 14:51:57.659042  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:57.662928  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:57.672103  7849 raft_consensus.cc:3060] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:51:57.638265 10748 leader_election.cc:290] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 11 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:57.633078 10933 leader_election.cc:290] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:57.682482  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:57.684969  7850 raft_consensus.cc:2468] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 7.
I20260709 14:51:57.637662 10742 raft_consensus.cc:515] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:57.680091  7845 raft_consensus.cc:2468] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 7.
W20260709 14:51:57.672022 10959 log.cc:927] Time spent T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 14:51:57.690158  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:57.695072 10870 leader_election.cc:290] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:57.687481 10745 consensus_queue.cc:1048] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
I20260709 14:51:57.687016 10930 raft_consensus.cc:3060] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:51:57.685087 10954 raft_consensus.cc:3055] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 14:51:57.721585 10954 raft_consensus.cc:740] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:57.722872 10954 consensus_queue.cc:260] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:57.724591 10954 raft_consensus.cc:3060] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:51:57.704555  7853 raft_consensus.cc:2393] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 7: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:51:57.700402 10903 raft_consensus.cc:515] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:57.729625  7846 raft_consensus.cc:2393] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 11: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:51:57.731829 10903 leader_election.cc:290] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 11 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:57.733632 10735 raft_consensus.cc:493] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:57.734943 10735 raft_consensus.cc:515] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:57.739125 10735 leader_election.cc:290] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:57.673492 10880 raft_consensus.cc:697] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:57.741775 10880 consensus_queue.cc:237] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:57.742918  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:57.677747 10744 raft_consensus.cc:515] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:57.747985 10744 leader_election.cc:290] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:57.761956  7849 raft_consensus.cc:2468] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 9.
I20260709 14:51:57.753149 10873 raft_consensus.cc:3060] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:51:57.772519  7851 raft_consensus.cc:2468] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 7.
I20260709 14:51:57.775470  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18d29d52d304c87b930d4fb5eaf50b1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:57.760385 10903 raft_consensus.cc:493] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:57.785077  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:51:57.787923  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 105977us
I20260709 14:51:57.786789 10903 raft_consensus.cc:515] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:57.798060  7893 leader_election.cc:304] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:51:57.798986 10903 leader_election.cc:290] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:57.798844 10933 raft_consensus.cc:3055] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 LEADER]: Stepping down as leader of term 6
I20260709 14:51:57.804227  7847 raft_consensus.cc:2368] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 9. Current term is 10.
I20260709 14:51:57.804850 10933 raft_consensus.cc:740] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:51:57.805884 10933 consensus_queue.cc:260] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:57.807272 10933 raft_consensus.cc:3060] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:51:57.811136  7851 raft_consensus.cc:2393] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 10: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:51:57.812456  7854 raft_consensus.cc:2468] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 7.
I20260709 14:51:57.815937 10745 raft_consensus.cc:2804] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 14:51:57.817668 10745 raft_consensus.cc:697] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:57.818958 10745 consensus_queue.cc:237] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:57.820132 10859 consensus_queue.cc:1048] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 14:51:57.820411 10955 consensus_queue.cc:1048] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 14:51:57.821518 10748 consensus_queue.cc:1048] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 14:51:57.822420  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:57.822165 10955 consensus_queue.cc:1048] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 14:51:57.824090  7893 leader_election.cc:304] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:51:57.841547  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:51:57.803670 10960 log.cc:927] Time spent T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.131s	user 0.003s	sys 0.000s
I20260709 14:51:57.848199  7893 leader_election.cc:304] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:51:57.821938 10859 consensus_queue.cc:1048] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 14:51:57.850910  7854 raft_consensus.cc:2468] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 10.
I20260709 14:51:57.852366  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:57.853441  7847 raft_consensus.cc:3060] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Advancing to term 8
I20260709 14:51:57.854682  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:57.856109  7851 raft_consensus.cc:2368] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 7. Current term is 8.
I20260709 14:51:57.858515  7893 leader_election.cc:304] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:51:57.858839 10735 raft_consensus.cc:493] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:57.859719 10955 raft_consensus.cc:2804] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 14:51:57.860432 10955 raft_consensus.cc:697] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:57.847859 10744 raft_consensus.cc:2804] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 14:51:57.861826 10744 raft_consensus.cc:697] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:57.861654 10955 consensus_queue.cc:237] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:57.863142 10744 consensus_queue.cc:237] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:57.859719 10735 raft_consensus.cc:515] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:57.868197  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:57.869439  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:57.870595  7845 raft_consensus.cc:2468] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 9.
I20260709 14:51:57.871038  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:57.871869  7852 raft_consensus.cc:2468] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 8.
I20260709 14:51:57.872991  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:57.874085  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:57.874364 10735 leader_election.cc:290] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:57.874998  7852 raft_consensus.cc:2468] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 9.
I20260709 14:51:57.869016  7846 raft_consensus.cc:1240] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 4. Current term is 5. Ops: []
I20260709 14:51:57.880247 10745 raft_consensus.cc:2804] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 14:51:57.881356 10745 raft_consensus.cc:697] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:57.883136  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:57.884555  7845 raft_consensus.cc:3060] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:51:57.887329  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:57.886003  7846 raft_consensus.cc:1240] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 6. Current term is 7. Ops: []
I20260709 14:51:57.845508 10930 raft_consensus.cc:493] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:57.870042  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:57.886471  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:57.927711  7850 raft_consensus.cc:3060] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:51:57.885303 10745 consensus_queue.cc:237] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:57.874610 10742 leader_election.cc:290] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:57.883177  7744 leader_election.cc:304] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 9418391fa82a42c79c6cad13ba91d964
I20260709 14:51:57.925128  7845 raft_consensus.cc:2468] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 5.
I20260709 14:51:57.929206  7847 raft_consensus.cc:2468] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 8.
I20260709 14:51:57.927758  7853 raft_consensus.cc:2468] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 9.
I20260709 14:51:57.933899  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:57.937459  7848 raft_consensus.cc:2376] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 12. Re-sending same reply.
W20260709 14:51:57.901724  7800 debug-util.cc:398] Leaking SignalData structure 0x7b08000e7fa0 after lost signal to thread 6552
I20260709 14:51:57.939229  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
W20260709 14:51:57.940356  7894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:57.941072  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:57.940591  7847 raft_consensus.cc:2368] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 9. Current term is 10.
W20260709 14:51:57.942135  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 59074.2us
I20260709 14:51:57.940645  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:51:57.945834  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:57.947827  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:57.948163  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:57.949234  7847 raft_consensus.cc:2368] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 10. Current term is 11.
I20260709 14:51:57.948791  7775 raft_consensus.cc:2376] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 8. Re-sending same reply.
I20260709 14:51:57.950423  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:57.951992  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
W20260709 14:51:57.952440  7800 debug-util.cc:398] Leaking SignalData structure 0x7b080017d3c0 after lost signal to thread 7711
I20260709 14:51:57.952194  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:57.952068  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:57.952276  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: true dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:57.953531  7774 raft_consensus.cc:2376] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 9. Re-sending same reply.
I20260709 14:51:57.950832  7845 raft_consensus.cc:2468] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 7.
I20260709 14:51:57.953987  7777 raft_consensus.cc:3060] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:51:57.952610  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:57.955713  7846 raft_consensus.cc:2393] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 7: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:51:57.956677  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:57.956733  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:57.957564  7845 raft_consensus.cc:2468] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 8.
I20260709 14:51:57.958094  7846 raft_consensus.cc:2393] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 11: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:51:57.958702  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:57.959478  7845 raft_consensus.cc:3060] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:51:57.961561  7850 raft_consensus.cc:2468] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 9.
I20260709 14:51:57.962510  7846 raft_consensus.cc:1240] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 4. Current term is 5. Ops: []
I20260709 14:51:57.972659  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
W20260709 14:51:57.971606  7800 debug-util.cc:398] Leaking SignalData structure 0x7b0800301b80 after lost signal to thread 7803
I20260709 14:51:57.973454  7778 raft_consensus.cc:2376] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 12. Re-sending same reply.
I20260709 14:51:57.954069  7853 raft_consensus.cc:2376] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 7. Re-sending same reply.
I20260709 14:51:57.964167  7850 raft_consensus.cc:1275] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 14:51:57.969292  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
W20260709 14:51:57.973783  7800 debug-util.cc:398] Leaking SignalData structure 0x7b08000a6480 after lost signal to thread 7804
I20260709 14:51:57.975785  7773 raft_consensus.cc:2376] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 9. Re-sending same reply.
I20260709 14:51:57.976418  7770 raft_consensus.cc:1275] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 14:51:57.977504  7845 raft_consensus.cc:2468] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 7.
W20260709 14:51:57.978868  7800 debug-util.cc:398] Leaking SignalData structure 0x7b08003886e0 after lost signal to thread 7878
I20260709 14:51:57.977944  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
W20260709 14:51:57.979568  7800 debug-util.cc:398] Leaking SignalData structure 0x7b0800328d80 after lost signal to thread 7879
I20260709 14:51:57.966632  7851 raft_consensus.cc:3060] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:51:57.981441  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:57.987855  7848 raft_consensus.cc:2368] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 8. Current term is 9.
W20260709 14:51:57.987413  7800 debug-util.cc:398] Leaking SignalData structure 0x7b08003310a0 after lost signal to thread 7952
W20260709 14:51:57.990715  7800 debug-util.cc:398] Leaking SignalData structure 0x7b08002fd0c0 after lost signal to thread 8664
I20260709 14:51:57.968608  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c563cc7cfbe4d59be4ffc5cf847ce56" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
W20260709 14:51:57.994542  7743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:57.950730 10742 raft_consensus.cc:2749] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 14:51:57.996342  7777 raft_consensus.cc:2468] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 10.
I20260709 14:51:57.963537 10880 raft_consensus.cc:493] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:57.995950  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:58.004345  7924 raft_consensus.cc:3060] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:51:58.004462  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:57.997640  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:58.004485  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:58.002471  7779 raft_consensus.cc:2468] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 8.
I20260709 14:51:58.006461  7926 raft_consensus.cc:2393] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 8: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:51:58.000769  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:58.010388 10880 raft_consensus.cc:515] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:58.010488  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:58.019696  7776 raft_consensus.cc:1240] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 6. Current term is 7. Ops: []
I20260709 14:51:58.023658  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:57.941627 10930 raft_consensus.cc:515] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:58.024736  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
W20260709 14:51:58.026211  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:58.026068  7845 raft_consensus.cc:3060] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:51:58.007251  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:58.028841  7925 raft_consensus.cc:2468] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 9.
I20260709 14:51:58.029495  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:58.030305  7848 raft_consensus.cc:2468] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 8.
I20260709 14:51:58.000769 10914 raft_consensus.cc:493] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:57.990485  7775 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "939996e77ee64e9fab21aef50758b706"
dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:37144
I20260709 14:51:58.031810  7775 raft_consensus.cc:493] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:51:58.032249  7775 raft_consensus.cc:3060] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:51:58.035857  7923 raft_consensus.cc:1275] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 14:51:58.032133  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:58.044718  7922 raft_consensus.cc:1240] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 4. Current term is 5. Ops: []
I20260709 14:51:58.044649  7924 raft_consensus.cc:2468] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 11.
W20260709 14:51:58.050427  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:58.054056  7854 raft_consensus.cc:3060] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:51:58.058516  7850 raft_consensus.cc:1275] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 14:51:58.059809  7775 raft_consensus.cc:515] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:58.061548  7776 raft_consensus.cc:1240] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 7. Current term is 8. Ops: []
I20260709 14:51:58.066337  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:58.067384  7850 raft_consensus.cc:2468] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 11.
I20260709 14:51:58.068046 10964 raft_consensus.cc:493] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:58.068888 10964 raft_consensus.cc:515] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:58.074082  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:58.075848  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:58.078181  7850 raft_consensus.cc:3060] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:51:58.078927  7847 raft_consensus.cc:2410] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 14:51:58.067976  7770 raft_consensus.cc:1275] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 14:51:58.081532  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:58.083803  7775 leader_election.cc:290] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:58.084514  7923 raft_consensus.cc:1240] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 8. Current term is 9. Ops: []
I20260709 14:51:58.087581  7851 raft_consensus.cc:2468] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 6.
I20260709 14:51:58.087581  7845 raft_consensus.cc:2468] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 10.
I20260709 14:51:58.089560  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:58.089921  7854 raft_consensus.cc:2468] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 12.
I20260709 14:51:58.031550 10914 raft_consensus.cc:515] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:58.111001  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:58.093436  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:58.111590  7848 raft_consensus.cc:1275] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 14:51:58.116369  7927 raft_consensus.cc:3060] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Advancing to term 8
W20260709 14:51:58.099462  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:58.092610  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:58.094091  7925 raft_consensus.cc:2468] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 8.
I20260709 14:51:58.110124  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:58.093060  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:58.121867  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:58.098436  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:58.124161  7776 raft_consensus.cc:2468] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 6.
I20260709 14:51:58.125452  7846 raft_consensus.cc:2410] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 14:51:58.127279  7926 raft_consensus.cc:3060] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:51:58.133432  7779 raft_consensus.cc:1240] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 6. Current term is 7. Ops: []
I20260709 14:51:58.136802 10930 leader_election.cc:290] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:58.138027  7849 raft_consensus.cc:1240] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 5. Current term is 6. Ops: []
I20260709 14:51:58.140832  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:58.141868  7776 raft_consensus.cc:3060] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:51:58.144023  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:58.147094  7770 raft_consensus.cc:2410] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 14:51:58.147831  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:58.147089  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:58.149663  7853 raft_consensus.cc:1275] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 14:51:58.148332  7925 raft_consensus.cc:2393] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 10: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:51:58.150106  7853 pending_rounds.cc:85] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting all ops after (but not including) 4
I20260709 14:51:58.154788  7853 pending_rounds.cc:107] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 14:51:58.155069  7853 raft_consensus.cc:2889] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:51:58.130137 10742 consensus_queue.cc:1048] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 14:51:58.165328  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:51:58.166142  7923 raft_consensus.cc:2393] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 11: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:51:58.166919  7920 raft_consensus.cc:1240] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 14:51:58.163542  7846 raft_consensus.cc:1240] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 8. Current term is 9. Ops: []
I20260709 14:51:58.162005  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:58.172983  7850 raft_consensus.cc:2468] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 9.
I20260709 14:51:58.137445 10735 consensus_queue.cc:1059] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 14:51:58.180598  7771 raft_consensus.cc:1240] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 10. Current term is 11. Ops: []
I20260709 14:51:58.188037  7926 raft_consensus.cc:2468] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 9.
I20260709 14:51:58.192809  7776 raft_consensus.cc:2468] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 11.
I20260709 14:51:58.199368 10742 consensus_queue.cc:1048] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 14:51:58.203403  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:51:58.212074 10970 log.cc:927] Time spent T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 14:51:58.218813 10880 leader_election.cc:290] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:58.221730  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:51:58.224714  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:58.225812  7779 raft_consensus.cc:3060] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:51:58.228154  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:58.229110  7853 raft_consensus.cc:3060] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:51:58.238211  7923 raft_consensus.cc:1275] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 14:51:58.255228  7893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:51:58.256433  7893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:58.264561  7927 raft_consensus.cc:2468] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 8.
I20260709 14:51:58.266286  7771 raft_consensus.cc:1275] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 14:51:58.267292  7854 raft_consensus.cc:1240] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 6. Current term is 7. Ops: []
I20260709 14:51:58.276213  7779 raft_consensus.cc:2468] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 10.
I20260709 14:51:58.269272  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:58.269765  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:58.277781  7847 raft_consensus.cc:1275] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 14:51:58.278868  7846 raft_consensus.cc:2410] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 14:51:58.271703  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:58.280175  7845 raft_consensus.cc:2468] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 10.
I20260709 14:51:58.285192  7847 raft_consensus.cc:1275] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 14:51:58.285730  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:58.287164  7849 raft_consensus.cc:2410] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for term 10 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 14:51:58.288513  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c563cc7cfbe4d59be4ffc5cf847ce56" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:58.291553  7854 raft_consensus.cc:1240] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 8. Current term is 9. Ops: []
I20260709 14:51:58.295697  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:58.296782  7853 raft_consensus.cc:2468] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 9.
I20260709 14:51:58.297920  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:58.298854  7847 raft_consensus.cc:2468] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 7.
I20260709 14:51:58.299001  7777 raft_consensus.cc:1240] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 8. Current term is 9. Ops: []
I20260709 14:51:58.299875  7850 raft_consensus.cc:1240] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 6. Current term is 7. Ops: []
I20260709 14:51:58.298137  7772 raft_consensus.cc:1275] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 14:51:58.262136 10914 leader_election.cc:290] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:58.302796  7772 raft_consensus.cc:1275] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 14:51:58.310310  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:58.311064  7852 raft_consensus.cc:3060] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:51:58.303705  7848 raft_consensus.cc:1275] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 14:51:58.301070  7777 raft_consensus.cc:1275] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 14:51:58.304360  7854 raft_consensus.cc:1275] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 14:51:58.305413  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:58.304864  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:58.315690  7850 raft_consensus.cc:2393] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 8: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:51:58.303110  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:58.316722  7853 raft_consensus.cc:2468] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 7.
I20260709 14:51:58.317224  7744 leader_election.cc:304] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
W20260709 14:51:58.320950  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 186553us
I20260709 14:51:58.322796  7745 leader_election.cc:304] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:51:58.339156  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 182031us
I20260709 14:51:58.346367  7846 raft_consensus.cc:1275] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 14:51:58.346932  7846 pending_rounds.cc:85] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting all ops after (but not including) 5
I20260709 14:51:58.347174  7846 pending_rounds.cc:107] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 14:51:58.347414  7846 raft_consensus.cc:2889] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:51:58.355410  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:58.356526  7849 raft_consensus.cc:3060] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Advancing to term 10
W20260709 14:51:58.360435  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:58.302923 10964 leader_election.cc:290] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:51:58.339838  7819 connection.cc:256] RPC call timeout handler was delayed by -2.132457780999971s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1831s for a response
W20260709 14:51:58.390753  7819 connection.cc:256] RPC call timeout handler was delayed by -1.7958577809999952s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22050000000000003s for a response
I20260709 14:51:58.417779  7849 raft_consensus.cc:2410] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for term 10 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 14:51:58.418864  7774 raft_consensus.cc:3055] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 LEADER]: Stepping down as leader of term 9
I20260709 14:51:58.419329  7774 raft_consensus.cc:740] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
W20260709 14:51:58.420415  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:58.420324  7774 consensus_queue.cc:260] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:58.402031 10964 raft_consensus.cc:493] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:58.431501  7819 leader_election.cc:304] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:58.452708  7845 raft_consensus.cc:1275] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 14:51:58.464021  7774 raft_consensus.cc:3060] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:51:58.486060  7846 raft_consensus.cc:1275] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 14:51:58.486676  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 55277.6us
I20260709 14:51:58.496002  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:58.497213  7845 raft_consensus.cc:2410] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for term 13 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 14:51:58.498335  7850 raft_consensus.cc:1275] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 14:51:58.502004  7850 pending_rounds.cc:85] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting all ops after (but not including) 3
I20260709 14:51:58.502269  7850 pending_rounds.cc:107] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 14:51:58.502534  7850 raft_consensus.cc:2889] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:51:58.499153  7853 raft_consensus.cc:1275] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 14:51:58.499898  7854 raft_consensus.cc:1275] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 14:51:58.500051  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:58.507046 10873 raft_consensus.cc:493] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:58.507714 10873 raft_consensus.cc:515] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:58.511497 10873 leader_election.cc:290] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:58.511792  6549 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 14:51:58.512363 10988 raft_consensus.cc:2804] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 14:51:58.512961 10988 raft_consensus.cc:493] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:58.513370 10988 raft_consensus.cc:3060] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:51:58.529196  7774 raft_consensus.cc:1275] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 14:51:58.529923  7774 pending_rounds.cc:85] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed: Aborting all ops after (but not including) 5
I20260709 14:51:58.530248  7774 pending_rounds.cc:107] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 14:51:58.530580  7774 raft_consensus.cc:2889] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:51:58.534858  7852 raft_consensus.cc:2468] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 11.
I20260709 14:51:58.450443 10964 raft_consensus.cc:515] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:58.482301 10914 raft_consensus.cc:2749] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 14:51:58.540144  7819 leader_election.cc:304] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
W20260709 14:51:58.566095  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 243365us
W20260709 14:51:58.585855  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:51:58.593043  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:51:58.609555  7743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:51:58.542270 10915 log.cc:927] Time spent T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260709 14:51:58.619174  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:51:58.538151 10735 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 10 current term: 10 is higher.
W20260709 14:51:58.622239  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 52638.3us
W20260709 14:51:58.627327  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 94376.9us
I20260709 14:51:58.637521  7745 leader_election.cc:304] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 3876b8ee8d744cb18e91d97aae93b1ac, 9418391fa82a42c79c6cad13ba91d964
I20260709 14:51:58.613981 10873 raft_consensus.cc:2749] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 14:51:58.652678  7745 leader_election.cc:400] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: Vote denied by peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529) with higher term. Message: Invalid argument: T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 7. Current term is 8.
I20260709 14:51:58.653190  7745 leader_election.cc:403] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
W20260709 14:51:58.712641  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 64141us
I20260709 14:51:58.715049  7745 leader_election.cc:304] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:51:58.716852  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 399681us
I20260709 14:51:58.726660  7676 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54344 (request call id 371) took 7590 ms. Trace:
I20260709 14:51:58.647039 10987 consensus_queue.cc:1048] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.093s
I20260709 14:51:58.704542 10742 raft_consensus.cc:2749] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 14:51:58.716888 10984 raft_consensus.cc:2749] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 14:51:58.736817  7745 leader_election.cc:304] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:58.770866 10964 leader_election.cc:290] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:51:58.838089  7893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:51:58.860113  7893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:51:58.840975  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 104252us
I20260709 14:51:58.866182  7745 leader_election.cc:304] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
W20260709 14:51:58.846655  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:51:58.851528  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 453493us
I20260709 14:51:58.713770 10980 raft_consensus.cc:3060] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Advancing to term 8
I20260709 14:51:58.779322 10987 raft_consensus.cc:2749] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 14:51:58.779775 10742 consensus_queue.cc:1059] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.091s
I20260709 14:51:58.882076  7745 leader_election.cc:304] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:58.834452 10880 raft_consensus.cc:493] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
W20260709 14:51:58.889935  7894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:58.896916  7848 raft_consensus.cc:1275] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 8. (term mismatch)
I20260709 14:51:58.870668 10986 raft_consensus.cc:2804] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader election won for term 7
I20260709 14:51:58.902876  7852 raft_consensus.cc:1275] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 14:51:58.780071 10989 consensus_queue.cc:1059] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.102s
I20260709 14:51:58.908315  7851 raft_consensus.cc:1275] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 14:51:58.897820  7848 pending_rounds.cc:85] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting all ops after (but not including) 7
I20260709 14:51:58.917428  7848 pending_rounds.cc:107] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting uncommitted NO_OP operation due to leader change: 9.8
I20260709 14:51:58.917814  7848 raft_consensus.cc:2889] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:51:58.920754  7745 leader_election.cc:304] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:58.924624  7894 leader_election.cc:304] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:51:58.727856  7676 rpcz_store.cc:276] 0709 14:51:51.125936 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:51.126113 (+   177us) service_pool.cc:224] Handling call
0709 14:51:58.708427 (+7582314us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 14:51:57.710885 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 14:51:57.711683 (+   798us) write_op.cc:432] Acquiring schema lock in shared mode
0709 14:51:57.711743 (+    60us) write_op.cc:435] Acquired schema lock
0709 14:51:57.711762 (+    19us) tablet.cc:662] Decoding operations
0709 14:51:57.712396 (+   634us) write_op.cc:620] Acquiring the partition lock for write op
0709 14:51:57.712681 (+   285us) write_op.cc:641] Partition lock acquired for write op
0709 14:51:57.712712 (+    31us) tablet.cc:685] Acquiring locks for 2 operations
0709 14:51:57.713209 (+   497us) tablet.cc:701] Row locks acquired
0709 14:51:57.713278 (+    69us) write_op.cc:260] PREPARE: finished
0709 14:51:57.713527 (+   249us) write_op.cc:270] Start()
0709 14:51:57.713710 (+   183us) write_op.cc:276] Timestamp: P: 1783608717713437 usec, L: 0
0709 14:51:57.713748 (+    38us) op_driver.cc:348] REPLICATION: starting
0709 14:51:57.714750 (+  1002us) log.cc:844] Serialized 923 byte log entry
0709 14:51:58.114921 (+400171us) op_driver.cc:464] REPLICATION: finished
0709 14:51:58.482681 (+367760us) write_op.cc:301] APPLY: starting
0709 14:51:58.515435 (+ 32754us) tablet.cc:1367] starting BulkCheckPresence
0709 14:51:58.515581 (+   146us) tablet.cc:1370] finished BulkCheckPresence
0709 14:51:58.515747 (+   166us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 14:51:58.516193 (+   446us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 14:51:58.516455 (+   262us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 14:51:58.516517 (+    62us) write_op.cc:312] APPLY: finished
0709 14:51:58.516824 (+   307us) log.cc:844] Serialized 29 byte log entry
0709 14:51:58.517013 (+   189us) write_op.cc:489] Releasing partition, row and schema locks
0709 14:51:58.517098 (+    85us) write_op.cc:454] Released schema lock
0709 14:51:58.517207 (+   109us) write_op.cc:341] FINISH: Updating metrics
0709 14:51:58.517648 (+   441us) write_op.cc:489] Releasing partition, row and schema locks
0709 14:51:58.517674 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":13,"child_traces":[["op",{"apply.queue_time_us":312084,"apply.run_cpu_time_us":2601,"apply.run_wall_time_us":50363,"num_ops":2,"prepare.queue_time_us":117278,"prepare.run_cpu_time_us":24278,"prepare.run_wall_time_us":103421,"raft.queue_time_us":162516,"raft.run_cpu_time_us":11833,"raft.run_wall_time_us":324496,"replication_time_us":349006,"thread_start_us":347634,"threads_started":4,"wal-append.queue_time_us":117090}]]}
I20260709 14:51:58.930197 10992 raft_consensus.cc:2804] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader election won for term 7
I20260709 14:51:58.931581 10987 raft_consensus.cc:2749] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 14:51:58.932494 10987 raft_consensus.cc:2804] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader election won for term 9
I20260709 14:51:58.932988 10987 raft_consensus.cc:697] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:51:58.934118 10987 consensus_queue.cc:237] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:58.915935 10712 raft_consensus.cc:493] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:58.942467 10712 raft_consensus.cc:515] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:58.945451  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 226328us
I20260709 14:51:58.952097  7819 leader_election.cc:304] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:58.955945 10873 consensus_queue.cc:1048] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.006s
W20260709 14:51:58.964051 10985 log.cc:927] Time spent T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 14:51:58.927109 10993 raft_consensus.cc:3055] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 LEADER]: Stepping down as leader of term 5
I20260709 14:51:58.965279 10993 raft_consensus.cc:740] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:51:58.966926 10712 leader_election.cc:290] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:58.899925 10880 raft_consensus.cc:515] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:58.953842 10991 log.cc:927] Time spent T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.097s	user 0.001s	sys 0.001s
W20260709 14:51:58.954242 10982 log.cc:927] Time spent T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.177s	user 0.000s	sys 0.001s
I20260709 14:51:58.966612 10993 consensus_queue.cc:260] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:58.957341 10930 raft_consensus.cc:2749] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 14:51:58.955314 10745 raft_consensus.cc:2804] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 14:51:58.989106 10735 raft_consensus.cc:493] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:58.989902 10735 raft_consensus.cc:515] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:58.992925 10735 leader_election.cc:290] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:59.002651 10735 consensus_queue.cc:1059] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 14:51:58.994119 10745 raft_consensus.cc:697] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:58.975899 10988 raft_consensus.cc:515] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:59.009524 10745 consensus_queue.cc:237] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:59.001217 10880 leader_election.cc:290] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:58.956529 10964 consensus_queue.cc:1059] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 14:51:59.013188 10964 raft_consensus.cc:3055] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 LEADER]: Stepping down as leader of term 8
I20260709 14:51:59.014163 10964 raft_consensus.cc:740] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:51:59.015548 10964 consensus_queue.cc:260] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:59.019272 10964 raft_consensus.cc:3060] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:51:58.997347 10993 raft_consensus.cc:3060] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:51:59.020412 10978 raft_consensus.cc:3055] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 LEADER]: Stepping down as leader of term 6
I20260709 14:51:59.011734 10988 leader_election.cc:290] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:51:59.037324  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 58964.5us
W20260709 14:51:59.040942  7743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:59.025225 10978 raft_consensus.cc:740] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:51:59.035977 10880 raft_consensus.cc:493] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:51:59.075789  8599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 131931us
I20260709 14:51:59.038323 10930 raft_consensus.cc:493] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:59.036571 10980 raft_consensus.cc:2749] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529) with higher term. Message: Invalid argument: T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 7. Current term is 8.
I20260709 14:51:59.099520  7819 leader_election.cc:304] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:59.085678 10880 raft_consensus.cc:515] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:59.101583  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 155353us
W20260709 14:51:59.102672  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 182052us
I20260709 14:51:59.089578 10873 raft_consensus.cc:493] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:59.105413  7745 leader_election.cc:304] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 3876b8ee8d744cb18e91d97aae93b1ac, 9418391fa82a42c79c6cad13ba91d964
I20260709 14:51:59.107944  7744 leader_election.cc:400] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: Vote denied by peer 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785) with higher term. Message: Invalid argument: T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 7. Current term is 8.
I20260709 14:51:59.094578 10914 raft_consensus.cc:493] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:59.109673  7744 leader_election.cc:403] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 14:51:59.112921 10986 raft_consensus.cc:697] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
W20260709 14:51:59.114257  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 189725us
I20260709 14:51:59.115598  7745 leader_election.cc:304] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:59.090456 10930 raft_consensus.cc:515] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:59.110327 10980 raft_consensus.cc:2749] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 14:51:59.126288  7745 leader_election.cc:304] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:59.128484  7894 leader_election.cc:304] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:51:59.117877 11011 consensus_queue.cc:1048] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 14:51:59.122943 11002 raft_consensus.cc:2749] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785) with higher term. Message: Invalid argument: T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 7. Current term is 8.
I20260709 14:51:59.108871 10873 raft_consensus.cc:515] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:59.141587 11009 raft_consensus.cc:2749] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 14:51:59.145171 10745 raft_consensus.cc:2804] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 14:51:59.141736  8598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 225218us
W20260709 14:51:59.146942  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:59.147835 10742 raft_consensus.cc:3055] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 LEADER]: Stepping down as leader of term 9
I20260709 14:51:59.110886 10978 consensus_queue.cc:260] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:59.149686 10742 raft_consensus.cc:740] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:51:59.150470 10978 raft_consensus.cc:3060] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:51:59.152072 10745 raft_consensus.cc:697] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:59.153182 10745 consensus_queue.cc:237] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:59.116334 10914 raft_consensus.cc:515] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:59.156049  7894 leader_election.cc:304] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:51:59.135032  7745 leader_election.cc:304] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:59.157564  7675 catalog_manager.cc:5697] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 8 to 11, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 11 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:51:59.123594 10992 raft_consensus.cc:697] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:51:59.150760 10742 consensus_queue.cc:260] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:59.144246 11007 raft_consensus.cc:2804] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader election won for term 7
I20260709 14:51:59.169489 10914 leader_election.cc:290] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:59.170061 10742 raft_consensus.cc:3060] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:51:59.142254 10930 leader_election.cc:290] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:59.170260 10992 consensus_queue.cc:237] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:59.164106  7675 catalog_manager.cc:5697] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 7 to 8, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 8 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:51:59.170167 11007 raft_consensus.cc:697] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:51:59.139501 10873 leader_election.cc:290] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:59.172547  7745 leader_election.cc:400] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: Vote denied by peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529) with higher term. Message: Invalid argument: T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 7. Current term is 8.
I20260709 14:51:59.172102  7675 catalog_manager.cc:5697] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:51:59.173478 10748 raft_consensus.cc:2804] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 14:51:59.176808  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 77488.6us
I20260709 14:51:59.173054 11008 raft_consensus.cc:2764] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 14:51:59.179450  7745 leader_election.cc:304] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:59.177824  7675 catalog_manager.cc:5697] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 7 to 8, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 8 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:51:59.170334 10914 raft_consensus.cc:2804] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader election won for term 10
I20260709 14:51:59.180166  7744 leader_election.cc:304] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:51:59.182893 10748 raft_consensus.cc:697] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:59.181496 10988 raft_consensus.cc:2749] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 14:51:59.184095 10748 consensus_queue.cc:237] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:59.186811 11007 consensus_queue.cc:237] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:59.192402 10712 consensus_queue.cc:1048] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 14:51:59.182082  7745 leader_election.cc:304] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:59.177979 10880 leader_election.cc:290] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:59.205699 10914 raft_consensus.cc:697] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:51:59.206923 10914 consensus_queue.cc:237] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:59.210342  7675 catalog_manager.cc:5697] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:51:59.114317 10986 consensus_queue.cc:237] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:59.219884  7745 leader_election.cc:304] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:59.226131  7745 leader_election.cc:304] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
W20260709 14:51:59.227909  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 45680.6us
I20260709 14:51:59.229557 10984 raft_consensus.cc:2804] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 14:51:59.223282  7744 leader_election.cc:304] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:51:59.233345  7745 leader_election.cc:400] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 election: Vote denied by peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529) with higher term. Message: Invalid argument: T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 9. Current term is 10.
I20260709 14:51:59.217198  7675 catalog_manager.cc:5697] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 7 to 10, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 10 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:51:59.230400 11008 raft_consensus.cc:2804] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 14:51:59.218459 10988 raft_consensus.cc:2804] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 14:51:59.239696 10988 raft_consensus.cc:493] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:59.240257 10988 raft_consensus.cc:3060] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:51:59.244415  7893 leader_election.cc:304] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:59.224582 10964 raft_consensus.cc:493] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:59.245754 11010 raft_consensus.cc:2804] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 14:51:59.245893 10964 raft_consensus.cc:515] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:59.246479 11010 raft_consensus.cc:697] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:59.233311 10880 raft_consensus.cc:493] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:59.247115 10880 raft_consensus.cc:515] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:59.247640 11010 consensus_queue.cc:237] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:59.227478 10980 consensus_queue.cc:1059] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 14:51:59.249712 10980 raft_consensus.cc:2804] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader election won for term 11
I20260709 14:51:59.222620 11009 consensus_queue.cc:1048] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 14:51:59.250324 10980 raft_consensus.cc:697] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:51:59.251526 10980 consensus_queue.cc:237] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:59.224565 11012 raft_consensus.cc:2804] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 14:51:59.253803 11012 raft_consensus.cc:493] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:59.254313 11012 raft_consensus.cc:3060] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:51:59.253808  7819 leader_election.cc:304] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:59.236181  7745 leader_election.cc:400] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 10 pre-election: Vote denied by peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529) with higher term. Message: Invalid argument: T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 10. Current term is 11.
I20260709 14:51:59.260605  7675 catalog_manager.cc:5697] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 6 to 7, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 7 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:51:59.252885 11009 raft_consensus.cc:3055] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 LEADER]: Stepping down as leader of term 4
W20260709 14:51:59.266757  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 71898.4us
I20260709 14:51:59.269809  7675 catalog_manager.cc:5697] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 7 to 9, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 9 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:51:59.273031  7675 catalog_manager.cc:5697] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 6 to 10, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 10 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:51:59.275749  7675 catalog_manager.cc:5697] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:51:59.234885 10984 raft_consensus.cc:493] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting leader election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:51:59.278479  7675 catalog_manager.cc:5697] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 10 to 11, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 11 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:51:59.277762  7745 leader_election.cc:304] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:59.267197 11015 raft_consensus.cc:2804] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 14:51:59.289393 11015 raft_consensus.cc:493] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:59.289932 11015 raft_consensus.cc:3060] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:51:59.267364 11009 raft_consensus.cc:740] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:51:59.293495 10930 raft_consensus.cc:493] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:59.294461 10745 consensus_queue.cc:1048] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 14:51:59.294380 10748 consensus_queue.cc:1048] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 14:51:59.299603  7745 leader_election.cc:304] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:59.258204 11008 raft_consensus.cc:493] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:59.297969  7819 leader_election.cc:304] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:59.297333  7675 catalog_manager.cc:5697] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 5 to 8, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 8 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:51:59.294359 10930 raft_consensus.cc:515] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:59.284605 10984 raft_consensus.cc:3060] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:51:59.314759  7675 catalog_manager.cc:5697] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 6 to 9, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 9 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:51:59.285043 10880 leader_election.cc:290] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:59.308434 11007 raft_consensus.cc:2804] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 14:51:59.320400  7745 leader_election.cc:304] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:59.280571 10873 consensus_queue.cc:1059] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 2, Time since last communication: 0.035s
W20260709 14:51:59.322012  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 74167.8us
I20260709 14:51:59.324393  7893 leader_election.cc:304] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:59.316928 10987 raft_consensus.cc:3060] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:51:59.312458 11008 raft_consensus.cc:3060] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:51:59.320174  7675 catalog_manager.cc:5697] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 4 to 5, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 5 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:51:59.322026 11007 raft_consensus.cc:493] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:59.332139  7675 catalog_manager.cc:5697] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 6 to 8, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 8 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:51:59.333585  7893 leader_election.cc:304] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:51:59.331737 10735 raft_consensus.cc:2804] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 14:51:59.344293 10748 consensus_queue.cc:1048] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 14:51:59.364153  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:59.365104  7774 raft_consensus.cc:2393] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 10: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:51:59.337229  7675 catalog_manager.cc:5697] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 8 to 12, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 12 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:51:59.351702  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:59.366998  7771 raft_consensus.cc:2393] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 9: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:51:59.352674  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18d29d52d304c87b930d4fb5eaf50b1" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:59.367520  7775 raft_consensus.cc:2468] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 3.
I20260709 14:51:59.354178  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:59.370431  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:59.371498  7778 raft_consensus.cc:3060] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:51:59.370487  7675 catalog_manager.cc:5697] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:51:59.293864 11009 consensus_queue.cc:260] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:59.377025  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:59.378468  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:59.336036 11007 raft_consensus.cc:3060] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Advancing to term 8
I20260709 14:51:59.380724  7773 raft_consensus.cc:1275] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 14:51:59.381438  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:59.387892  7771 raft_consensus.cc:2393] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 9: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:51:59.388031  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:59.388391  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:51:59.326188 10880 consensus_queue.cc:1048] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 14:51:59.389912  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:59.373085  7675 catalog_manager.cc:5697] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 8 to 9, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 9 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:51:59.336153 11022 raft_consensus.cc:2804] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 14:51:59.360972 10735 raft_consensus.cc:493] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
W20260709 14:51:59.397594  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 73338us
I20260709 14:51:59.401197  7774 raft_consensus.cc:1275] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 14:51:59.365646 11002 raft_consensus.cc:493] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:59.405623  7776 raft_consensus.cc:1275] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 14:51:59.393146  7675 catalog_manager.cc:5697] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 6 to 7, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 7 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:51:59.407215  7745 leader_election.cc:400] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 election: Vote denied by peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529) with higher term. Message: Invalid argument: T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 8. Current term is 9.
I20260709 14:51:59.407532  7745 leader_election.cc:403] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 14:51:59.407998  7778 raft_consensus.cc:2468] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 9.
I20260709 14:51:59.404932  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:59.408680  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:59.401898 10735 raft_consensus.cc:3060] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:51:59.391952 11011 consensus_queue.cc:1048] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 14:51:59.410640  7675 catalog_manager.cc:5697] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 7 to 8, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 8 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:51:59.412348  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:59.412710  7775 raft_consensus.cc:1275] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 14:51:59.404882  7894 leader_election.cc:304] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:59.416334  7745 leader_election.cc:304] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:59.419519  7779 raft_consensus.cc:2468] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 8.
I20260709 14:51:59.422158  7770 raft_consensus.cc:1275] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 14:51:59.395777 11010 raft_consensus.cc:2804] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 14:51:59.425742 10978 raft_consensus.cc:2804] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 14:51:59.426301 10978 raft_consensus.cc:493] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:59.423538 11022 raft_consensus.cc:697] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:59.427963 11022 consensus_queue.cc:237] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:59.421765 11011 raft_consensus.cc:2749] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529) with higher term. Message: Invalid argument: T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 8. Current term is 9.
I20260709 14:51:59.438504  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:59.439411  7773 raft_consensus.cc:2468] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 6.
I20260709 14:51:59.390986 10989 consensus_queue.cc:1059] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.036s
I20260709 14:51:59.442574  7745 leader_election.cc:304] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:59.413182  7675 catalog_manager.cc:5697] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:51:59.448112  7675 catalog_manager.cc:5697] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 7 to 9, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 9 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:51:59.389652 10988 raft_consensus.cc:515] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:59.426651 10978 raft_consensus.cc:3060] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:51:59.452435  7675 catalog_manager.cc:5697] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:51:59.456065 11011 raft_consensus.cc:2749] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 14:51:59.423894 10964 leader_election.cc:290] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:51:59.461205  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 56425.7us
W20260709 14:51:59.459535  7745 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:59.433167 11010 raft_consensus.cc:493] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:59.451700 11027 consensus_queue.cc:1059] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.015s
W20260709 14:51:59.465197  7745 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:59.466056  7675 catalog_manager.cc:5697] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:51:59.424163 11020 consensus_queue.cc:1059] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.058s
I20260709 14:51:59.476588  7675 catalog_manager.cc:5697] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 6 to 9. New cstate: current_term: 9 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:51:59.413877 11002 raft_consensus.cc:515] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:59.479732  7675 catalog_manager.cc:5697] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
W20260709 14:51:59.488914  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 211589us
I20260709 14:51:59.491413 10992 raft_consensus.cc:493] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:59.492111 10992 raft_consensus.cc:515] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:59.495817 11026 raft_consensus.cc:493] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:59.496598 11026 raft_consensus.cc:515] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:59.489535 11011 raft_consensus.cc:493] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:59.498749 11011 raft_consensus.cc:515] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:59.500382 11026 leader_election.cc:290] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:59.481381 10980 raft_consensus.cc:493] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:59.503049 10980 raft_consensus.cc:515] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:59.501464 11017 raft_consensus.cc:2749] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 14:51:59.504316 11008 raft_consensus.cc:515] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:59.502211 10992 leader_election.cc:290] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:59.501514  7819 leader_election.cc:304] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:51:59.490728  7675 catalog_manager.cc:5697] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:51:59.466141 11010 raft_consensus.cc:3060] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:51:59.452136 10993 consensus_queue.cc:1048] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 14:51:59.477917 10964 raft_consensus.cc:2804] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader election won for term 9
I20260709 14:51:59.520710  7772 raft_consensus.cc:2393] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 8: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:51:59.506414 11011 leader_election.cc:290] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:59.522948 11031 raft_consensus.cc:493] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:51:59.523494 11025 consensus_queue.cc:1059] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 14:51:59.480064 10745 consensus_queue.cc:1048] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
W20260709 14:51:59.525703 11021 log.cc:927] Time spent T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.199s	user 0.002s	sys 0.000s
I20260709 14:51:59.523996 11031 raft_consensus.cc:515] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:59.526834 10988 leader_election.cc:290] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 10 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:51:59.518994 11023 log.cc:927] Time spent T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
I20260709 14:51:59.532537 10735 raft_consensus.cc:515] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:59.511773 10930 leader_election.cc:290] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:51:59.534754 11016 log.cc:927] Time spent T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.148s	user 0.001s	sys 0.000s
I20260709 14:51:59.535772  7771 raft_consensus.cc:1275] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 14:51:59.536886 11002 leader_election.cc:290] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:59.506551 10980 leader_election.cc:290] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:59.511600 11022 raft_consensus.cc:3055] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 14:51:59.544476 11032 raft_consensus.cc:3055] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 14:51:59.565877  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 150049us
I20260709 14:51:59.611083  7893 leader_election.cc:304] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:51:59.538841 11009 raft_consensus.cc:3060] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:51:59.543502 11031 leader_election.cc:290] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:51:59.602385  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 136395us
I20260709 14:51:59.598974 10930 raft_consensus.cc:493] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:59.620299 10712 raft_consensus.cc:3055] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 14:51:59.621955 11035 raft_consensus.cc:3055] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 LEADER]: Stepping down as leader of term 9
I20260709 14:51:59.622431 11035 raft_consensus.cc:740] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:51:59.623313 10930 raft_consensus.cc:515] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:59.626142 10930 leader_election.cc:290] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:59.605965 10880 raft_consensus.cc:493] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:59.621047 10712 raft_consensus.cc:740] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:59.627336 10880 raft_consensus.cc:515] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:59.609978 11032 raft_consensus.cc:740] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:59.630677 10880 leader_election.cc:290] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:59.628575 10712 consensus_queue.cc:260] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:59.621006 10735 leader_election.cc:290] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:59.623294 11035 consensus_queue.cc:260] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:59.650540  7894 leader_election.cc:304] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:51:59.652860 11027 raft_consensus.cc:2804] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 14:51:59.653820 11027 raft_consensus.cc:493] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:59.654599 11027 raft_consensus.cc:3060] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 14:51:59.657757 10735 raft_consensus.cc:493] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:59.657516 11017 consensus_queue.cc:1048] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 14:51:59.658449 10735 raft_consensus.cc:515] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:59.650725 11035 raft_consensus.cc:3060] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:51:59.633154 11031 raft_consensus.cc:493] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:59.662631 11031 raft_consensus.cc:515] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:59.604166 10873 consensus_queue.cc:1048] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 14:51:59.640714 10930 raft_consensus.cc:493] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:59.667336 10930 raft_consensus.cc:515] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:59.606462 10980 raft_consensus.cc:493] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:59.612200 10964 raft_consensus.cc:697] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:51:59.612039 11022 raft_consensus.cc:740] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:59.617980 11012 raft_consensus.cc:515] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:59.687662  7894 leader_election.cc:304] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:59.632594 10712 raft_consensus.cc:3060] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:51:59.577454 11015 raft_consensus.cc:515] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:59.698446  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 81388.5us
I20260709 14:51:59.680864 10987 raft_consensus.cc:2749] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 14:51:59.683140 10748 consensus_queue.cc:1048] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 14:51:59.694360 10735 leader_election.cc:290] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:59.705916 10978 raft_consensus.cc:515] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:59.706554 11010 raft_consensus.cc:515] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:59.707290 11040 raft_consensus.cc:2804] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 14:51:59.708565  7893 leader_election.cc:304] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:51:59.614085 11039 raft_consensus.cc:2804] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader election won for term 8
I20260709 14:51:59.683243 10984 raft_consensus.cc:515] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:59.739053 10880 raft_consensus.cc:2804] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 14:51:59.736991  7893 leader_election.cc:304] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:59.683708 10980 raft_consensus.cc:515] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:51:59.717397  7742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:59.741876 11039 raft_consensus.cc:697] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:51:59.723691 11037 consensus_queue.cc:1059] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 14:51:59.673478 11007 raft_consensus.cc:515] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:59.700280 11031 leader_election.cc:290] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:59.712018 11033 raft_consensus.cc:2749] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 14:51:59.730175 11040 raft_consensus.cc:493] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:51:59.751398 10880 raft_consensus.cc:697] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:59.751667 11040 raft_consensus.cc:3060] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 14:51:59.751999 10984 leader_election.cc:290] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:59.746776 10987 raft_consensus.cc:493] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:59.752761 11036 raft_consensus.cc:493] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:59.752614 10880 consensus_queue.cc:237] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:59.719466 10964 consensus_queue.cc:237] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:59.753600 11036 raft_consensus.cc:515] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:59.756126 11036 leader_election.cc:290] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:59.734927 11010 leader_election.cc:290] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 9 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:59.718876 11012 leader_election.cc:290] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 10 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:59.720299 11034 raft_consensus.cc:493] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:59.761930 11025 consensus_queue.cc:1059] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 14:51:59.722710 10930 leader_election.cc:290] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:59.758692 11033 raft_consensus.cc:2804] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 14:51:59.750456 11008 leader_election.cc:290] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 10 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:59.760020 11010 consensus_queue.cc:1048] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 14:51:59.760603 10978 leader_election.cc:290] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:59.743042 11039 consensus_queue.cc:237] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:59.753221 10987 raft_consensus.cc:515] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:59.746403 11022 consensus_queue.cc:260] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:59.785693 10930 raft_consensus.cc:493] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:59.786433 10930 raft_consensus.cc:515] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:59.788820 10930 leader_election.cc:290] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:59.795768 10980 leader_election.cc:290] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:59.762305 11034 raft_consensus.cc:515] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:59.744091 10748 consensus_queue.cc:1048] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
W20260709 14:51:59.819144 11038 log.cc:927] Time spent T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 14:51:59.782909 11022 raft_consensus.cc:3060] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Advancing to term 8
W20260709 14:51:59.821919  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 74111.4us
W20260709 14:51:59.826663  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 325023us
I20260709 14:51:59.815848 11033 raft_consensus.cc:697] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:59.839736  7894 leader_election.cc:304] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:51:59.842016 11044 raft_consensus.cc:493] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:59.837802 10978 raft_consensus.cc:493] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:59.842708 11044 raft_consensus.cc:515] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:59.843489 10978 raft_consensus.cc:515] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:59.846318 10978 leader_election.cc:290] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:59.846896 11040 raft_consensus.cc:515] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:59.848475 11033 consensus_queue.cc:237] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:59.850528 11043 raft_consensus.cc:493] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:59.851506 11043 raft_consensus.cc:515] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:59.852780 11040 leader_election.cc:290] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:59.824654 10745 consensus_queue.cc:1048] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 14:51:59.876106 11035 raft_consensus.cc:493] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:59.877728 11015 leader_election.cc:290] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 9 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:59.879277 11034 leader_election.cc:290] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:59.880115 11032 consensus_queue.cc:260] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:59.881207 11032 raft_consensus.cc:3060] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:51:59.861685 11031 raft_consensus.cc:493] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:59.885778 11031 raft_consensus.cc:515] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:59.886487  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: true dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
W20260709 14:51:59.871521  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 122756us
I20260709 14:51:59.887821  7849 raft_consensus.cc:3060] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:51:59.890178 11047 raft_consensus.cc:2749] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 14:51:59.891433 11031 leader_election.cc:290] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:59.840065 10930 raft_consensus.cc:493] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:59.892199 10930 raft_consensus.cc:515] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:59.854189 11043 leader_election.cc:290] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:59.892379  7851 raft_consensus.cc:1240] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 9. Current term is 10. Ops: [8.6-9.7]
I20260709 14:51:59.900689 10978 raft_consensus.cc:493] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:59.865736 10873 raft_consensus.cc:493] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:51:59.901810  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:59.902484 10873 raft_consensus.cc:515] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:59.903261 11020 consensus_queue.cc:1048] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 14:51:59.904528  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:59.905230  7847 raft_consensus.cc:2468] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 10.
I20260709 14:51:59.896379  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
W20260709 14:51:59.906219  7745 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:59.896373  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:59.901682 10978 raft_consensus.cc:515] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:59.902813  7851 raft_consensus.cc:2468] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 11.
I20260709 14:51:59.905575  7848 raft_consensus.cc:1240] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 14:51:59.906314  7853 raft_consensus.cc:2393] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 9: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:51:59.898006  7845 raft_consensus.cc:1275] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 14:51:59.910465  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:59.907145  7854 raft_consensus.cc:2468] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 9.
I20260709 14:51:59.911365  7775 raft_consensus.cc:2468] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 5.
I20260709 14:51:59.897998  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:59.896346  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:59.912197  7846 raft_consensus.cc:2468] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 10.
I20260709 14:51:59.912707  7772 raft_consensus.cc:2393] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 12: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:51:59.908370  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:59.914045  7775 raft_consensus.cc:1240] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 14:51:59.914166  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:59.914829  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:59.915122  7774 raft_consensus.cc:2468] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 9.
I20260709 14:51:59.915028  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:59.916205  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:59.916603  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:59.916776  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:59.916847  7774 raft_consensus.cc:2468] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 6.
I20260709 14:51:59.914309  7770 raft_consensus.cc:2468] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 7.
I20260709 14:51:59.876793 11035 raft_consensus.cc:515] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:59.920138  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:59.920688  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:59.922161  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:59.924218  7845 raft_consensus.cc:3060] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:51:59.925654  7849 raft_consensus.cc:2468] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 11.
I20260709 14:51:59.926802  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:59.928122  7773 raft_consensus.cc:2393] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 9: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:51:59.923475  7777 raft_consensus.cc:2468] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 10.
I20260709 14:51:59.928660  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:59.923319  7776 raft_consensus.cc:2468] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 9.
I20260709 14:51:59.930091  7847 raft_consensus.cc:2468] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 9.
I20260709 14:51:59.931885  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:59.933385  7775 raft_consensus.cc:1275] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 14:51:59.933101  7772 raft_consensus.cc:2468] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 10.
I20260709 14:51:59.932031  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:59.938580  7778 raft_consensus.cc:2468] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 10.
I20260709 14:51:59.937093 11031 raft_consensus.cc:493] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:59.941058 11031 raft_consensus.cc:515] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:59.943683 11031 leader_election.cc:290] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:59.944058  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:59.944772  7846 raft_consensus.cc:3060] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:51:59.945626  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:59.946029  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:59.946650  7848 raft_consensus.cc:2468] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 7.
I20260709 14:51:59.947533  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:59.948081  7848 raft_consensus.cc:3060] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:51:59.948535 11036 raft_consensus.cc:3055] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 14:51:59.941943 10987 leader_election.cc:290] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:51:59.949818  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:51:59.952994 10930 leader_election.cc:290] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:59.896663 11040 consensus_queue.cc:1048] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 14:51:59.954202 11044 leader_election.cc:290] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:51:59.940425 11051 log.cc:927] Time spent T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
I20260709 14:51:59.887104 11027 raft_consensus.cc:515] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:59.956458 11007 leader_election.cc:290] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:59.957698  7854 raft_consensus.cc:1275] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 14:51:59.958400 11027 leader_election.cc:290] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:51:59.959587  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:51:59.960381  7770 raft_consensus.cc:2468] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 8.
I20260709 14:51:59.949064 11036 raft_consensus.cc:740] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:51:59.909705 10873 leader_election.cc:290] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:59.962080 11036 consensus_queue.cc:260] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:59.963449 11036 raft_consensus.cc:3060] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:51:59.966960 10978 leader_election.cc:290] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:59.970372  7819 leader_election.cc:304] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 9418391fa82a42c79c6cad13ba91d964
I20260709 14:51:59.971267 11035 leader_election.cc:290] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:51:59.962146  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:51:59.977288  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 79680.1us
I20260709 14:51:59.977710  7853 raft_consensus.cc:2468] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 8.
I20260709 14:51:59.957854  7849 raft_consensus.cc:2468] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 8.
I20260709 14:51:59.959216  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:59.982234  7854 raft_consensus.cc:3060] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Advancing to term 8
I20260709 14:51:59.983948  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:59.984789  7849 raft_consensus.cc:2376] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 9. Re-sending same reply.
I20260709 14:51:59.985991  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:59.986649  7849 raft_consensus.cc:2468] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 11.
I20260709 14:51:59.987898  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:51:59.988736 10930 raft_consensus.cc:493] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:51:59.989398 11031 raft_consensus.cc:2804] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 14:51:59.989428 10930 raft_consensus.cc:515] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:59.991137  7819 leader_election.cc:304] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:51:59.989924 11031 raft_consensus.cc:493] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9418391fa82a42c79c6cad13ba91d964)
I20260709 14:51:59.981338  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:51:59.993008  7847 raft_consensus.cc:3060] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:51:59.992221  7849 raft_consensus.cc:2468] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 10.
I20260709 14:51:59.999013  7854 raft_consensus.cc:2468] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 8.
I20260709 14:51:59.999879  7846 raft_consensus.cc:2468] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 10.
I20260709 14:52:00.000504  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:00.000773  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:00.001313  7854 raft_consensus.cc:2468] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 7.
I20260709 14:52:00.001595  7846 raft_consensus.cc:2410] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 14:52:00.002303  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:00.004346  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:00.004830  7845 raft_consensus.cc:2410] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 14:52:00.004662  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:00.006330  7853 raft_consensus.cc:2410] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 14:52:00.006690  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:00.008159  7845 raft_consensus.cc:2468] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 10.
I20260709 14:52:00.008968  7849 raft_consensus.cc:2376] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 6. Re-sending same reply.
W20260709 14:52:00.009750  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 121458us
I20260709 14:52:00.009891  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:00.010681  7854 raft_consensus.cc:3060] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:52:00.017508  7845 raft_consensus.cc:1275] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 14:52:00.019773  7849 raft_consensus.cc:1275] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 14:52:00.022022  7845 raft_consensus.cc:1275] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 14:52:00.026473  7819 leader_election.cc:304] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:00.027750  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:00.028306  7853 raft_consensus.cc:2468] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 9.
I20260709 14:51:59.994875 11031 raft_consensus.cc:3060] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Advancing to term 4
W20260709 14:52:00.031488  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:00.033020 11025 consensus_queue.cc:1048] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 14:52:00.036512 11010 consensus_queue.cc:1048] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 14:52:00.035899 11035 raft_consensus.cc:2749] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 14:52:00.037349 11010 consensus_queue.cc:1243] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer 3876b8ee8d744cb18e91d97aae93b1ac log is divergent from this leader: its last log entry 8.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 14:52:00.036953  7819 leader_election.cc:304] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:00.040544 10745 consensus_queue.cc:1048] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 14:52:00.027374 11041 consensus_queue.cc:1048] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.014s
I20260709 14:52:00.025445 10930 leader_election.cc:290] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:00.042946  7854 raft_consensus.cc:2468] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 9.
I20260709 14:52:00.024991 11009 raft_consensus.cc:493] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:00.050024 11009 raft_consensus.cc:515] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:51:59.981333 11017 consensus_queue.cc:1048] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 14:52:00.062767  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:00.055965  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:00.064363  7849 raft_consensus.cc:2376] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 9. Re-sending same reply.
I20260709 14:52:00.056720  7854 raft_consensus.cc:1275] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 14:52:00.068120  7819 leader_election.cc:304] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
W20260709 14:52:00.070063  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:00.056861  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:00.060529  7848 raft_consensus.cc:2468] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 10.
I20260709 14:52:00.073603  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:00.074640  7845 raft_consensus.cc:3060] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:52:00.076099  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:00.077004  7854 raft_consensus.cc:2376] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 11. Re-sending same reply.
I20260709 14:52:00.079286  7847 raft_consensus.cc:2468] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 9.
I20260709 14:52:00.080242  7819 leader_election.cc:304] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:00.082626  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:00.052465 10873 raft_consensus.cc:493] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:00.063601 11039 raft_consensus.cc:2749] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 14:52:00.084358  7819 leader_election.cc:304] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:00.020502 10748 consensus_queue.cc:1048] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.053s
I20260709 14:52:00.083698  7854 raft_consensus.cc:2376] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 12. Re-sending same reply.
I20260709 14:52:00.085435  7846 raft_consensus.cc:2468] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 9.
W20260709 14:52:00.098563  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:00.077438 10930 raft_consensus.cc:2749] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 14:52:00.094655  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:00.104146  7819 leader_election.cc:304] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:00.115288  7846 raft_consensus.cc:1240] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 8. Current term is 9. Ops: [6.4-8.5]
I20260709 14:52:00.082921 11035 raft_consensus.cc:2749] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 14:52:00.084046 10964 raft_consensus.cc:2749] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 14:52:00.117772  7819 leader_election.cc:304] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:00.124420  7819 leader_election.cc:304] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:00.119191  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:00.119982  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
W20260709 14:52:00.118438  7742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:00.067181 10745 consensus_queue.cc:1048] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 14:52:00.108845  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:00.109452  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:00.107990  7845 raft_consensus.cc:2468] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 6.
I20260709 14:52:00.120756  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:00.146459  7849 raft_consensus.cc:2468] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 6.
I20260709 14:52:00.144117  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783e4874513449ef9084b833f188a6d3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:00.146463  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:00.144461  7819 leader_election.cc:304] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:00.084797 11049 consensus_queue.cc:1048] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 14:52:00.151859  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:00.124825  7893 leader_election.cc:304] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:52:00.152566  7923 raft_consensus.cc:2368] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 7. Current term is 8.
I20260709 14:52:00.152828 10978 raft_consensus.cc:493] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:00.153751  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:00.088263 11052 consensus_queue.cc:1048] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 14:52:00.122407 11055 consensus_queue.cc:1048] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 14:52:00.153059 11010 consensus_queue.cc:1048] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.011s
I20260709 14:52:00.088510 11044 consensus_queue.cc:1048] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 14:52:00.102557 11050 raft_consensus.cc:2749] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 14:52:00.162778 11015 raft_consensus.cc:2804] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 14:52:00.163347 11015 raft_consensus.cc:493] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:00.163769 11015 raft_consensus.cc:3060] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:52:00.175369  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
W20260709 14:52:00.179132  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 54383.8us
I20260709 14:52:00.151494 10880 consensus_queue.cc:1048] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 14:52:00.153534 10978 raft_consensus.cc:515] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:00.154523  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:00.147598  7846 raft_consensus.cc:2468] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 7.
I20260709 14:52:00.150444  7819 leader_election.cc:304] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:00.128423  7926 raft_consensus.cc:2410] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 14:52:00.116662 11043 raft_consensus.cc:2749] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 14:52:00.190145  7846 raft_consensus.cc:1240] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 8. Current term is 9. Ops: []
I20260709 14:52:00.195006  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:00.098182 10873 raft_consensus.cc:515] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:00.213594 10873 leader_election.cc:290] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:00.214620  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:00.182451 11040 consensus_queue.cc:1048] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 14:52:00.215739  7771 raft_consensus.cc:2410] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 3.
I20260709 14:52:00.217566  7853 raft_consensus.cc:2468] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 9.
I20260709 14:52:00.149305 11039 raft_consensus.cc:2749] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 14:52:00.191375 11037 raft_consensus.cc:2804] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 14:52:00.219641 11037 raft_consensus.cc:493] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:00.220045 11037 raft_consensus.cc:3060] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:52:00.191685 10930 raft_consensus.cc:2764] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 14:52:00.228176 10978 leader_election.cc:290] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:00.186548  7819 leader_election.cc:304] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:00.197647  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:00.230326  7847 raft_consensus.cc:1240] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 10. Current term is 11. Ops: []
I20260709 14:52:00.200476 11009 leader_election.cc:290] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:00.233985  7849 raft_consensus.cc:1275] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 14:52:00.206141 11007 raft_consensus.cc:493] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
W20260709 14:52:00.190200 11053 log.cc:927] Time spent T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.195s	user 0.001s	sys 0.004s
I20260709 14:52:00.209122  7779 raft_consensus.cc:1275] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 14:52:00.209218  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783e4874513449ef9084b833f188a6d3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:00.209942  7773 raft_consensus.cc:1240] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 9. Current term is 10. Ops: []
I20260709 14:52:00.211053  7775 raft_consensus.cc:1240] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 7. Current term is 8. Ops: []
I20260709 14:52:00.153101 11034 raft_consensus.cc:2804] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 14:52:00.199535 11047 consensus_queue.cc:1048] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 14:52:00.230626  7926 raft_consensus.cc:2393] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 6: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:52:00.236465  7774 raft_consensus.cc:1240] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 8. Current term is 9. Ops: []
I20260709 14:52:00.207829  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:00.239336  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c563cc7cfbe4d59be4ffc5cf847ce56" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:00.230844  7819 leader_election.cc:304] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:00.249040  7772 raft_consensus.cc:3060] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:52:00.251596  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: true dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:00.250203  7819 leader_election.cc:304] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:00.257236  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:00.257459  7774 raft_consensus.cc:1240] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 9. Current term is 10. Ops: []
I20260709 14:52:00.260571  7775 raft_consensus.cc:1275] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 14:52:00.257747  7777 raft_consensus.cc:1275] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 14:52:00.262398  7927 raft_consensus.cc:2468] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 12.
I20260709 14:52:00.266247  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:00.272454  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:00.273351  7773 raft_consensus.cc:3060] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Advancing to term 8
I20260709 14:52:00.275224  7819 leader_election.cc:304] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:00.284767  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:00.286783  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:00.287786  7853 raft_consensus.cc:2468] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 7.
I20260709 14:52:00.287838  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:00.240716 11039 raft_consensus.cc:2804] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 14:52:00.294116  7772 raft_consensus.cc:2468] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 9.
I20260709 14:52:00.297284  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:00.298117  7920 raft_consensus.cc:3060] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:52:00.253014 11034 raft_consensus.cc:493] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:00.312657 11034 raft_consensus.cc:3060] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:52:00.301952  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:00.313861  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c563cc7cfbe4d59be4ffc5cf847ce56" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:00.314216  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:00.316071  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:00.318397  7779 raft_consensus.cc:1240] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 8. Current term is 9. Ops: []
I20260709 14:52:00.307399  7924 raft_consensus.cc:1240] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 14:52:00.258440 11044 raft_consensus.cc:2804] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 14:52:00.332150  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:00.304587  7922 raft_consensus.cc:1240] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 14:52:00.298566 11039 raft_consensus.cc:493] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:00.307363  7777 raft_consensus.cc:1240] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 7. Current term is 8. Ops: []
I20260709 14:52:00.307554 10987 raft_consensus.cc:493] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:00.308425  7853 raft_consensus.cc:1240] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 8. Current term is 9. Ops: []
I20260709 14:52:00.309890  7847 raft_consensus.cc:1275] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 14:52:00.310920  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:00.311758  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:00.292539  7819 leader_election.cc:304] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:00.338145  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:00.340827  7848 raft_consensus.cc:2410] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 3.
I20260709 14:52:00.240429 11007 raft_consensus.cc:515] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:00.341583  7919 raft_consensus.cc:2468] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 9.
W20260709 14:52:00.341463  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 49148.3us
I20260709 14:52:00.297475 11043 raft_consensus.cc:2804] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 14:52:00.347781  7819 leader_election.cc:304] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:00.350313  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:00.300910 10930 raft_consensus.cc:2804] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 14:52:00.353858  7919 raft_consensus.cc:1275] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 14:52:00.354818  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:00.358605 10964 raft_consensus.cc:2804] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 14:52:00.331069 11044 raft_consensus.cc:493] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:00.270722 11050 consensus_queue.cc:1048] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.080s
I20260709 14:52:00.330958 11009 raft_consensus.cc:493] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:00.331487 10873 raft_consensus.cc:493] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:00.359015  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:00.359762  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:00.361843  6549 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 14:52:00.362142  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:00.339025 11039 raft_consensus.cc:3060] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Advancing to term 8
I20260709 14:52:00.363469  7745 leader_election.cc:304] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:00.404165  7853 raft_consensus.cc:3060] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Advancing to term 8
I20260709 14:52:00.404923  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:00.384846  7847 raft_consensus.cc:1275] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 14:52:00.390154  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:00.336633  7920 raft_consensus.cc:2468] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 9.
I20260709 14:52:00.362068  7848 raft_consensus.cc:1240] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 9. Current term is 10. Ops: []
I20260709 14:52:00.353798 11043 raft_consensus.cc:493] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:00.349450 11035 raft_consensus.cc:2804] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 14:52:00.369783  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 11 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:00.359077 10930 raft_consensus.cc:493] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:00.355432  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:00.345904 10987 raft_consensus.cc:515] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:00.415448  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:00.416122  7745 leader_election.cc:304] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:00.424630  7919 raft_consensus.cc:1275] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 14:52:00.426501  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:00.411662  7773 raft_consensus.cc:2468] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 8.
I20260709 14:52:00.474478  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
W20260709 14:52:00.476804  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:00.476249  7922 raft_consensus.cc:1275] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 14:52:00.478538  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:00.480206  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:00.480788  7928 raft_consensus.cc:2393] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 9: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
W20260709 14:52:00.412789 11058 log.cc:927] Time spent T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
W20260709 14:52:00.523968  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:00.525090  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:00.525902  7926 raft_consensus.cc:2468] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 9.
I20260709 14:52:00.424479 11043 raft_consensus.cc:3060] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:52:00.511847  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:00.414208 11044 raft_consensus.cc:3060] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:52:00.376438 11037 raft_consensus.cc:515] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:00.407470 10964 raft_consensus.cc:493] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:00.534880  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:00.534873  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258d6c2dda954bf5b65930fde8ecb9f3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:00.516660 11040 raft_consensus.cc:493] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:00.474852  7924 raft_consensus.cc:2468] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 7.
I20260709 14:52:00.543524  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:00.375823 11031 raft_consensus.cc:515] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:52:00.531792  7919 raft_consensus.cc:2468] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 8.
I20260709 14:52:00.543426  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:00.477494 10978 raft_consensus.cc:2804] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 14:52:00.423836 11035 raft_consensus.cc:493] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:00.548022  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:00.478343 10930 raft_consensus.cc:3060] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:52:00.563609  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:00.434314 10873 raft_consensus.cc:515] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:00.572374 10914 raft_consensus.cc:493] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:00.423107 11009 raft_consensus.cc:515] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:00.434170 11002 consensus_queue.cc:1048] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.110s
I20260709 14:52:00.533087  7853 raft_consensus.cc:2468] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 8.
I20260709 14:52:00.617857  7845 raft_consensus.cc:1240] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Rejecting Update request from peer 9418391fa82a42c79c6cad13ba91d964 for earlier term 3. Current term is 4. Ops: []
I20260709 14:52:00.618474  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:00.562638 10964 raft_consensus.cc:3060] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:52:00.622128  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:00.624918  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:00.636379  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
W20260709 14:52:00.599282 11036 consensus_meta.cc:287] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent flushing consensus metadata: real 0.635s	user 0.011s	sys 0.006s
I20260709 14:52:00.603964 11035 raft_consensus.cc:3060] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:52:00.652016  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:00.664125  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:00.607857 11027 raft_consensus.cc:493] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:00.671972  7894 leader_election.cc:304] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:52:00.679188 11059 log.cc:927] Time spent T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.289s	user 0.000s	sys 0.001s
I20260709 14:52:00.681267  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:00.588537 11040 raft_consensus.cc:515] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:00.743146  7894 leader_election.cc:304] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:52:00.739406 11050 raft_consensus.cc:493] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:00.752086  7819 leader_election.cc:304] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:00.759150  7850 raft_consensus.cc:1240] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 9. Current term is 10. Ops: []
I20260709 14:52:00.760862  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:00.767769  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258d6c2dda954bf5b65930fde8ecb9f3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:00.769085  7773 raft_consensus.cc:2468] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 6.
I20260709 14:52:00.625756 10914 raft_consensus.cc:515] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:00.777280  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 11 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:00.782888  7894 leader_election.cc:304] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:00.786816  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:00.788203  7923 raft_consensus.cc:1275] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 14:52:00.787781  7773 raft_consensus.cc:2393] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 8: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
W20260709 14:52:00.799839  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 383832us
I20260709 14:52:00.754415 11033 raft_consensus.cc:2749] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 14:52:00.733273 11027 raft_consensus.cc:515] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:00.742858 11055 consensus_queue.cc:1048] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 14:52:00.831831  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:00.807010  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:00.828193  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:00.847563  7773 raft_consensus.cc:2393] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 10: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:52:00.835855  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:00.849407  7778 raft_consensus.cc:2393] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 11: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:52:00.801026  7745 leader_election.cc:304] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:00.743095 10738 consensus_queue.cc:1059] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 14:52:00.851296  7776 raft_consensus.cc:2410] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 14:52:00.837178  7894 leader_election.cc:304] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:52:00.834199  7921 raft_consensus.cc:2468] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 11.
I20260709 14:52:00.839371  7923 raft_consensus.cc:1275] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 14:52:00.779170 11060 log.cc:927] Time spent T 00000000000000000000000000000000 P 133636659113430cb53b321cb0b1d9ee: Append to log took a long time: real 0.421s	user 0.000s	sys 0.004s
W20260709 14:52:00.848280  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 240580us
I20260709 14:52:00.748843 11036 consensus_queue.cc:1059] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.081s
I20260709 14:52:00.863201  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:00.873440  7773 raft_consensus.cc:2393] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 9: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:52:00.800891 11025 raft_consensus.cc:2804] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 14:52:00.858552  7846 pending_rounds.cc:85] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting all ops after (but not including) 6
I20260709 14:52:00.876381  7846 pending_rounds.cc:107] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting uncommitted NO_OP operation due to leader change: 8.7
I20260709 14:52:00.876748  7846 raft_consensus.cc:2889] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:52:00.793502 11017 raft_consensus.cc:493] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:00.879884  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:00.834841 10880 raft_consensus.cc:2804] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 14:52:00.830624 11002 raft_consensus.cc:2804] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 14:52:00.887849  7776 raft_consensus.cc:2410] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 14:52:00.875521 11047 raft_consensus.cc:2804] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 14:52:00.892498  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:00.896044  7924 raft_consensus.cc:1275] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 14:52:00.772974 11050 raft_consensus.cc:515] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:00.908299 11084 raft_consensus.cc:493] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:00.851959 10712 consensus_queue.cc:1059] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 14:52:00.858758 11052 consensus_queue.cc:1048] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.055s
I20260709 14:52:00.887069 10880 raft_consensus.cc:493] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:00.932965 10880 raft_consensus.cc:3060] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Advancing to term 8
W20260709 14:52:00.934298 11034 consensus_meta.cc:287] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent flushing consensus metadata: real 0.621s	user 0.010s	sys 0.003s
I20260709 14:52:00.934883 11034 raft_consensus.cc:515] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:00.894230 11002 raft_consensus.cc:493] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:00.936343  7848 raft_consensus.cc:1240] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 14:52:00.909745 11047 raft_consensus.cc:493] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:00.937037 11002 raft_consensus.cc:3060] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:52:00.939635 11034 leader_election.cc:290] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 10 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:00.937551 11047 raft_consensus.cc:3060] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:52:00.909793 10987 leader_election.cc:290] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:00.943059 10987 raft_consensus.cc:493] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:00.943675 10987 raft_consensus.cc:515] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:00.946384 11040 leader_election.cc:290] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:52:00.950053 11069 log.cc:927] Time spent T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.212s	user 0.000s	sys 0.001s
W20260709 14:52:00.951148 11078 log.cc:927] Time spent T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.160s	user 0.001s	sys 0.000s
I20260709 14:52:00.952031 10712 raft_consensus.cc:3055] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 14:52:00.961483 11007 leader_election.cc:290] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:00.952028 11047 raft_consensus.cc:515] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:00.965111 10978 raft_consensus.cc:493] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:00.977223 11009 leader_election.cc:290] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:00.977366 11087 consensus_queue.cc:1059] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 14:52:00.979748 11027 leader_election.cc:290] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:00.927732 11084 raft_consensus.cc:515] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:01.056563 11088 consensus_queue.cc:1048] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 14:52:01.057189 11087 raft_consensus.cc:3055] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 LEADER]: Stepping down as leader of term 7
I20260709 14:52:00.983086 11032 consensus_queue.cc:1048] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 14:52:00.981722 11043 raft_consensus.cc:515] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:01.057958 11087 raft_consensus.cc:740] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:52:01.059161 11084 leader_election.cc:290] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:01.059856 11087 consensus_queue.cc:260] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:01.065616 10978 raft_consensus.cc:3060] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:52:01.067823  7770 raft_consensus.cc:1240] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 8. Current term is 9. Ops: [6.5-8.6]
I20260709 14:52:00.989745 11052 consensus_queue.cc:1059] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 14:52:00.995414 11072 log.cc:927] Time spent T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.082s	user 0.003s	sys 0.000s
W20260709 14:52:01.018110 11079 log.cc:927] Time spent T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.184s	user 0.000s	sys 0.002s
W20260709 14:52:01.027915  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:01.031127 11037 leader_election.cc:290] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 7 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:01.035904 10873 leader_election.cc:290] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:52:00.998610 11075 log.cc:927] Time spent T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 14:52:00.997311 10914 leader_election.cc:290] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:00.895365 11017 raft_consensus.cc:515] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:01.000494 11015 consensus_meta.cc:287] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent flushing consensus metadata: real 0.796s	user 0.015s	sys 0.000s
I20260709 14:52:01.046375 10712 raft_consensus.cc:740] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:01.057363 11005 raft_consensus.cc:3055] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 14:52:00.935981 11050 leader_election.cc:290] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:01.060860 11043 leader_election.cc:290] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 11 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:01.055611 11047 leader_election.cc:290] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:01.061877  7848 raft_consensus.cc:1240] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
W20260709 14:52:01.063217 11039 consensus_meta.cc:287] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent flushing consensus metadata: real 0.589s	user 0.011s	sys 0.003s
I20260709 14:52:00.993134 10987 leader_election.cc:290] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:52:01.133113  7743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:01.053386 11007 raft_consensus.cc:2804] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 14:52:01.154515  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:01.054272 11034 raft_consensus.cc:493] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:01.106570 11031 leader_election.cc:290] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 4 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68:42321)
I20260709 14:52:01.157877 11087 raft_consensus.cc:3060] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Advancing to term 8
W20260709 14:52:01.209550  7817 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.000s	sys 0.016s
W20260709 14:52:01.210201  7817 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.503s	user 0.000s	sys 0.017s
I20260709 14:52:01.179018 11005 raft_consensus.cc:740] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9418391fa82a42c79c6cad13ba91d964, State: Running, Role: LEADER
W20260709 14:52:01.214339  7777 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.778s	user 0.009s	sys 0.005s
W20260709 14:52:01.218863  7777 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.796s	user 0.010s	sys 0.006s
W20260709 14:52:01.219342  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 355892us
I20260709 14:52:01.220731  7894 leader_election.cc:304] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:01.192745 11007 raft_consensus.cc:493] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 14:52:01.202572 11041 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.824s	user 0.035s	sys 0.067s
I20260709 14:52:01.200556 11084 raft_consensus.cc:493] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:52:01.226292  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 474335us
W20260709 14:52:01.236423  7771 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.848s	user 0.006s	sys 0.011s
I20260709 14:52:01.240638  8637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18d29d52d304c87b930d4fb5eaf50b1" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9418391fa82a42c79c6cad13ba91d964"
I20260709 14:52:01.179425 11015 raft_consensus.cc:515] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:01.277493  7819 leader_election.cc:304] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
W20260709 14:52:01.278548  7771 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.890s	user 0.006s	sys 0.016s
W20260709 14:52:01.243538 11041 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.865s	user 0.036s	sys 0.075s
I20260709 14:52:01.254845  7894 leader_election.cc:304] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:01.288303 11040 raft_consensus.cc:2749] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 14:52:01.299947  7894 leader_election.cc:304] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:01.206679 11034 raft_consensus.cc:515] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:01.249938 11047 raft_consensus.cc:2804] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 14:52:01.225661 11032 raft_consensus.cc:3055] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 14:52:01.199946 11039 raft_consensus.cc:515] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:01.247040 11031 raft_consensus.cc:493] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:01.299115  7771 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 2613) took 1084 ms. Trace:
W20260709 14:52:01.270133 11044 consensus_meta.cc:287] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent flushing consensus metadata: real 0.712s	user 0.015s	sys 0.000s
W20260709 14:52:01.315902  7927 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.680s	user 0.017s	sys 0.007s
W20260709 14:52:01.321627  7927 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.703s	user 0.018s	sys 0.007s
I20260709 14:52:01.316164  7849 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 2863) took 1008 ms. Trace:
W20260709 14:52:01.306365 10964 consensus_meta.cc:287] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent flushing consensus metadata: real 0.650s	user 0.013s	sys 0.002s
I20260709 14:52:01.315066  7848 raft_consensus.cc:1240] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 5. Current term is 6. Ops: []
I20260709 14:52:01.296911 11040 consensus_queue.cc:1059] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
W20260709 14:52:01.305769  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 335620us
I20260709 14:52:01.322404  7849 rpcz_store.cc:276] 0709 14:52:00.307917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:00.308047 (+   130us) service_pool.cc:224] Handling call
0709 14:52:00.308473 (+   426us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 14:52:00.309328 (+   855us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 14:52:00.309360 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 14:52:00.310016 (+   656us) log.cc:844] Serialized 52 byte log entry
0709 14:52:00.545016 (+235000us) raft_consensus.cc:1645] Marking committed up to 4
0709 14:52:00.545059 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:00.545132 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:52:00.994291 (+449159us) spinlock_profiling.cc:243] Waited 2.8 ms on lock 0x7b4400022b4c. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb687c29db1 00007fb687cc7c85 00007fb687cc86a2 00007fb68aa3a1db 00007fb68aa35aaf 00007fb68aa2986e 00007fb68aa28bb6 00007fb68aa287d8 00007fb68aa32221 00007fb68aa321d9 00007fb68aa32169
0709 14:52:01.305736 (+311445us) raft_consensus.cc:1685] finished
0709 14:52:01.305760 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:01.316055 (+ 10295us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1623,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":136,"spinlock_wait_cycles":6450560,"thread_start_us":234547,"threads_started":1,"wal-append.queue_time_us":488462}
I20260709 14:52:01.318761  7771 rpcz_store.cc:276] 0709 14:52:00.214485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:00.232913 (+ 18428us) service_pool.cc:224] Handling call
0709 14:52:00.233559 (+   646us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:52:00.233795 (+   236us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 14:52:00.387935 (+154140us) log.cc:844] Serialized 14 byte log entry
0709 14:52:01.298535 (+910600us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:52:01.298639 (+   104us) raft_consensus.cc:1645] Marking committed up to 5
0709 14:52:01.298716 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:01.298818 (+   102us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:01.299022 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11170,"prepare.queue_time_us":336071,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":61,"raft.queue_time_us":15837,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":130,"thread_start_us":1027574,"threads_started":2}
W20260709 14:52:01.322363  7775 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.982s	user 0.013s	sys 0.012s
W20260709 14:52:01.325345  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 47969us
W20260709 14:52:01.332062  7775 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.991s	user 0.013s	sys 0.012s
W20260709 14:52:01.314743  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 513822us
I20260709 14:52:01.241489 10712 consensus_queue.cc:260] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:01.331249  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 458381us
I20260709 14:52:01.334527  7819 leader_election.cc:400] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 7 election: Vote denied by peer 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785) with higher term. Message: Invalid argument: T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 7. Current term is 8.
I20260709 14:52:01.335150  7745 leader_election.cc:304] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:01.394294  7849 raft_consensus.cc:1240] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 9. Current term is 10. Ops: []
W20260709 14:52:01.395843  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 60800.2us
I20260709 14:52:01.312968 11048 consensus_queue.cc:1048] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.070s
I20260709 14:52:01.319676 11047 raft_consensus.cc:493] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:01.318492 11033 raft_consensus.cc:2804] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 14:52:01.374482  7851 raft_consensus.cc:1240] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
W20260709 14:52:01.373745  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 46609.4us
I20260709 14:52:01.315708 11090 raft_consensus.cc:493] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:01.406224  7778 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 2631) took 1075 ms. Trace:
I20260709 14:52:01.398211 11040 consensus_queue.cc:1243] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer 3876b8ee8d744cb18e91d97aae93b1ac log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 14:52:01.244566 11007 raft_consensus.cc:3060] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:52:01.429885  7745 leader_election.cc:304] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:52:01.484475  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 85653.8us
I20260709 14:52:01.344859 10964 raft_consensus.cc:515] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:01.401033  7819 leader_election.cc:403] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
W20260709 14:52:01.434540  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:01.326215 11083 raft_consensus.cc:493] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:01.437932  7778 rpcz_store.cc:276] 0709 14:52:00.327597 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:00.910750 (+583153us) service_pool.cc:224] Handling call
0709 14:52:00.927633 (+ 16883us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:52:00.928136 (+   503us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 14:52:00.996119 (+ 67983us) log.cc:844] Serialized 14 byte log entry
0709 14:52:01.402335 (+406216us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:52:01.402405 (+    70us) raft_consensus.cc:1645] Marking committed up to 7
0709 14:52:01.402464 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:01.402877 (+   413us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:01.403046 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":66713,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":52,"raft.queue_time_us":1105,"raft.run_cpu_time_us":245,"raft.run_wall_time_us":27658,"thread_start_us":404106,"threads_started":1}
I20260709 14:52:01.318099 11032 raft_consensus.cc:740] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:01.404273 11025 raft_consensus.cc:697] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:01.269843 11037 consensus_queue.cc:1048] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.160s
I20260709 14:52:01.487495 11083 raft_consensus.cc:515] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:01.499540 11036 raft_consensus.cc:3055] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 14:52:01.502645 11036 raft_consensus.cc:740] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:01.326491 11084 raft_consensus.cc:515] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:01.485757  7745 leader_election.cc:304] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:01.510762  7745 leader_election.cc:304] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:01.512405  7745 leader_election.cc:304] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:01.333324 11043 raft_consensus.cc:2749] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 14:52:01.493199  7851 raft_consensus.cc:1240] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 7. Current term is 8. Ops: []
I20260709 14:52:01.381311 11027 consensus_queue.cc:1059] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.109s
W20260709 14:52:01.440011 10880 consensus_meta.cc:287] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent flushing consensus metadata: real 0.506s	user 0.020s	sys 0.000s
I20260709 14:52:01.328163 11031 raft_consensus.cc:515] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:01.332558 11044 raft_consensus.cc:515] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:01.495915 11009 raft_consensus.cc:2804] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader election won for term 9
I20260709 14:52:01.506588 11083 leader_election.cc:290] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:01.522902  7745 leader_election.cc:304] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
W20260709 14:52:01.540921  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 206562us
I20260709 14:52:01.510818 11047 raft_consensus.cc:3060] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 14:52:01.506217 11041 consensus_queue.cc:1048] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 14:52:01.488065 11033 raft_consensus.cc:697] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:01.508653 10712 raft_consensus.cc:3060] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:52:01.564673  7819 leader_election.cc:304] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:01.593570  7851 raft_consensus.cc:1240] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Rejecting Update request from peer 9418391fa82a42c79c6cad13ba91d964 for earlier term 3. Current term is 4. Ops: []
W20260709 14:52:01.567346  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 166126us
I20260709 14:52:01.499864 11017 leader_election.cc:290] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:52:01.571735  8598 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.011s	sys 0.004s
W20260709 14:52:01.624270  8598 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.592s	user 0.011s	sys 0.004s
W20260709 14:52:01.624715  8598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 592873us
I20260709 14:52:01.571271  7849 raft_consensus.cc:1275] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 14:52:01.625572  7849 pending_rounds.cc:85] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting all ops after (but not including) 5
I20260709 14:52:01.574873  7847 raft_consensus.cc:1240] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
W20260709 14:52:01.581979  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 181703us
I20260709 14:52:01.376739 11005 consensus_queue.cc:260] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:52:01.540433 11020 raft_consensus.cc:493] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:01.504050 11036 consensus_queue.cc:260] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:01.595707 11035 consensus_meta.cc:287] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent flushing consensus metadata: real 0.866s	user 0.007s	sys 0.007s
I20260709 14:52:01.596403 11022 raft_consensus.cc:3055] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 14:52:01.601833 11031 leader_election.cc:290] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:01.547586 10880 raft_consensus.cc:515] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:01.609547 11025 consensus_queue.cc:237] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:01.613446  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 179760us
W20260709 14:52:01.616983  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 52406.3us
I20260709 14:52:01.449404 11090 raft_consensus.cc:515] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:01.516352 11105 raft_consensus.cc:2749] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785) with higher term. Message: Invalid argument: T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 7. Current term is 8.
W20260709 14:52:01.554721 11060 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.000s	sys 0.016s
I20260709 14:52:01.622814  7893 leader_election.cc:304] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:01.634933  7849 pending_rounds.cc:107] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 14:52:01.576633 10987 raft_consensus.cc:2804] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 14:52:01.578192 10873 raft_consensus.cc:2749] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 14:52:01.536983 11094 consensus_queue.cc:1048] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.125s
W20260709 14:52:01.737732  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:52:01.735838  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 108022us
I20260709 14:52:01.755826  7819 leader_election.cc:304] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:01.757318  7849 raft_consensus.cc:2889] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:52:01.649744  7847 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 2871) took 1260 ms. Trace:
I20260709 14:52:01.759686  7847 rpcz_store.cc:276] 0709 14:52:00.389792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:00.419176 (+ 29384us) service_pool.cc:224] Handling call
0709 14:52:00.475952 (+ 56776us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:52:01.626272 (+1150320us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:01.649231 (+ 22959us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b540013c4d4. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae8ee01 00007fb68ae8d83e 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2 00007fb6891c948c 00007fb6891c88c6
0709 14:52:01.649641 (+   410us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2526543104}
I20260709 14:52:01.764264  7819 leader_election.cc:304] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:52:01.735519 11101 raft_consensus.cc:2804] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 14:52:01.769562 11115 log.cc:927] Time spent T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.162s	user 0.000s	sys 0.004s
I20260709 14:52:01.769829 11101 raft_consensus.cc:493] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:01.770562 11093 raft_consensus.cc:2804] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 14:52:01.770557 11101 raft_consensus.cc:3060] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:52:01.771399 11093 raft_consensus.cc:493] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting leader election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:52:01.771621  7850 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 2879) took 1130 ms. Trace:
I20260709 14:52:01.772022 11093 raft_consensus.cc:3060] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Advancing to term 13
I20260709 14:52:01.735299 11104 raft_consensus.cc:2804] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 14:52:01.773341 11104 raft_consensus.cc:493] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:01.773598  7853 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 2872) took 1299 ms. Trace:
I20260709 14:52:01.773720 11104 raft_consensus.cc:3060] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:52:01.684000 11050 raft_consensus.cc:493] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:01.774000  7853 rpcz_store.cc:276] 0709 14:52:00.473999 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:00.643543 (+169544us) service_pool.cc:224] Handling call
0709 14:52:00.644117 (+   574us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:52:00.741356 (+ 97239us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 14:52:01.205820 (+464464us) log.cc:844] Serialized 14 byte log entry
0709 14:52:01.597645 (+391825us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:52:01.598681 (+  1036us) log.cc:844] Serialized 26 byte log entry
0709 14:52:01.598880 (+   199us) raft_consensus.cc:1645] Marking committed up to 6
0709 14:52:01.598916 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:01.599148 (+   232us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:52:01.773334 (+174186us) raft_consensus.cc:1685] finished
0709 14:52:01.773357 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:01.773520 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":70886,"prepare.queue_time_us":203155,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":30,"raft.queue_time_us":386041,"raft.run_cpu_time_us":274,"raft.run_wall_time_us":278,"thread_start_us":738027,"threads_started":2,"wal-append.queue_time_us":516360}
I20260709 14:52:01.775699 11050 raft_consensus.cc:515] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:01.778204 11050 leader_election.cc:290] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:01.778970 11031 raft_consensus.cc:2749] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 14:52:01.780663 11098 log.cc:927] Time spent T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.144s	user 0.003s	sys 0.003s
I20260709 14:52:01.643728 11020 raft_consensus.cc:515] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:01.648135 11102 raft_consensus.cc:2804] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 14:52:01.783103 11102 raft_consensus.cc:493] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:01.783682 11102 raft_consensus.cc:3060] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:52:01.783574 11031 consensus_queue.cc:1059] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 14:52:01.783725 11020 leader_election.cc:290] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:01.784803 11050 raft_consensus.cc:3055] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 LEADER]: Stepping down as leader of term 8
I20260709 14:52:01.785329 11050 raft_consensus.cc:740] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:52:01.786703 11050 consensus_queue.cc:260] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:01.787539 11002 consensus_meta.cc:287] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent flushing consensus metadata: real 0.849s	user 0.002s	sys 0.013s
I20260709 14:52:01.788542 11084 leader_election.cc:290] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:01.788050 11002 raft_consensus.cc:515] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:01.789330 11084 raft_consensus.cc:493] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:01.789899 11084 raft_consensus.cc:515] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:01.790911 11002 leader_election.cc:290] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 12 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:01.791062 10738 consensus_queue.cc:1059] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 14:52:01.791641  7819 leader_election.cc:304] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:01.788241 11050 raft_consensus.cc:3060] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:52:01.795013  7819 leader_election.cc:304] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:52:01.782368 11093 raft_consensus.cc:515] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:01.636497 11088 raft_consensus.cc:2804] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 14:52:01.800266  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 277504us
W20260709 14:52:01.801443  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 52527.8us
I20260709 14:52:01.772171  7850 rpcz_store.cc:276] 0709 14:52:00.641058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:00.796853 (+155795us) service_pool.cc:224] Handling call
0709 14:52:00.844636 (+ 47783us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 14:52:01.208744 (+364108us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:52:01.208776 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 14:52:01.220687 (+ 11911us) log.cc:844] Serialized 52 byte log entry
0709 14:52:01.556311 (+335624us) raft_consensus.cc:1645] Marking committed up to 4
0709 14:52:01.556439 (+   128us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:01.556680 (+   241us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:52:01.771355 (+214675us) raft_consensus.cc:1685] finished
0709 14:52:01.771375 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:01.771552 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":315048,"raft.run_cpu_time_us":236,"raft.run_wall_time_us":6322,"thread_start_us":602909,"threads_started":2,"wal-append.queue_time_us":310117}
W20260709 14:52:01.802821  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 180126us
I20260709 14:52:01.810426  7819 leader_election.cc:304] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:01.633774 11043 raft_consensus.cc:2749] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 14:52:01.802145  7772 raft_consensus.cc:1275] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 14:52:01.905850  7745 leader_election.cc:304] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:01.910701  7745 leader_election.cc:304] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:01.736392 11015 leader_election.cc:290] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 6 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:01.728564 11083 raft_consensus.cc:493] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:01.903779 11017 consensus_queue.cc:1059] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
W20260709 14:52:01.768779 11060 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.718s	user 0.000s	sys 0.018s
I20260709 14:52:01.799588 11036 raft_consensus.cc:3060] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:52:01.933338  7775 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 2622) took 1696 ms. Trace:
I20260709 14:52:01.936983  7927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38532 (request call id 2930) took 1671 ms. Trace:
I20260709 14:52:01.793095 11084 leader_election.cc:290] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:52:01.939407  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:01.941303  7927 rpcz_store.cc:276] 0709 14:52:00.268517 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:00.281731 (+ 13214us) service_pool.cc:224] Handling call
0709 14:52:00.358867 (+ 77136us) spinlock_profiling.cc:243] Waited 1.28 ms on lock 0x7b5800200198. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb687c29db1 00007fb687d69b71 00007fb687d69a22 00007fb690c82c09 00007fb68fddcee0 00007fb68fea60ab 00007fb68fea6131 00007fb68fe67fc0 00007fb68fe52929 00007fb68fe523d2 00007fb6893c9bd4
0709 14:52:00.359358 (+   491us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 14:52:00.360028 (+   670us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:52:00.360060 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 14:52:00.366900 (+  6840us) log.cc:844] Serialized 52 byte log entry
0709 14:52:00.618780 (+251880us) spinlock_profiling.cc:243] Waited 2.21 ms on lock 0x7b1800365f80. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb690c69de1 00007fb690c765b1 00007fb687d83e07 00007fb690bdeab9 00007fb687da069b 00007fb687d9e93f 00007fb687da0c02 00007fb68aa2820b 00007fb68aa2dd23 00007fb68aa2e0d1 00007fb68ae49a0f
0709 14:52:01.322095 (+703315us) raft_consensus.cc:1645] Marking committed up to 6
0709 14:52:01.322142 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:01.322223 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:52:01.936299 (+614076us) raft_consensus.cc:1685] finished
0709 14:52:01.936329 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:01.936693 (+   364us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1276,"raft.run_cpu_time_us":334,"raft.run_wall_time_us":4201,"spinlock_wait_cycles":8042368,"thread_start_us":703073,"threads_started":1,"wal-append.queue_time_us":1232901}
I20260709 14:52:01.903832 11048 raft_consensus.cc:2749] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 14:52:01.940150  7775 rpcz_store.cc:276] 0709 14:52:00.237228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:00.268607 (+ 31379us) service_pool.cc:224] Handling call
0709 14:52:00.269048 (+   441us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:52:00.269582 (+   534us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:52:00.269617 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:52:00.270216 (+   599us) log.cc:844] Serialized 26 byte log entry
0709 14:52:01.332733 (+1062517us) raft_consensus.cc:1645] Marking committed up to 5
0709 14:52:01.332780 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:01.332862 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:52:01.933038 (+600176us) raft_consensus.cc:1685] finished
0709 14:52:01.933066 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:01.933230 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":15685,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":6726,"thread_start_us":991976,"threads_started":1,"wal-append.queue_time_us":1305219}
I20260709 14:52:01.820858 11039 leader_election.cc:290] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 8 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:01.758270 11022 raft_consensus.cc:740] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
W20260709 14:52:01.951697  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 44715.7us
I20260709 14:52:01.745076 11035 raft_consensus.cc:515] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:01.815670 10914 raft_consensus.cc:2804] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 14:52:01.968479 10914 raft_consensus.cc:493] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:01.968895 10914 raft_consensus.cc:3060] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:52:01.969667  7849 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 2888) took 1299 ms. Trace:
I20260709 14:52:01.970356 11100 consensus_queue.cc:1059] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.008s
W20260709 14:52:01.971071 11095 log.cc:927] Time spent T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
I20260709 14:52:01.971783 11100 raft_consensus.cc:3055] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 14:52:01.972275 11106 log.cc:927] Time spent T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.272s	user 0.000s	sys 0.001s
I20260709 14:52:01.972751  7852 raft_consensus.cc:1240] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 14:52:01.973086 10964 leader_election.cc:290] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 10 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:01.973474  7773 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 2629) took 1674 ms. Trace:
I20260709 14:52:01.974431  7852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 2883) took 1306 ms. Trace:
I20260709 14:52:01.904572 11009 raft_consensus.cc:697] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
W20260709 14:52:01.975891 11087 consensus_meta.cc:287] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent flushing consensus metadata: real 0.766s	user 0.012s	sys 0.002s
I20260709 14:52:01.976127 11097 raft_consensus.cc:2804] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 14:52:01.976732 11097 raft_consensus.cc:493] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:01.977453 11089 raft_consensus.cc:493] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:01.978055 11089 raft_consensus.cc:515] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:01.982650 10914 raft_consensus.cc:515] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:01.919154 11034 leader_election.cc:290] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:01.984714  7854 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 2881) took 1331 ms. Trace:
I20260709 14:52:01.939177 11033 consensus_queue.cc:237] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:01.985491  7854 rpcz_store.cc:276] 0709 14:52:00.653176 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:00.975750 (+322574us) service_pool.cc:224] Handling call
0709 14:52:00.976196 (+   446us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 14:52:01.051409 (+ 75213us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:52:01.051445 (+    36us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 14:52:01.055680 (+  4235us) spinlock_profiling.cc:243] Waited 2.82 ms on lock 0x7b2c000552c8. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb689787a11 00007fb689797372 00007fb68aec9a01 00007fb68ae8e43a 00007fb68ae8d83e 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2
0709 14:52:01.107288 (+ 51608us) log.cc:844] Serialized 52 byte log entry
0709 14:52:01.555575 (+448287us) raft_consensus.cc:1645] Marking committed up to 3
0709 14:52:01.555639 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:01.555750 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:52:01.583956 (+ 28206us) spinlock_profiling.cc:243] Waited 4.42 ms on lock 0x7b4800002dd8. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68fdb7aa1 00007fb68fdaeb37 00007fb68fdae9ca 00007fb68fea626f 00007fb68fea5f37 00007fb68feba55c 00007fb68feba508 00007fb68feba488 00007fb68feba443 00007fb68feb96ec 00007fb68ede3a96
0709 14:52:01.984369 (+400413us) raft_consensus.cc:1685] finished
0709 14:52:01.984396 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:01.984625 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":76060,"raft.queue_time_us":210676,"raft.run_cpu_time_us":6565,"raft.run_wall_time_us":419419,"spinlock_wait_cycles":16634496,"thread_start_us":368044,"threads_started":1,"wal-append.queue_time_us":637126}
I20260709 14:52:01.961753  7893 leader_election.cc:304] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:01.791427 11110 consensus_queue.cc:1048] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.160s
I20260709 14:52:01.967629 11093 leader_election.cc:290] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:01.967818 11035 leader_election.cc:290] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 11 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:52:01.961436  7743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:52:01.973752 11118 log.cc:927] Time spent T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.119s	user 0.000s	sys 0.001s
I20260709 14:52:01.987401 11055 consensus_queue.cc:1059] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 14:52:01.991595  7777 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 2628) took 1702 ms. Trace:
I20260709 14:52:01.988986  7770 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 2634) took 1395 ms. Trace:
I20260709 14:52:02.023386  7777 rpcz_store.cc:276] 0709 14:52:00.289534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:00.357977 (+ 68443us) service_pool.cc:224] Handling call
0709 14:52:00.369695 (+ 11718us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:52:00.370180 (+   485us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:52:00.370212 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:52:00.376607 (+  6395us) log.cc:844] Serialized 26 byte log entry
0709 14:52:01.219627 (+843020us) raft_consensus.cc:1645] Marking committed up to 4
0709 14:52:01.219676 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:01.219769 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:52:01.991299 (+771530us) raft_consensus.cc:1685] finished
0709 14:52:01.991326 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:01.991501 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":606,"raft.run_cpu_time_us":225,"raft.run_wall_time_us":4205,"thread_start_us":796394,"threads_started":1,"wal-append.queue_time_us":1394704}
I20260709 14:52:01.970247  7849 rpcz_store.cc:276] 0709 14:52:00.670223 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:01.511810 (+841587us) service_pool.cc:224] Handling call
0709 14:52:01.553666 (+ 41856us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:52:01.800094 (+246428us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:01.969148 (+169054us) spinlock_profiling.cc:243] Waited 16.6 ms on lock 0x7b5400140ad4. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae8ee01 00007fb68ae8d83e 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2 00007fb6891c948c 00007fb6891c88c6
0709 14:52:01.969541 (+   393us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":38236416}
I20260709 14:52:01.904366 11088 raft_consensus.cc:493] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:02.023653  7770 rpcz_store.cc:276] 0709 14:52:00.593567 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:01.158035 (+564468us) service_pool.cc:224] Handling call
0709 14:52:01.194766 (+ 36731us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:52:01.201081 (+  6315us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:52:01.201120 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:52:01.208100 (+  6980us) log.cc:844] Serialized 26 byte log entry
0709 14:52:01.561079 (+352979us) raft_consensus.cc:1645] Marking committed up to 7
0709 14:52:01.567911 (+  6832us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:01.568021 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:52:01.988630 (+420609us) raft_consensus.cc:1685] finished
0709 14:52:01.988654 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:01.988831 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":62596,"raft.queue_time_us":6455,"raft.run_cpu_time_us":263,"raft.run_wall_time_us":14742,"thread_start_us":263099,"threads_started":1,"wal-append.queue_time_us":512817}
W20260709 14:52:02.015374  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 104794us
I20260709 14:52:01.974905  7852 rpcz_store.cc:276] 0709 14:52:00.667736 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:01.056456 (+388720us) service_pool.cc:224] Handling call
0709 14:52:01.056909 (+   453us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:52:01.973206 (+916297us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:01.973999 (+   793us) spinlock_profiling.cc:243] Waited 915 ms on lock 0x7b54003b4a54. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae8ee01 00007fb68ae8d83e 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2 00007fb6891c948c 00007fb6891c88c6
0709 14:52:01.974293 (+   294us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2105589504}
I20260709 14:52:01.972237 11100 raft_consensus.cc:740] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:02.039258 11119 consensus_queue.cc:1059] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.016s
I20260709 14:52:02.039635 11100 consensus_queue.cc:260] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:02.041040 11100 raft_consensus.cc:3060] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:52:02.026487 11048 raft_consensus.cc:2804] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 14:52:02.042094 11107 consensus_queue.cc:1059] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
W20260709 14:52:02.044889  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:01.970196 11017 raft_consensus.cc:3055] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 14:52:01.977108 11097 raft_consensus.cc:3060] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Advancing to term 8
I20260709 14:52:01.958642 11043 raft_consensus.cc:2804] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 14:52:01.957976 11084 raft_consensus.cc:493] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:01.788048 11101 raft_consensus.cc:515] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:02.046319  7776 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 2630) took 1743 ms. Trace:
I20260709 14:52:02.048954 10914 leader_election.cc:290] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 10 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:01.985342 11117 consensus_queue.cc:1059] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.064s
W20260709 14:52:02.050884  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 240553us
I20260709 14:52:01.974186  7773 rpcz_store.cc:276] 0709 14:52:00.299185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:00.884024 (+584839us) service_pool.cc:224] Handling call
0709 14:52:00.884951 (+   927us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:52:01.301372 (+416421us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 14:52:01.301410 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:52:01.331644 (+ 30234us) log.cc:844] Serialized 26 byte log entry
0709 14:52:01.622572 (+290928us) raft_consensus.cc:1645] Marking committed up to 6
0709 14:52:01.622627 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:01.622722 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:52:01.970067 (+347345us) spinlock_profiling.cc:243] Waited 7.07 ms on lock 0x7b4400022b4c. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb687c29db1 00007fb687cc7c85 00007fb687cc86a2 00007fb68aa3a1db 00007fb68aa35aaf 00007fb68aa2986e 00007fb68aa28bb6 00007fb68aa287d8 00007fb68aa32221 00007fb68aa321d9 00007fb68aa32169
0709 14:52:01.972770 (+  2703us) raft_consensus.cc:1685] finished
0709 14:52:01.972804 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:01.973379 (+   575us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40077,"raft.queue_time_us":170894,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":116,"spinlock_wait_cycles":16252160,"thread_start_us":593783,"threads_started":2,"wal-append.queue_time_us":572352}
I20260709 14:52:02.036648  7745 leader_election.cc:304] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:02.067973  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: true dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:02.068622  7852 raft_consensus.cc:2376] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 11. Re-sending same reply.
W20260709 14:52:02.031239  8599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 398036us
W20260709 14:52:02.053484  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:02.049606 11127 raft_consensus.cc:2804] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader election won for term 9
I20260709 14:52:01.939193 11083 raft_consensus.cc:515] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:02.081112 11083 leader_election.cc:290] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:01.974218 11103 consensus_queue.cc:1048] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.314s
W20260709 14:52:02.084962 10930 consensus_meta.cc:287] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent flushing consensus metadata: real 1.458s	user 0.011s	sys 0.004s
I20260709 14:52:02.085623 10930 raft_consensus.cc:515] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:02.086882  7845 raft_consensus.cc:1240] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 14:52:02.059274  7776 rpcz_store.cc:276] 0709 14:52:00.302701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:00.912746 (+610045us) service_pool.cc:224] Handling call
0709 14:52:00.913459 (+   713us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:52:01.327370 (+413911us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:52:01.327402 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:52:01.381145 (+ 53743us) log.cc:844] Serialized 26 byte log entry
0709 14:52:01.568377 (+187232us) raft_consensus.cc:1645] Marking committed up to 6
0709 14:52:01.568424 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:01.594197 (+ 25773us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:52:02.046035 (+451838us) raft_consensus.cc:1685] finished
0709 14:52:02.046062 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:02.046241 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12036,"raft.queue_time_us":143162,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":81,"thread_start_us":487939,"threads_started":2,"wal-append.queue_time_us":205156}
I20260709 14:52:01.975764 11009 consensus_queue.cc:237] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:02.095242 11089 leader_election.cc:290] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:02.095486 10930 leader_election.cc:290] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 9 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:02.049636 11017 raft_consensus.cc:740] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:02.098839 11083 raft_consensus.cc:493] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:02.098587 11017 consensus_queue.cc:260] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:02.099602 11083 raft_consensus.cc:515] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:02.106547 11002 consensus_queue.cc:1048] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 14:52:02.108667 10880 leader_election.cc:290] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:02.035380 11088 raft_consensus.cc:3060] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Advancing to term 8
I20260709 14:52:02.074292  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:02.063198 11084 raft_consensus.cc:515] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:02.077268 11048 raft_consensus.cc:697] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:02.053419 11043 raft_consensus.cc:493] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:02.074878 11094 consensus_queue.cc:1059] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 14:52:02.111536 10930 raft_consensus.cc:493] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:52:02.112449 11101 leader_election.cc:290] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:02.112970 11035 raft_consensus.cc:493] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:02.112524 10914 raft_consensus.cc:493] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:02.114328 11122 raft_consensus.cc:493] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:02.115190  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:02.150485  7850 raft_consensus.cc:2468] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 5.
I20260709 14:52:02.115914 11110 raft_consensus.cc:493] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:52:02.119880  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 129005us
I20260709 14:52:02.036177 11087 raft_consensus.cc:493] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:02.124935  7819 leader_election.cc:304] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
W20260709 14:52:02.130630  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 94145.2us
I20260709 14:52:02.158349  7745 leader_election.cc:304] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:02.132390  7846 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 2880) took 1491 ms. Trace:
W20260709 14:52:02.137156  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:02.142668  7854 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129"
dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
mode: GRACEFUL
new_leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:41662
I20260709 14:52:02.162104  7854 raft_consensus.cc:606] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Received request to transfer leadership to TS 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:52:02.162621  7854 raft_consensus.cc:614] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 14:52:02.074411 11044 leader_election.cc:290] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 11 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:02.138190 11043 raft_consensus.cc:3060] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Advancing to term 8
W20260709 14:52:02.151989  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 171328us
W20260709 14:52:02.139721 11007 consensus_meta.cc:287] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent flushing consensus metadata: real 0.640s	user 0.010s	sys 0.005s
W20260709 14:52:02.184612  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 59764.9us
I20260709 14:52:02.185681  7819 leader_election.cc:304] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:02.132851 11017 raft_consensus.cc:3060] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:52:02.121973 10964 raft_consensus.cc:493] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:02.117223 11090 leader_election.cc:290] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:02.138602 11103 raft_consensus.cc:493] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:02.131886 11130 raft_consensus.cc:2804] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 14:52:02.180579  7745 leader_election.cc:304] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:02.207247  7745 leader_election.cc:304] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:02.159514  7846 rpcz_store.cc:276] 0709 14:52:00.641394 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:00.857562 (+216168us) service_pool.cc:224] Handling call
0709 14:52:00.858096 (+   534us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 14:52:01.404844 (+546748us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:52:01.404880 (+    36us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 14:52:01.405624 (+   744us) log.cc:844] Serialized 52 byte log entry
0709 14:52:01.494451 (+ 88827us) spinlock_profiling.cc:243] Waited 8.05 ms on lock 0x7b4800002dd8. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68fdb7aa1 00007fb68fdaeb37 00007fb68fdae9ca 00007fb68fea626f 00007fb68fea5f37 00007fb68feba55c 00007fb68feba508 00007fb68feba488 00007fb68feba443 00007fb68feb96ec 00007fb68ede3a96
0709 14:52:01.572311 (+ 77860us) raft_consensus.cc:1645] Marking committed up to 6
0709 14:52:01.572368 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:01.572464 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:52:02.119900 (+547436us) raft_consensus.cc:1685] finished
0709 14:52:02.119928 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:02.132252 (+ 12324us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":61764,"raft.queue_time_us":280027,"raft.run_cpu_time_us":5953,"raft.run_wall_time_us":311795,"spinlock_wait_cycles":18508672,"thread_start_us":504541,"threads_started":2,"wal-append.queue_time_us":352822}
W20260709 14:52:02.182684  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 165037us
I20260709 14:52:02.138181 11083 leader_election.cc:290] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:52:02.209596  7744 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.101.67:40785 timed out after 2.107s (SENT) [suppressed 22 similar messages]
I20260709 14:52:02.194146  7819 leader_election.cc:304] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
W20260709 14:52:02.169975 10978 consensus_meta.cc:287] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent flushing consensus metadata: real 1.057s	user 0.016s	sys 0.000s
W20260709 14:52:02.183836 11047 consensus_meta.cc:287] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent flushing consensus metadata: real 0.570s	user 0.014s	sys 0.000s
I20260709 14:52:02.145946 11089 raft_consensus.cc:493] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:02.168218 11127 raft_consensus.cc:697] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:52:02.145634 10930 raft_consensus.cc:515] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:02.154356 10914 raft_consensus.cc:515] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:02.226858  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:02.228579  7776 raft_consensus.cc:1275] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 14:52:02.214968  7819 leader_election.cc:304] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:02.229775  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:02.149617 11035 raft_consensus.cc:515] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:02.239483  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:02.215178  7745 leader_election.cc:304] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:02.199745 11044 raft_consensus.cc:2804] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 14:52:02.205287 11130 raft_consensus.cc:493] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:02.216477 11090 raft_consensus.cc:2804] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader election won for term 10
I20260709 14:52:02.231376  7819 leader_election.cc:304] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:02.245441  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18d29d52d304c87b930d4fb5eaf50b1" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:02.258320  7819 leader_election.cc:304] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:02.235383  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:02.186693 11087 raft_consensus.cc:515] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:02.217115 11101 raft_consensus.cc:2804] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 14:52:02.261274  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 71233.8us
I20260709 14:52:02.253108  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
W20260709 14:52:02.253156  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 81366.7us
I20260709 14:52:02.262996  7771 raft_consensus.cc:2468] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 5.
I20260709 14:52:02.241997  7745 leader_election.cc:304] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:02.255264  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 11 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:02.214784 11117 raft_consensus.cc:3055] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 14:52:02.222826 11083 raft_consensus.cc:2749] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 14:52:02.194406 11007 raft_consensus.cc:515] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:02.157675 11122 raft_consensus.cc:515] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:02.199412 10964 raft_consensus.cc:515] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:02.169276 11110 raft_consensus.cc:515] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:02.258711 11130 raft_consensus.cc:3060] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:52:02.252455 11107 consensus_queue.cc:1059] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 14:52:02.248353 11044 raft_consensus.cc:493] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:02.315881 11005 raft_consensus.cc:3060] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:52:02.316231 11044 raft_consensus.cc:3060] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:52:02.240197 11039 raft_consensus.cc:2749] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 14:52:02.225133 11089 raft_consensus.cc:515] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:02.212044 11054 consensus_queue.cc:1059] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 14:52:02.277403  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:02.217312 10978 raft_consensus.cc:515] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:02.270818  7819 leader_election.cc:304] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:02.280800 11128 raft_consensus.cc:2749] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 14:52:02.281277 11129 raft_consensus.cc:2804] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 14:52:02.266225 11101 raft_consensus.cc:493] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:02.285434 11124 raft_consensus.cc:2804] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader election won for term 8
I20260709 14:52:02.288535 10930 leader_election.cc:290] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:02.289402 11087 leader_election.cc:290] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:02.290791 11035 leader_election.cc:290] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:52:02.291381  8596 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:02.260633 11009 raft_consensus.cc:2749] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 14:52:02.216353 11047 raft_consensus.cc:515] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:02.266300  7772 raft_consensus.cc:2410] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 14:52:02.298954  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:02.289026 11104 raft_consensus.cc:515] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:02.368510 11104 leader_election.cc:290] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:02.238572 11048 consensus_queue.cc:237] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:02.369692  7778 raft_consensus.cc:1240] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
W20260709 14:52:02.302500 10712 consensus_meta.cc:287] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent flushing consensus metadata: real 0.682s	user 0.017s	sys 0.003s
I20260709 14:52:02.277477 11034 raft_consensus.cc:2749] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 14:52:02.302311 11102 raft_consensus.cc:515] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:02.372011  7771 raft_consensus.cc:3060] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:52:02.373387 11102 leader_election.cc:290] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 10 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:02.269649 11117 raft_consensus.cc:740] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:02.374783 11117 consensus_queue.cc:260] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:02.376253 11117 raft_consensus.cc:3060] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 14:52:02.380781  7775 raft_consensus.cc:2393] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 10: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
W20260709 14:52:02.311249 11050 consensus_meta.cc:287] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent flushing consensus metadata: real 0.519s	user 0.006s	sys 0.007s
I20260709 14:52:02.311363 11088 raft_consensus.cc:515] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:02.314468 10914 leader_election.cc:290] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:02.261433  7776 raft_consensus.cc:2468] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 10.
I20260709 14:52:02.259668 11093 raft_consensus.cc:2749] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 14:52:02.344075 11089 leader_election.cc:290] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:02.317565  7774 raft_consensus.cc:1240] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
W20260709 14:52:02.346477  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 74971.3us
I20260709 14:52:02.315656 11107 raft_consensus.cc:3055] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 14:52:02.403934 11107 raft_consensus.cc:740] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:02.405007 11107 consensus_queue.cc:260] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:02.407398 11107 raft_consensus.cc:3060] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:52:02.410224 11032 consensus_queue.cc:260] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:02.411577 11032 raft_consensus.cc:3060] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:52:02.413664 11097 raft_consensus.cc:515] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:02.347508  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 76798.4us
I20260709 14:52:02.318423  7779 raft_consensus.cc:1275] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 14:52:02.420431  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:02.345623  7770 raft_consensus.cc:2468] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 10.
I20260709 14:52:02.267726 11090 raft_consensus.cc:697] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:52:02.422307 11090 consensus_queue.cc:237] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:02.422554  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:02.424397  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
W20260709 14:52:02.349790  7894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:02.426570 11099 raft_consensus.cc:493] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:02.427307 11099 raft_consensus.cc:515] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:02.428789 11040 raft_consensus.cc:3055] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 14:52:02.214581 11103 raft_consensus.cc:515] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:02.429333 11040 raft_consensus.cc:740] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:02.431384  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:02.431952 11103 leader_election.cc:290] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:02.432401  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:02.433261  7922 raft_consensus.cc:1275] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 14:52:02.433727  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:02.403560  7774 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 2633) took 1811 ms. Trace:
I20260709 14:52:02.354239  7845 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 2874) took 1807 ms. Trace:
I20260709 14:52:02.431841  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:02.433166  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
W20260709 14:52:02.403522  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:02.351637 10978 leader_election.cc:290] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:02.384781  7771 raft_consensus.cc:2468] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 10.
I20260709 14:52:02.438814  7819 leader_election.cc:304] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 9418391fa82a42c79c6cad13ba91d964
I20260709 14:52:02.349167 11083 raft_consensus.cc:2749] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 14:52:02.444675  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:02.445557  7847 raft_consensus.cc:3060] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:52:02.317147 11110 leader_election.cc:290] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:02.344089 11122 leader_election.cc:290] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:02.357034 11101 raft_consensus.cc:3060] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Advancing to term 8
I20260709 14:52:02.355757 11129 raft_consensus.cc:493] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:02.395500 11142 raft_consensus.cc:2749] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 14:52:02.396056  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:02.355765 11127 consensus_queue.cc:237] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:02.400179  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:02.399976 10964 leader_election.cc:290] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:02.391654 11084 leader_election.cc:290] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:02.433414  7925 raft_consensus.cc:2410] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 14:52:02.436939  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:02.434667  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 11 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:02.432437  7921 raft_consensus.cc:2410] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 14:52:02.433229  7927 raft_consensus.cc:1275] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 14:52:02.435015  7845 rpcz_store.cc:276] 0709 14:52:00.546705 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:00.736799 (+190094us) service_pool.cc:224] Handling call
0709 14:52:00.742468 (+  5669us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:52:02.087298 (+1344830us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:02.353909 (+266611us) spinlock_profiling.cc:243] Waited 1.34 s on lock 0x7b54000d4b54. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae8ee01 00007fb68ae8d83e 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2 00007fb6891c948c 00007fb6891c88c6
0709 14:52:02.354171 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3091301248}
I20260709 14:52:02.436339  7923 raft_consensus.cc:2468] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 7.
W20260709 14:52:02.353523  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 111629us
I20260709 14:52:02.430712 11040 consensus_queue.cc:260] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:02.434890  7774 rpcz_store.cc:276] 0709 14:52:00.592469 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:01.156690 (+564221us) service_pool.cc:224] Handling call
0709 14:52:01.157121 (+   431us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:52:02.402270 (+1245149us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:02.403146 (+   876us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b54002debd4. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae8ee01 00007fb68ae8d83e 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2 00007fb6891c948c 00007fb6891c88c6
0709 14:52:02.403468 (+   322us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2668316544}
I20260709 14:52:02.364794 11124 raft_consensus.cc:697] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:52:02.452960  7819 leader_election.cc:304] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:02.454444  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:52:02.500838  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 48000.3us
I20260709 14:52:02.455454  7779 raft_consensus.cc:2393] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 8: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:52:02.501829  7819 leader_election.cc:304] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:02.456525  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:02.463673  7849 raft_consensus.cc:1275] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 14:52:02.501842  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783e4874513449ef9084b833f188a6d3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:02.285218 11136 consensus_queue.cc:1059] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 14:52:02.476755  7847 raft_consensus.cc:2468] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 7.
I20260709 14:52:02.438838  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:02.461051 11105 raft_consensus.cc:2749] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 14:52:02.485679  7852 raft_consensus.cc:1275] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 14:52:02.486514  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:02.511667  7845 raft_consensus.cc:2468] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 7.
I20260709 14:52:02.483009  7745 leader_election.cc:304] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:02.513535  7745 leader_election.cc:304] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:02.421099 11020 consensus_queue.cc:1048] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.063s
W20260709 14:52:02.490353  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:02.496333 11084 consensus_queue.cc:1048] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 14:52:02.460016 11129 raft_consensus.cc:3060] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:52:02.445477 11050 raft_consensus.cc:493] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:02.524748  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:02.502796  7849 pending_rounds.cc:85] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting all ops after (but not including) 5
I20260709 14:52:02.527575  7848 raft_consensus.cc:2393] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 10: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:52:02.527688  7849 pending_rounds.cc:107] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting uncommitted NO_OP operation due to leader change: 7.6
I20260709 14:52:02.469857  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:02.503716  7850 raft_consensus.cc:3060] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Advancing to term 8
I20260709 14:52:02.484664  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:02.528151  7849 raft_consensus.cc:2889] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:52:02.529456  7923 raft_consensus.cc:2468] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 11.
I20260709 14:52:02.529431  7846 raft_consensus.cc:2410] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for term 12 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 14:52:02.507596  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:02.510053  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:02.534135  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:02.447448 11103 raft_consensus.cc:493] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:52:02.515681  7743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:02.516076  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:02.471201 11097 leader_election.cc:290] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 8 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:02.518229  7819 leader_election.cc:304] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:02.538785  7819 leader_election.cc:304] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:02.523613  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:02.498703 11122 consensus_queue.cc:1048] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 14:52:02.439344 11089 consensus_queue.cc:1048] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.048s
W20260709 14:52:02.552296  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:02.554697  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:02.521076 11009 raft_consensus.cc:2804] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader election won for term 6
I20260709 14:52:02.526948 11104 consensus_queue.cc:1048] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 14:52:02.570348  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:02.557009 11103 raft_consensus.cc:515] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:02.565819  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:02.521539 11087 raft_consensus.cc:2804] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 14:52:02.566565  7819 leader_election.cc:304] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:02.524297 11083 consensus_queue.cc:1048] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 14:52:02.557281 11040 raft_consensus.cc:3060] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 14:52:02.521399 11143 consensus_queue.cc:1048] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 14:52:02.569152 11043 raft_consensus.cc:515] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:02.524122 11110 raft_consensus.cc:2804] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 14:52:02.558493 11093 raft_consensus.cc:2804] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 14:52:02.558739 10914 raft_consensus.cc:2804] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader election won for term 10
W20260709 14:52:02.594079  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 75710.7us
I20260709 14:52:02.599880  7819 leader_election.cc:304] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:02.635106  7745 leader_election.cc:304] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:02.538312 11050 raft_consensus.cc:515] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:02.639256  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:02.642699  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:02.653784  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:02.583763 11087 raft_consensus.cc:493] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:02.657858  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:02.659849  7921 raft_consensus.cc:2468] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 10.
W20260709 14:52:02.660006  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 60240.7us
I20260709 14:52:02.661893  7745 leader_election.cc:304] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:02.664688  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:02.667639  7921 raft_consensus.cc:1240] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 14:52:02.670387  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:02.671356 11043 leader_election.cc:290] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 8 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:02.671721  7921 raft_consensus.cc:2468] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 8.
I20260709 14:52:02.676316  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:02.676829  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:02.677732  7928 raft_consensus.cc:2468] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 9.
I20260709 14:52:02.679241  7850 raft_consensus.cc:2468] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 8.
I20260709 14:52:02.679708  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:02.682770  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:02.683736  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:02.636778 10964 raft_consensus.cc:2804] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 14:52:02.633178 11110 raft_consensus.cc:493] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:02.694655  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783e4874513449ef9084b833f188a6d3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:02.684900  7924 raft_consensus.cc:3060] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:52:02.687712  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:02.636739 11093 raft_consensus.cc:493] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:02.693222  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:02.697175  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:02.704990  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:02.706444  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:02.667505 11087 raft_consensus.cc:3060] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:52:02.663707 11097 raft_consensus.cc:2749] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 14:52:02.715461  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:02.663864 10914 raft_consensus.cc:697] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:52:02.648453 11102 consensus_queue.cc:1048] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 14:52:02.690903 11047 leader_election.cc:290] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:02.724852  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:02.700917 11110 raft_consensus.cc:3060] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:52:02.711796 11105 raft_consensus.cc:493] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:02.700662 11093 raft_consensus.cc:3060] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:52:02.574358 11124 consensus_queue.cc:237] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:02.758769 11007 leader_election.cc:290] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 10 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:02.763775  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:02.651413 11090 consensus_queue.cc:1048] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.061s
I20260709 14:52:02.769119 10987 raft_consensus.cc:493] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:02.769865 10987 raft_consensus.cc:3060] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:52:02.770179 11103 leader_election.cc:290] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:02.707333 11022 consensus_queue.cc:260] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:02.743769 11104 raft_consensus.cc:2804] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 14:52:02.744835 11152 raft_consensus.cc:493] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9418391fa82a42c79c6cad13ba91d964)
W20260709 14:52:02.746017 11146 log.cc:927] Time spent T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.150s	user 0.001s	sys 0.000s
W20260709 14:52:02.747117 11144 log.cc:927] Time spent T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.153s	user 0.001s	sys 0.000s
I20260709 14:52:02.751307  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:02.773938  7771 raft_consensus.cc:1275] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 14:52:02.719328  7927 raft_consensus.cc:2468] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 8.
I20260709 14:52:02.776518 11103 raft_consensus.cc:493] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
W20260709 14:52:02.781425 11153 log.cc:927] Time spent T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
W20260709 14:52:02.813449  8596 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:02.837705  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:02.836339  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:02.852283  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:02.847093  7777 raft_consensus.cc:2410] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for term 10 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 14:52:02.855105  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:02.884816  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:02.885380  7772 raft_consensus.cc:1275] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 14:52:02.799836 11022 raft_consensus.cc:3060] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:52:02.886682  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:02.887672  7925 raft_consensus.cc:2468] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 9.
I20260709 14:52:02.785907 11007 raft_consensus.cc:2804] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader election won for term 9
I20260709 14:52:02.897598  7919 raft_consensus.cc:2410] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 14:52:02.837085 11009 raft_consensus.cc:697] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:52:02.786350 11104 raft_consensus.cc:493] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:02.904740  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:02.911108  7927 raft_consensus.cc:2393] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 8: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:52:02.911728 11009 consensus_queue.cc:237] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:02.914728 11151 log.cc:927] Time spent T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.218s	user 0.000s	sys 0.001s
I20260709 14:52:02.914219  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:02.890491  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:02.917054  7927 raft_consensus.cc:2393] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 10: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:52:02.776279 11105 raft_consensus.cc:515] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:02.909723 11146 log.cc:927] Time spent T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 14:52:02.799173 11152 raft_consensus.cc:515] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:52:02.853742 11103 raft_consensus.cc:515] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:02.900255 11089 raft_consensus.cc:2749] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 14:52:02.910801 11104 raft_consensus.cc:3060] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:52:02.910640 11007 raft_consensus.cc:697] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:52:03.034880  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:03.054147  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:03.122035  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: true dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:03.124541  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:03.123009  7925 raft_consensus.cc:2376] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 11. Re-sending same reply.
I20260709 14:52:03.133190  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:03.134085  7923 raft_consensus.cc:2468] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 9.
I20260709 14:52:03.145862  7770 raft_consensus.cc:1240] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 LEADER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 9. Current term is 10. Ops: []
I20260709 14:52:03.147431  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:03.150645 11007 consensus_queue.cc:237] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:03.161764  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:03.162890  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:03.186861  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:03.195909  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:02.909017 10914 consensus_queue.cc:237] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:03.179054 11146 log.cc:927] Time spent T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.115s	user 0.001s	sys 0.000s
W20260709 14:52:03.243088  7891 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.665s	user 0.003s	sys 0.023s
W20260709 14:52:03.264009  7891 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.686s	user 0.004s	sys 0.023s
W20260709 14:52:03.265697  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:52:03.267009  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:52:03.306901  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:03.308825  7851 raft_consensus.cc:1240] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 8. Current term is 9. Ops: []
W20260709 14:52:03.308740  7743 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.649s	user 0.013s	sys 0.041s
W20260709 14:52:03.310628  7743 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.651s	user 0.013s	sys 0.042s
W20260709 14:52:03.311336  7743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:52:03.275275 11032 consensus_meta.cc:287] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent flushing consensus metadata: real 0.863s	user 0.017s	sys 0.009s
I20260709 14:52:03.277685  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
W20260709 14:52:03.226842 10978 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.014s	sys 0.004s
W20260709 14:52:03.251720 11017 consensus_meta.cc:287] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0: Time spent flushing consensus metadata: real 1.059s	user 0.015s	sys 0.009s
I20260709 14:52:03.294082  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
W20260709 14:52:03.297501  7852 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.727s	user 0.019s	sys 0.036s
W20260709 14:52:03.323578  7852 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.753s	user 0.020s	sys 0.036s
I20260709 14:52:03.339787  7920 raft_consensus.cc:2410] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
W20260709 14:52:03.346844  7924 consensus_meta.cc:287] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent flushing consensus metadata: real 0.649s	user 0.010s	sys 0.009s
I20260709 14:52:03.351181  7924 raft_consensus.cc:2468] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 10.
I20260709 14:52:03.436349 11103 leader_election.cc:290] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:03.364605  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:03.322474 11119 raft_consensus.cc:3055] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 14:52:03.396727 11005 consensus_meta.cc:287] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964: Time spent flushing consensus metadata: real 1.080s	user 0.007s	sys 0.009s
I20260709 14:52:03.399533 11152 leader_election.cc:290] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68:42321)
I20260709 14:52:03.354730 11140 raft_consensus.cc:493] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:03.413734  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:03.418736  7851 raft_consensus.cc:1240] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 9. Current term is 10. Ops: []
I20260709 14:52:03.420070  7847 raft_consensus.cc:1240] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 7. Current term is 8. Ops: []
W20260709 14:52:03.412431 11130 consensus_meta.cc:287] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent flushing consensus metadata: real 1.099s	user 0.007s	sys 0.010s
I20260709 14:52:03.421602  7854 raft_consensus.cc:1240] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 8. Current term is 9. Ops: [6.4-8.5]
W20260709 14:52:03.323388 10978 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.670s	user 0.015s	sys 0.004s
W20260709 14:52:03.440557 11164 log.cc:927] Time spent T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 14:52:03.431309 10987 consensus_meta.cc:287] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent flushing consensus metadata: real 0.661s	user 0.007s	sys 0.016s
I20260709 14:52:03.450127  7927 raft_consensus.cc:2393] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 8: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
W20260709 14:52:03.452904  7742 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.752s	user 0.018s	sys 0.050s
W20260709 14:52:03.442456 11044 consensus_meta.cc:287] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent flushing consensus metadata: real 1.126s	user 0.020s	sys 0.011s
I20260709 14:52:03.461040  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:03.426880 11105 leader_election.cc:290] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:03.451386 11119 raft_consensus.cc:740] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:03.477921  7847 raft_consensus.cc:2468] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 9.
W20260709 14:52:03.484715  7742 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.784s	user 0.019s	sys 0.050s
I20260709 14:52:03.482055  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:03.485841  7854 raft_consensus.cc:2393] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 8: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:52:03.479305 11088 leader_election.cc:290] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:03.488198  8637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18d29d52d304c87b930d4fb5eaf50b1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9418391fa82a42c79c6cad13ba91d964" is_pre_election: true
I20260709 14:52:03.488097 11125 raft_consensus.cc:493] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:03.486794 11105 raft_consensus.cc:493] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:03.487169 11032 raft_consensus.cc:493] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:03.521821 11119 consensus_queue.cc:260] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:03.483543 10987 raft_consensus.cc:515] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:03.484534 11044 raft_consensus.cc:515] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:03.468204 11130 raft_consensus.cc:515] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:03.526918 11129 consensus_meta.cc:287] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent flushing consensus metadata: real 1.003s	user 0.010s	sys 0.006s
W20260709 14:52:03.531643  7744 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.817s	user 0.010s	sys 0.037s
I20260709 14:52:03.464272 11140 raft_consensus.cc:515] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:03.543814  7849 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.865s	user 0.019s	sys 0.057s
W20260709 14:52:03.545702  8596 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.648s	user 0.011s	sys 0.026s
W20260709 14:52:03.547441  8596 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.657s	user 0.012s	sys 0.027s
I20260709 14:52:03.547514  7848 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 2904) took 1082 ms. Trace:
W20260709 14:52:03.550856  7772 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.663s	user 0.014s	sys 0.025s
I20260709 14:52:03.551445  7851 raft_consensus.cc:1240] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 6. Current term is 7. Ops: []
I20260709 14:52:03.551968  7777 raft_consensus.cc:1240] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 11. Current term is 12. Ops: []
W20260709 14:52:03.553885  7772 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.666s	user 0.015s	sys 0.025s
I20260709 14:52:03.549168  7848 rpcz_store.cc:276] 0709 14:52:02.470166 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:02.534682 (+ 64516us) service_pool.cc:224] Handling call
0709 14:52:02.566109 (+ 31427us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 14:52:02.566594 (+   485us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:52:02.566627 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 14:52:02.574504 (+  7877us) log.cc:844] Serialized 52 byte log entry
0709 14:52:02.899160 (+324656us) raft_consensus.cc:1645] Marking committed up to 3
0709 14:52:02.899222 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:02.899323 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:52:03.546916 (+647593us) raft_consensus.cc:1685] finished
0709 14:52:03.546940 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:03.547390 (+   450us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":755,"raft.run_cpu_time_us":201,"raft.run_wall_time_us":6521,"thread_start_us":244744,"threads_started":1,"wal-append.queue_time_us":685526}
W20260709 14:52:03.535722  7744 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.821s	user 0.010s	sys 0.037s
W20260709 14:52:03.544359  7849 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.866s	user 0.019s	sys 0.057s
I20260709 14:52:03.558593  7849 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 2905) took 1088 ms. Trace:
W20260709 14:52:03.538518 10712 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.822s	user 0.017s	sys 0.020s
I20260709 14:52:03.523442 11125 raft_consensus.cc:515] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
W20260709 14:52:03.552546 11101 consensus_meta.cc:287] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent flushing consensus metadata: real 1.074s	user 0.008s	sys 0.020s
I20260709 14:52:03.526682 11032 raft_consensus.cc:515] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:03.526237 11105 raft_consensus.cc:515] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:03.570508  7892 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.927s	user 0.025s	sys 0.055s
I20260709 14:52:03.563854  7849 rpcz_store.cc:276] 0709 14:52:02.470690 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:02.565648 (+ 94958us) service_pool.cc:224] Handling call
0709 14:52:02.582206 (+ 16558us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:52:02.582487 (+   281us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 14:52:02.675178 (+ 92691us) log.cc:844] Serialized 14 byte log entry
0709 14:52:03.558163 (+882985us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:52:03.558223 (+    60us) raft_consensus.cc:1645] Marking committed up to 5
0709 14:52:03.558282 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:03.558351 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:03.558516 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":92264,"prepare.run_wall_time_us":68,"spinlock_wait_cycles":60016256,"thread_start_us":923184,"threads_started":2}
W20260709 14:52:03.597451  7892 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.957s	user 0.026s	sys 0.055s
W20260709 14:52:03.570168 10712 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.860s	user 0.018s	sys 0.021s
I20260709 14:52:03.603578  8637 raft_consensus.cc:2468] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 4.
I20260709 14:52:03.539038 11129 raft_consensus.cc:515] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:03.597141 11122 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.850s	user 0.017s	sys 0.036s
W20260709 14:52:03.623497 11122 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.890s	user 0.018s	sys 0.036s
I20260709 14:52:03.641535 11129 leader_election.cc:290] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:03.646518 11052 consensus_queue.cc:1048] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 14:52:03.648988 11041 raft_consensus.cc:493] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:03.650123 11041 raft_consensus.cc:515] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:03.654487  7777 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 2650) took 1144 ms. Trace:
I20260709 14:52:03.655084  7777 rpcz_store.cc:276] 0709 14:52:02.510237 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:02.888633 (+378396us) service_pool.cc:224] Handling call
0709 14:52:02.904315 (+ 15682us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:52:03.553337 (+649022us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:03.654171 (+100834us) spinlock_profiling.cc:243] Waited 647 ms on lock 0x7b54003e5654. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae8ee01 00007fb68ae8d83e 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2 00007fb6891c948c 00007fb6891c88c6
0709 14:52:03.654406 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1488924032}
I20260709 14:52:03.656556  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:03.658463 11044 leader_election.cc:290] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 7 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:52:03.661839 11093 consensus_meta.cc:287] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent flushing consensus metadata: real 0.868s	user 0.006s	sys 0.014s
I20260709 14:52:03.662680 11093 raft_consensus.cc:515] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:03.669727 11148 log.cc:927] Time spent T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.958s	user 0.011s	sys 0.013s
I20260709 14:52:03.674616 11140 leader_election.cc:290] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:52:03.623636 11149 log.cc:927] Time spent T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.841s	user 0.003s	sys 0.009s
I20260709 14:52:03.582305 11101 raft_consensus.cc:515] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:03.612517 11127 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.684s	user 0.013s	sys 0.000s
I20260709 14:52:03.683790  7923 raft_consensus.cc:2468] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 8.
I20260709 14:52:03.683822  7773 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37136 (request call id 2233) took 1458 ms. Trace:
I20260709 14:52:03.684799  7773 rpcz_store.cc:276] 0709 14:52:02.225161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:02.225401 (+   240us) service_pool.cc:224] Handling call
0709 14:52:02.225847 (+   446us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:52:02.363562 (+137715us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:52:02.363600 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:52:02.382524 (+ 18924us) log.cc:844] Serialized 26 byte log entry
0709 14:52:02.513883 (+131359us) raft_consensus.cc:1645] Marking committed up to 7
0709 14:52:02.513922 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:02.514010 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:52:03.668548 (+1154538us) spinlock_profiling.cc:243] Waited 2.92 ms on lock 0x7b4400022b4c. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb687c29db1 00007fb687cc7c85 00007fb687cc86a2 00007fb68aa3a1db 00007fb68aa35aaf 00007fb68aa2986e 00007fb68aa28bb6 00007fb68aa287d8 00007fb68aa32221 00007fb68aa321d9 00007fb68aa32169
0709 14:52:03.678729 (+ 10181us) raft_consensus.cc:1685] finished
0709 14:52:03.678758 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:03.683741 (+  4983us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":919,"raft.run_cpu_time_us":208,"raft.run_wall_time_us":13071,"spinlock_wait_cycles":6715776,"thread_start_us":255565,"threads_started":2,"wal-append.queue_time_us":251667}
I20260709 14:52:03.687330  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:03.688047  7773 raft_consensus.cc:2468] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 8.
I20260709 14:52:03.689790  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:03.690624  7773 raft_consensus.cc:2468] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 9.
I20260709 14:52:03.692662  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:03.693783  7773 raft_consensus.cc:2468] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 8.
W20260709 14:52:03.639436 11040 consensus_meta.cc:287] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent flushing consensus metadata: real 1.008s	user 0.014s	sys 0.026s
W20260709 14:52:03.681679 11104 consensus_meta.cc:287] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent flushing consensus metadata: real 0.550s	user 0.019s	sys 0.008s
W20260709 14:52:03.681092 11127 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.762s	user 0.014s	sys 0.000s
I20260709 14:52:03.709975  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:03.710180  7925 raft_consensus.cc:2468] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 8.
I20260709 14:52:03.712185  7777 raft_consensus.cc:3060] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:52:03.683231 11093 leader_election.cc:290] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 11 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:52:03.703641 11107 consensus_meta.cc:287] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent flushing consensus metadata: real 1.295s	user 0.023s	sys 0.009s
W20260709 14:52:03.734714  7743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:52:03.704325 11087 consensus_meta.cc:287] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent flushing consensus metadata: real 0.975s	user 0.018s	sys 0.001s
I20260709 14:52:03.770000  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:03.783756  7773 raft_consensus.cc:2393] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 12: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
W20260709 14:52:03.768483 11020 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.991s	user 0.007s	sys 0.014s
W20260709 14:52:03.785812  8597 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.618s	user 0.000s	sys 0.012s
W20260709 14:52:03.790858 11167 log.cc:927] Time spent T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.166s	user 0.001s	sys 0.001s
W20260709 14:52:03.794494  6554 debug-util.cc:398] Leaking SignalData structure 0x7b080000fe00 after lost signal to thread 7745
W20260709 14:52:03.795471  6554 kernel_stack_watchdog.cc:198] Thread 7745 stuck at /apache/dev/git/kudu/src/kudu/rpc/outbound_call.cc:307 for 119ms:
Kernel stack:
(could not read kernel stack)
User stack:
<Timed out: thread did not respond: maybe it is blocking signals>
I20260709 14:52:03.802629 11105 leader_election.cc:290] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:52:03.851850  7850 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.165s	user 0.021s	sys 0.036s
W20260709 14:52:03.852308  7850 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.166s	user 0.021s	sys 0.036s
W20260709 14:52:03.768007 11110 consensus_meta.cc:287] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent flushing consensus metadata: real 0.983s	user 0.007s	sys 0.014s
I20260709 14:52:03.863991  7777 raft_consensus.cc:2410] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 14:52:03.878868  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:03.768332 10987 leader_election.cc:290] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:03.794348 11130 leader_election.cc:290] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 12 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:52:03.785848 11020 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.048s	user 0.007s	sys 0.015s
I20260709 14:52:03.712814 11104 raft_consensus.cc:515] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:03.899343  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:03.902011  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:03.773136 11087 raft_consensus.cc:515] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:03.903170  7777 raft_consensus.cc:2468] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 6.
I20260709 14:52:03.904047  7773 raft_consensus.cc:2393] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 9: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
W20260709 14:52:03.905896  7745 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.192s	user 0.050s	sys 0.067s
W20260709 14:52:03.912358  7745 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.198s	user 0.051s	sys 0.068s
W20260709 14:52:03.912787  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 1.25318e+06us
I20260709 14:52:03.913589  7745 leader_election.cc:304] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
W20260709 14:52:03.906679  7852 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.031s	sys 0.058s
W20260709 14:52:03.914498  7852 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.553s	user 0.031s	sys 0.058s
W20260709 14:52:03.924839  7853 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.005s	sys 0.023s
W20260709 14:52:03.925297  7853 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.504s	user 0.006s	sys 0.023s
I20260709 14:52:03.932447  7926 raft_consensus.cc:2468] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 6.
I20260709 14:52:03.880362 11110 raft_consensus.cc:515] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:03.954929 11166 raft_consensus.cc:493] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:03.955756 11166 raft_consensus.cc:515] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:03.960893 11166 leader_election.cc:290] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:52:03.908236 10914 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.001s	sys 0.026s
I20260709 14:52:03.915657  7852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 2902) took 1462 ms. Trace:
I20260709 14:52:03.922922 11130 raft_consensus.cc:2804] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader election won for term 10
I20260709 14:52:03.939121  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
W20260709 14:52:03.939849 11124 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.010s	user 0.009s	sys 0.097s
I20260709 14:52:03.940646  7745 leader_election.cc:304] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:03.971786 11119 raft_consensus.cc:3060] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:52:03.941566 11093 raft_consensus.cc:493] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:03.971978  7773 raft_consensus.cc:2393] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 8: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
W20260709 14:52:03.972075 11124 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.045s	user 0.009s	sys 0.098s
I20260709 14:52:03.974028  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:03.974941  7773 raft_consensus.cc:2468] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 11.
I20260709 14:52:03.970613  7852 rpcz_store.cc:276] 0709 14:52:02.453587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:02.524632 (+ 71045us) service_pool.cc:224] Handling call
0709 14:52:02.556899 (+ 32267us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 14:52:02.561281 (+  4382us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:52:02.561317 (+    36us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 14:52:02.570040 (+  8723us) log.cc:844] Serialized 78 byte log entry
0709 14:52:03.324295 (+754255us) raft_consensus.cc:1645] Marking committed up to 6
0709 14:52:03.914918 (+590623us) log.cc:844] Serialized 14 byte log entry
0709 14:52:03.915296 (+   378us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:03.915377 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:52:03.915421 (+    44us) raft_consensus.cc:1685] finished
0709 14:52:03.915432 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:03.915591 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3870,"raft.queue_time_us":4743,"raft.run_cpu_time_us":412,"raft.run_wall_time_us":7003,"thread_start_us":1307330,"threads_started":2,"wal-append.queue_time_us":992627}
I20260709 14:52:03.942492 11041 leader_election.cc:290] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:03.943358  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
W20260709 14:52:03.979219  7818 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.018s	sys 0.038s
W20260709 14:52:03.979674  7818 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.531s	user 0.018s	sys 0.038s
I20260709 14:52:03.987387  7777 raft_consensus.cc:1240] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 8. Current term is 9. Ops: []
I20260709 14:52:03.987617  7773 raft_consensus.cc:1240] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 10. Current term is 11. Ops: []
I20260709 14:52:03.988214  7777 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 2659) took 1347 ms. Trace:
I20260709 14:52:03.988976  7777 rpcz_store.cc:276] 0709 14:52:02.640982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:03.985954 (+1344972us) service_pool.cc:224] Handling call
0709 14:52:03.987205 (+  1251us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:52:03.987889 (+   684us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:03.988139 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 14:52:03.955641 11110 leader_election.cc:290] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 11 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:03.988531  7773 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 2658) took 1351 ms. Trace:
I20260709 14:52:03.991120 10880 raft_consensus.cc:3055] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 14:52:03.992317  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 51842.2us
I20260709 14:52:03.997227  7745 leader_election.cc:304] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:03.994028  7773 rpcz_store.cc:276] 0709 14:52:02.637672 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:03.986403 (+1348731us) service_pool.cc:224] Handling call
0709 14:52:03.987365 (+   962us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:52:03.988200 (+   835us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:03.988459 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 14:52:03.999712  7845 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.578s	user 0.010s	sys 0.024s
W20260709 14:52:04.000195  7845 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.579s	user 0.010s	sys 0.024s
I20260709 14:52:03.968202 11032 leader_election.cc:290] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:03.977597 11099 leader_election.cc:290] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:52:04.011438  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 520633us
I20260709 14:52:04.011823  7745 leader_election.cc:304] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
W20260709 14:52:03.978127 10914 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.574s	user 0.002s	sys 0.026s
W20260709 14:52:04.022101  7891 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.023s	sys 0.016s
W20260709 14:52:04.038552  7891 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.528s	user 0.024s	sys 0.016s
W20260709 14:52:04.040215  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:52:04.041195  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:04.043004  7777 raft_consensus.cc:1240] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 11. Current term is 12. Ops: []
I20260709 14:52:04.044018  7777 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 2660) took 1392 ms. Trace:
I20260709 14:52:03.992144 11087 leader_election.cc:290] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:04.044483  7777 rpcz_store.cc:276] 0709 14:52:02.651949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:03.990097 (+1338148us) service_pool.cc:224] Handling call
0709 14:52:04.042787 (+ 52690us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:52:04.043581 (+   794us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:04.043930 (+   349us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 14:52:04.008234 10987 raft_consensus.cc:2804] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader election won for term 9
W20260709 14:52:04.043273 11022 consensus_meta.cc:287] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent flushing consensus metadata: real 1.157s	user 0.024s	sys 0.009s
I20260709 14:52:04.009475 11170 raft_consensus.cc:493] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:04.039181 11166 raft_consensus.cc:2764] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader election decision vote started in defunct term 9: won
I20260709 14:52:03.995611 11127 raft_consensus.cc:493] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:04.090324 11127 raft_consensus.cc:515] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:03.996441 10880 raft_consensus.cc:740] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:03.972620 11093 raft_consensus.cc:515] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:04.094201  7779 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37136 (request call id 2243) took 1840 ms (client timeout 1929 ms). Trace:
W20260709 14:52:04.094758  7779 rpcz_store.cc:269] 0709 14:52:02.253968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:02.420050 (+166082us) service_pool.cc:224] Handling call
0709 14:52:04.093658 (+1673608us) spinlock_profiling.cc:243] Waited 29.1 ms on lock 0x7b54002b7fd4. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae922fa 00007fb68fe53b17 00007fb6893ce6d4 00007fb6893ce662 00007fb6893ce591 00007fb6893ce50c 00007fb6893cd7c2 00007fb6891c948c 00007fb6891c88c6 00007fb6891c826f
0709 14:52:04.093832 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":66836352}
I20260709 14:52:04.054440  7894 leader_election.cc:304] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:04.097704  7774 raft_consensus.cc:1240] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 7. Current term is 8. Ops: []
I20260709 14:52:04.097860  7894 leader_election.cc:304] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:04.009369 11130 raft_consensus.cc:697] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
W20260709 14:52:04.061987  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:04.065095  7925 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
mode: GRACEFUL
new_leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:48676
I20260709 14:52:04.068277 11170 raft_consensus.cc:515] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:04.071496 11159 consensus_queue.cc:1059] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 14:52:04.073822 11104 leader_election.cc:290] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 10 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:04.042171 11055 consensus_queue.cc:1059] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 14:52:04.080533  7742 leader_election.cc:304] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 9418391fa82a42c79c6cad13ba91d964; no voters: 
I20260709 14:52:04.084455 11124 raft_consensus.cc:2804] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader election won for term 11
I20260709 14:52:04.087230  7770 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 2655) took 1511 ms. Trace:
W20260709 14:52:04.061285 11009 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.501s	user 0.001s	sys 0.021s
I20260709 14:52:04.088454  7772 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 2649) took 1579 ms. Trace:
I20260709 14:52:04.102830  7921 raft_consensus.cc:2468] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 9.
I20260709 14:52:04.106894  7925 raft_consensus.cc:606] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Received request to transfer leadership to TS 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:52:04.133967  7925 raft_consensus.cc:614] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 14:52:04.107833  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:04.087332 11187 raft_consensus.cc:493] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
W20260709 14:52:04.130853  7742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.68:42321, user_credentials={real_user=slave}} blocked reactor thread for 50550.7us
I20260709 14:52:04.130921  7770 rpcz_store.cc:276] 0709 14:52:02.575916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:03.171393 (+595477us) service_pool.cc:224] Handling call
0709 14:52:03.246333 (+ 74940us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:52:03.246763 (+   430us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:52:03.246794 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:52:03.247344 (+   550us) log.cc:844] Serialized 26 byte log entry
0709 14:52:03.682341 (+434997us) raft_consensus.cc:1645] Marking committed up to 6
0709 14:52:03.682387 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:03.682461 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:52:04.086970 (+404509us) raft_consensus.cc:1685] finished
0709 14:52:04.086997 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:04.087146 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1183,"raft.run_cpu_time_us":227,"raft.run_wall_time_us":16432,"thread_start_us":434630,"threads_started":1,"wal-append.queue_time_us":794008}
I20260709 14:52:04.088392 10987 raft_consensus.cc:697] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:52:04.133653  7772 rpcz_store.cc:276] 0709 14:52:02.508869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:02.886362 (+377493us) service_pool.cc:224] Handling call
0709 14:52:02.886928 (+   566us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:52:02.887450 (+   522us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:52:02.887479 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:52:02.888034 (+   555us) log.cc:844] Serialized 26 byte log entry
0709 14:52:03.555295 (+667261us) raft_consensus.cc:1645] Marking committed up to 3
0709 14:52:03.555348 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:03.555429 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:52:04.088085 (+532656us) raft_consensus.cc:1685] finished
0709 14:52:04.088111 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:04.088372 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10116,"raft.run_cpu_time_us":232,"raft.run_wall_time_us":8403,"thread_start_us":666835,"threads_started":1,"wal-append.queue_time_us":1048021}
I20260709 14:52:04.087364 11050 leader_election.cc:290] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:04.108182 11105 raft_consensus.cc:493] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:04.114302 10712 raft_consensus.cc:2804] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 14:52:04.161485  7894 leader_election.cc:304] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
W20260709 14:52:04.167658  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:52:04.168179  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:04.140440 11088 raft_consensus.cc:2804] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 14:52:04.170571 11127 leader_election.cc:290] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:04.140450 10914 raft_consensus.cc:493] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:04.114027 11131 consensus_queue.cc:1048] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 14:52:04.155432 11041 raft_consensus.cc:2804] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 14:52:04.182525 10914 raft_consensus.cc:515] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:04.171329 11022 consensus_queue.cc:1048] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 14:52:04.186363 10987 consensus_queue.cc:237] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:04.157600 11187 raft_consensus.cc:515] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:04.094238 10880 consensus_queue.cc:260] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:04.191788 11187 leader_election.cc:290] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:04.185659 11130 consensus_queue.cc:237] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:04.159577 11124 raft_consensus.cc:697] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:52:04.197623 11124 consensus_queue.cc:237] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:04.200515 11127 raft_consensus.cc:493] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:04.201176 11127 raft_consensus.cc:515] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:04.201429 10712 raft_consensus.cc:697] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:04.202649 10712 consensus_queue.cc:237] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:04.203760 11127 leader_election.cc:290] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:04.204880 10914 leader_election.cc:290] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:04.170898 11105 raft_consensus.cc:515] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:04.191875 10880 raft_consensus.cc:3060] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:52:04.207803 11105 leader_election.cc:290] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:52:04.214177  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 52807.1us
I20260709 14:52:04.170471 11044 raft_consensus.cc:493] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:04.233973 11131 raft_consensus.cc:2804] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 14:52:04.234004  7925 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
mode: GRACEFUL
new_leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:48676
I20260709 14:52:04.239797  7925 raft_consensus.cc:606] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 LEADER]: Received request to transfer leadership to TS 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:52:04.178495 11088 raft_consensus.cc:493] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9418391fa82a42c79c6cad13ba91d964)
W20260709 14:52:04.227528 11133 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.552s	user 0.006s	sys 0.023s
I20260709 14:52:04.227135 10914 raft_consensus.cc:493] T 9441e831627143a991a1556dcdce71e3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9418391fa82a42c79c6cad13ba91d964)
W20260709 14:52:04.252902 11133 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.589s	user 0.006s	sys 0.023s
W20260709 14:52:04.237192 11007 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.789s	user 0.016s	sys 0.020s
I20260709 14:52:04.186226 11170 leader_election.cc:290] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:04.216291 11185 raft_consensus.cc:493] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9418391fa82a42c79c6cad13ba91d964)
I20260709 14:52:04.243999 11105 raft_consensus.cc:493] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:04.270359  7778 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 2637) took 2517 ms. Trace:
W20260709 14:52:04.286648  7919 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38516 (request call id 2259) took 1771 ms (client timeout 1929 ms). Trace:
I20260709 14:52:04.253319 11088 raft_consensus.cc:3060] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Advancing to term 4
W20260709 14:52:04.265133 11007 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.817s	user 0.017s	sys 0.020s
W20260709 14:52:04.295157  7893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:04.290737  7778 rpcz_store.cc:276] 0709 14:52:01.753067 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:01.753306 (+   239us) service_pool.cc:224] Handling call
0709 14:52:01.772708 (+ 19402us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:52:02.370311 (+597603us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:04.269500 (+1899189us) spinlock_profiling.cc:243] Waited 597 ms on lock 0x7b540003aa54. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae8ee01 00007fb68ae8d83e 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2 00007fb6891c948c 00007fb6891c88c6
0709 14:52:04.270252 (+   752us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1372345088}
W20260709 14:52:04.294068  7919 rpcz_store.cc:269] 0709 14:52:02.515573 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:02.515792 (+   219us) service_pool.cc:224] Handling call
0709 14:52:04.286271 (+1770479us) spinlock_profiling.cc:243] Waited 355 ms on lock 0x7b54001324d4. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae922fa 00007fb68fe53b17 00007fb6893ce6d4 00007fb6893ce662 00007fb6893ce591 00007fb6893ce50c 00007fb6893cd7c2 00007fb6891c948c 00007fb6891c88c6 00007fb6891c826f
0709 14:52:04.286521 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":816519040}
W20260709 14:52:04.296957 11173 log.cc:927] Time spent T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 14:52:04.266259 10914 raft_consensus.cc:515] T 9441e831627143a991a1556dcdce71e3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:52:04.293315 10964 raft_consensus.cc:493] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:04.304642  7774 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 2657) took 1702 ms. Trace:
W20260709 14:52:04.257231 11168 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.617s	user 0.025s	sys 0.025s
I20260709 14:52:04.306499  7925 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
mode: GRACEFUL
new_leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:48676
I20260709 14:52:04.319236  7894 leader_election.cc:304] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:04.378010  7925 raft_consensus.cc:606] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 LEADER]: Received request to transfer leadership to TS 1de5e20126fa4d8ca0793d19c7b847ed
W20260709 14:52:04.378578  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 59454.4us
I20260709 14:52:04.251679 11044 raft_consensus.cc:515] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:04.375582  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 353913us
W20260709 14:52:04.489143  7744 leader_election.cc:336] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785): Timed out: RequestConsensusVote RPC to 127.6.101.67:40785 timed out after 1.539s (SENT)
I20260709 14:52:04.374998  7774 rpcz_store.cc:276] 0709 14:52:02.602174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:03.516422 (+914248us) service_pool.cc:224] Handling call
0709 14:52:04.097507 (+581085us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:52:04.109552 (+ 12045us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:04.304337 (+194785us) spinlock_profiling.cc:243] Waited 580 ms on lock 0x7b54002b7fd0. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae8d8ad 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2 00007fb6891c948c 00007fb6891c88c6 00007fb6891c826f
0709 14:52:04.304556 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1335108352}
I20260709 14:52:04.379689  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
W20260709 14:52:04.495527  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 483822us
I20260709 14:52:04.496598  7745 leader_election.cc:304] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:04.294504 11131 raft_consensus.cc:697] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
W20260709 14:52:04.382424 11196 log.cc:927] Time spent T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.067s	user 0.003s	sys 0.000s
W20260709 14:52:04.510578  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 84817.3us
I20260709 14:52:04.511698  7893 leader_election.cc:304] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:52:04.377583 11168 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.741s	user 0.026s	sys 0.025s
W20260709 14:52:04.503192  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 121572us
W20260709 14:52:04.503334  7920 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38516 (request call id 2250) took 2073 ms (client timeout 2215 ms). Trace:
I20260709 14:52:04.489892 11007 raft_consensus.cc:493] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
W20260709 14:52:04.377646 11188 log.cc:927] Time spent T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.062s	user 0.002s	sys 0.000s
I20260709 14:52:04.505141  7745 leader_election.cc:304] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
W20260709 14:52:04.514907  7920 rpcz_store.cc:269] 0709 14:52:02.430202 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:02.433470 (+  3268us) service_pool.cc:224] Handling call
0709 14:52:04.503036 (+2069566us) spinlock_profiling.cc:243] Waited 905 ms on lock 0x7b54003c1ed4. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae922fa 00007fb68fe53b17 00007fb6893ce6d4 00007fb6893ce662 00007fb6893ce591 00007fb6893ce50c 00007fb6893cd7c2 00007fb6891c948c 00007fb6891c88c6 00007fb6891c826f
0709 14:52:04.503251 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2081501056}
I20260709 14:52:04.509867  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:04.383620 10964 raft_consensus.cc:3060] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:52:04.522467  7893 leader_election.cc:304] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:04.522468  7744 leader_election.cc:304] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:52:04.501797 11099 raft_consensus.cc:493] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:04.502667 11017 raft_consensus.cc:493] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:04.508895 10987 raft_consensus.cc:2749] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 14:52:04.501652 10880 raft_consensus.cc:493] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:04.501305 11094 raft_consensus.cc:493] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:52:04.295205 11105 raft_consensus.cc:515] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:04.525542 11173 log.cc:927] Time spent T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 14:52:04.293802 11185 raft_consensus.cc:515] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:52:04.545876  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:04.555039  7744 leader_election.cc:304] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
W20260709 14:52:04.551985  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:04.565393  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:04.574877  7744 leader_election.cc:304] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
W20260709 14:52:04.575223  7894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:52:04.576215  7894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:04.577316  7845 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 2914) took 1158 ms. Trace:
I20260709 14:52:04.577867  7845 rpcz_store.cc:276] 0709 14:52:03.418999 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:03.419161 (+   162us) service_pool.cc:224] Handling call
0709 14:52:03.421091 (+  1930us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:52:03.421361 (+   270us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 14:52:04.000601 (+579240us) log.cc:844] Serialized 14 byte log entry
0709 14:52:04.576756 (+576155us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:52:04.576837 (+    81us) raft_consensus.cc:1645] Marking committed up to 7
0709 14:52:04.576910 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:04.577008 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:04.577201 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":663041,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":33,"thread_start_us":1149760,"threads_started":3,"wal-append.queue_time_us":551758}
I20260709 14:52:04.532706 11159 raft_consensus.cc:2749] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 14:52:04.512071 11189 raft_consensus.cc:2804] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 14:52:04.616616  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:04.546201  7923 raft_consensus.cc:2468] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 8.
I20260709 14:52:04.600430  7774 raft_consensus.cc:1240] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 10. Current term is 11. Ops: []
I20260709 14:52:04.619808  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:04.620981  7774 raft_consensus.cc:2393] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 10: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:52:04.604198  7777 raft_consensus.cc:1240] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 7. Current term is 8. Ops: []
I20260709 14:52:04.550451 11009 raft_consensus.cc:2804] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 14:52:04.622665  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:04.675525  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:04.518136 11186 consensus_queue.cc:1059] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.082s
I20260709 14:52:04.568789 11087 raft_consensus.cc:2804] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 14:52:04.683655  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:04.652431  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258d6c2dda954bf5b65930fde8ecb9f3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
W20260709 14:52:04.625276  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 102889us
I20260709 14:52:04.694167  7893 leader_election.cc:304] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:04.705646  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:04.572875 11166 consensus_queue.cc:1059] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.132s
I20260709 14:52:04.717819  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:04.719861  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
W20260709 14:52:04.722312 11201 log.cc:927] Time spent T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 14:52:04.724536 11185 leader_election.cc:290] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785), 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68:42321)
W20260709 14:52:04.725033  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:52:04.728591 11119 consensus_meta.cc:287] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0: Time spent flushing consensus metadata: real 0.756s	user 0.013s	sys 0.000s
I20260709 14:52:04.730749  7775 raft_consensus.cc:1240] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 9. Current term is 10. Ops: []
I20260709 14:52:04.530941 11007 raft_consensus.cc:515] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:04.718284 11192 log.cc:927] Time spent T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.205s	user 0.000s	sys 0.001s
W20260709 14:52:04.726516  7926 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38516 (request call id 2257) took 2272 ms (client timeout 1795 ms). Trace:
I20260709 14:52:04.725592  7925 raft_consensus.cc:1275] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 14:52:04.565351 11017 raft_consensus.cc:515] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:04.749503  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:04.750568  7772 raft_consensus.cc:2468] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 10.
I20260709 14:52:04.735519  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:04.729350 10987 raft_consensus.cc:493] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:04.624971 11009 raft_consensus.cc:493] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:04.569907 11099 raft_consensus.cc:515] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:04.600660 11165 raft_consensus.cc:2804] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 14:52:04.699980 11087 raft_consensus.cc:493] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting leader election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:52:04.740211  7775 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 2642) took 2262 ms. Trace:
W20260709 14:52:04.737602  7926 rpcz_store.cc:269] 0709 14:52:02.454225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:02.456243 (+  2018us) service_pool.cc:224] Handling call
0709 14:52:04.726266 (+2270023us) spinlock_profiling.cc:243] Waited 1.35 s on lock 0x7b540031f6d4. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae922fa 00007fb68fe53b17 00007fb6893ce6d4 00007fb6893ce662 00007fb6893ce591 00007fb6893ce50c 00007fb6893cd7c2 00007fb6891c948c 00007fb6891c88c6 00007fb6891c826f
0709 14:52:04.726408 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3103150464}
I20260709 14:52:04.764758  7775 rpcz_store.cc:276] 0709 14:52:02.477873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:02.766896 (+289023us) service_pool.cc:224] Handling call
0709 14:52:04.730274 (+1963378us) spinlock_profiling.cc:243] Waited 7.44 ms on lock 0x7b5800002a98. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb687c29db1 00007fb687d69b71 00007fb687d69a22 00007fb690c82c09 00007fb68fddcee0 00007fb68fea60ab 00007fb68fea6131 00007fb68fe67fc0 00007fb68fe52929 00007fb68fe523d2 00007fb6893c9bd4
0709 14:52:04.730549 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:52:04.739684 (+  9135us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:04.740119 (+   435us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":17106816}
I20260709 14:52:04.765623  7774 raft_consensus.cc:3060] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:52:04.573980 11094 raft_consensus.cc:515] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:04.775900  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:04.780136  7851 raft_consensus.cc:2468] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 11.
W20260709 14:52:04.757709 11198 log.cc:927] Time spent T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.158s	user 0.000s	sys 0.001s
W20260709 14:52:04.737000  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 482660us
W20260709 14:52:04.756148  7853 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.026s	sys 0.023s
I20260709 14:52:04.598879 11191 consensus_queue.cc:1059] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.161s
I20260709 14:52:04.625224 11189 raft_consensus.cc:493] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:04.734298  7927 raft_consensus.cc:1240] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 14:52:04.685722 11104 raft_consensus.cc:493] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9418391fa82a42c79c6cad13ba91d964)
I20260709 14:52:04.571231 10880 raft_consensus.cc:515] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:04.741946  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:52:04.753918  8598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 255351us
W20260709 14:52:04.768258  7922 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38516 (request call id 2269) took 2061 ms (client timeout 1621 ms). Trace:
W20260709 14:52:04.784725  7853 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.543s	user 0.026s	sys 0.023s
I20260709 14:52:04.784847  7819 leader_election.cc:304] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:04.763451 11165 raft_consensus.cc:493] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:04.932147 11165 raft_consensus.cc:3060] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:52:04.932763  7853 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 2912) took 1514 ms. Trace:
I20260709 14:52:04.759502 10987 raft_consensus.cc:515] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:04.938479  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:04.943661  7772 raft_consensus.cc:2393] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 12: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:52:04.939021  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:04.933266  7853 rpcz_store.cc:276] 0709 14:52:03.418197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:03.418441 (+   244us) service_pool.cc:224] Handling call
0709 14:52:03.419024 (+   583us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:52:03.419271 (+   247us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 14:52:03.925805 (+506534us) log.cc:844] Serialized 14 byte log entry
0709 14:52:04.932357 (+1006552us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:52:04.932432 (+    75us) raft_consensus.cc:1645] Marking committed up to 3
0709 14:52:04.932484 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:04.932551 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:04.932699 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7427,"prepare.queue_time_us":664881,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":28,"raft.queue_time_us":483106,"raft.run_cpu_time_us":388,"raft.run_wall_time_us":26843,"thread_start_us":1509975,"threads_started":3,"wal-append.queue_time_us":605447}
I20260709 14:52:04.948863  7848 raft_consensus.cc:2393] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 11: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:52:04.949767  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:04.950519  7923 raft_consensus.cc:2468] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 11.
I20260709 14:52:04.950999  7853 raft_consensus.cc:2393] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 13: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:52:04.707096 11204 raft_consensus.cc:2749] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 14:52:04.936336  7922 rpcz_store.cc:269] 0709 14:52:02.706933 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:04.767980 (+2061047us) service_pool.cc:211] Skipping call since client already timed out
0709 14:52:04.768153 (+   173us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 14:52:04.776360 11194 log.cc:927] Time spent T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.221s	user 0.000s	sys 0.001s
I20260709 14:52:04.962778  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:04.964385  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c563cc7cfbe4d59be4ffc5cf847ce56" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
W20260709 14:52:04.796320  6554 debug-util.cc:398] Leaking SignalData structure 0x7b080000fe20 after lost signal to thread 7745
I20260709 14:52:04.934478  7852 raft_consensus.cc:1240] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 9. Current term is 10. Ops: []
I20260709 14:52:04.814421  7666 maintenance_manager.cc:419] P 133636659113430cb53b321cb0b1d9ee: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033391
I20260709 14:52:04.761795 11009 raft_consensus.cc:3060] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:52:04.880234  7846 raft_consensus.cc:1240] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 14:52:04.940804  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:04.967998  7923 raft_consensus.cc:1275] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
W20260709 14:52:04.773690 11048 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.161s	user 0.026s	sys 0.031s
I20260709 14:52:04.780251 11202 raft_consensus.cc:3055] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 LEADER]: Stepping down as leader of term 9
I20260709 14:52:04.955987 11104 raft_consensus.cc:515] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:52:04.970505  7928 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38516 (request call id 2264) took 2268 ms. Trace:
I20260709 14:52:04.769532 11087 raft_consensus.cc:3060] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:52:04.597673 11131 consensus_queue.cc:237] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:04.788228 11199 log.cc:927] Time spent T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.235s	user 0.000s	sys 0.002s
W20260709 14:52:04.980543  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:04.985452  7920 raft_consensus.cc:2468] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 8.
I20260709 14:52:04.986760  7854 raft_consensus.cc:2410] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for term 10 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 14:52:04.987123  7923 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
mode: GRACEFUL
new_leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:48676
I20260709 14:52:05.004025  7923 raft_consensus.cc:606] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 LEADER]: Received request to transfer leadership to TS 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:52:05.003559  7772 raft_consensus.cc:2468] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 9.
I20260709 14:52:05.008877  7774 raft_consensus.cc:2468] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 7.
I20260709 14:52:05.011057 10914 leader_election.cc:290] T 9441e831627143a991a1556dcdce71e3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68:42321)
I20260709 14:52:04.875362 11189 raft_consensus.cc:3060] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Advancing to term 10
W20260709 14:52:04.987159 11048 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.379s	user 0.031s	sys 0.034s
W20260709 14:52:05.029866  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:05.027223  7846 raft_consensus.cc:1275] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 14:52:04.993872  7928 rpcz_store.cc:276] 0709 14:52:02.688537 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:02.689724 (+  1187us) service_pool.cc:224] Handling call
0709 14:52:02.707943 (+ 18219us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:52:02.708381 (+   438us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:52:02.708409 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:52:02.721580 (+ 13171us) log.cc:844] Serialized 26 byte log entry
0709 14:52:03.643478 (+921898us) spinlock_profiling.cc:243] Waited 2.99 ms on lock 0x7b18004108c0. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb690c69de1 00007fb690c765b1 00007fb687d83e07 00007fb690bdeab9 00007fb687da069b 00007fb687d9e93f 00007fb687da0c02 00007fb68aa2820b 00007fb68aa2dd23 00007fb68aa2e0d1 00007fb68ae49a0f
0709 14:52:04.135469 (+491991us) raft_consensus.cc:1645] Marking committed up to 7
0709 14:52:04.136024 (+   555us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:04.136650 (+   626us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:52:04.936659 (+800009us) raft_consensus.cc:1685] finished
0709 14:52:04.936686 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:04.956383 (+ 19697us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1505,"raft.run_cpu_time_us":358,"raft.run_wall_time_us":13434,"spinlock_wait_cycles":6871424,"thread_start_us":484901,"threads_started":1,"wal-append.queue_time_us":1542321}
I20260709 14:52:05.035035  7852 raft_consensus.cc:1275] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 14:52:05.037813  8637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1f7722fdea49e0b5e9c5d96633eaf9" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9418391fa82a42c79c6cad13ba91d964" is_pre_election: true
I20260709 14:52:04.993209 11159 raft_consensus.cc:2749] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 14:52:04.987365 11202 raft_consensus.cc:740] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:52:05.002055 11044 leader_election.cc:290] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:05.018802 11217 raft_consensus.cc:493] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:05.076062 11007 leader_election.cc:290] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:05.076386 11130 raft_consensus.cc:2804] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 14:52:05.040367 11210 raft_consensus.cc:493] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:52:05.080731  7894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:05.088810 11217 raft_consensus.cc:515] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:05.072593 10914 raft_consensus.cc:493] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:05.230754  7923 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
mode: GRACEFUL
new_leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:48676
W20260709 14:52:05.231200  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:05.240959  7923 raft_consensus.cc:606] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Received request to transfer leadership to TS 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:52:05.241868  7923 raft_consensus.cc:614] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 14:52:05.082450 11208 raft_consensus.cc:493] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:52:05.215415 11105 leader_election.cc:290] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:05.227569 11015 raft_consensus.cc:493] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:05.253440 10914 raft_consensus.cc:515] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:05.286139  7773 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37136 (request call id 2263) took 1425 ms. Trace:
I20260709 14:52:05.295897 11202 consensus_queue.cc:260] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:05.309975  7773 rpcz_store.cc:276] 0709 14:52:03.860629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:03.998745 (+138116us) service_pool.cc:224] Handling call
0709 14:52:04.048879 (+ 50134us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:52:04.532061 (+483182us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:52:04.532100 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:52:04.550537 (+ 18437us) log.cc:844] Serialized 26 byte log entry
0709 14:52:05.076065 (+525528us) raft_consensus.cc:1645] Marking committed up to 6
0709 14:52:05.076122 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:05.076783 (+   661us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:52:05.285797 (+209014us) raft_consensus.cc:1685] finished
0709 14:52:05.285835 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:05.286046 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2761,"raft.queue_time_us":25546,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":142,"thread_start_us":917116,"threads_started":2,"wal-append.queue_time_us":707383}
W20260709 14:52:05.314400 11088 consensus_meta.cc:287] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent flushing consensus metadata: real 1.000s	user 0.015s	sys 0.000s
I20260709 14:52:05.324805  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:05.325749  7773 raft_consensus.cc:3060] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:52:05.313164 11207 raft_consensus.cc:2804] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 14:52:05.332330  8637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9441e831627143a991a1556dcdce71e3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9418391fa82a42c79c6cad13ba91d964" is_pre_election: true
I20260709 14:52:05.313627 11105 raft_consensus.cc:493] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:05.319593 11017 leader_election.cc:290] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:05.322382 11094 leader_election.cc:290] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:05.316697 11015 raft_consensus.cc:515] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:05.331498 11202 raft_consensus.cc:3060] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:52:05.218442 11210 raft_consensus.cc:515] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:05.352706 11099 leader_election.cc:290] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:05.336444 11207 raft_consensus.cc:493] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:05.367872  7773 raft_consensus.cc:2468] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 11.
I20260709 14:52:05.246739 11208 raft_consensus.cc:515] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:05.372577  7893 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.614s	user 0.001s	sys 0.005s
W20260709 14:52:05.373206  7893 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.615s	user 0.002s	sys 0.005s
W20260709 14:52:05.374361  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 680258us
I20260709 14:52:05.376304  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:05.331086 11088 raft_consensus.cc:515] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:52:05.377882  7893 leader_election.cc:304] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:52:05.370352 10964 consensus_meta.cc:287] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent flushing consensus metadata: real 0.815s	user 0.009s	sys 0.005s
I20260709 14:52:05.357976 10987 leader_election.cc:290] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:05.362774 10880 leader_election.cc:290] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:05.345459 11105 raft_consensus.cc:515] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:05.394882  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:05.372115 11207 raft_consensus.cc:3060] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:52:05.424216  7850 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 2910) took 2918 ms. Trace:
I20260709 14:52:05.410764 11094 raft_consensus.cc:2749] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 14:52:05.424768  7850 rpcz_store.cc:276] 0709 14:52:02.500272 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:02.682841 (+182569us) service_pool.cc:224] Handling call
0709 14:52:02.683183 (+   342us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:52:02.685965 (+  2782us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 14:52:03.858819 (+1172854us) log.cc:844] Serialized 14 byte log entry
0709 14:52:04.172094 (+313275us) log.cc:844] Serialized 14 byte log entry
0709 14:52:05.370675 (+1198581us) spinlock_profiling.cc:243] Waited 14 ms on lock 0x7b18000bd7c0. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb690c69de1 00007fb690c765b1 00007fb687d1bc0a 00007fb69145b219 00007fb687da3a40 00007fb687d9e4e4 00007fb687d9e455 00007fb68e8863c7 00007fb68ae989a7 00007fb68aea80bf 00007fb68aea8038
0709 14:52:05.370965 (+   290us) log.cc:844] Serialized 14 byte log entry
0709 14:52:05.393504 (+ 22539us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:52:05.393577 (+    73us) raft_consensus.cc:1645] Marking committed up to 7
0709 14:52:05.393645 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:05.393726 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:05.418601 (+ 24875us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1260549,"prepare.queue_time_us":2596099,"prepare.run_cpu_time_us":148,"prepare.run_wall_time_us":152,"raft.queue_time_us":51884,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":28728,"spinlock_wait_cycles":38848768,"thread_start_us":1454717,"threads_started":2,"wal-append.queue_time_us":410704}
I20260709 14:52:05.430913 11185 raft_consensus.cc:493] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
W20260709 14:52:05.436774 11222 log.cc:927] Time spent T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 14:52:05.437332 11185 raft_consensus.cc:515] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:05.434340  7773 raft_consensus.cc:1240] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 9. Current term is 10. Ops: []
I20260709 14:52:05.394201 11110 raft_consensus.cc:493] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:05.417303 11209 raft_consensus.cc:493] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:05.455947  7773 raft_consensus.cc:1240] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 10. Current term is 11. Ops: []
I20260709 14:52:05.389935 10964 raft_consensus.cc:515] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:05.462116  7924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38532 (request call id 2983) took 1082 ms. Trace:
I20260709 14:52:05.403461 11104 leader_election.cc:290] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68:42321)
I20260709 14:52:05.391758 11191 consensus_queue.cc:1048] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.071s
I20260709 14:52:05.474565  7924 rpcz_store.cc:276] 0709 14:52:04.379842 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:04.380376 (+   534us) service_pool.cc:224] Handling call
0709 14:52:04.510774 (+130398us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 14:52:04.519632 (+  8858us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:52:04.519676 (+    44us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 14:52:04.537969 (+ 18293us) log.cc:844] Serialized 52 byte log entry
0709 14:52:04.991064 (+453095us) raft_consensus.cc:1645] Marking committed up to 5
0709 14:52:04.991118 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:04.991210 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:52:05.461767 (+470557us) raft_consensus.cc:1685] finished
0709 14:52:05.461796 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:05.462007 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":66927,"raft.queue_time_us":9194,"raft.run_cpu_time_us":183,"raft.run_wall_time_us":22562,"thread_start_us":366048,"threads_started":1,"wal-append.queue_time_us":758667}
I20260709 14:52:05.486337  7773 raft_consensus.cc:1240] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 LEADER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 8. Current term is 9. Ops: []
I20260709 14:52:05.482993 10914 leader_election.cc:290] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:05.498907  7854 raft_consensus.cc:1240] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 5. Current term is 6. Ops: []
I20260709 14:52:05.500362  7771 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 2653) took 2952 ms. Trace:
I20260709 14:52:05.383488 11099 consensus_queue.cc:1048] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.077s
I20260709 14:52:05.502060  7771 rpcz_store.cc:276] 0709 14:52:02.548249 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:02.905304 (+357055us) service_pool.cc:224] Handling call
0709 14:52:02.922046 (+ 16742us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:52:02.922531 (+   485us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:52:02.922565 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:52:04.308100 (+1385535us) spinlock_profiling.cc:243] Waited 2.51 ms on lock 0x7b18003b5660. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb690c69de1 00007fb690c765b1 00007fb687d6f2a6 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb689787a11 00007fb689797372 00007fb68aec9a01 00007fb68ae8e43a
0709 14:52:04.309711 (+  1611us) spinlock_profiling.cc:243] Waited 3.41 ms on lock 0x7b2c000014c8. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb689787a11 00007fb689797372 00007fb68aec9a01 00007fb68ae8e43a 00007fb68ae8d83e 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2
0709 14:52:04.310792 (+  1081us) log.cc:844] Serialized 26 byte log entry
0709 14:52:04.746651 (+435859us) raft_consensus.cc:1645] Marking committed up to 3
0709 14:52:04.746704 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:04.746784 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:52:05.499924 (+753140us) raft_consensus.cc:1685] finished
0709 14:52:05.499946 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:05.500269 (+   323us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3407,"raft.run_cpu_time_us":247,"raft.run_wall_time_us":135363,"spinlock_wait_cycles":13606528,"thread_start_us":425685,"threads_started":1,"wal-append.queue_time_us":1060507}
W20260709 14:52:05.514675  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 85472.2us
I20260709 14:52:05.516362  7773 raft_consensus.cc:1240] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 8. Current term is 9. Ops: []
I20260709 14:52:05.485572 11110 raft_consensus.cc:515] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:05.474798 11209 raft_consensus.cc:515] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:05.558107  7771 raft_consensus.cc:1240] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 10. Current term is 11. Ops: []
I20260709 14:52:05.548588  7893 leader_election.cc:304] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:05.561079  7773 raft_consensus.cc:1240] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 LEADER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 9. Current term is 10. Ops: []
I20260709 14:52:05.533928 11015 leader_election.cc:290] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:52:05.570303  7893 connection.cc:256] RPC call timeout handler was delayed by -1.146293820999972s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2158s for a response
I20260709 14:52:05.538390 11105 leader_election.cc:290] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:05.525652 11094 consensus_queue.cc:1059] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 14:52:05.574559  7773 raft_consensus.cc:1275] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 14:52:05.548458 11088 leader_election.cc:290] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68:42321)
I20260709 14:52:05.578672  7771 raft_consensus.cc:1275] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 14:52:05.560724 11185 leader_election.cc:290] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:52:05.590621 11087 consensus_meta.cc:287] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent flushing consensus metadata: real 0.560s	user 0.011s	sys 0.002s
W20260709 14:52:05.591289 11165 consensus_meta.cc:287] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent flushing consensus metadata: real 0.659s	user 0.013s	sys 0.000s
I20260709 14:52:05.600252 11165 raft_consensus.cc:515] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:05.533941 11017 consensus_queue.cc:1059] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 14:52:05.563453 11119 raft_consensus.cc:2749] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 14:52:05.579806  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18d29d52d304c87b930d4fb5eaf50b1" candidate_uuid: "9418391fa82a42c79c6cad13ba91d964" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:52:05.568714 11189 consensus_meta.cc:287] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent flushing consensus metadata: real 0.526s	user 0.013s	sys 0.003s
I20260709 14:52:05.533407 11232 consensus_queue.cc:1059] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 14:52:05.555598 10880 consensus_queue.cc:1059] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 14:52:05.577734 11208 leader_election.cc:290] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:05.566282 11210 leader_election.cc:290] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:05.537148 11223 consensus_queue.cc:1059] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 4, Time since last communication: 0.069s
I20260709 14:52:05.593056 11125 leader_election.cc:290] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:52:05.611505  7819 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.638s	user 0.018s	sys 0.011s
W20260709 14:52:05.605298 11206 log.cc:927] Time spent T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.834s	user 0.006s	sys 0.006s
I20260709 14:52:05.574435 11104 raft_consensus.cc:493] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9418391fa82a42c79c6cad13ba91d964)
I20260709 14:52:05.646313 11104 raft_consensus.cc:515] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:52:05.564098 11191 consensus_queue.cc:1059] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 14:52:05.649955 11191 raft_consensus.cc:3055] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 14:52:05.650450 11191 raft_consensus.cc:740] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:05.651620 11022 raft_consensus.cc:3055] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 14:52:05.651437 11191 consensus_queue.cc:260] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:05.652207 11022 raft_consensus.cc:740] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:05.653036 11223 raft_consensus.cc:3055] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 14:52:05.653537 11223 raft_consensus.cc:740] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
W20260709 14:52:05.644136  7819 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.671s	user 0.018s	sys 0.011s
W20260709 14:52:05.655263  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 870484us
I20260709 14:52:05.655957  7819 leader_election.cc:304] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:05.627466  7845 raft_consensus.cc:2468] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9418391fa82a42c79c6cad13ba91d964 in term 4.
I20260709 14:52:05.557518 11048 consensus_queue.cc:1059] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 14:52:05.631214  7773 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47054 (request call id 198) took 1021 ms. Trace:
I20260709 14:52:05.634770 11100 raft_consensus.cc:3055] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 14:52:05.638289 11219 log.cc:927] Time spent T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.158s	user 0.003s	sys 0.001s
I20260709 14:52:05.634559 11189 raft_consensus.cc:515] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:05.640508 11119 raft_consensus.cc:3055] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 14:52:05.631938 11009 consensus_meta.cc:287] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent flushing consensus metadata: real 0.632s	user 0.010s	sys 0.007s
W20260709 14:52:05.650485  7920 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38532 (request call id 2985) took 1270 ms (client timeout 1673 ms). Trace:
W20260709 14:52:05.657826  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 82684.7us
I20260709 14:52:05.658581  7773 rpcz_store.cc:276] 0709 14:52:04.609957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:05.596967 (+987010us) service_pool.cc:224] Handling call
0709 14:52:05.630622 (+ 33655us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:52:05.630833 (+   211us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:52:05.630859 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:52:05.630903 (+    44us) raft_consensus.cc:1645] Marking committed up to 6
0709 14:52:05.630935 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:05.631001 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:05.631138 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 14:52:05.689790  7920 rpcz_store.cc:269] 0709 14:52:04.380492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:04.526926 (+146434us) service_pool.cc:224] Handling call
0709 14:52:05.650168 (+1123242us) spinlock_profiling.cc:243] Waited 410 ms on lock 0x7b54003124d4. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae922fa 00007fb68fe53b17 00007fb6893ce6d4 00007fb6893ce662 00007fb6893ce591 00007fb6893ce50c 00007fb6893cd7c2 00007fb6891c948c 00007fb6891c88c6 00007fb6891c826f
0709 14:52:05.650380 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":943499008}
I20260709 14:52:05.695519  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:05.697434  7928 raft_consensus.cc:2468] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 11.
I20260709 14:52:05.664722  8599 leader_election.cc:304] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac, 9418391fa82a42c79c6cad13ba91d964; no voters: 
I20260709 14:52:05.699163  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:05.696002  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:05.659842  7819 leader_election.cc:304] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
W20260709 14:52:05.660956 11211 log.cc:927] Time spent T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.361s	user 0.005s	sys 0.000s
I20260709 14:52:05.644146 11203 raft_consensus.cc:493] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:05.622802 11087 raft_consensus.cc:515] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:05.674515 11191 raft_consensus.cc:3060] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 14:52:05.672350 11119 raft_consensus.cc:740] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:05.680378 11189 leader_election.cc:290] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:05.681141 11104 leader_election.cc:290] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785), 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68:42321)
I20260709 14:52:05.683996 11223 consensus_queue.cc:260] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:05.665494 11208 raft_consensus.cc:2804] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 14:52:05.658957 11165 leader_election.cc:290] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:52:05.689671  7921 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38532 (request call id 2969) took 2992 ms (client timeout 2107 ms). Trace:
I20260709 14:52:05.702487  7819 leader_election.cc:304] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:05.707346  8637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9441e831627143a991a1556dcdce71e3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9418391fa82a42c79c6cad13ba91d964" is_pre_election: true
I20260709 14:52:05.661715 11100 raft_consensus.cc:740] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:05.663074 10964 leader_election.cc:290] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 6 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:05.661814 11022 consensus_queue.cc:260] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:05.689775 11009 raft_consensus.cc:515] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:05.893965  7776 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37144 (request call id 2644) took 3387 ms (client timeout 2158 ms). Trace:
I20260709 14:52:05.707993 11050 raft_consensus.cc:2804] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 14:52:05.918314  7776 rpcz_store.cc:269] 0709 14:52:02.507370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:02.554304 (+ 46934us) service_pool.cc:224] Handling call
0709 14:52:05.893445 (+3339141us) spinlock_profiling.cc:243] Waited 1.6 s on lock 0x7b5400115154. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae922fa 00007fb68fe53b17 00007fb6893ce6d4 00007fb6893ce662 00007fb6893ce591 00007fb6893ce50c 00007fb6893cd7c2 00007fb6891c948c 00007fb6891c88c6 00007fb6891c826f
0709 14:52:05.893714 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3685374336}
I20260709 14:52:05.891817  7676 catalog_manager.cc:5697] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 9 to 10, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 10 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:52:05.707616 11179 raft_consensus.cc:2804] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 14:52:05.883495  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:05.679682 11209 leader_election.cc:290] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:52:05.921708  7742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:52:05.841388 11250 log.cc:927] Time spent T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
W20260709 14:52:05.918453  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 216022us
I20260709 14:52:05.900239 11207 raft_consensus.cc:515] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:05.892593 11168 raft_consensus.cc:3055] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 14:52:05.872184 11189 raft_consensus.cc:493] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:05.939710  7778 raft_consensus.cc:1240] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 5. Current term is 6. Ops: []
I20260709 14:52:05.844424 11130 raft_consensus.cc:493] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Starting leader election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:52:05.940610  7819 leader_election.cc:304] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
W20260709 14:52:05.806982 11245 log.cc:927] Time spent T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.144s	user 0.000s	sys 0.001s
I20260709 14:52:05.806924 11101 leader_election.cc:290] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:05.942570 11100 consensus_queue.cc:260] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:05.898511 11093 leader_election.cc:290] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:05.908104  7923 raft_consensus.cc:1240] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 LEADER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 6. Current term is 7. Ops: []
I20260709 14:52:05.938407 11050 raft_consensus.cc:493] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Starting leader election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:52:05.912952 11191 raft_consensus.cc:493] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:05.805151  8639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18d29d52d304c87b930d4fb5eaf50b1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9418391fa82a42c79c6cad13ba91d964"
I20260709 14:52:05.918876 11208 raft_consensus.cc:493] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 14:52:05.918727  7921 rpcz_store.cc:269] 0709 14:52:02.696971 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:02.854741 (+157770us) service_pool.cc:224] Handling call
0709 14:52:05.689403 (+2834662us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b5400018e54. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae922fa 00007fb68fe53b17 00007fb6893ce6d4 00007fb6893ce662 00007fb6893ce591 00007fb6893ce50c 00007fb6893cd7c2 00007fb6891c948c 00007fb6891c88c6 00007fb6891c826f
0709 14:52:05.689579 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2815278848}
I20260709 14:52:05.929562 11179 raft_consensus.cc:493] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:05.884872  8640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce9c0ef2db24c13a8b1402f21819458" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9418391fa82a42c79c6cad13ba91d964" is_pre_election: true
I20260709 14:52:05.949702 11130 raft_consensus.cc:3060] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:52:05.944664 11022 raft_consensus.cc:3060] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:52:05.955530  7819 leader_election.cc:304] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:52:05.720459 11203 raft_consensus.cc:515] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:05.945034 11168 raft_consensus.cc:740] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:05.948211 11223 raft_consensus.cc:3060] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:52:05.920181 11210 raft_consensus.cc:2804] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 14:52:05.952935 11209 raft_consensus.cc:2804] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 14:52:05.837987 11119 consensus_queue.cc:260] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:05.967252  7819 leader_election.cc:304] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:05.955320 10964 consensus_queue.cc:1048] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 14:52:05.974198 11093 raft_consensus.cc:2804] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 14:52:05.957734 11050 raft_consensus.cc:3060] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Advancing to term 8
I20260709 14:52:06.037569 11093 raft_consensus.cc:493] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:06.038123 11093 raft_consensus.cc:3060] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Advancing to term 8
W20260709 14:52:06.038375  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 71188.8us
I20260709 14:52:06.038967 10964 raft_consensus.cc:2749] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 14:52:06.039367  7819 leader_election.cc:304] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:05.960927 11208 raft_consensus.cc:3060] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:52:05.960440 11100 raft_consensus.cc:3060] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:52:05.959153 11105 consensus_queue.cc:1048] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 14:52:05.962390 11191 raft_consensus.cc:515] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:05.960759 11179 raft_consensus.cc:3060] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:52:05.950726 11189 raft_consensus.cc:515] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:05.976370 11210 raft_consensus.cc:493] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:05.977494 11209 raft_consensus.cc:493] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:06.007932 11168 consensus_queue.cc:260] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:06.081517  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:06.082219  7924 raft_consensus.cc:3060] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:52:06.003364 11087 leader_election.cc:290] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:52:06.030092 11255 log.cc:927] Time spent T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.055s	user 0.002s	sys 0.000s
I20260709 14:52:06.043457 11044 raft_consensus.cc:2749] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 14:52:06.041934  7819 leader_election.cc:304] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:52:06.055727  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:06.059314  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258d6c2dda954bf5b65930fde8ecb9f3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:06.060325  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:06.061285  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c563cc7cfbe4d59be4ffc5cf847ce56" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:06.063161  7778 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 2663) took 1462 ms. Trace:
I20260709 14:52:06.093817  7778 rpcz_store.cc:276] 0709 14:52:04.601034 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:04.601166 (+   132us) service_pool.cc:224] Handling call
0709 14:52:04.678420 (+ 77254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:52:05.947708 (+1269288us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:06.062796 (+115088us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b540014f0d4. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae8ee01 00007fb68ae8d83e 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2 00007fb6891c948c 00007fb6891c88c6
0709 14:52:06.063062 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2900249344}
I20260709 14:52:06.096572  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:52:06.097045  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 55220.2us
I20260709 14:52:06.044306 11207 leader_election.cc:290] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 9 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:06.077196 11189 leader_election.cc:290] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:06.085904  7851 raft_consensus.cc:1240] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 14:52:06.078157  7848 raft_consensus.cc:1240] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 8. Current term is 9. Ops: []
I20260709 14:52:06.051110 11210 raft_consensus.cc:3060] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Advancing to term 7
W20260709 14:52:06.052838 11214 log.cc:927] Time spent T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.741s	user 0.000s	sys 0.005s
I20260709 14:52:06.090632  7924 raft_consensus.cc:2410] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 14:52:06.071077 11050 raft_consensus.cc:515] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:06.071709  7926 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38532 (request call id 2993) took 1648 ms. Trace:
I20260709 14:52:06.117847  7926 rpcz_store.cc:276] 0709 14:52:04.423615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:04.764019 (+340404us) service_pool.cc:224] Handling call
0709 14:52:04.764379 (+   360us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:52:04.944338 (+179959us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:52:04.944383 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:52:04.944803 (+   420us) raft_consensus.cc:1645] Marking committed up to 8
0709 14:52:04.945060 (+   257us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:06.071354 (+1126294us) spinlock_profiling.cc:243] Waited 180 ms on lock 0x7b5400132ed4. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae8ee01 00007fb68ae8d83e 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2 00007fb6891c948c 00007fb6891c88c6
0709 14:52:06.071420 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:06.071618 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":413088640}
I20260709 14:52:06.117787  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:06.119022  7845 raft_consensus.cc:1240] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 14:52:06.098891  7819 leader_election.cc:304] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:06.075299 11093 raft_consensus.cc:515] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:06.097652  7847 raft_consensus.cc:2468] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 11.
I20260709 14:52:06.102412  7853 raft_consensus.cc:1240] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 14:52:06.117787 11100 raft_consensus.cc:493] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:06.048966 11119 raft_consensus.cc:3060] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:52:06.111927  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:06.085784 11209 raft_consensus.cc:3060] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:52:06.111022 11217 leader_election.cc:290] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:06.121666  7852 raft_consensus.cc:2468] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 10.
I20260709 14:52:06.118743  7894 leader_election.cc:304] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:06.122844  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:06.150768  7848 raft_consensus.cc:2410] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 14:52:06.120225  7923 raft_consensus.cc:1275] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 14:52:06.129210  7850 raft_consensus.cc:1275] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 14:52:06.081017 11168 raft_consensus.cc:3060] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:52:06.105537 10964 raft_consensus.cc:2804] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 14:52:06.136334  7819 leader_election.cc:304] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:06.138383  7851 raft_consensus.cc:2468] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 11.
I20260709 14:52:06.132781 11009 leader_election.cc:290] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:06.159426  7819 leader_election.cc:304] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:06.141304 11105 raft_consensus.cc:2749] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 14:52:06.165086  7819 leader_election.cc:304] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
W20260709 14:52:06.131915 11252 log.cc:927] Time spent T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.152s	user 0.001s	sys 0.001s
I20260709 14:52:06.145069  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:06.174451  7845 raft_consensus.cc:3060] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:52:06.161441 11017 raft_consensus.cc:2804] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 14:52:06.190061  7819 leader_election.cc:304] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:52:06.157045 10964 raft_consensus.cc:493] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:06.191222  7770 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 2665) took 1589 ms. Trace:
I20260709 14:52:06.167451 11044 raft_consensus.cc:2749] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 14:52:06.142581 11100 raft_consensus.cc:515] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:06.161901 11203 leader_election.cc:290] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:06.192687 11093 leader_election.cc:290] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 8 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:06.207495  7770 rpcz_store.cc:276] 0709 14:52:04.601894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:04.602008 (+   114us) service_pool.cc:224] Handling call
0709 14:52:04.682860 (+ 80852us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:52:04.713816 (+ 30956us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:52:04.713855 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:52:05.808400 (+1094545us) spinlock_profiling.cc:243] Waited 28.5 ms on lock 0x7b2c000014c8. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb689787a11 00007fb689797372 00007fb68aec9a01 00007fb68ae8e43a 00007fb68ae8d83e 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2
0709 14:52:05.839276 (+ 30876us) log.cc:844] Serialized 26 byte log entry
0709 14:52:05.951367 (+112091us) raft_consensus.cc:1645] Marking committed up to 5
0709 14:52:05.951390 (+    23us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:05.951489 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:52:06.172915 (+221426us) raft_consensus.cc:1685] finished
0709 14:52:06.172964 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:06.191117 (+ 18153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24467,"raft.queue_time_us":53388,"raft.run_cpu_time_us":259,"raft.run_wall_time_us":9428,"spinlock_wait_cycles":65529600,"thread_start_us":69513,"threads_started":1,"wal-append.queue_time_us":99602}
I20260709 14:52:06.166057 11217 raft_consensus.cc:2749] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 14:52:06.221993 11191 leader_election.cc:290] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:06.210024 10964 raft_consensus.cc:3060] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:52:06.195802 11189 consensus_queue.cc:1048] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.037s
W20260709 14:52:06.228120  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:52:06.230710  7893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:06.232702  7845 raft_consensus.cc:2468] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 10.
I20260709 14:52:06.234441 11134 raft_consensus.cc:3055] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 14:52:06.235015 11134 raft_consensus.cc:740] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:06.235991 11134 consensus_queue.cc:260] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:06.238656  6549 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 14:52:06.241920 11041 raft_consensus.cc:493] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:52:06.242895 11041 raft_consensus.cc:3060] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Advancing to term 8
W20260709 14:52:06.229153  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:06.195145 11207 raft_consensus.cc:2749] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 14:52:06.196893 11017 raft_consensus.cc:493] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:06.177101 11159 consensus_queue.cc:1048] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 14:52:06.225611 11020 raft_consensus.cc:3055] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 14:52:06.273001  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 204003us
I20260709 14:52:06.253159 11203 raft_consensus.cc:493] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:06.265980 11093 raft_consensus.cc:2764] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 14:52:06.272964 11191 raft_consensus.cc:493] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:06.294572  7771 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37136 (request call id 2265) took 1684 ms. Trace:
I20260709 14:52:06.273813 11238 raft_consensus.cc:493] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:06.297145  7771 rpcz_store.cc:276] 0709 14:52:04.610289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:05.598675 (+988386us) service_pool.cc:224] Handling call
0709 14:52:05.616433 (+ 17758us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:52:05.617129 (+   696us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:52:05.617163 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:52:05.618523 (+  1360us) log.cc:844] Serialized 26 byte log entry
0709 14:52:05.706181 (+ 87658us) raft_consensus.cc:1645] Marking committed up to 5
0709 14:52:05.706219 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:05.706566 (+   347us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:52:06.294289 (+587723us) raft_consensus.cc:1685] finished
0709 14:52:06.294310 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:06.294496 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2888,"raft.run_cpu_time_us":190,"raft.run_wall_time_us":192,"thread_start_us":86972,"threads_started":1,"wal-append.queue_time_us":335527}
I20260709 14:52:06.271873 11017 raft_consensus.cc:3060] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:52:06.275307 11020 raft_consensus.cc:740] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:06.318722 11020 consensus_queue.cc:260] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:06.320201 11020 raft_consensus.cc:3060] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:52:06.285897 11134 raft_consensus.cc:3060] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Advancing to term 7
W20260709 14:52:06.331365  7742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:06.289991 11050 leader_election.cc:290] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 8 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:06.359906 11130 raft_consensus.cc:515] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:06.298055 11203 raft_consensus.cc:515] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:06.392774 11110 leader_election.cc:290] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:52:06.356578 11258 log.cc:927] Time spent T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.095s	user 0.000s	sys 0.001s
I20260709 14:52:06.356505 10964 raft_consensus.cc:515] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:06.308161 11238 raft_consensus.cc:515] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:06.303580 11191 raft_consensus.cc:515] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:06.427474 11203 leader_election.cc:290] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:52:06.437786  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:52:06.438298  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:06.437005  7854 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 2934) took 1653 ms. Trace:
W20260709 14:52:06.439307  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:06.439106  7854 rpcz_store.cc:276] 0709 14:52:04.783313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:05.011332 (+228019us) service_pool.cc:224] Handling call
0709 14:52:05.011791 (+   459us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:52:05.505717 (+493926us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:06.436726 (+931009us) spinlock_profiling.cc:243] Waited 487 ms on lock 0x7b540034ec54. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae8ee01 00007fb68ae8d83e 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2 00007fb6891c948c 00007fb6891c88c6
0709 14:52:06.436932 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1119836032}
W20260709 14:52:06.450740  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 262077us
I20260709 14:52:06.451954  7819 leader_election.cc:304] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:06.474205  7819 leader_election.cc:304] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:06.440141 11228 raft_consensus.cc:493] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:06.424969 11130 leader_election.cc:290] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 10 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:52:06.478701  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 312921us
I20260709 14:52:06.458734 11041 raft_consensus.cc:515] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:06.453140 11040 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.811s	user 0.025s	sys 0.069s
I20260709 14:52:06.499409  7819 leader_election.cc:304] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:06.480324 11110 raft_consensus.cc:3060] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:52:06.475587 11100 leader_election.cc:290] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:52:06.501317 11040 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.877s	user 0.026s	sys 0.073s
I20260709 14:52:06.508808  7819 leader_election.cc:304] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:06.502923 11022 raft_consensus.cc:3055] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 14:52:06.514886 11022 raft_consensus.cc:740] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:06.511382 11217 raft_consensus.cc:3060] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Advancing to term 9
W20260709 14:52:06.508594  7774 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37136 (request call id 2268) took 1897 ms (client timeout 1563 ms). Trace:
I20260709 14:52:06.496973 11050 raft_consensus.cc:2749] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 14:52:06.517951  7819 leader_election.cc:304] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed
W20260709 14:52:06.518565  7774 rpcz_store.cc:269] 0709 14:52:04.611231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:04.651986 (+ 40755us) service_pool.cc:224] Handling call
0709 14:52:06.508356 (+1856370us) spinlock_profiling.cc:243] Waited 76.3 ms on lock 0x7b5400221354. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae922fa 00007fb68fe53b17 00007fb6893ce6d4 00007fb6893ce662 00007fb6893ce591 00007fb6893ce50c 00007fb6893cd7c2 00007fb6891c948c 00007fb6891c88c6 00007fb6891c826f
0709 14:52:06.508510 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":175449472}
I20260709 14:52:06.519984 11266 raft_consensus.cc:2749] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 14:52:06.512699 11140 raft_consensus.cc:493] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:06.524204  7819 leader_election.cc:304] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:52:06.520263 11022 consensus_queue.cc:260] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:06.497558 11228 raft_consensus.cc:515] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:06.517153 10964 leader_election.cc:290] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 12 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:06.538091  7819 leader_election.cc:304] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:06.533538 11127 raft_consensus.cc:493] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:06.542557 11228 leader_election.cc:290] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:06.550621  7819 leader_election.cc:304] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:06.530103 11266 raft_consensus.cc:2804] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader election won for term 8
I20260709 14:52:06.562697  7819 leader_election.cc:304] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:52:06.513784 11017 raft_consensus.cc:515] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:06.562098 11208 consensus_meta.cc:287] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent flushing consensus metadata: real 0.517s	user 0.012s	sys 0.000s
I20260709 14:52:06.564126 11022 raft_consensus.cc:3060] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:52:06.531371 11140 raft_consensus.cc:515] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:06.566457 10964 raft_consensus.cc:2749] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 14:52:06.547847 11264 raft_consensus.cc:2804] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 14:52:06.570245 11228 raft_consensus.cc:2749] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 14:52:06.620796  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 87870.3us
I20260709 14:52:06.539793 11210 raft_consensus.cc:515] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:06.622680  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 48770.7us
I20260709 14:52:06.581938 11050 raft_consensus.cc:2804] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader election won for term 6
W20260709 14:52:06.625111  7744 leader_election.cc:336] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785): Timed out: RequestConsensusVote RPC to 127.6.101.67:40785 timed out after 2.107s (SENT)
I20260709 14:52:06.582589 11266 raft_consensus.cc:697] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:52:06.542299 11127 raft_consensus.cc:515] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:06.587368 11238 leader_election.cc:290] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:06.567512 11179 raft_consensus.cc:515] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
W20260709 14:52:06.643039  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:52:06.638898  7893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:06.654760  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:06.625152 11264 raft_consensus.cc:493] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:06.626892 11191 leader_election.cc:290] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:06.591423 11208 raft_consensus.cc:515] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:06.635812 11041 leader_election.cc:290] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:06.672864  7894 leader_election.cc:304] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:06.668012  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:06.669510  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:06.672948  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:06.675031  7923 raft_consensus.cc:2468] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 8.
I20260709 14:52:06.670279  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:06.676460  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:06.644768 11050 raft_consensus.cc:697] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:52:06.686617  7894 leader_election.cc:304] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
W20260709 14:52:06.675123 11267 log.cc:927] Time spent T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.053s	user 0.003s	sys 0.000s
I20260709 14:52:06.695604 11052 raft_consensus.cc:2804] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 14:52:06.691205  7928 raft_consensus.cc:1275] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 14:52:06.692896  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:06.664469 11264 raft_consensus.cc:3060] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Advancing to term 9
W20260709 14:52:06.694195  7772 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37136 (request call id 2270) took 2082 ms (client timeout 2070 ms). Trace:
I20260709 14:52:06.675222 11271 consensus_queue.cc:1059] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 14:52:06.728403  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:52:06.706298  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:06.724355  8639 raft_consensus.cc:2368] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 4. Current term is 5.
I20260709 14:52:06.665419 11020 consensus_queue.cc:1059] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 14:52:06.706550  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258d6c2dda954bf5b65930fde8ecb9f3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
W20260709 14:52:06.733620  7772 rpcz_store.cc:269] 0709 14:52:04.611861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:04.964090 (+352229us) service_pool.cc:224] Handling call
0709 14:52:06.693959 (+1729869us) spinlock_profiling.cc:243] Waited 37.2 ms on lock 0x7b5400221d54. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae922fa 00007fb68fe53b17 00007fb6893ce6d4 00007fb6893ce662 00007fb6893ce591 00007fb6893ce50c 00007fb6893cd7c2 00007fb6891c948c 00007fb6891c88c6 00007fb6891c826f
0709 14:52:06.694108 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":85651328}
I20260709 14:52:06.726233 11040 raft_consensus.cc:2804] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 14:52:06.737123 11040 raft_consensus.cc:493] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:06.737708 11040 raft_consensus.cc:3060] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:52:06.737322  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:06.738763  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:06.739015  7846 raft_consensus.cc:2468] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 10.
I20260709 14:52:06.739605  7849 raft_consensus.cc:2468] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 10.
W20260709 14:52:06.685338 11119 consensus_meta.cc:287] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0: Time spent flushing consensus metadata: real 0.538s	user 0.013s	sys 0.003s
I20260709 14:52:06.744861  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:06.734692  7851 raft_consensus.cc:2393] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 10: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:52:06.747972  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:06.749679  7845 raft_consensus.cc:2393] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 8: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:52:06.711143  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c563cc7cfbe4d59be4ffc5cf847ce56" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:06.747896  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:52:06.683187 11262 log.cc:927] Time spent T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.176s	user 0.000s	sys 0.002s
I20260709 14:52:06.756072  7920 raft_consensus.cc:2468] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 12.
I20260709 14:52:06.756363  7851 pending_rounds.cc:85] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting all ops after (but not including) 5
I20260709 14:52:06.753217 11238 raft_consensus.cc:493] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:06.757544  7851 pending_rounds.cc:107] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 14:52:06.696125 11052 raft_consensus.cc:493] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:52:06.758052  7851 raft_consensus.cc:2889] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 14:52:06.748706  7894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:06.762526  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:06.763378  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:06.763375  7920 raft_consensus.cc:2468] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 12.
W20260709 14:52:06.754848 11259 log.cc:927] Time spent T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.222s	user 0.001s	sys 0.001s
I20260709 14:52:06.765494  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
W20260709 14:52:06.768167  7744 connection.cc:256] RPC call timeout handler was delayed by -1.3537125289999494s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15780000000000002s for a response
I20260709 14:52:06.770823  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1f7722fdea49e0b5e9c5d96633eaf9" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:06.773170  7928 raft_consensus.cc:2468] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 7.
I20260709 14:52:06.773517  7923 raft_consensus.cc:2468] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 2.
W20260709 14:52:06.775075  7744 connection.cc:256] RPC call timeout handler was delayed by -1.3213125290000107s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16140000000000002s for a response
W20260709 14:52:06.775869  7744 connection.cc:256] RPC call timeout handler was delayed by -1.2682125289999249s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1673s for a response
W20260709 14:52:06.780750  8598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 117548us
I20260709 14:52:06.781560  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:06.782611  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
W20260709 14:52:06.785866 11209 consensus_meta.cc:287] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent flushing consensus metadata: real 0.633s	user 0.012s	sys 0.003s
I20260709 14:52:06.790299  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
W20260709 14:52:06.780028  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 61103.3us
I20260709 14:52:06.790110  7772 raft_consensus.cc:2468] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 8.
I20260709 14:52:06.764861 11052 raft_consensus.cc:3060] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:52:06.810528  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:06.823865  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
W20260709 14:52:06.827564  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:06.812577  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 10 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
W20260709 14:52:06.798920 11168 consensus_meta.cc:287] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0: Time spent flushing consensus metadata: real 0.640s	user 0.015s	sys 0.001s
I20260709 14:52:06.832818  7926 raft_consensus.cc:2410] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 14:52:06.831104  7923 raft_consensus.cc:2393] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 12: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:52:06.836808  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:06.838750  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:06.840137  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:06.811678  7927 raft_consensus.cc:2468] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 8.
I20260709 14:52:06.798877 11134 consensus_queue.cc:1059] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 14:52:06.842239  7921 raft_consensus.cc:2468] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 10.
I20260709 14:52:06.843633 11210 leader_election.cc:290] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 7 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:06.848618  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:06.874722  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:06.848655 11127 leader_election.cc:290] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:06.850252 11217 raft_consensus.cc:2749] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 14:52:06.851105 11040 raft_consensus.cc:515] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:06.811777 11017 leader_election.cc:290] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:06.758458 11266 consensus_queue.cc:237] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:06.835513 11209 raft_consensus.cc:515] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:06.768383 11238 raft_consensus.cc:515] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:06.835594  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:06.861899  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:06.861899  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:06.809811 11050 consensus_queue.cc:237] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:06.887615 11209 leader_election.cc:290] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 12 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:06.883776  7926 raft_consensus.cc:2468] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 10.
I20260709 14:52:06.859579  8639 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44352 (request call id 159) took 1147 ms. Trace:
I20260709 14:52:06.888612  8639 rpcz_store.cc:276] 0709 14:52:05.708848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:05.742094 (+ 33246us) service_pool.cc:224] Handling call
0709 14:52:06.855383 (+1113289us) spinlock_profiling.cc:243] Waited 704 ms on lock 0x7b54005a0354. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae922fa 00007fb68fe53b17 00007fb6893ce6d4 00007fb6893ce662 00007fb6893ce591 00007fb6893ce50c 00007fb6893cd7c2 00007fb6891c948c 00007fb6891c88c6 00007fb6891c826f
0709 14:52:06.855672 (+   289us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1619939072}
I20260709 14:52:06.891261  7920 raft_consensus.cc:2393] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 11: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:52:06.892379 11119 raft_consensus.cc:3055] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 14:52:06.883128 11140 leader_election.cc:290] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:06.871671 11099 consensus_queue.cc:1059] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 14:52:06.899681 11179 leader_election.cc:290] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 [CANDIDATE]: Term 5 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:06.918787 11168 raft_consensus.cc:3055] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 14:52:06.921422 11168 raft_consensus.cc:740] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:06.903053 11268 raft_consensus.cc:3055] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 14:52:06.927103 11223 consensus_meta.cc:287] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent flushing consensus metadata: real 0.951s	user 0.016s	sys 0.001s
I20260709 14:52:06.906579 11119 raft_consensus.cc:740] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:06.927919 11040 leader_election.cc:290] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 11 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:06.915238 11208 leader_election.cc:290] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 10 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:06.932164 11168 consensus_queue.cc:260] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:06.927280 11268 raft_consensus.cc:740] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:06.934613 11168 raft_consensus.cc:3060] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:52:06.934719 11268 consensus_queue.cc:260] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:06.935513 11238 leader_election.cc:290] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:06.936872 11268 raft_consensus.cc:3060] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:52:06.938104 11119 consensus_queue.cc:260] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:06.940063 11119 raft_consensus.cc:3060] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:52:06.942405 11110 raft_consensus.cc:2749] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 14:52:06.944737 11264 raft_consensus.cc:515] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:06.954645 11223 raft_consensus.cc:3055] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 14:52:06.955180 11223 raft_consensus.cc:740] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:06.955552 11264 leader_election.cc:290] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 9 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:06.956084 11223 consensus_queue.cc:260] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:06.957043 11223 raft_consensus.cc:3060] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:52:06.810757  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
W20260709 14:52:07.008436  7742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:07.010442  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
W20260709 14:52:06.814570  7819 connection.cc:256] RPC call timeout handler was delayed by -1.1987649899999724s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15080000000000002s for a response
I20260709 14:52:07.014680  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
W20260709 14:52:07.015712  7819 connection.cc:256] RPC call timeout handler was delayed by -1.149264990000006s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1563s for a response
W20260709 14:52:07.016413  7819 connection.cc:256] RPC call timeout handler was delayed by -1.149264990000006s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1563s for a response
W20260709 14:52:07.016829  7819 connection.cc:256] RPC call timeout handler was delayed by -1.0952649900000324s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1623s for a response
I20260709 14:52:07.017151  7846 raft_consensus.cc:2393] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 9: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:52:07.019392  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:07.021034  7772 raft_consensus.cc:2393] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 8: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:52:07.024533  7777 raft_consensus.cc:1240] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 10. Current term is 11. Ops: []
I20260709 14:52:07.041960  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:07.043560  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:07.044492  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:07.050843  7744 leader_election.cc:304] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:52:07.055472  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:07.057703  7744 leader_election.cc:304] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:52:07.062480  7925 raft_consensus.cc:1240] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 LEADER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 14:52:07.062539  7744 leader_election.cc:304] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:52:07.065018  7925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38532 (request call id 2988) took 2642 ms. Trace:
I20260709 14:52:07.048812  7779 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 2666) took 2446 ms. Trace:
I20260709 14:52:07.028939  7774 raft_consensus.cc:1275] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 14:52:07.030319  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:07.071280  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18d29d52d304c87b930d4fb5eaf50b1" candidate_uuid: "9418391fa82a42c79c6cad13ba91d964" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:07.072592  7778 raft_consensus.cc:2468] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9418391fa82a42c79c6cad13ba91d964 in term 4.
W20260709 14:52:07.073848  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:07.074643  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:07.032547  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 10 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:07.072964  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:07.034168  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:07.074463  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:07.037664  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:07.038105  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:07.076683  7771 raft_consensus.cc:2468] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 10.
I20260709 14:52:07.078140  7776 raft_consensus.cc:2393] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 6: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:52:07.078694  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:07.022861  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9441e831627143a991a1556dcdce71e3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:07.078608  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:07.080541  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:07.080993  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:07.081620  7771 raft_consensus.cc:2468] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 10.
I20260709 14:52:07.076889  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:07.083660  7772 raft_consensus.cc:3060] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:52:07.052431  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:07.031534  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:07.065621  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:07.071494  7852 raft_consensus.cc:1240] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 14:52:07.031467  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:07.032286  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18d29d52d304c87b930d4fb5eaf50b1" candidate_uuid: "9418391fa82a42c79c6cad13ba91d964" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:07.068984  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:07.079382  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18d29d52d304c87b930d4fb5eaf50b1" candidate_uuid: "9418391fa82a42c79c6cad13ba91d964" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:07.082442  7773 raft_consensus.cc:3060] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:52:07.085196  7921 raft_consensus.cc:3060] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:52:07.037146  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
W20260709 14:52:07.022563  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 159500us
I20260709 14:52:07.122622  7775 raft_consensus.cc:2468] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 7.
I20260709 14:52:07.074347  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:07.130638  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:07.068950  7779 rpcz_store.cc:276] 0709 14:52:04.602280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:04.602705 (+   425us) service_pool.cc:224] Handling call
0709 14:52:04.682300 (+ 79595us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:52:04.687883 (+  5583us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 14:52:04.977507 (+289624us) log.cc:844] Serialized 14 byte log entry
0709 14:52:05.391297 (+413790us) log.cc:844] Serialized 14 byte log entry
0709 14:52:05.391521 (+   224us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:52:05.391571 (+    50us) raft_consensus.cc:1645] Marking committed up to 8
0709 14:52:05.391638 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:06.406878 (+1015240us) spinlock_profiling.cc:243] Waited 3.38 ms on lock 0x7b180039f940. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb690c69de1 00007fb690c765b1 00007fb687da13f3 00007fb687da37c1 00007fb687da3779 00007fb687da3709 00007fb687da36d1 00007fb687da29cd 0000000000396ad4 0000000000396919 00007fb687d8483a
0709 14:52:06.669521 (+262643us) spinlock_profiling.cc:243] Waited 3.84 ms on lock 0x7b180039f940. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb690c69de1 00007fb690c765b1 00007fb687d6f2a6 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae8ee01 00007fb68ae8d83e 00007fb68fe52419
0709 14:52:06.859742 (+190221us) spinlock_profiling.cc:243] Waited 9.37 ms on lock 0x7b180039f940. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb690c69de1 00007fb690c765b1 00007fb687d6f2a6 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb690c69de1 00007fb690c765b1 00007fb687da13f3 00007fb687da37c1
0709 14:52:06.957901 (+ 98159us) spinlock_profiling.cc:243] Waited 3.42 ms on lock 0x7b180039f940. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb690c69de1 00007fb690c765b1 00007fb687da13f3 00007fb687da37c1 00007fb687da3779 00007fb687da3709 00007fb687da36d1 00007fb687da29cd 0000000000396ad4 0000000000396919 00007fb687d8483a
0709 14:52:07.048101 (+ 90200us) spinlock_profiling.cc:243] Waited 5.15 ms on lock 0x7b54002dd2d4. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae8ee01 00007fb68ae8d83e 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2 00007fb6891c948c 00007fb6891c88c6
0709 14:52:07.048208 (+   107us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:07.048558 (+   350us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":581739,"prepare.run_cpu_time_us":127,"prepare.run_wall_time_us":11792,"raft.queue_time_us":5449,"raft.run_cpu_time_us":254,"raft.run_wall_time_us":16359,"spinlock_wait_cycles":57861120,"thread_start_us":664897,"threads_started":2,"wal-append.queue_time_us":481496,"wal-append.run_cpu_time_us":2993,"wal-append.run_wall_time_us":1093550}
I20260709 14:52:07.086445  7920 raft_consensus.cc:2393] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 8: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:52:07.087594  7854 raft_consensus.cc:2393] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 11: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:52:07.088958  7776 raft_consensus.cc:3060] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:52:07.096453  6549 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 14:52:07.086059  7778 raft_consensus.cc:2393] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 9: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:52:07.037004  7742 leader_election.cc:400] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 election: Vote denied by peer 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68:42321) with higher term. Message: Invalid argument: T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 4. Current term is 5.
I20260709 14:52:07.088165  7849 raft_consensus.cc:3060] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:52:07.067232  7925 rpcz_store.cc:276] 0709 14:52:04.422299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:04.747470 (+325171us) service_pool.cc:224] Handling call
0709 14:52:04.747971 (+   501us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:52:07.063352 (+2315381us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:07.064394 (+  1042us) spinlock_profiling.cc:243] Waited 2.31 s on lock 0x7b5400019d54. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae8ee01 00007fb68ae8d83e 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2 00007fb6891c948c 00007fb6891c88c6
0709 14:52:07.064798 (+   404us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5320597376}
I20260709 14:52:07.083886  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:07.120069  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:07.120779  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:07.134204  7848 raft_consensus.cc:1240] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 14:52:07.086047  7851 raft_consensus.cc:2468] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 10.
I20260709 14:52:07.141481 11052 raft_consensus.cc:515] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:07.146445  7742 leader_election.cc:403] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 14:52:07.068387  7744 leader_election.cc:304] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:52:07.158355 11124 raft_consensus.cc:493] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:07.159773 11124 raft_consensus.cc:515] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:07.149739  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:07.165561 11048 raft_consensus.cc:493] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:07.166910 11048 raft_consensus.cc:515] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:07.169690 11130 consensus_queue.cc:1048] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 14:52:07.169409  7676 catalog_manager.cc:5697] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 7 to 9, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 9 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:52:07.165776  7771 raft_consensus.cc:2393] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 11: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:52:07.176503 11127 raft_consensus.cc:2804] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader election won for term 8
I20260709 14:52:07.178670 11203 consensus_queue.cc:1059] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 14:52:07.185593  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:07.187372  7851 raft_consensus.cc:2393] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 12: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:52:07.186009 11040 consensus_queue.cc:1059] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 14:52:07.189229 11268 raft_consensus.cc:3055] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 14:52:07.186944  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:07.189972 11268 raft_consensus.cc:740] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:07.200055  7772 raft_consensus.cc:2468] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 9.
I20260709 14:52:07.199338  7776 raft_consensus.cc:2468] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9418391fa82a42c79c6cad13ba91d964 in term 5.
I20260709 14:52:07.204592 11166 consensus_queue.cc:1048] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 14:52:07.206430 11124 leader_election.cc:290] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:07.189976 11052 leader_election.cc:290] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:07.207374 11127 raft_consensus.cc:697] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:52:07.205327  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:07.207880 10987 raft_consensus.cc:2749] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68:42321) with higher term. Message: Invalid argument: T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 4. Current term is 5.
I20260709 14:52:07.208457  7845 raft_consensus.cc:3060] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Advancing to term 11
W20260709 14:52:07.212255  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:07.198732 11162 raft_consensus.cc:2804] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader election won for term 11
I20260709 14:52:07.214378 11162 raft_consensus.cc:697] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:52:07.180248  7676 catalog_manager.cc:5697] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:52:07.216148 11162 consensus_queue.cc:237] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:07.217886  7923 raft_consensus.cc:2393] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 12: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:52:07.216141 11127 consensus_queue.cc:237] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:07.222083 11099 consensus_queue.cc:1048] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 14:52:07.222651  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 154699us
I20260709 14:52:07.223315 11265 consensus_queue.cc:1048] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 14:52:07.223810 11131 consensus_queue.cc:1059] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 14:52:07.213625  7924 raft_consensus.cc:2468] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 11.
I20260709 14:52:07.246982  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:07.250360  7845 raft_consensus.cc:2468] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 11.
I20260709 14:52:07.254716  7770 raft_consensus.cc:2468] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 8.
I20260709 14:52:07.261436 11130 raft_consensus.cc:2804] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 14:52:07.264508 11131 raft_consensus.cc:3055] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 14:52:07.265394 11131 raft_consensus.cc:740] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
W20260709 14:52:07.277710  7745 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 2.590s (SENT) [suppressed 42 similar messages]
I20260709 14:52:07.294879  7773 raft_consensus.cc:2468] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 6.
I20260709 14:52:07.298282  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:07.303252  7921 raft_consensus.cc:2410] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 14:52:07.308194  7852 raft_consensus.cc:2393] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 9: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:52:07.298193 11124 raft_consensus.cc:2804] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 14:52:07.316527  7742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.68:42321, user_credentials={real_user=slave}} blocked reactor thread for 280697us
W20260709 14:52:07.329486  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:07.329975  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:07.342382  7845 raft_consensus.cc:2393] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 6: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:52:07.315361 11124 raft_consensus.cc:493] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
W20260709 14:52:07.346972  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:52:07.348776  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:07.350807  7849 raft_consensus.cc:2468] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9418391fa82a42c79c6cad13ba91d964 in term 5.
I20260709 14:52:07.356421  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:07.364109  7854 raft_consensus.cc:1240] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 11. Current term is 12. Ops: []
I20260709 14:52:07.352481 11124 raft_consensus.cc:3060] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:52:07.366370  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:07.370870  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:07.371987  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:07.370266 11048 leader_election.cc:290] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:07.383361  8599 leader_election.cc:304] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac, 9418391fa82a42c79c6cad13ba91d964; no voters: 
I20260709 14:52:07.385135  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:07.386724  7854 raft_consensus.cc:2393] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 10: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:52:07.384012  7894 leader_election.cc:304] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:07.389377 11225 consensus_queue.cc:1059] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 14:52:07.390225 11238 raft_consensus.cc:2804] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 14:52:07.390511 11225 consensus_queue.cc:1243] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer 1e9289592458429bbddb19c2e7b7b7b0 log is divergent from this leader: its last log entry 7.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 14:52:07.391215 11225 raft_consensus.cc:3055] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 LEADER]: Stepping down as leader of term 6
I20260709 14:52:07.390990 11052 consensus_queue.cc:1048] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 14:52:07.391588 11225 raft_consensus.cc:740] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:52:07.391856 11238 raft_consensus.cc:493] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:07.392297 11238 raft_consensus.cc:3060] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:52:07.393069 11263 raft_consensus.cc:993] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0: : Instructing follower 1de5e20126fa4d8ca0793d19c7b847ed to start an election
I20260709 14:52:07.394320 11263 raft_consensus.cc:1081] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 LEADER]: Signalling peer 1de5e20126fa4d8ca0793d19c7b847ed to start an election
I20260709 14:52:07.371446 11265 raft_consensus.cc:493] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:07.396562 11265 raft_consensus.cc:515] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:07.381582 11131 consensus_queue.cc:260] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:07.403330  7851 raft_consensus.cc:3060] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:52:07.403815  7894 leader_election.cc:304] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:07.379169 11268 consensus_queue.cc:260] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:07.405764 11052 raft_consensus.cc:2804] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 14:52:07.406589 11052 raft_consensus.cc:697] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:07.406750  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:07.407462  7848 raft_consensus.cc:2468] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 10.
W20260709 14:52:07.414783  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:07.404079 11130 raft_consensus.cc:493] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:07.423476  7845 raft_consensus.cc:1240] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
W20260709 14:52:07.423635  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 51570.7us
W20260709 14:52:07.423089  8599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 47227us
I20260709 14:52:07.422261  7676 catalog_manager.cc:5697] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 3 to 5, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 5 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:52:07.430425  7849 raft_consensus.cc:3060] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:52:07.431496 11216 raft_consensus.cc:2804] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 14:52:07.434360  7852 raft_consensus.cc:3060] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:52:07.436621 11216 raft_consensus.cc:697] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 [term 5 LEADER]: Becoming Leader. State: Replica: 9418391fa82a42c79c6cad13ba91d964, State: Running, Role: LEADER
I20260709 14:52:07.426127 11130 raft_consensus.cc:3060] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:52:07.411732 11052 consensus_queue.cc:237] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:07.443717  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:07.445988  7848 raft_consensus.cc:2393] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 7: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:52:07.429816 11131 raft_consensus.cc:3060] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:52:07.460996 11168 raft_consensus.cc:493] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:07.461977 11168 raft_consensus.cc:515] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:07.427883 11263 consensus_queue.cc:1059] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 14:52:07.457669 11268 raft_consensus.cc:3060] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:52:07.470218  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:07.443740 11216 consensus_queue.cc:237] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
W20260709 14:52:07.479734  7893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:07.494258 11168 leader_election.cc:290] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:07.501664  7848 raft_consensus.cc:2393] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 8: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:52:07.489815 11265 leader_election.cc:290] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:52:07.505010 11022 consensus_meta.cc:287] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0: Time spent flushing consensus metadata: real 0.882s	user 0.013s	sys 0.009s
I20260709 14:52:07.511152 11166 raft_consensus.cc:3055] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 LEADER]: Stepping down as leader of term 7
I20260709 14:52:07.510715 11225 consensus_queue.cc:260] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:07.511435  7919 raft_consensus.cc:2468] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 9.
I20260709 14:52:07.511687 11166 raft_consensus.cc:740] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:52:07.512810 11225 raft_consensus.cc:3060] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:52:07.513161 11166 consensus_queue.cc:260] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:07.499800 11238 raft_consensus.cc:515] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:07.526065  7849 raft_consensus.cc:2410] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 14:52:07.538647  7851 raft_consensus.cc:2468] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 12.
I20260709 14:52:07.483687 11040 raft_consensus.cc:493] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:07.553149  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:07.557873  7919 raft_consensus.cc:3060] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:52:07.556850 11238 leader_election.cc:290] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:07.554131 11166 raft_consensus.cc:3060] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Advancing to term 8
I20260709 14:52:07.556216  7675 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54364 (request call id 341) took 9040 ms. Trace:
I20260709 14:52:07.572479  7845 raft_consensus.cc:1240] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 14:52:07.574324  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:07.569304  7744 leader_election.cc:304] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:52:07.594182  7925 raft_consensus.cc:1275] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 14:52:07.594666  7924 raft_consensus.cc:1240] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 11. Current term is 12. Ops: []
I20260709 14:52:07.569826  7675 rpcz_store.cc:276] 0709 14:51:58.515134 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:58.515368 (+   234us) service_pool.cc:224] Handling call
0709 14:52:07.555845 (+9040477us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 14:51:59.835282 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 14:51:59.843055 (+  7773us) write_op.cc:432] Acquiring schema lock in shared mode
0709 14:51:59.843100 (+    45us) write_op.cc:435] Acquired schema lock
0709 14:51:59.843120 (+    20us) tablet.cc:662] Decoding operations
0709 14:51:59.845157 (+  2037us) write_op.cc:620] Acquiring the partition lock for write op
0709 14:51:59.854651 (+  9494us) write_op.cc:641] Partition lock acquired for write op
0709 14:51:59.862485 (+  7834us) tablet.cc:685] Acquiring locks for 27 operations
0709 14:51:59.975438 (+112953us) tablet.cc:701] Row locks acquired
0709 14:51:59.975457 (+    19us) write_op.cc:260] PREPARE: finished
0709 14:51:59.975693 (+   236us) write_op.cc:270] Start()
0709 14:51:59.975843 (+   150us) write_op.cc:276] Timestamp: P: 1783608719975616 usec, L: 0
0709 14:51:59.975863 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 14:52:00.039355 (+ 63492us) log.cc:844] Serialized 10541 byte log entry
0709 14:52:01.603129 (+1563774us) op_driver.cc:464] REPLICATION: finished
0709 14:52:02.043738 (+440609us) write_op.cc:301] APPLY: starting
0709 14:52:02.043865 (+   127us) tablet.cc:1367] starting BulkCheckPresence
0709 14:52:02.044449 (+   584us) tablet.cc:1370] finished BulkCheckPresence
0709 14:52:02.047048 (+  2599us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 14:52:02.103591 (+ 56543us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 14:52:02.104090 (+   499us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=27
0709 14:52:02.104305 (+   215us) write_op.cc:312] APPLY: finished
0709 14:52:02.104875 (+   570us) log.cc:844] Serialized 182 byte log entry
0709 14:52:02.105118 (+   243us) write_op.cc:489] Releasing partition, row and schema locks
0709 14:52:02.141889 (+ 36771us) write_op.cc:454] Released schema lock
0709 14:52:02.153563 (+ 11674us) write_op.cc:341] FINISH: Updating metrics
0709 14:52:02.166348 (+ 12785us) write_op.cc:489] Releasing partition, row and schema locks
0709 14:52:02.166398 (+    50us) write_op.cc:454] Released schema lock
0709 14:52:02.351164 (+184766us) spinlock_profiling.cc:243] Waited 4.88 ms on lock 0x7b18002f6ec0. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb690c69de1 00007fb690c765b1 00007fb68aa364bc 00007fb687d8448b 00007fb690bdeab9 00007fb687da069b 00007fb687d9e93f 00007fb687d9e455 00007fb68ae0b190 00007fb68ae04ae7 00007fb68ae03dd9
Metrics: {"mutex_wait_us":2487,"reported_tablets":43,"child_traces":[["op",{"apply.queue_time_us":440260,"apply.run_cpu_time_us":8937,"apply.run_wall_time_us":122536,"num_ops":27,"prepare.queue_time_us":117446,"prepare.run_cpu_time_us":49990,"prepare.run_wall_time_us":463653,"raft.queue_time_us":601015,"raft.run_cpu_time_us":77970,"raft.run_wall_time_us":315017,"replication_time_us":1627064,"spinlock_wait_cycles":11213184,"thread_start_us":1465776,"threads_started":4,"wal-append.queue_time_us":310237,"wal-append.run_cpu_time_us":45086,"wal-append.run_wall_time_us":3001749}]]}
I20260709 14:52:07.602710 11124 raft_consensus.cc:515] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:07.593277  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:52:07.606798  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 116357us
I20260709 14:52:07.605427  7851 raft_consensus.cc:2468] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 8.
I20260709 14:52:07.588265  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce9c0ef2db24c13a8b1402f21819458" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
W20260709 14:52:07.610947  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:07.612875  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
W20260709 14:52:07.612193  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 148319us
I20260709 14:52:07.617702  7845 raft_consensus.cc:1240] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 14:52:07.620491  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18d29d52d304c87b930d4fb5eaf50b1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:07.621618  7851 raft_consensus.cc:2368] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 4. Current term is 5.
I20260709 14:52:07.625614 11266 raft_consensus.cc:493] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:07.626209  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:07.626928 11266 raft_consensus.cc:515] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:07.628487  7924 raft_consensus.cc:3060] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:52:07.630658 11168 raft_consensus.cc:3055] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 14:52:07.631536  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
W20260709 14:52:07.631933  7742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:07.627671 10987 raft_consensus.cc:2804] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 14:52:07.633153 10987 raft_consensus.cc:493] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting leader election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:52:07.633834 10987 raft_consensus.cc:3060] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:52:07.634428 11124 leader_election.cc:290] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:52:07.631765 11223 consensus_meta.cc:287] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent flushing consensus metadata: real 0.634s	user 0.017s	sys 0.005s
I20260709 14:52:07.594120 11040 raft_consensus.cc:515] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:07.638078 11285 log.cc:927] Time spent T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.178s	user 0.001s	sys 0.000s
I20260709 14:52:07.631366 11168 raft_consensus.cc:740] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:07.641197 11168 consensus_queue.cc:260] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:07.642444  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:07.642794 11168 raft_consensus.cc:3060] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:52:07.643337  7849 raft_consensus.cc:2393] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 11: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:52:07.646533 11266 leader_election.cc:290] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:07.646425  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:07.647706  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:07.648216  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:07.648869  7850 raft_consensus.cc:1240] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 6. Current term is 7. Ops: []
I20260709 14:52:07.651738 11040 leader_election.cc:290] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:07.653362  7848 raft_consensus.cc:3060] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:52:07.653373  7854 raft_consensus.cc:3060] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Advancing to term 8
W20260709 14:52:07.642602  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:07.670101  7919 raft_consensus.cc:2468] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 9.
I20260709 14:52:07.671705 11130 raft_consensus.cc:515] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:07.674552 11130 leader_election.cc:290] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:07.687646  7744 leader_election.cc:304] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:52:07.688812 11162 consensus_queue.cc:1048] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 14:52:07.689824 11119 consensus_meta.cc:287] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent flushing consensus metadata: real 0.736s	user 0.011s	sys 0.011s
I20260709 14:52:07.691008 11162 raft_consensus.cc:2804] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader election won for term 12
I20260709 14:52:07.691708 11162 raft_consensus.cc:697] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:52:07.692767 11162 consensus_queue.cc:237] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:07.693534  7894 leader_election.cc:304] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:07.695115  7894 leader_election.cc:304] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:07.696718 11124 raft_consensus.cc:493] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:07.697654 11124 raft_consensus.cc:515] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:07.699179  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:07.697467  7925 raft_consensus.cc:1240] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 LEADER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 9. Current term is 10. Ops: []
I20260709 14:52:07.710081 11119 raft_consensus.cc:2804] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 14:52:07.710883 11119 raft_consensus.cc:493] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:07.711365 11119 raft_consensus.cc:3060] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:52:07.713905  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:07.715031  7851 raft_consensus.cc:2393] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 9: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:52:07.700875 11295 raft_consensus.cc:2804] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 14:52:07.716847 11295 raft_consensus.cc:493] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:07.717298 11295 raft_consensus.cc:3060] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:52:07.718772  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:07.730611  7852 raft_consensus.cc:2468] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 11.
I20260709 14:52:07.731678  7845 raft_consensus.cc:1240] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 10. Current term is 11. Ops: []
W20260709 14:52:07.733384  7846 consensus_meta.cc:287] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent flushing consensus metadata: real 0.534s	user 0.008s	sys 0.006s
I20260709 14:52:07.734081  7846 raft_consensus.cc:2468] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 12.
I20260709 14:52:07.725936  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:07.689072  7744 leader_election.cc:304] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:52:07.734637  7924 raft_consensus.cc:2468] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 11.
I20260709 14:52:07.735530  7922 raft_consensus.cc:2468] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 6.
I20260709 14:52:07.741899 11166 raft_consensus.cc:2764] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
W20260709 14:52:07.740097  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 51188.5us
I20260709 14:52:07.737164  7848 raft_consensus.cc:2468] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 12.
I20260709 14:52:07.742036  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:07.740813  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:07.764423 11052 raft_consensus.cc:493] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:07.773042  7854 raft_consensus.cc:2468] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 8.
I20260709 14:52:07.774700  7852 raft_consensus.cc:1240] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 8. Current term is 9. Ops: []
I20260709 14:52:07.765338 11052 raft_consensus.cc:515] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:07.778167  7851 raft_consensus.cc:2393] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 11: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:52:07.764679 10987 raft_consensus.cc:515] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:07.778121 11124 leader_election.cc:290] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:07.805799  7744 leader_election.cc:304] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:52:07.794914 11166 consensus_queue.cc:1059] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 14:52:07.806118  7850 raft_consensus.cc:1240] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 12. Current term is 13. Ops: []
I20260709 14:52:07.825233 11166 consensus_queue.cc:1243] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer 1e9289592458429bbddb19c2e7b7b7b0 log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 14:52:07.826013 11166 raft_consensus.cc:3055] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 LEADER]: Stepping down as leader of term 7
I20260709 14:52:07.826386 11166 raft_consensus.cc:740] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:52:07.833739  7744 leader_election.cc:304] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 9418391fa82a42c79c6cad13ba91d964
I20260709 14:52:07.834918 11225 raft_consensus.cc:2804] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader election won for term 11
I20260709 14:52:07.838788 11225 raft_consensus.cc:697] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:52:07.842702 11284 raft_consensus.cc:2749] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 14:52:07.836098 11287 consensus_queue.cc:1048] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 14:52:07.836915 11130 consensus_queue.cc:1059] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 14:52:07.850831 11130 raft_consensus.cc:3055] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 LEADER]: Stepping down as leader of term 11
I20260709 14:52:07.851269 11130 raft_consensus.cc:740] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:52:07.852438 11130 consensus_queue.cc:260] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:07.789111 11052 leader_election.cc:290] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:07.867921 11266 raft_consensus.cc:493] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:07.868887 11266 raft_consensus.cc:515] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:07.872323 11266 leader_election.cc:290] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:52:07.878463  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:07.880159  7744 leader_election.cc:304] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:52:07.827853 11166 consensus_queue.cc:260] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:07.887653 11166 raft_consensus.cc:3060] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Advancing to term 8
I20260709 14:52:07.894277 11295 raft_consensus.cc:515] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:07.897812  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 154975us
I20260709 14:52:07.906667  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:52:07.901765  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 55188.1us
W20260709 14:52:07.910632  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:07.914140  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:07.840374 11225 consensus_queue.cc:237] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:07.916252 11168 raft_consensus.cc:493] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:07.926817 11052 consensus_queue.cc:1059] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 14:52:07.930276 11130 raft_consensus.cc:3060] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:52:07.933135  7675 catalog_manager.cc:5697] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "9418391fa82a42c79c6cad13ba91d964" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 14:52:07.939023  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:07.934587  7894 leader_election.cc:304] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:07.941597  7851 raft_consensus.cc:2393] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 11: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:52:07.925889 11287 raft_consensus.cc:2804] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader election won for term 9
W20260709 14:52:07.948732  7743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:07.949414  7850 raft_consensus.cc:1275] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 14:52:07.953994  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258d6c2dda954bf5b65930fde8ecb9f3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:52:07.954304  7743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:52:07.951928  7893 leader_election.cc:336] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Timed out: RequestConsensusVote RPC to 127.6.101.65:40587 timed out after 1.546s (SENT)
I20260709 14:52:07.939972 10987 leader_election.cc:290] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:07.936393 11168 raft_consensus.cc:515] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:07.958559  7893 leader_election.cc:304] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:07.958848 11052 raft_consensus.cc:2804] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 14:52:07.959702 11052 raft_consensus.cc:493] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:07.959818 11268 raft_consensus.cc:3060] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 14:52:07.946094 11295 leader_election.cc:290] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 11 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:07.962388  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9441e831627143a991a1556dcdce71e3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:07.939157 11162 consensus_queue.cc:1059] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 14:52:07.964313  7851 raft_consensus.cc:2393] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 7: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:52:07.962002 11131 consensus_queue.cc:1059] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 14:52:07.963181  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c563cc7cfbe4d59be4ffc5cf847ce56" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:07.966261  7744 leader_election.cc:304] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:52:07.960155 11052 raft_consensus.cc:3060] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:52:07.972642 11131 raft_consensus.cc:3055] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 14:52:07.973517 11040 raft_consensus.cc:3055] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 14:52:07.987221 11040 raft_consensus.cc:740] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
W20260709 14:52:07.986871  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 44756.1us
W20260709 14:52:07.992473 11298 log.cc:927] Time spent T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964: Append to log took a long time: real 0.070s	user 0.002s	sys 0.000s
W20260709 14:52:07.976030  7745 leader_election.cc:336] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 1.504s (SENT)
I20260709 14:52:07.956507 11287 raft_consensus.cc:697] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:52:07.992880 11168 leader_election.cc:290] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:07.994043 11287 consensus_queue.cc:237] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:07.996893 11299 log.cc:927] Time spent T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.075s	user 0.002s	sys 0.000s
I20260709 14:52:07.986428 11131 raft_consensus.cc:740] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:07.974539  7851 raft_consensus.cc:1240] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 9. Current term is 10. Ops: []
I20260709 14:52:07.968777  7894 leader_election.cc:304] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
W20260709 14:52:07.992360  7893 leader_election.cc:336] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Timed out: RequestConsensusVote RPC to 127.6.101.65:40587 timed out after 1.603s (SENT)
I20260709 14:52:08.002363  7893 leader_election.cc:304] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:52:08.006174  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 44799.8us
W20260709 14:52:08.006376 11300 log.cc:927] Time spent T 00000000000000000000000000000000 P 133636659113430cb53b321cb0b1d9ee: Append to log took a long time: real 0.083s	user 0.000s	sys 0.003s
I20260709 14:52:08.012267  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18d29d52d304c87b930d4fb5eaf50b1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:08.014634  7894 leader_election.cc:304] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
W20260709 14:52:08.013741  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 63243.6us
I20260709 14:52:07.990499 11040 consensus_queue.cc:260] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:08.018682  7850 raft_consensus.cc:2368] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 4. Current term is 5.
I20260709 14:52:08.015872 11124 raft_consensus.cc:2804] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader election won for term 11
I20260709 14:52:08.022128 11124 raft_consensus.cc:697] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:52:08.024215 11265 raft_consensus.cc:2749] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 14:52:08.025368 11265 raft_consensus.cc:2804] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 14:52:08.026037 11265 raft_consensus.cc:697] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:08.007236 11294 raft_consensus.cc:2804] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 14:52:08.026181  7742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:08.027266 11265 consensus_queue.cc:237] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:08.029034  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 11 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:08.029349  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:08.007508 11131 consensus_queue.cc:260] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:08.032774  7742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:08.004798 11162 consensus_queue.cc:1243] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer 1e9289592458429bbddb19c2e7b7b7b0 log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 14:52:08.035419  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:08.023195 11124 consensus_queue.cc:237] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:08.049747 10987 raft_consensus.cc:3055] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 LEADER]: Stepping down as leader of term 9
I20260709 14:52:08.059067  7851 raft_consensus.cc:1240] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 8. Current term is 9. Ops: []
W20260709 14:52:08.061821  7742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:52:08.062583  7745 leader_election.cc:336] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 1.539s (SENT)
I20260709 14:52:08.064289  7850 raft_consensus.cc:1275] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 14:52:08.029023 11294 raft_consensus.cc:697] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:08.067193  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:08.068295  7854 raft_consensus.cc:2468] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 8.
W20260709 14:52:08.070112 11305 log.cc:927] Time spent T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.149s	user 0.002s	sys 0.000s
I20260709 14:52:08.071815 11131 raft_consensus.cc:3060] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:52:08.075729  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:08.050463 10987 raft_consensus.cc:740] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:52:08.077270  7848 raft_consensus.cc:3060] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:52:08.078711 10987 consensus_queue.cc:260] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:08.080619 10987 raft_consensus.cc:3060] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Advancing to term 10
W20260709 14:52:08.077462  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:08.063544  7745 leader_election.cc:304] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:08.087852 11040 raft_consensus.cc:3060] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:52:08.087970 11284 raft_consensus.cc:2749] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 14:52:08.096495  7849 raft_consensus.cc:1275] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 14:52:08.096966  7845 raft_consensus.cc:1240] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 14:52:08.099888  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:08.101812 11050 raft_consensus.cc:493] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:08.102428 11050 raft_consensus.cc:515] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:08.057013 11119 raft_consensus.cc:515] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:08.106501 11050 leader_election.cc:290] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:08.107447 11119 leader_election.cc:290] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 11 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:08.109087  7744 leader_election.cc:304] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:52:08.109519  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:08.135568  7849 raft_consensus.cc:2468] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 11.
I20260709 14:52:08.137645  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:08.138521  7849 raft_consensus.cc:3060] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:52:08.112316  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:08.112948  7852 raft_consensus.cc:1240] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 11. Current term is 12. Ops: []
I20260709 14:52:08.112361  7854 raft_consensus.cc:1275] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Refusing update from remote peer 9418391fa82a42c79c6cad13ba91d964: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 14:52:08.142776  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:08.116312  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:08.143661  7847 raft_consensus.cc:2468] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 8.
I20260709 14:52:08.144343  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:08.144860  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:08.145519  7854 raft_consensus.cc:2468] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 11.
I20260709 14:52:08.119995  7848 raft_consensus.cc:2468] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 12.
I20260709 14:52:08.091681  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:52:08.121377  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 58850.3us
W20260709 14:52:08.149477  7745 leader_election.cc:336] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 1.548s (SENT)
I20260709 14:52:08.148973  7850 raft_consensus.cc:2468] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 9.
W20260709 14:52:08.128281  7894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:08.130533 11294 consensus_queue.cc:237] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:08.132496 11050 raft_consensus.cc:493] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:08.148739 11268 raft_consensus.cc:2749] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 14:52:08.187057  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 194829us
W20260709 14:52:08.188978  7743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:08.164569 11287 raft_consensus.cc:2804] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader election won for term 6
W20260709 14:52:08.195493  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 46055.7us
I20260709 14:52:08.195950  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:08.198107  7849 raft_consensus.cc:2468] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 11.
I20260709 14:52:08.148655 11216 consensus_queue.cc:1048] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
W20260709 14:52:08.205857  7894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:08.209659  7770 raft_consensus.cc:1275] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 14:52:08.195489 11119 raft_consensus.cc:493] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:08.213779  6549 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 14:52:08.216017  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:08.202095 11287 raft_consensus.cc:697] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:52:08.219008 11287 consensus_queue.cc:237] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:08.206539 11268 raft_consensus.cc:493] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:08.221896 11268 raft_consensus.cc:515] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:08.224674 11223 raft_consensus.cc:493] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:08.239804  7854 raft_consensus.cc:1275] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 14:52:08.244906  7894 leader_election.cc:304] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:08.250461  7894 leader_election.cc:304] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
W20260709 14:52:08.254609  7745 leader_election.cc:336] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 1.578s (SENT)
I20260709 14:52:08.256779  7745 leader_election.cc:304] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:08.225023 11268 leader_election.cc:290] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:08.261435  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:08.197846 11050 raft_consensus.cc:515] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:08.263916  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:08.272686  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:52:08.279493  8598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 101831us
I20260709 14:52:08.287487  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18d29d52d304c87b930d4fb5eaf50b1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:08.275444 11268 raft_consensus.cc:2804] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 14:52:08.290043  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:08.291000  7848 raft_consensus.cc:2393] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 6: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:52:08.291951  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:08.293366 11225 raft_consensus.cc:2749] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 14:52:08.296494  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:08.298918  7854 raft_consensus.cc:2393] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 11: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:52:08.300146  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:08.300843  7854 raft_consensus.cc:2468] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 8.
I20260709 14:52:08.302538  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:08.304450  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:08.305169  7854 raft_consensus.cc:2376] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 8. Re-sending same reply.
I20260709 14:52:08.305861  7850 raft_consensus.cc:3060] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:52:08.306126  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:08.308472  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:08.236335 11119 raft_consensus.cc:515] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:08.267292 11099 raft_consensus.cc:2804] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 14:52:08.315052  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:08.315275  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:08.319088  7849 raft_consensus.cc:2376] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 11. Re-sending same reply.
W20260709 14:52:08.321061  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 66850.9us
I20260709 14:52:08.322933  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:08.307826 11268 raft_consensus.cc:493] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:08.326335  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:08.252341 11223 raft_consensus.cc:515] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:08.329223  7745 leader_election.cc:336] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 1.597s (SENT)
I20260709 14:52:08.329897  7745 leader_election.cc:304] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:52:08.335438 11306 log.cc:927] Time spent T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 14:52:08.335804 11119 leader_election.cc:290] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:08.318730 11099 raft_consensus.cc:493] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:08.336769 11099 raft_consensus.cc:3060] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:52:08.337492  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:08.339797  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:08.340662  7845 raft_consensus.cc:2393] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 8: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:52:08.335475  7848 raft_consensus.cc:2468] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 9.
I20260709 14:52:08.341864  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:08.342763  7770 raft_consensus.cc:2468] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 11.
I20260709 14:52:08.344113  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:08.344746  7854 raft_consensus.cc:2393] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 7: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:52:08.348980  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:08.349781  7853 raft_consensus.cc:1240] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 9. Current term is 10. Ops: []
W20260709 14:52:08.350642  7893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:52:08.351949  7893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:08.354336  7854 raft_consensus.cc:2393] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 11: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:52:08.354571  7773 raft_consensus.cc:1240] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 14:52:08.329999 11268 raft_consensus.cc:3060] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:52:08.364588  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:08.370904  7777 raft_consensus.cc:2410] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 14:52:08.365959  7770 raft_consensus.cc:1240] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 14:52:08.366860  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:08.375641  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
W20260709 14:52:08.430158  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:08.430632  7774 raft_consensus.cc:2410] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 14:52:08.429731  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:08.428934  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:08.432109  7773 raft_consensus.cc:2393] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 9: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:52:08.355190 11130 raft_consensus.cc:2749] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 14:52:08.443405  7745 leader_election.cc:336] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 1.614s (SENT)
W20260709 14:52:08.428997  7743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:52:08.434376  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 184017us
W20260709 14:52:08.428746  7893 leader_election.cc:336] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Timed out: RequestConsensusVote RPC to 127.6.101.65:40587 timed out after 2.158s (SENT)
I20260709 14:52:08.446417  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:08.452167  7779 raft_consensus.cc:2410] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
W20260709 14:52:08.452709  8598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 146992us
I20260709 14:52:08.455729  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:08.456568  7846 raft_consensus.cc:2368] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 11. Current term is 12.
W20260709 14:52:08.457038  7742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:08.459581  7775 raft_consensus.cc:2393] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 11: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:52:08.460965  7894 leader_election.cc:304] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:08.361069 11052 raft_consensus.cc:515] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:08.459828  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:08.464668  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:08.496050  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:08.476438  7854 raft_consensus.cc:2393] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 11: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
W20260709 14:52:08.483155  7743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:52:08.484217  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:08.462647  7894 leader_election.cc:304] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:08.445926 11294 raft_consensus.cc:493] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:08.509397  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:08.510495  7854 raft_consensus.cc:2376] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 12. Re-sending same reply.
W20260709 14:52:08.517472  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 54933.6us
W20260709 14:52:08.518195  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 74884.3us
W20260709 14:52:08.522837  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 151859us
W20260709 14:52:08.513055 11313 log.cc:927] Time spent T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.181s	user 0.002s	sys 0.004s
I20260709 14:52:08.528806 11050 leader_election.cc:290] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:08.529543 11223 leader_election.cc:290] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:52:08.531946  7893 leader_election.cc:336] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Timed out: RequestConsensusVote RPC to 127.6.101.65:40587 timed out after 2.237s (SENT)
I20260709 14:52:08.533717 11223 raft_consensus.cc:493] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:08.534657 11223 raft_consensus.cc:515] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:08.507354 11131 raft_consensus.cc:2804] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 14:52:08.537526 11131 raft_consensus.cc:493] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:08.538046 11131 raft_consensus.cc:3060] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:52:08.528671  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:08.517823 11294 raft_consensus.cc:515] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:08.544763  7854 raft_consensus.cc:2376] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 12. Re-sending same reply.
I20260709 14:52:08.546871 11294 leader_election.cc:290] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:08.547205 11223 leader_election.cc:290] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:52:08.549619  7742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:08.550412  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:08.552733  7770 raft_consensus.cc:2468] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 10.
W20260709 14:52:08.553321 11308 log.cc:927] Time spent T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.230s	user 0.002s	sys 0.001s
I20260709 14:52:08.555534  7775 raft_consensus.cc:1275] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 14:52:08.558447  7774 raft_consensus.cc:1240] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 10. Current term is 11. Ops: []
W20260709 14:52:08.559527  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:08.558964  7775 pending_rounds.cc:85] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed: Aborting all ops after (but not including) 3
I20260709 14:52:08.560042  7775 pending_rounds.cc:107] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 14:52:08.560359  7775 raft_consensus.cc:2889] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:52:08.558661  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
W20260709 14:52:08.565073  7743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:08.522315  7894 leader_election.cc:304] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:08.564409  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
W20260709 14:52:08.566211  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 46127.3us
I20260709 14:52:08.567003  7894 leader_election.cc:304] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:08.572727  7850 raft_consensus.cc:2468] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 11.
I20260709 14:52:08.574242  7770 raft_consensus.cc:1240] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 14:52:08.580608 11223 raft_consensus.cc:2804] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 14:52:08.580853 11168 raft_consensus.cc:2804] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 14:52:08.521883 11317 raft_consensus.cc:2804] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 14:52:08.547554 11294 raft_consensus.cc:493] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:52:08.586690  7745 leader_election.cc:336] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 1.615s (SENT)
W20260709 14:52:08.591746  8598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 45211.8us
I20260709 14:52:08.592931  7894 leader_election.cc:304] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:08.599386  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:08.599471  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:08.600509  7850 raft_consensus.cc:2393] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 9: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:52:08.586342 11168 raft_consensus.cc:493] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:08.587934 11317 raft_consensus.cc:493] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:08.602638  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:08.586146 11223 raft_consensus.cc:697] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
W20260709 14:52:08.604290  7742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:08.610298  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
W20260709 14:52:08.611620  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 48473.1us
W20260709 14:52:08.603686 11315 log.cc:927] Time spent T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.059s	user 0.002s	sys 0.001s
I20260709 14:52:08.614547  7854 raft_consensus.cc:3060] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:52:08.597764 11052 leader_election.cc:290] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 11 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:08.603868 11040 raft_consensus.cc:2804] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 14:52:08.604044 11168 raft_consensus.cc:3060] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:52:08.588491 11099 raft_consensus.cc:515] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:08.621448  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:08.608315 11317 raft_consensus.cc:3060] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:52:08.631479  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258d6c2dda954bf5b65930fde8ecb9f3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:08.632757  7848 raft_consensus.cc:2393] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 7: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:52:08.620427 11050 raft_consensus.cc:493] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:08.608836 11293 consensus_queue.cc:1048] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 14:52:08.601980 11268 raft_consensus.cc:515] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:08.642844  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:08.648914 11295 raft_consensus.cc:493] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:52:08.639184  7770 raft_consensus.cc:2468] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 5.
I20260709 14:52:08.649825 11223 consensus_queue.cc:237] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:08.650342  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:08.652877  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:08.614840 11294 raft_consensus.cc:515] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:08.653967  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:08.654301  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:08.679757  7848 raft_consensus.cc:2393] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 9: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:52:08.655709  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:08.656597  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:08.657531  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:08.681336  7774 raft_consensus.cc:2410] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 14:52:08.646986 11099 leader_election.cc:290] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 9 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:08.635447 11052 raft_consensus.cc:493] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:52:08.674146 11314 log.cc:927] Time spent T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.130s	user 0.000s	sys 0.002s
I20260709 14:52:08.670436 11050 raft_consensus.cc:515] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:08.689211  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:08.690459 11287 raft_consensus.cc:493] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:08.691157 11287 raft_consensus.cc:515] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:08.631227 11040 raft_consensus.cc:697] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:08.693524 11294 leader_election.cc:290] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:08.694319 11040 consensus_queue.cc:237] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:08.693801 11287 leader_election.cc:290] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:08.696324 11050 leader_election.cc:290] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:08.683013  7779 raft_consensus.cc:2410] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 14:52:08.701442 11295 raft_consensus.cc:515] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:08.703199 11131 raft_consensus.cc:515] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:08.704136 11295 leader_election.cc:290] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:08.707103 11052 raft_consensus.cc:515] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:08.712091  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 87279.9us
W20260709 14:52:08.714552  7745 leader_election.cc:336] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 1.661s (SENT)
I20260709 14:52:08.715210  7745 leader_election.cc:304] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:52:08.718406  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 113986us
I20260709 14:52:08.726055  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 11 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:08.727152  7776 raft_consensus.cc:2410] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for term 11 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 3.
I20260709 14:52:08.734413  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:08.735915  7847 raft_consensus.cc:2410] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 14:52:08.740841  7854 raft_consensus.cc:2410] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 14:52:08.729666  7894 leader_election.cc:304] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:08.768230 11168 raft_consensus.cc:515] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:08.759680  7776 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f"
dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:37144
I20260709 14:52:08.769523  7776 raft_consensus.cc:493] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:52:08.769932  7776 raft_consensus.cc:3060] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:52:08.770948 11168 leader_election.cc:290] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:08.773653  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:08.774669  7847 raft_consensus.cc:2468] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 9.
I20260709 14:52:08.776798  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:08.780160  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:08.764935 11327 raft_consensus.cc:493] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:08.778532  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:08.777660  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:08.749634 11131 leader_election.cc:290] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 9 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:08.744149 10987 raft_consensus.cc:2749] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 14:52:08.790874  7846 raft_consensus.cc:1275] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 14:52:08.820349  7853 raft_consensus.cc:2368] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 11. Current term is 12.
I20260709 14:52:08.792691  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:08.820472  7852 raft_consensus.cc:3060] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:52:08.822742  7774 raft_consensus.cc:3060] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:52:08.789397  7778 raft_consensus.cc:1275] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 14:52:08.823734  7778 pending_rounds.cc:85] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed: Aborting all ops after (but not including) 4
I20260709 14:52:08.823993  7778 pending_rounds.cc:107] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 14:52:08.824467  7778 raft_consensus.cc:2889] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:52:08.762130  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:08.790179  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:08.782332  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:08.826716  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:52:08.820472  7743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:08.826817  7849 raft_consensus.cc:2468] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 10.
I20260709 14:52:08.799388  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9441e831627143a991a1556dcdce71e3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:08.786319  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
W20260709 14:52:08.806869  7894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:08.983038  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:08.790418  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:09.021219  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:52:08.948127  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:09.052872  7854 raft_consensus.cc:2468] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 10.
I20260709 14:52:09.054553  7846 raft_consensus.cc:2468] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 11.
W20260709 14:52:08.909559  7742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:08.899338  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
W20260709 14:52:09.054419  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:08.900063  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:09.056816  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
W20260709 14:52:09.052755  7894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:08.790858  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18d29d52d304c87b930d4fb5eaf50b1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:09.057511  7778 raft_consensus.cc:3060] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Advancing to term 11
W20260709 14:52:09.033676  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:08.947327  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:09.074512  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:09.074843  7852 raft_consensus.cc:2468] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 9.
W20260709 14:52:09.004169  7893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:52:09.085067  7893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:52:09.088225  7743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:52:09.088667  7743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:08.948091  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:52:08.851341  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 136827us
I20260709 14:52:09.092216  7848 raft_consensus.cc:2468] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 12.
I20260709 14:52:09.089309  7854 raft_consensus.cc:2468] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 9.
I20260709 14:52:09.089339  7676 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54350 (request call id 372) took 9289 ms. Trace:
I20260709 14:52:08.765781 11294 raft_consensus.cc:2804] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 14:52:08.879576  7776 raft_consensus.cc:515] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:08.811045 11119 raft_consensus.cc:493] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:09.124193  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:09.127876  7771 raft_consensus.cc:1240] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 9. Current term is 10. Ops: []
I20260709 14:52:08.780417 11052 leader_election.cc:290] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:09.133942  7776 leader_election.cc:290] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 10 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:09.124722  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
W20260709 14:52:09.122304  7742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:09.131299  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:09.131506  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:09.125525  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:08.830638 11050 raft_consensus.cc:493] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:08.798810 11268 leader_election.cc:290] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:09.069456 11225 raft_consensus.cc:493] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:09.166268  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:09.151407  7775 raft_consensus.cc:2410] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 14:52:09.136861  7846 raft_consensus.cc:3060] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Advancing to term 6
W20260709 14:52:09.139037  7745 leader_election.cc:336] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 1.671s (SENT)
I20260709 14:52:09.168653  7745 leader_election.cc:304] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:09.155643  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:09.005230 11168 raft_consensus.cc:493] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:09.154258  7772 raft_consensus.cc:2468] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 11.
I20260709 14:52:09.153236  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:09.175697  7849 raft_consensus.cc:2468] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 12.
I20260709 14:52:09.165181  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:09.170516  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:09.177373  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:09.178133  7851 raft_consensus.cc:3060] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:52:09.124545 11099 raft_consensus.cc:493] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:09.171103  7854 raft_consensus.cc:3060] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:52:09.203845  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:52:09.204938  7742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:09.178699  7777 raft_consensus.cc:2410] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 14:52:09.206595  7674 catalog_manager.cc:5697] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 6 to 7, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 7 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:52:09.209692 11295 raft_consensus.cc:493] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:09.210604 11295 raft_consensus.cc:515] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:09.212313  7779 raft_consensus.cc:2468] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 9.
I20260709 14:52:09.213804 11293 raft_consensus.cc:493] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:09.158666 11052 raft_consensus.cc:493] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:52:09.214886 11293 raft_consensus.cc:515] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:09.215060 11052 raft_consensus.cc:515] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:09.217650 11099 raft_consensus.cc:515] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:09.097559  7676 rpcz_store.cc:276] 0709 14:51:59.785228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:51:59.805891 (+ 20663us) service_pool.cc:224] Handling call
0709 14:52:09.074140 (+9268249us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 14:52:07.698032 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 14:52:07.698853 (+   821us) write_op.cc:432] Acquiring schema lock in shared mode
0709 14:52:07.698908 (+    55us) write_op.cc:435] Acquired schema lock
0709 14:52:07.698929 (+    21us) tablet.cc:662] Decoding operations
0709 14:52:07.699681 (+   752us) write_op.cc:620] Acquiring the partition lock for write op
0709 14:52:07.699817 (+   136us) write_op.cc:641] Partition lock acquired for write op
0709 14:52:07.699851 (+    34us) tablet.cc:685] Acquiring locks for 4 operations
0709 14:52:07.700434 (+   583us) tablet.cc:701] Row locks acquired
0709 14:52:07.700491 (+    57us) write_op.cc:260] PREPARE: finished
0709 14:52:07.700800 (+   309us) write_op.cc:270] Start()
0709 14:52:07.700956 (+   156us) write_op.cc:276] Timestamp: P: 1783608727700666 usec, L: 0
0709 14:52:07.700997 (+    41us) op_driver.cc:348] REPLICATION: starting
0709 14:52:07.738893 (+ 37896us) log.cc:844] Serialized 1694 byte log entry
0709 14:52:07.999942 (+261049us) spinlock_profiling.cc:243] Waited 3.76 ms on lock 0x7b4400022b4c. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb687c29db1 00007fb687cc7c85 00007fb687cc86a2 00007fb68aa3a1db 00007fb68aa35aaf 00007fb68aa2986e 00007fb68aa28bb6 00007fb68aa287d8 00007fb68aa32221 00007fb68aa321d9 00007fb68aa32169
0709 14:52:08.239590 (+239648us) op_driver.cc:464] REPLICATION: finished
0709 14:52:08.357681 (+118091us) write_op.cc:301] APPLY: starting
0709 14:52:08.370855 (+ 13174us) tablet.cc:1367] starting BulkCheckPresence
0709 14:52:08.375250 (+  4395us) tablet.cc:1370] finished BulkCheckPresence
0709 14:52:08.375291 (+    41us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 14:52:08.548703 (+173412us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 14:52:08.549085 (+   382us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=8
0709 14:52:08.549150 (+    65us) write_op.cc:312] APPLY: finished
0709 14:52:08.549780 (+   630us) log.cc:844] Serialized 41 byte log entry
0709 14:52:08.550059 (+   279us) write_op.cc:489] Releasing partition, row and schema locks
0709 14:52:08.550170 (+   111us) write_op.cc:454] Released schema lock
0709 14:52:08.550239 (+    69us) write_op.cc:341] FINISH: Updating metrics
0709 14:52:08.551099 (+   860us) write_op.cc:489] Releasing partition, row and schema locks
0709 14:52:08.551136 (+    37us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1825675,"reported_tablets":22,"child_traces":[["op",{"apply.queue_time_us":84499,"apply.run_cpu_time_us":11847,"apply.run_wall_time_us":208002,"num_ops":4,"prepare.queue_time_us":169634,"prepare.run_cpu_time_us":60662,"prepare.run_wall_time_us":219725,"raft.queue_time_us":255227,"raft.run_cpu_time_us":39320,"raft.run_wall_time_us":264352,"replication_time_us":538012,"spinlock_wait_cycles":8658304,"thread_start_us":405803,"threads_started":4,"wal-append.queue_time_us":183789}]]}
I20260709 14:52:09.225476  7847 raft_consensus.cc:2393] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 12: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:52:09.213877  7853 raft_consensus.cc:1275] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 14:52:09.230903  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:09.202762 11287 raft_consensus.cc:2749] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 14:52:09.203145 11168 raft_consensus.cc:515] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:09.233690 11295 leader_election.cc:290] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:09.235272  7771 raft_consensus.cc:2393] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 9: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:52:09.257874  7674 catalog_manager.cc:5697] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 6 to 7, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 7 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:52:09.206132  7848 raft_consensus.cc:3060] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:52:09.179375  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:09.283780  7854 raft_consensus.cc:2468] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 9.
I20260709 14:52:09.285014  7852 raft_consensus.cc:1240] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 8. Current term is 9. Ops: []
I20260709 14:52:09.291193  7674 catalog_manager.cc:5697] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 6 to 7, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 7 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:52:09.276801  7851 raft_consensus.cc:2468] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 9.
I20260709 14:52:09.181082 11050 raft_consensus.cc:515] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:08.878384 11327 raft_consensus.cc:515] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:09.348716  7848 raft_consensus.cc:2468] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 11.
I20260709 14:52:09.335655  7778 raft_consensus.cc:2468] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 11.
I20260709 14:52:09.174485 11225 raft_consensus.cc:515] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:09.166369 11119 raft_consensus.cc:515] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:09.418493  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 279551us
I20260709 14:52:09.431730  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:09.434716  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:09.435473  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258d6c2dda954bf5b65930fde8ecb9f3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:09.436087  7849 raft_consensus.cc:2468] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 7.
W20260709 14:52:09.445945  7774 consensus_meta.cc:287] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent flushing consensus metadata: real 0.615s	user 0.014s	sys 0.000s
I20260709 14:52:09.446502  7774 raft_consensus.cc:2468] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 12.
W20260709 14:52:09.449321  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:09.451658  7851 raft_consensus.cc:1275] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 14:52:09.454437  7852 raft_consensus.cc:1275] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 14:52:09.427505 11294 raft_consensus.cc:697] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:09.446822  7674 catalog_manager.cc:5697] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 6 to 7, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 7 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:52:09.461313  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:09.462224  7922 raft_consensus.cc:1240] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 10. Current term is 11. Ops: []
I20260709 14:52:09.462185  7845 raft_consensus.cc:3060] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:52:09.463455  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:09.465660  7854 raft_consensus.cc:1275] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 14:52:09.469444  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:09.470503 11168 leader_election.cc:290] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:09.470916 11050 leader_election.cc:290] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:09.471185  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:09.471711 11265 raft_consensus.cc:493] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:09.472033  7925 raft_consensus.cc:2410] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 14:52:09.472219 11265 raft_consensus.cc:515] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:09.474527 11265 leader_election.cc:290] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:52:09.476583  7745 leader_election.cc:336] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 1.673s (SENT)
I20260709 14:52:09.476763  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:09.477416  7847 raft_consensus.cc:3060] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:52:09.462512 11131 raft_consensus.cc:493] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:52:09.478008  7743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:09.478566 11131 raft_consensus.cc:515] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:09.481513 11331 log.cc:927] Time spent T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.193s	user 0.002s	sys 0.000s
I20260709 14:52:09.482921 11131 leader_election.cc:290] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:09.484344  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:09.485539 11225 leader_election.cc:290] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:09.487347  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:09.488010  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:09.487356 11099 leader_election.cc:290] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:09.488415  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:09.487465  7925 raft_consensus.cc:2410] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 14:52:09.457604 11040 raft_consensus.cc:493] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:09.490674 11040 raft_consensus.cc:515] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:09.492570 11119 leader_election.cc:290] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:09.492944 11040 leader_election.cc:290] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:09.493517  7776 raft_consensus.cc:3060] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:52:09.489729  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:09.496327  7778 raft_consensus.cc:2376] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 11. Re-sending same reply.
I20260709 14:52:09.489843  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:09.489312  7779 raft_consensus.cc:2468] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 11.
I20260709 14:52:09.498054  7846 raft_consensus.cc:2468] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 6.
I20260709 14:52:09.504462  7854 raft_consensus.cc:1275] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 14:52:09.505110  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
W20260709 14:52:09.519742  7743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:09.505568 11294 consensus_queue.cc:237] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:09.512111  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
W20260709 14:52:09.513343 11317 consensus_meta.cc:287] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent flushing consensus metadata: real 0.839s	user 0.010s	sys 0.005s
I20260709 14:52:09.522636 11317 raft_consensus.cc:515] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:09.525738  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:09.527063  7774 raft_consensus.cc:2468] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 9.
I20260709 14:52:09.529348 11327 leader_election.cc:290] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:52:09.530460 11330 log.cc:927] Time spent T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
I20260709 14:52:09.532104 11293 leader_election.cc:290] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:52:09.533001 11333 log.cc:927] Time spent T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.320s	user 0.000s	sys 0.004s
I20260709 14:52:09.534755 11052 leader_election.cc:290] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:09.536715  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:09.537636  7919 raft_consensus.cc:3060] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:52:09.538328  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:09.537696  7924 raft_consensus.cc:1240] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 8. Current term is 9. Ops: []
I20260709 14:52:09.538697  7920 raft_consensus.cc:1275] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 14:52:09.536823  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:09.540645  7922 raft_consensus.cc:3060] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:52:09.540982  7894 leader_election.cc:304] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:09.542482  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:09.540792  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:09.544152  7921 raft_consensus.cc:2468] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 13.
I20260709 14:52:09.544607  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
W20260709 14:52:09.544981  7743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:52:09.544672  7742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:09.545305  7779 raft_consensus.cc:3060] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Advancing to term 9
W20260709 14:52:09.545276  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:09.540647  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:09.547860  7925 raft_consensus.cc:2468] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 12.
I20260709 14:52:09.548350  7924 raft_consensus.cc:2393] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 9: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
W20260709 14:52:09.551311  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 74731.1us
I20260709 14:52:09.551700 11052 raft_consensus.cc:2804] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 14:52:09.551280  7776 raft_consensus.cc:2410] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 14:52:09.552150  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:09.526475 11317 leader_election.cc:290] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:09.552698  7771 raft_consensus.cc:3055] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 LEADER]: Stepping down as leader of term 10
W20260709 14:52:09.552277  7745 leader_election.cc:336] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 1.688s (SENT)
I20260709 14:52:09.562475  7745 leader_election.cc:304] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:09.552747  7894 leader_election.cc:304] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
W20260709 14:52:09.552403 11337 log.cc:927] Time spent T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.124s	user 0.000s	sys 0.001s
I20260709 14:52:09.560474  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:09.568267  7845 raft_consensus.cc:2468] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 10.
I20260709 14:52:09.552286  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:09.566771  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258d6c2dda954bf5b65930fde8ecb9f3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
W20260709 14:52:09.568560  7742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:09.569195  7894 leader_election.cc:304] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:09.571892  7778 raft_consensus.cc:2468] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 7.
I20260709 14:52:09.552151 11052 raft_consensus.cc:493] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:09.568143  7773 raft_consensus.cc:2393] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 10: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:52:09.567207  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:09.575564 11340 raft_consensus.cc:2804] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 14:52:09.575637 11052 raft_consensus.cc:3060] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:52:09.579761  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:09.575738 11287 raft_consensus.cc:493] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9418391fa82a42c79c6cad13ba91d964)
I20260709 14:52:09.579336 11340 raft_consensus.cc:493] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:09.581423 11340 raft_consensus.cc:3060] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:52:09.581039 11287 raft_consensus.cc:515] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:52:09.584151 11287 leader_election.cc:290] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785), 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68:42321)
I20260709 14:52:09.558390 11293 consensus_queue.cc:1048] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 14:52:09.575918  7926 raft_consensus.cc:2393] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 12: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:52:09.561846  7771 raft_consensus.cc:740] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:52:09.572991  7894 leader_election.cc:304] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:09.559201  7674 catalog_manager.cc:5697] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 10 to 12, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 12 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:52:09.573120 11327 raft_consensus.cc:2804] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 14:52:09.577409  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:09.593168  7894 leader_election.cc:304] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:09.594978  7894 leader_election.cc:304] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:09.597012  7894 leader_election.cc:304] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:09.607338  7922 raft_consensus.cc:2468] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 9.
I20260709 14:52:09.607317  7919 raft_consensus.cc:2468] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 10.
I20260709 14:52:09.610786  7776 raft_consensus.cc:1275] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 14:52:09.611627  7776 pending_rounds.cc:85] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed: Aborting all ops after (but not including) 5
I20260709 14:52:09.612167  7776 pending_rounds.cc:107] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 14:52:09.612457  7776 raft_consensus.cc:2889] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:52:09.575922 11225 raft_consensus.cc:2749] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 14:52:09.610675  7771 consensus_queue.cc:260] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:09.603346 11131 raft_consensus.cc:2804] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 14:52:09.599854 11327 raft_consensus.cc:493] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:09.620815  7779 raft_consensus.cc:2410] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 14:52:09.611517  7774 raft_consensus.cc:2468] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 12.
I20260709 14:52:09.599560 11317 raft_consensus.cc:2804] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 14:52:09.623178  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:09.603003 11040 raft_consensus.cc:2804] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 14:52:09.635077  7894 leader_election.cc:304] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:09.638253  7776 raft_consensus.cc:1275] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 9. (term mismatch)
I20260709 14:52:09.639555  7771 raft_consensus.cc:3060] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:52:09.640791  7776 pending_rounds.cc:85] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed: Aborting all ops after (but not including) 8
I20260709 14:52:09.641137  7776 pending_rounds.cc:107] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed: Aborting uncommitted NO_OP operation due to leader change: 11.9
I20260709 14:52:09.640302  7674 catalog_manager.cc:5697] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 8 to 9, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 9 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:52:09.637434  7894 leader_election.cc:304] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:09.642189  7776 raft_consensus.cc:2889] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:52:09.642334  7894 leader_election.cc:304] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:09.626734  8639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce9c0ef2db24c13a8b1402f21819458" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9418391fa82a42c79c6cad13ba91d964" is_pre_election: true
I20260709 14:52:09.623723 11131 raft_consensus.cc:493] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:09.627650 11327 raft_consensus.cc:3060] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:52:09.627364 11317 raft_consensus.cc:493] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:09.628986 11040 raft_consensus.cc:493] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 14:52:09.643982  7893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:09.646601  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:09.650784  7773 raft_consensus.cc:2468] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 5.
I20260709 14:52:09.645583 11342 raft_consensus.cc:2804] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 14:52:09.653496 11040 raft_consensus.cc:3060] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 14:52:09.653475 11168 raft_consensus.cc:2804] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 14:52:09.657879 11168 raft_consensus.cc:493] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:09.658265 11168 raft_consensus.cc:3060] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 14:52:09.648491 11131 raft_consensus.cc:3060] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 14:52:09.661854 11339 consensus_queue.cc:1048] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 14:52:09.639914 11119 raft_consensus.cc:2804] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 14:52:09.666222 11119 raft_consensus.cc:697] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:09.666438  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:09.667310 11119 consensus_queue.cc:237] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:09.667867  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:09.668678  7770 raft_consensus.cc:2468] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 9.
I20260709 14:52:09.647099 11268 raft_consensus.cc:493] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:09.670003 11268 raft_consensus.cc:515] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:09.670782  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:09.671468  7770 raft_consensus.cc:2468] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 8.
I20260709 14:52:09.672276 11268 leader_election.cc:290] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:09.645406 11265 raft_consensus.cc:2804] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 14:52:09.673444 11265 raft_consensus.cc:697] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:09.674079  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:09.674721  7773 raft_consensus.cc:2468] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 6.
I20260709 14:52:09.674508 11265 consensus_queue.cc:237] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:09.677626  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:09.672803  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:09.678861  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:09.684773  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:09.686002  7770 raft_consensus.cc:2393] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 9: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
W20260709 14:52:09.684902  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 163702us
I20260709 14:52:09.687491  7674 catalog_manager.cc:5697] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 9 to 11, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 11 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:52:09.695132  7847 raft_consensus.cc:2468] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 12.
I20260709 14:52:09.693773  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:09.698294  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:09.704135  7770 raft_consensus.cc:3060] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Advancing to term 12
W20260709 14:52:09.690354  7893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:09.709015  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
W20260709 14:52:09.720572  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 141362us
I20260709 14:52:09.677466 11317 raft_consensus.cc:3060] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:52:09.731230  7773 raft_consensus.cc:2468] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 9.
I20260709 14:52:09.729180  7777 raft_consensus.cc:2468] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 10.
I20260709 14:52:09.735373  7778 raft_consensus.cc:1275] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 14:52:09.736441 11225 raft_consensus.cc:493] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:52:09.737715  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 79433.2us
I20260709 14:52:09.689134 11342 raft_consensus.cc:697] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:09.737061 11225 raft_consensus.cc:515] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:09.752867  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
W20260709 14:52:09.751509  7745 leader_election.cc:336] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 1.858s (SENT)
I20260709 14:52:09.752425  7894 leader_election.cc:304] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:09.759083  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:09.764165  7778 raft_consensus.cc:2468] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 10.
I20260709 14:52:09.774463  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
W20260709 14:52:09.782599  7745 leader_election.cc:336] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 1.893s (SENT)
I20260709 14:52:09.783202  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:09.783520  7745 leader_election.cc:304] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:09.780598 11293 raft_consensus.cc:2804] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 14:52:09.785175 11293 raft_consensus.cc:697] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:09.786556 11293 consensus_queue.cc:237] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:09.792016  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 61278.4us
I20260709 14:52:09.793699 11342 consensus_queue.cc:237] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:09.744583 11340 raft_consensus.cc:515] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:09.800722 11131 raft_consensus.cc:515] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:09.801733  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:09.780943 11287 raft_consensus.cc:493] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:52:09.813495  7742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:09.817544  7770 raft_consensus.cc:2468] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 12.
I20260709 14:52:09.832377  7771 raft_consensus.cc:1275] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 8. (term mismatch)
I20260709 14:52:09.834681  7771 pending_rounds.cc:85] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed: Aborting all ops after (but not including) 7
I20260709 14:52:09.834936  7771 pending_rounds.cc:107] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed: Aborting uncommitted NO_OP operation due to leader change: 10.8
I20260709 14:52:09.835538  7771 raft_consensus.cc:2889] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:52:09.771870 11099 consensus_queue.cc:1048] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.055s
I20260709 14:52:09.821981 11338 raft_consensus.cc:493] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:52:09.854280  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:52:09.853065 11345 log.cc:927] Time spent T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
I20260709 14:52:09.829829 11050 raft_consensus.cc:493] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:09.867657 11340 leader_election.cc:290] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:09.868888 11050 raft_consensus.cc:515] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:09.870859 11347 log.cc:927] Time spent T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 14:52:09.846213 11287 raft_consensus.cc:515] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:09.854378 11052 raft_consensus.cc:515] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:09.876173 11287 leader_election.cc:290] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:09.877441 11052 leader_election.cc:290] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:52:09.881394  7893 leader_election.cc:336] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Timed out: RequestConsensusVote RPC to 127.6.101.65:40587 timed out after 1.580s (SENT)
I20260709 14:52:09.882570 11131 leader_election.cc:290] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 13 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:09.883456 11327 raft_consensus.cc:515] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:09.889173 11327 leader_election.cc:290] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:09.889508 11050 leader_election.cc:290] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:09.861194 11338 raft_consensus.cc:515] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:09.890267 11050 consensus_queue.cc:1048] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 14:52:09.891433 11050 consensus_queue.cc:1243] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer 1e9289592458429bbddb19c2e7b7b7b0 log is divergent from this leader: its last log entry 7.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 14:52:09.893774 11225 leader_election.cc:290] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:52:09.854023  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 101716us
I20260709 14:52:09.903003 11168 raft_consensus.cc:515] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:09.905476  7743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:09.909149  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:09.910408  7851 raft_consensus.cc:2468] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 12.
I20260709 14:52:09.912146 11052 raft_consensus.cc:493] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:52:09.921496  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:09.923172 11338 leader_election.cc:290] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:52:09.903667  7893 leader_election.cc:336] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Timed out: RequestConsensusVote RPC to 127.6.101.65:40587 timed out after 3.405s (SENT)
I20260709 14:52:09.930136  7893 leader_election.cc:304] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:09.932137  7847 raft_consensus.cc:1275] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 14:52:09.932916 11340 raft_consensus.cc:2749] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 14:52:09.927606  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:09.922818 11052 raft_consensus.cc:515] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:09.950088  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:09.951367  7845 raft_consensus.cc:2468] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 9.
I20260709 14:52:09.877092 11287 raft_consensus.cc:2749] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 14:52:09.942044  7743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:09.944020  7851 raft_consensus.cc:2468] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 11.
I20260709 14:52:09.944715  7922 raft_consensus.cc:1240] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 LEADER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 10. Current term is 11. Ops: []
I20260709 14:52:09.949954  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:09.957893  7919 raft_consensus.cc:2468] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 10.
I20260709 14:52:09.953976  7777 raft_consensus.cc:2468] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 12.
I20260709 14:52:09.963343  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:09.964349  7846 raft_consensus.cc:2468] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 9.
I20260709 14:52:09.965077  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:09.966200  7847 raft_consensus.cc:2468] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 6.
I20260709 14:52:09.968472  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:09.969564  7845 raft_consensus.cc:2468] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 9.
W20260709 14:52:09.971768  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 189243us
I20260709 14:52:09.974341  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:09.975466  7854 raft_consensus.cc:2468] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 12.
W20260709 14:52:09.972792  7745 leader_election.cc:336] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 1.954s (SENT)
I20260709 14:52:09.978878  7745 leader_election.cc:304] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:09.980329  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:09.995301  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:09.996321  7849 raft_consensus.cc:3060] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:52:09.981456  7853 raft_consensus.cc:2468] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 10.
I20260709 14:52:09.997985  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:10.001901  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:10.002816  7845 raft_consensus.cc:2468] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 6.
I20260709 14:52:10.009059  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:10.009999  7848 raft_consensus.cc:2468] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 8.
I20260709 14:52:10.013371  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:10.014997  7854 raft_consensus.cc:1275] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 14:52:10.016502  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:10.020291  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
W20260709 14:52:10.022713  7894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:52:10.023355  7894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:52:10.024029  8598 leader_election.cc:336] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Timed out: RequestConsensusVote RPC to 127.6.101.65:40587 timed out after 1.543s (SENT)
I20260709 14:52:10.024503  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:10.024547  7894 leader_election.cc:304] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:10.030498  7771 raft_consensus.cc:1240] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 LEADER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 8. Current term is 9. Ops: []
I20260709 14:52:10.031472  7922 raft_consensus.cc:1240] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 LEADER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 14:52:10.032799  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:10.033272  7925 raft_consensus.cc:1240] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 14:52:10.035867  7852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 3007) took 1250 ms. Trace:
I20260709 14:52:09.977058 11052 leader_election.cc:290] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:10.037097  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
W20260709 14:52:10.037539  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 203637us
I20260709 14:52:10.040086  7777 raft_consensus.cc:3060] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:52:10.036306  7852 rpcz_store.cc:276] 0709 14:52:08.805564 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:09.455581 (+650017us) service_pool.cc:224] Handling call
0709 14:52:09.456035 (+   454us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:52:09.456582 (+   547us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:52:09.456618 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:52:09.457172 (+   554us) log.cc:844] Serialized 26 byte log entry
0709 14:52:09.491148 (+ 33976us) spinlock_profiling.cc:243] Waited 5.51 ms on lock 0x7b180028e7c0. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb690c69de1 00007fb690c765b1 00007fb687d83e07 00007fb690bdeab9 00007fb687da069b 00007fb687d9e93f 00007fb687da0c02 00007fb68aa2820b 00007fb68aa2dd23 00007fb68aa2e0d1 00007fb68ae49a0f
0709 14:52:09.616663 (+125515us) raft_consensus.cc:1645] Marking committed up to 5
0709 14:52:09.616725 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:09.616820 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:52:09.852391 (+235571us) spinlock_profiling.cc:243] Waited 3.48 ms on lock 0x7b4400022b4c. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb687c29db1 00007fb687cc7c85 00007fb687cc86a2 00007fb68aa3a1db 00007fb68aa35aaf 00007fb68aa2986e 00007fb68aa28bb6 00007fb68aa287d8 00007fb68aa32221 00007fb68aa321d9 00007fb68aa32169
0709 14:52:10.035611 (+183220us) raft_consensus.cc:1685] finished
0709 14:52:10.035639 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:10.035799 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":877,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":9578,"spinlock_wait_cycles":20658432,"thread_start_us":125157,"threads_started":1,"wal-append.queue_time_us":207516}
I20260709 14:52:10.045918  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:10.047845  7778 raft_consensus.cc:2468] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 10.
I20260709 14:52:09.967155 11040 raft_consensus.cc:515] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:10.049335  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 76579us
I20260709 14:52:10.054816  7819 leader_election.cc:304] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:10.037580  7894 leader_election.cc:304] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:10.054361  7926 raft_consensus.cc:1240] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 11. Current term is 13. Ops: []
I20260709 14:52:10.017477 11119 raft_consensus.cc:493] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:10.054857  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:10.060894  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:10.061295  7920 raft_consensus.cc:3060] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:52:10.055917  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:10.062356  7778 raft_consensus.cc:2468] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 10.
I20260709 14:52:10.059767  7773 raft_consensus.cc:2410] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 14:52:10.062662  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
W20260709 14:52:10.065392  7742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:10.065418  7774 raft_consensus.cc:2393] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 12: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:52:10.071982  7924 raft_consensus.cc:1240] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 7. Current term is 8. Ops: []
W20260709 14:52:10.076490  8598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 52904.4us
I20260709 14:52:10.072788  7894 leader_election.cc:304] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:10.075127  7922 raft_consensus.cc:1240] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 9. Current term is 10. Ops: [9.7-9.7]
W20260709 14:52:10.081483  7745 leader_election.cc:336] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 1.956s (SENT)
I20260709 14:52:10.082535  7745 leader_election.cc:304] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:10.085084 11352 raft_consensus.cc:2749] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 14:52:10.086067 11317 raft_consensus.cc:515] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:10.089727 11268 consensus_queue.cc:1048] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 14:52:10.102130  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18d29d52d304c87b930d4fb5eaf50b1" candidate_uuid: "9418391fa82a42c79c6cad13ba91d964" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:10.090456 11052 raft_consensus.cc:2804] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 14:52:10.107666 11052 raft_consensus.cc:493] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:10.108368 11052 raft_consensus.cc:3060] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Advancing to term 13
W20260709 14:52:10.091212  7745 leader_election.cc:336] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 1.998s (SENT)
I20260709 14:52:10.110805  7745 leader_election.cc:304] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:10.113464 11352 raft_consensus.cc:2749] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 14:52:10.113772  7773 raft_consensus.cc:1275] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Refusing update from remote peer 9418391fa82a42c79c6cad13ba91d964: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 14:52:10.094900  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18d29d52d304c87b930d4fb5eaf50b1" candidate_uuid: "9418391fa82a42c79c6cad13ba91d964" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:10.089663 11338 raft_consensus.cc:2764] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 14:52:10.118827  7778 raft_consensus.cc:2376] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 9418391fa82a42c79c6cad13ba91d964 in term 5. Re-sending same reply.
I20260709 14:52:10.090118  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
W20260709 14:52:10.121004  7742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:10.121541  7922 raft_consensus.cc:1240] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 LEADER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 14:52:10.122707  7923 raft_consensus.cc:1275] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 14:52:10.124058  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: true dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:10.122718  7928 raft_consensus.cc:1275] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 14:52:10.127786  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:10.047075 11287 raft_consensus.cc:2749] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 14:52:10.130427  7770 raft_consensus.cc:3060] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:52:10.130959 11168 leader_election.cc:290] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:10.059273 11351 raft_consensus.cc:2804] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 14:52:10.132472 11351 raft_consensus.cc:697] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
W20260709 14:52:10.135437  7743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:10.136299 11351 consensus_queue.cc:237] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:10.102252  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:10.146430  7848 raft_consensus.cc:3060] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Advancing to term 12
W20260709 14:52:10.147790  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 75132.4us
W20260709 14:52:10.148466  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 57299.2us
W20260709 14:52:10.149729  7745 leader_election.cc:336] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 2.015s (SENT)
I20260709 14:52:10.137777  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:10.150632  7745 leader_election.cc:304] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:10.151175  7852 raft_consensus.cc:3060] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:52:10.151873  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce9c0ef2db24c13a8b1402f21819458" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
W20260709 14:52:10.159873  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:10.147768  7923 raft_consensus.cc:3055] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 14:52:10.153095  7926 raft_consensus.cc:1240] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 LEADER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 8. Current term is 9. Ops: []
I20260709 14:52:10.162366  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:10.183130  7928 raft_consensus.cc:1275] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 14:52:10.177584  7745 leader_election.cc:336] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 2.033s (SENT)
I20260709 14:52:10.159451  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:10.152997  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:10.190207  7853 raft_consensus.cc:3060] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Advancing to term 13
I20260709 14:52:10.190213  7921 raft_consensus.cc:3060] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:52:10.163174  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:10.198091  7852 raft_consensus.cc:2468] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 10.
I20260709 14:52:10.198442  7846 raft_consensus.cc:3060] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Advancing to term 12
I20260709 14:52:10.186866  7923 raft_consensus.cc:740] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:10.200143  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:10.202487  7777 raft_consensus.cc:2468] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 12.
I20260709 14:52:10.203145  7928 raft_consensus.cc:1275] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 14:52:10.205281  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 52928.2us
I20260709 14:52:10.205327  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
W20260709 14:52:10.211561  7745 leader_election.cc:336] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 2.044s (SENT)
I20260709 14:52:10.235395  7744 leader_election.cc:304] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:52:10.235347  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:10.089141 11317 leader_election.cc:290] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:10.207803  7770 raft_consensus.cc:1275] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
W20260709 14:52:10.239351  7742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:10.239503  7851 raft_consensus.cc:2468] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 7.
I20260709 14:52:10.219226  7849 raft_consensus.cc:2468] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 12.
I20260709 14:52:10.156927 11340 raft_consensus.cc:2804] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 14:52:10.076102 11119 raft_consensus.cc:515] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:10.161630 11040 leader_election.cc:290] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 13 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:10.176961 11287 raft_consensus.cc:2749] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 14:52:10.209924  7893 leader_election.cc:336] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Timed out: RequestConsensusVote RPC to 127.6.101.65:40587 timed out after 1.706s (SENT)
I20260709 14:52:10.237160  7850 raft_consensus.cc:3060] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:52:10.237044  7745 leader_election.cc:304] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 3876b8ee8d744cb18e91d97aae93b1ac, 9418391fa82a42c79c6cad13ba91d964
I20260709 14:52:10.238149  7848 raft_consensus.cc:2468] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 12.
I20260709 14:52:10.254777  7920 raft_consensus.cc:2468] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 9.
I20260709 14:52:10.220731  7921 raft_consensus.cc:2468] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 9.
I20260709 14:52:10.241205  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258d6c2dda954bf5b65930fde8ecb9f3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:10.256562  7851 raft_consensus.cc:3060] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Advancing to term 8
W20260709 14:52:10.244410  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 189697us
I20260709 14:52:10.094223 11349 raft_consensus.cc:493] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:10.232524 11225 raft_consensus.cc:493] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:10.212479 11269 consensus_queue.cc:1048] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 14:52:10.236063  7923 consensus_queue.cc:260] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:10.269318  7846 raft_consensus.cc:2468] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 12.
I20260709 14:52:10.242624 11340 raft_consensus.cc:493] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:10.213316 11352 consensus_queue.cc:1059] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 14:52:10.286989  7923 raft_consensus.cc:3060] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:52:10.291643  7894 leader_election.cc:304] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:10.292833 11317 raft_consensus.cc:2804] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 14:52:10.296464  7854 raft_consensus.cc:1275] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 14:52:10.297008  7894 leader_election.cc:304] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
W20260709 14:52:10.298108  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 93459.9us
I20260709 14:52:10.298593  7927 raft_consensus.cc:1275] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 14:52:10.300191  7851 raft_consensus.cc:2468] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 8.
I20260709 14:52:10.292773 11119 leader_election.cc:290] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:10.306854  7848 raft_consensus.cc:1275] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 14:52:10.310086  7894 leader_election.cc:304] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
W20260709 14:52:10.308382  7893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:52:10.312121  7893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:10.300931  7819 leader_election.cc:304] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 9418391fa82a42c79c6cad13ba91d964
I20260709 14:52:10.290467 11340 raft_consensus.cc:3060] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:52:10.298040 11317 raft_consensus.cc:493] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:10.281291 11225 raft_consensus.cc:515] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:10.322710  7894 leader_election.cc:304] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:10.277295 11349 raft_consensus.cc:515] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:10.338792  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 58205.7us
I20260709 14:52:10.321839 11268 raft_consensus.cc:2804] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 14:52:10.351423  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 116166us
I20260709 14:52:10.315009 11287 raft_consensus.cc:2804] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 14:52:10.352581  7894 leader_election.cc:304] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:10.360282  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:10.375571  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:10.375885  7850 raft_consensus.cc:2468] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 10.
I20260709 14:52:10.328356 11317 raft_consensus.cc:3060] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:52:10.371621  7894 leader_election.cc:304] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:10.377022  7846 raft_consensus.cc:3060] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Advancing to term 13
I20260709 14:52:10.331378 11119 raft_consensus.cc:2804] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 14:52:10.352015 11268 raft_consensus.cc:493] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:10.347107 11340 raft_consensus.cc:515] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:10.373399 11040 raft_consensus.cc:2804] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 14:52:10.396164 11040 raft_consensus.cc:493] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:10.396711 11040 raft_consensus.cc:3060] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:52:10.398330 11340 leader_election.cc:290] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:52:10.406239 11362 log.cc:927] Time spent T 00000000000000000000000000000000 P 133636659113430cb53b321cb0b1d9ee: Append to log took a long time: real 0.076s	user 0.002s	sys 0.000s
I20260709 14:52:10.379356  7853 raft_consensus.cc:2468] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 13.
I20260709 14:52:10.379185 11293 raft_consensus.cc:2804] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 14:52:10.390610  7743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:10.372216 11360 raft_consensus.cc:2804] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 14:52:10.382789  7894 leader_election.cc:304] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
W20260709 14:52:10.408229  7742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:10.355592 11287 raft_consensus.cc:493] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:10.429111  7846 raft_consensus.cc:2468] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 13.
I20260709 14:52:10.387492 11119 raft_consensus.cc:493] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:10.371040 11099 consensus_queue.cc:1048] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 14:52:10.390794 11295 raft_consensus.cc:2804] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 14:52:10.438724  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 55996.6us
W20260709 14:52:10.453923  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 64083.4us
I20260709 14:52:10.392540 11268 raft_consensus.cc:3060] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Advancing to term 11
W20260709 14:52:10.443308  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:10.421622 11293 raft_consensus.cc:493] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 14:52:10.446295  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 242109us
I20260709 14:52:10.449600 11370 raft_consensus.cc:2749] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 14:52:10.439002 11340 raft_consensus.cc:2804] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 14:52:10.436475 11052 raft_consensus.cc:515] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:10.469540 11365 raft_consensus.cc:493] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:10.470521 11365 raft_consensus.cc:515] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:10.439589  7819 leader_election.cc:304] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:10.473357  7819 leader_election.cc:304] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
W20260709 14:52:10.460652  7745 leader_election.cc:336] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 2.057s (SENT)
W20260709 14:52:10.477062  7745 leader_election.cc:336] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 2.058s (SENT)
I20260709 14:52:10.440270 11287 raft_consensus.cc:3060] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:52:10.444676 11119 raft_consensus.cc:3060] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:52:10.454896  7894 leader_election.cc:304] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:10.473430 11365 leader_election.cc:290] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:10.421722 11360 raft_consensus.cc:493] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9418391fa82a42c79c6cad13ba91d964)
I20260709 14:52:10.486750 11360 raft_consensus.cc:3060] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 2 FOLLOWER]: Advancing to term 3
W20260709 14:52:10.487195  7743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:10.490497 11361 raft_consensus.cc:2764] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 14:52:10.454487 11295 raft_consensus.cc:493] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:10.480654 11225 leader_election.cc:290] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:10.491524 11295 raft_consensus.cc:3060] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:52:10.492731 11349 leader_election.cc:290] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:10.495818 11365 consensus_queue.cc:1059] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 14:52:10.497488 11370 consensus_queue.cc:1059] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 14:52:10.498334 11367 consensus_queue.cc:1059] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 14:52:10.497155 11365 consensus_queue.cc:1059] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.002s
W20260709 14:52:10.500404  7742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:10.463732 11293 raft_consensus.cc:3060] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 14:52:10.482769 11342 consensus_queue.cc:1048] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 14:52:10.482148  7893 leader_election.cc:304] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:10.467430 11340 raft_consensus.cc:493] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 14:52:10.507225  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:10.498548 11370 raft_consensus.cc:3055] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 LEADER]: Stepping down as leader of term 8
I20260709 14:52:10.507992 11327 raft_consensus.cc:2749] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 14:52:10.504576 11365 raft_consensus.cc:3055] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 LEADER]: Stepping down as leader of term 9
I20260709 14:52:10.471513 11052 leader_election.cc:290] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 13 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:10.491572 11050 raft_consensus.cc:2764] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 14:52:10.504643 11225 raft_consensus.cc:3055] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 LEADER]: Stepping down as leader of term 7
I20260709 14:52:10.513969  7925 raft_consensus.cc:1240] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 LEADER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 11. Current term is 12. Ops: []
I20260709 14:52:10.531558 11225 raft_consensus.cc:740] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
W20260709 14:52:10.517405  7745 leader_election.cc:336] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 2.088s (SENT)
I20260709 14:52:10.508916 11131 consensus_queue.cc:1048] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 14:52:10.508006 11370 raft_consensus.cc:740] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:52:10.522881 11360 raft_consensus.cc:515] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:52:10.502948 11223 raft_consensus.cc:2804] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 14:52:10.531028  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:10.512607  7923 raft_consensus.cc:2468] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 10.
I20260709 14:52:10.532845  7745 leader_election.cc:304] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:10.508230 11372 raft_consensus.cc:3055] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 LEADER]: Stepping down as leader of term 11
I20260709 14:52:10.508823 11365 raft_consensus.cc:740] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:52:10.506160 11340 raft_consensus.cc:3060] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:52:10.547642 11360 leader_election.cc:290] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 3 election: Requested vote from peers 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785), 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68:42321)
I20260709 14:52:10.550467  8639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1f7722fdea49e0b5e9c5d96633eaf9" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9418391fa82a42c79c6cad13ba91d964"
I20260709 14:52:10.548249  7849 raft_consensus.cc:1240] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Rejecting Update request from peer 9418391fa82a42c79c6cad13ba91d964 for earlier term 2. Current term is 3. Ops: []
I20260709 14:52:10.544768 11370 consensus_queue.cc:260] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:10.543496 11223 raft_consensus.cc:493] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:10.541706 11225 consensus_queue.cc:260] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:10.568862  7894 leader_election.cc:304] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:10.558210 11268 raft_consensus.cc:515] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:10.570569 11295 raft_consensus.cc:515] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:10.566483  7819 leader_election.cc:304] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:10.514742 11352 consensus_queue.cc:1243] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer 1e9289592458429bbddb19c2e7b7b7b0 log is divergent from this leader: its last log entry 11.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 14:52:10.607806  7894 leader_election.cc:304] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:10.610792  7894 leader_election.cc:304] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:10.552909 11040 raft_consensus.cc:515] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:10.617606 11327 raft_consensus.cc:2804] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 14:52:10.617815 11052 raft_consensus.cc:2804] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 14:52:10.591322 11372 raft_consensus.cc:740] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
W20260709 14:52:10.644964  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 78904.7us
I20260709 14:52:10.647889  7893 leader_election.cc:304] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:10.650686  7894 leader_election.cc:304] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:10.646734 11360 raft_consensus.cc:2764] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 14:52:10.646185 11327 raft_consensus.cc:697] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
W20260709 14:52:10.654950  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 199511us
I20260709 14:52:10.643221 11052 raft_consensus.cc:493] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:10.648799 11131 raft_consensus.cc:2804] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 14:52:10.649312 11040 leader_election.cc:290] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:10.668639  7819 leader_election.cc:304] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:10.590039 11351 consensus_queue.cc:1048] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
W20260709 14:52:10.644685  7742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:10.605026 11223 raft_consensus.cc:3060] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Advancing to term 9
W20260709 14:52:10.657598  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 140244us
W20260709 14:52:10.699398  7742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:52:10.714241  7745 leader_election.cc:336] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 2.096s (SENT)
W20260709 14:52:10.714864  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 64307.3us
I20260709 14:52:10.715958  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:10.715942  7745 leader_election.cc:304] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:10.605804 11119 raft_consensus.cc:515] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:10.652837 11352 raft_consensus.cc:2749] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 14:52:10.719777  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:10.721944  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:10.718042  6549 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 14:52:10.748507  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:10.750976  7770 raft_consensus.cc:2376] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 12. Re-sending same reply.
I20260709 14:52:10.751873  7894 leader_election.cc:304] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:10.752252  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:10.752959  7770 raft_consensus.cc:3060] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Advancing to term 10
W20260709 14:52:10.749861  7743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:10.755271  7773 raft_consensus.cc:3060] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Advancing to term 12
W20260709 14:52:10.756664  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 108860us
I20260709 14:52:10.748989  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:10.757771  7779 raft_consensus.cc:3060] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Advancing to term 12
I20260709 14:52:10.753495 11168 raft_consensus.cc:2804] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 14:52:10.754284  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
W20260709 14:52:10.754825 11374 log.cc:927] Time spent T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 14:52:10.658195 11052 raft_consensus.cc:3060] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 14:52:10.720974 11339 raft_consensus.cc:2804] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 14:52:10.753602 11376 consensus_queue.cc:1048] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 14:52:10.770862 11339 raft_consensus.cc:697] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:10.771999 11339 consensus_queue.cc:237] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:10.753697  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:10.775547  7772 raft_consensus.cc:3055] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 LEADER]: Stepping down as leader of term 10
I20260709 14:52:10.776926  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258d6c2dda954bf5b65930fde8ecb9f3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:10.778523 11295 leader_election.cc:290] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 11 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:10.719869 11131 raft_consensus.cc:697] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:10.779043 11372 consensus_queue.cc:260] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:10.719924 11099 raft_consensus.cc:2749] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 14:52:10.776404  7772 raft_consensus.cc:740] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:52:10.723634  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:10.767737  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:10.777987  7775 raft_consensus.cc:3060] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Advancing to term 8
I20260709 14:52:10.721732  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:10.785349  7778 raft_consensus.cc:3060] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:52:10.785496  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:10.780755 11131 consensus_queue.cc:237] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:10.796841  7779 raft_consensus.cc:2468] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 12.
I20260709 14:52:10.797698  7773 raft_consensus.cc:2468] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 12.
I20260709 14:52:10.801046  7770 raft_consensus.cc:2468] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 10.
I20260709 14:52:10.791963  7776 raft_consensus.cc:2376] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 11. Re-sending same reply.
I20260709 14:52:10.673542 11361 consensus_queue.cc:1059] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.115s
I20260709 14:52:10.722451 11216 consensus_queue.cc:1059] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 9418391fa82a42c79c6cad13ba91d964 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.071s
I20260709 14:52:10.806290  7893 leader_election.cc:304] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:10.768951 11360 raft_consensus.cc:2749] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 14:52:10.775825 11287 raft_consensus.cc:515] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:10.720070 11373 consensus_queue.cc:1059] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.087s
I20260709 14:52:10.780803 11372 raft_consensus.cc:3060] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Advancing to term 13
I20260709 14:52:10.809398  7772 consensus_queue.cc:260] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:10.792866 11338 raft_consensus.cc:493] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:10.784822 11168 raft_consensus.cc:697] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
W20260709 14:52:10.818931  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 162267us
I20260709 14:52:10.802091 11352 raft_consensus.cc:2749] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 14:52:10.830775  7743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:52:10.819083  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 67322.7us
I20260709 14:52:10.834307  7778 raft_consensus.cc:2468] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 10.
I20260709 14:52:10.762320 11365 consensus_queue.cc:260] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:10.828503 11099 raft_consensus.cc:2749] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 14:52:10.848147  7894 leader_election.cc:304] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:10.854566 11050 consensus_queue.cc:1059] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 14:52:10.863788 11370 raft_consensus.cc:3060] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Advancing to term 9
W20260709 14:52:10.871340  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 157143us
W20260709 14:52:10.872308  7745 leader_election.cc:336] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 2.183s (SENT)
I20260709 14:52:10.873000  7745 leader_election.cc:304] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:10.828400 11338 raft_consensus.cc:515] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:10.878340  7894 leader_election.cc:304] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:10.879449 11295 raft_consensus.cc:2804] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 14:52:10.883359  7894 leader_election.cc:304] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:10.886451  7894 leader_election.cc:304] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:10.826169 11327 consensus_queue.cc:237] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:10.904668  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 56691.7us
I20260709 14:52:10.908902  7893 leader_election.cc:304] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:10.880393 11268 leader_election.cc:290] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 11 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:10.869596 11342 consensus_queue.cc:1048] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 14:52:10.887128 11365 raft_consensus.cc:3060] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:52:10.901717 11378 raft_consensus.cc:2804] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 14:52:10.902697 11265 raft_consensus.cc:2804] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 14:52:10.879789 11349 consensus_queue.cc:1048] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.033s
W20260709 14:52:10.927006  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 81544.8us
I20260709 14:52:10.927619 11361 consensus_queue.cc:1048] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 14:52:10.928912  7742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:52:10.931100  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 44765.9us
I20260709 14:52:10.933112  7819 leader_election.cc:304] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:10.934547  7819 leader_election.cc:304] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:10.936836  7819 leader_election.cc:304] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:10.938064 11040 raft_consensus.cc:2749] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 14:52:10.939237  7819 leader_election.cc:304] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:10.916088 11351 raft_consensus.cc:2804] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 14:52:10.948361  7893 leader_election.cc:304] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:10.920435 11373 consensus_queue.cc:1243] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer 1e9289592458429bbddb19c2e7b7b7b0 log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
W20260709 14:52:10.952798  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 80476.7us
W20260709 14:52:10.956213  7745 leader_election.cc:336] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 2.207s (SENT)
I20260709 14:52:10.956724  7745 leader_election.cc:304] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:10.941669 11378 raft_consensus.cc:697] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:10.912317 11168 consensus_queue.cc:237] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:10.966923  7744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:10.946381 11265 raft_consensus.cc:697] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
W20260709 14:52:10.991741  7745 leader_election.cc:336] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 2.294s (SENT)
I20260709 14:52:10.992373  7745 leader_election.cc:304] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:52:10.957841 11317 consensus_meta.cc:287] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent flushing consensus metadata: real 0.548s	user 0.014s	sys 0.000s
I20260709 14:52:10.949530 11119 leader_election.cc:290] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 7 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:52:10.994540 11385 log.cc:927] Time spent T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.155s	user 0.001s	sys 0.000s
I20260709 14:52:10.994925 11295 raft_consensus.cc:697] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
W20260709 14:52:10.999162  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 50918.2us
I20260709 14:52:11.000067 11389 raft_consensus.cc:2804] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader election won for term 12
I20260709 14:52:10.976864 11373 raft_consensus.cc:2749] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 14:52:10.950636 11340 raft_consensus.cc:515] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:10.967113 11351 raft_consensus.cc:697] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:10.967309 11050 raft_consensus.cc:2804] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 14:52:10.952118 11293 raft_consensus.cc:515] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:11.006554 11379 log.cc:927] Time spent T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.168s	user 0.002s	sys 0.000s
W20260709 14:52:11.007638 11386 log.cc:927] Time spent T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 14:52:11.014775 11040 raft_consensus.cc:3060] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:52:11.017175 11352 raft_consensus.cc:2749] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 14:52:11.017763  7742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:11.021065  7893 leader_election.cc:304] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:11.023716  7775 raft_consensus.cc:2468] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 8.
I20260709 14:52:11.028729 11389 raft_consensus.cc:697] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:52:11.029827 11340 leader_election.cc:290] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 7 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:10.993693 11287 leader_election.cc:290] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:52:11.042315  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 92368.9us
I20260709 14:52:11.046952  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:11.048132  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:11.048393  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:11.049173  7850 raft_consensus.cc:3060] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:52:11.057068  7852 raft_consensus.cc:1275] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 14:52:11.004365 11384 raft_consensus.cc:2749] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 14:52:11.059894  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:11.062438  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:11.062667  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:11.001423 11317 raft_consensus.cc:515] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:11.061964  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:11.060719  7847 raft_consensus.cc:2468] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 11.
I20260709 14:52:11.068269  7852 raft_consensus.cc:3060] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:52:11.031473 11050 raft_consensus.cc:493] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:11.063041  7848 raft_consensus.cc:3060] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Advancing to term 11
I20260709 14:52:11.063230  7849 raft_consensus.cc:3060] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:52:11.063150  7854 raft_consensus.cc:3060] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Advancing to term 10
W20260709 14:52:11.064805  7743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:11.070469 11050 raft_consensus.cc:3060] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Advancing to term 14
I20260709 14:52:11.006640 11052 raft_consensus.cc:515] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:11.075755  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:11.078778  7853 raft_consensus.cc:3060] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Advancing to term 7
W20260709 14:52:11.067549  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 46789.2us
W20260709 14:52:11.081473  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 142775us
I20260709 14:52:11.082442  7848 raft_consensus.cc:2468] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 11.
I20260709 14:52:11.063925 11367 raft_consensus.cc:493] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:52:11.088392  7743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:11.089284 11338 leader_election.cc:290] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:11.094461  7850 raft_consensus.cc:2468] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 11.
I20260709 14:52:11.094921  7849 raft_consensus.cc:2468] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 10.
I20260709 14:52:11.090101 11338 raft_consensus.cc:2804] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader election won for term 10
I20260709 14:52:11.075263 11131 raft_consensus.cc:2749] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 14:52:11.055450 11223 raft_consensus.cc:515] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:11.101349 11388 raft_consensus.cc:493] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:11.121177  7854 raft_consensus.cc:2468] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 10.
I20260709 14:52:11.102597 11367 raft_consensus.cc:515] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:11.124678 11394 consensus_queue.cc:1048] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 14:52:11.140614  7893 leader_election.cc:304] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:11.142887  7853 raft_consensus.cc:2468] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 7.
W20260709 14:52:11.145588  7742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:11.153064 11317 leader_election.cc:290] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:11.122562 11388 raft_consensus.cc:515] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:11.118880 11265 consensus_queue.cc:237] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:11.177331 11388 leader_election.cc:290] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:11.062516 11378 consensus_queue.cc:237] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:11.162039  7852 raft_consensus.cc:2468] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 7.
I20260709 14:52:11.128789 11396 consensus_queue.cc:1048] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 14:52:11.163149 11387 raft_consensus.cc:2804] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader election won for term 9
I20260709 14:52:11.182047 11387 raft_consensus.cc:697] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:52:11.183535 11387 consensus_queue.cc:237] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:11.144030 11295 consensus_queue.cc:237] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:11.164525 11052 leader_election.cc:290] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:11.142455 11389 consensus_queue.cc:237] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:11.173502  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 71315us
I20260709 14:52:11.191183  7819 leader_election.cc:304] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:11.192860  7819 leader_election.cc:304] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:11.153107 11223 leader_election.cc:290] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 9 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:52:11.221280  8598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 157828us
W20260709 14:52:11.222880  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 82359.9us
I20260709 14:52:11.161744 11225 raft_consensus.cc:3060] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Advancing to term 8
I20260709 14:52:11.138027 11351 consensus_queue.cc:237] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:11.236558  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 43799.7us
I20260709 14:52:11.237844  7819 leader_election.cc:304] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:11.222743 11349 raft_consensus.cc:2804] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 14:52:11.193854 11338 raft_consensus.cc:697] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:52:11.243033  7893 leader_election.cc:304] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:11.243796 11295 consensus_queue.cc:1048] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 14:52:11.244906 11388 consensus_queue.cc:1059] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 14:52:11.246959  7745 leader_election.cc:304] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:11.261668  7893 leader_election.cc:304] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:11.248891 11349 raft_consensus.cc:493] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:11.266268  7893 leader_election.cc:304] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:52:11.267949  7742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:11.246959 11372 consensus_queue.cc:1048] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.015s
I20260709 14:52:11.272024  7819 leader_election.cc:304] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:11.277799 11390 raft_consensus.cc:2804] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 14:52:11.278385 11390 raft_consensus.cc:493] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:11.265056 11223 raft_consensus.cc:2749] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 14:52:11.279621 11361 raft_consensus.cc:3055] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 LEADER]: Stepping down as leader of term 8
I20260709 14:52:11.282712 11352 raft_consensus.cc:2749] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 14:52:11.275763 11378 consensus_queue.cc:1048] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.011s
I20260709 14:52:11.278281 11366 raft_consensus.cc:3055] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 9418391fa82a42c79c6cad13ba91d964 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 14:52:11.292364 11366 raft_consensus.cc:740] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 9418391fa82a42c79c6cad13ba91d964 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9418391fa82a42c79c6cad13ba91d964, State: Running, Role: LEADER
I20260709 14:52:11.293484 11405 raft_consensus.cc:2749] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 14:52:11.278873 11390 raft_consensus.cc:3060] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:52:11.263226 11099 raft_consensus.cc:2749] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 14:52:11.311754 11405 raft_consensus.cc:2749] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 14:52:11.313089 11409 raft_consensus.cc:493] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:11.313758 11388 consensus_queue.cc:1048] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 14:52:11.280473 11361 raft_consensus.cc:740] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:52:11.319732 11367 leader_election.cc:290] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:11.325525 11414 raft_consensus.cc:2749] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 14:52:11.266376 11349 raft_consensus.cc:3060] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 6 FOLLOWER]: Advancing to term 7
W20260709 14:52:11.329042  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 65337.9us
I20260709 14:52:11.308713 11223 raft_consensus.cc:2749] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 14:52:11.347407 11396 consensus_queue.cc:1048] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 14:52:11.381222 11352 consensus_queue.cc:1048] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 14:52:11.391204 11355 raft_consensus.cc:3055] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 LEADER]: Stepping down as leader of term 10
I20260709 14:52:11.391878 11355 raft_consensus.cc:740] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:52:11.360958 11409 raft_consensus.cc:515] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:11.393664 11411 log.cc:927] Time spent T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.101s	user 0.002s	sys 0.000s
I20260709 14:52:11.396091 11409 leader_election.cc:290] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:11.365787 11366 consensus_queue.cc:260] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 9418391fa82a42c79c6cad13ba91d964 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:52:11.366895 11040 raft_consensus.cc:2749] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 14:52:11.400790 11382 raft_consensus.cc:3055] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 LEADER]: Stepping down as leader of term 9
I20260709 14:52:11.401841 11382 raft_consensus.cc:740] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:52:11.402024  7819 leader_election.cc:304] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:11.404156  7819 leader_election.cc:304] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:11.403564 11382 consensus_queue.cc:260] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:11.368149 11338 consensus_queue.cc:237] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:11.405916 11420 raft_consensus.cc:3060] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:52:11.409598 11405 raft_consensus.cc:2749] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 14:52:11.370429 11367 consensus_queue.cc:1048] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 14:52:11.392838 11355 consensus_queue.cc:260] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:11.413547 11360 consensus_queue.cc:1059] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 14:52:11.417472  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 47307.9us
I20260709 14:52:11.420009  7819 leader_election.cc:304] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:11.423372  7745 leader_election.cc:304] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:11.373834 11389 raft_consensus.cc:493] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:11.430492 11389 raft_consensus.cc:515] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:11.434309  7894 leader_election.cc:304] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:11.440714  7894 leader_election.cc:304] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:11.446986  7819 leader_election.cc:304] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:11.447124  7894 leader_election.cc:304] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:11.450595  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:11.448963  7894 leader_election.cc:304] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:11.463210  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:11.464720  7775 raft_consensus.cc:3060] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Advancing to term 13
I20260709 14:52:11.464573  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:11.465442  7850 raft_consensus.cc:3060] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Advancing to term 8
I20260709 14:52:11.466216  7846 raft_consensus.cc:3060] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:52:11.439824 11382 raft_consensus.cc:3060] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:52:11.467541  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:11.466395  7744 leader_election.cc:304] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 9418391fa82a42c79c6cad13ba91d964
I20260709 14:52:11.468994  7849 raft_consensus.cc:3060] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:52:11.446396 11225 raft_consensus.cc:2749] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 14:52:11.451519 11396 raft_consensus.cc:2804] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 14:52:11.442368 11050 raft_consensus.cc:515] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:11.443225 11040 raft_consensus.cc:2804] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 14:52:11.462524 11342 raft_consensus.cc:2804] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 14:52:11.447835 11387 raft_consensus.cc:2749] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 14:52:11.491027 11352 consensus_queue.cc:1048] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 14:52:11.486574  7771 raft_consensus.cc:1275] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 14:52:11.486330 11388 consensus_queue.cc:1059] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.010s
I20260709 14:52:11.496498 11388 consensus_queue.cc:1243] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer 1e9289592458429bbddb19c2e7b7b7b0 log is divergent from this leader: its last log entry 9.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 14:52:11.497143 11388 raft_consensus.cc:3055] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 LEADER]: Stepping down as leader of term 8
I20260709 14:52:11.497651 11388 raft_consensus.cc:740] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:52:11.477102 11367 raft_consensus.cc:2749] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 14:52:11.472611 11378 raft_consensus.cc:2804] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 14:52:11.485457 11376 consensus_queue.cc:1048] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.015s
I20260709 14:52:11.498600 11388 consensus_queue.cc:260] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:11.502861 11388 raft_consensus.cc:3060] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:52:11.503369 11050 leader_election.cc:290] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 14 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:11.491636 11040 raft_consensus.cc:493] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:11.504463 11040 raft_consensus.cc:3060] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:52:11.489667 11389 leader_election.cc:290] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:11.473131  7894 leader_election.cc:304] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:11.483965 11405 raft_consensus.cc:2804] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 14:52:11.491125  7772 raft_consensus.cc:3060] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:52:11.487455  7744 leader_election.cc:304] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:52:11.510867  7744 leader_election.cc:304] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:52:11.492072  7850 raft_consensus.cc:2468] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 8.
I20260709 14:52:11.492554  7745 leader_election.cc:304] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:11.495483  7771 pending_rounds.cc:85] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed: Aborting all ops after (but not including) 5
I20260709 14:52:11.515693  7771 pending_rounds.cc:107] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 14:52:11.516031  7771 raft_consensus.cc:2889] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:52:11.520619  7846 raft_consensus.cc:2468] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 12.
I20260709 14:52:11.525733  7775 raft_consensus.cc:2468] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 13.
I20260709 14:52:11.532198  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
W20260709 14:52:11.532290  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 63377.5us
I20260709 14:52:11.533978  7849 raft_consensus.cc:2468] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 9.
I20260709 14:52:11.536161  7921 raft_consensus.cc:1240] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 12. Current term is 13. Ops: []
I20260709 14:52:11.536348  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:11.538168  7920 raft_consensus.cc:3060] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:52:11.539034  7744 leader_election.cc:304] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:52:11.534106  7894 leader_election.cc:304] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:11.541803  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:11.515168 11405 raft_consensus.cc:493] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:11.543494 11052 raft_consensus.cc:2804] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 14:52:11.543996 11392 raft_consensus.cc:2804] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 14:52:11.544844 11367 raft_consensus.cc:2749] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 14:52:11.546242  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 54050.5us
I20260709 14:52:11.547267  7745 leader_election.cc:304] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:11.518005 11376 raft_consensus.cc:2804] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader election won for term 9
I20260709 14:52:11.547910  7922 raft_consensus.cc:1240] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 LEADER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 14:52:11.530360 11225 consensus_queue.cc:1048] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.020s
W20260709 14:52:11.551216 11365 consensus_meta.cc:287] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent flushing consensus metadata: real 0.611s	user 0.011s	sys 0.006s
I20260709 14:52:11.553834  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:11.556730  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:11.557447  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:11.646668  7777 raft_consensus.cc:3060] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Advancing to term 13
I20260709 14:52:11.646953  7779 raft_consensus.cc:3060] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:52:11.559829  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783e4874513449ef9084b833f188a6d3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:11.603801  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:11.602567  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:11.530754 11378 raft_consensus.cc:697] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:11.652102  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:11.650254  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:11.517719 11396 raft_consensus.cc:697] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
W20260709 14:52:11.588964  7744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:11.556954  7773 raft_consensus.cc:1275] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 14:52:11.570190  7921 raft_consensus.cc:1240] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 14:52:11.555876  7770 raft_consensus.cc:1275] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 14:52:11.553632  7894 leader_election.cc:304] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:11.527828 11352 raft_consensus.cc:2804] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader election won for term 9
I20260709 14:52:11.640863  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:11.533176 11342 raft_consensus.cc:697] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:11.642882  7926 raft_consensus.cc:1240] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 14:52:11.644062  7924 raft_consensus.cc:1240] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 11. Current term is 12. Ops: []
I20260709 14:52:11.645478  7922 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
mode: GRACEFUL
new_leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:48676
I20260709 14:52:11.656455  7774 raft_consensus.cc:2468] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 11.
I20260709 14:52:11.649685  7775 raft_consensus.cc:2468] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 11.
I20260709 14:52:11.554342  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:11.657918  7920 raft_consensus.cc:2468] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 11.
I20260709 14:52:11.671532  7779 raft_consensus.cc:2468] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 10.
I20260709 14:52:11.665164  7773 pending_rounds.cc:85] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed: Aborting all ops after (but not including) 5
I20260709 14:52:11.704617  7773 pending_rounds.cc:107] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed: Aborting uncommitted NO_OP operation due to leader change: 7.6
I20260709 14:52:11.705161  7773 raft_consensus.cc:2889] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:52:11.703998  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:11.706815  7770 raft_consensus.cc:3060] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:52:11.705591  7778 raft_consensus.cc:2376] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 12. Re-sending same reply.
I20260709 14:52:11.709527  7777 raft_consensus.cc:2468] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 13.
I20260709 14:52:11.598843 11052 raft_consensus.cc:697] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
W20260709 14:52:11.717502  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 145244us
W20260709 14:52:11.716678  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 163162us
I20260709 14:52:11.604099 11392 raft_consensus.cc:697] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:11.722766  7744 leader_election.cc:304] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:52:11.668216 11405 raft_consensus.cc:3060] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:52:11.716882  7772 raft_consensus.cc:1275] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 14:52:11.727572  7772 pending_rounds.cc:85] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed: Aborting all ops after (but not including) 6
I20260709 14:52:11.727905  7772 pending_rounds.cc:107] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 14:52:11.728153  7772 raft_consensus.cc:2889] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:52:11.723271 11342 consensus_queue.cc:237] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:11.724555 11317 consensus_queue.cc:1048] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 14:52:11.729470  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:11.739899  7771 raft_consensus.cc:3060] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:52:11.659714 11287 raft_consensus.cc:2804] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader election won for term 10
I20260709 14:52:11.734705  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:11.652416 11293 leader_election.cc:290] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 13 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:11.741412 11376 raft_consensus.cc:697] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:52:11.758894  7772 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 2788) took 1033 ms. Trace:
I20260709 14:52:11.712263 11367 raft_consensus.cc:2749] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 14:52:11.658901 11365 raft_consensus.cc:493] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:11.775592  7772 rpcz_store.cc:276] 0709 14:52:10.725135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:10.774579 (+ 49444us) service_pool.cc:224] Handling call
0709 14:52:10.775060 (+   481us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:52:11.478261 (+703201us) spinlock_profiling.cc:243] Waited 584 ms on lock 0x7b58005348d0. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68adea0aa 00007fb68ae6c447 00007fb68ae84fe7 00007fb68ae867de 00007fb68ae90b49 00007fb68ae91416 00007fb68ae8dd8f 00007fb68ae8d83e 00007fb68fe52419 00007fb6893c9bd4
0709 14:52:11.758518 (+280257us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:11.758812 (+   294us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1342111488}
I20260709 14:52:11.769187  7773 raft_consensus.cc:3060] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:52:11.738029 11265 raft_consensus.cc:2804] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 14:52:11.740649 11352 raft_consensus.cc:697] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:52:11.821709  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:11.824860  7771 raft_consensus.cc:2468] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 11.
I20260709 14:52:11.834409  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
W20260709 14:52:11.839605  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 292476us
W20260709 14:52:11.844374  7742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:11.837981 11367 raft_consensus.cc:2804] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader election won for term 11
I20260709 14:52:11.671742 11378 consensus_queue.cc:237] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:11.846227  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 398085us
W20260709 14:52:11.863890  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 138451us
I20260709 14:52:11.846766  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:11.869748  7772 raft_consensus.cc:3060] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:52:11.764783 11349 raft_consensus.cc:515] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:11.843313 11390 consensus_meta.cc:287] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent flushing consensus metadata: real 0.545s	user 0.009s	sys 0.005s
I20260709 14:52:11.850345  7773 raft_consensus.cc:2468] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 11.
I20260709 14:52:11.879343  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
W20260709 14:52:11.855189  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 122118us
I20260709 14:52:11.859274  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:11.882544  7771 raft_consensus.cc:3060] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Advancing to term 8
I20260709 14:52:11.860697  7770 raft_consensus.cc:2468] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 9.
I20260709 14:52:11.820905 11365 raft_consensus.cc:515] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:11.845049 11397 consensus_queue.cc:1059] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.304s
I20260709 14:52:11.841281 11293 consensus_queue.cc:1048] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 14:52:11.893316  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:11.901770  7773 raft_consensus.cc:3060] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:52:11.894552  7745 leader_election.cc:400] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 election: Vote denied by peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529) with higher term. Message: Invalid argument: T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 11. Current term is 12.
I20260709 14:52:11.905498  7745 leader_election.cc:403] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
W20260709 14:52:11.908826  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 185103us
I20260709 14:52:11.922703  7819 leader_election.cc:304] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:11.834390 11396 consensus_queue.cc:237] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:11.887457 11367 raft_consensus.cc:697] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:52:11.842703 11052 consensus_queue.cc:237] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:11.848311 11431 consensus_queue.cc:1059] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.076s
I20260709 14:52:11.916118 11420 raft_consensus.cc:2749] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 14:52:11.963169  7772 raft_consensus.cc:2468] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 10.
W20260709 14:52:11.932978 11428 log.cc:927] Time spent T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.095s	user 0.000s	sys 0.001s
W20260709 14:52:11.933104 11371 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 11 current term: 11 is higher.
W20260709 14:52:11.969003  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 79950.9us
I20260709 14:52:11.970284  7771 raft_consensus.cc:2468] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 8.
W20260709 14:52:11.971323  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 89845.8us
I20260709 14:52:11.890496 11390 raft_consensus.cc:515] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:11.968040  7773 raft_consensus.cc:2468] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 7.
I20260709 14:52:11.855866 11392 consensus_queue.cc:237] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:11.929606 11376 consensus_queue.cc:237] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:11.930629 11287 raft_consensus.cc:697] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
W20260709 14:52:11.991500 11382 consensus_meta.cc:287] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent flushing consensus metadata: real 0.512s	user 0.004s	sys 0.009s
I20260709 14:52:12.082935  7776 raft_consensus.cc:1275] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
W20260709 14:52:12.023597  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 101012us
I20260709 14:52:12.010298 11265 raft_consensus.cc:697] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:11.955775 11352 consensus_queue.cc:237] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:12.037165 11397 consensus_queue.cc:1243] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer 1e9289592458429bbddb19c2e7b7b7b0 log is divergent from this leader: its last log entry 12.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 14:52:11.929841 11432 consensus_queue.cc:1059] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.097s
I20260709 14:52:12.133610  7852 raft_consensus.cc:1240] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 8. Current term is 9. Ops: []
I20260709 14:52:12.145175  7776 pending_rounds.cc:85] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed: Aborting all ops after (but not including) 5
W20260709 14:52:12.008886  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 143325us
I20260709 14:52:12.023195 11373 raft_consensus.cc:493] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:12.193332  7894 leader_election.cc:304] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:12.191709  7819 leader_election.cc:304] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:12.190042  7776 pending_rounds.cc:107] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 14:52:12.198431  7776 raft_consensus.cc:2889] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:52:12.090606 11431 consensus_queue.cc:1059] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.072s
W20260709 14:52:12.162772 11424 log.cc:927] Time spent T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.335s	user 0.000s	sys 0.002s
I20260709 14:52:12.218456  7894 leader_election.cc:304] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
W20260709 14:52:12.186295 11370 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.003s	sys 0.027s
W20260709 14:52:12.252063  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 86791.5us
W20260709 14:52:12.247126 11370 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.593s	user 0.004s	sys 0.027s
I20260709 14:52:12.265981  7819 leader_election.cc:304] T 9441e831627143a991a1556dcdce71e3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 9418391fa82a42c79c6cad13ba91d964
I20260709 14:52:12.337637  7922 raft_consensus.cc:606] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 LEADER]: Received request to transfer leadership to TS 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:12.220242 11430 raft_consensus.cc:2749] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 14:52:12.257884 11432 raft_consensus.cc:2749] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529) with higher term. Message: Invalid argument: T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 11. Current term is 12.
W20260709 14:52:12.283532 11402 log.cc:927] Time spent T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.745s	user 0.002s	sys 0.007s
I20260709 14:52:12.133493 11367 consensus_queue.cc:237] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:12.343083 11437 raft_consensus.cc:493] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:12.358847 11446 raft_consensus.cc:3055] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 LEADER]: Stepping down as leader of term 12
I20260709 14:52:12.360014 11453 raft_consensus.cc:2804] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 14:52:12.258637 11365 leader_election.cc:290] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:12.255043 11426 raft_consensus.cc:2749] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 14:52:12.370545  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 104905us
W20260709 14:52:12.371366  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 153052us
I20260709 14:52:12.209444 11373 raft_consensus.cc:515] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:12.415277  7819 leader_election.cc:304] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:12.279511 11445 raft_consensus.cc:493] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:52:12.345666 11427 log.cc:927] Time spent T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.314s	user 0.000s	sys 0.001s
I20260709 14:52:12.351691 11420 raft_consensus.cc:2749] T 9441e831627143a991a1556dcdce71e3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 14:52:12.336109 11431 raft_consensus.cc:493] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:12.282618 11349 leader_election.cc:290] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 7 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:12.421108  7894 leader_election.cc:304] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:12.241729 11287 consensus_queue.cc:237] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:12.432142  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 423790us
I20260709 14:52:12.369899 11119 raft_consensus.cc:2804] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 14:52:12.340197 11397 consensus_queue.cc:1059] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.076s
I20260709 14:52:12.462189 11397 raft_consensus.cc:3055] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 LEADER]: Stepping down as leader of term 11
I20260709 14:52:12.462770 11397 raft_consensus.cc:740] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:52:12.444224 11453 raft_consensus.cc:697] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
W20260709 14:52:12.462249 11441 log.cc:927] Time spent T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 14:52:12.463976 11390 leader_election.cc:290] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 9 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:12.432107 11430 raft_consensus.cc:2804] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 14:52:12.451395 11438 log.cc:927] Time spent T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.330s	user 0.001s	sys 0.000s
I20260709 14:52:12.466060 11430 raft_consensus.cc:493] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:12.466702 11430 raft_consensus.cc:3060] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Advancing to term 11
W20260709 14:52:12.456594 11433 log.cc:927] Time spent T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.339s	user 0.000s	sys 0.002s
I20260709 14:52:12.458063 11440 raft_consensus.cc:3055] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 LEADER]: Stepping down as leader of term 11
I20260709 14:52:12.391990 11446 raft_consensus.cc:740] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:52:12.402374 11437 raft_consensus.cc:515] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:12.459416 11366 raft_consensus.cc:3060] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 9418391fa82a42c79c6cad13ba91d964 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:52:12.437541 11432 raft_consensus.cc:493] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:12.479583 11432 raft_consensus.cc:515] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:12.482079  7819 leader_election.cc:304] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:12.432479 11445 raft_consensus.cc:515] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:12.483165 11397 consensus_queue.cc:260] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:12.485910 11445 leader_election.cc:290] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:12.486965 11390 consensus_queue.cc:1048] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 14:52:12.487392 11437 leader_election.cc:290] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:12.445202 11447 raft_consensus.cc:493] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:52:12.488750 11388 consensus_meta.cc:287] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent flushing consensus metadata: real 0.985s	user 0.012s	sys 0.000s
W20260709 14:52:12.468498  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 47554.2us
I20260709 14:52:12.488984 11447 raft_consensus.cc:515] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:12.489207 11390 raft_consensus.cc:2749] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 14:52:12.483469 11432 leader_election.cc:290] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:12.461649 11384 raft_consensus.cc:3055] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 LEADER]: Stepping down as leader of term 12
W20260709 14:52:12.478724 11040 consensus_meta.cc:287] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent flushing consensus metadata: real 0.974s	user 0.003s	sys 0.014s
W20260709 14:52:12.471287  7744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:12.445513 11431 raft_consensus.cc:515] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:12.496809  7819 leader_election.cc:304] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:12.512346  7773 raft_consensus.cc:1275] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 14:52:12.513420  7773 pending_rounds.cc:85] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed: Aborting all ops after (but not including) 4
I20260709 14:52:12.513779  7773 pending_rounds.cc:107] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 14:52:12.514047  7773 raft_consensus.cc:2889] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:52:12.516193 11390 raft_consensus.cc:2804] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 14:52:12.516932 11390 raft_consensus.cc:493] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:12.517431 11390 raft_consensus.cc:3060] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Advancing to term 8
W20260709 14:52:12.521543  7744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:12.495203 11040 raft_consensus.cc:515] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:12.523872  7923 raft_consensus.cc:2393] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 12: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:52:12.526942 11446 consensus_queue.cc:260] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:12.492213 11447 leader_election.cc:290] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:12.531383  7819 leader_election.cc:304] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:12.365005 11265 consensus_queue.cc:237] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:12.536263 11426 raft_consensus.cc:2749] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 14:52:12.537027 11453 consensus_queue.cc:237] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:12.528941 11446 raft_consensus.cc:3060] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Advancing to term 13
I20260709 14:52:12.476390 11378 raft_consensus.cc:2804] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 14:52:12.524925 11040 leader_election.cc:290] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:12.475095 11440 raft_consensus.cc:740] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:52:12.476976 11119 raft_consensus.cc:697] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
W20260709 14:52:12.576256  7891 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.010s	sys 0.044s
I20260709 14:52:12.494871 11384 raft_consensus.cc:740] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:52:12.583132  7819 leader_election.cc:304] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:12.585563 11378 raft_consensus.cc:697] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:12.590301 11440 consensus_queue.cc:260] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:12.592217  7742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:12.595577  7776 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 2794) took 1041 ms. Trace:
I20260709 14:52:12.574769 11397 raft_consensus.cc:3060] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Advancing to term 12
W20260709 14:52:12.602447 11405 consensus_meta.cc:287] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent flushing consensus metadata: real 0.830s	user 0.017s	sys 0.000s
W20260709 14:52:12.576041 11458 log.cc:927] Time spent T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.051s	user 0.003s	sys 0.000s
I20260709 14:52:12.622488  7776 rpcz_store.cc:276] 0709 14:52:11.554342 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:11.554462 (+   120us) service_pool.cc:224] Handling call
0709 14:52:11.554939 (+   477us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:52:12.208006 (+653067us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:12.595292 (+387286us) spinlock_profiling.cc:243] Waited 527 ms on lock 0x7b54002b61d4. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae8ee01 00007fb68ae8d83e 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2 00007fb6891c948c 00007fb6891c88c6
0709 14:52:12.595507 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1213048192}
W20260709 14:52:12.601058  7891 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.569s	user 0.011s	sys 0.044s
W20260709 14:52:12.635001  7771 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.012s	sys 0.004s
W20260709 14:52:12.635419  7771 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.517s	user 0.012s	sys 0.004s
I20260709 14:52:12.646440  7776 raft_consensus.cc:1275] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 14:52:12.648100  7776 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 2822) took 1059 ms. Trace:
I20260709 14:52:12.648913  7776 rpcz_store.cc:276] 0709 14:52:11.588691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:12.636700 (+1048009us) service_pool.cc:224] Handling call
0709 14:52:12.637104 (+   404us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:52:12.647167 (+ 10063us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:12.647992 (+   825us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 14:52:12.664734  7928 raft_consensus.cc:1240] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 LEADER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 14:52:12.647006 11426 raft_consensus.cc:2764] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader election decision vote started in defunct term 9: won
I20260709 14:52:12.673002 11461 raft_consensus.cc:493] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:12.673679 11461 raft_consensus.cc:515] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:12.678881 11431 leader_election.cc:290] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:12.679241 11461 leader_election.cc:290] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:52:12.686548 11442 log.cc:927] Time spent T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.301s	user 0.000s	sys 0.003s
W20260709 14:52:12.688767  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 117060us
I20260709 14:52:12.690017  7819 leader_election.cc:304] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:12.692116  7819 leader_election.cc:304] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:12.664032 11432 raft_consensus.cc:493] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:12.694846 11384 consensus_queue.cc:260] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:12.700975 11378 consensus_queue.cc:237] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:12.702198 11119 consensus_queue.cc:237] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:12.635759 11405 raft_consensus.cc:515] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:12.720679  7743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:52:12.890414  7743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:12.711874 11352 raft_consensus.cc:493] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:12.895696 11352 raft_consensus.cc:515] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:12.753104  7745 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.717s	user 0.007s	sys 0.012s
W20260709 14:52:12.896929  7745 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.861s	user 0.013s	sys 0.013s
W20260709 14:52:12.898063  7745 leader_election.cc:336] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 1.888s (SENT)
I20260709 14:52:12.898531 11382 raft_consensus.cc:3055] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 LEADER]: Stepping down as leader of term 11
I20260709 14:52:12.899386 11382 raft_consensus.cc:740] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:52:12.819114  7776 raft_consensus.cc:1275] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 14:52:12.902071 11457 log.cc:927] Time spent T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.191s	user 0.000s	sys 0.001s
I20260709 14:52:12.902616 11382 consensus_queue.cc:260] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:12.904137  7928 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38532 (request call id 3063) took 1334 ms. Trace:
I20260709 14:52:12.898108 11352 leader_election.cc:290] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:12.817608 11426 raft_consensus.cc:2764] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader election decision vote started in defunct term 8: won
I20260709 14:52:12.929946 11373 leader_election.cc:290] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:12.899986  7852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 3080) took 1435 ms. Trace:
W20260709 14:52:12.899113  7745 leader_election.cc:336] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 2.025s (SENT)
I20260709 14:52:12.933348  7928 rpcz_store.cc:276] 0709 14:52:11.569835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:11.652597 (+ 82762us) service_pool.cc:224] Handling call
0709 14:52:11.652944 (+   347us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:52:12.665279 (+1012335us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:12.903640 (+238361us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b540025d5d4. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae8ee01 00007fb68ae8d83e 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2 00007fb6891c948c 00007fb6891c88c6
0709 14:52:12.904007 (+   367us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2326599936}
I20260709 14:52:12.943650  7777 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 2813) took 1357 ms. Trace:
W20260709 14:52:12.943535  7744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:12.944775  7852 rpcz_store.cc:276] 0709 14:52:11.464467 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:11.464613 (+   146us) service_pool.cc:224] Handling call
0709 14:52:11.464930 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:52:12.179326 (+714396us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:12.899652 (+720326us) spinlock_profiling.cc:243] Waited 588 ms on lock 0x7b54004434d4. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae8ee01 00007fb68ae8d83e 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2 00007fb6891c948c 00007fb6891c88c6
0709 14:52:12.899859 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1352169344}
W20260709 14:52:12.958328  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 59337.9us
W20260709 14:52:12.959385  7745 connection.cc:256] RPC call timeout handler was delayed by -1.9466083579999349s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20400000000000001s for a response
W20260709 14:52:12.960183  7745 connection.cc:256] RPC call timeout handler was delayed by -1.6430199839999204s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.29940000000000005s for a response
W20260709 14:52:12.960237  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 268323us
W20260709 14:52:12.960865  7745 connection.cc:256] RPC call timeout handler was delayed by -1.2330188939998834s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.32280000000000003s for a response
I20260709 14:52:12.895277 11414 raft_consensus.cc:2764] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader election decision vote started in defunct term 6: won
W20260709 14:52:12.961215  7745 connection.cc:256] RPC call timeout handler was delayed by -1.230318893999879s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3231s for a response
W20260709 14:52:12.963119  7745 connection.cc:256] RPC call timeout handler was delayed by -1.0305589979999468s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16990000000000002s for a response
W20260709 14:52:12.966205  7745 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 1.699s (SENT) [suppressed 55 similar messages]
I20260709 14:52:12.945142  7777 rpcz_store.cc:276] 0709 14:52:11.586177 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:12.347480 (+761303us) service_pool.cc:224] Handling call
0709 14:52:12.347871 (+   391us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:52:12.348293 (+   422us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 14:52:12.627467 (+279174us) log.cc:844] Serialized 14 byte log entry
0709 14:52:12.943154 (+315687us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:52:12.943229 (+    75us) raft_consensus.cc:1645] Marking committed up to 6
0709 14:52:12.943297 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:12.943378 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:12.943577 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4105,"prepare.queue_time_us":545174,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":78,"raft.queue_time_us":4439,"thread_start_us":475882,"threads_started":2}
I20260709 14:52:12.878232 11396 raft_consensus.cc:493] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:52:12.971153 11430 raft_consensus.cc:515] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:12.973357  7819 leader_election.cc:304] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:12.891702 11432 raft_consensus.cc:515] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:13.016490 11360 raft_consensus.cc:493] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
W20260709 14:52:13.027541  7845 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49946 (request call id 3057) took 1971 ms (client timeout 2009 ms). Trace:
I20260709 14:52:12.969156 11373 raft_consensus.cc:493] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:12.968799 11365 raft_consensus.cc:493] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9418391fa82a42c79c6cad13ba91d964)
W20260709 14:52:13.028124  7845 rpcz_store.cc:269] 0709 14:52:11.044299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:11.046692 (+  2393us) service_pool.cc:224] Handling call
0709 14:52:13.010637 (+1963945us) spinlock_profiling.cc:243] Waited 320 ms on lock 0x7b540013f454. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae922fa 00007fb68fe53b17 00007fb6893ce6d4 00007fb6893ce662 00007fb6893ce591 00007fb6893ce50c 00007fb6893cd7c2 00007fb6891c948c 00007fb6891c88c6 00007fb6891c826f
0709 14:52:13.015657 (+  5020us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":735740288}
I20260709 14:52:12.975868 11384 raft_consensus.cc:3060] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Advancing to term 13
W20260709 14:52:13.012856 11457 log.cc:927] Time spent T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 14:52:13.027138 11426 raft_consensus.cc:493] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:13.033528 11287 raft_consensus.cc:493] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:52:13.083509  8598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 109939us
I20260709 14:52:13.087098  7773 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 2803) took 1496 ms. Trace:
W20260709 14:52:13.088299  7742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:13.010311 11396 raft_consensus.cc:515] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:13.090250  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 124130us
I20260709 14:52:13.062812 11414 raft_consensus.cc:493] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:13.087867  7773 rpcz_store.cc:276] 0709 14:52:11.582976 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:12.007765 (+424789us) service_pool.cc:224] Handling call
0709 14:52:12.008194 (+   429us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:52:12.514572 (+506378us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:13.079563 (+564991us) spinlock_profiling.cc:243] Waited 504 ms on lock 0x7b54002b7fd4. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae8ee01 00007fb68ae8d83e 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2 00007fb6891c948c 00007fb6891c88c6
0709 14:52:13.079799 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1158471552}
W20260709 14:52:13.093663  7745 leader_election.cc:336] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 2.040s (SENT)
W20260709 14:52:13.100699  7745 leader_election.cc:336] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 2.591s (SENT)
I20260709 14:52:13.047104 11373 raft_consensus.cc:515] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:13.080379 11361 consensus_queue.cc:260] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:13.110903  7745 leader_election.cc:336] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 2.994s (SENT)
I20260709 14:52:13.111701  7745 leader_election.cc:304] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:13.112522 11373 leader_election.cc:290] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:13.112735 11449 raft_consensus.cc:2749] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 LEADER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 14:52:13.106190 11414 raft_consensus.cc:515] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:13.114744  7745 leader_election.cc:336] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 3.228s (SENT)
W20260709 14:52:13.115742  7745 leader_election.cc:336] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 3.231s (SENT)
I20260709 14:52:13.116207 11414 leader_election.cc:290] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:52:13.119782 11390 consensus_meta.cc:287] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent flushing consensus metadata: real 0.602s	user 0.014s	sys 0.000s
I20260709 14:52:13.120466 11390 raft_consensus.cc:515] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:13.121420 11366 consensus_meta.cc:287] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 9418391fa82a42c79c6cad13ba91d964: Time spent flushing consensus metadata: real 0.622s	user 0.005s	sys 0.010s
I20260709 14:52:13.093778 11287 raft_consensus.cc:515] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:13.122598  7770 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 2820) took 1534 ms. Trace:
I20260709 14:52:13.063755 11365 raft_consensus.cc:515] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:52:13.116308  7745 leader_election.cc:304] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:13.041630 11360 raft_consensus.cc:515] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:13.129016  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:13.117102 11414 raft_consensus.cc:2749] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 14:52:13.132720  7845 raft_consensus.cc:3060] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Advancing to term 13
I20260709 14:52:13.127043  7770 rpcz_store.cc:276] 0709 14:52:11.588160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:12.534591 (+946431us) service_pool.cc:224] Handling call
0709 14:52:12.535002 (+   411us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:52:12.537830 (+  2828us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 14:52:12.537862 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:52:12.538699 (+   837us) log.cc:844] Serialized 26 byte log entry
0709 14:52:12.874460 (+335761us) raft_consensus.cc:1645] Marking committed up to 6
0709 14:52:12.874527 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:12.874642 (+   115us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:52:13.122258 (+247616us) raft_consensus.cc:1685] finished
0709 14:52:13.122283 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:13.122512 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2252,"raft.queue_time_us":2443,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":116,"thread_start_us":334086,"threads_started":1,"wal-append.queue_time_us":526226}
I20260709 14:52:13.134339  7852 raft_consensus.cc:1275] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 14:52:13.111491 11361 raft_consensus.cc:3060] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:52:13.144352  7846 raft_consensus.cc:1275] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 14:52:13.145562  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 172363us
I20260709 14:52:13.149895  7854 raft_consensus.cc:1275] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 14:52:13.151019  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:13.152659  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:13.153481  7846 raft_consensus.cc:3060] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:52:13.127374 11216 raft_consensus.cc:493] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 9418391fa82a42c79c6cad13ba91d964 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:13.155578  7850 raft_consensus.cc:1275] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 14:52:13.155612  7849 raft_consensus.cc:1275] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 14:52:13.088030 11426 raft_consensus.cc:515] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:13.175206 11426 leader_election.cc:290] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:13.176925 11373 raft_consensus.cc:493] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:13.177636 11373 raft_consensus.cc:515] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:13.179833  7922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:48676 (request call id 47) took 1641 ms. Trace:
I20260709 14:52:13.180166 11373 leader_election.cc:290] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:13.183290 11390 leader_election.cc:290] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 8 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:13.183570  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:52:13.184180  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 68501.5us
I20260709 14:52:13.186547  7848 raft_consensus.cc:1275] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 14:52:13.188486  8639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18d29d52d304c87b930d4fb5eaf50b1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9418391fa82a42c79c6cad13ba91d964" is_pre_election: true
I20260709 14:52:13.158623  7819 leader_election.cc:304] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
W20260709 14:52:13.160202 11474 log.cc:927] Time spent T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
I20260709 14:52:13.162582 11430 leader_election.cc:290] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 11 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:52:13.162850 11479 log.cc:927] Time spent T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
W20260709 14:52:13.163546 11480 log.cc:927] Time spent T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 14:52:13.194898 11396 leader_election.cc:290] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:13.164883 11365 leader_election.cc:290] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68:42321)
I20260709 14:52:13.197089 11426 raft_consensus.cc:2804] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 14:52:13.197625 11426 raft_consensus.cc:493] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:13.198025 11426 raft_consensus.cc:3060] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:52:13.198161 11360 leader_election.cc:290] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:13.199435 11405 leader_election.cc:290] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 11 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:13.142112 11376 raft_consensus.cc:2749] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 14:52:13.205492  7819 leader_election.cc:304] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
W20260709 14:52:13.206843 11472 log.cc:927] Time spent T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.305s	user 0.005s	sys 0.000s
I20260709 14:52:13.166340 11432 leader_election.cc:290] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:13.207468 11373 raft_consensus.cc:493] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:13.168005 11287 leader_election.cc:290] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:52:13.170051 11469 log.cc:927] Time spent T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.278s	user 0.001s	sys 0.001s
I20260709 14:52:13.208412 11373 raft_consensus.cc:515] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:13.206911 11405 raft_consensus.cc:2804] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 14:52:13.209856 11405 raft_consensus.cc:493] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:13.193389  7774 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 2821) took 1605 ms. Trace:
I20260709 14:52:13.165551 11216 raft_consensus.cc:515] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 9418391fa82a42c79c6cad13ba91d964 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:52:13.207664 11466 raft_consensus.cc:493] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:13.210896 11373 leader_election.cc:290] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:13.172791  7854 raft_consensus.cc:1275] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 14:52:13.211880  7849 raft_consensus.cc:1275] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 14:52:13.213778  7850 raft_consensus.cc:2393] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 14: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
W20260709 14:52:13.215899 11464 log.cc:927] Time spent T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.307s	user 0.000s	sys 0.003s
I20260709 14:52:13.295462  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:13.298065  7850 raft_consensus.cc:1240] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 10. Current term is 11. Ops: []
I20260709 14:52:13.299765  7850 raft_consensus.cc:1240] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 7. Current term is 8. Ops: []
I20260709 14:52:13.219416  7819 leader_election.cc:304] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:13.224148  7923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38532 (request call id 3060) took 1655 ms. Trace:
I20260709 14:52:13.225406 11287 raft_consensus.cc:493] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:13.224968 11426 raft_consensus.cc:515] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:13.239200 11382 raft_consensus.cc:3060] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Advancing to term 12
W20260709 14:52:13.253194  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 183867us
I20260709 14:52:13.302351  7923 rpcz_store.cc:276] 0709 14:52:11.568762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:11.640498 (+ 71736us) service_pool.cc:224] Handling call
0709 14:52:13.223776 (+1583278us) spinlock_profiling.cc:243] Waited 857 ms on lock 0x7b540041e1d4. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae922fa 00007fb68fe53b17 00007fb6893ce6d4 00007fb6893ce662 00007fb6893ce591 00007fb6893ce50c 00007fb6893cd7c2 00007fb6891c948c 00007fb6891c88c6 00007fb6891c826f
0709 14:52:13.223995 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1970244992}
I20260709 14:52:13.296459  7849 raft_consensus.cc:2468] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 8.
I20260709 14:52:13.172899  7772 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 2808) took 1588 ms. Trace:
W20260709 14:52:13.258318  7744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:13.250038  7774 rpcz_store.cc:276] 0709 14:52:11.588416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:12.539087 (+950671us) service_pool.cc:224] Handling call
0709 14:52:12.582475 (+ 43388us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:52:12.582864 (+   389us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:52:12.582906 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:52:12.583401 (+   495us) log.cc:844] Serialized 26 byte log entry
0709 14:52:12.865451 (+282050us) raft_consensus.cc:1645] Marking committed up to 8
0709 14:52:12.895806 (+ 30355us) log.cc:844] Serialized 14 byte log entry
0709 14:52:12.896090 (+   284us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:12.896169 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:52:13.192982 (+296813us) raft_consensus.cc:1685] finished
0709 14:52:13.193013 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:13.193288 (+   275us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38342,"prepare.queue_time_us":51577,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":50,"raft.queue_time_us":33434,"raft.run_cpu_time_us":301,"raft.run_wall_time_us":5050,"thread_start_us":281494,"threads_started":1,"wal-append.queue_time_us":391043}
I20260709 14:52:13.268899  7845 raft_consensus.cc:2468] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 13.
I20260709 14:52:13.251794  7922 rpcz_store.cc:276] 0709 14:52:11.552521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:11.645196 (+ 92675us) service_pool.cc:224] Handling call
0709 14:52:13.179480 (+1534284us) spinlock_profiling.cc:243] Waited 635 ms on lock 0x7b5400131ad4. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae88853 00007fb68fe5660a 00007fb6893dc7d4 00007fb6893dc762 00007fb6893dc691 00007fb6893dc60c 00007fb6893db8c2 00007fb6891c948c 00007fb6891c88c6 00007fb6891c826f
0709 14:52:13.179657 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1460876544}
I20260709 14:52:13.232910 11371 raft_consensus.cc:493] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:13.263568 11405 raft_consensus.cc:3060] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:52:13.314376  7772 rpcz_store.cc:276] 0709 14:52:11.584819 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:12.132458 (+547639us) service_pool.cc:224] Handling call
0709 14:52:12.172901 (+ 40443us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:52:12.185714 (+ 12813us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:52:12.187086 (+  1372us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:52:12.188586 (+  1500us) log.cc:844] Serialized 26 byte log entry
0709 14:52:13.172056 (+983470us) spinlock_profiling.cc:243] Waited 6.98 ms on lock 0x7b180033ade0. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb690c69de1 00007fb690c765b1 00007fb68aa364bc 00007fb687d8448b 00007fb690bdeab9 00007fb687da069b 00007fb687d9e93f 00007fb687da0c02 00007fb68aa2820b 00007fb68aa2dd23 00007fb68aa2e0d1
0709 14:52:13.172311 (+   255us) raft_consensus.cc:1645] Marking committed up to 4
0709 14:52:13.172358 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:13.172458 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:52:13.172525 (+    67us) raft_consensus.cc:1685] finished
0709 14:52:13.172538 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:13.172809 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17672,"raft.queue_time_us":184928,"raft.run_cpu_time_us":198,"raft.run_wall_time_us":12107,"spinlock_wait_cycles":47689856,"thread_start_us":119004,"threads_started":1,"wal-append.queue_time_us":314975}
W20260709 14:52:13.302734  7742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:52:13.318817  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 99559us
I20260709 14:52:13.283545 11265 raft_consensus.cc:493] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:13.321507  7849 raft_consensus.cc:1275] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 14:52:13.314281  7846 raft_consensus.cc:2468] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 12.
I20260709 14:52:13.315922 11445 raft_consensus.cc:493] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:13.316502 11396 raft_consensus.cc:493] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:13.303874 11099 raft_consensus.cc:493] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:13.336561  7854 raft_consensus.cc:1275] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 14:52:13.320937  7819 leader_election.cc:304] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:13.297046 11466 raft_consensus.cc:515] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:13.342667 11099 raft_consensus.cc:515] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:13.323935 11489 raft_consensus.cc:2749] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 14:52:13.319100 11371 raft_consensus.cc:515] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:13.340051 11470 log.cc:927] Time spent T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.370s	user 0.000s	sys 0.003s
I20260709 14:52:13.327996 11295 consensus_queue.cc:1059] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 14:52:13.355083 11360 raft_consensus.cc:2749] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 14:52:13.318059 11287 raft_consensus.cc:515] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:13.377091  7665 tablet_replica.cc:1411] Time spent flushing the Log queue took a long time: real 0.343s	user 0.015s	sys 0.008s
I20260709 14:52:13.358741 11293 consensus_queue.cc:1048] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 14:52:13.327756 11265 raft_consensus.cc:515] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:13.367782 11481 consensus_queue.cc:1048] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 14:52:13.367110 11168 raft_consensus.cc:493] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:13.343780 11396 raft_consensus.cc:515] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:13.339166 11445 raft_consensus.cc:515] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:13.406674  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:13.414896  7846 raft_consensus.cc:1275] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 14:52:13.423836  7849 raft_consensus.cc:1275] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 14:52:13.426136  7922 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
mode: GRACEFUL
new_leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:48676
I20260709 14:52:13.427253  7922 raft_consensus.cc:606] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 LEADER]: Received request to transfer leadership to TS 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:52:13.429951  7846 raft_consensus.cc:1275] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 14:52:13.432524  7851 raft_consensus.cc:1275] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 14:52:13.434423  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:52:13.433975  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 100124us
I20260709 14:52:13.435329  7854 raft_consensus.cc:2468] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 9.
W20260709 14:52:13.418361 11465 log.cc:927] Time spent T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.388s	user 0.000s	sys 0.003s
I20260709 14:52:13.440719 11440 raft_consensus.cc:3060] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:52:13.392544 11168 raft_consensus.cc:515] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:13.445048 11378 consensus_queue.cc:1048] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 3, Time since last communication: 0.013s
I20260709 14:52:13.450822 11295 consensus_queue.cc:1048] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 14:52:13.463629 11371 leader_election.cc:290] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:13.464468 11396 leader_election.cc:290] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:13.448616 11439 raft_consensus.cc:493] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9418391fa82a42c79c6cad13ba91d964)
I20260709 14:52:13.466296 11099 leader_election.cc:290] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:13.453919 11426 leader_election.cc:290] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 11 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:13.456976 11295 consensus_queue.cc:1048] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 14:52:13.461717 11409 raft_consensus.cc:493] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:13.493867  7922 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
mode: GRACEFUL
new_leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:48676
I20260709 14:52:13.449698 11349 consensus_queue.cc:1048] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 14:52:13.487202  7894 leader_election.cc:304] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:13.497291  7894 leader_election.cc:304] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:13.495450  7922 raft_consensus.cc:606] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 LEADER]: Received request to transfer leadership to TS 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:13.451416 11456 consensus_queue.cc:1048] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.155s
I20260709 14:52:13.478950 11445 leader_election.cc:290] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:13.491171 11378 consensus_queue.cc:1059] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 14:52:13.491636 11099 consensus_queue.cc:1048] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 14:52:13.489145 11481 raft_consensus.cc:493] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:13.494328 11293 consensus_queue.cc:1059] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 14:52:13.516567 11481 raft_consensus.cc:515] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:13.519558 11481 leader_election.cc:290] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:13.492525 11396 consensus_queue.cc:1048] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 14:52:13.514380  7922 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
mode: GRACEFUL
new_leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:48676
I20260709 14:52:13.526877  7922 raft_consensus.cc:606] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Received request to transfer leadership to TS 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:52:13.512758 11445 raft_consensus.cc:2804] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 14:52:13.503545 11409 raft_consensus.cc:515] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:13.527500  7922 raft_consensus.cc:614] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 14:52:13.494530 11495 raft_consensus.cc:493] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:52:13.538789 11463 log.cc:927] Time spent T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.612s	user 0.002s	sys 0.006s
I20260709 14:52:13.540709  7775 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 2819) took 1952 ms. Trace:
I20260709 14:52:13.542164  7922 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
mode: GRACEFUL
new_leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:48676
I20260709 14:52:13.542938  7922 raft_consensus.cc:606] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 LEADER]: Received request to transfer leadership to TS 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:52:13.527455 11265 leader_election.cc:290] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:13.541219  7775 rpcz_store.cc:276] 0709 14:52:11.587893 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:12.351404 (+763511us) service_pool.cc:224] Handling call
0709 14:52:12.390365 (+ 38961us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:52:12.396606 (+  6241us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:52:12.396656 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:52:12.397655 (+   999us) log.cc:844] Serialized 26 byte log entry
0709 14:52:12.634803 (+237148us) raft_consensus.cc:1645] Marking committed up to 6
0709 14:52:13.010252 (+375449us) log.cc:844] Serialized 14 byte log entry
0709 14:52:13.022343 (+ 12091us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:13.022455 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:52:13.515429 (+492974us) spinlock_profiling.cc:243] Waited 31 ms on lock 0x7b4400022b4c. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb687c29db1 00007fb687cc7c85 00007fb687cc86a2 00007fb68aa3a1db 00007fb68aa35aaf 00007fb68aa2986e 00007fb68aa28bb6 00007fb68aa287d8 00007fb68aa32221 00007fb68aa321d9 00007fb68aa32169
0709 14:52:13.540331 (+ 24902us) raft_consensus.cc:1685] finished
0709 14:52:13.540460 (+   129us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:13.540634 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21743,"prepare.queue_time_us":259569,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":76596,"raft.run_cpu_time_us":726,"raft.run_wall_time_us":11969,"spinlock_wait_cycles":71209984,"thread_start_us":464170,"threads_started":2,"wal-append.queue_time_us":477100}
I20260709 14:52:13.543440 11495 raft_consensus.cc:515] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:13.548372 11495 leader_election.cc:290] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:52:13.543356 11453 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.617s	user 0.003s	sys 0.006s
W20260709 14:52:13.549183 11453 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.623s	user 0.003s	sys 0.006s
I20260709 14:52:13.550815  6549 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 14:52:13.552304 11287 leader_election.cc:290] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:13.531291 11445 raft_consensus.cc:493] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:13.550800 11168 leader_election.cc:290] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:13.526813 11466 leader_election.cc:290] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:13.487105 11439 raft_consensus.cc:515] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
W20260709 14:52:13.558179  7742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:52:13.542383 11471 log.cc:927] Time spent T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.621s	user 0.000s	sys 0.004s
W20260709 14:52:13.574187 11467 log.cc:927] Time spent T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.654s	user 0.005s	sys 0.000s
I20260709 14:52:13.575240 11383 raft_consensus.cc:3055] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 14:52:13.578866  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 81760.8us
I20260709 14:52:13.557490 11445 raft_consensus.cc:3060] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:52:13.582926  7779 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 2826) took 1015 ms. Trace:
I20260709 14:52:13.585302 11405 raft_consensus.cc:515] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:13.589598 11409 leader_election.cc:290] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:13.590379 11439 leader_election.cc:290] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68:42321)
I20260709 14:52:13.592866  8639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1f7722fdea49e0b5e9c5d96633eaf9" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9418391fa82a42c79c6cad13ba91d964" is_pre_election: true
I20260709 14:52:13.541821 11504 raft_consensus.cc:2804] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 14:52:13.603781  7779 rpcz_store.cc:276] 0709 14:52:12.567331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:12.969734 (+402403us) service_pool.cc:224] Handling call
0709 14:52:12.970182 (+   448us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:52:12.996105 (+ 25923us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:52:12.996145 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:52:13.363279 (+367134us) spinlock_profiling.cc:243] Waited 3.05 ms on lock 0x7b2c000014c8. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb689787a11 00007fb689797372 00007fb68aec9a01 00007fb68ae8e43a 00007fb68ae8d83e 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2
0709 14:52:13.363810 (+   531us) log.cc:844] Serialized 26 byte log entry
0709 14:52:13.432601 (+ 68791us) raft_consensus.cc:1645] Marking committed up to 5
0709 14:52:13.432643 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:13.432724 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:52:13.582538 (+149814us) raft_consensus.cc:1685] finished
0709 14:52:13.582563 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:13.582835 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":55216,"raft.queue_time_us":43583,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":4910,"spinlock_wait_cycles":7011200,"thread_start_us":47235,"threads_started":1,"wal-append.queue_time_us":117779}
I20260709 14:52:13.605937  7894 leader_election.cc:304] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:13.603417 11383 raft_consensus.cc:740] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:13.629769  7850 raft_consensus.cc:1240] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 10. Current term is 11. Ops: []
I20260709 14:52:13.610368  8639 raft_consensus.cc:2468] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 9418391fa82a42c79c6cad13ba91d964 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 3.
I20260709 14:52:13.608256 11349 consensus_queue.cc:1048] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 14:52:13.640396 11394 raft_consensus.cc:2804] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 14:52:13.649886  7745 leader_election.cc:336] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 1.660s (SENT)
I20260709 14:52:13.652100  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:13.652617  7745 leader_election.cc:304] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:13.647262  7891 leader_election.cc:304] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 9418391fa82a42c79c6cad13ba91d964; no voters: 
I20260709 14:52:13.644565 11378 consensus_queue.cc:1048] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 14:52:13.654640  7847 raft_consensus.cc:1240] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 10. Current term is 11. Ops: []
I20260709 14:52:13.665815  7771 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 2802) took 2083 ms. Trace:
I20260709 14:52:13.665172 11383 consensus_queue.cc:260] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:13.666399  7771 rpcz_store.cc:276] 0709 14:52:11.582536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:12.007025 (+424489us) service_pool.cc:224] Handling call
0709 14:52:12.007652 (+   627us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:52:12.011103 (+  3451us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:52:12.011152 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:52:12.011913 (+   761us) log.cc:844] Serialized 26 byte log entry
0709 14:52:12.657044 (+645131us) raft_consensus.cc:1645] Marking committed up to 4
0709 14:52:13.010675 (+353631us) log.cc:844] Serialized 14 byte log entry
0709 14:52:13.028539 (+ 17864us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:13.028635 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:52:13.573280 (+544645us) spinlock_profiling.cc:243] Waited 27.1 ms on lock 0x7b4400022b4c. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb687c29db1 00007fb687cc7c85 00007fb687cc86a2 00007fb68aa3a1db 00007fb68aa35aaf 00007fb68aa2986e 00007fb68aa28bb6 00007fb68aa287d8 00007fb68aa32221 00007fb68aa321d9 00007fb68aa32169
0709 14:52:13.649448 (+ 76168us) raft_consensus.cc:1685] finished
0709 14:52:13.665431 (+ 15983us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:13.665700 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":191307,"prepare.queue_time_us":237716,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":46,"raft.queue_time_us":285254,"raft.run_cpu_time_us":936,"raft.run_wall_time_us":95199,"spinlock_wait_cycles":62290816,"thread_start_us":644691,"threads_started":2,"wal-append.queue_time_us":882386}
I20260709 14:52:13.640898 11388 raft_consensus.cc:493] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:13.632354 11439 consensus_queue.cc:1048] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.017s
I20260709 14:52:13.640869 11504 raft_consensus.cc:697] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:13.674964 11382 raft_consensus.cc:2749] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 14:52:13.669302 11099 consensus_queue.cc:1048] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.009s
I20260709 14:52:13.676131 11388 raft_consensus.cc:515] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:13.680177 11500 raft_consensus.cc:493] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:13.680037  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:13.683661  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:13.684706  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:13.685637  7919 raft_consensus.cc:1240] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 12. Current term is 13. Ops: []
I20260709 14:52:13.685976  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
W20260709 14:52:13.685760  7745 leader_election.cc:336] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 1.695s (SENT)
I20260709 14:52:13.686910  7920 raft_consensus.cc:2393] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 7: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:52:13.688686  7925 raft_consensus.cc:1217] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 LEADER]: Deduplicated request from leader. Original: 7.5->[10.6-11.7]   Dedup: 10.6->[11.7-11.7]
I20260709 14:52:13.689349  7925 raft_consensus.cc:1240] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 LEADER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 11. Current term is 12. Ops: [10.6-11.7]
I20260709 14:52:13.691684  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:13.692018  7927 raft_consensus.cc:1275] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 14:52:13.692637  7919 raft_consensus.cc:1275] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 14:52:13.692247  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:13.694316  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:13.695518  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:13.696409  7922 raft_consensus.cc:2468] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 10.
I20260709 14:52:13.697180  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:13.697964  7928 raft_consensus.cc:2468] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 9.
I20260709 14:52:13.700018  7927 raft_consensus.cc:1240] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 11. Current term is 12. Ops: []
I20260709 14:52:13.700052  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258d6c2dda954bf5b65930fde8ecb9f3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:13.699009  7893 leader_election.cc:304] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:13.702018  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:13.676928 11506 raft_consensus.cc:2804] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 14:52:13.688450 11383 raft_consensus.cc:3060] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 14:52:13.684347 11394 raft_consensus.cc:697] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:13.710309  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:13.705464  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:13.719128  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:13.719832  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:13.711903  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c563cc7cfbe4d59be4ffc5cf847ce56" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:13.706945  7893 leader_election.cc:304] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:52:13.709098  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258d6c2dda954bf5b65930fde8ecb9f3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:13.723269  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783e4874513449ef9084b833f188a6d3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:13.723516  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:13.702150 11293 raft_consensus.cc:493] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:52:13.683331 11500 raft_consensus.cc:515] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:13.702778 11349 raft_consensus.cc:493] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:13.708793 11401 raft_consensus.cc:2749] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 14:52:13.732930  7928 raft_consensus.cc:1240] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 9. Current term is 10. Ops: []
I20260709 14:52:13.731467  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:13.709524 11506 raft_consensus.cc:493] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9418391fa82a42c79c6cad13ba91d964)
I20260709 14:52:13.741417  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1f7722fdea49e0b5e9c5d96633eaf9" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:13.735224  7919 raft_consensus.cc:1240] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 14:52:13.738694  7926 raft_consensus.cc:1240] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 10. Current term is 11. Ops: [3.3-10.6]
W20260709 14:52:13.745455  7745 leader_election.cc:336] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 1.754s (SENT)
I20260709 14:52:13.746266  7745 leader_election.cc:304] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:13.750599  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:13.752761  7920 raft_consensus.cc:1275] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 14:52:13.753096  7745 leader_election.cc:336] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 1.763s (SENT)
I20260709 14:52:13.732545 11265 raft_consensus.cc:2804] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 14:52:13.737836 11440 raft_consensus.cc:493] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:13.762152  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:13.729594 11396 consensus_queue.cc:1048] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 14:52:13.743970 11506 raft_consensus.cc:3060] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:52:13.756449 11382 raft_consensus.cc:2749] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 14:52:13.737639 11378 consensus_queue.cc:1048] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 14:52:13.770030 11453 consensus_queue.cc:1048] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 14:52:13.774693  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:13.776585  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:13.740679 11349 raft_consensus.cc:515] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:13.777858 11453 consensus_queue.cc:1048] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 14:52:13.756727 11405 leader_election.cc:290] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 11 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:13.756727 11504 consensus_queue.cc:237] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:13.736033 11293 raft_consensus.cc:515] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:13.778093  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:13.787892  7925 raft_consensus.cc:1240] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 8. Current term is 9. Ops: []
I20260709 14:52:13.790341 11388 leader_election.cc:290] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:13.790920 11293 leader_election.cc:290] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:13.792774 11500 leader_election.cc:290] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:13.797879 11349 leader_election.cc:290] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:13.801734  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:13.807708  7919 raft_consensus.cc:3060] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Advancing to term 14
W20260709 14:52:13.808702  7745 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:13.803220  7926 raft_consensus.cc:1275] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 14:52:13.803524  7744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:13.804607  7924 raft_consensus.cc:1240] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 14:52:13.789094  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:13.802536 11216 leader_election.cc:290] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 9418391fa82a42c79c6cad13ba91d964 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:13.813935  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258d6c2dda954bf5b65930fde8ecb9f3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:13.744850 11445 raft_consensus.cc:515] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:13.814388  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:13.815090  7771 raft_consensus.cc:2368] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 7. Current term is 8.
I20260709 14:52:13.822715  7921 raft_consensus.cc:2393] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 9: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:52:13.814246  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:13.823900  7776 raft_consensus.cc:2368] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 12. Current term is 13.
I20260709 14:52:13.816684  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:13.825088  7775 raft_consensus.cc:2368] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 10. Current term is 11.
I20260709 14:52:13.824841  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:13.812026 11388 raft_consensus.cc:493] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:13.825911  7771 raft_consensus.cc:2368] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 11. Current term is 12.
I20260709 14:52:13.827790  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c563cc7cfbe4d59be4ffc5cf847ce56" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:13.830801  7770 raft_consensus.cc:1240] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 LEADER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 8. Current term is 9. Ops: []
I20260709 14:52:13.802943 11394 consensus_queue.cc:237] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:13.832394  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:13.832953  7773 raft_consensus.cc:1240] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 9. Current term is 10. Ops: []
I20260709 14:52:13.830895  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:13.833997  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:13.833868  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:13.838057  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:13.839982  7778 raft_consensus.cc:2410] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for term 12 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 14:52:13.841487  7770 raft_consensus.cc:2410] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for term 10 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 14:52:13.840467  7774 raft_consensus.cc:2376] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 11. Re-sending same reply.
I20260709 14:52:13.842798  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1f7722fdea49e0b5e9c5d96633eaf9" candidate_uuid: "9418391fa82a42c79c6cad13ba91d964" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:13.843473  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:13.845057  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783e4874513449ef9084b833f188a6d3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:13.846134  7775 raft_consensus.cc:2410] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 14:52:13.848071  7771 raft_consensus.cc:1240] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 12. Current term is 13. Ops: []
I20260709 14:52:13.848376  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:13.848899  7778 raft_consensus.cc:3060] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:52:13.843078  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:13.852901  7919 raft_consensus.cc:2468] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 14.
I20260709 14:52:13.770957 11440 raft_consensus.cc:515] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:13.847277 11388 raft_consensus.cc:515] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:13.857676  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:13.858510  7774 raft_consensus.cc:3060] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Advancing to term 14
I20260709 14:52:13.858852 11388 leader_election.cc:290] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:13.860203  7775 raft_consensus.cc:1240] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 LEADER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 14:52:13.861852 11295 raft_consensus.cc:3055] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 14:52:13.862349 11295 raft_consensus.cc:740] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:13.863301 11295 consensus_queue.cc:260] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:13.864482  7778 raft_consensus.cc:2468] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 9.
I20260709 14:52:13.864856 11295 raft_consensus.cc:3060] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:52:13.865840  7776 raft_consensus.cc:2410] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 14:52:13.865876  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:13.866704  7775 raft_consensus.cc:2468] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 13.
I20260709 14:52:13.868629  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:13.869388  7775 raft_consensus.cc:3060] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:52:13.873585  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:13.834043 11265 raft_consensus.cc:697] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:13.875691  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:13.877945  7776 raft_consensus.cc:3060] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:52:13.876281 11445 leader_election.cc:290] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 9 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:13.880714  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:13.882004  7778 raft_consensus.cc:2410] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for term 11 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 14:52:13.879887 11506 raft_consensus.cc:515] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:52:13.885885  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:13.886634  7771 raft_consensus.cc:3060] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Advancing to term 8
I20260709 14:52:13.889448  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:13.890926  7778 raft_consensus.cc:2468] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 8.
I20260709 14:52:13.895569  7775 raft_consensus.cc:2468] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 11.
I20260709 14:52:13.899334 11466 consensus_queue.cc:1059] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 14:52:13.900825 11466 consensus_queue.cc:1243] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer 1e9289592458429bbddb19c2e7b7b7b0 log is divergent from this leader: its last log entry 7.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 14:52:13.901670 11466 raft_consensus.cc:3055] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 LEADER]: Stepping down as leader of term 6
I20260709 14:52:13.902282 11466 raft_consensus.cc:740] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:52:13.902714 11506 leader_election.cc:290] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 3 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68:42321)
I20260709 14:52:13.882938 11223 raft_consensus.cc:3055] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 14:52:13.904055 11223 raft_consensus.cc:740] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:13.905159 11223 consensus_queue.cc:260] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:13.906395  7927 raft_consensus.cc:2393] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 3: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:52:13.906898 11223 raft_consensus.cc:3060] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:52:13.907210 11440 leader_election.cc:290] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:13.912693  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1f7722fdea49e0b5e9c5d96633eaf9" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:13.914285  7852 raft_consensus.cc:2393] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 3: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:52:13.920161 11388 raft_consensus.cc:493] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:13.896793  7774 raft_consensus.cc:2468] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 14.
I20260709 14:52:13.930204  7774 raft_consensus.cc:1275] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 14:52:13.936955  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:13.938012  7852 raft_consensus.cc:2468] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 12.
I20260709 14:52:13.938408 11355 raft_consensus.cc:3060] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:52:13.939231  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:13.942988  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:13.921195 11388 raft_consensus.cc:515] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:13.944715  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:13.945693  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:13.945879  7776 raft_consensus.cc:2468] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 11.
I20260709 14:52:13.946266 11388 leader_election.cc:290] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:13.946429  7774 raft_consensus.cc:3060] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:52:13.948834  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:13.950630  7778 raft_consensus.cc:2393] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 14: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:52:13.949826 11265 consensus_queue.cc:237] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:13.955016  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:13.956305  7776 raft_consensus.cc:3060] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:52:13.958628  7774 raft_consensus.cc:2468] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 7.
W20260709 14:52:13.965937  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 199671us
I20260709 14:52:13.938026  7775 raft_consensus.cc:1275] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 14:52:13.967957  7745 leader_election.cc:336] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 1.979s (SENT)
I20260709 14:52:13.969672  7845 raft_consensus.cc:2410] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for term 10 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 14:52:13.940871  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:52:13.979270  7742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:13.984408  7775 raft_consensus.cc:1275] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 14:52:13.984408  7774 raft_consensus.cc:1275] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 14:52:13.990731  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:13.991617  7774 raft_consensus.cc:2468] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 8.
I20260709 14:52:13.995308  7776 raft_consensus.cc:2468] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 12.
I20260709 14:52:13.998701  7771 raft_consensus.cc:2468] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 8.
I20260709 14:52:14.001422  7776 raft_consensus.cc:1275] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 14:52:13.978328 11466 consensus_queue.cc:260] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:13.986572 11223 consensus_queue.cc:1048] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 14:52:14.002863  7771 raft_consensus.cc:1275] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 14:52:14.013329  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
W20260709 14:52:14.005131  7745 leader_election.cc:336] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 1.993s (SENT)
I20260709 14:52:14.025203  7745 leader_election.cc:304] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:13.847009  7665 maintenance_manager.cc:643] P 133636659113430cb53b321cb0b1d9ee: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 8.836s	user 0.220s	sys 0.119s Metrics: {"bytes_written":29955,"cfile_init":1,"delete_count":0,"dirs.queue_time_us":258243,"dirs.run_cpu_time_us":494,"dirs.run_wall_time_us":3125,"drs_written":1,"lbm_read_time_us":81910,"lbm_reads_10-100_ms":4,"lbm_write_time_us":220007,"lbm_writes_1-10_ms":3,"lbm_writes_10-100_ms":10,"lbm_writes_lt_1ms":21,"peak_mem_usage":0,"reinsert_count":0,"rows_written":63,"thread_start_us":316684,"threads_started":2,"update_count":12,"wal-append.queue_time_us":287733}
I20260709 14:52:14.004374  8639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1f7722fdea49e0b5e9c5d96633eaf9" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9418391fa82a42c79c6cad13ba91d964"
I20260709 14:52:14.033233  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:52:14.052623  7744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:14.053728  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:14.055640  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:14.033465 11388 raft_consensus.cc:493] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:14.057848 11388 raft_consensus.cc:515] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:14.060374 11388 leader_election.cc:290] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:13.994668 11506 consensus_queue.cc:1048] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 14:52:14.075448  8639 raft_consensus.cc:2468] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 9418391fa82a42c79c6cad13ba91d964 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 3.
I20260709 14:52:14.073904  6549 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 14:52:14.076915 11287 raft_consensus.cc:2749] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 14:52:14.077205  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: true dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:14.007025 11466 raft_consensus.cc:3060] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Advancing to term 7
W20260709 14:52:14.080119  7744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:14.063956  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:14.094535 11361 raft_consensus.cc:493] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:14.095214 11361 raft_consensus.cc:515] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:14.098934  7743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:14.046576 11450 raft_consensus.cc:493] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
W20260709 14:52:14.086180  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 81096.9us
I20260709 14:52:14.106551  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:14.102905  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:14.108174  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1f7722fdea49e0b5e9c5d96633eaf9" candidate_uuid: "9418391fa82a42c79c6cad13ba91d964" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:14.086714  7850 raft_consensus.cc:3060] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:52:14.109150  7851 raft_consensus.cc:2468] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9418391fa82a42c79c6cad13ba91d964 in term 3.
W20260709 14:52:14.102203  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:14.081836  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:14.118124  8599 leader_election.cc:304] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 9418391fa82a42c79c6cad13ba91d964 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac, 9418391fa82a42c79c6cad13ba91d964; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:14.092681  7666 maintenance_manager.cc:419] P 133636659113430cb53b321cb0b1d9ee: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 9285 bytes on disk
I20260709 14:52:14.126142 11366 raft_consensus.cc:2804] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 9418391fa82a42c79c6cad13ba91d964 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 14:52:14.127079 11489 raft_consensus.cc:493] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:14.134373  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:52:14.137765  7745 leader_election.cc:336] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 2.148s (SENT)
I20260709 14:52:14.137811  7848 raft_consensus.cc:2393] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 11: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:52:14.138465  7745 leader_election.cc:304] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:14.084607 11409 raft_consensus.cc:493] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:14.141746  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:14.161844  7851 raft_consensus.cc:2393] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 8: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:52:14.142086 11361 leader_election.cc:290] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:14.167668  7922 raft_consensus.cc:2468] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 8.
I20260709 14:52:14.148824  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1f7722fdea49e0b5e9c5d96633eaf9" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:14.127712 11450 raft_consensus.cc:515] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:14.134195 11366 raft_consensus.cc:493] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 9418391fa82a42c79c6cad13ba91d964 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:14.158481  7891 leader_election.cc:304] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 9418391fa82a42c79c6cad13ba91d964; no voters: 
I20260709 14:52:14.169360  7848 raft_consensus.cc:2393] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 3: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:52:14.121893 11371 raft_consensus.cc:493] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:14.175990  7850 raft_consensus.cc:2468] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 10.
I20260709 14:52:14.136870 11430 raft_consensus.cc:493] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:14.178081  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:14.177183  7665 maintenance_manager.cc:643] P 133636659113430cb53b321cb0b1d9ee: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.029s	user 0.002s	sys 0.001s Metrics: {"cfile_init":1,"lbm_read_time_us":480,"lbm_reads_lt_1ms":4}
I20260709 14:52:14.147100 11489 raft_consensus.cc:515] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:14.185784  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:14.191740  7850 raft_consensus.cc:2468] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 13.
I20260709 14:52:14.147045 11287 raft_consensus.cc:2749] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 14:52:14.198968  7745 leader_election.cc:336] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 2.209s (SENT)
I20260709 14:52:14.199832  7745 leader_election.cc:304] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:14.186872 11366 raft_consensus.cc:3060] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 9418391fa82a42c79c6cad13ba91d964 [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:52:14.195147  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783e4874513449ef9084b833f188a6d3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:14.218055  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:14.219796  7744 leader_election.cc:304] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:52:14.219661  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:14.152743 11409 raft_consensus.cc:515] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:14.188905 11506 raft_consensus.cc:2804] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 14:52:14.234979  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258d6c2dda954bf5b65930fde8ecb9f3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:14.191290 11481 raft_consensus.cc:493] T 9441e831627143a991a1556dcdce71e3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9418391fa82a42c79c6cad13ba91d964)
I20260709 14:52:14.236296  7848 raft_consensus.cc:2468] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 8.
I20260709 14:52:14.211964 11388 consensus_queue.cc:1048] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 14:52:14.243618  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:14.246126  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:14.250938  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:14.231575 11317 consensus_queue.cc:1048] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 14:52:14.231894 11440 consensus_queue.cc:1048] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 14:52:14.228883 11372 raft_consensus.cc:493] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:14.258555  7854 raft_consensus.cc:2468] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 12.
I20260709 14:52:14.221460 11287 raft_consensus.cc:493] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:14.259554  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:14.191385 11371 raft_consensus.cc:515] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:14.195638 11430 raft_consensus.cc:515] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:14.262655  7745 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:52:14.269184 11518 log.cc:927] Time spent T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.184s	user 0.002s	sys 0.000s
I20260709 14:52:14.239184 11361 raft_consensus.cc:493] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:14.297292  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:14.261982  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c563cc7cfbe4d59be4ffc5cf847ce56" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:14.255972  7894 leader_election.cc:304] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:14.260100 11506 raft_consensus.cc:697] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
W20260709 14:52:14.264492 11516 log.cc:927] Time spent T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
I20260709 14:52:14.271359  7922 raft_consensus.cc:1275] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 14:52:14.315215  7893 leader_election.cc:304] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:14.274917  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:14.221655 11382 raft_consensus.cc:2749] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 14:52:14.321442 11445 raft_consensus.cc:2804] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 14:52:14.321851 11382 raft_consensus.cc:2804] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 14:52:14.322407 11382 raft_consensus.cc:493] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:14.322789 11382 raft_consensus.cc:3060] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:52:14.323396  7893 leader_election.cc:304] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:14.286037  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:14.263216  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:14.291445  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
W20260709 14:52:14.291738  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 72039.5us
I20260709 14:52:14.253060 11481 raft_consensus.cc:515] T 9441e831627143a991a1556dcdce71e3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
W20260709 14:52:14.296836  7819 service_pool.cc:136] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:49948 dropped due to backpressure: service queue is full with 50 items [suppressed 1 similar messages]
I20260709 14:52:14.296943 11287 raft_consensus.cc:515] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:14.300444  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:14.302700 11409 leader_election.cc:290] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:14.306993 11371 leader_election.cc:290] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:14.309196  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:14.306838 11430 leader_election.cc:290] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:14.270946  7850 raft_consensus.cc:2393] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 9: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:52:14.318749  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:14.281716 11440 consensus_queue.cc:1243] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer 1e9289592458429bbddb19c2e7b7b7b0 log is divergent from this leader: its last log entry 7.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 14:52:14.291940 11372 raft_consensus.cc:515] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:14.320603  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 64786.3us
I20260709 14:52:14.328368  7744 leader_election.cc:304] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:52:14.331110  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:14.333693  7845 raft_consensus.cc:2410] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 14:52:14.309602  7851 raft_consensus.cc:2468] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 9.
I20260709 14:52:14.337875  7852 raft_consensus.cc:2376] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 9. Re-sending same reply.
I20260709 14:52:14.325873 11378 raft_consensus.cc:2749] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 14:52:14.329011 11445 raft_consensus.cc:493] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:52:14.376242 11445 raft_consensus.cc:3060] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:52:14.364743 11366 raft_consensus.cc:515] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 9418391fa82a42c79c6cad13ba91d964 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
W20260709 14:52:14.378064 11523 log.cc:927] Time spent T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
I20260709 14:52:14.363082 11287 leader_election.cc:290] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:14.329427 11435 consensus_queue.cc:1048] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 14:52:14.345021  7928 raft_consensus.cc:2468] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 11.
I20260709 14:52:14.338905 11388 raft_consensus.cc:493] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:14.336148 11295 raft_consensus.cc:2804] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 14:52:14.384191  7894 leader_election.cc:304] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:14.375466 11527 raft_consensus.cc:493] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:52:14.379288 11521 log.cc:927] Time spent T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
I20260709 14:52:14.316908 11361 raft_consensus.cc:515] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:14.372988 11371 raft_consensus.cc:2804] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 14:52:14.425995 11371 raft_consensus.cc:493] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:14.426502 11371 raft_consensus.cc:3060] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:52:14.427804 11361 leader_election.cc:290] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:14.428565 11450 leader_election.cc:290] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:14.405227 11378 raft_consensus.cc:2804] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 14:52:14.429579 11378 raft_consensus.cc:493] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:14.430231 11378 raft_consensus.cc:3060] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 14:52:14.406740 11366 leader_election.cc:290] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 9418391fa82a42c79c6cad13ba91d964 [CANDIDATE]: Term 4 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:14.392612 11293 consensus_queue.cc:1048] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.015s
I20260709 14:52:14.377875 11099 consensus_queue.cc:1048] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 14:52:14.369138 11394 consensus_queue.cc:1048] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 14:52:14.399940 11388 raft_consensus.cc:515] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:14.413357 11510 consensus_queue.cc:1059] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 14:52:14.386269 11168 consensus_queue.cc:1059] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 14:52:14.417877  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1f7722fdea49e0b5e9c5d96633eaf9" candidate_uuid: "9418391fa82a42c79c6cad13ba91d964" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:14.339953 11434 consensus_queue.cc:1048] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 14:52:14.379649 11398 consensus_queue.cc:1048] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 14:52:14.421152 11527 raft_consensus.cc:515] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:14.330193  7819 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:49948 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3331)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49946 (request call id 3141)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3342)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49946 (request call id 3139)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3343)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3318)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3344)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3341)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3338)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3319)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49946 (request call id 3140)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3334)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3349)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3327)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3347)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3305)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3339)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3340)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3333)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3324)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 3126)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 3128)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49948 (request call id 3304)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49948 (request call id 3306)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41650 (request call id 332)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41650 (request call id 334)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 3130)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 3131)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 3132)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 3133)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 3134)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 3135)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 3136)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 3138)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 3142)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 3144)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 3145)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49948 (request call id 3321)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49948 (request call id 3325)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49948 (request call id 3326)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49948 (request call id 3328)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49948 (request call id 3336)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49948 (request call id 3337)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 3146)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 3147)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49948 (request call id 3346)
W20260709 14:52:14.444021  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 70756.2us
I20260709 14:52:14.460738 11527 leader_election.cc:290] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:14.394928 11287 consensus_queue.cc:1048] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 14:52:14.421574 11506 consensus_queue.cc:237] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:52:14.466874 11481 leader_election.cc:290] T 9441e831627143a991a1556dcdce71e3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68:42321)
I20260709 14:52:14.467658  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:14.468394  7845 raft_consensus.cc:3060] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:52:14.470021  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:14.473399 11388 leader_election.cc:290] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:14.475874  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1f7722fdea49e0b5e9c5d96633eaf9" candidate_uuid: "9418391fa82a42c79c6cad13ba91d964" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:14.476657  7852 raft_consensus.cc:3060] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:52:14.452713 11489 leader_election.cc:290] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:14.478034 11510 raft_consensus.cc:3055] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 14:52:14.478490 11510 raft_consensus.cc:740] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:14.479377 11510 consensus_queue.cc:260] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:14.468969  7819 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:49946 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3351)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3352)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3344)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3353)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3354)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3341)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3338)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3355)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3319)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49946 (request call id 3140)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3334)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3349)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3327)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3357)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3347)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3358)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3361)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3305)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3356)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3339)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3340)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3359)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3333)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3360)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3324)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 3126)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 3128)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49948 (request call id 3304)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49948 (request call id 3306)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41650 (request call id 332)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41650 (request call id 334)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 3130)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 3131)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 3132)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 3133)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 3135)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 3136)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 3138)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 3142)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 3144)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 3145)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49948 (request call id 3321)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49948 (request call id 3325)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49948 (request call id 3326)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49948 (request call id 3328)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49948 (request call id 3336)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49948 (request call id 3337)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 3146)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 3147)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49948 (request call id 3346)
I20260709 14:52:14.474434  8639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9441e831627143a991a1556dcdce71e3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9418391fa82a42c79c6cad13ba91d964" is_pre_election: true
I20260709 14:52:14.481830 11434 consensus_queue.cc:1048] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 14:52:14.482169  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:14.543555  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:14.544523  7848 raft_consensus.cc:2393] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 11: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:52:14.469841 11372 leader_election.cc:290] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:14.485984  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783e4874513449ef9084b833f188a6d3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:52:14.486852  7743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:14.543151  7819 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:49948 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3354)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3341)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3338)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3355)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3319)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49946 (request call id 3140)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3334)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3349)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3327)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3357)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3347)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3358)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3361)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3364)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3305)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3363)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3356)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3339)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3362)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3340)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3359)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3333)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3360)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3324)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 3126)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 3128)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49948 (request call id 3304)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49948 (request call id 3306)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41650 (request call id 332)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41650 (request call id 334)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 3130)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 3131)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 3132)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 3133)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 3135)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 3136)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 3138)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 3142)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 3144)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 3145)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49948 (request call id 3321)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49948 (request call id 3325)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49948 (request call id 3326)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49948 (request call id 3328)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49948 (request call id 3336)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49948 (request call id 3337)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 3146)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 3147)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49948 (request call id 3346)
I20260709 14:52:14.488190 11223 raft_consensus.cc:3055] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 14:52:14.547170 11223 raft_consensus.cc:740] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:14.548168 11223 consensus_queue.cc:260] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:14.491770  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:14.401271 11382 raft_consensus.cc:515] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:14.549942  7675 catalog_manager.cc:5697] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:52:14.505803  7845 raft_consensus.cc:2468] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 9.
I20260709 14:52:14.507931 11445 raft_consensus.cc:515] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:14.551396 11382 leader_election.cc:290] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:14.502431 11440 raft_consensus.cc:493] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:14.510936  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: true dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:14.552335 11440 raft_consensus.cc:515] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:14.527426  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:14.530398  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:14.551851  7675 catalog_manager.cc:5697] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:52:14.539431  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:14.550561 11223 raft_consensus.cc:3060] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:52:14.554293  7847 raft_consensus.cc:2393] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 9: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:52:14.554610 11440 leader_election.cc:290] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:14.480777 11510 raft_consensus.cc:3060] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:52:14.556131 11378 raft_consensus.cc:515] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:14.552893  7851 raft_consensus.cc:2376] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 10. Re-sending same reply.
I20260709 14:52:14.583539  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:14.537361  7852 raft_consensus.cc:2468] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9418391fa82a42c79c6cad13ba91d964 in term 4.
I20260709 14:52:14.556066  7675 catalog_manager.cc:5697] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:52:14.585546  8599 leader_election.cc:304] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 9418391fa82a42c79c6cad13ba91d964 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac, 9418391fa82a42c79c6cad13ba91d964; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:14.586032  7675 catalog_manager.cc:5697] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:52:14.587855  7675 catalog_manager.cc:5697] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
W20260709 14:52:14.573086  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:14.574029 11295 raft_consensus.cc:697] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
W20260709 14:52:14.575659  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 206639us
I20260709 14:52:14.576246  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:14.590781  7848 raft_consensus.cc:2393] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 9: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:52:14.591707  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:14.592351  7848 raft_consensus.cc:2468] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 13.
I20260709 14:52:14.593274  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:14.593840  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:14.577971  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:14.578071  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18d29d52d304c87b930d4fb5eaf50b1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:14.594966  7847 raft_consensus.cc:2468] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 5.
I20260709 14:52:14.595302  7675 catalog_manager.cc:5697] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:52:14.595922  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:14.547911  7819 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:49948 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3354)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3341)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3338)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3355)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3319)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49946 (request call id 3140)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3334)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3349)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3327)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3367)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3357)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3347)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3358)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3361)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3364)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3305)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3363)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3356)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3339)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3362)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3340)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3359)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3333)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3360)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3324)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 3126)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 3128)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49948 (request call id 3304)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49948 (request call id 3306)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41650 (request call id 332)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41650 (request call id 334)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 3130)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 3131)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 3132)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 3133)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 3135)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 3136)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 3138)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 3142)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 3144)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 3145)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49948 (request call id 3321)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49948 (request call id 3325)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49948 (request call id 3326)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49948 (request call id 3328)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49948 (request call id 3336)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49948 (request call id 3337)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 3146)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 3147)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49948 (request call id 3346)
I20260709 14:52:14.594194  7848 raft_consensus.cc:2410] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 14:52:14.597621  7675 catalog_manager.cc:5697] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:52:14.599251  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:14.600392  7776 raft_consensus.cc:2468] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 12.
I20260709 14:52:14.601136  7774 raft_consensus.cc:1275] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 14:52:14.602239  7774 pending_rounds.cc:85] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed: Aborting all ops after (but not including) 6
I20260709 14:52:14.602459  7774 pending_rounds.cc:107] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 14:52:14.602613  7774 raft_consensus.cc:2889] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:52:14.604095  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:14.604549  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:14.603611  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:14.604710  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:14.606323  7776 raft_consensus.cc:2393] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 11: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:52:14.606562  7770 raft_consensus.cc:2468] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 10.
I20260709 14:52:14.606175  7773 raft_consensus.cc:1275] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 14:52:14.599299  7675 catalog_manager.cc:5697] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 8 to 9, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 9 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:52:14.609578  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c563cc7cfbe4d59be4ffc5cf847ce56" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:14.609279  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:14.608520  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:14.610662  7849 raft_consensus.cc:2468] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 10.
I20260709 14:52:14.610054  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:14.611910  7851 raft_consensus.cc:2468] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 12.
I20260709 14:52:14.610558  7675 catalog_manager.cc:5697] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 7 to 8, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 8 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:52:14.610776  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:14.615995  7853 raft_consensus.cc:2393] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 11: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:52:14.606159  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:14.617406  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
W20260709 14:52:14.617862  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:14.617971  7771 raft_consensus.cc:3060] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:52:14.619465  7774 raft_consensus.cc:1275] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 14:52:14.620105  7774 pending_rounds.cc:85] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed: Aborting all ops after (but not including) 3
I20260709 14:52:14.620494  7774 pending_rounds.cc:107] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 14:52:14.614481  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:14.624238  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:14.620859  7774 raft_consensus.cc:2889] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:52:14.627395  7779 raft_consensus.cc:1275] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 14:52:14.627761  7674 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54344 (request call id 372) took 14076 ms (client timeout 15000 ms). Trace:
I20260709 14:52:14.631487  7775 raft_consensus.cc:1275] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 14:52:14.632619  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:52:14.637862  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 229923us
I20260709 14:52:14.638253  7779 raft_consensus.cc:1275] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 14:52:14.642607  7775 raft_consensus.cc:1275] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 14:52:14.644557  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:14.638301  7675 catalog_manager.cc:5697] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 5 to 6, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 6 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:52:14.647620  7675 catalog_manager.cc:5697] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 6 to 9. New cstate: current_term: 9 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:52:14.649922  7675 catalog_manager.cc:5697] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 4 to 7. New cstate: current_term: 7 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:52:14.651681  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:14.608603 11216 raft_consensus.cc:2804] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 9418391fa82a42c79c6cad13ba91d964 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 14:52:14.657044  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:14.658327  7847 raft_consensus.cc:2410] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
W20260709 14:52:14.628724  7674 rpcz_store.cc:269] 0709 14:52:00.550995 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:00.565192 (+ 14197us) service_pool.cc:224] Handling call
0709 14:52:14.627684 (+14062492us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 14:52:10.043387 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 14:52:10.044058 (+   671us) write_op.cc:432] Acquiring schema lock in shared mode
0709 14:52:10.044094 (+    36us) write_op.cc:435] Acquired schema lock
0709 14:52:10.044111 (+    17us) tablet.cc:662] Decoding operations
0709 14:52:10.142252 (+ 98141us) write_op.cc:620] Acquiring the partition lock for write op
0709 14:52:10.142346 (+    94us) write_op.cc:641] Partition lock acquired for write op
0709 14:52:10.142378 (+    32us) tablet.cc:685] Acquiring locks for 7 operations
0709 14:52:10.143049 (+   671us) tablet.cc:701] Row locks acquired
0709 14:52:10.143069 (+    20us) write_op.cc:260] PREPARE: finished
0709 14:52:10.143268 (+   199us) write_op.cc:270] Start()
0709 14:52:10.143454 (+   186us) write_op.cc:276] Timestamp: P: 1783608730143213 usec, L: 0
0709 14:52:10.143483 (+    29us) op_driver.cc:348] REPLICATION: starting
0709 14:52:10.158195 (+ 14712us) log.cc:844] Serialized 2845 byte log entry
0709 14:52:10.828503 (+670308us) op_driver.cc:464] REPLICATION: finished
0709 14:52:11.083919 (+255416us) write_op.cc:301] APPLY: starting
0709 14:52:11.087701 (+  3782us) tablet.cc:1367] starting BulkCheckPresence
0709 14:52:11.236557 (+148856us) tablet.cc:1370] finished BulkCheckPresence
0709 14:52:11.251837 (+ 15280us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 14:52:11.290133 (+ 38296us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 14:52:11.290400 (+   267us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=14
0709 14:52:11.290445 (+    45us) write_op.cc:312] APPLY: finished
0709 14:52:11.290776 (+   331us) log.cc:844] Serialized 59 byte log entry
0709 14:52:11.291014 (+   238us) write_op.cc:489] Releasing partition, row and schema locks
0709 14:52:11.291157 (+   143us) write_op.cc:454] Released schema lock
0709 14:52:11.291208 (+    51us) write_op.cc:341] FINISH: Updating metrics
0709 14:52:11.293552 (+  2344us) write_op.cc:489] Releasing partition, row and schema locks
0709 14:52:11.293590 (+    38us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":890,"reported_tablets":39,"child_traces":[["op",{"apply.queue_time_us":242190,"apply.run_cpu_time_us":6280,"apply.run_wall_time_us":217144,"num_ops":7,"prepare.queue_time_us":196219,"prepare.run_cpu_time_us":40367,"prepare.run_wall_time_us":226982,"raft.queue_time_us":311078,"raft.run_cpu_time_us":11147,"raft.run_wall_time_us":151834,"replication_time_us":670921,"thread_start_us":613996,"threads_started":4,"wal-append.queue_time_us":163173,"wal-append.run_cpu_time_us":57325,"wal-append.run_wall_time_us":2009602}]]}
I20260709 14:52:14.651666  7675 catalog_manager.cc:5697] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 7 to 10, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 10 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:52:14.654714  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:14.550691 11371 raft_consensus.cc:515] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:14.661396  7852 raft_consensus.cc:2393] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 11: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:52:14.667870  7771 raft_consensus.cc:2468] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 9.
I20260709 14:52:14.608810 11382 consensus_queue.cc:1048] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 14:52:14.674217  7778 raft_consensus.cc:2393] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 10: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:52:14.653050 11338 raft_consensus.cc:493] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:14.680367  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:14.695168  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:14.698081  7853 raft_consensus.cc:2468] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 8.
I20260709 14:52:14.678485  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:14.670181 11445 leader_election.cc:290] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:14.669890 11216 raft_consensus.cc:697] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 9418391fa82a42c79c6cad13ba91d964 [term 4 LEADER]: Becoming Leader. State: Replica: 9418391fa82a42c79c6cad13ba91d964, State: Running, Role: LEADER
I20260709 14:52:14.730309  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:14.726595  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:14.738456  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:14.741313  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:14.743357  7847 raft_consensus.cc:2393] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 12: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:52:14.749791  7819 leader_election.cc:400] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 7 election: Vote denied by peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587) with higher term. Message: Invalid argument: T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 7. Current term is 8.
I20260709 14:52:14.750216  7819 leader_election.cc:403] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 14:52:14.753784  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:14.757575  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:14.696990 11489 raft_consensus.cc:493] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:14.783833  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:14.765676  7851 raft_consensus.cc:1240] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 6. Current term is 7. Ops: []
W20260709 14:52:14.794570  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 44979.1us
I20260709 14:52:14.762394  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:14.801601  7819 leader_election.cc:400] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 12 pre-election: Vote denied by peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587) with higher term. Message: Invalid argument: T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 12. Current term is 13.
I20260709 14:52:14.801808  7928 raft_consensus.cc:2393] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 13: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:52:14.802852  7819 leader_election.cc:400] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 10 pre-election: Vote denied by peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587) with higher term. Message: Invalid argument: T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 10. Current term is 11.
I20260709 14:52:14.803260  7819 leader_election.cc:403] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 14:52:14.777616  7919 pending_rounds.cc:85] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0: Aborting all ops after (but not including) 2
I20260709 14:52:14.805756  7919 pending_rounds.cc:107] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0: Aborting uncommitted NO_OP operation due to leader change: 7.3
I20260709 14:52:14.806270  7919 raft_consensus.cc:2889] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:52:14.819303  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:14.819670  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:14.820497  7922 raft_consensus.cc:3060] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:52:14.822208  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:14.702102 11338 raft_consensus.cc:515] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:14.759902 11355 raft_consensus.cc:493] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:14.794289 11466 raft_consensus.cc:493] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:14.679791 11295 consensus_queue.cc:237] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:14.738307 11409 raft_consensus.cc:493] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:14.762390 11430 raft_consensus.cc:493] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
W20260709 14:52:14.887120  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 243198us
I20260709 14:52:14.849474 11378 leader_election.cc:290] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 13 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:14.804665 11405 raft_consensus.cc:2749] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587) with higher term. Message: Invalid argument: T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 7. Current term is 8.
I20260709 14:52:14.865015  7922 raft_consensus.cc:2468] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 11.
I20260709 14:52:14.866489  7893 leader_election.cc:304] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:14.810480 11489 raft_consensus.cc:515] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:14.832430 11371 leader_election.cc:290] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 10 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:14.888548 11409 raft_consensus.cc:515] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:14.916724  7850 raft_consensus.cc:2468] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 11.
I20260709 14:52:14.918052 11409 leader_election.cc:290] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:14.919265 11409 raft_consensus.cc:493] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:14.920097 11409 raft_consensus.cc:515] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:14.906534  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:14.906917  7893 leader_election.cc:304] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:14.915591 11489 leader_election.cc:290] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:14.865331 11355 raft_consensus.cc:515] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:14.792994  7744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:14.890349 11430 raft_consensus.cc:515] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:14.930976  7893 leader_election.cc:304] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:52:14.952003  7745 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:52:14.971058  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 298624us
I20260709 14:52:14.860926 11466 raft_consensus.cc:515] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:14.887423 11506 consensus_queue.cc:1048] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 14:52:14.929427 11378 raft_consensus.cc:2804] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 14:52:14.975924  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9441e831627143a991a1556dcdce71e3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:14.978174  7745 leader_election.cc:304] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:14.978467 11287 raft_consensus.cc:493] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:14.981566 11265 consensus_queue.cc:1048] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 14:52:14.982030 11317 consensus_queue.cc:1048] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 14:52:14.983366 11168 consensus_queue.cc:1048] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 14:52:14.985917 11500 consensus_queue.cc:1048] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 14:52:14.986465  7894 leader_election.cc:304] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:52:14.987172 11434 consensus_queue.cc:1048] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 14:52:14.995908  7893 leader_election.cc:304] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:52:14.933097 11383 raft_consensus.cc:2749] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 14:52:14.934020 11405 raft_consensus.cc:2749] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587) with higher term. Message: Invalid argument: T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 10. Current term is 11.
I20260709 14:52:15.010774  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:14.939419 11533 raft_consensus.cc:493] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:15.012240  7846 raft_consensus.cc:1275] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 14:52:15.026988  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 48948.5us
W20260709 14:52:15.035075  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 48834.2us
I20260709 14:52:14.891901 11216 consensus_queue.cc:237] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 9418391fa82a42c79c6cad13ba91d964 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:52:14.973762 11510 raft_consensus.cc:2749] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 14:52:15.036669  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:15.073278  7778 raft_consensus.cc:2468] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 12.
I20260709 14:52:15.037056 11372 raft_consensus.cc:2804] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 14:52:15.041440  7849 raft_consensus.cc:2468] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 10.
I20260709 14:52:14.937405 11445 consensus_queue.cc:1048] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.087s
W20260709 14:52:15.042361  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 46749.4us
I20260709 14:52:15.009471 11378 raft_consensus.cc:493] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:15.045945  7894 leader_election.cc:304] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:15.041786 11119 raft_consensus.cc:2804] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 14:52:15.062219  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:52:15.070443  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:15.025978 11382 raft_consensus.cc:493] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:15.070802  7745 leader_election.cc:304] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:15.050104 11401 raft_consensus.cc:2804] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 14:52:15.024478 11287 raft_consensus.cc:515] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:15.089728 11372 raft_consensus.cc:493] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:15.127867  7853 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 3133) took 1012 ms. Trace:
I20260709 14:52:15.140830  7853 rpcz_store.cc:276] 0709 14:52:14.115228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:14.900019 (+784791us) service_pool.cc:224] Handling call
0709 14:52:14.909000 (+  8981us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:52:15.021749 (+112749us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:52:15.021786 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:52:15.021836 (+    50us) raft_consensus.cc:1645] Marking committed up to 7
0709 14:52:15.021871 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:15.127588 (+105717us) spinlock_profiling.cc:243] Waited 112 ms on lock 0x7b540013b5d4. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae8ee01 00007fb68ae8d83e 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2 00007fb6891c948c 00007fb6891c88c6
0709 14:52:15.127640 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:15.127797 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":258228096}
I20260709 14:52:15.092779 11378 raft_consensus.cc:3060] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:52:15.150825  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:15.094527 11119 raft_consensus.cc:493] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
W20260709 14:52:15.157363  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 354570us
I20260709 14:52:15.158536  7853 raft_consensus.cc:1275] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 14:52:15.162133  7853 pending_rounds.cc:85] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting all ops after (but not including) 5
I20260709 14:52:15.162492  7853 pending_rounds.cc:107] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 14:52:15.162806  7853 raft_consensus.cc:2889] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:52:15.163358  7819 leader_election.cc:400] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 11 election: Vote denied by peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587) with higher term. Message: Invalid argument: T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 11. Current term is 12.
I20260709 14:52:15.163736  7819 leader_election.cc:403] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 14:52:15.163586  7853 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49948 (request call id 3321) took 1019 ms. Trace:
I20260709 14:52:15.164940  7853 rpcz_store.cc:276] 0709 14:52:14.144289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:15.151456 (+1007167us) service_pool.cc:224] Handling call
0709 14:52:15.158010 (+  6554us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:52:15.163316 (+  5306us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:15.163523 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 14:52:15.171705  7819 leader_election.cc:304] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:15.174979  7850 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 3145) took 1050 ms. Trace:
I20260709 14:52:15.070322 11533 raft_consensus.cc:515] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:15.175560  7850 rpcz_store.cc:276] 0709 14:52:14.124827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:15.138621 (+1013794us) service_pool.cc:224] Handling call
0709 14:52:15.174276 (+ 35655us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:52:15.174561 (+   285us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:52:15.174589 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:52:15.174643 (+    54us) raft_consensus.cc:1645] Marking committed up to 9
0709 14:52:15.174681 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:15.174747 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:15.174884 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":50944}
I20260709 14:52:15.151829 11372 raft_consensus.cc:3060] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:52:15.137229 11401 raft_consensus.cc:697] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:15.188563  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:15.187698  7819 leader_election.cc:304] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:15.194398  7778 raft_consensus.cc:2468] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 10.
I20260709 14:52:15.195138  7819 leader_election.cc:304] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:15.170616 11119 raft_consensus.cc:3060] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:52:15.122079 11382 raft_consensus.cc:515] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:15.183609 11500 raft_consensus.cc:2749] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 14:52:15.208314  6549 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 14:52:15.213797 11361 raft_consensus.cc:2749] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587) with higher term. Message: Invalid argument: T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 11. Current term is 12.
W20260709 14:52:15.214166 11547 log.cc:927] Time spent T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
I20260709 14:52:15.221300  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:15.198482 11338 leader_election.cc:290] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:15.173352 11405 consensus_queue.cc:1059] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 14:52:15.185575 11481 consensus_queue.cc:1059] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 14:52:15.214855 11361 raft_consensus.cc:2764] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader election decision vote started in defunct term 11: won
I20260709 14:52:15.253360  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:15.254467  7778 raft_consensus.cc:2468] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 9.
I20260709 14:52:15.255774  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:15.261325  7778 raft_consensus.cc:3060] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:52:15.261521  7846 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49948 (request call id 3304) took 1250 ms. Trace:
I20260709 14:52:15.216516 11409 leader_election.cc:290] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:15.266139  7847 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 3132) took 1151 ms. Trace:
I20260709 14:52:15.262354  7846 rpcz_store.cc:276] 0709 14:52:14.011447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:14.759808 (+748361us) service_pool.cc:224] Handling call
0709 14:52:14.760200 (+   392us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:52:15.043540 (+283340us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:15.260164 (+216624us) spinlock_profiling.cc:243] Waited 215 ms on lock 0x7b54003561d4. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae8ee01 00007fb68ae8d83e 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2 00007fb6891c948c 00007fb6891c88c6
0709 14:52:15.261415 (+  1251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":494088064}
W20260709 14:52:15.267683 11534 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.006s	sys 0.022s
W20260709 14:52:15.268191 11534 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.533s	user 0.006s	sys 0.022s
I20260709 14:52:15.268947  7846 raft_consensus.cc:1240] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 11. Current term is 12. Ops: []
I20260709 14:52:15.270064  7846 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49948 (request call id 3328) took 1110 ms. Trace:
I20260709 14:52:15.270507  7846 rpcz_store.cc:276] 0709 14:52:14.159932 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:15.267673 (+1107741us) service_pool.cc:224] Handling call
0709 14:52:15.268199 (+   526us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:52:15.269683 (+  1484us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:15.269988 (+   305us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 14:52:15.272171  7846 raft_consensus.cc:3055] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 LEADER]: Stepping down as leader of term 10
I20260709 14:52:15.272670  7846 raft_consensus.cc:740] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:52:15.273702  7846 consensus_queue.cc:260] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:15.245289 11355 leader_election.cc:290] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:52:15.278638 11541 log.cc:927] Time spent T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.185s	user 0.000s	sys 0.001s
W20260709 14:52:15.280194 11545 log.cc:927] Time spent T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 14:52:15.310200 11409 raft_consensus.cc:2804] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader election won for term 9
I20260709 14:52:15.293607  7847 rpcz_store.cc:276] 0709 14:52:14.114506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:14.830234 (+715728us) service_pool.cc:224] Handling call
0709 14:52:14.846529 (+ 16295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:52:14.848802 (+  2273us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 14:52:14.886346 (+ 37544us) log.cc:844] Serialized 14 byte log entry
0709 14:52:15.249509 (+363163us) log.cc:844] Serialized 14 byte log entry
0709 14:52:15.265642 (+ 16133us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:52:15.265725 (+    83us) raft_consensus.cc:1645] Marking committed up to 7
0709 14:52:15.265790 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:15.265888 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:15.266052 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9634,"prepare.queue_time_us":40595,"prepare.run_cpu_time_us":185,"prepare.run_wall_time_us":6388,"thread_start_us":357332,"threads_started":1}
I20260709 14:52:15.265213 11338 consensus_queue.cc:1059] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 14:52:15.260219 11405 consensus_queue.cc:1243] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer 1de5e20126fa4d8ca0793d19c7b847ed log is divergent from this leader: its last log entry 9.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 14:52:15.257355 11430 leader_election.cc:290] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:52:15.311808 11539 log.cc:927] Time spent T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.261s	user 0.002s	sys 0.002s
I20260709 14:52:15.327725  7852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 3138) took 1211 ms. Trace:
W20260709 14:52:15.336529  7775 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.501s	user 0.011s	sys 0.035s
W20260709 14:52:15.329049 11548 log.cc:927] Time spent T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.069s	user 0.000s	sys 0.002s
W20260709 14:52:15.288467  7743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:15.316490 11466 leader_election.cc:290] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:15.350024 11440 raft_consensus.cc:2749] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 14:52:15.365649 11287 leader_election.cc:290] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:15.365849  7847 raft_consensus.cc:1275] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 14:52:15.366851  7847 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49948 (request call id 3337) took 1203 ms. Trace:
I20260709 14:52:15.367276  7847 rpcz_store.cc:276] 0709 14:52:14.163584 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:15.364940 (+1201356us) service_pool.cc:224] Handling call
0709 14:52:15.365427 (+   487us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:52:15.366339 (+   912us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:15.366755 (+   416us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 14:52:15.370643 11533 leader_election.cc:290] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:15.372426 11527 raft_consensus.cc:493] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:15.373281 11527 raft_consensus.cc:515] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:15.373785 11338 raft_consensus.cc:3055] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 LEADER]: Stepping down as leader of term 12
I20260709 14:52:15.374194 11338 raft_consensus.cc:740] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:52:15.375022  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:15.375362 11338 consensus_queue.cc:260] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:15.375921 11527 leader_election.cc:290] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:15.376946 11338 raft_consensus.cc:3060] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Advancing to term 13
I20260709 14:52:15.328748 11552 raft_consensus.cc:2804] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 14:52:15.351059  7852 rpcz_store.cc:276] 0709 14:52:14.116659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:14.931215 (+814556us) service_pool.cc:224] Handling call
0709 14:52:15.039440 (+108225us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:52:15.039695 (+   255us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:52:15.039724 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:52:15.039779 (+    55us) raft_consensus.cc:1645] Marking committed up to 8
0709 14:52:15.039823 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:15.039887 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:15.327457 (+287570us) spinlock_profiling.cc:243] Waited 108 ms on lock 0x7b54000d4650. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae8d8ad 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2 00007fb6891c948c 00007fb6891c88c6 00007fb6891c826f
0709 14:52:15.327651 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":247796608}
I20260709 14:52:15.336354 11554 consensus_queue.cc:1059] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 14:52:15.377583 11409 raft_consensus.cc:697] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:52:15.369045  7847 raft_consensus.cc:1275] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 14:52:15.422845  7847 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 3146) took 1228 ms. Trace:
I20260709 14:52:15.423388  7847 rpcz_store.cc:276] 0709 14:52:14.194567 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:15.368078 (+1173511us) service_pool.cc:224] Handling call
0709 14:52:15.368493 (+   415us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:52:15.422259 (+ 53766us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:15.422758 (+   499us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 14:52:15.306787 11401 consensus_queue.cc:237] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:15.379704  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:15.425441  7779 raft_consensus.cc:3060] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:52:15.363049  7744 leader_election.cc:304] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:52:15.408740  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:15.426971  7776 raft_consensus.cc:3060] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Advancing to term 13
I20260709 14:52:15.410276  7852 raft_consensus.cc:1275] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 14:52:15.346612  7778 raft_consensus.cc:2468] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 11.
I20260709 14:52:15.409704 11552 raft_consensus.cc:493] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 14:52:15.424979 11563 log.cc:927] Time spent T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.056s	user 0.003s	sys 0.006s
I20260709 14:52:15.438022 11552 raft_consensus.cc:3060] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Advancing to term 14
W20260709 14:52:15.430805  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 67869.6us
I20260709 14:52:15.442006  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:15.442724  7852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 3147) took 1247 ms. Trace:
I20260709 14:52:15.443109  7852 rpcz_store.cc:276] 0709 14:52:14.195421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:15.383713 (+1188292us) service_pool.cc:224] Handling call
0709 14:52:15.409630 (+ 25917us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:52:15.442293 (+ 32663us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:15.442654 (+   361us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 14:52:15.444293  7778 raft_consensus.cc:2468] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 7.
I20260709 14:52:15.448462  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
W20260709 14:52:15.454981  7744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:15.464174  7847 raft_consensus.cc:3055] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 LEADER]: Stepping down as leader of term 8
I20260709 14:52:15.465412  7847 raft_consensus.cc:740] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:52:15.456873  7778 raft_consensus.cc:2468] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 10.
I20260709 14:52:15.482044  7779 raft_consensus.cc:2468] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 11.
W20260709 14:52:15.490192  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:15.490768  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:15.452167 11388 raft_consensus.cc:2804] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader election won for term 11
I20260709 14:52:15.493649  7923 raft_consensus.cc:3060] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:52:15.484910  7847 consensus_queue.cc:260] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:15.495787  7776 raft_consensus.cc:2468] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 13.
I20260709 14:52:15.461938 11554 consensus_queue.cc:1243] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Peer 1de5e20126fa4d8ca0793d19c7b847ed log is divergent from this leader: its last log entry 11.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 14:52:15.500200  7847 raft_consensus.cc:3060] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Advancing to term 9
W20260709 14:52:15.483814 11539 log.cc:927] Time spent T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 14:52:15.567183  7776 raft_consensus.cc:1240] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 10. Current term is 11. Ops: []
I20260709 14:52:15.498096  7926 raft_consensus.cc:1240] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 9. Current term is 10. Ops: []
I20260709 14:52:15.572551  7776 raft_consensus.cc:1275] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 14:52:15.574723  7776 pending_rounds.cc:85] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed: Aborting all ops after (but not including) 7
I20260709 14:52:15.575469  7776 pending_rounds.cc:107] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 14:52:15.575937  7776 raft_consensus.cc:2889] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 14:52:15.511915  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 441310us
W20260709 14:52:15.577762  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 532018us
I20260709 14:52:15.578881  7745 leader_election.cc:304] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:52:15.580008  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 384991us
W20260709 14:52:15.581067  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:15.581367  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:15.582657  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:15.569176  7923 raft_consensus.cc:2468] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 10.
I20260709 14:52:15.586511  7847 raft_consensus.cc:1275] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 14:52:15.584756  7893 leader_election.cc:304] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:15.587613  7847 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49948 (request call id 3346) took 1320 ms. Trace:
I20260709 14:52:15.588341  7847 rpcz_store.cc:276] 0709 14:52:14.267474 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:15.446349 (+1178875us) service_pool.cc:224] Handling call
0709 14:52:15.463882 (+ 17533us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:52:15.587113 (+123231us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:15.587522 (+   409us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 14:52:15.587934  7894 leader_election.cc:304] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:15.491602 11287 raft_consensus.cc:476] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 LEADER]: Not starting pre-election -- already a leader
I20260709 14:52:15.593003  7774 raft_consensus.cc:1240] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 10. Current term is 11. Ops: []
I20260709 14:52:15.594487  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
W20260709 14:52:15.522042 11541 log.cc:927] Time spent T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 14:52:15.602288  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:15.604904  7774 raft_consensus.cc:1275] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 14:52:15.536031 11563 log.cc:927] Time spent T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.052s	user 0.001s	sys 0.001s
I20260709 14:52:15.612747  7745 leader_election.cc:304] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:15.614522  7745 leader_election.cc:304] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:15.618314  7819 leader_election.cc:304] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:15.619971  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:15.523137 11388 raft_consensus.cc:697] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:52:15.626150  7819 leader_election.cc:304] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:15.622635  7745 leader_election.cc:304] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:15.629081  7819 leader_election.cc:304] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:15.638350 11355 raft_consensus.cc:2804] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader election won for term 11
I20260709 14:52:15.639822  7819 leader_election.cc:304] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:15.596136 11466 raft_consensus.cc:493] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9418391fa82a42c79c6cad13ba91d964)
I20260709 14:52:15.643831  7819 leader_election.cc:304] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:15.644550  7745 leader_election.cc:304] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:15.627153 11559 raft_consensus.cc:493] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:15.611114 11440 raft_consensus.cc:2749] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 14:52:15.682057  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 51169.3us
I20260709 14:52:15.653352  7745 leader_election.cc:304] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
W20260709 14:52:15.657948 11560 log.cc:927] Time spent T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.122s	user 0.001s	sys 0.001s
I20260709 14:52:15.647393 11527 raft_consensus.cc:2749] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 14:52:15.663297 11287 raft_consensus.cc:2749] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 14:52:15.647893 11567 raft_consensus.cc:2749] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 14:52:15.664912 11555 log.cc:927] Time spent T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.239s	user 0.001s	sys 0.001s
I20260709 14:52:15.666170 11339 raft_consensus.cc:993] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0: : Instructing follower 1de5e20126fa4d8ca0793d19c7b847ed to start an election
I20260709 14:52:15.666662 11554 raft_consensus.cc:2804] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Leader election won for term 14
I20260709 14:52:15.668020  7770 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 2859) took 1055 ms. Trace:
I20260709 14:52:15.628726 11535 raft_consensus.cc:2749] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 14:52:15.636972 11481 raft_consensus.cc:2804] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 14:52:15.673478 11355 raft_consensus.cc:697] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
W20260709 14:52:15.693636  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:15.699329  7777 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 2851) took 1093 ms. Trace:
I20260709 14:52:15.639012 11430 raft_consensus.cc:493] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:15.664803 11504 raft_consensus.cc:2749] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 14:52:15.733394  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 49873.6us
I20260709 14:52:15.741217 11440 raft_consensus.cc:493] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:15.738931  7770 rpcz_store.cc:276] 0709 14:52:14.612251 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:14.628631 (+ 16380us) service_pool.cc:224] Handling call
0709 14:52:14.629389 (+   758us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:52:14.630029 (+   640us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 14:52:14.647528 (+ 17499us) log.cc:844] Serialized 14 byte log entry
0709 14:52:14.745336 (+ 97808us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:52:14.746032 (+   696us) log.cc:844] Serialized 26 byte log entry
0709 14:52:14.746203 (+   171us) raft_consensus.cc:1645] Marking committed up to 5
0709 14:52:14.794046 (+ 47843us) log.cc:844] Serialized 14 byte log entry
0709 14:52:14.794981 (+   935us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:14.795080 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:52:15.335351 (+540271us) spinlock_profiling.cc:243] Waited 12.2 ms on lock 0x7b18001b1000. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb690c69de1 00007fb690c765b1 00007fb687da13f3 00007fb687da37c1 00007fb687da3779 00007fb687da3709 00007fb687da36d1 00007fb687da29cd 0000000000396ad4 0000000000396919 00007fb687d8483a
0709 14:52:15.667684 (+332333us) raft_consensus.cc:1685] finished
0709 14:52:15.667723 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:15.667926 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1073,"prepare.queue_time_us":36492,"prepare.run_cpu_time_us":96,"prepare.run_wall_time_us":100,"raft.queue_time_us":8092,"raft.run_cpu_time_us":486,"raft.run_wall_time_us":26819,"spinlock_wait_cycles":28081536,"thread_start_us":97271,"threads_started":1,"wal-append.queue_time_us":388991}
I20260709 14:52:15.612651 11409 consensus_queue.cc:237] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:15.745879 11562 log.cc:927] Time spent T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.114s	user 0.000s	sys 0.001s
I20260709 14:52:15.746547 11579 raft_consensus.cc:2804] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader election won for term 11
I20260709 14:52:15.741503 11577 raft_consensus.cc:2749] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 14:52:15.681834 11466 raft_consensus.cc:515] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:52:15.733273  7745 leader_election.cc:304] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:15.752846 11339 raft_consensus.cc:1081] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 LEADER]: Signalling peer 1de5e20126fa4d8ca0793d19c7b847ed to start an election
I20260709 14:52:15.753700 11481 raft_consensus.cc:493] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:15.649296 11388 consensus_queue.cc:237] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:15.687505 11559 raft_consensus.cc:515] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:15.858325  7775 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 2865) took 1208 ms. Trace:
I20260709 14:52:15.859468 11582 raft_consensus.cc:2804] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader election won for term 8
I20260709 14:52:15.746075 11575 raft_consensus.cc:493] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
W20260709 14:52:15.861035  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 270845us
I20260709 14:52:15.836809  7921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38532 (request call id 3096) took 1095 ms. Trace:
I20260709 14:52:15.865882  7847 raft_consensus.cc:1275] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 14:52:15.753199  7777 rpcz_store.cc:276] 0709 14:52:14.605851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:14.606634 (+   783us) service_pool.cc:224] Handling call
0709 14:52:14.606983 (+   349us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:52:14.627238 (+ 20255us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:52:14.627269 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:52:14.628025 (+   756us) log.cc:844] Serialized 26 byte log entry
0709 14:52:14.756021 (+127996us) raft_consensus.cc:1645] Marking committed up to 7
0709 14:52:14.809927 (+ 53906us) log.cc:844] Serialized 14 byte log entry
0709 14:52:14.810198 (+   271us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:14.810291 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:52:15.276105 (+465814us) spinlock_profiling.cc:243] Waited 4.94 ms on lock 0x7b480006c3d8. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68fdb7aa1 00007fb68fdaeb37 00007fb68fdae9ca 00007fb68fea626f 00007fb68fea5f37 00007fb68feba55c 00007fb68feba508 00007fb68feba488 00007fb68feba443 00007fb68feb96ec 00007fb68ede3a96
0709 14:52:15.674722 (+398617us) raft_consensus.cc:1685] finished
0709 14:52:15.698792 (+ 24070us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:15.699042 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19804,"prepare.queue_time_us":56814,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":66,"raft.queue_time_us":21806,"raft.run_cpu_time_us":3782,"raft.run_wall_time_us":467317,"spinlock_wait_cycles":11362688,"thread_start_us":127473,"threads_started":1,"wal-append.queue_time_us":344849}
W20260709 14:52:15.883051  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 149975us
I20260709 14:52:15.882963  7775 rpcz_store.cc:276] 0709 14:52:14.649450 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:14.651045 (+  1595us) service_pool.cc:224] Handling call
0709 14:52:14.653858 (+  2813us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:52:14.657371 (+  3513us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 14:52:14.717489 (+ 60118us) log.cc:844] Serialized 14 byte log entry
0709 14:52:15.351693 (+634204us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:52:15.379836 (+ 28143us) log.cc:844] Serialized 26 byte log entry
0709 14:52:15.380025 (+   189us) raft_consensus.cc:1645] Marking committed up to 8
0709 14:52:15.380061 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:15.380149 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:52:15.857700 (+477551us) raft_consensus.cc:1685] finished
0709 14:52:15.857743 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:15.858128 (+   385us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13135,"prepare.queue_time_us":58797,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":52,"raft.queue_time_us":16437,"raft.run_cpu_time_us":280,"raft.run_wall_time_us":11262,"spinlock_wait_cycles":871808,"thread_start_us":515752,"threads_started":1,"wal-append.queue_time_us":854451}
I20260709 14:52:15.889186  7745 leader_election.cc:304] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:15.826431 11527 raft_consensus.cc:2804] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 14:52:15.885136  7921 rpcz_store.cc:276] 0709 14:52:14.741111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:14.741387 (+   276us) service_pool.cc:224] Handling call
0709 14:52:14.741867 (+   480us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:52:14.796944 (+ 55077us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 14:52:14.797081 (+   137us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:52:14.798171 (+  1090us) log.cc:844] Serialized 26 byte log entry
0709 14:52:15.165980 (+367809us) raft_consensus.cc:1645] Marking committed up to 5
0709 14:52:15.166048 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:15.166150 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:52:15.836430 (+670280us) raft_consensus.cc:1685] finished
0709 14:52:15.836485 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:15.836710 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":53848,"raft.queue_time_us":82358,"raft.run_cpu_time_us":232,"raft.run_wall_time_us":21001,"thread_start_us":367358,"threads_started":1,"wal-append.queue_time_us":548060}
I20260709 14:52:15.893790  7745 leader_election.cc:304] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 9418391fa82a42c79c6cad13ba91d964
I20260709 14:52:15.894150  7919 raft_consensus.cc:3055] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 14:52:15.895268  7775 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 2877) took 1217 ms. Trace:
I20260709 14:52:15.881762 11481 raft_consensus.cc:3060] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Advancing to term 9
W20260709 14:52:15.898636 11550 log.cc:927] Time spent T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.686s	user 0.002s	sys 0.002s
W20260709 14:52:15.909096  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 265367us
I20260709 14:52:15.916496  7775 rpcz_store.cc:276] 0709 14:52:14.677708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:15.889151 (+1211443us) service_pool.cc:224] Handling call
0709 14:52:15.894289 (+  5138us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:52:15.894753 (+   464us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:52:15.894798 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:52:15.894859 (+    61us) raft_consensus.cc:1645] Marking committed up to 9
0709 14:52:15.894907 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:15.894996 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:15.895184 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 14:52:15.917992 11574 log.cc:927] Time spent T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.089s	user 0.001s	sys 0.001s
I20260709 14:52:15.922109  7774 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 2874) took 1253 ms. Trace:
I20260709 14:52:15.854707 11430 raft_consensus.cc:515] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:15.924962  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:15.942358  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:15.943096  7847 raft_consensus.cc:3060] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Advancing to term 13
I20260709 14:52:15.939687  7819 leader_election.cc:304] T 9441e831627143a991a1556dcdce71e3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 9418391fa82a42c79c6cad13ba91d964
I20260709 14:52:15.928946 11371 raft_consensus.cc:2804] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 14:52:15.930835  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 44381us
I20260709 14:52:15.884186 11577 raft_consensus.cc:2749] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 14:52:15.876513 11440 raft_consensus.cc:515] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:15.954965  7772 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 2850) took 1349 ms. Trace:
I20260709 14:52:15.915781  7745 leader_election.cc:304] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:15.916249  7919 raft_consensus.cc:740] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:15.907807 11287 raft_consensus.cc:2749] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 14:52:15.946285  7775 raft_consensus.cc:1275] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 8. (term mismatch)
I20260709 14:52:15.925761 11355 consensus_queue.cc:237] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:15.937861  7774 rpcz_store.cc:276] 0709 14:52:14.668798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:15.612419 (+943621us) service_pool.cc:224] Handling call
0709 14:52:15.620803 (+  8384us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:52:15.621269 (+   466us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:52:15.621308 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:52:15.622134 (+   826us) log.cc:844] Serialized 26 byte log entry
0709 14:52:15.825692 (+203558us) raft_consensus.cc:1645] Marking committed up to 3
0709 14:52:15.825733 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:15.825805 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:52:15.921764 (+ 95959us) raft_consensus.cc:1685] finished
0709 14:52:15.921789 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:15.922002 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":26436,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":151,"thread_start_us":203102,"threads_started":1,"wal-append.queue_time_us":297515}
W20260709 14:52:15.959575  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 43938.9us
I20260709 14:52:15.963557  7775 pending_rounds.cc:85] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed: Aborting all ops after (but not including) 7
I20260709 14:52:15.952617  7819 leader_election.cc:304] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:15.890450 11535 consensus_queue.cc:1048] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.063s
W20260709 14:52:15.938505 11372 consensus_meta.cc:287] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent flushing consensus metadata: real 0.737s	user 0.009s	sys 0.008s
I20260709 14:52:15.955600  7772 rpcz_store.cc:276] 0709 14:52:14.605554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:14.605687 (+   133us) service_pool.cc:224] Handling call
0709 14:52:14.641586 (+ 35899us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:52:14.644938 (+  3352us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 14:52:14.926682 (+281744us) log.cc:844] Serialized 14 byte log entry
0709 14:52:15.308058 (+381376us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:52:15.309076 (+  1018us) log.cc:844] Serialized 26 byte log entry
0709 14:52:15.334897 (+ 25821us) spinlock_profiling.cc:243] Waited 2.83 ms on lock 0x7b480006c3d8. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68fdb7aa1 00007fb68fdaeb37 00007fb68fdae9ca 00007fb68fea626f 00007fb68fea5f37 00007fb68feba55c 00007fb68feba508 00007fb68feba488 00007fb68feba443 00007fb68feb96ec 00007fb68ede3a96
0709 14:52:15.413608 (+ 78711us) raft_consensus.cc:1645] Marking committed up to 5
0709 14:52:15.413680 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:15.413765 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:52:15.934187 (+520422us) raft_consensus.cc:1685] finished
0709 14:52:15.954630 (+ 20443us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:15.954876 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14608,"prepare.queue_time_us":20672,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":29,"raft.queue_time_us":59756,"raft.run_cpu_time_us":4344,"raft.run_wall_time_us":712936,"spinlock_wait_cycles":7497344,"thread_start_us":551117,"threads_started":2,"wal-append.queue_time_us":969488}
I20260709 14:52:15.967114  7775 pending_rounds.cc:107] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 14:52:15.979115  7775 raft_consensus.cc:2889] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:52:15.957127  7919 consensus_queue.cc:260] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:52:15.980556  7775 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 2878) took 1284 ms. Trace:
I20260709 14:52:15.937215 11527 raft_consensus.cc:493] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:15.967483  7745 leader_election.cc:304] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:52:15.991850  7894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:15.981178  7775 rpcz_store.cc:276] 0709 14:52:14.696046 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:15.936993 (+1240947us) service_pool.cc:224] Handling call
0709 14:52:15.945851 (+  8858us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:52:15.980039 (+ 34188us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:15.980462 (+   423us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 14:52:15.997225  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:15.998199  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:15.982538  7819 leader_election.cc:304] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:15.995390  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:15.981045  7919 raft_consensus.cc:3060] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:52:16.009150  7922 raft_consensus.cc:1240] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 10. Current term is 11. Ops: []
I20260709 14:52:15.997498  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:15.976287  7847 raft_consensus.cc:2468] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 13.
W20260709 14:52:16.010736  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 59294.4us
I20260709 14:52:15.999066  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:16.014307  7847 raft_consensus.cc:1275] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 14:52:16.016621  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:15.950902 11371 raft_consensus.cc:493] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9418391fa82a42c79c6cad13ba91d964)
I20260709 14:52:15.953621 11489 raft_consensus.cc:493] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:16.016978  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:16.030791  7847 raft_consensus.cc:1275] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 14:52:16.029316  7772 raft_consensus.cc:1240] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 10. Current term is 11. Ops: []
I20260709 14:52:16.017685  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:16.032373  7772 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 2880) took 1328 ms. Trace:
I20260709 14:52:16.032760  7772 rpcz_store.cc:276] 0709 14:52:14.703993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:15.978609 (+1274616us) service_pool.cc:224] Handling call
0709 14:52:16.029066 (+ 50457us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:52:16.032100 (+  3034us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:16.032308 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 14:52:16.018106  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 50841.5us
I20260709 14:52:16.033319  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:16.034369  7745 leader_election.cc:304] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:16.019611  7819 leader_election.cc:304] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:16.033496  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:16.037508  7919 raft_consensus.cc:1275] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Refusing update from remote peer 9418391fa82a42c79c6cad13ba91d964: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 14:52:16.037987  7919 pending_rounds.cc:85] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1e9289592458429bbddb19c2e7b7b7b0: Aborting all ops after (but not including) 5
I20260709 14:52:16.038208  7919 pending_rounds.cc:107] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1e9289592458429bbddb19c2e7b7b7b0: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 14:52:16.038439  7919 raft_consensus.cc:2889] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:52:15.965128 11568 raft_consensus.cc:2749] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 14:52:16.044664  7819 leader_election.cc:304] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:16.058636  7852 raft_consensus.cc:1275] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 14:52:16.052698  7745 leader_election.cc:304] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:16.019938  7846 raft_consensus.cc:3060] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:52:16.065415  7745 leader_election.cc:304] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
W20260709 14:52:16.067571  7744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:16.073302  7771 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47054 (request call id 216) took 1109 ms. Trace:
I20260709 14:52:16.073935  7771 rpcz_store.cc:276] 0709 14:52:14.964085 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:16.072109 (+1108024us) service_pool.cc:224] Handling call
0709 14:52:16.072604 (+   495us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:52:16.072844 (+   240us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:52:16.072872 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:52:16.072921 (+    49us) raft_consensus.cc:1645] Marking committed up to 6
0709 14:52:16.072956 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:16.073013 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:16.073185 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 14:52:16.009886 11527 raft_consensus.cc:3060] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Advancing to term 14
I20260709 14:52:15.890868 11575 raft_consensus.cc:515] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:16.030017 11591 log.cc:927] Time spent T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
W20260709 14:52:16.088972  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 44485.6us
I20260709 14:52:16.078632  7779 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47054 (request call id 217) took 1114 ms. Trace:
I20260709 14:52:16.094535  7779 rpcz_store.cc:276] 0709 14:52:14.964411 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:16.072685 (+1108274us) service_pool.cc:224] Handling call
0709 14:52:16.077392 (+  4707us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:52:16.078223 (+   831us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:52:16.078254 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:52:16.078297 (+    43us) raft_consensus.cc:1645] Marking committed up to 5
0709 14:52:16.078327 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:16.078386 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:16.078528 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 14:52:16.081415  7745 leader_election.cc:304] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:16.035187 11577 raft_consensus.cc:2749] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 14:52:16.035506 11371 raft_consensus.cc:3060] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:52:16.079107 11573 raft_consensus.cc:2804] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 14:52:16.099720  7772 raft_consensus.cc:1240] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 14:52:16.108352  7847 raft_consensus.cc:1275] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 14:52:16.160539  7772 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37136 (request call id 2330) took 1224 ms. Trace:
I20260709 14:52:16.161062  7772 rpcz_store.cc:276] 0709 14:52:14.936165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:16.069391 (+1133226us) service_pool.cc:224] Handling call
0709 14:52:16.099161 (+ 29770us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:52:16.160041 (+ 60880us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:16.160428 (+   387us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 14:52:16.036093 11579 raft_consensus.cc:697] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:52:16.045687 11595 raft_consensus.cc:2749] T 9441e831627143a991a1556dcdce71e3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 14:52:16.134991  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:16.075671 11567 raft_consensus.cc:2749] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 14:52:16.120195 11568 raft_consensus.cc:2749] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 14:52:16.008857 11372 raft_consensus.cc:515] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:16.101467  7819 leader_election.cc:304] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:16.146763  7924 raft_consensus.cc:2468] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 11.
I20260709 14:52:16.102998  7745 leader_election.cc:304] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:16.150367  7778 raft_consensus.cc:1240] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 LEADER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 10. Current term is 11. Ops: []
I20260709 14:52:16.100428 11287 raft_consensus.cc:2804] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 14:52:16.152580  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 101719us
W20260709 14:52:16.156216 11592 log.cc:927] Time spent T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
I20260709 14:52:16.053218 11553 raft_consensus.cc:2804] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 14:52:16.160773  7849 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 3144) took 2041 ms. Trace:
I20260709 14:52:16.054701 11489 raft_consensus.cc:515] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:16.192814  7846 raft_consensus.cc:1275] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
W20260709 14:52:16.172351  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 69472.6us
W20260709 14:52:16.173740  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 74999.7us
I20260709 14:52:16.195091  7846 pending_rounds.cc:85] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting all ops after (but not including) 5
I20260709 14:52:16.138314 11586 raft_consensus.cc:493] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:16.181236  7894 leader_election.cc:304] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:16.181027  7847 raft_consensus.cc:1275] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
W20260709 14:52:16.183882  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 171360us
I20260709 14:52:16.112390 11584 consensus_queue.cc:1048] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 9418391fa82a42c79c6cad13ba91d964 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.115s
I20260709 14:52:16.175056 11577 raft_consensus.cc:2749] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 14:52:16.184753 11590 log.cc:927] Time spent T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.168s	user 0.000s	sys 0.000s
I20260709 14:52:16.185372 11579 consensus_queue.cc:237] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:16.187290 11430 leader_election.cc:290] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:16.188634 11440 leader_election.cc:290] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:16.191408  7850 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49948 (request call id 3326) took 2032 ms. Trace:
I20260709 14:52:16.113376 11594 raft_consensus.cc:2804] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 14:52:16.194433  7745 leader_election.cc:304] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:16.197577 11569 raft_consensus.cc:493] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:16.195465  7846 pending_rounds.cc:107] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 14:52:16.161178 11573 raft_consensus.cc:493] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:16.190344  7849 rpcz_store.cc:276] 0709 14:52:14.119022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:15.077976 (+958954us) service_pool.cc:224] Handling call
0709 14:52:15.078278 (+   302us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 14:52:15.078603 (+   325us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 14:52:15.078631 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 14:52:15.079192 (+   561us) log.cc:844] Serialized 52 byte log entry
0709 14:52:15.580224 (+501032us) raft_consensus.cc:1645] Marking committed up to 2
0709 14:52:15.580268 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:15.580340 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:52:16.159894 (+579554us) raft_consensus.cc:1685] finished
0709 14:52:16.159916 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:16.160125 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":14439,"raft.run_cpu_time_us":643,"raft.run_wall_time_us":46560,"thread_start_us":379465,"threads_started":1,"wal-append.queue_time_us":575957}
I20260709 14:52:16.199622  7770 raft_consensus.cc:1240] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260709 14:52:16.159446 11593 raft_consensus.cc:2804] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 14:52:16.201664 11602 raft_consensus.cc:2804] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 14:52:16.147939 11582 raft_consensus.cc:697] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:52:16.174914 11287 raft_consensus.cc:493] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:16.223807 11466 leader_election.cc:290] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785), 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68:42321)
W20260709 14:52:16.216269 11552 consensus_meta.cc:287] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent flushing consensus metadata: real 0.777s	user 0.011s	sys 0.007s
W20260709 14:52:16.227705  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 46586.5us
I20260709 14:52:16.231448 11594 raft_consensus.cc:493] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:16.194103 11553 raft_consensus.cc:493] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:16.228626  7850 rpcz_store.cc:276] 0709 14:52:14.159110 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:15.182493 (+1023383us) service_pool.cc:224] Handling call
0709 14:52:15.203151 (+ 20658us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:52:15.573307 (+370156us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:52:15.573628 (+   321us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:52:15.574427 (+   799us) log.cc:844] Serialized 26 byte log entry
0709 14:52:15.851160 (+276733us) raft_consensus.cc:1645] Marking committed up to 5
0709 14:52:15.851210 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:15.851304 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:52:16.191149 (+339845us) raft_consensus.cc:1685] finished
0709 14:52:16.191170 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:16.191335 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":105357,"raft.run_cpu_time_us":206,"raft.run_wall_time_us":19594,"thread_start_us":576786,"threads_started":2,"wal-append.queue_time_us":403243}
I20260709 14:52:16.250654 11287 raft_consensus.cc:3060] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Advancing to term 13
I20260709 14:52:16.269361 11553 raft_consensus.cc:3060] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Advancing to term 13
I20260709 14:52:16.236747 11573 raft_consensus.cc:3060] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:52:16.233850 11440 raft_consensus.cc:2749] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 14:52:16.195425  7819 leader_election.cc:304] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
W20260709 14:52:16.208207 11338 consensus_meta.cc:287] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent flushing consensus metadata: real 0.799s	user 0.014s	sys 0.002s
I20260709 14:52:16.231006  7745 leader_election.cc:304] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:52:16.287464  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 56581.3us
I20260709 14:52:16.231958  7846 raft_consensus.cc:2889] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:52:16.232833 11510 raft_consensus.cc:2749] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 14:52:16.181803 11580 consensus_queue.cc:1048] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.068s
I20260709 14:52:16.204079 11504 consensus_queue.cc:1048] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
W20260709 14:52:16.236343 11119 consensus_meta.cc:287] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent flushing consensus metadata: real 1.008s	user 0.017s	sys 0.001s
I20260709 14:52:16.251459  7894 leader_election.cc:304] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:16.178171 11598 raft_consensus.cc:2804] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader election won for term 11
W20260709 14:52:16.283337  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 88049.4us
I20260709 14:52:16.319857  7819 leader_election.cc:304] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:16.236279 11593 raft_consensus.cc:493] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:16.321017 11405 raft_consensus.cc:3055] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 LEADER]: Stepping down as leader of term 9
I20260709 14:52:16.321834 11405 raft_consensus.cc:740] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:52:16.322353 11598 raft_consensus.cc:697] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:52:16.322821 11405 consensus_queue.cc:260] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:16.324150 11405 raft_consensus.cc:3060] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:52:16.323536 11598 consensus_queue.cc:237] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:16.206459 11586 raft_consensus.cc:515] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:16.287303  7773 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 2872) took 1624 ms. Trace:
I20260709 14:52:16.325943  7773 rpcz_store.cc:276] 0709 14:52:14.663006 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:15.579578 (+916572us) service_pool.cc:224] Handling call
0709 14:52:15.579935 (+   357us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:52:15.606927 (+ 26992us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:52:15.606969 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:52:15.607664 (+   695us) log.cc:844] Serialized 26 byte log entry
0709 14:52:15.820034 (+212370us) raft_consensus.cc:1645] Marking committed up to 7
0709 14:52:15.820079 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:15.820164 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:52:16.286836 (+466672us) raft_consensus.cc:1685] finished
0709 14:52:16.286859 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:16.287227 (+   368us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26551,"raft.queue_time_us":27793,"raft.run_cpu_time_us":257,"raft.run_wall_time_us":29702,"thread_start_us":152343,"threads_started":1,"wal-append.queue_time_us":328683}
W20260709 14:52:16.329562  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:16.329752 11119 raft_consensus.cc:515] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:16.330102  7851 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 3131) took 2216 ms. Trace:
I20260709 14:52:16.330607  7851 rpcz_store.cc:276] 0709 14:52:14.114065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:14.800429 (+686364us) service_pool.cc:224] Handling call
0709 14:52:14.800982 (+   553us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:52:14.923870 (+122888us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:52:14.923902 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:52:14.942811 (+ 18909us) log.cc:844] Serialized 26 byte log entry
0709 14:52:15.349826 (+407015us) raft_consensus.cc:1645] Marking committed up to 3
0709 14:52:15.349893 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:16.329527 (+979634us) spinlock_profiling.cc:243] Waited 122 ms on lock 0x7b54002cabd4. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae8ee01 00007fb68ae8d83e 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2 00007fb6891c948c 00007fb6891c88c6
0709 14:52:16.329590 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:52:16.329656 (+    66us) raft_consensus.cc:1685] finished
0709 14:52:16.329671 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:16.330014 (+   343us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10616,"raft.run_cpu_time_us":279,"raft.run_wall_time_us":33129,"spinlock_wait_cycles":281284992,"thread_start_us":315910,"threads_started":1,"wal-append.queue_time_us":629535}
I20260709 14:52:16.332387 11119 leader_election.cc:290] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:16.243171 11602 raft_consensus.cc:493] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:16.313050  7846 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49948 (request call id 3336) took 2149 ms. Trace:
I20260709 14:52:16.351804  7846 rpcz_store.cc:276] 0709 14:52:14.163298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:15.271492 (+1108194us) service_pool.cc:224] Handling call
0709 14:52:15.272007 (+   515us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:52:16.019215 (+747208us) spinlock_profiling.cc:243] Waited 199 ms on lock 0x7b54002b3f20. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae03a1d 00007fb68adea1a4 00007fb68ae6c447 00007fb68ae84fe7 00007fb68ae867de 00007fb68ae90b49 00007fb68ae91416 00007fb68ae8dd8f 00007fb68ae8d83e 00007fb68fe52419
0709 14:52:16.312589 (+293374us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:16.312911 (+   322us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":457893760}
I20260709 14:52:16.242390 11559 leader_election.cc:290] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:16.320768 11338 raft_consensus.cc:2804] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader election won for term 11
I20260709 14:52:16.238266 11569 raft_consensus.cc:515] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:16.308209 11466 raft_consensus.cc:2749] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 14:52:16.309299 11430 raft_consensus.cc:2804] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 14:52:16.306741  7745 leader_election.cc:304] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:52:16.334720  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 83441.7us
I20260709 14:52:16.336249 11504 raft_consensus.cc:2804] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 14:52:16.282016 11594 raft_consensus.cc:3060] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:52:16.337955 11582 consensus_queue.cc:237] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:16.346287  7775 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 2881) took 1634 ms. Trace:
I20260709 14:52:16.322721  7819 leader_election.cc:304] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
W20260709 14:52:16.376610  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 70056.5us
I20260709 14:52:16.333877  7928 raft_consensus.cc:2393] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 10: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
W20260709 14:52:16.343784 11596 log.cc:927] Time spent T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.184s	user 0.000s	sys 0.002s
I20260709 14:52:16.327888 11586 leader_election.cc:290] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:16.384615 11595 raft_consensus.cc:2749] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 14:52:16.384960  7845 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 3128) took 2708 ms. Trace:
I20260709 14:52:16.345060 11593 raft_consensus.cc:3060] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Advancing to term 10
W20260709 14:52:16.380271  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 57341.2us
I20260709 14:52:16.385507  7853 raft_consensus.cc:1217] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Deduplicated request from leader. Original: 4.3->[6.4-9.6]   Dedup: 8.5->[9.6-9.6]
I20260709 14:52:16.387485  7853 raft_consensus.cc:1240] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 9. Current term is 10. Ops: [6.4-9.6]
I20260709 14:52:16.374465  7775 rpcz_store.cc:276] 0709 14:52:14.711880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:15.993800 (+1281920us) service_pool.cc:224] Handling call
0709 14:52:16.007178 (+ 13378us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 14:52:16.007691 (+   513us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:52:16.007724 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 14:52:16.060642 (+ 52918us) log.cc:844] Serialized 52 byte log entry
0709 14:52:16.227361 (+166719us) raft_consensus.cc:1645] Marking committed up to 3
0709 14:52:16.308227 (+ 80866us) log.cc:844] Serialized 14 byte log entry
0709 14:52:16.312088 (+  3861us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:16.312218 (+   130us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:52:16.345887 (+ 33669us) raft_consensus.cc:1685] finished
0709 14:52:16.345912 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:16.346205 (+   293us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1943,"prepare.queue_time_us":42012,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":62,"raft.queue_time_us":13464,"raft.run_cpu_time_us":412,"raft.run_wall_time_us":48390,"thread_start_us":160684,"threads_started":2,"wal-append.queue_time_us":150995}
I20260709 14:52:16.359490 11535 raft_consensus.cc:493] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:16.385737  7845 rpcz_store.cc:276] 0709 14:52:13.676618 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:14.760397 (+1083779us) service_pool.cc:224] Handling call
0709 14:52:14.760791 (+   394us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 14:52:15.127453 (+366662us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:52:15.127501 (+    48us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 14:52:15.152767 (+ 25266us) log.cc:844] Serialized 78 byte log entry
0709 14:52:15.458172 (+305405us) raft_consensus.cc:1645] Marking committed up to 5
0709 14:52:15.491943 (+ 33771us) log.cc:844] Serialized 14 byte log entry
0709 14:52:15.904880 (+412937us) spinlock_profiling.cc:243] Waited 18.8 ms on lock 0x7b18003cdcc0. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb690c69de1 00007fb690c765b1 00007fb687da13f3 00007fb687da37c1 00007fb687da3779 00007fb687da3709 00007fb687da36d1 00007fb687da29cd 0000000000396ad4 0000000000396919 00007fb687d8483a
0709 14:52:16.383958 (+479078us) spinlock_profiling.cc:243] Waited 3.03 ms on lock 0x7b18003cdcc0. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb690c69de1 00007fb690c765b1 00007fb687d1bc0a 00007fb69145b219 00007fb687da3a40 00007fb687d9e4e4 00007fb687d9e455 00007fb68e8863c7 00007fb68ae989a7 00007fb68aea80bf 00007fb68aea8038
0709 14:52:16.384234 (+   276us) log.cc:844] Serialized 14 byte log entry
0709 14:52:16.384503 (+   269us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:16.384604 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:52:16.384652 (+    48us) raft_consensus.cc:1685] finished
0709 14:52:16.384664 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:16.384882 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":827629,"prepare.queue_time_us":930062,"prepare.run_cpu_time_us":4078,"prepare.run_wall_time_us":46392,"raft.queue_time_us":148886,"raft.run_cpu_time_us":414,"raft.run_wall_time_us":11809,"spinlock_wait_cycles":50130176,"thread_start_us":582878,"threads_started":2,"wal-append.queue_time_us":829656}
I20260709 14:52:16.358480 11602 raft_consensus.cc:3060] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Advancing to term 8
I20260709 14:52:16.411767  7819 leader_election.cc:304] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:16.413094 11577 raft_consensus.cc:493] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:16.380887 11382 leader_election.cc:290] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:52:16.441772  7743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:16.413035 11604 consensus_queue.cc:1048] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 14:52:16.370682 11338 raft_consensus.cc:697] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:52:16.380916 11533 raft_consensus.cc:2749] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 14:52:16.281558 11552 raft_consensus.cc:515] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:16.422518  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:16.421943 11440 consensus_queue.cc:1059] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 14:52:16.391218 11504 raft_consensus.cc:697] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:16.397050  7744 leader_election.cc:304] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
W20260709 14:52:16.432497  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 58364.1us
I20260709 14:52:16.530541  7851 raft_consensus.cc:1240] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 LEADER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 10. Current term is 11. Ops: []
W20260709 14:52:16.530624  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 133721us
I20260709 14:52:16.366184 11580 consensus_queue.cc:1048] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 14:52:16.535502  7849 raft_consensus.cc:1240] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
W20260709 14:52:16.461427  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 49816.2us
I20260709 14:52:16.386884 11575 leader_election.cc:290] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:52:16.469147  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:16.460300 11559 raft_consensus.cc:2749] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 14:52:16.413426 11372 leader_election.cc:290] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:16.413502 11383 consensus_queue.cc:1048] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.115s
I20260709 14:52:16.368917 11430 raft_consensus.cc:493] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:16.454387 11466 raft_consensus.cc:493] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:16.407941 11500 consensus_queue.cc:1048] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.083s
I20260709 14:52:16.537704  7819 leader_election.cc:304] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
W20260709 14:52:16.539981  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:16.430572 11605 raft_consensus.cc:493] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:52:16.466544 11534 raft_consensus.cc:493] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:52:16.531840 11578 log.cc:927] Time spent T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260709 14:52:16.422983 11535 raft_consensus.cc:515] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:16.535240 11382 raft_consensus.cc:2804] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader election won for term 10
I20260709 14:52:16.560165  7819 leader_election.cc:304] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:16.564833  7774 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 2879) took 1863 ms. Trace:
I20260709 14:52:16.568284 11405 raft_consensus.cc:493] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:16.547195 11430 raft_consensus.cc:3060] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:52:16.602105  7774 rpcz_store.cc:276] 0709 14:52:14.701487 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:15.966434 (+1264947us) service_pool.cc:224] Handling call
0709 14:52:15.969415 (+  2981us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:52:15.969689 (+   274us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 14:52:16.245111 (+275422us) log.cc:844] Serialized 14 byte log entry
0709 14:52:16.564383 (+319272us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:52:16.564447 (+    64us) raft_consensus.cc:1645] Marking committed up to 5
0709 14:52:16.564518 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:16.564616 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:16.564756 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17694,"prepare.queue_time_us":281518,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":59,"raft.queue_time_us":18895,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":125,"thread_start_us":528545,"threads_started":2}
W20260709 14:52:16.606756  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 46700.7us
I20260709 14:52:16.558059 11575 raft_consensus.cc:2749] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 14:52:16.528966 11338 consensus_queue.cc:237] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:16.462085 11577 raft_consensus.cc:515] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:16.690940  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 90641.4us
W20260709 14:52:16.673897 11378 consensus_meta.cc:287] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent flushing consensus metadata: real 1.495s	user 0.019s	sys 0.000s
I20260709 14:52:16.692890  7819 leader_election.cc:304] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
W20260709 14:52:16.673709 11616 log.cc:927] Time spent T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.057s	user 0.000s	sys 0.002s
I20260709 14:52:16.661124 11595 raft_consensus.cc:493] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:16.700547 11595 raft_consensus.cc:515] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:16.705565  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 43772.1us
W20260709 14:52:16.686115 11527 consensus_meta.cc:287] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent flushing consensus metadata: real 0.579s	user 0.013s	sys 0.002s
I20260709 14:52:16.706768  7819 leader_election.cc:304] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:16.562732 11466 raft_consensus.cc:515] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:16.670047 11559 raft_consensus.cc:2749] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 14:52:16.709813  7744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:16.711867  7819 leader_election.cc:304] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:16.714459 11595 leader_election.cc:290] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:16.658887 11405 raft_consensus.cc:515] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:16.601154 11534 raft_consensus.cc:515] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:16.726045  7927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38532 (request call id 3107) took 1235 ms. Trace:
W20260709 14:52:16.758563  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:16.716348 11575 raft_consensus.cc:2749] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 14:52:16.745663  7927 rpcz_store.cc:276] 0709 14:52:15.491103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:15.491311 (+   208us) service_pool.cc:224] Handling call
0709 14:52:15.566854 (+ 75543us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:52:15.567507 (+   653us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:52:15.567536 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:52:16.187590 (+620054us) spinlock_profiling.cc:243] Waited 13 ms on lock 0x7b2c0010d148. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb689787a11 00007fb689797372 00007fb68aec9a01 00007fb68ae8e43a 00007fb68ae8d83e 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2
0709 14:52:16.188192 (+   602us) log.cc:844] Serialized 26 byte log entry
0709 14:52:16.443948 (+255756us) raft_consensus.cc:1645] Marking committed up to 5
0709 14:52:16.443991 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:16.444080 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:52:16.719427 (+275347us) raft_consensus.cc:1685] finished
0709 14:52:16.719461 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:16.725932 (+  6471us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23860,"raft.queue_time_us":52710,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":5072,"spinlock_wait_cycles":29931904,"thread_start_us":254936,"threads_started":1,"wal-append.queue_time_us":373073}
I20260709 14:52:16.595799 11605 raft_consensus.cc:515] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:16.703699 11383 consensus_queue.cc:1048] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.063s
I20260709 14:52:16.707321 11355 consensus_queue.cc:1059] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.077s
I20260709 14:52:16.753137 11595 raft_consensus.cc:2749] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 14:52:16.723253 11586 consensus_queue.cc:1059] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.073s
I20260709 14:52:16.689847 11504 consensus_queue.cc:237] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:16.709326 11378 raft_consensus.cc:515] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:16.809648  7745 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:16.812233  7845 raft_consensus.cc:1240] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 3. Current term is 4. Ops: []
I20260709 14:52:16.723804 11527 raft_consensus.cc:515] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:16.807139 11559 raft_consensus.cc:2749] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 14:52:16.843814  8639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce9c0ef2db24c13a8b1402f21819458" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9418391fa82a42c79c6cad13ba91d964" is_pre_election: true
W20260709 14:52:16.844830 11611 log.cc:927] Time spent T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 14:52:16.807799 11569 leader_election.cc:290] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:16.851682 11405 leader_election.cc:290] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:16.832906 11355 raft_consensus.cc:3055] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 LEADER]: Stepping down as leader of term 6
W20260709 14:52:16.841126 11607 log.cc:927] Time spent T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.307s	user 0.000s	sys 0.003s
I20260709 14:52:16.855264 11605 leader_election.cc:290] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:52:16.862418 11612 log.cc:927] Time spent T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.290s	user 0.001s	sys 0.001s
I20260709 14:52:16.857051 11355 raft_consensus.cc:740] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:52:16.845058 11466 leader_election.cc:290] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:16.870640 11355 consensus_queue.cc:260] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:16.874981 11355 raft_consensus.cc:3060] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Advancing to term 7
W20260709 14:52:16.870505 11371 consensus_meta.cc:287] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent flushing consensus metadata: real 0.703s	user 0.012s	sys 0.003s
W20260709 14:52:16.908468 11597 log.cc:927] Time spent T 00000000000000000000000000000000 P 133636659113430cb53b321cb0b1d9ee: Append to log took a long time: real 0.730s	user 0.005s	sys 0.000s
W20260709 14:52:16.930451 11609 log.cc:927] Time spent T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.311s	user 0.002s	sys 0.000s
I20260709 14:52:16.932986  7777 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 2876) took 2259 ms. Trace:
I20260709 14:52:16.935285  7777 rpcz_store.cc:276] 0709 14:52:14.673232 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:15.888814 (+1215582us) service_pool.cc:224] Handling call
0709 14:52:15.889257 (+   443us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:52:15.894823 (+  5566us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 14:52:16.137496 (+242673us) log.cc:844] Serialized 14 byte log entry
0709 14:52:16.319383 (+181887us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:52:16.363479 (+ 44096us) log.cc:844] Serialized 26 byte log entry
0709 14:52:16.363671 (+   192us) raft_consensus.cc:1645] Marking committed up to 5
0709 14:52:16.363712 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:16.363802 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:52:16.932669 (+568867us) raft_consensus.cc:1685] finished
0709 14:52:16.932698 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:16.932893 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":334208,"prepare.run_cpu_time_us":88,"prepare.run_wall_time_us":3734,"raft.queue_time_us":1417,"raft.run_cpu_time_us":356,"raft.run_wall_time_us":361,"thread_start_us":313840,"threads_started":2,"wal-append.queue_time_us":305165}
W20260709 14:52:16.949898 11613 log.cc:927] Time spent T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.245s	user 0.000s	sys 0.002s
I20260709 14:52:16.952448 11527 leader_election.cc:290] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 14 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:52:16.964859 11594 consensus_meta.cc:287] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent flushing consensus metadata: real 0.575s	user 0.009s	sys 0.000s
W20260709 14:52:16.997622  7743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:16.999181  7770 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 2875) took 2328 ms. Trace:
I20260709 14:52:16.999979  7770 rpcz_store.cc:276] 0709 14:52:14.671162 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:15.858866 (+1187704us) service_pool.cc:224] Handling call
0709 14:52:15.860009 (+  1143us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:52:16.236494 (+376485us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:16.998693 (+762199us) spinlock_profiling.cc:243] Waited 339 ms on lock 0x7b5400221354. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae8ee01 00007fb68ae8d83e 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2 00007fb6891c948c 00007fb6891c88c6
0709 14:52:16.999073 (+   380us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":780219776}
I20260709 14:52:16.862488 11622 raft_consensus.cc:493] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:17.008939 11512 raft_consensus.cc:493] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:52:17.013053 11567 raft_consensus.cc:3055] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 LEADER]: Stepping down as leader of term 9
I20260709 14:52:17.018254 11552 leader_election.cc:290] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 14 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:52:17.031667 11581 log.cc:927] Time spent T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 1.051s	user 0.000s	sys 0.005s
I20260709 14:52:16.865617 11569 consensus_queue.cc:1048] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.113s
I20260709 14:52:17.082489 11527 raft_consensus.cc:493] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:17.083622 11527 raft_consensus.cc:515] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:16.938352 11371 raft_consensus.cc:515] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
W20260709 14:52:17.050874 11481 consensus_meta.cc:287] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent flushing consensus metadata: real 1.089s	user 0.009s	sys 0.009s
W20260709 14:52:17.037122 11553 consensus_meta.cc:287] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent flushing consensus metadata: real 0.766s	user 0.009s	sys 0.003s
W20260709 14:52:17.053761 11593 consensus_meta.cc:287] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent flushing consensus metadata: real 0.632s	user 0.008s	sys 0.006s
I20260709 14:52:17.039069 11378 leader_election.cc:290] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 11 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:17.038213 11577 leader_election.cc:290] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:17.042613 11567 raft_consensus.cc:740] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:52:17.149072 11567 consensus_queue.cc:260] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:17.150743 11567 raft_consensus.cc:3060] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:52:16.992831 11594 raft_consensus.cc:515] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:17.155395  7850 raft_consensus.cc:1240] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 14:52:17.154415 11594 leader_election.cc:290] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 11 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:17.157732  7854 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 3130) took 3044 ms. Trace:
I20260709 14:52:17.162657 11593 raft_consensus.cc:515] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:17.165661  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:52:17.166662  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:52:17.089412 11287 consensus_meta.cc:287] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent flushing consensus metadata: real 0.819s	user 0.014s	sys 0.001s
I20260709 14:52:17.158290  7854 rpcz_store.cc:276] 0709 14:52:14.113442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:14.750401 (+636959us) service_pool.cc:224] Handling call
0709 14:52:14.750810 (+   409us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:52:15.145691 (+394881us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 14:52:15.195813 (+ 50122us) log.cc:844] Serialized 14 byte log entry
0709 14:52:15.936017 (+740204us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:52:15.947993 (+ 11976us) log.cc:844] Serialized 26 byte log entry
0709 14:52:15.948430 (+   437us) raft_consensus.cc:1645] Marking committed up to 3
0709 14:52:15.948479 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:15.948579 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:52:17.028155 (+1079576us) spinlock_profiling.cc:243] Waited 18.5 ms on lock 0x7b2400266408. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb687c29db1 00007fb687c279c4 00007fb687c25acb 00007fb687de0dc9 00007fb687de0a55 00007fb687de009d 00007fb68aa1210e 00007fb68aa2988c 00007fb68aa28bb6 00007fb68aa287d8 00007fb68aa32221
0709 14:52:17.142510 (+114355us) raft_consensus.cc:1685] finished
0709 14:52:17.157385 (+ 14875us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:17.157604 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46692,"prepare.queue_time_us":42030,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":60,"raft.queue_time_us":353921,"raft.run_cpu_time_us":471,"raft.run_wall_time_us":30081,"spinlock_wait_cycles":42562816,"thread_start_us":992354,"threads_started":3,"wal-append.queue_time_us":694525}
I20260709 14:52:17.182742 11593 leader_election.cc:290] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 10 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:52:17.186898 11430 consensus_meta.cc:287] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent flushing consensus metadata: real 0.516s	user 0.013s	sys 0.000s
I20260709 14:52:17.189178  7771 raft_consensus.cc:1240] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Rejecting Update request from peer 9418391fa82a42c79c6cad13ba91d964 for earlier term 5. Current term is 6. Ops: []
W20260709 14:52:17.203728  7745 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:17.207639  7854 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 3169) took 1284 ms. Trace:
I20260709 14:52:17.208750  7854 rpcz_store.cc:276] 0709 14:52:15.892870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:17.175561 (+1282691us) service_pool.cc:224] Handling call
0709 14:52:17.176103 (+   542us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:52:17.176443 (+   340us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:52:17.176472 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:52:17.176569 (+    97us) raft_consensus.cc:1645] Marking committed up to 5
0709 14:52:17.176653 (+    84us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:17.176717 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:17.177027 (+   310us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 14:52:17.042131 11622 raft_consensus.cc:515] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:17.201259 11573 consensus_meta.cc:287] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent flushing consensus metadata: real 0.928s	user 0.010s	sys 0.010s
W20260709 14:52:17.206737 11602 consensus_meta.cc:287] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent flushing consensus metadata: real 0.745s	user 0.002s	sys 0.016s
I20260709 14:52:17.198333 11582 raft_consensus.cc:493] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:17.187629 11430 raft_consensus.cc:515] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:17.131728 11512 raft_consensus.cc:515] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:17.216866 11361 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
I20260709 14:52:17.143011 11481 raft_consensus.cc:515] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:17.250818  7854 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 3170) took 1250 ms. Trace:
I20260709 14:52:17.251585  7854 rpcz_store.cc:276] 0709 14:52:15.999933 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:17.214555 (+1214622us) service_pool.cc:224] Handling call
0709 14:52:17.222582 (+  8027us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:52:17.222805 (+   223us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:52:17.222831 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:52:17.222878 (+    47us) raft_consensus.cc:1645] Marking committed up to 8
0709 14:52:17.231153 (+  8275us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:17.231365 (+   212us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:17.250720 (+ 19355us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 14:52:17.257905  7847 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.679s	user 0.041s	sys 0.100s
W20260709 14:52:17.258417  7847 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.679s	user 0.041s	sys 0.100s
I20260709 14:52:17.265408  7846 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 3165) took 1376 ms. Trace:
I20260709 14:52:17.266202  7846 rpcz_store.cc:276] 0709 14:52:15.888586 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:16.587992 (+699406us) service_pool.cc:224] Handling call
0709 14:52:16.588521 (+   529us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:52:16.589033 (+   512us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:52:16.589066 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:52:16.665960 (+ 76894us) log.cc:844] Serialized 26 byte log entry
0709 14:52:16.793681 (+127721us) raft_consensus.cc:1645] Marking committed up to 8
0709 14:52:16.793728 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:16.793821 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:52:17.060608 (+266787us) spinlock_profiling.cc:243] Waited 3.31 ms on lock 0x7b4800002dd8. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68fdb7aa1 00007fb68fdaeb37 00007fb68fdae9ca 00007fb68fea626f 00007fb68fea5f37 00007fb68feba55c 00007fb68feba508 00007fb68feba488 00007fb68feba443 00007fb68feb96ec 00007fb68ede3a96
0709 14:52:17.264848 (+204240us) raft_consensus.cc:1685] finished
0709 14:52:17.264884 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:17.265289 (+   405us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":129234,"raft.queue_time_us":173,"raft.run_cpu_time_us":4634,"raft.run_wall_time_us":466210,"spinlock_wait_cycles":7612800,"thread_start_us":62039,"threads_started":1,"wal-append.queue_time_us":568976}
I20260709 14:52:17.216986 11265 raft_consensus.cc:493] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
W20260709 14:52:17.273437  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:17.268105 11582 raft_consensus.cc:515] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:17.273515 11265 raft_consensus.cc:515] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:17.274945 11371 leader_election.cc:290] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68:42321)
I20260709 14:52:17.192044 11287 raft_consensus.cc:515] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:17.145814 11553 raft_consensus.cc:515] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:17.287588  7847 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 3164) took 1399 ms. Trace:
I20260709 14:52:17.288600  7847 rpcz_store.cc:276] 0709 14:52:15.888332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:16.577514 (+689182us) service_pool.cc:224] Handling call
0709 14:52:16.577984 (+   470us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:52:16.578244 (+   260us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 14:52:16.578670 (+   426us) log.cc:844] Serialized 14 byte log entry
0709 14:52:17.259552 (+680882us) log.cc:844] Serialized 14 byte log entry
0709 14:52:17.260317 (+   765us) log.cc:844] Serialized 14 byte log entry
0709 14:52:17.261045 (+   728us) log.cc:844] Serialized 14 byte log entry
0709 14:52:17.287068 (+ 26023us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:52:17.287152 (+    84us) raft_consensus.cc:1645] Marking committed up to 7
0709 14:52:17.287213 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:17.287300 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:17.287502 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":2330,"prepare.run_cpu_time_us":291,"prepare.run_wall_time_us":295,"raft.queue_time_us":544,"raft.run_cpu_time_us":417,"raft.run_wall_time_us":413,"thread_start_us":680015,"threads_started":1,"wal-append.queue_time_us":679552}
W20260709 14:52:17.264895 11382 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.020s	sys 0.038s
I20260709 14:52:17.322631  7845 raft_consensus.cc:1240] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 8. Current term is 9. Ops: []
W20260709 14:52:17.334625 11576 log.cc:927] Time spent T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 1.304s	user 0.000s	sys 0.004s
I20260709 14:52:17.335309 11265 leader_election.cc:290] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:17.337226  7848 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 3126) took 3661 ms. Trace:
I20260709 14:52:17.337886  7848 rpcz_store.cc:276] 0709 14:52:13.676091 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:14.764176 (+1088085us) service_pool.cc:224] Handling call
0709 14:52:14.764671 (+   495us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 14:52:15.124322 (+359651us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 14:52:15.124358 (+    36us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 14:52:15.125053 (+   695us) log.cc:844] Serialized 52 byte log entry
0709 14:52:15.580550 (+455497us) raft_consensus.cc:1645] Marking committed up to 5
0709 14:52:15.580582 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:15.580644 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:52:17.187305 (+1606661us) spinlock_profiling.cc:243] Waited 7.6 ms on lock 0x7b2400266408. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb687c29db1 00007fb687c279c4 00007fb687c25acb 00007fb687de0dc9 00007fb687de0a55 00007fb687de009d 00007fb68aa1210e 00007fb68aa2988c 00007fb68aa28bb6 00007fb68aa287d8 00007fb68aa32221
0709 14:52:17.336826 (+149521us) raft_consensus.cc:1685] finished
0709 14:52:17.336852 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:17.337153 (+   301us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29825,"raft.queue_time_us":153720,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":153,"spinlock_wait_cycles":17479552,"thread_start_us":710204,"threads_started":2,"wal-append.queue_time_us":596277}
I20260709 14:52:17.275656 11582 leader_election.cc:290] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:17.242930 11573 raft_consensus.cc:515] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:17.351107 11573 leader_election.cc:290] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:17.275671 11512 leader_election.cc:290] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:17.371543 11553 leader_election.cc:290] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:17.375537 11287 leader_election.cc:290] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:52:17.331893 11382 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.647s	user 0.021s	sys 0.039s
I20260709 14:52:17.249634 11602 raft_consensus.cc:515] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:17.379046 11622 leader_election.cc:290] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:17.409996 11382 raft_consensus.cc:697] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:52:17.412787 11602 leader_election.cc:290] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 8 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:17.453140 11527 leader_election.cc:290] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:17.455586 11481 leader_election.cc:290] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 9 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:17.456293 11534 leader_election.cc:290] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:17.479038 11534 raft_consensus.cc:493] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:17.489888 11534 raft_consensus.cc:515] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:17.510461 11489 leader_election.cc:290] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:17.510849 11430 leader_election.cc:290] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 11 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:17.512511 11535 leader_election.cc:290] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:17.515125  7928 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38516 (request call id 2356) took 1517 ms. Trace:
I20260709 14:52:17.515622  7928 rpcz_store.cc:276] 0709 14:52:15.998134 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:15.998809 (+   675us) service_pool.cc:224] Handling call
0709 14:52:17.514857 (+1516048us) spinlock_profiling.cc:243] Waited 320 ms on lock 0x7b54001743d4. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae922fa 00007fb68fe53b17 00007fb6893ce6d4 00007fb6893ce662 00007fb6893ce591 00007fb6893ce50c 00007fb6893cd7c2 00007fb6891c948c 00007fb6891c88c6 00007fb6891c826f
0709 14:52:17.515043 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":736319872}
I20260709 14:52:17.518232 11534 leader_election.cc:290] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:52:17.636190  7744 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.914s	user 0.005s	sys 0.050s
W20260709 14:52:17.638295  7744 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.916s	user 0.005s	sys 0.051s
W20260709 14:52:17.636190  7742 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.020s	user 0.013s	sys 0.042s
W20260709 14:52:17.639789  7742 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.024s	user 0.014s	sys 0.043s
W20260709 14:52:17.640121  7743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:52:17.643402  7745 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:52:17.657708  7774 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.833s	user 0.010s	sys 0.003s
W20260709 14:52:17.659277  7774 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.837s	user 0.011s	sys 0.003s
I20260709 14:52:17.659657  7779 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 2887) took 1072 ms. Trace:
W20260709 14:52:17.662602  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:52:17.663971  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:17.668035  7847 raft_consensus.cc:1275] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Refusing update from remote peer 9418391fa82a42c79c6cad13ba91d964: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 14:52:17.657708  7773 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.058s	user 0.004s	sys 0.008s
W20260709 14:52:17.673072  7773 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.074s	user 0.004s	sys 0.008s
I20260709 14:52:17.674643  7773 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 2884) took 1100 ms. Trace:
I20260709 14:52:17.660679  7779 rpcz_store.cc:276] 0709 14:52:16.586540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:16.590623 (+  4083us) service_pool.cc:224] Handling call
0709 14:52:16.597050 (+  6427us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:52:16.700714 (+103664us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:52:16.700757 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:52:16.709609 (+  8852us) log.cc:844] Serialized 26 byte log entry
0709 14:52:17.301397 (+591788us) raft_consensus.cc:1645] Marking committed up to 5
0709 14:52:17.301465 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:17.301571 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:52:17.658000 (+356429us) raft_consensus.cc:1685] finished
0709 14:52:17.658095 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:17.659206 (+  1111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10555,"raft.queue_time_us":188081,"raft.run_cpu_time_us":295,"raft.run_wall_time_us":15292,"thread_start_us":582648,"threads_started":2,"wal-append.queue_time_us":811225}
I20260709 14:52:17.675251  7773 rpcz_store.cc:276] 0709 14:52:16.574775 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:16.575102 (+   327us) service_pool.cc:224] Handling call
0709 14:52:16.575600 (+   498us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 14:52:16.576093 (+   493us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 14:52:16.576592 (+   499us) log.cc:844] Serialized 14 byte log entry
0709 14:52:16.580849 (+  4257us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 14:52:16.581866 (+  1017us) log.cc:844] Serialized 52 byte log entry
0709 14:52:16.582123 (+   257us) raft_consensus.cc:1645] Marking committed up to 6
0709 14:52:16.582532 (+   409us) log.cc:844] Serialized 14 byte log entry
0709 14:52:16.903400 (+320868us) spinlock_profiling.cc:243] Waited 11.8 ms on lock 0x7b18004189c0. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb690c69de1 00007fb690c765b1 00007fb687da13f3 00007fb687da37c1 00007fb687da3779 00007fb687da3709 00007fb687da36d1 00007fb687da29cd 0000000000396ad4 0000000000396919 00007fb687d8483a
0709 14:52:17.014890 (+111490us) spinlock_profiling.cc:243] Waited 26.9 ms on lock 0x7b480006c3d8. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68fdb7aa1 00007fb68fdaeb37 00007fb68fdae9ca 00007fb68fea626f 00007fb68fea5f37 00007fb68feba55c 00007fb68feba508 00007fb68feba488 00007fb68feba443 00007fb68feb96ec 00007fb68ede3a96
0709 14:52:17.487814 (+472924us) spinlock_profiling.cc:243] Waited 11.4 ms on lock 0x7b18004189c0. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb690c69de1 00007fb690c765b1 00007fb687da1522 00007fb687da37c1 00007fb687da3779 00007fb687da3709 00007fb687da36d1 00007fb687da29cd 0000000000396ad4 0000000000396919 00007fb687d8483a
0709 14:52:17.489316 (+  1502us) spinlock_profiling.cc:243] Waited 5.64 ms on lock 0x7b18004189c0. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb690c69de1 00007fb690c765b1 00007fb687da13f3 00007fb687da37c1 00007fb687da3779 00007fb687da3709 00007fb687da36d1 00007fb687da29cd 0000000000396ad4 0000000000396919 00007fb687d8483a
0709 14:52:17.673938 (+184622us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:17.674143 (+   205us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:52:17.674237 (+    94us) raft_consensus.cc:1685] finished
0709 14:52:17.674255 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:17.674520 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":497,"prepare.run_cpu_time_us":94,"prepare.run_wall_time_us":98,"raft.queue_time_us":427321,"raft.run_cpu_time_us":3150,"raft.run_wall_time_us":332629,"spinlock_wait_cycles":128003200,"thread_start_us":1077931,"threads_started":3,"wal-append.queue_time_us":1725}
I20260709 14:52:17.692047  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:17.698311  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:17.699486  7778 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37136 (request call id 2334) took 2738 ms. Trace:
I20260709 14:52:17.700168  7778 rpcz_store.cc:276] 0709 14:52:14.961015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:16.070427 (+1109412us) service_pool.cc:224] Handling call
0709 14:52:16.070907 (+   480us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:52:16.171934 (+101027us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:17.698621 (+1526687us) spinlock_profiling.cc:243] Waited 79.2 ms on lock 0x7b54002549d4. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae8ee01 00007fb68ae8d83e 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2 00007fb6891c948c 00007fb6891c88c6
0709 14:52:17.699219 (+   598us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":182124288}
I20260709 14:52:17.703830  7845 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 3168) took 1811 ms. Trace:
I20260709 14:52:17.704895  7845 rpcz_store.cc:276] 0709 14:52:15.892142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:16.824236 (+932094us) service_pool.cc:224] Handling call
0709 14:52:16.826004 (+  1768us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:52:17.323475 (+497471us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:17.702918 (+379443us) spinlock_profiling.cc:243] Waited 496 ms on lock 0x7b54003b3654. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae8ee01 00007fb68ae8d83e 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2 00007fb6891c948c 00007fb6891c88c6
0709 14:52:17.703537 (+   619us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1141248896}
I20260709 14:52:17.717639  7773 raft_consensus.cc:2468] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 11.
I20260709 14:52:17.716919  7778 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072"
dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:37144
I20260709 14:52:17.719044  7778 raft_consensus.cc:493] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
W20260709 14:52:17.721756  7852 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.901s	user 0.000s	sys 0.006s
I20260709 14:52:17.722815  7849 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 3155) took 1843 ms. Trace:
I20260709 14:52:17.725451  7851 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 3157) took 1845 ms. Trace:
I20260709 14:52:17.720954  7771 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47054 (request call id 218) took 2258 ms. Trace:
W20260709 14:52:17.734542  7893 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.932s	user 0.008s	sys 0.020s
W20260709 14:52:17.734913  7894 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.919s	user 0.010s	sys 0.019s
W20260709 14:52:17.735329  7893 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.933s	user 0.008s	sys 0.020s
W20260709 14:52:17.735968  7894 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.920s	user 0.011s	sys 0.019s
I20260709 14:52:17.728943  7850 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 3156) took 1848 ms. Trace:
W20260709 14:52:17.734004  7852 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.913s	user 0.000s	sys 0.006s
W20260709 14:52:17.737795  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 946913us
W20260709 14:52:17.738590  7893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:17.739616  7852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 3166) took 1850 ms. Trace:
I20260709 14:52:17.734005  7849 rpcz_store.cc:276] 0709 14:52:15.879744 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:16.234267 (+354523us) service_pool.cc:224] Handling call
0709 14:52:16.234735 (+   468us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:52:16.539400 (+304665us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:17.722079 (+1182679us) spinlock_profiling.cc:243] Waited 300 ms on lock 0x7b540020dad4. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae8ee01 00007fb68ae8d83e 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2 00007fb6891c948c 00007fb6891c88c6
0709 14:52:17.722605 (+   526us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":691060096}
I20260709 14:52:17.730789  7853 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49948 (request call id 3325) took 3572 ms. Trace:
I20260709 14:52:17.743922  7850 rpcz_store.cc:276] 0709 14:52:15.879987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:16.269993 (+390006us) service_pool.cc:224] Handling call
0709 14:52:16.270585 (+   592us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:52:17.156134 (+885549us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:17.727896 (+571762us) spinlock_profiling.cc:243] Waited 884 ms on lock 0x7b54003ab1d4. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae8ee01 00007fb68ae8d83e 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2 00007fb6891c948c 00007fb6891c88c6
0709 14:52:17.728668 (+   772us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2034167552}
I20260709 14:52:17.740212  7852 rpcz_store.cc:276] 0709 14:52:15.888812 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:16.802104 (+913292us) service_pool.cc:224] Handling call
0709 14:52:16.819937 (+ 17833us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:52:16.820324 (+   387us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 14:52:16.820678 (+   354us) log.cc:844] Serialized 14 byte log entry
0709 14:52:17.738469 (+917791us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:52:17.738634 (+   165us) raft_consensus.cc:1645] Marking committed up to 9
0709 14:52:17.738763 (+   129us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:17.739049 (+   286us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:17.739413 (+   364us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":3009,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":59,"thread_start_us":916574,"threads_started":1,"wal-append.queue_time_us":774873}
I20260709 14:52:17.743314  7853 rpcz_store.cc:276] 0709 14:52:14.158694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:15.167039 (+1008345us) service_pool.cc:224] Handling call
0709 14:52:16.385317 (+1218278us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 14:52:16.387818 (+  2501us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:17.729657 (+1341839us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b54000d3c50. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae8d8ad 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2 00007fb6891c948c 00007fb6891c88c6 00007fb6891c826f
0709 14:52:17.730471 (+   814us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2785336320}
I20260709 14:52:17.734141  7851 rpcz_store.cc:276] 0709 14:52:15.880227 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:16.332383 (+452156us) service_pool.cc:224] Handling call
0709 14:52:16.333046 (+   663us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:52:16.534262 (+201216us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:17.723813 (+1189551us) spinlock_profiling.cc:243] Waited 197 ms on lock 0x7b540013bfd4. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae8ee01 00007fb68ae8d83e 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2 00007fb6891c948c 00007fb6891c88c6
0709 14:52:17.725130 (+  1317us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":453633920}
W20260709 14:52:17.749259  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:17.734562  7771 rpcz_store.cc:276] 0709 14:52:15.462470 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:16.103689 (+641219us) service_pool.cc:224] Handling call
0709 14:52:16.104308 (+   619us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:52:17.190169 (+1085861us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:17.719992 (+529823us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b540014e6d4. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae8ee01 00007fb68ae8d83e 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2 00007fb6891c948c 00007fb6891c88c6
0709 14:52:17.720551 (+   559us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2494112512}
I20260709 14:52:17.734050  7778 raft_consensus.cc:3060] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Advancing to term 13
I20260709 14:52:17.759704  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:17.761160  7921 raft_consensus.cc:2468] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 8.
I20260709 14:52:17.755746  7771 raft_consensus.cc:1275] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 14:52:17.769934  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:17.771510  7923 raft_consensus.cc:1240] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 9. Current term is 10. Ops: []
I20260709 14:52:17.771869  7926 raft_consensus.cc:2468] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 14.
W20260709 14:52:17.776671  8598 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.056s	user 0.069s	sys 0.083s
W20260709 14:52:17.777416  8598 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.057s	user 0.070s	sys 0.083s
I20260709 14:52:17.778601  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258d6c2dda954bf5b65930fde8ecb9f3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:17.781423  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce9c0ef2db24c13a8b1402f21819458" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:17.782389  7919 raft_consensus.cc:1240] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 9. Current term is 10. Ops: []
I20260709 14:52:17.782618  7928 raft_consensus.cc:2468] T 9ce9c0ef2db24c13a8b1402f21819458 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 2.
I20260709 14:52:17.830911  7771 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 2897) took 1218 ms. Trace:
I20260709 14:52:17.831552  7771 rpcz_store.cc:276] 0709 14:52:16.601182 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:17.754443 (+1153261us) service_pool.cc:224] Handling call
0709 14:52:17.755095 (+   652us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:52:17.793546 (+ 38451us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:17.819598 (+ 26052us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 14:52:17.535458 11382 consensus_queue.cc:237] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:17.841956 11533 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.112s	user 0.006s	sys 0.029s
W20260709 14:52:17.842582 11533 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.121s	user 0.006s	sys 0.029s
W20260709 14:52:17.844918 11627 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.983s	user 0.010s	sys 0.025s
W20260709 14:52:17.845613 11627 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.993s	user 0.010s	sys 0.026s
W20260709 14:52:17.846539 11510 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.984s	user 0.003s	sys 0.032s
I20260709 14:52:17.846156 11317 consensus_queue.cc:1048] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 14:52:17.847076 11510 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.984s	user 0.003s	sys 0.032s
W20260709 14:52:17.852313 11504 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.880s	user 0.008s	sys 0.007s
W20260709 14:52:17.852996 11504 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.881s	user 0.008s	sys 0.007s
I20260709 14:52:17.853106  7920 raft_consensus.cc:1275] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 14:52:17.853470 11445 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.026s	user 0.006s	sys 0.011s
W20260709 14:52:17.854230 11295 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.806s	user 0.008s	sys 0.003s
W20260709 14:52:17.854926 11295 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.807s	user 0.008s	sys 0.004s
I20260709 14:52:17.861802 11372 raft_consensus.cc:493] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:17.863181 11372 raft_consensus.cc:515] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:17.854025 11445 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.035s	user 0.007s	sys 0.011s
I20260709 14:52:17.865746 11567 raft_consensus.cc:493] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:17.867023 11567 raft_consensus.cc:515] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:17.869990 11629 raft_consensus.cc:493] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
W20260709 14:52:17.871488 11554 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.996s	user 0.007s	sys 0.011s
I20260709 14:52:17.871253 11629 raft_consensus.cc:515] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:17.872085 11554 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.009s	user 0.007s	sys 0.011s
I20260709 14:52:17.872294 11655 raft_consensus.cc:493] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:52:17.872967 11223 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.067s	user 0.005s	sys 0.011s
W20260709 14:52:17.871733  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 60617.5us
I20260709 14:52:17.874691 11631 raft_consensus.cc:493] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:17.843883 11585 consensus_queue.cc:1059] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 14:52:17.875751 11631 raft_consensus.cc:515] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:17.877339 11585 consensus_queue.cc:1048] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 9418391fa82a42c79c6cad13ba91d964 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 14:52:17.880084 11287 raft_consensus.cc:493] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:17.845542  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
W20260709 14:52:17.873771 11223 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.068s	user 0.005s	sys 0.011s
I20260709 14:52:17.869983 11577 raft_consensus.cc:493] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:17.881536  7774 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 2888) took 1290 ms. Trace:
I20260709 14:52:17.883735 11577 raft_consensus.cc:515] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:17.884585  7774 rpcz_store.cc:276] 0709 14:52:16.591231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:16.669664 (+ 78433us) service_pool.cc:224] Handling call
0709 14:52:16.683218 (+ 13554us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:52:16.719757 (+ 36539us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 14:52:16.768895 (+ 49138us) log.cc:844] Serialized 14 byte log entry
0709 14:52:17.660502 (+891607us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:52:17.665834 (+  5332us) log.cc:844] Serialized 26 byte log entry
0709 14:52:17.666314 (+   480us) raft_consensus.cc:1645] Marking committed up to 5
0709 14:52:17.666400 (+    86us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:17.666646 (+   246us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:52:17.881044 (+214398us) raft_consensus.cc:1685] finished
0709 14:52:17.881066 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:17.881450 (+   384us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35566,"prepare.queue_time_us":44901,"prepare.run_cpu_time_us":88,"prepare.run_wall_time_us":3704,"raft.queue_time_us":392671,"raft.run_cpu_time_us":484,"raft.run_wall_time_us":488,"thread_start_us":837649,"threads_started":1,"wal-append.queue_time_us":790012}
I20260709 14:52:17.848984 11317 consensus_queue.cc:1048] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.026s
W20260709 14:52:17.845502 11579 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.780s	user 0.000s	sys 0.014s
W20260709 14:52:17.841156 11597 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.649s	user 0.000s	sys 0.014s
I20260709 14:52:17.853992 11361 raft_consensus.cc:493] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:52:17.578703 11586 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.743s	user 0.024s	sys 0.051s
I20260709 14:52:17.903714 11361 raft_consensus.cc:515] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:17.910831 11586 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.078s	user 0.025s	sys 0.052s
W20260709 14:52:17.873980 11327 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.707s	user 0.006s	sys 0.006s
W20260709 14:52:17.914412 11579 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.849s	user 0.000s	sys 0.015s
I20260709 14:52:17.881457 11287 raft_consensus.cc:515] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:17.873760 11655 raft_consensus.cc:515] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:17.920310 11580 consensus_queue.cc:1059] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 14:52:17.907358 11569 raft_consensus.cc:493] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:17.921649 11265 consensus_queue.cc:1059] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 14:52:17.922346 11629 leader_election.cc:290] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:17.922597 11504 consensus_queue.cc:1059] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 14:52:17.923705 11631 leader_election.cc:290] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:17.889899 11317 consensus_queue.cc:1243] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer 3876b8ee8d744cb18e91d97aae93b1ac log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 14:52:17.872550 11554 raft_consensus.cc:697] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:52:17.953902  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:17.925802 11643 raft_consensus.cc:493] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:17.955462 11554 consensus_queue.cc:237] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:17.928779  7778 raft_consensus.cc:515] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:17.930612  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
W20260709 14:52:17.931401 11597 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.759s	user 0.001s	sys 0.014s
I20260709 14:52:17.960702  7774 raft_consensus.cc:1240] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 12. Current term is 13. Ops: []
W20260709 14:52:17.957021 11327 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.790s	user 0.007s	sys 0.007s
I20260709 14:52:17.973694  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:17.971544 11168 consensus_queue.cc:1059] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.004s
I20260709 14:52:17.970963  7778 leader_election.cc:290] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:17.955787 11643 raft_consensus.cc:515] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:17.992448 11567 leader_election.cc:290] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:17.993563  7778 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:37144 (request call id 2895) took 1385 ms. Trace:
I20260709 14:52:17.959349 11372 leader_election.cc:290] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:18.001756  7778 rpcz_store.cc:276] 0709 14:52:16.599240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:17.716543 (+1117303us) service_pool.cc:224] Handling call
0709 14:52:17.978163 (+261620us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 14:52:17.997643 11168 consensus_queue.cc:1243] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer 3876b8ee8d744cb18e91d97aae93b1ac log is divergent from this leader: its last log entry 11.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 14:52:18.021905  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:18.022329 11383 raft_consensus.cc:3055] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 14:52:18.025226  7771 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 2898) took 1412 ms. Trace:
I20260709 14:52:18.027869  7771 rpcz_store.cc:276] 0709 14:52:16.601509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:17.933748 (+1332239us) service_pool.cc:224] Handling call
0709 14:52:17.968108 (+ 34360us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:52:17.995368 (+ 27260us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:52:17.995413 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:52:17.998666 (+  3253us) raft_consensus.cc:1645] Marking committed up to 4
0709 14:52:18.013317 (+ 14651us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:18.013425 (+   108us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:18.013633 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 14:52:18.029887  7779 raft_consensus.cc:2468] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 8.
I20260709 14:52:18.000921 11577 leader_election.cc:290] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:52:18.039804  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:52:18.040612  7744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:18.027040 11383 raft_consensus.cc:740] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:18.080435  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:18.038427 11372 raft_consensus.cc:493] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
W20260709 14:52:18.097314  7743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:18.010560 11569 raft_consensus.cc:515] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:18.108639  7742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:18.130478  7778 raft_consensus.cc:1275] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 14:52:18.131970  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
W20260709 14:52:18.114630  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 469504us
W20260709 14:52:18.114681  7744 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.101.67:40785 timed out after 1.685s (SENT) [suppressed 27 similar messages]
W20260709 14:52:18.135782  7924 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.012s	sys 0.012s
W20260709 14:52:18.141469  7924 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.630s	user 0.012s	sys 0.013s
W20260709 14:52:18.145820  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 50582.8us
I20260709 14:52:18.149482  7920 raft_consensus.cc:2468] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 11.
W20260709 14:52:18.150910  7772 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.360s	user 0.012s	sys 0.074s
W20260709 14:52:18.151558  7772 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.431s	user 0.013s	sys 0.074s
I20260709 14:52:18.125279 11361 leader_election.cc:290] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:52:18.153688  7775 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.491s	user 0.004s	sys 0.038s
W20260709 14:52:18.154300  7775 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.555s	user 0.005s	sys 0.038s
W20260709 14:52:18.156757  7777 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.949s	user 0.054s	sys 0.048s
W20260709 14:52:18.157361  7777 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.015s	user 0.055s	sys 0.048s
I20260709 14:52:18.157620 11401 raft_consensus.cc:493] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9418391fa82a42c79c6cad13ba91d964)
I20260709 14:52:18.158591 11401 raft_consensus.cc:515] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:52:18.159825  7771 raft_consensus.cc:1275] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
W20260709 14:52:18.160010  7819 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.354s	user 0.013s	sys 0.010s
W20260709 14:52:18.160712  7819 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.425s	user 0.013s	sys 0.010s
W20260709 14:52:18.162365  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 1.45125e+06us
I20260709 14:52:18.165649 11372 raft_consensus.cc:515] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:18.144528 11383 consensus_queue.cc:260] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:18.170760 11317 raft_consensus.cc:3055] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 14:52:18.171463 11569 leader_election.cc:290] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:18.173286  7779 raft_consensus.cc:1275] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 14:52:18.162261  7771 raft_consensus.cc:1240] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 14:52:18.176429 11287 leader_election.cc:290] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:18.168766 11372 leader_election.cc:290] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:52:18.198302  8598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 405639us
I20260709 14:52:18.171605 11317 raft_consensus.cc:740] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:18.176652 11655 leader_election.cc:290] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:18.165457 11409 raft_consensus.cc:493] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:18.131111 11579 raft_consensus.cc:493] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:18.217482 11631 raft_consensus.cc:493] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:18.226387 11631 raft_consensus.cc:515] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:18.198410 11361 raft_consensus.cc:493] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:52:18.244479  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:18.250072 11361 raft_consensus.cc:515] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:18.239368  7770 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.852s	user 0.045s	sys 0.042s
W20260709 14:52:18.256186  7745 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:52:18.262368  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 98231.5us
W20260709 14:52:18.263813  7770 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.020s	user 0.046s	sys 0.043s
W20260709 14:52:18.254894 11338 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.249s	user 0.008s	sys 0.023s
I20260709 14:52:18.260601 11287 raft_consensus.cc:493] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
W20260709 14:52:18.291872  7776 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.086s	user 0.013s	sys 0.033s
W20260709 14:52:18.301662  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:52:18.290463 11338 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.419s	user 0.009s	sys 0.023s
W20260709 14:52:18.319121  7776 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.280s	user 0.014s	sys 0.033s
W20260709 14:52:18.339090  8599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 353212us
I20260709 14:52:18.341219  7777 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 2889) took 1749 ms. Trace:
I20260709 14:52:18.285089 11579 raft_consensus.cc:515] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:18.310587 11295 raft_consensus.cc:3055] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 14:52:18.279460 11409 raft_consensus.cc:515] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:18.367779  7773 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 2896) took 1739 ms. Trace:
I20260709 14:52:18.388221 11361 leader_election.cc:290] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:18.374277 11643 leader_election.cc:290] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:18.389665 11317 consensus_queue.cc:260] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:18.416466 11317 raft_consensus.cc:3060] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:52:18.419848 11401 leader_election.cc:290] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68:42321)
I20260709 14:52:18.392019  8639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18d29d52d304c87b930d4fb5eaf50b1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9418391fa82a42c79c6cad13ba91d964"
I20260709 14:52:18.377177 11655 consensus_queue.cc:1048] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 14:52:18.396071 11287 raft_consensus.cc:515] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:18.396945 11668 raft_consensus.cc:3055] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 14:52:18.345206  7777 rpcz_store.cc:276] 0709 14:52:16.591527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:16.939116 (+347589us) service_pool.cc:224] Handling call
0709 14:52:16.973483 (+ 34367us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 14:52:16.993084 (+ 19601us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 14:52:17.063001 (+ 69917us) log.cc:844] Serialized 14 byte log entry
0709 14:52:18.158052 (+1095051us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 14:52:18.159172 (+  1120us) log.cc:844] Serialized 52 byte log entry
0709 14:52:18.159396 (+   224us) raft_consensus.cc:1645] Marking committed up to 5
0709 14:52:18.159740 (+   344us) log.cc:844] Serialized 14 byte log entry
0709 14:52:18.184400 (+ 24660us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:18.198543 (+ 14143us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:52:18.337563 (+139020us) raft_consensus.cc:1685] finished
0709 14:52:18.337611 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:18.341133 (+  3522us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":69159,"prepare.queue_time_us":69687,"prepare.run_cpu_time_us":104,"prepare.run_wall_time_us":109,"raft.queue_time_us":53100,"raft.run_cpu_time_us":580,"raft.run_wall_time_us":38275,"thread_start_us":1015666,"threads_started":1,"wal-append.queue_time_us":1035793}
I20260709 14:52:18.401569 11579 leader_election.cc:290] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:18.401696 11631 leader_election.cc:290] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:18.406961 11409 leader_election.cc:290] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:52:18.392808 11663 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.714s	user 0.021s	sys 0.034s
I20260709 14:52:18.421656  7773 rpcz_store.cc:276] 0709 14:52:16.600804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:17.718901 (+1118097us) service_pool.cc:224] Handling call
0709 14:52:17.719513 (+   612us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:52:17.720160 (+   647us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 14:52:17.721138 (+   978us) log.cc:844] Serialized 14 byte log entry
0709 14:52:18.335934 (+614796us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:52:18.338181 (+  2247us) raft_consensus.cc:1645] Marking committed up to 6
0709 14:52:18.338327 (+   146us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:18.338626 (+   299us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:18.339213 (+   587us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6737,"prepare.queue_time_us":102469,"prepare.run_cpu_time_us":87,"prepare.run_wall_time_us":90,"raft.queue_time_us":22450,"raft.run_cpu_time_us":429,"raft.run_wall_time_us":39640,"thread_start_us":412638,"threads_started":1}
I20260709 14:52:18.428817 11119 raft_consensus.cc:3055] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 14:52:18.381863 11295 raft_consensus.cc:740] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
W20260709 14:52:18.453559  8598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 157185us
I20260709 14:52:18.443615 11668 raft_consensus.cc:740] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9418391fa82a42c79c6cad13ba91d964, State: Running, Role: LEADER
W20260709 14:52:18.476452 11663 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.880s	user 0.021s	sys 0.036s
I20260709 14:52:18.466755 11119 raft_consensus.cc:740] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
W20260709 14:52:18.488915  7743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:18.490072  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
W20260709 14:52:18.493419 11667 log.cc:927] Time spent T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.051s	user 0.000s	sys 0.004s
W20260709 14:52:18.504020  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:18.506484  7776 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 2871) took 3847 ms. Trace:
I20260709 14:52:18.528091  7770 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 2894) took 1935 ms. Trace:
W20260709 14:52:18.509579 11656 log.cc:927] Time spent T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.071s	user 0.002s	sys 0.000s
I20260709 14:52:18.562232  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:18.512174 11287 leader_election.cc:290] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:18.483086 11372 raft_consensus.cc:493] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:18.496953 11383 raft_consensus.cc:3060] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:52:18.575955  7773 raft_consensus.cc:1240] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 14:52:18.532867  7776 rpcz_store.cc:276] 0709 14:52:14.659109 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:15.577041 (+917932us) service_pool.cc:224] Handling call
0709 14:52:15.577498 (+   457us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:52:15.579667 (+  2169us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:52:15.579701 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:52:15.604733 (+ 25032us) log.cc:844] Serialized 26 byte log entry
0709 14:52:17.038928 (+1434195us) spinlock_profiling.cc:243] Waited 16.9 ms on lock 0x7b18003bc5c0. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb690c69de1 00007fb690c765b1 00007fb687d83e07 00007fb690bdeab9 00007fb687da069b 00007fb687d9e93f 00007fb687da0c02 00007fb68aa2820b 00007fb68aa2dd23 00007fb68aa2e0d1 00007fb68ae49a0f
0709 14:52:18.413630 (+1374702us) raft_consensus.cc:1645] Marking committed up to 5
0709 14:52:18.414011 (+   381us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:18.414286 (+   275us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:52:18.505791 (+ 91505us) raft_consensus.cc:1685] finished
0709 14:52:18.505822 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:18.506270 (+   448us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10173,"raft.queue_time_us":24669,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":15869,"spinlock_wait_cycles":38761216,"thread_start_us":1281100,"threads_started":1,"wal-append.queue_time_us":2776488}
I20260709 14:52:18.540153  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:18.603286  7777 raft_consensus.cc:2468] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 9.
I20260709 14:52:18.534453 11655 raft_consensus.cc:493] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:18.611627 11655 raft_consensus.cc:515] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:18.571929 11672 log.cc:927] Time spent T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.086s	user 0.000s	sys 0.004s
W20260709 14:52:18.572187 11666 log.cc:927] Time spent T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.072s	user 0.001s	sys 0.002s
I20260709 14:52:18.582495 11382 raft_consensus.cc:493] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:18.634403 11382 raft_consensus.cc:515] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:18.606808  7745 leader_election.cc:336] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 1.541s (SENT)
I20260709 14:52:18.500056 11388 raft_consensus.cc:493] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
W20260709 14:52:18.660780  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 249567us
I20260709 14:52:18.606424 11579 raft_consensus.cc:493] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:18.557282  7770 rpcz_store.cc:276] 0709 14:52:16.592914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:17.180014 (+587100us) service_pool.cc:224] Handling call
0709 14:52:17.180585 (+   571us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:52:17.216394 (+ 35809us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 14:52:17.243364 (+ 26970us) log.cc:844] Serialized 14 byte log entry
0709 14:52:17.510094 (+266730us) spinlock_profiling.cc:243] Waited 2.11 ms on lock 0x7b18002a8f80. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb690c69de1 00007fb690c765b1 00007fb687da13f3 00007fb687da37c1 00007fb687da3779 00007fb687da3709 00007fb687da36d1 00007fb687da29cd 0000000000396ad4 0000000000396919 00007fb687d8483a
0709 14:52:18.336854 (+826760us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:52:18.491570 (+154716us) spinlock_profiling.cc:243] Waited 27.9 ms on lock 0x7b2c000014c8. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb689787a11 00007fb689797372 00007fb68aec9a01 00007fb68ae8e43a 00007fb68ae8d83e 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2
0709 14:52:18.492223 (+   653us) log.cc:844] Serialized 26 byte log entry
0709 14:52:18.492459 (+   236us) raft_consensus.cc:1645] Marking committed up to 7
0709 14:52:18.492771 (+   312us) log.cc:844] Serialized 14 byte log entry
0709 14:52:18.493065 (+   294us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:18.493219 (+   154us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:52:18.520108 (+ 26889us) raft_consensus.cc:1685] finished
0709 14:52:18.520146 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:18.527966 (+  7820us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12240,"prepare.queue_time_us":30025,"prepare.run_cpu_time_us":90,"prepare.run_wall_time_us":94,"raft.queue_time_us":47679,"raft.run_cpu_time_us":690,"raft.run_wall_time_us":23888,"spinlock_wait_cycles":68925568,"thread_start_us":1038008,"threads_started":1,"wal-append.queue_time_us":1059026}
I20260709 14:52:18.646894  7779 raft_consensus.cc:2468] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 11.
I20260709 14:52:18.619292 11287 raft_consensus.cc:493] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
W20260709 14:52:18.668920 11670 log.cc:927] Time spent T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.058s	user 0.000s	sys 0.002s
I20260709 14:52:18.687188  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:18.688192  7777 raft_consensus.cc:3060] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:52:18.678028 11388 raft_consensus.cc:515] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:18.573414 11119 consensus_queue.cc:260] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:18.672410 11664 log.cc:927] Time spent T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.074s	user 0.001s	sys 0.002s
W20260709 14:52:18.703222  7742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:18.726033  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:18.727468  7775 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 2885) took 2143 ms. Trace:
W20260709 14:52:18.738809  7744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:18.574350 11668 consensus_queue.cc:260] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:52:18.678699 11372 raft_consensus.cc:515] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:18.741643 11533 raft_consensus.cc:493] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
W20260709 14:52:18.772050  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:18.773602  7852 raft_consensus.cc:1275] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 14:52:18.730093  7775 rpcz_store.cc:276] 0709 14:52:16.584126 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:16.585687 (+  1561us) service_pool.cc:224] Handling call
0709 14:52:16.598231 (+ 12544us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:52:18.154861 (+1556630us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:52:18.154923 (+    62us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:52:18.155967 (+  1044us) log.cc:844] Serialized 26 byte log entry
0709 14:52:18.437369 (+281402us) raft_consensus.cc:1645] Marking committed up to 3
0709 14:52:18.437525 (+   156us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:18.455750 (+ 18225us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:52:18.727136 (+271386us) raft_consensus.cc:1685] finished
0709 14:52:18.727163 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:18.727373 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":230271,"raft.run_cpu_time_us":220,"raft.run_wall_time_us":10810,"thread_start_us":1835100,"threads_started":2,"wal-append.queue_time_us":477836}
I20260709 14:52:18.729660 11382 leader_election.cc:290] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:18.788596 11643 raft_consensus.cc:493] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:18.789373 11643 raft_consensus.cc:515] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:18.791898 11643 leader_election.cc:290] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:52:18.792248  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:18.796948  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:18.729399 11287 raft_consensus.cc:515] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:18.740890 11631 raft_consensus.cc:493] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:18.771624 11579 raft_consensus.cc:515] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:18.831382  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 125497us
W20260709 14:52:18.838781  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 303252us
W20260709 14:52:18.817090 11679 log.cc:927] Time spent T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
I20260709 14:52:18.847792  7770 raft_consensus.cc:1240] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Rejecting Update request from peer 9418391fa82a42c79c6cad13ba91d964 for earlier term 5. Current term is 6. Ops: []
I20260709 14:52:18.848573  7775 raft_consensus.cc:1240] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 10. Current term is 11. Ops: []
W20260709 14:52:18.844187 11678 log.cc:927] Time spent T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.207s	user 0.000s	sys 0.002s
I20260709 14:52:18.866760  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:18.838392  8639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1f7722fdea49e0b5e9c5d96633eaf9" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9418391fa82a42c79c6cad13ba91d964" is_pre_election: true
I20260709 14:52:18.772431 11295 consensus_queue.cc:260] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:18.841128 11655 leader_election.cc:290] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:18.879487  7744 leader_election.cc:304] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:52:18.878500  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:52:18.895974  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 47605.6us
W20260709 14:52:18.898139  7745 leader_election.cc:336] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 1.572s (SENT)
I20260709 14:52:18.898950  7745 leader_election.cc:304] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:18.871106 11361 raft_consensus.cc:493] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:52:18.901646 11382 raft_consensus.cc:2749] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 14:52:18.903736  7819 leader_election.cc:304] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:18.904129 11361 raft_consensus.cc:515] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:18.902788 11554 raft_consensus.cc:493] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:18.905789  7924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48672 (request call id 324) took 2665 ms. Trace:
I20260709 14:52:18.876312 11631 raft_consensus.cc:515] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:18.906673 11554 raft_consensus.cc:515] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:18.906410  7924 rpcz_store.cc:276] 0709 14:52:16.239983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:16.240148 (+   165us) service_pool.cc:224] Handling call
0709 14:52:16.240609 (+   461us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:52:16.247245 (+  6636us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:52:16.247290 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:52:16.247970 (+   680us) log.cc:844] Serialized 26 byte log entry
0709 14:52:17.511588 (+1263618us) spinlock_profiling.cc:243] Waited 3.53 ms on lock 0x7b180031d8c0. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb690c69de1 00007fb690c765b1 00007fb687d83e07 00007fb690bdeab9 00007fb687da069b 00007fb687d9e93f 00007fb687da0c02 00007fb68aa2820b 00007fb68aa2dd23 00007fb68aa2e0d1 00007fb68ae49a0f
0709 14:52:18.142660 (+631072us) raft_consensus.cc:1645] Marking committed up to 5
0709 14:52:18.142785 (+   125us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:18.142919 (+   134us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:52:18.881264 (+738345us) raft_consensus.cc:1685] finished
0709 14:52:18.881285 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:18.905518 (+ 24233us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10724,"raft.queue_time_us":6832,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":17926,"spinlock_wait_cycles":8110976,"thread_start_us":630353,"threads_started":1,"wal-append.queue_time_us":2085897}
I20260709 14:52:18.907907 11287 leader_election.cc:290] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:18.902074  7849 raft_consensus.cc:3060] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Advancing to term 10
W20260709 14:52:18.911504 11680 log.cc:927] Time spent T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 14:52:18.913615  7772 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 2886) took 2327 ms. Trace:
I20260709 14:52:18.914903 11579 leader_election.cc:290] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:18.915681 11554 leader_election.cc:290] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:18.915894 11579 raft_consensus.cc:2749] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 14:52:18.868221 11533 raft_consensus.cc:515] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:18.914147  7772 rpcz_store.cc:276] 0709 14:52:16.586152 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:16.586306 (+   154us) service_pool.cc:224] Handling call
0709 14:52:16.624190 (+ 37884us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:52:18.152138 (+1527948us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:52:18.152227 (+    89us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:52:18.189431 (+ 37204us) log.cc:844] Serialized 26 byte log entry
0709 14:52:18.438233 (+248802us) raft_consensus.cc:1645] Marking committed up to 6
0709 14:52:18.438274 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:18.447054 (+  8780us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:52:18.913343 (+466289us) raft_consensus.cc:1685] finished
0709 14:52:18.913367 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:18.913550 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27218,"raft.queue_time_us":169215,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":76,"thread_start_us":1649706,"threads_started":2,"wal-append.queue_time_us":571368}
I20260709 14:52:18.923988 11533 leader_election.cc:290] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:18.926059 11372 leader_election.cc:290] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:18.929224 11668 raft_consensus.cc:3060] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:52:18.924160 11361 leader_election.cc:290] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:18.936550  7778 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 2909) took 1265 ms. Trace:
I20260709 14:52:18.937364  7778 rpcz_store.cc:276] 0709 14:52:17.671231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:18.167505 (+496274us) service_pool.cc:224] Handling call
0709 14:52:18.167927 (+   422us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:52:18.199933 (+ 32006us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 14:52:18.199980 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:52:18.230951 (+ 30971us) log.cc:844] Serialized 26 byte log entry
0709 14:52:18.706563 (+475612us) raft_consensus.cc:1645] Marking committed up to 2
0709 14:52:18.706622 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:18.706703 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:52:18.936090 (+229387us) raft_consensus.cc:1685] finished
0709 14:52:18.936119 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:18.936457 (+   338us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":45457,"raft.queue_time_us":26659,"raft.run_cpu_time_us":454,"raft.run_wall_time_us":10201,"thread_start_us":431411,"threads_started":1,"wal-append.queue_time_us":685433}
W20260709 14:52:18.938973  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:18.940505  7847 raft_consensus.cc:1275] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 6. (term mismatch)
I20260709 14:52:18.941109  7847 pending_rounds.cc:85] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting all ops after (but not including) 5
I20260709 14:52:18.941718  7847 pending_rounds.cc:107] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting uncommitted NO_OP operation due to leader change: 6.6
I20260709 14:52:18.942444  7847 raft_consensus.cc:2889] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:52:18.942832  7846 raft_consensus.cc:1240] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 14:52:18.903237 11378 raft_consensus.cc:493] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:52:18.881546 11671 log.cc:927] Time spent T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.216s	user 0.000s	sys 0.002s
I20260709 14:52:18.946149 11378 raft_consensus.cc:515] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:18.946787  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:18.947609  7775 raft_consensus.cc:2468] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 14.
W20260709 14:52:18.903038 11674 log.cc:927] Time spent T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 14:52:18.957648 11295 raft_consensus.cc:3060] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 14:52:18.860863 11409 raft_consensus.cc:493] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:18.959117 11409 raft_consensus.cc:515] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:18.959457  7849 raft_consensus.cc:2468] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 10.
W20260709 14:52:18.962595  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:18.926222 11119 raft_consensus.cc:3060] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Advancing to term 9
W20260709 14:52:18.964416  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 66494.1us
W20260709 14:52:18.908890 11676 log.cc:927] Time spent T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
I20260709 14:52:18.983508 11378 leader_election.cc:290] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:18.987543 11168 consensus_queue.cc:1059] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 14:52:18.995098  7893 leader_election.cc:304] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
W20260709 14:52:18.969834  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:52:18.971776  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 111996us
I20260709 14:52:18.972436 11287 raft_consensus.cc:2804] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 14:52:18.976670  7849 raft_consensus.cc:1240] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
W20260709 14:52:19.006815  7745 leader_election.cc:336] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 1.624s (SENT)
I20260709 14:52:19.010752 11372 consensus_queue.cc:1059] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 14:52:19.012403 11372 raft_consensus.cc:3055] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 LEADER]: Stepping down as leader of term 9
I20260709 14:52:18.977030 11388 leader_election.cc:290] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:18.977412 11631 leader_election.cc:290] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:19.004695 11287 raft_consensus.cc:493] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:19.016414 11287 raft_consensus.cc:3060] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:52:19.016734 11409 leader_election.cc:290] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:19.012900 11372 raft_consensus.cc:740] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:52:19.034017  7777 raft_consensus.cc:2468] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 11.
I20260709 14:52:19.034435  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:52:19.044373  7745 leader_election.cc:336] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 1.751s (SENT)
I20260709 14:52:19.048404  7852 raft_consensus.cc:2468] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 11.
W20260709 14:52:19.049932  8596 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:19.050168  7745 leader_election.cc:304] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:19.053050  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:19.054780 11372 consensus_queue.cc:260] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:19.056509 11372 raft_consensus.cc:3060] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:52:19.052971 11382 raft_consensus.cc:2749] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 14:52:19.057765  7743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:19.090202  7774 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 2905) took 1421 ms. Trace:
I20260709 14:52:19.101832  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:19.085206 11445 raft_consensus.cc:2804] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 14:52:19.107992 11445 raft_consensus.cc:493] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:19.108443 11445 raft_consensus.cc:3060] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:52:19.042300 11388 consensus_queue.cc:1048] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.059s
W20260709 14:52:19.144325  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 100124us
W20260709 14:52:19.145589  7745 leader_election.cc:336] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 1.754s (SENT)
I20260709 14:52:19.146118  7745 leader_election.cc:304] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:19.147177 11533 raft_consensus.cc:2749] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 14:52:19.154508  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:52:19.169308  7744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:19.172632  7849 raft_consensus.cc:1240] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 12. Current term is 13. Ops: []
I20260709 14:52:19.196079  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:19.090826  7774 rpcz_store.cc:276] 0709 14:52:17.669078 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:18.127385 (+458307us) service_pool.cc:224] Handling call
0709 14:52:18.191288 (+ 63903us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:52:18.232346 (+ 41058us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 14:52:18.654210 (+421864us) log.cc:844] Serialized 14 byte log entry
0709 14:52:19.066869 (+412659us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:52:19.066970 (+   101us) raft_consensus.cc:1645] Marking committed up to 6
0709 14:52:19.088893 (+ 21923us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:19.089028 (+   135us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:19.090091 (+  1063us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":53823,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":82,"raft.queue_time_us":24168,"thread_start_us":782144,"threads_started":2}
I20260709 14:52:19.197165  7845 raft_consensus.cc:2468] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 10.
I20260709 14:52:19.197748  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:19.198727  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:19.198952  7847 raft_consensus.cc:2468] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 9.
I20260709 14:52:19.203087  7849 raft_consensus.cc:1275] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 9. (term mismatch)
I20260709 14:52:19.203564  7849 pending_rounds.cc:85] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting all ops after (but not including) 8
I20260709 14:52:19.203900  7849 pending_rounds.cc:107] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting uncommitted NO_OP operation due to leader change: 12.9
I20260709 14:52:19.204190  7849 raft_consensus.cc:2889] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 14:52:19.164101 11317 consensus_meta.cc:287] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0: Time spent flushing consensus metadata: real 0.745s	user 0.009s	sys 0.011s
I20260709 14:52:19.205343  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:19.165692 11586 consensus_queue.cc:1048] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.047s
W20260709 14:52:19.216928  7745 leader_election.cc:336] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 2.023s (SENT)
W20260709 14:52:19.218127  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 221663us
I20260709 14:52:19.219053  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:19.220089  7852 raft_consensus.cc:3060] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:52:19.222957  7745 leader_election.cc:304] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:52:19.243649  7744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:19.232334 11317 raft_consensus.cc:493] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:19.251387 11533 raft_consensus.cc:2749] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 14:52:19.230942 11577 raft_consensus.cc:493] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
W20260709 14:52:19.310467  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 407306us
I20260709 14:52:19.318961 11445 raft_consensus.cc:515] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:19.321770 11445 leader_election.cc:290] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:52:19.330161  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:52:19.355789  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 187406us
I20260709 14:52:19.356746  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:19.357324  7893 leader_election.cc:304] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
W20260709 14:52:19.359615  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:19.362123 11586 consensus_queue.cc:1048] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 14:52:19.362834 11295 consensus_queue.cc:1048] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 14:52:19.356806  7745 leader_election.cc:336] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 2.029s (SENT)
I20260709 14:52:19.365227  7745 leader_election.cc:304] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:19.367388 11533 raft_consensus.cc:2749] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 14:52:19.370124 11295 consensus_queue.cc:1048] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 14:52:19.371598 11445 raft_consensus.cc:493] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:19.372429 11445 raft_consensus.cc:515] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:19.378597  7745 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:52:19.381909  7745 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:52:19.382854  7745 leader_election.cc:336] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 1.769s (SENT)
I20260709 14:52:19.383836 11445 leader_election.cc:290] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:19.323056 11317 raft_consensus.cc:515] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:19.387343 11317 leader_election.cc:290] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:19.359791 11504 raft_consensus.cc:2804] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 14:52:19.388432 11504 raft_consensus.cc:493] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:19.388870 11504 raft_consensus.cc:3060] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Advancing to term 9
W20260709 14:52:19.391376  7745 leader_election.cc:336] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 2.191s (SENT)
I20260709 14:52:19.391872 11287 raft_consensus.cc:515] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:19.393112  7745 leader_election.cc:336] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 2.223s (SENT)
I20260709 14:52:19.393754  7745 leader_election.cc:304] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:19.394657 11533 raft_consensus.cc:2749] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 14:52:19.361910 11168 consensus_queue.cc:1059] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 14:52:19.399395 11287 leader_election.cc:290] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:52:19.409814  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 48973.1us
W20260709 14:52:19.346946 11383 consensus_meta.cc:287] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0: Time spent flushing consensus metadata: real 0.728s	user 0.011s	sys 0.005s
I20260709 14:52:19.328789 11577 raft_consensus.cc:515] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:19.414103 11704 log.cc:927] Time spent T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.056s	user 0.001s	sys 0.006s
I20260709 14:52:19.421540  7850 raft_consensus.cc:1240] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
W20260709 14:52:19.436112  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:19.454272  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1f7722fdea49e0b5e9c5d96633eaf9" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:52:19.456426  7743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:19.463598 11327 raft_consensus.cc:3055] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 14:52:19.464214 11327 raft_consensus.cc:740] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:19.465647 11327 consensus_queue.cc:260] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:19.465947 11713 consensus_queue.cc:1059] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 14:52:19.466861 11327 raft_consensus.cc:3060] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:52:19.472019  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:19.475862 11317 raft_consensus.cc:3055] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 14:52:19.476503 11317 raft_consensus.cc:740] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:19.478559  7851 pending_rounds.cc:85] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting all ops after (but not including) 4
I20260709 14:52:19.479090  7851 pending_rounds.cc:107] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 14:52:19.479408  7851 raft_consensus.cc:2889] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:52:19.484009  7819 leader_election.cc:304] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 9418391fa82a42c79c6cad13ba91d964
I20260709 14:52:19.477970 11317 consensus_queue.cc:260] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:19.485383 11696 raft_consensus.cc:2749] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 14:52:19.486146 11317 raft_consensus.cc:3060] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 14:52:19.494118  7853 raft_consensus.cc:1240] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 14:52:19.494148  7819 leader_election.cc:304] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:19.497663  7852 raft_consensus.cc:2468] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 11.
I20260709 14:52:19.460862 11577 leader_election.cc:290] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:52:19.510437  7745 leader_election.cc:336] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 2.510s (SENT)
W20260709 14:52:19.511735  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:19.513139  7745 leader_election.cc:304] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:19.494226 11701 consensus_queue.cc:1048] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 14:52:19.523586 11695 consensus_queue.cc:1059] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 14:52:19.524657 11401 consensus_queue.cc:1048] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 14:52:19.527441 11577 raft_consensus.cc:2749] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 14:52:19.541792  7894 leader_election.cc:304] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:52:19.548365 11714 raft_consensus.cc:3055] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 LEADER]: Stepping down as leader of term 13
W20260709 14:52:19.548889  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 46233.8us
W20260709 14:52:19.549842  7745 leader_election.cc:336] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 2.574s (SENT)
I20260709 14:52:19.550397  7745 leader_election.cc:304] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:19.551239  7819 leader_election.cc:304] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:19.552553  7894 leader_election.cc:304] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:52:19.561506  7846 raft_consensus.cc:1240] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
W20260709 14:52:19.561954  7744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:19.549154 11714 raft_consensus.cc:740] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:19.555055 11700 raft_consensus.cc:493] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:19.555104 11580 raft_consensus.cc:2804] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 14:52:19.530071 11378 consensus_queue.cc:1059] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 14:52:19.557381 11504 raft_consensus.cc:515] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:19.591907 11378 raft_consensus.cc:3055] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 14:52:19.557013 11372 raft_consensus.cc:2749] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 14:52:19.588150 11699 raft_consensus.cc:2804] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 14:52:19.589912 11714 consensus_queue.cc:260] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:19.605777 11714 raft_consensus.cc:3060] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 14:52:19.560885 11713 consensus_queue.cc:1059] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.013s
I20260709 14:52:19.595890 11699 raft_consensus.cc:493] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:52:19.597168 11700 raft_consensus.cc:515] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:19.598176 11580 raft_consensus.cc:697] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
W20260709 14:52:19.600955 11119 consensus_meta.cc:287] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0: Time spent flushing consensus metadata: real 0.617s	user 0.013s	sys 0.005s
I20260709 14:52:19.602761  7854 raft_consensus.cc:1240] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 8. Current term is 9. Ops: []
W20260709 14:52:19.602732 11707 log.cc:927] Time spent T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
W20260709 14:52:19.603394  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:19.592350 11378 raft_consensus.cc:740] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
W20260709 14:52:19.590699 11712 log.cc:927] Time spent T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 14:52:19.603111  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 53337.8us
W20260709 14:52:19.621815  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 69389.4us
I20260709 14:52:19.618110 11699 raft_consensus.cc:3060] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:52:19.654629 11504 leader_election.cc:290] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 9 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:19.674269 11119 consensus_queue.cc:1059] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 14:52:19.674528 11378 consensus_queue.cc:260] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:19.678342  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 47339.5us
I20260709 14:52:19.646739 11696 raft_consensus.cc:2749] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 14:52:19.688069  7745 leader_election.cc:336] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 2.770s (SENT)
I20260709 14:52:19.691705  7745 leader_election.cc:304] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:52:19.698350 11719 log.cc:927] Time spent T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 14:52:19.701570 11699 raft_consensus.cc:515] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:19.704721 11699 leader_election.cc:290] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:52:19.705801 11721 log.cc:927] Time spent T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.104s	user 0.000s	sys 0.004s
I20260709 14:52:19.707593 11504 consensus_queue.cc:1059] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 14:52:19.708913 11504 raft_consensus.cc:3055] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 14:52:19.709970 11504 raft_consensus.cc:740] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:19.710388 11703 raft_consensus.cc:3055] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 14:52:19.711119 11703 raft_consensus.cc:740] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:19.711179 11504 consensus_queue.cc:260] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:19.713855 11378 raft_consensus.cc:3060] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:52:19.718044 11409 raft_consensus.cc:3055] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 LEADER]: Stepping down as leader of term 10
I20260709 14:52:19.718555 11409 raft_consensus.cc:740] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:52:19.718832 11586 raft_consensus.cc:3055] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 14:52:19.719333 11586 raft_consensus.cc:740] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:19.712419 11703 consensus_queue.cc:260] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:19.720458 11586 consensus_queue.cc:260] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:19.722668 11703 raft_consensus.cc:3060] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 14:52:19.727852 11724 raft_consensus.cc:2749] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 14:52:19.771081 11586 raft_consensus.cc:3060] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 14:52:19.712931 11504 raft_consensus.cc:3060] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Advancing to term 13
W20260709 14:52:19.738996  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:19.741509  7893 leader_election.cc:304] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
W20260709 14:52:19.774284  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 97411.8us
W20260709 14:52:19.742448  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 204011us
I20260709 14:52:19.750550 11700 leader_election.cc:290] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:19.718086  7894 leader_election.cc:304] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:19.752050 11580 consensus_queue.cc:237] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:19.757236 11409 consensus_queue.cc:260] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:19.761016  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 77493.4us
W20260709 14:52:19.781188  7744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:19.761705 11372 raft_consensus.cc:2749] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 14:52:19.776755  7893 leader_election.cc:304] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:52:19.783967  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 66044.3us
W20260709 14:52:19.779620 11722 log.cc:927] Time spent T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.057s	user 0.001s	sys 0.001s
W20260709 14:52:19.783874 11728 log.cc:927] Time spent T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.073s	user 0.008s	sys 0.000s
I20260709 14:52:19.790506 11713 raft_consensus.cc:2804] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 14:52:19.793195 11699 raft_consensus.cc:2804] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 14:52:19.798890  7894 leader_election.cc:304] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
W20260709 14:52:19.801596  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:52:19.805101  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:19.805419 11700 raft_consensus.cc:2804] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 14:52:19.799291 11409 raft_consensus.cc:3060] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:52:19.797318 11713 raft_consensus.cc:493] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:19.818102 11119 consensus_queue.cc:1048] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 14:52:19.809834 11317 raft_consensus.cc:2804] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 14:52:19.823530 11317 raft_consensus.cc:493] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:19.824075 11317 raft_consensus.cc:3060] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:52:19.818130 11713 raft_consensus.cc:3060] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:52:19.809885 11700 raft_consensus.cc:493] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:52:19.827080 11700 raft_consensus.cc:3060] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:52:19.823205 11119 consensus_queue.cc:1059] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 14:52:19.831173 11119 raft_consensus.cc:3055] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 14:52:19.831787 11119 raft_consensus.cc:740] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
W20260709 14:52:19.832623  7745 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:19.833333  7819 leader_election.cc:304] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:19.804946 11699 raft_consensus.cc:493] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:52:19.846668 11372 raft_consensus.cc:493] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:19.847453 11730 raft_consensus.cc:2749] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 14:52:19.847502 11372 raft_consensus.cc:515] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:19.853927 11372 leader_election.cc:290] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:19.859988 11699 raft_consensus.cc:3060] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:52:19.865378  7894 leader_election.cc:304] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac, 9418391fa82a42c79c6cad13ba91d964
I20260709 14:52:19.866030 11327 consensus_queue.cc:1059] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 14:52:19.866441 11295 raft_consensus.cc:2749] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 14:52:19.871765  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 46676.2us
I20260709 14:52:19.873925  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:19.876403  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:19.875000 11119 consensus_queue.cc:260] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:19.877084 11327 raft_consensus.cc:3055] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 14:52:19.877696 11327 raft_consensus.cc:740] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:19.878249 11119 raft_consensus.cc:3060] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:52:19.878834 11327 consensus_queue.cc:260] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:19.879455  7893 leader_election.cc:304] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:19.880304 11327 raft_consensus.cc:3060] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:52:19.881767 11168 raft_consensus.cc:2804] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 14:52:19.882097  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:19.883189 11168 raft_consensus.cc:493] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:19.883761 11168 raft_consensus.cc:3060] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 14:52:19.886732  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:19.892391  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:19.895179  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:19.896337  7849 raft_consensus.cc:2393] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 11: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:52:19.898353  7893 leader_election.cc:304] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:52:19.899410  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:19.900511  7847 raft_consensus.cc:2393] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 9: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:52:19.898353  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:19.902362  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:19.903357  7849 raft_consensus.cc:2393] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 10: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:52:19.907083  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:19.911012 11445 raft_consensus.cc:2804] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 14:52:19.906044 11713 raft_consensus.cc:515] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:19.918972  7745 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:19.922401  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:19.926051  7851 raft_consensus.cc:2410] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
W20260709 14:52:19.925810  7745 leader_election.cc:336] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 2.892s (SENT)
I20260709 14:52:19.926108  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:19.926625  7745 leader_election.cc:304] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:19.928154  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:19.928659 11372 raft_consensus.cc:2749] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 14:52:19.913143 11700 raft_consensus.cc:515] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:19.931303  7774 raft_consensus.cc:2468] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 11.
I20260709 14:52:19.943025  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:19.943905  7773 raft_consensus.cc:3060] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Advancing to term 12
W20260709 14:52:19.961383  7893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:19.973276  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:19.935230 11445 raft_consensus.cc:697] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:19.989464  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:19.991009  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:20.000694  7845 raft_consensus.cc:1275] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 14:52:20.001579  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:19.998242  7771 raft_consensus.cc:2468] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 10.
I20260709 14:52:19.932447 11317 raft_consensus.cc:515] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:20.013520  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:20.007376  6549 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 14:52:20.012952  7772 raft_consensus.cc:1240] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260709 14:52:20.014496  7845 raft_consensus.cc:2468] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 13.
I20260709 14:52:20.018782 11713 leader_election.cc:290] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:52:20.031450  7743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:20.037060  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:20.060002  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:20.025683 11699 raft_consensus.cc:515] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:20.068743  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:52:20.080986  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:20.083837  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:20.111781 11168 raft_consensus.cc:515] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:20.095628 11700 leader_election.cc:290] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:52:20.125102  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:20.127859  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:20.131526  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: true dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:20.131703  7777 raft_consensus.cc:2393] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 9: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:52:20.134850  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:20.135658  7923 raft_consensus.cc:2468] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 11.
I20260709 14:52:20.135816 11168 leader_election.cc:290] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 15 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:20.136751  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:20.132688  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:20.137686  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783e4874513449ef9084b833f188a6d3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:20.139909  7923 raft_consensus.cc:1275] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 14:52:20.140380  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:20.142498  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:20.149981  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:20.150987  7924 raft_consensus.cc:2468] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 14.
I20260709 14:52:20.151749  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:20.151895  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:20.153096  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:20.154511  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:20.155200  7922 raft_consensus.cc:1240] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 11. Current term is 12. Ops: []
I20260709 14:52:20.155424  7927 raft_consensus.cc:2468] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 10.
I20260709 14:52:20.156436  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:20.087320 11445 consensus_queue.cc:237] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:20.160768  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:20.161731  7777 raft_consensus.cc:2468] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 11.
I20260709 14:52:20.162699  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:20.157440  7925 raft_consensus.cc:2393] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 10: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:52:20.163108 11317 leader_election.cc:290] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:20.166744  7927 raft_consensus.cc:2393] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 15: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
W20260709 14:52:20.177940  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 246649us
I20260709 14:52:20.178521  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:20.190234  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:52:20.193006  7744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:52:20.177431 11733 log.cc:927] Time spent T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.174s	user 0.000s	sys 0.002s
I20260709 14:52:20.230850 11699 leader_election.cc:290] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 11 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:20.231504  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:20.232420  7927 raft_consensus.cc:2468] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 9.
W20260709 14:52:20.233435 11734 log.cc:927] Time spent T 00000000000000000000000000000000 P 133636659113430cb53b321cb0b1d9ee: Append to log took a long time: real 0.216s	user 0.000s	sys 0.002s
I20260709 14:52:20.234037  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:20.234956  7853 raft_consensus.cc:2468] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 7.
I20260709 14:52:20.236158  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:20.236930  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:20.237972  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:20.238775  7919 raft_consensus.cc:2468] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 8.
I20260709 14:52:20.239415  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:20.240186  7924 raft_consensus.cc:1240] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 10. Current term is 11. Ops: []
I20260709 14:52:20.182919  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce9c0ef2db24c13a8b1402f21819458" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
W20260709 14:52:20.315490  7744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:20.210376 11577 raft_consensus.cc:493] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:20.214354  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258d6c2dda954bf5b65930fde8ecb9f3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:20.216339  7849 raft_consensus.cc:1275] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 14:52:20.217203  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:20.217875  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:20.218083  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:20.218837  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:20.338086  7854 raft_consensus.cc:2410] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 14:52:20.219588  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:20.251168  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c563cc7cfbe4d59be4ffc5cf847ce56" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:20.237057  7922 raft_consensus.cc:2468] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 11.
I20260709 14:52:20.310986  7920 raft_consensus.cc:2468] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 13.
I20260709 14:52:20.206907  7773 raft_consensus.cc:2468] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 12.
W20260709 14:52:20.329190  7745 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:20.329437  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:52:20.331991  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:20.332901  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:20.336062  7847 raft_consensus.cc:2468] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 11.
I20260709 14:52:20.345062  7919 raft_consensus.cc:2393] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 12: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
W20260709 14:52:20.351310  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:20.344820 11577 raft_consensus.cc:515] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:20.351639  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18d29d52d304c87b930d4fb5eaf50b1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:20.352392  7846 raft_consensus.cc:3060] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:52:20.355607  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:20.357685  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:20.359141  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:52:20.361783  7745 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:20.375092  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:20.377732  7926 raft_consensus.cc:2393] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 9: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:52:20.378618  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:20.412221  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:20.414639  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:20.418869  7848 raft_consensus.cc:2393] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 13: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:52:20.420248  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:20.420583  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:20.421128  7849 raft_consensus.cc:3060] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Advancing to term 13
W20260709 14:52:20.421811  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 48052.1us
I20260709 14:52:20.421144  7920 raft_consensus.cc:2468] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 13.
I20260709 14:52:20.418800  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783e4874513449ef9084b833f188a6d3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:20.440171  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:20.429356  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:20.443632  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:20.443161  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:20.449106  7927 raft_consensus.cc:2393] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 10: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:52:20.450718  7848 raft_consensus.cc:2393] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 11: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:52:20.452301  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:20.452193  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:20.455468  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:20.453899  7851 raft_consensus.cc:2468] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 9.
I20260709 14:52:20.467689  7853 raft_consensus.cc:2393] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 14: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:52:20.467974  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:20.470351  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:20.482127  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:20.482973  7850 raft_consensus.cc:3060] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Advancing to term 12
W20260709 14:52:20.486220  8598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 140475us
W20260709 14:52:20.489831  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:20.484974  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:20.473457 11699 raft_consensus.cc:493] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:20.493845  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:20.496378  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:20.492303  7673 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51352 (request call id 120) took 6857 ms. Trace:
I20260709 14:52:20.503775  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783e4874513449ef9084b833f188a6d3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:20.469893 11747 raft_consensus.cc:493] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:52:20.514653  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:20.521468  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:20.503130  7673 rpcz_store.cc:276] 0709 14:52:13.580368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:13.580685 (+   317us) service_pool.cc:224] Handling call
0709 14:52:20.438009 (+6857324us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":649484,"reported_tablets":1}
W20260709 14:52:20.528494  7743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:20.522161  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: true dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:20.530261  7848 raft_consensus.cc:3060] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Advancing to term 13
I20260709 14:52:20.503063 11699 raft_consensus.cc:515] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:20.541723 11743 log.cc:927] Time spent T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.126s	user 0.000s	sys 0.001s
I20260709 14:52:20.529021 11688 raft_consensus.cc:493] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:20.544013 11688 raft_consensus.cc:515] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:52:20.534718 11747 raft_consensus.cc:515] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:20.548817  7744 leader_election.cc:304] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:52:20.548857  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18d29d52d304c87b930d4fb5eaf50b1" candidate_uuid: "9418391fa82a42c79c6cad13ba91d964" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:20.565745  7772 raft_consensus.cc:2468] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9418391fa82a42c79c6cad13ba91d964 in term 6.
I20260709 14:52:20.540896 11699 leader_election.cc:290] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:20.575304  7849 raft_consensus.cc:2410] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 14:52:20.584218  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:20.583269  7846 raft_consensus.cc:2468] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 6.
I20260709 14:52:20.585943  7744 leader_election.cc:304] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:52:20.581103  7893 leader_election.cc:304] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:20.594923  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:20.600381  7893 leader_election.cc:304] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:20.601807  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:20.582302 11372 raft_consensus.cc:2804] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 14:52:20.608058 11372 raft_consensus.cc:493] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:20.613811 11372 raft_consensus.cc:3060] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:52:20.608081 11701 raft_consensus.cc:2749] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 14:52:20.621043  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:20.629464 11580 raft_consensus.cc:2804] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 14:52:20.630064 11580 raft_consensus.cc:493] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:20.630450 11580 raft_consensus.cc:3060] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:52:20.634989 11577 leader_election.cc:290] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:20.635771 11577 raft_consensus.cc:2804] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 14:52:20.636173 11577 raft_consensus.cc:493] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:20.636518 11577 raft_consensus.cc:3060] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:52:20.638875  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:20.580879 11747 leader_election.cc:290] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:20.584635 11754 consensus_queue.cc:1048] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.071s
I20260709 14:52:20.592739 11746 consensus_queue.cc:1059] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.063s
I20260709 14:52:20.655867 11746 raft_consensus.cc:3055] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 LEADER]: Stepping down as leader of term 11
I20260709 14:52:20.656365 11746 raft_consensus.cc:740] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:52:20.657570 11746 consensus_queue.cc:260] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:20.659216 11746 raft_consensus.cc:3060] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:52:20.665499 11688 leader_election.cc:290] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:52:20.668236 11751 log.cc:927] Time spent T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 14:52:20.671316  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:20.672580  7848 raft_consensus.cc:2468] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 13.
I20260709 14:52:20.672880  7851 raft_consensus.cc:3060] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:52:20.606226  7893 leader_election.cc:304] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:52:20.678822  7894 leader_election.cc:304] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:52:20.682453  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:20.685789  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:20.688859  7850 raft_consensus.cc:2468] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 12.
I20260709 14:52:20.688925  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:52:20.692530  7745 leader_election.cc:336] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 1.541s (SENT)
I20260709 14:52:20.710805  7745 leader_election.cc:304] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:20.690881 11699 raft_consensus.cc:2804] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 14:52:20.691557 11317 raft_consensus.cc:2749] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 14:52:20.678920  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 72798.3us
I20260709 14:52:20.738015  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:20.745690  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:20.749148  7846 raft_consensus.cc:2393] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 9: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:52:20.750725  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:20.750834  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:20.751573  7850 raft_consensus.cc:2468] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 11.
I20260709 14:52:20.754643  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:20.757223  7848 raft_consensus.cc:3060] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:52:20.755939  7894 leader_election.cc:304] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:20.716203 11754 raft_consensus.cc:2749] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 14:52:20.694589  7673 catalog_manager.cc:5697] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 9418391fa82a42c79c6cad13ba91d964 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "9418391fa82a42c79c6cad13ba91d964" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 14:52:20.767916  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 75515.7us
I20260709 14:52:20.734308  7919 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "258d6c2dda954bf5b65930fde8ecb9f3"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
mode: GRACEFUL
new_leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:48676
I20260709 14:52:20.770016  7919 raft_consensus.cc:606] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Received request to transfer leadership to TS 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:52:20.770674  7919 raft_consensus.cc:614] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 14:52:20.742133 11699 raft_consensus.cc:493] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:20.773052 11699 raft_consensus.cc:3060] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:52:20.772748 11445 raft_consensus.cc:2804] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 14:52:20.775753  7919 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
mode: GRACEFUL
new_leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:48676
I20260709 14:52:20.776607  7919 raft_consensus.cc:606] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 LEADER]: Received request to transfer leadership to TS 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:20.775846 11445 raft_consensus.cc:697] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:20.782922 11445 consensus_queue.cc:237] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:20.752036  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c563cc7cfbe4d59be4ffc5cf847ce56" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:20.801693  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18d29d52d304c87b930d4fb5eaf50b1" candidate_uuid: "9418391fa82a42c79c6cad13ba91d964" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:20.804996  7846 raft_consensus.cc:2468] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9418391fa82a42c79c6cad13ba91d964 in term 6.
I20260709 14:52:20.811092  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:20.828836  7846 raft_consensus.cc:2468] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 12.
I20260709 14:52:20.809181  7848 raft_consensus.cc:2468] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 11.
I20260709 14:52:20.817579  7675 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54350 (request call id 373) took 10441 ms. Trace:
I20260709 14:52:20.821434  7919 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
mode: GRACEFUL
new_leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:48676
I20260709 14:52:20.809873  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:20.833153  7919 raft_consensus.cc:606] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Received request to transfer leadership to TS 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:20.833308  7850 raft_consensus.cc:2468] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 9.
W20260709 14:52:20.821471  7745 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:20.833568  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783e4874513449ef9084b833f188a6d3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:20.833580  7919 raft_consensus.cc:614] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 14:52:20.835724  7846 raft_consensus.cc:2468] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 8.
W20260709 14:52:20.836194  7745 leader_election.cc:336] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 1.685s (SENT)
I20260709 14:52:20.810525  8599 leader_election.cc:304] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac, 9418391fa82a42c79c6cad13ba91d964; no voters: 
I20260709 14:52:20.824111  7676 catalog_manager.cc:5697] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 7 to 8, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 8 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:52:20.845140  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:20.856667  7851 raft_consensus.cc:2468] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 10.
I20260709 14:52:20.859889  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:20.860592  7850 raft_consensus.cc:3060] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:52:20.865978  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:20.868093  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:20.843593 11755 raft_consensus.cc:2804] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 14:52:20.869429  7848 raft_consensus.cc:2393] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 11: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:52:20.870414  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:20.815044 11372 raft_consensus.cc:515] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:20.811961 11699 raft_consensus.cc:515] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:20.866086  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:20.880311  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:20.881567  7848 raft_consensus.cc:2468] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 9.
I20260709 14:52:20.883315  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:20.885731  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:20.885089  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:20.874598 11755 raft_consensus.cc:493] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:20.890563  7848 raft_consensus.cc:2393] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 10: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:52:20.831976  7675 rpcz_store.cc:276] 0709 14:52:10.382720 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:10.382990 (+   270us) service_pool.cc:224] Handling call
0709 14:52:20.817349 (+10434359us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 14:52:15.350207 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 14:52:15.367088 (+ 16881us) write_op.cc:432] Acquiring schema lock in shared mode
0709 14:52:15.367135 (+    47us) write_op.cc:435] Acquired schema lock
0709 14:52:15.367154 (+    19us) tablet.cc:662] Decoding operations
0709 14:52:15.633277 (+266123us) write_op.cc:620] Acquiring the partition lock for write op
0709 14:52:15.645629 (+ 12352us) write_op.cc:641] Partition lock acquired for write op
0709 14:52:15.649627 (+  3998us) tablet.cc:685] Acquiring locks for 13 operations
0709 14:52:15.747800 (+ 98173us) tablet.cc:701] Row locks acquired
0709 14:52:15.747825 (+    25us) write_op.cc:260] PREPARE: finished
0709 14:52:15.748048 (+   223us) write_op.cc:270] Start()
0709 14:52:15.764057 (+ 16009us) write_op.cc:276] Timestamp: P: 1783608735747972 usec, L: 0
0709 14:52:15.820140 (+ 56083us) op_driver.cc:348] REPLICATION: starting
0709 14:52:15.898896 (+ 78756us) log.cc:844] Serialized 5159 byte log entry
0709 14:52:16.906876 (+1007980us) spinlock_profiling.cc:243] Waited 6.63 ms on lock 0x7b4400022b4c. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb687c29db1 00007fb687cc7c85 00007fb687cc86a2 00007fb68aa3a1db 00007fb68aa35aaf 00007fb68aa2986e 00007fb68aa28bb6 00007fb68aa287d8 00007fb68aa32221 00007fb68aa321d9 00007fb68aa32169
0709 14:52:17.595846 (+688970us) op_driver.cc:464] REPLICATION: finished
0709 14:52:18.502025 (+906179us) write_op.cc:301] APPLY: starting
0709 14:52:18.502209 (+   184us) tablet.cc:1367] starting BulkCheckPresence
0709 14:52:18.817696 (+315487us) spinlock_profiling.cc:243] Waited 6.08 ms on lock 0x7b180016fa80. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb690c69de1 00007fb690c765b1 00007fb68aa364bc 00007fb687d8448b 00007fb690bdeab9 00007fb687da069b 00007fb687d9e93f 00007fb687da0c02 00007fb68e8c4ef0 00007fb68e8c5489 00007fb68e8c771a
0709 14:52:19.588757 (+771061us) tablet.cc:1370] finished BulkCheckPresence
0709 14:52:19.588810 (+    53us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 14:52:19.855942 (+267132us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 14:52:19.856523 (+   581us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=26,key_file_lookups=26,delta_file_lookups=26,mrs_lookups=0
0709 14:52:19.856598 (+    75us) write_op.cc:312] APPLY: finished
0709 14:52:19.857211 (+   613us) log.cc:844] Serialized 121 byte log entry
0709 14:52:19.922677 (+ 65466us) write_op.cc:489] Releasing partition, row and schema locks
0709 14:52:20.002889 (+ 80212us) write_op.cc:454] Released schema lock
0709 14:52:20.010516 (+  7627us) write_op.cc:341] FINISH: Updating metrics
0709 14:52:20.066136 (+ 55620us) write_op.cc:489] Releasing partition, row and schema locks
0709 14:52:20.075944 (+  9808us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":73871,"reported_tablets":28,"child_traces":[["op",{"apply.queue_time_us":905513,"apply.run_cpu_time_us":73777,"apply.run_wall_time_us":1550667,"cfile_cache_hit":50,"cfile_cache_hit_bytes":52100,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6211,"cfile_init":2,"lbm_read_time_us":47660,"lbm_reads_10-100_ms":3,"lbm_reads_lt_1ms":9,"num_ops":13,"prepare.queue_time_us":577281,"prepare.run_cpu_time_us":31726,"prepare.run_wall_time_us":685308,"raft.queue_time_us":451417,"raft.run_cpu_time_us":70642,"raft.run_wall_time_us":1222536,"replication_time_us":1773498,"spinlock_wait_cycles":29239936,"thread_start_us":2283173,"threads_started":5,"wal-append.queue_time_us":323619,"wal-append.run_cpu_time_us":27000,"wal-append.run_wall_time_us":2839993}]]}
I20260709 14:52:20.875597 11580 raft_consensus.cc:515] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:20.907368 11580 leader_election.cc:290] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:20.907796 11372 leader_election.cc:290] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 12 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:20.888890  7846 raft_consensus.cc:2468] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 10.
I20260709 14:52:20.910948  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:20.912485  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:20.886019 11754 raft_consensus.cc:493] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:20.884387  7850 raft_consensus.cc:2468] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 11.
I20260709 14:52:20.919473  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:20.915167  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:20.893226 11755 raft_consensus.cc:3060] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:52:20.921185  7846 raft_consensus.cc:2393] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 9: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:52:20.913754  7848 raft_consensus.cc:2393] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 8: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:52:20.931118  7676 catalog_manager.cc:5697] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:52:20.935213  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:20.936110  7851 raft_consensus.cc:3060] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Advancing to term 14
I20260709 14:52:20.940794  7850 raft_consensus.cc:2468] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 12.
I20260709 14:52:20.939952  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:20.941449  7676 catalog_manager.cc:5697] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:52:20.942389  7846 raft_consensus.cc:2393] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 14: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:52:20.918854 11580 raft_consensus.cc:493] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:20.945194  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258d6c2dda954bf5b65930fde8ecb9f3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:20.953519  7850 raft_consensus.cc:3060] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:52:20.926190  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
W20260709 14:52:20.956525  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:20.959125  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:52:20.961454  7745 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:52:20.962666  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 376832us
I20260709 14:52:20.965883  7744 leader_election.cc:304] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:20.955197  7848 raft_consensus.cc:2410] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 14:52:20.972563  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: true dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:20.973632  7848 raft_consensus.cc:2376] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 13. Re-sending same reply.
I20260709 14:52:20.968571  7846 raft_consensus.cc:2393] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 13: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:52:20.977350  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:20.981698  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:20.922281 11754 raft_consensus.cc:515] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:20.984678  7919 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
mode: GRACEFUL
new_leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:48676
W20260709 14:52:20.985589  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:21.007889  7919 raft_consensus.cc:606] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Received request to transfer leadership to TS 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:20.985484  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18d29d52d304c87b930d4fb5eaf50b1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:20.983273  7851 raft_consensus.cc:2410] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 14:52:21.003289  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:20.998903  7744 leader_election.cc:304] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:52:21.009023  7846 raft_consensus.cc:2376] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 6. Re-sending same reply.
W20260709 14:52:21.020051  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 264187us
I20260709 14:52:21.009876  7848 raft_consensus.cc:2468] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 10.
I20260709 14:52:21.022574  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:21.022828  7850 raft_consensus.cc:2410] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for term 9 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 14:52:21.008409  7919 raft_consensus.cc:614] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 14:52:21.011336  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:21.026352  7851 raft_consensus.cc:2468] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 11.
I20260709 14:52:21.011250  7744 leader_election.cc:304] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
W20260709 14:52:21.027922  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 277405us
I20260709 14:52:21.028792  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:21.003155 11372 raft_consensus.cc:493] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:20.958283 11580 raft_consensus.cc:515] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:21.030119  7850 raft_consensus.cc:3060] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Advancing to term 11
I20260709 14:52:21.031051  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:21.008373 11746 raft_consensus.cc:3060] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Advancing to term 15
I20260709 14:52:21.018996 11699 leader_election.cc:290] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 11 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:21.042455  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:21.037931  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:21.032807  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:21.040019  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:21.047648  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:21.049762  7851 raft_consensus.cc:2393] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 11: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:52:21.051532  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:21.053951  7852 raft_consensus.cc:2393] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 11: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:52:21.050277  7893 leader_election.cc:304] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:21.059795  7849 raft_consensus.cc:1275] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 14:52:21.092360 11580 leader_election.cc:290] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:21.055325 11764 raft_consensus.cc:2804] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 14:52:21.093784 11764 raft_consensus.cc:493] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:21.094323 11764 raft_consensus.cc:3060] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:52:21.098235  7850 raft_consensus.cc:2468] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 11.
I20260709 14:52:21.101778  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:21.098608  7893 leader_election.cc:304] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:21.102111  7849 raft_consensus.cc:3055] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 LEADER]: Stepping down as leader of term 9
I20260709 14:52:21.103942  7849 raft_consensus.cc:740] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:52:21.041640 11372 raft_consensus.cc:515] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:21.117353  7894 leader_election.cc:304] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:21.115747  7893 leader_election.cc:304] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:21.122079  7894 leader_election.cc:304] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
W20260709 14:52:21.122821  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 111640us
I20260709 14:52:21.118801  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:21.130324  7919 raft_consensus.cc:1240] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 LEADER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 12. Current term is 13. Ops: []
I20260709 14:52:21.132254  7894 leader_election.cc:304] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:21.137871 11768 raft_consensus.cc:2804] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 14:52:21.138877 11768 raft_consensus.cc:493] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:21.139705 11768 raft_consensus.cc:3060] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:52:21.095711 11699 raft_consensus.cc:2749] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 14:52:21.081670 11757 raft_consensus.cc:493] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:21.149544  7926 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
mode: GRACEFUL
new_leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:48676
I20260709 14:52:21.155898  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:21.157421  7926 raft_consensus.cc:606] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Received request to transfer leadership to TS 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:52:21.157701  7922 raft_consensus.cc:2393] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 10: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:52:21.158012  7926 raft_consensus.cc:614] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 14:52:21.131172  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:21.144997 11317 raft_consensus.cc:2804] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 14:52:21.166728 11701 raft_consensus.cc:2804] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 14:52:21.170994 11757 raft_consensus.cc:515] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:21.205812 11701 raft_consensus.cc:697] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:21.206921 11701 consensus_queue.cc:237] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:21.207621 11746 raft_consensus.cc:2749] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 14:52:21.208006 11757 leader_election.cc:290] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:21.208658 11746 raft_consensus.cc:2804] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 14:52:21.210561 11746 raft_consensus.cc:493] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:21.211522 11746 raft_consensus.cc:3060] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Advancing to term 8
I20260709 14:52:21.192163  6549 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 14:52:21.166992 11119 raft_consensus.cc:2804] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 14:52:21.213359 11119 raft_consensus.cc:697] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:21.213721  6549 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 14:52:21.214437 11119 consensus_queue.cc:237] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:21.171834 11327 raft_consensus.cc:2804] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 14:52:21.219590 11327 raft_consensus.cc:493] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:52:21.220338 11327 raft_consensus.cc:3060] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:52:21.211617 11372 leader_election.cc:290] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:52:21.190150 11762 log.cc:927] Time spent T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.132s	user 0.000s	sys 0.001s
W20260709 14:52:21.177886  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 55457.4us
W20260709 14:52:21.231045  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:21.111904  7849 consensus_queue.cc:260] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:21.225710  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 101670us
I20260709 14:52:21.181682 11317 raft_consensus.cc:493] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:21.238163  7744 leader_election.cc:304] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 9418391fa82a42c79c6cad13ba91d964
I20260709 14:52:21.255715  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:21.223959 11168 raft_consensus.cc:493] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:52:21.264029  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 131893us
I20260709 14:52:21.261181  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:21.265183  7927 raft_consensus.cc:2468] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 14.
I20260709 14:52:21.260094  7920 raft_consensus.cc:1240] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 9. Current term is 10. Ops: []
I20260709 14:52:21.265203  7894 leader_election.cc:304] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:21.252660 11372 consensus_queue.cc:1048] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.011s
I20260709 14:52:21.272776  7849 raft_consensus.cc:3060] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:52:21.273335  7744 leader_election.cc:304] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
W20260709 14:52:21.275146 11577 consensus_meta.cc:287] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent flushing consensus metadata: real 0.638s	user 0.011s	sys 0.004s
I20260709 14:52:21.253571 11317 raft_consensus.cc:3060] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Advancing to term 12
W20260709 14:52:21.280261  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 103983us
I20260709 14:52:21.276542 11168 raft_consensus.cc:515] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:21.280212 11378 raft_consensus.cc:2804] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 14:52:21.298619 11755 raft_consensus.cc:515] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:52:21.299552  7849 raft_consensus.cc:1275] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 8 index: 6. (term mismatch)
I20260709 14:52:21.273415 11775 consensus_queue.cc:1059] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 14:52:21.298558 11168 leader_election.cc:290] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:21.275655 11577 raft_consensus.cc:515] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:21.306448  7849 pending_rounds.cc:85] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting all ops after (but not including) 5
I20260709 14:52:21.318375  7849 pending_rounds.cc:107] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 14:52:21.319051  7849 raft_consensus.cc:2889] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 14:52:21.320070  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 44649.9us
I20260709 14:52:21.322484 11747 raft_consensus.cc:493] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:21.323467 11372 raft_consensus.cc:2804] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 14:52:21.320381 11378 raft_consensus.cc:697] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:21.326244 11372 raft_consensus.cc:493] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:21.325894 11378 consensus_queue.cc:237] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:21.326700 11372 raft_consensus.cc:3060] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:52:21.327168 11755 leader_election.cc:290] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 [CANDIDATE]: Term 7 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:21.328995 11577 leader_election.cc:290] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:52:21.322587  7745 leader_election.cc:336] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 4.417s (SENT)
I20260709 14:52:21.323195 11747 raft_consensus.cc:515] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:21.330276  7745 leader_election.cc:304] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:21.337292 11580 raft_consensus.cc:993] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0: : Instructing follower 3876b8ee8d744cb18e91d97aae93b1ac to start an election
I20260709 14:52:21.337054  7744 leader_election.cc:304] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:52:21.338168 11580 raft_consensus.cc:1081] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 LEADER]: Signalling peer 3876b8ee8d744cb18e91d97aae93b1ac to start an election
I20260709 14:52:21.340847 11784 raft_consensus.cc:2749] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 14:52:21.343820 11784 raft_consensus.cc:2804] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 14:52:21.345505 11784 raft_consensus.cc:493] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:21.347882 11784 raft_consensus.cc:3060] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Advancing to term 13
W20260709 14:52:21.350188 11770 log.cc:927] Time spent T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.176s	user 0.000s	sys 0.005s
I20260709 14:52:21.301600 11778 raft_consensus.cc:2749] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 14:52:21.358740  7744 leader_election.cc:304] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:52:21.366235  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18d29d52d304c87b930d4fb5eaf50b1" candidate_uuid: "9418391fa82a42c79c6cad13ba91d964" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:21.379606  7847 raft_consensus.cc:3060] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:52:21.343688 11445 raft_consensus.cc:493] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:21.388316 11779 raft_consensus.cc:493] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:21.389433 11747 leader_election.cc:290] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:21.392714 11784 raft_consensus.cc:515] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:21.395859 11784 leader_election.cc:290] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:21.389118 11779 raft_consensus.cc:515] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:21.382496 11754 leader_election.cc:290] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:52:21.436146  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:21.396963 11784 consensus_queue.cc:1048] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 14:52:21.396212 11445 raft_consensus.cc:515] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:21.453655  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 150457us
I20260709 14:52:21.438164 11754 raft_consensus.cc:2804] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 14:52:21.457877  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:52:21.458012  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 99359.1us
I20260709 14:52:21.450649 11778 raft_consensus.cc:493] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:21.457582 11378 consensus_queue.cc:1048] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 14:52:21.468935  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:21.473109  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:21.474021  7776 raft_consensus.cc:3060] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:52:21.468305 11778 raft_consensus.cc:515] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:21.475390 11372 raft_consensus.cc:515] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:21.454934 11577 consensus_queue.cc:1048] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 14:52:21.482273 11372 leader_election.cc:290] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 12 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:21.459156 11754 raft_consensus.cc:493] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:21.485530 11786 consensus_queue.cc:1059] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 14:52:21.486603 11754 raft_consensus.cc:3060] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Advancing to term 14
I20260709 14:52:21.487095 11786 raft_consensus.cc:3055] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 LEADER]: Stepping down as leader of term 9
I20260709 14:52:21.487782 11786 raft_consensus.cc:740] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:52:21.488701 11786 consensus_queue.cc:260] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:21.490118 11786 raft_consensus.cc:3060] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:52:21.492208  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:21.472102  7894 leader_election.cc:304] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:21.493054  7774 raft_consensus.cc:3060] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:52:21.499217  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:21.501827 11787 raft_consensus.cc:2804] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 14:52:21.463076 11775 raft_consensus.cc:493] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:21.510737 11781 raft_consensus.cc:3055] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 LEADER]: Stepping down as leader of term 10
I20260709 14:52:21.511346 11781 raft_consensus.cc:740] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:52:21.512260 11781 consensus_queue.cc:260] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:21.510881 11789 log.cc:927] Time spent T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.128s	user 0.002s	sys 0.000s
I20260709 14:52:21.516258 11317 raft_consensus.cc:515] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:21.532459 11781 raft_consensus.cc:3060] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:52:21.545773  7776 raft_consensus.cc:2468] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 12.
I20260709 14:52:21.546662  7847 raft_consensus.cc:2468] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9418391fa82a42c79c6cad13ba91d964 in term 7.
I20260709 14:52:21.547649  7774 raft_consensus.cc:2468] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 10.
I20260709 14:52:21.551298  7777 raft_consensus.cc:2468] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 15.
I20260709 14:52:21.549088  8599 leader_election.cc:304] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac, 9418391fa82a42c79c6cad13ba91d964; no voters: 
I20260709 14:52:21.543265 11577 raft_consensus.cc:493] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:21.553333 11577 raft_consensus.cc:515] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:21.543872 11787 raft_consensus.cc:697] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:21.559861 11688 raft_consensus.cc:2804] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 14:52:21.560590 11688 raft_consensus.cc:697] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 [term 7 LEADER]: Becoming Leader. State: Replica: 9418391fa82a42c79c6cad13ba91d964, State: Running, Role: LEADER
I20260709 14:52:21.561666 11688 consensus_queue.cc:237] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:52:21.564522 11317 leader_election.cc:290] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:21.565073 11445 leader_election.cc:290] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:21.566578 11779 leader_election.cc:290] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:21.477065 11778 leader_election.cc:290] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:21.552479  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:21.553351 11746 raft_consensus.cc:515] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:21.574982 11785 log.cc:927] Time spent T 00000000000000000000000000000000 P 133636659113430cb53b321cb0b1d9ee: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 14:52:21.577800 11746 leader_election.cc:290] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:52:21.573199 11792 log.cc:927] Time spent T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.064s	user 0.001s	sys 0.001s
I20260709 14:52:21.557101 11577 leader_election.cc:290] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:21.576678 11764 raft_consensus.cc:515] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:21.582490 11764 leader_election.cc:290] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:21.585518  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:21.586442  7770 raft_consensus.cc:2468] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 10.
I20260709 14:52:21.587064 11327 raft_consensus.cc:515] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:21.574671 11754 raft_consensus.cc:515] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:21.585518  7776 raft_consensus.cc:1275] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 14:52:21.589769 11754 leader_election.cc:290] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 14 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:21.593701  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:21.594848  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:21.594614  7849 raft_consensus.cc:2468] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 13.
W20260709 14:52:21.599386  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 239696us
I20260709 14:52:21.600987 11747 raft_consensus.cc:493] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:21.601742 11747 raft_consensus.cc:515] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:21.604422 11747 leader_election.cc:290] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:21.605000  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:21.605762  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
W20260709 14:52:21.607841  7745 leader_election.cc:336] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 1.937s (SENT)
I20260709 14:52:21.608356  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:21.608531  7745 leader_election.cc:304] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:21.609912  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:21.611717 11794 raft_consensus.cc:2749] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 14:52:21.614017  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:21.614773  7924 raft_consensus.cc:2468] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 11.
W20260709 14:52:21.614040  7745 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:21.611546  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:21.568936 11768 raft_consensus.cc:515] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:21.618002  7847 raft_consensus.cc:1275] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 14:52:21.607630  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:21.622004  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:21.625317  7847 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa"
dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:49946
I20260709 14:52:21.533612 11775 raft_consensus.cc:515] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:21.626072  7847 raft_consensus.cc:493] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:52:21.629876  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258d6c2dda954bf5b65930fde8ecb9f3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:21.635520  7846 raft_consensus.cc:2468] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 10.
I20260709 14:52:21.636432  7845 raft_consensus.cc:2468] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 9.
I20260709 14:52:21.635435  7847 raft_consensus.cc:3060] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:52:21.629559  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:21.638725  7853 raft_consensus.cc:2468] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 11.
I20260709 14:52:21.630584 11775 leader_election.cc:290] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:21.631551  7920 raft_consensus.cc:1240] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 11. Current term is 12. Ops: []
I20260709 14:52:21.558892 11787 consensus_queue.cc:237] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:21.643676  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
W20260709 14:52:21.648222  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:21.656077  7851 raft_consensus.cc:3060] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:52:21.625581 11327 leader_election.cc:290] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:21.649513  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:21.658425  7770 raft_consensus.cc:2393] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 12: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:52:21.642761  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
W20260709 14:52:21.663215  7745 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:21.666265  7927 raft_consensus.cc:2410] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
W20260709 14:52:21.668272  7745 leader_election.cc:336] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 2.038s (SENT)
I20260709 14:52:21.668898  7745 leader_election.cc:304] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:21.671813  7777 raft_consensus.cc:1275] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 14:52:21.652113 11768 leader_election.cc:290] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:21.665002 11794 raft_consensus.cc:493] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:21.682945 11775 raft_consensus.cc:2749] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 14:52:21.683151  7745 leader_election.cc:336] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 2.115s (SENT)
I20260709 14:52:21.688500  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:21.696038  7745 leader_election.cc:304] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:21.703402  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:21.705567  7847 raft_consensus.cc:515] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:21.697183  7852 raft_consensus.cc:2468] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 11.
I20260709 14:52:21.714285  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:21.713804  7851 raft_consensus.cc:2468] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 12.
I20260709 14:52:21.715359  7770 raft_consensus.cc:2393] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 11: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
W20260709 14:52:21.685591 11798 log.cc:927] Time spent T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.064s	user 0.002s	sys 0.000s
I20260709 14:52:21.713835  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:21.718523  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:21.720439  7920 raft_consensus.cc:2410] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 14:52:21.721069  7924 raft_consensus.cc:1240] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 11. Current term is 12. Ops: []
I20260709 14:52:21.721694  7847 leader_election.cc:290] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 12 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:21.683715 11794 raft_consensus.cc:515] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:21.723806  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:21.724476  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:21.725143  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:21.727577  7923 raft_consensus.cc:1240] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 11. Current term is 12. Ops: []
I20260709 14:52:21.729902  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:21.731109  7926 raft_consensus.cc:2410] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 14:52:21.732084 11794 leader_election.cc:290] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:21.721640 11791 raft_consensus.cc:2749] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 14:52:21.730034  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:21.734608  7921 raft_consensus.cc:2410] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 14:52:21.683633 11786 raft_consensus.cc:493] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:21.732797  7926 raft_consensus.cc:1240] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 LEADER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 11. Current term is 12. Ops: []
I20260709 14:52:21.740614  7927 raft_consensus.cc:2368] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 11. Current term is 12.
I20260709 14:52:21.749064  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:21.749851  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:52:21.750444  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 67345.1us
I20260709 14:52:21.750931  7854 raft_consensus.cc:2468] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 14.
I20260709 14:52:21.754673  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:21.755507  7854 raft_consensus.cc:3060] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:52:21.757208  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:21.753391  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:21.760666  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:21.763633  7770 raft_consensus.cc:2468] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 13.
I20260709 14:52:21.768453  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:21.780079  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:21.781273  7772 raft_consensus.cc:2468] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 9.
I20260709 14:52:21.782821  7852 raft_consensus.cc:1240] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 11. Current term is 12. Ops: []
I20260709 14:52:21.783759  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:21.784912  7853 raft_consensus.cc:1275] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 14:52:21.787192  7853 raft_consensus.cc:1275] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 14:52:21.787487  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c563cc7cfbe4d59be4ffc5cf847ce56" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:21.791100  7894 leader_election.cc:304] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:21.750216 11786 raft_consensus.cc:515] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:21.805712 11786 leader_election.cc:290] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:21.806054  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258d6c2dda954bf5b65930fde8ecb9f3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:21.813951  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:21.827081  7772 raft_consensus.cc:3060] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Advancing to term 12
I20260709 14:52:21.814956  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:21.815780  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:21.817399  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:21.818321  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:21.819368  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:21.828413  7778 raft_consensus.cc:2468] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 10.
I20260709 14:52:21.821033  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
W20260709 14:52:21.825021  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:21.826224  7771 raft_consensus.cc:2468] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 9.
I20260709 14:52:21.828766  7775 raft_consensus.cc:2468] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 14.
I20260709 14:52:21.839193  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
W20260709 14:52:21.840901  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 43732.6us
I20260709 14:52:21.841826  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:21.844959  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:21.845909  7776 raft_consensus.cc:2468] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 12.
I20260709 14:52:21.846905  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:21.847486  7776 raft_consensus.cc:2468] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 11.
I20260709 14:52:21.848658  7773 raft_consensus.cc:2468] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 11.
I20260709 14:52:21.839046  7922 raft_consensus.cc:2468] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 13.
I20260709 14:52:21.852119  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:21.853598  7745 leader_election.cc:304] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:21.853682  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:21.852293  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:21.853863  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:21.855512  7745 leader_election.cc:304] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:21.858007  7925 raft_consensus.cc:2468] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 9.
I20260709 14:52:21.858204  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:21.859655  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:21.861534  7919 raft_consensus.cc:1240] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 14. Current term is 15. Ops: []
I20260709 14:52:21.864014  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:21.865142  7775 raft_consensus.cc:2410] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 14:52:21.866772  7745 leader_election.cc:304] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:21.868400  7776 raft_consensus.cc:1240] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 LEADER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 9. Current term is 10. Ops: []
I20260709 14:52:21.871024  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
W20260709 14:52:21.868381  8598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 48306.7us
I20260709 14:52:21.872166  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:21.874784  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:21.876878  7778 raft_consensus.cc:2393] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 11: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:52:21.877756  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:21.878938  7773 raft_consensus.cc:2393] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 12: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:52:21.879629  7745 leader_election.cc:304] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:21.881661  7775 raft_consensus.cc:1240] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 9. Current term is 11. Ops: []
I20260709 14:52:21.890372 11786 raft_consensus.cc:2749] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 14:52:21.893929 11754 raft_consensus.cc:2749] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 14:52:21.897881  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:21.860952 11794 consensus_queue.cc:1048] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 14:52:21.899266  7771 raft_consensus.cc:2410] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 14:52:21.899533 11794 consensus_queue.cc:1243] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer 3876b8ee8d744cb18e91d97aae93b1ac log is divergent from this leader: its last log entry 10.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 14:52:21.876263 11775 raft_consensus.cc:2749] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 14:52:21.885548  7928 raft_consensus.cc:1240] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 14:52:21.852999 11747 raft_consensus.cc:2804] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 14:52:21.912456  7819 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:21.910249  7745 leader_election.cc:304] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:21.911592  7776 raft_consensus.cc:2393] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 14: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:52:21.849449 11784 raft_consensus.cc:493] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:21.912235  7854 raft_consensus.cc:2468] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 10.
I20260709 14:52:21.864955 11791 raft_consensus.cc:2804] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 14:52:21.921772  7773 raft_consensus.cc:1240] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 9. Current term is 10. Ops: []
I20260709 14:52:21.916970  7745 leader_election.cc:304] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
W20260709 14:52:21.917397  7742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:21.923385  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
W20260709 14:52:21.925036  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 62167.9us
I20260709 14:52:21.930055  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:21.931200  7778 raft_consensus.cc:3060] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:52:21.934739  7775 raft_consensus.cc:1240] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 11. Current term is 12. Ops: []
I20260709 14:52:21.941414  7774 raft_consensus.cc:2468] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 11.
I20260709 14:52:21.942067  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:21.938616  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:21.945577  7776 raft_consensus.cc:1240] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 11. Current term is 12. Ops: []
I20260709 14:52:21.945950  7771 raft_consensus.cc:2393] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 8: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
W20260709 14:52:21.946571  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:21.949671  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:21.950649  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:21.951134  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:21.951462  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:21.952215  7779 raft_consensus.cc:3060] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:52:21.952332  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:21.954293  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:21.914709 11747 raft_consensus.cc:493] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:21.948561  7894 leader_election.cc:304] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
W20260709 14:52:21.918063 11799 log.cc:927] Time spent T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 14:52:21.956004  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:21.958058  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:21.958201  7775 raft_consensus.cc:2393] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 13: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:52:21.959053  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:21.959621  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:21.960271  7921 raft_consensus.cc:2393] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 13: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:52:21.961069  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:21.954667  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:21.950762  7771 raft_consensus.cc:2393] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 9: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:52:21.956234  7927 raft_consensus.cc:2393] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 12: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:52:21.963174  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:21.963827  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: true dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:21.964906  7920 raft_consensus.cc:2376] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 13. Re-sending same reply.
I20260709 14:52:21.922353 11791 raft_consensus.cc:493] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:21.966589 11791 raft_consensus.cc:3060] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:52:21.921847 11781 raft_consensus.cc:2804] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 14:52:21.970259  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:21.971122  7926 raft_consensus.cc:2468] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 13.
I20260709 14:52:21.972246  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:21.957890 11794 raft_consensus.cc:2804] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader election won for term 11
I20260709 14:52:21.973549 11794 raft_consensus.cc:697] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:52:21.974974 11794 consensus_queue.cc:237] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:21.964109  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:21.969570  7928 raft_consensus.cc:1240] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 9. Current term is 10. Ops: []
I20260709 14:52:21.960692 11747 raft_consensus.cc:3060] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 14:52:21.980378  7924 raft_consensus.cc:2393] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 9: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:52:21.979979  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:21.984925  7773 raft_consensus.cc:2410] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 14:52:21.973624  7926 raft_consensus.cc:2393] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 12: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:52:21.970312  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
W20260709 14:52:21.980540  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 63673.7us
W20260709 14:52:21.955037 11800 log.cc:927] Time spent T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 14:52:21.966264  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:21.927639 11784 raft_consensus.cc:515] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:21.999184  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:21.987020  7775 raft_consensus.cc:2410] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 14:52:21.983580  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:21.988288  7745 leader_election.cc:304] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:21.988070  7894 leader_election.cc:304] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:22.000418  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:21.996045  7925 raft_consensus.cc:2468] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 14.
I20260709 14:52:21.922828 11317 consensus_queue.cc:1048] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.061s
I20260709 14:52:22.002851  7771 raft_consensus.cc:2393] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 11: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:52:22.004223  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c563cc7cfbe4d59be4ffc5cf847ce56" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:21.999747 11119 raft_consensus.cc:2804] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 14:52:22.008083  7745 leader_election.cc:304] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:22.008893 11786 raft_consensus.cc:2804] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 14:52:22.011966  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 52137.5us
I20260709 14:52:22.012614  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
W20260709 14:52:22.018424  7819 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:22.013967  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:22.019016  7894 leader_election.cc:304] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:22.016010  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:21.978717 11781 raft_consensus.cc:493] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:22.023638  7778 raft_consensus.cc:2410] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 14:52:22.024571  7775 raft_consensus.cc:2468] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 13.
I20260709 14:52:22.025846  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:22.027374 11739 raft_consensus.cc:2804] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 14:52:22.027922 11739 raft_consensus.cc:493] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:22.028295 11739 raft_consensus.cc:3060] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:52:22.016690 11119 raft_consensus.cc:493] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:22.029944 11119 raft_consensus.cc:3060] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:52:22.018895 11786 raft_consensus.cc:493] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:22.030777 11786 raft_consensus.cc:3060] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Advancing to term 13
I20260709 14:52:22.031248 11781 raft_consensus.cc:3060] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:52:22.035457  7778 raft_consensus.cc:2410] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 14:52:22.035004  7745 leader_election.cc:304] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:22.035699  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:22.036517  7773 raft_consensus.cc:2368] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 10. Current term is 11.
I20260709 14:52:22.036808  7745 leader_election.cc:304] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:22.040473  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:22.041141  7894 leader_election.cc:304] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:22.051275  7777 raft_consensus.cc:1240] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 14. Current term is 15. Ops: []
I20260709 14:52:22.061611  7745 leader_election.cc:304] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:22.064838  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18d29d52d304c87b930d4fb5eaf50b1" candidate_uuid: "9418391fa82a42c79c6cad13ba91d964" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:22.065982  7773 raft_consensus.cc:3060] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Advancing to term 7
I20260709 14:52:22.065949  7745 leader_election.cc:304] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 9418391fa82a42c79c6cad13ba91d964
I20260709 14:52:22.065521  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: true dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:22.069043  7777 raft_consensus.cc:3060] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:52:22.048380 11764 raft_consensus.cc:2749] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 14:52:22.048162 11754 raft_consensus.cc:2804] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader election won for term 13
I20260709 14:52:22.051364 11775 raft_consensus.cc:2749] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 14:52:22.061203  7894 leader_election.cc:304] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:22.054857 11782 raft_consensus.cc:2804] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 14:52:22.058663 11701 raft_consensus.cc:2804] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 14:52:22.081530  7770 raft_consensus.cc:1275] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 14:52:22.070097 11577 raft_consensus.cc:2749] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 14:52:22.093695  7771 raft_consensus.cc:1275] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 14:52:22.101632  7773 raft_consensus.cc:2468] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9418391fa82a42c79c6cad13ba91d964 in term 7.
I20260709 14:52:22.104722  7819 leader_election.cc:304] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:22.108353 11757 raft_consensus.cc:2764] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 14:52:22.109613 11757 consensus_queue.cc:1059] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 14:52:22.113132  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 47266.2us
I20260709 14:52:22.114333  7745 leader_election.cc:304] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:22.119727  7745 leader_election.cc:304] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:22.086477 11782 raft_consensus.cc:493] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:22.130679  7777 raft_consensus.cc:2468] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 12.
I20260709 14:52:22.086165 11701 raft_consensus.cc:493] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:22.094372 11754 raft_consensus.cc:697] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:52:22.142544 11701 raft_consensus.cc:3060] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:52:22.145581 11756 raft_consensus.cc:3055] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 LEADER]: Stepping down as leader of term 11
I20260709 14:52:22.146222 11756 raft_consensus.cc:740] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:52:22.147396 11756 consensus_queue.cc:260] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:22.134100 11764 raft_consensus.cc:2804] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 14:52:22.151506 11764 raft_consensus.cc:493] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:22.151932 11764 raft_consensus.cc:3060] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:52:22.146251  7745 leader_election.cc:304] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:22.153450 11775 raft_consensus.cc:2804] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 14:52:22.154066 11775 raft_consensus.cc:493] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:22.154444 11775 raft_consensus.cc:3060] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:52:22.158578  7745 leader_election.cc:304] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:22.160084 11794 raft_consensus.cc:2749] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 14:52:22.160631  7745 leader_election.cc:304] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:22.145737 11577 raft_consensus.cc:2749] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 14:52:22.137306 11782 raft_consensus.cc:3060] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:52:22.103682 11778 raft_consensus.cc:2764] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader election decision vote started in defunct term 6: won
W20260709 14:52:22.179831  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 107992us
W20260709 14:52:22.197609  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:22.207968  7893 leader_election.cc:304] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:22.123627 11580 raft_consensus.cc:2804] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 14:52:22.246367  7893 leader_election.cc:304] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:22.207676 11577 raft_consensus.cc:2749] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 14:52:22.249161  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 88634.7us
W20260709 14:52:22.251075  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 143928us
I20260709 14:52:22.252664  7745 leader_election.cc:304] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:22.221891 11699 raft_consensus.cc:2804] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 14:52:22.276058  7772 raft_consensus.cc:2468] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 12.
W20260709 14:52:22.281843  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 232989us
I20260709 14:52:22.244699 11580 raft_consensus.cc:697] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:22.292879 11754 consensus_queue.cc:237] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:22.299511  7779 raft_consensus.cc:2410] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 14:52:22.300647 11701 raft_consensus.cc:515] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:22.302053  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 49504us
I20260709 14:52:22.287808 11378 raft_consensus.cc:2804] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 14:52:22.308962  8598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 214603us
I20260709 14:52:22.313160  7779 raft_consensus.cc:1275] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Refusing update from remote peer 9418391fa82a42c79c6cad13ba91d964: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 14:52:22.317127 11819 raft_consensus.cc:493] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:52:22.317548  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 60327.5us
I20260709 14:52:22.318480  7894 leader_election.cc:304] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:22.318818 11699 raft_consensus.cc:697] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:22.319777 11819 raft_consensus.cc:515] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:22.319895 11699 consensus_queue.cc:237] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:22.322240 11819 leader_election.cc:290] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:22.323161 11787 raft_consensus.cc:2804] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 14:52:22.323593 11787 raft_consensus.cc:493] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:22.323967 11787 raft_consensus.cc:3060] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 14:52:22.325947 11816 consensus_queue.cc:1059] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 14:52:22.326296 11768 consensus_queue.cc:1048] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 14:52:22.327597 11816 consensus_queue.cc:1048] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 14:52:22.328375 11768 raft_consensus.cc:3055] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 14:52:22.328805 11768 raft_consensus.cc:740] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:22.329341 11784 leader_election.cc:290] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:22.324957  7894 leader_election.cc:304] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:22.330494 11809 raft_consensus.cc:2804] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 14:52:22.331028 11809 raft_consensus.cc:697] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:22.331890 11809 consensus_queue.cc:237] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:22.335841 11756 raft_consensus.cc:3060] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:52:22.336619 11768 consensus_queue.cc:260] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:22.338296 11747 raft_consensus.cc:515] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:22.324093 11580 consensus_queue.cc:237] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:22.340868  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 48933.8us
I20260709 14:52:22.348495  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:22.349349  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:22.318404  7893 leader_election.cc:304] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:22.342062  7745 leader_election.cc:304] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:22.349764  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:22.343660  7927 raft_consensus.cc:2468] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 8.
I20260709 14:52:22.301903 11794 raft_consensus.cc:2749] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 14:52:22.352358  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:22.353559  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:22.354303  7849 raft_consensus.cc:2468] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 13.
I20260709 14:52:22.356678  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
W20260709 14:52:22.365097  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 46799.8us
I20260709 14:52:22.364411  7849 raft_consensus.cc:2393] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 11: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:52:22.373731  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
W20260709 14:52:22.375329  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:22.377085  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c563cc7cfbe4d59be4ffc5cf847ce56" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:22.379416  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:22.380398  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:22.386654  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:22.347172 11378 raft_consensus.cc:697] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:22.392499  7850 raft_consensus.cc:2393] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 11: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:52:22.310191 11764 raft_consensus.cc:515] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:22.410986  7853 raft_consensus.cc:3055] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 LEADER]: Stepping down as leader of term 11
I20260709 14:52:22.363345 11784 raft_consensus.cc:2749] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 14:52:22.412004  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 103489us
I20260709 14:52:22.416448  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:22.416687  7745 leader_election.cc:304] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:22.417435  7850 raft_consensus.cc:2393] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 13: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:52:22.411574  7853 raft_consensus.cc:740] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:52:22.419087  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:22.385403 11768 raft_consensus.cc:3060] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:52:22.329222 11739 raft_consensus.cc:515] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:22.426985  7851 raft_consensus.cc:1275] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 14:52:22.428203  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:22.429076  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: true dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:22.433971 11701 leader_election.cc:290] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:22.434628 11764 leader_election.cc:290] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:52:22.435794 11814 log.cc:927] Time spent T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
I20260709 14:52:22.435607 11764 consensus_queue.cc:1048] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 14:52:22.357957 11781 raft_consensus.cc:515] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:22.437179  7673 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51352 (request call id 121) took 1824 ms. Trace:
I20260709 14:52:22.431226  7853 consensus_queue.cc:260] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:22.412236 11168 raft_consensus.cc:2804] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 14:52:22.381910 11119 raft_consensus.cc:515] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:22.419754 11577 raft_consensus.cc:2749] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 14:52:22.450917  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:22.460361  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:22.465104  7853 raft_consensus.cc:3060] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:52:22.473693  6549 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 14:52:22.447576 11784 raft_consensus.cc:493] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:22.498782  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:22.499024  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
W20260709 14:52:22.500200  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 94125.7us
I20260709 14:52:22.507503  7848 raft_consensus.cc:2393] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 9: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:52:22.508903  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:22.510123  7848 raft_consensus.cc:2393] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 14: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:52:22.511241  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:22.442387  7673 rpcz_store.cc:276] 0709 14:52:20.607615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:20.617459 (+  9844us) service_pool.cc:224] Handling call
0709 14:52:22.421964 (+1804505us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 14:52:21.196561 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 14:52:21.197674 (+  1113us) write_op.cc:432] Acquiring schema lock in shared mode
0709 14:52:21.197835 (+   161us) write_op.cc:435] Acquired schema lock
0709 14:52:21.197862 (+    27us) tablet.cc:662] Decoding operations
0709 14:52:21.198606 (+   744us) write_op.cc:620] Acquiring the partition lock for write op
0709 14:52:21.198739 (+   133us) write_op.cc:641] Partition lock acquired for write op
0709 14:52:21.198775 (+    36us) tablet.cc:685] Acquiring locks for 1 operations
0709 14:52:21.262211 (+ 63436us) tablet.cc:701] Row locks acquired
0709 14:52:21.282611 (+ 20400us) write_op.cc:260] PREPARE: finished
0709 14:52:21.299625 (+ 17014us) write_op.cc:270] Start()
0709 14:52:21.299805 (+   180us) write_op.cc:276] Timestamp: P: 1783608741299512 usec, L: 0
0709 14:52:21.299828 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 14:52:21.300847 (+  1019us) log.cc:844] Serialized 533 byte log entry
0709 14:52:21.574019 (+273172us) spinlock_profiling.cc:243] Waited 3.55 ms on lock 0x7b4400022b4c. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb687c29db1 00007fb687cc7c85 00007fb687cc86a2 00007fb68aa3a1db 00007fb68aa35aaf 00007fb68aa2986e 00007fb68aa28bb6 00007fb68aa287d8 00007fb68aa32221 00007fb68aa321d9 00007fb68aa32169
0709 14:52:22.155562 (+581543us) spinlock_profiling.cc:243] Waited 26.9 ms on lock 0x7b5400349f20. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae0c343 00007fb68ae0fd75 00007fb68ae0fd09 00007fb68ae0fc99 00007fb68ae0fc61 00007fb68ae0ef5d 0000000000396ad4 0000000000396919 00007fb687da1475 00007fb687da37c1
0709 14:52:22.156106 (+   544us) op_driver.cc:464] REPLICATION: finished
0709 14:52:22.330303 (+174197us) write_op.cc:301] APPLY: starting
0709 14:52:22.330403 (+   100us) tablet.cc:1367] starting BulkCheckPresence
0709 14:52:22.331604 (+  1201us) tablet.cc:1370] finished BulkCheckPresence
0709 14:52:22.331630 (+    26us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 14:52:22.332325 (+   695us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 14:52:22.332534 (+   209us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 14:52:22.332598 (+    64us) write_op.cc:312] APPLY: finished
0709 14:52:22.332804 (+   206us) log.cc:844] Serialized 25 byte log entry
0709 14:52:22.332997 (+   193us) write_op.cc:489] Releasing partition, row and schema locks
0709 14:52:22.333082 (+    85us) write_op.cc:454] Released schema lock
0709 14:52:22.333125 (+    43us) write_op.cc:341] FINISH: Updating metrics
0709 14:52:22.385549 (+ 52424us) write_op.cc:489] Releasing partition, row and schema locks
0709 14:52:22.390592 (+  5043us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":61012,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":173836,"apply.run_cpu_time_us":3453,"apply.run_wall_time_us":24934,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8295,"num_ops":1,"prepare.queue_time_us":408897,"prepare.run_cpu_time_us":49678,"prepare.run_wall_time_us":241171,"raft.queue_time_us":697360,"raft.run_cpu_time_us":27782,"raft.run_wall_time_us":568203,"replication_time_us":855991,"spinlock_wait_cycles":69923584,"thread_start_us":565041,"threads_started":4,"wal-append.queue_time_us":161330}]]}
I20260709 14:52:22.455394 11746 raft_consensus.cc:493] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9418391fa82a42c79c6cad13ba91d964)
I20260709 14:52:22.519959  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:22.442126 11786 raft_consensus.cc:515] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:22.536966  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:22.449642 11815 consensus_queue.cc:1048] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.071s
I20260709 14:52:22.520077  7845 raft_consensus.cc:2393] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 8: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
W20260709 14:52:22.547684  7742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:22.548378  7846 raft_consensus.cc:1275] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Refusing update from remote peer 9418391fa82a42c79c6cad13ba91d964: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 14:52:22.490272 11791 consensus_meta.cc:287] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent flushing consensus metadata: real 0.523s	user 0.018s	sys 0.004s
W20260709 14:52:22.551343  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 122118us
I20260709 14:52:22.551357  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:22.447153 11782 raft_consensus.cc:515] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:22.554639  7893 leader_election.cc:304] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:22.477207 11775 raft_consensus.cc:515] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:22.560189  7778 raft_consensus.cc:1240] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 12. Current term is 13. Ops: []
I20260709 14:52:22.523236 11168 raft_consensus.cc:697] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:22.566977  7846 raft_consensus.cc:1240] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 14:52:22.515431 11807 consensus_queue.cc:1048] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.072s
I20260709 14:52:22.570421  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:52:22.572582  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:22.573344  7847 pending_rounds.cc:85] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting all ops after (but not including) 6
I20260709 14:52:22.573975  7847 pending_rounds.cc:107] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 14:52:22.574333  7847 raft_consensus.cc:2889] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:52:22.519304 11784 raft_consensus.cc:515] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:22.577819  7777 raft_consensus.cc:1240] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 11. Current term is 12. Ops: []
I20260709 14:52:22.547111 11746 raft_consensus.cc:515] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:52:22.567037 11816 raft_consensus.cc:2749] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 14:52:22.586627  7776 raft_consensus.cc:1240] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 8. Current term is 9. Ops: []
I20260709 14:52:22.588043  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:22.584004  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:22.571765 11445 consensus_queue.cc:1048] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 14:52:22.523666 11378 consensus_queue.cc:237] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:22.605875  7848 raft_consensus.cc:1217] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Deduplicated request from leader. Original: 9.5->[10.6-10.6]   Dedup: 10.6->[]
I20260709 14:52:22.608065  7848 raft_consensus.cc:1240] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 14:52:22.594658 11119 leader_election.cc:290] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 11 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:22.610760  7776 raft_consensus.cc:1240] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 11. Current term is 12. Ops: []
I20260709 14:52:22.601127  8639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9441e831627143a991a1556dcdce71e3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9418391fa82a42c79c6cad13ba91d964" is_pre_election: true
I20260709 14:52:22.593782 11746 leader_election.cc:290] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68:42321)
W20260709 14:52:22.613811 11824 log.cc:927] Time spent T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.158s	user 0.001s	sys 0.000s
I20260709 14:52:22.574623 11747 leader_election.cc:290] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:22.618916  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
W20260709 14:52:22.622797  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 59154.8us
I20260709 14:52:22.627663  7745 leader_election.cc:304] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:22.631807 11168 consensus_queue.cc:237] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:22.634078 11739 leader_election.cc:290] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:22.590164 11818 consensus_queue.cc:1048] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 14:52:22.557933 11791 raft_consensus.cc:515] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:22.639007 11791 leader_election.cc:290] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:22.639596 11782 leader_election.cc:290] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:22.647374 11781 leader_election.cc:290] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:22.599282 11775 leader_election.cc:290] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 12 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:52:22.649864  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:22.679407  7853 raft_consensus.cc:1275] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 14:52:22.680269  7853 pending_rounds.cc:85] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting all ops after (but not including) 6
I20260709 14:52:22.680593  7853 pending_rounds.cc:107] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 14:52:22.681015  7853 raft_consensus.cc:2889] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:52:22.673409  7819 leader_election.cc:304] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:22.663463  7745 leader_election.cc:304] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:22.691440  7922 raft_consensus.cc:2468] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 12.
I20260709 14:52:22.691681  7745 leader_election.cc:304] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:22.696455  7893 leader_election.cc:304] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:22.704694  7745 leader_election.cc:304] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:22.673581 11794 raft_consensus.cc:2749] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 14:52:22.716288  7745 leader_election.cc:304] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:22.724479  7745 leader_election.cc:304] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:22.727319  7745 leader_election.cc:304] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:22.714527 11775 raft_consensus.cc:2749] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 14:52:22.734822  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 61568.4us
I20260709 14:52:22.733314  7673 catalog_manager.cc:5697] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "9418391fa82a42c79c6cad13ba91d964" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 14:52:22.738433  7819 leader_election.cc:304] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:22.721027 11768 raft_consensus.cc:2749] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 14:52:22.719233 11577 raft_consensus.cc:2749] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 14:52:22.716425 11781 raft_consensus.cc:2749] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 14:52:22.694084 11787 raft_consensus.cc:515] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:22.744251  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 87734.2us
I20260709 14:52:22.728039 11757 raft_consensus.cc:2804] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 14:52:22.728627 11754 raft_consensus.cc:2749] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 14:52:22.731642 11778 raft_consensus.cc:2749] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 14:52:22.761310  7819 leader_election.cc:304] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:22.756695 11756 raft_consensus.cc:2804] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 14:52:22.779500  7744 leader_election.cc:304] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:22.784709 11819 raft_consensus.cc:2749] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 14:52:22.756160 11757 raft_consensus.cc:493] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:22.790372  7744 leader_election.cc:304] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:22.750985 11794 consensus_queue.cc:1059] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 14:52:22.783797 11756 raft_consensus.cc:493] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:22.800915  7744 leader_election.cc:304] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:22.796845  7819 leader_election.cc:304] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:22.795691 11757 raft_consensus.cc:3060] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Advancing to term 13
I20260709 14:52:22.794457 11775 raft_consensus.cc:2749] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 14:52:22.782114 11701 consensus_queue.cc:1048] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 14:52:22.821874  7744 leader_election.cc:304] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:22.827699  7744 leader_election.cc:304] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:22.814186 11756 raft_consensus.cc:3060] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:52:22.826464 11577 raft_consensus.cc:2749] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 14:52:22.830402 11787 leader_election.cc:290] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 15 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:22.815234 11754 raft_consensus.cc:2749] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 14:52:22.810937 11815 raft_consensus.cc:493] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:22.836256 11815 raft_consensus.cc:515] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:22.837852 11843 log.cc:927] Time spent T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 14:52:22.818724 11784 leader_election.cc:290] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:22.869493 11577 raft_consensus.cc:2749] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 14:52:22.870437 11815 leader_election.cc:290] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:22.871150  7744 leader_election.cc:304] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:22.796365 11817 consensus_queue.cc:1059] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 14:52:22.824770 11842 raft_consensus.cc:2749] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 14:52:22.834589  7819 leader_election.cc:304] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
W20260709 14:52:22.883147  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 48666.5us
I20260709 14:52:22.884025  7819 leader_election.cc:304] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:22.778406 11837 consensus_queue.cc:1048] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 14:52:22.886405  7819 leader_election.cc:304] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
W20260709 14:52:22.872144  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 60518.8us
I20260709 14:52:22.869351 11794 raft_consensus.cc:2749] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 14:52:22.885676 11842 raft_consensus.cc:2749] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 14:52:22.895049  7744 leader_election.cc:304] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:22.897948 11775 raft_consensus.cc:2749] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 14:52:22.889176 11819 raft_consensus.cc:2749] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 14:52:22.902524 11778 raft_consensus.cc:3055] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 LEADER]: Stepping down as leader of term 9
I20260709 14:52:22.903117 11778 raft_consensus.cc:740] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:52:22.907184 11786 leader_election.cc:290] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:22.908156  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:22.891793 11784 raft_consensus.cc:2749] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 14:52:22.912092 11580 consensus_queue.cc:1048] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 14:52:22.915446 11842 raft_consensus.cc:2749] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 14:52:22.904433 11778 consensus_queue.cc:260] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:22.922773  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:22.923105  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:22.925984  7744 leader_election.cc:304] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:22.927537  7923 raft_consensus.cc:1240] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 11. Current term is 12. Ops: []
I20260709 14:52:22.928159  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783e4874513449ef9084b833f188a6d3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:22.934470  7744 leader_election.cc:304] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:22.935968  7744 leader_election.cc:304] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:22.938560  7744 leader_election.cc:304] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:22.942862  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:22.947769  7744 leader_election.cc:304] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:22.952203  7744 leader_election.cc:304] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:52:22.946338 11839 log.cc:927] Time spent T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.123s	user 0.005s	sys 0.000s
I20260709 14:52:22.960371 11746 consensus_queue.cc:1059] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 14:52:22.961134 11831 raft_consensus.cc:2804] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader election won for term 8
I20260709 14:52:22.961531 11746 raft_consensus.cc:3055] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 LEADER]: Stepping down as leader of term 11
I20260709 14:52:22.962253 11746 raft_consensus.cc:740] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:52:22.962884 11580 consensus_queue.cc:1048] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 14:52:22.963248 11746 consensus_queue.cc:260] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:22.964764 11746 raft_consensus.cc:3060] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:52:22.951897 11794 raft_consensus.cc:2804] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader election won for term 14
I20260709 14:52:22.964982 11815 raft_consensus.cc:3055] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 14:52:22.943986 11791 raft_consensus.cc:2749] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 14:52:22.967367 11815 raft_consensus.cc:740] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:22.948992 11784 raft_consensus.cc:2749] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 14:52:22.930666 11577 consensus_queue.cc:1059] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 14:52:22.968410 11815 consensus_queue.cc:260] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:22.970600 11815 raft_consensus.cc:3060] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 14:52:22.951712 11775 raft_consensus.cc:2749] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 14:52:22.961777 11831 raft_consensus.cc:697] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:52:22.945585 11786 raft_consensus.cc:2749] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 14:52:22.952796 11756 raft_consensus.cc:515] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:22.972750 11831 consensus_queue.cc:237] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:22.975147 11756 leader_election.cc:290] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 12 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:52:22.977011  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:22.979677 11794 raft_consensus.cc:697] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:52:22.980844 11794 consensus_queue.cc:237] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:22.989368 11845 log.cc:927] Time spent T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
W20260709 14:52:22.992605  7744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:23.001976  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:23.002300  7778 raft_consensus.cc:1275] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 14:52:23.003763  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:23.004287  7778 raft_consensus.cc:1275] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 14:52:23.004384  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:23.004505  7848 raft_consensus.cc:3060] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Advancing to term 14
I20260709 14:52:23.006531  7849 raft_consensus.cc:1275] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 14:52:23.030592  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 145333us
I20260709 14:52:23.032500  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:23.032631  7819 leader_election.cc:304] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:23.035313 11756 raft_consensus.cc:2749] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 14:52:23.037061  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:23.037930  7772 raft_consensus.cc:3060] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Advancing to term 14
I20260709 14:52:23.038393  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:23.039412  7852 raft_consensus.cc:3060] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:52:23.040808  7819 leader_election.cc:304] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:23.045311  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:23.046186  7774 raft_consensus.cc:3060] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:52:23.006232 11784 raft_consensus.cc:493] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:23.048617  7771 raft_consensus.cc:1240] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 11. Current term is 12. Ops: []
I20260709 14:52:23.050014  7778 raft_consensus.cc:1275] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 14:52:23.052667  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258d6c2dda954bf5b65930fde8ecb9f3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:22.992475  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:23.055346  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:23.067605  7853 raft_consensus.cc:3060] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:52:23.070429  7771 raft_consensus.cc:1240] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 14:52:23.072563  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:23.073611  7771 raft_consensus.cc:3060] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:52:23.079506  7847 raft_consensus.cc:3060] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:52:23.080174  7772 raft_consensus.cc:2468] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 14.
I20260709 14:52:23.082018  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:23.082911  7772 raft_consensus.cc:3060] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Advancing to term 15
I20260709 14:52:23.070421  7819 leader_election.cc:304] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
W20260709 14:52:23.086333  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:23.086637 11756 raft_consensus.cc:2749] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 14:52:23.087608 11756 raft_consensus.cc:2749] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 14:52:23.089123 11699 consensus_queue.cc:1048] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 14:52:23.090179 11837 consensus_queue.cc:1048] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 14:52:23.092195 11699 consensus_queue.cc:1059] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 14:52:23.092487 11837 consensus_queue.cc:1048] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 14:52:23.093508 11811 raft_consensus.cc:3055] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 14:52:23.094483 11811 raft_consensus.cc:740] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:23.093497 11833 consensus_queue.cc:1059] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 14:52:23.094759 11794 raft_consensus.cc:493] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:23.059135  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258d6c2dda954bf5b65930fde8ecb9f3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:23.096423  7849 raft_consensus.cc:3060] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:52:23.100021  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:23.100835  7854 raft_consensus.cc:3060] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Advancing to term 15
I20260709 14:52:23.105945  7893 leader_election.cc:304] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:52:23.106892  7927 raft_consensus.cc:1275] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 14:52:23.107300  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:23.108172  7770 raft_consensus.cc:2468] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 9.
I20260709 14:52:23.096012  7778 raft_consensus.cc:3060] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Advancing to term 10
W20260709 14:52:23.118364  7742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:23.095443 11833 raft_consensus.cc:3055] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 14:52:23.119445 11833 raft_consensus.cc:740] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:23.120436 11833 consensus_queue.cc:260] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:23.122114 11833 raft_consensus.cc:3060] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:52:23.095824 11794 raft_consensus.cc:515] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:23.095484  7819 leader_election.cc:304] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:22.957653 11757 raft_consensus.cc:515] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:23.146317  7852 raft_consensus.cc:2468] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 11.
I20260709 14:52:23.163895  7848 raft_consensus.cc:2468] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 14.
I20260709 14:52:23.166167  7854 raft_consensus.cc:2468] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 15.
I20260709 14:52:23.167554  7853 raft_consensus.cc:2468] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 12.
I20260709 14:52:23.173895  7774 raft_consensus.cc:2468] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 11.
I20260709 14:52:23.108033 11775 raft_consensus.cc:493] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:23.174603  7772 raft_consensus.cc:2468] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 15.
I20260709 14:52:23.134259 11779 raft_consensus.cc:2804] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 14:52:23.195894  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:52:23.198616  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 103236us
I20260709 14:52:23.176244  7847 raft_consensus.cc:2468] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 12.
I20260709 14:52:23.061987 11784 raft_consensus.cc:515] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:23.213461  7778 raft_consensus.cc:2468] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 10.
I20260709 14:52:23.229161  7819 leader_election.cc:304] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:23.234411  7849 raft_consensus.cc:2468] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 10.
I20260709 14:52:23.251603  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:23.253382  7922 raft_consensus.cc:1240] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 8. Current term is 9. Ops: []
I20260709 14:52:23.253619  7927 raft_consensus.cc:1240] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 LEADER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 9. Current term is 10. Ops: []
I20260709 14:52:23.170284 11577 consensus_queue.cc:1048] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.058s
I20260709 14:52:23.125604 11811 consensus_queue.cc:260] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:23.281790  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 52760.8us
I20260709 14:52:23.201722 11775 raft_consensus.cc:515] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:23.286274  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:23.300108  7771 raft_consensus.cc:2468] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 12.
I20260709 14:52:23.301429 11848 consensus_queue.cc:1059] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.074s
I20260709 14:52:23.311811  7847 raft_consensus.cc:1240] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 12. Current term is 13. Ops: []
I20260709 14:52:23.314587 11847 raft_consensus.cc:2749] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 14:52:23.238422 11756 consensus_queue.cc:1059] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.055s
I20260709 14:52:23.281561 11819 raft_consensus.cc:2749] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 14:52:23.347143  7743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:23.289130 11791 raft_consensus.cc:493] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
W20260709 14:52:23.314986 11812 log.cc:927] Time spent T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
W20260709 14:52:23.367559  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 48276.1us
I20260709 14:52:23.369017  7819 leader_election.cc:304] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:23.314733 11757 leader_election.cc:290] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:52:23.386391  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 205256us
I20260709 14:52:23.387552  7893 leader_election.cc:304] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:52:23.318740 11817 consensus_queue.cc:1048] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.065s
I20260709 14:52:23.403633  7893 leader_election.cc:304] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:52:23.366016 11764 raft_consensus.cc:493] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:23.374946 11848 raft_consensus.cc:3055] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 LEADER]: Stepping down as leader of term 11
I20260709 14:52:23.307483 11842 consensus_queue.cc:1059] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.080s
I20260709 14:52:23.434928  7848 raft_consensus.cc:1275] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 14:52:23.435112  7893 leader_election.cc:304] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:52:23.441910  7819 leader_election.cc:400] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 10 pre-election: Vote denied by peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587) with higher term. Message: Invalid argument: T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 10. Current term is 11.
I20260709 14:52:23.416664 11764 raft_consensus.cc:515] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:23.449616 11784 leader_election.cc:290] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:23.466073  7848 raft_consensus.cc:3055] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 LEADER]: Stepping down as leader of term 14
I20260709 14:52:23.467922  7848 raft_consensus.cc:740] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:52:23.373481 11791 raft_consensus.cc:515] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:23.414625 11848 raft_consensus.cc:740] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:52:23.454464  7819 leader_election.cc:403] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 14:52:23.416587 11168 raft_consensus.cc:2804] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 14:52:23.409984 11756 raft_consensus.cc:2749] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 14:52:23.462132  7893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:23.486722  7894 leader_election.cc:304] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:23.469169  7848 consensus_queue.cc:260] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:23.495288  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 61442.8us
I20260709 14:52:23.385030 11779 raft_consensus.cc:697] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
W20260709 14:52:23.464543 11856 log.cc:927] Time spent T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.091s	user 0.002s	sys 0.000s
I20260709 14:52:23.463369 11809 raft_consensus.cc:2804] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 14:52:23.498896  7819 leader_election.cc:304] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:23.453135 11778 raft_consensus.cc:3060] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:52:23.510928  7845 raft_consensus.cc:1275] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 14:52:23.419910 11794 leader_election.cc:290] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:23.463181 11445 raft_consensus.cc:2804] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 14:52:23.448063 11775 leader_election.cc:290] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:23.496153  7848 raft_consensus.cc:3060] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Advancing to term 15
W20260709 14:52:23.519732  7742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:23.520375  7776 raft_consensus.cc:1240] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 10. Current term is 11. Ops: []
I20260709 14:52:23.519738  7819 leader_election.cc:304] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
W20260709 14:52:23.526196 11746 consensus_meta.cc:287] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent flushing consensus metadata: real 0.547s	user 0.009s	sys 0.004s
I20260709 14:52:23.493814 11168 raft_consensus.cc:493] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 14:52:23.537997 11860 log.cc:927] Time spent T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.172s	user 0.000s	sys 0.002s
W20260709 14:52:23.538936 11849 log.cc:927] Time spent T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.196s	user 0.002s	sys 0.000s
I20260709 14:52:23.539914 11868 raft_consensus.cc:2749] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587) with higher term. Message: Invalid argument: T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 10. Current term is 11.
W20260709 14:52:23.541360 11865 log.cc:927] Time spent T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
W20260709 14:52:23.516541 11815 consensus_meta.cc:287] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0: Time spent flushing consensus metadata: real 0.545s	user 0.011s	sys 0.003s
I20260709 14:52:23.596419  7773 raft_consensus.cc:2410] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 14:52:23.600612 11445 raft_consensus.cc:697] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:23.600992 11764 leader_election.cc:290] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:23.541379 11809 raft_consensus.cc:697] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
W20260709 14:52:23.611943  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 92821.6us
I20260709 14:52:23.624858  7848 raft_consensus.cc:1275] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 9. (term mismatch)
W20260709 14:52:23.583161  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 49057.7us
I20260709 14:52:23.527503 11842 raft_consensus.cc:2804] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 14:52:23.623303  7894 leader_election.cc:304] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:23.541579 11701 raft_consensus.cc:493] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:23.628083  7819 leader_election.cc:304] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:23.625375  7848 pending_rounds.cc:85] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting all ops after (but not including) 8
I20260709 14:52:23.540005 11378 raft_consensus.cc:2804] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 14:52:23.635169  7848 pending_rounds.cc:107] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 14:52:23.637872  7779 raft_consensus.cc:1275] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 14:52:23.638676  7848 raft_consensus.cc:2889] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 14:52:23.623464 11856 log.cc:927] Time spent T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 14:52:23.641181  7779 raft_consensus.cc:1240] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 8. Current term is 9. Ops: []
I20260709 14:52:23.610152 11168 raft_consensus.cc:3060] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:52:23.523205 11848 consensus_queue.cc:260] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:23.609763 11819 raft_consensus.cc:2804] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader election won for term 12
I20260709 14:52:23.643376  7894 leader_election.cc:304] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
W20260709 14:52:23.638698 11835 log.cc:927] Time spent T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
W20260709 14:52:23.674993  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:23.647519 11872 raft_consensus.cc:2804] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 14:52:23.657171 11809 consensus_queue.cc:237] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:23.647859 11779 consensus_queue.cc:237] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:23.689359  7921 raft_consensus.cc:2468] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 13.
W20260709 14:52:23.704670  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:23.639410 11842 raft_consensus.cc:493] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:23.634075 11445 consensus_queue.cc:237] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:23.698655 11833 consensus_meta.cc:287] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent flushing consensus metadata: real 0.576s	user 0.013s	sys 0.006s
I20260709 14:52:23.684119 11378 raft_consensus.cc:697] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:23.637892 11868 consensus_queue.cc:1059] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.071s
W20260709 14:52:23.733575  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 105539us
I20260709 14:52:23.640101 11701 raft_consensus.cc:515] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:23.739063  7819 leader_election.cc:304] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:23.719883 11842 raft_consensus.cc:3060] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Advancing to term 14
I20260709 14:52:23.707309 11872 raft_consensus.cc:697] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:23.734385 11848 raft_consensus.cc:3060] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:52:23.733219 11870 raft_consensus.cc:2749] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 14:52:23.855788  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 73901.5us
W20260709 14:52:23.919548  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:23.893209 11767 raft_consensus.cc:2804] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 14:52:23.785444 11880 consensus_queue.cc:1048] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.136s
I20260709 14:52:23.915369 11791 leader_election.cc:290] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:23.920910 11787 consensus_queue.cc:1048] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 14:52:23.935900 11809 consensus_queue.cc:1048] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 14:52:23.958554 11819 raft_consensus.cc:697] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:52:23.964264 11767 raft_consensus.cc:697] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:23.895756 11378 consensus_queue.cc:237] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:23.986428 11791 raft_consensus.cc:493] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:23.953799 11872 consensus_queue.cc:237] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:24.005788 11168 raft_consensus.cc:515] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:24.059633 11885 log.cc:927] Time spent T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.145s	user 0.003s	sys 0.000s
I20260709 14:52:24.026880 11869 raft_consensus.cc:493] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:52:24.026503 11881 raft_consensus.cc:493] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
W20260709 14:52:24.052640 11866 log.cc:927] Time spent T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.314s	user 0.001s	sys 0.001s
I20260709 14:52:24.053360 11747 raft_consensus.cc:493] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:24.019732 11791 raft_consensus.cc:515] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:24.083724 11890 log.cc:927] Time spent T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
W20260709 14:52:24.086856  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:24.087033  7770 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 3011) took 1015 ms. Trace:
I20260709 14:52:24.091964  7770 rpcz_store.cc:276] 0709 14:52:23.071865 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:23.108963 (+ 37098us) service_pool.cc:224] Handling call
0709 14:52:23.165316 (+ 56353us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:52:23.165783 (+   467us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 14:52:23.165813 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:52:23.178782 (+ 12969us) log.cc:844] Serialized 26 byte log entry
0709 14:52:23.384146 (+205364us) raft_consensus.cc:1645] Marking committed up to 6
0709 14:52:23.384197 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:23.384277 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:52:24.086668 (+702391us) raft_consensus.cc:1685] finished
0709 14:52:24.086705 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:24.086939 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":802,"raft.run_cpu_time_us":206,"raft.run_wall_time_us":14482,"thread_start_us":152330,"threads_started":1,"wal-append.queue_time_us":427178}
I20260709 14:52:24.073071 11881 raft_consensus.cc:515] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:24.078715 11884 log.cc:927] Time spent T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.178s	user 0.001s	sys 0.001s
W20260709 14:52:24.117771  7742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:24.119984 11168 leader_election.cc:290] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:24.070308 11869 raft_consensus.cc:515] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:24.135727  7770 raft_consensus.cc:1275] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 14:52:24.132472  7921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38532 (request call id 3192) took 1126 ms. Trace:
I20260709 14:52:24.137511  7921 rpcz_store.cc:276] 0709 14:52:23.001581 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:23.001712 (+   131us) service_pool.cc:224] Handling call
0709 14:52:24.127274 (+1125562us) spinlock_profiling.cc:243] Waited 607 ms on lock 0x7b540031fbd4. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae922fa 00007fb68fe53b17 00007fb6893ce6d4 00007fb6893ce662 00007fb6893ce591 00007fb6893ce50c 00007fb6893cd7c2 00007fb6891c948c 00007fb6891c88c6 00007fb6891c826f
0709 14:52:24.127461 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1395735936}
W20260709 14:52:24.132061 11879 log.cc:927] Time spent T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.254s	user 0.000s	sys 0.002s
I20260709 14:52:24.081640 11747 raft_consensus.cc:515] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:24.071252 11767 consensus_queue.cc:237] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:24.134840 11881 leader_election.cc:290] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:24.079949 11819 consensus_queue.cc:237] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:24.178591 11791 leader_election.cc:290] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:52:24.179447 11883 log.cc:927] Time spent T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.203s	user 0.002s	sys 0.000s
W20260709 14:52:24.180708 11892 log.cc:927] Time spent T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
I20260709 14:52:24.181951 11747 leader_election.cc:290] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:24.179172  7779 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 3027) took 1075 ms. Trace:
I20260709 14:52:24.188838  7779 rpcz_store.cc:276] 0709 14:52:23.103588 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:23.646233 (+542645us) service_pool.cc:224] Handling call
0709 14:52:23.646599 (+   366us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:52:23.684215 (+ 37616us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:52:23.684249 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:52:23.702207 (+ 17958us) log.cc:844] Serialized 26 byte log entry
0709 14:52:23.957022 (+254815us) raft_consensus.cc:1645] Marking committed up to 6
0709 14:52:23.957070 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:23.957169 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:52:24.178883 (+221714us) raft_consensus.cc:1685] finished
0709 14:52:24.178911 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:24.179096 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":172,"raft.run_cpu_time_us":198,"raft.run_wall_time_us":12871,"thread_start_us":208098,"threads_started":1,"wal-append.queue_time_us":343683}
W20260709 14:52:24.201088  7893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:24.212289 11791 raft_consensus.cc:493] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:24.215746 11791 raft_consensus.cc:515] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:24.217392 11778 consensus_meta.cc:287] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent flushing consensus metadata: real 0.683s	user 0.011s	sys 0.004s
I20260709 14:52:24.216444 11900 raft_consensus.cc:493] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:24.233740 11900 raft_consensus.cc:515] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:24.226262  7776 raft_consensus.cc:1275] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 14:52:24.238022 11869 leader_election.cc:290] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:24.219072 11817 raft_consensus.cc:493] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:24.239257 11817 raft_consensus.cc:515] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:24.240347  7776 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 3020) took 1165 ms. Trace:
I20260709 14:52:24.240828  7776 rpcz_store.cc:276] 0709 14:52:23.075055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:23.533537 (+458482us) service_pool.cc:224] Handling call
0709 14:52:23.533874 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:52:24.236067 (+702193us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:24.240031 (+  3964us) spinlock_profiling.cc:243] Waited 692 ms on lock 0x7b540037d054. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae8ee01 00007fb68ae8d83e 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2 00007fb6891c948c 00007fb6891c88c6
0709 14:52:24.240270 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1591431552}
I20260709 14:52:24.299642 11778 raft_consensus.cc:493] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
W20260709 14:52:24.301113  7744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:24.300509 11778 raft_consensus.cc:515] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:24.302883 11775 raft_consensus.cc:493] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:24.303503 11847 raft_consensus.cc:3055] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 LEADER]: Stepping down as leader of term 9
I20260709 14:52:24.303710 11778 leader_election.cc:290] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:52:24.319790 11848 consensus_meta.cc:287] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent flushing consensus metadata: real 0.536s	user 0.005s	sys 0.008s
I20260709 14:52:24.322657 11791 leader_election.cc:290] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:24.281584 11842 raft_consensus.cc:515] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:24.287577 11817 leader_election.cc:290] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:24.304108 11847 raft_consensus.cc:740] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:52:24.303493 11775 raft_consensus.cc:515] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:23.875813  6549 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 14:52:24.326874 11847 consensus_queue.cc:260] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:24.328099 11847 raft_consensus.cc:3060] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:52:24.328001 11775 leader_election.cc:290] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:24.325461 11842 leader_election.cc:290] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 14 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:52:24.341622  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:52:24.342854 11886 log.cc:927] Time spent T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.374s	user 0.001s	sys 0.001s
I20260709 14:52:24.358639 11775 raft_consensus.cc:493] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:24.359478  7773 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37144 (request call id 3001) took 1329 ms. Trace:
I20260709 14:52:24.359961  7773 rpcz_store.cc:276] 0709 14:52:23.031904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:23.032074 (+   170us) service_pool.cc:224] Handling call
0709 14:52:24.359117 (+1327043us) spinlock_profiling.cc:243] Waited 562 ms on lock 0x7b54002b61d4. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae922fa 00007fb68fe53b17 00007fb6893ce6d4 00007fb6893ce662 00007fb6893ce591 00007fb6893ce50c 00007fb6893cd7c2 00007fb6891c948c 00007fb6891c88c6 00007fb6891c826f
0709 14:52:24.359353 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1292835712}
I20260709 14:52:24.359479 11775 raft_consensus.cc:515] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:24.362924 11811 raft_consensus.cc:3060] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Advancing to term 12
W20260709 14:52:24.386410  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 647565us
W20260709 14:52:24.382663 11907 log.cc:927] Time spent T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.060s	user 0.000s	sys 0.005s
I20260709 14:52:24.382958 11767 raft_consensus.cc:493] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:52:24.394479 11905 log.cc:927] Time spent T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.072s	user 0.003s	sys 0.002s
W20260709 14:52:24.394279 11902 log.cc:927] Time spent T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.110s	user 0.000s	sys 0.006s
W20260709 14:52:24.396243 11877 log.cc:927] Time spent T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.432s	user 0.007s	sys 0.001s
I20260709 14:52:24.398383 11791 raft_consensus.cc:493] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:24.417855 11791 raft_consensus.cc:515] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:24.420629 11791 leader_election.cc:290] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:24.407653 11891 raft_consensus.cc:3055] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 LEADER]: Stepping down as leader of term 8
I20260709 14:52:24.421432 11891 raft_consensus.cc:740] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:52:24.394239 11775 leader_election.cc:290] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:24.410512 11894 raft_consensus.cc:2749] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 14:52:24.412879  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:24.414710 11900 leader_election.cc:290] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:52:24.434201  7745 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:52:24.445794  8598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 53426.2us
I20260709 14:52:24.443526 11775 raft_consensus.cc:493] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:24.452972 11775 raft_consensus.cc:515] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:24.458496  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 70793.4us
I20260709 14:52:24.429670 11819 raft_consensus.cc:493] T 9441e831627143a991a1556dcdce71e3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9418391fa82a42c79c6cad13ba91d964)
I20260709 14:52:24.467036  7819 leader_election.cc:304] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:24.471446  7854 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 3333) took 1094 ms. Trace:
W20260709 14:52:24.473568  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 169606us
I20260709 14:52:24.447003 11791 raft_consensus.cc:493] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:24.472137  7854 rpcz_store.cc:276] 0709 14:52:23.376831 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:23.377658 (+   827us) service_pool.cc:224] Handling call
0709 14:52:23.378143 (+   485us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:52:23.378467 (+   324us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 14:52:23.631221 (+252754us) log.cc:844] Serialized 14 byte log entry
0709 14:52:24.341979 (+710758us) spinlock_profiling.cc:243] Waited 7.66 ms on lock 0x7b4400022b4c. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb687c29db1 00007fb687cc7c85 00007fb687cc86a2 00007fb68aa3a1db 00007fb68aa35aaf 00007fb68aa2986e 00007fb68aa28bb6 00007fb68aa287d8 00007fb68aa32221 00007fb68aa321d9 00007fb68aa32169
0709 14:52:24.470924 (+128945us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:52:24.471016 (+    92us) raft_consensus.cc:1645] Marking committed up to 8
0709 14:52:24.471084 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:24.471162 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:24.471344 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":680452,"prepare.queue_time_us":224175,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":651519,"raft.run_cpu_time_us":187,"raft.run_wall_time_us":189,"spinlock_wait_cycles":17629056,"thread_start_us":446398,"threads_started":3,"wal-append.queue_time_us":292118}
I20260709 14:52:24.471825 11819 raft_consensus.cc:515] T 9441e831627143a991a1556dcdce71e3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:52:24.475425 11888 raft_consensus.cc:493] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:24.480592  7847 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 3329) took 1161 ms. Trace:
I20260709 14:52:24.475699  7744 leader_election.cc:304] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:52:24.410612 11767 raft_consensus.cc:515] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:24.480981 11847 raft_consensus.cc:2749] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 14:52:24.485175 11767 leader_election.cc:290] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:24.502620  7775 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 3028) took 1398 ms. Trace:
I20260709 14:52:24.422875 11891 consensus_queue.cc:260] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:24.489813  7847 rpcz_store.cc:276] 0709 14:52:23.319576 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:23.319755 (+   179us) service_pool.cc:224] Handling call
0709 14:52:23.322809 (+  3054us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 14:52:23.324406 (+  1597us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 14:52:23.495236 (+170830us) log.cc:844] Serialized 14 byte log entry
0709 14:52:23.735421 (+240185us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 14:52:23.742036 (+  6615us) log.cc:844] Serialized 52 byte log entry
0709 14:52:23.742315 (+   279us) raft_consensus.cc:1645] Marking committed up to 7
0709 14:52:23.742737 (+   422us) log.cc:844] Serialized 14 byte log entry
0709 14:52:24.363487 (+620750us) spinlock_profiling.cc:243] Waited 3.48 ms on lock 0x7b18002724a0. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb690c69de1 00007fb690c765b1 00007fb687d1bc0a 00007fb69145b219 00007fb687da3a40 00007fb687d9e4e4 00007fb687d9e455 00007fb68ae86060 00007fb68ae98716 00007fb68aea9287 00007fb68aea9208
0709 14:52:24.454512 (+ 91025us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:24.454621 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:52:24.480228 (+ 25607us) raft_consensus.cc:1685] finished
0709 14:52:24.480267 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:24.480484 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":61764,"prepare.queue_time_us":279480,"prepare.run_cpu_time_us":89,"prepare.run_wall_time_us":95,"raft.queue_time_us":1473492,"raft.run_cpu_time_us":734,"raft.run_wall_time_us":14053,"spinlock_wait_cycles":7993216,"thread_start_us":396464,"threads_started":4,"wal-append.queue_time_us":225983}
I20260709 14:52:24.503383  7775 rpcz_store.cc:276] 0709 14:52:23.103821 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:24.078609 (+974788us) service_pool.cc:224] Handling call
0709 14:52:24.080827 (+  2218us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:52:24.081376 (+   549us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:52:24.081410 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:52:24.083964 (+  2554us) log.cc:844] Serialized 26 byte log entry
0709 14:52:24.200143 (+116179us) raft_consensus.cc:1645] Marking committed up to 7
0709 14:52:24.200405 (+   262us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:24.200506 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:52:24.502381 (+301875us) raft_consensus.cc:1685] finished
0709 14:52:24.502404 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:24.502544 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3115,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":132,"thread_start_us":115692,"threads_started":1,"wal-append.queue_time_us":141834}
W20260709 14:52:24.530037  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 63119.2us
I20260709 14:52:24.508416  7777 raft_consensus.cc:1275] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 14:52:24.531306  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:24.532702  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:24.547435  7775 raft_consensus.cc:3060] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Advancing to term 10
W20260709 14:52:24.537262  7742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:24.531504  7774 raft_consensus.cc:1275] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 14:52:24.561546  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:24.469678 11894 consensus_queue.cc:1059] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.065s
I20260709 14:52:24.567988  7773 raft_consensus.cc:2468] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 9.
I20260709 14:52:24.574306  7819 leader_election.cc:400] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 11 election: Vote denied by peer 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785) with higher term. Message: Invalid argument: T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 11. Current term is 12.
I20260709 14:52:24.574827  7819 leader_election.cc:403] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 14:52:24.494019 11791 raft_consensus.cc:515] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:24.546254 11914 raft_consensus.cc:493] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:24.585494 11908 raft_consensus.cc:2804] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader election won for term 13
I20260709 14:52:24.587885  7819 leader_election.cc:304] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:24.589491 11894 raft_consensus.cc:2749] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785) with higher term. Message: Invalid argument: T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 11. Current term is 12.
I20260709 14:52:24.590317 11894 raft_consensus.cc:2749] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 14:52:24.591231  7921 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "258d6c2dda954bf5b65930fde8ecb9f3"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
mode: GRACEFUL
new_leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:48676
I20260709 14:52:24.591615  7819 leader_election.cc:304] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:24.592013  7921 raft_consensus.cc:606] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 LEADER]: Received request to transfer leadership to TS 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:52:24.592756 11913 raft_consensus.cc:2749] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 14:52:24.595074  7819 leader_election.cc:304] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:24.596151 11913 raft_consensus.cc:2749] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 14:52:24.598001  7819 leader_election.cc:304] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:24.506053 11888 raft_consensus.cc:515] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:24.571249 11891 raft_consensus.cc:3060] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:52:24.608187  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:24.608716  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:24.608023  7819 leader_election.cc:304] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:24.640275  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:24.638803  7819 leader_election.cc:304] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:52:24.641232  7779 raft_consensus.cc:2468] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 13.
I20260709 14:52:24.641846  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:24.650831  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:24.652004  7772 raft_consensus.cc:2468] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 12.
I20260709 14:52:24.654665  7770 raft_consensus.cc:1275] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 14:52:24.635767 11913 raft_consensus.cc:2749] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 14:52:24.664839  7819 leader_election.cc:304] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:24.670291  7819 leader_election.cc:304] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:24.672731  7921 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
mode: GRACEFUL
new_leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:48676
I20260709 14:52:24.645010 11894 raft_consensus.cc:2749] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 14:52:24.671550 11829 raft_consensus.cc:493] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:24.681903  7921 raft_consensus.cc:606] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Received request to transfer leadership to TS 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:52:24.603261 11914 raft_consensus.cc:515] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:24.696456  7921 raft_consensus.cc:614] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 14:52:24.683552  7819 leader_election.cc:304] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:52:24.664451 11847 raft_consensus.cc:2804] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Leader election won for term 13
W20260709 14:52:24.702859  7745 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 1.508s (SENT) [suppressed 42 similar messages]
I20260709 14:52:24.681531 11895 raft_consensus.cc:2749] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 14:52:24.693646 11757 raft_consensus.cc:3055] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 LEADER]: Stepping down as leader of term 11
I20260709 14:52:24.689621 11870 raft_consensus.cc:2749] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 14:52:24.682452 11908 raft_consensus.cc:697] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:52:24.727535  7848 raft_consensus.cc:1275] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 7. (term mismatch)
I20260709 14:52:24.728153  7848 pending_rounds.cc:85] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting all ops after (but not including) 6
I20260709 14:52:24.728627  7848 pending_rounds.cc:107] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260709 14:52:24.729110  7848 raft_consensus.cc:2889] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:52:24.720973  7819 leader_election.cc:304] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:24.736212 11775 leader_election.cc:290] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:24.737062 11775 raft_consensus.cc:493] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:24.737766 11775 raft_consensus.cc:515] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:24.719485 11917 raft_consensus.cc:493] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:24.740279 11917 raft_consensus.cc:515] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:24.703033 11829 raft_consensus.cc:515] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:24.719890 11757 raft_consensus.cc:740] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:52:24.759728  7819 leader_election.cc:304] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:24.765600  7775 raft_consensus.cc:2468] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 10.
I20260709 14:52:24.708009 11918 raft_consensus.cc:493] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:24.714386 11913 raft_consensus.cc:2804] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader election won for term 9
I20260709 14:52:24.749547  7921 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
mode: GRACEFUL
new_leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:48676
I20260709 14:52:24.746901 11829 leader_election.cc:290] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:24.750206 11819 leader_election.cc:290] T 9441e831627143a991a1556dcdce71e3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68:42321)
I20260709 14:52:24.736886 11922 raft_consensus.cc:493] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:24.786712 11922 raft_consensus.cc:515] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:24.770107 11908 consensus_queue.cc:237] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:24.776803  7921 raft_consensus.cc:606] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 LEADER]: Received request to transfer leadership to TS 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:52:24.782923 11914 leader_election.cc:290] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:24.769042 11317 raft_consensus.cc:493] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:52:24.783561  7819 leader_election.cc:304] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:24.778312 11918 raft_consensus.cc:515] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:24.784312 11894 raft_consensus.cc:2749] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 14:52:24.746310 11757 consensus_queue.cc:260] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:24.764223 11888 leader_election.cc:290] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:24.725122 11847 raft_consensus.cc:697] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
W20260709 14:52:24.791115  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 88282.3us
I20260709 14:52:24.765133 11842 raft_consensus.cc:2749] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 14:52:24.741169 11775 leader_election.cc:290] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:24.744477 11917 leader_election.cc:290] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:24.817744  7854 raft_consensus.cc:1240] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 13. Current term is 14. Ops: []
I20260709 14:52:24.824828  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:24.785130 11921 raft_consensus.cc:493] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:24.834491  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:24.812513 11895 raft_consensus.cc:493] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:24.837042  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:24.816277 11913 raft_consensus.cc:697] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:52:24.843079  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:24.843232  7922 raft_consensus.cc:1275] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 14:52:24.840052  7923 raft_consensus.cc:2393] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 13: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:52:24.822474 11778 raft_consensus.cc:493] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:24.827713 11870 raft_consensus.cc:2749] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 14:52:24.848208 11767 raft_consensus.cc:493] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:24.827929 11775 raft_consensus.cc:493] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
W20260709 14:52:24.862205  7745 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:24.832199 11791 leader_election.cc:290] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:24.811321 11317 raft_consensus.cc:515] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:24.860385  7923 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
mode: GRACEFUL
new_leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:48676
I20260709 14:52:24.856765  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:24.867244  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:24.842890 11922 leader_election.cc:290] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:24.854794 11767 raft_consensus.cc:515] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:24.855576 11757 raft_consensus.cc:3060] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:52:24.895944  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:24.902136  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:24.903702  7845 raft_consensus.cc:2468] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 13.
I20260709 14:52:24.905834  7745 leader_election.cc:304] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:24.907534  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:24.832885 11921 raft_consensus.cc:515] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:24.881556 11878 log.cc:927] Time spent T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 1.184s	user 0.004s	sys 0.004s
I20260709 14:52:24.920917  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:24.922484  7923 raft_consensus.cc:606] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Received request to transfer leadership to TS 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:24.924384  7923 raft_consensus.cc:614] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 14:52:24.923038  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:24.926815  7777 raft_consensus.cc:2393] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 12: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:52:24.932688  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:24.927264  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:24.934715  7845 raft_consensus.cc:2468] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 11.
I20260709 14:52:24.936074  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:52:24.909297 11811 consensus_meta.cc:287] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0: Time spent flushing consensus metadata: real 0.546s	user 0.017s	sys 0.000s
W20260709 14:52:24.930738  7744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:24.883006 11870 raft_consensus.cc:493] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:24.862641 11778 raft_consensus.cc:515] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:24.943410  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:24.943437  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:24.889778 11887 raft_consensus.cc:493] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:24.905395 11910 raft_consensus.cc:493] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:24.971873 11910 raft_consensus.cc:515] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:24.974874  7771 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 3017) took 1900 ms. Trace:
I20260709 14:52:24.975708  7771 rpcz_store.cc:276] 0709 14:52:23.074157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:23.320192 (+246035us) service_pool.cc:224] Handling call
0709 14:52:23.320892 (+   700us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:52:23.321626 (+   734us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:52:23.321652 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:52:23.322935 (+  1283us) log.cc:844] Serialized 26 byte log entry
0709 14:52:23.486766 (+163831us) raft_consensus.cc:1645] Marking committed up to 5
0709 14:52:23.487625 (+   859us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:23.487713 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:52:24.755074 (+1267361us) spinlock_profiling.cc:243] Waited 5.99 ms on lock 0x7b4400022b4c. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb687c29db1 00007fb687cc7c85 00007fb687cc86a2 00007fb68aa3a1db 00007fb68aa35aaf 00007fb68aa2986e 00007fb68aa28bb6 00007fb68aa287d8 00007fb68aa32221 00007fb68aa321d9 00007fb68aa32169
0709 14:52:24.974453 (+219379us) raft_consensus.cc:1685] finished
0709 14:52:24.974482 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:24.974785 (+   303us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":151,"raft.run_cpu_time_us":188,"raft.run_wall_time_us":40857,"spinlock_wait_cycles":13785856,"thread_start_us":159350,"threads_started":1,"wal-append.queue_time_us":301646}
I20260709 14:52:24.914063 11848 consensus_queue.cc:1048] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 14:52:24.982101 11887 raft_consensus.cc:515] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:24.846884 11895 raft_consensus.cc:515] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:24.987921  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:24.996356  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9441e831627143a991a1556dcdce71e3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:24.996980  7845 raft_consensus.cc:2410] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 14:52:24.895469 11888 raft_consensus.cc:493] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:24.947238  7819 leader_election.cc:304] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:24.872551 11775 raft_consensus.cc:515] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:24.966879 11918 leader_election.cc:290] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:24.969303  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:24.992576  7779 raft_consensus.cc:1240] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 14:52:24.995597  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:52:25.009595  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 62541.5us
I20260709 14:52:25.016239  7921 raft_consensus.cc:2468] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 12.
I20260709 14:52:24.945713 11925 raft_consensus.cc:493] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:25.026202  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:25.028584  7770 raft_consensus.cc:1240] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 14:52:24.951848 11917 raft_consensus.cc:2804] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 14:52:25.006876 11811 raft_consensus.cc:493] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:24.987617 11919 raft_consensus.cc:493] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9418391fa82a42c79c6cad13ba91d964)
I20260709 14:52:24.890277 11847 consensus_queue.cc:237] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:25.044631  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:25.015738 11842 raft_consensus.cc:493] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:25.048024  7775 raft_consensus.cc:1275] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 14:52:25.017904 11914 raft_consensus.cc:493] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:25.017697 11894 raft_consensus.cc:2749] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 14:52:25.022297 11923 raft_consensus.cc:493] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:25.024953 11900 raft_consensus.cc:493] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:25.080780  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:25.082206  7854 raft_consensus.cc:2468] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 11.
I20260709 14:52:25.039470 11917 raft_consensus.cc:493] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:24.994915 11870 raft_consensus.cc:515] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:25.092213  7819 leader_election.cc:304] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:24.950115 11913 consensus_queue.cc:237] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:25.019727 11888 raft_consensus.cc:515] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:25.111330  7953 heartbeater.cc:646] Failed to heartbeat to 127.6.101.126:38743 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.6.101.126:38743 timed out after 15.000s (SENT)
I20260709 14:52:25.117754  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9441e831627143a991a1556dcdce71e3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:25.119594  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:25.124220 11868 raft_consensus.cc:493] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:25.125005 11868 raft_consensus.cc:515] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:25.127744 11868 leader_election.cc:290] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:25.128397 11868 raft_consensus.cc:2749] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 14:52:25.129700  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:25.130976  7925 raft_consensus.cc:2410] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 14:52:25.129868  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:25.121024  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:25.133646  7850 raft_consensus.cc:2468] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 7.
I20260709 14:52:25.135361  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:25.137116  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:25.138051  7854 raft_consensus.cc:2468] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 14.
I20260709 14:52:25.136233  7850 raft_consensus.cc:2468] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 12.
I20260709 14:52:25.141345  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:25.063442 11900 raft_consensus.cc:515] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:25.040266 11925 raft_consensus.cc:515] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:25.145772  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:25.141496  7851 raft_consensus.cc:2468] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 7.
I20260709 14:52:25.095678 11917 raft_consensus.cc:3060] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Advancing to term 14
I20260709 14:52:25.061775 11842 raft_consensus.cc:515] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:25.052138 11811 raft_consensus.cc:515] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:25.092140 11894 raft_consensus.cc:493] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:25.166985  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:25.155062  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:25.155746  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:25.062168 11914 raft_consensus.cc:515] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:25.107511 11932 raft_consensus.cc:493] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:25.056995 11919 raft_consensus.cc:515] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:52:25.071604 11923 raft_consensus.cc:515] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:25.167732  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:25.710791  7854 raft_consensus.cc:3060] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:52:25.711138  7850 raft_consensus.cc:2393] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 12: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:52:25.148974 11887 leader_election.cc:290] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:25.160516 11317 leader_election.cc:290] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:25.718817 11934 raft_consensus.cc:493] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:25.719524 11934 raft_consensus.cc:515] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:25.720427  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:25.201764 11767 leader_election.cc:290] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:25.170306 11910 leader_election.cc:290] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:25.179863 11894 raft_consensus.cc:515] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:25.722958 11934 leader_election.cc:290] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:25.726876  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:25.726837 11934 raft_consensus.cc:493] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:25.731000 11894 leader_election.cc:290] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:25.730865 11934 raft_consensus.cc:515] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:25.731653 11701 leader_election.cc:290] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:25.735244  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:25.735455  7848 raft_consensus.cc:2468] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 13.
W20260709 14:52:25.724776 11891 consensus_meta.cc:287] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent flushing consensus metadata: real 1.080s	user 0.020s	sys 0.007s
W20260709 14:52:25.695647  7744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:25.177935  7775 raft_consensus.cc:2468] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 12.
I20260709 14:52:25.154688 11791 raft_consensus.cc:493] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:25.775704 11791 raft_consensus.cc:515] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:25.776531  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:25.777671  7922 raft_consensus.cc:2468] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 13.
I20260709 14:52:25.778155 11791 leader_election.cc:290] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:25.779847  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
W20260709 14:52:25.707952  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:25.698176 11775 leader_election.cc:290] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:52:25.718091 11927 log.cc:927] Time spent T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.585s	user 0.005s	sys 0.008s
I20260709 14:52:25.782493 11775 raft_consensus.cc:493] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:25.693447 11932 raft_consensus.cc:515] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:25.783077 11775 raft_consensus.cc:515] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:25.783987 11756 raft_consensus.cc:493] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:25.784626 11756 raft_consensus.cc:515] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:25.760811 11842 leader_election.cc:290] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:25.724357 11935 raft_consensus.cc:493] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:52:25.737471 11931 log.cc:927] Time spent T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.567s	user 0.000s	sys 0.011s
W20260709 14:52:25.737957 11929 log.cc:927] Time spent T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.707s	user 0.000s	sys 0.014s
I20260709 14:52:25.763463 11925 leader_election.cc:290] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:25.766022 11778 leader_election.cc:290] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:25.774946 11914 leader_election.cc:290] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:25.785646 11775 leader_election.cc:290] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:25.785918  7847 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 3342) took 1064 ms. Trace:
I20260709 14:52:25.760223  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783e4874513449ef9084b833f188a6d3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:25.784966 11932 leader_election.cc:290] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:25.787407 11922 raft_consensus.cc:493] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:25.732776 11887 raft_consensus.cc:493] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:25.795326  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:25.718706 11923 leader_election.cc:290] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:25.799888  7846 raft_consensus.cc:3060] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Advancing to term 10
W20260709 14:52:25.768951 11757 consensus_meta.cc:287] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent flushing consensus metadata: real 0.874s	user 0.015s	sys 0.005s
I20260709 14:52:25.806869  7854 raft_consensus.cc:2410] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 14:52:25.728230 11938 raft_consensus.cc:493] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:25.733637 11872 raft_consensus.cc:493] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:25.812775 11811 leader_election.cc:290] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:25.814371 11919 leader_election.cc:290] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68:42321)
W20260709 14:52:25.825327  7745 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:25.827756  7847 rpcz_store.cc:276] 0709 14:52:24.721192 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:24.721525 (+   333us) service_pool.cc:224] Handling call
0709 14:52:24.722649 (+  1124us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:52:24.727835 (+  5186us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 14:52:24.747240 (+ 19405us) log.cc:844] Serialized 14 byte log entry
0709 14:52:24.878762 (+131522us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:52:24.879473 (+   711us) log.cc:844] Serialized 26 byte log entry
0709 14:52:24.879652 (+   179us) raft_consensus.cc:1645] Marking committed up to 6
0709 14:52:24.879701 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:24.879790 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:52:25.785638 (+905848us) raft_consensus.cc:1685] finished
0709 14:52:25.785662 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:25.785844 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":42289,"prepare.queue_time_us":18468,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":65,"raft.queue_time_us":59663,"raft.run_cpu_time_us":694,"raft.run_wall_time_us":28413,"thread_start_us":107591,"threads_started":1,"wal-append.queue_time_us":301912}
I20260709 14:52:25.858377  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:25.833544  7845 raft_consensus.cc:2393] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 13: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:52:25.846253  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:25.861088  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:25.804989 11921 leader_election.cc:290] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:25.828392 11934 leader_election.cc:290] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:25.867297  7853 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 3350) took 1109 ms. Trace:
I20260709 14:52:25.852324  7852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 3353) took 1089 ms. Trace:
I20260709 14:52:25.870419  7852 rpcz_store.cc:276] 0709 14:52:24.762878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:24.763014 (+   136us) service_pool.cc:224] Handling call
0709 14:52:24.763365 (+   351us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:52:24.779134 (+ 15769us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 14:52:24.785650 (+  6516us) log.cc:844] Serialized 14 byte log entry
0709 14:52:24.883045 (+ 97395us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:52:24.883792 (+   747us) log.cc:844] Serialized 26 byte log entry
0709 14:52:24.884321 (+   529us) raft_consensus.cc:1645] Marking committed up to 8
0709 14:52:24.884373 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:24.884460 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:52:25.785577 (+901117us) spinlock_profiling.cc:243] Waited 5.31 ms on lock 0x7b4800002dd8. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68fdb7aa1 00007fb68fdaeb37 00007fb68fdae9ca 00007fb68fea626f 00007fb68fea5f37 00007fb68feba55c 00007fb68feba508 00007fb68feba488 00007fb68feba443 00007fb68feb96ec 00007fb68ede3a96
0709 14:52:25.844784 (+ 59207us) raft_consensus.cc:1685] finished
0709 14:52:25.852038 (+  7254us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:25.852248 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32688,"prepare.queue_time_us":6908,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":31462,"raft.run_cpu_time_us":1898,"raft.run_wall_time_us":896526,"spinlock_wait_cycles":12206464,"thread_start_us":85346,"threads_started":1,"wal-append.queue_time_us":160614}
I20260709 14:52:25.867888  7853 rpcz_store.cc:276] 0709 14:52:24.758291 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:24.758421 (+   130us) service_pool.cc:224] Handling call
0709 14:52:24.758815 (+   394us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 14:52:24.791883 (+ 33068us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:52:24.792026 (+   143us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 14:52:24.810082 (+ 18056us) log.cc:844] Serialized 52 byte log entry
0709 14:52:25.019060 (+208978us) raft_consensus.cc:1645] Marking committed up to 7
0709 14:52:25.266693 (+247633us) log.cc:844] Serialized 14 byte log entry
0709 14:52:25.266991 (+   298us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:25.267090 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:52:25.866935 (+599845us) raft_consensus.cc:1685] finished
0709 14:52:25.866967 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:25.867209 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38195,"prepare.queue_time_us":700459,"prepare.run_cpu_time_us":142,"prepare.run_wall_time_us":136,"raft.queue_time_us":19455,"raft.run_cpu_time_us":439,"raft.run_wall_time_us":15543,"thread_start_us":399838,"threads_started":2,"wal-append.queue_time_us":267603}
I20260709 14:52:25.879321  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:25.882108  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:25.834087 11895 leader_election.cc:290] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:25.877534 11923 raft_consensus.cc:493] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:25.886343  8639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18d29d52d304c87b930d4fb5eaf50b1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9418391fa82a42c79c6cad13ba91d964" is_pre_election: true
I20260709 14:52:25.925613 11923 raft_consensus.cc:515] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:25.852180 11938 raft_consensus.cc:515] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:25.854429 11872 raft_consensus.cc:515] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:25.848950 11922 raft_consensus.cc:515] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:25.848819 11887 raft_consensus.cc:515] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:25.890544 11930 log.cc:927] Time spent T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.747s	user 0.007s	sys 0.011s
I20260709 14:52:25.877645  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:25.906664  8640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9441e831627143a991a1556dcdce71e3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9418391fa82a42c79c6cad13ba91d964" is_pre_election: true
I20260709 14:52:25.910329  7923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:48676 (request call id 60) took 1050 ms. Trace:
I20260709 14:52:25.932986  7847 raft_consensus.cc:2468] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 12.
I20260709 14:52:25.937505  7745 leader_election.cc:304] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:25.963596  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:52:25.962201  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 72046.9us
I20260709 14:52:25.964601  7852 raft_consensus.cc:2468] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 11.
I20260709 14:52:25.960247  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:52:25.940864 11928 log.cc:927] Time spent T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.874s	user 0.000s	sys 0.001s
I20260709 14:52:25.935773  7851 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3500) took 1045 ms. Trace:
I20260709 14:52:25.964406  7745 leader_election.cc:304] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:25.961658  7923 rpcz_store.cc:276] 0709 14:52:24.859745 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:24.860177 (+   432us) service_pool.cc:224] Handling call
0709 14:52:25.910006 (+1049829us) spinlock_profiling.cc:243] Waited 47.7 ms on lock 0x7b540025d5d4. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae88853 00007fb68fe5660a 00007fb6893dc7d4 00007fb6893dc762 00007fb6893dc691 00007fb6893dc60c 00007fb6893db8c2 00007fb6891c948c 00007fb6891c88c6 00007fb6891c826f
0709 14:52:25.910204 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":109763840}
I20260709 14:52:25.817160 11935 raft_consensus.cc:515] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:25.972369  7851 rpcz_store.cc:276] 0709 14:52:24.890081 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:25.025855 (+135774us) service_pool.cc:224] Handling call
0709 14:52:25.935498 (+909643us) spinlock_profiling.cc:243] Waited 113 ms on lock 0x7b540013c9d4. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae922fa 00007fb68fe53b17 00007fb6893ce6d4 00007fb6893ce662 00007fb6893ce591 00007fb6893ce50c 00007fb6893cd7c2 00007fb6891c948c 00007fb6891c88c6 00007fb6891c826f
0709 14:52:25.935687 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":259493120}
I20260709 14:52:25.876751 11932 raft_consensus.cc:493] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:52:25.934633 11917 consensus_meta.cc:287] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent flushing consensus metadata: real 0.764s	user 0.004s	sys 0.010s
W20260709 14:52:25.956171  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:25.991753  7853 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3508) took 1099 ms. Trace:
I20260709 14:52:25.992826 11917 raft_consensus.cc:515] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:25.995414 11917 leader_election.cc:290] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 14 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:25.996570 11887 leader_election.cc:290] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:25.997013  7817 leader_election.cc:304] T 9441e831627143a991a1556dcdce71e3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 9418391fa82a42c79c6cad13ba91d964
I20260709 14:52:26.000001 11942 raft_consensus.cc:2749] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 14:52:26.000946 11778 raft_consensus.cc:493] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:26.001827 11778 raft_consensus.cc:515] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:26.004499 11778 leader_election.cc:290] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:26.006899  7921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38516 (request call id 2401) took 1182 ms. Trace:
I20260709 14:52:26.007416  7921 rpcz_store.cc:276] 0709 14:52:24.824294 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:24.824452 (+   158us) service_pool.cc:224] Handling call
0709 14:52:26.006574 (+1182122us) spinlock_profiling.cc:243] Waited 130 ms on lock 0x7b540041c8d4. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae922fa 00007fb68fe53b17 00007fb6893ce6d4 00007fb6893ce662 00007fb6893ce591 00007fb6893ce50c 00007fb6893cd7c2 00007fb6891c948c 00007fb6891c88c6 00007fb6891c826f
0709 14:52:26.006811 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":298478336}
I20260709 14:52:25.929181 11923 leader_election.cc:290] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:26.008677  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:26.008992 11923 raft_consensus.cc:493] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:26.009579  7848 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49946 (request call id 3368) took 1031 ms. Trace:
I20260709 14:52:25.992610 11848 raft_consensus.cc:493] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:25.975050 11921 raft_consensus.cc:2804] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 14:52:25.978540  7846 raft_consensus.cc:2410] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 14:52:25.979291  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:52:25.950001 11941 log.cc:927] Time spent T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.122s	user 0.000s	sys 0.001s
I20260709 14:52:25.977200 11701 consensus_queue.cc:1059] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 14:52:26.011731  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9441e831627143a991a1556dcdce71e3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:26.010143  7851 raft_consensus.cc:2410] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 14:52:26.020803  7850 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3504) took 1129 ms. Trace:
I20260709 14:52:25.936266 11919 raft_consensus.cc:493] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:25.939841 11922 leader_election.cc:290] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:25.942896 11900 leader_election.cc:290] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:25.992295  7853 rpcz_store.cc:276] 0709 14:52:24.892369 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:25.959900 (+1067531us) service_pool.cc:224] Handling call
0709 14:52:25.991673 (+ 31773us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 14:52:26.025158  7850 rpcz_store.cc:276] 0709 14:52:24.891284 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:25.978985 (+1087701us) service_pool.cc:224] Handling call
0709 14:52:26.020720 (+ 41735us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 14:52:26.029505  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:26.029794  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:26.010074  7848 rpcz_store.cc:276] 0709 14:52:24.978570 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:25.726476 (+747906us) service_pool.cc:224] Handling call
0709 14:52:26.009335 (+282859us) spinlock_profiling.cc:243] Waited 7.53 ms on lock 0x7b540013b0d4. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae922fa 00007fb68fe53b17 00007fb6893ce6d4 00007fb6893ce662 00007fb6893ce591 00007fb6893ce50c 00007fb6893cd7c2 00007fb6891c948c 00007fb6891c88c6 00007fb6891c826f
0709 14:52:26.009497 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":17323392}
I20260709 14:52:26.026614  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:52:26.013013 11931 log.cc:927] Time spent T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 14:52:26.032992  7850 raft_consensus.cc:2393] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 12: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:52:25.975159 11767 consensus_queue.cc:1059] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 14:52:26.031577  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:26.032902  7851 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3502) took 1142 ms. Trace:
I20260709 14:52:26.034107  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:26.093382  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:26.094365  7772 raft_consensus.cc:2468] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 7.
I20260709 14:52:26.095642  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:26.088807  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783e4874513449ef9084b833f188a6d3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:26.098629  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:26.098168  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:26.100988  7774 raft_consensus.cc:2468] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 11.
I20260709 14:52:26.099462  7777 raft_consensus.cc:2468] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 11.
I20260709 14:52:26.102823  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258d6c2dda954bf5b65930fde8ecb9f3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:26.104050  7775 raft_consensus.cc:2468] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 10.
I20260709 14:52:26.061195 11913 raft_consensus.cc:493] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:25.974800 11932 raft_consensus.cc:515] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:26.057402  7745 leader_election.cc:304] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:26.058947  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:26.061954  7770 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37136 (request call id 2386) took 1139 ms. Trace:
I20260709 14:52:26.063143  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:26.026466 11910 raft_consensus.cc:2749] T 9441e831627143a991a1556dcdce71e3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 14:52:25.979408 11811 consensus_queue.cc:1048] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 14:52:26.012869 11872 leader_election.cc:290] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:26.022550 11923 raft_consensus.cc:515] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:26.066135  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:26.131548  7771 raft_consensus.cc:2468] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 12.
I20260709 14:52:26.066731  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:26.061322  7921 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ad8e261558b942c6b42c841689082c10"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
mode: GRACEFUL
new_leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:48676
I20260709 14:52:26.132761  7921 raft_consensus.cc:606] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Received request to transfer leadership to TS 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:26.133111  7921 raft_consensus.cc:614] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 14:52:26.070366  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:26.135725  7773 raft_consensus.cc:2410] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 14:52:26.093487  7851 rpcz_store.cc:276] 0709 14:52:24.890680 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:26.026343 (+1135663us) service_pool.cc:224] Handling call
0709 14:52:26.032804 (+  6461us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 14:52:26.136835  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:26.104956  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18d29d52d304c87b930d4fb5eaf50b1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:26.106048  7848 raft_consensus.cc:2393] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 13: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:52:26.138870  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:26.105810  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:26.022725 11921 raft_consensus.cc:493] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:26.107072  7846 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49946 (request call id 3359) took 1267 ms. Trace:
I20260709 14:52:26.022367 11848 raft_consensus.cc:515] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:26.099352  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:26.110814  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:26.112497  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:26.154637  7772 raft_consensus.cc:2468] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 12.
I20260709 14:52:26.117161  7770 rpcz_store.cc:276] 0709 14:52:24.925911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:24.926072 (+   161us) service_pool.cc:224] Handling call
0709 14:52:24.953010 (+ 26938us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:52:25.029160 (+ 76150us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:26.061675 (+1032515us) spinlock_profiling.cc:243] Waited 69.4 ms on lock 0x7b54000ce254. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae8ee01 00007fb68ae8d83e 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2 00007fb6891c948c 00007fb6891c88c6
0709 14:52:26.061890 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":159640832}
I20260709 14:52:26.039541 11922 raft_consensus.cc:493] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:26.129110  7849 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 3352) took 1367 ms. Trace:
I20260709 14:52:26.087579 11946 raft_consensus.cc:493] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:26.130640  7847 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3507) took 1238 ms. Trace:
I20260709 14:52:26.160547  7847 rpcz_store.cc:276] 0709 14:52:24.892089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:26.058318 (+1166229us) service_pool.cc:224] Handling call
0709 14:52:26.130575 (+ 72257us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 14:52:26.031649 11919 raft_consensus.cc:515] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:26.114668 11918 raft_consensus.cc:493] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:26.141183  7674 catalog_manager.cc:5697] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:52:26.125433 11842 raft_consensus.cc:493] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:26.168633  7848 raft_consensus.cc:2468] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 11.
I20260709 14:52:26.073894 11756 leader_election.cc:290] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:26.073611 11775 raft_consensus.cc:493] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:26.169777 11775 raft_consensus.cc:515] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:26.172283 11775 leader_election.cc:290] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:26.145915 11867 raft_consensus.cc:3055] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 14:52:26.151608  7819 leader_election.cc:304] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:26.150873  6549 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 14:52:26.157194 11921 raft_consensus.cc:3060] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Advancing to term 13
I20260709 14:52:26.175477  7776 raft_consensus.cc:2468] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 12.
W20260709 14:52:26.116374  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 59045.1us
I20260709 14:52:26.071735 11887 raft_consensus.cc:493] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:26.157982  7849 rpcz_store.cc:276] 0709 14:52:24.761747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:24.761895 (+   148us) service_pool.cc:224] Handling call
0709 14:52:24.762236 (+   341us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 14:52:24.791868 (+ 29632us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:52:24.791900 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 14:52:24.798016 (+  6116us) log.cc:844] Serialized 52 byte log entry
0709 14:52:24.923897 (+125881us) raft_consensus.cc:1645] Marking committed up to 5
0709 14:52:24.923945 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:24.924035 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:52:25.889937 (+965902us) spinlock_profiling.cc:243] Waited 18 ms on lock 0x7b2400266498. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb687c29db1 00007fb687c279c4 00007fb687c25acb 00007fb687de0dc9 00007fb687de0a55 00007fb687de009d 00007fb68aa1210e 00007fb68aa2988c 00007fb68aa28bb6 00007fb68aa287d8 00007fb68aa32221
0709 14:52:26.114930 (+224993us) raft_consensus.cc:1685] finished
0709 14:52:26.114954 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:26.129008 (+ 14054us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29134,"raft.queue_time_us":36427,"raft.run_cpu_time_us":249,"raft.run_wall_time_us":4254,"spinlock_wait_cycles":41499008,"thread_start_us":93364,"threads_started":1,"wal-append.queue_time_us":252142}
I20260709 14:52:26.154877  7845 raft_consensus.cc:2468] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 12.
I20260709 14:52:26.178000  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:26.178380  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:26.179137  7849 raft_consensus.cc:2410] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for term 13 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 14:52:26.114725 11757 raft_consensus.cc:493] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:26.162185  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258d6c2dda954bf5b65930fde8ecb9f3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:26.114821 11895 raft_consensus.cc:493] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:26.129050 11908 raft_consensus.cc:2804] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 14:52:26.142724  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:26.173010 11867 raft_consensus.cc:740] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:26.185068  7851 raft_consensus.cc:2410] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 14:52:26.185922  7745 leader_election.cc:304] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:26.186676  7851 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 3364) took 1312 ms. Trace:
I20260709 14:52:26.123939 11914 raft_consensus.cc:493] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:26.125337 11870 leader_election.cc:290] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:26.125509 11913 raft_consensus.cc:515] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:26.129356 11891 raft_consensus.cc:493] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9418391fa82a42c79c6cad13ba91d964)
I20260709 14:52:26.152740  7846 rpcz_store.cc:276] 0709 14:52:24.830731 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:24.834266 (+  3535us) service_pool.cc:224] Handling call
0709 14:52:26.095710 (+1261444us) spinlock_profiling.cc:243] Waited 965 ms on lock 0x7b540020e4d4. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae922fa 00007fb68fe53b17 00007fb6893ce6d4 00007fb6893ce662 00007fb6893ce591 00007fb6893ce50c 00007fb6893cd7c2 00007fb6891c948c 00007fb6891c88c6 00007fb6891c826f
0709 14:52:26.095863 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2218580736}
I20260709 14:52:26.156050  7850 raft_consensus.cc:2393] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 14: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:52:26.186940  7745 leader_election.cc:304] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:26.202152  7846 raft_consensus.cc:1240] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 11. Current term is 12. Ops: []
I20260709 14:52:26.202841  7846 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49948 (request call id 3482) took 1322 ms. Trace:
I20260709 14:52:26.203413  7745 leader_election.cc:304] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:26.179029  7845 raft_consensus.cc:2468] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 10.
I20260709 14:52:26.207302  7849 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 3363) took 1328 ms. Trace:
I20260709 14:52:26.158838 11819 consensus_queue.cc:1048] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 14:52:26.054028 11942 raft_consensus.cc:493] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:26.182835  7847 raft_consensus.cc:2410] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for term 11 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 14:52:26.163489 11922 raft_consensus.cc:515] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:26.203151  7846 rpcz_store.cc:276] 0709 14:52:24.880467 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:26.201589 (+1321122us) service_pool.cc:224] Handling call
0709 14:52:26.201979 (+   390us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:52:26.202565 (+   586us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:26.202771 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 14:52:26.166520 11946 raft_consensus.cc:515] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:26.174140 11918 raft_consensus.cc:515] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:26.207237  7845 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 3365) took 1325 ms. Trace:
I20260709 14:52:26.175820 11842 raft_consensus.cc:515] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:26.243901  7845 rpcz_store.cc:276] 0709 14:52:24.881970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:26.206381 (+1324411us) service_pool.cc:224] Handling call
0709 14:52:26.206720 (+   339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:52:26.206922 (+   202us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:52:26.206946 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:52:26.206985 (+    39us) raft_consensus.cc:1645] Marking committed up to 4
0709 14:52:26.207024 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:26.207076 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:26.207182 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 14:52:26.193784 11908 raft_consensus.cc:493] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:26.208196  7849 rpcz_store.cc:276] 0709 14:52:24.861024 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:26.183192 (+1322168us) service_pool.cc:224] Handling call
0709 14:52:26.183584 (+   392us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:52:26.183770 (+   186us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:52:26.183833 (+    63us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:52:26.183877 (+    44us) raft_consensus.cc:1645] Marking committed up to 7
0709 14:52:26.183922 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:26.183975 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:26.188808 (+  4833us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 14:52:26.183382 11756 raft_consensus.cc:2804] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 14:52:26.246574  7846 raft_consensus.cc:1275] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 14:52:26.250994  7846 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49948 (request call id 3489) took 1364 ms. Trace:
W20260709 14:52:26.251389  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 280476us
I20260709 14:52:26.246402  7847 raft_consensus.cc:1217] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Deduplicated request from leader. Original: 8.6->[9.7-9.7]   Dedup: 9.7->[]
I20260709 14:52:26.251472  7846 rpcz_store.cc:276] 0709 14:52:24.886149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:26.243213 (+1357064us) service_pool.cc:224] Handling call
0709 14:52:26.243557 (+   344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:52:26.250683 (+  7126us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:26.250927 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 14:52:26.246222  7845 raft_consensus.cc:1275] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 14:52:26.225564  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 405699us
I20260709 14:52:26.184847 11935 leader_election.cc:290] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:26.196292 11775 raft_consensus.cc:2804] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 14:52:26.252787  7847 raft_consensus.cc:1240] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 14:52:26.233626 11945 raft_consensus.cc:2749] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 14:52:26.245337  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 71257us
I20260709 14:52:26.242684  7851 rpcz_store.cc:276] 0709 14:52:24.874850 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:26.185862 (+1311012us) service_pool.cc:224] Handling call
0709 14:52:26.186196 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:52:26.186372 (+   176us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:52:26.186403 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:52:26.186443 (+    40us) raft_consensus.cc:1645] Marking committed up to 9
0709 14:52:26.186473 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:26.186520 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:26.186622 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 14:52:26.260739  7848 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 3369) took 1281 ms. Trace:
I20260709 14:52:26.258579  7845 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49948 (request call id 3494) took 1370 ms. Trace:
I20260709 14:52:26.264009  7847 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49948 (request call id 3490) took 1377 ms. Trace:
I20260709 14:52:26.265017  7819 leader_election.cc:304] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:26.265753  7849 raft_consensus.cc:1275] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 14:52:26.266270  7819 leader_election.cc:304] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:26.265471  7847 rpcz_store.cc:276] 0709 14:52:24.886421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:26.244495 (+1358074us) service_pool.cc:224] Handling call
0709 14:52:26.246293 (+  1798us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:52:26.263566 (+ 17273us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:26.263924 (+   358us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 14:52:26.265144  7848 rpcz_store.cc:276] 0709 14:52:24.978959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:26.259821 (+1280862us) service_pool.cc:224] Handling call
0709 14:52:26.260175 (+   354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:52:26.260377 (+   202us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:52:26.260403 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:52:26.260448 (+    45us) raft_consensus.cc:1645] Marking committed up to 9
0709 14:52:26.260483 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:26.260538 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:26.260672 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 14:52:26.265213  7845 rpcz_store.cc:276] 0709 14:52:24.887907 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:26.245558 (+1357651us) service_pool.cc:224] Handling call
0709 14:52:26.245886 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:52:26.253110 (+  7224us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:26.258497 (+  5387us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 14:52:26.244616 11888 leader_election.cc:290] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:26.182817 11887 raft_consensus.cc:515] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:26.268041  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:26.184757 11757 raft_consensus.cc:515] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:26.268673  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:26.286605  7851 raft_consensus.cc:2468] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 10.
I20260709 14:52:26.264439  7846 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 3367) took 1286 ms. Trace:
I20260709 14:52:26.270160  7845 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 3370) took 1243 ms. Trace:
I20260709 14:52:26.254238 11908 raft_consensus.cc:3060] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:52:26.227442 11943 raft_consensus.cc:2749] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 14:52:26.227146 11894 raft_consensus.cc:493] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:26.252369 11756 raft_consensus.cc:493] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:26.287856  7845 rpcz_store.cc:276] 0709 14:52:25.026645 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:26.268928 (+1242283us) service_pool.cc:224] Handling call
0709 14:52:26.269452 (+   524us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:52:26.269685 (+   233us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:52:26.269710 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:52:26.269761 (+    51us) raft_consensus.cc:1645] Marking committed up to 6
0709 14:52:26.269796 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:26.269939 (+   143us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:26.270088 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 14:52:26.263303 11775 raft_consensus.cc:493] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:26.199275 11914 raft_consensus.cc:515] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:26.287712  7846 rpcz_store.cc:276] 0709 14:52:24.978015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:26.262573 (+1284558us) service_pool.cc:224] Handling call
0709 14:52:26.263928 (+  1355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:52:26.264118 (+   190us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:52:26.264141 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:52:26.264181 (+    40us) raft_consensus.cc:1645] Marking committed up to 7
0709 14:52:26.264211 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:26.264261 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:26.264374 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 14:52:26.306892  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:26.307679  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:26.308619  7852 raft_consensus.cc:2468] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 13.
I20260709 14:52:26.300806  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:26.302341  7845 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 3371) took 1257 ms. Trace:
I20260709 14:52:26.263307 11935 raft_consensus.cc:493] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:26.210369 11891 raft_consensus.cc:515] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:52:26.268033  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:26.191250 11895 raft_consensus.cc:515] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:26.307616  7850 raft_consensus.cc:2468] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 12.
I20260709 14:52:26.313133  7848 raft_consensus.cc:2410] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for term 13 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 14:52:26.314440  7852 raft_consensus.cc:1275] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 14:52:26.251147 11942 raft_consensus.cc:515] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:26.328712 11887 leader_election.cc:290] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:26.291250 11811 consensus_queue.cc:1048] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 14:52:26.311162 11894 raft_consensus.cc:515] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:26.334553 11894 leader_election.cc:290] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:52:26.316552  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 50393.2us
I20260709 14:52:26.318037  7852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 3373) took 1177 ms. Trace:
I20260709 14:52:26.336633  7852 rpcz_store.cc:276] 0709 14:52:25.140617 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:26.312422 (+1171805us) service_pool.cc:224] Handling call
0709 14:52:26.313961 (+  1539us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:52:26.317743 (+  3782us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:26.317989 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 14:52:26.300912 11896 consensus_queue.cc:1048] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 14:52:26.337102  7819 leader_election.cc:304] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:26.338485 11768 consensus_queue.cc:1048] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 14:52:26.339316 11848 leader_election.cc:290] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:26.290298 11867 consensus_queue.cc:260] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:26.342038 11819 raft_consensus.cc:493] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:26.342757 11819 raft_consensus.cc:515] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:26.344901 11918 leader_election.cc:290] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:26.346855 11867 raft_consensus.cc:3060] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:52:26.347826 11923 leader_election.cc:290] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:26.352371 11932 leader_election.cc:290] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:26.322863 11891 leader_election.cc:290] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68:42321)
I20260709 14:52:26.291543 11888 raft_consensus.cc:493] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:26.356594 11913 leader_election.cc:290] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:26.305825 11756 raft_consensus.cc:3060] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Advancing to term 13
I20260709 14:52:26.326313 11935 raft_consensus.cc:515] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:26.358662 11914 leader_election.cc:290] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:26.359159 11935 leader_election.cc:290] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:26.335484 11922 leader_election.cc:290] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:26.338651  7819 leader_election.cc:304] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:26.340173 11848 raft_consensus.cc:2804] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 14:52:26.364629  7849 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49948 (request call id 3495) took 1476 ms. Trace:
I20260709 14:52:26.365713  7849 rpcz_store.cc:276] 0709 14:52:24.888210 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:26.250694 (+1362484us) service_pool.cc:224] Handling call
0709 14:52:26.251185 (+   491us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:52:26.266926 (+ 15741us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:26.364385 (+ 97459us) spinlock_profiling.cc:243] Waited 14 ms on lock 0x7b54000951d4. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae8ee01 00007fb68ae8d83e 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2 00007fb6891c948c 00007fb6891c88c6
0709 14:52:26.364565 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":32091904}
I20260709 14:52:26.301126 11829 raft_consensus.cc:3055] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 14:52:26.355970 11888 raft_consensus.cc:515] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:26.325368  7853 raft_consensus.cc:2468] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 7.
I20260709 14:52:26.322182 11954 raft_consensus.cc:2804] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 14:52:26.313745  7845 rpcz_store.cc:276] 0709 14:52:25.045458 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:26.301286 (+1255828us) service_pool.cc:224] Handling call
0709 14:52:26.301669 (+   383us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:52:26.301934 (+   265us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:52:26.301958 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:52:26.302003 (+    45us) raft_consensus.cc:1645] Marking committed up to 8
0709 14:52:26.302036 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:26.302097 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:26.302258 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 14:52:26.367949  7674 catalog_manager.cc:5697] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:52:26.366008  7819 leader_election.cc:304] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:26.369087  6549 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 14:52:26.304029 11847 raft_consensus.cc:2804] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 14:52:26.310814 11775 raft_consensus.cc:3060] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Advancing to term 8
I20260709 14:52:26.376406  7849 raft_consensus.cc:1275] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 14:52:26.379642  7845 raft_consensus.cc:1275] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 14:52:26.380455 11954 raft_consensus.cc:493] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:26.397485 11954 raft_consensus.cc:3060] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:52:26.399261 11938 leader_election.cc:290] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:26.399381 11819 leader_election.cc:290] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:26.381129 11842 leader_election.cc:290] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:26.409556  7852 raft_consensus.cc:1275] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 14:52:26.382141 11935 raft_consensus.cc:493] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:26.382332 11942 leader_election.cc:290] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:26.375684 11894 raft_consensus.cc:2804] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 14:52:26.380505  8640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18d29d52d304c87b930d4fb5eaf50b1" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9418391fa82a42c79c6cad13ba91d964" is_pre_election: true
I20260709 14:52:26.392167 11910 raft_consensus.cc:2804] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 14:52:26.383354 11948 log.cc:927] Time spent T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.093s	user 0.009s	sys 0.000s
I20260709 14:52:26.385005  7854 raft_consensus.cc:2468] T 9441e831627143a991a1556dcdce71e3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 3.
I20260709 14:52:26.386379 11919 leader_election.cc:290] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:26.388746 11888 leader_election.cc:290] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:52:26.389943  7745 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:26.417738 11910 raft_consensus.cc:493] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:26.421770 11910 raft_consensus.cc:3060] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Advancing to term 13
I20260709 14:52:26.372242 11829 raft_consensus.cc:740] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:26.391412  7819 leader_election.cc:304] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:26.328737 11895 leader_election.cc:290] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:26.370592 11848 raft_consensus.cc:493] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:26.402463  7848 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 3375) took 1147 ms. Trace:
I20260709 14:52:26.426026 11946 leader_election.cc:290] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:26.426661 11848 raft_consensus.cc:3060] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:52:26.426335  7848 rpcz_store.cc:276] 0709 14:52:25.255013 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:26.324335 (+1069322us) service_pool.cc:224] Handling call
0709 14:52:26.324913 (+   578us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:52:26.330942 (+  6029us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:52:26.330975 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:52:26.331015 (+    40us) raft_consensus.cc:1645] Marking committed up to 5
0709 14:52:26.331046 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:26.402169 (+ 71123us) spinlock_profiling.cc:243] Waited 5.8 ms on lock 0x7b54000956d4. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae8ee01 00007fb68ae8d83e 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2 00007fb6891c948c 00007fb6891c88c6
0709 14:52:26.402223 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:26.402394 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13346176}
I20260709 14:52:26.426465 11829 consensus_queue.cc:260] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:26.430934 11829 raft_consensus.cc:3060] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:52:26.375316 11914 raft_consensus.cc:493] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:26.433713 11914 raft_consensus.cc:515] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:26.405138  7744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:52:26.378508 11950 log.cc:927] Time spent T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.077s	user 0.002s	sys 0.001s
I20260709 14:52:26.416548 11949 consensus_queue.cc:1048] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 14:52:26.417002 11894 raft_consensus.cc:493] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:26.436789 11914 leader_election.cc:290] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:52:26.389937  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 74491.4us
I20260709 14:52:26.438210  7848 raft_consensus.cc:1275] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 14:52:26.436903 11894 raft_consensus.cc:3060] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:52:26.391072 11847 raft_consensus.cc:493] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
W20260709 14:52:26.460606  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 57565.8us
I20260709 14:52:26.461651  7846 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41650 (request call id 364) took 1322 ms. Trace:
I20260709 14:52:26.462380  7846 rpcz_store.cc:276] 0709 14:52:25.139431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:26.307480 (+1168049us) service_pool.cc:224] Handling call
0709 14:52:26.459991 (+152511us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:52:26.460255 (+   264us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:52:26.460282 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:52:26.460328 (+    46us) raft_consensus.cc:1645] Marking committed up to 8
0709 14:52:26.460361 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:26.460417 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:26.461437 (+  1020us) spinlock_profiling.cc:243] Waited 152 ms on lock 0x7b540011f650. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae8d8ad 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2 00007fb6891c948c 00007fb6891c88c6 00007fb6891c826f
0709 14:52:26.461550 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":349750016}
I20260709 14:52:26.463222  7893 leader_election.cc:304] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:52:26.465759 11317 consensus_queue.cc:1059] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 14:52:26.408469 11757 leader_election.cc:290] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:26.437755 11935 raft_consensus.cc:515] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:26.468868 11900 consensus_queue.cc:1048] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 14:52:26.470921 11701 raft_consensus.cc:3055] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 14:52:26.471489 11701 raft_consensus.cc:740] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:26.472515 11701 consensus_queue.cc:260] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:26.484119  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:26.486950 11756 raft_consensus.cc:515] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:26.497742  7778 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 3030) took 2011 ms. Trace:
I20260709 14:52:26.470770 11935 leader_election.cc:290] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:26.457756 11847 raft_consensus.cc:3060] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Advancing to term 8
W20260709 14:52:26.499727  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 108405us
I20260709 14:52:26.500926  7819 leader_election.cc:304] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:26.503845 11819 raft_consensus.cc:2804] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 14:52:26.504738 11819 raft_consensus.cc:493] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:26.505353 11819 raft_consensus.cc:3060] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Advancing to term 13
I20260709 14:52:26.511463  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:26.516016  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:26.517931  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:26.518818  7854 raft_consensus.cc:2468] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 11.
I20260709 14:52:26.499233  7851 raft_consensus.cc:1240] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 12. Current term is 13. Ops: []
I20260709 14:52:26.521178  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c563cc7cfbe4d59be4ffc5cf847ce56" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:26.498273  7778 rpcz_store.cc:276] 0709 14:52:24.486817 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:24.487370 (+   553us) service_pool.cc:224] Handling call
0709 14:52:24.488071 (+   701us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:52:24.568546 (+ 80475us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:52:24.568578 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:52:24.582814 (+ 14236us) log.cc:844] Serialized 26 byte log entry
0709 14:52:25.900188 (+1317374us) spinlock_profiling.cc:243] Waited 1.81 ms on lock 0x7b1800410f80. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb690c69de1 00007fb690c765b1 00007fb687d83e07 00007fb690bdeab9 00007fb687da069b 00007fb687d9e93f 00007fb687da0c02 00007fb68aa2820b 00007fb68aa2dd23 00007fb68aa2e0d1 00007fb68ae49a0f
0709 14:52:26.151556 (+251368us) raft_consensus.cc:1645] Marking committed up to 6
0709 14:52:26.151604 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:26.151684 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:52:26.475893 (+324209us) raft_consensus.cc:1685] finished
0709 14:52:26.475925 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:26.497425 (+ 21500us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20809,"raft.queue_time_us":157172,"raft.run_cpu_time_us":403,"raft.run_wall_time_us":19396,"spinlock_wait_cycles":4165376,"thread_start_us":330803,"threads_started":2,"wal-append.queue_time_us":1619774}
I20260709 14:52:26.523814  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:26.532532  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:52:26.535101  8598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 45474.7us
I20260709 14:52:26.510181  7674 catalog_manager.cc:5697] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 8 to 11, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 11 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:52:26.556686  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:26.477330 11848 raft_consensus.cc:515] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:26.470866 11900 raft_consensus.cc:2804] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 14:52:26.548506  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:26.568097  7852 raft_consensus.cc:2468] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 10.
I20260709 14:52:26.570000  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:52:26.566898  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 115822us
I20260709 14:52:26.546712  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:26.570322  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:52:26.566308 11958 log.cc:927] Time spent T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
I20260709 14:52:26.565572 11756 leader_election.cc:290] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:26.572957  7853 raft_consensus.cc:2410] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for term 16 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 14:52:26.568020 11900 raft_consensus.cc:493] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:26.569844 11921 raft_consensus.cc:515] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:26.581619 11900 raft_consensus.cc:3060] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:52:26.572643  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:26.552999  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:26.583065 11848 leader_election.cc:290] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 12 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:26.583393  7854 raft_consensus.cc:2468] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 12.
I20260709 14:52:26.592425 11921 leader_election.cc:290] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:26.583052  7846 raft_consensus.cc:2410] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
W20260709 14:52:26.598423  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 135295us
I20260709 14:52:26.607082  7893 leader_election.cc:304] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:52:26.612442 11963 raft_consensus.cc:2804] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 14:52:26.613833 11963 raft_consensus.cc:493] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:26.614357 11963 raft_consensus.cc:3060] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 14:52:26.621937  7893 leader_election.cc:304] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:52:26.622159 11317 consensus_queue.cc:1048] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 14:52:26.566849  7674 catalog_manager.cc:5697] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 7 to 9, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 9 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:52:26.695796  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:26.695948  7745 leader_election.cc:304] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:26.696933  7846 raft_consensus.cc:2410] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for term 15 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 14:52:26.697446  7894 leader_election.cc:304] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed
W20260709 14:52:26.697937  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 76087.2us
I20260709 14:52:26.698868  7893 leader_election.cc:304] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:52:26.697921  7674 catalog_manager.cc:5697] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:52:26.702720  7674 catalog_manager.cc:5697] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 8 to 9, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 9 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:52:26.707864  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:26.706229  7674 catalog_manager.cc:5697] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 9 to 10, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 10 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:52:26.708186  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:26.714152  7745 leader_election.cc:304] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:26.719460 11946 raft_consensus.cc:2749] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 14:52:26.724472  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:26.724328  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:26.721205  7745 leader_election.cc:304] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:26.726261  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
W20260709 14:52:26.717885  7676 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54364 (request call id 342) took 16632 ms (client timeout 15000 ms). Trace:
I20260709 14:52:26.717200  7674 catalog_manager.cc:5697] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:52:26.729986  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:26.730641  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:26.731805  7674 catalog_manager.cc:5697] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:52:26.726653  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:26.714537  7925 raft_consensus.cc:1275] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 14:52:26.733604  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:26.736150  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:26.717604 11908 raft_consensus.cc:515] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:26.737771  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:26.739570 11908 leader_election.cc:290] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 12 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:26.740082  7926 raft_consensus.cc:1275] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 14:52:26.718035 11701 raft_consensus.cc:3060] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 14:52:26.712643 11962 raft_consensus.cc:2804] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 14:52:26.721463 11895 raft_consensus.cc:2804] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 14:52:26.742403  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:26.717990 11964 raft_consensus.cc:2804] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 14:52:26.743307  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:26.743995 11964 raft_consensus.cc:697] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:26.744256 11895 raft_consensus.cc:493] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:26.744748 11895 raft_consensus.cc:3060] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Advancing to term 13
I20260709 14:52:26.745126 11964 consensus_queue.cc:237] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:26.741236 11962 raft_consensus.cc:493] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:52:26.748005 11962 raft_consensus.cc:3060] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 14:52:26.751032  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
W20260709 14:52:26.752645  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 55302.4us
I20260709 14:52:26.701998 11921 raft_consensus.cc:2804] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 14:52:26.758512  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:26.761755  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:26.762838  7778 raft_consensus.cc:2468] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 15.
I20260709 14:52:26.755478  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:26.717022 11775 raft_consensus.cc:515] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:26.773706 11847 raft_consensus.cc:515] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:26.760903  7745 leader_election.cc:304] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:26.773687  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:26.774374 11775 leader_election.cc:290] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:26.754125  7674 catalog_manager.cc:5697] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:52:26.754810 11946 raft_consensus.cc:2749] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 14:52:26.780633  7745 leader_election.cc:304] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:26.783334  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:26.783397  7745 leader_election.cc:304] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:52:26.728544  7676 rpcz_store.cc:269] 0709 14:52:10.085789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:10.113858 (+ 28069us) service_pool.cc:224] Handling call
0709 14:52:10.372297 (+258439us) spinlock_profiling.cc:243] Waited 11.3 ms on lock 0x7b54003499d4. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf8090 00007fb68ae96f3a 00007fb690c4d1cc 00007fb690d4b37e 00007fb68f20c2a4 00007fb68f20c232 00007fb68f20c161 00007fb68f20c0dc 00007fb68f20b392 00007fb6891c948c 00007fb6891c88c6
0709 14:52:26.717737 (+16345440us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 14:52:21.468960 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 14:52:21.495067 (+ 26107us) write_op.cc:432] Acquiring schema lock in shared mode
0709 14:52:21.495104 (+    37us) write_op.cc:435] Acquired schema lock
0709 14:52:21.495122 (+    18us) tablet.cc:662] Decoding operations
0709 14:52:21.495740 (+   618us) write_op.cc:620] Acquiring the partition lock for write op
0709 14:52:21.495790 (+    50us) write_op.cc:641] Partition lock acquired for write op
0709 14:52:21.495819 (+    29us) tablet.cc:685] Acquiring locks for 3 operations
0709 14:52:21.496154 (+   335us) tablet.cc:701] Row locks acquired
0709 14:52:21.496173 (+    19us) write_op.cc:260] PREPARE: finished
0709 14:52:21.496338 (+   165us) write_op.cc:270] Start()
0709 14:52:21.496476 (+   138us) write_op.cc:276] Timestamp: P: 1783608741496285 usec, L: 0
0709 14:52:21.496498 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 14:52:21.530355 (+ 33857us) log.cc:844] Serialized 1308 byte log entry
0709 14:52:22.359884 (+829529us) op_driver.cc:464] REPLICATION: finished
0709 14:52:22.437220 (+ 77336us) write_op.cc:301] APPLY: starting
0709 14:52:22.440251 (+  3031us) tablet.cc:1367] starting BulkCheckPresence
0709 14:52:22.763470 (+323219us) tablet.cc:1370] finished BulkCheckPresence
0709 14:52:22.788088 (+ 24618us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 14:52:22.976201 (+188113us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 14:52:22.976411 (+   210us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=6,mrs_lookups=0
0709 14:52:22.976462 (+    51us) write_op.cc:312] APPLY: finished
0709 14:52:22.976715 (+   253us) log.cc:844] Serialized 41 byte log entry
0709 14:52:23.022008 (+ 45293us) write_op.cc:489] Releasing partition, row and schema locks
0709 14:52:23.024959 (+  2951us) write_op.cc:454] Released schema lock
0709 14:52:23.030302 (+  5343us) write_op.cc:341] FINISH: Updating metrics
0709 14:52:23.165165 (+134863us) write_op.cc:489] Releasing partition, row and schema locks
0709 14:52:23.168282 (+  3117us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":41229,"reported_tablets":39,"spinlock_wait_cycles":26032512,"child_traces":[["op",{"apply.queue_time_us":48175,"apply.run_cpu_time_us":15397,"apply.run_wall_time_us":682928,"cfile_cache_hit":12,"cfile_cache_hit_bytes":12504,"num_ops":3,"prepare.queue_time_us":395309,"prepare.run_cpu_time_us":4272,"prepare.run_wall_time_us":85154,"replication_time_us":846593,"thread_start_us":93784,"threads_started":1}]]}
I20260709 14:52:26.786748 11919 raft_consensus.cc:2804] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 14:52:26.787328 11919 raft_consensus.cc:493] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:26.787737 11919 raft_consensus.cc:3060] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:52:26.766652 11921 raft_consensus.cc:493] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:26.766991 11767 raft_consensus.cc:2804] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 14:52:26.792012  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:26.796446  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:26.798032  7850 raft_consensus.cc:1240] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 7. Current term is 8. Ops: []
I20260709 14:52:26.795811 11921 raft_consensus.cc:3060] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Advancing to term 13
I20260709 14:52:26.791143 11942 raft_consensus.cc:3060] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Advancing to term 14
I20260709 14:52:26.795874 11767 raft_consensus.cc:493] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:52:26.801927 11767 raft_consensus.cc:3060] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:52:26.788708 11908 raft_consensus.cc:2804] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 14:52:26.803831 11908 raft_consensus.cc:493] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:26.804289 11908 raft_consensus.cc:3060] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Advancing to term 13
I20260709 14:52:26.807456 11847 leader_election.cc:290] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 8 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:26.810793  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258d6c2dda954bf5b65930fde8ecb9f3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:26.793286  7745 leader_election.cc:304] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:26.798636 11775 consensus_queue.cc:1048] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 14:52:26.804401 11910 raft_consensus.cc:515] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:26.818193  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:26.821866 11847 raft_consensus.cc:493] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:26.822153  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:26.822736  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:26.824555 11847 raft_consensus.cc:515] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:26.824846 11946 raft_consensus.cc:2804] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 14:52:26.793723  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:26.826370  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:26.826617  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:26.827234 11910 leader_election.cc:290] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:26.796707  7924 raft_consensus.cc:2468] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 12.
I20260709 14:52:26.834367  7745 leader_election.cc:304] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 9418391fa82a42c79c6cad13ba91d964
I20260709 14:52:26.843402  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:26.843971  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:26.846223  7922 raft_consensus.cc:1275] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 14:52:26.841487  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:26.826756  7894 leader_election.cc:304] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:52:26.832971  7850 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 3374) took 1669 ms. Trace:
I20260709 14:52:26.842226  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:26.830060 11775 consensus_queue.cc:1048] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.007s
I20260709 14:52:26.789402  7674 catalog_manager.cc:5697] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 10 to 11, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 11 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:52:26.854127  7850 rpcz_store.cc:276] 0709 14:52:25.163664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:26.317799 (+1154135us) service_pool.cc:224] Handling call
0709 14:52:26.376164 (+ 58365us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:52:26.805862 (+429698us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:26.832703 (+ 26841us) spinlock_profiling.cc:243] Waited 422 ms on lock 0x7b540013c9d4. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae8ee01 00007fb68ae8d83e 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2 00007fb6891c948c 00007fb6891c88c6
0709 14:52:26.832896 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":969815808}
I20260709 14:52:26.854576 11791 raft_consensus.cc:2804] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 14:52:26.856505  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:26.857373  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c563cc7cfbe4d59be4ffc5cf847ce56" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:26.856248  7745 leader_election.cc:304] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 9418391fa82a42c79c6cad13ba91d964
I20260709 14:52:26.835019 11922 consensus_queue.cc:1048] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 14:52:26.835495 11946 raft_consensus.cc:493] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:26.869669  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18d29d52d304c87b930d4fb5eaf50b1" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:26.871007  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:26.872218  7819 leader_election.cc:304] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:26.874431  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:26.875296  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:26.876264  7776 raft_consensus.cc:2468] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 9.
I20260709 14:52:26.846549 11963 raft_consensus.cc:515] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:26.875145  7674 catalog_manager.cc:5697] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:52:26.880007  7920 raft_consensus.cc:2393] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 14: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:52:26.879659  7674 catalog_manager.cc:5697] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 10 to 11, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 11 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:52:26.881870  7674 catalog_manager.cc:5697] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:52:26.883337  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:26.883827  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:26.885175  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:26.885385  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:26.886656  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:26.887161  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:26.888249  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:26.888408  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:26.890254  7674 catalog_manager.cc:5697] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 11 to 13, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 13 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:52:26.884162  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:26.893810  7819 leader_election.cc:304] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:26.894775  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:26.873955 11949 raft_consensus.cc:2804] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 14:52:26.892824  7674 catalog_manager.cc:5697] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 9 to 12, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 12 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:52:26.897486  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:26.898711  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:26.900902  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:26.900027  7674 catalog_manager.cc:5697] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:52:26.902407  7922 raft_consensus.cc:2468] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 12.
I20260709 14:52:26.906040  7674 catalog_manager.cc:5697] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:52:26.917752  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:26.874343 11946 raft_consensus.cc:3060] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:52:26.874481 11922 raft_consensus.cc:2804] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 14:52:26.865909 11791 raft_consensus.cc:493] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9418391fa82a42c79c6cad13ba91d964)
I20260709 14:52:26.839048 11894 raft_consensus.cc:515] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:26.921732  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:26.927202 11922 raft_consensus.cc:493] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9418391fa82a42c79c6cad13ba91d964)
I20260709 14:52:26.927834 11922 raft_consensus.cc:3060] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Advancing to term 4
W20260709 14:52:26.933997  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 77949.8us
I20260709 14:52:26.935245  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:26.935017  7745 leader_election.cc:304] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:26.908290  7674 catalog_manager.cc:5697] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 5 to 8, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 8 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:52:26.921862  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:26.920197 11756 raft_consensus.cc:2749] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 14:52:26.841096 11954 raft_consensus.cc:515] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:26.961990  7849 raft_consensus.cc:1240] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 10. Current term is 11. Ops: []
I20260709 14:52:26.962229 11921 raft_consensus.cc:515] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:26.963624 11954 leader_election.cc:290] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 11 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:26.965921  7849 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 3381) took 1063 ms. Trace:
I20260709 14:52:26.966244  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:26.966583  7849 rpcz_store.cc:276] 0709 14:52:25.902997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:26.393662 (+490665us) service_pool.cc:224] Handling call
0709 14:52:26.394041 (+   379us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:52:26.964669 (+570628us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:26.965622 (+   953us) spinlock_profiling.cc:243] Waited 568 ms on lock 0x7b54002cabd4. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae8ee01 00007fb68ae8d83e 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2 00007fb6891c948c 00007fb6891c88c6
0709 14:52:26.965850 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1305529728}
I20260709 14:52:26.969738  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:26.937376 11895 raft_consensus.cc:515] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:26.974623  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:26.976354 11895 leader_election.cc:290] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:26.992064 11847 leader_election.cc:290] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:26.873600 11910 raft_consensus.cc:493] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:26.921833  7819 leader_election.cc:304] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:26.889685 11935 raft_consensus.cc:493] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:26.879664 11963 leader_election.cc:290] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:26.949556  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:27.028995  7771 raft_consensus.cc:2468] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 9.
I20260709 14:52:27.030452  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:27.031246  7771 raft_consensus.cc:3060] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Advancing to term 13
I20260709 14:52:26.936093  7776 raft_consensus.cc:2468] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 14.
I20260709 14:52:27.033165  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:27.033905  7776 raft_consensus.cc:2468] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 11.
I20260709 14:52:26.953694  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:26.954846 11962 raft_consensus.cc:515] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:26.934478 11791 raft_consensus.cc:3060] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Advancing to term 8
I20260709 14:52:26.900993 11848 raft_consensus.cc:2749] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 14:52:26.900893 11949 raft_consensus.cc:493] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:52:26.926005 11900 raft_consensus.cc:515] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:26.959316 11894 leader_election.cc:290] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 12 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:26.997792  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:27.046746  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:27.047915  7776 raft_consensus.cc:2393] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 11: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:52:26.999796  7674 catalog_manager.cc:5697] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 9 to 11, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 11 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:52:27.048368  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:27.049124  7674 catalog_manager.cc:5697] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 11 to 13, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 13 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
W20260709 14:52:27.014422  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 92755.7us
W20260709 14:52:27.021103  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 86189.9us
I20260709 14:52:27.051942  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:27.050621  7674 catalog_manager.cc:5697] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:52:27.037793  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:27.053359  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:27.034988  7777 raft_consensus.cc:2468] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 11.
I20260709 14:52:27.053778  7772 raft_consensus.cc:2468] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 11.
I20260709 14:52:27.052663  7770 raft_consensus.cc:2468] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 10.
I20260709 14:52:26.965013 11921 leader_election.cc:290] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:27.053946  7779 raft_consensus.cc:2468] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 11.
I20260709 14:52:26.956991 11767 raft_consensus.cc:515] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:27.046648  7773 raft_consensus.cc:2468] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 13.
I20260709 14:52:27.094077  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:27.098369  7777 raft_consensus.cc:2468] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 9.
I20260709 14:52:27.055990  7674 catalog_manager.cc:5697] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:52:27.096248  7925 raft_consensus.cc:2393] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 13: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:52:27.052975  7819 leader_election.cc:304] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:27.056938 11947 raft_consensus.cc:493] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:27.089916 11895 raft_consensus.cc:493] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:27.130313 11895 raft_consensus.cc:515] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:27.127398  7674 catalog_manager.cc:5697] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:52:27.108119 11962 leader_election.cc:290] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 13 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:27.057011 11775 raft_consensus.cc:2804] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 14:52:27.021427 11910 raft_consensus.cc:515] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:27.038707 11919 raft_consensus.cc:515] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:27.109903  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:27.038962 11847 raft_consensus.cc:2749] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 14:52:27.058238 11971 raft_consensus.cc:493] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:27.038352 11949 raft_consensus.cc:3060] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 14:52:27.038290 11756 raft_consensus.cc:493] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:27.132534  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
W20260709 14:52:27.132756  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 80463.2us
I20260709 14:52:27.163092  7819 leader_election.cc:304] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:52:27.164871  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:27.168511  7819 leader_election.cc:304] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:52:27.038306 11935 raft_consensus.cc:515] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:27.157356  7777 raft_consensus.cc:3060] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Advancing to term 12
W20260709 14:52:27.126084 11819 consensus_meta.cc:287] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent flushing consensus metadata: real 0.620s	user 0.013s	sys 0.004s
I20260709 14:52:27.175104 11900 leader_election.cc:290] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:27.116413 11908 raft_consensus.cc:515] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:27.170591 11756 raft_consensus.cc:515] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:27.178393 11908 leader_election.cc:290] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:27.180063 11756 leader_election.cc:290] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:27.147531 11894 raft_consensus.cc:2749] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 14:52:27.186767  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:27.159680  7674 catalog_manager.cc:5697] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:52:27.187292  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
W20260709 14:52:27.201395  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 275102us
I20260709 14:52:27.201786  7845 raft_consensus.cc:2393] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 8: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:52:27.203014  7777 raft_consensus.cc:2468] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 12.
I20260709 14:52:27.187536  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:27.204293  7894 leader_election.cc:304] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:27.207463  7674 catalog_manager.cc:5697] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:52:27.211477  7674 catalog_manager.cc:5697] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:52:27.214051  7771 raft_consensus.cc:2468] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 13.
I20260709 14:52:27.181721 11954 raft_consensus.cc:2804] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 14:52:27.209726 11756 raft_consensus.cc:2804] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader election won for term 12
I20260709 14:52:27.129464 11947 raft_consensus.cc:515] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:27.215202 11900 raft_consensus.cc:2804] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 14:52:27.210142 11847 raft_consensus.cc:493] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:27.188644  7744 leader_election.cc:304] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:27.216106  7674 catalog_manager.cc:5697] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 7 to 10, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 10 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:52:27.202618 11977 consensus_queue.cc:1048] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 14:52:27.165201 11971 raft_consensus.cc:515] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:27.184129 11819 raft_consensus.cc:515] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:27.214488 11894 raft_consensus.cc:493] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:27.221658 11954 raft_consensus.cc:493] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:27.237854  7894 leader_election.cc:304] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
W20260709 14:52:27.233177 11829 consensus_meta.cc:287] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent flushing consensus metadata: real 0.799s	user 0.018s	sys 0.000s
I20260709 14:52:27.230865 11942 raft_consensus.cc:2749] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 14:52:27.246130  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 57594us
I20260709 14:52:27.248061  7772 raft_consensus.cc:1275] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 14:52:27.241792  7674 catalog_manager.cc:5697] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 4 to 7, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 7 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:52:27.251729  7744 leader_election.cc:304] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:27.253439 11982 raft_consensus.cc:493] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:27.254629  7744 leader_election.cc:304] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:27.252413  7894 leader_election.cc:304] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:27.255664 11982 raft_consensus.cc:515] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:27.247192 11954 raft_consensus.cc:3060] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Advancing to term 14
I20260709 14:52:27.234417 11900 raft_consensus.cc:493] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:52:27.247401 11908 raft_consensus.cc:2749] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 14:52:27.262830 11942 raft_consensus.cc:2749] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 14:52:27.284106 11819 leader_election.cc:290] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:27.273628 11962 consensus_queue.cc:1048] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.006s
I20260709 14:52:27.285301 11819 raft_consensus.cc:493] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:27.286098 11910 leader_election.cc:290] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:27.286013 11819 raft_consensus.cc:515] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:27.258107 11932 consensus_queue.cc:1048] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 14:52:27.286896 11957 consensus_queue.cc:1048] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 14:52:27.288409 11819 leader_election.cc:290] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:27.288923 11919 leader_election.cc:290] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:27.274475 11767 leader_election.cc:290] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:27.289273 11971 leader_election.cc:290] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:27.268453 11829 raft_consensus.cc:2804] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 14:52:27.289968 11829 raft_consensus.cc:493] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:27.290390 11829 raft_consensus.cc:3060] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 14:52:27.294620 11963 consensus_queue.cc:1048] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 14:52:27.276361 11947 leader_election.cc:290] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:27.280165 11935 leader_election.cc:290] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:27.269773 11900 raft_consensus.cc:3060] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:52:27.238212 11847 raft_consensus.cc:515] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:27.303716 11847 leader_election.cc:290] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:27.304853 11954 raft_consensus.cc:515] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:27.305840 11775 raft_consensus.cc:493] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:27.306198  7846 raft_consensus.cc:1240] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 14:52:27.281499 11895 leader_election.cc:290] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:27.247484 11894 raft_consensus.cc:515] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:27.310772 11982 leader_election.cc:290] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:27.311422 11894 leader_election.cc:290] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:52:27.298686 11970 log.cc:927] Time spent T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
W20260709 14:52:27.300846 11968 log.cc:927] Time spent T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260709 14:52:27.327910  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 73388us
I20260709 14:52:27.258383 11960 raft_consensus.cc:2804] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 14:52:27.329588 11960 raft_consensus.cc:493] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:27.306496 11775 raft_consensus.cc:3060] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:52:27.330385  7744 leader_election.cc:304] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:27.331514 11921 raft_consensus.cc:2749] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 14:52:27.317880 11946 raft_consensus.cc:515] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:27.334156  7744 leader_election.cc:304] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:27.335145 11921 raft_consensus.cc:2749] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 14:52:27.319432 11767 consensus_queue.cc:1048] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.007s
I20260709 14:52:27.336131  7744 leader_election.cc:304] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:27.337430 11921 raft_consensus.cc:2804] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 14:52:27.335922 11946 leader_election.cc:290] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 12 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:27.337873 11921 raft_consensus.cc:493] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:27.338080  7744 leader_election.cc:304] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:27.330438 11960 raft_consensus.cc:3060] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 14:52:27.340164 11919 raft_consensus.cc:2749] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 14:52:27.340270  7744 leader_election.cc:304] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:27.338392  7778 raft_consensus.cc:2393] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 12: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:52:27.338300 11921 raft_consensus.cc:3060] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Advancing to term 13
I20260709 14:52:27.299734 11976 raft_consensus.cc:2749] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 14:52:27.312937 11980 log.cc:927] Time spent T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 14:52:27.342218  7744 leader_election.cc:304] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:27.311661 11922 raft_consensus.cc:515] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
W20260709 14:52:27.297732  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 244193us
I20260709 14:52:27.354056  7745 leader_election.cc:304] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:27.356410  7745 leader_election.cc:304] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:27.341544 11949 raft_consensus.cc:515] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:27.342521 11756 raft_consensus.cc:697] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:52:27.355046 11946 consensus_queue.cc:1048] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.005s
I20260709 14:52:27.359850 11756 consensus_queue.cc:237] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:27.357761 11977 raft_consensus.cc:2804] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 14:52:27.363826 11977 raft_consensus.cc:493] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:27.364286 11977 raft_consensus.cc:3060] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:52:27.368654  8640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9441e831627143a991a1556dcdce71e3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9418391fa82a42c79c6cad13ba91d964"
I20260709 14:52:27.344636 11919 raft_consensus.cc:2749] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 14:52:27.373870  7744 leader_election.cc:304] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:27.382552  6549 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 14:52:27.387450  7819 leader_election.cc:304] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:27.390770 11983 raft_consensus.cc:493] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:27.391418 11317 consensus_queue.cc:1048] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 14:52:27.392073 11982 raft_consensus.cc:2804] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 14:52:27.379050 11949 leader_election.cc:290] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:27.393492  7819 leader_election.cc:304] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 9418391fa82a42c79c6cad13ba91d964
I20260709 14:52:27.395104  7819 leader_election.cc:304] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:27.396008  7819 leader_election.cc:304] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:27.377146 11942 raft_consensus.cc:2749] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 14:52:27.392622 11982 raft_consensus.cc:493] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:27.375658 11922 leader_election.cc:290] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68:42321)
I20260709 14:52:27.397529 11982 raft_consensus.cc:3060] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Advancing to term 16
I20260709 14:52:27.392280 11954 leader_election.cc:290] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 14 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:27.398751 11954 raft_consensus.cc:2749] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 14:52:27.399577 11954 raft_consensus.cc:2804] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 14:52:27.399955 11954 raft_consensus.cc:493] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:27.400297 11947 consensus_queue.cc:1059] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 14:52:27.401420 11947 consensus_queue.cc:1243] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer 3876b8ee8d744cb18e91d97aae93b1ac log is divergent from this leader: its last log entry 11.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 14:52:27.402088 11947 raft_consensus.cc:3055] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 14:52:27.402594 11947 raft_consensus.cc:740] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:27.370138 11894 raft_consensus.cc:493] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:27.404132 11894 raft_consensus.cc:515] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:27.405570 11919 raft_consensus.cc:2749] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 14:52:27.406361 11984 raft_consensus.cc:2804] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 14:52:27.407063  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:27.407064 11984 raft_consensus.cc:493] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:27.409474  7744 leader_election.cc:304] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:27.409474  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258d6c2dda954bf5b65930fde8ecb9f3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:27.410205 11952 consensus_queue.cc:1059] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 14:52:27.355654 11791 raft_consensus.cc:515] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:52:27.412053 11952 consensus_queue.cc:1059] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 14:52:27.412904 11949 raft_consensus.cc:3055] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 14:52:27.413444 11949 raft_consensus.cc:740] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:27.414332 11919 raft_consensus.cc:2749] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 14:52:27.417953 11847 raft_consensus.cc:2804] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 14:52:27.418653 11847 raft_consensus.cc:493] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:27.419277 11847 raft_consensus.cc:3060] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:52:27.414815 11949 consensus_queue.cc:260] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:27.409510 11984 raft_consensus.cc:3060] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Advancing to term 13
I20260709 14:52:27.421598  7744 leader_election.cc:304] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:27.422794  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:27.423763  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:27.428432  7925 raft_consensus.cc:2468] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 12.
I20260709 14:52:27.424017  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:27.425115  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:27.396870  7819 leader_election.cc:304] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:27.426528  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:27.353219 11829 raft_consensus.cc:515] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:27.429895  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:27.434968  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:27.436968  7819 leader_election.cc:304] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:27.412997 11952 raft_consensus.cc:3055] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 14:52:27.439175  7819 leader_election.cc:304] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:27.432467  7744 leader_election.cc:304] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:27.441332  7928 raft_consensus.cc:1240] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 9. Current term is 10. Ops: []
I20260709 14:52:27.442777  7819 leader_election.cc:304] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:27.444494  7819 leader_election.cc:304] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:27.412636 11977 raft_consensus.cc:515] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:27.452342  7819 leader_election.cc:304] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:27.454779 11977 leader_election.cc:290] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:27.445596 11819 raft_consensus.cc:2804] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 14:52:27.391436 11983 raft_consensus.cc:515] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:27.471989 11819 raft_consensus.cc:493] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:27.472560 11819 raft_consensus.cc:3060] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:52:27.474710 11983 leader_election.cc:290] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:27.447614 11895 raft_consensus.cc:2804] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 14:52:27.475579 11895 raft_consensus.cc:493] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
W20260709 14:52:27.475847  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 43507.7us
I20260709 14:52:27.476222 11829 leader_election.cc:290] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 13 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:27.470198 11960 raft_consensus.cc:515] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:27.472432  7819 leader_election.cc:304] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:27.449170 11848 raft_consensus.cc:2804] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 14:52:27.445719 11756 raft_consensus.cc:2804] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 14:52:27.484241  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:27.484674 11756 raft_consensus.cc:493] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:27.484854  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:27.485541 11848 raft_consensus.cc:493] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:27.485945 11848 raft_consensus.cc:3060] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:52:27.487030  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:27.487560 11791 leader_election.cc:290] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68:42321)
I20260709 14:52:27.488029  7922 raft_consensus.cc:2410] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 14:52:27.475915 11977 raft_consensus.cc:2749] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 14:52:27.489642  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:27.489804  8640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18d29d52d304c87b930d4fb5eaf50b1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9418391fa82a42c79c6cad13ba91d964"
I20260709 14:52:27.471892 11985 raft_consensus.cc:2804] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 14:52:27.441458 11952 raft_consensus.cc:740] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:27.477582 11895 raft_consensus.cc:3060] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:52:27.400377 11954 raft_consensus.cc:3060] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:52:27.446350 11935 raft_consensus.cc:2804] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 14:52:27.493551 11935 raft_consensus.cc:493] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:27.494135 11935 raft_consensus.cc:3060] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:52:27.495121  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:27.474733 11894 leader_election.cc:290] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:27.496423  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:27.484150  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:27.497154  7919 raft_consensus.cc:2468] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 11.
I20260709 14:52:27.485200 11756 raft_consensus.cc:3060] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Advancing to term 15
I20260709 14:52:27.500396 11900 raft_consensus.cc:515] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:27.509523  7927 raft_consensus.cc:1240] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 13. Current term is 14. Ops: []
I20260709 14:52:27.403920 11947 consensus_queue.cc:260] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:27.510996 11947 raft_consensus.cc:3060] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 14:52:27.442440 11976 raft_consensus.cc:2749] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 14:52:27.491705 11985 raft_consensus.cc:493] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:27.504212  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:27.513875 11985 raft_consensus.cc:3060] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:52:27.514215  7924 raft_consensus.cc:2468] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 11.
I20260709 14:52:27.505795  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:27.501797 11952 consensus_queue.cc:260] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:27.516208 11952 raft_consensus.cc:3060] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:52:27.506942  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:27.507663 11949 raft_consensus.cc:3060] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 14:52:27.521883 11960 leader_election.cc:290] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:27.522143  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:27.523344 11894 raft_consensus.cc:2804] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 14:52:27.523988 11894 raft_consensus.cc:493] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:27.524487 11894 raft_consensus.cc:3060] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Advancing to term 14
I20260709 14:52:27.491514  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:27.525355  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
W20260709 14:52:27.525586  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 53234.9us
I20260709 14:52:27.508042 11921 raft_consensus.cc:515] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:27.526469  7819 leader_election.cc:304] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:27.482766  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:27.482159  7744 leader_election.cc:304] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:27.530256 11900 leader_election.cc:290] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 11 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:27.533474 11983 raft_consensus.cc:2804] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 14:52:27.534099 11983 raft_consensus.cc:493] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:27.531090 11921 leader_election.cc:290] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:27.535310 11976 consensus_queue.cc:1059] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 14:52:27.535673 11848 raft_consensus.cc:515] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:27.534512 11983 raft_consensus.cc:3060] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:52:27.538262 11848 leader_election.cc:290] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 11 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:27.536635 11982 raft_consensus.cc:515] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:27.544019 11982 leader_election.cc:290] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 16 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:52:27.548219  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 66234.9us
I20260709 14:52:27.548273  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:27.548833  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:27.549670  7846 raft_consensus.cc:3060] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Advancing to term 13
I20260709 14:52:27.551347  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:27.554545  7854 raft_consensus.cc:3060] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:52:27.555063  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18d29d52d304c87b930d4fb5eaf50b1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:27.558348  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:27.558633  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:27.559190  7848 raft_consensus.cc:3060] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:52:27.556632  7744 leader_election.cc:304] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:27.551672  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:27.559548  7851 raft_consensus.cc:2393] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 13: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:52:27.555922  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9441e831627143a991a1556dcdce71e3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:27.563115  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:27.563980  7847 raft_consensus.cc:3060] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:52:27.563437  7745 leader_election.cc:304] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 3876b8ee8d744cb18e91d97aae93b1ac, 9418391fa82a42c79c6cad13ba91d964
I20260709 14:52:27.565995  7744 leader_election.cc:304] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:27.569567  7745 leader_election.cc:304] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 3876b8ee8d744cb18e91d97aae93b1ac, 9418391fa82a42c79c6cad13ba91d964
W20260709 14:52:27.586839  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:27.608140  7846 raft_consensus.cc:2468] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 13.
I20260709 14:52:27.617429  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:27.618152  7923 raft_consensus.cc:3060] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Advancing to term 13
W20260709 14:52:27.621850  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 52373us
I20260709 14:52:27.622509  7848 raft_consensus.cc:2468] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 12.
I20260709 14:52:27.623179  7745 leader_election.cc:304] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:27.554028 11976 raft_consensus.cc:3060] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Advancing to term 14
I20260709 14:52:27.626825  7854 raft_consensus.cc:2468] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 11.
I20260709 14:52:27.626860  7745 leader_election.cc:304] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
W20260709 14:52:27.628913  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 63037.8us
I20260709 14:52:27.630699 11942 raft_consensus.cc:2804] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader election won for term 13
I20260709 14:52:27.631573 11932 raft_consensus.cc:2749] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 14:52:27.633956 11895 raft_consensus.cc:515] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:27.636776  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258d6c2dda954bf5b65930fde8ecb9f3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:27.637899  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:27.638269  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:27.639925  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:27.642876 11942 raft_consensus.cc:697] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:52:27.646543  7744 leader_election.cc:304] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:27.646932  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:27.643987 11942 consensus_queue.cc:237] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:27.603403 11977 raft_consensus.cc:2749] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 14:52:27.652442  7922 raft_consensus.cc:1240] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 12. Current term is 13. Ops: []
I20260709 14:52:27.614447 11791 raft_consensus.cc:2749] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 14:52:27.651032  7744 leader_election.cc:304] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:27.559990 11756 raft_consensus.cc:515] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:27.548974 11819 raft_consensus.cc:515] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:27.553022 11954 raft_consensus.cc:515] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:27.654462  7745 leader_election.cc:304] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:27.667518  7744 leader_election.cc:304] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:27.563483 11775 raft_consensus.cc:515] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:27.683866  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:27.630888 11922 raft_consensus.cc:2749] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 14:52:27.670851  7847 raft_consensus.cc:2468] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 11.
I20260709 14:52:27.672637  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:27.686625  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:27.652266 11971 raft_consensus.cc:2749] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 14:52:27.676777  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:27.676975  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783e4874513449ef9084b833f188a6d3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:27.715410  7925 raft_consensus.cc:2468] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 9.
I20260709 14:52:27.716578  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:27.677688  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:27.717270  7923 raft_consensus.cc:2468] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 13.
I20260709 14:52:27.717834  7920 raft_consensus.cc:2468] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 12.
I20260709 14:52:27.718585  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:27.719028  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:27.682713  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:27.675588  7744 leader_election.cc:304] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:27.686040 11977 raft_consensus.cc:2749] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 14:52:27.688218 11921 raft_consensus.cc:2804] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader election won for term 11
I20260709 14:52:27.733805 11791 raft_consensus.cc:2749] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 14:52:27.735461  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:27.689013  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:27.673739 11946 raft_consensus.cc:2749] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 14:52:27.699083 11756 leader_election.cc:290] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:27.701603 11775 leader_election.cc:290] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 12 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:27.704409 11819 leader_election.cc:290] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 12 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:27.651893 11908 raft_consensus.cc:2804] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader election won for term 12
I20260709 14:52:27.706305  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:27.708186 11982 raft_consensus.cc:493] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
W20260709 14:52:27.707154  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 52846.1us
I20260709 14:52:27.747812  7846 raft_consensus.cc:1240] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 10. Current term is 11. Ops: []
I20260709 14:52:27.707365 11985 raft_consensus.cc:515] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:27.758476  7745 leader_election.cc:304] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:27.712108 11983 raft_consensus.cc:515] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:27.720213  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:27.720945  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:52:27.721133  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 45627.3us
I20260709 14:52:27.764637  7744 leader_election.cc:304] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:27.723472  7851 raft_consensus.cc:1240] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 14:52:27.728648 11932 raft_consensus.cc:3055] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 LEADER]: Stepping down as leader of term 13
I20260709 14:52:27.765445 11932 raft_consensus.cc:740] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:52:27.730300 11954 leader_election.cc:290] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 10 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:27.731537 11847 raft_consensus.cc:515] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:27.732615  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:27.733649  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:27.746371  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:27.710613 11895 leader_election.cc:290] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 12 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:27.767839  7744 leader_election.cc:304] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:27.776697  7744 leader_election.cc:304] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:52:27.768555  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 64337.6us
I20260709 14:52:27.733667 11921 raft_consensus.cc:697] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:52:27.766413 11977 raft_consensus.cc:2804] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader election won for term 11
I20260709 14:52:27.784413 11985 leader_election.cc:290] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 12 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:27.786960 11847 leader_election.cc:290] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 10 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:27.788344 11932 consensus_queue.cc:260] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:27.792869  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:27.798185  7928 raft_consensus.cc:2410] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 14:52:27.795413  7744 leader_election.cc:304] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:27.769752 11908 raft_consensus.cc:697] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:52:27.769515 11775 raft_consensus.cc:2749] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 14:52:27.803488  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:27.803802  7919 raft_consensus.cc:2468] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 8.
I20260709 14:52:27.806594  7744 leader_election.cc:304] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:27.807791  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:27.840857  7926 raft_consensus.cc:3060] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:52:27.772621 11756 raft_consensus.cc:493] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:27.775918 11942 raft_consensus.cc:2804] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 14:52:27.843132  7819 leader_election.cc:304] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:27.845671  7850 raft_consensus.cc:1240] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 11. Current term is 12. Ops: []
I20260709 14:52:27.766139 11982 raft_consensus.cc:515] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:27.847942  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
W20260709 14:52:27.871891  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:27.854537  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:27.797029 11922 raft_consensus.cc:2749] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 14:52:27.847074 11996 log.cc:927] Time spent T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 14:52:27.845561 11932 raft_consensus.cc:3060] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Advancing to term 14
I20260709 14:52:27.879369  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:27.883985  7819 leader_election.cc:304] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:27.894318  7819 leader_election.cc:304] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:52:27.865422 11977 raft_consensus.cc:697] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:52:27.921186 11977 consensus_queue.cc:237] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:27.889168 11985 raft_consensus.cc:2749] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 14:52:27.874161 11942 raft_consensus.cc:493] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:27.870980 11995 raft_consensus.cc:2749] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 14:52:27.925741 11942 raft_consensus.cc:3060] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Advancing to term 13
I20260709 14:52:27.928170 11982 leader_election.cc:290] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:27.883961 11848 raft_consensus.cc:2749] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 14:52:27.869990 11756 raft_consensus.cc:515] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:27.888855 11847 consensus_queue.cc:1059] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 14:52:27.940167 11847 raft_consensus.cc:3055] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 LEADER]: Stepping down as leader of term 9
I20260709 14:52:27.940737 11847 raft_consensus.cc:740] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:52:27.877863 11946 raft_consensus.cc:493] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:27.941824 11946 raft_consensus.cc:515] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:27.945528 11756 leader_election.cc:290] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:27.910789 11935 raft_consensus.cc:515] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:27.947355  7853 raft_consensus.cc:1240] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 11. Current term is 12. Ops: []
I20260709 14:52:27.911713 11895 consensus_queue.cc:1059] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 14:52:27.950397 11895 raft_consensus.cc:3055] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 LEADER]: Stepping down as leader of term 13
I20260709 14:52:27.951089 11895 raft_consensus.cc:740] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:52:27.912930 11947 raft_consensus.cc:493] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:27.953991 11947 raft_consensus.cc:515] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:27.913714 11921 consensus_queue.cc:237] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:27.957561 11908 consensus_queue.cc:237] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:27.968967  7849 raft_consensus.cc:1240] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 9. Current term is 10. Ops: []
I20260709 14:52:27.915585  7926 raft_consensus.cc:2468] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 12.
I20260709 14:52:27.919340 11894 raft_consensus.cc:515] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:27.924790 11954 raft_consensus.cc:2804] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 14:52:27.994131  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 88818.5us
I20260709 14:52:28.008621  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:28.022055 11756 consensus_queue.cc:1059] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 14:52:28.023643 11848 raft_consensus.cc:3055] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 LEADER]: Stepping down as leader of term 12
I20260709 14:52:28.024339 11848 raft_consensus.cc:740] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:52:28.025395 11848 consensus_queue.cc:260] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:28.026748 11848 raft_consensus.cc:3060] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Advancing to term 13
I20260709 14:52:27.879786 11984 raft_consensus.cc:515] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:27.900573 11971 raft_consensus.cc:2749] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 14:52:27.989636 11994 log.cc:927] Time spent T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 14:52:27.949236 11935 leader_election.cc:290] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 12 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:28.042500  7850 raft_consensus.cc:1240] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 13. Current term is 14. Ops: []
I20260709 14:52:28.063102  7849 raft_consensus.cc:1240] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 12. Current term is 13. Ops: []
I20260709 14:52:28.006590 11954 raft_consensus.cc:493] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:28.071938  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:28.073057  7851 raft_consensus.cc:2393] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 14: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:52:28.074599  7851 raft_consensus.cc:1240] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 14:52:27.953087 11895 consensus_queue.cc:260] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:28.075142  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:52:28.079828  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 273336us
I20260709 14:52:28.080396  7853 raft_consensus.cc:2393] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 12: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:52:28.076483  7851 raft_consensus.cc:1240] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
W20260709 14:52:28.081400  7745 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:28.081070  7744 leader_election.cc:304] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:28.023695  7819 leader_election.cc:304] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
W20260709 14:52:28.084604  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 61073us
I20260709 14:52:28.086364  7819 leader_election.cc:304] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:28.086530  7853 raft_consensus.cc:1240] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 11. Current term is 12. Ops: [9.6-11.7]
W20260709 14:52:28.066745 11952 consensus_meta.cc:287] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent flushing consensus metadata: real 0.550s	user 0.013s	sys 0.000s
I20260709 14:52:28.088454 11946 leader_election.cc:290] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:28.091939 11985 raft_consensus.cc:2804] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 14:52:28.083281 11971 raft_consensus.cc:2749] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 14:52:28.110559  7924 raft_consensus.cc:2410] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for term 11 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 14:52:28.092948 11942 raft_consensus.cc:515] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:28.093936  7848 raft_consensus.cc:1240] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 14:52:28.096320 11982 raft_consensus.cc:2804] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Leader election won for term 13
W20260709 14:52:28.100149  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:28.119146  7852 raft_consensus.cc:1240] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 9. Current term is 10. Ops: []
I20260709 14:52:28.088119  7819 leader_election.cc:304] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:28.058553 11847 consensus_queue.cc:260] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:28.109165  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:28.074340 11954 raft_consensus.cc:3060] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:52:28.105899 11895 raft_consensus.cc:3060] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Advancing to term 14
I20260709 14:52:28.084182 11947 leader_election.cc:290] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:28.127826  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:28.114988  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:28.132323 11756 raft_consensus.cc:2804] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 14:52:28.113525 11983 leader_election.cc:290] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 10 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:52:28.137569  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:28.133226 11756 raft_consensus.cc:493] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:28.106755 11985 raft_consensus.cc:493] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:28.146147 11756 raft_consensus.cc:3060] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Advancing to term 13
I20260709 14:52:28.151268 11982 raft_consensus.cc:697] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:52:28.152415 11982 consensus_queue.cc:237] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:28.123203 11976 raft_consensus.cc:2749] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 14:52:28.157998 11894 leader_election.cc:290] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 14 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:28.158691 11984 leader_election.cc:290] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:28.146423 11985 raft_consensus.cc:3060] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:52:28.156930 11942 leader_election.cc:290] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:28.150179 11847 raft_consensus.cc:3060] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:52:28.179050 11756 raft_consensus.cc:515] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:28.182046 12001 log.cc:927] Time spent T 00000000000000000000000000000000 P 133636659113430cb53b321cb0b1d9ee: Append to log took a long time: real 0.093s	user 0.004s	sys 0.000s
I20260709 14:52:28.184015 11756 leader_election.cc:290] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:28.098048  7744 leader_election.cc:304] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:52:28.239636  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 151388us
W20260709 14:52:28.243553  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 145484us
I20260709 14:52:28.246173  7744 leader_election.cc:304] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:28.254789  7744 leader_election.cc:304] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:28.255270  7845 raft_consensus.cc:1240] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 9. Current term is 10. Ops: []
I20260709 14:52:28.140913  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:28.266995  7854 raft_consensus.cc:1240] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 12. Current term is 13. Ops: []
I20260709 14:52:28.271046  7848 raft_consensus.cc:1240] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 11. Current term is 12. Ops: []
I20260709 14:52:28.271967  7852 raft_consensus.cc:1240] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 11. Current term is 12. Ops: []
I20260709 14:52:28.273996  7744 leader_election.cc:304] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:28.277956  7744 leader_election.cc:304] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:28.296574  7778 raft_consensus.cc:1275] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 14:52:28.298462  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:28.300009  7771 raft_consensus.cc:1275] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 14:52:28.298626  7774 raft_consensus.cc:1240] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 LEADER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 12. Current term is 13. Ops: []
I20260709 14:52:28.310233  7772 raft_consensus.cc:2393] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 13: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:52:28.315415  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:28.316049 11932 raft_consensus.cc:2749] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 14:52:28.318483 11946 raft_consensus.cc:2749] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 14:52:28.321152 11971 raft_consensus.cc:2749] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 14:52:28.324134 11908 raft_consensus.cc:2749] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 14:52:28.339217  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
W20260709 14:52:28.313412 12017 log.cc:927] Time spent T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.116s	user 0.000s	sys 0.002s
I20260709 14:52:28.347375  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:28.356120  7770 raft_consensus.cc:1275] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 14:52:28.322724 11971 raft_consensus.cc:3060] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Advancing to term 13
W20260709 14:52:28.358451  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:28.366469  7774 raft_consensus.cc:1240] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 12. Current term is 13. Ops: []
W20260709 14:52:28.345533  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 95278.8us
W20260709 14:52:28.370085  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:28.370102  7778 raft_consensus.cc:2393] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 13: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:52:28.335376  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:28.378616  7819 leader_election.cc:304] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:28.315189 11942 raft_consensus.cc:493] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9418391fa82a42c79c6cad13ba91d964)
I20260709 14:52:28.388773 11942 raft_consensus.cc:515] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:52:28.398252 12011 raft_consensus.cc:2804] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader election won for term 8
I20260709 14:52:28.399714 12011 raft_consensus.cc:697] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:52:28.412891  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:28.415290  7770 raft_consensus.cc:2468] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 12.
I20260709 14:52:28.405907 12011 consensus_queue.cc:237] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:28.421425  7819 leader_election.cc:304] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:28.435575  7847 raft_consensus.cc:1240] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 11. Current term is 12. Ops: []
I20260709 14:52:28.436071  8640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce9c0ef2db24c13a8b1402f21819458" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9418391fa82a42c79c6cad13ba91d964" is_pre_election: true
I20260709 14:52:28.432053  7771 raft_consensus.cc:1240] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 14:52:28.429904 11942 leader_election.cc:290] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785), 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68:42321)
W20260709 14:52:28.452652 12016 log.cc:927] Time spent T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.070s	user 0.003s	sys 0.000s
I20260709 14:52:28.457417 11982 raft_consensus.cc:2804] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader election won for term 12
I20260709 14:52:28.459463  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:28.462095  7847 raft_consensus.cc:2468] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 14.
W20260709 14:52:28.466699  7745 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:28.475896  7847 raft_consensus.cc:1240] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 10. Current term is 11. Ops: []
I20260709 14:52:28.483315  7774 raft_consensus.cc:1240] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 11. Current term is 12. Ops: []
I20260709 14:52:28.483191  7778 raft_consensus.cc:1240] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 12. Current term is 13. Ops: []
I20260709 14:52:28.464169 11982 raft_consensus.cc:697] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:52:28.456104 11954 raft_consensus.cc:515] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:28.510541  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:28.510058 11982 consensus_queue.cc:237] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:28.518162 11701 consensus_queue.cc:1059] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 14:52:28.520704 11701 raft_consensus.cc:3055] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 14:52:28.530606 11949 consensus_queue.cc:1059] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 14:52:28.532663 11949 raft_consensus.cc:3055] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 14:52:28.533210 11949 raft_consensus.cc:740] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:28.533767  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:28.530872  7894 leader_election.cc:304] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:28.531659 11701 raft_consensus.cc:740] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:28.538117 11701 consensus_queue.cc:260] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:28.539881 11701 raft_consensus.cc:3060] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:52:28.543479  7777 raft_consensus.cc:1240] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 LEADER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 14:52:28.535077 11949 consensus_queue.cc:260] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:28.546136 11949 raft_consensus.cc:3060] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:52:28.535085  7847 raft_consensus.cc:2393] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 12: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:52:28.548199 11963 raft_consensus.cc:2749] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 14:52:28.550590  7894 leader_election.cc:304] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:28.551994  7852 raft_consensus.cc:1240] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 14:52:28.567103  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:28.571743  7852 raft_consensus.cc:2468] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 11.
I20260709 14:52:28.576958 11963 raft_consensus.cc:2749] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 14:52:28.582500  7777 raft_consensus.cc:1240] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 11. Current term is 12. Ops: []
I20260709 14:52:28.581360  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:28.577898 11971 raft_consensus.cc:2749] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 14:52:28.593674  7854 raft_consensus.cc:2393] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 13: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:52:28.584141 11954 leader_election.cc:290] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 11 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:28.593170 11985 raft_consensus.cc:515] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:28.599632 11985 leader_election.cc:290] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 9 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:28.601913  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:28.621791  7854 raft_consensus.cc:1275] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 14:52:28.623968  6549 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 14:52:28.640923  7778 raft_consensus.cc:1240] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 11. Current term is 12. Ops: []
I20260709 14:52:28.643198  7774 raft_consensus.cc:1240] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 LEADER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
W20260709 14:52:28.643782  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 93337.1us
I20260709 14:52:28.652298 11791 raft_consensus.cc:493] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:28.655153 11791 raft_consensus.cc:515] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:28.667747  7848 raft_consensus.cc:1275] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 14:52:28.668607  7852 raft_consensus.cc:1275] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 14:52:28.676997  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:28.675302 11791 leader_election.cc:290] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:28.681536  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
W20260709 14:52:28.685042 12026 log.cc:927] Time spent T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.053s	user 0.000s	sys 0.002s
I20260709 14:52:28.696759 11963 consensus_queue.cc:1059] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 14:52:28.713873  7777 raft_consensus.cc:2410] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 14:52:28.718468  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
W20260709 14:52:28.729525 12023 log.cc:927] Time spent T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 14:52:28.731443 11963 raft_consensus.cc:3055] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 14:52:28.738009 12030 consensus_queue.cc:1059] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 14:52:28.740038 12030 raft_consensus.cc:493] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:28.740860 12030 raft_consensus.cc:515] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:28.748435  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:28.749405  7777 raft_consensus.cc:3060] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:52:28.750330 11701 raft_consensus.cc:3055] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 14:52:28.751017 11701 raft_consensus.cc:740] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:28.752835 12030 leader_election.cc:290] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:28.754395  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:28.754643  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:28.755425  7772 raft_consensus.cc:1275] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 14:52:28.755554  7771 raft_consensus.cc:2468] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 11.
I20260709 14:52:28.758031  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:28.732100 11963 raft_consensus.cc:740] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:28.762951 11963 consensus_queue.cc:260] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:28.764501 11963 raft_consensus.cc:3060] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Advancing to term 12
W20260709 14:52:28.761525  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:28.770475 12031 consensus_queue.cc:1059] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 14:52:28.752466 11701 consensus_queue.cc:260] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:28.776165  7745 leader_election.cc:304] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:28.783440  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:28.784536  7775 raft_consensus.cc:3060] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Advancing to term 13
I20260709 14:52:28.767678 12030 consensus_queue.cc:1059] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.005s
W20260709 14:52:28.790499  7819 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:28.795908  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:28.794435  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:28.797703  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:28.822238  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783e4874513449ef9084b833f188a6d3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:28.823211  7854 raft_consensus.cc:2468] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 9.
I20260709 14:52:28.824232 11775 raft_consensus.cc:2804] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 14:52:28.824942 11775 raft_consensus.cc:493] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:28.825448 11775 raft_consensus.cc:3060] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:52:28.826377  7778 raft_consensus.cc:1240] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 13. Current term is 14. Ops: []
I20260709 14:52:28.832338  7779 raft_consensus.cc:1240] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 LEADER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 10. Current term is 11. Ops: []
I20260709 14:52:28.834214  7852 raft_consensus.cc:1275] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 14:52:28.842291  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:28.843241 11949 consensus_queue.cc:1059] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 14:52:28.850390  7771 raft_consensus.cc:1240] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Rejecting Update request from peer 9418391fa82a42c79c6cad13ba91d964 for earlier term 7. Current term is 8. Ops: []
I20260709 14:52:28.854729  7770 raft_consensus.cc:2468] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 14.
I20260709 14:52:28.855490  7774 raft_consensus.cc:2468] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 13.
I20260709 14:52:28.831561  7772 raft_consensus.cc:2468] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 14.
I20260709 14:52:28.860481  7776 raft_consensus.cc:1240] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 12. Current term is 13. Ops: []
I20260709 14:52:28.861013 11942 raft_consensus.cc:493] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:52:28.866918  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 99057.5us
I20260709 14:52:28.866089  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:28.873963 11701 raft_consensus.cc:3060] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:52:28.868083 11971 consensus_queue.cc:1048] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 14:52:28.876451  7771 raft_consensus.cc:1240] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Rejecting Update request from peer 9418391fa82a42c79c6cad13ba91d964 for earlier term 3. Current term is 4. Ops: []
W20260709 14:52:28.873695  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:28.868626  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:28.874200 11976 consensus_queue.cc:1048] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 14:52:28.882444  7779 raft_consensus.cc:2468] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 13.
I20260709 14:52:28.892134  7745 leader_election.cc:304] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:28.894507 11971 consensus_queue.cc:1048] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 14:52:28.895942  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:28.904918 11921 raft_consensus.cc:2804] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 14:52:28.906013 11921 raft_consensus.cc:493] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:28.906481 11921 raft_consensus.cc:3060] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:52:28.871052 11942 raft_consensus.cc:515] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:28.920960 12029 log.cc:927] Time spent T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.231s	user 0.000s	sys 0.006s
I20260709 14:52:28.925361 11791 consensus_queue.cc:1048] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 14:52:28.926589 11949 raft_consensus.cc:3055] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 14:52:28.927085 11949 raft_consensus.cc:740] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:28.928354 11949 consensus_queue.cc:260] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:28.925438  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:28.932358 12033 raft_consensus.cc:3055] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 14:52:28.933055 12033 raft_consensus.cc:740] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:28.945179  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:28.947042  7924 raft_consensus.cc:2410] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 14:52:28.943804 12033 consensus_queue.cc:260] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:28.954373 11949 raft_consensus.cc:3060] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 14:52:28.961758  7777 raft_consensus.cc:2468] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 10.
I20260709 14:52:28.963152  7775 raft_consensus.cc:2468] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 13.
I20260709 14:52:28.970583 11942 leader_election.cc:290] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:52:28.977428  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:28.981566  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:28.983063 11921 raft_consensus.cc:515] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:28.984957  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:28.986680 11921 leader_election.cc:290] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 10 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:28.986526 12031 consensus_queue.cc:1059] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 14:52:28.983129  7924 raft_consensus.cc:2393] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 10: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:52:28.987933 12031 consensus_queue.cc:1059] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 14:52:28.990195 12035 raft_consensus.cc:3055] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 14:52:28.964480 12033 raft_consensus.cc:3060] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 14:52:28.990844 12035 raft_consensus.cc:740] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
W20260709 14:52:29.001297  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 118158us
I20260709 14:52:28.990633 11775 raft_consensus.cc:515] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:29.018301 12031 raft_consensus.cc:3055] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 14:52:29.019042 12031 raft_consensus.cc:740] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:29.020332 12031 consensus_queue.cc:260] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:29.022511 12031 raft_consensus.cc:3060] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:52:29.022663 12035 consensus_queue.cc:260] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:29.044595  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:29.051187 12038 consensus_queue.cc:1059] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 14:52:29.049162 11775 leader_election.cc:290] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 12 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:29.063342  7922 raft_consensus.cc:1240] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 14:52:29.063685 11701 consensus_queue.cc:1059] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 14:52:29.064427  7924 raft_consensus.cc:1240] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 13. Current term is 14. Ops: []
I20260709 14:52:29.065572 12040 raft_consensus.cc:3055] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 14:52:29.063427 12035 raft_consensus.cc:3060] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 14:52:29.069694 12040 raft_consensus.cc:740] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:29.075129  7923 raft_consensus.cc:1240] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 11. Current term is 12. Ops: []
I20260709 14:52:29.077754  7819 leader_election.cc:304] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:29.078958 11954 raft_consensus.cc:2749] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 14:52:29.090394  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
W20260709 14:52:29.091781  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:29.092125  7924 raft_consensus.cc:1240] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 10. Current term is 11. Ops: []
I20260709 14:52:29.092397  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:29.091042  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:29.093372  7928 raft_consensus.cc:2468] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 11.
I20260709 14:52:29.094143  7925 raft_consensus.cc:2393] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 13: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:52:29.095293  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:29.096045  7925 raft_consensus.cc:3060] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 14:52:29.096583  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:29.059448 12038 raft_consensus.cc:3055] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 14:52:29.106532  7923 raft_consensus.cc:2468] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 11.
I20260709 14:52:29.114130 12036 raft_consensus.cc:3055] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 14:52:29.114822 12036 raft_consensus.cc:740] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:29.116261 12036 consensus_queue.cc:260] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:29.120419  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 58495.5us
I20260709 14:52:29.123409  7925 raft_consensus.cc:2468] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 13.
I20260709 14:52:29.105156 12038 raft_consensus.cc:740] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:29.129756 12038 consensus_queue.cc:260] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:29.131721 12038 raft_consensus.cc:3060] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 14:52:29.133813 12036 raft_consensus.cc:3060] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Advancing to term 12
W20260709 14:52:29.135152  7893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:29.101068 12040 consensus_queue.cc:260] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:29.138779 12040 raft_consensus.cc:3060] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 14:52:29.160020  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:29.161018  7852 raft_consensus.cc:2468] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 14.
I20260709 14:52:29.161991 12035 consensus_queue.cc:1059] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 14:52:29.162103 11775 raft_consensus.cc:493] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:29.163643 11701 raft_consensus.cc:3055] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 14:52:29.164258 11701 raft_consensus.cc:740] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:29.163666 11775 raft_consensus.cc:515] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:29.167879  7893 leader_election.cc:304] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:29.169631 11775 leader_election.cc:290] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:29.195798  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783e4874513449ef9084b833f188a6d3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:29.197072  7852 raft_consensus.cc:3060] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:52:29.178756 12035 raft_consensus.cc:2749] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 14:52:29.227097  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:29.224172  7673 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51352 (request call id 125) took 3462 ms. Trace:
I20260709 14:52:29.178282 11701 consensus_queue.cc:260] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:29.246027  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:29.248428  7845 raft_consensus.cc:3060] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:52:29.251140 12033 consensus_queue.cc:1059] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 14:52:29.237545  7673 rpcz_store.cc:276] 0709 14:52:25.761706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:25.762039 (+   333us) service_pool.cc:224] Handling call
0709 14:52:29.223839 (+3461800us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":284296,"reported_tablets":1}
I20260709 14:52:29.261668 11775 raft_consensus.cc:493] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:29.269071 11775 raft_consensus.cc:515] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:29.272264 11775 leader_election.cc:290] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:29.273159  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:29.274485  7777 raft_consensus.cc:2393] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 8: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:52:29.274330  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:29.275113  7775 raft_consensus.cc:2393] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 13: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:52:29.279783  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:29.280130  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:29.280864  7773 raft_consensus.cc:2393] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 13: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:52:29.281942  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:29.283010  7775 raft_consensus.cc:2393] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 12: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:52:29.283977  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258d6c2dda954bf5b65930fde8ecb9f3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:29.284703  7777 raft_consensus.cc:3060] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:52:29.276629  7893 leader_election.cc:304] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:29.285858 11701 raft_consensus.cc:3060] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Advancing to term 10
W20260709 14:52:29.289906  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:52:29.290560  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:29.292526 12035 consensus_queue.cc:1059] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 14:52:29.294059  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:29.294867 12042 raft_consensus.cc:3055] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 14:52:29.295396 12042 raft_consensus.cc:740] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:29.301898 11949 consensus_queue.cc:1059] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 14:52:29.302289 12030 consensus_queue.cc:1059] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 14:52:29.294945  7853 raft_consensus.cc:2468] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 12.
I20260709 14:52:29.303309  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:29.304944  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783e4874513449ef9084b833f188a6d3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:29.305832  7771 raft_consensus.cc:2368] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 9. Current term is 10.
I20260709 14:52:29.306950  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:29.308370  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:29.309646  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:29.310083  7745 leader_election.cc:304] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:29.296993 12042 consensus_queue.cc:260] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:29.311232 11921 raft_consensus.cc:2804] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 14:52:29.311722 11921 raft_consensus.cc:493] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:29.312104 11921 raft_consensus.cc:3060] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Advancing to term 15
I20260709 14:52:29.309891  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:29.313651  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:29.314558  7776 raft_consensus.cc:2393] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 13: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:52:29.315071 12042 raft_consensus.cc:3060] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:52:29.319797 12039 consensus_queue.cc:1059] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 14:52:29.322058  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:29.322357 12036 raft_consensus.cc:3055] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 14:52:29.322747 12036 raft_consensus.cc:740] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:29.323688 12036 consensus_queue.cc:260] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:29.324213  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:29.325083 11949 raft_consensus.cc:3055] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 14:52:29.325160 11963 raft_consensus.cc:3055] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 14:52:29.325971 11949 raft_consensus.cc:740] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:29.330968 12033 raft_consensus.cc:2749] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 14:52:29.326174  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:29.325366  7777 raft_consensus.cc:2468] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 11.
W20260709 14:52:29.330449  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 80898.4us
I20260709 14:52:29.335600 12036 raft_consensus.cc:3060] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:52:29.335057  7776 raft_consensus.cc:2393] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 14: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:52:29.336390  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:29.337121  7777 raft_consensus.cc:3060] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:52:29.326084 11963 raft_consensus.cc:740] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:29.339381  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:29.322149 12039 consensus_queue.cc:1059] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 14:52:29.341727 12039 raft_consensus.cc:3055] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 14:52:29.342212 12039 raft_consensus.cc:740] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:29.342453  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:29.342613  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:29.343602  7776 raft_consensus.cc:3060] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Advancing to term 16
I20260709 14:52:29.345471 12045 raft_consensus.cc:493] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:29.343279  7773 raft_consensus.cc:3060] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Advancing to term 15
I20260709 14:52:29.346359 12045 raft_consensus.cc:515] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:29.334460  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:29.349689  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:29.343251 12039 consensus_queue.cc:260] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:29.340099 11963 consensus_queue.cc:260] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:29.364908 11982 raft_consensus.cc:493] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:29.334378 11949 consensus_queue.cc:260] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:29.365696 11982 raft_consensus.cc:515] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:29.366103  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:29.368007  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:29.327553  7894 leader_election.cc:304] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:29.363168  7770 raft_consensus.cc:1240] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 12. Current term is 13. Ops: []
I20260709 14:52:29.363744 11791 raft_consensus.cc:493] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:29.353164  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:29.369313  7845 raft_consensus.cc:2468] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 12.
I20260709 14:52:29.373184  7777 raft_consensus.cc:2468] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 11.
I20260709 14:52:29.374909  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:29.377142  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:29.378000  7777 raft_consensus.cc:2393] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 13: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:52:29.378376  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:29.379025  7778 raft_consensus.cc:3060] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:52:29.373934  7852 raft_consensus.cc:2468] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 10.
I20260709 14:52:29.381234  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:29.382303  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:29.383587  7777 raft_consensus.cc:2368] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 11. Current term is 12.
I20260709 14:52:29.385895 12040 raft_consensus.cc:2804] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 14:52:29.386858 12040 raft_consensus.cc:493] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:29.387372 12040 raft_consensus.cc:3060] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 14:52:29.388996 11949 raft_consensus.cc:3060] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:52:29.391458  7770 raft_consensus.cc:1275] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 14:52:29.382602  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 55179.2us
I20260709 14:52:29.396173  7771 raft_consensus.cc:2393] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 12: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:52:29.384930  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:29.400101  7778 raft_consensus.cc:2468] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 12.
I20260709 14:52:29.365204 11963 raft_consensus.cc:3060] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 14:52:29.349064 12045 leader_election.cc:290] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:29.404212  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c563cc7cfbe4d59be4ffc5cf847ce56" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:29.417591  7773 raft_consensus.cc:2468] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 15.
I20260709 14:52:29.426520  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:29.437454  7776 raft_consensus.cc:2468] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 16.
I20260709 14:52:29.368256 11982 leader_election.cc:290] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:29.441188  7778 raft_consensus.cc:1275] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 14:52:29.443078  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783e4874513449ef9084b833f188a6d3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:29.446931  7777 raft_consensus.cc:2368] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 9. Current term is 10.
W20260709 14:52:29.457160  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:29.462298  7675 catalog_manager.cc:5697] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 8 to 9, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 9 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:52:29.464051  7675 catalog_manager.cc:5697] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 6 to 7, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 7 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:52:29.465487  7775 raft_consensus.cc:1275] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 14:52:29.475114  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:29.440694 12031 raft_consensus.cc:3055] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 14:52:29.479739  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:29.476081  7775 raft_consensus.cc:2376] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 12. Re-sending same reply.
I20260709 14:52:29.485023  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:29.485996  7776 raft_consensus.cc:2393] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 13: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:52:29.488714  7779 raft_consensus.cc:2393] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 13: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
W20260709 14:52:29.505452  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:29.516539  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:29.517844  7778 raft_consensus.cc:2376] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 13. Re-sending same reply.
I20260709 14:52:29.406884 11791 raft_consensus.cc:515] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:52:29.516404  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:29.520605  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:29.521298  7852 raft_consensus.cc:2393] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 11: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:52:29.483691 12031 raft_consensus.cc:740] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:29.538904  7745 leader_election.cc:304] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:29.522306 12039 raft_consensus.cc:3060] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:52:29.563879  7675 catalog_manager.cc:5697] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 12 to 14, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 14 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:52:29.514183 12038 consensus_queue.cc:1059] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
W20260709 14:52:29.571981  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:52:29.579536  7744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:29.557186 11911 consensus_queue.cc:1059] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 14:52:29.585332 12052 raft_consensus.cc:3055] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 14:52:29.585793 12052 raft_consensus.cc:740] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9418391fa82a42c79c6cad13ba91d964, State: Running, Role: LEADER
I20260709 14:52:29.586723 12052 consensus_queue.cc:260] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:52:29.589471 12045 raft_consensus.cc:493] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:29.590301  7744 leader_election.cc:304] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:29.590646 12045 raft_consensus.cc:515] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:29.592770 12045 leader_election.cc:290] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:29.597235 12040 raft_consensus.cc:515] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:29.599565 12040 leader_election.cc:290] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 15 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:29.573626 11982 raft_consensus.cc:493] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:29.601923 11982 raft_consensus.cc:515] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:29.603662 11911 consensus_queue.cc:1059] T 9441e831627143a991a1556dcdce71e3 P 9418391fa82a42c79c6cad13ba91d964 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 14:52:29.589234 12052 raft_consensus.cc:3060] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 [term 7 FOLLOWER]: Advancing to term 8
W20260709 14:52:29.605660  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 77048.1us
I20260709 14:52:29.609418  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:29.615401  7777 raft_consensus.cc:2393] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 12: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:52:29.620623 11895 raft_consensus.cc:493] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:29.628324  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:29.631284 12031 consensus_queue.cc:260] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:29.633073  7854 raft_consensus.cc:2468] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 13.
I20260709 14:52:29.634742 11982 leader_election.cc:290] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:29.646965  7819 leader_election.cc:304] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:29.648152  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:29.648814  7852 raft_consensus.cc:3060] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Advancing to term 15
W20260709 14:52:29.665591  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 99786.2us
W20260709 14:52:29.687646  8599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 103515us
I20260709 14:52:29.653813 12031 raft_consensus.cc:3060] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Advancing to term 13
W20260709 14:52:29.698873  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 52151.5us
I20260709 14:52:29.705090 12054 raft_consensus.cc:2749] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 14:52:29.638492  7919 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
mode: GRACEFUL
new_leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:48676
I20260709 14:52:29.708225  7675 catalog_manager.cc:5697] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 10 to 11, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 11 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:52:29.709426 12058 raft_consensus.cc:2804] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 14:52:29.709983 12058 raft_consensus.cc:493] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:29.710341  7675 catalog_manager.cc:5697] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:52:29.711648  7674 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54344 (request call id 373) took 9601 ms. Trace:
I20260709 14:52:29.716939 11791 leader_election.cc:290] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68:42321)
I20260709 14:52:29.698246 11982 raft_consensus.cc:2749] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 14:52:29.698472 12040 raft_consensus.cc:493] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:52:29.728137  7894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:29.724714  7852 raft_consensus.cc:2468] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 15.
I20260709 14:52:29.731835  7819 leader_election.cc:304] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:29.719888 12040 raft_consensus.cc:515] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:29.712230  7675 catalog_manager.cc:5697] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 10 to 11, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 11 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:52:29.643103 11895 raft_consensus.cc:515] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:29.742197  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 48378us
I20260709 14:52:29.743372  7819 leader_election.cc:304] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:29.678018 12038 consensus_queue.cc:1243] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer 3876b8ee8d744cb18e91d97aae93b1ac log is divergent from this leader: its last log entry 8.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
W20260709 14:52:29.747959  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 167195us
W20260709 14:52:29.750041  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:29.754266  8640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18d29d52d304c87b930d4fb5eaf50b1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9418391fa82a42c79c6cad13ba91d964" is_pre_election: true
I20260709 14:52:29.710372 12058 raft_consensus.cc:3060] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Advancing to term 13
I20260709 14:52:29.765945  7675 catalog_manager.cc:5697] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 7 to 8, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 8 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:52:29.769522 12040 leader_election.cc:290] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:29.769750 12035 raft_consensus.cc:3055] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 14:52:29.772043  7675 catalog_manager.cc:5697] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 10 to 11, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 11 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:52:29.756465 12045 raft_consensus.cc:2749] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 14:52:29.749020 11982 raft_consensus.cc:2749] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 14:52:29.785760 12040 raft_consensus.cc:493] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:29.790190 12040 raft_consensus.cc:515] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:29.791029  8598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 112608us
I20260709 14:52:29.712218  7674 rpcz_store.cc:276] 0709 14:52:20.109751 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:20.110125 (+   374us) service_pool.cc:224] Handling call
0709 14:52:29.711260 (+9601135us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 14:52:27.552466 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 14:52:27.555693 (+  3227us) write_op.cc:432] Acquiring schema lock in shared mode
0709 14:52:27.557594 (+  1901us) write_op.cc:435] Acquired schema lock
0709 14:52:27.557614 (+    20us) tablet.cc:662] Decoding operations
0709 14:52:27.562575 (+  4961us) write_op.cc:620] Acquiring the partition lock for write op
0709 14:52:27.562672 (+    97us) write_op.cc:641] Partition lock acquired for write op
0709 14:52:27.562700 (+    28us) tablet.cc:685] Acquiring locks for 29 operations
0709 14:52:27.633598 (+ 70898us) tablet.cc:701] Row locks acquired
0709 14:52:27.633621 (+    23us) write_op.cc:260] PREPARE: finished
0709 14:52:27.633855 (+   234us) write_op.cc:270] Start()
0709 14:52:27.634042 (+   187us) write_op.cc:276] Timestamp: P: 1783608747633783 usec, L: 0
0709 14:52:27.634070 (+    28us) op_driver.cc:348] REPLICATION: starting
0709 14:52:27.789511 (+155441us) log.cc:844] Serialized 11315 byte log entry
0709 14:52:28.197475 (+407964us) op_driver.cc:464] REPLICATION: finished
0709 14:52:28.468748 (+271273us) spinlock_profiling.cc:243] Waited 11.9 ms on lock 0x7b180029fa40. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb690c69de1 00007fb690c765b1 00007fb687da13f3 00007fb687da37c1 00007fb687da3779 00007fb687da3709 00007fb687da36d1 00007fb687da29cd 0000000000396ad4 0000000000396919 00007fb687d8483a
0709 14:52:28.469052 (+   304us) write_op.cc:301] APPLY: starting
0709 14:52:28.469307 (+   255us) tablet.cc:1367] starting BulkCheckPresence
0709 14:52:28.707656 (+238349us) tablet.cc:1370] finished BulkCheckPresence
0709 14:52:28.707709 (+    53us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 14:52:29.088235 (+380526us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 14:52:29.088762 (+   527us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=58,key_file_lookups=58,delta_file_lookups=58,mrs_lookups=0
0709 14:52:29.088833 (+    71us) write_op.cc:312] APPLY: finished
0709 14:52:29.163337 (+ 74504us) log.cc:844] Serialized 252 byte log entry
0709 14:52:29.165325 (+  1988us) write_op.cc:489] Releasing partition, row and schema locks
0709 14:52:29.166248 (+   923us) write_op.cc:454] Released schema lock
0709 14:52:29.166366 (+   118us) write_op.cc:341] FINISH: Updating metrics
0709 14:52:29.167241 (+   875us) write_op.cc:489] Releasing partition, row and schema locks
0709 14:52:29.167278 (+    37us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":575033,"reported_tablets":52,"child_traces":[["op",{"apply.queue_time_us":230407,"apply.run_cpu_time_us":65805,"apply.run_wall_time_us":698141,"cfile_cache_hit":118,"cfile_cache_hit_bytes":124999,"num_ops":29,"prepare.queue_time_us":154584,"prepare.run_cpu_time_us":110162,"prepare.run_wall_time_us":436068,"raft.queue_time_us":11905,"raft.run_cpu_time_us":6749,"raft.run_wall_time_us":225303,"replication_time_us":563125,"spinlock_wait_cycles":27295488,"thread_start_us":536384,"threads_started":4,"wal-append.queue_time_us":290482}]]}
I20260709 14:52:29.795923  7744 leader_election.cc:304] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:29.770136 12035 raft_consensus.cc:740] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
W20260709 14:52:29.799595  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 265718us
I20260709 14:52:29.789484  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:29.819073  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:29.823628  7745 leader_election.cc:304] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:29.823890 11895 leader_election.cc:290] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:29.824832  7745 leader_election.cc:304] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:29.830296 12057 raft_consensus.cc:2804] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader election won for term 10
I20260709 14:52:29.830709 11775 raft_consensus.cc:2804] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader election won for term 12
I20260709 14:52:29.831243 11775 raft_consensus.cc:697] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:52:29.832301 11775 consensus_queue.cc:237] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:29.828729  7675 catalog_manager.cc:5697] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 10 to 11, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 11 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:52:29.841333  7675 catalog_manager.cc:5697] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 8 to 12, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 12 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
W20260709 14:52:29.816089 11921 consensus_meta.cc:287] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent flushing consensus metadata: real 0.503s	user 0.010s	sys 0.005s
W20260709 14:52:29.843395  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 55067.9us
I20260709 14:52:29.853358  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:29.863394  7925 raft_consensus.cc:2468] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 10.
W20260709 14:52:29.849913 12042 consensus_meta.cc:287] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0: Time spent flushing consensus metadata: real 0.534s	user 0.017s	sys 0.000s
I20260709 14:52:29.850327 11942 raft_consensus.cc:2749] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 14:52:29.862524  7675 catalog_manager.cc:5697] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 7 to 9, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 9 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:52:29.875110  7919 raft_consensus.cc:606] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Received request to transfer leadership to TS 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:29.878788  7919 raft_consensus.cc:614] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 14:52:29.855985 11921 raft_consensus.cc:515] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:29.855024 11791 consensus_queue.cc:1059] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 14:52:29.885113  7819 leader_election.cc:400] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 11 election: Vote denied by peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587) with higher term. Message: Invalid argument: T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 11. Current term is 12.
I20260709 14:52:29.902070  7819 leader_election.cc:403] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 14:52:29.900851  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:29.843637 11982 consensus_queue.cc:1059] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.056s
W20260709 14:52:29.886161  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 47890.4us
I20260709 14:52:29.909138  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:29.912298  7925 raft_consensus.cc:2376] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 8. Re-sending same reply.
I20260709 14:52:29.887048 12057 raft_consensus.cc:697] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:52:29.920382 12057 consensus_queue.cc:237] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:29.924202 11982 raft_consensus.cc:3055] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 LEADER]: Stepping down as leader of term 12
I20260709 14:52:29.924815 11982 raft_consensus.cc:740] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:52:29.914633  7922 raft_consensus.cc:2376] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 13. Re-sending same reply.
I20260709 14:52:29.890837 11921 leader_election.cc:290] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:29.909096 12064 consensus_queue.cc:1059] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 14:52:29.912911 11942 raft_consensus.cc:3055] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 LEADER]: Stepping down as leader of term 13
I20260709 14:52:29.933439 11942 raft_consensus.cc:740] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:52:29.934651 11942 consensus_queue.cc:260] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:29.935251  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:29.935994  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:29.936647  7928 raft_consensus.cc:1240] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 12. Current term is 13. Ops: []
I20260709 14:52:29.937731  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:29.938102  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258d6c2dda954bf5b65930fde8ecb9f3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:29.939672  7925 raft_consensus.cc:2410] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for term 11 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 14:52:29.908933 11895 raft_consensus.cc:2749] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587) with higher term. Message: Invalid argument: T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 11. Current term is 12.
I20260709 14:52:29.883893 12035 consensus_queue.cc:260] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:29.943512 12035 raft_consensus.cc:3060] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Advancing to term 11
W20260709 14:52:29.945432 12066 log.cc:927] Time spent T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.054s	user 0.001s	sys 0.001s
I20260709 14:52:29.946084  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:29.947045  7921 raft_consensus.cc:2393] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 13: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:52:29.945981  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c563cc7cfbe4d59be4ffc5cf847ce56" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:29.951429  7819 leader_election.cc:304] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:29.909786 11791 raft_consensus.cc:493] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:29.921007 12040 leader_election.cc:290] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:52:29.938742 12036 consensus_meta.cc:287] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent flushing consensus metadata: real 0.602s	user 0.017s	sys 0.000s
I20260709 14:52:29.884346 12065 consensus_queue.cc:1059] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.054s
I20260709 14:52:29.962404  7927 raft_consensus.cc:2468] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 14.
I20260709 14:52:29.956684  7744 leader_election.cc:304] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:29.956737  7923 raft_consensus.cc:2468] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 12.
I20260709 14:52:29.962594  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:29.968896  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783e4874513449ef9084b833f188a6d3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:29.965554 11895 raft_consensus.cc:2749] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 14:52:29.971999 11791 raft_consensus.cc:515] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:52:29.993971  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:29.994910  7922 raft_consensus.cc:2468] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 10.
I20260709 14:52:29.995714 11791 leader_election.cc:290] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68:42321)
I20260709 14:52:29.996176  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:29.997597 11915 raft_consensus.cc:3055] T 9441e831627143a991a1556dcdce71e3 P 9418391fa82a42c79c6cad13ba91d964 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 14:52:29.998055 11915 raft_consensus.cc:740] T 9441e831627143a991a1556dcdce71e3 P 9418391fa82a42c79c6cad13ba91d964 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9418391fa82a42c79c6cad13ba91d964, State: Running, Role: LEADER
I20260709 14:52:29.999200 11915 consensus_queue.cc:260] T 9441e831627143a991a1556dcdce71e3 P 9418391fa82a42c79c6cad13ba91d964 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:52:30.002882  7893 leader_election.cc:304] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:30.004009  7919 raft_consensus.cc:1275] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 14:52:30.006454 12058 raft_consensus.cc:515] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:29.931034 12045 consensus_queue.cc:1048] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 14:52:30.009608 11982 consensus_queue.cc:260] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:30.011214 11982 raft_consensus.cc:3060] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Advancing to term 13
I20260709 14:52:30.013103  7919 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
mode: GRACEFUL
new_leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:48676
W20260709 14:52:30.013650  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 62339.9us
I20260709 14:52:30.014042  7919 raft_consensus.cc:606] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 LEADER]: Received request to transfer leadership to TS 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:30.014493 11971 raft_consensus.cc:493] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:30.015183 11971 raft_consensus.cc:515] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:30.017786 12076 raft_consensus.cc:493] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:30.011216 12036 raft_consensus.cc:2764] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 14:52:30.018775 11942 raft_consensus.cc:3060] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Advancing to term 14
I20260709 14:52:30.019110 12065 raft_consensus.cc:3055] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 LEADER]: Stepping down as leader of term 11
I20260709 14:52:30.019412  7927 raft_consensus.cc:1275] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 14:52:30.021503  8640 raft_consensus.cc:2468] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 8.
I20260709 14:52:30.022960  7894 leader_election.cc:304] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
W20260709 14:52:30.026008  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 75467.2us
I20260709 14:52:30.026959  7744 leader_election.cc:304] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:30.015617 12067 raft_consensus.cc:493] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:30.028239 12067 raft_consensus.cc:515] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:30.029524 12054 raft_consensus.cc:2749] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 14:52:30.030367 12054 raft_consensus.cc:2749] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 14:52:30.031010 12054 raft_consensus.cc:493] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:30.031502 12054 raft_consensus.cc:515] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:29.997128  7928 raft_consensus.cc:2468] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 14.
I20260709 14:52:30.014906  7819 leader_election.cc:304] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:30.034763 11971 leader_election.cc:290] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:30.035552 11971 raft_consensus.cc:493] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:30.036052 11971 raft_consensus.cc:515] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:29.997467 11921 raft_consensus.cc:3055] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 LEADER]: Stepping down as leader of term 10
I20260709 14:52:30.037443 12064 raft_consensus.cc:493] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:30.038173 12064 raft_consensus.cc:515] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:30.038410 12036 raft_consensus.cc:2804] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 14:52:30.041937 12064 leader_election.cc:290] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:30.037322 11921 raft_consensus.cc:740] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:52:30.043323 12076 raft_consensus.cc:515] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:30.035864 11895 raft_consensus.cc:2749] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 14:52:30.039516 12036 raft_consensus.cc:493] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:30.036362  7819 leader_election.cc:304] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:30.045969  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:30.046471  7923 raft_consensus.cc:1275] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 14:52:30.028905  7744 leader_election.cc:304] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:30.054466  7924 raft_consensus.cc:2468] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 10.
I20260709 14:52:30.058166  7927 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
mode: GRACEFUL
new_leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:48676
I20260709 14:52:30.059700  7925 raft_consensus.cc:2468] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 9.
I20260709 14:52:30.058811  7894 leader_election.cc:304] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:30.058389  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783e4874513449ef9084b833f188a6d3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:30.039114 12065 raft_consensus.cc:740] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:52:30.065393  7853 raft_consensus.cc:2393] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 10: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:52:30.009137 12058 leader_election.cc:290] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:30.067557  7921 raft_consensus.cc:2468] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 11.
I20260709 14:52:30.067673  7926 raft_consensus.cc:2468] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 12.
I20260709 14:52:30.054996 12036 raft_consensus.cc:3060] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 14:52:30.059201  7927 raft_consensus.cc:606] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 LEADER]: Received request to transfer leadership to TS 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:30.066023 11791 raft_consensus.cc:493] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:30.074925  8640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9441e831627143a991a1556dcdce71e3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9418391fa82a42c79c6cad13ba91d964" is_pre_election: true
I20260709 14:52:30.043629 11921 consensus_queue.cc:260] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:30.076500 12056 raft_consensus.cc:2804] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 14:52:30.076531 11921 raft_consensus.cc:3060] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:52:30.078542 11963 raft_consensus.cc:993] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0: : Instructing follower 3876b8ee8d744cb18e91d97aae93b1ac to start an election
I20260709 14:52:30.079147 11963 raft_consensus.cc:1081] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 LEADER]: Signalling peer 3876b8ee8d744cb18e91d97aae93b1ac to start an election
I20260709 14:52:30.061198 12045 raft_consensus.cc:2804] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Leader election won for term 15
I20260709 14:52:30.080722 12045 raft_consensus.cc:697] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:52:30.082044 12045 consensus_queue.cc:237] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:30.074553  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:30.075125 11791 raft_consensus.cc:515] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:30.082705 11915 raft_consensus.cc:3060] T 9441e831627143a991a1556dcdce71e3 P 9418391fa82a42c79c6cad13ba91d964 [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:52:30.089908  7927 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
mode: GRACEFUL
new_leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:48676
I20260709 14:52:30.090734  7927 raft_consensus.cc:606] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Received request to transfer leadership to TS 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:52:30.091105  7927 raft_consensus.cc:614] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 14:52:30.091662 11971 leader_election.cc:290] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:30.088768 11791 leader_election.cc:290] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:30.077214 12056 raft_consensus.cc:697] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:30.094501 12056 consensus_queue.cc:237] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:30.094998  7927 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
mode: GRACEFUL
new_leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:48676
I20260709 14:52:30.095877  7927 raft_consensus.cc:606] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Received request to transfer leadership to TS 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:52:30.085938 12078 raft_consensus.cc:2804] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader election won for term 13
I20260709 14:52:30.096868 12078 raft_consensus.cc:697] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:52:30.097116 12077 raft_consensus.cc:493] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:30.097877 12077 raft_consensus.cc:515] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:30.098162 12065 consensus_queue.cc:260] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:30.096516  7927 raft_consensus.cc:614] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 14:52:30.101809  7893 leader_election.cc:304] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:30.086220  7742 leader_election.cc:304] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 9418391fa82a42c79c6cad13ba91d964; no voters: 
W20260709 14:52:30.104076  7742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.68:42321, user_credentials={real_user=slave}} blocked reactor thread for 45173.4us
I20260709 14:52:30.104698 11791 raft_consensus.cc:2804] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 14:52:30.105530 11791 raft_consensus.cc:493] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:30.098203 12078 consensus_queue.cc:237] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:30.106813 12076 leader_election.cc:290] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:30.107452 11791 raft_consensus.cc:3060] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:52:30.104720 12040 raft_consensus.cc:2749] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 14:52:30.105783  6549 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 14:52:30.086004  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 57169.5us
I20260709 14:52:30.111600  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:30.112735  7779 raft_consensus.cc:2410] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 14:52:30.113574  6549 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 14:52:30.114065 12065 raft_consensus.cc:3060] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Advancing to term 12
W20260709 14:52:30.115684  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 79497us
I20260709 14:52:30.107667 12067 leader_election.cc:290] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:30.066617 12064 raft_consensus.cc:493] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:30.117769  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:30.118418  7778 raft_consensus.cc:2376] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 13. Re-sending same reply.
I20260709 14:52:30.118516  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:30.118983 12054 leader_election.cc:290] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:30.118352 12064 raft_consensus.cc:515] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:30.118016  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:30.124693  7777 raft_consensus.cc:2468] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 11.
I20260709 14:52:30.125587  7819 leader_election.cc:400] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 9 election: Vote denied by peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587) with higher term. Message: Invalid argument: T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 9. Current term is 10.
I20260709 14:52:30.126116  7819 leader_election.cc:403] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
W20260709 14:52:30.126119  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 58172.3us
I20260709 14:52:30.130887 11895 consensus_queue.cc:1048] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 14:52:30.136567 12072 raft_consensus.cc:2749] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587) with higher term. Message: Invalid argument: T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 9. Current term is 10.
I20260709 14:52:30.113935 12077 leader_election.cc:290] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:30.139832  7893 leader_election.cc:304] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:30.154613  7819 leader_election.cc:304] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:30.158272 12075 raft_consensus.cc:493] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:30.159083 12075 raft_consensus.cc:515] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:30.154868 12054 raft_consensus.cc:493] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:30.160528  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:30.164937  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:30.166317  7774 raft_consensus.cc:2468] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 14.
I20260709 14:52:30.169672  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:30.170162 11775 raft_consensus.cc:493] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:30.171098 12075 leader_election.cc:290] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:30.171736  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:30.172652  7778 raft_consensus.cc:2468] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 10.
I20260709 14:52:30.170601 12067 raft_consensus.cc:493] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:30.171538 11775 raft_consensus.cc:515] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:30.182118 12031 raft_consensus.cc:993] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0: : Instructing follower 3876b8ee8d744cb18e91d97aae93b1ac to start an election
I20260709 14:52:30.177662 11963 raft_consensus.cc:2749] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 14:52:30.179865 12064 leader_election.cc:290] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:30.160578 12054 raft_consensus.cc:515] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:30.178180 11895 raft_consensus.cc:2804] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader election won for term 12
I20260709 14:52:30.184043 11895 raft_consensus.cc:697] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:52:30.185215 11895 consensus_queue.cc:237] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:30.188467 12058 raft_consensus.cc:493] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:30.176466 12067 raft_consensus.cc:515] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:30.189214 12058 raft_consensus.cc:515] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:30.169484 12078 raft_consensus.cc:493] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:30.180858 11775 leader_election.cc:290] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:30.191340 12067 leader_election.cc:290] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:30.194133  7775 raft_consensus.cc:2468] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 11.
I20260709 14:52:30.157392 12077 raft_consensus.cc:493] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:30.198597 12077 raft_consensus.cc:515] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:30.180948  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 50593.3us
I20260709 14:52:30.205029 11963 raft_consensus.cc:1081] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 LEADER]: Signalling peer 3876b8ee8d744cb18e91d97aae93b1ac to start an election
I20260709 14:52:30.205467  7854 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d"
dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:49946
I20260709 14:52:30.206530  7854 raft_consensus.cc:493] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:52:30.206964  7854 raft_consensus.cc:3060] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Advancing to term 13
I20260709 14:52:30.202497 12078 raft_consensus.cc:515] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:30.174203 12045 consensus_queue.cc:1048] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.055s
I20260709 14:52:30.218684 12031 consensus_queue.cc:1059] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 14:52:30.220237 12031 raft_consensus.cc:3055] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 14:52:30.220638 12031 raft_consensus.cc:740] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:30.222177 12077 leader_election.cc:290] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:30.223163  7893 leader_election.cc:304] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:30.225675  7846 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf"
dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:49946
I20260709 14:52:30.227360  7846 raft_consensus.cc:493] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:52:30.227990  7846 raft_consensus.cc:3060] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Advancing to term 13
I20260709 14:52:30.233425  8640 raft_consensus.cc:2468] T 9441e831627143a991a1556dcdce71e3 P 9418391fa82a42c79c6cad13ba91d964 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 4.
I20260709 14:52:30.235183 12054 leader_election.cc:290] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:30.191915 12058 leader_election.cc:290] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:30.236207  7742 leader_election.cc:304] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 9418391fa82a42c79c6cad13ba91d964; no voters: 
I20260709 14:52:30.236613 12031 consensus_queue.cc:260] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:30.238485 12031 raft_consensus.cc:3060] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 14:52:30.215395 12078 leader_election.cc:290] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:30.245514 12055 raft_consensus.cc:2749] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 14:52:30.247579 12054 raft_consensus.cc:493] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:30.245600 12058 raft_consensus.cc:2804] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 14:52:30.251253  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 96759.1us
I20260709 14:52:30.252949  7819 leader_election.cc:304] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:30.252708 12036 raft_consensus.cc:515] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:30.254397  7819 leader_election.cc:304] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:30.251688 12058 raft_consensus.cc:493] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:30.255906 12058 raft_consensus.cc:3060] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:52:30.257840  7854 raft_consensus.cc:515] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:30.262140  7846 raft_consensus.cc:515] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:30.266580 12078 raft_consensus.cc:493] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:30.269795  7846 leader_election.cc:290] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:30.273401 12077 raft_consensus.cc:493] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:30.279273 11942 raft_consensus.cc:493] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:30.279966 11942 raft_consensus.cc:515] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:30.282615 11982 raft_consensus.cc:2749] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 14:52:30.284070 11775 raft_consensus.cc:493] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:30.284932 11775 raft_consensus.cc:515] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:30.285578 12067 raft_consensus.cc:493] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
W20260709 14:52:30.287395  7743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:30.288054 11942 leader_election.cc:290] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:30.287127 12067 raft_consensus.cc:515] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:30.278064 12077 raft_consensus.cc:515] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:30.290761  7854 leader_election.cc:290] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:30.292004  7893 leader_election.cc:304] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:52:30.302486  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 48159.8us
I20260709 14:52:30.304121  7819 leader_election.cc:304] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:30.266376 12054 raft_consensus.cc:515] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:30.276146 12084 raft_consensus.cc:2804] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Leader election won for term 13
I20260709 14:52:30.313580 11982 raft_consensus.cc:2749] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 14:52:30.313619 12055 raft_consensus.cc:2804] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 14:52:30.315285 12067 leader_election.cc:290] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:30.317616  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:30.300045 11949 raft_consensus.cc:493] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:30.322928 11775 leader_election.cc:290] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:30.277186 12078 raft_consensus.cc:515] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:30.363850 12058 raft_consensus.cc:515] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:52:30.349304 12064 raft_consensus.cc:493] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:30.353080  7779 raft_consensus.cc:2468] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 12.
W20260709 14:52:30.362313  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 91885.5us
I20260709 14:52:30.364081 11949 raft_consensus.cc:515] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:30.336233 12077 leader_election.cc:290] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:30.299515 12065 raft_consensus.cc:493] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:30.307850 12036 leader_election.cc:290] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:30.365330 12064 raft_consensus.cc:515] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:30.367818 12055 raft_consensus.cc:697] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:30.308706 11791 raft_consensus.cc:515] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
W20260709 14:52:30.381677  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 77722.9us
I20260709 14:52:30.393554  7853 raft_consensus.cc:1240] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 12. Current term is 13. Ops: []
I20260709 14:52:30.395371  7819 leader_election.cc:304] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:30.396955 11982 raft_consensus.cc:2749] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 14:52:30.372363 12084 raft_consensus.cc:697] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:52:30.397718  7819 leader_election.cc:304] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:30.398650 11982 raft_consensus.cc:2804] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 14:52:30.399085 11982 raft_consensus.cc:493] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:30.399448 11982 raft_consensus.cc:3060] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Advancing to term 15
I20260709 14:52:30.399573 12070 consensus_queue.cc:1059] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 14:52:30.401062 12070 raft_consensus.cc:3055] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 14:52:30.401630 12070 raft_consensus.cc:740] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:30.401854  7854 raft_consensus.cc:1240] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 12. Current term is 13. Ops: []
I20260709 14:52:30.393939 12064 leader_election.cc:290] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:30.402683 12070 consensus_queue.cc:260] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:30.403586 12039 raft_consensus.cc:493] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:30.404964 12070 raft_consensus.cc:3060] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 14:52:30.406033 12084 consensus_queue.cc:237] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:30.404816 12039 raft_consensus.cc:515] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:30.409198 12064 raft_consensus.cc:493] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:30.410180 12064 raft_consensus.cc:515] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:30.411214  7819 leader_election.cc:304] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:30.412271 11895 raft_consensus.cc:2804] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 14:52:30.414206  7819 leader_election.cc:304] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:30.415601 12045 raft_consensus.cc:2804] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 14:52:30.400980 12055 consensus_queue.cc:237] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:30.416810 12045 raft_consensus.cc:493] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:30.417425  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:30.417587 12045 raft_consensus.cc:3060] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:52:30.418284  7779 raft_consensus.cc:2468] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 12.
I20260709 14:52:30.421617 11982 raft_consensus.cc:515] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:30.424721  7893 leader_election.cc:304] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:30.399209 12078 leader_election.cc:290] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:30.426878  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:30.428747  7779 raft_consensus.cc:2393] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 8: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
W20260709 14:52:30.429107  7743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:30.412829 11895 raft_consensus.cc:493] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 14:52:30.429982  7743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:30.430210 11895 raft_consensus.cc:3060] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:52:30.427624 12064 leader_election.cc:290] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:30.415212 11949 leader_election.cc:290] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:30.431319  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:30.434638  7779 raft_consensus.cc:2468] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 10.
I20260709 14:52:30.435670  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:30.435882  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:30.436470  7777 raft_consensus.cc:2376] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 12. Re-sending same reply.
I20260709 14:52:30.369419 12065 raft_consensus.cc:515] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:30.438524  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:30.439321  7775 raft_consensus.cc:2468] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 7.
I20260709 14:52:30.412717 12039 leader_election.cc:290] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:30.447249  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:52:30.449043  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 46646us
I20260709 14:52:30.452466  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:30.453444  7776 raft_consensus.cc:2376] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 16. Re-sending same reply.
I20260709 14:52:30.456120  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:30.457198  7774 raft_consensus.cc:2393] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 14: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:52:30.461203  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:30.462519  7777 raft_consensus.cc:2376] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 11. Re-sending same reply.
I20260709 14:52:30.464277 11982 leader_election.cc:290] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:30.456120  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:30.468603  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:30.469025  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783e4874513449ef9084b833f188a6d3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:30.469631  7771 raft_consensus.cc:2393] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 13: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:52:30.469808  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:30.470507  7774 raft_consensus.cc:2468] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 11.
I20260709 14:52:30.470700  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:30.469327  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258d6c2dda954bf5b65930fde8ecb9f3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:30.471374  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:30.471410  7776 raft_consensus.cc:2468] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 12.
I20260709 14:52:30.471944  7773 raft_consensus.cc:2376] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 11. Re-sending same reply.
I20260709 14:52:30.472178  7772 raft_consensus.cc:2468] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 13.
I20260709 14:52:30.477144  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:30.477650  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: true dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:30.478188  7927 raft_consensus.cc:2468] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 13.
I20260709 14:52:30.478997  7893 leader_election.cc:304] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:30.478462  7819 leader_election.cc:304] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:30.467667 12065 leader_election.cc:290] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:30.480401  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:30.449493 12056 consensus_queue.cc:1059] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 14:52:30.489190  7926 raft_consensus.cc:2468] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 13.
I20260709 14:52:30.483619  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: true dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:30.449658 11949 consensus_queue.cc:1059] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 14:52:30.485926  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:30.491664  7777 raft_consensus.cc:2468] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 8.
I20260709 14:52:30.491850  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: true dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:30.492646  7775 raft_consensus.cc:3060] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Advancing to term 13
I20260709 14:52:30.455276 12070 raft_consensus.cc:2804] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 14:52:30.496459  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: true dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:30.498777  7772 raft_consensus.cc:3060] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Advancing to term 13
I20260709 14:52:30.504168  7893 leader_election.cc:304] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:30.510406  7819 leader_election.cc:304] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:52:30.496006 12030 raft_consensus.cc:2804] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 14:52:30.505890 11982 raft_consensus.cc:2749] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 14:52:30.524091 12072 raft_consensus.cc:2804] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader election won for term 10
I20260709 14:52:30.516271 12070 raft_consensus.cc:697] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:30.525550  7925 raft_consensus.cc:3055] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 14:52:30.530984  8640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18d29d52d304c87b930d4fb5eaf50b1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9418391fa82a42c79c6cad13ba91d964"
I20260709 14:52:30.532030  8640 raft_consensus.cc:3060] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:52:30.526073 12070 consensus_queue.cc:237] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:30.536455  7772 raft_consensus.cc:2468] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 13.
I20260709 14:52:30.541637  7921 raft_consensus.cc:3055] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 14:52:30.542125  7921 raft_consensus.cc:740] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:30.542172 11791 leader_election.cc:290] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68:42321)
I20260709 14:52:30.542999  7921 consensus_queue.cc:260] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:30.544700  7921 raft_consensus.cc:3060] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 14:52:30.538450 12054 leader_election.cc:290] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:30.526048  7925 raft_consensus.cc:740] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
W20260709 14:52:30.555891  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 47949.2us
I20260709 14:52:30.560573  7921 raft_consensus.cc:2468] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 13.
I20260709 14:52:30.543653 11895 raft_consensus.cc:515] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:30.566296  8640 raft_consensus.cc:2468] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 9.
I20260709 14:52:30.567215 11895 leader_election.cc:290] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 11 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:52:30.572037  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 61732.8us
W20260709 14:52:30.575079  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 71002.3us
I20260709 14:52:30.575822  7775 raft_consensus.cc:2468] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 13.
I20260709 14:52:30.576483  7893 leader_election.cc:304] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:30.555572 12045 raft_consensus.cc:515] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:30.579944  7742 leader_election.cc:304] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 9418391fa82a42c79c6cad13ba91d964; no voters: 
I20260709 14:52:30.561017 11949 raft_consensus.cc:2749] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 14:52:30.563277 12058 leader_election.cc:290] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68:42321)
I20260709 14:52:30.581367  8640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9441e831627143a991a1556dcdce71e3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9418391fa82a42c79c6cad13ba91d964"
I20260709 14:52:30.564301 12055 raft_consensus.cc:493] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:52:30.563464 12030 raft_consensus.cc:697] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
W20260709 14:52:30.582784 12036 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 13 current term: 13 is higher.
I20260709 14:52:30.599606  7925 consensus_queue.cc:260] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:30.596180 11791 raft_consensus.cc:2804] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader election won for term 9
I20260709 14:52:30.613039  7925 raft_consensus.cc:3060] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 14:52:30.600848 12040 raft_consensus.cc:2804] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 14:52:30.609305  8640 raft_consensus.cc:3060] T 9441e831627143a991a1556dcdce71e3 P 9418391fa82a42c79c6cad13ba91d964 [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:52:30.615968  7893 leader_election.cc:304] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:30.622978  7852 raft_consensus.cc:1275] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 14:52:30.626758  7925 raft_consensus.cc:2468] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 13.
W20260709 14:52:30.627470 12039 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 13 current term: 13 is higher.
I20260709 14:52:30.627797 12068 consensus_queue.cc:1048] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 14:52:30.631760  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783e4874513449ef9084b833f188a6d3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:30.632824  7924 raft_consensus.cc:2468] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 9.
I20260709 14:52:30.634549  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:30.635339  7921 raft_consensus.cc:2410] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 14:52:30.636355  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783e4874513449ef9084b833f188a6d3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:30.636559  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:30.637229  7928 raft_consensus.cc:3060] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:52:30.638872  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:30.617739 11791 raft_consensus.cc:697] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:52:30.640120  7924 raft_consensus.cc:2468] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 12.
I20260709 14:52:30.642058 12030 consensus_queue.cc:237] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:30.632725  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:30.646206  7919 raft_consensus.cc:3060] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:52:30.649369  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:30.630896 11949 raft_consensus.cc:2804] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 14:52:30.651523 11949 raft_consensus.cc:697] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:30.653203 12095 raft_consensus.cc:493] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:52:30.653815 12095 raft_consensus.cc:515] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:30.653961  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce9c0ef2db24c13a8b1402f21819458" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:30.654879  7927 raft_consensus.cc:1275] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 14:52:30.609484 12072 raft_consensus.cc:697] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:52:30.652422  7926 raft_consensus.cc:1275] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 14:52:30.650468  7920 raft_consensus.cc:1275] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 14:52:30.656965 12072 consensus_queue.cc:237] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:30.612257 12055 raft_consensus.cc:515] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:30.682987 11895 raft_consensus.cc:493] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:52:30.683907  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:30.684799  7923 raft_consensus.cc:3060] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 14:52:30.683960 11895 raft_consensus.cc:515] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:30.649942 11791 consensus_queue.cc:237] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:52:30.651077 12036 raft_consensus.cc:493] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
W20260709 14:52:30.656680 12096 log.cc:927] Time spent T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.070s	user 0.002s	sys 0.000s
I20260709 14:52:30.670519 12045 leader_election.cc:290] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 12 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:30.650532  7922 raft_consensus.cc:2410] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 14:52:30.630110 12040 raft_consensus.cc:697] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:30.657924  7920 pending_rounds.cc:85] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0: Aborting all ops after (but not including) 6
I20260709 14:52:30.695930  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:30.652683 11949 consensus_queue.cc:237] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:30.697355 12036 raft_consensus.cc:515] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:30.714841  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:30.716066  7922 raft_consensus.cc:2393] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 10: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:52:30.717105  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:30.718549  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:30.720012  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:30.720861  7922 raft_consensus.cc:2393] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 10: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:52:30.722546  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:30.725741 12055 leader_election.cc:290] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:30.731820  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:30.733007  7926 raft_consensus.cc:2393] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 13: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:52:30.733747  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:30.735436  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:30.738353  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:30.739936  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:30.740698  7927 raft_consensus.cc:2468] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 12.
I20260709 14:52:30.713343 11895 leader_election.cc:290] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:30.741740  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:30.742656  7925 raft_consensus.cc:2468] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 10.
I20260709 14:52:30.701277  7920 pending_rounds.cc:107] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 14:52:30.706261  7928 raft_consensus.cc:2468] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 10.
I20260709 14:52:30.743439 12036 leader_election.cc:290] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:30.744109  7927 raft_consensus.cc:1275] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 14:52:30.746004  7920 raft_consensus.cc:2889] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:52:30.751688  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:30.753011  7927 pending_rounds.cc:85] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0: Aborting all ops after (but not including) 6
I20260709 14:52:30.753643  7927 pending_rounds.cc:107] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 14:52:30.754004  7927 raft_consensus.cc:2889] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:52:30.744308  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:30.745828  7926 raft_consensus.cc:1240] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 14:52:30.752130  7919 raft_consensus.cc:2468] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 12.
I20260709 14:52:30.757993  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:30.759101  7921 raft_consensus.cc:2468] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 13.
I20260709 14:52:30.759701  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:30.701851  7924 raft_consensus.cc:2393] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 14: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
W20260709 14:52:30.762177  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 111746us
I20260709 14:52:30.763337  7819 leader_election.cc:304] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:30.764722  7923 raft_consensus.cc:2468] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 13.
I20260709 14:52:30.765584  7854 raft_consensus.cc:2468] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 11.
I20260709 14:52:30.768101  7676 catalog_manager.cc:5697] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 11 to 15. New cstate: current_term: 15 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:52:30.759828 12036 raft_consensus.cc:493] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:30.756354 12055 raft_consensus.cc:493] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:30.753317 12039 raft_consensus.cc:493] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:30.779819  7819 leader_election.cc:304] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:30.782377  7894 leader_election.cc:304] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:30.782872 11895 raft_consensus.cc:493] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:52:30.777979 12036 raft_consensus.cc:515] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:30.785321 11895 raft_consensus.cc:515] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:30.787210 12036 leader_election.cc:290] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:30.773587 12045 raft_consensus.cc:493] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:52:30.787907 12040 consensus_queue.cc:237] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:30.775440 12084 raft_consensus.cc:2749] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 14:52:30.791900 12068 raft_consensus.cc:2804] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 14:52:30.792264 12084 raft_consensus.cc:2749] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 14:52:30.788081 12045 raft_consensus.cc:515] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:30.777702 12039 raft_consensus.cc:515] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:30.794883  7819 leader_election.cc:304] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:52:30.796263 12084 raft_consensus.cc:2804] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Leader election won for term 14
I20260709 14:52:30.796828 12084 raft_consensus.cc:697] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:52:30.778692 12055 raft_consensus.cc:515] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:30.797924 12084 consensus_queue.cc:237] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:30.802137  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:30.802471 12055 leader_election.cc:290] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:30.803095  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:30.797029 12039 leader_election.cc:290] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:30.803356  7846 raft_consensus.cc:2468] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 13.
I20260709 14:52:30.804265  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:30.806782  7852 raft_consensus.cc:2410] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 14:52:30.807377  7854 raft_consensus.cc:2468] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 12.
I20260709 14:52:30.811301  7819 leader_election.cc:304] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:52:30.811738  7894 leader_election.cc:304] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:30.792793 12068 raft_consensus.cc:493] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:52:30.813951 12068 raft_consensus.cc:3060] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:52:30.806740 12095 leader_election.cc:290] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:30.817998 11982 raft_consensus.cc:2804] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader election won for term 12
I20260709 14:52:30.818305 12095 consensus_queue.cc:1048] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 14:52:30.821094  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:30.826206  7921 raft_consensus.cc:2393] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 12: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:52:30.827389  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:30.818661 11982 raft_consensus.cc:697] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:52:30.827913 12068 raft_consensus.cc:515] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:30.829046 11982 consensus_queue.cc:237] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:30.831023 12068 leader_election.cc:290] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:52:30.834004  7744 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.101.67:40785 timed out after 1.983s (SENT) [suppressed 56 similar messages]
I20260709 14:52:30.834270  7819 leader_election.cc:304] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:52:30.836683  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:30.822574  7920 raft_consensus.cc:1275] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 14:52:30.838487  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:30.838729  7819 leader_election.cc:304] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:52:30.840660  7920 raft_consensus.cc:1275] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 14:52:30.842656  7920 raft_consensus.cc:1275] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 14:52:30.842768  7819 leader_election.cc:304] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:30.844350  7921 raft_consensus.cc:2468] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 8.
I20260709 14:52:30.846189  7819 leader_election.cc:304] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:30.827286 12072 consensus_queue.cc:1048] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 14:52:30.826242  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:30.849956  7922 raft_consensus.cc:2393] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 13: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:52:30.848903 12072 consensus_queue.cc:1048] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 14:52:30.853426 12072 raft_consensus.cc:2804] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader election won for term 10
I20260709 14:52:30.851583  7819 leader_election.cc:304] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:30.855679  7894 leader_election.cc:304] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:30.856424  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:30.857105  7854 raft_consensus.cc:3060] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:52:30.859344  7847 raft_consensus.cc:1240] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 11. Current term is 12. Ops: []
W20260709 14:52:30.860685  7743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:30.870829  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:30.871920  7779 raft_consensus.cc:2410] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 14:52:30.853662 11982 raft_consensus.cc:2804] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader election won for term 12
I20260709 14:52:30.875442  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:30.876305  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783e4874513449ef9084b833f188a6d3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:30.854084 12072 raft_consensus.cc:697] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:52:30.969492  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:30.912045  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:30.943787  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:30.861459 12055 raft_consensus.cc:2804] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 14:52:30.988042  7744 leader_election.cc:304] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:52:31.047611  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 59733.4us
W20260709 14:52:31.035548  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 67406.6us
I20260709 14:52:30.970468  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:31.049896  7923 raft_consensus.cc:2468] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 13.
I20260709 14:52:31.051102  7778 raft_consensus.cc:2468] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 15.
I20260709 14:52:30.901903  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:30.981803  7928 raft_consensus.cc:2393] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 12: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:52:30.979267  7779 raft_consensus.cc:2393] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 15: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:52:30.878585  7819 leader_election.cc:304] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:31.046068  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:30.929054  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:31.055931  7925 raft_consensus.cc:2468] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 14.
I20260709 14:52:30.940992  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:31.057379  7774 raft_consensus.cc:2393] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 13: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:52:31.057320  7744 leader_election.cc:304] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
W20260709 14:52:30.910832  7743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:30.936136  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:31.059615  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:31.060210  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce9c0ef2db24c13a8b1402f21819458" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:31.060542  7778 raft_consensus.cc:2468] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 12.
I20260709 14:52:31.059098  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:30.950133  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:30.948465  7854 raft_consensus.cc:2468] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 12.
I20260709 14:52:30.952654 12039 raft_consensus.cc:493] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:30.906208 12045 leader_election.cc:290] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:30.901894 12105 raft_consensus.cc:2804] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 14:52:30.890213  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:30.967583  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:30.919294  7777 raft_consensus.cc:1240] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 12. Current term is 13. Ops: []
I20260709 14:52:30.936260  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c563cc7cfbe4d59be4ffc5cf847ce56" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:30.861676 12077 raft_consensus.cc:493] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:30.871271 12068 raft_consensus.cc:2804] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 14:52:30.920516 11895 leader_election.cc:290] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:30.950970 11963 raft_consensus.cc:493] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:30.906840 12111 raft_consensus.cc:2804] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 14:52:30.942281 12036 raft_consensus.cc:493] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:30.926553 12108 raft_consensus.cc:2804] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Leader election won for term 13
I20260709 14:52:30.980031  7676 catalog_manager.cc:5697] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:52:31.055413 12055 raft_consensus.cc:493] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:31.085835  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:30.911063  8640 raft_consensus.cc:2468] T 9441e831627143a991a1556dcdce71e3 P 9418391fa82a42c79c6cad13ba91d964 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 5.
I20260709 14:52:31.055733 12054 raft_consensus.cc:2749] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 14:52:31.054509 11982 raft_consensus.cc:697] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
W20260709 14:52:31.096022  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 217297us
W20260709 14:52:31.102917  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 45687.3us
I20260709 14:52:31.054805 12095 raft_consensus.cc:493] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:52:30.975449 12065 consensus_queue.cc:1048] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.098s
I20260709 14:52:31.113127  7770 raft_consensus.cc:2468] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 13.
I20260709 14:52:31.046211 12064 consensus_queue.cc:1048] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 14:52:31.117735  7774 raft_consensus.cc:1275] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 14:52:31.125488  7744 leader_election.cc:304] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:52:31.080863 12058 raft_consensus.cc:2804] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 14:52:31.077576 12105 raft_consensus.cc:493] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:31.109901 12045 raft_consensus.cc:2804] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Leader election won for term 13
I20260709 14:52:31.076167 12109 raft_consensus.cc:493] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:52:31.088614 12068 raft_consensus.cc:493] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:31.113505 12111 raft_consensus.cc:493] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:31.137166 12065 consensus_queue.cc:1243] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer 1e9289592458429bbddb19c2e7b7b7b0 log is divergent from this leader: its last log entry 12.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 14:52:31.149945  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9441e831627143a991a1556dcdce71e3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:31.150168  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:31.150710 12065 raft_consensus.cc:2804] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 14:52:31.115512 11963 raft_consensus.cc:515] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:31.151202 12065 raft_consensus.cc:493] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:31.151618 12065 raft_consensus.cc:3060] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:52:31.152336  7853 raft_consensus.cc:1240] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 11. Current term is 12. Ops: []
I20260709 14:52:31.143981  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18d29d52d304c87b930d4fb5eaf50b1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:31.156682  7847 raft_consensus.cc:2468] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 7.
I20260709 14:52:31.136018  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:31.116576  7676 catalog_manager.cc:5697] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 9 to 10, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 10 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:52:31.115556 12055 raft_consensus.cc:3060] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 14:52:31.139331  7675 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54350 (request call id 374) took 9337 ms. Trace:
I20260709 14:52:31.077399 12039 raft_consensus.cc:515] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:31.160085  6549 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 14:52:31.162776  7676 catalog_manager.cc:5697] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 11 to 12, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 12 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:52:31.126909 12070 raft_consensus.cc:493] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:31.124034 12108 raft_consensus.cc:697] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:52:31.167280  7742 leader_election.cc:304] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 9418391fa82a42c79c6cad13ba91d964; no voters: 
I20260709 14:52:31.137683 12058 raft_consensus.cc:493] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:31.156869 12068 raft_consensus.cc:3060] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 14:52:31.140259 12105 raft_consensus.cc:3060] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Advancing to term 13
I20260709 14:52:31.116816 12036 raft_consensus.cc:515] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:31.115751 12077 raft_consensus.cc:515] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:31.159472 12045 raft_consensus.cc:697] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:52:31.157179 12111 raft_consensus.cc:3060] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Advancing to term 14
I20260709 14:52:31.186029  7676 catalog_manager.cc:5697] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 10 to 11, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 11 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
W20260709 14:52:31.203671  7893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:31.198378  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:31.204959  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:31.165761  7675 rpcz_store.cc:276] 0709 14:52:21.790203 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:21.792320 (+  2117us) service_pool.cc:224] Handling call
0709 14:52:31.127323 (+9335003us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 14:52:30.088530 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 14:52:30.089518 (+   988us) write_op.cc:432] Acquiring schema lock in shared mode
0709 14:52:30.089689 (+   171us) write_op.cc:435] Acquired schema lock
0709 14:52:30.089723 (+    34us) tablet.cc:662] Decoding operations
0709 14:52:30.091415 (+  1692us) write_op.cc:620] Acquiring the partition lock for write op
0709 14:52:30.091601 (+   186us) write_op.cc:641] Partition lock acquired for write op
0709 14:52:30.091636 (+    35us) tablet.cc:685] Acquiring locks for 11 operations
0709 14:52:30.133301 (+ 41665us) tablet.cc:701] Row locks acquired
0709 14:52:30.133360 (+    59us) write_op.cc:260] PREPARE: finished
0709 14:52:30.133560 (+   200us) write_op.cc:270] Start()
0709 14:52:30.133728 (+   168us) write_op.cc:276] Timestamp: P: 1783608750133496 usec, L: 0
0709 14:52:30.133747 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 14:52:30.134498 (+   751us) log.cc:844] Serialized 4385 byte log entry
0709 14:52:30.256189 (+121691us) op_driver.cc:464] REPLICATION: finished
0709 14:52:30.454515 (+198326us) write_op.cc:301] APPLY: starting
0709 14:52:30.457217 (+  2702us) tablet.cc:1367] starting BulkCheckPresence
0709 14:52:30.518639 (+ 61422us) tablet.cc:1370] finished BulkCheckPresence
0709 14:52:30.518716 (+    77us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 14:52:30.547677 (+ 28961us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 14:52:30.547936 (+   259us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=22,key_file_lookups=22,delta_file_lookups=22,mrs_lookups=0
0709 14:52:30.547985 (+    49us) write_op.cc:312] APPLY: finished
0709 14:52:30.548329 (+   344us) log.cc:844] Serialized 105 byte log entry
0709 14:52:30.573848 (+ 25519us) write_op.cc:489] Releasing partition, row and schema locks
0709 14:52:30.578132 (+  4284us) write_op.cc:454] Released schema lock
0709 14:52:30.578201 (+    69us) write_op.cc:341] FINISH: Updating metrics
0709 14:52:30.578892 (+   691us) write_op.cc:489] Releasing partition, row and schema locks
0709 14:52:30.578929 (+    37us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":129573,"reported_tablets":42,"child_traces":[["op",{"apply.queue_time_us":181731,"apply.run_cpu_time_us":16148,"apply.run_wall_time_us":132319,"cfile_cache_hit":46,"cfile_cache_hit_bytes":49975,"num_ops":11,"prepare.queue_time_us":117435,"prepare.run_cpu_time_us":6578,"prepare.run_wall_time_us":49727,"replication_time_us":122166,"thread_start_us":192625,"threads_started":2}]]}
W20260709 14:52:31.222048  7743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:31.226768  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:31.188599 12058 raft_consensus.cc:3060] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Advancing to term 13
I20260709 14:52:31.230399  7676 catalog_manager.cc:5697] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:52:31.193321 12117 raft_consensus.cc:2804] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Leader election won for term 5
I20260709 14:52:31.252842  7676 catalog_manager.cc:5697] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 11 to 12, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 12 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:52:31.255069  7676 catalog_manager.cc:5697] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 11 to 12, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 12 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:52:31.240036 11963 leader_election.cc:290] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:31.240602  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:31.244410  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:31.245720  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:31.246729  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:31.247761  7771 raft_consensus.cc:3060] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Advancing to term 14
I20260709 14:52:31.257448  7676 catalog_manager.cc:5697] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 9 to 10, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 10 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:52:31.259251  7851 raft_consensus.cc:2393] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 10: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:52:31.161267 12095 raft_consensus.cc:515] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:31.264176  7676 catalog_manager.cc:5697] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:52:31.265715  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:31.164474 12109 raft_consensus.cc:515] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:31.273932  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:31.271060  7676 catalog_manager.cc:5697] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 9 to 11, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 11 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:52:31.274116  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:31.274503  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:31.188841 12070 raft_consensus.cc:515] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:31.274910  7847 raft_consensus.cc:2468] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 12.
I20260709 14:52:31.280285  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:31.282510  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:31.283720  7676 catalog_manager.cc:5697] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:52:31.288849  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:31.291136  7894 leader_election.cc:304] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:31.263103 11791 raft_consensus.cc:493] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:31.294504  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:31.297384  7676 catalog_manager.cc:5697] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 7 to 11, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 11 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
W20260709 14:52:31.299397  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 156645us
I20260709 14:52:31.299963  7846 raft_consensus.cc:2393] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 13: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:52:31.280143 12117 raft_consensus.cc:697] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:52:31.202718 12072 consensus_queue.cc:237] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:31.304157  7676 catalog_manager.cc:5697] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:52:31.224973 11982 consensus_queue.cc:237] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:31.321385 12070 leader_election.cc:290] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:31.321662 12095 leader_election.cc:290] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:31.322631 12121 raft_consensus.cc:2804] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 14:52:31.322238  7676 catalog_manager.cc:5697] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 9 to 10, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 10 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:52:31.324688  7676 catalog_manager.cc:5697] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 11 to 12, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 12 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:52:31.330191 12045 consensus_queue.cc:237] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:31.331984  7676 catalog_manager.cc:5697] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:52:31.334316  7676 catalog_manager.cc:5697] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 14 to 15, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 15 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:52:31.338913  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:31.344450  7771 raft_consensus.cc:2468] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 14.
I20260709 14:52:31.348619  7744 leader_election.cc:304] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:52:31.346215 12064 consensus_queue.cc:1048] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 14:52:31.363811  7744 leader_election.cc:304] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:52:31.301220 12031 consensus_queue.cc:1059] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 14:52:31.299597 11791 raft_consensus.cc:515] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:31.362290  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:31.345119 12121 raft_consensus.cc:697] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:31.375954  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:52:31.387426  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 96388.1us
I20260709 14:52:31.388105  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c563cc7cfbe4d59be4ffc5cf847ce56" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:31.390528 12117 consensus_queue.cc:237] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:52:31.391769 12039 leader_election.cc:290] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:31.367560 12118 consensus_queue.cc:1048] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
W20260709 14:52:31.394205 12116 log.cc:927] Time spent T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 14:52:31.394745 12118 raft_consensus.cc:2804] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader election won for term 13
I20260709 14:52:31.395442 12118 raft_consensus.cc:697] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:52:31.300979 12108 consensus_queue.cc:237] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:31.398648 12065 raft_consensus.cc:515] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:31.375849 12106 log.cc:927] Time spent T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.238s	user 0.002s	sys 0.000s
W20260709 14:52:31.388319 12112 log.cc:927] Time spent T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.208s	user 0.000s	sys 0.002s
W20260709 14:52:31.390177 12103 log.cc:927] Time spent T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.113s	user 0.000s	sys 0.001s
I20260709 14:52:31.388841 12125 raft_consensus.cc:2804] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 14:52:31.410706 12125 raft_consensus.cc:493] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:31.411108 12125 raft_consensus.cc:3060] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Advancing to term 13
I20260709 14:52:31.412878  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:31.413134 12109 leader_election.cc:290] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:31.413638  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:31.414394  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:31.415043 12121 consensus_queue.cc:237] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:31.415781  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:31.423610  7846 raft_consensus.cc:1275] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 14:52:31.414314 12077 leader_election.cc:290] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:31.426332  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:52:31.424264  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 60526.6us
W20260709 14:52:31.446485  7743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:31.457118  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9441e831627143a991a1556dcdce71e3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:31.460873  7744 leader_election.cc:304] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:52:31.461236  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:31.396553 11791 leader_election.cc:290] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:31.462661  7845 raft_consensus.cc:2410] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 14:52:31.463940  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:31.401134 12065 leader_election.cc:290] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 10 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:31.466593  7744 leader_election.cc:304] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:52:31.473006  7845 raft_consensus.cc:1275] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 14:52:31.423375 12031 raft_consensus.cc:493] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:31.478930  7845 raft_consensus.cc:1275] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 14:52:31.482654  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18d29d52d304c87b930d4fb5eaf50b1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:31.483584  7849 raft_consensus.cc:3060] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Advancing to term 9
I20260709 14:52:31.475584 12110 raft_consensus.cc:493] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:31.486428 12110 raft_consensus.cc:515] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:31.489984 12133 raft_consensus.cc:2804] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 14:52:31.490725 12133 raft_consensus.cc:493] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:31.491185 12133 raft_consensus.cc:3060] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Advancing to term 14
I20260709 14:52:31.494457  7850 raft_consensus.cc:1240] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 10. Current term is 11. Ops: []
I20260709 14:52:31.496305  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:31.497267  7848 raft_consensus.cc:2468] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 16.
I20260709 14:52:31.396546 12118 consensus_queue.cc:237] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:31.490782  7854 raft_consensus.cc:1275] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 14:52:31.507885  7854 pending_rounds.cc:85] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting all ops after (but not including) 7
I20260709 14:52:31.508141  7854 pending_rounds.cc:107] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 14:52:31.508682  7854 raft_consensus.cc:2889] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:52:31.513125  7852 raft_consensus.cc:1275] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 7. (term mismatch)
I20260709 14:52:31.513595  7852 pending_rounds.cc:85] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting all ops after (but not including) 6
I20260709 14:52:31.513803  7852 pending_rounds.cc:107] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 14:52:31.514024  7852 raft_consensus.cc:2889] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:52:31.482625 11791 raft_consensus.cc:2804] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 14:52:31.517993 11791 raft_consensus.cc:493] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting leader election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:52:31.518564 11791 raft_consensus.cc:3060] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:52:31.519152 12039 raft_consensus.cc:493] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:31.519886 12039 raft_consensus.cc:515] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:31.528093  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258d6c2dda954bf5b65930fde8ecb9f3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:31.528170  7852 raft_consensus.cc:3060] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:52:31.528759  7848 raft_consensus.cc:2468] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 11.
I20260709 14:52:31.469134 12054 consensus_queue.cc:1048] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 14:52:31.546672  7847 raft_consensus.cc:1240] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 11. Current term is 12. Ops: []
I20260709 14:52:31.509784 12105 raft_consensus.cc:515] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:31.547452 12056 consensus_queue.cc:1048] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.004s
I20260709 14:52:31.551882 12105 leader_election.cc:290] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:31.553602 12054 raft_consensus.cc:493] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:31.548023 12058 raft_consensus.cc:515] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:31.554221 12054 raft_consensus.cc:515] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:31.555899 12058 leader_election.cc:290] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:31.556692 12054 leader_election.cc:290] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:31.468228 12064 consensus_queue.cc:1048] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 14:52:31.557358  7819 leader_election.cc:304] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:31.558284 12105 raft_consensus.cc:2764] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 LEADER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 14:52:31.515045 12114 raft_consensus.cc:493] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:31.559015 12114 raft_consensus.cc:515] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:31.558365  8640 raft_consensus.cc:1275] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 [term 9 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 14:52:31.559669 12039 leader_election.cc:290] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:31.468750 12077 consensus_queue.cc:1048] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 14:52:31.510080 12031 raft_consensus.cc:515] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:31.510279 12065 raft_consensus.cc:493] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:31.563426 12114 leader_election.cc:290] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:31.562850 12065 raft_consensus.cc:515] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:31.567307  7894 leader_election.cc:304] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:31.503968 12068 raft_consensus.cc:515] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:31.549441 12108 raft_consensus.cc:493] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:31.583493  7819 leader_election.cc:304] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:31.563475 12031 leader_election.cc:290] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:31.585968  7819 leader_election.cc:304] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:31.585997  7894 leader_election.cc:304] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:31.597350  7852 raft_consensus.cc:1275] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 14:52:31.601153  7819 leader_election.cc:304] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:31.601648 12030 raft_consensus.cc:3055] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 14:52:31.602205 12030 raft_consensus.cc:740] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:31.602697  7819 leader_election.cc:304] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:31.587942 12109 raft_consensus.cc:2804] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 14:52:31.603771 12109 raft_consensus.cc:493] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:31.603199 12030 consensus_queue.cc:260] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:31.605747 12119 raft_consensus.cc:2804] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 14:52:31.606333 12119 raft_consensus.cc:493] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:31.606743 12119 raft_consensus.cc:3060] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Advancing to term 8
I20260709 14:52:31.607210 12068 leader_election.cc:290] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 13 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:31.583722 12056 raft_consensus.cc:2804] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 14:52:31.604241 12109 raft_consensus.cc:3060] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:52:31.617658  7849 raft_consensus.cc:2468] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 9.
I20260709 14:52:31.621848  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:31.624747  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:31.626060  7926 raft_consensus.cc:1275] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 9. (term mismatch)
I20260709 14:52:31.626526  7926 pending_rounds.cc:85] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0: Aborting all ops after (but not including) 8
I20260709 14:52:31.626816  7926 pending_rounds.cc:107] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 14:52:31.626909  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:31.627094  7926 raft_consensus.cc:2889] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:52:31.616137 12045 raft_consensus.cc:2804] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Leader election won for term 16
I20260709 14:52:31.629971 12045 raft_consensus.cc:697] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:52:31.588472 12108 raft_consensus.cc:515] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:31.631171 12045 consensus_queue.cc:237] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:31.633374 12108 leader_election.cc:290] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:31.633767  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:31.634440  7848 raft_consensus.cc:2468] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 11.
I20260709 14:52:31.634817  7819 leader_election.cc:304] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:31.595782 12105 raft_consensus.cc:493] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:31.637686 12124 raft_consensus.cc:493] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:31.638154 12105 raft_consensus.cc:515] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:31.638731 12124 raft_consensus.cc:515] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:31.640648 12105 leader_election.cc:290] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:31.641424 12105 raft_consensus.cc:2804] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader election won for term 11
I20260709 14:52:31.636940  7819 leader_election.cc:304] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:31.568310 12077 consensus_queue.cc:1048] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 14:52:31.644601  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:31.631176  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
W20260709 14:52:31.644245  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 88129.3us
I20260709 14:52:31.646006  7923 raft_consensus.cc:3060] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Advancing to term 15
W20260709 14:52:31.647256  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 180767us
I20260709 14:52:31.609148 12031 raft_consensus.cc:2804] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 14:52:31.655126  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:31.581537 12055 raft_consensus.cc:515] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:31.649016  7744 leader_election.cc:304] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 9418391fa82a42c79c6cad13ba91d964
I20260709 14:52:31.649971  7922 raft_consensus.cc:1240] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 12. Current term is 13. Ops: []
I20260709 14:52:31.660638  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:31.651827  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:31.647951  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:31.576220 12114 consensus_queue.cc:1059] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 14:52:31.662460  7850 raft_consensus.cc:3060] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Advancing to term 13
I20260709 14:52:31.617552 12056 raft_consensus.cc:493] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:31.660524  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:31.661422  7926 raft_consensus.cc:2468] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 13.
I20260709 14:52:31.665678  7920 raft_consensus.cc:1240] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 13. Current term is 14. Ops: []
I20260709 14:52:31.665803  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:31.666781  7926 raft_consensus.cc:2393] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 11: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:52:31.664783  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:31.669539  7928 raft_consensus.cc:2393] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 14: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:52:31.671290  7927 raft_consensus.cc:1275] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 14:52:31.647166 12110 leader_election.cc:290] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:31.655715 12031 raft_consensus.cc:493] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:31.660931 12108 raft_consensus.cc:2804] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 14:52:31.646641 12105 raft_consensus.cc:697] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:52:31.725051  7923 raft_consensus.cc:2468] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 15.
I20260709 14:52:31.670423 12056 raft_consensus.cc:3060] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 14:52:31.616101 12035 consensus_queue.cc:1059] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 14:52:31.727658  7928 raft_consensus.cc:1275] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 14:52:31.727576  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 90742.3us
I20260709 14:52:31.747392  7819 leader_election.cc:304] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:31.727793 12117 consensus_queue.cc:1059] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 14:52:31.749439 11963 consensus_queue.cc:1048] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 14:52:31.721891  7744 leader_election.cc:304] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:52:31.729992  7745 leader_election.cc:304] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:31.750840  7894 leader_election.cc:304] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:31.749926 12117 raft_consensus.cc:3055] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 LEADER]: Stepping down as leader of term 11
I20260709 14:52:31.726311 12114 consensus_queue.cc:1243] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer 3876b8ee8d744cb18e91d97aae93b1ac log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 14:52:31.758522  7745 leader_election.cc:304] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:31.740247 12031 raft_consensus.cc:3060] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:52:31.725301 12141 raft_consensus.cc:2749] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 14:52:31.739950 12108 raft_consensus.cc:493] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:31.766805  7819 leader_election.cc:304] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:31.727226 12122 consensus_queue.cc:1048] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.178s
I20260709 14:52:31.758033 12072 raft_consensus.cc:2749] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 14:52:31.762138 12110 raft_consensus.cc:2804] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader election won for term 11
I20260709 14:52:31.760108 12070 raft_consensus.cc:2804] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 14:52:31.759326 12117 raft_consensus.cc:740] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:52:31.763345 12054 raft_consensus.cc:2804] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 14:52:31.763592 12077 raft_consensus.cc:2749] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 14:52:31.794014 12131 log.cc:927] Time spent T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.217s	user 0.001s	sys 0.001s
I20260709 14:52:31.794210 12065 leader_election.cc:290] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:31.776563 12108 raft_consensus.cc:3060] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:52:31.798430  7819 leader_election.cc:304] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:31.804826  7850 raft_consensus.cc:2468] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 13.
I20260709 14:52:31.776403 12124 leader_election.cc:290] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:31.784255 11982 raft_consensus.cc:2804] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 14:52:31.796432 12133 raft_consensus.cc:515] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:31.828320  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 69868us
I20260709 14:52:31.786911 12070 raft_consensus.cc:493] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 14:52:31.838192  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 77445.9us
I20260709 14:52:31.838769  7745 leader_election.cc:304] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:31.839324  7893 leader_election.cc:304] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:31.840498  7745 leader_election.cc:304] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:31.808126 12141 raft_consensus.cc:2749] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 14:52:31.832299 12132 log.cc:927] Time spent T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.262s	user 0.002s	sys 0.000s
I20260709 14:52:31.801896 12054 raft_consensus.cc:493] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:31.827204 12035 raft_consensus.cc:493] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:31.849687  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:31.846493  7745 leader_election.cc:304] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:31.827996 12110 raft_consensus.cc:697] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:52:31.855434  7926 pending_rounds.cc:85] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0: Aborting all ops after (but not including) 6
I20260709 14:52:31.838318 12070 raft_consensus.cc:3060] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:52:31.863225  7926 pending_rounds.cc:107] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 14:52:31.859113  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:31.835494 11982 raft_consensus.cc:493] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:31.861835  7893 leader_election.cc:304] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:31.859195  7923 raft_consensus.cc:2410] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 14:52:31.872151  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:31.869982  7926 raft_consensus.cc:2889] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 14:52:31.870656  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 72366.9us
I20260709 14:52:31.874109  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:31.849126 11963 raft_consensus.cc:2749] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 14:52:31.852169 12077 raft_consensus.cc:3060] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:52:31.875044  7923 raft_consensus.cc:3060] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 14:52:31.876681  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:31.881333  7927 raft_consensus.cc:2468] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 14.
I20260709 14:52:31.882628  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:31.884099  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:31.884827  7927 raft_consensus.cc:2393] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 14: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:52:31.876593 11982 raft_consensus.cc:3060] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Advancing to term 13
I20260709 14:52:31.861616 12095 raft_consensus.cc:2804] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 14:52:31.859622 12054 raft_consensus.cc:3060] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Advancing to term 15
I20260709 14:52:31.897141  7893 leader_election.cc:304] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:31.892447  7923 raft_consensus.cc:2468] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 13.
I20260709 14:52:31.847504 12125 raft_consensus.cc:515] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:31.837729 12105 consensus_queue.cc:237] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:31.879778 12141 raft_consensus.cc:493] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:31.923384 12141 raft_consensus.cc:515] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:31.925832 12143 log.cc:927] Time spent T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 14:52:31.904428  7893 leader_election.cc:304] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:31.927696 12141 leader_election.cc:290] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:31.935091 12125 leader_election.cc:290] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:52:31.936925 12142 log.cc:927] Time spent T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
W20260709 14:52:31.905407 12134 log.cc:927] Time spent T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.227s	user 0.001s	sys 0.001s
I20260709 14:52:31.896129 12058 raft_consensus.cc:3060] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Advancing to term 14
W20260709 14:52:31.928896 12140 log.cc:927] Time spent T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
I20260709 14:52:31.865178 12035 raft_consensus.cc:515] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:31.944696  8599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 210381us
W20260709 14:52:31.945006  8598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 102160us
I20260709 14:52:31.895970 12095 raft_consensus.cc:493] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:31.900624 12055 leader_election.cc:290] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:31.907326 12068 raft_consensus.cc:2804] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 14:52:31.951546  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 75986.3us
W20260709 14:52:31.952061  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 47780.3us
I20260709 14:52:31.940006 12109 raft_consensus.cc:515] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:31.953920  7893 leader_election.cc:304] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:31.954600 12114 raft_consensus.cc:2749] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 14:52:31.955399 12133 leader_election.cc:290] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 14 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:52:31.956549 12138 log.cc:927] Time spent T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.164s	user 0.000s	sys 0.002s
I20260709 14:52:31.957414 12149 raft_consensus.cc:2749] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 14:52:31.958316 12129 raft_consensus.cc:2749] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 14:52:31.962531 12036 leader_election.cc:290] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:31.952747 12095 raft_consensus.cc:3060] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:52:31.967322 12035 leader_election.cc:290] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:31.968039 11791 raft_consensus.cc:515] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:31.967720 12117 consensus_queue.cc:260] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:31.968631 12068 raft_consensus.cc:493] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:31.973104  7893 leader_election.cc:304] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:52:32.027163  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 54123us
I20260709 14:52:31.978703  7920 raft_consensus.cc:2468] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 10.
W20260709 14:52:31.980870 12111 consensus_meta.cc:287] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent flushing consensus metadata: real 0.710s	user 0.010s	sys 0.004s
I20260709 14:52:31.978240 12039 raft_consensus.cc:2749] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 14:52:32.025149  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 71396.1us
I20260709 14:52:32.040027  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:32.040263  7893 leader_election.cc:304] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:32.041165  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:32.044428  7775 raft_consensus.cc:2393] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 12: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:52:32.041431 11963 consensus_queue.cc:1048] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 14:52:32.042276  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:32.043538  7771 raft_consensus.cc:3060] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Advancing to term 15
I20260709 14:52:32.045625  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:32.046366  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:32.046614  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:32.051936  7779 raft_consensus.cc:2468] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 11.
I20260709 14:52:32.052995  7776 raft_consensus.cc:3060] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:52:32.058230  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:32.064069  7772 raft_consensus.cc:1240] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 13. Current term is 14. Ops: []
I20260709 14:52:32.063153  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:32.067072  7777 raft_consensus.cc:2468] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 14.
I20260709 14:52:32.038954 12068 raft_consensus.cc:3060] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 14:52:32.060966  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:31.952546 12110 consensus_queue.cc:237] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:32.042922 12133 raft_consensus.cc:493] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:32.057323 12117 raft_consensus.cc:3060] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:52:32.107410 12133 raft_consensus.cc:515] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:32.108690  7774 raft_consensus.cc:3060] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:52:32.109944 12133 leader_election.cc:290] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:32.102553  7771 raft_consensus.cc:2468] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 15.
I20260709 14:52:32.057580 12036 raft_consensus.cc:2804] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 14:52:32.113914  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:32.118221  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:32.124537  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:32.128283  8639 raft_consensus.cc:1275] T 9441e831627143a991a1556dcdce71e3 P 9418391fa82a42c79c6cad13ba91d964 [term 5 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 14:52:32.091257 12065 raft_consensus.cc:493] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:52:32.129667 12148 raft_consensus.cc:493] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:32.129833 12065 raft_consensus.cc:515] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:32.130801 12148 raft_consensus.cc:515] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:32.132572  7743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:32.135497  7775 raft_consensus.cc:2468] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 16.
I20260709 14:52:32.092105 12149 raft_consensus.cc:493] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:52:32.139899  7774 raft_consensus.cc:2468] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 11.
I20260709 14:52:32.043485 12111 raft_consensus.cc:515] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:32.063658 12031 raft_consensus.cc:515] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:32.119383 12036 raft_consensus.cc:697] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:32.168686  7776 raft_consensus.cc:1275] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 14:52:32.150476 12125 consensus_queue.cc:1048] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 14:52:32.171923  7772 raft_consensus.cc:1275] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 14:52:32.181892  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 335579us
I20260709 14:52:32.183303  7852 raft_consensus.cc:1240] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 13. Current term is 14. Ops: []
W20260709 14:52:32.184793 12144 log.cc:927] Time spent T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.203s	user 0.002s	sys 0.000s
I20260709 14:52:32.155656 12149 raft_consensus.cc:515] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:32.191095  7925 raft_consensus.cc:1240] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 LEADER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 11. Current term is 12. Ops: []
I20260709 14:52:32.190837  7745 leader_election.cc:304] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:32.198406  7772 raft_consensus.cc:1275] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 14:52:32.200022 12065 leader_election.cc:290] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:32.190191 12149 leader_election.cc:290] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:32.189136 12070 raft_consensus.cc:515] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:32.226347  7745 leader_election.cc:304] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:32.231812 12133 raft_consensus.cc:2749] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 14:52:32.234102  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:32.236495  7745 leader_election.cc:304] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:32.237017  7776 raft_consensus.cc:2393] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 13: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:52:32.237501  7772 raft_consensus.cc:1275] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 14:52:32.238178  7745 leader_election.cc:304] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:32.232371  7819 leader_election.cc:304] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:32.234318 12109 leader_election.cc:290] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 11 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:32.250341  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:32.234146 12149 raft_consensus.cc:2749] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 14:52:32.262120 12119 consensus_meta.cc:287] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent flushing consensus metadata: real 0.654s	user 0.007s	sys 0.005s
I20260709 14:52:32.262893 12119 raft_consensus.cc:515] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:32.267663 12119 leader_election.cc:290] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 8 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:32.240737 12064 raft_consensus.cc:3060] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:52:32.269886 12119 consensus_queue.cc:1059] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 14:52:32.271675 12119 consensus_queue.cc:1243] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer 1e9289592458429bbddb19c2e7b7b7b0 log is divergent from this leader: its last log entry 12.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 14:52:32.252655  7745 leader_election.cc:304] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:32.256043  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:32.256845 12030 raft_consensus.cc:3060] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:52:32.258968 12031 leader_election.cc:290] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:32.238971 12105 consensus_queue.cc:1059] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 14:52:32.276795  7772 raft_consensus.cc:2468] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 13.
I20260709 14:52:32.280102  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
W20260709 14:52:32.283682 12118 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.780s	user 0.018s	sys 0.021s
I20260709 14:52:32.283068 12153 consensus_queue.cc:1048] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.048s
W20260709 14:52:32.284173 12146 log.cc:927] Time spent T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964: Append to log took a long time: real 0.283s	user 0.002s	sys 0.000s
I20260709 14:52:32.248731 11791 leader_election.cc:290] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:32.252153 12045 raft_consensus.cc:2804] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 14:52:32.249059 12129 raft_consensus.cc:2749] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 14:52:32.289355  7776 raft_consensus.cc:2468] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 13.
I20260709 14:52:32.272959 12119 consensus_queue.cc:1048] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.004s
I20260709 14:52:32.249715 12133 raft_consensus.cc:2749] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 14:52:32.267784 11949 raft_consensus.cc:3055] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 14:52:32.287859 12109 raft_consensus.cc:3055] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 LEADER]: Stepping down as leader of term 13
W20260709 14:52:32.290882 12118 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.787s	user 0.018s	sys 0.021s
I20260709 14:52:32.306339  7819 leader_election.cc:304] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:32.290644 12125 raft_consensus.cc:2749] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 14:52:32.315126  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:32.315860  7850 raft_consensus.cc:2393] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 10: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:52:32.309389  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:32.316669  7819 leader_election.cc:304] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
W20260709 14:52:32.300273 12056 consensus_meta.cc:287] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0: Time spent flushing consensus metadata: real 0.545s	user 0.014s	sys 0.000s
I20260709 14:52:32.297122 12045 raft_consensus.cc:493] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Starting leader election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:52:32.322489  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:32.313539  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:32.321223  7776 raft_consensus.cc:1240] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 LEADER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 12. Current term is 13. Ops: []
I20260709 14:52:32.324870  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:32.322187 12056 raft_consensus.cc:515] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:32.326583  7772 raft_consensus.cc:3060] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:52:32.327629 12056 leader_election.cc:290] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 17 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:32.317903 12070 leader_election.cc:290] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:32.331590 12153 raft_consensus.cc:2804] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Leader election won for term 15
I20260709 14:52:32.332391 12153 raft_consensus.cc:697] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:52:32.336302 12064 raft_consensus.cc:2749] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 14:52:32.339085 12111 leader_election.cc:290] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 14 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:32.340020 12111 raft_consensus.cc:493] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:32.340571 12111 raft_consensus.cc:515] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:32.307963 12109 raft_consensus.cc:740] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:52:32.304850 11949 raft_consensus.cc:740] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:32.342852 12109 consensus_queue.cc:260] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:32.344245 11949 consensus_queue.cc:260] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:32.344583 12109 raft_consensus.cc:3060] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Advancing to term 14
I20260709 14:52:32.345873 11949 raft_consensus.cc:3060] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:52:32.348352 12058 raft_consensus.cc:2749] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 14:52:32.349591 12119 raft_consensus.cc:2749] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 14:52:32.307873 12077 raft_consensus.cc:2749] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 14:52:32.352882  7745 leader_election.cc:304] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:32.353581  7778 raft_consensus.cc:1275] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 14:52:32.354173 12068 raft_consensus.cc:515] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:32.355266 12054 raft_consensus.cc:515] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:32.310422 11982 raft_consensus.cc:515] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:32.288676 12036 consensus_queue.cc:237] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:32.336302 12108 raft_consensus.cc:515] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:32.364003  7745 leader_election.cc:304] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:32.329830 12045 raft_consensus.cc:3060] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Advancing to term 14
I20260709 14:52:32.368129  7772 raft_consensus.cc:1275] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 14:52:32.368935  7745 leader_election.cc:304] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:32.367799 12064 raft_consensus.cc:2749] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 14:52:32.314082 12105 consensus_queue.cc:1048] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 14:52:32.356612 12068 leader_election.cc:290] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:32.373168  7745 leader_election.cc:304] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:32.375167  7772 raft_consensus.cc:1275] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 14:52:32.377902 12054 leader_election.cc:290] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:32.378573 11982 leader_election.cc:290] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:32.382619 12111 leader_election.cc:290] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:52:32.388113 12151 log.cc:927] Time spent T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.513s	user 0.003s	sys 0.000s
I20260709 14:52:32.391608  6549 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 14:52:32.395715  7777 raft_consensus.cc:1275] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 14:52:32.402750 12054 raft_consensus.cc:493] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:32.403429 12054 raft_consensus.cc:515] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:32.405939 12054 leader_election.cc:290] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:52:32.406569  7743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:32.407601 12054 raft_consensus.cc:2749] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 14:52:32.409602  7745 leader_election.cc:304] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:32.419744  7777 raft_consensus.cc:1240] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 8. Current term is 9. Ops: []
I20260709 14:52:32.423138 12056 raft_consensus.cc:493] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:32.426270 12056 raft_consensus.cc:515] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:32.371253 11791 raft_consensus.cc:2749] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 14:52:32.429392  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 112817us
I20260709 14:52:32.430189  7819 leader_election.cc:304] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:32.431483  7819 leader_election.cc:304] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:32.374504 12077 raft_consensus.cc:2749] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 14:52:32.435935  7745 leader_election.cc:304] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:32.438751  7819 leader_election.cc:304] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:32.442644  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:32.447849  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:32.443288  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:32.449123  7923 raft_consensus.cc:2468] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 13.
I20260709 14:52:32.443672  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:32.450146  7928 raft_consensus.cc:1275] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 14:52:32.422895 11963 raft_consensus.cc:493] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:32.423138 12070 raft_consensus.cc:493] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:32.444775 12125 raft_consensus.cc:2749] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 14:52:32.444772 12111 raft_consensus.cc:2749] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 14:52:32.453367 11963 raft_consensus.cc:515] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:32.460143 11963 leader_election.cc:290] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:32.452868 12148 leader_election.cc:290] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:32.449368 12056 leader_election.cc:290] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:32.453498 11982 raft_consensus.cc:2804] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 14:52:32.464833 11982 raft_consensus.cc:493] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Starting leader election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:52:32.465363 11982 raft_consensus.cc:3060] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Advancing to term 14
I20260709 14:52:32.466794 12070 raft_consensus.cc:515] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:32.470369 12108 leader_election.cc:290] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 12 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:32.471312 12111 consensus_queue.cc:1048] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 14:52:32.428184 12150 log.cc:927] Time spent T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.470s	user 0.004s	sys 0.000s
I20260709 14:52:32.477622 12111 consensus_queue.cc:1048] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 14:52:32.480727 12077 raft_consensus.cc:2749] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 14:52:32.480217  7819 leader_election.cc:304] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:32.485224  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258d6c2dda954bf5b65930fde8ecb9f3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:32.489825 12108 raft_consensus.cc:2804] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 14:52:32.490351 12108 raft_consensus.cc:493] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:32.490897 12108 raft_consensus.cc:3060] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Advancing to term 14
I20260709 14:52:32.485473 12183 raft_consensus.cc:2804] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 14:52:32.492281 12183 raft_consensus.cc:493] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Starting leader election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:52:32.490175  7771 raft_consensus.cc:2468] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 11.
W20260709 14:52:32.494832  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 59217.5us
I20260709 14:52:32.373133 12153 consensus_queue.cc:237] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:32.497776 12175 raft_consensus.cc:493] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:32.498310 12070 leader_election.cc:290] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:32.500290  7852 raft_consensus.cc:1240] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 10. Current term is 11. Ops: []
I20260709 14:52:32.501513 12119 raft_consensus.cc:493] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:32.506843  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:32.446907 12068 raft_consensus.cc:493] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:32.511860  7921 raft_consensus.cc:1275] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 14:52:32.536693  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:32.489084  7777 raft_consensus.cc:1275] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 14:52:32.512069  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:32.487529  7775 raft_consensus.cc:1275] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 14:52:32.512061  7745 leader_election.cc:304] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:52:32.539402  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 59240.5us
I20260709 14:52:32.514698  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:32.515321  7894 leader_election.cc:304] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:32.524704  7770 raft_consensus.cc:1240] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 10. Current term is 11. Ops: []
I20260709 14:52:32.554750  7845 raft_consensus.cc:3060] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Advancing to term 14
I20260709 14:52:32.492678 12183 raft_consensus.cc:3060] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:52:32.556741  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:32.543249  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258d6c2dda954bf5b65930fde8ecb9f3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:32.541702  7771 raft_consensus.cc:1275] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 14:52:32.542126  7745 leader_election.cc:304] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:32.551270  7779 raft_consensus.cc:1275] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 14:52:32.559289  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:32.541003  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:32.551009  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
W20260709 14:52:32.527045  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:52:32.561398  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:32.514616  7848 raft_consensus.cc:1240] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 12. Current term is 13. Ops: []
I20260709 14:52:32.488903 11982 raft_consensus.cc:515] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:32.556746  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:32.564687  7854 raft_consensus.cc:1240] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 11. Current term is 12. Ops: []
I20260709 14:52:32.510191 12095 raft_consensus.cc:515] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:32.577162 12158 raft_consensus.cc:2804] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 14:52:32.542294 12119 raft_consensus.cc:515] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:32.561405  7745 leader_election.cc:304] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:32.567785  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:32.556010 11949 raft_consensus.cc:493] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:52:32.545476 12077 raft_consensus.cc:2749] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 14:52:32.574662  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258d6c2dda954bf5b65930fde8ecb9f3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:32.558383  7819 leader_election.cc:304] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
W20260709 14:52:32.618204  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 59963.6us
I20260709 14:52:32.586473  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:32.619743  7775 raft_consensus.cc:2468] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 11.
I20260709 14:52:32.588752  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:32.544413  7744 leader_election.cc:304] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:32.600144  7847 raft_consensus.cc:1240] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 8. Current term is 9. Ops: []
I20260709 14:52:32.596894  7924 raft_consensus.cc:2468] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 12.
I20260709 14:52:32.589516  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:32.621706  7774 raft_consensus.cc:2468] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 10.
I20260709 14:52:32.587809  7920 raft_consensus.cc:2468] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 13.
I20260709 14:52:32.621038  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:32.623579  7775 raft_consensus.cc:3060] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Advancing to term 13
I20260709 14:52:32.622308  7779 raft_consensus.cc:3060] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:52:32.626092  7845 raft_consensus.cc:2468] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 14.
I20260709 14:52:32.615948  7773 raft_consensus.cc:2468] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 12.
I20260709 14:52:32.617434  7771 raft_consensus.cc:3060] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Advancing to term 12
W20260709 14:52:32.615043  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 53731.2us
I20260709 14:52:32.600010  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:32.563357 12148 raft_consensus.cc:2749] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 14:52:32.547233 12068 raft_consensus.cc:515] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:32.656510  7745 leader_election.cc:304] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:52:32.571569 12180 log.cc:927] Time spent T 9441e831627143a991a1556dcdce71e3 P 9418391fa82a42c79c6cad13ba91d964: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
I20260709 14:52:32.677062  7848 raft_consensus.cc:1275] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 14:52:32.537388 12175 raft_consensus.cc:515] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:32.681603  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:32.682864  7774 raft_consensus.cc:2468] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 12.
W20260709 14:52:32.688222  7743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:32.588763 12056 consensus_queue.cc:1059] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.102s
I20260709 14:52:32.640419 11949 raft_consensus.cc:515] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:32.673429 12177 log.cc:927] Time spent T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 14:52:32.616379 12158 raft_consensus.cc:697] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:32.633828 12125 raft_consensus.cc:2749] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 14:52:32.690822  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:32.665751 12109 raft_consensus.cc:2804] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 14:52:32.713995  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:52:32.742204  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 197931us
I20260709 14:52:32.713680  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:32.723834  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:32.744408  7848 raft_consensus.cc:2468] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 13.
I20260709 14:52:32.743283  7744 leader_election.cc:304] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:52:32.671121 12035 raft_consensus.cc:493] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:32.690022  7775 raft_consensus.cc:2468] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 13.
I20260709 14:52:32.748741  7771 raft_consensus.cc:2468] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 12.
I20260709 14:52:32.747206  7744 leader_election.cc:304] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:52:32.750211  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:32.753243  7744 leader_election.cc:304] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:52:32.748641  7675 catalog_manager.cc:5697] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 reported cstate change: term changed from 7 to 9, leader changed from 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68) to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 9 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } } }
I20260709 14:52:32.759195  7779 raft_consensus.cc:2468] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 12.
I20260709 14:52:32.665619 12110 consensus_queue.cc:1048] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.083s
I20260709 14:52:32.694058 12077 raft_consensus.cc:2749] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 14:52:32.704581 12160 raft_consensus.cc:493] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:32.720460 12148 raft_consensus.cc:493] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:32.703464 11982 leader_election.cc:290] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 14 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:32.707615 12175 leader_election.cc:290] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:32.711544 12095 leader_election.cc:290] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 9 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:32.676676 12064 consensus_queue.cc:1048] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.077s
I20260709 14:52:32.768108 12149 raft_consensus.cc:2804] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader election won for term 10
W20260709 14:52:32.834440  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 213911us
I20260709 14:52:32.665818 12105 consensus_queue.cc:1048] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.081s
I20260709 14:52:32.696029 11949 leader_election.cc:290] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:32.690346 12117 raft_consensus.cc:2749] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 14:52:32.745558 12109 raft_consensus.cc:493] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:32.692111 11963 raft_consensus.cc:493] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:32.820719  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:32.848014  7854 raft_consensus.cc:2468] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 8.
I20260709 14:52:32.755322 12054 raft_consensus.cc:2804] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 14:52:32.694550 12118 consensus_queue.cc:1048] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.099s
I20260709 14:52:32.694265 12065 consensus_queue.cc:1048] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.099s
I20260709 14:52:32.760280 12170 raft_consensus.cc:2804] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader election won for term 13
I20260709 14:52:32.842487  7819 leader_election.cc:304] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:32.761957 12035 raft_consensus.cc:515] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:32.716574 12158 consensus_queue.cc:237] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:32.900015  7854 raft_consensus.cc:1240] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 7. Current term is 8. Ops: []
I20260709 14:52:32.793670 12120 consensus_queue.cc:1048] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 14:52:32.823191 12045 raft_consensus.cc:515] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:32.847268 12109 raft_consensus.cc:3060] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Advancing to term 14
I20260709 14:52:32.824949 12160 raft_consensus.cc:515] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:32.866874 12054 raft_consensus.cc:493] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:32.882441 12095 raft_consensus.cc:493] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:32.839253 12175 consensus_queue.cc:1059] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.061s
I20260709 14:52:32.830713 12148 raft_consensus.cc:515] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:32.881983 11949 raft_consensus.cc:493] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:32.934998  7775 raft_consensus.cc:1275] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 14:52:32.887990 12070 raft_consensus.cc:493] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:52:32.945370  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 231763us
I20260709 14:52:32.979198  7924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38516 (request call id 2490) took 1310 ms. Trace:
I20260709 14:52:32.904151 12170 raft_consensus.cc:697] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:52:32.979730  7924 rpcz_store.cc:276] 0709 14:52:31.624880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:31.626621 (+  1741us) service_pool.cc:224] Handling call
0709 14:52:32.934976 (+1308355us) spinlock_profiling.cc:243] Waited 939 ms on lock 0x7b54001e4954. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae922fa 00007fb68fe53b17 00007fb6893ce6d4 00007fb6893ce662 00007fb6893ce591 00007fb6893ce50c 00007fb6893cd7c2 00007fb6891c948c 00007fb6891c88c6 00007fb6891c826f
0709 14:52:32.935084 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2159570176}
I20260709 14:52:32.867506 11963 raft_consensus.cc:515] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:32.982185  7774 raft_consensus.cc:3060] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Advancing to term 14
W20260709 14:52:32.989688 12187 log.cc:927] Time spent T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 14:52:32.979604 11949 raft_consensus.cc:515] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:32.992172 11949 leader_election.cc:290] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:32.926595 12054 raft_consensus.cc:3060] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Advancing to term 15
I20260709 14:52:32.907744 12056 consensus_queue.cc:1059] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.075s
W20260709 14:52:32.999732  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:33.013629  7774 raft_consensus.cc:2468] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 14.
W20260709 14:52:32.993598 12140 log.cc:927] Time spent T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
W20260709 14:52:33.020924  7743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:52:33.023809  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 228899us
W20260709 14:52:33.028391  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 186032us
I20260709 14:52:33.023211  7893 leader_election.cc:304] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:32.987144 12119 leader_election.cc:290] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:32.944365 12095 raft_consensus.cc:515] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:33.027426 12108 consensus_meta.cc:287] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent flushing consensus metadata: real 0.536s	user 0.014s	sys 0.001s
I20260709 14:52:32.984712 12188 consensus_queue.cc:1059] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 14:52:33.002969 12036 consensus_queue.cc:1059] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 14:52:33.048664  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:33.002118 12031 consensus_queue.cc:1059] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 14:52:33.054118  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:33.060205  7776 raft_consensus.cc:2468] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 12.
I20260709 14:52:33.041903 12068 leader_election.cc:290] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:32.984831 12070 raft_consensus.cc:515] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:33.040220 11949 raft_consensus.cc:2749] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 14:52:33.061770  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:33.061830  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:33.057614  7778 raft_consensus.cc:3060] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Advancing to term 17
W20260709 14:52:33.065934  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 84592.8us
I20260709 14:52:33.066433  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:33.076870  7771 raft_consensus.cc:2468] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 10.
I20260709 14:52:33.076082  7773 raft_consensus.cc:3060] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Advancing to term 16
I20260709 14:52:33.078487  7894 leader_election.cc:304] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:33.091212  7770 raft_consensus.cc:2468] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 13.
I20260709 14:52:33.060819 12188 consensus_queue.cc:1243] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer 1de5e20126fa4d8ca0793d19c7b847ed log is divergent from this leader: its last log entry 13.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 14:52:33.098722  7778 raft_consensus.cc:2468] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 17.
I20260709 14:52:33.059175 12149 raft_consensus.cc:697] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:52:33.122628  7773 raft_consensus.cc:2468] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 16.
I20260709 14:52:33.097860 12045 leader_election.cc:290] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 14 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:33.075428 12196 consensus_queue.cc:1048] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.043s
I20260709 14:52:33.105736 12068 raft_consensus.cc:2804] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 14:52:33.079756 12199 raft_consensus.cc:2804] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader election won for term 11
I20260709 14:52:33.114575 12095 leader_election.cc:290] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:33.048281 12108 raft_consensus.cc:515] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:33.115866 12157 raft_consensus.cc:3055] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 LEADER]: Stepping down as leader of term 12
I20260709 14:52:33.081478 12175 raft_consensus.cc:493] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:52:33.133186  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:52:33.143379  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 43614.6us
I20260709 14:52:33.179382  7849 raft_consensus.cc:1240] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
W20260709 14:52:33.185835  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 84605.1us
I20260709 14:52:33.155197 12068 raft_consensus.cc:697] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:33.154358 12157 raft_consensus.cc:740] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:52:33.139770 12036 consensus_queue.cc:1048] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 14:52:33.155699 12199 raft_consensus.cc:697] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:52:33.179494 12035 leader_election.cc:290] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:33.097221 12170 consensus_queue.cc:237] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:33.218760 12196 raft_consensus.cc:493] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:52:33.218963 12199 consensus_queue.cc:237] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:33.222078 12200 log.cc:927] Time spent T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.119s	user 0.000s	sys 0.001s
I20260709 14:52:33.201790 11963 leader_election.cc:290] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:33.160090 12175 raft_consensus.cc:515] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:33.225339 12196 raft_consensus.cc:515] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:33.211875 12160 leader_election.cc:290] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:33.245653 12068 consensus_queue.cc:237] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:33.246642 12157 consensus_queue.cc:260] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:33.231411 12149 consensus_queue.cc:237] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:33.230573 12148 leader_election.cc:290] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:33.185549 12212 consensus_queue.cc:1048] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.060s
I20260709 14:52:33.238093 12070 leader_election.cc:290] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:52:33.238976 12206 log.cc:927] Time spent T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 14:52:33.242348 12108 leader_election.cc:290] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 14 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:52:33.255748  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 100272us
I20260709 14:52:33.229914 12035 raft_consensus.cc:493] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:52:33.264313  7893 leader_election.cc:304] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:52:33.277064  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 84003.4us
I20260709 14:52:33.278211  7894 leader_election.cc:304] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:33.296466  7893 leader_election.cc:304] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:33.299170 12070 consensus_queue.cc:1048] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 14:52:33.302466 12109 raft_consensus.cc:515] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:33.310340 12161 raft_consensus.cc:3055] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 14:52:33.291498 11963 raft_consensus.cc:2749] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 14:52:33.273274 12035 raft_consensus.cc:515] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:33.326592  7894 leader_election.cc:304] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:33.288012 12175 leader_election.cc:290] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:33.336277 12070 raft_consensus.cc:2749] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 14:52:33.308851 12218 raft_consensus.cc:2804] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 14:52:33.339649 12217 raft_consensus.cc:2804] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 14:52:33.340317 12031 consensus_queue.cc:1059] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 14:52:33.321141 12184 log.cc:927] Time spent T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.500s	user 0.000s	sys 0.007s
I20260709 14:52:33.322917 12161 raft_consensus.cc:740] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:33.352166  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:33.353718  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:33.354615  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:33.355533  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:33.358050  7850 raft_consensus.cc:2468] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 12.
I20260709 14:52:33.361764  7852 raft_consensus.cc:1240] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 12. Current term is 13. Ops: []
I20260709 14:52:33.366293  7848 raft_consensus.cc:1240] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 11. Current term is 12. Ops: []
I20260709 14:52:33.346619 12217 raft_consensus.cc:493] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:52:33.344525 12218 raft_consensus.cc:493] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:33.368397  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:33.370538 12217 raft_consensus.cc:3060] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:52:33.375718 12219 consensus_queue.cc:1048] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 14:52:33.343804 12221 consensus_queue.cc:1059] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 14:52:33.385823 12221 raft_consensus.cc:3055] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 14:52:33.386277 12221 raft_consensus.cc:740] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:33.387317 12221 consensus_queue.cc:260] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:33.342979 12054 raft_consensus.cc:515] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:33.388667 12109 leader_election.cc:290] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 14 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:33.391043 12035 leader_election.cc:290] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:33.391418 12218 raft_consensus.cc:3060] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Advancing to term 14
W20260709 14:52:33.366302 12183 consensus_meta.cc:287] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent flushing consensus metadata: real 0.789s	user 0.016s	sys 0.000s
I20260709 14:52:33.398890 12183 raft_consensus.cc:515] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:33.401449  7845 raft_consensus.cc:2468] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 11.
I20260709 14:52:33.402498 12196 leader_election.cc:290] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:33.420049 12153 raft_consensus.cc:3055] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 LEADER]: Stepping down as leader of term 8
I20260709 14:52:33.420737 12153 raft_consensus.cc:740] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:52:33.374737  7854 raft_consensus.cc:2468] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 13.
I20260709 14:52:33.391122 12054 leader_election.cc:290] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:33.431555 12153 consensus_queue.cc:260] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:33.435047 12183 leader_election.cc:290] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 11 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:33.436384 12030 raft_consensus.cc:3055] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 14:52:33.436899  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:33.437662  7774 raft_consensus.cc:3060] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Advancing to term 14
I20260709 14:52:33.438704  7745 leader_election.cc:304] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:33.440212  7745 leader_election.cc:304] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:33.441027 12160 raft_consensus.cc:2749] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 14:52:33.441836  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:33.441803 12160 raft_consensus.cc:2749] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 14:52:33.388767 12221 raft_consensus.cc:3060] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:52:33.451716  7774 raft_consensus.cc:2468] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 14.
I20260709 14:52:33.456629  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
W20260709 14:52:33.458437  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:33.461079  7778 raft_consensus.cc:1240] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 11. Current term is 12. Ops: []
I20260709 14:52:33.462436  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:33.463797  7774 raft_consensus.cc:2368] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 14. Current term is 15.
I20260709 14:52:33.463711  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783e4874513449ef9084b833f188a6d3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:33.470602  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:33.486320  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
W20260709 14:52:33.487377  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 191025us
I20260709 14:52:33.488404  7893 leader_election.cc:304] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:33.491876  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:33.494349  7776 raft_consensus.cc:1240] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 11. Current term is 12. Ops: []
I20260709 14:52:33.494640  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:33.495415  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:33.496376  7776 raft_consensus.cc:3060] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Advancing to term 14
I20260709 14:52:33.496575  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:33.500923  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:33.501268  7924 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
mode: GRACEFUL
new_leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:48676
I20260709 14:52:33.503885  7893 leader_election.cc:304] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:33.437090 12030 raft_consensus.cc:740] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
W20260709 14:52:33.506531  7743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:33.510311  7850 raft_consensus.cc:1275] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 9. (term mismatch)
I20260709 14:52:33.510648  7850 pending_rounds.cc:85] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting all ops after (but not including) 8
I20260709 14:52:33.510840  7850 pending_rounds.cc:107] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting uncommitted NO_OP operation due to leader change: 13.9
I20260709 14:52:33.511116  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:33.511093  7850 raft_consensus.cc:2889] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:52:33.511453  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:33.512527  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258d6c2dda954bf5b65930fde8ecb9f3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:33.509469  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:33.515539  7920 raft_consensus.cc:1240] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 14:52:33.516276  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:33.517688  7848 raft_consensus.cc:3060] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Advancing to term 13
I20260709 14:52:33.517856  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:33.516856  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:33.512315  7847 raft_consensus.cc:2468] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 14.
I20260709 14:52:33.519807  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:33.518030  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:33.522948  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:33.523490  7927 raft_consensus.cc:1275] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 14:52:33.474448 12153 raft_consensus.cc:3060] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:52:33.527004  7774 raft_consensus.cc:2468] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 11.
I20260709 14:52:33.526423  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:33.528088  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:33.528510  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:33.530025  7893 leader_election.cc:304] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:33.531286  7927 raft_consensus.cc:1275] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 14:52:33.531770  7893 leader_election.cc:304] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:33.533182  7927 raft_consensus.cc:1240] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 16. Current term is 17. Ops: []
I20260709 14:52:33.534943  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:33.535657  7847 raft_consensus.cc:3060] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Advancing to term 15
I20260709 14:52:33.538434  7853 raft_consensus.cc:1240] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 11. Current term is 12. Ops: []
I20260709 14:52:33.539755  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:33.540575  7853 raft_consensus.cc:2393] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 14: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:52:33.541525  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:33.542446  7772 raft_consensus.cc:3060] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Advancing to term 14
I20260709 14:52:33.537981 12030 consensus_queue.cc:260] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:33.543783  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:33.509654 12070 raft_consensus.cc:2749] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 14:52:33.506563 12111 raft_consensus.cc:493] T 9441e831627143a991a1556dcdce71e3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9418391fa82a42c79c6cad13ba91d964)
I20260709 14:52:33.509972 12175 raft_consensus.cc:493] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:52:33.552459  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783e4874513449ef9084b833f188a6d3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:33.549410  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:33.555985  7819 leader_election.cc:304] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:33.556838  7893 leader_election.cc:304] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:33.549527  7847 raft_consensus.cc:2468] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 15.
I20260709 14:52:33.523185 12183 raft_consensus.cc:493] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:52:33.545717  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:33.561265  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:33.581233  7774 raft_consensus.cc:1275] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 14:52:33.583158  7927 raft_consensus.cc:2393] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 14: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:52:33.582423  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:33.521281 12156 raft_consensus.cc:493] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:52:33.585640  7847 raft_consensus.cc:2393] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 14: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:52:33.583009  7776 raft_consensus.cc:2468] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 14.
I20260709 14:52:33.582044 12183 raft_consensus.cc:515] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:33.595100 12183 leader_election.cc:290] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:33.597694 12030 raft_consensus.cc:3060] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:52:33.587383  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:33.587713  7776 raft_consensus.cc:1275] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 14:52:33.587639  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:33.588721  7819 leader_election.cc:304] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:33.587821  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:33.550519 12212 raft_consensus.cc:2804] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 14:52:33.589664 12207 consensus_queue.cc:1048] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 14:52:33.601773 12224 raft_consensus.cc:2804] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 14:52:33.605636  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:33.546656 12035 raft_consensus.cc:493] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:52:33.656883  7854 raft_consensus.cc:2368] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 13. Current term is 14.
W20260709 14:52:33.607759 12216 log.cc:927] Time spent T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.294s	user 0.000s	sys 0.003s
I20260709 14:52:33.601938 12176 raft_consensus.cc:2749] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 14:52:33.588065 12175 raft_consensus.cc:515] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:33.613327 12222 log.cc:927] Time spent T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.295s	user 0.003s	sys 0.000s
I20260709 14:52:33.614641 12045 raft_consensus.cc:476] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 LEADER]: Not starting pre-election -- already a leader
I20260709 14:52:33.585423 12036 raft_consensus.cc:493] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:33.583804 12072 consensus_queue.cc:1048] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 14:52:33.621589 12156 raft_consensus.cc:515] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:33.624606  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:33.691009  7925 raft_consensus.cc:3060] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 14:52:33.625931  7772 raft_consensus.cc:2468] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 14.
W20260709 14:52:33.627094  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 69853.7us
I20260709 14:52:33.628052  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:33.628219  7774 raft_consensus.cc:1240] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 8. Current term is 9. Ops: []
I20260709 14:52:33.652176  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
W20260709 14:52:33.652462  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 63783.1us
I20260709 14:52:33.694465  7847 raft_consensus.cc:3060] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Advancing to term 14
I20260709 14:52:33.694972  7819 leader_election.cc:304] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:33.696301  7819 leader_election.cc:304] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:52:33.654616  7848 raft_consensus.cc:2468] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 13.
I20260709 14:52:33.632887 12212 raft_consensus.cc:493] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:33.632777 12110 raft_consensus.cc:2749] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 14:52:33.661830  7919 raft_consensus.cc:2468] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 9.
I20260709 14:52:33.629462 12196 raft_consensus.cc:2804] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 14:52:33.663977  7894 leader_election.cc:304] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:33.683714  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:33.684818  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:33.706357  7854 raft_consensus.cc:3060] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Advancing to term 15
I20260709 14:52:33.697603  7926 raft_consensus.cc:2468] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 10.
I20260709 14:52:33.708958  7819 leader_election.cc:304] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:52:33.712080  7745 leader_election.cc:304] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:33.629747 12111 raft_consensus.cc:515] T 9441e831627143a991a1556dcdce71e3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:52:33.675757 12224 raft_consensus.cc:697] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:33.717713  7894 leader_election.cc:304] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:33.720893  7745 leader_election.cc:304] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
W20260709 14:52:33.725512 12231 log.cc:927] Time spent T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.134s	user 0.000s	sys 0.003s
I20260709 14:52:33.722306 11949 consensus_queue.cc:1059] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 14:52:33.653448 12218 raft_consensus.cc:515] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:33.729619  7920 raft_consensus.cc:2410] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 14:52:33.676528 12035 raft_consensus.cc:515] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:33.704710 12212 raft_consensus.cc:3060] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 14:52:33.704339 12045 raft_consensus.cc:2749] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 14:52:33.651530 12217 raft_consensus.cc:515] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:33.736882  7745 leader_election.cc:400] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 election: Vote denied by peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529) with higher term. Message: Invalid argument: T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 13. Current term is 14.
I20260709 14:52:33.737149  7849 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 3526) took 1212 ms. Trace:
I20260709 14:52:33.744256  7853 raft_consensus.cc:1275] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 14:52:33.743868  7847 raft_consensus.cc:2468] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 14.
I20260709 14:52:33.747645  7925 raft_consensus.cc:2468] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 14.
I20260709 14:52:33.770151  7849 rpcz_store.cc:276] 0709 14:52:32.515651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:32.519862 (+  4211us) service_pool.cc:224] Handling call
0709 14:52:32.520293 (+   431us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:52:33.180067 (+659774us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:33.727512 (+547445us) spinlock_profiling.cc:243] Waited 659 ms on lock 0x7b540013b5d4. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae8ee01 00007fb68ae8d83e 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2 00007fb6891c948c 00007fb6891c88c6
0709 14:52:33.727830 (+   318us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1515128192}
I20260709 14:52:33.719435 12201 raft_consensus.cc:2804] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Leader election won for term 13
I20260709 14:52:33.719769 12221 raft_consensus.cc:2804] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 14:52:33.719128 12095 raft_consensus.cc:2804] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader election won for term 12
I20260709 14:52:33.723273 12160 raft_consensus.cc:2749] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 14:52:33.768666  7924 raft_consensus.cc:606] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Received request to transfer leadership to TS 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:33.799438  7924 raft_consensus.cc:614] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 14:52:33.693956 12036 raft_consensus.cc:515] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:33.769989  7745 leader_election.cc:403] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 14:52:33.754112  7848 raft_consensus.cc:3060] T 9441e831627143a991a1556dcdce71e3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 3 FOLLOWER]: Advancing to term 5
I20260709 14:52:33.801117  7675 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51352 (request call id 129) took 1513 ms. Trace:
I20260709 14:52:33.801717  7675 rpcz_store.cc:276] 0709 14:52:32.282195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:32.289715 (+  7520us) service_pool.cc:224] Handling call
0709 14:52:33.795532 (+1505817us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 14:52:33.106768 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 14:52:33.110400 (+  3632us) write_op.cc:432] Acquiring schema lock in shared mode
0709 14:52:33.110448 (+    48us) write_op.cc:435] Acquired schema lock
0709 14:52:33.110461 (+    13us) tablet.cc:662] Decoding operations
0709 14:52:33.110844 (+   383us) write_op.cc:620] Acquiring the partition lock for write op
0709 14:52:33.110907 (+    63us) write_op.cc:641] Partition lock acquired for write op
0709 14:52:33.110936 (+    29us) tablet.cc:685] Acquiring locks for 1 operations
0709 14:52:33.111150 (+   214us) tablet.cc:701] Row locks acquired
0709 14:52:33.111161 (+    11us) write_op.cc:260] PREPARE: finished
0709 14:52:33.111411 (+   250us) write_op.cc:270] Start()
0709 14:52:33.111596 (+   185us) write_op.cc:276] Timestamp: P: 1783608753111288 usec, L: 0
0709 14:52:33.111616 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 14:52:33.112876 (+  1260us) log.cc:844] Serialized 533 byte log entry
0709 14:52:33.163545 (+ 50669us) op_driver.cc:464] REPLICATION: finished
0709 14:52:33.295129 (+131584us) write_op.cc:301] APPLY: starting
0709 14:52:33.297901 (+  2772us) tablet.cc:1367] starting BulkCheckPresence
0709 14:52:33.319361 (+ 21460us) tablet.cc:1370] finished BulkCheckPresence
0709 14:52:33.319510 (+   149us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 14:52:33.320441 (+   931us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 14:52:33.320696 (+   255us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 14:52:33.320750 (+    54us) write_op.cc:312] APPLY: finished
0709 14:52:33.321001 (+   251us) log.cc:844] Serialized 25 byte log entry
0709 14:52:33.334739 (+ 13738us) write_op.cc:489] Releasing partition, row and schema locks
0709 14:52:33.341784 (+  7045us) write_op.cc:454] Released schema lock
0709 14:52:33.344100 (+  2316us) write_op.cc:341] FINISH: Updating metrics
0709 14:52:33.357085 (+ 12985us) write_op.cc:489] Releasing partition, row and schema locks
0709 14:52:33.361545 (+  4460us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":114015,"apply.run_cpu_time_us":4868,"apply.run_wall_time_us":57530,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8295,"num_ops":1,"prepare.queue_time_us":348062,"prepare.run_cpu_time_us":3670,"prepare.run_wall_time_us":10500,"replication_time_us":34250,"thread_start_us":401041,"threads_started":2}]]}
W20260709 14:52:33.806169  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 74155.8us
I20260709 14:52:33.784905 12161 consensus_queue.cc:260] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:33.780023  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:33.737003 12054 raft_consensus.cc:2804] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader election won for term 15
I20260709 14:52:33.781976  7854 raft_consensus.cc:2468] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 15.
I20260709 14:52:33.787624  7779 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 3160) took 1254 ms. Trace:
W20260709 14:52:33.792258  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:33.722975 12213 consensus_queue.cc:1059] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 14:52:33.825570  7848 raft_consensus.cc:1275] T 9441e831627143a991a1556dcdce71e3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 14:52:33.826467  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:33.781759 12221 raft_consensus.cc:493] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:33.819835  7779 rpcz_store.cc:276] 0709 14:52:32.533138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:32.770611 (+237473us) service_pool.cc:224] Handling call
0709 14:52:32.794634 (+ 24023us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:52:33.060493 (+265859us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:52:33.060529 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:52:33.080381 (+ 19852us) log.cc:844] Serialized 26 byte log entry
0709 14:52:33.185468 (+105087us) raft_consensus.cc:1645] Marking committed up to 9
0709 14:52:33.211574 (+ 26106us) log.cc:844] Serialized 14 byte log entry
0709 14:52:33.211873 (+   299us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:33.211973 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:52:33.606757 (+394784us) spinlock_profiling.cc:243] Waited 11.1 ms on lock 0x7b4400022b4c. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb687c29db1 00007fb687cc7c85 00007fb687cc86a2 00007fb68aa3a1db 00007fb68aa35aaf 00007fb68aa2986e 00007fb68aa28bb6 00007fb68aa287d8 00007fb68aa32221 00007fb68aa321d9 00007fb68aa32169
0709 14:52:33.787157 (+180400us) raft_consensus.cc:1685] finished
0709 14:52:33.787289 (+   132us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:33.787525 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3337,"prepare.queue_time_us":25795,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":53,"raft.queue_time_us":112068,"raft.run_cpu_time_us":409,"raft.run_wall_time_us":22232,"spinlock_wait_cycles":25609088,"thread_start_us":321214,"threads_started":2,"wal-append.queue_time_us":171674}
I20260709 14:52:33.829710  7925 raft_consensus.cc:3060] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 14:52:33.798906 12201 raft_consensus.cc:697] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:52:33.792321 12226 raft_consensus.cc:2804] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 14:52:33.822579 12056 raft_consensus.cc:3055] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 14:52:33.801779 12070 consensus_queue.cc:1048] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.072s
I20260709 14:52:33.836272 12221 raft_consensus.cc:3060] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 14:52:33.818897 12077 raft_consensus.cc:2749] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529) with higher term. Message: Invalid argument: T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 13. Current term is 14.
I20260709 14:52:33.825769 12095 raft_consensus.cc:697] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:52:33.957194  7925 raft_consensus.cc:2468] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 14.
W20260709 14:52:33.960309  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 231551us
I20260709 14:52:33.968756  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:33.970384  7925 raft_consensus.cc:2410] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for term 14 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 14:52:33.748734 12224 consensus_queue.cc:237] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:33.893988 12226 raft_consensus.cc:493] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 14:52:33.978327  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 247323us
I20260709 14:52:33.892318 12160 raft_consensus.cc:493] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:33.911098 12070 consensus_queue.cc:1243] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer 3876b8ee8d744cb18e91d97aae93b1ac log is divergent from this leader: its last log entry 11.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 14:52:33.903972 12045 raft_consensus.cc:493] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:52:34.005577 12156 leader_election.cc:290] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:34.006584 12156 raft_consensus.cc:493] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:52:34.005692 12045 raft_consensus.cc:515] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:34.007551 12156 raft_consensus.cc:515] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:34.009825 12175 leader_election.cc:290] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:34.014142 12201 consensus_queue.cc:237] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:34.022818 12156 leader_election.cc:290] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:34.031363  7849 raft_consensus.cc:1240] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 13. Current term is 14. Ops: []
I20260709 14:52:33.929668 12056 raft_consensus.cc:740] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
W20260709 14:52:34.041728  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:34.042304 12056 consensus_queue.cc:260] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:34.044411 12056 raft_consensus.cc:3060] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:52:33.955509 12219 raft_consensus.cc:2804] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 14:52:34.004714 12218 leader_election.cc:290] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:34.040288 12212 raft_consensus.cc:515] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:33.996338 12226 raft_consensus.cc:3060] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 14:52:34.100556  7849 raft_consensus.cc:1275] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 14:52:34.102859  7925 raft_consensus.cc:1275] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 14:52:34.053819 12160 raft_consensus.cc:515] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:34.135919  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:34.137105  7925 raft_consensus.cc:2393] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 11: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:52:34.079360 12054 raft_consensus.cc:697] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
W20260709 14:52:34.146910  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 155283us
I20260709 14:52:34.122155 12196 raft_consensus.cc:697] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:34.151029  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:34.148386  7893 leader_election.cc:304] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:34.152125  7925 raft_consensus.cc:2468] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 12.
I20260709 14:52:34.139477 12111 leader_election.cc:290] T 9441e831627143a991a1556dcdce71e3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68:42321)
I20260709 14:52:34.161626 12045 leader_election.cc:290] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:34.144372 12217 leader_election.cc:290] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 9 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:34.177425  7893 leader_election.cc:304] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:34.181983 12160 leader_election.cc:290] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:52:34.193497 12235 log.cc:927] Time spent T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.083s	user 0.002s	sys 0.000s
I20260709 14:52:34.138762 12095 consensus_queue.cc:237] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:34.180075 12153 consensus_meta.cc:287] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent flushing consensus metadata: real 0.637s	user 0.011s	sys 0.003s
I20260709 14:52:34.206228 12129 raft_consensus.cc:3055] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 14:52:34.207099 12212 leader_election.cc:290] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 13 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:34.207175 12129 raft_consensus.cc:740] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:34.211474 12129 consensus_queue.cc:260] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:34.180326 12242 raft_consensus.cc:493] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:34.232510  7819 leader_election.cc:304] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
W20260709 14:52:34.241707  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 66558.3us
I20260709 14:52:34.196481  7675 catalog_manager.cc:5697] T 9441e831627143a991a1556dcdce71e3 P 9418391fa82a42c79c6cad13ba91d964 reported cstate change: term changed from 3 to 5, leader changed from 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68) to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 5 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } } }
W20260709 14:52:34.246562  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 69285.1us
I20260709 14:52:34.248468  7893 leader_election.cc:304] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:34.248757  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:34.250972 12070 raft_consensus.cc:2804] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 14:52:34.253062 12153 consensus_queue.cc:1048] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.010s
I20260709 14:52:34.263684 12239 raft_consensus.cc:2804] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 14:52:34.264439 12239 raft_consensus.cc:493] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:34.264986 12239 raft_consensus.cc:3060] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:52:34.257089  7779 raft_consensus.cc:1240] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 15. Current term is 16. Ops: [12.8-15.9]
I20260709 14:52:34.262557 12070 raft_consensus.cc:493] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:34.268394 12070 raft_consensus.cc:3060] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 14:52:34.253192 12118 raft_consensus.cc:493] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:34.270973 12118 raft_consensus.cc:515] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:34.254102  7846 raft_consensus.cc:2468] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 9.
W20260709 14:52:34.218829 12236 log.cc:927] Time spent T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.089s	user 0.000s	sys 0.001s
I20260709 14:52:34.288730  7919 raft_consensus.cc:1240] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 14:52:34.213207 12129 raft_consensus.cc:3060] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 14:52:34.222517 12149 raft_consensus.cc:493] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:34.228096 12188 raft_consensus.cc:493] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:34.227929 12110 raft_consensus.cc:493] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:34.220036 12157 raft_consensus.cc:3060] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Advancing to term 13
I20260709 14:52:34.279285 12045 raft_consensus.cc:2764] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 14:52:34.273088 12035 leader_election.cc:290] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:34.228498 12072 consensus_queue.cc:1048] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.079s
W20260709 14:52:34.333951  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 90885.2us
W20260709 14:52:34.338100  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 89708.1us
I20260709 14:52:34.339440  7893 leader_election.cc:304] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:52:34.339401  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:34.216199 12242 raft_consensus.cc:515] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:34.317539 12030 consensus_meta.cc:287] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent flushing consensus metadata: real 0.719s	user 0.017s	sys 0.000s
I20260709 14:52:34.345055  7927 raft_consensus.cc:1240] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 LEADER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 11. Current term is 12. Ops: []
I20260709 14:52:34.286046 12175 consensus_queue.cc:1048] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 14:52:34.338748 12111 raft_consensus.cc:493] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:34.369614 12111 raft_consensus.cc:515] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:34.372416 12111 leader_election.cc:290] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:34.373893  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:34.313782 12149 raft_consensus.cc:515] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:34.374845  7923 raft_consensus.cc:2368] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 13. Current term is 14.
I20260709 14:52:34.376155  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258d6c2dda954bf5b65930fde8ecb9f3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:34.306166 12054 consensus_queue.cc:237] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:34.380251 12036 leader_election.cc:290] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:34.381914 12179 raft_consensus.cc:493] T 9441e831627143a991a1556dcdce71e3 P 9418391fa82a42c79c6cad13ba91d964 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:52:34.382711 12179 raft_consensus.cc:515] T 9441e831627143a991a1556dcdce71e3 P 9418391fa82a42c79c6cad13ba91d964 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:52:34.374716 12219 raft_consensus.cc:493] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:52:34.386127 12219 raft_consensus.cc:3060] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:52:34.345093 11949 raft_consensus.cc:2804] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 14:52:34.387924  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 46550.8us
I20260709 14:52:34.391656  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:34.399138  7919 raft_consensus.cc:2410] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 14:52:34.392472  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:34.400132  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:34.400732  7926 raft_consensus.cc:3060] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:52:34.400148  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:34.402225  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:34.394717 12030 raft_consensus.cc:2804] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 14:52:34.396499  8639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9441e831627143a991a1556dcdce71e3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9418391fa82a42c79c6cad13ba91d964" is_pre_election: true
I20260709 14:52:34.393535  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:34.404160  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:34.316359 12110 raft_consensus.cc:515] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:52:34.350346 12160 raft_consensus.cc:493] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:34.340337 12213 consensus_queue.cc:1059] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 14:52:34.423795  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:34.428784  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
W20260709 14:52:34.424829 12199 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.042s	user 0.013s	sys 0.005s
I20260709 14:52:34.316124 12188 raft_consensus.cc:515] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:34.334697 12196 consensus_queue.cc:237] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:34.421315 12031 raft_consensus.cc:493] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:34.444470 12188 leader_election.cc:290] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:34.441529 12247 consensus_queue.cc:1048] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.014s
I20260709 14:52:34.448910  7894 leader_election.cc:304] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
W20260709 14:52:34.466533  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 118330us
W20260709 14:52:34.441447 12199 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.060s	user 0.013s	sys 0.005s
I20260709 14:52:34.472713  7926 raft_consensus.cc:2468] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 9.
I20260709 14:52:34.431073 12030 raft_consensus.cc:697] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:34.476966  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:34.479323  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:34.481694  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783e4874513449ef9084b833f188a6d3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:34.487679  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:34.435560 12149 leader_election.cc:290] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:34.481889  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:34.424600 12221 raft_consensus.cc:515] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:34.494342  7926 raft_consensus.cc:3060] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 14:52:34.424948 12160 raft_consensus.cc:515] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:34.502156  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:34.501466  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:34.466290 11949 raft_consensus.cc:697] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:34.511595  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:34.517970  7845 pending_rounds.cc:85] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting all ops after (but not including) 7
I20260709 14:52:34.518548  7845 pending_rounds.cc:107] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 14:52:34.519055  7845 raft_consensus.cc:2889] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 14:52:34.518518  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:52:34.522756  8598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 117609us
I20260709 14:52:34.542939 12204 raft_consensus.cc:493] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:34.543692 12204 raft_consensus.cc:515] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:34.546124  7846 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3661) took 1031 ms. Trace:
I20260709 14:52:34.546619  7846 rpcz_store.cc:276] 0709 14:52:33.514184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:33.528282 (+ 14098us) service_pool.cc:224] Handling call
0709 14:52:34.545878 (+1017596us) spinlock_profiling.cc:243] Waited 674 ms on lock 0x7b540013c9d4. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae922fa 00007fb68fe53b17 00007fb6893ce6d4 00007fb6893ce662 00007fb6893ce591 00007fb6893ce50c 00007fb6893cd7c2 00007fb6891c948c 00007fb6891c88c6 00007fb6891c826f
0709 14:52:34.546039 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1549406592}
I20260709 14:52:34.498788 12212 raft_consensus.cc:2804] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 14:52:34.594857  7923 raft_consensus.cc:2393] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 14: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:52:34.549034  7846 raft_consensus.cc:1275] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 14:52:34.550308  7920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38516 (request call id 2523) took 1001 ms. Trace:
I20260709 14:52:34.577736  7848 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49948 (request call id 3653) took 1065 ms. Trace:
W20260709 14:52:34.588672  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:34.597806  7848 rpcz_store.cc:276] 0709 14:52:33.512429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:33.704954 (+192525us) service_pool.cc:224] Handling call
0709 14:52:33.705439 (+   485us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:52:33.832718 (+127279us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:34.553026 (+720308us) spinlock_profiling.cc:243] Waited 48.4 ms on lock 0x7b540020d0d4. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae8ee01 00007fb68ae8d83e 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2 00007fb6891c948c 00007fb6891c88c6
0709 14:52:34.577639 (+ 24613us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":111422848}
I20260709 14:52:34.597707  7920 rpcz_store.cc:276] 0709 14:52:33.548803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:33.552104 (+  3301us) service_pool.cc:224] Handling call
0709 14:52:34.549964 (+997860us) spinlock_profiling.cc:243] Waited 149 ms on lock 0x7b5400019d54. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae922fa 00007fb68fe53b17 00007fb6893ce6d4 00007fb6893ce662 00007fb6893ce591 00007fb6893ce50c 00007fb6893cd7c2 00007fb6891c948c 00007fb6891c88c6 00007fb6891c826f
0709 14:52:34.550212 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":343692672}
I20260709 14:52:34.605685  7849 raft_consensus.cc:1240] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 12. Current term is 13. Ops: []
I20260709 14:52:34.474402 12056 consensus_queue.cc:1048] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.058s
I20260709 14:52:34.507284 12238 raft_consensus.cc:493] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:52:34.614825  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:34.465893 12031 raft_consensus.cc:515] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:34.589643  7926 raft_consensus.cc:2468] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 15.
W20260709 14:52:34.619540  7745 leader_election.cc:336] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 1.508s (SENT)
I20260709 14:52:34.633621  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
W20260709 14:52:34.633769  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 378109us
I20260709 14:52:34.586900 12035 raft_consensus.cc:493] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:34.594400 12212 raft_consensus.cc:493] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 14:52:34.642517  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:34.600313 12213 raft_consensus.cc:493] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:52:34.635123  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:34.644773  7926 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
mode: GRACEFUL
new_leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:48676
I20260709 14:52:34.658968  7926 raft_consensus.cc:606] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Received request to transfer leadership to TS 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:52:34.572319 12243 raft_consensus.cc:493] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:34.609958 12214 raft_consensus.cc:493] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:34.639505  7819 leader_election.cc:304] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:34.665516 11949 consensus_queue.cc:237] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:34.671111  7926 raft_consensus.cc:614] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 14:52:34.630728 12217 raft_consensus.cc:493] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:34.671764  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9441e831627143a991a1556dcdce71e3" candidate_uuid: "9418391fa82a42c79c6cad13ba91d964" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:34.677793  7853 raft_consensus.cc:2468] T 9441e831627143a991a1556dcdce71e3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9418391fa82a42c79c6cad13ba91d964 in term 5.
I20260709 14:52:34.656042 12212 raft_consensus.cc:3060] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Advancing to term 12
W20260709 14:52:34.683408  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 43980.6us
I20260709 14:52:34.682163  8599 leader_election.cc:304] T 9441e831627143a991a1556dcdce71e3 P 9418391fa82a42c79c6cad13ba91d964 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac, 9418391fa82a42c79c6cad13ba91d964; no voters: 
W20260709 14:52:34.667209 12226 consensus_meta.cc:287] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent flushing consensus metadata: real 0.557s	user 0.008s	sys 0.005s
I20260709 14:52:34.695716 12199 consensus_queue.cc:1059] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 14:52:34.695773  7819 leader_election.cc:400] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 14 election: Vote denied by peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587) with higher term. Message: Invalid argument: T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 14. Current term is 15.
I20260709 14:52:34.696833  7819 leader_election.cc:403] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 14:52:34.697324 12095 raft_consensus.cc:3055] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 LEADER]: Stepping down as leader of term 11
I20260709 14:52:34.698495 12095 raft_consensus.cc:740] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:52:34.656303 12179 leader_election.cc:290] T 9441e831627143a991a1556dcdce71e3 P 9418391fa82a42c79c6cad13ba91d964 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:34.654255 12188 raft_consensus.cc:493] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:34.660708 12118 leader_election.cc:290] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:34.697590 12207 raft_consensus.cc:2749] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587) with higher term. Message: Invalid argument: T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 14. Current term is 15.
I20260709 14:52:34.715615  7819 leader_election.cc:304] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:34.714694 12199 consensus_queue.cc:1059] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 14:52:34.684703 12217 raft_consensus.cc:515] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:34.770706  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 55169.7us
I20260709 14:52:34.706287 12226 raft_consensus.cc:515] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:34.720631 12221 leader_election.cc:290] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:34.637004 12238 raft_consensus.cc:515] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:34.723158 12031 leader_election.cc:290] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:34.723826 12188 raft_consensus.cc:515] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:34.668430 12213 raft_consensus.cc:515] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:34.725961 12258 raft_consensus.cc:493] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:34.655220 12030 consensus_queue.cc:237] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:34.733479 12242 leader_election.cc:290] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:34.700073 12201 raft_consensus.cc:2804] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Leader election won for term 14
I20260709 14:52:34.733412 12253 raft_consensus.cc:493] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:34.793681 12253 raft_consensus.cc:515] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:34.734982 12254 log.cc:927] Time spent T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
W20260709 14:52:34.794551 12250 log.cc:927] Time spent T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260709 14:52:34.796015  7851 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49948 (request call id 3667) took 1275 ms. Trace:
I20260709 14:52:34.773471 12095 consensus_queue.cc:260] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:34.777017 12248 log.cc:927] Time spent T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.344s	user 0.000s	sys 0.002s
I20260709 14:52:34.796453  7851 rpcz_store.cc:276] 0709 14:52:33.520550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:33.828898 (+308348us) service_pool.cc:224] Handling call
0709 14:52:33.830737 (+  1839us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:52:33.831135 (+   398us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:52:33.831163 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:52:34.181384 (+350221us) spinlock_profiling.cc:243] Waited 1.98 ms on lock 0x7b18000b1dc0. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb690c69de1 00007fb690c765b1 00007fb687da1522 00007fb687da37c1 00007fb687da3779 00007fb687da3709 00007fb687da36d1 00007fb687da29cd 0000000000396ad4 0000000000396919 00007fb687d8483a
0709 14:52:34.182811 (+  1427us) spinlock_profiling.cc:243] Waited 5.65 ms on lock 0x7b18000b1dc0. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb690c69de1 00007fb690c765b1 00007fb687d6f2a6 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb689787a11 00007fb689797372 00007fb68aec9a01 00007fb68ae8e43a
0709 14:52:34.183307 (+   496us) spinlock_profiling.cc:243] Waited 1.53 ms on lock 0x7b2c000552c8. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb689787a11 00007fb689797372 00007fb68aec9a01 00007fb68ae8e43a 00007fb68ae8d83e 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2
0709 14:52:34.183740 (+   433us) log.cc:844] Serialized 26 byte log entry
0709 14:52:34.495617 (+311877us) raft_consensus.cc:1645] Marking committed up to 6
0709 14:52:34.495668 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:34.502645 (+  6977us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:52:34.795735 (+293090us) raft_consensus.cc:1685] finished
0709 14:52:34.795766 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:34.795935 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":495,"raft.run_cpu_time_us":250,"raft.run_wall_time_us":35702,"spinlock_wait_cycles":21065088,"thread_start_us":311441,"threads_started":1,"wal-append.queue_time_us":484220}
I20260709 14:52:34.798063 12160 leader_election.cc:290] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:34.798457  7854 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49948 (request call id 3670) took 1274 ms. Trace:
I20260709 14:52:34.683547 12243 raft_consensus.cc:515] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:34.794348 12158 raft_consensus.cc:3055] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 14:52:34.676119 12214 raft_consensus.cc:515] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:34.806177 12214 leader_election.cc:290] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:34.806820 12201 raft_consensus.cc:697] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:52:34.808229 12201 consensus_queue.cc:237] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:34.734840 12265 raft_consensus.cc:493] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:34.809782 12265 raft_consensus.cc:515] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:34.737536 12118 raft_consensus.cc:493] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:34.654708 12035 raft_consensus.cc:515] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:34.736538 12110 leader_election.cc:290] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68:42321)
I20260709 14:52:34.745357 12273 raft_consensus.cc:493] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:34.723235 12239 raft_consensus.cc:515] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:34.746409 12064 raft_consensus.cc:493] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:34.732336 12070 raft_consensus.cc:515] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:34.783210  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 137284us
I20260709 14:52:34.727319 12179 raft_consensus.cc:2804] T 9441e831627143a991a1556dcdce71e3 P 9418391fa82a42c79c6cad13ba91d964 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 14:52:34.787211  7819 leader_election.cc:304] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
W20260709 14:52:34.867700  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 80617us
I20260709 14:52:34.791769  7919 raft_consensus.cc:2393] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 15: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:52:34.813651 12118 raft_consensus.cc:515] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:34.792526 12207 consensus_queue.cc:1048] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 14:52:34.771112 12058 raft_consensus.cc:493] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:34.798941  7854 rpcz_store.cc:276] 0709 14:52:33.523793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:33.893474 (+369681us) service_pool.cc:224] Handling call
0709 14:52:33.966578 (+ 73104us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:52:33.967202 (+   624us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:52:33.967243 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:52:34.014304 (+ 47061us) log.cc:844] Serialized 26 byte log entry
0709 14:52:34.244415 (+230111us) raft_consensus.cc:1645] Marking committed up to 5
0709 14:52:34.244480 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:34.244594 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:52:34.798211 (+553617us) raft_consensus.cc:1685] finished
0709 14:52:34.798231 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:34.798381 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":725,"raft.run_cpu_time_us":265,"raft.run_wall_time_us":78574,"thread_start_us":229308,"threads_started":1,"wal-append.queue_time_us":339596}
I20260709 14:52:34.817963 12244 raft_consensus.cc:493] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:34.819443 12272 raft_consensus.cc:493] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:34.812914 12265 leader_election.cc:290] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:34.776036 12263 raft_consensus.cc:2804] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader election won for term 11
W20260709 14:52:34.862083  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:34.802119 12175 raft_consensus.cc:3055] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 LEADER]: Stepping down as leader of term 11
I20260709 14:52:34.868774  7819 leader_election.cc:304] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:34.792709  8639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18d29d52d304c87b930d4fb5eaf50b1" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9418391fa82a42c79c6cad13ba91d964" is_pre_election: true
I20260709 14:52:34.871760  7926 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
mode: GRACEFUL
new_leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:48676
I20260709 14:52:34.905601  7926 raft_consensus.cc:606] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Received request to transfer leadership to TS 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:52:34.807972 12243 leader_election.cc:290] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:34.878407  7744 leader_election.cc:304] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:34.816546 12158 raft_consensus.cc:740] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:34.904958  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9441e831627143a991a1556dcdce71e3" candidate_uuid: "9418391fa82a42c79c6cad13ba91d964" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:34.907073  7926 raft_consensus.cc:614] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 14:52:34.870270 12095 raft_consensus.cc:3060] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:52:34.870560 12179 raft_consensus.cc:493] T 9441e831627143a991a1556dcdce71e3 P 9418391fa82a42c79c6cad13ba91d964 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:52:34.880456 11982 raft_consensus.cc:2804] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Leader election won for term 14
I20260709 14:52:34.915941  7744 leader_election.cc:304] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:34.904711 12175 raft_consensus.cc:740] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:52:34.934758 12263 raft_consensus.cc:697] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:52:34.889936 12176 consensus_queue.cc:1048] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 14:52:34.869865 12064 raft_consensus.cc:515] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:34.801573 12258 raft_consensus.cc:515] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:34.914997 12243 raft_consensus.cc:2749] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 14:52:34.901701 12058 raft_consensus.cc:515] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:34.905326 12244 raft_consensus.cc:515] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:34.943826 12253 leader_election.cc:290] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:34.916997 12179 raft_consensus.cc:3060] T 9441e831627143a991a1556dcdce71e3 P 9418391fa82a42c79c6cad13ba91d964 [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:52:34.915449 12199 raft_consensus.cc:2804] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Leader election won for term 14
W20260709 14:52:34.941538  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 62431.6us
I20260709 14:52:34.949656  7744 leader_election.cc:304] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:34.983198  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:34.984807  7778 raft_consensus.cc:2393] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 14: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:52:34.984400  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:34.988830  7776 raft_consensus.cc:1240] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 14:52:34.992647  7777 raft_consensus.cc:2410] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 14:52:34.864287 12273 raft_consensus.cc:515] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:35.002342  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:35.005878  7772 raft_consensus.cc:2393] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 15: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:52:35.007457  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:35.009474  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:35.010586  7773 raft_consensus.cc:2410] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 14:52:35.011093  7927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38516 (request call id 2525) took 1417 ms. Trace:
I20260709 14:52:35.012121  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:34.955412 12281 raft_consensus.cc:2749] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 14:52:35.013113  7779 raft_consensus.cc:2468] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 11.
I20260709 14:52:35.011591  7927 rpcz_store.cc:276] 0709 14:52:33.584566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:33.585900 (+  1334us) service_pool.cc:224] Handling call
0709 14:52:33.586213 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:52:34.350865 (+764652us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:35.001873 (+651008us) spinlock_profiling.cc:243] Waited 756 ms on lock 0x7b540041c3d4. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae8ee01 00007fb68ae8d83e 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2 00007fb6891c948c 00007fb6891c88c6
0709 14:52:35.002150 (+   277us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1739581824}
I20260709 14:52:34.901147 12272 raft_consensus.cc:515] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:34.970568 12054 raft_consensus.cc:493] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:52:34.921432 12158 consensus_queue.cc:260] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:35.025393  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
W20260709 14:52:35.023917  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 47417.2us
I20260709 14:52:35.025055  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:35.028074  7776 raft_consensus.cc:3060] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Advancing to term 14
I20260709 14:52:35.030910  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783e4874513449ef9084b833f188a6d3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:35.037667  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
W20260709 14:52:35.007582 12129 consensus_meta.cc:287] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent flushing consensus metadata: real 0.695s	user 0.008s	sys 0.008s
I20260709 14:52:35.044519 12213 leader_election.cc:290] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:35.046053 12273 leader_election.cc:290] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:35.052109 12199 raft_consensus.cc:697] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
W20260709 14:52:35.054543 12284 log.cc:927] Time spent T 00000000000000000000000000000000 P 133636659113430cb53b321cb0b1d9ee: Append to log took a long time: real 0.118s	user 0.000s	sys 0.001s
I20260709 14:52:35.054903 12058 leader_election.cc:290] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:35.058722  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
W20260709 14:52:35.066527  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 129884us
W20260709 14:52:35.023664 12157 consensus_meta.cc:287] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent flushing consensus metadata: real 0.689s	user 0.015s	sys 0.000s
I20260709 14:52:35.123301  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:35.124162  7852 raft_consensus.cc:2410] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 14:52:34.996421 12253 raft_consensus.cc:493] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:52:35.125056 12253 raft_consensus.cc:515] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:35.114143 12263 consensus_queue.cc:237] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:34.996213 12283 raft_consensus.cc:2749] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 14:52:35.041714  7772 raft_consensus.cc:1240] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 14:52:35.040851  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:35.043267  7777 raft_consensus.cc:1275] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 14:52:35.454332  7779 raft_consensus.cc:2468] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 12.
I20260709 14:52:35.113907  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:35.019655 12226 leader_election.cc:290] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 15 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:35.115693  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:35.459477  7770 raft_consensus.cc:2393] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 9: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:52:35.116707  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:35.113696  7849 raft_consensus.cc:2393] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 15: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:52:35.117236  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:52:35.027005 12219 consensus_meta.cc:287] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent flushing consensus metadata: real 0.637s	user 0.015s	sys 0.000s
I20260709 14:52:35.023842 12243 raft_consensus.cc:493] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:52:35.463927  7848 raft_consensus.cc:1240] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 LEADER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 14:52:35.435159  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:35.178176 12238 leader_election.cc:290] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:35.124994  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:35.187913 12239 leader_election.cc:290] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 11 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:52:35.238616 12282 log.cc:927] Time spent T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.215s	user 0.001s	sys 0.000s
I20260709 14:52:35.126459 12108 raft_consensus.cc:493] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:52:35.434617  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:35.013062 12175 consensus_queue.cc:260] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.5, Last appended by leader: 5, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:35.028316 11949 consensus_queue.cc:1048] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.146s
I20260709 14:52:35.032280 12054 raft_consensus.cc:515] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:35.493984 12281 raft_consensus.cc:493] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:35.494992 12054 leader_election.cc:290] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:35.188894 12199 consensus_queue.cc:237] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:35.121477 11982 raft_consensus.cc:697] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
W20260709 14:52:35.452021  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 324458us
I20260709 14:52:35.040838 12030 raft_consensus.cc:493] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:52:35.039108  7771 raft_consensus.cc:2468] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 13.
I20260709 14:52:35.469856  7850 raft_consensus.cc:2393] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 14: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
W20260709 14:52:35.473795  7894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:35.474134  7922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38532 (request call id 3348) took 1066 ms. Trace:
I20260709 14:52:35.471946 12219 raft_consensus.cc:515] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:35.479512  7893 leader_election.cc:304] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:35.483672  7779 raft_consensus.cc:1275] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 14:52:35.486224 12292 consensus_queue.cc:1059] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 14:52:35.470993 12129 raft_consensus.cc:493] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:35.489957 12289 raft_consensus.cc:493] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:35.486299 12108 raft_consensus.cc:515] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:35.524695  7926 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.001s	sys 0.031s
I20260709 14:52:35.498003  7776 raft_consensus.cc:2468] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 14.
W20260709 14:52:35.498371  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:35.479826 11963 raft_consensus.cc:493] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:35.494695 12281 raft_consensus.cc:515] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:35.509564 11982 consensus_queue.cc:237] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:35.506503  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
W20260709 14:52:35.509021 12249 log.cc:927] Time spent T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 1.052s	user 0.000s	sys 0.012s
I20260709 14:52:35.506925  7745 leader_election.cc:304] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
W20260709 14:52:35.525729  7926 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.576s	user 0.001s	sys 0.032s
I20260709 14:52:35.481787 12125 raft_consensus.cc:493] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:35.532634  7926 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38532 (request call id 3350) took 1106 ms. Trace:
I20260709 14:52:35.529932  7772 raft_consensus.cc:3060] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Advancing to term 13
I20260709 14:52:35.532800  7745 leader_election.cc:304] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:35.525218  7893 leader_election.cc:304] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:35.535782  7926 rpcz_store.cc:276] 0709 14:52:34.426448 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:34.911299 (+484851us) service_pool.cc:224] Handling call
0709 14:52:34.911674 (+   375us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:52:34.911944 (+   270us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 14:52:34.923639 (+ 11695us) log.cc:844] Serialized 14 byte log entry
0709 14:52:35.532049 (+608410us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:52:35.532113 (+    64us) raft_consensus.cc:1645] Marking committed up to 7
0709 14:52:35.532169 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:35.532247 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:35.532548 (+   301us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":18490,"spinlock_wait_cycles":5145984,"thread_start_us":582427,"threads_started":1}
I20260709 14:52:35.500136 12170 raft_consensus.cc:493] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:52:35.512616 12118 leader_election.cc:290] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:35.548851  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:35.548977  7893 leader_election.cc:304] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:35.479437 12243 raft_consensus.cc:515] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:35.530674 12285 log.cc:927] Time spent T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.537s	user 0.002s	sys 0.000s
I20260709 14:52:35.499962 12214 consensus_queue.cc:1059] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
W20260709 14:52:35.591684  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:35.528252 12291 raft_consensus.cc:493] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:35.469378 12179 raft_consensus.cc:515] T 9441e831627143a991a1556dcdce71e3 P 9418391fa82a42c79c6cad13ba91d964 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:52:35.539674 12058 raft_consensus.cc:2804] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader election won for term 14
I20260709 14:52:35.552735  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:35.516203 12030 raft_consensus.cc:515] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:35.544140 12273 raft_consensus.cc:2804] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader election won for term 15
I20260709 14:52:35.517484 12054 consensus_queue.cc:1048] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 14:52:35.543345 12064 leader_election.cc:290] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:35.638453 12290 raft_consensus.cc:493] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:35.639537 12290 raft_consensus.cc:515] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:35.639601 12293 log.cc:927] Time spent T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
W20260709 14:52:35.642688 12212 consensus_meta.cc:287] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent flushing consensus metadata: real 0.934s	user 0.017s	sys 0.007s
I20260709 14:52:35.643296 12212 raft_consensus.cc:515] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:35.647665 12212 leader_election.cc:290] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:35.535336 11963 raft_consensus.cc:515] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:35.550956 12156 raft_consensus.cc:2749] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 14:52:35.553229 12170 raft_consensus.cc:515] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:35.667851 12170 leader_election.cc:290] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:35.612975 12291 raft_consensus.cc:515] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:35.667991 11963 leader_election.cc:290] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:35.618556 12275 raft_consensus.cc:2749] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 14:52:35.619095 12287 log.cc:927] Time spent T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.347s	user 0.000s	sys 0.012s
I20260709 14:52:35.521883 12129 raft_consensus.cc:515] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:35.551100 12036 raft_consensus.cc:3055] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 14:52:35.733930 12036 raft_consensus.cc:740] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:35.735157 12036 consensus_queue.cc:260] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:35.736819 12036 raft_consensus.cc:3060] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 14:52:35.555307 12201 raft_consensus.cc:493] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
W20260709 14:52:35.597563 12284 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.542s	user 0.047s	sys 0.029s
I20260709 14:52:35.528970 12289 raft_consensus.cc:515] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:35.544308 12125 raft_consensus.cc:515] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:35.635581 12179 leader_election.cc:290] T 9441e831627143a991a1556dcdce71e3 P 9418391fa82a42c79c6cad13ba91d964 [CANDIDATE]: Term 6 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:35.636758 12281 leader_election.cc:290] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:35.648315  7925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38532 (request call id 3345) took 1255 ms. Trace:
I20260709 14:52:35.746520 11963 raft_consensus.cc:493] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:35.650377 12219 leader_election.cc:290] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 11 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:35.651293 12253 leader_election.cc:290] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:35.823045 11963 raft_consensus.cc:515] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:35.653024 12095 consensus_meta.cc:287] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent flushing consensus metadata: real 0.738s	user 0.009s	sys 0.017s
I20260709 14:52:35.824299 12095 raft_consensus.cc:493] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:35.824906 12095 raft_consensus.cc:515] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:35.827652 12095 leader_election.cc:290] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:35.655063 12290 leader_election.cc:290] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:35.657019  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:35.819505 12239 raft_consensus.cc:493] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:35.822443  7925 rpcz_store.cc:276] 0709 14:52:34.392825 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:34.685608 (+292783us) service_pool.cc:224] Handling call
0709 14:52:34.715037 (+ 29429us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:52:34.814704 (+ 99667us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:52:34.814754 (+    50us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:52:34.814816 (+    62us) raft_consensus.cc:1645] Marking committed up to 9
0709 14:52:34.814865 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:35.648025 (+833160us) spinlock_profiling.cc:243] Waited 99.3 ms on lock 0x7b54000fa354. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae8ee01 00007fb68ae8d83e 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2 00007fb6891c948c 00007fb6891c88c6
0709 14:52:35.648081 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:35.648245 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":228439936}
I20260709 14:52:35.878176  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:35.879042  7925 raft_consensus.cc:2376] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 9. Re-sending same reply.
I20260709 14:52:35.880306  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:35.886044  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:35.903527  7926 raft_consensus.cc:2393] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 12: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:52:35.819741 12054 raft_consensus.cc:493] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9418391fa82a42c79c6cad13ba91d964)
I20260709 14:52:35.603755 12278 raft_consensus.cc:2749] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 14:52:35.914789  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:35.916164  7926 raft_consensus.cc:2410] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for term 15 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
W20260709 14:52:35.925097  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 426681us
I20260709 14:52:35.608780  7772 raft_consensus.cc:2410] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 14:52:35.730041 12291 leader_election.cc:290] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:35.733155 12129 leader_election.cc:290] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:35.659269 12058 raft_consensus.cc:697] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
W20260709 14:52:35.629966  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:35.738803  7927 raft_consensus.cc:2468] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 11.
W20260709 14:52:35.798144  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 260665us
I20260709 14:52:35.660784 12273 raft_consensus.cc:697] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:52:35.831501 12275 raft_consensus.cc:493] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:35.507732  7922 rpcz_store.cc:276] 0709 14:52:34.408232 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:34.882170 (+473938us) service_pool.cc:224] Handling call
0709 14:52:34.882525 (+   355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:52:34.882748 (+   223us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 14:52:34.909950 (+ 27202us) log.cc:844] Serialized 14 byte log entry
0709 14:52:35.473724 (+563774us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:52:35.473792 (+    68us) raft_consensus.cc:1645] Marking committed up to 6
0709 14:52:35.473846 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:35.473929 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:35.474069 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31750,"prepare.queue_time_us":27643,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":42,"raft.queue_time_us":27890,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":9538,"thread_start_us":281495,"threads_started":1,"wal-append.queue_time_us":581552}
I20260709 14:52:36.027685  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:35.821915 12201 raft_consensus.cc:515] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:35.952999 11963 leader_election.cc:290] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:35.887720 12239 raft_consensus.cc:515] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:35.905757 12219 raft_consensus.cc:493] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9418391fa82a42c79c6cad13ba91d964)
I20260709 14:52:35.914777 12054 raft_consensus.cc:515] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
W20260709 14:52:36.011861  7854 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.054s	sys 0.067s
W20260709 14:52:36.008729  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 459845us
I20260709 14:52:36.008563  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:36.033385  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:36.034448  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:36.036473  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9441e831627143a991a1556dcdce71e3" candidate_uuid: "9418391fa82a42c79c6cad13ba91d964" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
W20260709 14:52:35.597308  7819 connection.cc:256] RPC call timeout handler was delayed by -1.0787029040001244s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15460000000000002s for a response
I20260709 14:52:36.007787 12281 raft_consensus.cc:493] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:52:36.075364  7854 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.567s	user 0.054s	sys 0.068s
W20260709 14:52:36.076468  7819 connection.cc:256] RPC call timeout handler was delayed by -1.0553029040000865s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1572s for a response
I20260709 14:52:36.077001  7893 leader_election.cc:304] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:36.078092  7853 raft_consensus.cc:2468] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 13.
I20260709 14:52:36.079560  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:36.054757  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:36.075116  7850 raft_consensus.cc:2468] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 13.
I20260709 14:52:36.025568 12278 raft_consensus.cc:493] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:36.025511 12253 raft_consensus.cc:493] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:36.082969  7922 raft_consensus.cc:2368] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 13. Current term is 14.
I20260709 14:52:36.132735  7922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38532 (request call id 3367) took 1136 ms. Trace:
I20260709 14:52:36.132521 12253 raft_consensus.cc:515] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:36.133193  7922 rpcz_store.cc:276] 0709 14:52:34.998193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:36.034069 (+1035876us) service_pool.cc:224] Handling call
0709 14:52:36.132661 (+ 98592us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 14:52:36.134603  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:36.135593  7922 raft_consensus.cc:2468] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 13.
I20260709 14:52:36.057785 12118 consensus_queue.cc:1048] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.079s
I20260709 14:52:36.136816  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:36.092873 11963 raft_consensus.cc:2749] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 14:52:36.093425 12218 consensus_queue.cc:1059] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 14:52:36.094178 12305 consensus_queue.cc:1048] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 14:52:36.140208  7922 raft_consensus.cc:2468] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 11.
I20260709 14:52:36.141422  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:36.142767  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:36.143916  7922 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
mode: GRACEFUL
new_leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:48676
I20260709 14:52:36.144496  7922 raft_consensus.cc:606] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Received request to transfer leadership to TS 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:52:36.144970  7922 raft_consensus.cc:614] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 14:52:36.095083  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:36.097072 12291 raft_consensus.cc:493] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:36.097155 11982 raft_consensus.cc:493] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:36.097076 12201 leader_election.cc:290] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:36.145640 12291 raft_consensus.cc:515] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:36.145900 11982 raft_consensus.cc:515] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:36.148442 12291 leader_election.cc:290] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:36.149760  7853 raft_consensus.cc:2468] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 14.
I20260709 14:52:36.151467 12278 raft_consensus.cc:515] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:36.152520  7920 raft_consensus.cc:1240] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 8. Current term is 9. Ops: []
I20260709 14:52:36.153582  7920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38532 (request call id 3352) took 1719 ms. Trace:
I20260709 14:52:36.154062  7920 rpcz_store.cc:276] 0709 14:52:34.434735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:36.151997 (+1717262us) service_pool.cc:224] Handling call
0709 14:52:36.152345 (+   348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:52:36.153067 (+   722us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:36.153483 (+   416us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 14:52:36.155673  7920 raft_consensus.cc:1240] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 13. Current term is 14. Ops: []
I20260709 14:52:36.157569  7926 raft_consensus.cc:2468] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 13.
I20260709 14:52:36.099277  8640 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44352 (request call id 182) took 1717 ms. Trace:
I20260709 14:52:36.100173 12290 consensus_queue.cc:1059] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 14:52:36.104033 12239 leader_election.cc:290] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:36.105294 12125 leader_election.cc:290] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:36.107039 12054 leader_election.cc:290] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785), 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68:42321)
I20260709 14:52:36.108035 12289 leader_election.cc:290] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:36.108299  8639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce9c0ef2db24c13a8b1402f21819458" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9418391fa82a42c79c6cad13ba91d964" is_pre_election: true
I20260709 14:52:36.113801 12058 consensus_queue.cc:237] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:36.097599 12281 raft_consensus.cc:515] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:36.128829 12273 consensus_queue.cc:237] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:36.057513 12283 consensus_queue.cc:1059] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.074s
I20260709 14:52:36.032255 12275 raft_consensus.cc:515] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:36.092085  7893 leader_election.cc:304] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:52:36.256381  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 164264us
I20260709 14:52:36.257826  7893 leader_election.cc:304] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:36.165855  7853 raft_consensus.cc:1240] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 LEADER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 14:52:36.097510  7819 leader_election.cc:304] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:36.212750  7920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38532 (request call id 3353) took 1771 ms. Trace:
W20260709 14:52:36.232115  7820 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.600s	user 0.025s	sys 0.036s
I20260709 14:52:36.212234  7922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:48676 (request call id 70) took 1221 ms. Trace:
W20260709 14:52:36.261191  7820 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.631s	user 0.026s	sys 0.036s
I20260709 14:52:36.259768  7920 rpcz_store.cc:276] 0709 14:52:34.441590 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:36.154974 (+1713384us) service_pool.cc:224] Handling call
0709 14:52:36.155416 (+   442us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:52:36.212269 (+ 56853us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:36.212651 (+   382us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 14:52:36.263861  7920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38532 (request call id 3355) took 1816 ms. Trace:
I20260709 14:52:36.264305  7920 rpcz_store.cc:276] 0709 14:52:34.447342 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:36.262837 (+1815495us) service_pool.cc:224] Handling call
0709 14:52:36.263227 (+   390us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:52:36.263467 (+   240us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:52:36.263489 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:52:36.263534 (+    45us) raft_consensus.cc:1645] Marking committed up to 7
0709 14:52:36.263568 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:36.263619 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:36.263792 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 14:52:36.149034 11982 leader_election.cc:290] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:36.242324  7850 raft_consensus.cc:3055] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 LEADER]: Stepping down as leader of term 16
I20260709 14:52:36.243594  7894 leader_election.cc:304] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:36.273882  7850 raft_consensus.cc:740] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:52:36.085597 12219 raft_consensus.cc:515] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:52:36.276387  7894 leader_election.cc:304] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:36.274899  7850 consensus_queue.cc:260] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:36.135649 12253 leader_election.cc:290] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:36.266191  7922 rpcz_store.cc:276] 0709 14:52:34.940592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:36.143780 (+1203188us) service_pool.cc:224] Handling call
0709 14:52:36.162199 (+ 18419us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 14:52:36.267858  7893 leader_election.cc:304] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:36.269519  7920 raft_consensus.cc:1275] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 14:52:36.243185 12291 raft_consensus.cc:493] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:36.289081  7920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38532 (request call id 3356) took 1835 ms. Trace:
I20260709 14:52:36.277814  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:36.289647  7920 rpcz_store.cc:276] 0709 14:52:34.453798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:36.268688 (+1814890us) service_pool.cc:224] Handling call
0709 14:52:36.269079 (+   391us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:52:36.288605 (+ 19526us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:36.288988 (+   383us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 14:52:36.289328 12291 raft_consensus.cc:515] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:36.294078 12291 leader_election.cc:290] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:36.284614  7850 raft_consensus.cc:3060] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Advancing to term 17
I20260709 14:52:36.303541  7850 raft_consensus.cc:1275] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
W20260709 14:52:36.306039  7745 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 1.524s (SENT) [suppressed 9 similar messages]
I20260709 14:52:36.260550 12290 raft_consensus.cc:493] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:36.259873 12095 raft_consensus.cc:493] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
W20260709 14:52:36.241626 12196 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.018s	sys 0.009s
W20260709 14:52:36.242941 12299 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.007s	sys 0.023s
W20260709 14:52:36.276109 12263 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.620s	user 0.009s	sys 0.038s
I20260709 14:52:36.279443 11963 raft_consensus.cc:2804] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 14:52:36.276479 12036 raft_consensus.cc:2804] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 14:52:36.321544 12176 raft_consensus.cc:493] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:52:36.334403 12291 raft_consensus.cc:493] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:52:36.350611 12270 log.cc:927] Time spent T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 1.614s	user 0.009s	sys 0.020s
I20260709 14:52:36.277231 12308 raft_consensus.cc:2749] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 14:52:36.306183 12218 raft_consensus.cc:2804] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 14:52:36.322724 12196 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.589s	user 0.018s	sys 0.010s
I20260709 14:52:36.362228 12176 raft_consensus.cc:515] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:36.357154 12263 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.701s	user 0.010s	sys 0.038s
W20260709 14:52:36.358507 12299 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.624s	user 0.012s	sys 0.023s
I20260709 14:52:36.355131 12201 raft_consensus.cc:2749] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 14:52:36.360455 11963 raft_consensus.cc:493] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:36.174525  8640 rpcz_store.cc:276] 0709 14:52:34.381631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:34.382284 (+   653us) service_pool.cc:224] Handling call
0709 14:52:34.382725 (+   441us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:52:34.385366 (+  2641us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:52:34.385402 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:52:34.385458 (+    56us) raft_consensus.cc:1645] Marking committed up to 7
0709 14:52:34.385500 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:36.098896 (+1713396us) spinlock_profiling.cc:243] Waited 2.36 ms on lock 0x7b54005a0fd4. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae8ee01 00007fb68ae8d83e 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2 00007fb6891c948c 00007fb6891c88c6
0709 14:52:36.098965 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:36.099160 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5422976}
I20260709 14:52:36.361407 12241 raft_consensus.cc:2749] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 14:52:36.320057 12290 raft_consensus.cc:515] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:36.363461 12291 raft_consensus.cc:515] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:36.361701 12036 raft_consensus.cc:493] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:52:36.387892  7921 raft_consensus.cc:1240] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 LEADER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 11. Current term is 12. Ops: []
I20260709 14:52:36.331533 12095 raft_consensus.cc:515] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:36.391101  7919 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38532 (request call id 3346) took 1998 ms. Trace:
W20260709 14:52:36.392611  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:52:36.380347  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:36.372365 12218 raft_consensus.cc:493] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:52:36.411597  7919 rpcz_store.cc:276] 0709 14:52:34.393071 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:34.428485 (+ 35414us) service_pool.cc:224] Handling call
0709 14:52:36.390782 (+1962297us) spinlock_profiling.cc:243] Waited 362 ms on lock 0x7b540001a254. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae922fa 00007fb68fe53b17 00007fb6893ce6d4 00007fb6893ce662 00007fb6893ce591 00007fb6893ce50c 00007fb6893cd7c2 00007fb6891c948c 00007fb6891c88c6 00007fb6891c826f
0709 14:52:36.391009 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":832397568}
I20260709 14:52:36.415854  7919 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
mode: GRACEFUL
new_leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:48676
I20260709 14:52:36.416509  7919 raft_consensus.cc:606] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Received request to transfer leadership to TS 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:52:36.416800  7919 raft_consensus.cc:614] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 14:52:36.399406  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 301983us
I20260709 14:52:36.403905  7775 raft_consensus.cc:1240] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 16. Current term is 17. Ops: [13.8-16.9]
I20260709 14:52:36.418483  7919 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48672 (request call id 374) took 1886 ms. Trace:
I20260709 14:52:36.418665  7819 leader_election.cc:304] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:36.396569 11963 raft_consensus.cc:3060] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 14:52:36.426883  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9441e831627143a991a1556dcdce71e3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:36.404362  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:36.428717  7819 leader_election.cc:304] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:36.402323  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:36.429494  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:36.430900  7776 raft_consensus.cc:1275] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 14:52:36.402846  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:36.432189  7778 raft_consensus.cc:2468] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 12.
W20260709 14:52:36.412006  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 144278us
I20260709 14:52:36.418911  7919 rpcz_store.cc:276] 0709 14:52:34.531689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:36.417575 (+1885886us) service_pool.cc:224] Handling call
0709 14:52:36.417944 (+   369us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:52:36.418150 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:52:36.418175 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:52:36.418220 (+    45us) raft_consensus.cc:1645] Marking committed up to 5
0709 14:52:36.418252 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:36.418305 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:36.418419 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 14:52:36.413190  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:52:36.406545  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 125691us
I20260709 14:52:36.435249  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18d29d52d304c87b930d4fb5eaf50b1" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:36.429406  7777 raft_consensus.cc:2468] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 13.
I20260709 14:52:36.437721  7845 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 3573) took 1956 ms. Trace:
I20260709 14:52:36.437924  7894 leader_election.cc:304] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:36.433871  7893 leader_election.cc:304] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:36.444999  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9441e831627143a991a1556dcdce71e3" candidate_uuid: "9418391fa82a42c79c6cad13ba91d964" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:36.446201  7850 raft_consensus.cc:3060] T 9441e831627143a991a1556dcdce71e3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:52:36.438271  7845 rpcz_store.cc:276] 0709 14:52:34.481049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:34.516884 (+ 35835us) service_pool.cc:224] Handling call
0709 14:52:34.517586 (+   702us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 14:52:34.587011 (+ 69425us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:52:34.587050 (+    39us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 14:52:34.587837 (+   787us) log.cc:844] Serialized 52 byte log entry
0709 14:52:34.653932 (+ 66095us) raft_consensus.cc:1645] Marking committed up to 7
0709 14:52:34.653980 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:34.654477 (+   497us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:52:36.349677 (+1695200us) spinlock_profiling.cc:243] Waited 15 ms on lock 0x7b4400022b4c. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb687c29db1 00007fb687cc7c85 00007fb687cc86a2 00007fb68aa3a1db 00007fb68aa35aaf 00007fb68aa2986e 00007fb68aa28bb6 00007fb68aa287d8 00007fb68aa32221 00007fb68aa321d9 00007fb68aa32169
0709 14:52:36.414725 (+ 65048us) raft_consensus.cc:1685] finished
0709 14:52:36.414763 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:36.437633 (+ 22870us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5984,"raft.queue_time_us":7352,"raft.run_cpu_time_us":217,"raft.run_wall_time_us":12845,"spinlock_wait_cycles":34577152,"thread_start_us":65645,"threads_started":1,"wal-append.queue_time_us":147984}
I20260709 14:52:36.447216  7919 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48672 (request call id 375) took 1472 ms. Trace:
I20260709 14:52:36.447769  7919 rpcz_store.cc:276] 0709 14:52:34.974670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:36.446230 (+1471560us) service_pool.cc:224] Handling call
0709 14:52:36.446649 (+   419us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:52:36.446849 (+   200us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:52:36.446880 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:52:36.446928 (+    48us) raft_consensus.cc:1645] Marking committed up to 6
0709 14:52:36.446962 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:36.447013 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:36.447147 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 14:52:36.449352  7893 leader_election.cc:304] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:36.450848  7893 leader_election.cc:304] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:36.455651  6549 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 14:52:36.449594  7919 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38532 (request call id 3361) took 1462 ms. Trace:
I20260709 14:52:36.457319  7919 rpcz_store.cc:276] 0709 14:52:34.987586 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:36.448743 (+1461157us) service_pool.cc:224] Handling call
0709 14:52:36.449090 (+   347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:52:36.449283 (+   193us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:52:36.449305 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:52:36.449354 (+    49us) raft_consensus.cc:1645] Marking committed up to 7
0709 14:52:36.449390 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:36.449434 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:36.449541 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 14:52:36.460956  7919 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38532 (request call id 3370) took 1452 ms. Trace:
I20260709 14:52:36.461597  7919 rpcz_store.cc:276] 0709 14:52:35.008199 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:36.458367 (+1450168us) service_pool.cc:224] Handling call
0709 14:52:36.458781 (+   414us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:52:36.459621 (+   840us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:52:36.459649 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:52:36.459702 (+    53us) raft_consensus.cc:1645] Marking committed up to 7
0709 14:52:36.459745 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:36.460268 (+   523us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:36.460873 (+   605us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 14:52:36.413502 12036 raft_consensus.cc:3060] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 14:52:36.462492  7819 leader_election.cc:304] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:36.421340 12218 raft_consensus.cc:3060] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 14:52:36.420964 12278 leader_election.cc:290] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:52:36.456130 12157 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.918s	user 0.028s	sys 0.015s
I20260709 14:52:36.448738 12305 raft_consensus.cc:2804] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 14:52:36.454967 12266 log.cc:927] Time spent T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
I20260709 14:52:36.460042 12308 raft_consensus.cc:2804] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 14:52:36.445492 12263 raft_consensus.cc:2749] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 14:52:36.426688 12201 consensus_queue.cc:1048] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.048s
W20260709 14:52:36.474028 12157 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.953s	user 0.029s	sys 0.015s
I20260709 14:52:36.476763 12305 raft_consensus.cc:493] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
W20260709 14:52:36.487445  7742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.68:42321, user_credentials={real_user=slave}} blocked reactor thread for 59244.3us
I20260709 14:52:36.464668 12309 raft_consensus.cc:2749] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 14:52:36.492053  7850 raft_consensus.cc:2468] T 9441e831627143a991a1556dcdce71e3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9418391fa82a42c79c6cad13ba91d964 in term 6.
I20260709 14:52:36.493212  7922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38532 (request call id 3359) took 2026 ms. Trace:
I20260709 14:52:36.511861  7922 rpcz_store.cc:276] 0709 14:52:34.467287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:36.328218 (+1860931us) service_pool.cc:224] Handling call
0709 14:52:36.328657 (+   439us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:52:36.328962 (+   305us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 14:52:36.422476 (+ 93514us) log.cc:844] Serialized 14 byte log entry
0709 14:52:36.492758 (+ 70282us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:52:36.492825 (+    67us) raft_consensus.cc:1645] Marking committed up to 7
0709 14:52:36.492898 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:36.492976 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:36.493146 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":175424,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"thread_start_us":114895,"threads_started":2}
I20260709 14:52:36.498593  7819 leader_election.cc:304] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:52:36.499511 12196 raft_consensus.cc:2749] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 14:52:36.500299 12319 raft_consensus.cc:2749] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 14:52:36.501304 12219 leader_election.cc:290] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68:42321)
I20260709 14:52:36.501436 12275 leader_election.cc:290] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:36.486102 12308 raft_consensus.cc:493] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:52:36.502880 12281 leader_election.cc:290] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:36.504097 12291 leader_election.cc:290] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:36.505498  7772 raft_consensus.cc:1240] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 13. Current term is 14. Ops: []
I20260709 14:52:36.513649 12305 raft_consensus.cc:3060] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 14:52:36.483829 12278 raft_consensus.cc:2804] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 14:52:36.514721  8599 leader_election.cc:304] T 9441e831627143a991a1556dcdce71e3 P 9418391fa82a42c79c6cad13ba91d964 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac, 9418391fa82a42c79c6cad13ba91d964; no voters: 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:52:36.552805 12278 raft_consensus.cc:697] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:36.554129 12278 consensus_queue.cc:237] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:36.561169 12275 raft_consensus.cc:493] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:52:36.564095  7923 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38532 (request call id 3338) took 2173 ms (client timeout 2883 ms). Trace:
W20260709 14:52:36.564703  7923 rpcz_store.cc:269] 0709 14:52:34.390876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:34.393210 (+  2334us) service_pool.cc:224] Handling call
0709 14:52:36.556367 (+2163157us) spinlock_profiling.cc:243] Waited 175 ms on lock 0x7b540041e1d4. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae922fa 00007fb68fe53b17 00007fb6893ce6d4 00007fb6893ce662 00007fb6893ce591 00007fb6893ce50c 00007fb6893cd7c2 00007fb6891c948c 00007fb6891c88c6 00007fb6891c826f
0709 14:52:36.563970 (+  7603us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":401792384}
W20260709 14:52:36.565841 12302 log.cc:927] Time spent T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.209s	user 0.007s	sys 0.000s
W20260709 14:52:36.567186  7744 leader_election.cc:336] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785): Timed out: RequestConsensusVote RPC to 127.6.101.67:40785 timed out after 1.563s (SENT)
I20260709 14:52:36.567530  7854 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 3581) took 1512 ms. Trace:
I20260709 14:52:36.567862  7744 leader_election.cc:304] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:52:36.544835 12306 log.cc:927] Time spent T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.190s	user 0.000s	sys 0.002s
W20260709 14:52:36.569403  7744 leader_election.cc:336] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785): Timed out: RequestConsensusVote RPC to 127.6.101.67:40785 timed out after 1.579s (SENT)
I20260709 14:52:36.570570  7744 leader_election.cc:304] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:36.571903 12316 raft_consensus.cc:2749] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 14:52:36.572254 12281 raft_consensus.cc:2749] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 14:52:36.573432 12275 raft_consensus.cc:515] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:36.574911 12288 raft_consensus.cc:3055] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 LEADER]: Stepping down as leader of term 15
I20260709 14:52:36.575472 12288 raft_consensus.cc:740] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:52:36.567330  7923 raft_consensus.cc:1275] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 14:52:36.582413  7923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38516 (request call id 2543) took 1017 ms. Trace:
I20260709 14:52:36.516695  7819 leader_election.cc:304] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:52:36.505582 12290 leader_election.cc:290] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:52:36.541499 12310 log.cc:927] Time spent T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
I20260709 14:52:36.483280 12318 consensus_queue.cc:1048] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.060s
I20260709 14:52:36.542863 12095 leader_election.cc:290] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:36.529314 12263 raft_consensus.cc:2804] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 14:52:36.538041 12308 raft_consensus.cc:3060] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 14:52:36.550880 12325 raft_consensus.cc:493] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
W20260709 14:52:36.569466 12312 log.cc:927] Time spent T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.187s	user 0.001s	sys 0.000s
I20260709 14:52:36.568109  7854 rpcz_store.cc:276] 0709 14:52:35.054895 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:35.058142 (+  3247us) service_pool.cc:224] Handling call
0709 14:52:35.435149 (+377007us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:52:35.500170 (+ 65021us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:52:35.500208 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:52:35.508444 (+  8236us) log.cc:844] Serialized 26 byte log entry
0709 14:52:36.076085 (+567641us) raft_consensus.cc:1645] Marking committed up to 7
0709 14:52:36.076131 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:36.076205 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:52:36.567285 (+491080us) raft_consensus.cc:1685] finished
0709 14:52:36.567308 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:36.567462 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":76969,"raft.queue_time_us":65480,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":9962,"thread_start_us":567175,"threads_started":1,"wal-append.queue_time_us":762890}
I20260709 14:52:36.502291 12176 leader_election.cc:290] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:36.583003  7923 rpcz_store.cc:276] 0709 14:52:35.565098 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:36.566486 (+1001388us) service_pool.cc:224] Handling call
0709 14:52:36.566894 (+   408us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:52:36.582023 (+ 15129us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:36.582342 (+   319us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 14:52:36.587175  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 126167us
I20260709 14:52:36.607981  7923 raft_consensus.cc:1275] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 14:52:36.530304  7922 raft_consensus.cc:1240] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 12. Current term is 13. Ops: [12.8-12.8]
W20260709 14:52:36.587947  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 71484us
I20260709 14:52:36.527333 12268 raft_consensus.cc:493] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:36.596254  8640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1f7722fdea49e0b5e9c5d96633eaf9" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9418391fa82a42c79c6cad13ba91d964" is_pre_election: true
I20260709 14:52:36.596766 12290 raft_consensus.cc:493] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:36.597194 12320 raft_consensus.cc:2804] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Leader election won for term 14
I20260709 14:52:36.602743 12263 raft_consensus.cc:493] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:36.597669 12288 consensus_queue.cc:260] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:36.586484 12281 raft_consensus.cc:493] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:36.608779  7923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38516 (request call id 2546) took 1043 ms. Trace:
I20260709 14:52:36.615417  7819 leader_election.cc:304] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:36.615836  7923 rpcz_store.cc:276] 0709 14:52:35.566559 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:36.607283 (+1040724us) service_pool.cc:224] Handling call
0709 14:52:36.607626 (+   343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:52:36.608309 (+   683us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:36.608643 (+   334us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 14:52:36.612613  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:36.619277 12321 consensus_queue.cc:1048] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 14:52:36.620173 12321 consensus_queue.cc:1243] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer 3876b8ee8d744cb18e91d97aae93b1ac log is divergent from this leader: its last log entry 16.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 14:52:36.589450 12218 raft_consensus.cc:515] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:36.618525  7819 leader_election.cc:304] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed
W20260709 14:52:36.628585  7745 leader_election.cc:336] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 1.811s (SENT)
I20260709 14:52:36.631795 12327 raft_consensus.cc:2804] T 9441e831627143a991a1556dcdce71e3 P 9418391fa82a42c79c6cad13ba91d964 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 14:52:36.636283 12036 raft_consensus.cc:515] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:36.625157 12275 leader_election.cc:290] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:36.626191 12290 raft_consensus.cc:515] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:36.639463 12161 raft_consensus.cc:3060] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 14:52:36.626089 12281 raft_consensus.cc:515] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:36.622524 12263 raft_consensus.cc:3060] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:52:36.623570 12176 raft_consensus.cc:2749] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 14:52:36.645715  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 194923us
I20260709 14:52:36.606092 12325 raft_consensus.cc:515] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:52:36.648402  7819 leader_election.cc:304] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:52:36.629616 12288 raft_consensus.cc:3060] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Advancing to term 16
I20260709 14:52:36.626642 12320 raft_consensus.cc:697] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:52:36.624143 12095 consensus_queue.cc:1048] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 14:52:36.613668 12268 raft_consensus.cc:515] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:36.647317 12201 raft_consensus.cc:2804] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 14:52:36.670655  8598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 62434.4us
I20260709 14:52:36.682178 12320 consensus_queue.cc:237] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:36.686820 12035 leader_election.cc:290] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:36.691560 12030 leader_election.cc:290] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:36.695684  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:36.698006 12036 leader_election.cc:290] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 13 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:36.655084 12305 raft_consensus.cc:515] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:36.659544 12291 raft_consensus.cc:2804] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader election won for term 9
I20260709 14:52:36.702123  7771 raft_consensus.cc:2468] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 11.
I20260709 14:52:36.696050 12281 leader_election.cc:290] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:36.704217  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:36.709774 12325 leader_election.cc:290] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:36.717900  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:36.719527  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:36.721382  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:36.721750 12291 raft_consensus.cc:697] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:52:36.723196  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18d29d52d304c87b930d4fb5eaf50b1" candidate_uuid: "9418391fa82a42c79c6cad13ba91d964" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:36.724089  7854 raft_consensus.cc:2468] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9418391fa82a42c79c6cad13ba91d964 in term 9.
I20260709 14:52:36.710665  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:36.725723  7853 raft_consensus.cc:2468] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 11.
I20260709 14:52:36.726089  8599 leader_election.cc:304] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac, 9418391fa82a42c79c6cad13ba91d964; no voters: 
I20260709 14:52:36.727407 12188 leader_election.cc:290] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:36.723098 12291 consensus_queue.cc:237] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:36.725112  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:36.731209  7854 raft_consensus.cc:2468] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 12.
W20260709 14:52:36.732995 12256 log.cc:927] Time spent T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 1.991s	user 0.016s	sys 0.015s
W20260709 14:52:36.716190  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 44039.4us
I20260709 14:52:36.742951  7819 leader_election.cc:304] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:36.746059  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:36.746003 11949 raft_consensus.cc:493] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:36.751238  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:36.751933  7845 raft_consensus.cc:2468] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 13.
I20260709 14:52:36.752688  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1f7722fdea49e0b5e9c5d96633eaf9" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:36.673619 12201 raft_consensus.cc:493] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting leader election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:52:36.754732 12204 leader_election.cc:290] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:36.747080 12325 raft_consensus.cc:2804] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 14:52:36.756935 12325 raft_consensus.cc:493] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:52:36.757848 12305 leader_election.cc:290] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:36.758486 12325 raft_consensus.cc:3060] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:52:36.759665 12217 leader_election.cc:290] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:36.759701  7928 raft_consensus.cc:2410] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
W20260709 14:52:36.762393  7894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:52:36.763975  7928 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38516 (request call id 2513) took 3248 ms (client timeout 1673 ms). Trace:
W20260709 14:52:36.764539  7928 rpcz_store.cc:269] 0709 14:52:33.515008 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:33.516602 (+  1594us) service_pool.cc:224] Handling call
0709 14:52:36.763542 (+3246940us) spinlock_profiling.cc:243] Waited 3.24 s on lock 0x7b540001a754. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae922fa 00007fb68fe53b17 00007fb6893ce6d4 00007fb6893ce662 00007fb6893ce591 00007fb6893ce50c 00007fb6893cd7c2 00007fb6891c948c 00007fb6891c88c6 00007fb6891c826f
0709 14:52:36.763727 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7452892416}
I20260709 14:52:36.765065  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:36.767196  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:36.769548  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:36.770635  7848 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 3583) took 1715 ms. Trace:
I20260709 14:52:36.771059  7848 rpcz_store.cc:276] 0709 14:52:35.055594 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:35.057227 (+  1633us) service_pool.cc:224] Handling call
0709 14:52:35.060994 (+  3767us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:52:35.464444 (+403450us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:36.770286 (+1305842us) spinlock_profiling.cc:243] Waited 403 ms on lock 0x7b54000d5f54. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae8ee01 00007fb68ae8d83e 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2 00007fb6891c948c 00007fb6891c88c6
0709 14:52:36.770561 (+   275us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":925916416}
I20260709 14:52:36.773867  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:36.773867  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:36.775185  7928 raft_consensus.cc:2393] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 13: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:52:36.770654  7771 raft_consensus.cc:3060] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:52:36.778259 12035 raft_consensus.cc:493] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:36.766970 12188 raft_consensus.cc:2749] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 14:52:36.780007 12035 raft_consensus.cc:515] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:36.781726 11963 raft_consensus.cc:515] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:36.782999  7920 raft_consensus.cc:1240] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 13. Current term is 14. Ops: []
I20260709 14:52:36.783835  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:36.784711  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:36.784277  7920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38532 (request call id 3357) took 2330 ms. Trace:
I20260709 14:52:36.798664  7920 rpcz_store.cc:276] 0709 14:52:34.454079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:36.290890 (+1836811us) service_pool.cc:224] Handling call
0709 14:52:36.291312 (+   422us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:52:36.783472 (+492160us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:36.784005 (+   533us) spinlock_profiling.cc:243] Waited 491 ms on lock 0x7b5400019854. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae8ee01 00007fb68ae8d83e 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2 00007fb6891c948c 00007fb6891c88c6
0709 14:52:36.784216 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1130362112}
I20260709 14:52:36.799755  7819 leader_election.cc:304] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:36.787088  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:36.787743  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:36.798630  7770 raft_consensus.cc:2468] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 11.
I20260709 14:52:36.801818  7777 raft_consensus.cc:3060] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:52:36.788496  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:36.804018 12268 leader_election.cc:290] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:36.806464  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:36.790170 12281 raft_consensus.cc:493] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:36.810091 12281 raft_consensus.cc:515] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:36.810978  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:36.811770  7920 raft_consensus.cc:2393] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 11: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:52:36.790611 12258 leader_election.cc:290] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:36.791061 11949 raft_consensus.cc:515] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:36.818602 12157 consensus_queue.cc:1048] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 14:52:36.821208 12188 raft_consensus.cc:2804] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 14:52:36.822422 12188 raft_consensus.cc:493] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Starting leader election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:52:36.823101 12188 raft_consensus.cc:3060] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:52:36.740165 12308 raft_consensus.cc:515] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:36.825026  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:36.830389  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:36.837550  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:36.812479 12281 leader_election.cc:290] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:36.772975 12201 raft_consensus.cc:3060] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Advancing to term 13
I20260709 14:52:36.841773  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce9c0ef2db24c13a8b1402f21819458" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:36.856899  7921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38516 (request call id 2529) took 3226 ms. Trace:
I20260709 14:52:36.851270  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:36.852421  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
W20260709 14:52:36.843073  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:36.854918  7770 raft_consensus.cc:1240] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 12. Current term is 13. Ops: []
I20260709 14:52:36.861020  7921 rpcz_store.cc:276] 0709 14:52:33.630110 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:33.630819 (+   709us) service_pool.cc:224] Handling call
0709 14:52:33.631233 (+   414us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:52:36.406911 (+2775678us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:36.856543 (+449632us) spinlock_profiling.cc:243] Waited 2.76 s on lock 0x7b54003adc54. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae8ee01 00007fb68ae8d83e 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2 00007fb6891c948c 00007fb6891c88c6
0709 14:52:36.856777 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6339337600}
I20260709 14:52:36.874938  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:36.875912  7921 raft_consensus.cc:2468] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 15.
I20260709 14:52:36.876856  7853 raft_consensus.cc:1217] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Deduplicated request from leader. Original: 11.7->[13.8-17.10]   Dedup: 13.8->[15.9-17.10]
I20260709 14:52:36.877265  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:36.877481  7853 pending_rounds.cc:85] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting all ops after (but not including) 8
I20260709 14:52:36.880035  7853 pending_rounds.cc:107] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting uncommitted NO_OP operation due to leader change: 16.9
I20260709 14:52:36.880458  7853 raft_consensus.cc:2889] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:52:36.882172  7921 raft_consensus.cc:2468] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 12.
I20260709 14:52:36.837764 12158 raft_consensus.cc:3060] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 14:52:36.748334 12327 raft_consensus.cc:697] T 9441e831627143a991a1556dcdce71e3 P 9418391fa82a42c79c6cad13ba91d964 [term 6 LEADER]: Becoming Leader. State: Replica: 9418391fa82a42c79c6cad13ba91d964, State: Running, Role: LEADER
I20260709 14:52:36.919037  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:36.920357  7851 raft_consensus.cc:2393] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 13: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
W20260709 14:52:36.922441  7852 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3650) took 3410 ms (client timeout 1508 ms). Trace:
W20260709 14:52:36.923219  7852 rpcz_store.cc:269] 0709 14:52:33.511400 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:33.511537 (+   137us) service_pool.cc:224] Handling call
0709 14:52:36.921930 (+3410393us) spinlock_profiling.cc:243] Waited 1.61 s on lock 0x7b540020dfd4. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae922fa 00007fb68fe53b17 00007fb6893ce6d4 00007fb6893ce662 00007fb6893ce591 00007fb6893ce50c 00007fb6893cd7c2 00007fb6891c948c 00007fb6891c88c6 00007fb6891c826f
0709 14:52:36.922123 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3695936896}
I20260709 14:52:36.925866  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:36.926982 12281 raft_consensus.cc:493] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:36.927670 12281 raft_consensus.cc:515] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:36.932417  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:36.934247  7923 raft_consensus.cc:2393] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 14: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:52:36.935698  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:36.939414  7851 raft_consensus.cc:1275] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 14:52:36.941010  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:36.942374  7773 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37144 (request call id 3192) took 1826 ms. Trace:
I20260709 14:52:36.942795  7773 rpcz_store.cc:276] 0709 14:52:35.116447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:36.940445 (+1823998us) service_pool.cc:224] Handling call
0709 14:52:36.942289 (+  1844us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 14:52:36.943383  7772 raft_consensus.cc:1275] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 14:52:36.888365  7919 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38516 (request call id 2539) took 1324 ms. Trace:
I20260709 14:52:36.952579  7923 raft_consensus.cc:2393] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 9: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:52:36.901902  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:36.943183  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:36.842706 12157 consensus_queue.cc:1048] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 14:52:36.945331  6549 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 14:52:36.953063  7919 rpcz_store.cc:276] 0709 14:52:35.563782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:36.467595 (+903813us) service_pool.cc:224] Handling call
0709 14:52:36.468312 (+   717us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:52:36.582654 (+114342us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:52:36.582690 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:52:36.585519 (+  2829us) log.cc:844] Serialized 26 byte log entry
0709 14:52:36.655829 (+ 70310us) raft_consensus.cc:1645] Marking committed up to 7
0709 14:52:36.656390 (+   561us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:36.656473 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:52:36.887810 (+231337us) raft_consensus.cc:1685] finished
0709 14:52:36.887839 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:36.888256 (+   417us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":54561,"raft.run_cpu_time_us":225,"raft.run_wall_time_us":15801,"thread_start_us":164586,"threads_started":2,"wal-append.queue_time_us":208796}
I20260709 14:52:36.954634  7852 raft_consensus.cc:2468] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 12.
I20260709 14:52:36.957619  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:36.960078  7854 raft_consensus.cc:2468] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 13.
I20260709 14:52:36.874811  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:36.877522  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c563cc7cfbe4d59be4ffc5cf847ce56" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:36.886593  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:36.961138  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:36.964411  7852 raft_consensus.cc:2393] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 11: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:52:36.963658  7777 raft_consensus.cc:2468] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 12.
I20260709 14:52:36.964274  7921 raft_consensus.cc:2393] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 11: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:52:36.964186  7771 raft_consensus.cc:2468] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 11.
I20260709 14:52:36.967893  7778 raft_consensus.cc:1240] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 14:52:36.968972  7923 raft_consensus.cc:1275] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 9. (term mismatch)
I20260709 14:52:36.969491  7923 pending_rounds.cc:85] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0: Aborting all ops after (but not including) 8
I20260709 14:52:36.969736  7923 pending_rounds.cc:107] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0: Aborting uncommitted NO_OP operation due to leader change: 13.9
I20260709 14:52:36.969348  7919 raft_consensus.cc:1240] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 LEADER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 13. Current term is 14. Ops: []
I20260709 14:52:36.970225  7923 raft_consensus.cc:2889] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:52:36.971078  7919 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38516 (request call id 2548) took 1374 ms. Trace:
I20260709 14:52:36.971698  7923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38516 (request call id 2549) took 1369 ms. Trace:
I20260709 14:52:36.971550  7919 rpcz_store.cc:276] 0709 14:52:35.596646 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:36.968747 (+1372101us) service_pool.cc:224] Handling call
0709 14:52:36.969034 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:52:36.970310 (+  1276us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:36.970994 (+   684us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 14:52:36.973857  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:36.976322  7771 raft_consensus.cc:2468] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 11.
I20260709 14:52:36.979560  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:36.975018  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:36.981745  7777 raft_consensus.cc:2468] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 10.
W20260709 14:52:36.982712  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:36.985549  7770 raft_consensus.cc:1275] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 14:52:36.986862  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:36.974567  7923 rpcz_store.cc:276] 0709 14:52:35.602344 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:36.968206 (+1365862us) service_pool.cc:224] Handling call
0709 14:52:36.968631 (+   425us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:52:36.971410 (+  2779us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:36.971632 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 14:52:36.988401  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:36.976401  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:36.992154 12281 leader_election.cc:290] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:36.993525  7894 leader_election.cc:304] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:36.994094  7920 raft_consensus.cc:1275] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 14:52:36.994558  7894 leader_election.cc:304] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:36.994879  7920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38516 (request call id 2547) took 1428 ms. Trace:
I20260709 14:52:36.995218 12277 raft_consensus.cc:2804] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 14:52:36.995636 12277 raft_consensus.cc:493] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:36.995977  7773 raft_consensus.cc:1275] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 14:52:36.996477 12278 raft_consensus.cc:2804] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 14:52:36.996837 12278 raft_consensus.cc:493] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:36.997128  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:36.998083  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:36.995227  7920 rpcz_store.cc:276] 0709 14:52:35.566891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:36.968326 (+1401435us) service_pool.cc:224] Handling call
0709 14:52:36.993735 (+ 25409us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:52:36.994588 (+   853us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:36.994815 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 14:52:37.000667  7894 leader_election.cc:304] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:37.000826  7852 raft_consensus.cc:2468] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 15.
W20260709 14:52:37.002866  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:37.003365  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:52:37.004858  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:37.006929  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:36.946676 12054 raft_consensus.cc:3055] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 LEADER]: Stepping down as leader of term 13
I20260709 14:52:36.961195 12157 consensus_queue.cc:1243] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer 1e9289592458429bbddb19c2e7b7b7b0 log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 14:52:37.011938  7854 raft_consensus.cc:2393] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 8: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:52:37.014945  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:37.007682  7851 raft_consensus.cc:2376] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 9. Re-sending same reply.
I20260709 14:52:37.013527  7894 leader_election.cc:304] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac, 9418391fa82a42c79c6cad13ba91d964
I20260709 14:52:37.016305  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:37.020565  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:37.022384  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:37.024151  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c563cc7cfbe4d59be4ffc5cf847ce56" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:37.027318  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:37.027539  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:37.028421  7777 raft_consensus.cc:2468] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 12.
I20260709 14:52:37.028510  7851 raft_consensus.cc:2410] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for term 16 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 14:52:37.031095  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:37.033313  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:37.034897  7777 raft_consensus.cc:2468] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 8.
I20260709 14:52:37.026718 11949 leader_election.cc:290] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:37.036286  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:37.037354  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:37.041083  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:36.995981 12277 raft_consensus.cc:3060] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:52:36.997364 12278 raft_consensus.cc:3060] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 14:52:37.045022  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:37.014099 12054 raft_consensus.cc:740] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:52:37.026145 12226 raft_consensus.cc:2804] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 14:52:37.030965 12221 raft_consensus.cc:2749] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 14:52:37.060631  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:37.068078  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:37.071444  7849 raft_consensus.cc:2393] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 12: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:52:36.968586 12327 consensus_queue.cc:237] T 9441e831627143a991a1556dcdce71e3 P 9418391fa82a42c79c6cad13ba91d964 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:52:37.090821  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:37.064482 12226 raft_consensus.cc:493] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:37.106000 12244 leader_election.cc:290] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:37.080557 12308 leader_election.cc:290] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 15 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:37.111320 12226 raft_consensus.cc:3060] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 14:52:37.133608  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
W20260709 14:52:37.146499  7927 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38532 (request call id 3368) took 2147 ms (client timeout 1551 ms). Trace:
W20260709 14:52:37.159036  7927 rpcz_store.cc:269] 0709 14:52:34.998677 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:35.124680 (+126003us) service_pool.cc:224] Handling call
0709 14:52:37.146246 (+2021566us) spinlock_profiling.cc:243] Waited 263 ms on lock 0x7b54001329d4. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae922fa 00007fb68fe53b17 00007fb6893ce6d4 00007fb6893ce662 00007fb6893ce591 00007fb6893ce50c 00007fb6893cd7c2 00007fb6891c948c 00007fb6891c88c6 00007fb6891c826f
0709 14:52:37.146405 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":604440320}
I20260709 14:52:37.149204  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:37.124526 12243 leader_election.cc:290] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:37.174119  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:37.176059 12108 leader_election.cc:290] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:37.172149 12325 raft_consensus.cc:515] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:52:37.199397 12325 leader_election.cc:290] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 [CANDIDATE]: Term 10 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:52:37.200528 12264 log.cc:927] Time spent T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 2.520s	user 0.008s	sys 0.012s
I20260709 14:52:37.201350  8640 raft_consensus.cc:1240] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 [term 10 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 9. Current term is 10. Ops: []
I20260709 14:52:37.114904 12054 consensus_queue.cc:260] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:37.209930 12277 raft_consensus.cc:515] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:37.216490  7777 raft_consensus.cc:1275] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
W20260709 14:52:37.220855  7744 leader_election.cc:336] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785): Timed out: RequestConsensusVote RPC to 127.6.101.67:40785 timed out after 1.811s (SENT)
I20260709 14:52:37.221815  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:37.222029  7744 leader_election.cc:304] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:52:37.224022  7924 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38532 (request call id 3340) took 2832 ms (client timeout 3139 ms). Trace:
W20260709 14:52:37.224656  7924 rpcz_store.cc:269] 0709 14:52:34.391533 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:34.392233 (+   700us) service_pool.cc:224] Handling call
0709 14:52:37.223661 (+2831428us) spinlock_profiling.cc:243] Waited 573 ms on lock 0x7b54003129d4. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae922fa 00007fb68fe53b17 00007fb6893ce6d4 00007fb6893ce662 00007fb6893ce591 00007fb6893ce50c 00007fb6893cd7c2 00007fb6891c948c 00007fb6891c88c6 00007fb6891c826f
0709 14:52:37.223907 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1318838528}
I20260709 14:52:37.229717  8639 raft_consensus.cc:1240] T 9441e831627143a991a1556dcdce71e3 P 9418391fa82a42c79c6cad13ba91d964 [term 6 LEADER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 5. Current term is 6. Ops: []
I20260709 14:52:37.238049 12054 raft_consensus.cc:3060] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Advancing to term 14
I20260709 14:52:37.169791 12263 raft_consensus.cc:515] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:37.252302  7745 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:37.253149  7925 raft_consensus.cc:2468] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 8.
I20260709 14:52:37.254472  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:52:37.240545 12288 consensus_meta.cc:287] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent flushing consensus metadata: real 0.581s	user 0.023s	sys 0.000s
I20260709 14:52:37.260252  7850 raft_consensus.cc:2393] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 11: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:52:37.246737 12243 raft_consensus.cc:2749] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 14:52:37.263773 12218 leader_election.cc:290] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:37.254324 12036 raft_consensus.cc:493] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:37.267318 12036 raft_consensus.cc:515] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:37.267925  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:37.269984  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:37.270823  7854 raft_consensus.cc:2393] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 11: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:52:37.272310 12201 raft_consensus.cc:515] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:37.274858 12263 leader_election.cc:290] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 11 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:37.269028  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18d29d52d304c87b930d4fb5eaf50b1" candidate_uuid: "9418391fa82a42c79c6cad13ba91d964" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:37.278786  7847 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49948 (request call id 3662) took 3764 ms. Trace:
I20260709 14:52:37.285343  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:37.287699 12241 raft_consensus.cc:493] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:37.272327  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:37.290860  7847 rpcz_store.cc:276] 0709 14:52:33.514359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:33.779096 (+264737us) service_pool.cc:224] Handling call
0709 14:52:36.929441 (+3150345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:52:36.929837 (+   396us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 14:52:36.929869 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:52:36.930082 (+   213us) raft_consensus.cc:1645] Marking committed up to 6
0709 14:52:36.930135 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:36.930215 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:37.278503 (+348288us) spinlock_profiling.cc:243] Waited 3.15 s on lock 0x7b540020dfd0. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae8d8ad 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2 00007fb6891c948c 00007fb6891c88c6 00007fb6891c826f
0709 14:52:37.278662 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":998,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":113,"spinlock_wait_cycles":7244447104}
I20260709 14:52:37.294071  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:37.294785  7847 raft_consensus.cc:3060] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Advancing to term 15
I20260709 14:52:37.295264  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18d29d52d304c87b930d4fb5eaf50b1" candidate_uuid: "9418391fa82a42c79c6cad13ba91d964" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:37.299237  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:37.299914  7845 raft_consensus.cc:2468] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 12.
I20260709 14:52:37.300609  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:37.302816  7852 raft_consensus.cc:1240] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 12. Current term is 13. Ops: []
I20260709 14:52:37.303740  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18d29d52d304c87b930d4fb5eaf50b1" candidate_uuid: "9418391fa82a42c79c6cad13ba91d964" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:37.304247  7744 leader_election.cc:400] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 election: Vote denied by peer 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785) with higher term. Message: Invalid argument: T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 13. Current term is 14.
W20260709 14:52:37.302884  7743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:37.304978  7744 leader_election.cc:304] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:37.307868  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:37.308519  7854 raft_consensus.cc:2468] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 15.
I20260709 14:52:37.301573  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:37.312261 12125 raft_consensus.cc:2804] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 14:52:37.302145 12296 log.cc:927] Time spent T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 1.679s	user 0.024s	sys 0.011s
I20260709 14:52:37.318887  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:37.329320  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:52:37.360531  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 53166.4us
I20260709 14:52:37.368155  7854 raft_consensus.cc:2393] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 8: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:52:37.378901  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:37.381587  7847 raft_consensus.cc:2468] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 15.
I20260709 14:52:37.319816 12125 raft_consensus.cc:493] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Starting leader election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:52:37.373592 12161 raft_consensus.cc:493] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:37.373827 12118 consensus_queue.cc:1048] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 14:52:37.389050 12161 raft_consensus.cc:515] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:37.391170 12161 leader_election.cc:290] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:37.386351 12125 raft_consensus.cc:3060] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Advancing to term 14
I20260709 14:52:37.398444  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:37.399537  7854 raft_consensus.cc:2393] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 13: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:52:37.405640  7848 raft_consensus.cc:1240] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 10. Current term is 11. Ops: []
I20260709 14:52:37.407380 12226 raft_consensus.cc:515] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:37.409377 12036 leader_election.cc:290] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:37.297329 12241 raft_consensus.cc:515] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:37.412330 12241 leader_election.cc:290] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:37.413584 12035 leader_election.cc:290] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:37.414980 12070 leader_election.cc:290] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 13 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:52:37.418462  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:37.420987 12277 leader_election.cc:290] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:37.423087 12201 leader_election.cc:290] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:52:37.425741  7925 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38532 (request call id 3374) took 1960 ms (client timeout 1548 ms). Trace:
W20260709 14:52:37.426281  7925 rpcz_store.cc:269] 0709 14:52:35.465182 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:35.879949 (+414767us) service_pool.cc:224] Handling call
0709 14:52:37.425494 (+1545545us) spinlock_profiling.cc:243] Waited 1.37 s on lock 0x7b540031f6d4. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae922fa 00007fb68fe53b17 00007fb6893ce6d4 00007fb6893ce662 00007fb6893ce591 00007fb6893ce50c 00007fb6893cd7c2 00007fb6891c948c 00007fb6891c88c6 00007fb6891c826f
0709 14:52:37.425656 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3155694976}
I20260709 14:52:37.430658  7779 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 3194) took 1974 ms. Trace:
I20260709 14:52:37.431165  7779 rpcz_store.cc:276] 0709 14:52:35.455761 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:35.456004 (+   243us) service_pool.cc:224] Handling call
0709 14:52:35.458038 (+  2034us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:52:35.508894 (+ 50856us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:37.430250 (+1921356us) spinlock_profiling.cc:243] Waited 25.1 ms on lock 0x7b5400223154. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae8ee01 00007fb68ae8d83e 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2 00007fb6891c948c 00007fb6891c88c6
0709 14:52:37.430534 (+   284us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":57730432}
W20260709 14:52:37.434808 12188 consensus_meta.cc:287] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent flushing consensus metadata: real 0.564s	user 0.013s	sys 0.001s
I20260709 14:52:37.435583 12290 leader_election.cc:290] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:37.375106 12268 consensus_queue.cc:1059] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.070s
I20260709 14:52:37.446487 12272 leader_election.cc:290] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:37.452466 12175 raft_consensus.cc:3060] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:52:37.468760  7774 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37136 (request call id 2562) took 1058 ms. Trace:
I20260709 14:52:37.469381  7774 rpcz_store.cc:276] 0709 14:52:36.410129 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:36.809846 (+399717us) service_pool.cc:224] Handling call
0709 14:52:36.810376 (+   530us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:52:36.810661 (+   285us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 14:52:36.987171 (+176510us) log.cc:844] Serialized 14 byte log entry
0709 14:52:37.411456 (+424285us) spinlock_profiling.cc:243] Waited 11.8 ms on lock 0x7b1800334480. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb690c69de1 00007fb690c765b1 00007fb68aa364bc 00007fb687d8448b 00007fb690bdeab9 00007fb687da069b 00007fb687d9e93f 00007fb687da0c02 00007fb68aa2820b 00007fb68aa2dd23 00007fb68aa2e23a
0709 14:52:37.468211 (+ 56755us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:52:37.468282 (+    71us) raft_consensus.cc:1645] Marking committed up to 7
0709 14:52:37.468335 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:37.468416 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:37.468685 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":62398,"prepare.queue_time_us":225958,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":5927,"spinlock_wait_cycles":27064064,"thread_start_us":259552,"threads_started":2,"wal-append.queue_time_us":184362}
I20260709 14:52:37.435657 12188 raft_consensus.cc:515] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:37.415051 12278 raft_consensus.cc:515] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:37.473870  7845 raft_consensus.cc:1240] T 9441e831627143a991a1556dcdce71e3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 14:52:37.482079  7772 raft_consensus.cc:2468] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 14.
I20260709 14:52:37.466114 12243 consensus_queue.cc:1059] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.014s
W20260709 14:52:37.493737  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 118542us
I20260709 14:52:37.495467  7744 leader_election.cc:304] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 9418391fa82a42c79c6cad13ba91d964
W20260709 14:52:37.492251 12111 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.494s	user 0.017s	sys 0.011s
I20260709 14:52:37.495820  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:37.473124 12244 consensus_queue.cc:1059] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.020s
W20260709 14:52:37.501648  7926 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38532 (request call id 3362) took 2513 ms (client timeout 2094 ms). Trace:
W20260709 14:52:37.502206  7926 rpcz_store.cc:269] 0709 14:52:34.988030 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:35.949967 (+961937us) service_pool.cc:224] Handling call
0709 14:52:37.501359 (+1551392us) spinlock_profiling.cc:243] Waited 68.3 ms on lock 0x7b5400311ad4. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae922fa 00007fb68fe53b17 00007fb6893ce6d4 00007fb6893ce662 00007fb6893ce591 00007fb6893ce50c 00007fb6893cd7c2 00007fb6891c948c 00007fb6891c88c6 00007fb6891c826f
0709 14:52:37.501550 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":157160704}
W20260709 14:52:37.497830 12319 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.743s	user 0.000s	sys 0.014s
I20260709 14:52:37.505901  7744 leader_election.cc:304] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:52:37.511231 12117 raft_consensus.cc:2804] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 14:52:37.511818 12117 raft_consensus.cc:493] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Starting leader election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:52:37.512245 12188 leader_election.cc:290] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 12 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:37.496512 12226 leader_election.cc:290] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:52:37.498068 12111 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.511s	user 0.018s	sys 0.011s
I20260709 14:52:37.513293  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:37.514593  7744 leader_election.cc:304] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:52:37.516360  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:37.509927 12243 raft_consensus.cc:2749] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 14:52:37.522341  7852 raft_consensus.cc:2410] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for term 17 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 14:52:37.526103  7744 leader_election.cc:304] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:52:37.528599  7744 leader_election.cc:304] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:52:37.528453 12170 raft_consensus.cc:2804] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 14:52:37.529342 12170 raft_consensus.cc:493] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:37.545146 12170 raft_consensus.cc:3060] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Advancing to term 8
I20260709 14:52:37.546130  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:37.546931 12278 leader_election.cc:290] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 13 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:37.529960 12243 raft_consensus.cc:2804] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 14:52:37.506448 12365 raft_consensus.cc:3055] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 LEADER]: Stepping down as leader of term 13
I20260709 14:52:37.547654  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:37.547914 12365 raft_consensus.cc:740] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:52:37.548471  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:52:37.510274 12319 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.764s	user 0.001s	sys 0.015s
I20260709 14:52:37.549079 12365 consensus_queue.cc:260] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:37.550860 12365 raft_consensus.cc:3060] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Advancing to term 14
I20260709 14:52:37.532202 12303 consensus_queue.cc:1059] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 14:52:37.512285 12117 raft_consensus.cc:3060] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Advancing to term 16
I20260709 14:52:37.553874 12303 consensus_queue.cc:1243] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer 9418391fa82a42c79c6cad13ba91d964 log is divergent from this leader: its last log entry 6.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 14:52:37.553848  7852 raft_consensus.cc:1240] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 11. Current term is 12. Ops: []
I20260709 14:52:37.535533  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:52:37.528424 12359 log.cc:927] Time spent T 9441e831627143a991a1556dcdce71e3 P 9418391fa82a42c79c6cad13ba91d964: Append to log took a long time: real 0.155s	user 0.000s	sys 0.002s
I20260709 14:52:37.556267  7847 raft_consensus.cc:2468] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 12.
W20260709 14:52:37.538223 12354 log.cc:927] Time spent T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.163s	user 0.001s	sys 0.001s
I20260709 14:52:37.523182 12244 raft_consensus.cc:2804] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 14:52:37.539940 12357 log.cc:927] Time spent T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 14:52:37.558115 11963 leader_election.cc:290] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:37.544010  7846 raft_consensus.cc:1275] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 14:52:37.544579  7893 leader_election.cc:304] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:37.559736 12199 raft_consensus.cc:493] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:37.560271 12199 raft_consensus.cc:515] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:37.554303 12272 raft_consensus.cc:3055] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 LEADER]: Stepping down as leader of term 9
I20260709 14:52:37.562345  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:37.562655 12272 raft_consensus.cc:740] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:52:37.533016  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:37.564575  7926 raft_consensus.cc:2410] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 14:52:37.556133  7850 raft_consensus.cc:1275] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 14:52:37.543143  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:37.564399 12272 consensus_queue.cc:260] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:52:37.566241 12272 raft_consensus.cc:3060] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:52:37.567077  7778 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37136 (request call id 2561) took 1157 ms. Trace:
I20260709 14:52:37.567590  7778 rpcz_store.cc:276] 0709 14:52:36.409971 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:36.803401 (+393430us) service_pool.cc:224] Handling call
0709 14:52:36.967634 (+164233us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:52:36.968321 (+   687us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:37.561888 (+593567us) spinlock_profiling.cc:243] Waited 164 ms on lock 0x7b54003e4c50. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae8d8ad 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2 00007fb6891c948c 00007fb6891c88c6 00007fb6891c826f
0709 14:52:37.562067 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":376775040}
W20260709 14:52:37.569271  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:37.570242 11963 raft_consensus.cc:2804] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 14:52:37.555735 12243 raft_consensus.cc:493] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:37.571943  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:37.572398 12243 raft_consensus.cc:3060] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Advancing to term 13
I20260709 14:52:37.572923  7920 raft_consensus.cc:2393] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 15: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:52:37.562578  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:37.554718 12303 raft_consensus.cc:3055] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 LEADER]: Stepping down as leader of term 5
I20260709 14:52:37.575270  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:37.575939  7920 raft_consensus.cc:2468] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 14.
I20260709 14:52:37.576992  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:37.577095  7849 raft_consensus.cc:1240] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 14. Current term is 15. Ops: []
I20260709 14:52:37.570590  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:37.579035  7849 raft_consensus.cc:1240] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 LEADER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 13. Current term is 14. Ops: []
I20260709 14:52:37.579715  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:37.581036  7925 raft_consensus.cc:2368] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 11. Current term is 12.
I20260709 14:52:37.581622  7922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38516 (request call id 2540) took 2017 ms. Trace:
I20260709 14:52:37.582034  7922 rpcz_store.cc:276] 0709 14:52:35.564088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:36.514427 (+950339us) service_pool.cc:224] Handling call
0709 14:52:36.517575 (+  3148us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:52:36.608731 (+ 91156us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:37.581328 (+972597us) spinlock_profiling.cc:243] Waited 12.2 ms on lock 0x7b54003c1ed4. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae8ee01 00007fb68ae8d83e 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2 00007fb6891c948c 00007fb6891c88c6
0709 14:52:37.581563 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":27966208}
I20260709 14:52:37.583199  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:37.585685  7846 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 3585) took 2529 ms. Trace:
I20260709 14:52:37.586117  7846 rpcz_store.cc:276] 0709 14:52:35.056245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:35.057462 (+  1217us) service_pool.cc:224] Handling call
0709 14:52:35.057929 (+   467us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:52:37.559531 (+2501602us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:37.585436 (+ 25905us) spinlock_profiling.cc:243] Waited 2.49 s on lock 0x7b54002cabd4. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae8ee01 00007fb68ae8d83e 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2 00007fb6891c948c 00007fb6891c88c6
0709 14:52:37.585623 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5716839296}
I20260709 14:52:37.587472  7925 raft_consensus.cc:1275] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 14:52:37.588488  7853 raft_consensus.cc:1275] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 14:52:37.588949  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:37.589949  7922 raft_consensus.cc:2468] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 14.
I20260709 14:52:37.592701  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:37.593138  7922 raft_consensus.cc:1240] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 13. Current term is 14. Ops: []
I20260709 14:52:37.592422 11963 raft_consensus.cc:493] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:37.600601  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:37.602988  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:37.603659  7922 raft_consensus.cc:2468] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 13.
I20260709 14:52:37.605445  7922 raft_consensus.cc:1275] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 14:52:37.605973  7852 raft_consensus.cc:1275] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 9. (term mismatch)
I20260709 14:52:37.606463  7893 leader_election.cc:304] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:37.606828  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:37.608103 11949 raft_consensus.cc:2749] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 14:52:37.608738  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:37.609457  7893 leader_election.cc:304] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:37.609572  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:37.607612  7852 pending_rounds.cc:85] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting all ops after (but not including) 8
I20260709 14:52:37.610457  7852 pending_rounds.cc:107] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting uncommitted NO_OP operation due to leader change: 15.9
I20260709 14:52:37.610716  7852 raft_consensus.cc:2889] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:52:37.610984  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:37.613710 12199 leader_election.cc:290] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:37.610093  7848 raft_consensus.cc:1275] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 14:52:37.614693  7848 pending_rounds.cc:85] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting all ops after (but not including) 6
I20260709 14:52:37.614981  7848 pending_rounds.cc:107] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 14:52:37.615252  7848 raft_consensus.cc:2889] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:52:37.616004  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:37.616844  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:37.616822  7846 raft_consensus.cc:3060] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Advancing to term 13
I20260709 14:52:37.617408  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:37.617926  7852 raft_consensus.cc:3060] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Advancing to term 14
I20260709 14:52:37.618558  7848 raft_consensus.cc:3060] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Advancing to term 14
I20260709 14:52:37.617509  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:37.620378  7845 raft_consensus.cc:3060] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Advancing to term 12
W20260709 14:52:37.609138  7894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:37.624403  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:37.624933  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:37.625208  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:37.625947  7924 raft_consensus.cc:2468] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 8.
I20260709 14:52:37.626948  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:37.629027  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:37.629937  7927 raft_consensus.cc:2468] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 15.
I20260709 14:52:37.610093  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:37.631093 11949 raft_consensus.cc:2749] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 14:52:37.631699  7849 raft_consensus.cc:2468] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 8.
I20260709 14:52:37.632977  7849 raft_consensus.cc:3055] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 LEADER]: Stepping down as leader of term 13
I20260709 14:52:37.633430  7849 raft_consensus.cc:740] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:52:37.634568  7849 consensus_queue.cc:260] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:37.633486  7893 leader_election.cc:304] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:52:37.626952  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:37.638072  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:37.767050  7779 raft_consensus.cc:1275] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 14:52:37.675056  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:37.751494  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:37.725973  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:37.782019  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:37.783974  7777 raft_consensus.cc:2468] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 14.
I20260709 14:52:37.784180  7775 raft_consensus.cc:1275] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 14:52:37.767540  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:37.691941  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:37.681106  7921 raft_consensus.cc:1240] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 LEADER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 14:52:37.642557  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:37.691495  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:37.719154  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:37.589951 12303 raft_consensus.cc:740] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:52:37.640868  7845 raft_consensus.cc:2468] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 12.
I20260709 14:52:37.683000  7675 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51352 (request call id 130) took 3847 ms. Trace:
I20260709 14:52:37.672043  7922 raft_consensus.cc:1275] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 14:52:37.650521  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:37.693137  7848 raft_consensus.cc:2468] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 14.
I20260709 14:52:37.791313  8639 raft_consensus.cc:1240] T 9441e831627143a991a1556dcdce71e3 P 9418391fa82a42c79c6cad13ba91d964 [term 6 LEADER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 5. Current term is 6. Ops: []
I20260709 14:52:37.789585  7849 raft_consensus.cc:3060] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Advancing to term 14
I20260709 14:52:37.588354 12244 raft_consensus.cc:493] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:37.764214  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:37.649571  8598 leader_election.cc:304] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9418391fa82a42c79c6cad13ba91d964; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:37.781850  7927 raft_consensus.cc:2468] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 14.
I20260709 14:52:37.809329  7773 raft_consensus.cc:2410] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 14:52:37.796940  7771 raft_consensus.cc:3060] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Advancing to term 12
W20260709 14:52:37.794380  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 160968us
I20260709 14:52:37.810371  7893 leader_election.cc:304] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:37.812922  7927 raft_consensus.cc:1240] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 14:52:37.794962  7772 raft_consensus.cc:2468] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 14.
I20260709 14:52:37.794229  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:37.664177  7745 leader_election.cc:304] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:37.742826  7852 raft_consensus.cc:2468] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 14.
I20260709 14:52:37.689455  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:37.814759  7819 leader_election.cc:304] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:37.803459  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c563cc7cfbe4d59be4ffc5cf847ce56" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:37.816646  7925 raft_consensus.cc:2393] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 12: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
W20260709 14:52:37.818624  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 154614us
I20260709 14:52:37.820680  7745 leader_election.cc:304] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:37.798666 11949 raft_consensus.cc:2749] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 14:52:37.800624  7675 rpcz_store.cc:276] 0709 14:52:33.889320 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:33.893823 (+  4503us) service_pool.cc:224] Handling call
0709 14:52:37.682910 (+3789087us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 14:52:34.614814 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 14:52:34.722126 (+107312us) write_op.cc:432] Acquiring schema lock in shared mode
0709 14:52:34.722168 (+    42us) write_op.cc:435] Acquired schema lock
0709 14:52:34.722185 (+    17us) tablet.cc:662] Decoding operations
0709 14:52:34.722576 (+   391us) write_op.cc:620] Acquiring the partition lock for write op
0709 14:52:34.722632 (+    56us) write_op.cc:641] Partition lock acquired for write op
0709 14:52:34.722668 (+    36us) tablet.cc:685] Acquiring locks for 1 operations
0709 14:52:34.722995 (+   327us) tablet.cc:701] Row locks acquired
0709 14:52:34.723017 (+    22us) write_op.cc:260] PREPARE: finished
0709 14:52:34.723231 (+   214us) write_op.cc:270] Start()
0709 14:52:34.723415 (+   184us) write_op.cc:276] Timestamp: P: 1783608754723154 usec, L: 0
0709 14:52:34.723443 (+    28us) op_driver.cc:348] REPLICATION: starting
0709 14:52:34.724650 (+  1207us) log.cc:844] Serialized 533 byte log entry
0709 14:52:35.731258 (+1006608us) op_driver.cc:464] REPLICATION: finished
0709 14:52:36.127813 (+396555us) write_op.cc:301] APPLY: starting
0709 14:52:36.127917 (+   104us) tablet.cc:1367] starting BulkCheckPresence
0709 14:52:36.128937 (+  1020us) tablet.cc:1370] finished BulkCheckPresence
0709 14:52:36.129041 (+   104us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 14:52:36.311509 (+182468us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 14:52:36.357807 (+ 46298us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 14:52:36.366076 (+  8269us) write_op.cc:312] APPLY: finished
0709 14:52:36.377043 (+ 10967us) log.cc:844] Serialized 25 byte log entry
0709 14:52:36.384613 (+  7570us) write_op.cc:489] Releasing partition, row and schema locks
0709 14:52:36.393995 (+  9382us) write_op.cc:454] Released schema lock
0709 14:52:36.396718 (+  2723us) write_op.cc:341] FINISH: Updating metrics
0709 14:52:36.443786 (+ 47068us) write_op.cc:489] Releasing partition, row and schema locks
0709 14:52:36.454823 (+ 11037us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":603274,"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":396277,"apply.run_cpu_time_us":5244,"apply.run_wall_time_us":284349,"cfile_cache_hit":4,"cfile_cache_hit_bytes":4168,"num_ops":1,"prepare.queue_time_us":249214,"prepare.run_cpu_time_us":13778,"prepare.run_wall_time_us":210668,"raft.queue_time_us":674850,"raft.run_cpu_time_us":36372,"raft.run_wall_time_us":658158,"replication_time_us":1007613,"thread_start_us":1612496,"threads_started":4,"wal-append.queue_time_us":179410,"wal-append.run_cpu_time_us":85221,"wal-append.run_wall_time_us":2532404}]]}
I20260709 14:52:37.799609  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:37.807713  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:37.746809 12281 raft_consensus.cc:3055] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 LEADER]: Stepping down as leader of term 8
I20260709 14:52:37.859898  7773 raft_consensus.cc:1240] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 15. Current term is 16. Ops: [12.8-15.9]
I20260709 14:52:37.638840  7846 raft_consensus.cc:2468] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 13.
I20260709 14:52:37.802403  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:37.811748  7893 leader_election.cc:304] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:37.861617  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:37.862787  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:37.863133  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:37.864238  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:37.601979 11963 raft_consensus.cc:3060] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:52:37.825326 12278 raft_consensus.cc:493] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
W20260709 14:52:37.829422  7743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:37.813585 12244 raft_consensus.cc:3060] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:52:37.836089 12117 raft_consensus.cc:515] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:37.838363 12325 raft_consensus.cc:2749] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 14:52:37.808936 12125 raft_consensus.cc:515] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:37.843922 12170 raft_consensus.cc:515] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:37.845441 12054 raft_consensus.cc:2749] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 14:52:37.850283  7924 raft_consensus.cc:1240] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 11. Current term is 12. Ops: []
I20260709 14:52:37.855640 12058 raft_consensus.cc:2749] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 14:52:37.854097  7921 raft_consensus.cc:2468] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 9.
W20260709 14:52:37.870128  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 58454.8us
I20260709 14:52:37.870986  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:37.814613 12156 raft_consensus.cc:2804] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 14:52:37.876621  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:37.901062 12125 leader_election.cc:290] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 14 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:37.901826  7893 leader_election.cc:304] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:37.876716 12226 raft_consensus.cc:2749] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 14:52:37.874114  7674 catalog_manager.cc:5697] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 12 to 13, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 13 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:52:37.869724 12268 raft_consensus.cc:493] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:37.881618  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:37.882385  7849 raft_consensus.cc:1275] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 9. (term mismatch)
I20260709 14:52:37.883723 12117 leader_election.cc:290] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 16 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:37.909369 12219 raft_consensus.cc:2749] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 14:52:37.910904 12036 consensus_queue.cc:1048] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 14:52:37.910998  7674 catalog_manager.cc:5697] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 13 to 14, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 14 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:52:37.855468 12279 raft_consensus.cc:493] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:52:37.855479 12281 raft_consensus.cc:740] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:52:37.902453  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:37.814744 12188 raft_consensus.cc:493] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:37.903262  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:37.853011  7745 leader_election.cc:304] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:37.911947 12170 leader_election.cc:290] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:37.881923  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:37.906018  7849 pending_rounds.cc:85] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting all ops after (but not including) 8
I20260709 14:52:37.924136  7849 pending_rounds.cc:107] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting uncommitted NO_OP operation due to leader change: 13.9
I20260709 14:52:37.924460  7849 raft_consensus.cc:2889] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:52:37.914000  7674 catalog_manager.cc:5697] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 7 to 8, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 8 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:52:37.926093  7921 raft_consensus.cc:1240] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 14:52:37.922214  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:37.922214  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
W20260709 14:52:37.913640  7744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:37.919744  7893 leader_election.cc:304] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:37.927452  7775 raft_consensus.cc:2468] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 14.
I20260709 14:52:37.797578  7778 raft_consensus.cc:2468] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 14.
I20260709 14:52:37.903846 12156 raft_consensus.cc:493] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:37.935859  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c563cc7cfbe4d59be4ffc5cf847ce56" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:37.937851  7774 raft_consensus.cc:1275] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 14:52:37.943722  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:37.945152  7893 leader_election.cc:304] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:37.879060 12278 raft_consensus.cc:515] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:37.954071  7674 catalog_manager.cc:5697] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 10 to 11, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 11 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:52:37.945936  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:37.957535 12281 consensus_queue.cc:260] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:37.950567  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:37.966008  7775 raft_consensus.cc:2468] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 9.
W20260709 14:52:37.966837  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:52:37.962756  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 109899us
I20260709 14:52:37.967998  7775 raft_consensus.cc:1275] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 14:52:37.952530  7675 catalog_manager.cc:5697] T 9441e831627143a991a1556dcdce71e3 P 9418391fa82a42c79c6cad13ba91d964 reported cstate change: term changed from 5 to 6, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68). New cstate: current_term: 6 leader_uuid: "9418391fa82a42c79c6cad13ba91d964" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 14:52:37.950392  7893 leader_election.cc:304] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:37.947816 12170 raft_consensus.cc:493] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:37.943310 12156 raft_consensus.cc:3060] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 14:52:37.927954 12188 raft_consensus.cc:515] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:37.978905  7774 raft_consensus.cc:1275] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 14:52:37.948519 12036 raft_consensus.cc:2804] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 14:52:37.969007  7745 leader_election.cc:304] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:37.971112  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:37.917626 12268 raft_consensus.cc:515] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:37.954671 12258 raft_consensus.cc:2749] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 14:52:38.038259 12268 leader_election.cc:290] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:37.997841  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:38.035532 11963 raft_consensus.cc:515] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:38.047525 11963 leader_election.cc:290] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:38.050325 11963 consensus_queue.cc:1048] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 14:52:38.050693 12278 leader_election.cc:290] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:37.986280  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:37.953121 11949 raft_consensus.cc:2804] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 14:52:38.015774 12117 raft_consensus.cc:2749] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 14:52:38.005950  7745 leader_election.cc:304] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:37.978259  7674 catalog_manager.cc:5697] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 11 to 12, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 12 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:52:38.074390  7674 catalog_manager.cc:5697] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 10 to 11, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 11 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
W20260709 14:52:38.075938  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 261250us
I20260709 14:52:38.015707  7676 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54364 (request call id 343) took 10041 ms. Trace:
I20260709 14:52:38.077991  7819 leader_election.cc:304] T 9441e831627143a991a1556dcdce71e3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 9418391fa82a42c79c6cad13ba91d964
I20260709 14:52:37.975087 12243 raft_consensus.cc:515] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:38.026784  7774 raft_consensus.cc:3060] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:52:37.923627 12279 raft_consensus.cc:515] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:37.978070 12226 raft_consensus.cc:2749] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 14:52:38.085109  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 79296.7us
I20260709 14:52:38.076902  7674 catalog_manager.cc:5697] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 11 to 13, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 13 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:52:38.090566  7745 leader_election.cc:304] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:38.063318 12281 raft_consensus.cc:3060] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Advancing to term 9
W20260709 14:52:38.072446 12272 consensus_meta.cc:287] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent flushing consensus metadata: real 0.506s	user 0.005s	sys 0.007s
I20260709 14:52:38.102353  7920 raft_consensus.cc:2468] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 12.
I20260709 14:52:38.092128  7674 catalog_manager.cc:5697] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 8 to 10, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 10 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:52:38.086341 12175 raft_consensus.cc:2749] T 9441e831627143a991a1556dcdce71e3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 14:52:38.069796 12036 raft_consensus.cc:697] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:38.073001 11949 raft_consensus.cc:697] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:38.104483  7770 raft_consensus.cc:3060] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Advancing to term 14
I20260709 14:52:38.105603  7925 raft_consensus.cc:1240] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 10. Current term is 11. Ops: []
I20260709 14:52:38.105429  7745 leader_election.cc:304] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:38.088518  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:38.079469 12278 raft_consensus.cc:493] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:38.085947 12111 consensus_queue.cc:1048] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 14:52:38.080773 12319 raft_consensus.cc:2749] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 14:52:38.077452  7676 rpcz_store.cc:276] 0709 14:52:27.976447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:27.976691 (+   244us) service_pool.cc:224] Handling call
0709 14:52:28.436424 (+459733us) spinlock_profiling.cc:243] Waited 185 ms on lock 0x7b54003499d4. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf8090 00007fb68ae96f3a 00007fb690c4d1cc 00007fb690d4b37e 00007fb68f20c2a4 00007fb68f20c232 00007fb68f20c161 00007fb68f20c0dc 00007fb68f20b392 00007fb6891c948c 00007fb6891c88c6
0709 14:52:38.015563 (+9579139us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 14:52:31.764893 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 14:52:31.795746 (+ 30853us) write_op.cc:432] Acquiring schema lock in shared mode
0709 14:52:31.795857 (+   111us) write_op.cc:435] Acquired schema lock
0709 14:52:31.795878 (+    21us) tablet.cc:662] Decoding operations
0709 14:52:31.907857 (+111979us) write_op.cc:620] Acquiring the partition lock for write op
0709 14:52:31.937319 (+ 29462us) write_op.cc:641] Partition lock acquired for write op
0709 14:52:31.937365 (+    46us) tablet.cc:685] Acquiring locks for 18 operations
0709 14:52:31.938692 (+  1327us) tablet.cc:701] Row locks acquired
0709 14:52:31.938713 (+    21us) write_op.cc:260] PREPARE: finished
0709 14:52:31.938938 (+   225us) write_op.cc:270] Start()
0709 14:52:31.939079 (+   141us) write_op.cc:276] Timestamp: P: 1783608751938861 usec, L: 0
0709 14:52:31.939099 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 14:52:31.940064 (+   965us) log.cc:844] Serialized 7084 byte log entry
0709 14:52:32.460706 (+520642us) spinlock_profiling.cc:243] Waited 2.21 ms on lock 0x7b18000198a0. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb690c69de1 00007fb690c765b1 00007fb687da13f3 00007fb687da37c1 00007fb687da3779 00007fb687da3709 00007fb687da36d1 00007fb687da29cd 0000000000396ad4 0000000000396919 00007fb687d8483a
0709 14:52:32.839343 (+378637us) op_driver.cc:464] REPLICATION: finished
0709 14:52:33.214957 (+375614us) write_op.cc:301] APPLY: starting
0709 14:52:33.217376 (+  2419us) tablet.cc:1367] starting BulkCheckPresence
0709 14:52:34.223243 (+1005867us) spinlock_profiling.cc:243] Waited 4.42 ms on lock 0x7b18000198a0. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb690c69de1 00007fb690c765b1 00007fb68abcd0ec 00007fb68ac19c0a 00007fb68ac194f7 00007fb68ac19490 00007fb68abd0f48 00007fb68e8e51bb 00007fb68e8e5532 00007fb68e92cb93 00007fb68e7d9de3
0709 14:52:34.474103 (+250860us) tablet.cc:1370] finished BulkCheckPresence
0709 14:52:34.486645 (+ 12542us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 14:52:35.960056 (+1473411us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 14:52:36.095745 (+135689us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=36,key_file_lookups=36,delta_file_lookups=36,mrs_lookups=0
0709 14:52:36.095808 (+    63us) write_op.cc:312] APPLY: finished
0709 14:52:36.096358 (+   550us) log.cc:844] Serialized 164 byte log entry
0709 14:52:36.108561 (+ 12203us) write_op.cc:489] Releasing partition, row and schema locks
0709 14:52:36.108821 (+   260us) write_op.cc:454] Released schema lock
0709 14:52:36.108904 (+    83us) write_op.cc:341] FINISH: Updating metrics
0709 14:52:36.126907 (+ 18003us) write_op.cc:489] Releasing partition, row and schema locks
0709 14:52:36.126951 (+    44us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":686895,"reported_tablets":55,"spinlock_wait_cycles":426114816,"child_traces":[["op",{"apply.queue_time_us":364965,"apply.run_cpu_time_us":68902,"apply.run_wall_time_us":2911911,"cfile_cache_hit":74,"cfile_cache_hit_bytes":79151,"mutex_wait_us":10286,"num_ops":18,"prepare.queue_time_us":262089,"prepare.run_cpu_time_us":26328,"prepare.run_wall_time_us":466527,"raft.queue_time_us":303687,"raft.run_cpu_time_us":39976,"raft.run_wall_time_us":472841,"replication_time_us":859152,"spinlock_wait_cycles":15257216,"thread_start_us":714683,"threads_started":4,"wal-append.queue_time_us":293497,"wal-append.run_cpu_time_us":18417,"wal-append.run_wall_time_us":1884537}]]}
I20260709 14:52:38.105345  7674 catalog_manager.cc:5697] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 10 to 12, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 12 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:52:38.119915  7774 raft_consensus.cc:1275] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 14:52:38.079480  7819 leader_election.cc:304] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:37.898878 12303 consensus_queue.cc:260] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
W20260709 14:52:38.141916  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 62529.5us
I20260709 14:52:38.127058 12188 leader_election.cc:290] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:38.143028  7925 raft_consensus.cc:1240] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 13. Current term is 14. Ops: []
I20260709 14:52:38.103677 12117 raft_consensus.cc:3060] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:52:37.993822 12170 raft_consensus.cc:515] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:38.152890  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 47556.5us
I20260709 14:52:38.153766  7745 leader_election.cc:304] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:38.155018 12036 consensus_queue.cc:237] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:38.162173  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:38.163159  7927 raft_consensus.cc:3060] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Advancing to term 11
W20260709 14:52:38.164162  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:38.154086  7771 raft_consensus.cc:2468] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 12.
I20260709 14:52:38.143090  7819 leader_election.cc:304] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 9418391fa82a42c79c6cad13ba91d964
I20260709 14:52:38.149592 12111 raft_consensus.cc:2804] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 14:52:38.150483  7920 raft_consensus.cc:1240] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 11. Current term is 12. Ops: [9.6-11.7]
W20260709 14:52:38.158046 12365 consensus_meta.cc:287] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent flushing consensus metadata: real 0.606s	user 0.014s	sys 0.000s
I20260709 14:52:38.175918 12175 raft_consensus.cc:2749] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 14:52:38.181078  6549 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 14:52:38.182006  7779 raft_consensus.cc:2468] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 12.
I20260709 14:52:38.175300  7819 leader_election.cc:304] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:38.151186 12279 leader_election.cc:290] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:38.144372 12054 raft_consensus.cc:2749] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 14:52:38.186648  7776 raft_consensus.cc:2410] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 14:52:38.186453  7745 leader_election.cc:304] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:38.165577 12303 raft_consensus.cc:3060] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 5 FOLLOWER]: Advancing to term 6
I20260709 14:52:38.180217  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:38.165191 12058 raft_consensus.cc:2749] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 14:52:38.172397 12258 raft_consensus.cc:493] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:52:38.152159 12278 raft_consensus.cc:515] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:38.179903 12111 raft_consensus.cc:493] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:38.193454 12365 raft_consensus.cc:2804] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 14:52:38.202538  7745 leader_election.cc:304] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:38.189059 12272 raft_consensus.cc:2804] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 14:52:38.193709 12199 raft_consensus.cc:2804] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 14:52:38.209730  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:38.217836  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:38.275310  7925 raft_consensus.cc:3060] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 14:52:38.222827  7770 raft_consensus.cc:2468] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 14.
I20260709 14:52:38.224274  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:38.276937  7922 raft_consensus.cc:3060] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:52:38.232973  7927 raft_consensus.cc:2468] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 11.
W20260709 14:52:38.296592  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:52:38.304452 12369 log.cc:927] Time spent T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.253s	user 0.004s	sys 0.000s
I20260709 14:52:38.207398 12268 consensus_queue.cc:1059] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.078s
I20260709 14:52:38.306176 12268 raft_consensus.cc:3055] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 LEADER]: Stepping down as leader of term 12
I20260709 14:52:38.306685 12268 raft_consensus.cc:740] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:52:38.307734 12268 consensus_queue.cc:260] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:38.245822 12272 raft_consensus.cc:493] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:38.318444 12272 raft_consensus.cc:3060] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Advancing to term 13
W20260709 14:52:38.319159  7743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:38.325982 12243 leader_election.cc:290] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:38.249040 12111 raft_consensus.cc:3060] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Advancing to term 14
I20260709 14:52:38.245451 12365 raft_consensus.cc:493] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:38.309163 12268 raft_consensus.cc:3060] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Advancing to term 13
I20260709 14:52:38.272805 12058 raft_consensus.cc:2749] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 14:52:38.274904 12199 raft_consensus.cc:493] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:38.243897 12258 raft_consensus.cc:515] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:38.356498  8598 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.074s	sys 0.090s
W20260709 14:52:38.357024  8598 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.543s	user 0.074s	sys 0.090s
W20260709 14:52:38.342734  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 56292.6us
W20260709 14:52:38.357889  8598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 708395us
W20260709 14:52:38.356664  7743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:38.349730  7925 raft_consensus.cc:2468] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 13.
W20260709 14:52:38.296804 12366 log.cc:927] Time spent T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
W20260709 14:52:38.362583 12129 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.604s	user 0.042s	sys 0.046s
I20260709 14:52:38.358039  7894 leader_election.cc:304] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:38.219030 11949 consensus_queue.cc:237] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:38.345099 12365 raft_consensus.cc:3060] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Advancing to term 16
I20260709 14:52:38.353298 12199 raft_consensus.cc:3060] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Advancing to term 13
W20260709 14:52:38.386638  7744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:38.370038 12226 raft_consensus.cc:2804] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 14:52:38.363942 12319 consensus_queue.cc:1059] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.023s
W20260709 14:52:38.397737  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:52:38.366319 12129 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.616s	user 0.042s	sys 0.047s
W20260709 14:52:38.413905 12371 log.cc:927] Time spent T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 14:52:38.401118 12226 raft_consensus.cc:697] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:38.447461  7853 raft_consensus.cc:1275] T 9441e831627143a991a1556dcdce71e3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Refusing update from remote peer 9418391fa82a42c79c6cad13ba91d964: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 14:52:38.435465  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 461338us
I20260709 14:52:38.440543 12278 leader_election.cc:290] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:38.473567  7922 raft_consensus.cc:2468] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 12.
I20260709 14:52:38.444291 12170 leader_election.cc:290] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:52:38.450304 12244 consensus_meta.cc:287] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent flushing consensus metadata: real 0.562s	user 0.007s	sys 0.007s
I20260709 14:52:38.501178  7893 leader_election.cc:304] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:38.514561  7893 leader_election.cc:304] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:38.515707 12278 consensus_queue.cc:1048] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 14:52:38.517143 12258 leader_election.cc:290] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:38.527311  7893 leader_election.cc:304] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:38.530910 12278 raft_consensus.cc:2804] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 14:52:38.502573 12372 consensus_queue.cc:1048] T 9441e831627143a991a1556dcdce71e3 P 9418391fa82a42c79c6cad13ba91d964 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 14:52:38.533834 12258 raft_consensus.cc:493] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:38.538489  7893 leader_election.cc:304] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:38.487876 12244 raft_consensus.cc:515] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:38.548002 11963 raft_consensus.cc:2749] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 14:52:38.536993 12278 raft_consensus.cc:493] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:38.576799 12111 raft_consensus.cc:515] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:38.606041 12111 leader_election.cc:290] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 14 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:38.610534 11963 raft_consensus.cc:2749] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 14:52:38.611585 11963 raft_consensus.cc:2749] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 14:52:38.576100 12156 consensus_meta.cc:287] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent flushing consensus metadata: real 0.517s	user 0.013s	sys 0.000s
I20260709 14:52:38.613881 12156 raft_consensus.cc:515] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:38.614845 12117 raft_consensus.cc:2749] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 14:52:38.537185 12226 consensus_queue.cc:237] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:38.616817 12156 leader_election.cc:290] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 13 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:38.547511 12258 raft_consensus.cc:515] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:38.581625 12278 raft_consensus.cc:3060] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:52:38.665007 12365 raft_consensus.cc:515] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:38.668111 12365 leader_election.cc:290] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 16 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:52:38.713068  7743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:52:38.722151  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 349967us
I20260709 14:52:38.723001  7770 raft_consensus.cc:1275] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Refusing update from remote peer 9418391fa82a42c79c6cad13ba91d964: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 14:52:38.724625  7924 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.628s	user 0.010s	sys 0.010s
W20260709 14:52:38.725500  8598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 352073us
W20260709 14:52:38.726004  7924 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.629s	user 0.011s	sys 0.010s
W20260709 14:52:38.713689  7675 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.732s	user 0.022s	sys 0.018s
W20260709 14:52:38.742686  7675 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.762s	user 0.022s	sys 0.018s
I20260709 14:52:38.725170  7772 raft_consensus.cc:3060] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Advancing to term 13
I20260709 14:52:38.744607 12036 consensus_queue.cc:1048] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 14:52:38.749828 12036 consensus_queue.cc:1243] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer 3876b8ee8d744cb18e91d97aae93b1ac log is divergent from this leader: its last log entry 11.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 14:52:38.771432 12244 leader_election.cc:290] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 12 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:38.807395 12258 leader_election.cc:290] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:52:38.840129  7744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:38.846496 12384 consensus_queue.cc:1048] T 9441e831627143a991a1556dcdce71e3 P 9418391fa82a42c79c6cad13ba91d964 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 14:52:38.645706 12272 raft_consensus.cc:515] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:38.859592 12388 raft_consensus.cc:3055] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 LEADER]: Stepping down as leader of term 12
I20260709 14:52:38.860267 12388 raft_consensus.cc:740] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
W20260709 14:52:38.866030  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 499489us
I20260709 14:52:38.869956 12388 consensus_queue.cc:260] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:38.905808 12272 leader_election.cc:290] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:38.906648 12388 raft_consensus.cc:3060] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Advancing to term 13
W20260709 14:52:38.910907  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 60616.7us
I20260709 14:52:38.913867 12129 consensus_queue.cc:1048] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 14:52:38.915678  7745 leader_election.cc:336] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 1.604s (SENT)
I20260709 14:52:38.916541  7745 leader_election.cc:304] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:38.933660 12375 consensus_queue.cc:1048] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 14:52:38.935253 12375 consensus_queue.cc:1243] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer 3876b8ee8d744cb18e91d97aae93b1ac log is divergent from this leader: its last log entry 8.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 14:52:38.936473 12244 raft_consensus.cc:493] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:38.937474 12244 raft_consensus.cc:515] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:38.937928  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 69266us
I20260709 14:52:38.940765 12244 leader_election.cc:290] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:38.941502 12258 raft_consensus.cc:493] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:38.942637 12258 raft_consensus.cc:515] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:38.953442  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:38.955147 12258 leader_election.cc:290] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:52:38.956609  7743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:52:38.962541  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 420602us
I20260709 14:52:38.965373 12390 raft_consensus.cc:493] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:38.966580 12390 raft_consensus.cc:515] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:38.947248 12272 raft_consensus.cc:2749] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 14:52:38.969897  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:52:38.970724  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:38.946341 12389 consensus_queue.cc:1059] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 14:52:38.975860 12400 raft_consensus.cc:3055] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 LEADER]: Stepping down as leader of term 10
I20260709 14:52:38.976718 12400 raft_consensus.cc:740] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:52:38.979979 12400 consensus_queue.cc:260] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:38.982280 12400 raft_consensus.cc:3060] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Advancing to term 11
W20260709 14:52:38.986303 12403 log.cc:927] Time spent T 9441e831627143a991a1556dcdce71e3 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.058s	user 0.002s	sys 0.000s
I20260709 14:52:38.923911  7894 leader_election.cc:304] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:38.988132 11963 raft_consensus.cc:2804] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 14:52:38.988696 11963 raft_consensus.cc:493] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:38.989507 11963 raft_consensus.cc:3060] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:52:38.990209  7893 leader_election.cc:304] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:38.986804 12390 leader_election.cc:290] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:52:38.993541  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 74006us
I20260709 14:52:38.994210 12397 raft_consensus.cc:2749] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 14:52:38.995023  7894 leader_election.cc:304] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:38.996856 12397 raft_consensus.cc:2804] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 14:52:38.997874 12397 raft_consensus.cc:697] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:39.004848 12375 consensus_queue.cc:1048] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 14:52:39.015198  7893 leader_election.cc:304] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:39.022084 12375 raft_consensus.cc:2749] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 14:52:39.029874  7819 leader_election.cc:304] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:39.031596 12390 raft_consensus.cc:2804] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 14:52:39.032274 12390 raft_consensus.cc:493] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:39.031898  7894 leader_election.cc:304] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:39.032974 12390 raft_consensus.cc:3060] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Advancing to term 15
I20260709 14:52:39.034716 12226 raft_consensus.cc:2804] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 14:52:39.001096 12397 consensus_queue.cc:237] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:39.039762 12226 raft_consensus.cc:697] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:39.047277 12258 raft_consensus.cc:493] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:39.056381 12258 raft_consensus.cc:515] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:39.055389  7926 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38516 (request call id 2565) took 1240 ms. Trace:
I20260709 14:52:39.044652 12375 consensus_queue.cc:1048] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 14:52:39.042531  7894 leader_election.cc:304] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:39.064239  7772 raft_consensus.cc:2468] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 13.
I20260709 14:52:39.058279  7926 rpcz_store.cc:276] 0709 14:52:37.815237 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:37.815484 (+   247us) service_pool.cc:224] Handling call
0709 14:52:37.992956 (+177472us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:52:38.439627 (+446671us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:52:38.439658 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:52:38.440168 (+   510us) log.cc:844] Serialized 26 byte log entry
0709 14:52:38.846792 (+406624us) raft_consensus.cc:1645] Marking committed up to 8
0709 14:52:38.847774 (+   982us) log.cc:844] Serialized 14 byte log entry
0709 14:52:38.922125 (+ 74351us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:38.922355 (+   230us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:52:38.972984 (+ 50629us) spinlock_profiling.cc:243] Waited 17.7 ms on lock 0x7b18004021c0. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb690c69de1 00007fb690c765b1 00007fb687da13f3 00007fb687da37c1 00007fb687da3779 00007fb687da3709 00007fb687da36d1 00007fb687da29cd 0000000000396ad4 0000000000396919 00007fb687d8483a
0709 14:52:39.047007 (+ 74023us) raft_consensus.cc:1685] finished
0709 14:52:39.047240 (+   233us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:39.055098 (+  7858us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":53169,"prepare.queue_time_us":4954,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":66,"raft.queue_time_us":119704,"raft.run_cpu_time_us":367,"raft.run_wall_time_us":359,"spinlock_wait_cycles":40763136,"thread_start_us":787128,"threads_started":2,"wal-append.queue_time_us":424798}
W20260709 14:52:39.082748 11949 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.019s	sys 0.034s
W20260709 14:52:39.083438 12199 consensus_meta.cc:287] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent flushing consensus metadata: real 0.701s	user 0.009s	sys 0.019s
W20260709 14:52:39.083806 11949 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.549s	user 0.019s	sys 0.034s
W20260709 14:52:39.087268  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 45008.1us
I20260709 14:52:39.056422 12226 consensus_queue.cc:237] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:39.059521 12390 raft_consensus.cc:515] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:39.098953 12390 leader_election.cc:290] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:39.100679 12244 raft_consensus.cc:493] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:39.101737 12244 raft_consensus.cc:515] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:39.108660 12377 raft_consensus.cc:2804] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 14:52:39.109898 12377 raft_consensus.cc:697] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:39.110278 12400 raft_consensus.cc:493] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:52:39.110670  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:39.111135 12400 raft_consensus.cc:515] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:39.111816  7893 leader_election.cc:304] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:39.111518 12377 consensus_queue.cc:237] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:39.114183  7772 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37144 (request call id 3245) took 1249 ms. Trace:
I20260709 14:52:39.114892  7772 rpcz_store.cc:276] 0709 14:52:37.856061 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:37.856207 (+   146us) service_pool.cc:224] Handling call
0709 14:52:39.085998 (+1229791us) spinlock_profiling.cc:243] Waited 801 ms on lock 0x7b5400325354. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae922fa 00007fb68fe53b17 00007fb6893ce6d4 00007fb6893ce662 00007fb6893ce591 00007fb6893ce50c 00007fb6893cd7c2 00007fb6891c948c 00007fb6891c88c6 00007fb6891c826f
0709 14:52:39.105494 (+ 19496us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1841187712}
I20260709 14:52:39.118705 12375 raft_consensus.cc:2804] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 14:52:39.119355 12375 raft_consensus.cc:493] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:39.122706 12375 raft_consensus.cc:3060] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Advancing to term 15
W20260709 14:52:39.129297  7743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:39.135066 12278 raft_consensus.cc:515] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:39.140805 12258 leader_election.cc:290] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:52:39.142481  7744 leader_election.cc:336] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785): Timed out: RequestConsensusVote RPC to 127.6.101.67:40785 timed out after 1.524s (SENT)
I20260709 14:52:39.143265  7744 leader_election.cc:304] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:39.168844 12399 consensus_queue.cc:1048] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.002s
W20260709 14:52:39.171756  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 54423.9us
I20260709 14:52:39.144554 12400 leader_election.cc:290] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:39.147065 12375 raft_consensus.cc:515] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:39.164865 12219 raft_consensus.cc:493] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9418391fa82a42c79c6cad13ba91d964)
I20260709 14:52:39.175117 12219 raft_consensus.cc:515] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:52:39.093434 12199 raft_consensus.cc:515] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:39.166122  7894 leader_election.cc:304] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:39.167611 12388 raft_consensus.cc:493] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:39.175597 12375 leader_election.cc:290] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 15 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:39.178153 11949 raft_consensus.cc:2804] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 14:52:39.177989 12199 leader_election.cc:290] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:39.179034 11949 raft_consensus.cc:697] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:39.168749  7819 leader_election.cc:304] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:39.181849 11949 consensus_queue.cc:237] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:39.184811 12389 consensus_queue.cc:1048] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 14:52:39.186149 12258 raft_consensus.cc:2749] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 14:52:39.138592 12390 raft_consensus.cc:493] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:52:39.182572 12199 raft_consensus.cc:2804] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 14:52:39.188283 12390 raft_consensus.cc:515] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:39.188988 12199 raft_consensus.cc:493] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 14:52:39.177950  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 72048.6us
I20260709 14:52:39.190304 12399 consensus_queue.cc:1048] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.007s
I20260709 14:52:39.192106 12199 raft_consensus.cc:3060] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:52:39.193037 12383 consensus_queue.cc:1048] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 14:52:39.179025 12388 raft_consensus.cc:515] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:39.193730  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 55246.3us
I20260709 14:52:39.164383 11963 raft_consensus.cc:515] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:39.191049 12390 leader_election.cc:290] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:39.208479 12400 consensus_queue.cc:1048] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 14:52:39.215349 12244 leader_election.cc:290] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:52:39.232239  7744 leader_election.cc:336] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785): Timed out: RequestConsensusVote RPC to 127.6.101.67:40785 timed out after 1.551s (SENT)
I20260709 14:52:39.236212  7744 leader_election.cc:304] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:39.241868  7819 leader_election.cc:304] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
W20260709 14:52:39.251869  7745 leader_election.cc:336] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 1.853s (SENT)
I20260709 14:52:39.254274 12258 raft_consensus.cc:2749] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 14:52:39.254580 11963 leader_election.cc:290] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 9 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:39.255434 12258 raft_consensus.cc:493] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:39.257149 12258 raft_consensus.cc:515] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:39.252844  7745 leader_election.cc:304] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:39.260329 12258 leader_election.cc:290] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:39.257181 12388 leader_election.cc:290] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:52:39.254454  7744 leader_election.cc:336] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785): Timed out: RequestConsensusVote RPC to 127.6.101.67:40785 timed out after 1.676s (SENT)
I20260709 14:52:39.271385 12278 leader_election.cc:290] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:39.273209 12258 raft_consensus.cc:2749] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 14:52:39.277091  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 45886us
I20260709 14:52:39.278708  7893 leader_election.cc:304] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:39.279698  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:39.280710  7849 raft_consensus.cc:2468] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 12.
I20260709 14:52:39.277091  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783e4874513449ef9084b833f188a6d3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:39.289397 12400 raft_consensus.cc:2804] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 14:52:39.290068 12400 raft_consensus.cc:493] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:39.290477 12400 raft_consensus.cc:3060] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Advancing to term 13
I20260709 14:52:39.288221 12390 consensus_queue.cc:1048] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.006s
I20260709 14:52:39.296047 12375 raft_consensus.cc:2804] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 14:52:39.296620 12375 raft_consensus.cc:493] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:39.297142 12375 raft_consensus.cc:3060] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 14:52:39.302433  7850 raft_consensus.cc:2468] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 10.
I20260709 14:52:39.304854  8639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1f7722fdea49e0b5e9c5d96633eaf9" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9418391fa82a42c79c6cad13ba91d964" is_pre_election: true
I20260709 14:52:39.222003 12397 consensus_queue.cc:1048] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 14:52:39.292510 12219 leader_election.cc:290] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68:42321)
I20260709 14:52:39.305526 12199 raft_consensus.cc:515] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:39.289575  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:39.318082  7846 raft_consensus.cc:2410] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 14:52:39.319379  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:39.320465  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:39.311025 12278 consensus_queue.cc:1048] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 14:52:39.325819 12188 consensus_queue.cc:1048] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 14:52:39.329885  7847 raft_consensus.cc:3055] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 LEADER]: Stepping down as leader of term 11
I20260709 14:52:39.330578  7847 raft_consensus.cc:740] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:52:39.332757  7850 raft_consensus.cc:1240] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 13. Current term is 14. Ops: []
I20260709 14:52:39.331593  7847 consensus_queue.cc:260] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:39.340641  7847 raft_consensus.cc:3060] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:52:39.345726  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:39.346460  7846 pending_rounds.cc:85] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting all ops after (but not including) 4
I20260709 14:52:39.346863  7846 pending_rounds.cc:107] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting uncommitted NO_OP operation due to leader change: 11.5
I20260709 14:52:39.347447  7846 raft_consensus.cc:2889] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:52:39.349088  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:39.350036  7854 raft_consensus.cc:3060] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:52:39.351198  7819 leader_election.cc:304] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:39.352533 12399 raft_consensus.cc:2749] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 14:52:39.350111  7853 raft_consensus.cc:1275] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 14:52:39.358855  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:39.359159  7893 leader_election.cc:304] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:39.360638  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1f7722fdea49e0b5e9c5d96633eaf9" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:39.362264 12377 raft_consensus.cc:2749] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 14:52:39.366430 12199 leader_election.cc:290] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 10 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:39.354529  7853 pending_rounds.cc:85] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting all ops after (but not including) 6
I20260709 14:52:39.377768  7853 pending_rounds.cc:107] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 14:52:39.378211  7853 raft_consensus.cc:2889] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:52:39.352758  7819 leader_election.cc:304] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
W20260709 14:52:39.385874  7745 leader_election.cc:336] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 1.564s (SENT)
I20260709 14:52:39.386497  7745 leader_election.cc:304] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:39.388134 12258 raft_consensus.cc:3060] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Advancing to term 13
I20260709 14:52:39.393484  7854 raft_consensus.cc:2468] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 9.
I20260709 14:52:39.395453 12375 raft_consensus.cc:515] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:39.396355 12397 raft_consensus.cc:493] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:39.400436  7893 leader_election.cc:304] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:39.377816  7894 leader_election.cc:304] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
W20260709 14:52:39.410275  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 85084us
I20260709 14:52:39.397722 12397 raft_consensus.cc:515] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:39.411969  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 59330.9us
I20260709 14:52:39.423058  7894 leader_election.cc:304] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:39.427503  7893 leader_election.cc:304] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:39.404836 12278 raft_consensus.cc:2749] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 14:52:39.412240 12199 raft_consensus.cc:2749] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 14:52:39.424743 12219 raft_consensus.cc:2804] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 14:52:39.438450 12244 raft_consensus.cc:493] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:39.439157 12377 raft_consensus.cc:2804] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 14:52:39.439656 12377 raft_consensus.cc:493] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:52:39.439530 12244 raft_consensus.cc:515] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:52:39.440141 12377 raft_consensus.cc:3060] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Advancing to term 11
W20260709 14:52:39.442381  7744 leader_election.cc:336] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785): Timed out: RequestConsensusVote RPC to 127.6.101.67:40785 timed out after 1.880s (SENT)
I20260709 14:52:39.442940  7744 leader_election.cc:304] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:39.444698 12258 raft_consensus.cc:2749] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 14:52:39.444962  8639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18d29d52d304c87b930d4fb5eaf50b1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9418391fa82a42c79c6cad13ba91d964" is_pre_election: true
I20260709 14:52:39.438558 12219 raft_consensus.cc:493] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:52:39.445863  8639 raft_consensus.cc:2468] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 10.
I20260709 14:52:39.445885 12219 raft_consensus.cc:3060] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 14:52:39.447693 12272 raft_consensus.cc:2749] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 14:52:39.449666 12411 log.cc:927] Time spent T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.139s	user 0.002s	sys 0.000s
I20260709 14:52:39.451342 12400 raft_consensus.cc:515] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:39.450111  7742 leader_election.cc:304] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 9418391fa82a42c79c6cad13ba91d964; no voters: 
I20260709 14:52:39.455912  7851 raft_consensus.cc:1240] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 12. Current term is 13. Ops: [10.6-12.7]
I20260709 14:52:39.455955 12272 raft_consensus.cc:2804] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 14:52:39.458082 12272 raft_consensus.cc:493] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 14:52:39.458250  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:39.458526 12272 raft_consensus.cc:3060] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:52:39.448938 12397 leader_election.cc:290] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:39.452390 12244 leader_election.cc:290] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68:42321)
W20260709 14:52:39.453742  7744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:39.476879  7819 leader_election.cc:304] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:52:39.439719  6549 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 14:52:39.481271 11949 raft_consensus.cc:2804] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 14:52:39.483893 11949 raft_consensus.cc:493] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:39.484301 11949 raft_consensus.cc:3060] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Advancing to term 15
W20260709 14:52:39.484997  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 57666.4us
I20260709 14:52:39.488457 12390 raft_consensus.cc:2764] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 14:52:39.496765 12278 consensus_queue.cc:1059] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 14:52:39.497936 12278 raft_consensus.cc:3055] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 14:52:39.498358 12278 raft_consensus.cc:740] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:39.499758 12278 consensus_queue.cc:260] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:39.496133  7894 leader_election.cc:304] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac, 9418391fa82a42c79c6cad13ba91d964
I20260709 14:52:39.505712  7893 leader_election.cc:304] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:39.491529 11963 raft_consensus.cc:493] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:52:39.510447 11963 raft_consensus.cc:515] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:39.511195 12226 raft_consensus.cc:2749] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 14:52:39.512923 11963 leader_election.cc:290] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:39.508692 12278 raft_consensus.cc:3060] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 14:52:39.508957  7894 leader_election.cc:304] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:39.522197 12226 raft_consensus.cc:2804] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 14:52:39.522828 12226 raft_consensus.cc:493] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:39.523306 12226 raft_consensus.cc:3060] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 14:52:39.522959  7744 leader_election.cc:304] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:39.526085 12244 raft_consensus.cc:2749] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 14:52:39.527025 12244 raft_consensus.cc:493] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:39.527632 12244 raft_consensus.cc:515] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:39.493705 12375 leader_election.cc:290] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 15 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:39.529152 12397 raft_consensus.cc:2804] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 14:52:39.522190  7819 leader_election.cc:304] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:39.530449  7744 leader_election.cc:304] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:39.531446  7675 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51352 (request call id 131) took 1628 ms. Trace:
I20260709 14:52:39.538626 11963 consensus_queue.cc:1048] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 14:52:39.544273 12390 raft_consensus.cc:2749] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 14:52:39.538335  7675 rpcz_store.cc:276] 0709 14:52:37.902652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:37.913852 (+ 11200us) service_pool.cc:224] Handling call
0709 14:52:39.531283 (+1617431us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 14:52:38.666732 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 14:52:38.667446 (+   714us) write_op.cc:432] Acquiring schema lock in shared mode
0709 14:52:38.667488 (+    42us) write_op.cc:435] Acquired schema lock
0709 14:52:38.667508 (+    20us) tablet.cc:662] Decoding operations
0709 14:52:38.667941 (+   433us) write_op.cc:620] Acquiring the partition lock for write op
0709 14:52:38.668050 (+   109us) write_op.cc:641] Partition lock acquired for write op
0709 14:52:38.668080 (+    30us) tablet.cc:685] Acquiring locks for 1 operations
0709 14:52:38.668312 (+   232us) tablet.cc:701] Row locks acquired
0709 14:52:38.668332 (+    20us) write_op.cc:260] PREPARE: finished
0709 14:52:38.668543 (+   211us) write_op.cc:270] Start()
0709 14:52:38.668720 (+   177us) write_op.cc:276] Timestamp: P: 1783608758668465 usec, L: 0
0709 14:52:38.668744 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 14:52:38.871440 (+202696us) log.cc:844] Serialized 533 byte log entry
0709 14:52:39.126740 (+255300us) op_driver.cc:464] REPLICATION: finished
0709 14:52:39.400430 (+273690us) write_op.cc:301] APPLY: starting
0709 14:52:39.405145 (+  4715us) tablet.cc:1367] starting BulkCheckPresence
0709 14:52:39.420401 (+ 15256us) tablet.cc:1370] finished BulkCheckPresence
0709 14:52:39.420614 (+   213us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 14:52:39.424554 (+  3940us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 14:52:39.427326 (+  2772us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 14:52:39.427393 (+    67us) write_op.cc:312] APPLY: finished
0709 14:52:39.427680 (+   287us) log.cc:844] Serialized 25 byte log entry
0709 14:52:39.433613 (+  5933us) write_op.cc:489] Releasing partition, row and schema locks
0709 14:52:39.434140 (+   527us) write_op.cc:454] Released schema lock
0709 14:52:39.435818 (+  1678us) write_op.cc:341] FINISH: Updating metrics
0709 14:52:39.478434 (+ 42616us) write_op.cc:489] Releasing partition, row and schema locks
0709 14:52:39.481657 (+  3223us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":80307,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":207021,"apply.run_cpu_time_us":5751,"apply.run_wall_time_us":100633,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8295,"num_ops":1,"prepare.queue_time_us":685697,"prepare.run_cpu_time_us":14975,"prepare.run_wall_time_us":394673,"raft.queue_time_us":71670,"raft.run_cpu_time_us":31779,"raft.run_wall_time_us":137613,"replication_time_us":457729,"spinlock_wait_cycles":35072,"thread_start_us":1080557,"threads_started":4,"wal-append.queue_time_us":189638}]]}
I20260709 14:52:39.554991 11949 raft_consensus.cc:515] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:39.557574 11949 leader_election.cc:290] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 15 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:39.558615 12258 raft_consensus.cc:2749] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 14:52:39.559348  7744 leader_election.cc:304] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:39.560372 12258 raft_consensus.cc:2749] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 14:52:39.538542 12219 raft_consensus.cc:515] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:39.562750 12226 raft_consensus.cc:515] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:39.563496 12219 leader_election.cc:290] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 13 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:39.564900  7819 leader_election.cc:304] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:52:39.565919 12390 raft_consensus.cc:2804] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 14:52:39.566350 12390 raft_consensus.cc:493] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:39.566569  7847 raft_consensus.cc:1240] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 14. Current term is 15. Ops: []
I20260709 14:52:39.567123 12219 consensus_queue.cc:1059] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 14:52:39.532156 12244 leader_election.cc:290] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:39.567946 12219 consensus_queue.cc:1243] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer 3876b8ee8d744cb18e91d97aae93b1ac log is divergent from this leader: its last log entry 8.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 14:52:39.568420 11963 raft_consensus.cc:3055] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 14:52:39.566668 12390 raft_consensus.cc:3060] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Advancing to term 16
I20260709 14:52:39.569005 11963 raft_consensus.cc:740] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:39.570430 11963 consensus_queue.cc:260] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:39.571985 11963 raft_consensus.cc:3060] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 14:52:39.573459  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:39.574599  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
W20260709 14:52:39.576156  7745 leader_election.cc:336] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 2.182s (SENT)
I20260709 14:52:39.603523  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
W20260709 14:52:39.581166  7743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:39.581899  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:39.587548  7851 pending_rounds.cc:85] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting all ops after (but not including) 7
I20260709 14:52:39.607520  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:39.610991  7852 raft_consensus.cc:3060] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Advancing to term 13
I20260709 14:52:39.612390  7851 pending_rounds.cc:107] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 14:52:39.612938  7851 raft_consensus.cc:2889] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:52:39.541148 12397 raft_consensus.cc:697] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:39.596529 11963 raft_consensus.cc:493] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:52:39.610783  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:39.567606  7819 leader_election.cc:304] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:39.598363  7744 leader_election.cc:304] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:39.602768 12400 leader_election.cc:290] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:39.575668 12272 raft_consensus.cc:515] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
W20260709 14:52:39.622344  7743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:39.616098 11963 raft_consensus.cc:515] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:39.616209 12390 raft_consensus.cc:515] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:39.645752 12156 raft_consensus.cc:493] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:52:39.646113 12219 raft_consensus.cc:493] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:39.649415 12272 leader_election.cc:290] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68:42321)
I20260709 14:52:39.651111  8639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18d29d52d304c87b930d4fb5eaf50b1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9418391fa82a42c79c6cad13ba91d964"
I20260709 14:52:39.670532  8639 raft_consensus.cc:3060] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:52:39.670816 12390 leader_election.cc:290] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 16 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:39.665870 12199 raft_consensus.cc:2749] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 14:52:39.672302 11949 raft_consensus.cc:493] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:39.673511 12258 raft_consensus.cc:493] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:39.674367 12258 raft_consensus.cc:515] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:39.669332 12156 raft_consensus.cc:515] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:39.677654  7849 raft_consensus.cc:2393] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 16: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:52:39.677878 12258 leader_election.cc:290] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:39.678068 12156 leader_election.cc:290] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:39.667382  7852 raft_consensus.cc:2468] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 13.
I20260709 14:52:39.620617 12226 leader_election.cc:290] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 15 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:39.673030 11949 raft_consensus.cc:515] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:39.673574 12219 raft_consensus.cc:515] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:39.603515 12377 raft_consensus.cc:515] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:39.690601  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 123071us
I20260709 14:52:39.681056 12244 raft_consensus.cc:2749] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 14:52:39.696501  7894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:52:39.697824  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 99642.4us
I20260709 14:52:39.699100  7744 leader_election.cc:304] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:39.699729 12219 leader_election.cc:290] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:39.700775 12272 raft_consensus.cc:2764] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 14:52:39.701166  7744 leader_election.cc:304] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:39.702483 12258 raft_consensus.cc:2749] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 14:52:39.704829  7744 leader_election.cc:304] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:52:39.705071 12272 raft_consensus.cc:493] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:39.706162 12258 raft_consensus.cc:2804] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 14:52:39.706014 12272 raft_consensus.cc:515] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:39.701654 11949 leader_election.cc:290] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:39.707960 12199 consensus_queue.cc:1048] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 14:52:39.706737 12258 raft_consensus.cc:493] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:39.717914 12258 raft_consensus.cc:3060] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Advancing to term 15
I20260709 14:52:39.719102 12272 leader_election.cc:290] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:52:39.706656  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:39.721710 12226 raft_consensus.cc:493] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:52:39.724164 12226 raft_consensus.cc:515] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:39.708108  7819 leader_election.cc:304] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:52:39.727125 12199 raft_consensus.cc:2804] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 14:52:39.727720 12199 raft_consensus.cc:493] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:39.728200 12199 raft_consensus.cc:3060] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Advancing to term 15
I20260709 14:52:39.728363  7819 leader_election.cc:304] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:39.728597 12390 consensus_queue.cc:1059] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 14:52:39.721783  8639 raft_consensus.cc:2468] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 11.
I20260709 14:52:39.683665 12397 consensus_queue.cc:237] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:39.739845 12188 raft_consensus.cc:3055] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 LEADER]: Stepping down as leader of term 12
I20260709 14:52:39.740576 12188 raft_consensus.cc:740] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:52:39.742990  7742 leader_election.cc:304] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 9418391fa82a42c79c6cad13ba91d964; no voters: 
I20260709 14:52:39.729483 12400 raft_consensus.cc:2749] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 14:52:39.744184 12272 raft_consensus.cc:2804] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader election won for term 11
I20260709 14:52:39.745759 12272 raft_consensus.cc:697] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:52:39.746887 12272 consensus_queue.cc:237] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:52:39.749662 12377 leader_election.cc:290] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 11 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:39.756628 12226 leader_election.cc:290] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:39.754036 12188 consensus_queue.cc:260] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:39.744601 12400 raft_consensus.cc:493] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:52:39.758325 12188 raft_consensus.cc:3060] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Advancing to term 13
I20260709 14:52:39.755942  7674 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54344 (request call id 374) took 9028 ms. Trace:
I20260709 14:52:39.758157 12400 raft_consensus.cc:515] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:52:39.732245 11963 leader_election.cc:290] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:39.779534  7819 leader_election.cc:304] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:39.783874  7676 catalog_manager.cc:5697] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:52:39.786391  7676 catalog_manager.cc:5697] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:52:39.788511  7676 catalog_manager.cc:5697] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 11 to 12, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 12 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:52:39.790910  7676 catalog_manager.cc:5697] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 12 to 13, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 13 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:52:39.778558 12244 consensus_queue.cc:1048] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 14:52:39.796263 12390 raft_consensus.cc:2749] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 14:52:39.806843  7676 catalog_manager.cc:5697] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:52:39.805168 11963 raft_consensus.cc:493] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:52:39.809039 12427 consensus_queue.cc:1059] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 14:52:39.808816 11963 raft_consensus.cc:515] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:39.808677  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:39.816315  7921 raft_consensus.cc:2368] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 12. Current term is 13.
I20260709 14:52:39.815729  7676 catalog_manager.cc:5697] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:52:39.819027  7676 catalog_manager.cc:5697] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 13 to 14, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 14 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:52:39.763847  7674 rpcz_store.cc:276] 0709 14:52:30.727531 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:30.728741 (+  1210us) service_pool.cc:224] Handling call
0709 14:52:39.755711 (+9026970us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 14:52:39.061909 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 14:52:39.062954 (+  1045us) write_op.cc:432] Acquiring schema lock in shared mode
0709 14:52:39.063011 (+    57us) write_op.cc:435] Acquired schema lock
0709 14:52:39.063051 (+    40us) tablet.cc:662] Decoding operations
0709 14:52:39.064564 (+  1513us) write_op.cc:620] Acquiring the partition lock for write op
0709 14:52:39.064683 (+   119us) write_op.cc:641] Partition lock acquired for write op
0709 14:52:39.064734 (+    51us) tablet.cc:685] Acquiring locks for 9 operations
0709 14:52:39.119692 (+ 54958us) tablet.cc:701] Row locks acquired
0709 14:52:39.119761 (+    69us) write_op.cc:260] PREPARE: finished
0709 14:52:39.141827 (+ 22066us) write_op.cc:270] Start()
0709 14:52:39.142138 (+   311us) write_op.cc:276] Timestamp: P: 1783608759141738 usec, L: 0
0709 14:52:39.142163 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 14:52:39.258723 (+116560us) log.cc:844] Serialized 3619 byte log entry
0709 14:52:39.266166 (+  7443us) spinlock_profiling.cc:243] Waited 108 ms on lock 0x7b54003499d4. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae89e28 00007fb68e8c4581 00007fb68e8c3d58 00007fb68e8c89f1 00007fb68e8c89a9 00007fb68e8c8939 00007fb68e8c8901 00007fb68e8c7b2d 0000000000396ad4 0000000000396919
0709 14:52:39.275034 (+  8868us) op_driver.cc:464] REPLICATION: finished
0709 14:52:39.338621 (+ 63587us) write_op.cc:301] APPLY: starting
0709 14:52:39.338750 (+   129us) tablet.cc:1367] starting BulkCheckPresence
0709 14:52:39.348052 (+  9302us) tablet.cc:1370] finished BulkCheckPresence
0709 14:52:39.348099 (+    47us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 14:52:39.364493 (+ 16394us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 14:52:39.364883 (+   390us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=18,key_file_lookups=18,delta_file_lookups=18,mrs_lookups=0
0709 14:52:39.364963 (+    80us) write_op.cc:312] APPLY: finished
0709 14:52:39.365454 (+   491us) log.cc:844] Serialized 89 byte log entry
0709 14:52:39.369160 (+  3706us) write_op.cc:489] Releasing partition, row and schema locks
0709 14:52:39.369370 (+   210us) write_op.cc:454] Released schema lock
0709 14:52:39.369452 (+    82us) write_op.cc:341] FINISH: Updating metrics
0709 14:52:39.370204 (+   752us) write_op.cc:489] Releasing partition, row and schema locks
0709 14:52:39.370242 (+    38us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":515691,"reported_tablets":34,"child_traces":[["op",{"apply.queue_time_us":63105,"apply.run_cpu_time_us":17091,"apply.run_wall_time_us":31495,"cfile_cache_hit":38,"cfile_cache_hit_bytes":41639,"num_ops":9,"prepare.queue_time_us":905898,"prepare.run_cpu_time_us":11797,"prepare.run_wall_time_us":204575,"replication_time_us":132679,"spinlock_wait_cycles":249422080,"thread_start_us":12426,"threads_started":1}]]}
I20260709 14:52:39.820895  7926 raft_consensus.cc:1240] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 14:52:39.823441  7921 raft_consensus.cc:1275] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 14:52:39.825214  7894 leader_election.cc:304] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:39.822479 12383 raft_consensus.cc:3055] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 14:52:39.828059 12383 raft_consensus.cc:740] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:39.829421 12244 consensus_queue.cc:1059] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 14:52:39.829313 12383 consensus_queue.cc:260] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:39.831182 12272 raft_consensus.cc:3055] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 LEADER]: Stepping down as leader of term 13
I20260709 14:52:39.831429 12383 raft_consensus.cc:3060] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 14:52:39.831724 12272 raft_consensus.cc:740] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:52:39.833695  7676 catalog_manager.cc:5697] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:52:39.836189 12219 raft_consensus.cc:2804] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 14:52:39.837363 12219 raft_consensus.cc:697] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:39.838567 12219 consensus_queue.cc:237] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:39.843698 12244 consensus_queue.cc:1048] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 14:52:39.824584 12258 raft_consensus.cc:515] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:39.835819  7676 catalog_manager.cc:5697] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 11 to 12, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 12 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:52:39.877069  7676 catalog_manager.cc:5697] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 13 to 14, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 14 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:52:39.885121  7676 catalog_manager.cc:5697] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 12 to 15, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 15 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:52:39.887392  7676 catalog_manager.cc:5697] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 9 to 10, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 10 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:52:39.891665  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:39.891021  7676 catalog_manager.cc:5697] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 11 to 12, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 12 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:52:39.898309  7852 raft_consensus.cc:1240] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 12. Current term is 13. Ops: []
I20260709 14:52:39.902330  7676 catalog_manager.cc:5697] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 11 to 13, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 13 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:52:39.901887  7925 raft_consensus.cc:1240] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 12. Current term is 13. Ops: []
I20260709 14:52:39.903474  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:39.903600  7921 raft_consensus.cc:1240] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 LEADER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 12. Current term is 13. Ops: []
I20260709 14:52:39.905648  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:39.904415  7676 catalog_manager.cc:5697] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 10 to 11, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 11 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:52:39.906677  7924 raft_consensus.cc:2393] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 14: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:52:39.907501  7676 catalog_manager.cc:5697] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:52:39.905118 12272 consensus_queue.cc:260] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:39.915231  7676 catalog_manager.cc:5697] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 8 to 11, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 11 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:52:39.916280  7927 raft_consensus.cc:1240] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 11. Current term is 12. Ops: []
I20260709 14:52:39.917435  7676 catalog_manager.cc:5697] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 11 to 12, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 12 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:52:39.919018  7676 catalog_manager.cc:5697] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 9 to 10, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 10 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:52:39.920495 12258 leader_election.cc:290] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:39.927855 12258 raft_consensus.cc:493] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:39.928522 12258 raft_consensus.cc:515] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:39.929518 12391 raft_consensus.cc:493] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:39.930336  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:39.923472 12400 leader_election.cc:290] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68:42321)
I20260709 14:52:39.926823  7819 leader_election.cc:304] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:52:39.902259  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:39.932768  7676 catalog_manager.cc:5697] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:52:39.939875  7926 raft_consensus.cc:3060] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 14:52:39.940817  7676 catalog_manager.cc:5697] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 12 to 13, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 13 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:52:39.940255 12258 leader_election.cc:290] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:39.946841  7676 catalog_manager.cc:5697] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 11 to 14, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 14 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:52:39.948153 11963 leader_election.cc:290] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:39.949832  7676 catalog_manager.cc:5697] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
W20260709 14:52:39.953329  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:39.954108  7927 raft_consensus.cc:1240] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 LEADER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 14. Current term is 15. Ops: []
I20260709 14:52:39.949640  7923 raft_consensus.cc:1240] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 10. Current term is 11. Ops: []
I20260709 14:52:39.930387 12391 raft_consensus.cc:515] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:39.965760  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 121639us
I20260709 14:52:39.940840 12272 raft_consensus.cc:3060] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Advancing to term 14
I20260709 14:52:39.968375 12258 raft_consensus.cc:493] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:39.969331 12258 raft_consensus.cc:515] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:39.971663 12258 leader_election.cc:290] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:39.968459  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:39.928857 12199 raft_consensus.cc:515] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:39.973133  7852 raft_consensus.cc:2468] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 8.
I20260709 14:52:39.989176  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:39.946435 12400 raft_consensus.cc:2764] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 14:52:39.973847  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:39.983603  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:39.985288  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:39.987869  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
W20260709 14:52:39.990020  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 63351.9us
I20260709 14:52:39.976649  7926 raft_consensus.cc:2468] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 16.
I20260709 14:52:39.993417  7921 raft_consensus.cc:2393] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 13: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:52:39.993980  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:39.995764  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:40.001995  7923 raft_consensus.cc:2410] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 14:52:40.011170  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258d6c2dda954bf5b65930fde8ecb9f3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:40.012595  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:40.013509  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:40.014599  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783e4874513449ef9084b833f188a6d3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:40.017994  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:40.006693 12188 consensus_queue.cc:1059] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 14:52:40.022121 12199 leader_election.cc:290] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:40.022176  7771 raft_consensus.cc:1240] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 15. Current term is 16. Ops: []
I20260709 14:52:40.023120  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:40.024214  7773 raft_consensus.cc:2410] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
W20260709 14:52:40.025471  7745 leader_election.cc:336] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 2.482s (SENT)
W20260709 14:52:40.026866  7743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:40.026641  7779 raft_consensus.cc:3060] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:52:40.019984 12391 leader_election.cc:290] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:40.028719 12188 raft_consensus.cc:3055] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 LEADER]: Stepping down as leader of term 10
I20260709 14:52:40.029203 12188 raft_consensus.cc:740] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:52:40.029897  7819 leader_election.cc:304] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:40.031142  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:40.032015  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:40.033026 12400 consensus_queue.cc:1059] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 14:52:40.033757  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:40.033941 12390 consensus_queue.cc:1059] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 14:52:40.034562 12400 raft_consensus.cc:2749] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 14:52:40.035128 12390 consensus_queue.cc:1243] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer 1e9289592458429bbddb19c2e7b7b7b0 log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 14:52:40.036302 12400 raft_consensus.cc:3055] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 LEADER]: Stepping down as leader of term 13
I20260709 14:52:40.036530 12390 raft_consensus.cc:3055] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 LEADER]: Stepping down as leader of term 11
I20260709 14:52:40.036942 12400 raft_consensus.cc:740] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:52:40.037846  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:40.019836  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:40.032048  7926 raft_consensus.cc:2468] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 13.
I20260709 14:52:40.032696  7819 leader_election.cc:304] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:40.034598  7920 raft_consensus.cc:2468] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 9.
I20260709 14:52:40.047717  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:40.056193  7923 raft_consensus.cc:2468] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 13.
I20260709 14:52:40.069087  7778 raft_consensus.cc:3060] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Advancing to term 13
I20260709 14:52:40.046566  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:40.071012  7927 raft_consensus.cc:2468] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 14.
I20260709 14:52:40.073752  7852 raft_consensus.cc:1275] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 14:52:40.018887  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:40.037091 12390 raft_consensus.cc:740] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
W20260709 14:52:40.081091  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 48358.3us
W20260709 14:52:40.082223  7743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:40.084350  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:40.089627  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:40.090829  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:40.096886  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:40.098116  7923 raft_consensus.cc:2393] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 15: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
W20260709 14:52:40.099311  7743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:40.078387 12199 raft_consensus.cc:2749] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 14:52:40.111116  7819 leader_election.cc:304] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:52:40.112735  7928 raft_consensus.cc:2393] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 15: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:52:40.119971  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c563cc7cfbe4d59be4ffc5cf847ce56" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:40.123579  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:40.124732  7846 raft_consensus.cc:2468] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 13.
I20260709 14:52:40.030670 12188 consensus_queue.cc:260] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:40.134578  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783e4874513449ef9084b833f188a6d3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:40.137331  7852 raft_consensus.cc:3060] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:52:40.038286 12400 consensus_queue.cc:260] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:40.161736  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:40.162971  7772 raft_consensus.cc:3060] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Advancing to term 15
I20260709 14:52:40.160431  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:40.171051  7776 raft_consensus.cc:3060] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:52:40.176071  7778 raft_consensus.cc:2468] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 13.
I20260709 14:52:40.177500  7846 raft_consensus.cc:1275] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 14:52:40.180359 12188 raft_consensus.cc:3060] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:52:40.165725 12199 raft_consensus.cc:2804] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader election won for term 11
I20260709 14:52:40.182165  7853 raft_consensus.cc:1275] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 14:52:40.195070  7852 raft_consensus.cc:2468] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 11.
I20260709 14:52:40.203452 12400 raft_consensus.cc:3060] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Advancing to term 14
I20260709 14:52:40.204131  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:40.230618  7770 raft_consensus.cc:3060] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:52:40.231817  7778 raft_consensus.cc:3055] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 LEADER]: Stepping down as leader of term 14
I20260709 14:52:40.232254  7778 raft_consensus.cc:740] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:52:40.235493  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:40.238569  7852 raft_consensus.cc:1275] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 14:52:40.236689  7853 raft_consensus.cc:2468] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 11.
I20260709 14:52:40.177207 12390 consensus_queue.cc:260] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:40.249493  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 153099us
W20260709 14:52:40.260072  7894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:40.262516  7778 consensus_queue.cc:260] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:40.264294  7778 raft_consensus.cc:3060] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Advancing to term 15
I20260709 14:52:40.265425  7776 raft_consensus.cc:2468] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 9.
I20260709 14:52:40.268440  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:40.269025 12390 raft_consensus.cc:3060] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:52:40.270073  8639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18d29d52d304c87b930d4fb5eaf50b1" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9418391fa82a42c79c6cad13ba91d964" is_pre_election: true
I20260709 14:52:40.271056  8639 raft_consensus.cc:2368] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 10. Current term is 11.
I20260709 14:52:40.240737  7925 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
mode: GRACEFUL
new_leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:48676
I20260709 14:52:40.273531  7854 raft_consensus.cc:1275] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 14:52:40.274536  7925 raft_consensus.cc:606] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Received request to transfer leadership to TS 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:40.275067  7925 raft_consensus.cc:614] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 14:52:40.263289 12244 raft_consensus.cc:493] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:52:40.283521  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:40.265726  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:40.310124  7772 raft_consensus.cc:2468] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 15.
I20260709 14:52:40.313727  7777 raft_consensus.cc:3060] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Advancing to term 15
I20260709 14:52:40.319087  7819 leader_election.cc:304] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed
W20260709 14:52:40.330689  7893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:40.291128 12258 raft_consensus.cc:493] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:52:40.344385  7817 leader_election.cc:400] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 10 pre-election: Vote denied by peer 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68:42321) with higher term. Message: Invalid argument: T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 10. Current term is 11.
I20260709 14:52:40.351027  7817 leader_election.cc:403] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 14:52:40.348646  7894 leader_election.cc:304] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:40.323654  8639 raft_consensus.cc:1275] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 [term 11 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 14:52:40.366691  7817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.68:42321, user_credentials={real_user=slave}} blocked reactor thread for 69070.7us
I20260709 14:52:40.367405  7894 leader_election.cc:304] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:40.356369 12244 raft_consensus.cc:515] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:40.376515 12244 leader_election.cc:290] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:52:40.346154 12439 log.cc:927] Time spent T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
W20260709 14:52:40.365327  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:52:40.382380 12442 log.cc:927] Time spent T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.141s	user 0.001s	sys 0.000s
I20260709 14:52:40.397186  7779 raft_consensus.cc:2468] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 12.
I20260709 14:52:40.399977  7894 leader_election.cc:304] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:40.402956  7778 raft_consensus.cc:1275] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
W20260709 14:52:40.404068  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 102429us
I20260709 14:52:40.414032  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:40.418735  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:40.343771 12430 consensus_queue.cc:1059] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 14:52:40.410802 12377 consensus_queue.cc:1048] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 14:52:40.387378 12383 raft_consensus.cc:2804] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 14:52:40.458756 12383 raft_consensus.cc:493] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:40.411650 12427 raft_consensus.cc:2804] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 14:52:40.459095  7770 raft_consensus.cc:2468] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 10.
I20260709 14:52:40.420644  7778 raft_consensus.cc:2468] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 14.
I20260709 14:52:40.465600  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
W20260709 14:52:40.470368  7893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:40.396518 11963 consensus_queue.cc:1048] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.067s
I20260709 14:52:40.470840  7779 raft_consensus.cc:2393] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 15: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:52:40.411314 12156 consensus_queue.cc:1048] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.073s
W20260709 14:52:40.467559 12442 log.cc:927] Time spent T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 14:52:40.473007 12427 raft_consensus.cc:493] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:52:40.471165 12457 raft_consensus.cc:3060] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Advancing to term 11
I20260709 14:52:40.486877 12427 raft_consensus.cc:3060] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 14:52:40.473646 12451 raft_consensus.cc:2804] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Leader election won for term 13
I20260709 14:52:40.485399  7779 raft_consensus.cc:1275] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 14:52:40.495157 12451 raft_consensus.cc:697] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
W20260709 14:52:40.496438  7742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:40.509074  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
W20260709 14:52:40.517016  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:52:40.517441  7743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:40.517747  7925 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
mode: GRACEFUL
new_leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:48676
I20260709 14:52:40.518479  7925 raft_consensus.cc:606] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 LEADER]: Received request to transfer leadership to TS 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:40.520324  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783e4874513449ef9084b833f188a6d3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:40.524531  7925 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
mode: GRACEFUL
new_leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:48676
I20260709 14:52:40.525533  7925 raft_consensus.cc:606] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 LEADER]: Received request to transfer leadership to TS 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:52:40.518026  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:40.524703  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:40.421145 12375 raft_consensus.cc:2804] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 14:52:40.464872  7819 leader_election.cc:304] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:52:40.539252  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
W20260709 14:52:40.551438  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 147084us
I20260709 14:52:40.467135 12383 raft_consensus.cc:3060] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:52:40.402307 12258 raft_consensus.cc:515] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:40.565754  7770 raft_consensus.cc:3060] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Advancing to term 15
W20260709 14:52:40.564618  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 99906.5us
I20260709 14:52:40.567971  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:40.568276  7893 leader_election.cc:304] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:40.535796 11949 raft_consensus.cc:3055] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 14:52:40.568749  7925 raft_consensus.cc:2468] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 11.
I20260709 14:52:40.586263  7779 raft_consensus.cc:2468] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 13.
W20260709 14:52:40.580542  7743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:40.569621 12244 consensus_queue.cc:1048] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 14:52:40.597672  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:40.600039 12278 raft_consensus.cc:2749] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 14:52:40.602944  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:40.605588  7925 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
mode: GRACEFUL
new_leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:48676
W20260709 14:52:40.606241  7743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:40.606360  7925 raft_consensus.cc:606] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 LEADER]: Received request to transfer leadership to TS 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:40.608984  7771 raft_consensus.cc:2468] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 11.
W20260709 14:52:40.585543 12272 consensus_meta.cc:287] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent flushing consensus metadata: real 0.605s	user 0.017s	sys 0.001s
I20260709 14:52:40.612761  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:40.612629 12199 raft_consensus.cc:697] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:52:40.557690 12375 raft_consensus.cc:697] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:40.577834  7894 leader_election.cc:304] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:40.617738  7776 raft_consensus.cc:2393] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 16: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:52:40.621647 12427 raft_consensus.cc:515] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:40.625850  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:40.640232  7779 raft_consensus.cc:2468] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 9.
I20260709 14:52:40.576535 11949 raft_consensus.cc:740] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:40.632936 12199 consensus_queue.cc:237] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:40.635144  7770 raft_consensus.cc:2468] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 15.
W20260709 14:52:40.638010  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 69880.2us
I20260709 14:52:40.575155 12391 raft_consensus.cc:493] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:52:40.630820  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 53069us
I20260709 14:52:40.587836 12452 raft_consensus.cc:2804] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader election won for term 12
I20260709 14:52:40.646109  7777 raft_consensus.cc:2468] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 15.
I20260709 14:52:40.577570 12219 consensus_queue.cc:1059] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 14:52:40.651443  7777 raft_consensus.cc:1240] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 12. Current term is 13. Ops: []
I20260709 14:52:40.651618  7778 raft_consensus.cc:1275] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 14:52:40.583535 12430 consensus_queue.cc:1048] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.056s
I20260709 14:52:40.643172 12377 raft_consensus.cc:2804] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 14:52:40.657600 12451 consensus_queue.cc:237] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:40.662139 12391 raft_consensus.cc:515] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:40.657622 12377 raft_consensus.cc:493] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:52:40.666035 12377 raft_consensus.cc:3060] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:52:40.666440 12258 leader_election.cc:290] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:40.667786  7779 raft_consensus.cc:1275] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 9. (term mismatch)
I20260709 14:52:40.668212  7779 pending_rounds.cc:85] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed: Aborting all ops after (but not including) 8
I20260709 14:52:40.668431  7779 pending_rounds.cc:107] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed: Aborting uncommitted NO_OP operation due to leader change: 13.9
I20260709 14:52:40.668656  7779 raft_consensus.cc:2889] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:52:40.670790 12219 raft_consensus.cc:3055] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 14:52:40.671396 12458 consensus_queue.cc:1048] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 14:52:40.672055 12219 raft_consensus.cc:740] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:40.670940  7926 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
mode: GRACEFUL
new_leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:48676
I20260709 14:52:40.674290  7926 raft_consensus.cc:606] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Received request to transfer leadership to TS 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:40.674650  7926 raft_consensus.cc:614] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 14:52:40.678068  6549 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 14:52:40.680192  7893 leader_election.cc:304] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:40.680826  6549 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 14:52:40.681397 11963 raft_consensus.cc:2804] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 14:52:40.682176 12427 leader_election.cc:290] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:40.682734 11963 raft_consensus.cc:697] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:40.684250 11963 consensus_queue.cc:237] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:40.673179  7779 raft_consensus.cc:1275] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 14:52:40.695262 12452 raft_consensus.cc:697] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:52:40.684821  7771 raft_consensus.cc:3055] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 LEADER]: Stepping down as leader of term 12
I20260709 14:52:40.699189  7771 raft_consensus.cc:740] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:52:40.703061  7893 leader_election.cc:304] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:52:40.704486  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 54610us
I20260709 14:52:40.705828  7770 raft_consensus.cc:1275] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 14:52:40.697182 12452 consensus_queue.cc:237] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:40.716456  7893 leader_election.cc:304] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:40.700625 12391 leader_election.cc:290] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:40.715730 12278 raft_consensus.cc:3060] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 14:52:40.743647 12258 consensus_queue.cc:1048] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 14:52:40.736681 12458 consensus_queue.cc:1059] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 14:52:40.744736  7771 consensus_queue.cc:260] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:40.749456 11949 consensus_queue.cc:260] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:40.784829  8599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 191692us
I20260709 14:52:40.730103 12244 consensus_queue.cc:1048] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.051s
I20260709 14:52:40.673100 12219 consensus_queue.cc:260] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:40.778101 12465 raft_consensus.cc:2804] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 14:52:40.796841 12434 consensus_queue.cc:1059] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 14:52:40.796727 12437 raft_consensus.cc:3055] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 LEADER]: Stepping down as leader of term 10
I20260709 14:52:40.798228 12467 consensus_queue.cc:1059] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 14:52:40.733855 12383 raft_consensus.cc:515] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:40.779764 12391 raft_consensus.cc:493] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:40.807499  7771 raft_consensus.cc:3060] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Advancing to term 13
W20260709 14:52:40.824702  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 108347us
I20260709 14:52:40.830150  7893 leader_election.cc:304] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:52:40.831331  7742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:40.777333 11963 consensus_queue.cc:1048] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 14:52:40.819022 11949 raft_consensus.cc:3060] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 14:52:40.826757 12437 raft_consensus.cc:740] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:52:40.825078 12465 raft_consensus.cc:697] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:40.840072 12156 consensus_queue.cc:1048] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 14:52:40.858836  7893 leader_election.cc:304] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:40.829464 12391 raft_consensus.cc:515] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:40.862350 12465 consensus_queue.cc:237] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:40.863315 12391 leader_election.cc:290] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:40.864993 12219 raft_consensus.cc:3060] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 14:52:40.864419 12437 consensus_queue.cc:260] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:40.870505  7893 leader_election.cc:304] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:40.802858 12375 consensus_queue.cc:237] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:40.874955  7893 leader_election.cc:304] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:40.866390 12437 raft_consensus.cc:3060] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:52:40.869145 12457 raft_consensus.cc:2749] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68:42321) with higher term. Message: Invalid argument: T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 10. Current term is 11.
I20260709 14:52:40.866420 12383 leader_election.cc:290] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:52:40.885630  7745 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:40.877733 12430 raft_consensus.cc:2804] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 14:52:40.895440  7771 raft_consensus.cc:1275] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 14:52:40.876552 12427 raft_consensus.cc:493] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:40.853060 12473 raft_consensus.cc:2804] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 14:52:40.888067  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:52:40.892666  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:40.876026 12469 consensus_queue.cc:1059] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.013s
I20260709 14:52:40.892588 12244 raft_consensus.cc:493] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:40.904433 12258 raft_consensus.cc:3055] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 LEADER]: Stepping down as leader of term 11
I20260709 14:52:40.911168 12244 raft_consensus.cc:515] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:40.936446 12244 leader_election.cc:290] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:52:40.939301 12471 log.cc:927] Time spent T 00000000000000000000000000000000 P 133636659113430cb53b321cb0b1d9ee: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
I20260709 14:52:40.917847 12258 raft_consensus.cc:740] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:52:40.947608 12258 consensus_queue.cc:260] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:40.915226 12427 raft_consensus.cc:515] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:40.951452 12427 leader_election.cc:290] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:40.952065  7744 leader_election.cc:304] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:40.953481 12244 consensus_queue.cc:1059] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 14:52:40.954649 12244 raft_consensus.cc:2804] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 14:52:40.955029 12244 raft_consensus.cc:493] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Starting leader election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:52:40.955380 12244 raft_consensus.cc:3060] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Advancing to term 14
I20260709 14:52:40.956753 12377 raft_consensus.cc:515] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:40.957445 12434 raft_consensus.cc:3055] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 LEADER]: Stepping down as leader of term 10
I20260709 14:52:40.957839 12434 raft_consensus.cc:740] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:52:40.959415 12377 leader_election.cc:290] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:40.959054 12434 consensus_queue.cc:260] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:40.961947  7744 leader_election.cc:304] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:52:40.919039 12383 raft_consensus.cc:2749] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 14:52:40.967254  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 92376.1us
I20260709 14:52:40.970403  7744 leader_election.cc:304] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:52:40.971429  7744 leader_election.cc:304] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
W20260709 14:52:40.985431  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 254787us
I20260709 14:52:41.005770 12429 raft_consensus.cc:2804] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 14:52:41.006464 12429 raft_consensus.cc:493] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:52:40.978262 12469 raft_consensus.cc:2804] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 14:52:40.978147 12458 raft_consensus.cc:2804] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 14:52:40.977833 12467 raft_consensus.cc:2804] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 14:52:41.013820  7894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:52:41.047590  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 59100.4us
I20260709 14:52:41.026774  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:41.089622  7852 raft_consensus.cc:2468] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 13.
I20260709 14:52:41.089201  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
W20260709 14:52:41.048326  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:41.091879  7850 raft_consensus.cc:3060] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Advancing to term 10
W20260709 14:52:41.092445  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:41.094040  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:41.094641  7853 raft_consensus.cc:3060] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:52:41.101051  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:41.102754  7846 raft_consensus.cc:3060] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Advancing to term 14
W20260709 14:52:41.104815  7893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:41.012337 12478 raft_consensus.cc:493] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:41.003556 12473 raft_consensus.cc:697] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:41.010110 12458 raft_consensus.cc:493] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:41.012804 12383 raft_consensus.cc:493] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:41.009218 12429 raft_consensus.cc:3060] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 14:52:41.113138 12478 raft_consensus.cc:515] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:41.113722 12479 raft_consensus.cc:493] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:41.122905 12479 raft_consensus.cc:515] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:41.124940 12478 leader_election.cc:290] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:41.127964 12479 leader_election.cc:290] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:41.013473 12377 raft_consensus.cc:493] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:41.087869 12258 raft_consensus.cc:3060] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:52:41.003237 12430 raft_consensus.cc:697] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:41.127135 12458 raft_consensus.cc:3060] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Advancing to term 14
I20260709 14:52:41.116771 12375 raft_consensus.cc:493] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:41.114442 12156 raft_consensus.cc:493] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:41.009727 12469 raft_consensus.cc:493] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:41.010339 12467 raft_consensus.cc:493] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:41.162484 12488 raft_consensus.cc:493] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:41.158926 12375 raft_consensus.cc:515] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:41.139096 12434 raft_consensus.cc:3060] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:52:41.159092 12156 raft_consensus.cc:515] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:41.159056 12469 raft_consensus.cc:3060] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Advancing to term 14
I20260709 14:52:41.188161 12473 consensus_queue.cc:237] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:41.140076 12383 raft_consensus.cc:515] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:41.146698 12377 raft_consensus.cc:515] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:41.178655  7846 raft_consensus.cc:2468] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 14.
I20260709 14:52:41.170086 12467 raft_consensus.cc:3060] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Advancing to term 10
W20260709 14:52:41.210117  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 120544us
I20260709 14:52:41.215934  7744 leader_election.cc:304] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:52:41.221896  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258d6c2dda954bf5b65930fde8ecb9f3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:41.233914  7925 raft_consensus.cc:1240] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 LEADER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 14. Current term is 15. Ops: []
W20260709 14:52:41.239387  7819 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:41.241816  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
W20260709 14:52:41.243595  7742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.68:42321, user_credentials={real_user=slave}} blocked reactor thread for 96029.6us
I20260709 14:52:41.249953  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:41.250238  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:41.252562  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:41.258448  7850 raft_consensus.cc:2468] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 10.
I20260709 14:52:41.260934  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:41.215549 12452 raft_consensus.cc:493] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:41.264415  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:41.268949  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:41.271589  7925 raft_consensus.cc:2393] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 14: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:52:41.206027 12488 raft_consensus.cc:515] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:41.312486  7926 raft_consensus.cc:1240] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 14:52:41.272076 12480 raft_consensus.cc:493] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:41.325817 12480 raft_consensus.cc:515] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:41.330945 12497 raft_consensus.cc:493] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:41.331951 12497 raft_consensus.cc:515] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:41.304688 12156 leader_election.cc:290] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:41.221504 12430 consensus_queue.cc:237] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:41.343885 12244 raft_consensus.cc:515] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:41.269544 12452 raft_consensus.cc:515] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:41.347786 12452 leader_election.cc:290] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:41.343598  7926 raft_consensus.cc:1240] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 LEADER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 14:52:41.350034  7923 raft_consensus.cc:2468] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 13.
W20260709 14:52:41.357800 12483 log.cc:927] Time spent T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.134s	user 0.004s	sys 0.004s
I20260709 14:52:41.371587  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:41.372576  7923 raft_consensus.cc:3060] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:52:41.373708  7853 raft_consensus.cc:2468] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 12.
W20260709 14:52:41.374917 12491 log.cc:927] Time spent T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.063s	user 0.002s	sys 0.000s
I20260709 14:52:41.377894  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:41.388406  7926 raft_consensus.cc:2410] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 14:52:41.379046  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:41.380366  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:41.381559 12272 raft_consensus.cc:493] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:41.382565  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:41.381878 12495 raft_consensus.cc:2804] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 14:52:41.382637  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:41.382961  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:41.383813  7923 raft_consensus.cc:2468] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 10.
W20260709 14:52:41.358486 12487 log.cc:927] Time spent T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.149s	user 0.001s	sys 0.000s
I20260709 14:52:41.390782  7850 raft_consensus.cc:2468] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 13.
I20260709 14:52:41.398326  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:41.402599  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:41.401032  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:41.406563  7923 raft_consensus.cc:3060] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 14:52:41.405386  7927 raft_consensus.cc:2468] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 14.
W20260709 14:52:41.419428  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:41.420665  7919 raft_consensus.cc:2468] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 15.
W20260709 14:52:41.421990  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:41.425596  7919 raft_consensus.cc:1240] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 15. Current term is 16. Ops: []
I20260709 14:52:41.427883  7853 raft_consensus.cc:1275] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 14:52:41.402551 12495 raft_consensus.cc:493] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:41.445504  7850 raft_consensus.cc:1275] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 14:52:41.448570  7923 raft_consensus.cc:2468] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 15.
I20260709 14:52:41.403311 12272 raft_consensus.cc:515] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:41.447149 12495 raft_consensus.cc:3060] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:52:41.475615  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:41.476714  7845 raft_consensus.cc:2368] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 8. Current term is 9.
I20260709 14:52:41.477820  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:52:41.478884 12278 consensus_meta.cc:287] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent flushing consensus metadata: real 0.703s	user 0.012s	sys 0.002s
I20260709 14:52:41.479396 12278 raft_consensus.cc:2749] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 14:52:41.490576  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:41.492481  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:52:41.486716  7745 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 1.620s (SENT) [suppressed 38 similar messages]
I20260709 14:52:41.514706  7771 raft_consensus.cc:1275] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 14:52:41.517621  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:41.517781  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:41.519510  7852 raft_consensus.cc:2468] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 12.
I20260709 14:52:41.526117  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:41.527354  7922 raft_consensus.cc:1240] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 14:52:41.532250  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:41.533838  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:41.551642  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:41.514423 12434 raft_consensus.cc:493] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:41.552083  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:41.552675 12434 raft_consensus.cc:515] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:41.553519  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:41.554458  7852 raft_consensus.cc:2393] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 15: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:52:41.555495 12434 leader_election.cc:290] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:41.555385  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:41.556463  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
W20260709 14:52:41.524134 12489 log.cc:927] Time spent T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.072s	user 0.001s	sys 0.003s
I20260709 14:52:41.556368  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:41.560711  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:41.515311 12506 raft_consensus.cc:493] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:52:41.575353  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 44717.7us
I20260709 14:52:41.577428 12503 raft_consensus.cc:493] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:41.559715 12485 raft_consensus.cc:493] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9418391fa82a42c79c6cad13ba91d964)
I20260709 14:52:41.578159  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:41.579602  7779 raft_consensus.cc:2468] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 15.
I20260709 14:52:41.580264 12377 leader_election.cc:290] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:41.580915  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:41.582682  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258d6c2dda954bf5b65930fde8ecb9f3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:41.578852 12485 raft_consensus.cc:515] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:52:41.584092  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:41.584700  7775 raft_consensus.cc:3060] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Advancing to term 15
I20260709 14:52:41.586308  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:41.586259 12485 leader_election.cc:290] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68:42321)
I20260709 14:52:41.587126  7778 raft_consensus.cc:2468] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 14.
I20260709 14:52:41.580868  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:41.589401  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:41.590116  7779 raft_consensus.cc:2468] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 14.
I20260709 14:52:41.591223  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
W20260709 14:52:41.571069  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:41.592007  7778 raft_consensus.cc:2468] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 17.
I20260709 14:52:41.593057  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:41.591553  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:41.576629  7894 leader_election.cc:304] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:41.562559  7852 raft_consensus.cc:2393] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 13: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:52:41.578022  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:41.598338  7845 raft_consensus.cc:1240] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 14. Current term is 15. Ops: []
I20260709 14:52:41.488423 12429 raft_consensus.cc:515] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:41.599236  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:41.605327  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:41.606681  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:41.607471  7924 raft_consensus.cc:2468] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 13.
I20260709 14:52:41.608852  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:41.609876  7779 raft_consensus.cc:3060] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:52:41.600338  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:41.610787  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:41.611604  7927 raft_consensus.cc:2393] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 14: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:52:41.612536  7776 raft_consensus.cc:1240] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 12. Current term is 13. Ops: []
I20260709 14:52:41.614181  7925 raft_consensus.cc:1240] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 14. Current term is 15. Ops: [14.7-14.7]
I20260709 14:52:41.613617  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:41.529399 12465 raft_consensus.cc:493] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:41.620180  7922 raft_consensus.cc:2376] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 16. Re-sending same reply.
I20260709 14:52:41.621438  7775 raft_consensus.cc:2468] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 15.
I20260709 14:52:41.620043  7779 raft_consensus.cc:2468] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 10.
I20260709 14:52:41.626394  7778 raft_consensus.cc:1240] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 11. Current term is 12. Ops: [9.6-11.7]
I20260709 14:52:41.627961  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:52:41.634213  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:41.553135 12244 leader_election.cc:290] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 14 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:41.635998  7851 raft_consensus.cc:2410] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 14:52:41.637419  7845 raft_consensus.cc:1240] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 14:52:41.662103  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:41.662541  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:41.664009  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:41.665953  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:41.667712  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:41.619362 12465 raft_consensus.cc:515] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:41.664620  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:41.578276 12503 raft_consensus.cc:515] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:41.596374 12506 raft_consensus.cc:515] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:41.633183 12501 raft_consensus.cc:493] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
W20260709 14:52:41.656539  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 80027.2us
I20260709 14:52:41.661058  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18d29d52d304c87b930d4fb5eaf50b1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
W20260709 14:52:41.840435 12458 consensus_meta.cc:287] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent flushing consensus metadata: real 0.667s	user 0.006s	sys 0.007s
I20260709 14:52:41.842401 12503 leader_election.cc:290] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:41.669207  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:41.698261  6549 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 14:52:41.682400  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:41.851048  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:41.705772  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:41.700397 11949 raft_consensus.cc:2804] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 14:52:41.854851 11949 raft_consensus.cc:493] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:41.716355 12488 leader_election.cc:290] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:41.697933 12272 leader_election.cc:290] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:41.855341 11949 raft_consensus.cc:3060] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Advancing to term 14
W20260709 14:52:41.736377  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 76385.7us
I20260709 14:52:41.772387  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:41.862010  7851 raft_consensus.cc:3060] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Advancing to term 16
I20260709 14:52:41.852869  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:41.835541  7849 raft_consensus.cc:2468] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 14.
I20260709 14:52:41.864707  7848 raft_consensus.cc:2393] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 10: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:52:41.774896  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:41.791100  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18d29d52d304c87b930d4fb5eaf50b1" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:41.792826  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:41.719545 12500 raft_consensus.cc:493] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:41.870682  7853 raft_consensus.cc:2368] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 8. Current term is 9.
I20260709 14:52:41.794866  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:41.796533  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18d29d52d304c87b930d4fb5eaf50b1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:41.830749 12480 leader_election.cc:290] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:41.704778 12156 consensus_queue.cc:1048] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.012s
I20260709 14:52:41.890568  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:41.831118 12429 leader_election.cc:290] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 15 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:52:41.834702 12469 consensus_meta.cc:287] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent flushing consensus metadata: real 0.625s	user 0.010s	sys 0.013s
I20260709 14:52:41.835253  8640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9441e831627143a991a1556dcdce71e3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9418391fa82a42c79c6cad13ba91d964" is_pre_election: true
I20260709 14:52:41.835651  7779 raft_consensus.cc:1240] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 13. Current term is 14. Ops: []
I20260709 14:52:41.836723 12465 leader_election.cc:290] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:41.837098  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:52:41.838486 12437 consensus_meta.cc:287] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent flushing consensus metadata: real 0.950s	user 0.019s	sys 0.000s
I20260709 14:52:41.855485  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:41.863005  7893 leader_election.cc:304] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:41.873557  7928 raft_consensus.cc:1240] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 LEADER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 11. Current term is 12. Ops: [9.6-11.7]
W20260709 14:52:41.875447  7745 leader_election.cc:336] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 2.162s (SENT)
I20260709 14:52:41.906555  7745 leader_election.cc:304] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:52:41.885427  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:41.890215 12500 raft_consensus.cc:515] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:41.892699  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:41.893206  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:41.913972  7849 raft_consensus.cc:2393] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 14: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:52:41.891659  7778 raft_consensus.cc:2393] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 10: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:52:41.894651  7922 raft_consensus.cc:1240] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 15. Current term is 16. Ops: []
I20260709 14:52:41.895083  7776 raft_consensus.cc:2468] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 14.
I20260709 14:52:41.833791 12383 leader_election.cc:290] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:52:41.899856  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 60304.5us
I20260709 14:52:41.907948  7852 raft_consensus.cc:2468] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 11.
I20260709 14:52:41.912395  7772 raft_consensus.cc:2410] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 14:52:41.834609 12497 leader_election.cc:290] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:41.924260  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:41.921414  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258d6c2dda954bf5b65930fde8ecb9f3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:52:41.938498  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 75592us
I20260709 14:52:41.898772 12457 raft_consensus.cc:493] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:41.930424  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:41.948731  7779 raft_consensus.cc:2468] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 14.
I20260709 14:52:41.912283 12272 raft_consensus.cc:493] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:41.931597  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c563cc7cfbe4d59be4ffc5cf847ce56" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:41.931746 11949 raft_consensus.cc:515] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:41.938266  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:41.959295  7847 raft_consensus.cc:2410] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 14:52:41.940282  7893 leader_election.cc:304] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:41.841020 12458 raft_consensus.cc:515] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:41.909947  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:41.946419  7920 raft_consensus.cc:1240] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 LEADER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 9. Current term is 10. Ops: []
I20260709 14:52:41.946851  7894 leader_election.cc:304] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:41.930790  7845 raft_consensus.cc:2468] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 11.
I20260709 14:52:41.960618  7893 leader_election.cc:304] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:52:41.968152  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 92806.5us
I20260709 14:52:41.968897  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:41.971836  7778 raft_consensus.cc:2468] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 12.
I20260709 14:52:41.966137  7894 leader_election.cc:304] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:41.972015 11949 leader_election.cc:290] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:41.974464  7894 leader_election.cc:304] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:41.976758  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:41.935489 12503 raft_consensus.cc:493] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:41.978223  7779 raft_consensus.cc:2468] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 12.
I20260709 14:52:41.977705  7893 leader_election.cc:304] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:41.991652  7893 leader_election.cc:304] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:41.995466  7852 raft_consensus.cc:1275] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 14:52:41.947903 12375 leader_election.cc:290] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:41.952992 12473 raft_consensus.cc:2804] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 14:52:41.905494 12469 raft_consensus.cc:515] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:42.001914  7774 raft_consensus.cc:1240] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 15. Current term is 16. Ops: []
I20260709 14:52:42.002303  7772 raft_consensus.cc:1240] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 14:52:42.004047  7779 raft_consensus.cc:1240] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 14:52:42.006035  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:42.009498  7778 raft_consensus.cc:1240] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 12. Current term is 13. Ops: []
I20260709 14:52:41.967864 12437 raft_consensus.cc:2749] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 14:52:42.012284 11963 raft_consensus.cc:2804] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 14:52:41.998533 12495 consensus_meta.cc:287] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent flushing consensus metadata: real 0.500s	user 0.007s	sys 0.005s
I20260709 14:52:42.001339 12479 raft_consensus.cc:2804] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 14:52:42.016535  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:42.039454  7849 raft_consensus.cc:2468] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 13.
I20260709 14:52:41.904071 12501 raft_consensus.cc:515] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:41.956784 12457 raft_consensus.cc:515] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:42.001582 12473 raft_consensus.cc:493] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:52:42.018391 12429 consensus_queue.cc:1048] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 14:52:41.999670 12490 raft_consensus.cc:2804] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 14:52:42.019018  7850 raft_consensus.cc:1240] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 11. Current term is 12. Ops: []
I20260709 14:52:42.018412  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:42.018424  7772 raft_consensus.cc:1240] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 9. Current term is 10. Ops: [9.6-9.6]
W20260709 14:52:42.020136  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:42.023775 12278 raft_consensus.cc:993] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0: : Instructing follower 3876b8ee8d744cb18e91d97aae93b1ac to start an election
I20260709 14:52:42.024819  7845 raft_consensus.cc:1240] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 14:52:42.070423  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:41.988619 12383 raft_consensus.cc:2804] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 14:52:42.028487  7770 raft_consensus.cc:1275] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 14:52:41.976611 12430 raft_consensus.cc:2804] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 14:52:42.019624  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:41.995033 12465 raft_consensus.cc:2804] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 14:52:42.032931  8598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 116898us
I20260709 14:52:41.991631 12427 raft_consensus.cc:2749] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 14:52:42.037608 11963 raft_consensus.cc:697] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:42.017522  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:42.052803  7779 raft_consensus.cc:1240] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 13. Current term is 14. Ops: []
I20260709 14:52:42.056291 12500 leader_election.cc:290] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:42.059190  7776 raft_consensus.cc:1240] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 14:52:41.968583 12272 raft_consensus.cc:515] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:42.061327  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:42.062855  7774 raft_consensus.cc:1275] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 14:52:42.067420  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:42.101974 12383 raft_consensus.cc:697] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:42.071425 11949 consensus_queue.cc:1048] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 14:52:42.061846 12473 raft_consensus.cc:3060] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Advancing to term 14
W20260709 14:52:42.082368 12467 consensus_meta.cc:287] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent flushing consensus metadata: real 0.830s	user 0.016s	sys 0.000s
W20260709 14:52:42.078118  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:42.071183  7845 raft_consensus.cc:2468] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 13.
I20260709 14:52:42.129578  7745 leader_election.cc:304] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:42.130604  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9441e831627143a991a1556dcdce71e3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:42.084842 12457 leader_election.cc:290] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:42.076953  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:42.052098 12495 raft_consensus.cc:515] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:41.998821 12503 raft_consensus.cc:515] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:42.090976 12501 leader_election.cc:290] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:42.092011  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:42.092993  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:42.095582 12469 leader_election.cc:290] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 14 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:52:42.074512 12514 log.cc:927] Time spent T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 14:52:42.085002 12506 leader_election.cc:290] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:42.077641  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:42.099548  7851 raft_consensus.cc:2468] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 16.
I20260709 14:52:42.157953  7770 raft_consensus.cc:2468] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 13.
I20260709 14:52:42.103752  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:42.114713  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:42.097709 12479 raft_consensus.cc:697] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:42.163683  7772 raft_consensus.cc:1275] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 14:52:42.071213  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:42.126646  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:42.165205  7776 raft_consensus.cc:2468] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 9.
I20260709 14:52:42.166601  7776 raft_consensus.cc:1240] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 14. Current term is 15. Ops: []
I20260709 14:52:42.104359 12490 raft_consensus.cc:697] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:42.132472  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:42.144325  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18d29d52d304c87b930d4fb5eaf50b1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:42.144575 12427 raft_consensus.cc:1081] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 LEADER]: Signalling peer 3876b8ee8d744cb18e91d97aae93b1ac to start an election
I20260709 14:52:42.168251 12490 consensus_queue.cc:237] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:42.144016 11963 consensus_queue.cc:237] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:42.128640 12437 consensus_queue.cc:1059] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 14:52:42.115437 12430 raft_consensus.cc:493] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:42.163947 12479 consensus_queue.cc:237] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:42.173997 12383 consensus_queue.cc:237] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:42.146647  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:42.176494  7845 raft_consensus.cc:2410] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 14:52:42.144049  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:42.132939  7819 leader_election.cc:304] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:42.155529  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:42.168591  7854 raft_consensus.cc:2376] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 11. Re-sending same reply.
I20260709 14:52:42.164135  7772 pending_rounds.cc:85] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed: Aborting all ops after (but not including) 5
I20260709 14:52:42.158471  7849 raft_consensus.cc:2393] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 10: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:52:42.146226  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:42.159037  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:42.160632  7745 leader_election.cc:304] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:52:42.155411  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 163901us
I20260709 14:52:42.162359  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:42.156774  7778 raft_consensus.cc:2468] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 13.
I20260709 14:52:42.180685  7775 raft_consensus.cc:1240] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 10. Current term is 12. Ops: []
I20260709 14:52:42.178283  7772 pending_rounds.cc:107] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed: Aborting uncommitted NO_OP operation due to leader change: 10.6
W20260709 14:52:42.177786  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 44964.5us
W20260709 14:52:42.181921  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 143172us
W20260709 14:52:42.183264  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:42.182695  7819 leader_election.cc:304] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:42.184826  7819 leader_election.cc:304] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:42.185906  7772 raft_consensus.cc:2889] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:52:42.187104  7774 raft_consensus.cc:2393] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 16: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:52:42.190294  7770 raft_consensus.cc:1240] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 13. Current term is 14. Ops: []
I20260709 14:52:42.192572  7850 raft_consensus.cc:2393] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 10: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:52:42.156368 12457 raft_consensus.cc:493] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:42.173480 12430 raft_consensus.cc:3060] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:52:42.158812 12258 raft_consensus.cc:3060] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Advancing to term 13
I20260709 14:52:42.200057  7819 leader_election.cc:304] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:42.146840 12497 consensus_queue.cc:1059] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.060s
I20260709 14:52:42.181277 12501 raft_consensus.cc:2804] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 14:52:42.212814  7745 leader_election.cc:400] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 election: Vote denied by peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529) with higher term. Message: Invalid argument: T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 8. Current term is 9.
I20260709 14:52:42.192404 12506 raft_consensus.cc:3055] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 LEADER]: Stepping down as leader of term 14
I20260709 14:52:42.213760  7745 leader_election.cc:403] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 14:52:42.133087 12467 raft_consensus.cc:515] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:42.191763 12500 raft_consensus.cc:2804] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 14:52:42.202049 12437 raft_consensus.cc:2749] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 14:52:42.205053 12469 raft_consensus.cc:493] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:42.211731 12244 raft_consensus.cc:493] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:42.268252  7745 leader_election.cc:304] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:42.208312 12465 raft_consensus.cc:697] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:42.218829 12501 raft_consensus.cc:493] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:42.220315 12497 consensus_queue.cc:1243] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer 3876b8ee8d744cb18e91d97aae93b1ac log is divergent from this leader: its last log entry 12.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 14:52:42.264560  7773 raft_consensus.cc:2393] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 10: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:52:42.208688 12507 raft_consensus.cc:493] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:42.221474 12506 raft_consensus.cc:740] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
W20260709 14:52:42.273551  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 73539.2us
I20260709 14:52:42.228775 12500 raft_consensus.cc:493] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Starting leader election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:52:42.232569 12481 raft_consensus.cc:493] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:42.206899 12457 raft_consensus.cc:515] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:42.233675 12510 raft_consensus.cc:493] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:42.281709  7745 leader_election.cc:304] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:52:42.285135  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 98269.1us
W20260709 14:52:42.285282  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 90886.7us
I20260709 14:52:42.276079 12501 raft_consensus.cc:3060] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Advancing to term 16
I20260709 14:52:42.313318 12490 consensus_queue.cc:1048] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 14:52:42.283414 12500 raft_consensus.cc:3060] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Advancing to term 14
I20260709 14:52:42.321486  7745 leader_election.cc:304] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:42.282560 12497 raft_consensus.cc:2749] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529) with higher term. Message: Invalid argument: T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 8. Current term is 9.
I20260709 14:52:42.305596 12437 raft_consensus.cc:2749] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 14:52:42.334087  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:42.340155  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:42.342301  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:42.347527  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:42.351867  7846 raft_consensus.cc:1275] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 14:52:42.352303 12495 leader_election.cc:290] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 12 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:42.353294 12495 raft_consensus.cc:2749] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 14:52:42.353796  7854 raft_consensus.cc:3055] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 LEADER]: Stepping down as leader of term 12
I20260709 14:52:42.354353  7854 raft_consensus.cc:740] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:52:42.354892 12495 raft_consensus.cc:2749] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 14:52:42.355404  7854 consensus_queue.cc:260] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:42.278084 12244 raft_consensus.cc:515] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:42.366016  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:42.367697  7848 raft_consensus.cc:2393] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 10: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:52:42.378667  7919 raft_consensus.cc:1240] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 12. Current term is 13. Ops: []
I20260709 14:52:42.277432 12469 raft_consensus.cc:515] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:42.379812  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:42.380795  7923 raft_consensus.cc:1275] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 14:52:42.359297  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:42.374477  7845 raft_consensus.cc:3055] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 LEADER]: Stepping down as leader of term 14
I20260709 14:52:42.305006 12524 consensus_queue.cc:1059] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.083s
I20260709 14:52:42.290848 12481 raft_consensus.cc:515] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:42.400046  7845 raft_consensus.cc:740] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:52:42.282122 12507 raft_consensus.cc:515] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:42.353171  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:42.396972  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:42.397652  7928 raft_consensus.cc:1240] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 14. Current term is 15. Ops: []
I20260709 14:52:42.382036 12272 leader_election.cc:290] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:42.396204  7850 raft_consensus.cc:3060] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Advancing to term 14
I20260709 14:52:42.381836 12465 consensus_queue.cc:237] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:42.304322 12510 raft_consensus.cc:515] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:42.357385  7847 raft_consensus.cc:2410] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 14:52:42.379314 12537 raft_consensus.cc:2804] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Leader election won for term 15
I20260709 14:52:42.397768  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:42.410146  7926 raft_consensus.cc:1275] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 14:52:42.351917 12467 leader_election.cc:290] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 10 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:42.401961  7924 raft_consensus.cc:1275] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 14:52:42.405570  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:42.435920  7922 raft_consensus.cc:2468] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 13.
I20260709 14:52:42.325691 12375 consensus_queue.cc:1048] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.057s
I20260709 14:52:42.367988 12522 raft_consensus.cc:2804] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 14:52:42.424491  7845 consensus_queue.cc:260] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:42.385857  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
W20260709 14:52:42.441814  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 120419us
I20260709 14:52:42.441854  7927 raft_consensus.cc:2468] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 16.
I20260709 14:52:42.443038  7745 leader_election.cc:304] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:42.448509  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:42.371184 12427 consensus_queue.cc:1048] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.058s
I20260709 14:52:42.462560  7845 raft_consensus.cc:3060] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Advancing to term 15
I20260709 14:52:42.327207 12506 consensus_queue.cc:260] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:42.468487  7745 leader_election.cc:304] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:42.464807  7850 raft_consensus.cc:2468] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 14.
I20260709 14:52:42.470364  7745 leader_election.cc:304] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
W20260709 14:52:42.472095  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 190446us
I20260709 14:52:42.444046 12522 raft_consensus.cc:493] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:42.442773 12503 leader_election.cc:290] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:52:42.493638  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:42.461150  7847 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3"
dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:49946
I20260709 14:52:42.500456  7847 raft_consensus.cc:493] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:52:42.501003  7847 raft_consensus.cc:3060] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Advancing to term 13
I20260709 14:52:42.519193 12507 leader_election.cc:290] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:42.520862 12538 consensus_queue.cc:1059] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 14:52:42.522305 12507 consensus_queue.cc:1059] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 14:52:42.523813 12538 raft_consensus.cc:3055] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 LEADER]: Stepping down as leader of term 11
I20260709 14:52:42.524528 12538 raft_consensus.cc:740] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:52:42.521214  7745 leader_election.cc:304] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:42.525931 12481 leader_election.cc:290] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:42.527194 12437 raft_consensus.cc:3055] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 LEADER]: Stepping down as leader of term 15
I20260709 14:52:42.527716 12437 raft_consensus.cc:740] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:52:42.527931 12469 leader_election.cc:290] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:42.528678 12437 consensus_queue.cc:260] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:42.529651 12244 leader_election.cc:290] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:42.529924 12437 raft_consensus.cc:3060] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Advancing to term 16
I20260709 14:52:42.531767 12510 leader_election.cc:290] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:42.533607 12495 raft_consensus.cc:2749] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 14:52:42.525657 12538 consensus_queue.cc:260] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:42.535718 12538 raft_consensus.cc:3060] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:52:42.537840 12457 leader_election.cc:290] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:52:42.546406  7745 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:52:42.547288  7745 leader_election.cc:336] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 1.635s (SENT)
I20260709 14:52:42.547698  7745 leader_election.cc:304] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:42.547767 12430 raft_consensus.cc:515] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:42.548671 12510 raft_consensus.cc:2749] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 14:52:42.549378 12506 raft_consensus.cc:3060] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Advancing to term 15
I20260709 14:52:42.464104 12467 raft_consensus.cc:2749] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 14:52:42.549489 12510 raft_consensus.cc:493] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:42.550680 12510 raft_consensus.cc:515] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:42.550861 12503 consensus_queue.cc:1059] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 14:52:42.549751 12469 raft_consensus.cc:493] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:42.555241 12469 raft_consensus.cc:515] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:42.486310 12522 raft_consensus.cc:3060] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Advancing to term 18
I20260709 14:52:42.557827 12469 leader_election.cc:290] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:42.558562 12510 leader_election.cc:290] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:42.486378 12497 consensus_queue.cc:1048] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.075s
I20260709 14:52:42.478137 12543 raft_consensus.cc:2804] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 14:52:42.563609 12543 raft_consensus.cc:493] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:42.564030 12543 raft_consensus.cc:3060] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Advancing to term 14
I20260709 14:52:42.475817 12272 raft_consensus.cc:2749] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 14:52:42.583702 12542 raft_consensus.cc:493] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:42.584519 12542 raft_consensus.cc:515] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:42.588133 12542 leader_election.cc:290] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:42.597858 12537 raft_consensus.cc:697] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:52:42.599238 12537 consensus_queue.cc:237] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:42.600219 12258 raft_consensus.cc:2749] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 14:52:42.601544  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 124276us
W20260709 14:52:42.602046  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 230986us
W20260709 14:52:42.604971  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:42.614898  7925 raft_consensus.cc:2393] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 12: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
W20260709 14:52:42.619649  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:42.613586  7819 leader_election.cc:304] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:42.634550 12555 raft_consensus.cc:2804] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader election won for term 10
I20260709 14:52:42.635295 12555 raft_consensus.cc:697] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:52:42.646010  7845 raft_consensus.cc:1275] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 9. (term mismatch)
I20260709 14:52:42.646781  7845 pending_rounds.cc:85] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting all ops after (but not including) 8
I20260709 14:52:42.647071  7845 pending_rounds.cc:107] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 14:52:42.647336  7845 raft_consensus.cc:2889] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:52:42.636215  7819 leader_election.cc:304] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
W20260709 14:52:42.642760 12515 log.cc:927] Time spent T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.631s	user 0.000s	sys 0.008s
I20260709 14:52:42.650691  7849 raft_consensus.cc:3055] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 LEADER]: Stepping down as leader of term 9
I20260709 14:52:42.652357  7849 raft_consensus.cc:740] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:52:42.655228  7847 raft_consensus.cc:515] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:42.626847 12478 consensus_queue.cc:1048] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 14:52:42.673125  7849 consensus_queue.cc:260] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:42.689625  7893 leader_election.cc:304] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:42.694692  7893 leader_election.cc:304] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:42.696177  7849 raft_consensus.cc:3060] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Advancing to term 10
W20260709 14:52:42.698582  7745 leader_election.cc:336] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 1.509s (SENT)
I20260709 14:52:42.699255  7745 leader_election.cc:304] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:42.701316  7847 leader_election.cc:290] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:42.650401 12555 consensus_queue.cc:237] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:42.708483  7745 leader_election.cc:336] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 1.576s (SENT)
I20260709 14:52:42.710683 11949 raft_consensus.cc:2749] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 14:52:42.728418 12546 raft_consensus.cc:2804] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 14:52:42.728971 12546 raft_consensus.cc:493] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:42.729415 12546 raft_consensus.cc:3060] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Advancing to term 15
I20260709 14:52:42.730505  7775 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37136 (request call id 2594) took 1158 ms. Trace:
I20260709 14:52:42.731033  7775 rpcz_store.cc:276] 0709 14:52:41.572188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:41.622719 (+ 50531us) service_pool.cc:224] Handling call
0709 14:52:41.623146 (+   427us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:52:42.181157 (+558011us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:42.730160 (+549003us) spinlock_profiling.cc:243] Waited 557 ms on lock 0x7b54001d01d4. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae8ee01 00007fb68ae8d83e 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2 00007fb6891c948c 00007fb6891c88c6
0709 14:52:42.730383 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1281668992}
I20260709 14:52:42.733469 12525 consensus_queue.cc:1048] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.061s
I20260709 14:52:42.736078 12543 raft_consensus.cc:515] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:42.736792 12559 consensus_queue.cc:1059] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 14:52:42.712067 12258 raft_consensus.cc:2749] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 14:52:42.738221 12473 consensus_meta.cc:287] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0: Time spent flushing consensus metadata: real 0.593s	user 0.014s	sys 0.000s
I20260709 14:52:42.738709 12473 raft_consensus.cc:515] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:42.724557 12457 consensus_queue.cc:1059] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
W20260709 14:52:42.742226 12551 log.cc:927] Time spent T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 14:52:42.685529 12465 consensus_queue.cc:1048] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 14:52:42.745931 12430 leader_election.cc:290] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:52:42.705227 12544 log.cc:927] Time spent T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.097s	user 0.000s	sys 0.017s
I20260709 14:52:42.673820 12500 raft_consensus.cc:515] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:42.752540  7745 leader_election.cc:304] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:42.750238  7852 raft_consensus.cc:2468] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 14.
W20260709 14:52:42.759867  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 51436.5us
I20260709 14:52:42.766571 12562 raft_consensus.cc:3055] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 LEADER]: Stepping down as leader of term 14
I20260709 14:52:42.767587 12562 raft_consensus.cc:740] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
W20260709 14:52:42.770740  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 76670.7us
I20260709 14:52:42.774102  7849 raft_consensus.cc:1275] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 14:52:42.774699  7849 pending_rounds.cc:85] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting all ops after (but not including) 5
I20260709 14:52:42.775385  7849 pending_rounds.cc:107] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 14:52:42.749760 12500 leader_election.cc:290] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 14 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:52:42.781714  7742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:42.778283  7849 raft_consensus.cc:2889] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:52:42.763237 12258 raft_consensus.cc:2749] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 14:52:42.784300  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 89666.9us
I20260709 14:52:42.785516  7819 leader_election.cc:304] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:42.787612  7893 leader_election.cc:304] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:52:42.795409  7893 leader_election.cc:304] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:42.801395 12554 raft_consensus.cc:2804] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 14:52:42.802103 12554 raft_consensus.cc:493] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:42.802487 12554 raft_consensus.cc:3060] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 14:52:42.803440 12564 raft_consensus.cc:2749] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 14:52:42.805151  7893 leader_election.cc:304] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:52:42.807850 12564 raft_consensus.cc:2804] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 14:52:42.805361  7920 raft_consensus.cc:1240] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 LEADER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 14. Current term is 15. Ops: []
I20260709 14:52:42.769119 12562 consensus_queue.cc:260] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:42.808842  7893 leader_election.cc:304] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:42.790040 12383 raft_consensus.cc:2804] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 14:52:42.790706 12473 leader_election.cc:290] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:42.809981 12564 raft_consensus.cc:493] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:42.842070 12564 raft_consensus.cc:3060] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 14:52:42.844311 12458 leader_election.cc:290] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 14 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:42.845821 12562 raft_consensus.cc:3060] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Advancing to term 15
I20260709 14:52:42.848461  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:42.851758  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:42.822197 12383 raft_consensus.cc:493] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 14:52:42.829774  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 44363.5us
I20260709 14:52:42.853674 12383 raft_consensus.cc:3060] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 14:52:42.854557  7819 leader_election.cc:304] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:42.854705  7920 raft_consensus.cc:1240] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 LEADER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 11. Current term is 12. Ops: []
I20260709 14:52:42.855959  7819 leader_election.cc:304] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:42.856781  7920 raft_consensus.cc:1240] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 LEADER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 13. Current term is 14. Ops: []
I20260709 14:52:42.822798 12500 consensus_queue.cc:1059] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 14:52:42.858031 12500 raft_consensus.cc:2749] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 14:52:42.831177 12543 leader_election.cc:290] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 14 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:42.858577  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:42.827052 12479 raft_consensus.cc:2804] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 14:52:42.852720  7928 raft_consensus.cc:2393] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 10: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:52:42.860105 12479 raft_consensus.cc:493] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:42.858634 12536 raft_consensus.cc:3055] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 14:52:42.860581 12479 raft_consensus.cc:3060] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 14:52:42.793071 12501 raft_consensus.cc:515] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:42.860879 12536 raft_consensus.cc:740] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:42.861980 12536 consensus_queue.cc:260] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:42.858948  7819 leader_election.cc:304] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:52:42.828903  7744 leader_election.cc:304] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:42.867106  7744 leader_election.cc:304] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:42.868950  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
W20260709 14:52:42.857077 12558 log.cc:927] Time spent T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.128s	user 0.004s	sys 0.000s
I20260709 14:52:42.875118  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:42.872347  7819 leader_election.cc:304] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:42.827764 12457 raft_consensus.cc:2749] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 14:52:42.879034  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:42.879616  7847 raft_consensus.cc:3055] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 LEADER]: Stepping down as leader of term 14
I20260709 14:52:42.883009 12458 raft_consensus.cc:2749] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 14:52:42.883770  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:42.883814 12537 raft_consensus.cc:2804] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Leader election won for term 13
I20260709 14:52:42.858693 12500 raft_consensus.cc:2749] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 14:52:42.852591 12522 raft_consensus.cc:515] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:42.890318  7819 leader_election.cc:304] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:42.890455  7744 leader_election.cc:304] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:42.901033  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:42.968242  7853 raft_consensus.cc:1275] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 14:52:42.968591  7852 raft_consensus.cc:3060] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:52:42.902191  7847 raft_consensus.cc:740] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:52:42.863261 12501 leader_election.cc:290] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 16 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:42.875192 12543 raft_consensus.cc:2749] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 14:52:42.877466 12559 raft_consensus.cc:3055] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 LEADER]: Stepping down as leader of term 15
I20260709 14:52:42.905927  7849 raft_consensus.cc:2468] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 16.
I20260709 14:52:42.910852  7773 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37144 (request call id 3296) took 1398 ms. Trace:
I20260709 14:52:42.927341 12568 raft_consensus.cc:2749] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 14:52:43.034534  7894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:42.915053 12546 raft_consensus.cc:515] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:42.930204  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:42.915373 12520 raft_consensus.cc:493] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:52:42.989681  7745 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:43.021942  7773 rpcz_store.cc:276] 0709 14:52:41.512937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:41.513107 (+   170us) service_pool.cc:224] Handling call
0709 14:52:42.910551 (+1397444us) spinlock_profiling.cc:243] Waited 746 ms on lock 0x7b540014f0d4. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae922fa 00007fb68fe53b17 00007fb6893ce6d4 00007fb6893ce662 00007fb6893ce591 00007fb6893ce50c 00007fb6893cd7c2 00007fb6891c948c 00007fb6891c88c6 00007fb6891c826f
0709 14:52:42.910755 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1715429120}
W20260709 14:52:43.039363  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 149198us
W20260709 14:52:43.035374  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 145024us
I20260709 14:52:43.035952  7850 raft_consensus.cc:1240] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 17. Current term is 18. Ops: []
I20260709 14:52:43.041013  7819 leader_election.cc:304] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:52:43.037698 12383 raft_consensus.cc:515] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:43.044148 12383 leader_election.cc:290] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 15 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:43.046334 12375 raft_consensus.cc:493] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:43.047492 12429 raft_consensus.cc:493] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:43.048075 12429 raft_consensus.cc:515] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:42.910686 12554 raft_consensus.cc:515] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:43.050062  7845 raft_consensus.cc:1240] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 14. Current term is 15. Ops: []
I20260709 14:52:43.050123  7928 raft_consensus.cc:2393] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 15: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:52:43.046885 12375 raft_consensus.cc:515] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:42.966957 12490 raft_consensus.cc:493] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:43.062849  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:43.063597  7772 raft_consensus.cc:3060] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Advancing to term 14
I20260709 14:52:43.047575 12258 raft_consensus.cc:2804] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader election won for term 16
I20260709 14:52:43.034005 12559 raft_consensus.cc:740] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
W20260709 14:52:43.066290  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:43.068117  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:43.061439  7894 leader_election.cc:304] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:43.069667  7819 leader_election.cc:304] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:52:43.081732  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:43.052202 12272 raft_consensus.cc:493] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:43.053785 12457 raft_consensus.cc:2749] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 14:52:43.089054 12555 raft_consensus.cc:2804] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Leader election won for term 15
I20260709 14:52:43.090339 12473 consensus_queue.cc:1048] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 14:52:43.089438 11963 raft_consensus.cc:2749] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 14:52:43.089236  7852 raft_consensus.cc:2468] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 12.
I20260709 14:52:43.092541 12569 consensus_queue.cc:1059] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 14:52:43.038038 12537 raft_consensus.cc:697] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:52:43.095923  7773 raft_consensus.cc:1275] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 14:52:43.097592  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:43.125897  7920 raft_consensus.cc:2393] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 14: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:52:43.047397 12546 leader_election.cc:290] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:43.087989  7894 leader_election.cc:304] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:43.102694  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:43.103395  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:43.128427  7771 raft_consensus.cc:2410] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 14:52:43.103945  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:43.104825  7770 raft_consensus.cc:1275] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 14:52:43.105305  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:43.105719  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:43.130015  7927 raft_consensus.cc:2393] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 12: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:52:43.096415  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:43.106889  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783e4874513449ef9084b833f188a6d3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:43.107805  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:43.102694  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:43.044870 12564 raft_consensus.cc:515] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:43.134277  7924 raft_consensus.cc:2393] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 13: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:52:43.111418  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:43.135138  7778 raft_consensus.cc:2468] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 16.
I20260709 14:52:43.069535 12568 raft_consensus.cc:2804] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Leader election won for term 14
I20260709 14:52:43.113396 12530 consensus_queue.cc:1048] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.064s
I20260709 14:52:43.113850 12429 leader_election.cc:290] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:52:43.158052 12571 log.cc:927] Time spent T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260709 14:52:43.160694  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:43.115746 12244 raft_consensus.cc:493] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:43.115144 12375 leader_election.cc:290] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:43.059569 12542 raft_consensus.cc:493] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:43.165740 12244 raft_consensus.cc:515] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:43.166582 12542 raft_consensus.cc:515] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:43.168241 12244 leader_election.cc:290] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:43.168536 12542 leader_election.cc:290] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:43.127389  7926 raft_consensus.cc:2468] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 13.
I20260709 14:52:43.065143 12543 consensus_queue.cc:1059] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.065s
I20260709 14:52:43.170926 12543 consensus_queue.cc:1243] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer 1e9289592458429bbddb19c2e7b7b7b0 log is divergent from this leader: its last log entry 14.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 14:52:43.131250 12555 raft_consensus.cc:697] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:52:43.129160  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:43.177368  7920 raft_consensus.cc:3060] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 14:52:43.145756 12537 consensus_queue.cc:237] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:43.146857  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:43.181546  7773 raft_consensus.cc:2393] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 12: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:52:43.177441  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:43.149884  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:43.152354 12480 consensus_queue.cc:1048] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 14:52:43.153518 12568 raft_consensus.cc:697] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:52:43.075958 12490 raft_consensus.cc:515] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:43.083021 12278 consensus_queue.cc:1048] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 14:52:43.172693 12555 consensus_queue.cc:237] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:43.192543 12568 consensus_queue.cc:237] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:43.166630  7854 raft_consensus.cc:3060] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Advancing to term 13
I20260709 14:52:43.172468  7772 raft_consensus.cc:2468] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 14.
I20260709 14:52:43.134473 12528 raft_consensus.cc:2804] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 14:52:43.066572 12520 raft_consensus.cc:515] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:43.116196 12258 raft_consensus.cc:697] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:52:43.160889  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:43.199071  7775 raft_consensus.cc:3060] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Advancing to term 14
I20260709 14:52:43.082038 12562 consensus_queue.cc:1059] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.050s
I20260709 14:52:43.112351 12501 consensus_queue.cc:1059] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.069s
I20260709 14:52:43.196372  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:43.201853  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:43.198185 11963 consensus_queue.cc:1048] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 14:52:43.202975  7771 raft_consensus.cc:3055] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 LEADER]: Stepping down as leader of term 13
I20260709 14:52:43.207967  7773 raft_consensus.cc:3060] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Advancing to term 15
I20260709 14:52:43.211445  7772 raft_consensus.cc:2468] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 15.
I20260709 14:52:43.213629  7771 raft_consensus.cc:740] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:52:43.220366  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:43.221479  7772 raft_consensus.cc:2468] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 12.
W20260709 14:52:43.203477  8599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 161295us
I20260709 14:52:43.110863 12272 raft_consensus.cc:515] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:43.208106  8598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 147578us
I20260709 14:52:43.229959  7854 raft_consensus.cc:1275] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 14:52:43.230456  7854 pending_rounds.cc:85] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting all ops after (but not including) 7
I20260709 14:52:43.230736  7854 pending_rounds.cc:107] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 14:52:43.230979  7854 raft_consensus.cc:2889] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:52:43.235529  7922 raft_consensus.cc:3060] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 14:52:43.122664 12566 consensus_queue.cc:1048] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.092s
I20260709 14:52:43.200394 12522 leader_election.cc:290] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 18 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:43.228652 12528 raft_consensus.cc:697] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:43.249136  7775 raft_consensus.cc:2468] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 14.
I20260709 14:52:43.205776 12437 raft_consensus.cc:493] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:52:43.249974  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 146776us
I20260709 14:52:43.262264  7771 consensus_queue.cc:260] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:43.267211  7744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:52:43.276031  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 116427us
I20260709 14:52:43.282389  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:43.268165  7819 leader_election.cc:304] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
W20260709 14:52:43.339581  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 56403us
W20260709 14:52:43.340129  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 72080.8us
I20260709 14:52:43.233162 12535 consensus_queue.cc:1048] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 14:52:43.342124  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
W20260709 14:52:43.350143  7745 leader_election.cc:336] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 1.620s (SENT)
I20260709 14:52:43.350765  7745 leader_election.cc:304] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:43.275168 12546 raft_consensus.cc:493] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:52:43.281872 12506 consensus_meta.cc:287] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent flushing consensus metadata: real 0.686s	user 0.006s	sys 0.009s
I20260709 14:52:43.282719  7893 leader_election.cc:304] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:52:43.350937  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 150344us
W20260709 14:52:43.361932  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 79344.9us
I20260709 14:52:43.363209  7893 leader_election.cc:304] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:52:43.368213 12479 raft_consensus.cc:515] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:43.370026 12542 raft_consensus.cc:2749] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 14:52:43.365115 12546 raft_consensus.cc:515] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:43.373926  7771 raft_consensus.cc:3060] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Advancing to term 14
I20260709 14:52:43.277504 12457 consensus_queue.cc:1048] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.079s
I20260709 14:52:43.377924 12561 raft_consensus.cc:493] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:43.380925 12554 leader_election.cc:290] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 15 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:43.364807 12430 raft_consensus.cc:2749] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 14:52:43.383594 12546 leader_election.cc:290] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:43.384053 12528 consensus_queue.cc:237] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:43.274030 12501 consensus_queue.cc:1059] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.091s
I20260709 14:52:43.273764 12437 raft_consensus.cc:515] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:43.353200 12522 raft_consensus.cc:2804] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 14:52:43.392895 11963 raft_consensus.cc:2804] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 14:52:43.419647 11963 raft_consensus.cc:493] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:43.420076 11963 raft_consensus.cc:3060] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 14:52:43.420313  7920 raft_consensus.cc:2468] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 14.
W20260709 14:52:43.393584  8599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 161130us
I20260709 14:52:43.398679  7893 leader_election.cc:304] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:43.400669  7922 raft_consensus.cc:2468] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 14.
I20260709 14:52:43.425640 12437 leader_election.cc:290] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:43.429775 12383 raft_consensus.cc:2749] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 14:52:43.431226  7893 leader_election.cc:304] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:52:43.432272 12430 raft_consensus.cc:2804] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 14:52:43.432787 12430 raft_consensus.cc:493] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:43.433288 12430 raft_consensus.cc:3060] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 14:52:43.419083 12522 raft_consensus.cc:493] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:43.432399  7893 leader_election.cc:304] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:52:43.397184 12377 raft_consensus.cc:493] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:52:43.449397  7893 leader_election.cc:304] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:43.438014 12559 consensus_queue.cc:260] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:43.448881  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 100559us
I20260709 14:52:43.352492 12258 consensus_queue.cc:237] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:43.459542  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18d29d52d304c87b930d4fb5eaf50b1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:43.460390  7854 raft_consensus.cc:2376] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 11. Re-sending same reply.
I20260709 14:52:43.462999  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:52:43.456519  8598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 222855us
I20260709 14:52:43.464521 11963 raft_consensus.cc:515] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:43.463375  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:43.463788  7845 raft_consensus.cc:2468] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 13.
I20260709 14:52:43.493991  7848 raft_consensus.cc:2368] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 13. Current term is 14.
I20260709 14:52:43.399096 12561 raft_consensus.cc:515] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:43.500552  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:43.410887 12534 consensus_queue.cc:1048] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 14:52:43.449591 12522 raft_consensus.cc:3060] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Advancing to term 14
I20260709 14:52:43.397814 12566 consensus_queue.cc:1048] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 14:52:43.432838 12506 raft_consensus.cc:493] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:52:43.495069  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:43.484483  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:43.449270 12427 raft_consensus.cc:493] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:43.497130  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
W20260709 14:52:43.761718 12537 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.003s	sys 0.009s
I20260709 14:52:43.724249 12524 consensus_queue.cc:1048] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 14:52:43.571880 12552 raft_consensus.cc:3055] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 LEADER]: Stepping down as leader of term 14
I20260709 14:52:43.572701  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:43.597265  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:43.740303 12547 raft_consensus.cc:493] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:52:43.614532 12567 log.cc:927] Time spent T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.578s	user 0.005s	sys 0.000s
I20260709 14:52:43.388942  6549 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 14:52:43.743777 12569 raft_consensus.cc:3055] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 LEADER]: Stepping down as leader of term 14
I20260709 14:52:43.789775  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:43.790144 12569 raft_consensus.cc:740] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:52:43.791256  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:43.792095  7852 raft_consensus.cc:2468] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 14.
I20260709 14:52:43.582517  7675 catalog_manager.cc:5697] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } } }
I20260709 14:52:43.550549 11963 leader_election.cc:290] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 17 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:43.589777 12536 raft_consensus.cc:3060] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Advancing to term 13
W20260709 14:52:43.570981 12584 log.cc:927] Time spent T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 14:52:43.588466  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:43.462416 12554 raft_consensus.cc:2804] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 14:52:43.604393  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:52:43.598688 12580 log.cc:927] Time spent T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.113s	user 0.000s	sys 0.001s
I20260709 14:52:43.784878 12547 raft_consensus.cc:515] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:43.646037  7894 leader_election.cc:304] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed
W20260709 14:52:43.793633 12568 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.002s	sys 0.014s
I20260709 14:52:43.456219 12377 raft_consensus.cc:515] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:43.546847 12490 leader_election.cc:290] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:43.594151 12272 leader_election.cc:290] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:43.588034 12561 leader_election.cc:290] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:43.791216 12569 consensus_queue.cc:260] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:43.818286 12569 raft_consensus.cc:3060] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Advancing to term 15
I20260709 14:52:43.585664 12479 leader_election.cc:290] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:52:43.582451 12583 log.cc:927] Time spent T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.211s	user 0.002s	sys 0.000s
I20260709 14:52:43.420490 12546 consensus_queue.cc:1059] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 14:52:43.609472 12501 raft_consensus.cc:493] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:43.654790  7744 leader_election.cc:304] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:52:43.454865 12563 raft_consensus.cc:2804] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 14:52:43.722620  7773 consensus_meta.cc:287] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent flushing consensus metadata: real 0.503s	user 0.010s	sys 0.002s
I20260709 14:52:43.770394  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:43.598986 12562 raft_consensus.cc:3055] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 LEADER]: Stepping down as leader of term 12
W20260709 14:52:43.572800  7745 leader_election.cc:336] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 1.944s (SENT)
W20260709 14:52:43.594787 12572 log.cc:927] Time spent T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.361s	user 0.000s	sys 0.003s
I20260709 14:52:43.597936  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:52:43.911718 12599 log.cc:927] Time spent T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 14:52:43.912606  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:43.569029  7850 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 3751) took 1123 ms. Trace:
I20260709 14:52:43.774564  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:43.778278  7845 raft_consensus.cc:2393] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 10: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:52:43.778609  7920 raft_consensus.cc:2468] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 11.
I20260709 14:52:43.497627  7771 raft_consensus.cc:1275] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 14:52:43.782953  7848 raft_consensus.cc:2393] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 12: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:52:43.916162  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:43.916936  7845 raft_consensus.cc:3060] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Advancing to term 17
W20260709 14:52:43.917433 12488 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 14 current term: 14 is higher.
I20260709 14:52:43.783669 12590 raft_consensus.cc:493] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:43.784144 12552 raft_consensus.cc:740] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:52:43.921952 12590 raft_consensus.cc:515] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:43.917084  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:43.922631 12552 consensus_queue.cc:260] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:43.924388 12552 raft_consensus.cc:3060] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Advancing to term 15
I20260709 14:52:43.778693 12559 raft_consensus.cc:3060] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Advancing to term 16
I20260709 14:52:43.794206  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:52:43.779883 12537 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.584s	user 0.003s	sys 0.010s
I20260709 14:52:43.777328 12500 raft_consensus.cc:493] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:43.796350  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:43.603276 12564 leader_election.cc:290] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 13 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:52:43.802747  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:52:43.929698  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:43.740669  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
W20260709 14:52:43.805291  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 159328us
I20260709 14:52:43.930909  7772 raft_consensus.cc:3060] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Advancing to term 13
I20260709 14:52:43.812736  7778 raft_consensus.cc:1275] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 14:52:43.932667 12536 consensus_queue.cc:1059] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 14:52:43.933763 12156 consensus_queue.cc:1048] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 14:52:43.782015 12427 raft_consensus.cc:515] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:43.782066 12506 raft_consensus.cc:515] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:43.825733  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783e4874513449ef9084b833f188a6d3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:43.951424  7853 raft_consensus.cc:2468] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 11.
I20260709 14:52:43.952729  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:43.954162  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:43.955286  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:43.955856  7853 raft_consensus.cc:2468] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 13.
I20260709 14:52:43.956657  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:52:43.804734 12568 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.547s	user 0.003s	sys 0.014s
I20260709 14:52:43.829387  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:43.943024 12500 raft_consensus.cc:515] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:43.958703  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:43.950623 12503 raft_consensus.cc:493] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:43.959991  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:43.960258 12503 raft_consensus.cc:515] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:52:43.961215 12590 leader_election.cc:290] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:43.962001  7851 raft_consensus.cc:3060] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Advancing to term 15
I20260709 14:52:43.962567 12503 leader_election.cc:290] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68:42321)
I20260709 14:52:43.831418  7922 raft_consensus.cc:2393] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 15: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
W20260709 14:52:43.832259  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 177551us
W20260709 14:52:43.831176  7819 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:43.802289 12554 raft_consensus.cc:697] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:43.835664  7846 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 3749) took 1418 ms. Trace:
I20260709 14:52:43.826439 12528 raft_consensus.cc:2804] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 14:52:43.968034  7846 rpcz_store.cc:276] 0709 14:52:42.417394 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:42.444521 (+ 27127us) service_pool.cc:224] Handling call
0709 14:52:42.470097 (+ 25576us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:52:42.681422 (+211325us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:52:42.681466 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:52:42.693045 (+ 11579us) log.cc:844] Serialized 26 byte log entry
0709 14:52:42.793474 (+100429us) raft_consensus.cc:1645] Marking committed up to 6
0709 14:52:42.793513 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:42.793590 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:52:43.549036 (+755446us) spinlock_profiling.cc:243] Waited 14 ms on lock 0x7b4400022b4c. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb687c29db1 00007fb687cc7c85 00007fb687cc86a2 00007fb68aa3a1db 00007fb68aa35aaf 00007fb68aa2986e 00007fb68aa28bb6 00007fb68aa287d8 00007fb68aa32221 00007fb68aa321d9 00007fb68aa32169
0709 14:52:43.834760 (+285724us) raft_consensus.cc:1685] finished
0709 14:52:43.834791 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:43.835576 (+   785us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":84097,"raft.run_cpu_time_us":42,"raft.run_wall_time_us":42,"spinlock_wait_cycles":32141184,"thread_start_us":225360,"threads_started":2,"wal-append.queue_time_us":186513}
I20260709 14:52:43.833003 12562 raft_consensus.cc:740] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:52:43.834663 12542 raft_consensus.cc:2804] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 14:52:43.830749 12563 raft_consensus.cc:493] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:43.836709 12546 consensus_queue.cc:1243] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer 1e9289592458429bbddb19c2e7b7b7b0 log is divergent from this leader: its last log entry 15.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 14:52:43.835157 12430 raft_consensus.cc:515] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:43.832595 12501 raft_consensus.cc:515] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:43.856609 12589 log.cc:927] Time spent T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.265s	user 0.006s	sys 0.000s
I20260709 14:52:43.867084 12377 leader_election.cc:290] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:43.869581 12592 raft_consensus.cc:493] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:43.870790  7777 raft_consensus.cc:1275] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 14:52:43.883318  7770 raft_consensus.cc:1275] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 14:52:43.886452 12578 raft_consensus.cc:493] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:43.911099  7745 leader_election.cc:304] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:43.913702  7850 rpcz_store.cc:276] 0709 14:52:42.445627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:42.475918 (+ 30291us) service_pool.cc:224] Handling call
0709 14:52:42.476389 (+   471us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:52:43.041587 (+565198us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:43.555288 (+513701us) spinlock_profiling.cc:243] Waited 559 ms on lock 0x7b540013ced4. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae8ee01 00007fb68ae8d83e 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2 00007fb6891c948c 00007fb6891c88c6
0709 14:52:43.568552 (+ 13264us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1286406016}
I20260709 14:52:43.926177  7852 raft_consensus.cc:2468] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 15.
I20260709 14:52:43.960677  7853 raft_consensus.cc:3060] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Advancing to term 15
I20260709 14:52:43.832866  7773 raft_consensus.cc:2468] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 15.
I20260709 14:52:43.952612  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:52:43.966207  7819 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:43.971360 12547 leader_election.cc:290] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:43.965283  7744 leader_election.cc:304] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:52:43.934721 12479 raft_consensus.cc:3055] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 14:52:43.971666  7772 raft_consensus.cc:2468] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 13.
I20260709 14:52:43.974588 12563 raft_consensus.cc:3060] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 14:52:43.978233  7851 raft_consensus.cc:2468] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 15.
I20260709 14:52:43.959384 12506 leader_election.cc:290] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:43.920573 12522 raft_consensus.cc:515] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:44.005940  7854 raft_consensus.cc:2393] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 14: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
W20260709 14:52:43.966291  7894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:43.989022  7845 raft_consensus.cc:2468] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 17.
I20260709 14:52:43.997809  7744 leader_election.cc:304] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:52:43.993161  8639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18d29d52d304c87b930d4fb5eaf50b1" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9418391fa82a42c79c6cad13ba91d964" is_pre_election: true
I20260709 14:52:43.959544 12500 leader_election.cc:290] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:43.987782 12528 raft_consensus.cc:697] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:43.972630 12542 raft_consensus.cc:493] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:43.978580 12473 raft_consensus.cc:493] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:44.005570 12568 consensus_queue.cc:1059] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 14:52:44.000152  7819 leader_election.cc:304] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
W20260709 14:52:44.055047  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 54971.4us
I20260709 14:52:44.056020  7819 leader_election.cc:304] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
W20260709 14:52:44.005630  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 432855us
I20260709 14:52:44.006924  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:44.059026  7852 raft_consensus.cc:2468] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 15.
I20260709 14:52:44.003146 12488 raft_consensus.cc:2804] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader election won for term 14
I20260709 14:52:44.063454  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:44.063877 12488 raft_consensus.cc:697] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:52:44.001468 12479 raft_consensus.cc:740] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:44.016860  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:44.015846  7744 leader_election.cc:304] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
W20260709 14:52:44.066259  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 50513us
W20260709 14:52:44.060983  7745 leader_election.cc:336] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 1.716s (SENT)
I20260709 14:52:44.017418  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:44.067487  7927 raft_consensus.cc:2468] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 13.
W20260709 14:52:44.067797  7745 leader_election.cc:336] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 1.719s (SENT)
I20260709 14:52:44.018016  7853 raft_consensus.cc:2468] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 15.
I20260709 14:52:44.016196  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:44.022603  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:44.029372  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:44.031636 12547 raft_consensus.cc:2804] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader election won for term 14
I20260709 14:52:44.021596  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:44.029683  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:44.062713  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:44.068796  7745 leader_election.cc:304] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:44.071099  7925 raft_consensus.cc:2368] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 14. Current term is 15.
I20260709 14:52:44.016786  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: true dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:44.071640  7819 leader_election.cc:304] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:44.072233  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:44.074270  7919 raft_consensus.cc:1240] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 15. Current term is 16. Ops: []
I20260709 14:52:44.076280  7922 raft_consensus.cc:1240] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 14. Current term is 15. Ops: []
I20260709 14:52:44.081048  7919 raft_consensus.cc:1240] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 14:52:44.082118  7927 raft_consensus.cc:1240] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 14:52:44.089228  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:44.090728  7819 leader_election.cc:304] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:44.093371  7924 raft_consensus.cc:1275] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 14:52:44.093686  7745 leader_election.cc:304] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:52:44.095894  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:44.064107 12427 leader_election.cc:290] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:44.023473 12506 raft_consensus.cc:2749] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 14:52:44.029649 12542 raft_consensus.cc:3060] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Advancing to term 14
I20260709 14:52:44.103379  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:44.107775  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:44.020776 12528 consensus_queue.cc:237] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:44.000113 12592 raft_consensus.cc:515] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:44.105556  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:44.125794  7777 raft_consensus.cc:2468] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 12.
I20260709 14:52:44.007114 12546 consensus_queue.cc:1059] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.084s
W20260709 14:52:44.090229 12597 log.cc:927] Time spent T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.240s	user 0.001s	sys 0.001s
I20260709 14:52:44.070281 12500 raft_consensus.cc:2749] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 14:52:44.089737 12590 raft_consensus.cc:2804] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 14:52:44.129309  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:44.130252 12568 consensus_queue.cc:1059] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 14:52:44.091571 12258 raft_consensus.cc:2804] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 14:52:43.999478 12578 raft_consensus.cc:515] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:44.126571  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: true dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:44.132161  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:44.066457 12473 raft_consensus.cc:515] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:44.134241  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:44.098097 12569 raft_consensus.cc:2749] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 14:52:43.999998 12555 raft_consensus.cc:493] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
W20260709 14:52:44.146090  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:44.233949  7923 raft_consensus.cc:2468] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 13.
W20260709 14:52:44.128322 12589 log.cc:927] Time spent T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 14:52:44.132951  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:44.241009  7776 raft_consensus.cc:1275] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 14:52:44.220522  7770 raft_consensus.cc:2393] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 13: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:52:44.241462  7852 raft_consensus.cc:2410] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for term 16 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
W20260709 14:52:44.221118  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 122300us
I20260709 14:52:44.220554  7775 raft_consensus.cc:2368] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 14. Current term is 15.
I20260709 14:52:44.218726 12590 raft_consensus.cc:493] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:44.202167 12506 raft_consensus.cc:2749] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 14:52:44.134613 12577 raft_consensus.cc:2749] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 14:52:44.119282 12457 raft_consensus.cc:2804] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 14:52:44.164160  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:44.248608  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:44.245220  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:44.250487  7852 raft_consensus.cc:2468] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 16.
I20260709 14:52:44.071272 12562 consensus_queue.cc:260] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:44.203292 12258 raft_consensus.cc:493] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:44.245935  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:44.064965 12488 consensus_queue.cc:237] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:44.261345  7819 leader_election.cc:304] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:52:44.246457  7776 raft_consensus.cc:1275] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 14:52:44.243526  7848 raft_consensus.cc:2468] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 7.
I20260709 14:52:44.252139  7773 raft_consensus.cc:1240] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 13. Current term is 14. Ops: []
I20260709 14:52:44.250800  7778 raft_consensus.cc:1240] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 LEADER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 15. Current term is 16. Ops: []
I20260709 14:52:44.255445 12522 leader_election.cc:290] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 14 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:44.102902 12479 consensus_queue.cc:260] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:44.266783  7819 leader_election.cc:304] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
W20260709 14:52:44.264074  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 136375us
I20260709 14:52:44.273509  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:44.277998  7852 raft_consensus.cc:2468] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 10.
I20260709 14:52:44.278084  7779 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 3322) took 1207 ms. Trace:
I20260709 14:52:44.279388  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:44.282003  7778 raft_consensus.cc:1240] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 12. Current term is 13. Ops: []
I20260709 14:52:44.263274 12258 raft_consensus.cc:3060] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:52:44.294981 12258 raft_consensus.cc:515] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:44.295617 12473 leader_election.cc:290] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:44.266186 12577 raft_consensus.cc:493] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:44.298702 12258 leader_election.cc:290] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 12 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:44.257072 12457 raft_consensus.cc:493] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:44.298298 12577 raft_consensus.cc:515] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:44.299474 12457 raft_consensus.cc:3060] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Advancing to term 14
I20260709 14:52:44.263525 12569 consensus_queue.cc:1048] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 14:52:44.249643 12555 raft_consensus.cc:515] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:44.307183 12592 leader_election.cc:290] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:44.278779  7779 rpcz_store.cc:276] 0709 14:52:43.070918 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:43.071066 (+   148us) service_pool.cc:224] Handling call
0709 14:52:43.110343 (+ 39277us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:52:43.264733 (+154390us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:52:43.264769 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:52:43.265877 (+  1108us) log.cc:844] Serialized 26 byte log entry
0709 14:52:43.366614 (+100737us) spinlock_profiling.cc:243] Waited 14.9 ms on lock 0x7b480006c3d8. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68fdb7aa1 00007fb68fdaeb37 00007fb68fdae9ca 00007fb68fea626f 00007fb68fea5f37 00007fb68feba55c 00007fb68feba508 00007fb68feba488 00007fb68feba443 00007fb68feb96ec 00007fb68ede3a96
0709 14:52:43.445271 (+ 78657us) raft_consensus.cc:1645] Marking committed up to 9
0709 14:52:43.483078 (+ 37807us) log.cc:844] Serialized 14 byte log entry
0709 14:52:43.483377 (+   299us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:43.483473 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:52:43.856093 (+372620us) spinlock_profiling.cc:243] Waited 1.65 ms on lock 0x7b240015b078. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb687c29db1 00007fb687c279c4 00007fb687c25acb 00007fb687de0dc9 00007fb687de0a55 00007fb687de009d 00007fb68aa1210e 00007fb68aa2988c 00007fb68aa28bb6 00007fb68aa287d8 00007fb68aa32221
0709 14:52:44.277821 (+421728us) raft_consensus.cc:1685] finished
0709 14:52:44.277847 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:44.278013 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11385,"prepare.queue_time_us":35374,"prepare.run_cpu_time_us":274,"prepare.run_wall_time_us":1543,"raft.queue_time_us":58501,"raft.run_cpu_time_us":1355,"raft.run_wall_time_us":269545,"spinlock_wait_cycles":38048256,"thread_start_us":242511,"threads_started":2,"wal-append.queue_time_us":279576}
I20260709 14:52:44.124135 12554 consensus_queue.cc:237] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:44.326833  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 233247us
I20260709 14:52:44.272964 12605 raft_consensus.cc:2764] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 14:52:44.336514  7745 leader_election.cc:304] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:44.340384  7745 leader_election.cc:304] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:44.342105  7847 consensus_queue.cc:260] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:44.346882  7847 raft_consensus.cc:3060] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Advancing to term 15
I20260709 14:52:44.308159 12430 leader_election.cc:290] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:44.352192  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:44.353014  7776 raft_consensus.cc:3060] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Advancing to term 15
I20260709 14:52:44.358161  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:44.358937  7778 raft_consensus.cc:2468] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 15.
I20260709 14:52:44.327605 12522 raft_consensus.cc:2804] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 14:52:44.361411  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:44.254355 12590 raft_consensus.cc:3060] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:52:44.371023  7745 leader_election.cc:400] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Vote denied by peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529) with higher term. Message: Invalid argument: T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 13. Current term is 14.
I20260709 14:52:44.371662  7745 leader_election.cc:403] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 14:52:44.373950  7849 raft_consensus.cc:1240] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 15. Current term is 16. Ops: []
I20260709 14:52:44.378137 12592 raft_consensus.cc:493] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:44.386890 12592 raft_consensus.cc:515] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:44.394285 12592 leader_election.cc:290] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:44.401901 12590 raft_consensus.cc:515] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:44.405283 12590 leader_election.cc:290] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 10 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:44.363924 12522 raft_consensus.cc:493] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:44.409875 12522 raft_consensus.cc:3060] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Advancing to term 14
I20260709 14:52:44.345093 12437 raft_consensus.cc:2749] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 14:52:44.413429 12473 consensus_queue.cc:1048] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 14:52:44.416193 12473 consensus_queue.cc:1048] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 14:52:44.418910  7893 leader_election.cc:304] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:52:44.420436 12272 raft_consensus.cc:2749] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529) with higher term. Message: Invalid argument: T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 13. Current term is 14.
I20260709 14:52:44.421797 12529 consensus_queue.cc:1048] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 14:52:44.420199 12522 raft_consensus.cc:515] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:44.424503 12577 leader_election.cc:290] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:44.427168  7849 raft_consensus.cc:1240] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 12. Current term is 13. Ops: []
I20260709 14:52:44.426568  7894 leader_election.cc:304] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
W20260709 14:52:44.432077  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 61482.9us
I20260709 14:52:44.434751  7893 leader_election.cc:304] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:52:44.442936  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:44.363303 12258 raft_consensus.cc:2749] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 14:52:44.450253  7745 leader_election.cc:304] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:52:44.471019  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 44571.4us
I20260709 14:52:44.471073  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
W20260709 14:52:44.456128  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:44.472030  7775 raft_consensus.cc:3060] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Advancing to term 17
W20260709 14:52:44.457708  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 180712us
I20260709 14:52:44.470739  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:44.473201  7770 raft_consensus.cc:3060] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Advancing to term 14
I20260709 14:52:44.472051  7894 leader_election.cc:304] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:44.474972  7819 leader_election.cc:400] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 14 election: Vote denied by peer 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785) with higher term. Message: Invalid argument: T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 14. Current term is 15.
I20260709 14:52:44.475375  7819 leader_election.cc:403] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 14:52:44.478602  7779 raft_consensus.cc:1275] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 14:52:44.479213  7847 raft_consensus.cc:1275] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 14:52:44.480198  7847 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 3765) took 1601 ms. Trace:
I20260709 14:52:44.455588  7776 raft_consensus.cc:2468] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 15.
I20260709 14:52:44.487839  7745 leader_election.cc:304] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:44.490715  7745 leader_election.cc:304] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:44.484481  7894 leader_election.cc:304] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:44.487099  7847 rpcz_store.cc:276] 0709 14:52:42.879020 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:42.879139 (+   119us) service_pool.cc:224] Handling call
0709 14:52:42.879446 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:52:43.591858 (+712412us) spinlock_profiling.cc:243] Waited 71.7 ms on lock 0x7b4c0024c8c0. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68915aa20 00007fb68916ba29 00007fb689131644 00007fb689158f2d 00007fb689158b93 00007fb68ae8918b 00007fb68ae89cb5 00007fb68ae84f30 00007fb68ae867de 00007fb68ae90b49 00007fb68ae91416
0709 14:52:44.325269 (+733411us) spinlock_profiling.cc:243] Waited 383 ms on lock 0x7b540006c320. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae0c06f 00007fb68ae84f60 00007fb68ae867de 00007fb68ae90b49 00007fb68ae91416 00007fb68ae8dd8f 00007fb68ae8d83e 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62
0709 14:52:44.479799 (+154530us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:44.480112 (+   313us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1044817024}
W20260709 14:52:44.500372  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:44.447523 12490 raft_consensus.cc:2804] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 14:52:44.503507  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:44.492901  7745 leader_election.cc:304] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:44.506669  7776 raft_consensus.cc:2468] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 16.
I20260709 14:52:44.421365 12560 consensus_queue.cc:1048] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
W20260709 14:52:44.509923  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 75326.1us
I20260709 14:52:44.516521  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
W20260709 14:52:44.494418 12559 consensus_meta.cc:287] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent flushing consensus metadata: real 0.569s	user 0.013s	sys 0.000s
I20260709 14:52:44.510015  7924 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
mode: GRACEFUL
new_leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:48676
I20260709 14:52:44.505458 12437 raft_consensus.cc:3060] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Advancing to term 13
I20260709 14:52:44.522718  7924 raft_consensus.cc:606] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 LEADER]: Received request to transfer leadership to TS 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:52:44.522626  7745 leader_election.cc:304] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:44.505779 12258 raft_consensus.cc:2749] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 14:52:44.477588 12546 raft_consensus.cc:493] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:44.494580 12536 raft_consensus.cc:2804] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 14:52:44.440747 12377 consensus_queue.cc:1059] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.063s
I20260709 14:52:44.534485  7745 leader_election.cc:304] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:44.540580  7775 raft_consensus.cc:2468] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 17.
I20260709 14:52:44.493953 12568 raft_consensus.cc:2749] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785) with higher term. Message: Invalid argument: T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 14. Current term is 15.
I20260709 14:52:44.505832 12577 raft_consensus.cc:2749] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 14:52:44.543092  7847 raft_consensus.cc:1275] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 14:52:44.459514 12457 raft_consensus.cc:515] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:44.546445  7770 raft_consensus.cc:2468] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 14.
I20260709 14:52:44.514966 12564 raft_consensus.cc:2804] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 14:52:44.522300 12488 raft_consensus.cc:2764] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 14:52:44.556778  7922 raft_consensus.cc:1240] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 LEADER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 13. Current term is 14. Ops: []
I20260709 14:52:44.503286 12590 consensus_queue.cc:1059] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.052s
I20260709 14:52:44.509106 12542 raft_consensus.cc:515] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:44.501765 12592 consensus_queue.cc:1059] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
W20260709 14:52:44.546939 12552 consensus_meta.cc:287] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent flushing consensus metadata: real 0.622s	user 0.015s	sys 0.000s
I20260709 14:52:44.544732 12272 raft_consensus.cc:2749] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 14:52:44.519318 12534 raft_consensus.cc:2804] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 14:52:44.534603 12156 raft_consensus.cc:2804] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 14:52:44.552318 12606 raft_consensus.cc:493] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:44.515219 12561 consensus_queue.cc:1059] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 14:52:44.590245 12561 raft_consensus.cc:3055] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 14:52:44.590745 12561 raft_consensus.cc:740] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:44.574587 12534 raft_consensus.cc:493] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:52:44.592031 12534 raft_consensus.cc:3060] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 14:52:44.591696 12561 consensus_queue.cc:260] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:44.558871 12609 raft_consensus.cc:493] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:44.560568  7770 raft_consensus.cc:1240] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 14:52:44.547698 12559 raft_consensus.cc:493] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:44.565554 12577 raft_consensus.cc:2749] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 14:52:44.564520 12457 leader_election.cc:290] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 14 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:44.558766 12564 raft_consensus.cc:493] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:44.580927  7772 raft_consensus.cc:2393] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 14: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:52:44.581928  7845 raft_consensus.cc:2410] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for term 16 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
W20260709 14:52:44.587817 12563 consensus_meta.cc:287] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent flushing consensus metadata: real 0.564s	user 0.011s	sys 0.001s
I20260709 14:52:44.554920  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:44.618510  7847 raft_consensus.cc:2468] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 16.
I20260709 14:52:44.619937  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:44.549757 12546 raft_consensus.cc:515] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:44.635615  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 101227us
I20260709 14:52:44.641669  7745 leader_election.cc:304] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:44.646063  7847 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 3774) took 1034 ms. Trace:
I20260709 14:52:44.654934  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18d29d52d304c87b930d4fb5eaf50b1" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:44.597793 12568 raft_consensus.cc:493] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:44.676565 12622 raft_consensus.cc:493] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:44.602921 12561 raft_consensus.cc:3060] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 14:52:44.677484 12622 raft_consensus.cc:515] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:44.642288 12615 log.cc:927] Time spent T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
W20260709 14:52:44.642401 12616 log.cc:927] Time spent T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 14:52:44.642077 12614 log.cc:927] Time spent T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 14:52:44.685487  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:44.686836 12520 leader_election.cc:290] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:44.687381  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:44.688196  7779 raft_consensus.cc:2468] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 13.
I20260709 14:52:44.689756  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c563cc7cfbe4d59be4ffc5cf847ce56" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:44.690632 12500 raft_consensus.cc:3055] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 LEADER]: Stepping down as leader of term 13
I20260709 14:52:44.691239 12500 raft_consensus.cc:740] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:52:44.602322 12606 raft_consensus.cc:515] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:44.691514  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:44.693130  7854 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3809) took 1066 ms. Trace:
I20260709 14:52:44.643254 12609 raft_consensus.cc:515] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:44.660725  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:44.642345 12564 raft_consensus.cc:3060] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 14:52:44.642503 12156 raft_consensus.cc:697] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:44.651155 12272 raft_consensus.cc:2749] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 14:52:44.693882  7854 rpcz_store.cc:276] 0709 14:52:43.626852 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:43.803824 (+176972us) service_pool.cc:224] Handling call
0709 14:52:44.692547 (+888723us) spinlock_profiling.cc:243] Waited 48 ms on lock 0x7b540034e754. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae922fa 00007fb68fe53b17 00007fb6893ce6d4 00007fb6893ce662 00007fb6893ce591 00007fb6893ce50c 00007fb6893cd7c2 00007fb6891c948c 00007fb6891c88c6 00007fb6891c826f
0709 14:52:44.693018 (+   471us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":110422912}
W20260709 14:52:44.666954  7894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:44.645022  7745 leader_election.cc:304] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:44.669678  7847 rpcz_store.cc:276] 0709 14:52:43.611133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:44.644782 (+1033649us) service_pool.cc:224] Handling call
0709 14:52:44.645181 (+   399us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:52:44.645671 (+   490us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:52:44.645702 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:52:44.645750 (+    48us) raft_consensus.cc:1645] Marking committed up to 7
0709 14:52:44.645783 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:44.645845 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:44.645987 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 14:52:44.673158 12566 raft_consensus.cc:3055] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 LEADER]: Stepping down as leader of term 12
I20260709 14:52:44.676184 12568 raft_consensus.cc:515] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:44.656975  7776 raft_consensus.cc:1240] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 12. Current term is 13. Ops: []
I20260709 14:52:44.698046  7779 raft_consensus.cc:1240] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 14:52:44.722743  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:52:44.726586 12613 log.cc:927] Time spent T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
W20260709 14:52:44.727708 12610 log.cc:927] Time spent T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.154s	user 0.000s	sys 0.000s
W20260709 14:52:44.698747 12602 log.cc:927] Time spent T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.597s	user 0.003s	sys 0.001s
I20260709 14:52:44.644430 12559 raft_consensus.cc:515] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:44.730530  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 85625.2us
I20260709 14:52:44.731402  7847 raft_consensus.cc:2468] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 16.
I20260709 14:52:44.746645  7745 leader_election.cc:304] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:44.732213  7852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49948 (request call id 3807) took 1139 ms. Trace:
I20260709 14:52:44.733434  7775 raft_consensus.cc:1240] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 11. Current term is 12. Ops: [11.6-11.6]
W20260709 14:52:44.733976  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 70790.5us
I20260709 14:52:44.748394  7819 leader_election.cc:304] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:44.727916 12156 consensus_queue.cc:237] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:44.752797  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:44.747241  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:44.752494  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:44.754864  7923 raft_consensus.cc:2393] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 15: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:52:44.755852  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:44.756431  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:44.646533 12563 raft_consensus.cc:515] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:44.764364  7745 leader_election.cc:304] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:44.754880  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:44.758494  7923 raft_consensus.cc:1275] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 14:52:44.756690  7854 raft_consensus.cc:2468] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 15.
I20260709 14:52:44.759835  7847 raft_consensus.cc:2410] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for term 13 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 14:52:44.760453 12503 raft_consensus.cc:2804] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Leader election won for term 13
I20260709 14:52:44.760728  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:44.734882 12577 raft_consensus.cc:2749] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 14:52:44.763049 12559 leader_election.cc:290] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:44.741484 12612 raft_consensus.cc:493] T 9441e831627143a991a1556dcdce71e3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9418391fa82a42c79c6cad13ba91d964)
I20260709 14:52:44.694365 12606 leader_election.cc:290] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:44.779803 12621 raft_consensus.cc:493] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:44.780457 12621 raft_consensus.cc:515] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:44.741837 12546 leader_election.cc:290] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:44.781546 12609 leader_election.cc:290] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:44.722012 12566 raft_consensus.cc:740] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:52:44.782944 12621 leader_election.cc:290] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:44.782858 12566 consensus_queue.cc:260] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:44.783792 12473 consensus_queue.cc:1048] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 14:52:44.784551 12473 consensus_queue.cc:1243] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer 3876b8ee8d744cb18e91d97aae93b1ac log is divergent from this leader: its last log entry 12.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 14:52:44.787734 12612 raft_consensus.cc:515] T 9441e831627143a991a1556dcdce71e3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:52:44.789805 12542 leader_election.cc:290] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 14 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:44.790719 12561 consensus_queue.cc:1048] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 14:52:44.768816  7745 leader_election.cc:304] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:44.693233 12500 consensus_queue.cc:260] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:44.721890 12536 raft_consensus.cc:697] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:44.770970  7921 raft_consensus.cc:2468] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 15.
I20260709 14:52:44.760951 12272 raft_consensus.cc:2749] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 14:52:44.771889  7893 leader_election.cc:304] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:52:44.748889  7852 rpcz_store.cc:276] 0709 14:52:43.593006 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:44.282006 (+689000us) service_pool.cc:224] Handling call
0709 14:52:44.289872 (+  7866us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:52:44.314009 (+ 24137us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:52:44.314053 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:52:44.338204 (+ 24151us) log.cc:844] Serialized 26 byte log entry
0709 14:52:44.509723 (+171519us) raft_consensus.cc:1645] Marking committed up to 10
0709 14:52:44.654532 (+144809us) log.cc:844] Serialized 14 byte log entry
0709 14:52:44.711796 (+ 57264us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:44.712687 (+   891us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:52:44.731950 (+ 19263us) raft_consensus.cc:1685] finished
0709 14:52:44.731974 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:44.732147 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":80223,"prepare.queue_time_us":139659,"prepare.run_cpu_time_us":72,"prepare.run_wall_time_us":75,"raft.queue_time_us":105249,"raft.run_cpu_time_us":286,"raft.run_wall_time_us":7693,"thread_start_us":236694,"threads_started":2,"wal-append.queue_time_us":210106}
I20260709 14:52:44.732865 12522 leader_election.cc:290] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 14 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:44.773522  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
W20260709 14:52:44.778883 12618 log.cc:927] Time spent T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
I20260709 14:52:44.755312 12619 raft_consensus.cc:493] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:44.791379 12612 leader_election.cc:290] T 9441e831627143a991a1556dcdce71e3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68:42321)
I20260709 14:52:44.777194  7894 leader_election.cc:304] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:44.744845 12457 consensus_queue.cc:1048] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 14:52:44.795132  7745 leader_election.cc:304] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:44.780179 12568 leader_election.cc:290] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:44.797330  7854 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 3775) took 1186 ms. Trace:
I20260709 14:52:44.830886  7745 leader_election.cc:304] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:44.770864 12506 raft_consensus.cc:2749] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 14:52:44.788188 12564 raft_consensus.cc:515] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:44.826792  7771 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 3348) took 1173 ms. Trace:
W20260709 14:52:44.828820  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:52:44.818989  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 47176.2us
I20260709 14:52:44.831243  7854 rpcz_store.cc:276] 0709 14:52:43.611388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:44.772374 (+1160986us) service_pool.cc:224] Handling call
0709 14:52:44.796818 (+ 24444us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:52:44.796992 (+   174us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:52:44.797018 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:52:44.797057 (+    39us) raft_consensus.cc:1645] Marking committed up to 9
0709 14:52:44.797097 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:44.797145 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:44.797271 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 14:52:44.794111 12561 consensus_queue.cc:1243] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer 3876b8ee8d744cb18e91d97aae93b1ac log is divergent from this leader: its last log entry 14.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 14:52:44.784281 12566 raft_consensus.cc:3060] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Advancing to term 13
W20260709 14:52:44.845320  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 68236.4us
I20260709 14:52:44.793037 12590 raft_consensus.cc:493] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:44.797758 12606 raft_consensus.cc:2804] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 14:52:44.778887 12624 raft_consensus.cc:493] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:44.838821  7745 leader_election.cc:304] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:52:44.919116  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 80434.1us
I20260709 14:52:44.920024  7745 leader_election.cc:304] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:44.839941  7771 rpcz_store.cc:276] 0709 14:52:43.653360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:43.918515 (+265155us) service_pool.cc:224] Handling call
0709 14:52:43.924261 (+  5746us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:52:43.924697 (+   436us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:52:43.924725 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:52:43.925487 (+   762us) log.cc:844] Serialized 26 byte log entry
0709 14:52:44.364434 (+438947us) spinlock_profiling.cc:243] Waited 12.6 ms on lock 0x7b1800356320. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb690c69de1 00007fb690c765b1 00007fb687d83e07 00007fb690bdeab9 00007fb687da069b 00007fb687d9e93f 00007fb687da0c02 00007fb68aa2820b 00007fb68aa2dd23 00007fb68aa2e0d1 00007fb68ae49a0f
0709 14:52:44.526224 (+161790us) raft_consensus.cc:1645] Marking committed up to 7
0709 14:52:44.526268 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:44.526345 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:52:44.819050 (+292705us) raft_consensus.cc:1685] finished
0709 14:52:44.819075 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:44.826720 (+  7645us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3501,"raft.run_cpu_time_us":212,"raft.run_wall_time_us":15173,"spinlock_wait_cycles":28893056,"thread_start_us":161554,"threads_started":1,"wal-append.queue_time_us":623528}
I20260709 14:52:44.809996 12490 raft_consensus.cc:697] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:44.834173 12619 raft_consensus.cc:515] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:44.843065  8639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9441e831627143a991a1556dcdce71e3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9418391fa82a42c79c6cad13ba91d964" is_pre_election: true
I20260709 14:52:44.838426 12577 raft_consensus.cc:2804] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 14:52:44.828833 12473 raft_consensus.cc:2804] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 14:52:44.829442 12546 raft_consensus.cc:493] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:44.835697 12609 raft_consensus.cc:493] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:44.921839  7745 leader_election.cc:304] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:44.953778 12609 raft_consensus.cc:515] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:44.955236 12506 raft_consensus.cc:2749] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 14:52:44.953152 12622 leader_election.cc:290] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:44.956035  7745 leader_election.cc:304] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:44.956898  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:44.958133  7919 raft_consensus.cc:2393] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 14: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:52:44.959740 12506 raft_consensus.cc:2804] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 14:52:44.959097 12546 raft_consensus.cc:515] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:44.960273 12506 raft_consensus.cc:493] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:44.960690 12506 raft_consensus.cc:3060] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Advancing to term 17
I20260709 14:52:44.911999  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:44.961637  7775 raft_consensus.cc:3060] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Advancing to term 16
I20260709 14:52:44.911211 12383 raft_consensus.cc:2804] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 14:52:44.959125  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:44.967387  7919 raft_consensus.cc:2468] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 13.
W20260709 14:52:44.909888  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 69354.7us
I20260709 14:52:44.924402  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:44.923105  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258d6c2dda954bf5b65930fde8ecb9f3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:44.924121 12488 raft_consensus.cc:2749] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 14:52:44.935134  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:44.912619 12542 raft_consensus.cc:493] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:52:44.935070  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:44.944747  7923 raft_consensus.cc:1240] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 13. Current term is 14. Ops: []
I20260709 14:52:44.938251 12258 raft_consensus.cc:2804] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 14:52:44.836889 12534 raft_consensus.cc:515] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:44.948355  7921 raft_consensus.cc:1240] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 14:52:44.949146 12490 consensus_queue.cc:237] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:44.950022 12619 leader_election.cc:290] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:44.917011 12606 raft_consensus.cc:493] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:44.937496 12577 raft_consensus.cc:493] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:44.951994 12563 leader_election.cc:290] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:44.926608  7920 raft_consensus.cc:2393] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 17: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:52:44.990749  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:45.023903  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258d6c2dda954bf5b65930fde8ecb9f3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:44.909507 12272 raft_consensus.cc:2804] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 14:52:44.927683 12437 raft_consensus.cc:2749] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 14:52:45.015002  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:45.015313  7773 raft_consensus.cc:3060] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Advancing to term 14
W20260709 14:52:44.993918 12633 log.cc:927] Time spent T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.067s	user 0.004s	sys 0.000s
I20260709 14:52:45.011217  7819 leader_election.cc:304] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:44.999915  7893 leader_election.cc:304] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:45.035005  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:45.012063 12258 raft_consensus.cc:493] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:45.017513  7927 raft_consensus.cc:1240] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 15. Current term is 16. Ops: []
I20260709 14:52:44.940672 12473 raft_consensus.cc:493] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:45.045502 12473 raft_consensus.cc:3060] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 14:52:45.047731  7773 raft_consensus.cc:2468] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 14.
I20260709 14:52:45.013859  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c563cc7cfbe4d59be4ffc5cf847ce56" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
W20260709 14:52:45.048645  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:45.022405 12606 raft_consensus.cc:3060] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:52:45.025761 12577 raft_consensus.cc:3060] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Advancing to term 14
I20260709 14:52:45.025642 12272 raft_consensus.cc:493] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:45.032747  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:44.937695 12590 raft_consensus.cc:515] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:44.990646 12609 leader_election.cc:290] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:45.036128  7922 raft_consensus.cc:2393] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 15: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:52:44.965937 12383 raft_consensus.cc:493] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:45.038969 12619 raft_consensus.cc:2749] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 14:52:45.070039  7921 raft_consensus.cc:1275] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
I20260709 14:52:45.070372 12534 leader_election.cc:290] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:45.070909 12529 raft_consensus.cc:3055] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 14:52:45.071476 12529 raft_consensus.cc:740] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:45.072783  7921 raft_consensus.cc:1240] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 12. Current term is 14. Ops: []
I20260709 14:52:45.044194 12537 raft_consensus.cc:3055] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 LEADER]: Stepping down as leader of term 13
I20260709 14:52:45.073872 12537 raft_consensus.cc:740] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:52:44.940495 12624 raft_consensus.cc:515] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:45.075304  7849 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 3769) took 1465 ms. Trace:
I20260709 14:52:45.075729  7849 rpcz_store.cc:276] 0709 14:52:43.609835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:44.375557 (+765722us) service_pool.cc:224] Handling call
0709 14:52:44.376014 (+   457us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:52:44.448431 (+ 72417us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:45.075049 (+626618us) spinlock_profiling.cc:243] Waited 50.9 ms on lock 0x7b54000d5a54. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae8ee01 00007fb68ae8d83e 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2 00007fb6891c948c 00007fb6891c88c6
0709 14:52:45.075240 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":117117696}
I20260709 14:52:45.076843 12564 leader_election.cc:290] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 17 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:45.051923  7771 raft_consensus.cc:1240] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 13. Current term is 14. Ops: []
I20260709 14:52:45.037669  7819 leader_election.cc:304] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
W20260709 14:52:45.104126  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 66576.1us
I20260709 14:52:45.105854  7819 leader_election.cc:304] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:45.026154  7775 raft_consensus.cc:2468] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 16.
I20260709 14:52:45.108484  7853 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 3781) took 1495 ms. Trace:
I20260709 14:52:45.074684  7847 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 3776) took 1463 ms. Trace:
I20260709 14:52:45.112721  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:44.937601 12536 consensus_queue.cc:237] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:45.051868 12258 raft_consensus.cc:3060] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:52:45.050696 12563 raft_consensus.cc:2749] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 14:52:45.025853 12542 raft_consensus.cc:515] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:45.069435 12383 raft_consensus.cc:3060] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 14:52:45.058302 12560 consensus_queue.cc:1048] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 14:52:45.074791 12537 consensus_queue.cc:260] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:45.050882  7893 leader_election.cc:304] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:52:45.050364  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:45.153581  7923 raft_consensus.cc:3060] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 14:52:45.072556 12529 consensus_queue.cc:260] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:45.155109  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 104290us
I20260709 14:52:45.077107 12624 leader_election.cc:290] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:45.059007 12546 leader_election.cc:290] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:45.065734 12272 raft_consensus.cc:3060] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Advancing to term 16
I20260709 14:52:44.946511  7854 raft_consensus.cc:1275] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 9. (term mismatch)
I20260709 14:52:45.098106 12552 raft_consensus.cc:3055] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 LEADER]: Stepping down as leader of term 15
I20260709 14:52:45.101689 12590 leader_election.cc:290] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:45.113480 12619 raft_consensus.cc:2749] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 14:52:45.112350  7847 rpcz_store.cc:276] 0709 14:52:43.611663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:44.772788 (+1161125us) service_pool.cc:224] Handling call
0709 14:52:44.773554 (+   766us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:52:44.834998 (+ 61444us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:52:44.835037 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:52:44.835594 (+   557us) log.cc:844] Serialized 26 byte log entry
0709 14:52:44.992475 (+156881us) raft_consensus.cc:1645] Marking committed up to 5
0709 14:52:44.992534 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:44.992638 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:52:45.074399 (+ 81761us) raft_consensus.cc:1685] finished
0709 14:52:45.074425 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:45.074612 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":60673,"raft.queue_time_us":62905,"raft.run_cpu_time_us":206,"raft.run_wall_time_us":61729,"thread_start_us":71373,"threads_started":1,"wal-append.queue_time_us":137148}
I20260709 14:52:45.130298 12503 raft_consensus.cc:697] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:52:45.175503  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:45.176366  7847 raft_consensus.cc:3060] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Advancing to term 16
I20260709 14:52:45.119460  7775 raft_consensus.cc:1275] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 14:52:45.032449  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:45.114192 12569 raft_consensus.cc:2749] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 14:52:45.122215  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:45.123764  7770 raft_consensus.cc:2393] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 15: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:52:45.108487  7819 leader_election.cc:304] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:45.109172  7853 rpcz_store.cc:276] 0709 14:52:43.612975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:45.106932 (+1493957us) service_pool.cc:224] Handling call
0709 14:52:45.107656 (+   724us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:52:45.108019 (+   363us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:52:45.108061 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:52:45.108124 (+    63us) raft_consensus.cc:1645] Marking committed up to 9
0709 14:52:45.108165 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:45.108232 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:45.108388 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 14:52:45.114347  7848 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3811) took 1486 ms (client timeout 1911 ms). Trace:
I20260709 14:52:45.083951 12501 leader_election.cc:290] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:45.164928  7854 pending_rounds.cc:85] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting all ops after (but not including) 8
I20260709 14:52:45.121542 12506 raft_consensus.cc:515] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:45.187722 12562 raft_consensus.cc:3060] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Advancing to term 13
I20260709 14:52:45.188120 12506 leader_election.cc:290] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:45.161106 12577 raft_consensus.cc:515] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:45.167606  7893 leader_election.cc:304] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:52:45.192041 12427 raft_consensus.cc:2804] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 14:52:45.175659 12552 raft_consensus.cc:740] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:52:45.193826  7845 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49946 (request call id 3785) took 1465 ms. Trace:
I20260709 14:52:45.193472 12503 consensus_queue.cc:237] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:45.194238  7845 rpcz_store.cc:276] 0709 14:52:43.728230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:44.007604 (+279374us) service_pool.cc:224] Handling call
0709 14:52:45.193547 (+1185943us) spinlock_profiling.cc:243] Waited 476 ms on lock 0x7b54003b4a54. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae922fa 00007fb68fe53b17 00007fb6893ce6d4 00007fb6893ce662 00007fb6893ce591 00007fb6893ce50c 00007fb6893cd7c2 00007fb6891c948c 00007fb6891c88c6 00007fb6891c826f
0709 14:52:45.193747 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1095779072}
I20260709 14:52:45.194610 12552 consensus_queue.cc:260] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:45.196139  7845 raft_consensus.cc:1275] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 14:52:45.184890  7854 pending_rounds.cc:107] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 14:52:45.197032  7854 raft_consensus.cc:2889] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:52:45.198329  7854 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 3779) took 1585 ms. Trace:
I20260709 14:52:45.198709  7854 rpcz_store.cc:276] 0709 14:52:43.612438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:44.919162 (+1306724us) service_pool.cc:224] Handling call
0709 14:52:44.946050 (+ 26888us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:52:45.197947 (+251897us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:45.198253 (+   306us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 14:52:45.185180  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 76811.8us
W20260709 14:52:45.179971  7848 rpcz_store.cc:269] 0709 14:52:43.627615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:43.916793 (+289178us) service_pool.cc:224] Handling call
0709 14:52:45.114084 (+1197291us) spinlock_profiling.cc:243] Waited 320 ms on lock 0x7b540034ec54. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae922fa 00007fb68fe53b17 00007fb6893ce6d4 00007fb6893ce662 00007fb6893ce591 00007fb6893ce50c 00007fb6893cd7c2 00007fb6891c948c 00007fb6891c88c6 00007fb6891c826f
0709 14:52:45.114242 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":736184704}
I20260709 14:52:45.202958  7848 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 3787) took 1464 ms. Trace:
I20260709 14:52:45.203541  7848 rpcz_store.cc:276] 0709 14:52:43.738693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:45.201855 (+1463162us) service_pool.cc:224] Handling call
0709 14:52:45.202222 (+   367us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:52:45.202421 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:52:45.202445 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:52:45.202484 (+    39us) raft_consensus.cc:1645] Marking committed up to 4
0709 14:52:45.202514 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:45.202726 (+   212us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:45.202883 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 14:52:45.192983 12427 raft_consensus.cc:697] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:45.206943 12427 consensus_queue.cc:237] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:45.173735 12156 raft_consensus.cc:2804] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 14:52:45.208828 12156 raft_consensus.cc:697] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:45.210482 12156 consensus_queue.cc:237] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:45.200971  7854 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 3784) took 1475 ms. Trace:
I20260709 14:52:45.183593  7849 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 3782) took 1570 ms. Trace:
I20260709 14:52:45.227188  7849 rpcz_store.cc:276] 0709 14:52:43.662443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:45.182616 (+1520173us) service_pool.cc:224] Handling call
0709 14:52:45.182999 (+   383us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:52:45.183222 (+   223us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:52:45.183247 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:52:45.183292 (+    45us) raft_consensus.cc:1645] Marking committed up to 6
0709 14:52:45.183332 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:45.183398 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:45.183526 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 14:52:45.224241  7854 rpcz_store.cc:276] 0709 14:52:43.725578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:45.199823 (+1474245us) service_pool.cc:224] Handling call
0709 14:52:45.200415 (+   592us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:52:45.200631 (+   216us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:52:45.200657 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:52:45.200701 (+    44us) raft_consensus.cc:1645] Marking committed up to 10
0709 14:52:45.200732 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:45.200786 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:45.200910 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 14:52:45.233934  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:45.222656  7848 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 3788) took 1474 ms. Trace:
I20260709 14:52:45.238384  7848 rpcz_store.cc:276] 0709 14:52:43.748011 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:45.204571 (+1456560us) service_pool.cc:224] Handling call
0709 14:52:45.204999 (+   428us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:52:45.205220 (+   221us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:52:45.221515 (+ 16295us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:52:45.221868 (+   353us) raft_consensus.cc:1645] Marking committed up to 8
0709 14:52:45.221925 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:45.222356 (+   431us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:45.222566 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 14:52:45.178902 12547 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.055s	user 0.011s	sys 0.016s
W20260709 14:52:45.242918 12547 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.134s	user 0.012s	sys 0.016s
I20260709 14:52:45.238500 12619 raft_consensus.cc:2804] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 14:52:45.266911  7923 raft_consensus.cc:2468] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 14.
I20260709 14:52:45.254324  7848 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41650 (request call id 419) took 1309 ms. Trace:
I20260709 14:52:45.232230  7854 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 3794) took 1288 ms. Trace:
W20260709 14:52:45.255569  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 64048us
I20260709 14:52:45.257138  7847 raft_consensus.cc:2468] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 16.
I20260709 14:52:45.196849  7845 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 3783) took 1518 ms. Trace:
I20260709 14:52:45.239024  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
W20260709 14:52:45.263091  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:45.274212  7854 rpcz_store.cc:276] 0709 14:52:43.943968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:45.230207 (+1286239us) service_pool.cc:224] Handling call
0709 14:52:45.230770 (+   563us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:52:45.230993 (+   223us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:52:45.231271 (+   278us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:52:45.231575 (+   304us) raft_consensus.cc:1645] Marking committed up to 8
0709 14:52:45.231640 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:45.231731 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:45.232116 (+   385us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 14:52:45.276558  7853 raft_consensus.cc:3060] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Advancing to term 17
I20260709 14:52:45.273141  7848 rpcz_store.cc:276] 0709 14:52:43.945071 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:45.250758 (+1305687us) service_pool.cc:224] Handling call
0709 14:52:45.253674 (+  2916us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:52:45.253908 (+   234us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:52:45.253939 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:52:45.253991 (+    52us) raft_consensus.cc:1645] Marking committed up to 6
0709 14:52:45.254025 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:45.254084 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:45.254247 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 14:52:45.252751  7819 leader_election.cc:304] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:45.275174  7845 rpcz_store.cc:276] 0709 14:52:43.678379 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:45.195334 (+1516955us) service_pool.cc:224] Handling call
0709 14:52:45.195773 (+   439us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:52:45.196533 (+   760us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:45.196780 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 14:52:45.277933  7854 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 3796) took 1307 ms. Trace:
I20260709 14:52:45.279214  7854 rpcz_store.cc:276] 0709 14:52:43.970999 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:45.277070 (+1306071us) service_pool.cc:224] Handling call
0709 14:52:45.277427 (+   357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:52:45.277619 (+   192us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:52:45.277644 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:52:45.277682 (+    38us) raft_consensus.cc:1645] Marking committed up to 8
0709 14:52:45.277710 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:45.277762 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:45.277877 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 14:52:45.283315  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:45.246040 12552 raft_consensus.cc:3060] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Advancing to term 16
I20260709 14:52:45.279623  7848 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41650 (request call id 420) took 1214 ms. Trace:
I20260709 14:52:45.287115  7819 leader_election.cc:400] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 14 election: Vote denied by peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587) with higher term. Message: Invalid argument: T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 14. Current term is 15.
I20260709 14:52:45.266193 12547 raft_consensus.cc:697] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:52:45.270084 12619 raft_consensus.cc:493] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:45.297084 12619 raft_consensus.cc:3060] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Advancing to term 13
I20260709 14:52:45.297497 12547 consensus_queue.cc:237] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:45.283133 12495 raft_consensus.cc:493] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:45.297770 12578 leader_election.cc:290] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:45.298955 12495 raft_consensus.cc:515] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:45.276100 12542 leader_election.cc:290] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:45.282119  7854 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 3799) took 1181 ms. Trace:
I20260709 14:52:45.290750  7845 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 3798) took 1190 ms. Trace:
I20260709 14:52:45.307281 12619 raft_consensus.cc:515] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:45.305689  7845 rpcz_store.cc:276] 0709 14:52:44.100427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:45.278702 (+1178275us) service_pool.cc:224] Handling call
0709 14:52:45.289908 (+ 11206us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:52:45.290265 (+   357us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:52:45.290294 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:52:45.290339 (+    45us) raft_consensus.cc:1645] Marking committed up to 9
0709 14:52:45.290369 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:45.290427 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:45.290676 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 14:52:45.309916 12619 leader_election.cc:290] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:45.297858 12272 raft_consensus.cc:515] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:45.311064  7854 rpcz_store.cc:276] 0709 14:52:44.100943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:45.281142 (+1180199us) service_pool.cc:224] Handling call
0709 14:52:45.281531 (+   389us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:52:45.281750 (+   219us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:52:45.281777 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:52:45.281830 (+    53us) raft_consensus.cc:1645] Marking committed up to 11
0709 14:52:45.281863 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:45.281918 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:45.282054 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 14:52:45.284736 12638 raft_consensus.cc:2749] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 14:52:45.313897 12272 leader_election.cc:290] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 16 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:45.268990 12501 consensus_queue.cc:1048] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 14:52:45.310604  7845 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 3800) took 1209 ms. Trace:
I20260709 14:52:45.314550  7847 raft_consensus.cc:1240] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 12. Current term is 13. Ops: []
I20260709 14:52:45.295667 12606 raft_consensus.cc:515] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:45.314826  7845 rpcz_store.cc:276] 0709 14:52:44.101354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:45.308703 (+1207349us) service_pool.cc:224] Handling call
0709 14:52:45.309102 (+   399us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:52:45.310184 (+  1082us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:52:45.310214 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:52:45.310262 (+    48us) raft_consensus.cc:1645] Marking committed up to 9
0709 14:52:45.310296 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:45.310364 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:45.310528 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 14:52:45.321820  7850 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 3778) took 1709 ms. Trace:
I20260709 14:52:45.330461  7850 rpcz_store.cc:276] 0709 14:52:43.612140 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:44.903005 (+1290865us) service_pool.cc:224] Handling call
0709 14:52:44.934839 (+ 31834us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:52:44.966710 (+ 31871us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:52:44.966746 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:52:44.996642 (+ 29896us) log.cc:844] Serialized 26 byte log entry
0709 14:52:45.267479 (+270837us) raft_consensus.cc:1645] Marking committed up to 6
0709 14:52:45.267540 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:45.267628 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:52:45.321507 (+ 53879us) raft_consensus.cc:1685] finished
0709 14:52:45.321537 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:45.321731 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":32041,"raft.run_cpu_time_us":212,"raft.run_wall_time_us":26571,"thread_start_us":232511,"threads_started":1,"wal-append.queue_time_us":256384}
W20260709 14:52:45.334585  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 118614us
I20260709 14:52:45.288682  7848 rpcz_store.cc:276] 0709 14:52:44.065654 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:45.278572 (+1212918us) service_pool.cc:224] Handling call
0709 14:52:45.278998 (+   426us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:52:45.279244 (+   246us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:52:45.279273 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:52:45.279339 (+    66us) raft_consensus.cc:1645] Marking committed up to 8
0709 14:52:45.279384 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:45.279437 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:45.279559 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 14:52:45.337795  7853 raft_consensus.cc:2468] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 17.
I20260709 14:52:45.340883  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:45.342381  7925 raft_consensus.cc:1275] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 14:52:45.341311  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:45.343453  7920 raft_consensus.cc:2393] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 14: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:52:45.342641  7744 leader_election.cc:304] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:52:45.358589  7819 leader_election.cc:304] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 9418391fa82a42c79c6cad13ba91d964
I20260709 14:52:45.354789 12644 raft_consensus.cc:493] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:45.347415 12577 leader_election.cc:290] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 14 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:45.346706 12542 consensus_queue.cc:1048] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 14:52:45.363173 12630 raft_consensus.cc:493] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:52:45.381197 12630 raft_consensus.cc:515] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:52:45.295672 12473 raft_consensus.cc:515] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:45.371212  7819 leader_election.cc:304] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:45.389426  7745 leader_election.cc:304] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:45.363351 12488 raft_consensus.cc:2804] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 14:52:45.370497 12503 raft_consensus.cc:2749] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 14:52:45.402561  7745 leader_election.cc:304] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:52:45.402842  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 163878us
I20260709 14:52:45.347360 12638 consensus_queue.cc:1059] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 14:52:45.406337  7772 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37136 (request call id 2635) took 1174 ms. Trace:
I20260709 14:52:45.418601  7772 rpcz_store.cc:276] 0709 14:52:44.231984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:44.232216 (+   232us) service_pool.cc:224] Handling call
0709 14:52:45.406041 (+1173825us) spinlock_profiling.cc:243] Waited 331 ms on lock 0x7b54002562d4. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae922fa 00007fb68fe53b17 00007fb6893ce6d4 00007fb6893ce662 00007fb6893ce591 00007fb6893ce50c 00007fb6893cd7c2 00007fb6891c948c 00007fb6891c88c6 00007fb6891c826f
0709 14:52:45.406245 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":760265088}
I20260709 14:52:45.365398 12437 consensus_queue.cc:1059] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.037s
I20260709 14:52:45.399060 12488 raft_consensus.cc:493] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Starting leader election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:52:45.404867 12577 raft_consensus.cc:493] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:45.446499  7894 leader_election.cc:304] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:45.405498 12272 raft_consensus.cc:2804] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 14:52:45.419745 12621 raft_consensus.cc:2749] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 14:52:45.458649  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:45.467562  7772 raft_consensus.cc:3060] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Advancing to term 14
W20260709 14:52:45.457875 12566 consensus_meta.cc:287] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent flushing consensus metadata: real 0.535s	user 0.010s	sys 0.005s
I20260709 14:52:45.397019 12590 consensus_queue.cc:1059] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 14:52:45.376116 12644 raft_consensus.cc:515] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:45.474673  7851 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49946 (request call id 3780) took 1861 ms (client timeout 1824 ms). Trace:
W20260709 14:52:45.462850 12645 log.cc:927] Time spent T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 14:52:45.454499 12503 raft_consensus.cc:493] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:52:45.475310  7851 rpcz_store.cc:269] 0709 14:52:43.612720 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:43.912308 (+299588us) service_pool.cc:224] Handling call
0709 14:52:45.474395 (+1562087us) spinlock_profiling.cc:243] Waited 48.4 ms on lock 0x7b540013bfd4. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae922fa 00007fb68fe53b17 00007fb6893ce6d4 00007fb6893ce662 00007fb6893ce591 00007fb6893ce50c 00007fb6893cd7c2 00007fb6891c948c 00007fb6891c88c6 00007fb6891c826f
0709 14:52:45.474571 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":111330176}
I20260709 14:52:45.495031  7848 raft_consensus.cc:1240] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 13. Current term is 14. Ops: []
I20260709 14:52:45.461030 12488 raft_consensus.cc:3060] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Advancing to term 16
I20260709 14:52:45.503316  7851 raft_consensus.cc:1275] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 14:52:45.506116  7851 raft_consensus.cc:1240] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 17. Current term is 18. Ops: []
W20260709 14:52:45.506376  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 44822.2us
I20260709 14:52:45.424476 12156 consensus_queue.cc:1048] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.057s
I20260709 14:52:45.462376 12272 raft_consensus.cc:493] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting leader election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:52:45.471692 12536 raft_consensus.cc:2804] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 14:52:45.515486 12272 raft_consensus.cc:3060] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Advancing to term 15
I20260709 14:52:45.515795  7772 raft_consensus.cc:2468] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 14.
I20260709 14:52:45.516993  7848 raft_consensus.cc:1240] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 9. Current term is 10. Ops: []
I20260709 14:52:45.518466  7894 leader_election.cc:304] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:45.522884  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:45.523988  7772 raft_consensus.cc:2468] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 14.
W20260709 14:52:45.533980  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 119825us
I20260709 14:52:45.466377 12577 raft_consensus.cc:515] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:45.548184  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:45.519484 12552 raft_consensus.cc:493] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:45.567966  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9441e831627143a991a1556dcdce71e3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:45.519222 12631 consensus_queue.cc:1048] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 14:52:45.573350  7848 raft_consensus.cc:3055] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 LEADER]: Stepping down as leader of term 13
I20260709 14:52:45.506605 12503 raft_consensus.cc:515] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:45.573957  7848 raft_consensus.cc:740] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
W20260709 14:52:45.588577  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 70220.2us
I20260709 14:52:45.588604  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:45.593813  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:45.555888 12606 leader_election.cc:290] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 12 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:45.598783  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:45.598989  7851 raft_consensus.cc:1217] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Deduplicated request from leader. Original: 10.6->[11.7-14.9]   Dedup: 11.7->[13.8-14.9]
I20260709 14:52:45.594295  7848 consensus_queue.cc:260] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:45.599804  7851 pending_rounds.cc:85] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting all ops after (but not including) 7
I20260709 14:52:45.600155  7851 pending_rounds.cc:107] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 14:52:45.600414  7851 raft_consensus.cc:2889] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:52:45.606009 12644 leader_election.cc:290] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:45.607060 12577 leader_election.cc:290] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:45.565289 12552 raft_consensus.cc:515] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:45.611924 12552 leader_election.cc:290] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:45.580950 12560 raft_consensus.cc:493] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:52:45.617386 12473 leader_election.cc:290] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:45.619578 12555 leader_election.cc:290] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:52:45.623600  7819 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:45.626762 12503 leader_election.cc:290] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:52:45.627143  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:45.586301 12630 leader_election.cc:290] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:45.635370  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:45.637391  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:45.638321  7770 raft_consensus.cc:2468] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 7.
I20260709 14:52:45.639290  7845 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 3803) took 1533 ms. Trace:
I20260709 14:52:45.641805  7848 raft_consensus.cc:3060] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Advancing to term 14
I20260709 14:52:45.640148  7845 rpcz_store.cc:276] 0709 14:52:44.105752 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:45.358802 (+1253050us) service_pool.cc:224] Handling call
0709 14:52:45.372158 (+ 13356us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:52:45.372687 (+   529us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:52:45.372720 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:52:45.373477 (+   757us) log.cc:844] Serialized 26 byte log entry
0709 14:52:45.522328 (+148851us) raft_consensus.cc:1645] Marking committed up to 7
0709 14:52:45.524427 (+  2099us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:45.524511 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:52:45.639018 (+114507us) raft_consensus.cc:1685] finished
0709 14:52:45.639049 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:45.639224 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":126,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":19646,"thread_start_us":106238,"threads_started":1,"wal-append.queue_time_us":239131}
I20260709 14:52:45.598968 12625 raft_consensus.cc:993] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0: : Instructing follower 1de5e20126fa4d8ca0793d19c7b847ed to start an election
I20260709 14:52:45.645836  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:45.646773  7770 raft_consensus.cc:2468] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 12.
I20260709 14:52:45.647473 12537 raft_consensus.cc:3060] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Advancing to term 14
I20260709 14:52:45.648487  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
W20260709 14:52:45.650427 12651 log.cc:927] Time spent T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.095s	user 0.000s	sys 0.001s
W20260709 14:52:45.650820 12640 log.cc:927] Time spent T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.458s	user 0.003s	sys 0.000s
W20260709 14:52:45.651749 12649 log.cc:927] Time spent T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.137s	user 0.001s	sys 0.000s
I20260709 14:52:45.651880  7849 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 3793) took 1715 ms. Trace:
I20260709 14:52:45.653174  7849 rpcz_store.cc:276] 0709 14:52:43.937026 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:45.229191 (+1292165us) service_pool.cc:224] Handling call
0709 14:52:45.229848 (+   657us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:52:45.261203 (+ 31355us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:52:45.261281 (+    78us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:52:45.274534 (+ 13253us) log.cc:844] Serialized 26 byte log entry
0709 14:52:45.452809 (+178275us) raft_consensus.cc:1645] Marking committed up to 7
0709 14:52:45.452854 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:45.452939 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:52:45.651558 (+198619us) raft_consensus.cc:1685] finished
0709 14:52:45.651584 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:45.651801 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32331,"raft.queue_time_us":30745,"raft.run_cpu_time_us":187,"raft.run_wall_time_us":6718,"thread_start_us":158510,"threads_started":1,"wal-append.queue_time_us":213972}
W20260709 14:52:45.655345 12620 log.cc:927] Time spent T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 1.092s	user 0.007s	sys 0.009s
I20260709 14:52:45.652277 12625 raft_consensus.cc:1081] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 LEADER]: Signalling peer 1de5e20126fa4d8ca0793d19c7b847ed to start an election
I20260709 14:52:45.657666 12542 raft_consensus.cc:3055] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 LEADER]: Stepping down as leader of term 15
I20260709 14:52:45.658246 12542 raft_consensus.cc:740] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:52:45.659657 12542 consensus_queue.cc:260] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:45.660830 12542 raft_consensus.cc:3060] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Advancing to term 16
I20260709 14:52:45.661767  7774 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 3359) took 1217 ms. Trace:
I20260709 14:52:45.662314  7774 rpcz_store.cc:276] 0709 14:52:44.444344 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:44.444564 (+   220us) service_pool.cc:224] Handling call
0709 14:52:44.445029 (+   465us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:52:44.458484 (+ 13455us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:52:44.458515 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:52:44.472734 (+ 14219us) log.cc:844] Serialized 26 byte log entry
0709 14:52:44.549209 (+ 76475us) raft_consensus.cc:1645] Marking committed up to 8
0709 14:52:44.549300 (+    91us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:44.549390 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:52:45.654632 (+1105242us) spinlock_profiling.cc:243] Waited 2.35 ms on lock 0x7b4400022b4c. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb687c29db1 00007fb687cc7c85 00007fb687cc86a2 00007fb68aa3a1db 00007fb68aa35aaf 00007fb68aa2986e 00007fb68aa28bb6 00007fb68aa287d8 00007fb68aa32221 00007fb68aa321d9 00007fb68aa32169
0709 14:52:45.661346 (+  6714us) raft_consensus.cc:1685] finished
0709 14:52:45.661377 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:45.661696 (+   319us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":700,"raft.queue_time_us":845,"raft.run_cpu_time_us":292,"raft.run_wall_time_us":30739,"spinlock_wait_cycles":5408640,"thread_start_us":27697,"threads_started":1,"wal-append.queue_time_us":60575}
I20260709 14:52:45.664584  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:45.665789 12578 raft_consensus.cc:493] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:45.666549 12578 raft_consensus.cc:515] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:45.651310  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:45.667901  7770 raft_consensus.cc:2468] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 12.
I20260709 14:52:45.669111  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:45.669819  7770 raft_consensus.cc:2468] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 14.
I20260709 14:52:45.640760 12566 raft_consensus.cc:3055] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 LEADER]: Stepping down as leader of term 11
I20260709 14:52:45.671180 12566 raft_consensus.cc:740] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:52:45.672228 12566 consensus_queue.cc:260] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:45.672716 12529 raft_consensus.cc:3060] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Advancing to term 18
W20260709 14:52:45.604970 12652 log.cc:927] Time spent T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 14:52:45.675014  7847 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 3795) took 1707 ms. Trace:
I20260709 14:52:45.586608 12524 raft_consensus.cc:2804] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 14:52:45.698645 12524 raft_consensus.cc:697] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:45.699716 12524 consensus_queue.cc:237] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:45.697535  7847 rpcz_store.cc:276] 0709 14:52:43.967873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:45.275244 (+1307371us) service_pool.cc:224] Handling call
0709 14:52:45.275833 (+   589us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:52:45.315067 (+ 39234us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:45.674274 (+359207us) spinlock_profiling.cc:243] Waited 38.5 ms on lock 0x7b54003b3654. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae8ee01 00007fb68ae8d83e 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2 00007fb6891c948c 00007fb6891c88c6
0709 14:52:45.674691 (+   417us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":88528128}
I20260709 14:52:45.597976 12660 consensus_queue.cc:1048] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.082s
W20260709 14:52:45.665983 12258 consensus_meta.cc:287] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent flushing consensus metadata: real 0.513s	user 0.016s	sys 0.000s
I20260709 14:52:45.688793  7779 raft_consensus.cc:1240] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 15. Current term is 16. Ops: []
I20260709 14:52:45.713335  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18d29d52d304c87b930d4fb5eaf50b1" candidate_uuid: "9418391fa82a42c79c6cad13ba91d964" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:45.710777 12258 raft_consensus.cc:515] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:45.681466 12560 raft_consensus.cc:515] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:45.682824  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:45.670967  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:45.722177  7845 pending_rounds.cc:85] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting all ops after (but not including) 7
I20260709 14:52:45.722399 12560 leader_election.cc:290] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:45.723645  7770 raft_consensus.cc:1240] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 11. Current term is 12. Ops: []
I20260709 14:52:45.691572 12495 leader_election.cc:290] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:45.674877  7846 raft_consensus.cc:3060] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Advancing to term 14
I20260709 14:52:45.705597  7848 raft_consensus.cc:1275] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 14:52:45.725811  7775 raft_consensus.cc:1240] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
W20260709 14:52:45.726832 12546 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 14 current term: 14 is higher.
W20260709 14:52:45.700562  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:52:45.728229  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:45.728618 12258 leader_election.cc:290] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:45.725802  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:45.729737  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18d29d52d304c87b930d4fb5eaf50b1" candidate_uuid: "9418391fa82a42c79c6cad13ba91d964" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:45.708257 12578 leader_election.cc:290] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:45.732719  7774 raft_consensus.cc:2393] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 17: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:52:45.733979  7774 raft_consensus.cc:1240] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 13. Current term is 14. Ops: []
I20260709 14:52:45.734968  7846 raft_consensus.cc:2468] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 14.
I20260709 14:52:45.735575 12590 raft_consensus.cc:493] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:45.736054 12590 raft_consensus.cc:515] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:45.734257 12479 raft_consensus.cc:3060] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 14:52:45.722666  7845 pending_rounds.cc:107] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting uncommitted NO_OP operation due to leader change: 14.8
I20260709 14:52:45.738576  7845 raft_consensus.cc:2889] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:52:45.740686 12500 raft_consensus.cc:3060] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Advancing to term 14
I20260709 14:52:45.740979 12590 leader_election.cc:290] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:45.733870  7770 raft_consensus.cc:1275] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 14:52:45.742527 12639 log.cc:927] Time spent T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.531s	user 0.002s	sys 0.000s
W20260709 14:52:45.736868 12650 log.cc:927] Time spent T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.172s	user 0.001s	sys 0.000s
W20260709 14:52:45.760995  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:45.687237  7777 raft_consensus.cc:1275] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 14:52:45.625168  7819 leader_election.cc:304] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:45.715418  7772 raft_consensus.cc:1275] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 14:52:45.639161 12643 log.cc:927] Time spent T 00000000000000000000000000000000 P 133636659113430cb53b321cb0b1d9ee: Append to log took a long time: real 0.447s	user 0.000s	sys 0.002s
I20260709 14:52:45.681777 12566 raft_consensus.cc:3060] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:52:45.713680 12488 raft_consensus.cc:515] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:45.842526  7674 catalog_manager.cc:5697] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
W20260709 14:52:45.665803 12383 consensus_meta.cc:287] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0: Time spent flushing consensus metadata: real 0.502s	user 0.005s	sys 0.011s
I20260709 14:52:45.807673  7846 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49946 (request call id 3789) took 2052 ms. Trace:
W20260709 14:52:45.813480  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 188425us
I20260709 14:52:45.814859 12546 raft_consensus.cc:2749] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 14:52:45.821077  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:45.861646  8598 leader_election.cc:304] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9418391fa82a42c79c6cad13ba91d964; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:45.872496  7847 raft_consensus.cc:3060] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Advancing to term 16
I20260709 14:52:45.856098  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:45.856299  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:45.858114  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:45.858222  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:45.874167  7846 rpcz_store.cc:276] 0709 14:52:43.754960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:44.223345 (+468385us) service_pool.cc:224] Handling call
0709 14:52:45.758909 (+1535564us) spinlock_profiling.cc:243] Waited 1.41 s on lock 0x7b540019a0d4. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae922fa 00007fb68fe53b17 00007fb6893ce6d4 00007fb6893ce662 00007fb6893ce591 00007fb6893ce50c 00007fb6893cd7c2 00007fb6891c948c 00007fb6891c88c6 00007fb6891c826f
0709 14:52:45.807602 (+ 48693us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3247942528}
I20260709 14:52:45.859870  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:45.874816  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:45.875391  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:45.846644  7674 catalog_manager.cc:5697] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 10 to 11, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 11 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:52:45.878777  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:45.877748  7819 leader_election.cc:304] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:45.879614  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:45.881156  7850 raft_consensus.cc:2376] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 15. Re-sending same reply.
I20260709 14:52:45.882256  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:45.882503  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:45.887439  7923 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
mode: GRACEFUL
new_leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:48676
I20260709 14:52:45.888429  7923 raft_consensus.cc:606] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Received request to transfer leadership to TS 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:52:45.888840  7923 raft_consensus.cc:614] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 14:52:45.890805  7819 leader_election.cc:304] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:45.878815  7674 catalog_manager.cc:5697] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:52:45.893051  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:45.899390  7674 catalog_manager.cc:5697] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 14 to 15, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 15 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:52:45.831947 12536 raft_consensus.cc:697] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:45.901448  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:45.920416  7772 raft_consensus.cc:3060] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Advancing to term 16
I20260709 14:52:45.892647  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:45.906100  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:45.911761  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:45.913108  7847 raft_consensus.cc:2410] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for term 16 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 14:52:45.913160  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:45.912705  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
W20260709 14:52:45.914844  7778 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37144 (request call id 3352) took 1554 ms (client timeout 1908 ms). Trace:
W20260709 14:52:45.870247 12561 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.662s	user 0.003s	sys 0.007s
I20260709 14:52:45.892966  7676 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54350 (request call id 375) took 6497 ms. Trace:
W20260709 14:52:45.923800  7778 rpcz_store.cc:269] 0709 14:52:44.360940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:44.361071 (+   131us) service_pool.cc:224] Handling call
0709 14:52:45.905458 (+1544387us) spinlock_profiling.cc:243] Waited 1.54 s on lock 0x7b540019ffd4. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae922fa 00007fb68fe53b17 00007fb6893ce6d4 00007fb6893ce662 00007fb6893ce591 00007fb6893ce50c 00007fb6893cd7c2 00007fb6891c948c 00007fb6891c88c6 00007fb6891c826f
0709 14:52:45.914767 (+  9309us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3542275968}
I20260709 14:52:45.933022  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:45.883370 12612 consensus_queue.cc:1059] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.058s
I20260709 14:52:45.894428 12457 raft_consensus.cc:2749] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 14:52:45.942481  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:45.945482  7852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 3777) took 2333 ms. Trace:
I20260709 14:52:45.946087  7852 rpcz_store.cc:276] 0709 14:52:43.611901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:44.819906 (+1208005us) service_pool.cc:224] Handling call
0709 14:52:44.826172 (+  6266us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:52:44.835132 (+  8960us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:52:44.835173 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:52:44.835733 (+   560us) log.cc:844] Serialized 26 byte log entry
0709 14:52:45.064514 (+228781us) raft_consensus.cc:1645] Marking committed up to 8
0709 14:52:45.064578 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:45.064657 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:52:45.100571 (+ 35914us) spinlock_profiling.cc:243] Waited 55.8 ms on lock 0x7b4800002dd8. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68fdb7aa1 00007fb68fdaeb37 00007fb68fdae9ca 00007fb68fea626f 00007fb68fea5f37 00007fb68feba55c 00007fb68feba508 00007fb68feba488 00007fb68feba443 00007fb68feb96ec 00007fb68ede3a96
0709 14:52:45.741686 (+641115us) spinlock_profiling.cc:243] Waited 3.23 ms on lock 0x7b4400022b4c. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb687c29db1 00007fb687cc7c85 00007fb687cc86a2 00007fb68aa3a1db 00007fb68aa35aaf 00007fb68aa2986e 00007fb68aa28bb6 00007fb68aa287d8 00007fb68aa32221 00007fb68aa321d9 00007fb68aa32169
0709 14:52:45.945145 (+203459us) raft_consensus.cc:1685] finished
0709 14:52:45.945175 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:45.945382 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8466,"raft.queue_time_us":10766,"raft.run_cpu_time_us":3116,"raft.run_wall_time_us":258914,"spinlock_wait_cycles":135796352,"thread_start_us":130565,"threads_started":1,"wal-append.queue_time_us":253645}
I20260709 14:52:45.933336  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:45.929428  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783e4874513449ef9084b833f188a6d3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:45.958976  7819 leader_election.cc:304] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:45.959337  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258d6c2dda954bf5b65930fde8ecb9f3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
W20260709 14:52:45.962685  7854 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.648s	user 0.035s	sys 0.025s
W20260709 14:52:45.963647  7854 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.649s	user 0.035s	sys 0.026s
I20260709 14:52:45.883466 12653 raft_consensus.cc:2749] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 14:52:45.901437 12621 raft_consensus.cc:493] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:45.970738  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:45.972920  7779 raft_consensus.cc:1275] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
W20260709 14:52:45.926705 12561 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.718s	user 0.004s	sys 0.008s
I20260709 14:52:45.994751  7850 raft_consensus.cc:1275] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 14:52:46.001214  7778 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072"
dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:37144
W20260709 14:52:45.999883  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 83271.5us
I20260709 14:52:46.003929  7778 raft_consensus.cc:493] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:52:46.004554  7778 raft_consensus.cc:3060] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Advancing to term 15
I20260709 14:52:46.007128  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:46.008245  7775 raft_consensus.cc:2393] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 12: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:52:45.936017  7676 rpcz_store.cc:276] 0709 14:52:39.383886 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:39.385868 (+  1982us) service_pool.cc:224] Handling call
0709 14:52:45.877864 (+6491996us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 14:52:40.220476 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 14:52:40.358061 (+137585us) write_op.cc:432] Acquiring schema lock in shared mode
0709 14:52:40.364815 (+  6754us) write_op.cc:435] Acquired schema lock
0709 14:52:40.385953 (+ 21138us) tablet.cc:662] Decoding operations
0709 14:52:40.521030 (+135077us) write_op.cc:620] Acquiring the partition lock for write op
0709 14:52:40.521120 (+    90us) write_op.cc:641] Partition lock acquired for write op
0709 14:52:40.521154 (+    34us) tablet.cc:685] Acquiring locks for 23 operations
0709 14:52:40.546855 (+ 25701us) tablet.cc:701] Row locks acquired
0709 14:52:40.550099 (+  3244us) write_op.cc:260] PREPARE: finished
0709 14:52:40.564398 (+ 14299us) write_op.cc:270] Start()
0709 14:52:40.579214 (+ 14816us) write_op.cc:276] Timestamp: P: 1783608760562040 usec, L: 0
0709 14:52:40.581680 (+  2466us) op_driver.cc:348] REPLICATION: starting
0709 14:52:40.693201 (+111521us) log.cc:844] Serialized 9005 byte log entry
0709 14:52:41.184429 (+491228us) op_driver.cc:464] REPLICATION: finished
0709 14:52:41.412212 (+227783us) write_op.cc:301] APPLY: starting
0709 14:52:41.421379 (+  9167us) tablet.cc:1367] starting BulkCheckPresence
0709 14:52:41.805028 (+383649us) tablet.cc:1370] finished BulkCheckPresence
0709 14:52:41.843389 (+ 38361us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 14:52:42.407234 (+563845us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 14:52:42.408055 (+   821us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=46,key_file_lookups=46,delta_file_lookups=46,mrs_lookups=0
0709 14:52:42.408116 (+    61us) write_op.cc:312] APPLY: finished
0709 14:52:42.408651 (+   535us) log.cc:844] Serialized 204 byte log entry
0709 14:52:42.430118 (+ 21467us) write_op.cc:489] Releasing partition, row and schema locks
0709 14:52:42.430389 (+   271us) write_op.cc:454] Released schema lock
0709 14:52:42.430460 (+    71us) write_op.cc:341] FINISH: Updating metrics
0709 14:52:42.431015 (+   555us) write_op.cc:489] Releasing partition, row and schema locks
0709 14:52:42.431045 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":57049,"reported_tablets":46,"child_traces":[["op",{"apply.queue_time_us":210865,"apply.run_cpu_time_us":49154,"apply.run_wall_time_us":1032174,"cfile_cache_hit":94,"cfile_cache_hit_bytes":99991,"num_ops":23,"prepare.queue_time_us":179717,"prepare.run_cpu_time_us":28050,"prepare.run_wall_time_us":589736,"raft.queue_time_us":229656,"raft.run_cpu_time_us":10919,"raft.run_wall_time_us":65075,"replication_time_us":602538,"thread_start_us":362927,"threads_started":5,"wal-append.queue_time_us":261104,"wal-append.run_cpu_time_us":28534,"wal-append.run_wall_time_us":2374889}]]}
I20260709 14:52:45.919086 12546 raft_consensus.cc:2749] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 14:52:46.011629  7777 raft_consensus.cc:1275] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 14:52:45.883504 12383 raft_consensus.cc:515] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:46.017884  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 59089.7us
I20260709 14:52:46.018721  7772 raft_consensus.cc:2468] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 16.
I20260709 14:52:46.010115  7674 catalog_manager.cc:5697] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:52:46.021807  7778 raft_consensus.cc:515] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:46.018786  7819 leader_election.cc:304] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed
W20260709 14:52:46.037871  7743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:46.034132  7674 catalog_manager.cc:5697] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 11 to 12, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 12 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
W20260709 14:52:46.115046  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 187393us
I20260709 14:52:45.960609 12555 consensus_queue.cc:1048] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.063s
I20260709 14:52:46.135681  7674 catalog_manager.cc:5697] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:52:46.137615  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9441e831627143a991a1556dcdce71e3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:52:46.122092  7744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:46.121133  7852 raft_consensus.cc:1275] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 14:52:46.001783 12547 raft_consensus.cc:493] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:46.133179  7919 raft_consensus.cc:1240] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 14:52:46.023085 12457 raft_consensus.cc:2749] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 14:52:46.215384  7847 raft_consensus.cc:1240] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 15. Current term is 16. Ops: []
I20260709 14:52:46.576958 12258 raft_consensus.cc:493] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:52:46.207432  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:46.008631 12621 raft_consensus.cc:515] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:46.237211  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 232641us
W20260709 14:52:46.593891 12542 consensus_meta.cc:287] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent flushing consensus metadata: real 0.885s	user 0.009s	sys 0.005s
W20260709 14:52:46.256304  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:46.220651  7674 catalog_manager.cc:5697] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 11 to 14. New cstate: current_term: 14 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:52:46.357003  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:46.544360 12546 raft_consensus.cc:493] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:52:46.545104  7743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:46.290499 12664 consensus_queue.cc:1059] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.277s
I20260709 14:52:46.211311 12660 raft_consensus.cc:493] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:52:46.292032 12637 log.cc:927] Time spent T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
W20260709 14:52:46.440493 12537 consensus_meta.cc:287] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent flushing consensus metadata: real 0.792s	user 0.010s	sys 0.005s
I20260709 14:52:46.203840 12536 consensus_queue.cc:237] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:46.237917 12495 raft_consensus.cc:493] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:52:46.473706  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 240294us
W20260709 14:52:46.292354  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:52:46.283932 12641 log.cc:927] Time spent T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.129s	user 0.000s	sys 0.001s
W20260709 14:52:46.403574 12662 log.cc:927] Time spent T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.390s	user 0.003s	sys 0.000s
W20260709 14:52:46.402335 12670 log.cc:927] Time spent T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.183s	user 0.000s	sys 0.003s
I20260709 14:52:46.441891 12383 leader_election.cc:290] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 17 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:46.212481 12606 raft_consensus.cc:493] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
W20260709 14:52:46.449049 12500 consensus_meta.cc:287] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent flushing consensus metadata: real 0.693s	user 0.012s	sys 0.001s
W20260709 14:52:46.346027 12663 log.cc:927] Time spent T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.337s	user 0.000s	sys 0.001s
W20260709 14:52:46.448216 12672 log.cc:927] Time spent T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.212s	user 0.000s	sys 0.004s
I20260709 14:52:46.440353  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:46.032315 12529 consensus_queue.cc:1048] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.207s
I20260709 14:52:46.352149 12488 leader_election.cc:290] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 16 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:46.473871 11963 consensus_queue.cc:1059] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 14:52:46.463272  7928 consensus_meta.cc:287] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent flushing consensus metadata: real 0.504s	user 0.011s	sys 0.003s
I20260709 14:52:46.674980  7928 raft_consensus.cc:2468] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 15.
I20260709 14:52:46.606801 12258 raft_consensus.cc:515] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:46.210690 12560 raft_consensus.cc:493] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:52:46.571342 12680 log.cc:927] Time spent T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.127s	user 0.002s	sys 0.000s
W20260709 14:52:46.531002  7927 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.022s	sys 0.027s
W20260709 14:52:46.686851  7927 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.667s	user 0.023s	sys 0.028s
I20260709 14:52:46.291277  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
W20260709 14:52:46.582880 12561 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.030s	sys 0.056s
W20260709 14:52:46.694063 12561 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.666s	user 0.031s	sys 0.056s
I20260709 14:52:46.694993  7845 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 3816) took 1639 ms. Trace:
I20260709 14:52:46.597466  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:46.695636  7778 leader_election.cc:290] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:46.696244  7847 raft_consensus.cc:2393] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 17: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:52:46.697525  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:46.698031  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:46.698894  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783e4874513449ef9084b833f188a6d3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:46.699340 12488 raft_consensus.cc:493] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:46.700260  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:46.214251  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:46.702443  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:46.602836  7893 leader_election.cc:304] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:52:46.704108  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 101397us
I20260709 14:52:46.036863 12612 raft_consensus.cc:2804] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Leader election won for term 14
I20260709 14:52:46.705708 12612 raft_consensus.cc:697] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:52:46.707042 12612 consensus_queue.cc:237] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:46.708102 12534 raft_consensus.cc:2804] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 14:52:46.708773 12534 raft_consensus.cc:697] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:46.616979  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:52:46.620389  7853 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.600s	user 0.007s	sys 0.008s
W20260709 14:52:46.709555  7853 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.689s	user 0.007s	sys 0.008s
I20260709 14:52:46.695637  7845 rpcz_store.cc:276] 0709 14:52:45.056271 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:45.721424 (+665153us) service_pool.cc:224] Handling call
0709 14:52:45.721921 (+   497us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 14:52:45.739447 (+ 17526us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:52:45.739484 (+    37us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 14:52:45.803245 (+ 63761us) log.cc:844] Serialized 52 byte log entry
0709 14:52:46.121821 (+318576us) raft_consensus.cc:1645] Marking committed up to 7
0709 14:52:46.121870 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:46.121952 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:52:46.694724 (+572772us) raft_consensus.cc:1685] finished
0709 14:52:46.694747 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:46.694921 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3064,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":97,"thread_start_us":132744,"threads_started":1,"wal-append.queue_time_us":555569}
I20260709 14:52:46.712700 12534 consensus_queue.cc:237] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:46.715878  7928 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38516 (request call id 2620) took 2699 ms (client timeout 1539 ms). Trace:
I20260709 14:52:46.689436 12679 consensus_queue.cc:1048] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 14:52:46.699150  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:46.719125  7850 raft_consensus.cc:2468] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 14.
I20260709 14:52:46.720187  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
W20260709 14:52:46.610479 12473 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.615s	user 0.005s	sys 0.006s
W20260709 14:52:46.723369 12473 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.757s	user 0.006s	sys 0.007s
I20260709 14:52:46.724399 12258 leader_election.cc:290] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:46.620146 12457 raft_consensus.cc:493] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:46.725457 12457 raft_consensus.cc:515] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:46.618251 12524 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.913s	user 0.000s	sys 0.017s
I20260709 14:52:46.610575 12555 raft_consensus.cc:493] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:46.728129 12457 leader_election.cc:290] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:46.620117 12542 raft_consensus.cc:493] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:46.620711 12687 raft_consensus.cc:493] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
W20260709 14:52:46.528532 12272 consensus_meta.cc:287] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent flushing consensus metadata: real 0.988s	user 0.012s	sys 0.004s
I20260709 14:52:46.752828 12501 raft_consensus.cc:3055] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 LEADER]: Stepping down as leader of term 13
I20260709 14:52:46.752537 12272 raft_consensus.cc:515] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:46.607686 12547 raft_consensus.cc:515] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:46.682504  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:46.755227  7848 raft_consensus.cc:3060] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Advancing to term 16
I20260709 14:52:46.689401 11963 consensus_queue.cc:1048] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 14:52:46.691900 12560 raft_consensus.cc:515] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:46.712886  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258d6c2dda954bf5b65930fde8ecb9f3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:46.680859 12631 raft_consensus.cc:493] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:46.686895 12465 raft_consensus.cc:3055] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 14:52:46.716439  7928 rpcz_store.cc:269] 0709 14:52:44.016157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:44.016298 (+   141us) service_pool.cc:224] Handling call
0709 14:52:46.715583 (+2699285us) spinlock_profiling.cc:243] Waited 1.88 s on lock 0x7b5400311ad4. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae922fa 00007fb68fe53b17 00007fb6893ce6d4 00007fb6893ce662 00007fb6893ce591 00007fb6893ce50c 00007fb6893cd7c2 00007fb6891c948c 00007fb6891c88c6 00007fb6891c826f
0709 14:52:46.715756 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4315066624}
I20260709 14:52:46.729771  7852 raft_consensus.cc:2468] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 14.
I20260709 14:52:46.617648 12546 raft_consensus.cc:515] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:46.732730  7745 leader_election.cc:304] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 3876b8ee8d744cb18e91d97aae93b1ac, 9418391fa82a42c79c6cad13ba91d964
I20260709 14:52:46.735647  7847 raft_consensus.cc:1275] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 14:52:46.608991  7674 catalog_manager.cc:5697] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:52:46.680388 12383 consensus_queue.cc:1059] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.034s
W20260709 14:52:46.749115  7819 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.101.67:40785 timed out after 1.539s (SENT) [suppressed 16 similar messages]
I20260709 14:52:46.628512 12660 raft_consensus.cc:515] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:46.676964 12529 consensus_queue.cc:1243] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer 3876b8ee8d744cb18e91d97aae93b1ac log is divergent from this leader: its last log entry 8.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
W20260709 14:52:46.728190 12524 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.023s	user 0.001s	sys 0.017s
I20260709 14:52:46.762019  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
W20260709 14:52:46.790131  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 57513.1us
I20260709 14:52:46.720618  7850 raft_consensus.cc:1275] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 14:52:46.681214 12590 raft_consensus.cc:493] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:46.776368 12479 raft_consensus.cc:493] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:46.753461 12501 raft_consensus.cc:740] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:52:46.778249 12560 leader_election.cc:290] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:46.700515 12488 raft_consensus.cc:515] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:46.728551 12555 raft_consensus.cc:515] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:46.790249  7845 raft_consensus.cc:3060] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Advancing to term 17
I20260709 14:52:46.785885  7674 catalog_manager.cc:5697] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:52:46.751112 12500 raft_consensus.cc:493] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:46.770313 12465 raft_consensus.cc:740] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:46.813863  7926 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38516 (request call id 2622) took 2788 ms. Trace:
I20260709 14:52:46.799861  7848 raft_consensus.cc:2468] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 16.
I20260709 14:52:46.741266 12258 raft_consensus.cc:493] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:46.803954  7776 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 3376) took 1472 ms. Trace:
I20260709 14:52:46.654971 12495 raft_consensus.cc:515] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:46.833915  7926 rpcz_store.cc:276] 0709 14:52:44.016693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:44.017056 (+   363us) service_pool.cc:224] Handling call
0709 14:52:44.020586 (+  3530us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:52:44.062576 (+ 41990us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:52:44.062607 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:52:44.063214 (+   607us) log.cc:844] Serialized 26 byte log entry
0709 14:52:45.506772 (+1443558us) spinlock_profiling.cc:243] Waited 2.98 ms on lock 0x7b180042b380. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb690c69de1 00007fb690c765b1 00007fb687d83e07 00007fb690bdeab9 00007fb687da069b 00007fb687d9e93f 00007fb687da0c02 00007fb68aa2820b 00007fb68aa2dd23 00007fb68aa2e0d1 00007fb68ae49a0f
0709 14:52:45.578468 (+ 71696us) raft_consensus.cc:1645] Marking committed up to 5
0709 14:52:45.578536 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:45.578647 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:52:46.788096 (+1209449us) raft_consensus.cc:1685] finished
0709 14:52:46.788119 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:46.805097 (+ 16978us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":41127,"raft.queue_time_us":33111,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":12459,"spinlock_wait_cycles":6850432,"thread_start_us":71191,"threads_started":1,"wal-append.queue_time_us":1819234}
I20260709 14:52:46.848179  7850 raft_consensus.cc:1275] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 14:52:46.837193  7848 raft_consensus.cc:1275] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 14:52:46.754549 12542 raft_consensus.cc:515] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:46.675133 12606 raft_consensus.cc:515] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:46.760802 12687 raft_consensus.cc:515] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:46.872140  7744 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.655s	user 0.026s	sys 0.050s
W20260709 14:52:46.873754  7744 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.656s	user 0.027s	sys 0.050s
I20260709 14:52:46.873929  7845 raft_consensus.cc:2468] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 17.
W20260709 14:52:46.807730 12566 consensus_meta.cc:287] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent flushing consensus metadata: real 0.955s	user 0.016s	sys 0.000s
W20260709 14:52:46.864190  7773 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.648s	user 0.001s	sys 0.014s
I20260709 14:52:46.779740 12631 raft_consensus.cc:515] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:46.880577  7773 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.664s	user 0.002s	sys 0.014s
I20260709 14:52:46.894227  7846 raft_consensus.cc:2468] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 12.
I20260709 14:52:46.840204  7776 rpcz_store.cc:276] 0709 14:52:45.331786 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:45.333491 (+  1705us) service_pool.cc:224] Handling call
0709 14:52:45.349013 (+ 15522us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:52:45.349595 (+   582us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:52:45.349631 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:52:45.357467 (+  7836us) log.cc:844] Serialized 26 byte log entry
0709 14:52:45.869927 (+512460us) raft_consensus.cc:1645] Marking committed up to 5
0709 14:52:45.869993 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:45.870098 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:52:46.803688 (+933590us) raft_consensus.cc:1685] finished
0709 14:52:46.803711 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:46.803881 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3636,"raft.run_cpu_time_us":325,"raft.run_wall_time_us":7972,"thread_start_us":489282,"threads_started":1,"wal-append.queue_time_us":592048}
I20260709 14:52:46.897943  7845 raft_consensus.cc:1275] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 14:52:46.805335 12590 raft_consensus.cc:515] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:46.837944 12383 consensus_queue.cc:1243] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer 3876b8ee8d744cb18e91d97aae93b1ac log is divergent from this leader: its last log entry 11.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 14:52:46.805516 12479 raft_consensus.cc:515] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:46.942974 12546 leader_election.cc:290] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:46.947052 12687 leader_election.cc:290] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:46.947989 12687 raft_consensus.cc:493] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:46.948590 12687 raft_consensus.cc:515] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:46.963585  8597 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.022s	sys 0.080s
W20260709 14:52:46.984437  8597 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.660s	user 0.023s	sys 0.081s
I20260709 14:52:46.955334 12272 leader_election.cc:290] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:46.985927 12272 raft_consensus.cc:2749] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 14:52:46.965428 12665 raft_consensus.cc:3055] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 14:52:46.989477 12665 raft_consensus.cc:740] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:46.991046 12665 consensus_queue.cc:260] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:46.951792 12660 leader_election.cc:290] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:46.993899 12660 consensus_queue.cc:1048] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 14:52:46.996132 12660 raft_consensus.cc:493] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:46.906431 12621 leader_election.cc:290] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:46.849893 12258 raft_consensus.cc:515] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:46.954516 12555 leader_election.cc:290] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:46.841216 12500 raft_consensus.cc:515] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:46.969875 12465 consensus_queue.cc:260] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:46.953966 12542 leader_election.cc:290] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:46.957185 12488 leader_election.cc:290] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:52:47.000133 12643 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.183s	user 0.036s	sys 0.020s
I20260709 14:52:47.050257 12606 leader_election.cc:290] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:46.882831 12501 consensus_queue.cc:260] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:47.026050 12685 log.cc:927] Time spent T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.359s	user 0.004s	sys 0.000s
I20260709 14:52:47.058817  7847 raft_consensus.cc:1275] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 14:52:47.061208  7853 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 3825) took 1238 ms. Trace:
W20260709 14:52:47.023392 12639 log.cc:927] Time spent T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.058s	user 0.000s	sys 0.004s
I20260709 14:52:47.023003 12665 raft_consensus.cc:3060] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 14:52:47.027261 12566 raft_consensus.cc:493] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:47.024905 12660 raft_consensus.cc:515] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:47.306341  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:47.300526  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
W20260709 14:52:47.110249  7743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:52:47.193536  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 444428us
W20260709 14:52:47.083428  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:52:47.117710  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:47.300625  7920 raft_consensus.cc:1240] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 LEADER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 15. Current term is 16. Ops: []
I20260709 14:52:47.320592  7847 pending_rounds.cc:85] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting all ops after (but not including) 7
W20260709 14:52:47.317391  7893 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.612s	user 0.020s	sys 0.026s
I20260709 14:52:47.306016  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:47.257287  7851 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 3813) took 2224 ms. Trace:
I20260709 14:52:47.326488  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:52:47.066172  7854 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.101s	user 0.007s	sys 0.020s
I20260709 14:52:47.201285  7846 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49946 (request call id 3828) took 1377 ms. Trace:
W20260709 14:52:47.069053  7742 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.810s	user 0.031s	sys 0.031s
I20260709 14:52:47.325687  7847 pending_rounds.cc:107] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting uncommitted NO_OP operation due to leader change: 12.8
W20260709 14:52:47.326381  7893 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.621s	user 0.020s	sys 0.026s
W20260709 14:52:47.327565  7854 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.362s	user 0.008s	sys 0.020s
W20260709 14:52:47.328737  7742 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.070s	user 0.035s	sys 0.042s
I20260709 14:52:47.328130  7846 rpcz_store.cc:276] 0709 14:52:45.823631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:45.876735 (+ 53104us) service_pool.cc:224] Handling call
0709 14:52:47.200966 (+1324231us) spinlock_profiling.cc:243] Waited 971 ms on lock 0x7b54000956d4. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae922fa 00007fb68fe53b17 00007fb6893ce6d4 00007fb6893ce662 00007fb6893ce591 00007fb6893ce50c 00007fb6893cd7c2 00007fb6891c948c 00007fb6891c88c6 00007fb6891c826f
0709 14:52:47.201161 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2233990528}
I20260709 14:52:47.320281  7926 raft_consensus.cc:2393] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 16: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
W20260709 14:52:47.332911  7925 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.002s	sys 0.009s
W20260709 14:52:47.333482  7925 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.523s	user 0.002s	sys 0.009s
W20260709 14:52:47.064175 12643 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.243s	user 0.036s	sys 0.020s
W20260709 14:52:47.329288  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 624354us
I20260709 14:52:47.328307  7847 raft_consensus.cc:2889] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:52:47.361567  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:47.373994  7849 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3826) took 1159 ms. Trace:
I20260709 14:52:47.156152 12546 raft_consensus.cc:493] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:47.178040 12479 leader_election.cc:290] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:47.135741 12692 raft_consensus.cc:493] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:47.382707  7849 rpcz_store.cc:276] 0709 14:52:46.214782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:46.702144 (+487362us) service_pool.cc:224] Handling call
0709 14:52:47.359529 (+657385us) spinlock_profiling.cc:243] Waited 462 ms on lock 0x7b54003809d4. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae922fa 00007fb68fe53b17 00007fb6893ce6d4 00007fb6893ce662 00007fb6893ce591 00007fb6893ce50c 00007fb6893cd7c2 00007fb6891c948c 00007fb6891c88c6 00007fb6891c826f
0709 14:52:47.373832 (+ 14303us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1062725504}
W20260709 14:52:47.184527 12678 log.cc:927] Time spent T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.591s	user 0.006s	sys 0.000s
I20260709 14:52:47.359838 12606 raft_consensus.cc:493] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:47.063848 12488 raft_consensus.cc:493] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:47.319510  7853 rpcz_store.cc:276] 0709 14:52:45.822274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:45.900949 (+ 78675us) service_pool.cc:224] Handling call
0709 14:52:45.911875 (+ 10926us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:52:45.915856 (+  3981us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:52:45.916012 (+   156us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:52:45.942133 (+ 26121us) log.cc:844] Serialized 26 byte log entry
0709 14:52:46.710012 (+767879us) raft_consensus.cc:1645] Marking committed up to 5
0709 14:52:46.710062 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:46.710142 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:52:47.060825 (+350683us) raft_consensus.cc:1685] finished
0709 14:52:47.060857 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:47.061103 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":83269,"raft.queue_time_us":3558,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":13594,"thread_start_us":689704,"threads_started":1,"wal-append.queue_time_us":904384}
I20260709 14:52:47.431250  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:47.273097 12465 raft_consensus.cc:3060] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:52:47.431851  7921 raft_consensus.cc:1240] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 14:52:47.108513 12501 raft_consensus.cc:3060] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Advancing to term 14
W20260709 14:52:47.432293  7773 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.537s	user 0.017s	sys 0.027s
W20260709 14:52:47.449765  7773 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.555s	user 0.018s	sys 0.028s
I20260709 14:52:47.331435 12612 raft_consensus.cc:493] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:47.327180  7851 rpcz_store.cc:276] 0709 14:52:45.032717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:45.506915 (+474198us) service_pool.cc:224] Handling call
0709 14:52:45.522899 (+ 15984us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 14:52:45.613199 (+ 90300us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:52:45.613236 (+    37us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 14:52:45.613953 (+   717us) log.cc:844] Serialized 52 byte log entry
0709 14:52:45.943941 (+329988us) raft_consensus.cc:1645] Marking committed up to 8
0709 14:52:46.580660 (+636719us) spinlock_profiling.cc:243] Waited 2.59 ms on lock 0x7b18003a65a0. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb690c69de1 00007fb690c765b1 00007fb687d83e07 00007fb690bdeab9 00007fb687da069b 00007fb687d9e93f 00007fb687d9e455 00007fb68e8863c7 00007fb68ae989a7 00007fb68aea80bf 00007fb68aea8038
0709 14:52:47.049933 (+469273us) log.cc:844] Serialized 14 byte log entry
0709 14:52:47.051237 (+  1304us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:47.256461 (+205224us) spinlock_profiling.cc:243] Waited 75.6 ms on lock 0x7b540020dfd4. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae8ee01 00007fb68ae8d83e 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2 00007fb6891c948c 00007fb6891c88c6
0709 14:52:47.256546 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:52:47.256745 (+   199us) raft_consensus.cc:1685] finished
0709 14:52:47.256766 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:47.257011 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17565,"prepare.queue_time_us":499956,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"raft.queue_time_us":7538,"raft.run_cpu_time_us":343,"raft.run_wall_time_us":6674,"spinlock_wait_cycles":179870976,"thread_start_us":796443,"threads_started":2,"wal-append.queue_time_us":402197}
I20260709 14:52:47.433231  7922 raft_consensus.cc:1275] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 14:52:47.331732 12700 raft_consensus.cc:493] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:52:47.381727  7892 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.003s	sys 0.016s
I20260709 14:52:47.135903 12547 leader_election.cc:290] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:47.089015 12555 raft_consensus.cc:493] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:47.375861 12156 raft_consensus.cc:3055] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 LEADER]: Stepping down as leader of term 13
W20260709 14:52:47.440980  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 448610us
I20260709 14:52:47.437760 12495 leader_election.cc:290] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:52:47.436434  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 61343.8us
I20260709 14:52:47.442411  7920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38532 (request call id 3496) took 1526 ms. Trace:
W20260709 14:52:47.372558 12701 log.cc:927] Time spent T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.160s	user 0.000s	sys 0.002s
I20260709 14:52:47.376423 12691 raft_consensus.cc:493] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:47.376786 12621 raft_consensus.cc:493] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:47.483741  7893 leader_election.cc:304] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:47.376530 12542 raft_consensus.cc:493] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:47.450733  7846 raft_consensus.cc:1240] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 13. Current term is 14. Ops: []
I20260709 14:52:47.437212 12546 raft_consensus.cc:515] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:47.358799 12566 raft_consensus.cc:515] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:47.459458  7892 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.644s	user 0.003s	sys 0.016s
W20260709 14:52:47.435375 12684 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.659s	user 0.027s	sys 0.042s
W20260709 14:52:47.511591 12684 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.736s	user 0.028s	sys 0.042s
I20260709 14:52:47.119820 12500 leader_election.cc:290] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:47.462397 12272 raft_consensus.cc:493] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:52:47.471856 12713 raft_consensus.cc:493] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:47.452490 12606 raft_consensus.cc:515] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:47.479146 12660 leader_election.cc:290] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:47.480052 12555 raft_consensus.cc:515] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:47.458439 12712 raft_consensus.cc:493] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:52:47.481968  7771 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 3392) took 2008 ms. Trace:
W20260709 14:52:47.471099 12698 log.cc:927] Time spent T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.300s	user 0.002s	sys 0.000s
W20260709 14:52:47.461133 12706 log.cc:927] Time spent T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.270s	user 0.002s	sys 0.000s
I20260709 14:52:47.484761  7920 rpcz_store.cc:276] 0709 14:52:45.915632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:45.957994 (+ 42362us) service_pool.cc:224] Handling call
0709 14:52:46.007198 (+ 49204us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:52:47.325707 (+1318509us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:47.442151 (+116444us) spinlock_profiling.cc:243] Waited 1.29 s on lock 0x7b540031fbd4. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae8ee01 00007fb68ae8d83e 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2 00007fb6891c948c 00007fb6891c88c6
0709 14:52:47.442353 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2973974400}
I20260709 14:52:47.489938  7847 raft_consensus.cc:1240] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 15. Current term is 16. Ops: []
W20260709 14:52:47.493513  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 57211.9us
I20260709 14:52:47.552516  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:47.454984  7853 pending_rounds.cc:85] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting all ops after (but not including) 5
I20260709 14:52:47.553460  7853 pending_rounds.cc:107] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 14:52:47.553923  7853 raft_consensus.cc:2889] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:52:47.463207 12590 leader_election.cc:290] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:47.465552 12156 raft_consensus.cc:740] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
W20260709 14:52:47.477975 12702 log.cc:927] Time spent T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.224s	user 0.000s	sys 0.001s
I20260709 14:52:47.484159 12547 raft_consensus.cc:493] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:47.442401 12692 raft_consensus.cc:515] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:47.527441  7846 raft_consensus.cc:1240] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 9. Current term is 10. Ops: []
I20260709 14:52:47.488979 12495 raft_consensus.cc:493] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:47.459609 12612 raft_consensus.cc:515] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:47.505878 12691 raft_consensus.cc:515] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:47.547634  7771 rpcz_store.cc:276] 0709 14:52:45.473146 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:45.718340 (+245194us) service_pool.cc:224] Handling call
0709 14:52:45.718736 (+   396us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:52:45.753305 (+ 34569us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:52:45.808186 (+ 54881us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:52:45.808862 (+   676us) log.cc:844] Serialized 26 byte log entry
0709 14:52:46.039588 (+230726us) raft_consensus.cc:1645] Marking committed up to 7
0709 14:52:46.039654 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:46.040892 (+  1238us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:52:47.183406 (+1142514us) spinlock_profiling.cc:243] Waited 1.79 ms on lock 0x7b4400022b4c. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb687c29db1 00007fb687cc7c85 00007fb687cc86a2 00007fb68aa3a1db 00007fb68aa35aaf 00007fb68aa2986e 00007fb68aa28bb6 00007fb68aa287d8 00007fb68aa32221 00007fb68aa321d9 00007fb68aa32169
0709 14:52:47.481196 (+297790us) raft_consensus.cc:1685] finished
0709 14:52:47.481224 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:47.481840 (+   616us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":33847,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":126,"spinlock_wait_cycles":4125440,"thread_start_us":137329,"threads_started":1,"wal-append.queue_time_us":671937}
I20260709 14:52:47.499082 12687 leader_election.cc:290] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:47.460678 12258 leader_election.cc:290] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:47.458531 12488 raft_consensus.cc:515] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:47.463496 12700 raft_consensus.cc:515] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:47.523769 12703 raft_consensus.cc:2804] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 14:52:47.560112  7847 raft_consensus.cc:2468] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 15.
I20260709 14:52:47.523222 12631 leader_election.cc:290] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:47.523977 12666 raft_consensus.cc:493] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:52:47.627151 12666 raft_consensus.cc:515] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:47.628834 12692 leader_election.cc:290] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:47.500744 12621 raft_consensus.cc:515] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:47.630517 12666 leader_election.cc:290] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:47.500382 12681 consensus_queue.cc:1048] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.058s
I20260709 14:52:47.548255 12717 raft_consensus.cc:493] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:47.504464 12542 raft_consensus.cc:515] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:47.548763 12500 raft_consensus.cc:493] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:47.521587 12272 raft_consensus.cc:515] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:47.548009 12623 consensus_queue.cc:1059] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 14:52:47.648063 12500 raft_consensus.cc:515] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:47.610625  7920 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
mode: GRACEFUL
new_leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:48676
W20260709 14:52:47.620273  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:47.649786  7920 raft_consensus.cc:606] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 LEADER]: Received request to transfer leadership to TS 1de5e20126fa4d8ca0793d19c7b847ed
W20260709 14:52:47.650225 12709 log.cc:927] Time spent T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.410s	user 0.002s	sys 0.001s
I20260709 14:52:47.621170  7925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38532 (request call id 3497) took 1705 ms. Trace:
I20260709 14:52:47.653530  7925 rpcz_store.cc:276] 0709 14:52:45.915911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:45.949862 (+ 33951us) service_pool.cc:224] Handling call
0709 14:52:45.950299 (+   437us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 14:52:46.017631 (+ 67332us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:52:46.017668 (+    37us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 14:52:46.743904 (+726236us) spinlock_profiling.cc:243] Waited 2.74 ms on lock 0x7b2c0010d148. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb689787a11 00007fb689797372 00007fb68aec9a01 00007fb68ae8e43a 00007fb68ae8d83e 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2
0709 14:52:46.762644 (+ 18740us) log.cc:844] Serialized 52 byte log entry
0709 14:52:47.375373 (+612729us) raft_consensus.cc:1645] Marking committed up to 7
0709 14:52:47.375420 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:47.375506 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:52:47.611720 (+236214us) raft_consensus.cc:1685] finished
0709 14:52:47.611742 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:47.621090 (+  9348us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":136086,"raft.queue_time_us":253596,"raft.run_cpu_time_us":267,"raft.run_wall_time_us":26224,"spinlock_wait_cycles":6299008,"thread_start_us":564869,"threads_started":1,"wal-append.queue_time_us":649082}
I20260709 14:52:47.623667 11963 consensus_queue.cc:1059] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 14:52:47.541611 12713 raft_consensus.cc:515] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:47.658962 12713 leader_election.cc:290] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:52:47.563740  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:47.661742  7894 leader_election.cc:304] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:47.662037 12465 consensus_queue.cc:1048] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 14:52:47.663190 12566 leader_election.cc:290] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:47.633378  7845 raft_consensus.cc:2468] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 16.
I20260709 14:52:47.608990 12590 raft_consensus.cc:493] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:52:47.664762 12590 raft_consensus.cc:515] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:52:47.665946 11963 raft_consensus.cc:3055] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 14:52:47.666426 11963 raft_consensus.cc:740] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:47.556885 12712 raft_consensus.cc:515] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:47.638826  7854 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 3801) took 3532 ms. Trace:
I20260709 14:52:47.669492  7854 rpcz_store.cc:276] 0709 14:52:44.101622 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:45.313000 (+1211378us) service_pool.cc:224] Handling call
0709 14:52:45.313398 (+   398us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:52:45.313650 (+   252us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 14:52:45.964191 (+650541us) log.cc:844] Serialized 14 byte log entry
0709 14:52:47.471889 (+1507698us) spinlock_profiling.cc:243] Waited 26.9 ms on lock 0x7b18002740c0. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb690c69de1 00007fb690c765b1 00007fb687d1bc0a 00007fb69145b219 00007fb687da3a40 00007fb687d9e4e4 00007fb687d9e455 00007fb68ae86060 00007fb68ae98716 00007fb68aea9287 00007fb68aea9208
0709 14:52:47.634064 (+162175us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:52:47.634122 (+    58us) raft_consensus.cc:1645] Marking committed up to 8
0709 14:52:47.634176 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:47.634246 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:47.634386 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9656,"prepare.queue_time_us":630634,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":51,"raft.queue_time_us":233465,"raft.run_cpu_time_us":206,"raft.run_wall_time_us":28568,"spinlock_wait_cycles":61979008,"thread_start_us":2176430,"threads_started":3,"wal-append.queue_time_us":1352909}
W20260709 14:52:47.641343 12705 log.cc:927] Time spent T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 14:52:47.634819 12555 leader_election.cc:290] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:47.675102 12488 leader_election.cc:290] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:47.605834 12495 raft_consensus.cc:515] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:47.679352 12495 leader_election.cc:290] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:47.708134 12621 leader_election.cc:290] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:47.709427 12691 leader_election.cc:290] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:47.711668 12500 leader_election.cc:290] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:47.713117 12606 leader_election.cc:290] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:47.647284 12700 leader_election.cc:290] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:47.667382 11963 consensus_queue.cc:260] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:47.721925 11963 raft_consensus.cc:3060] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 14:52:47.646634  7773 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37136 (request call id 2670) took 2065 ms. Trace:
I20260709 14:52:47.725461  7773 rpcz_store.cc:276] 0709 14:52:45.581019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:45.735650 (+154631us) service_pool.cc:224] Handling call
0709 14:52:45.736000 (+   350us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:52:45.831612 (+ 95612us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 14:52:46.021518 (+189906us) log.cc:844] Serialized 14 byte log entry
0709 14:52:47.450356 (+1428838us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:52:47.457275 (+  6919us) log.cc:844] Serialized 26 byte log entry
0709 14:52:47.460331 (+  3056us) raft_consensus.cc:1645] Marking committed up to 5
0709 14:52:47.460375 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:47.460465 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:52:47.646320 (+185855us) raft_consensus.cc:1685] finished
0709 14:52:47.646351 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:47.646537 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":72664,"prepare.queue_time_us":404593,"prepare.run_cpu_time_us":2294,"prepare.run_wall_time_us":107771,"raft.queue_time_us":165778,"raft.run_cpu_time_us":269,"raft.run_wall_time_us":269,"thread_start_us":1375341,"threads_started":3,"wal-append.queue_time_us":1091607}
I20260709 14:52:47.682186 12712 leader_election.cc:290] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:47.684506 12612 leader_election.cc:290] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:47.601272 12547 raft_consensus.cc:515] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:47.731577 12547 leader_election.cc:290] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:47.686311 12546 leader_election.cc:290] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:47.686980  7925 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
mode: GRACEFUL
new_leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:48676
I20260709 14:52:47.733511  7925 raft_consensus.cc:606] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Received request to transfer leadership to TS 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:52:47.733965  7925 raft_consensus.cc:614] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 14:52:47.735118 12590 leader_election.cc:290] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68:42321)
I20260709 14:52:47.690004 12717 raft_consensus.cc:515] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:47.698211  8639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18d29d52d304c87b930d4fb5eaf50b1" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9418391fa82a42c79c6cad13ba91d964" is_pre_election: true
I20260709 14:52:47.736016  7675 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51352 (request call id 134) took 6741 ms. Trace:
I20260709 14:52:47.732194 12156 consensus_queue.cc:260] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:47.739117 12156 raft_consensus.cc:3060] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 14:52:47.736411  7675 rpcz_store.cc:276] 0709 14:52:40.994402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:40.994802 (+   400us) service_pool.cc:224] Handling call
0709 14:52:47.735936 (+6741134us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 14:52:44.546849 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 14:52:44.695781 (+148932us) write_op.cc:432] Acquiring schema lock in shared mode
0709 14:52:44.695823 (+    42us) write_op.cc:435] Acquired schema lock
0709 14:52:44.695841 (+    18us) tablet.cc:662] Decoding operations
0709 14:52:44.696268 (+   427us) write_op.cc:620] Acquiring the partition lock for write op
0709 14:52:44.696349 (+    81us) write_op.cc:641] Partition lock acquired for write op
0709 14:52:44.696380 (+    31us) tablet.cc:685] Acquiring locks for 1 operations
0709 14:52:44.696755 (+   375us) tablet.cc:701] Row locks acquired
0709 14:52:44.696774 (+    19us) write_op.cc:260] PREPARE: finished
0709 14:52:44.696944 (+   170us) write_op.cc:270] Start()
0709 14:52:44.697170 (+   226us) write_op.cc:276] Timestamp: P: 1783608764696887 usec, L: 0
0709 14:52:44.697193 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 14:52:44.698028 (+   835us) log.cc:844] Serialized 533 byte log entry
0709 14:52:45.095762 (+397734us) spinlock_profiling.cc:243] Waited 3.53 ms on lock 0x7b4400022b4c. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb687c29db1 00007fb687cc7c85 00007fb687cc86a2 00007fb68aa3a1db 00007fb68aa35aaf 00007fb687d840ac 00007fb690bdeab9 00007fb687da069b 00007fb687d9e93f 00007fb687da0c02 00007fb68aa2820b
0709 14:52:45.638453 (+542691us) spinlock_profiling.cc:243] Waited 46.1 ms on lock 0x7b4400022b4c. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb687c29db1 00007fb687cc7c85 00007fb687cc86a2 00007fb68aa3a1db 00007fb68aa35aaf 00007fb68aa2986e 00007fb68aa28bb6 00007fb68aa287d8 00007fb68aa32221 00007fb68aa321d9 00007fb68aa32169
0709 14:52:47.172762 (+1534309us) op_driver.cc:464] REPLICATION: finished
0709 14:52:47.605958 (+433196us) write_op.cc:301] APPLY: starting
0709 14:52:47.611728 (+  5770us) tablet.cc:1367] starting BulkCheckPresence
0709 14:52:47.648740 (+ 37012us) tablet.cc:1370] finished BulkCheckPresence
0709 14:52:47.648772 (+    32us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 14:52:47.683508 (+ 34736us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 14:52:47.683943 (+   435us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 14:52:47.684009 (+    66us) write_op.cc:312] APPLY: finished
0709 14:52:47.684540 (+   531us) log.cc:844] Serialized 25 byte log entry
0709 14:52:47.684835 (+   295us) write_op.cc:489] Releasing partition, row and schema locks
0709 14:52:47.684936 (+   101us) write_op.cc:454] Released schema lock
0709 14:52:47.684993 (+    57us) write_op.cc:341] FINISH: Updating metrics
0709 14:52:47.688171 (+  3178us) write_op.cc:489] Releasing partition, row and schema locks
0709 14:52:47.688221 (+    50us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1056070,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":382518,"apply.run_cpu_time_us":5654,"apply.run_wall_time_us":94175,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8295,"num_ops":1,"prepare.queue_time_us":431456,"prepare.run_cpu_time_us":14383,"prepare.run_wall_time_us":640441,"raft.queue_time_us":1329333,"raft.run_cpu_time_us":48084,"raft.run_wall_time_us":312061,"replication_time_us":2465304,"spinlock_wait_cycles":114105344,"thread_start_us":2539366,"threads_started":4,"wal-append.queue_time_us":493707}]]}
I20260709 14:52:47.688995 12542 leader_election.cc:290] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:47.790961  7819 leader_election.cc:304] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:47.765679 12546 raft_consensus.cc:493] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:47.800158  7819 leader_election.cc:304] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:47.804885  7819 leader_election.cc:304] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
W20260709 14:52:47.807557  7743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:47.762275 12465 raft_consensus.cc:2804] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 14:52:47.741220 12272 leader_election.cc:290] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:47.814175  7819 leader_election.cc:304] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:47.816164  7819 leader_election.cc:304] T 9441e831627143a991a1556dcdce71e3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 9418391fa82a42c79c6cad13ba91d964
I20260709 14:52:47.737471 12717 leader_election.cc:290] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:47.766410 12590 raft_consensus.cc:493] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:47.842442  7773 raft_consensus.cc:1240] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 13. Current term is 14. Ops: []
I20260709 14:52:47.802224 12612 raft_consensus.cc:2749] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 14:52:47.810223 12700 raft_consensus.cc:2804] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Leader election won for term 14
I20260709 14:52:47.854988 12700 raft_consensus.cc:697] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:52:47.856623 12700 consensus_queue.cc:237] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:47.813704 12500 raft_consensus.cc:2749] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 14:52:47.816107 12606 raft_consensus.cc:493] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:47.801438 12542 raft_consensus.cc:493] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9418391fa82a42c79c6cad13ba91d964)
I20260709 14:52:47.850981 12590 raft_consensus.cc:515] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:47.812901 12546 raft_consensus.cc:515] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:47.806211 12547 raft_consensus.cc:493] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:47.868767  7776 raft_consensus.cc:1240] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 15. Current term is 16. Ops: [15.7-15.7]
I20260709 14:52:47.806483 12712 raft_consensus.cc:493] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:47.842553  7819 leader_election.cc:304] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:47.838213 12501 raft_consensus.cc:2804] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 14:52:47.874405  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
W20260709 14:52:47.875042  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 254523us
I20260709 14:52:47.815653 12691 raft_consensus.cc:493] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:47.815237 12495 raft_consensus.cc:493] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
W20260709 14:52:47.864570  7818 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.018s	sys 0.010s
I20260709 14:52:47.815915 12621 raft_consensus.cc:493] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:47.838997 12488 raft_consensus.cc:493] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:47.841177 12728 raft_consensus.cc:2749] T 9441e831627143a991a1556dcdce71e3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 14:52:47.875059  7745 leader_election.cc:336] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 1.911s (SENT)
I20260709 14:52:47.877511  7773 raft_consensus.cc:2393] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 16: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:52:47.841591 12465 raft_consensus.cc:697] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:47.882378  7819 leader_election.cc:304] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:47.884974  7745 leader_election.cc:304] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:52:47.879951  7818 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.543s	user 0.018s	sys 0.011s
W20260709 14:52:47.887934  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:47.888769  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
W20260709 14:52:47.889530  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:47.896746  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:47.894783  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:47.897656  7778 raft_consensus.cc:2468] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 14.
I20260709 14:52:47.897886 12272 raft_consensus.cc:2749] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 14:52:47.886647  7819 leader_election.cc:304] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:47.898099 12692 raft_consensus.cc:493] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:47.905212 12692 raft_consensus.cc:515] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:47.908082 12692 leader_election.cc:290] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:47.899629  7772 raft_consensus.cc:1275] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 14:52:47.897455 12495 raft_consensus.cc:515] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:47.898255  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 235266us
I20260709 14:52:47.899471  7774 raft_consensus.cc:2410] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for term 15 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 14:52:47.873714 12501 raft_consensus.cc:493] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:47.915474 11963 consensus_queue.cc:1048] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 14:52:47.918224  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:47.878489 12713 raft_consensus.cc:493] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:47.890265 12500 raft_consensus.cc:2804] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 14:52:47.922931  7773 raft_consensus.cc:2410] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 14:52:47.867233 12606 raft_consensus.cc:515] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:47.870997 12542 raft_consensus.cc:515] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:52:47.883395 12488 raft_consensus.cc:515] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:47.930905  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 44331.1us
I20260709 14:52:47.932075  7819 leader_election.cc:304] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:47.897495 12721 raft_consensus.cc:2804] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 14:52:47.880530 12547 raft_consensus.cc:515] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:47.883343 12621 raft_consensus.cc:515] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:47.879771 12712 raft_consensus.cc:515] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:47.886308 12691 raft_consensus.cc:515] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:47.923882 12501 raft_consensus.cc:3060] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Advancing to term 15
W20260709 14:52:48.002609  7819 connection.cc:256] RPC call timeout handler was delayed by -1.2362954939999327s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1503s for a response
W20260709 14:52:48.003819  7819 connection.cc:256] RPC call timeout handler was delayed by -1.1390954940000029s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16110000000000002s for a response
W20260709 14:52:48.004141  7819 connection.cc:256] RPC call timeout handler was delayed by -1.0886954939999214s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16670000000000001s for a response
W20260709 14:52:48.004400  7819 connection.cc:256] RPC call timeout handler was delayed by -1.0571954939999841s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17020000000000002s for a response
I20260709 14:52:47.935426 12718 raft_consensus.cc:2804] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 14:52:48.005811 12718 raft_consensus.cc:493] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:48.006338 12718 raft_consensus.cc:3060] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Advancing to term 13
I20260709 14:52:48.007090 12621 leader_election.cc:290] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:47.930478 12684 consensus_queue.cc:1059] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.078s
I20260709 14:52:47.924618 12500 raft_consensus.cc:493] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:48.009472 12500 raft_consensus.cc:3060] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 7 FOLLOWER]: Advancing to term 8
I20260709 14:52:47.939610 12721 raft_consensus.cc:493] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:48.013829 12721 raft_consensus.cc:3060] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Advancing to term 13
I20260709 14:52:47.992995 12547 leader_election.cc:290] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:48.016176 12612 raft_consensus.cc:493] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:48.016891 12612 raft_consensus.cc:515] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:48.019462 12712 leader_election.cc:290] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:48.020234 12612 leader_election.cc:290] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:47.977074 12727 raft_consensus.cc:2804] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 14:52:47.990885 12495 leader_election.cc:290] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:47.915237 12665 consensus_queue.cc:1059] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 14:52:47.941085 12703 raft_consensus.cc:697] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
W20260709 14:52:47.977299  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 50084.3us
W20260709 14:52:47.981575  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 45304.1us
I20260709 14:52:47.993907 12726 raft_consensus.cc:493] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:47.932600 12427 consensus_queue.cc:1048] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.062s
I20260709 14:52:47.994817 12606 leader_election.cc:290] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:47.995836 12692 consensus_queue.cc:1048] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 14:52:48.024484 12703 consensus_queue.cc:237] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:48.026374  7893 leader_election.cc:304] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:48.027441 12560 consensus_queue.cc:1048] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 14:52:48.028440 12726 raft_consensus.cc:515] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:47.926858 12713 raft_consensus.cc:515] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:47.999402 12691 leader_election.cc:290] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:48.060772 11963 consensus_queue.cc:1048] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 14:52:48.063120  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:48.062436 11963 consensus_queue.cc:1048] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 14:52:48.062599  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: true dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
W20260709 14:52:48.067471  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 77972.3us
I20260709 14:52:48.067677  7854 raft_consensus.cc:3060] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Advancing to term 15
I20260709 14:52:48.066646  7845 raft_consensus.cc:1275] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 14:52:48.070459  7845 pending_rounds.cc:85] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting all ops after (but not including) 7
I20260709 14:52:48.070725  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:48.072006  7852 raft_consensus.cc:2468] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 15.
I20260709 14:52:48.021740 12612 raft_consensus.cc:493] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:48.071092  7845 pending_rounds.cc:107] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 14:52:48.068475  7894 leader_election.cc:304] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:52:48.076527  7776 raft_consensus.cc:2468] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 16.
I20260709 14:52:48.077644  7845 raft_consensus.cc:2889] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:52:48.080331  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:48.082140  7846 raft_consensus.cc:2468] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 15.
I20260709 14:52:48.045454 12606 raft_consensus.cc:493] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:48.082829  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:48.083328  7850 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1"
dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
mode: GRACEFUL
new_leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:41662
I20260709 14:52:48.088315  7850 raft_consensus.cc:606] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Received request to transfer leadership to TS 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:52:48.088780  7850 raft_consensus.cc:614] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 14:52:48.086395  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:52:48.091581  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 60557.5us
I20260709 14:52:48.084333  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:48.098124  7846 raft_consensus.cc:2468] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 14.
I20260709 14:52:48.021143 12727 raft_consensus.cc:493] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:48.085296  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:48.105901  7819 leader_election.cc:304] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:48.106160  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:48.107131  7776 raft_consensus.cc:2468] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 14.
I20260709 14:52:48.100209  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:48.107821  7846 raft_consensus.cc:2376] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 16. Re-sending same reply.
I20260709 14:52:48.113322  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:48.109449  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:48.113716  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:48.111804  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:48.114322  7774 raft_consensus.cc:2468] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 13.
I20260709 14:52:48.115593  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:48.116261  7774 raft_consensus.cc:2468] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 15.
I20260709 14:52:48.116535  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:48.117586  7777 raft_consensus.cc:2468] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 15.
I20260709 14:52:48.070191 12710 raft_consensus.cc:2804] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 14:52:48.090415  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:48.072137 12691 raft_consensus.cc:493] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:48.118827  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:48.140480  7851 raft_consensus.cc:2393] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 10: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:52:48.119765  7819 leader_election.cc:304] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:48.114262  7776 raft_consensus.cc:2468] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 17.
I20260709 14:52:48.120661  7778 raft_consensus.cc:2393] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 14: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:52:48.119493  7846 raft_consensus.cc:2410] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for term 17 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 14:52:48.118955 12737 consensus_queue.cc:1048] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.055s
I20260709 14:52:48.120519 12727 raft_consensus.cc:3060] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Advancing to term 15
I20260709 14:52:48.087659 12612 raft_consensus.cc:515] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:48.139555 12722 raft_consensus.cc:2749] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 14:52:48.166311 12665 raft_consensus.cc:3055] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 14:52:48.167151 12665 raft_consensus.cc:740] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:48.167917 12590 leader_election.cc:290] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:52:48.169359  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 100978us
I20260709 14:52:48.172241  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783e4874513449ef9084b833f188a6d3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:48.172559 12691 raft_consensus.cc:515] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:48.173120  7770 raft_consensus.cc:2393] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 12: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:52:48.174125 12679 raft_consensus.cc:493] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:48.174647 12679 raft_consensus.cc:515] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:48.174865  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:48.175463  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:48.175694  7922 raft_consensus.cc:2468] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 18.
I20260709 14:52:48.176054  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:48.177438  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: true dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:48.177847  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:48.178478  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:48.179260  7926 raft_consensus.cc:2468] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 10.
I20260709 14:52:48.180248 12681 raft_consensus.cc:493] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:52:48.180946 12681 raft_consensus.cc:515] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:48.182392 12710 raft_consensus.cc:697] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:48.183596 12710 consensus_queue.cc:237] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:48.102053 12606 raft_consensus.cc:515] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:48.138803  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 18 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:48.189916  7779 raft_consensus.cc:2410] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for term 18 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 14:52:48.063537 12707 consensus_queue.cc:1048] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 14:52:48.195305  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:48.197687  7922 raft_consensus.cc:1275] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 14:52:48.199007  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:48.134989  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:48.136292  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18d29d52d304c87b930d4fb5eaf50b1" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:48.139478  7845 raft_consensus.cc:2393] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 16: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:52:48.200232  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:48.200918  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:48.146086  7819 leader_election.cc:304] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:48.149348  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:48.202128  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:48.149603  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:48.202374  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:48.203143  7775 raft_consensus.cc:2468] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 17.
I20260709 14:52:48.146323 12728 raft_consensus.cc:2749] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 14:52:48.175534 12666 raft_consensus.cc:493] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:48.194887  7925 raft_consensus.cc:3055] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 14:52:48.207583  7925 raft_consensus.cc:740] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:48.145112  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
W20260709 14:52:48.208633  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 62651.2us
I20260709 14:52:48.209450  7851 raft_consensus.cc:2410] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 14:52:48.153677  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:48.210161  7773 raft_consensus.cc:2468] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 12.
I20260709 14:52:48.197805  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:48.211468  7819 leader_election.cc:304] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:48.143977  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:48.200131  7777 raft_consensus.cc:2468] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 14.
I20260709 14:52:48.132999  7854 raft_consensus.cc:2468] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 15.
I20260709 14:52:48.204568  7847 raft_consensus.cc:2468] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 15.
W20260709 14:52:48.203862  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:48.206130  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:48.119011  7852 raft_consensus.cc:2393] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 18: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:52:48.206687  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:48.214322  7921 raft_consensus.cc:2468] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 16.
W20260709 14:52:48.157423 12719 log.cc:927] Time spent T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.222s	user 0.000s	sys 0.001s
I20260709 14:52:48.216153 11963 consensus_queue.cc:1048] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 14:52:48.022533 12734 consensus_queue.cc:1059] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.178s
I20260709 14:52:48.212795  7776 raft_consensus.cc:2393] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 11: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:52:48.176941 12679 leader_election.cc:290] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:48.211185  7919 raft_consensus.cc:2468] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 13.
I20260709 14:52:48.169571 12564 raft_consensus.cc:2804] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 14:52:48.217967  7846 raft_consensus.cc:2393] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 13: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:52:48.218379  7819 leader_election.cc:304] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:48.218017  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:48.255136  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:48.220965  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
W20260709 14:52:48.221119  7743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:48.256201  7927 raft_consensus.cc:2468] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 13.
I20260709 14:52:48.158915 12713 leader_election.cc:290] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:48.223563  7777 raft_consensus.cc:1275] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 14:52:48.266758  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783e4874513449ef9084b833f188a6d3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:48.267421  7846 raft_consensus.cc:3060] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:52:48.267704  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:48.268707  7777 raft_consensus.cc:2468] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 10.
I20260709 14:52:48.261770  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:48.270982  7851 raft_consensus.cc:2393] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 17: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:52:48.272104  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:48.226042  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:48.225817  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:48.224234  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:48.235843  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:48.223670  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:48.224073  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:48.274519  7778 raft_consensus.cc:2468] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 15.
I20260709 14:52:48.276032  7777 raft_consensus.cc:1275] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 14:52:48.242554  7774 raft_consensus.cc:1240] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 14. Current term is 15. Ops: []
W20260709 14:52:48.251905  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:48.068409 12465 consensus_queue.cc:237] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:48.255360  7854 raft_consensus.cc:2468] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 13.
I20260709 14:52:48.281555  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:48.220258  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:48.168371 12665 consensus_queue.cc:260] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:48.261004  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:48.287345  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:48.265825 12564 raft_consensus.cc:493] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:52:48.288228  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:48.221941 12666 raft_consensus.cc:515] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:48.293171 12665 raft_consensus.cc:3060] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:52:48.295408 12666 leader_election.cc:290] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:48.208603  7925 consensus_queue.cc:260] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:48.261652  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:48.296890  7776 raft_consensus.cc:2468] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 14.
I20260709 14:52:48.297610  7923 raft_consensus.cc:2468] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 13.
I20260709 14:52:48.287736  7920 raft_consensus.cc:2393] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 15: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:52:48.262495  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
W20260709 14:52:48.263953  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 45668.3us
I20260709 14:52:48.300168  7773 raft_consensus.cc:1275] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 14:52:48.300616  7819 leader_election.cc:304] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
W20260709 14:52:48.253733 12735 log.cc:927] Time spent T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.094s	user 0.000s	sys 0.003s
I20260709 14:52:48.194232 12681 leader_election.cc:290] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:48.215703 12546 leader_election.cc:290] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:48.275612  7849 raft_consensus.cc:2468] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 16.
I20260709 14:52:48.279462  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:48.310609  7770 raft_consensus.cc:2468] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 15.
I20260709 14:52:48.286507  7775 raft_consensus.cc:1275] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 14:52:48.219162 12717 raft_consensus.cc:2749] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 14:52:48.261770  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:48.297060  7925 raft_consensus.cc:3060] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 14:52:48.305469  7850 raft_consensus.cc:2468] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 15.
I20260709 14:52:48.219338 12723 raft_consensus.cc:2749] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 14:52:48.313100  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:48.302502  7819 leader_election.cc:304] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:48.307221  7894 leader_election.cc:304] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:48.324322  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:48.325371  7928 raft_consensus.cc:2468] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 14.
I20260709 14:52:48.327085  7846 raft_consensus.cc:2468] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 12.
I20260709 14:52:48.279312 12722 raft_consensus.cc:2749] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 14:52:48.302277 12560 raft_consensus.cc:3055] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 14:52:48.340037  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c563cc7cfbe4d59be4ffc5cf847ce56" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:48.340978  7849 raft_consensus.cc:2468] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 9.
I20260709 14:52:48.342533  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:48.337152  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:48.331972  7773 raft_consensus.cc:1275] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 14:52:48.337172  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:48.331437  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:48.349645  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:48.351584  7848 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 3845) took 1027 ms. Trace:
I20260709 14:52:48.307633 12564 raft_consensus.cc:3060] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:52:48.352248  7848 rpcz_store.cc:276] 0709 14:52:47.324607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:47.324740 (+   133us) service_pool.cc:224] Handling call
0709 14:52:47.325122 (+   382us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:52:47.806378 (+481256us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:52:47.806418 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:52:47.810010 (+  3592us) log.cc:844] Serialized 26 byte log entry
0709 14:52:48.092557 (+282547us) raft_consensus.cc:1645] Marking committed up to 9
0709 14:52:48.092613 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:48.092722 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:52:48.351190 (+258468us) raft_consensus.cc:1685] finished
0709 14:52:48.351222 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:48.351484 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17482,"raft.queue_time_us":186913,"raft.run_cpu_time_us":226,"raft.run_wall_time_us":14004,"thread_start_us":684783,"threads_started":2,"wal-append.queue_time_us":333696}
I20260709 14:52:48.356520  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:48.345984  7745 leader_election.cc:304] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:48.373265 12495 raft_consensus.cc:2804] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 14:52:48.373822 12495 raft_consensus.cc:493] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:48.348589  7894 leader_election.cc:304] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:48.374078 12272 consensus_queue.cc:1048] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 14:52:48.316285 12501 raft_consensus.cc:515] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:48.382174  7920 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
mode: GRACEFUL
new_leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:48676
I20260709 14:52:48.373744  7745 leader_election.cc:304] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:48.383136  7920 raft_consensus.cc:606] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 LEADER]: Received request to transfer leadership to TS 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:52:48.366750  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:48.392390  7928 raft_consensus.cc:2393] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 15: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:52:48.390619  7924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38516 (request call id 2666) took 1022 ms. Trace:
I20260709 14:52:48.386765  7745 leader_election.cc:304] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:48.397050  7745 leader_election.cc:304] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:48.401415  7854 raft_consensus.cc:2468] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 12.
I20260709 14:52:48.327442 12700 raft_consensus.cc:2749] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 14:52:48.333062 12546 raft_consensus.cc:2749] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 14:52:48.401758  7745 leader_election.cc:304] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:48.411438  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:48.334472 12479 raft_consensus.cc:2804] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 14:52:48.414099  7745 leader_election.cc:304] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
W20260709 14:52:48.412392  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 54609.1us
I20260709 14:52:48.394791  7924 rpcz_store.cc:276] 0709 14:52:47.368551 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:47.368828 (+   277us) service_pool.cc:224] Handling call
0709 14:52:47.369422 (+   594us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:52:47.381200 (+ 11778us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:52:47.381270 (+    70us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:52:47.430106 (+ 48836us) log.cc:844] Serialized 26 byte log entry
0709 14:52:47.634427 (+204321us) raft_consensus.cc:1645] Marking committed up to 6
0709 14:52:47.634485 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:47.634566 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:52:48.390374 (+755808us) raft_consensus.cc:1685] finished
0709 14:52:48.390399 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:48.390554 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43756,"raft.queue_time_us":66530,"raft.run_cpu_time_us":228,"raft.run_wall_time_us":6769,"thread_start_us":169277,"threads_started":1,"wal-append.queue_time_us":435324}
I20260709 14:52:48.418159 11963 raft_consensus.cc:2804] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 14:52:48.418993 11963 raft_consensus.cc:493] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:48.419431 11963 raft_consensus.cc:3060] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 14:52:48.422820  7745 leader_election.cc:304] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:52:48.426229  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 51086.4us
I20260709 14:52:48.339063 12560 raft_consensus.cc:740] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:48.431886  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:48.434177  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:48.435052  7845 raft_consensus.cc:2468] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 13.
I20260709 14:52:48.436313  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:48.437017  7845 raft_consensus.cc:2468] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 15.
I20260709 14:52:48.439927  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:48.427379  7819 leader_election.cc:304] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:48.392849 12495 raft_consensus.cc:3060] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Advancing to term 16
I20260709 14:52:48.432761  7849 raft_consensus.cc:2468] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 10.
I20260709 14:52:48.393337 12712 raft_consensus.cc:2804] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 14:52:48.475062  7925 raft_consensus.cc:2468] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 15.
I20260709 14:52:48.394696 12722 raft_consensus.cc:493] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:48.421973 12479 raft_consensus.cc:493] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:48.424796 12621 raft_consensus.cc:2804] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader election won for term 15
I20260709 14:52:48.412530 12272 raft_consensus.cc:2804] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 14:52:48.417872 12547 raft_consensus.cc:2804] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader election won for term 16
I20260709 14:52:48.428174 12606 leader_election.cc:290] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:48.531214  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c563cc7cfbe4d59be4ffc5cf847ce56" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:48.530732  7744 leader_election.cc:304] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:48.536543  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:48.551906  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:48.556398  7744 leader_election.cc:304] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:48.425019 12724 raft_consensus.cc:2804] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader election won for term 15
I20260709 14:52:48.558106  7920 raft_consensus.cc:2468] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 10.
W20260709 14:52:48.524454 12721 consensus_meta.cc:287] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent flushing consensus metadata: real 0.510s	user 0.014s	sys 0.000s
I20260709 14:52:48.507567 12712 raft_consensus.cc:493] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:48.552801  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:48.571138  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:48.527333 12546 raft_consensus.cc:2804] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 14:52:48.523104 12692 raft_consensus.cc:2749] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 14:52:48.588539  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:48.511871 12542 leader_election.cc:290] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785), 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68:42321)
I20260709 14:52:48.595176  7853 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 3851) took 1267 ms. Trace:
I20260709 14:52:48.595992  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:48.532959 12479 raft_consensus.cc:3060] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 14:52:48.588990  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:48.597508  7849 raft_consensus.cc:2468] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 12.
I20260709 14:52:48.555876 12488 leader_election.cc:290] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:48.595727  7853 rpcz_store.cc:276] 0709 14:52:47.327639 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:47.454357 (+126718us) service_pool.cc:224] Handling call
0709 14:52:47.454760 (+   403us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 14:52:47.554989 (+100229us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:52:47.555031 (+    42us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 14:52:47.562060 (+  7029us) log.cc:844] Serialized 78 byte log entry
0709 14:52:48.046317 (+484257us) raft_consensus.cc:1645] Marking committed up to 5
0709 14:52:48.046367 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:48.046461 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:52:48.594825 (+548364us) raft_consensus.cc:1685] finished
0709 14:52:48.594865 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:48.595093 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":79003,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":47116,"thread_start_us":426193,"threads_started":1,"wal-append.queue_time_us":558123}
W20260709 14:52:48.571275 12740 log.cc:927] Time spent T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 14:52:48.506157 12700 consensus_queue.cc:1059] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.074s
I20260709 14:52:48.556536 12272 raft_consensus.cc:493] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:48.605861  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:48.687492  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:48.606775  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:48.688961  7849 raft_consensus.cc:2468] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 14.
I20260709 14:52:48.610862  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:48.690771  7853 raft_consensus.cc:2468] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 18.
I20260709 14:52:48.613293  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:48.580274 12606 raft_consensus.cc:2749] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 14:52:48.583583 12546 raft_consensus.cc:493] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:48.583997 12712 raft_consensus.cc:3060] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Advancing to term 16
W20260709 14:52:48.606452 12718 consensus_meta.cc:287] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent flushing consensus metadata: real 0.600s	user 0.012s	sys 0.001s
I20260709 14:52:48.556350 12722 raft_consensus.cc:515] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:48.587936  8639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce9c0ef2db24c13a8b1402f21819458" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9418391fa82a42c79c6cad13ba91d964" is_pre_election: true
I20260709 14:52:48.635596  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:48.637406  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:48.646210 12561 raft_consensus.cc:3055] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 14:52:48.619796 12691 leader_election.cc:290] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:48.628738 12542 raft_consensus.cc:2749] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 14:52:48.642272 11963 raft_consensus.cc:515] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:48.589664 12721 raft_consensus.cc:515] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:48.606464  8598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 261946us
W20260709 14:52:48.671216  7743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:52:48.677358  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 254616us
I20260709 14:52:48.692145 12272 raft_consensus.cc:3060] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Advancing to term 15
I20260709 14:52:48.696306  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:48.700124  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:48.706348  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:48.717342  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:48.718087  7849 raft_consensus.cc:2393] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 15: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:52:48.718401 11963 leader_election.cc:290] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 17 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:52:48.678737  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 251411us
I20260709 14:52:48.699013 12546 raft_consensus.cc:3060] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Advancing to term 15
I20260709 14:52:48.721313  7849 raft_consensus.cc:1240] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 14:52:48.720317  7819 leader_election.cc:304] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:48.722281  7745 leader_election.cc:304] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:48.704829 12717 raft_consensus.cc:493] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:48.740314  7745 leader_election.cc:304] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:48.743395  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
W20260709 14:52:48.744956  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:48.708982 12718 raft_consensus.cc:515] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:48.708804 12561 raft_consensus.cc:740] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
W20260709 14:52:48.719641  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 163330us
I20260709 14:52:48.752912  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:48.748872  7745 leader_election.cc:304] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:48.767309  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:48.743568 12758 raft_consensus.cc:493] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:52:48.775413 12744 log.cc:927] Time spent T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.181s	user 0.000s	sys 0.000s
I20260709 14:52:48.778283  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:48.775077 12561 consensus_queue.cc:260] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:48.782215 12561 raft_consensus.cc:3060] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Advancing to term 11
W20260709 14:52:48.785362 12739 log.cc:927] Time spent T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.226s	user 0.000s	sys 0.002s
I20260709 14:52:48.746296 12717 raft_consensus.cc:515] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:48.788064 12717 leader_election.cc:290] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:48.790818  7924 raft_consensus.cc:2468] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 16.
W20260709 14:52:48.762231 12743 log.cc:927] Time spent T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.205s	user 0.001s	sys 0.001s
I20260709 14:52:48.770748  7745 leader_election.cc:304] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
W20260709 14:52:48.797052 12500 consensus_meta.cc:287] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent flushing consensus metadata: real 0.787s	user 0.005s	sys 0.005s
I20260709 14:52:48.756995 12756 raft_consensus.cc:2804] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 14:52:48.836354  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:48.788867 12717 consensus_queue.cc:1048] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.016s
W20260709 14:52:48.833220 12755 log.cc:927] Time spent T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
W20260709 14:52:48.838835 12746 log.cc:927] Time spent T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.120s	user 0.000s	sys 0.001s
I20260709 14:52:48.857059  7771 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37136 (request call id 2672) took 1044 ms. Trace:
I20260709 14:52:48.860126  7771 rpcz_store.cc:276] 0709 14:52:47.812455 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:47.812741 (+   286us) service_pool.cc:224] Handling call
0709 14:52:47.813504 (+   763us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:52:47.813851 (+   347us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:52:47.813882 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:52:47.814572 (+   690us) log.cc:844] Serialized 26 byte log entry
0709 14:52:48.219168 (+404596us) raft_consensus.cc:1645] Marking committed up to 8
0709 14:52:48.219211 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:48.219281 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:52:48.856771 (+637490us) raft_consensus.cc:1685] finished
0709 14:52:48.856798 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:48.856969 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":403770,"threads_started":1,"wal-append.queue_time_us":691127}
W20260709 14:52:48.836556 12766 log.cc:927] Time spent T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 14:52:48.863444  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
W20260709 14:52:48.845539 12745 log.cc:927] Time spent T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.161s	user 0.000s	sys 0.003s
I20260709 14:52:48.840083 12590 raft_consensus.cc:2804] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 14:52:48.872726  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:48.874032  7771 raft_consensus.cc:2468] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 16.
I20260709 14:52:48.793085 12606 consensus_queue.cc:1059] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.059s
I20260709 14:52:48.877789  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:48.878926  7771 raft_consensus.cc:2468] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 13.
I20260709 14:52:48.844587 12756 raft_consensus.cc:493] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:48.892011  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
W20260709 14:52:48.904882  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 184622us
I20260709 14:52:48.842067 12621 raft_consensus.cc:697] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:52:48.855182 12700 consensus_queue.cc:1243] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer 1de5e20126fa4d8ca0793d19c7b847ed log is divergent from this leader: its last log entry 14.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 14:52:48.905853  7819 leader_election.cc:304] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:48.907475  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
W20260709 14:52:48.916458  7778 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.595s	user 0.028s	sys 0.018s
I20260709 14:52:48.803467 12758 raft_consensus.cc:515] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:48.917138  7778 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.596s	user 0.029s	sys 0.019s
I20260709 14:52:48.847297 12500 raft_consensus.cc:515] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:48.875625 12590 raft_consensus.cc:493] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:48.920645  7819 leader_election.cc:304] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:48.930208  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783e4874513449ef9084b833f188a6d3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:48.870510 12547 raft_consensus.cc:697] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:52:48.911590 12756 raft_consensus.cc:3060] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Advancing to term 17
I20260709 14:52:48.928351 12590 raft_consensus.cc:3060] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Advancing to term 17
I20260709 14:52:48.961396  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce9c0ef2db24c13a8b1402f21819458" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:48.923895 12762 raft_consensus.cc:2749] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 14:52:48.928203 12754 raft_consensus.cc:2804] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 14:52:48.967867  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:48.940604 12700 raft_consensus.cc:493] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:48.948561 12722 leader_election.cc:290] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:49.006106 12560 consensus_queue.cc:260] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:49.007544 12758 leader_election.cc:290] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:52:48.988416  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:52:49.015275  8598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 111255us
W20260709 14:52:49.015853  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:49.002769  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:49.012547  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:49.018258  7923 raft_consensus.cc:2468] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 15.
W20260709 14:52:48.977052 12769 log.cc:927] Time spent T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.124s	user 0.000s	sys 0.001s
I20260709 14:52:48.968166 12754 raft_consensus.cc:493] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
W20260709 14:52:49.016114 12742 log.cc:927] Time spent T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.422s	user 0.003s	sys 0.000s
W20260709 14:52:49.033883 12665 consensus_meta.cc:287] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent flushing consensus metadata: real 0.740s	user 0.013s	sys 0.001s
I20260709 14:52:49.034283 12500 leader_election.cc:290] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 8 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:52:49.016993 12752 log.cc:927] Time spent T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.169s	user 0.000s	sys 0.002s
I20260709 14:52:49.034950 12560 raft_consensus.cc:3060] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Advancing to term 14
W20260709 14:52:49.037986 12727 consensus_meta.cc:287] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent flushing consensus metadata: real 0.888s	user 0.009s	sys 0.005s
W20260709 14:52:49.016247 12767 log.cc:927] Time spent T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.075s	user 0.001s	sys 0.001s
I20260709 14:52:49.009683 12721 leader_election.cc:290] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:48.981922 12773 raft_consensus.cc:2804] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader election won for term 12
I20260709 14:52:49.038635 12727 raft_consensus.cc:515] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:49.047506 12726 leader_election.cc:290] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:49.058403 12712 raft_consensus.cc:515] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:49.023977 12718 leader_election.cc:290] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:49.083205 12773 raft_consensus.cc:697] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
W20260709 14:52:49.087116 12564 consensus_meta.cc:287] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0: Time spent flushing consensus metadata: real 0.691s	user 0.014s	sys 0.001s
I20260709 14:52:49.045531 12561 raft_consensus.cc:493] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:49.014038 12700 raft_consensus.cc:515] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:49.030318 12754 raft_consensus.cc:3060] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Advancing to term 15
I20260709 14:52:49.019961 12762 raft_consensus.cc:3055] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 LEADER]: Stepping down as leader of term 16
I20260709 14:52:49.116557 12590 raft_consensus.cc:515] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:48.982263 12621 consensus_queue.cc:237] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:49.094066 12712 leader_election.cc:290] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 16 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:49.061951 12479 raft_consensus.cc:515] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:49.132203 12700 leader_election.cc:290] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:49.099443 12612 leader_election.cc:290] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:49.101500 12773 consensus_queue.cc:237] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:49.104882 12727 leader_election.cc:290] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:49.106353 12757 raft_consensus.cc:3055] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 LEADER]: Stepping down as leader of term 15
W20260709 14:52:49.109037 12750 log.cc:927] Time spent T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.377s	user 0.004s	sys 0.000s
I20260709 14:52:49.111011 12501 leader_election.cc:290] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:49.067835 12547 consensus_queue.cc:237] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:49.124008 12770 log.cc:927] Time spent T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.084s	user 0.003s	sys 0.000s
I20260709 14:52:49.079864 12272 raft_consensus.cc:515] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:49.117544 12724 raft_consensus.cc:697] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:52:49.125066 12762 raft_consensus.cc:740] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:52:49.125412 12564 raft_consensus.cc:515] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:49.168740 12724 consensus_queue.cc:237] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:49.170262 12762 consensus_queue.cc:260] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:49.172015 12762 raft_consensus.cc:3060] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Advancing to term 17
I20260709 14:52:49.142149 12757 raft_consensus.cc:740] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:52:49.178525 12564 leader_election.cc:290] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:49.178066 12757 consensus_queue.cc:260] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 15.7, Last appended by leader: 7, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:49.180109 12757 raft_consensus.cc:3060] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Advancing to term 16
I20260709 14:52:49.181689 12272 leader_election.cc:290] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:49.183331 12590 leader_election.cc:290] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 17 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:49.147454 12479 leader_election.cc:290] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:49.129019 12561 raft_consensus.cc:515] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:49.191202 12561 leader_election.cc:290] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:49.184567 12756 raft_consensus.cc:515] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:49.205516 12546 raft_consensus.cc:515] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:49.215623 12756 leader_election.cc:290] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:49.218400 12754 raft_consensus.cc:515] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:49.222602 12754 leader_election.cc:290] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:52:49.262306  7743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:52:49.265275  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 347856us
I20260709 14:52:49.287393  7845 raft_consensus.cc:2393] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 15: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:52:49.290558  7853 raft_consensus.cc:2393] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 15: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:52:49.302045 12546 leader_election.cc:290] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:49.281015  7744 leader_election.cc:304] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:52:49.328253  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:52:49.329150  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:49.341863  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:49.351622  7778 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 3418) took 1098 ms. Trace:
I20260709 14:52:49.353457  7851 raft_consensus.cc:1240] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
W20260709 14:52:49.357189 12495 consensus_meta.cc:287] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent flushing consensus metadata: real 0.843s	user 0.007s	sys 0.013s
I20260709 14:52:49.362771 12542 raft_consensus.cc:2804] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 14:52:49.367095 12785 raft_consensus.cc:2804] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 14:52:49.355955  7778 rpcz_store.cc:276] 0709 14:52:48.252691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:48.276630 (+ 23939us) service_pool.cc:224] Handling call
0709 14:52:48.276982 (+   352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:52:48.277226 (+   244us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 14:52:48.917698 (+640472us) log.cc:844] Serialized 14 byte log entry
0709 14:52:49.349649 (+431951us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:52:49.349802 (+   153us) raft_consensus.cc:1645] Marking committed up to 9
0709 14:52:49.349936 (+   134us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:49.350080 (+   144us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:49.350786 (+   706us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3777,"prepare.queue_time_us":460908,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"raft.queue_time_us":71913,"raft.run_cpu_time_us":419,"raft.run_wall_time_us":5596,"thread_start_us":1012159,"threads_started":3,"wal-append.queue_time_us":134085}
W20260709 14:52:49.375285  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 94926.5us
I20260709 14:52:49.381996  7853 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3860) took 1294 ms. Trace:
I20260709 14:52:49.386793  7853 rpcz_store.cc:276] 0709 14:52:48.087252 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:48.696008 (+608756us) service_pool.cc:224] Handling call
0709 14:52:49.352224 (+656216us) spinlock_profiling.cc:243] Waited 572 ms on lock 0x7b540019a0d4. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae922fa 00007fb68fe53b17 00007fb6893ce6d4 00007fb6893ce662 00007fb6893ce591 00007fb6893ce50c 00007fb6893cd7c2 00007fb6891c948c 00007fb6891c88c6 00007fb6891c826f
0709 14:52:49.381589 (+ 29365us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1315475328}
I20260709 14:52:49.385907 12785 raft_consensus.cc:493] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:49.386468 12495 raft_consensus.cc:515] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:49.391266 12785 raft_consensus.cc:3060] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Advancing to term 18
I20260709 14:52:49.395381  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:49.397809 12542 raft_consensus.cc:493] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:49.399176 12542 raft_consensus.cc:3060] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Advancing to term 14
I20260709 14:52:49.403203  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:49.404323  7927 raft_consensus.cc:1275] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 14:52:49.406387  7851 raft_consensus.cc:1275] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 14:52:49.407529  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:49.409932 12785 raft_consensus.cc:515] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:49.407938  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:49.413158 12785 leader_election.cc:290] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:49.414297  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:49.416328  7926 raft_consensus.cc:2393] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 17: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:52:49.417750  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:49.412950  7927 raft_consensus.cc:2468] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 14.
I20260709 14:52:49.414995  7845 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 3863) took 1326 ms. Trace:
W20260709 14:52:49.412829  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 492180us
I20260709 14:52:49.424063  7845 rpcz_store.cc:276] 0709 14:52:48.088167 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:48.439655 (+351488us) service_pool.cc:224] Handling call
0709 14:52:49.414551 (+974896us) spinlock_profiling.cc:243] Waited 845 ms on lock 0x7b5400095bd4. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae922fa 00007fb68fe53b17 00007fb6893ce6d4 00007fb6893ce662 00007fb6893ce591 00007fb6893ce50c 00007fb6893cd7c2 00007fb6891c948c 00007fb6891c88c6 00007fb6891c826f
0709 14:52:49.414799 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1943998848}
I20260709 14:52:49.429880  7773 raft_consensus.cc:1240] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 14:52:49.432158  6549 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 14:52:49.414255  7920 raft_consensus.cc:2376] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 15. Re-sending same reply.
I20260709 14:52:49.439422  7819 leader_election.cc:304] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:49.440748 12754 raft_consensus.cc:493] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:49.441386  7925 raft_consensus.cc:2468] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 14.
I20260709 14:52:49.444276  7819 leader_election.cc:304] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:49.446439  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:49.458024  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:49.447721  7850 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 3863) took 1009 ms. Trace:
I20260709 14:52:49.448366 12771 raft_consensus.cc:2804] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 14:52:49.459496 12771 raft_consensus.cc:493] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:49.460333 12771 raft_consensus.cc:3060] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Advancing to term 17
I20260709 14:52:49.459268  7850 rpcz_store.cc:276] 0709 14:52:48.437985 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:48.732536 (+294551us) service_pool.cc:224] Handling call
0709 14:52:48.732894 (+   358us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:52:48.733111 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 14:52:48.742973 (+  9862us) log.cc:844] Serialized 14 byte log entry
0709 14:52:48.934641 (+191668us) log.cc:844] Serialized 14 byte log entry
0709 14:52:49.068519 (+133878us) spinlock_profiling.cc:243] Waited 11.1 ms on lock 0x7b180033bec0. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb690c69de1 00007fb690c765b1 00007fb687da13f3 00007fb687da37c1 00007fb687da3779 00007fb687da3709 00007fb687da36d1 00007fb687da29cd 0000000000396ad4 0000000000396919 00007fb687d8483a
0709 14:52:49.091746 (+ 23227us) spinlock_profiling.cc:243] Waited 4.27 ms on lock 0x7b180033bec0. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb690c69de1 00007fb690c765b1 00007fb687da1522 00007fb687da37c1 00007fb687da3779 00007fb687da3709 00007fb687da36d1 00007fb687da29cd 0000000000396ad4 0000000000396919 00007fb687d8483a
0709 14:52:49.411987 (+320241us) spinlock_profiling.cc:243] Waited 4.8 ms on lock 0x7b180033bec0. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb690c69de1 00007fb690c765b1 00007fb687d1bc0a 00007fb69145b219 00007fb687da3a40 00007fb687d9e4e4 00007fb687d9e455 00007fb68ae86060 00007fb68ae98716 00007fb68aea9287 00007fb68aea9208
0709 14:52:49.436261 (+ 24274us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:52:49.446613 (+ 10352us) raft_consensus.cc:1645] Marking committed up to 9
0709 14:52:49.446898 (+   285us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:49.447033 (+   135us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:49.447372 (+   339us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":346438,"prepare.queue_time_us":13559,"prepare.run_cpu_time_us":126,"prepare.run_wall_time_us":135,"raft.queue_time_us":483292,"raft.run_cpu_time_us":712,"raft.run_wall_time_us":20558,"spinlock_wait_cycles":46440960,"thread_start_us":190460,"threads_started":1,"wal-append.queue_time_us":262371}
W20260709 14:52:49.474180 12793 log.cc:927] Time spent T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 14:52:49.446252  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:49.457845  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 18 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:49.444655  7773 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 3425) took 1019 ms. Trace:
I20260709 14:52:49.476192  7773 rpcz_store.cc:276] 0709 14:52:48.425343 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:48.425472 (+   129us) service_pool.cc:224] Handling call
0709 14:52:48.425987 (+   515us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:52:49.438257 (+1012270us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:49.444086 (+  5829us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b5400325854. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae8ee01 00007fb68ae8d83e 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2 00007fb6891c948c 00007fb6891c88c6
0709 14:52:49.444554 (+   468us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2307411840}
I20260709 14:52:49.470788 12564 raft_consensus.cc:493] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:52:49.478685  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:49.478982  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783e4874513449ef9084b833f188a6d3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:49.477874  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:49.481135  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:49.484027  7921 raft_consensus.cc:2468] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 11.
I20260709 14:52:49.459554  7920 raft_consensus.cc:2468] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 18.
I20260709 14:52:49.456517  7924 raft_consensus.cc:2468] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 12.
W20260709 14:52:49.488145  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:49.486250 12771 raft_consensus.cc:515] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:49.472481  7744 leader_election.cc:304] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:49.456374  7819 leader_election.cc:304] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:49.454610 12495 leader_election.cc:290] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 16 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:49.441789 12754 raft_consensus.cc:515] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:49.490170  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:49.471455  7928 raft_consensus.cc:2468] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 13.
I20260709 14:52:49.501219  6549 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 14:52:49.501734  7745 leader_election.cc:336] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 1.656s (SENT)
I20260709 14:52:49.502203  7819 leader_election.cc:304] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 9418391fa82a42c79c6cad13ba91d964
I20260709 14:52:49.505808 12495 raft_consensus.cc:2749] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 14:52:49.509142 12772 raft_consensus.cc:2804] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 14:52:49.512037 12772 raft_consensus.cc:493] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:49.509188 12771 leader_election.cc:290] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 17 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:49.512905 12772 raft_consensus.cc:3060] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Advancing to term 14
W20260709 14:52:49.522964  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 129013us
I20260709 14:52:49.482072 12564 raft_consensus.cc:515] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:49.530061 12771 raft_consensus.cc:2749] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 14:52:49.531984  7819 leader_election.cc:304] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:49.509737 12754 leader_election.cc:290] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:49.533515 12771 raft_consensus.cc:2804] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 14:52:49.534193 12771 raft_consensus.cc:493] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:49.533406  7853 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 3873) took 1001 ms. Trace:
I20260709 14:52:49.535475 12771 raft_consensus.cc:3060] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Advancing to term 19
I20260709 14:52:49.546079  7845 raft_consensus.cc:1240] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 14. Current term is 15. Ops: []
I20260709 14:52:49.547240  7848 raft_consensus.cc:1275] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 10. (term mismatch)
I20260709 14:52:49.511546 12542 raft_consensus.cc:515] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:49.529140 12564 leader_election.cc:290] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:49.550140  7848 pending_rounds.cc:85] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting all ops after (but not including) 9
I20260709 14:52:49.557332 12774 raft_consensus.cc:2804] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 14:52:49.548938  7853 rpcz_store.cc:276] 0709 14:52:48.514771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:49.395578 (+880807us) service_pool.cc:224] Handling call
0709 14:52:49.425943 (+ 30365us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:52:49.443079 (+ 17136us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 14:52:49.463924 (+ 20845us) log.cc:844] Serialized 14 byte log entry
0709 14:52:49.515210 (+ 51286us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:52:49.515300 (+    90us) raft_consensus.cc:1645] Marking committed up to 9
0709 14:52:49.515356 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:49.515447 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:49.515656 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":605,"prepare.run_cpu_time_us":84,"prepare.run_wall_time_us":88,"raft.queue_time_us":9564,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":156,"thread_start_us":41882,"threads_started":1}
I20260709 14:52:49.560642  7848 pending_rounds.cc:107] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting uncommitted NO_OP operation due to leader change: 15.10
I20260709 14:52:49.571564  7847 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 3874) took 1028 ms. Trace:
I20260709 14:52:49.569399  7848 raft_consensus.cc:2889] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:52:49.572168  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:49.577899  7854 raft_consensus.cc:2393] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 17: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:52:49.575652  7819 leader_election.cc:304] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:49.572161  7847 rpcz_store.cc:276] 0709 14:52:48.533364 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:49.402051 (+868687us) service_pool.cc:224] Handling call
0709 14:52:49.402636 (+   585us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:52:49.439826 (+ 37190us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:52:49.439861 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:52:49.440678 (+   817us) log.cc:844] Serialized 26 byte log entry
0709 14:52:49.503054 (+ 62376us) raft_consensus.cc:1645] Marking committed up to 7
0709 14:52:49.503117 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:49.503413 (+   296us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:52:49.560143 (+ 56730us) raft_consensus.cc:1685] finished
0709 14:52:49.560165 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:49.561478 (+  1313us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32862,"raft.queue_time_us":36540,"raft.run_cpu_time_us":206,"raft.run_wall_time_us":207,"thread_start_us":61799,"threads_started":1,"wal-append.queue_time_us":104383}
I20260709 14:52:49.579107 12774 raft_consensus.cc:493] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
W20260709 14:52:49.588497  7893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:52:49.586201  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 61121.4us
I20260709 14:52:49.586299 12754 raft_consensus.cc:2804] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 14:52:49.597780  7849 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 3869) took 1077 ms. Trace:
I20260709 14:52:49.590581 12774 raft_consensus.cc:3060] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Advancing to term 16
I20260709 14:52:49.609201  7847 raft_consensus.cc:1240] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 14. Current term is 15. Ops: []
I20260709 14:52:49.609421  7819 leader_election.cc:304] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:49.609751 12757 raft_consensus.cc:2804] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 14:52:49.600338 12754 raft_consensus.cc:493] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
W20260709 14:52:49.622139  7893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:49.632268  7845 raft_consensus.cc:1275] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 14:52:49.605350  7849 rpcz_store.cc:276] 0709 14:52:48.471753 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:49.325050 (+853297us) service_pool.cc:224] Handling call
0709 14:52:49.354541 (+ 29491us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:52:49.440589 (+ 86048us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:52:49.440629 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:52:49.441388 (+   759us) log.cc:844] Serialized 26 byte log entry
0709 14:52:49.536524 (+ 95136us) raft_consensus.cc:1645] Marking committed up to 6
0709 14:52:49.536823 (+   299us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:49.536928 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:52:49.548601 (+ 11673us) raft_consensus.cc:1685] finished
0709 14:52:49.548623 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:49.548760 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":84267,"raft.queue_time_us":86194,"raft.run_cpu_time_us":238,"raft.run_wall_time_us":240,"thread_start_us":94307,"threads_started":1,"wal-append.queue_time_us":98437}
I20260709 14:52:49.632788  7845 pending_rounds.cc:85] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting all ops after (but not including) 7
I20260709 14:52:49.637179  7845 pending_rounds.cc:107] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 14:52:49.637585  7845 raft_consensus.cc:2889] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 14:52:49.637513  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 43969.9us
I20260709 14:52:49.620057 12757 raft_consensus.cc:493] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:49.624275 12754 raft_consensus.cc:3060] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Advancing to term 13
I20260709 14:52:49.645038  7847 raft_consensus.cc:1240] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 12. Current term is 13. Ops: []
I20260709 14:52:49.644102 12757 raft_consensus.cc:3060] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Advancing to term 18
I20260709 14:52:49.628629 12495 consensus_queue.cc:1048] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 14:52:49.646159  7854 raft_consensus.cc:1240] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 7. Current term is 8. Ops: []
I20260709 14:52:49.642187 12717 raft_consensus.cc:2804] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 14:52:49.643524 12542 leader_election.cc:290] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 14 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:49.666816 12717 raft_consensus.cc:493] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:49.674314 12717 raft_consensus.cc:3060] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Advancing to term 15
I20260709 14:52:49.676359 11963 raft_consensus.cc:493] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
W20260709 14:52:49.677318  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:49.677402 11963 raft_consensus.cc:515] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:49.696609  7845 raft_consensus.cc:1240] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 12. Current term is 13. Ops: []
I20260709 14:52:49.714362 11963 leader_election.cc:290] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:52:49.729372 12797 log.cc:927] Time spent T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.089s	user 0.002s	sys 0.000s
I20260709 14:52:49.729830  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
W20260709 14:52:49.733654  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 64532.9us
W20260709 14:52:49.735204 12796 log.cc:927] Time spent T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.096s	user 0.003s	sys 0.000s
I20260709 14:52:49.736162 12772 raft_consensus.cc:515] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:49.739830 12717 raft_consensus.cc:515] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:49.741812  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:49.742883 12717 leader_election.cc:290] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:49.741689  7744 leader_election.cc:304] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:49.744971 12724 raft_consensus.cc:2749] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 14:52:49.745159  7853 raft_consensus.cc:1240] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 14. Current term is 15. Ops: []
I20260709 14:52:49.748174  7744 leader_election.cc:304] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:49.749805  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:49.751246  7854 raft_consensus.cc:3060] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Advancing to term 16
I20260709 14:52:49.753502 12724 raft_consensus.cc:2749] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 14:52:49.755034  7744 leader_election.cc:304] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:52:49.756425 12724 raft_consensus.cc:2804] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 14:52:49.757115 12724 raft_consensus.cc:493] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:49.757603 12724 raft_consensus.cc:3060] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Advancing to term 15
I20260709 14:52:49.759577 11963 consensus_queue.cc:1048] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 14:52:49.763432  7893 leader_election.cc:304] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:52:49.763767 12772 leader_election.cc:290] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 14 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:49.765450 11963 raft_consensus.cc:2804] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 14:52:49.765960 12799 log.cc:927] Time spent T 00000000000000000000000000000000 P 133636659113430cb53b321cb0b1d9ee: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 14:52:49.766045 11963 raft_consensus.cc:493] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:52:49.766639 11963 raft_consensus.cc:3060] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:52:49.767148  7744 leader_election.cc:304] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:49.777279 12542 raft_consensus.cc:2804] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 14:52:49.778278 12542 raft_consensus.cc:493] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:49.779052 12542 raft_consensus.cc:3060] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Advancing to term 14
I20260709 14:52:49.780282  7744 leader_election.cc:304] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
W20260709 14:52:49.773455  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 57360.5us
I20260709 14:52:49.783349  7819 leader_election.cc:304] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:49.786422  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:49.784494  7848 raft_consensus.cc:2468] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 12.
I20260709 14:52:49.796334 12272 raft_consensus.cc:2804] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 14:52:49.796911 12272 raft_consensus.cc:493] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting leader election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:52:49.797345 12272 raft_consensus.cc:3060] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:52:49.798624 12771 raft_consensus.cc:515] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:49.790278 12772 raft_consensus.cc:2804] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 14:52:49.802958 12772 raft_consensus.cc:493] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:49.803588 12772 raft_consensus.cc:3060] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Advancing to term 17
I20260709 14:52:49.808089 12774 raft_consensus.cc:515] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:49.810608 12757 raft_consensus.cc:515] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:49.810971  7894 leader_election.cc:304] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:49.812019  7846 raft_consensus.cc:1240] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 17. Current term is 18. Ops: []
I20260709 14:52:49.813163 12564 raft_consensus.cc:2804] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 14:52:49.813692 12564 raft_consensus.cc:493] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:49.814047 12564 raft_consensus.cc:3060] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Advancing to term 16
W20260709 14:52:49.814147  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:49.816896  7852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 3868) took 1345 ms. Trace:
I20260709 14:52:49.817505  7852 rpcz_store.cc:276] 0709 14:52:48.471510 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:49.299449 (+827939us) service_pool.cc:224] Handling call
0709 14:52:49.300305 (+   856us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:52:49.415774 (+115469us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:52:49.415817 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:52:49.417170 (+  1353us) log.cc:844] Serialized 26 byte log entry
0709 14:52:49.449080 (+ 31910us) spinlock_profiling.cc:243] Waited 2.37 ms on lock 0x7b1800425e00. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb690c69de1 00007fb690c765b1 00007fb687d83e07 00007fb690bdeab9 00007fb687da069b 00007fb687d9e93f 00007fb687da0c02 00007fb68aa2820b 00007fb68aa2dd23 00007fb68aa2e0d1 00007fb68ae49a0f
0709 14:52:49.555388 (+106308us) raft_consensus.cc:1645] Marking committed up to 7
0709 14:52:49.555444 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:49.555594 (+   150us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:52:49.734132 (+178538us) spinlock_profiling.cc:243] Waited 2.19 ms on lock 0x7b4400022b4c. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb687c29db1 00007fb687cc7c85 00007fb687cc86a2 00007fb68aa3a1db 00007fb68aa35aaf 00007fb68aa2986e 00007fb68aa28bb6 00007fb68aa287d8 00007fb68aa32221 00007fb68aa321d9 00007fb68aa32169
0709 14:52:49.816491 (+ 82359us) raft_consensus.cc:1685] finished
0709 14:52:49.816519 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:49.816682 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":136858,"raft.queue_time_us":116135,"raft.run_cpu_time_us":252,"raft.run_wall_time_us":253,"spinlock_wait_cycles":10484864,"thread_start_us":106027,"threads_started":1,"wal-append.queue_time_us":177161}
W20260709 14:52:49.824154  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:49.825639  7894 leader_election.cc:304] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:49.827296 12479 raft_consensus.cc:2804] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 14:52:49.827822 12479 raft_consensus.cc:493] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:52:49.828384 12479 raft_consensus.cc:3060] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 14:52:49.795166  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:49.827729  7894 leader_election.cc:304] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:49.834035  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:49.837231 12754 raft_consensus.cc:515] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:49.840871  7743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:52:49.845853 12800 log.cc:927] Time spent T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.134s	user 0.000s	sys 0.004s
I20260709 14:52:49.848471  7847 raft_consensus.cc:1275] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 14:52:49.834645 12707 raft_consensus.cc:2804] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 14:52:49.850040 12707 raft_consensus.cc:493] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:49.850512 12707 raft_consensus.cc:3060] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Advancing to term 19
I20260709 14:52:49.852335  7846 raft_consensus.cc:1275] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 10. (term mismatch)
I20260709 14:52:49.853060  7846 pending_rounds.cc:85] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting all ops after (but not including) 9
I20260709 14:52:49.854233  7846 pending_rounds.cc:107] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting uncommitted NO_OP operation due to leader change: 14.10
I20260709 14:52:49.854561  7846 raft_consensus.cc:2889] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:52:49.855748 12771 leader_election.cc:290] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 19 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:49.857417 12724 raft_consensus.cc:515] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:49.859261 12757 leader_election.cc:290] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 18 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:49.831593  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:49.863051  7852 raft_consensus.cc:2393] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 17: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:52:49.830470 12272 raft_consensus.cc:515] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:49.862860  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:49.865434 12542 raft_consensus.cc:515] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:49.865815 12479 raft_consensus.cc:515] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:49.866187 12774 leader_election.cc:290] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 16 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:49.866322 12564 raft_consensus.cc:515] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:49.863437 11963 raft_consensus.cc:515] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:49.865386  7854 raft_consensus.cc:2468] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 16.
I20260709 14:52:49.873406  7744 leader_election.cc:304] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:49.881026 12479 leader_election.cc:290] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 15 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:49.888044 12757 raft_consensus.cc:493] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:52:49.889926  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 62384.4us
I20260709 14:52:49.887959 12479 consensus_queue.cc:1048] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 14:52:49.892414 12272 leader_election.cc:290] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:49.867666 12754 leader_election.cc:290] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:49.892720 12564 leader_election.cc:290] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:49.893340 11963 leader_election.cc:290] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 11 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:49.888818 12757 raft_consensus.cc:515] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:49.898201 12772 raft_consensus.cc:515] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:49.900518 12757 leader_election.cc:290] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:49.904723 12542 leader_election.cc:290] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 14 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:49.912483  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:49.913452  7854 raft_consensus.cc:2468] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 15.
I20260709 14:52:49.917845 12564 consensus_queue.cc:1059] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 14:52:49.919502 12707 raft_consensus.cc:515] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:49.923350 12724 leader_election.cc:290] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:49.923507  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:49.924549  7847 raft_consensus.cc:2393] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 15: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:52:49.923009  7893 leader_election.cc:304] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:49.927794  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:49.928761  7848 raft_consensus.cc:2368] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 18. Current term is 19.
I20260709 14:52:49.931118 12542 raft_consensus.cc:2749] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 14:52:49.934806  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:49.933352  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:49.936638  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:49.935128 11963 raft_consensus.cc:3055] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 14:52:49.938987  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:49.940539  7854 raft_consensus.cc:2468] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 14.
I20260709 14:52:49.923103 12707 leader_election.cc:290] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:49.941838 11963 raft_consensus.cc:740] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:49.946240 11963 consensus_queue.cc:260] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:49.948200 11963 raft_consensus.cc:3060] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 14:52:49.947834  7676 catalog_manager.cc:5697] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 14 to 15, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 15 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
W20260709 14:52:49.949734  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 76574us
I20260709 14:52:49.952546  7744 leader_election.cc:304] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:49.955811 12805 consensus_queue.cc:1048] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 14:52:49.959233  7849 raft_consensus.cc:3060] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Advancing to term 17
I20260709 14:52:49.965731  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:49.966952  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:49.931663 12772 leader_election.cc:290] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 17 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:49.965658  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:49.969194  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:49.970973 12724 raft_consensus.cc:2749] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 14:52:49.972975  7744 leader_election.cc:304] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:49.974247 12724 raft_consensus.cc:2749] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 14:52:49.975240  7744 leader_election.cc:304] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:49.984905  7846 raft_consensus.cc:1275] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 14:52:49.989096  7849 raft_consensus.cc:2468] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 17.
I20260709 14:52:49.967396 12479 raft_consensus.cc:2749] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 14:52:50.015441  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:50.036101  7846 raft_consensus.cc:1275] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 14:52:50.005208 12542 raft_consensus.cc:2749] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 14:52:50.036257  7744 leader_election.cc:304] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 9418391fa82a42c79c6cad13ba91d964
I20260709 14:52:50.044902  7676 catalog_manager.cc:5697] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:52:50.048156  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:50.050518  7847 raft_consensus.cc:2393] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 17: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:52:50.054364  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:50.052716  7676 catalog_manager.cc:5697] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 11 to 14, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 14 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:52:50.056752  7849 raft_consensus.cc:1240] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 15. Current term is 16. Ops: []
I20260709 14:52:50.066767  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:50.051311 12724 raft_consensus.cc:2749] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 14:52:50.072345  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 147174us
I20260709 14:52:50.065830  7676 catalog_manager.cc:5697] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 14 to 15, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 15 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
W20260709 14:52:50.076130  7745 leader_election.cc:336] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 2.229s (SENT)
W20260709 14:52:50.076712  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 51500.3us
W20260709 14:52:50.079689  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:50.079936  7745 leader_election.cc:304] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:50.074167 12542 raft_consensus.cc:493] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:50.083416  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
W20260709 14:52:50.085580  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 162838us
I20260709 14:52:50.091339  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:50.097157  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c563cc7cfbe4d59be4ffc5cf847ce56" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:50.091502 12542 raft_consensus.cc:515] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:50.091619 12724 raft_consensus.cc:2749] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 14:52:50.091459 11963 consensus_queue.cc:1059] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 14:52:50.105165  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:50.108464  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:50.109562  7770 raft_consensus.cc:2468] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 18.
I20260709 14:52:50.116093 12542 leader_election.cc:290] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:50.118095  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:50.118813 12804 raft_consensus.cc:3055] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 14:52:50.119306 12804 raft_consensus.cc:740] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:50.120481 12804 consensus_queue.cc:260] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:50.122171 12804 raft_consensus.cc:3060] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 14:52:50.135262  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:50.136253  7778 raft_consensus.cc:2393] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 14: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:52:50.138839  7676 catalog_manager.cc:5697] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 13 to 14, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 14 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:52:50.140645 12561 consensus_queue.cc:1048] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 14:52:50.142496 12561 consensus_queue.cc:1048] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 14:52:50.145967  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:50.150866  7676 catalog_manager.cc:5697] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 8 to 10, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 10 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:52:50.153436  7676 catalog_manager.cc:5697] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 11 to 12, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 12 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:52:50.155628  7676 catalog_manager.cc:5697] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 11 to 12, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 12 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:52:50.176518 12561 consensus_queue.cc:1048] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 14:52:50.178198  7770 raft_consensus.cc:1275] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 14:52:50.172473 12804 raft_consensus.cc:493] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:50.182113 12804 raft_consensus.cc:515] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:50.185514 12807 consensus_queue.cc:1059] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 14:52:50.187090  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:50.188007  7776 raft_consensus.cc:3060] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Advancing to term 17
I20260709 14:52:50.188630 12561 raft_consensus.cc:3055] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 14:52:50.189129 12561 raft_consensus.cc:740] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:50.190408 12561 consensus_queue.cc:260] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:50.188696 12542 raft_consensus.cc:493] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:50.192149 12542 raft_consensus.cc:515] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:50.195333 12542 leader_election.cc:290] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:50.200593 12561 raft_consensus.cc:3060] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 14:52:50.212379  7776 raft_consensus.cc:2468] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 17.
I20260709 14:52:50.210701  7676 catalog_manager.cc:5697] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 12 to 13, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 13 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:52:50.216354  7676 catalog_manager.cc:5697] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 15 to 16, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 16 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:52:50.220528  7676 catalog_manager.cc:5697] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 7 to 10, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 10 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:52:50.225817  7676 catalog_manager.cc:5697] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 11 to 14, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 14 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:52:50.230784  7676 catalog_manager.cc:5697] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 14 to 15, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 15 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:52:50.234689 12757 raft_consensus.cc:493] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:50.233445 12804 leader_election.cc:290] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:50.226714 12772 raft_consensus.cc:493] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:50.251875  7676 catalog_manager.cc:5697] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 14 to 15, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 15 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
W20260709 14:52:50.261001  7743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:50.250216 12757 raft_consensus.cc:515] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:50.270740  7676 catalog_manager.cc:5697] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:52:50.260125 12772 raft_consensus.cc:515] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:50.280252 11963 consensus_queue.cc:1059] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 14:52:50.290647  7773 raft_consensus.cc:1275] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 11. (term mismatch)
I20260709 14:52:50.292902 12479 consensus_queue.cc:1048] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 14:52:50.291514  7773 pending_rounds.cc:85] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed: Aborting all ops after (but not including) 10
I20260709 14:52:50.282302 12786 raft_consensus.cc:493] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:50.302539 12786 raft_consensus.cc:515] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:50.271406 12809 consensus_queue.cc:1059] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 14:52:50.306363 12707 raft_consensus.cc:3055] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 14:52:50.306957 12707 raft_consensus.cc:740] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:50.308270 12707 consensus_queue.cc:260] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:50.298875 12808 log.cc:927] Time spent T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.130s	user 0.000s	sys 0.002s
I20260709 14:52:50.309315  7674 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54364 (request call id 344) took 10292 ms. Trace:
I20260709 14:52:50.311578 12807 consensus_queue.cc:1059] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 14:52:50.322000 12479 raft_consensus.cc:3055] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 14:52:50.322732 12479 raft_consensus.cc:740] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:50.317596 12805 consensus_queue.cc:1059] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 14:52:50.326416 12564 raft_consensus.cc:3055] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 14:52:50.330101  7773 pending_rounds.cc:107] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed: Aborting uncommitted NO_OP operation due to leader change: 16.11
I20260709 14:52:50.332826  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:50.333578 12772 leader_election.cc:290] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:50.335798 12786 leader_election.cc:290] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:50.320374  7674 rpcz_store.cc:276] 0709 14:52:39.948442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:39.948700 (+   258us) service_pool.cc:224] Handling call
0709 14:52:50.237691 (+10288991us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 14:52:47.539908 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 14:52:47.664699 (+124791us) write_op.cc:432] Acquiring schema lock in shared mode
0709 14:52:47.664737 (+    38us) write_op.cc:435] Acquired schema lock
0709 14:52:47.664754 (+    17us) tablet.cc:662] Decoding operations
0709 14:52:47.665810 (+  1056us) write_op.cc:620] Acquiring the partition lock for write op
0709 14:52:47.665865 (+    55us) write_op.cc:641] Partition lock acquired for write op
0709 14:52:47.665890 (+    25us) tablet.cc:685] Acquiring locks for 10 operations
0709 14:52:47.666855 (+   965us) tablet.cc:701] Row locks acquired
0709 14:52:47.666877 (+    22us) write_op.cc:260] PREPARE: finished
0709 14:52:47.667104 (+   227us) write_op.cc:270] Start()
0709 14:52:47.667227 (+   123us) write_op.cc:276] Timestamp: P: 1783608767667044 usec, L: 0
0709 14:52:47.667254 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 14:52:47.668404 (+  1150us) log.cc:844] Serialized 4000 byte log entry
0709 14:52:47.813866 (+145462us) op_driver.cc:464] REPLICATION: finished
0709 14:52:47.860304 (+ 46438us) write_op.cc:301] APPLY: starting
0709 14:52:47.867176 (+  6872us) tablet.cc:1367] starting BulkCheckPresence
0709 14:52:49.092293 (+1225117us) tablet.cc:1370] finished BulkCheckPresence
0709 14:52:49.092653 (+   360us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 14:52:49.479853 (+387200us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 14:52:49.480394 (+   541us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=20,key_file_lookups=20,delta_file_lookups=20,mrs_lookups=0
0709 14:52:49.480463 (+    69us) write_op.cc:312] APPLY: finished
0709 14:52:49.481098 (+   635us) log.cc:844] Serialized 97 byte log entry
0709 14:52:49.580050 (+ 98952us) write_op.cc:489] Releasing partition, row and schema locks
0709 14:52:49.599964 (+ 19914us) write_op.cc:454] Released schema lock
0709 14:52:49.608734 (+  8770us) write_op.cc:341] FINISH: Updating metrics
0709 14:52:49.696363 (+ 87629us) write_op.cc:489] Releasing partition, row and schema locks
0709 14:52:49.700987 (+  4624us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":7786,"reported_tablets":43,"child_traces":[["op",{"apply.queue_time_us":2880,"apply.run_cpu_time_us":59724,"apply.run_wall_time_us":1808052,"cfile_cache_hit":40,"cfile_cache_hit_bytes":41680,"num_ops":10,"prepare.queue_time_us":588626,"prepare.run_cpu_time_us":6065,"prepare.run_wall_time_us":267797,"replication_time_us":126628,"thread_start_us":535137,"threads_started":2,"wal-append.queue_time_us":116353}]]}
I20260709 14:52:50.331928  7773 raft_consensus.cc:2889] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:52:50.335829 12807 raft_consensus.cc:493] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:50.338958  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:50.339802  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:50.340452 12757 leader_election.cc:290] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:50.336925  7745 leader_election.cc:304] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:50.343405  7778 raft_consensus.cc:1275] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 14:52:50.349129  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:50.349409 12479 consensus_queue.cc:260] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:50.351598  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:50.354389  7774 raft_consensus.cc:1240] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260709 14:52:50.355564  7779 raft_consensus.cc:1240] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 14:52:50.337306 12707 raft_consensus.cc:3060] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 14:52:50.359102  7776 raft_consensus.cc:2393] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 12: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:52:50.327623 12564 raft_consensus.cc:740] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:50.354417  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:50.364634 12807 raft_consensus.cc:515] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:50.366627  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:50.367352  7745 leader_election.cc:304] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:52:50.368098  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:50.367679  7777 raft_consensus.cc:2393] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 16: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:52:50.368885 12542 raft_consensus.cc:3060] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Advancing to term 15
I20260709 14:52:50.367337  7770 raft_consensus.cc:3060] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Advancing to term 19
I20260709 14:52:50.370962  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:50.371919  7779 raft_consensus.cc:2393] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 11: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:52:50.363492  7775 raft_consensus.cc:2468] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 14.
I20260709 14:52:50.374070 12724 raft_consensus.cc:2749] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 14:52:50.370427  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:50.368834 12807 leader_election.cc:290] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:50.382370 12542 raft_consensus.cc:2749] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 14:52:50.383958  7778 raft_consensus.cc:3060] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Advancing to term 16
I20260709 14:52:50.393088  7771 raft_consensus.cc:2410] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for term 15 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 14:52:50.397317  7770 raft_consensus.cc:2468] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 19.
W20260709 14:52:50.398131  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:52:50.403523  7745 leader_election.cc:336] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 2.238s (SENT)
I20260709 14:52:50.404248  7745 leader_election.cc:304] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:50.406297 12724 raft_consensus.cc:2749] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 14:52:50.408073  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:50.412377 12479 raft_consensus.cc:3060] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Advancing to term 13
W20260709 14:52:50.417516  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 104997us
I20260709 14:52:50.426533  7894 leader_election.cc:304] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:50.428392 11963 raft_consensus.cc:3055] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 14:52:50.428081 12564 consensus_queue.cc:260] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:50.429332 12564 raft_consensus.cc:3060] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 14:52:50.433759 12757 raft_consensus.cc:493] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:50.434778 12757 raft_consensus.cc:515] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:50.428762 11963 raft_consensus.cc:740] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:50.438090 11963 consensus_queue.cc:260] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:50.439491 11963 raft_consensus.cc:3060] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 14:52:50.437099 12757 leader_election.cc:290] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:50.455142  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:50.455986  7774 raft_consensus.cc:2468] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 9.
I20260709 14:52:50.461858  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:50.463464  7778 raft_consensus.cc:2468] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 16.
I20260709 14:52:50.464392  7774 raft_consensus.cc:2468] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 12.
I20260709 14:52:50.474599  7745 leader_election.cc:304] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:50.479884 12786 raft_consensus.cc:3060] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Advancing to term 15
I20260709 14:52:50.465883 12757 raft_consensus.cc:493] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:50.485913 12757 raft_consensus.cc:515] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:50.487532  7927 raft_consensus.cc:1240] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 14. Current term is 15. Ops: []
I20260709 14:52:50.488833 12757 leader_election.cc:290] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:50.497349 12707 raft_consensus.cc:2804] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 14:52:50.503857  6549 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 14:52:50.503686  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:50.507485  7745 leader_election.cc:304] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:50.515931 12542 raft_consensus.cc:2749] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 14:52:50.519989  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:50.502502 12707 raft_consensus.cc:697] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:50.530354  7745 leader_election.cc:304] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:50.531420 12542 raft_consensus.cc:2749] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 14:52:50.532805  7745 leader_election.cc:304] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:50.531559 12707 consensus_queue.cc:237] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:50.534591 12805 consensus_queue.cc:1059] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 14:52:50.535076  7745 leader_election.cc:400] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 election: Vote denied by peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529) with higher term. Message: Invalid argument: T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 18. Current term is 19.
I20260709 14:52:50.546306  7745 leader_election.cc:403] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
I20260709 14:52:50.554103 11963 consensus_queue.cc:1048] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 14:52:50.555835 11963 consensus_queue.cc:1048] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 14:52:50.557633 12805 raft_consensus.cc:3055] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 14:52:50.559401 12805 raft_consensus.cc:740] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:50.563133 12805 consensus_queue.cc:260] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:50.547640 12786 raft_consensus.cc:2749] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 14:52:50.566810  7745 leader_election.cc:304] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:50.560262  7894 leader_election.cc:304] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:50.566254 12542 raft_consensus.cc:2749] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529) with higher term. Message: Invalid argument: T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 18. Current term is 19.
W20260709 14:52:50.573228  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 52648.2us
I20260709 14:52:50.575582  7745 leader_election.cc:304] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:50.580971 12724 raft_consensus.cc:2749] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 14:52:50.581071  7745 leader_election.cc:304] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:50.582155 12724 raft_consensus.cc:2749] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 14:52:50.577138 12805 raft_consensus.cc:3060] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 14:52:50.573513 12757 raft_consensus.cc:493] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:50.589784  7779 raft_consensus.cc:1240] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 10. Current term is 11. Ops: []
I20260709 14:52:50.589784 12757 raft_consensus.cc:515] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:50.590726  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:50.591303  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:50.589190  7771 raft_consensus.cc:1240] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 14. Current term is 15. Ops: []
I20260709 14:52:50.591432  7778 raft_consensus.cc:2468] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 15.
I20260709 14:52:50.592350  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:50.592411 12757 leader_election.cc:290] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:50.579669 12542 raft_consensus.cc:2804] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 14:52:50.589777  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:50.593856 12542 raft_consensus.cc:493] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:50.595269  7778 raft_consensus.cc:1240] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 14:52:50.595389  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:50.599679  7849 raft_consensus.cc:1240] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 16. Current term is 17. Ops: []
I20260709 14:52:50.595630  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:50.601225  7771 raft_consensus.cc:2468] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 12.
I20260709 14:52:50.601776  7745 leader_election.cc:304] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:50.602922  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:50.603267  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:50.604264  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:50.604831  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:50.604962  7846 raft_consensus.cc:1240] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 16. Current term is 17. Ops: []
I20260709 14:52:50.605551  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:50.606501  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:50.606544  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:50.608208  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:50.609170 12818 raft_consensus.cc:2804] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 14:52:50.609995 12818 raft_consensus.cc:697] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:50.610054  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:50.611147 12818 consensus_queue.cc:237] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:50.611944  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:50.612581  7776 raft_consensus.cc:2468] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 14.
I20260709 14:52:50.613504  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:50.613802 12724 raft_consensus.cc:2749] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 14:52:50.614797  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:50.615602  7849 raft_consensus.cc:3060] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Advancing to term 16
I20260709 14:52:50.610128  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
W20260709 14:52:50.623238  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 44608.7us
I20260709 14:52:50.614254  7847 raft_consensus.cc:2468] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 16.
W20260709 14:52:50.628993  7819 connection.cc:256] RPC call timeout handler was delayed by -1.4856477820000009s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22000000000000003s for a response
I20260709 14:52:50.630126  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:50.601298 12542 raft_consensus.cc:3060] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Advancing to term 15
I20260709 14:52:50.637502 11963 raft_consensus.cc:493] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:50.639377  7778 raft_consensus.cc:2393] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 15: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:52:50.639124 11963 raft_consensus.cc:515] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:50.640823  7845 raft_consensus.cc:1240] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 13. Current term is 14. Ops: []
I20260709 14:52:50.638306  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:50.641790  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:50.642364  7770 raft_consensus.cc:2393] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 17: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:52:50.642771  7852 raft_consensus.cc:2393] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 19: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:52:50.644294 11963 leader_election.cc:290] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:50.655932  7745 leader_election.cc:304] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:50.659267  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:50.659168  7850 raft_consensus.cc:1240] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 14:52:50.660480  7770 raft_consensus.cc:2393] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 14: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
W20260709 14:52:50.667320  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 50610.7us
I20260709 14:52:50.637485 12757 raft_consensus.cc:493] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:50.625926 12805 consensus_queue.cc:1059] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 14:52:50.629945 12786 consensus_queue.cc:1048] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.032s
I20260709 14:52:50.678221  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:50.680603  7854 raft_consensus.cc:2468] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 10.
I20260709 14:52:50.658541 12772 raft_consensus.cc:493] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:52:50.683708  7894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:50.686017  7893 leader_election.cc:304] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:50.686097  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:50.688087  7770 raft_consensus.cc:2393] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 19: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:52:50.690845  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:50.692826  7849 raft_consensus.cc:2468] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 16.
I20260709 14:52:50.694746  7850 raft_consensus.cc:1240] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 12. Current term is 13. Ops: []
I20260709 14:52:50.701367 11963 raft_consensus.cc:3060] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Advancing to term 14
W20260709 14:52:50.736670  7894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:50.749454 12833 raft_consensus.cc:493] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:50.750380 12833 raft_consensus.cc:515] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:50.752395  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:50.752677 12840 raft_consensus.cc:2804] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader election won for term 17
I20260709 14:52:50.754148 12840 raft_consensus.cc:697] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
W20260709 14:52:50.754276  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 130232us
I20260709 14:52:50.678406 12757 raft_consensus.cc:515] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:50.757476  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:50.762573  7770 raft_consensus.cc:2393] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 16: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:52:50.767866  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:50.768152  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:50.769114  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:50.687148 12772 raft_consensus.cc:515] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:50.770488  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 89922.9us
I20260709 14:52:50.762382  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:50.770406  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:50.772696  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:50.774340  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:50.775014  7778 raft_consensus.cc:2410] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 14:52:50.775669  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:50.784317  7928 raft_consensus.cc:1275] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 14:52:50.787338  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:50.789376  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:50.802366 11963 raft_consensus.cc:2749] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 14:52:50.803555  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 47148.5us
I20260709 14:52:50.807175  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:50.808391  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:50.810174  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:50.804720  7745 leader_election.cc:304] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:50.815629  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:50.815953  7819 leader_election.cc:304] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:50.800329  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:50.817023  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:50.819010  7928 raft_consensus.cc:2410] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 14:52:50.820026 12479 raft_consensus.cc:493] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:50.820977 12479 raft_consensus.cc:515] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:50.823572 12479 leader_election.cc:290] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:50.816425  7850 raft_consensus.cc:2468] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 13.
I20260709 14:52:50.829938  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
W20260709 14:52:50.830576  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:50.831719  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
W20260709 14:52:50.832186 12832 log.cc:927] Time spent T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 14:52:50.832543  7924 raft_consensus.cc:2393] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 17: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
W20260709 14:52:50.856772  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:52:50.857861  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 52498.8us
W20260709 14:52:50.846369  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 56919.2us
I20260709 14:52:50.899099 12842 raft_consensus.cc:3060] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Advancing to term 17
I20260709 14:52:50.846335  7922 raft_consensus.cc:2393] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 15: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:52:50.912969  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
W20260709 14:52:50.974689  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 172571us
I20260709 14:52:50.913182  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
W20260709 14:52:50.926273 12829 log.cc:927] Time spent T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.149s	user 0.000s	sys 0.000s
I20260709 14:52:50.829957 12833 leader_election.cc:290] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:50.845947 12831 consensus_queue.cc:1048] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.104s
I20260709 14:52:50.962289  7927 raft_consensus.cc:1240] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 10. Current term is 11. Ops: []
I20260709 14:52:50.910831 12840 consensus_queue.cc:237] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:50.967856  7925 raft_consensus.cc:2468] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 15.
W20260709 14:52:50.969762  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:52:50.970326  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:50.868996  7920 raft_consensus.cc:2468] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 13.
I20260709 14:52:50.972328  7921 raft_consensus.cc:2468] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 15.
W20260709 14:52:50.962479  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:50.977335  7919 raft_consensus.cc:2468] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 15.
I20260709 14:52:50.973068  7926 raft_consensus.cc:2468] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 8.
I20260709 14:52:50.978688  7779 raft_consensus.cc:2468] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 15.
W20260709 14:52:50.910622 12832 log.cc:927] Time spent T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 14:52:50.985193  7923 raft_consensus.cc:2468] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 13.
W20260709 14:52:50.990228  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 185631us
I20260709 14:52:51.000521  7745 leader_election.cc:304] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:51.004696  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:51.005515  7924 raft_consensus.cc:3060] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Advancing to term 15
W20260709 14:52:51.006807  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 45171.4us
I20260709 14:52:51.008832  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:50.987005 12805 raft_consensus.cc:3055] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 14:52:51.011461  7928 raft_consensus.cc:2393] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 19: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:52:51.016229  7850 raft_consensus.cc:1240] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 15. Current term is 16. Ops: []
I20260709 14:52:51.018582  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:51.023524 12786 raft_consensus.cc:2749] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 14:52:51.014778 12805 raft_consensus.cc:740] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:51.029374  7744 leader_election.cc:304] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:51.032061  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:51.041728  7745 leader_election.cc:304] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:51.035156 12724 raft_consensus.cc:2804] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader election won for term 14
I20260709 14:52:51.040743 12757 leader_election.cc:290] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:51.040848 12772 leader_election.cc:290] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:51.027210 12707 consensus_queue.cc:1048] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 14:52:51.013752 12845 consensus_queue.cc:1059] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 14:52:51.052205  7819 leader_election.cc:304] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:51.053364  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:51.057726 12831 raft_consensus.cc:2749] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 14:52:51.069219  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 46189.8us
W20260709 14:52:51.072389 12830 log.cc:927] Time spent T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.362s	user 0.002s	sys 0.004s
I20260709 14:52:51.072188 12805 consensus_queue.cc:260] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:51.073643 12805 raft_consensus.cc:3060] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 14:52:51.073945  7744 leader_election.cc:304] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:51.076082  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:51.056267  7924 raft_consensus.cc:2468] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 15.
W20260709 14:52:51.087404  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 45775.4us
I20260709 14:52:51.088689  7745 leader_election.cc:304] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:51.092109  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:51.095777  7928 raft_consensus.cc:2410] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 14:52:51.110567 12819 consensus_queue.cc:1048] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 14:52:51.112452 12819 consensus_queue.cc:1059] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 14:52:51.113461 12819 raft_consensus.cc:3055] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 14:52:51.113830 12819 raft_consensus.cc:740] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:51.114696 12819 consensus_queue.cc:260] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:51.115892 12819 raft_consensus.cc:3060] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 14:52:51.096341 12845 raft_consensus.cc:2749] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 14:52:51.123982  7927 raft_consensus.cc:2468] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 18.
I20260709 14:52:51.090550 12840 consensus_queue.cc:1059] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 14:52:51.096089 12850 raft_consensus.cc:2749] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 14:52:51.127775 12818 consensus_queue.cc:1059] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 14:52:51.140913 12786 raft_consensus.cc:493] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:52:51.140627 12844 log.cc:927] Time spent T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
W20260709 14:52:51.161739 12835 log.cc:927] Time spent T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.174s	user 0.000s	sys 0.002s
I20260709 14:52:51.162205 12805 consensus_queue.cc:1059] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 14:52:51.187624 12786 raft_consensus.cc:515] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:51.189320 12839 raft_consensus.cc:2749] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 14:52:51.191129 12786 leader_election.cc:290] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:52:51.192911  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 146754us
I20260709 14:52:51.193351 12818 raft_consensus.cc:3055] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 14:52:51.193832 12818 raft_consensus.cc:740] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:51.195053 12831 raft_consensus.cc:3055] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 LEADER]: Stepping down as leader of term 15
I20260709 14:52:51.195701 12831 raft_consensus.cc:740] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:52:51.196593 12805 raft_consensus.cc:3055] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 14:52:51.197137 12805 raft_consensus.cc:740] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:51.125535 12724 raft_consensus.cc:697] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:52:51.168706  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:51.180787  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:51.183888  7851 raft_consensus.cc:1275] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 14:52:51.194854 12818 consensus_queue.cc:260] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:51.160778 12542 raft_consensus.cc:515] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:51.171905  7894 leader_election.cc:304] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:51.197556 12772 raft_consensus.cc:2749] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 14:52:51.197728 12757 raft_consensus.cc:493] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:51.247025 12757 raft_consensus.cc:515] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:51.197902 12848 raft_consensus.cc:493] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:51.250144 12848 raft_consensus.cc:515] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:51.252784 12848 leader_election.cc:290] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:51.198287 12843 consensus_queue.cc:1048] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 14:52:51.197208 12831 consensus_queue.cc:260] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:51.203117 12852 log.cc:927] Time spent T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.112s	user 0.001s	sys 0.001s
I20260709 14:52:51.203981  7819 leader_election.cc:304] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:52:51.204223 12839 consensus_queue.cc:1048] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 14:52:51.208428 12805 consensus_queue.cc:260] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:51.213743 12707 raft_consensus.cc:493] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:51.217644 11963 raft_consensus.cc:2804] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 14:52:51.217753  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 46116.2us
I20260709 14:52:51.274771 11963 raft_consensus.cc:493] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:52:51.275290 11963 raft_consensus.cc:3060] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 14:52:51.201298 12724 consensus_queue.cc:237] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:51.206707  7845 raft_consensus.cc:2468] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 15.
W20260709 14:52:51.259317  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 135355us
I20260709 14:52:51.279009  7893 leader_election.cc:304] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:51.280251  7893 leader_election.cc:304] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:51.216562 12542 leader_election.cc:290] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:51.209499 12818 raft_consensus.cc:3060] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Advancing to term 16
W20260709 14:52:51.297151  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:51.288005 12848 raft_consensus.cc:2804] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 14:52:51.288775 12561 raft_consensus.cc:2804] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 14:52:51.327494  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 123607us
I20260709 14:52:51.332923 11963 raft_consensus.cc:515] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:51.334829  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 54576us
W20260709 14:52:51.335115  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 54934.6us
I20260709 14:52:51.339224  7894 leader_election.cc:304] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:51.285568 12479 consensus_queue.cc:1059] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 14:52:51.286151 12707 raft_consensus.cc:515] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:51.339463 12786 raft_consensus.cc:3055] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 LEADER]: Stepping down as leader of term 14
I20260709 14:52:51.341286  7893 leader_election.cc:304] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:51.334064 12831 raft_consensus.cc:3060] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Advancing to term 16
I20260709 14:52:51.289408 12804 consensus_queue.cc:1048] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 14:52:51.354271 11963 leader_election.cc:290] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:51.317855 12848 raft_consensus.cc:493] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Starting leader election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:52:51.334679 12561 raft_consensus.cc:493] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:52:51.349785 12805 raft_consensus.cc:3060] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 14:52:51.350706 12786 raft_consensus.cc:740] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:52:51.350056 12757 leader_election.cc:290] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:51.365435 11963 raft_consensus.cc:3055] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 14:52:51.365553  7894 leader_election.cc:304] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:51.366019 11963 raft_consensus.cc:740] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:51.358057 12848 raft_consensus.cc:3060] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Advancing to term 15
W20260709 14:52:51.364065  8599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 171293us
I20260709 14:52:51.368083 12819 raft_consensus.cc:2804] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 14:52:51.378142 12819 raft_consensus.cc:493] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:51.378697 12819 raft_consensus.cc:3060] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:52:51.368799 12859 raft_consensus.cc:2749] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 14:52:51.382040 12804 raft_consensus.cc:2804] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 14:52:51.368809 12860 consensus_queue.cc:1059] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 14:52:51.383427 12860 raft_consensus.cc:3055] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 14:52:51.383859 12860 raft_consensus.cc:740] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:51.385643 12804 raft_consensus.cc:697] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:51.387050 12804 consensus_queue.cc:237] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:51.371068 12707 leader_election.cc:290] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:51.384833 12860 consensus_queue.cc:260] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:51.390373 12858 raft_consensus.cc:2749] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 14:52:51.391264 12860 raft_consensus.cc:3060] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 14:52:51.370255 11963 consensus_queue.cc:260] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:51.371227 12479 consensus_queue.cc:1059] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 14:52:51.371817  7894 leader_election.cc:304] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:51.372104 12786 consensus_queue.cc:260] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:51.373205  7819 leader_election.cc:304] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:52:51.413178 12786 raft_consensus.cc:3060] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Advancing to term 15
I20260709 14:52:51.415997  7819 leader_election.cc:304] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:51.416245 12842 raft_consensus.cc:2749] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 14:52:51.359710 12561 raft_consensus.cc:3060] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 14:52:51.417474 12859 raft_consensus.cc:2804] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 14:52:51.415715 12848 raft_consensus.cc:515] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:51.417944 12859 raft_consensus.cc:493] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:51.418485 12859 raft_consensus.cc:3060] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 14:52:51.420563 12848 leader_election.cc:290] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:51.424995 12757 raft_consensus.cc:2749] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 14:52:51.421912 11963 raft_consensus.cc:3060] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 14:52:51.424191 12843 raft_consensus.cc:2764] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Leader election decision vote started in defunct term 15: won
I20260709 14:52:51.428719 12479 raft_consensus.cc:3055] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 14:52:51.429571 12479 raft_consensus.cc:740] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:51.431201 12479 consensus_queue.cc:260] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:51.432807 12479 raft_consensus.cc:3060] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 14:52:51.446405  7819 leader_election.cc:304] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:51.447424 12843 raft_consensus.cc:2749] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 14:52:51.448120  7819 leader_election.cc:304] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:52:51.449009 12843 raft_consensus.cc:2804] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 14:52:51.449450 12843 raft_consensus.cc:493] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:51.449856 12843 raft_consensus.cc:3060] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Advancing to term 11
W20260709 14:52:51.458503  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 117386us
I20260709 14:52:51.469177  7893 leader_election.cc:304] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:51.471204 11963 raft_consensus.cc:2804] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 14:52:51.471925 11963 raft_consensus.cc:697] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:51.473186 11963 consensus_queue.cc:237] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:51.477707  7893 leader_election.cc:304] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:51.482666  7676 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54344 (request call id 375) took 1746 ms. Trace:
I20260709 14:52:51.492926 12561 raft_consensus.cc:515] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:51.494396 12859 raft_consensus.cc:515] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:51.503923 12859 leader_election.cc:290] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:51.496760 12561 leader_election.cc:290] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 15 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:51.499804  7675 catalog_manager.cc:5697] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:52:51.486658 12804 raft_consensus.cc:2749] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 14:52:51.517844  7819 leader_election.cc:304] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:51.519529 12757 raft_consensus.cc:2749] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 14:52:51.507117  7675 catalog_manager.cc:5697] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:52:51.526124  7675 catalog_manager.cc:5697] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 13 to 14, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 14 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:52:51.484571  7676 rpcz_store.cc:276] 0709 14:52:49.734905 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:49.735405 (+   500us) service_pool.cc:224] Handling call
0709 14:52:51.481111 (+1745706us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 14:52:50.539145 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 14:52:50.540110 (+   965us) write_op.cc:432] Acquiring schema lock in shared mode
0709 14:52:50.540175 (+    65us) write_op.cc:435] Acquired schema lock
0709 14:52:50.540197 (+    22us) tablet.cc:662] Decoding operations
0709 14:52:50.550041 (+  9844us) write_op.cc:620] Acquiring the partition lock for write op
0709 14:52:50.550153 (+   112us) write_op.cc:641] Partition lock acquired for write op
0709 14:52:50.550181 (+    28us) tablet.cc:685] Acquiring locks for 15 operations
0709 14:52:50.551445 (+  1264us) tablet.cc:701] Row locks acquired
0709 14:52:50.551502 (+    57us) write_op.cc:260] PREPARE: finished
0709 14:52:50.551910 (+   408us) write_op.cc:270] Start()
0709 14:52:50.564639 (+ 12729us) write_op.cc:276] Timestamp: P: 1783608770551824 usec, L: 0
0709 14:52:50.565498 (+   859us) op_driver.cc:348] REPLICATION: starting
0709 14:52:50.593898 (+ 28400us) log.cc:844] Serialized 5929 byte log entry
0709 14:52:51.001541 (+407643us) op_driver.cc:464] REPLICATION: finished
0709 14:52:51.109775 (+108234us) write_op.cc:301] APPLY: starting
0709 14:52:51.109909 (+   134us) tablet.cc:1367] starting BulkCheckPresence
0709 14:52:51.151935 (+ 42026us) tablet.cc:1370] finished BulkCheckPresence
0709 14:52:51.152065 (+   130us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 14:52:51.358644 (+206579us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 14:52:51.359014 (+   370us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=30,key_file_lookups=30,delta_file_lookups=30,mrs_lookups=0
0709 14:52:51.359079 (+    65us) write_op.cc:312] APPLY: finished
0709 14:52:51.398153 (+ 39074us) log.cc:844] Serialized 139 byte log entry
0709 14:52:51.399352 (+  1199us) write_op.cc:489] Releasing partition, row and schema locks
0709 14:52:51.399732 (+   380us) write_op.cc:454] Released schema lock
0709 14:52:51.399807 (+    75us) write_op.cc:341] FINISH: Updating metrics
0709 14:52:51.400573 (+   766us) write_op.cc:489] Releasing partition, row and schema locks
0709 14:52:51.400606 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":202986,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":98975,"apply.run_cpu_time_us":27232,"apply.run_wall_time_us":290743,"cfile_cache_hit":62,"cfile_cache_hit_bytes":66647,"num_ops":15,"prepare.queue_time_us":138727,"prepare.run_cpu_time_us":6900,"prepare.run_wall_time_us":122073,"replication_time_us":345488,"thread_start_us":53041,"threads_started":2}]]}
I20260709 14:52:51.530875  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:51.531122 12843 raft_consensus.cc:515] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:51.532570  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:51.533434  7927 raft_consensus.cc:2393] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 15: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:52:51.549226  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:51.550380  7928 raft_consensus.cc:2368] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 16. Current term is 17.
W20260709 14:52:51.556392  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 144834us
I20260709 14:52:51.558969  7924 raft_consensus.cc:2410] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for term 16 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 14:52:51.560534  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:51.559711  7675 catalog_manager.cc:5697] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 8 to 14, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 14 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:52:51.562711  7928 raft_consensus.cc:2410] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for term 17 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
W20260709 14:52:51.566835  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:51.568602  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:51.568156  7675 catalog_manager.cc:5697] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 12 to 13, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 13 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:52:51.564178 12859 raft_consensus.cc:493] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:51.574882  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:51.575857  7924 raft_consensus.cc:2368] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 13. Current term is 14.
I20260709 14:52:51.575994  7675 catalog_manager.cc:5697] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 12 to 13, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 13 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:52:51.557386 12819 raft_consensus.cc:515] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:51.580044 12757 consensus_queue.cc:1048] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 14:52:51.584110 12818 consensus_queue.cc:1048] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 14:52:51.584445  7894 leader_election.cc:304] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:51.580068  7675 catalog_manager.cc:5697] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 13 to 15, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 15 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:52:51.594574 12842 raft_consensus.cc:493] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:51.595290 12842 raft_consensus.cc:515] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:51.595959 12707 raft_consensus.cc:2804] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 14:52:51.596446 12707 raft_consensus.cc:493] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:51.596822 12707 raft_consensus.cc:3060] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 14:52:51.599051 12842 leader_election.cc:290] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:51.594609  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:51.600476  7924 raft_consensus.cc:2410] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for term 16 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 14:52:51.602262 12843 leader_election.cc:290] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 11 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:51.604396  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:51.591190  7675 catalog_manager.cc:5697] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 13 to 14, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 14 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
W20260709 14:52:51.607558  7743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:51.615355  7850 raft_consensus.cc:2468] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 16.
I20260709 14:52:51.619254  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:51.621871  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:51.624717  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:51.625675  7848 raft_consensus.cc:2468] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 15.
I20260709 14:52:51.625765  7819 leader_election.cc:304] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:51.622157  7928 raft_consensus.cc:2368] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 10. Current term is 11.
I20260709 14:52:51.629294  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:51.572695 12859 raft_consensus.cc:515] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:51.630158  7847 raft_consensus.cc:3060] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Advancing to term 14
I20260709 14:52:51.636125 11963 raft_consensus.cc:493] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:51.636920 11963 raft_consensus.cc:515] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:51.643348  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
W20260709 14:52:51.659093  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:51.653016  7819 leader_election.cc:304] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:51.671283  7928 raft_consensus.cc:1275] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 14:52:51.676287 11963 leader_election.cc:290] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:51.652145 12757 raft_consensus.cc:2804] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Leader election won for term 15
I20260709 14:52:51.674057 12804 raft_consensus.cc:493] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:51.678566 12848 raft_consensus.cc:2804] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Leader election won for term 8
I20260709 14:52:51.689035 12848 raft_consensus.cc:697] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:52:51.690181  7819 leader_election.cc:304] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
W20260709 14:52:51.688235  7742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:51.707229  7927 raft_consensus.cc:2468] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 14.
I20260709 14:52:51.716384  7927 raft_consensus.cc:1240] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 LEADER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 15. Current term is 16. Ops: []
I20260709 14:52:51.698912 12757 raft_consensus.cc:697] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:52:51.722589 12848 consensus_queue.cc:237] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:51.688280 12804 raft_consensus.cc:515] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:51.718568  7819 leader_election.cc:304] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:51.714391 12843 raft_consensus.cc:2804] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Leader election won for term 15
I20260709 14:52:51.736549  7819 leader_election.cc:304] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:51.739204  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:51.740675  7925 raft_consensus.cc:1275] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 14:52:51.743944  7819 leader_election.cc:304] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:51.748914  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:51.751171  7919 raft_consensus.cc:3060] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 14:52:51.742151 12843 raft_consensus.cc:697] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:52:51.753749 12843 consensus_queue.cc:237] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:51.754849 12804 leader_election.cc:290] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:51.759562  7920 raft_consensus.cc:2468] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 14.
I20260709 14:52:51.761361 12772 raft_consensus.cc:2804] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Leader election won for term 13
I20260709 14:52:51.762087 12772 raft_consensus.cc:697] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:52:51.743563 12839 raft_consensus.cc:2804] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Leader election won for term 15
I20260709 14:52:51.762249 12707 raft_consensus.cc:515] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:51.763190 12772 consensus_queue.cc:237] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:51.742416 12834 raft_consensus.cc:2804] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Leader election won for term 13
I20260709 14:52:51.740309 12819 leader_election.cc:290] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 11 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:51.762058  7919 raft_consensus.cc:2468] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 15.
I20260709 14:52:51.773852  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:51.778311  7924 raft_consensus.cc:2410] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for term 16 because replica has last-logged OpId of term: 15 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 14:52:51.784776  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:51.769982 12842 raft_consensus.cc:493] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:51.785826  7927 raft_consensus.cc:2393] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 11: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:52:51.787135  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:51.788139  7919 raft_consensus.cc:2393] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 8: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:52:51.790279 12831 raft_consensus.cc:493] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:51.784189 12859 leader_election.cc:290] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:51.790997 12831 raft_consensus.cc:515] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:51.762319 12757 consensus_queue.cc:237] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:51.794612 12831 leader_election.cc:290] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:51.765002 12707 leader_election.cc:290] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:51.807432  7847 raft_consensus.cc:2468] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 14.
I20260709 14:52:51.786037 12842 raft_consensus.cc:515] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:51.799561  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:51.809258  7927 raft_consensus.cc:2410] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 14:52:51.799955  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:51.807570  7923 raft_consensus.cc:1240] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 15. Current term is 16. Ops: []
I20260709 14:52:51.801745  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
W20260709 14:52:51.813923  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 72927.9us
I20260709 14:52:51.821671  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:51.822481  7776 raft_consensus.cc:2376] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 17. Re-sending same reply.
I20260709 14:52:51.824638  7778 raft_consensus.cc:1240] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 13. Current term is 14. Ops: []
I20260709 14:52:51.827601  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:51.828698  7925 raft_consensus.cc:2410] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for term 17 because replica has last-logged OpId of term: 15 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 7.
I20260709 14:52:51.831528  7772 raft_consensus.cc:1240] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 14:52:51.832490  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:51.832653  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:51.833362  7920 raft_consensus.cc:2393] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 13: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:52:51.835000  7773 raft_consensus.cc:1275] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 14:52:51.836416  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:51.837095  7770 raft_consensus.cc:2393] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 15: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:52:51.844031  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:51.845057  7850 raft_consensus.cc:3060] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:52:51.848058  7922 raft_consensus.cc:1275] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 11. (term mismatch)
I20260709 14:52:51.848605  7922 pending_rounds.cc:85] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0: Aborting all ops after (but not including) 10
I20260709 14:52:51.848846  7922 pending_rounds.cc:107] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0: Aborting uncommitted NO_OP operation due to leader change: 16.11
I20260709 14:52:51.849151  7922 raft_consensus.cc:2889] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:52:51.850394  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:51.851051  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:51.851220  7851 raft_consensus.cc:2468] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 16.
I20260709 14:52:51.851878  7853 raft_consensus.cc:3060] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Advancing to term 16
I20260709 14:52:51.853802  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:51.854847  7894 leader_election.cc:304] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:51.851773  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:51.857880  7849 raft_consensus.cc:2468] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 13.
I20260709 14:52:51.861867  7854 raft_consensus.cc:1275] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 14:52:51.857769  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:51.862179  7893 leader_election.cc:304] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:51.860476  7894 leader_election.cc:304] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:51.834523 12862 raft_consensus.cc:493] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:51.834785 12839 raft_consensus.cc:697] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:52:51.862829  7845 raft_consensus.cc:2468] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 11.
I20260709 14:52:51.865965  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:51.872646  7850 raft_consensus.cc:2468] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 11.
I20260709 14:52:51.831454 12834 raft_consensus.cc:697] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:52:51.875082  7772 raft_consensus.cc:2393] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 16: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:52:51.861604 12859 raft_consensus.cc:2804] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 14:52:51.869933  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:51.877086  7773 raft_consensus.cc:2468] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 15.
I20260709 14:52:51.876372 12805 raft_consensus.cc:2804] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 14:52:51.876405 12819 raft_consensus.cc:2804] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 14:52:51.883895 12819 raft_consensus.cc:493] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:51.884305 12819 raft_consensus.cc:3060] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 14:52:51.885581 12839 consensus_queue.cc:237] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:51.892024 12805 raft_consensus.cc:697] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:51.893678 12805 consensus_queue.cc:237] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:51.900915 12859 raft_consensus.cc:697] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:51.902259 12859 consensus_queue.cc:237] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 15.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:51.869151 12862 raft_consensus.cc:515] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:51.912549  7853 raft_consensus.cc:2468] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 16.
I20260709 14:52:51.913842  7774 raft_consensus.cc:1240] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 14:52:51.882405  7894 leader_election.cc:304] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:51.878823 12831 raft_consensus.cc:493] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:51.934458  7894 leader_election.cc:304] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:51.912571 12724 raft_consensus.cc:493] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:51.958216  7894 leader_election.cc:304] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:51.960656 12875 raft_consensus.cc:2804] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 14:52:51.963898  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 148994us
I20260709 14:52:51.919377 12861 raft_consensus.cc:2804] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 14:52:51.971262  7819 leader_election.cc:304] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:51.972007 12842 leader_election.cc:290] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:51.976442  7819 leader_election.cc:304] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:51.910707 12877 consensus_queue.cc:1059] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.076s
I20260709 14:52:51.978509  7894 leader_election.cc:304] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:51.996978 12874 raft_consensus.cc:2804] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 14:52:51.998306 12874 raft_consensus.cc:493] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:51.998893 12874 raft_consensus.cc:3060] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:52:51.995318  7894 leader_election.cc:304] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:51.967098 12875 raft_consensus.cc:493] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 14:52:52.038612  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 62265.4us
I20260709 14:52:52.042840  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:52.045868 12878 raft_consensus.cc:2804] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Leader election won for term 15
I20260709 14:52:51.970768 12724 raft_consensus.cc:515] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:52.046715 12878 raft_consensus.cc:697] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:52:52.047850 12878 consensus_queue.cc:237] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:52.048741 12724 leader_election.cc:290] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:51.987493 12873 raft_consensus.cc:2804] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 14:52:52.049448 12876 log.cc:927] Time spent T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.154s	user 0.000s	sys 0.002s
I20260709 14:52:52.049559 12873 raft_consensus.cc:493] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:52.050035 12873 raft_consensus.cc:3060] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 14:52:52.050289 12757 raft_consensus.cc:2804] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Leader election won for term 18
I20260709 14:52:52.051023 12757 raft_consensus.cc:697] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:52:52.054368  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c563cc7cfbe4d59be4ffc5cf847ce56" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:52.059588 12834 consensus_queue.cc:237] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:51.958128 12831 raft_consensus.cc:515] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:52.088701  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:52.089161  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:52.089568  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:51.994611 12861 raft_consensus.cc:697] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:51.963604 12819 raft_consensus.cc:515] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:52.093941  7919 raft_consensus.cc:2468] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 16.
I20260709 14:52:52.096386  7894 leader_election.cc:304] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:52.098503  7744 leader_election.cc:304] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:52:52.102536 12883 log.cc:927] Time spent T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 14:52:52.064085 12875 raft_consensus.cc:3060] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 14:52:52.110123  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:52.111176  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:52.116501 12724 raft_consensus.cc:493] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:52:51.988010 12858 consensus_queue.cc:1048] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.097s
I20260709 14:52:52.066407 12864 raft_consensus.cc:2804] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 14:52:52.127477  7742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:52.108127 12879 raft_consensus.cc:3055] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 LEADER]: Stepping down as leader of term 10
I20260709 14:52:52.052577 12757 consensus_queue.cc:237] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:52.134197  7744 leader_election.cc:400] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 16 pre-election: Vote denied by peer 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785) with higher term. Message: Invalid argument: T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 16. Current term is 17.
I20260709 14:52:52.134419 12861 consensus_queue.cc:237] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:52.136703 12842 raft_consensus.cc:2749] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 14:52:52.142052 12724 raft_consensus.cc:515] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:52.145618  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:52.146600  7928 raft_consensus.cc:1240] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 14. Current term is 15. Ops: []
I20260709 14:52:52.145618  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:52.147229  7920 raft_consensus.cc:2368] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 15. Current term is 16.
I20260709 14:52:52.146914  7744 leader_election.cc:403] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 14:52:52.153071 12831 leader_election.cc:290] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:52.165987  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:52.160225  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:52.142210 12804 raft_consensus.cc:2804] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 14:52:52.136763 12862 leader_election.cc:290] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:52.179198  7926 raft_consensus.cc:1240] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 13. Current term is 14. Ops: [13.8-13.8]
W20260709 14:52:52.146653  7819 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.101.65:40587 timed out after 1.975s (SENT) [suppressed 39 similar messages]
W20260709 14:52:52.179644  7743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:52.170912  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783e4874513449ef9084b833f188a6d3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:52.200209  7846 raft_consensus.cc:2468] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 12.
I20260709 14:52:52.205578  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:52.206418  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:52.147850 12879 raft_consensus.cc:740] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:52:52.208978  7928 raft_consensus.cc:1240] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 14:52:52.215664  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:52.169610 12864 raft_consensus.cc:697] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:52.223860 12831 raft_consensus.cc:2749] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785) with higher term. Message: Invalid argument: T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 16. Current term is 17.
I20260709 14:52:52.223078 12804 raft_consensus.cc:697] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:52.241048  7894 leader_election.cc:304] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:52.271807  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:52.255493 12879 consensus_queue.cc:260] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:52.258299 12864 consensus_queue.cc:237] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:52.261415 12874 raft_consensus.cc:515] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:52.262082 12819 leader_election.cc:290] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:52.272686  7849 raft_consensus.cc:3060] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Advancing to term 16
I20260709 14:52:52.281289  7852 raft_consensus.cc:1275] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 14:52:52.285331 12724 leader_election.cc:290] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:52.285779 12561 raft_consensus.cc:2804] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 14:52:52.314275  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 90045.2us
I20260709 14:52:52.286893  7848 raft_consensus.cc:1275] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 14:52:52.302313 12804 consensus_queue.cc:237] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:52.311254  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 165062us
I20260709 14:52:52.327409  6549 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 14:52:52.316478  7745 leader_election.cc:336] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 2.105s (SENT)
I20260709 14:52:52.347079  7745 leader_election.cc:304] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:52.356434  7921 raft_consensus.cc:2368] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 11. Current term is 12.
W20260709 14:52:52.317209 12894 log.cc:927] Time spent T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.060s	user 0.000s	sys 0.002s
I20260709 14:52:52.369068  7819 leader_election.cc:304] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:52.314710 12561 raft_consensus.cc:493] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 14:52:52.378484  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 62264.7us
I20260709 14:52:52.379420 11963 raft_consensus.cc:493] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:52.376888  7849 raft_consensus.cc:2468] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 16.
I20260709 14:52:52.385655 11963 raft_consensus.cc:515] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:52.363423 12884 raft_consensus.cc:493] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
W20260709 14:52:52.391249  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 257217us
I20260709 14:52:52.312538 12873 raft_consensus.cc:515] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:52.433192  7745 leader_election.cc:336] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 2.102s (SENT)
I20260709 14:52:52.433979  7745 leader_election.cc:304] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:52.383345 12561 raft_consensus.cc:3060] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 14:52:52.387588 12724 raft_consensus.cc:2749] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 14:52:52.392951 12877 raft_consensus.cc:2749] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 14:52:52.441035  7744 leader_election.cc:304] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:52.464993 11963 leader_election.cc:290] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:52.467088 11963 raft_consensus.cc:493] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:52.467800 11963 raft_consensus.cc:515] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:52.479586  7745 leader_election.cc:336] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 2.210s (SENT)
I20260709 14:52:52.480232  7745 leader_election.cc:304] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:52:52.431064 12896 log.cc:927] Time spent T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 14:52:52.484642  7925 raft_consensus.cc:2393] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 17: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:52:52.381024 12878 consensus_queue.cc:1059] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.059s
W20260709 14:52:52.502835  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 110755us
I20260709 14:52:52.504767  7744 leader_election.cc:400] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Vote denied by peer 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785) with higher term. Message: Invalid argument: T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 13. Current term is 14.
I20260709 14:52:52.506870  7744 leader_election.cc:403] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 14:52:52.507711 12724 raft_consensus.cc:3060] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Advancing to term 14
W20260709 14:52:52.510341  8599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 78463.8us
I20260709 14:52:52.515798  7744 leader_election.cc:400] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 10 pre-election: Vote denied by peer 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785) with higher term. Message: Invalid argument: T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 10. Current term is 11.
I20260709 14:52:52.521692  7744 leader_election.cc:403] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 14:52:52.523006 12831 raft_consensus.cc:3060] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Advancing to term 11
I20260709 14:52:52.466022 12901 raft_consensus.cc:2749] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 14:52:52.447252 12904 raft_consensus.cc:493] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:52:52.528498  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 48982.8us
W20260709 14:52:52.531308  7745 leader_election.cc:336] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 2.219s (SENT)
I20260709 14:52:52.532241 11963 leader_election.cc:290] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:52:52.548667  7745 leader_election.cc:336] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 2.223s (SENT)
I20260709 14:52:52.549353  7745 leader_election.cc:304] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:52.397210 12884 raft_consensus.cc:515] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
W20260709 14:52:52.555240  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 158527us
I20260709 14:52:52.505312 12842 raft_consensus.cc:2749] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 14:52:52.482928 12772 consensus_queue.cc:1059] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.064s
I20260709 14:52:52.546041 12724 raft_consensus.cc:2749] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785) with higher term. Message: Invalid argument: T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 13. Current term is 14.
W20260709 14:52:52.594908  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 46316.8us
W20260709 14:52:52.624562  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 68177.5us
I20260709 14:52:52.625821  7819 leader_election.cc:304] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
W20260709 14:52:52.628232  8598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 137559us
I20260709 14:52:52.629314 12898 raft_consensus.cc:2749] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 14:52:52.621286 12842 raft_consensus.cc:2749] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 14:52:52.634105 12900 log.cc:927] Time spent T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.170s	user 0.001s	sys 0.000s
I20260709 14:52:52.641631 12874 leader_election.cc:290] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:52.643982 12874 raft_consensus.cc:493] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:52:52.650233  7743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:52:52.655640  7742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.68:42321, user_credentials={real_user=slave}} blocked reactor thread for 67324.5us
W20260709 14:52:52.656155  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 132093us
I20260709 14:52:52.660271  7744 leader_election.cc:304] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:52:52.661439  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 105589us
I20260709 14:52:52.562589 12901 consensus_queue.cc:1048] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.086s
W20260709 14:52:52.673683  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 47988us
I20260709 14:52:52.680670  7744 leader_election.cc:304] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:52.547377 12904 raft_consensus.cc:515] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:52.689903  7744 leader_election.cc:304] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:52.692044  7744 leader_election.cc:304] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:52.662708 12724 raft_consensus.cc:493] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:52.698632  7894 leader_election.cc:304] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
W20260709 14:52:52.704473  7745 leader_election.cc:336] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 2.244s (SENT)
I20260709 14:52:52.711762  7745 leader_election.cc:304] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:52.663612 12874 raft_consensus.cc:515] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:52.724399  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:52.725085  7853 raft_consensus.cc:2468] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 16.
I20260709 14:52:52.686422 12843 raft_consensus.cc:2804] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 14:52:52.693506 12842 raft_consensus.cc:2804] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader election won for term 14
I20260709 14:52:52.730727  7819 leader_election.cc:304] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:52.731499  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:52.738962  7852 raft_consensus.cc:2468] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 17.
I20260709 14:52:52.740335  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:52.742360  7845 raft_consensus.cc:3060] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:52:52.705693 12878 consensus_queue.cc:1059] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
W20260709 14:52:52.761744  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 69874.8us
I20260709 14:52:52.729162 12843 raft_consensus.cc:493] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
W20260709 14:52:52.762859  7742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:52.723338 12707 consensus_queue.cc:1048] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 14:52:52.717396 12724 raft_consensus.cc:515] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:52.763312  7744 leader_election.cc:304] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:52.744432 12877 raft_consensus.cc:2804] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 14:52:52.784649  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 53994.6us
I20260709 14:52:52.785966  7819 leader_election.cc:304] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:52.727551 12916 consensus_queue.cc:1048] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.047s
I20260709 14:52:52.755270 12873 leader_election.cc:290] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 17 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:52.763545 12831 raft_consensus.cc:2749] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785) with higher term. Message: Invalid argument: T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 10. Current term is 11.
I20260709 14:52:52.768105 12843 raft_consensus.cc:3060] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Advancing to term 16
I20260709 14:52:52.766414 12901 raft_consensus.cc:2749] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 14:52:52.758111 12920 raft_consensus.cc:2804] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader election won for term 15
I20260709 14:52:52.790247 12860 raft_consensus.cc:493] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:52.788805 12877 raft_consensus.cc:493] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
W20260709 14:52:52.807130  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 43901.2us
I20260709 14:52:52.799279 12878 raft_consensus.cc:3060] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Advancing to term 15
I20260709 14:52:52.809203 12877 raft_consensus.cc:3060] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Advancing to term 13
I20260709 14:52:52.803196 12842 raft_consensus.cc:697] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
W20260709 14:52:52.877753  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 67932.8us
I20260709 14:52:52.880275 12904 leader_election.cc:290] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:52.811452 12860 raft_consensus.cc:515] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:52.877899 12831 raft_consensus.cc:2749] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 14:52:52.886335 12923 log.cc:927] Time spent T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.125s	user 0.000s	sys 0.001s
W20260709 14:52:52.886801 12905 log.cc:927] Time spent T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.250s	user 0.001s	sys 0.000s
I20260709 14:52:52.767560  7925 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
mode: GRACEFUL
new_leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:48676
I20260709 14:52:52.912297  7925 raft_consensus.cc:606] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 LEADER]: Received request to transfer leadership to TS 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:52:52.891690 12927 raft_consensus.cc:493] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:52.817030 12884 leader_election.cc:290] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68:42321)
I20260709 14:52:52.900943 12918 raft_consensus.cc:2804] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader election won for term 14
I20260709 14:52:52.870270 12901 consensus_queue.cc:1048] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.043s
I20260709 14:52:52.891794 12916 raft_consensus.cc:493] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:52.899876  7819 leader_election.cc:304] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:52.903991 12903 raft_consensus.cc:2804] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 14:52:52.927778 12834 raft_consensus.cc:3055] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 LEADER]: Stepping down as leader of term 14
I20260709 14:52:52.928525 12842 consensus_queue.cc:237] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:52.936923  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 232537us
I20260709 14:52:52.929466 12921 raft_consensus.cc:493] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:52.940812 11963 raft_consensus.cc:493] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:52.941512 11963 raft_consensus.cc:515] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:52.942003  7745 leader_election.cc:336] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 2.441s (SENT)
I20260709 14:52:52.946352  7745 leader_election.cc:304] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:52:52.954123  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 54419.5us
I20260709 14:52:52.955123  7819 leader_election.cc:304] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:52.955751 12931 consensus_queue.cc:1059] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.031s
I20260709 14:52:52.930123 12918 raft_consensus.cc:697] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:52:52.957232  7819 leader_election.cc:304] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:52.937747 12834 raft_consensus.cc:740] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:52:52.963775  7845 raft_consensus.cc:2468] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 12.
W20260709 14:52:52.976222 12907 log.cc:927] Time spent T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.247s	user 0.002s	sys 0.000s
W20260709 14:52:52.979993 12561 consensus_meta.cc:287] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent flushing consensus metadata: real 0.502s	user 0.010s	sys 0.002s
I20260709 14:52:52.980548 12561 raft_consensus.cc:515] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:52.949743 12884 raft_consensus.cc:2749] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 14:52:52.980463 12757 raft_consensus.cc:3055] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 LEADER]: Stepping down as leader of term 13
I20260709 14:52:52.933005 12904 consensus_queue.cc:1048] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.029s
I20260709 14:52:52.980022 12874 leader_election.cc:290] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:52.982506 12926 raft_consensus.cc:2749] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 14:52:52.952440 12903 raft_consensus.cc:697] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:53.002436 12929 raft_consensus.cc:3055] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 LEADER]: Stepping down as leader of term 15
I20260709 14:52:53.008658 12929 raft_consensus.cc:740] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:52:53.009665 12929 consensus_queue.cc:260] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:53.011633 12929 raft_consensus.cc:3060] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Advancing to term 16
I20260709 14:52:53.003937  7923 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
mode: GRACEFUL
new_leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:48676
I20260709 14:52:52.982044 12918 consensus_queue.cc:237] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:52.992928 12860 leader_election.cc:290] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:52.950560 12921 raft_consensus.cc:515] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:52.994614 12917 raft_consensus.cc:2749] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 14:52:52.936410 12916 raft_consensus.cc:515] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:52.923548 12927 raft_consensus.cc:515] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:53.002151 12479 raft_consensus.cc:493] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:53.001268 12931 raft_consensus.cc:2749] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 14:52:52.952890 12843 raft_consensus.cc:515] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:53.017769  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 75826.1us
I20260709 14:52:53.019297  7819 leader_election.cc:304] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:53.002655 12757 raft_consensus.cc:740] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:52:53.003175 12915 raft_consensus.cc:2804] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 14:52:53.006606 12903 consensus_queue.cc:237] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:53.037736 12901 raft_consensus.cc:493] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:53.026710 12926 raft_consensus.cc:493] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:53.054631  7819 leader_election.cc:304] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:53.028275 12904 raft_consensus.cc:493] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:52.976828 11963 leader_election.cc:290] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:53.049407 12860 raft_consensus.cc:493] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:53.045924 12898 raft_consensus.cc:493] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:53.076305  8639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18d29d52d304c87b930d4fb5eaf50b1" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9418391fa82a42c79c6cad13ba91d964" is_pre_election: true
I20260709 14:52:53.076102 12898 raft_consensus.cc:515] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:53.060968 12839 raft_consensus.cc:2749] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 14:52:53.078305 12926 raft_consensus.cc:515] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:53.080132 12921 leader_election.cc:290] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:53.062007 12724 leader_election.cc:290] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:53.070958 12884 raft_consensus.cc:2749] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 14:52:53.077948 12860 raft_consensus.cc:515] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:53.083895 12860 leader_election.cc:290] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:52:53.087795 12930 log.cc:927] Time spent T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.117s	user 0.000s	sys 0.001s
I20260709 14:52:53.063577 12915 raft_consensus.cc:493] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:53.089385 12904 raft_consensus.cc:515] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:53.091740 12904 leader_election.cc:290] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:53.050530 12479 raft_consensus.cc:515] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:53.089061 12915 raft_consensus.cc:3060] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Advancing to term 15
W20260709 14:52:53.081604 12875 consensus_meta.cc:287] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent flushing consensus metadata: real 0.928s	user 0.009s	sys 0.008s
I20260709 14:52:53.096107 12757 consensus_queue.cc:260] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:53.100651 12757 raft_consensus.cc:3060] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Advancing to term 14
I20260709 14:52:53.069594  7851 raft_consensus.cc:1240] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 15. Current term is 16. Ops: []
I20260709 14:52:53.101174 12875 raft_consensus.cc:515] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:53.106191  7923 raft_consensus.cc:606] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Received request to transfer leadership to TS 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:52:53.106578  7924 raft_consensus.cc:2368] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 14. Current term is 15.
I20260709 14:52:53.098304 12805 raft_consensus.cc:493] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:53.106674  7923 raft_consensus.cc:614] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 14:52:53.111397 12875 leader_election.cc:290] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 15 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:53.067590 12931 raft_consensus.cc:493] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:53.074091  7819 leader_election.cc:304] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:53.048815 12864 raft_consensus.cc:493] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:53.004084 12834 consensus_queue.cc:260] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:53.120132  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 50264.3us
I20260709 14:52:53.120815  7819 leader_election.cc:304] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:53.097536 12561 leader_election.cc:290] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 13 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:53.121699 12884 raft_consensus.cc:2749] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 14:52:53.122532 12839 raft_consensus.cc:2749] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 14:52:53.123116 12909 log.cc:927] Time spent T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.499s	user 0.009s	sys 0.003s
I20260709 14:52:53.123019 12931 raft_consensus.cc:515] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:53.124059 12724 raft_consensus.cc:493] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:53.124359 12479 leader_election.cc:290] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:53.125077  7922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38516 (request call id 2714) took 1041 ms. Trace:
I20260709 14:52:53.126782  7922 rpcz_store.cc:276] 0709 14:52:52.083346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:52.083500 (+   154us) service_pool.cc:224] Handling call
0709 14:52:53.124827 (+1041327us) spinlock_profiling.cc:243] Waited 900 ms on lock 0x7b540031f6d4. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae922fa 00007fb68fe53b17 00007fb6893ce6d4 00007fb6893ce662 00007fb6893ce591 00007fb6893ce50c 00007fb6893cd7c2 00007fb6891c948c 00007fb6891c88c6 00007fb6891c826f
0709 14:52:53.125003 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2069140736}
I20260709 14:52:53.131508  7819 leader_election.cc:304] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:53.063797 12920 raft_consensus.cc:697] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:52:53.133453  7819 leader_election.cc:304] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:53.134905  7819 leader_election.cc:304] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:53.119565 12879 raft_consensus.cc:3060] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:52:53.124816 12724 raft_consensus.cc:515] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:53.138599  7819 leader_election.cc:304] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:53.079041 12898 leader_election.cc:290] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:53.119349 12904 raft_consensus.cc:493] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:53.095733 12916 leader_election.cc:290] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:53.094250 12927 leader_election.cc:290] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:53.137774  7894 leader_election.cc:304] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:53.132407 12839 raft_consensus.cc:2749] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 14:52:53.134037 12479 raft_consensus.cc:493] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:53.131219 12843 leader_election.cc:290] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 16 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:53.117429 12805 raft_consensus.cc:515] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:53.135254 12884 raft_consensus.cc:2749] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 14:52:53.140380 12834 raft_consensus.cc:3060] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Advancing to term 15
I20260709 14:52:53.073099 12901 raft_consensus.cc:515] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:53.128518 12864 raft_consensus.cc:515] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:53.155735  7894 leader_election.cc:304] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:53.168409  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:53.169728  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:53.158717 12927 raft_consensus.cc:2804] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 14:52:53.166651  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:53.172554  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:53.168874  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:53.151944 12848 raft_consensus.cc:2764] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Leader election decision vote started in defunct term 15: won
I20260709 14:52:53.170670  7845 raft_consensus.cc:1240] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 14:52:53.173383  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:53.165961  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:53.172323  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:53.175192  7849 raft_consensus.cc:2393] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 12: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:52:53.178506 12920 consensus_queue.cc:237] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:53.179311  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:52:53.181620  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:52:53.182163  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:53.184942  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:53.186587 12884 raft_consensus.cc:493] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:53.187366 12884 raft_consensus.cc:515] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:53.172554 12561 raft_consensus.cc:2804] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 14:52:53.188517 12561 raft_consensus.cc:493] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:53.188905 12561 raft_consensus.cc:3060] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 14:52:53.189839 12884 leader_election.cc:290] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:53.190984 12724 leader_election.cc:290] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:53.176975 12927 raft_consensus.cc:493] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:53.192657 12927 raft_consensus.cc:3060] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 14:52:53.196623 12887 raft_consensus.cc:2749] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 14:52:53.197891  7923 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
mode: GRACEFUL
new_leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:48676
I20260709 14:52:53.198694  7923 raft_consensus.cc:606] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Received request to transfer leadership to TS 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:52:53.199071  7923 raft_consensus.cc:614] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 14:52:53.200625  7849 raft_consensus.cc:1240] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 14. Current term is 15. Ops: []
I20260709 14:52:53.202512  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:53.203230  7923 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
mode: GRACEFUL
new_leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:48676
I20260709 14:52:53.203282  7845 raft_consensus.cc:3060] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Advancing to term 17
I20260709 14:52:53.187785  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:53.204937 12877 raft_consensus.cc:515] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:53.207712 12877 leader_election.cc:290] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:53.211573  7923 raft_consensus.cc:606] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Received request to transfer leadership to TS 1de5e20126fa4d8ca0793d19c7b847ed
W20260709 14:52:53.211782  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 346640us
I20260709 14:52:53.212361  7923 raft_consensus.cc:614] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 14:52:53.213356  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:53.214012  7776 raft_consensus.cc:3060] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Advancing to term 15
I20260709 14:52:53.215859  7845 raft_consensus.cc:2468] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 17.
I20260709 14:52:53.217080  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:53.153700 12904 raft_consensus.cc:515] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:53.213704  7894 leader_election.cc:304] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
W20260709 14:52:53.229863 12932 log.cc:927] Time spent T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.074s	user 0.001s	sys 0.001s
I20260709 14:52:53.231693  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:53.233732  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:53.235368  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:53.173954 12878 raft_consensus.cc:2749] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 14:52:53.203869 12931 leader_election.cc:290] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:53.161018 12479 raft_consensus.cc:515] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:53.260768  7850 raft_consensus.cc:1275] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 14:52:53.249969  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:53.264219  7775 raft_consensus.cc:2468] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 11.
I20260709 14:52:53.218081 12926 leader_election.cc:290] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:53.258837 12901 leader_election.cc:290] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:53.273717  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:53.290607  7776 raft_consensus.cc:2468] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 15.
I20260709 14:52:53.295791  7849 raft_consensus.cc:2468] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 17.
I20260709 14:52:53.273226  7850 raft_consensus.cc:1240] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 12. Current term is 13. Ops: []
I20260709 14:52:53.299717  7778 raft_consensus.cc:1275] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 14:52:53.270838 12479 leader_election.cc:290] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:53.301676  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783e4874513449ef9084b833f188a6d3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:53.301055  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:53.268711  7779 raft_consensus.cc:2468] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 14.
I20260709 14:52:53.239651 12903 raft_consensus.cc:493] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
W20260709 14:52:53.279906  7743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:53.303800  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:53.314947  7778 raft_consensus.cc:3060] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Advancing to term 16
I20260709 14:52:53.303800  7845 raft_consensus.cc:2468] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 17.
I20260709 14:52:53.307430  7774 raft_consensus.cc:2468] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 11.
W20260709 14:52:53.307862  7742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:53.231676 12936 raft_consensus.cc:493] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9418391fa82a42c79c6cad13ba91d964)
W20260709 14:52:53.271422 12939 log.cc:927] Time spent T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 14:52:53.305639  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:53.309449  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:53.279282  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:53.248188 12861 raft_consensus.cc:2804] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 14:52:53.326100  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:53.332402  7849 raft_consensus.cc:1275] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 14:52:53.326100  7846 raft_consensus.cc:2468] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 13.
I20260709 14:52:53.272442 12805 leader_election.cc:290] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:53.337718  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783e4874513449ef9084b833f188a6d3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:53.342636  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:53.321919 12479 raft_consensus.cc:493] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:53.347726  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:53.350695  7846 raft_consensus.cc:3060] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Advancing to term 15
I20260709 14:52:53.358359  7851 raft_consensus.cc:1240] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 14. Current term is 15. Ops: []
I20260709 14:52:53.360859  7923 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
mode: GRACEFUL
new_leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:48676
I20260709 14:52:53.361016 12831 raft_consensus.cc:493] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
W20260709 14:52:53.361544  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:53.361661  7923 raft_consensus.cc:606] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 LEADER]: Received request to transfer leadership to TS 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:53.361902 12831 raft_consensus.cc:515] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:53.365471 12831 leader_election.cc:290] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:53.359628  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:53.334053 12931 raft_consensus.cc:493] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:53.369819 12931 raft_consensus.cc:515] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:53.372499 12931 leader_election.cc:290] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:53.369397 12479 raft_consensus.cc:515] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:53.378805  7850 raft_consensus.cc:1240] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 16. Current term is 17. Ops: []
I20260709 14:52:53.380250  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:53.381667  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:53.380926  7674 catalog_manager.cc:5697] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:52:53.383600  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:53.325538 12936 raft_consensus.cc:515] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:52:53.386340 12936 leader_election.cc:290] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785), 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68:42321)
I20260709 14:52:53.386787  6549 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 14:52:53.361764 12938 log.cc:927] Time spent T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 14:52:53.387095  7853 raft_consensus.cc:2468] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 11.
I20260709 14:52:53.348197 12926 raft_consensus.cc:493] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:53.340471 12901 raft_consensus.cc:493] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:53.303303 12915 raft_consensus.cc:515] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:53.389217  8639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce9c0ef2db24c13a8b1402f21819458" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9418391fa82a42c79c6cad13ba91d964" is_pre_election: true
I20260709 14:52:53.389992 12901 raft_consensus.cc:515] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:53.391283  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:53.391693 12915 leader_election.cc:290] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:53.383329  7674 catalog_manager.cc:5697] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:52:53.262830 12875 consensus_queue.cc:1059] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.082s
I20260709 14:52:53.393635  7674 catalog_manager.cc:5697] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 16 to 17, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 17 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:52:53.399718  7846 raft_consensus.cc:2468] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 15.
I20260709 14:52:53.395427  6549 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 14:52:53.400087  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:53.394387  7853 raft_consensus.cc:2410] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for term 17 because replica has last-logged OpId of term: 15 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 7.
I20260709 14:52:53.382612 12904 leader_election.cc:290] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:53.389786 12926 raft_consensus.cc:515] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:53.400878  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:53.427982  7675 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54350 (request call id 376) took 3275 ms. Trace:
I20260709 14:52:53.383448 12864 leader_election.cc:290] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:53.417002  7778 raft_consensus.cc:2468] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 16.
I20260709 14:52:53.421649  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:53.345577 12861 raft_consensus.cc:697] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:53.423297  7775 raft_consensus.cc:2410] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for term 16 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260709 14:52:53.321647 12903 raft_consensus.cc:515] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:53.426127  7846 raft_consensus.cc:1275] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 14:52:53.412554  7674 catalog_manager.cc:5697] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 9 to 12. New cstate: current_term: 12 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:52:53.429358  7853 raft_consensus.cc:1275] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 14:52:53.447175  7770 raft_consensus.cc:1275] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 14:52:53.433523  7845 raft_consensus.cc:1275] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 14:52:53.448359  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:53.438249  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:53.449450  7674 catalog_manager.cc:5697] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 12 to 16. New cstate: current_term: 16 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:52:53.449548  7849 raft_consensus.cc:2468] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 11.
I20260709 14:52:53.452592  7674 catalog_manager.cc:5697] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 12 to 15, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 15 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:52:53.454646  7674 catalog_manager.cc:5697] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 10 to 12, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 12 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:52:53.369026 12927 raft_consensus.cc:515] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:53.458781  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:53.459744  7674 catalog_manager.cc:5697] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:52:53.462355  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:52:53.463523  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:53.463709  7674 catalog_manager.cc:5697] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 11 to 13, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 13 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:52:53.410354 12561 raft_consensus.cc:515] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:53.428416  7675 rpcz_store.cc:276] 0709 14:52:50.139116 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:50.139326 (+   210us) service_pool.cc:224] Handling call
0709 14:52:53.414517 (+3275191us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 14:52:51.776384 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 14:52:51.876716 (+100332us) write_op.cc:432] Acquiring schema lock in shared mode
0709 14:52:51.879109 (+  2393us) write_op.cc:435] Acquired schema lock
0709 14:52:51.881667 (+  2558us) tablet.cc:662] Decoding operations
0709 14:52:51.973313 (+ 91646us) write_op.cc:620] Acquiring the partition lock for write op
0709 14:52:51.973383 (+    70us) write_op.cc:641] Partition lock acquired for write op
0709 14:52:51.973416 (+    33us) tablet.cc:685] Acquiring locks for 8 operations
0709 14:52:51.974081 (+   665us) tablet.cc:701] Row locks acquired
0709 14:52:51.974101 (+    20us) write_op.cc:260] PREPARE: finished
0709 14:52:51.974284 (+   183us) write_op.cc:270] Start()
0709 14:52:51.974429 (+   145us) write_op.cc:276] Timestamp: P: 1783608771974226 usec, L: 0
0709 14:52:51.974452 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 14:52:52.049560 (+ 75108us) log.cc:844] Serialized 3234 byte log entry
0709 14:52:52.152774 (+103214us) op_driver.cc:464] REPLICATION: finished
0709 14:52:52.292708 (+139934us) write_op.cc:301] APPLY: starting
0709 14:52:52.292814 (+   106us) tablet.cc:1367] starting BulkCheckPresence
0709 14:52:52.304382 (+ 11568us) tablet.cc:1370] finished BulkCheckPresence
0709 14:52:52.304508 (+   126us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 14:52:52.588746 (+284238us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 14:52:52.659238 (+ 70492us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=16,key_file_lookups=16,delta_file_lookups=16,mrs_lookups=0
0709 14:52:52.664977 (+  5739us) write_op.cc:312] APPLY: finished
0709 14:52:52.726372 (+ 61395us) log.cc:844] Serialized 81 byte log entry
0709 14:52:52.739804 (+ 13432us) write_op.cc:489] Releasing partition, row and schema locks
0709 14:52:52.751574 (+ 11770us) write_op.cc:454] Released schema lock
0709 14:52:52.755632 (+  4058us) write_op.cc:341] FINISH: Updating metrics
0709 14:52:52.792657 (+ 37025us) write_op.cc:489] Releasing partition, row and schema locks
0709 14:52:52.796271 (+  3614us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":12121,"reported_tablets":48,"child_traces":[["op",{"apply.queue_time_us":139502,"apply.run_cpu_time_us":20762,"apply.run_wall_time_us":477072,"cfile_cache_hit":34,"cfile_cache_hit_bytes":37471,"num_ops":8,"prepare.queue_time_us":106218,"prepare.run_cpu_time_us":6193,"prepare.run_wall_time_us":289052,"replication_time_us":178132,"thread_start_us":156254,"threads_started":2}]]}
I20260709 14:52:53.466212  7674 catalog_manager.cc:5697] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 13 to 17. New cstate: current_term: 17 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:52:53.478514  7770 raft_consensus.cc:1275] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 11. (term mismatch)
I20260709 14:52:53.479254  7770 pending_rounds.cc:85] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed: Aborting all ops after (but not including) 10
I20260709 14:52:53.479504  7770 pending_rounds.cc:107] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed: Aborting uncommitted NO_OP operation due to leader change: 15.11
I20260709 14:52:53.479776  7770 raft_consensus.cc:2889] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:52:53.482107  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:52:53.489275  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 76345.1us
I20260709 14:52:53.499845  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:53.496654  7894 leader_election.cc:304] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:53.503417  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:53.504586  7846 raft_consensus.cc:2393] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 13: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:52:53.505698  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:53.506516  7846 raft_consensus.cc:2468] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 15.
I20260709 14:52:53.507339  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:53.505781  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:53.508733  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:53.508881  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:53.509613  7777 raft_consensus.cc:2468] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 16.
I20260709 14:52:53.512544  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:53.514391  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:53.517901  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:53.519356  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c563cc7cfbe4d59be4ffc5cf847ce56" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:53.519691  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:53.521082 11963 raft_consensus.cc:993] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0: : Instructing follower 3876b8ee8d744cb18e91d97aae93b1ac to start an election
I20260709 14:52:53.521628  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:53.522399  7775 raft_consensus.cc:3060] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:52:53.523221 11963 raft_consensus.cc:1081] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 LEADER]: Signalling peer 3876b8ee8d744cb18e91d97aae93b1ac to start an election
I20260709 14:52:53.519388  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:53.524534  7770 raft_consensus.cc:2468] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 17.
I20260709 14:52:53.525084 12561 leader_election.cc:290] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 17 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:53.495455 12479 leader_election.cc:290] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:53.534482  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:53.535362  7846 raft_consensus.cc:2468] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 17.
I20260709 14:52:53.535593 12913 raft_consensus.cc:2804] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 14:52:53.536940 12913 raft_consensus.cc:697] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:53.541497 12861 consensus_queue.cc:237] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:53.542371  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:53.543190  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:53.543408  7774 raft_consensus.cc:1275] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 14:52:53.545388  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:53.546798  7774 raft_consensus.cc:1275] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 14:52:53.546234  7778 raft_consensus.cc:2468] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 14.
I20260709 14:52:53.502368 12901 leader_election.cc:290] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:53.546222 12903 leader_election.cc:290] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:53.563418  7819 leader_election.cc:304] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
W20260709 14:52:53.561519  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 99239.7us
I20260709 14:52:53.556085  7894 leader_election.cc:304] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:53.567860  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:53.568656  7778 raft_consensus.cc:2468] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 16.
I20260709 14:52:53.567201  7894 leader_election.cc:304] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:53.559077 12921 consensus_queue.cc:1048] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.007s
I20260709 14:52:53.537936 12913 consensus_queue.cc:237] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:53.574545  7894 leader_election.cc:304] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:53.576238 11963 raft_consensus.cc:2804] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 14:52:53.576648 11963 raft_consensus.cc:493] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:53.576954 11963 raft_consensus.cc:3060] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 14:52:53.578420  7745 leader_election.cc:304] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:53.565383 12915 raft_consensus.cc:2749] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 14:52:53.582811  7894 leader_election.cc:304] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:53.571136 12903 raft_consensus.cc:2804] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 14:52:53.585758  7745 leader_election.cc:304] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:53.584285 12561 consensus_queue.cc:1048] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 14:52:53.601168 12862 raft_consensus.cc:2804] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 14:52:53.605763 12919 raft_consensus.cc:493] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:53.579949 12875 raft_consensus.cc:2804] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 14:52:53.620211 11963 raft_consensus.cc:515] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:53.563524 12479 consensus_queue.cc:1059] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.018s
W20260709 14:52:53.624233  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 60866.1us
I20260709 14:52:53.624791  7745 leader_election.cc:304] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:53.608991  7775 raft_consensus.cc:2468] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 12.
I20260709 14:52:53.629562  7819 leader_election.cc:304] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:53.615037 12903 raft_consensus.cc:493] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:53.637661  7745 leader_election.cc:304] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:53.639708  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783e4874513449ef9084b833f188a6d3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:53.642462  7819 leader_election.cc:400] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 pre-election: Vote denied by peer 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785) with higher term. Message: Invalid argument: T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 15. Current term is 16.
I20260709 14:52:53.648141 11963 leader_election.cc:290] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:53.627826 12936 raft_consensus.cc:2749] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 14:52:53.627893 12921 raft_consensus.cc:493] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:53.654595  7745 leader_election.cc:304] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:53.630824 12875 raft_consensus.cc:493] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:53.636343 12864 raft_consensus.cc:493] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:53.623247 12929 consensus_queue.cc:1059] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.026s
W20260709 14:52:53.671726  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 44752.9us
I20260709 14:52:53.686646 12929 raft_consensus.cc:3055] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 LEADER]: Stepping down as leader of term 14
I20260709 14:52:53.686810  7894 leader_election.cc:304] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:53.687160 12929 raft_consensus.cc:740] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:52:53.688122 12929 consensus_queue.cc:260] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:53.690245  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:53.691893  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:53.692113  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:53.692793  7778 raft_consensus.cc:2468] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 14.
I20260709 14:52:53.693233  7770 raft_consensus.cc:2468] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 12.
I20260709 14:52:53.693459  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:53.694283  7775 raft_consensus.cc:2468] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 12.
I20260709 14:52:53.694995  7777 raft_consensus.cc:1275] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 12. (term mismatch)
I20260709 14:52:53.695091  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:53.695572  7777 pending_rounds.cc:85] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed: Aborting all ops after (but not including) 11
I20260709 14:52:53.695854  7777 pending_rounds.cc:107] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed: Aborting uncommitted NO_OP operation due to leader change: 15.12
I20260709 14:52:53.696008  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:53.630717 12904 consensus_queue.cc:1059] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.047s
I20260709 14:52:53.694571  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:53.638761 12901 raft_consensus.cc:3060] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Advancing to term 13
I20260709 14:52:53.698928 12927 leader_election.cc:290] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 18 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:53.699635 12927 raft_consensus.cc:2804] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 14:52:53.699872  7854 raft_consensus.cc:1275] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 14:52:53.639554 12915 raft_consensus.cc:2804] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 14:52:53.673115 12831 consensus_queue.cc:1048] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 14:52:53.701684 12915 raft_consensus.cc:493] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:53.702207 12915 raft_consensus.cc:3060] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Advancing to term 16
W20260709 14:52:53.702852 12834 consensus_meta.cc:287] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent flushing consensus metadata: real 0.537s	user 0.010s	sys 0.000s
I20260709 14:52:53.636197 12920 raft_consensus.cc:2749] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 14:52:53.708655 12949 log.cc:927] Time spent T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.122s	user 0.000s	sys 0.001s
I20260709 14:52:53.630470 12922 consensus_queue.cc:1048] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 14:52:53.710613  7849 raft_consensus.cc:1275] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 14:52:53.708460  7854 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258"
dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:49946
I20260709 14:52:53.712661  7852 raft_consensus.cc:1240] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 15. Current term is 16. Ops: []
I20260709 14:52:53.669490 12479 raft_consensus.cc:3055] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 14:52:53.713452  7854 raft_consensus.cc:493] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:52:53.677045 12875 raft_consensus.cc:3060] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 14:52:53.714424  7854 raft_consensus.cc:3060] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Advancing to term 17
I20260709 14:52:53.676324 12724 raft_consensus.cc:3060] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [term 7 FOLLOWER]: Advancing to term 8
I20260709 14:52:53.717770  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:53.718899  7849 raft_consensus.cc:2393] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 15: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:52:53.697041 12904 raft_consensus.cc:3055] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 LEADER]: Stepping down as leader of term 16
I20260709 14:52:53.720141 12904 raft_consensus.cc:740] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:52:53.721500 12904 consensus_queue.cc:260] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:53.723359 12904 raft_consensus.cc:3060] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Advancing to term 17
I20260709 14:52:53.698022 12926 leader_election.cc:290] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:53.696708  7772 raft_consensus.cc:2468] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 14.
I20260709 14:52:53.694301  7774 raft_consensus.cc:1275] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 14:52:53.639433 12879 consensus_queue.cc:1059] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.087s
I20260709 14:52:53.705027  7777 raft_consensus.cc:2889] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:52:53.705618  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:53.706290  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:53.637178 12860 raft_consensus.cc:3055] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 14:52:53.726955 12879 raft_consensus.cc:3055] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 LEADER]: Stepping down as leader of term 14
I20260709 14:52:53.727300 12860 raft_consensus.cc:740] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:53.728677 12860 consensus_queue.cc:260] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:53.669647 12561 consensus_queue.cc:1048] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 14:52:53.646581 12903 raft_consensus.cc:3060] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 14:52:53.730288 12561 consensus_queue.cc:1243] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer 3876b8ee8d744cb18e91d97aae93b1ac log is divergent from this leader: its last log entry 11.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 14:52:53.731837  7771 raft_consensus.cc:2468] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 17.
I20260709 14:52:53.654011 12842 raft_consensus.cc:2749] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 14:52:53.714116 12479 raft_consensus.cc:740] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:53.678192 12921 raft_consensus.cc:515] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:53.734392  7851 raft_consensus.cc:3060] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Advancing to term 17
I20260709 14:52:53.630577 12919 raft_consensus.cc:515] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:53.733762 12479 consensus_queue.cc:260] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:53.737538 12479 raft_consensus.cc:3060] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 14:52:53.696645  7847 raft_consensus.cc:1240] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 14. Current term is 15. Ops: []
I20260709 14:52:53.730103 12860 raft_consensus.cc:3060] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 14:52:53.732096 12864 raft_consensus.cc:515] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:53.753288  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 47677.9us
I20260709 14:52:53.756181 12879 raft_consensus.cc:740] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:52:53.757928 12879 consensus_queue.cc:260] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:53.683183 12862 raft_consensus.cc:697] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:53.762578 12862 consensus_queue.cc:237] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:53.700002 12927 raft_consensus.cc:493] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:53.770437 12927 raft_consensus.cc:3060] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:52:53.775354 12929 raft_consensus.cc:3060] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Advancing to term 15
I20260709 14:52:53.778987  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:53.780876  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:53.781774  7777 raft_consensus.cc:2468] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 15.
I20260709 14:52:53.807401 12919 leader_election.cc:290] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:53.809080  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:53.810150  7777 raft_consensus.cc:2468] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 11.
I20260709 14:52:53.810974  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:53.811990  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:53.812260  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:53.812448  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:53.813632  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:53.812878  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:53.813153  7778 raft_consensus.cc:2376] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 16. Re-sending same reply.
I20260709 14:52:53.814917  7776 raft_consensus.cc:2468] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 16.
I20260709 14:52:53.815814 12921 leader_election.cc:290] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:53.816002  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:53.811331  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
W20260709 14:52:53.817121  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:53.817653  7774 raft_consensus.cc:3060] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Advancing to term 17
W20260709 14:52:53.816768  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 181102us
I20260709 14:52:53.814325  7770 raft_consensus.cc:3060] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Advancing to term 14
I20260709 14:52:53.813875  7773 raft_consensus.cc:2393] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 16: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:52:53.832190  7819 leader_election.cc:400] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 11 election: Vote denied by peer 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785) with higher term. Message: Invalid argument: T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 11. Current term is 12.
I20260709 14:52:53.832568  7819 leader_election.cc:403] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 14:52:53.834048  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:53.838430  7778 raft_consensus.cc:2376] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 15. Re-sending same reply.
I20260709 14:52:53.838798  7819 leader_election.cc:400] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 14 pre-election: Vote denied by peer 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785) with higher term. Message: Invalid argument: T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 14. Current term is 15.
I20260709 14:52:53.839462  7819 leader_election.cc:403] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
W20260709 14:52:53.845466  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:52:53.846072  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:53.844436  7745 leader_election.cc:304] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:53.852015  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:53.853279  7777 raft_consensus.cc:3060] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Advancing to term 18
I20260709 14:52:53.814391 12879 raft_consensus.cc:3060] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Advancing to term 15
I20260709 14:52:53.814169 12864 leader_election.cc:290] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:53.878659  7774 raft_consensus.cc:2468] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 17.
I20260709 14:52:53.873592  7745 leader_election.cc:304] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:53.886653  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:53.887892  7848 raft_consensus.cc:3060] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Advancing to term 14
I20260709 14:52:53.868831  7854 raft_consensus.cc:515] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:53.896657  7770 raft_consensus.cc:2468] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 14.
I20260709 14:52:53.838289 12834 raft_consensus.cc:2749] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785) with higher term. Message: Invalid argument: T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 11. Current term is 12.
I20260709 14:52:53.851272 12878 raft_consensus.cc:2749] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785) with higher term. Message: Invalid argument: T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 14. Current term is 15.
I20260709 14:52:53.871657 12920 raft_consensus.cc:2804] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 14:52:53.927933  7744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:52:53.930599  7742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:53.927057 12920 raft_consensus.cc:493] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:53.925132  7776 raft_consensus.cc:2468] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 16.
I20260709 14:52:53.953760  7854 leader_election.cc:290] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 17 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:53.928987 12916 raft_consensus.cc:493] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:52:53.989387  7848 raft_consensus.cc:2468] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 14.
W20260709 14:52:54.008149  7893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:53.958804 12920 raft_consensus.cc:3060] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Advancing to term 16
W20260709 14:52:54.029750  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:54.037086  7923 raft_consensus.cc:1275] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 14:52:54.040616  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 165783us
I20260709 14:52:54.042922  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:54.045030  7853 raft_consensus.cc:1275] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 14:52:54.045670  7853 pending_rounds.cc:85] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting all ops after (but not including) 7
I20260709 14:52:54.045908  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:54.045912  7853 pending_rounds.cc:107] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 14:52:54.047760  7853 raft_consensus.cc:2889] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:52:54.046553  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:54.012113 12831 raft_consensus.cc:493] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:54.058020  7745 leader_election.cc:304] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:54.059762  7925 raft_consensus.cc:1275] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 14:52:53.992404 12916 raft_consensus.cc:515] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:54.071643  7849 raft_consensus.cc:1275] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 8. (term mismatch)
I20260709 14:52:54.072258  7849 pending_rounds.cc:85] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting all ops after (but not including) 7
I20260709 14:52:54.072475  7849 pending_rounds.cc:107] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting uncommitted NO_OP operation due to leader change: 14.8
I20260709 14:52:54.072698  7849 raft_consensus.cc:2889] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:52:54.074308  7854 raft_consensus.cc:1275] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 14:52:54.036314 12921 raft_consensus.cc:493] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:54.077889  7848 raft_consensus.cc:1240] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 14. Current term is 15. Ops: []
I20260709 14:52:54.085791  7924 raft_consensus.cc:1275] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 14:52:54.086529  7921 raft_consensus.cc:1275] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 14:52:54.085791  7923 raft_consensus.cc:1275] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 14:52:54.102295  7925 raft_consensus.cc:1275] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 14:52:54.087754 12724 raft_consensus.cc:2749] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 14:52:54.116285 12724 raft_consensus.cc:493] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:54.116873 12724 raft_consensus.cc:515] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:54.119426  7779 raft_consensus.cc:2468] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 8.
I20260709 14:52:54.074237 12931 raft_consensus.cc:2749] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 14:52:54.123721  7851 raft_consensus.cc:2468] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 17.
I20260709 14:52:54.137179  7925 raft_consensus.cc:1275] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 14:52:54.073602 12831 raft_consensus.cc:515] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:54.146661 12931 raft_consensus.cc:493] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9418391fa82a42c79c6cad13ba91d964)
I20260709 14:52:54.157570 12903 raft_consensus.cc:515] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:54.164400  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:54.164471 12903 leader_election.cc:290] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 18 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:54.166112 12901 raft_consensus.cc:2749] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 14:52:54.167923  7771 raft_consensus.cc:2468] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 13.
I20260709 14:52:54.167452  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:54.087721 12921 raft_consensus.cc:515] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:54.166287  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:54.175410  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:54.175837  7925 raft_consensus.cc:2393] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 13: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:52:54.174348  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:54.178375  7920 raft_consensus.cc:1240] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 LEADER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 16. Current term is 17. Ops: [16.11-16.11]
W20260709 14:52:54.180133 12955 log.cc:927] Time spent T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.133s	user 0.001s	sys 0.000s
I20260709 14:52:54.186595  7927 raft_consensus.cc:1240] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 14:52:54.174064  7921 raft_consensus.cc:2393] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 18: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:52:54.197593 12964 raft_consensus.cc:493] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:54.212078 12964 raft_consensus.cc:515] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:54.212337  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:54.213837  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:54.214849  7854 raft_consensus.cc:2468] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 14.
I20260709 14:52:54.216190  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:54.198086  7745 leader_election.cc:304] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:54.217675  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:54.206480  7919 raft_consensus.cc:1275] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 14:52:54.217773  7851 raft_consensus.cc:1240] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 16. Current term is 17. Ops: []
I20260709 14:52:54.209860  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:54.221328  7923 raft_consensus.cc:1240] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 14:52:54.200479  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:54.223253  7848 raft_consensus.cc:2468] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 15.
I20260709 14:52:54.250062  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:54.210330  7849 pending_rounds.cc:85] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting all ops after (but not including) 5
W20260709 14:52:54.243763  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:54.254876  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:54.256172  7853 raft_consensus.cc:3060] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Advancing to term 18
I20260709 14:52:54.251165  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:54.253630  7849 pending_rounds.cc:107] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 14:52:54.258890  7849 raft_consensus.cc:2889] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:52:54.199661  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:54.264132  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c563cc7cfbe4d59be4ffc5cf847ce56" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:54.206878  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: true dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:54.266541  7926 raft_consensus.cc:3055] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 14:52:54.267064  7926 raft_consensus.cc:740] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
W20260709 14:52:54.267442  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:54.222918  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:54.187062 12921 leader_election.cc:290] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:52:54.199193 12954 log.cc:927] Time spent T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.192s	user 0.003s	sys 0.003s
I20260709 14:52:54.278698  7894 leader_election.cc:304] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:54.270830  7922 raft_consensus.cc:2393] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 15: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:52:54.271020  7849 pending_rounds.cc:107] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 14:52:54.280705  7849 raft_consensus.cc:2889] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:52:54.281195  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:54.272783  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:54.173879 12724 leader_election.cc:290] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:52:54.251405 12904 consensus_meta.cc:287] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent flushing consensus metadata: real 0.527s	user 0.011s	sys 0.004s
I20260709 14:52:54.280033  7894 leader_election.cc:304] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:54.291127  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c563cc7cfbe4d59be4ffc5cf847ce56" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:54.253690 12757 raft_consensus.cc:493] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:54.294009 11963 raft_consensus.cc:2804] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 14:52:54.295004 11963 raft_consensus.cc:697] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:54.295634  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:54.295831  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:54.298524  7778 raft_consensus.cc:1275] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 14:52:54.299093  7777 raft_consensus.cc:2468] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 18.
I20260709 14:52:54.299711 12936 raft_consensus.cc:2764] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 14:52:54.299847  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:54.300105  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:54.299587 12970 raft_consensus.cc:493] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:54.301088 12936 raft_consensus.cc:2749] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 14:52:54.300993 12970 raft_consensus.cc:515] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:54.302101  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:54.303331  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:54.303785  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:54.306129  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:54.307232  7777 raft_consensus.cc:2410] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for term 18 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 14:52:54.296089 11963 consensus_queue.cc:237] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:54.308929  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:54.311018 12980 consensus_queue.cc:1048] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 14:52:54.312162  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
W20260709 14:52:54.312471  7742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:54.318130  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:54.313966  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
W20260709 14:52:54.314008  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:54.321096  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:54.321894  7773 raft_consensus.cc:2468] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 16.
I20260709 14:52:54.304569  7771 raft_consensus.cc:2468] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 16.
I20260709 14:52:54.322989  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:54.323954  7778 raft_consensus.cc:2368] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 11. Current term is 12.
W20260709 14:52:54.324767  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 126793us
I20260709 14:52:54.324923  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:54.325728  7778 raft_consensus.cc:3060] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Advancing to term 16
I20260709 14:52:54.325987  7923 raft_consensus.cc:1275] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 14:52:54.326671 12936 consensus_queue.cc:1059] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 14:52:54.303234 12970 leader_election.cc:290] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:54.327908  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:54.316305  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:54.328914  7928 raft_consensus.cc:2468] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 15.
I20260709 14:52:54.323067  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:54.330341  7893 leader_election.cc:304] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:54.317806  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:54.324103  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18d29d52d304c87b930d4fb5eaf50b1" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:54.334794  7777 raft_consensus.cc:3060] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Advancing to term 13
I20260709 14:52:54.335970  7771 raft_consensus.cc:3060] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Advancing to term 15
I20260709 14:52:54.326633 12978 consensus_queue.cc:1048] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.010s
I20260709 14:52:54.348224  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:54.349011  7774 raft_consensus.cc:2393] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 16: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:52:54.349308  7770 raft_consensus.cc:2468] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 15.
I20260709 14:52:54.350250  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:54.350848  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:54.328259 12970 consensus_queue.cc:1048] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 14:52:54.337102 12956 raft_consensus.cc:2749] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 14:52:54.294070  7894 leader_election.cc:304] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:54.346750  7924 raft_consensus.cc:2468] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 16.
I20260709 14:52:54.346750  7778 raft_consensus.cc:2468] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 16.
I20260709 14:52:54.318318  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce9c0ef2db24c13a8b1402f21819458" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:54.288599  7926 consensus_queue.cc:260] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:54.352247  7775 raft_consensus.cc:2410] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for term 17 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 14:52:54.352246  7770 raft_consensus.cc:3060] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Advancing to term 13
I20260709 14:52:54.351643  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:54.366966  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
W20260709 14:52:54.369099  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:54.353124  7773 raft_consensus.cc:3060] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Advancing to term 15
W20260709 14:52:54.358335  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 64369.9us
I20260709 14:52:54.358706  7926 raft_consensus.cc:3060] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 14:52:54.372812  7894 leader_election.cc:304] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:54.197961 12931 raft_consensus.cc:515] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:52:54.293025 12921 raft_consensus.cc:2804] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 14:52:54.375382  7853 raft_consensus.cc:2468] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 18.
I20260709 14:52:54.375757  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:54.385208  7778 raft_consensus.cc:3060] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Advancing to term 15
I20260709 14:52:54.239391 12927 raft_consensus.cc:515] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:54.368496  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:54.378475  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
W20260709 14:52:54.374554  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 122945us
I20260709 14:52:54.377996  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:54.386852  7776 raft_consensus.cc:2468] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 15.
I20260709 14:52:54.387205  7922 raft_consensus.cc:2393] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 18: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:52:54.270594 12878 consensus_queue.cc:1048] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.085s
I20260709 14:52:54.274240 12903 consensus_queue.cc:1048] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.086s
I20260709 14:52:54.394410  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:54.393658  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:54.277346 12804 consensus_queue.cc:1059] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.100s
I20260709 14:52:54.388875  7774 raft_consensus.cc:2393] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 16: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:52:54.270435 12861 consensus_queue.cc:1048] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.104s
I20260709 14:52:54.409410  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:54.410492  7776 raft_consensus.cc:2368] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 11. Current term is 12.
I20260709 14:52:54.277647 12959 consensus_queue.cc:1048] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.119s
I20260709 14:52:54.376706 12958 raft_consensus.cc:2804] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 14:52:54.404649 12927 leader_election.cc:290] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:54.413235  7778 raft_consensus.cc:2468] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 15.
I20260709 14:52:54.414070  7777 raft_consensus.cc:1275] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 14:52:54.395653  7853 raft_consensus.cc:2468] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 14.
I20260709 14:52:54.281921 12962 consensus_queue.cc:1048] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.120s
I20260709 14:52:54.417754  6549 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 14:52:54.400522  7770 raft_consensus.cc:2468] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 13.
I20260709 14:52:54.408020  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:54.282884 12965 consensus_queue.cc:1048] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.119s
I20260709 14:52:54.388115 12922 raft_consensus.cc:2804] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 14:52:54.428406 12922 raft_consensus.cc:493] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:54.428660  7926 raft_consensus.cc:2468] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 17.
I20260709 14:52:54.351238 12757 raft_consensus.cc:515] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:54.425323  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 98276.9us
I20260709 14:52:54.427752  7774 raft_consensus.cc:2468] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 16.
I20260709 14:52:54.434392  7845 raft_consensus.cc:1275] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 14:52:54.441443  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:54.432849  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c563cc7cfbe4d59be4ffc5cf847ce56" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:54.442531  7774 raft_consensus.cc:2468] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 16.
I20260709 14:52:54.432511  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:54.443801  7770 raft_consensus.cc:2410] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for term 18 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 14:52:54.428777  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:54.430536  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:54.454394  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: true dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:54.455897  7774 raft_consensus.cc:3060] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Advancing to term 17
I20260709 14:52:54.455791  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:54.460278  7778 raft_consensus.cc:1275] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 14:52:54.461551  7770 raft_consensus.cc:3060] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Advancing to term 15
I20260709 14:52:54.454497  7894 leader_election.cc:304] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:54.389051 12919 consensus_queue.cc:1059] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 14:52:54.421825 12958 raft_consensus.cc:493] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:54.472826  7774 raft_consensus.cc:2468] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 17.
I20260709 14:52:54.434600 12922 raft_consensus.cc:3060] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 14:52:54.477701  7778 raft_consensus.cc:1240] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 LEADER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 14:52:54.486083  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:54.481516  7774 raft_consensus.cc:1240] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 14. Current term is 15. Ops: []
I20260709 14:52:54.487861  7774 raft_consensus.cc:3060] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Advancing to term 18
I20260709 14:52:54.488171  7778 raft_consensus.cc:1275] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 14:52:54.450183 12921 raft_consensus.cc:697] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
W20260709 14:52:54.467129 12929 consensus_meta.cc:287] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent flushing consensus metadata: real 0.691s	user 0.013s	sys 0.002s
I20260709 14:52:54.456625 12916 leader_election.cc:290] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:54.510871  7772 raft_consensus.cc:2468] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 15.
I20260709 14:52:54.484949 12958 raft_consensus.cc:3060] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Advancing to term 15
W20260709 14:52:54.504958 12985 log.cc:927] Time spent T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.166s	user 0.002s	sys 0.000s
I20260709 14:52:54.390296 12979 consensus_queue.cc:1048] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.087s
I20260709 14:52:54.500828  7774 raft_consensus.cc:1275] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 14:52:54.517495  7770 raft_consensus.cc:1275] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
W20260709 14:52:54.506601 12875 consensus_meta.cc:287] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent flushing consensus metadata: real 0.792s	user 0.013s	sys 0.003s
I20260709 14:52:54.533370 12875 raft_consensus.cc:515] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:54.502022 12975 raft_consensus.cc:2804] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Leader election won for term 18
W20260709 14:52:54.536823  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 156912us
W20260709 14:52:54.552621  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 164881us
I20260709 14:52:54.554363 12962 consensus_queue.cc:1048] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 14:52:54.556602  7819 leader_election.cc:304] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:54.493619 12977 consensus_queue.cc:1048] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.056s
I20260709 14:52:54.512513 12980 consensus_queue.cc:1048] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.044s
I20260709 14:52:54.556700 12964 leader_election.cc:290] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:54.599748  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:52:54.601372 12984 log.cc:927] Time spent T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 14:52:54.602432 12875 leader_election.cc:290] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 18 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:52:54.605403 12920 consensus_meta.cc:287] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent flushing consensus metadata: real 0.572s	user 0.008s	sys 0.004s
I20260709 14:52:54.607235  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:54.569705 12921 consensus_queue.cc:237] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:54.605932 12920 raft_consensus.cc:515] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:54.617136  7777 raft_consensus.cc:2393] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 16: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:52:54.631780  7773 raft_consensus.cc:1275] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 14:52:54.636302  7771 raft_consensus.cc:1275] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
W20260709 14:52:54.658013  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:54.665225  7819 leader_election.cc:304] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:54.667323  7819 leader_election.cc:304] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:54.596112 12993 raft_consensus.cc:2804] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Leader election won for term 16
I20260709 14:52:54.672695  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:52:54.644881 12963 log.cc:927] Time spent T 00000000000000000000000000000000 P 133636659113430cb53b321cb0b1d9ee: Append to log took a long time: real 0.395s	user 0.000s	sys 0.003s
I20260709 14:52:54.629827 12920 leader_election.cc:290] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 16 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:54.680477  7819 leader_election.cc:304] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:54.688832  8639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9441e831627143a991a1556dcdce71e3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9418391fa82a42c79c6cad13ba91d964" is_pre_election: true
I20260709 14:52:54.692006 12975 raft_consensus.cc:697] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
W20260709 14:52:54.700065  8598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 59516.3us
W20260709 14:52:54.669092 12966 log.cc:927] Time spent T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.262s	user 0.002s	sys 0.000s
W20260709 14:52:54.724541 12983 log.cc:927] Time spent T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.190s	user 0.000s	sys 0.001s
W20260709 14:52:54.727540 12479 consensus_meta.cc:287] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0: Time spent flushing consensus metadata: real 0.989s	user 0.014s	sys 0.003s
I20260709 14:52:54.728020  7776 raft_consensus.cc:1240] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 LEADER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 14. Current term is 15. Ops: [14.8-14.8]
W20260709 14:52:54.749353  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:54.730819 12757 leader_election.cc:290] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:54.668691 12834 raft_consensus.cc:2749] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 14:52:54.672852 12931 leader_election.cc:290] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68:42321)
W20260709 14:52:54.739346  7744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:52:54.738965  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 58594us
I20260709 14:52:54.715456 12878 raft_consensus.cc:2804] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 14:52:54.752543  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 196327us
W20260709 14:52:54.752415  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 189756us
I20260709 14:52:54.672117 12977 consensus_queue.cc:1048] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.071s
I20260709 14:52:54.733122 12993 raft_consensus.cc:697] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:52:54.743623 12959 raft_consensus.cc:2749] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 14:52:54.770308  7819 leader_election.cc:304] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 9418391fa82a42c79c6cad13ba91d964
I20260709 14:52:54.775087  7819 leader_election.cc:304] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:54.776649  7819 leader_election.cc:304] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:54.774313  7894 leader_election.cc:304] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:54.783571 12993 consensus_queue.cc:237] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:54.786350 12998 raft_consensus.cc:2804] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 14:52:54.787078 12998 raft_consensus.cc:493] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:54.787541 12998 raft_consensus.cc:3060] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 14:52:54.789762 13000 raft_consensus.cc:2749] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 14:52:54.803932  7920 raft_consensus.cc:2468] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 13.
I20260709 14:52:54.807814  7819 leader_election.cc:304] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:54.808885 12757 raft_consensus.cc:2804] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 14:52:54.809455 12757 raft_consensus.cc:493] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:54.809855 12757 raft_consensus.cc:3060] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Advancing to term 16
I20260709 14:52:54.810329 12804 consensus_queue.cc:1048] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 14:52:54.808576 12975 consensus_queue.cc:237] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:54.799669 12922 raft_consensus.cc:515] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:54.818614 12931 raft_consensus.cc:493] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:54.819365 12931 raft_consensus.cc:515] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:54.819842 12922 leader_election.cc:290] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:54.816423  7819 leader_election.cc:400] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 11 election: Vote denied by peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587) with higher term. Message: Invalid argument: T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 11. Current term is 12.
I20260709 14:52:54.826153  7847 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 4034) took 1008 ms. Trace:
W20260709 14:52:54.827196  7742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:54.826699  7847 rpcz_store.cc:276] 0709 14:52:53.817583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:53.855873 (+ 38290us) service_pool.cc:224] Handling call
0709 14:52:53.856393 (+   520us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:52:54.013527 (+157134us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:52:54.014688 (+  1161us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:52:54.015709 (+  1021us) log.cc:844] Serialized 26 byte log entry
0709 14:52:54.129440 (+113731us) raft_consensus.cc:1645] Marking committed up to 9
0709 14:52:54.129525 (+    85us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:54.129635 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:52:54.825876 (+696241us) raft_consensus.cc:1685] finished
0709 14:52:54.825900 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:54.826072 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":74482,"raft.run_cpu_time_us":271,"raft.run_wall_time_us":8892,"thread_start_us":269389,"threads_started":2,"wal-append.queue_time_us":261270}
I20260709 14:52:54.799763 12957 raft_consensus.cc:3055] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 14:52:54.805992 12834 raft_consensus.cc:2749] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 14:52:54.823817 12920 raft_consensus.cc:493] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:54.835634 13000 raft_consensus.cc:2749] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 14:52:54.853405 12834 consensus_queue.cc:1048] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 14:52:54.844815 12915 consensus_meta.cc:287] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent flushing consensus metadata: real 1.142s	user 0.017s	sys 0.003s
I20260709 14:52:54.849040 12920 raft_consensus.cc:515] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:54.862919 12724 raft_consensus.cc:3055] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 LEADER]: Stepping down as leader of term 14
I20260709 14:52:54.863494 12724 raft_consensus.cc:740] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:52:54.864215 12920 leader_election.cc:290] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:54.865721 12860 raft_consensus.cc:3055] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 14:52:54.866268 12860 raft_consensus.cc:740] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:54.867383 12860 consensus_queue.cc:260] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:54.833838 12862 consensus_queue.cc:1048] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.015s
W20260709 14:52:54.874001 12879 consensus_meta.cc:287] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent flushing consensus metadata: real 0.993s	user 0.014s	sys 0.002s
I20260709 14:52:54.875183 12931 leader_election.cc:290] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:54.860868 12915 raft_consensus.cc:515] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:54.877118  7854 raft_consensus.cc:2468] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 16.
I20260709 14:52:54.878499 12915 leader_election.cc:290] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 16 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:54.838207 12957 raft_consensus.cc:740] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:54.882788 12957 consensus_queue.cc:260] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:54.883766  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:52:54.900962  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 70600.8us
I20260709 14:52:54.864512 12724 consensus_queue.cc:260] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:54.905798  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:54.907824  7847 raft_consensus.cc:3060] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Advancing to term 16
I20260709 14:52:54.913753  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:54.917133 12958 raft_consensus.cc:515] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:54.919948 12958 leader_election.cc:290] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 15 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:54.923259  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
W20260709 14:52:54.925617  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 99828.9us
I20260709 14:52:54.928691  7848 raft_consensus.cc:3060] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:52:54.929016  7819 leader_election.cc:304] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:54.930369  7846 raft_consensus.cc:3060] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Advancing to term 18
I20260709 14:52:54.869113 12831 leader_election.cc:290] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:54.942354  7847 raft_consensus.cc:2468] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 16.
W20260709 14:52:54.950783  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:54.900193 12879 raft_consensus.cc:493] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:54.955386  7846 raft_consensus.cc:2468] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 18.
I20260709 14:52:54.929286 12724 raft_consensus.cc:3060] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Advancing to term 15
W20260709 14:52:54.973325  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 44365.2us
I20260709 14:52:54.914541 12757 raft_consensus.cc:515] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:54.988656  7846 raft_consensus.cc:1275] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 14:52:54.989414  7819 leader_election.cc:304] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:54.990593  7819 leader_election.cc:304] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:54.992445  7848 raft_consensus.cc:2468] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 12.
I20260709 14:52:54.999130  7852 raft_consensus.cc:1275] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 14:52:54.929713 12919 consensus_queue.cc:1048] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.043s
I20260709 14:52:54.929381 12479 consensus_queue.cc:1048] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 14:52:55.000114  7819 leader_election.cc:304] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:55.006851  7819 leader_election.cc:304] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:55.010099  7819 leader_election.cc:304] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:55.003158 12977 raft_consensus.cc:493] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:55.008800 12915 raft_consensus.cc:2749] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 14:52:55.003044 12993 raft_consensus.cc:2804] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 14:52:55.012537 12993 raft_consensus.cc:493] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:55.013005 12993 raft_consensus.cc:3060] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Advancing to term 17
I20260709 14:52:55.005502 12831 raft_consensus.cc:493] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:55.018157 12831 raft_consensus.cc:515] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:55.020103 13014 raft_consensus.cc:2749] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 14:52:55.033053  7819 leader_election.cc:304] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:55.029284  7851 raft_consensus.cc:1240] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 15. Current term is 16. Ops: []
I20260709 14:52:55.001586 12996 raft_consensus.cc:2804] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Leader election won for term 15
I20260709 14:52:55.046469 12842 raft_consensus.cc:493] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:54.964022 12879 raft_consensus.cc:515] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:55.053900  7819 leader_election.cc:304] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
W20260709 14:52:55.035627  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:55.021081 12831 leader_election.cc:290] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:55.022718 12920 raft_consensus.cc:493] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:55.004155 13013 raft_consensus.cc:2804] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Leader election won for term 13
I20260709 14:52:55.043143 13014 raft_consensus.cc:2749] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 14:52:55.056896  7893 leader_election.cc:304] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:55.011797 12977 raft_consensus.cc:515] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:55.022445 12931 raft_consensus.cc:493] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:55.072325  7893 leader_election.cc:304] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:55.057981 12980 raft_consensus.cc:2749] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 14:52:55.070345 12919 raft_consensus.cc:2804] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 14:52:55.059326 13007 consensus_queue.cc:1048] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 14:52:55.060036 12915 consensus_queue.cc:1048] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.022s
I20260709 14:52:55.060360 12958 consensus_queue.cc:1048] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 14:52:55.057928 12842 raft_consensus.cc:515] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:55.088891 13014 raft_consensus.cc:2804] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Leader election won for term 17
I20260709 14:52:55.077087 12805 raft_consensus.cc:2749] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 14:52:55.078670 12931 raft_consensus.cc:515] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:55.093874 12919 raft_consensus.cc:493] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:55.102169 12958 consensus_queue.cc:1243] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer 1de5e20126fa4d8ca0793d19c7b847ed log is divergent from this leader: its last log entry 14.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 14:52:55.114473 12757 leader_election.cc:290] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 16 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:55.115957 12879 leader_election.cc:290] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:55.116782 12831 raft_consensus.cc:493] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
W20260709 14:52:55.194391  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 122175us
I20260709 14:52:55.124816 13014 raft_consensus.cc:697] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:52:55.126883  7852 raft_consensus.cc:1275] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 14:52:55.130182 12993 raft_consensus.cc:515] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:55.133703  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:55.137319 12998 raft_consensus.cc:515] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:55.143571 12860 raft_consensus.cc:3060] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 14:52:55.065548 12920 raft_consensus.cc:515] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:55.145723 12842 leader_election.cc:290] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:55.148300 13013 raft_consensus.cc:697] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
W20260709 14:52:55.153843  7744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:55.117972  7894 leader_election.cc:304] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
W20260709 14:52:55.204769  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 86903.9us
I20260709 14:52:55.195395  7893 leader_election.cc:304] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:52:55.199448  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 145638us
I20260709 14:52:55.191169 12919 raft_consensus.cc:3060] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 14:52:55.206686 11963 raft_consensus.cc:2804] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 14:52:55.207129 11963 raft_consensus.cc:493] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:52:55.207216  7893 leader_election.cc:304] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:55.207659 11963 raft_consensus.cc:3060] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 14:52:55.205528  7894 leader_election.cc:304] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:55.210099  7893 leader_election.cc:304] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:55.210652  7894 leader_election.cc:304] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
W20260709 14:52:55.208752 12970 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.017s	sys 0.004s
I20260709 14:52:55.196262 12996 raft_consensus.cc:697] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:52:55.197606 12831 raft_consensus.cc:515] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:55.223227  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:55.264670 13013 consensus_queue.cc:237] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:55.265000 12996 consensus_queue.cc:237] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:55.265669  7771 raft_consensus.cc:3060] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Advancing to term 16
I20260709 14:52:55.224717 12921 raft_consensus.cc:2804] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 14:52:55.216926 13000 consensus_queue.cc:1048] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.008s
I20260709 14:52:55.271085  7920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38516 (request call id 2737) took 1069 ms. Trace:
I20260709 14:52:55.215418 12879 consensus_queue.cc:1048] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.012s
I20260709 14:52:55.220597  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:55.272195  7777 raft_consensus.cc:2468] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 16.
I20260709 14:52:55.228221  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:55.212288 12805 raft_consensus.cc:2804] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 14:52:55.214586 12922 raft_consensus.cc:2804] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 14:52:55.228619  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:55.274572  7779 raft_consensus.cc:2393] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 16: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:52:55.275480 12921 raft_consensus.cc:697] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:55.271654  7920 rpcz_store.cc:276] 0709 14:52:54.201167 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:54.249675 (+ 48508us) service_pool.cc:224] Handling call
0709 14:52:55.270782 (+1021107us) spinlock_profiling.cc:243] Waited 505 ms on lock 0x7b54001324d4. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae922fa 00007fb68fe53b17 00007fb6893ce6d4 00007fb6893ce662 00007fb6893ce591 00007fb6893ce50c 00007fb6893cd7c2 00007fb6891c948c 00007fb6891c88c6 00007fb6891c826f
0709 14:52:55.270949 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1160554752}
I20260709 14:52:55.273897 12922 raft_consensus.cc:697] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:55.276960 12921 consensus_queue.cc:237] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:55.278102 12922 consensus_queue.cc:237] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:55.229389  7744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:55.273175 12931 leader_election.cc:290] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:55.229866  7894 leader_election.cc:304] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:55.214454 12903 consensus_queue.cc:1048] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 14:52:55.232568 12479 consensus_queue.cc:1048] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 14:52:55.235808 13014 consensus_queue.cc:237] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:55.212479 12757 consensus_queue.cc:1048] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 14:52:55.214006 12956 raft_consensus.cc:2804] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 14:52:55.248867 12920 leader_election.cc:290] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:55.226910 13002 consensus_queue.cc:1048] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 14:52:55.218802 13021 consensus_queue.cc:1048] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 14:52:55.217446 12965 raft_consensus.cc:493] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
W20260709 14:52:55.259019 12988 log.cc:927] Time spent T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.664s	user 0.000s	sys 0.006s
I20260709 14:52:55.259837  7893 leader_election.cc:304] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:55.261622 12861 consensus_queue.cc:1048] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 14:52:55.218379 12959 consensus_queue.cc:1048] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 14:52:55.262317 11963 raft_consensus.cc:515] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:55.273774 12805 raft_consensus.cc:697] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:55.273164  7770 raft_consensus.cc:2468] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 17.
W20260709 14:52:55.285534  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 62566.4us
W20260709 14:52:55.291641  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 61837.8us
W20260709 14:52:55.220083 12970 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.599s	user 0.018s	sys 0.004s
I20260709 14:52:55.297137  7771 raft_consensus.cc:2468] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 16.
W20260709 14:52:55.299226  7742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:55.297199 12875 raft_consensus.cc:2804] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 14:52:55.344872  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:55.294765 12956 raft_consensus.cc:493] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:52:55.351351  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9441e831627143a991a1556dcdce71e3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:55.358189 12927 raft_consensus.cc:2804] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 14:52:55.358775 12927 raft_consensus.cc:493] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:55.359161 12927 raft_consensus.cc:3060] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Advancing to term 19
I20260709 14:52:55.358243 12864 consensus_queue.cc:1048] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 14:52:55.359798 12990 consensus_queue.cc:1059] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 14:52:55.351701  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:55.361902  7846 raft_consensus.cc:2393] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 16: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
W20260709 14:52:55.351864  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 131828us
I20260709 14:52:55.370397  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:55.371539  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:55.373292  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:55.373553  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
W20260709 14:52:55.355908  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 98620.3us
W20260709 14:52:55.356913  7744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:55.361099 12864 raft_consensus.cc:3055] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 14:52:55.378966 12864 raft_consensus.cc:740] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:55.380249 12864 consensus_queue.cc:260] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:55.377116  7893 leader_election.cc:304] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:55.382498 12561 raft_consensus.cc:2804] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 14:52:55.383133 12561 raft_consensus.cc:493] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:52:55.383500 12561 raft_consensus.cc:3060] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 14:52:55.397030 12561 raft_consensus.cc:515] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:55.400758 12561 leader_election.cc:290] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:55.406982 12864 raft_consensus.cc:3060] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 14:52:55.415092  7893 leader_election.cc:304] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:55.416736 12561 raft_consensus.cc:2804] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 14:52:55.422945 11963 leader_election.cc:290] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:55.423497  7893 leader_election.cc:304] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:52:55.423830  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 60533.8us
I20260709 14:52:55.434226  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:55.425056  7893 leader_election.cc:304] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:55.441689  7893 leader_election.cc:304] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:55.307654 13023 raft_consensus.cc:2804] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 14:52:55.419517 12561 raft_consensus.cc:697] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:55.458001  7845 raft_consensus.cc:1240] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 14:52:55.459894  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:55.460492  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:55.352624 12875 raft_consensus.cc:493] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 14:52:55.463102  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 85252.5us
I20260709 14:52:55.421494 12956 raft_consensus.cc:3060] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 14:52:55.473361  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:55.485051  7744 leader_election.cc:304] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:55.485476  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:55.488595  7744 leader_election.cc:304] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:52:55.491107  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 100401us
I20260709 14:52:55.455855 12724 raft_consensus.cc:493] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:55.319855 12965 raft_consensus.cc:515] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:55.469563 12875 raft_consensus.cc:3060] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 14:52:55.498705  7745 leader_election.cc:304] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 3876b8ee8d744cb18e91d97aae93b1ac, 9418391fa82a42c79c6cad13ba91d964
I20260709 14:52:55.471866 12879 raft_consensus.cc:493] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:55.509667  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:55.509187  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:55.487107 12970 raft_consensus.cc:493] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:55.489517 13007 raft_consensus.cc:2804] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 14:52:55.492918 12998 leader_election.cc:290] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 15 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:55.496107 12993 leader_election.cc:290] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 17 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:55.527729 11963 raft_consensus.cc:2804] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 14:52:55.514737 12831 leader_election.cc:290] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:55.515411 12959 raft_consensus.cc:493] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:52:55.548345  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 59560.7us
I20260709 14:52:55.557658  7744 leader_election.cc:304] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:55.559579  7744 leader_election.cc:304] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:55.508116 12724 raft_consensus.cc:515] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:55.546721 13038 log.cc:927] Time spent T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.180s	user 0.002s	sys 0.000s
W20260709 14:52:55.568881  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 72070.4us
I20260709 14:52:55.546072 12931 raft_consensus.cc:2749] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 14:52:55.574297  7819 leader_election.cc:304] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:55.506076 12805 consensus_queue.cc:237] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:55.548712 12901 raft_consensus.cc:2749] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 14:52:55.517441 12879 raft_consensus.cc:515] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:55.569839 12927 raft_consensus.cc:515] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:55.622110  7926 raft_consensus.cc:1240] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 14:52:55.623492 12927 leader_election.cc:290] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:55.588502  7819 leader_election.cc:304] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
W20260709 14:52:55.625197  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 48522.5us
I20260709 14:52:55.626302  7819 leader_election.cc:304] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
W20260709 14:52:55.577184 13039 log.cc:927] Time spent T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 14:52:55.579381 12940 raft_consensus.cc:2749] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 14:52:55.579526 12997 raft_consensus.cc:2804] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 14:52:55.584491 12878 raft_consensus.cc:493] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:55.630074 12997 raft_consensus.cc:493] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:52:55.528509 12970 raft_consensus.cc:515] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:55.630558 12915 raft_consensus.cc:2804] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 14:52:55.630630 12997 raft_consensus.cc:3060] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 14:52:55.631278 12915 raft_consensus.cc:493] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:55.632398 12915 raft_consensus.cc:3060] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Advancing to term 18
I20260709 14:52:55.633805 13029 raft_consensus.cc:2804] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Leader election won for term 16
I20260709 14:52:55.634130 12970 leader_election.cc:290] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:55.602303 13050 consensus_queue.cc:1059] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 14:52:55.603273 12920 raft_consensus.cc:2749] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 14:52:55.603962 12931 raft_consensus.cc:2749] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 14:52:55.607671 12965 leader_election.cc:290] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:55.562146 12959 raft_consensus.cc:515] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:55.690914 12959 leader_election.cc:290] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:52:55.578083 13037 log.cc:927] Time spent T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
W20260709 14:52:55.610219 13033 log.cc:927] Time spent T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 14:52:55.523320 12561 consensus_queue.cc:237] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:55.696599 13029 raft_consensus.cc:697] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:52:55.630460 12878 raft_consensus.cc:3060] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Advancing to term 17
I20260709 14:52:55.601441 12996 raft_consensus.cc:2804] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 14:52:55.720204  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 221605us
I20260709 14:52:55.743758 11963 raft_consensus.cc:493] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:52:55.744419 11963 raft_consensus.cc:3060] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Advancing to term 14
W20260709 14:52:55.712302 13031 log.cc:927] Time spent T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.143s	user 0.004s	sys 0.000s
I20260709 14:52:55.752172  6549 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 14:52:55.792002  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 277622us
I20260709 14:52:55.714915 12970 raft_consensus.cc:3055] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 LEADER]: Stepping down as leader of term 17
W20260709 14:52:55.789212 12862 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.001s	sys 0.013s
I20260709 14:52:55.741955 12996 raft_consensus.cc:493] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:55.810480 11963 raft_consensus.cc:515] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:55.788909 12919 consensus_meta.cc:287] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0: Time spent flushing consensus metadata: real 0.573s	user 0.012s	sys 0.000s
I20260709 14:52:55.812649  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:52:55.819820  7894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:55.823601  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258d6c2dda954bf5b65930fde8ecb9f3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:55.787896 12757 raft_consensus.cc:493] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:55.836642  7921 raft_consensus.cc:1240] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 15. Current term is 16. Ops: []
I20260709 14:52:55.836879  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:55.840014  7925 raft_consensus.cc:1240] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 15. Current term is 16. Ops: []
I20260709 14:52:55.801137 12970 raft_consensus.cc:740] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
W20260709 14:52:55.843401  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 283867us
W20260709 14:52:55.818638 12862 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.534s	user 0.002s	sys 0.013s
I20260709 14:52:55.847918 11963 leader_election.cc:290] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:55.849845  7744 leader_election.cc:304] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:55.866276 12724 leader_election.cc:290] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:52:55.989274 13040 log.cc:927] Time spent T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.160s	user 0.000s	sys 0.003s
W20260709 14:52:55.987145 13049 log.cc:927] Time spent T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.177s	user 0.003s	sys 0.000s
I20260709 14:52:55.878825 12915 raft_consensus.cc:515] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:55.986356 13066 raft_consensus.cc:493] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:55.853557  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:55.868940 12875 raft_consensus.cc:515] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:55.949371  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 136545us
I20260709 14:52:55.842996 12757 raft_consensus.cc:515] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:55.852828 13034 log.cc:927] Time spent T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.160s	user 0.002s	sys 0.002s
I20260709 14:52:55.924404 11963 raft_consensus.cc:493] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:56.061429 11963 raft_consensus.cc:515] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:55.849108 13014 raft_consensus.cc:493] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:56.062753  7921 raft_consensus.cc:1275] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 14:52:56.002130 12997 raft_consensus.cc:515] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:55.999713 13055 log.cc:927] Time spent T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.071s	user 0.001s	sys 0.001s
I20260709 14:52:55.828557 12996 raft_consensus.cc:3060] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Advancing to term 17
I20260709 14:52:55.838209 12919 raft_consensus.cc:515] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:55.826699 13000 consensus_queue.cc:1059] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.040s
I20260709 14:52:55.860900 12970 consensus_queue.cc:260] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:55.876621  7925 raft_consensus.cc:1275] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 14:52:55.809007 13029 consensus_queue.cc:237] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:55.932246 12879 leader_election.cc:290] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:52:55.953022 13018 log.cc:927] Time spent T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.643s	user 0.008s	sys 0.000s
I20260709 14:52:56.005465 13023 raft_consensus.cc:493] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:52:55.854563  7924 raft_consensus.cc:1275] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
W20260709 14:52:56.027907  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:56.029367  7922 raft_consensus.cc:1240] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 LEADER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 14. Current term is 15. Ops: []
W20260709 14:52:56.030546  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 180815us
I20260709 14:52:56.056298  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
W20260709 14:52:56.104988  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:55.965958 13022 raft_consensus.cc:493] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:56.063330  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:56.042234 12904 raft_consensus.cc:2749] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 14:52:56.090546  7919 raft_consensus.cc:2368] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 16. Current term is 17.
I20260709 14:52:56.095789 11963 leader_election.cc:290] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:56.099385  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:56.105970  7744 leader_election.cc:304] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:56.106945  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:56.112047  7920 raft_consensus.cc:1240] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 14:52:56.114543 11963 raft_consensus.cc:493] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:56.115662 11963 raft_consensus.cc:515] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:56.117501  7925 raft_consensus.cc:2393] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 16: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:52:56.118918  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:56.121654  7744 leader_election.cc:304] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:56.123291  7744 leader_election.cc:304] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:56.124312  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:56.125916  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:56.091945 12920 raft_consensus.cc:493] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:56.136817 12875 leader_election.cc:290] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 17 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:56.136986 12920 raft_consensus.cc:515] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:56.139528 12920 leader_election.cc:290] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:56.108088 13023 raft_consensus.cc:3060] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 14:52:56.114548 12724 consensus_queue.cc:1059] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 14:52:56.141615  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:56.136996 12957 raft_consensus.cc:3060] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 14:52:56.143313  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:56.144635  7923 raft_consensus.cc:2410] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 14:52:56.117578 13022 raft_consensus.cc:515] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:56.147941 13022 leader_election.cc:290] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:52:56.150276 12956 consensus_meta.cc:287] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent flushing consensus metadata: real 0.658s	user 0.011s	sys 0.002s
I20260709 14:52:56.129760 13036 raft_consensus.cc:2749] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 14:52:56.150961  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:56.152194 12915 leader_election.cc:290] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 18 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:56.152549  7926 raft_consensus.cc:1240] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 14. Current term is 15. Ops: []
I20260709 14:52:56.155352 12757 leader_election.cc:290] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:56.155565 12940 raft_consensus.cc:2749] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 14:52:56.066936 13014 raft_consensus.cc:515] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:56.157732  7853 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 4068) took 1272 ms. Trace:
I20260709 14:52:56.159061 13014 leader_election.cc:290] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:56.059928 13066 raft_consensus.cc:515] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:56.164283 13066 leader_election.cc:290] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:56.133924 12970 raft_consensus.cc:3060] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Advancing to term 18
I20260709 14:52:56.169070 12724 raft_consensus.cc:3055] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 LEADER]: Stepping down as leader of term 12
I20260709 14:52:56.169651 12724 raft_consensus.cc:740] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:52:56.170542 12724 consensus_queue.cc:260] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:56.172298 12724 raft_consensus.cc:3060] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Advancing to term 13
I20260709 14:52:56.128108  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:56.136243  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:56.150846 12956 raft_consensus.cc:515] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:56.127588  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:56.180336  7927 raft_consensus.cc:2376] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 13. Re-sending same reply.
I20260709 14:52:56.181074  7926 raft_consensus.cc:1240] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 13. Current term is 14. Ops: []
I20260709 14:52:56.185294  7928 raft_consensus.cc:1240] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 13. Current term is 14. Ops: []
W20260709 14:52:56.184963  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 61761.8us
I20260709 14:52:56.235132  7744 leader_election.cc:304] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:56.194386 11963 leader_election.cc:290] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:56.216259  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:56.225605  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:56.158416  7853 rpcz_store.cc:276] 0709 14:52:54.885566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:54.887255 (+  1689us) service_pool.cc:224] Handling call
0709 14:52:54.887745 (+   490us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:52:54.888202 (+   457us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:52:54.888234 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:52:54.903578 (+ 15344us) log.cc:844] Serialized 26 byte log entry
0709 14:52:55.051991 (+148413us) raft_consensus.cc:1645] Marking committed up to 11
0709 14:52:55.055722 (+  3731us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:55.055801 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:52:55.490107 (+434306us) spinlock_profiling.cc:243] Waited 1.97 ms on lock 0x7b4400022b4c. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb687c29db1 00007fb687cc7c85 00007fb687cc86a2 00007fb68aa3a1db 00007fb68aa35aaf 00007fb68aa2986e 00007fb68aa28bb6 00007fb68aa287d8 00007fb68aa32221 00007fb68aa321d9 00007fb68aa32169
0709 14:52:56.157272 (+667165us) raft_consensus.cc:1685] finished
0709 14:52:56.157306 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:56.157614 (+   308us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13263,"raft.queue_time_us":14430,"raft.run_cpu_time_us":225,"raft.run_wall_time_us":17212,"spinlock_wait_cycles":4537728,"thread_start_us":96353,"threads_started":1,"wal-append.queue_time_us":147833}
I20260709 14:52:56.241493  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:56.243371  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:56.246953  7853 raft_consensus.cc:1240] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 16. Current term is 17. Ops: []
I20260709 14:52:56.254359  7744 leader_election.cc:304] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:56.264576  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:56.269809 13050 raft_consensus.cc:2749] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 14:52:56.270572  7744 leader_election.cc:304] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:56.270823 13050 raft_consensus.cc:2749] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 14:52:56.271762 13050 raft_consensus.cc:2749] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 14:52:56.272732  7744 leader_election.cc:304] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:56.150432 13053 raft_consensus.cc:2749] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 14:52:56.272531 13065 raft_consensus.cc:3055] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 LEADER]: Stepping down as leader of term 18
I20260709 14:52:56.173669 12977 leader_election.cc:290] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:56.279063  7848 raft_consensus.cc:1275] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 14:52:56.282083  7744 leader_election.cc:304] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 9418391fa82a42c79c6cad13ba91d964
I20260709 14:52:56.193593 12956 leader_election.cc:290] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:56.191711 12997 leader_election.cc:290] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 15 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:56.288332  7744 leader_election.cc:304] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:56.175093 13072 raft_consensus.cc:493] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:56.289368  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:56.174691 13051 raft_consensus.cc:493] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:56.293565  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:56.295351  7744 leader_election.cc:304] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:56.296324  7847 raft_consensus.cc:3060] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Advancing to term 17
W20260709 14:52:56.300604 13070 log.cc:927] Time spent T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.136s	user 0.001s	sys 0.000s
I20260709 14:52:56.301620 13073 raft_consensus.cc:493] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:56.297060 13056 raft_consensus.cc:2749] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 14:52:56.305895  7744 leader_election.cc:304] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:56.281136 12970 raft_consensus.cc:2749] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 14:52:56.182425 12878 raft_consensus.cc:515] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:56.312155  7744 leader_election.cc:304] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:56.313827  7744 leader_election.cc:304] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:56.285882 12920 raft_consensus.cc:2749] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 14:52:56.284279 12919 leader_election.cc:290] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:56.272617 13050 consensus_queue.cc:1048] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 14:52:56.321820  7847 raft_consensus.cc:2468] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 17.
I20260709 14:52:56.288854 13065 raft_consensus.cc:740] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:52:56.302693 13053 raft_consensus.cc:2749] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 14:52:56.326184  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:56.328624  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:56.329878  7847 raft_consensus.cc:2393] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 15: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:52:56.331046  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:56.331568  7849 raft_consensus.cc:1240] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 16. Current term is 17. Ops: []
I20260709 14:52:56.332562  7847 raft_consensus.cc:1240] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 17. Current term is 18. Ops: []
I20260709 14:52:56.313788 12940 raft_consensus.cc:2749] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 14:52:56.313501 12965 raft_consensus.cc:2749] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 14:52:56.346926  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:56.339447  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:56.328660 12970 raft_consensus.cc:2749] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 14:52:56.337762 13053 raft_consensus.cc:493] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:56.400710 13053 raft_consensus.cc:515] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:56.403677 13053 leader_election.cc:290] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:56.354501 13075 consensus_queue.cc:1048] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 14:52:56.364770 13007 raft_consensus.cc:493] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:52:56.324501 13073 raft_consensus.cc:515] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:56.303931 13072 raft_consensus.cc:515] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:56.302690 13051 raft_consensus.cc:515] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:56.390552 12957 raft_consensus.cc:493] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:56.392827  7919 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38516 (request call id 2751) took 1022 ms. Trace:
I20260709 14:52:56.394959  7920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38516 (request call id 2748) took 1026 ms. Trace:
I20260709 14:52:56.418105  7920 rpcz_store.cc:276] 0709 14:52:55.368402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:55.368564 (+   162us) service_pool.cc:224] Handling call
0709 14:52:55.368885 (+   321us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:52:56.113180 (+744295us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:56.394620 (+281440us) spinlock_profiling.cc:243] Waited 743 ms on lock 0x7b5400131ad4. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae8ee01 00007fb68ae8d83e 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2 00007fb6891c948c 00007fb6891c88c6
0709 14:52:56.394854 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1708614016}
I20260709 14:52:56.400004  7851 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49948 (request call id 3966) took 1051 ms. Trace:
I20260709 14:52:56.405308 13007 raft_consensus.cc:3060] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:52:56.354480 12993 consensus_queue.cc:1048] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.014s
I20260709 14:52:56.422277  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:56.417469  7919 rpcz_store.cc:276] 0709 14:52:55.370890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:55.371155 (+   265us) service_pool.cc:224] Handling call
0709 14:52:56.392526 (+1021371us) spinlock_profiling.cc:243] Waited 698 ms on lock 0x7b54001e5354. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae922fa 00007fb68fe53b17 00007fb6893ce6d4 00007fb6893ce662 00007fb6893ce591 00007fb6893ce50c 00007fb6893cd7c2 00007fb6891c948c 00007fb6891c88c6 00007fb6891c826f
0709 14:52:56.392741 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1605615360}
I20260709 14:52:56.346777 12879 consensus_queue.cc:1059] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.066s
I20260709 14:52:56.343464 12977 consensus_queue.cc:1059] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.068s
I20260709 14:52:56.419098  7851 rpcz_store.cc:276] 0709 14:52:55.348087 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:55.348301 (+   214us) service_pool.cc:224] Handling call
0709 14:52:55.348660 (+   359us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:52:55.349070 (+   410us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:52:55.349100 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:52:55.349612 (+   512us) log.cc:844] Serialized 26 byte log entry
0709 14:52:56.108476 (+758864us) spinlock_profiling.cc:243] Waited 1.53 ms on lock 0x7b1800270160. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb690c69de1 00007fb690c765b1 00007fb687d83e07 00007fb690bdeab9 00007fb687da069b 00007fb687d9e93f 00007fb687da0c02 00007fb68aa2820b 00007fb68aa2dd23 00007fb68aa2e0d1 00007fb68ae49a0f
0709 14:52:56.273139 (+164663us) raft_consensus.cc:1645] Marking committed up to 7
0709 14:52:56.273189 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:56.277784 (+  4595us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:52:56.399659 (+121875us) raft_consensus.cc:1685] finished
0709 14:52:56.399681 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:56.399933 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9658,"raft.queue_time_us":966,"raft.run_cpu_time_us":253,"raft.run_wall_time_us":83998,"spinlock_wait_cycles":3508992,"thread_start_us":164399,"threads_started":1,"wal-append.queue_time_us":869461}
I20260709 14:52:56.429934  7848 raft_consensus.cc:1275] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 14:52:56.428223 13080 log.cc:927] Time spent T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.056s	user 0.004s	sys 0.000s
I20260709 14:52:56.444182  7854 raft_consensus.cc:1275] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 14:52:56.352754 13023 raft_consensus.cc:515] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:56.449311 13072 leader_election.cc:290] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:56.450346 12879 raft_consensus.cc:3055] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 LEADER]: Stepping down as leader of term 15
I20260709 14:52:56.451155 12977 raft_consensus.cc:3055] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 LEADER]: Stepping down as leader of term 15
I20260709 14:52:56.400084 12916 consensus_queue.cc:1059] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 16.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
W20260709 14:52:56.429404 13082 log.cc:927] Time spent T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.063s	user 0.005s	sys 0.002s
I20260709 14:52:56.428153 12957 raft_consensus.cc:515] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:56.459586 13051 leader_election.cc:290] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:56.455579 12879 raft_consensus.cc:740] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:52:56.469291 12879 consensus_queue.cc:260] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:56.469921 12916 raft_consensus.cc:3055] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 14:52:56.460639 12977 raft_consensus.cc:740] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:52:56.428742 13013 raft_consensus.cc:493] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:56.471065 12916 raft_consensus.cc:740] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:56.471508 13013 raft_consensus.cc:515] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:56.472221 12916 consensus_queue.cc:260] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:56.473783 13013 leader_election.cc:290] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:56.467044 12957 leader_election.cc:290] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:52:56.464200 13081 log.cc:927] Time spent T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 14:52:56.470732 12879 raft_consensus.cc:3060] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Advancing to term 16
W20260709 14:52:56.483805  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 170115us
I20260709 14:52:56.488219  7744 leader_election.cc:304] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:56.490581  7744 leader_election.cc:304] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:56.443900 13019 consensus_queue.cc:1048] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 14:52:56.493059  7744 leader_election.cc:304] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:56.492997 13051 raft_consensus.cc:2749] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 14:52:56.504510  7919 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
mode: GRACEFUL
new_leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:48676
I20260709 14:52:56.505455  7919 raft_consensus.cc:606] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 LEADER]: Received request to transfer leadership to TS 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:52:56.502707 12916 raft_consensus.cc:3060] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Advancing to term 17
W20260709 14:52:56.508773 13077 log.cc:927] Time spent T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.213s	user 0.001s	sys 0.001s
I20260709 14:52:56.509438 13051 raft_consensus.cc:493] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:56.510090 13051 raft_consensus.cc:515] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:56.512554 13051 leader_election.cc:290] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:52:56.518304  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:56.489261 13053 raft_consensus.cc:2749] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 14:52:56.519133  7744 leader_election.cc:304] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:56.520291  7894 leader_election.cc:304] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
W20260709 14:52:56.527165  7893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:56.529371  7744 leader_election.cc:304] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:56.527202 13002 raft_consensus.cc:2804] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 14:52:56.521075 12724 raft_consensus.cc:2749] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 14:52:56.522514 13051 raft_consensus.cc:493] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:52:56.592757  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 63542us
I20260709 14:52:56.593758  7744 leader_election.cc:304] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:56.490288 12977 consensus_queue.cc:260] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:56.598155  7919 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
mode: GRACEFUL
new_leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:48676
I20260709 14:52:56.527258 12957 consensus_queue.cc:1059] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.008s
I20260709 14:52:56.528697 12970 raft_consensus.cc:2749] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 14:52:56.598958  7919 raft_consensus.cc:606] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 LEADER]: Received request to transfer leadership to TS 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:56.598649 12965 raft_consensus.cc:2749] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 14:52:56.591144 13002 raft_consensus.cc:697] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:56.619742  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:56.603607  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:56.620803  7772 raft_consensus.cc:2410] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for term 18 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 14:52:56.601950  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:56.610077  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:56.604204  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:56.624148  7777 raft_consensus.cc:3060] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Advancing to term 18
I20260709 14:52:56.626878  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:56.627610  7779 raft_consensus.cc:3060] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:52:56.624720  7773 raft_consensus.cc:2376] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 12. Re-sending same reply.
I20260709 14:52:56.629086  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:56.596921 13050 raft_consensus.cc:2749] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 14:52:56.632043  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:56.536695 12997 consensus_queue.cc:1059] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.086s
I20260709 14:52:56.634979  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:56.531512 13053 consensus_queue.cc:1059] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.088s
I20260709 14:52:56.633803  7770 raft_consensus.cc:3060] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Advancing to term 16
I20260709 14:52:56.597700 12975 raft_consensus.cc:493] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:56.528309 12996 raft_consensus.cc:515] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:56.647332  7775 raft_consensus.cc:1275] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 9. (term mismatch)
I20260709 14:52:56.647913  7775 pending_rounds.cc:85] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed: Aborting all ops after (but not including) 8
I20260709 14:52:56.648156  7775 pending_rounds.cc:107] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 14:52:56.648445  7775 raft_consensus.cc:2889] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:52:56.641558  7772 raft_consensus.cc:2393] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 16: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:52:56.650274  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:56.650995  7775 raft_consensus.cc:3060] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Advancing to term 16
I20260709 14:52:56.653273  7779 raft_consensus.cc:2468] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 12.
I20260709 14:52:56.654671  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:56.655654  7779 raft_consensus.cc:3060] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Advancing to term 19
I20260709 14:52:56.622648 12724 consensus_queue.cc:1048] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 14:52:56.661630 13002 consensus_queue.cc:237] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:56.665771  7771 raft_consensus.cc:1275] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 11. (term mismatch)
I20260709 14:52:56.666040  7777 raft_consensus.cc:2468] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 18.
I20260709 14:52:56.672875  7771 pending_rounds.cc:85] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed: Aborting all ops after (but not including) 10
I20260709 14:52:56.673540  7771 pending_rounds.cc:107] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed: Aborting uncommitted NO_OP operation due to leader change: 16.11
I20260709 14:52:56.673975  7771 raft_consensus.cc:2889] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:52:56.600966 13084 raft_consensus.cc:493] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:56.679769  7775 raft_consensus.cc:2468] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 16.
I20260709 14:52:56.680335  7776 raft_consensus.cc:1275] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 14:52:56.630376 12862 raft_consensus.cc:493] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:56.684140  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:56.676070  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:56.630705 12977 raft_consensus.cc:3060] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Advancing to term 16
I20260709 14:52:56.699517 12996 leader_election.cc:290] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 17 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:56.707398 13065 consensus_queue.cc:260] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:56.708626 13065 raft_consensus.cc:3060] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Advancing to term 19
I20260709 14:52:56.668066 12975 raft_consensus.cc:515] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:56.712849 12975 leader_election.cc:290] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:56.683977 12990 consensus_queue.cc:1048] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.007s
I20260709 14:52:56.689424 12724 raft_consensus.cc:3055] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 LEADER]: Stepping down as leader of term 14
I20260709 14:52:56.689846 12862 raft_consensus.cc:515] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:56.667891 13073 leader_election.cc:290] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:56.667445 13023 leader_election.cc:290] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:56.762102  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:56.714051 12878 leader_election.cc:290] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 17 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:56.717355  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:56.765569  7775 raft_consensus.cc:2468] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 15.
I20260709 14:52:56.767378  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:56.768268  7775 raft_consensus.cc:3060] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Advancing to term 16
I20260709 14:52:56.675956  7779 raft_consensus.cc:2468] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 19.
I20260709 14:52:56.770624  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:56.771449  7779 raft_consensus.cc:3060] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Advancing to term 14
I20260709 14:52:56.723100  7770 raft_consensus.cc:2468] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 16.
I20260709 14:52:56.773500  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:56.726724  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:56.774592  7850 raft_consensus.cc:2468] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 14.
I20260709 14:52:56.728634  7847 raft_consensus.cc:1275] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 14:52:56.731577  7845 raft_consensus.cc:1240] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 16. Current term is 17. Ops: []
I20260709 14:52:56.734090  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:56.595678 13051 raft_consensus.cc:515] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:56.736948  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
W20260709 14:52:56.750025  7894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:56.776409  7772 raft_consensus.cc:3060] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Advancing to term 17
I20260709 14:52:56.732276 13053 raft_consensus.cc:493] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:56.780390  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:56.782145  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:56.735821 12724 raft_consensus.cc:740] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:52:56.795758  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:56.792810  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:56.797529  7774 raft_consensus.cc:2468] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 15.
I20260709 14:52:56.793810  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:56.793711  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:56.798779  7776 raft_consensus.cc:3060] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Advancing to term 16
I20260709 14:52:56.799923  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:56.796615  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:56.801621  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:56.803915  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:56.804648  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258d6c2dda954bf5b65930fde8ecb9f3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:56.805634  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:56.805769  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:56.807086  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:56.807729  7928 raft_consensus.cc:2468] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 17.
I20260709 14:52:56.811794  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:56.804829  7922 raft_consensus.cc:2468] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 16.
I20260709 14:52:56.807410  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:56.817121 12878 raft_consensus.cc:493] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:56.817830 12878 raft_consensus.cc:515] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:56.819957 12878 leader_election.cc:290] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:56.786235 13053 raft_consensus.cc:515] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:56.821635 12958 raft_consensus.cc:3055] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 14:52:56.825969 12958 raft_consensus.cc:740] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:56.819782 12862 leader_election.cc:290] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:56.826747  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:56.827005 12958 consensus_queue.cc:260] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:56.827659  7924 raft_consensus.cc:2393] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 16: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:52:56.828414 12958 raft_consensus.cc:3060] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 14:52:56.830698 13051 leader_election.cc:290] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:56.831753  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
W20260709 14:52:56.825562  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:56.836333  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:56.730571 13084 raft_consensus.cc:515] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:56.827337 13053 leader_election.cc:290] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:56.793434 12804 raft_consensus.cc:493] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:56.852736  7926 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
mode: GRACEFUL
new_leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:48676
I20260709 14:52:56.840631  7928 raft_consensus.cc:1240] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 14:52:56.861550  7926 raft_consensus.cc:606] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 LEADER]: Received request to transfer leadership to TS 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:52:56.866475  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:56.873665  7893 leader_election.cc:304] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:56.880590  7779 raft_consensus.cc:2468] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 14.
I20260709 14:52:56.882477  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:56.885641  7770 raft_consensus.cc:2468] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 15.
I20260709 14:52:56.848189  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
W20260709 14:52:56.857724  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:56.896472  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:56.889338  7776 raft_consensus.cc:2468] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 16.
I20260709 14:52:56.897838  7920 raft_consensus.cc:1275] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 14:52:56.858421  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:56.900369  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:56.901010  7771 raft_consensus.cc:2468] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 16.
I20260709 14:52:56.901317  7776 raft_consensus.cc:3060] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Advancing to term 17
I20260709 14:52:56.903518  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:56.854461  7772 raft_consensus.cc:2468] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 17.
I20260709 14:52:56.906834  7779 raft_consensus.cc:2468] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 15.
I20260709 14:52:56.908445  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:56.909684  7772 raft_consensus.cc:2468] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 15.
I20260709 14:52:56.907795  7771 raft_consensus.cc:2468] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 16.
I20260709 14:52:56.910102  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:56.913422  7779 raft_consensus.cc:2468] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 15.
I20260709 14:52:56.924322  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:56.926695  7779 raft_consensus.cc:3060] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Advancing to term 18
I20260709 14:52:56.854705 13084 leader_election.cc:290] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:56.893191  7775 raft_consensus.cc:2468] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 16.
W20260709 14:52:56.917827  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 44404.7us
I20260709 14:52:56.940456  7893 leader_election.cc:304] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:52:56.916366  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 43980.8us
I20260709 14:52:56.895181 12965 raft_consensus.cc:493] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:56.942724  7744 leader_election.cc:304] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:52:56.945943  7744 leader_election.cc:304] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:56.947113  7893 leader_election.cc:304] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:56.947258  7744 leader_election.cc:304] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:56.951929  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:56.952795  7775 raft_consensus.cc:2468] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 14.
I20260709 14:52:56.953734  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:56.954088 12965 raft_consensus.cc:515] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:56.956516 12965 leader_election.cc:290] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:56.957304 12479 raft_consensus.cc:2749] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 14:52:56.959184  7819 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:52:56.962193 13007 consensus_meta.cc:287] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0: Time spent flushing consensus metadata: real 0.518s	user 0.003s	sys 0.009s
I20260709 14:52:56.962857 13007 raft_consensus.cc:515] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:56.928718 12875 raft_consensus.cc:2749] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 14:52:56.851150 12724 consensus_queue.cc:260] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:56.967128 12904 raft_consensus.cc:2804] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 14:52:56.967797 12904 raft_consensus.cc:493] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:56.968156 12904 raft_consensus.cc:3060] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Advancing to term 18
I20260709 14:52:56.969514 13084 raft_consensus.cc:2749] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 14:52:56.971794  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:56.973235  7774 raft_consensus.cc:1275] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 14:52:56.850605 12804 raft_consensus.cc:515] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:56.988034  7819 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:56.990097  7923 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
mode: GRACEFUL
new_leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:48676
W20260709 14:52:56.989284  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 47247.4us
I20260709 14:52:56.988369 12879 raft_consensus.cc:493] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:52:57.000442  7819 leader_election.cc:304] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:57.005735  7819 leader_election.cc:304] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:56.987891 12990 raft_consensus.cc:2749] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 14:52:56.962247 12921 raft_consensus.cc:3055] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 14:52:57.017629 12962 raft_consensus.cc:2804] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 14:52:57.018594 12962 raft_consensus.cc:493] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:57.019095 12962 raft_consensus.cc:3060] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Advancing to term 16
I20260709 14:52:57.012631 12879 raft_consensus.cc:515] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:57.024564  7893 leader_election.cc:304] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:57.014395 12921 raft_consensus.cc:740] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
W20260709 14:52:57.026499  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 79313.4us
I20260709 14:52:57.026934 12921 consensus_queue.cc:260] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:57.027688  7744 leader_election.cc:304] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:56.989760 12805 consensus_queue.cc:1048] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 14:52:57.012590  7819 leader_election.cc:304] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:56.996064 13007 leader_election.cc:290] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 9 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:57.027915 12990 consensus_queue.cc:1048] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.006s
I20260709 14:52:57.036387 13053 raft_consensus.cc:2749] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 14:52:57.032915 12921 raft_consensus.cc:3060] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 14:52:57.037707  7744 leader_election.cc:304] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:52:57.043074  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 45494.1us
I20260709 14:52:57.043383  7744 leader_election.cc:304] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:57.043547  7893 leader_election.cc:304] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:57.045655  7744 leader_election.cc:304] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:57.051029  7744 leader_election.cc:304] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:52:57.058693  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:57.054684  7776 raft_consensus.cc:2468] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 17.
I20260709 14:52:57.055027  7819 leader_election.cc:304] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:57.038515 12913 raft_consensus.cc:2804] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 14:52:57.064646  7894 leader_election.cc:304] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:57.064971  7893 leader_election.cc:304] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:57.061388  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:57.044448 13084 raft_consensus.cc:2764] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 14:52:57.046705 13056 raft_consensus.cc:2749] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 14:52:57.071060  7893 leader_election.cc:304] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:57.085804  7893 leader_election.cc:304] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:57.076500 11963 consensus_queue.cc:1048] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 14:52:57.064369 13073 raft_consensus.cc:2804] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 14:52:57.055570 12970 raft_consensus.cc:493] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:52:57.065552 13090 log.cc:927] Time spent T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260709 14:52:57.075037 12916 raft_consensus.cc:2749] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 14:52:57.078307 12904 raft_consensus.cc:515] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:57.083310 12913 raft_consensus.cc:697] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:57.079145  7776 raft_consensus.cc:2468] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 12.
I20260709 14:52:57.057873 12996 raft_consensus.cc:2804] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 14:52:57.099323  7893 leader_election.cc:304] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:57.115898  7893 leader_election.cc:304] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:57.077821 12862 raft_consensus.cc:2804] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 14:52:57.118666 12862 raft_consensus.cc:493] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:57.119139 12862 raft_consensus.cc:3060] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 14:52:57.120283 11963 raft_consensus.cc:993] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0: : Instructing follower 3876b8ee8d744cb18e91d97aae93b1ac to start an election
I20260709 14:52:57.120739 11963 raft_consensus.cc:1081] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 LEADER]: Signalling peer 3876b8ee8d744cb18e91d97aae93b1ac to start an election
I20260709 14:52:57.119215 13007 raft_consensus.cc:2804] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 14:52:57.122169 13007 raft_consensus.cc:697] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:57.098471 13073 raft_consensus.cc:493] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:57.087787 13000 raft_consensus.cc:2804] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 14:52:57.099545 13002 raft_consensus.cc:2804] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 14:52:57.128474 13002 raft_consensus.cc:493] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:57.128906 13002 raft_consensus.cc:3060] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 14:52:57.124658  7775 raft_consensus.cc:2393] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 18: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
W20260709 14:52:57.133860 13091 log.cc:927] Time spent T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
I20260709 14:52:57.139235  7893 leader_election.cc:304] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:57.124742 13007 consensus_queue.cc:237] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:57.127843 13000 raft_consensus.cc:493] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:57.083005 12998 consensus_queue.cc:1059] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.031s
I20260709 14:52:57.081830 12922 raft_consensus.cc:2749] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 14:52:57.145437  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:57.106089 12970 raft_consensus.cc:515] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:57.137925 13073 raft_consensus.cc:3060] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Advancing to term 17
I20260709 14:52:57.154460  7893 leader_election.cc:304] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:57.142534 12916 raft_consensus.cc:2804] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 14:52:57.165108  7851 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463"
dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:49946
I20260709 14:52:57.165752  7851 raft_consensus.cc:493] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:52:57.166129  7851 raft_consensus.cc:3060] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:52:57.169966  7893 leader_election.cc:304] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:57.138484 13017 consensus_queue.cc:1048] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 14:52:57.156141 13000 raft_consensus.cc:3060] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Advancing to term 16
I20260709 14:52:57.126319  7779 raft_consensus.cc:2468] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 18.
I20260709 14:52:57.159598 12997 raft_consensus.cc:2804] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 14:52:57.145008 13023 consensus_queue.cc:1048] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 14:52:57.169305 12875 raft_consensus.cc:3055] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 14:52:57.222597  7851 raft_consensus.cc:515] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:57.174634 12998 raft_consensus.cc:2804] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 14:52:57.163956 12879 leader_election.cc:290] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:57.195585 12904 leader_election.cc:290] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:57.216475  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
W20260709 14:52:57.218484  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:57.226776  7776 raft_consensus.cc:1240] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 14:52:57.169646 12804 leader_election.cc:290] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:52:57.254457  7893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:57.270076  7851 leader_election.cc:290] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 11 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:52:57.270344  7893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:57.183904 12990 raft_consensus.cc:2804] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 14:52:57.265936  7776 raft_consensus.cc:1240] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 16. Current term is 17. Ops: [15.7-16.8]
I20260709 14:52:57.279466  7779 raft_consensus.cc:1275] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 14:52:57.179929 12916 raft_consensus.cc:697] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:57.253724 12997 raft_consensus.cc:697] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
W20260709 14:52:57.277514  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 222608us
I20260709 14:52:57.283551  7776 raft_consensus.cc:1240] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 15. Current term is 16. Ops: []
I20260709 14:52:57.249855 12875 raft_consensus.cc:740] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
W20260709 14:52:57.268560  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 217701us
I20260709 14:52:57.271824 12805 raft_consensus.cc:2749] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 14:52:57.300238  7744 leader_election.cc:304] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:57.278694 12990 raft_consensus.cc:493] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:57.305563  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:57.186965 12913 consensus_queue.cc:237] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:57.314432 12970 leader_election.cc:290] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:57.277025 12998 raft_consensus.cc:697] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:57.315560 12997 consensus_queue.cc:237] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:57.317797 12916 consensus_queue.cc:237] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:57.321798  7923 raft_consensus.cc:606] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Received request to transfer leadership to TS 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:52:57.322090 12862 raft_consensus.cc:515] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:57.326241 13097 log.cc:927] Time spent T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 14:52:57.325081  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:57.326087 13002 raft_consensus.cc:515] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:57.367412 13002 leader_election.cc:290] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:52:57.326812 13096 log.cc:927] Time spent T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.121s	user 0.000s	sys 0.001s
I20260709 14:52:57.328027  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:57.358974 13109 consensus_queue.cc:1059] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.014s
I20260709 14:52:57.329015 12875 consensus_queue.cc:260] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:57.370090 13109 raft_consensus.cc:3055] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 LEADER]: Stepping down as leader of term 13
I20260709 14:52:57.330574  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:57.370530 13109 raft_consensus.cc:740] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:52:57.371417 13109 consensus_queue.cc:260] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:57.371673  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:57.372323  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:57.372648 13109 raft_consensus.cc:3060] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Advancing to term 14
I20260709 14:52:57.334693  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:57.369637  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:57.373771  7847 raft_consensus.cc:2393] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 17: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:52:57.370537 12875 raft_consensus.cc:3060] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 14:52:57.375906 12998 consensus_queue.cc:237] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:57.378696 12862 leader_election.cc:290] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:57.383780 12962 raft_consensus.cc:515] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:57.352486  7819 leader_election.cc:400] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 16 election: Vote denied by peer 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785) with higher term. Message: Invalid argument: T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 16. Current term is 17.
I20260709 14:52:57.352803  7776 raft_consensus.cc:1240] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 17. Current term is 18. Ops: []
I20260709 14:52:57.395854  7819 leader_election.cc:403] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 14:52:57.354415  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:57.357661  7923 raft_consensus.cc:614] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 14:52:57.359309  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:57.323627 13000 raft_consensus.cc:515] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:57.365370  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
W20260709 14:52:57.333235  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:57.334622 13110 raft_consensus.cc:493] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
W20260709 14:52:57.356130 13098 log.cc:927] Time spent T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.196s	user 0.001s	sys 0.000s
I20260709 14:52:57.335865 12878 raft_consensus.cc:493] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:52:57.373099  7920 raft_consensus.cc:2468] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 15.
I20260709 14:52:57.351332 12990 raft_consensus.cc:3060] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 14:52:57.398125  7851 raft_consensus.cc:2468] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 15.
I20260709 14:52:57.401432  7927 raft_consensus.cc:2410] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for term 17 because replica has last-logged OpId of term: 16 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 7.
W20260709 14:52:57.405380  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 53047.6us
I20260709 14:52:57.410296  7846 raft_consensus.cc:1240] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260709 14:52:57.357406 12879 consensus_queue.cc:1059] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.049s
I20260709 14:52:57.412458 12879 raft_consensus.cc:3055] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 LEADER]: Stepping down as leader of term 15
I20260709 14:52:57.413096 12879 raft_consensus.cc:740] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:52:57.414218 12879 consensus_queue.cc:260] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:57.415725 12879 raft_consensus.cc:3060] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Advancing to term 16
I20260709 14:52:57.417636 12940 raft_consensus.cc:2749] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 14:52:57.418766 13000 leader_election.cc:290] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 16 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:57.406239 13106 raft_consensus.cc:2749] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785) with higher term. Message: Invalid argument: T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 16. Current term is 17.
I20260709 14:52:57.421622 12940 raft_consensus.cc:493] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:52:57.428097 13106 consensus_queue.cc:1048] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 14:52:57.428340 12996 raft_consensus.cc:493] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:57.429587 12996 raft_consensus.cc:3060] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Advancing to term 16
I20260709 14:52:57.422377 13053 raft_consensus.cc:2749] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 14:52:57.436839  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:57.406550 12862 raft_consensus.cc:493] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:52:57.466686  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 166577us
W20260709 14:52:57.469024  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:57.469087  7744 leader_election.cc:304] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:52:57.422005 12904 raft_consensus.cc:493] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:57.485479  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:57.487665  7919 raft_consensus.cc:1240] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 LEADER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 14:52:57.489683  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:57.491595  7924 raft_consensus.cc:1240] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 8. Current term is 9. Ops: []
I20260709 14:52:57.492197  7927 raft_consensus.cc:1240] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 14:52:57.433346 12977 consensus_queue.cc:1059] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.062s
I20260709 14:52:57.493991  7920 raft_consensus.cc:1275] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 14:52:57.494292  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:57.408756 12878 raft_consensus.cc:515] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:57.501704  7779 raft_consensus.cc:1275] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 14:52:57.466220 13109 raft_consensus.cc:493] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:52:57.483815 13065 raft_consensus.cc:493] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:52:57.462137 12940 raft_consensus.cc:515] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:57.481379 13107 raft_consensus.cc:2749] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 14:52:57.523375  7779 raft_consensus.cc:1275] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 14:52:57.406389 13110 raft_consensus.cc:515] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:57.547592  7819 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:57.552347  7770 raft_consensus.cc:1275] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
W20260709 14:52:57.557602  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:52:57.610342  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:57.610411 13110 leader_election.cc:290] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:57.529055  7777 raft_consensus.cc:1275] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 14:52:57.570396  7676 catalog_manager.cc:5697] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:52:57.487519 13108 consensus_queue.cc:1059] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.106s
I20260709 14:52:57.614544 13108 raft_consensus.cc:3055] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 LEADER]: Stepping down as leader of term 14
W20260709 14:52:57.593405 13116 log.cc:927] Time spent T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
W20260709 14:52:57.597676 13081 log.cc:927] Time spent T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 14:52:57.486320 13073 raft_consensus.cc:515] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:57.474364 12862 raft_consensus.cc:515] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:57.531361 13084 raft_consensus.cc:2804] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 14:52:57.607626  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:57.620325  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:57.677692  7924 raft_consensus.cc:2468] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 15.
I20260709 14:52:57.679174  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:57.680694  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:57.620471  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
W20260709 14:52:57.537068 13103 log.cc:927] Time spent T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.229s	user 0.002s	sys 0.000s
I20260709 14:52:57.594971 13050 raft_consensus.cc:493] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9418391fa82a42c79c6cad13ba91d964)
I20260709 14:52:57.621110  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: true dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:57.685338  7925 raft_consensus.cc:3055] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 14:52:57.685747  7925 raft_consensus.cc:740] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:57.619979  7770 raft_consensus.cc:1240] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 14:52:57.687837  7770 raft_consensus.cc:1275] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 14:52:57.621480  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:57.490943 12904 raft_consensus.cc:515] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:57.521865 13109 raft_consensus.cc:515] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:57.627571  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:57.631033  7923 raft_consensus.cc:1275] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 14:52:57.637470  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:57.606379 13065 raft_consensus.cc:515] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:57.606752 12962 leader_election.cc:290] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 16 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:57.656625 12878 leader_election.cc:290] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:52:57.657454 13098 log.cc:927] Time spent T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 14:52:57.663369 13073 leader_election.cc:290] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 17 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:57.664062  7854 raft_consensus.cc:1240] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 16. Current term is 17. Ops: []
I20260709 14:52:57.624188 13053 raft_consensus.cc:493] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:57.666461 12940 leader_election.cc:290] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:52:57.802338  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 330187us
I20260709 14:52:57.666815  7772 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 3561) took 1044 ms. Trace:
I20260709 14:52:57.667596  7779 raft_consensus.cc:1240] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 14:52:57.668335 12862 leader_election.cc:290] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:57.690977  7922 raft_consensus.cc:2393] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 15: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:52:57.691891  7919 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
mode: GRACEFUL
new_leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:48676
I20260709 14:52:57.803350  7772 rpcz_store.cc:276] 0709 14:52:56.622092 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:56.928339 (+306247us) service_pool.cc:224] Handling call
0709 14:52:56.929560 (+  1221us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:52:56.930019 (+   459us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 14:52:57.190046 (+260027us) log.cc:844] Serialized 14 byte log entry
0709 14:52:57.475269 (+285223us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:52:57.484934 (+  9665us) log.cc:844] Serialized 26 byte log entry
0709 14:52:57.485088 (+   154us) raft_consensus.cc:1645] Marking committed up to 11
0709 14:52:57.515507 (+ 30419us) log.cc:844] Serialized 14 byte log entry
0709 14:52:57.515761 (+   254us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:57.515866 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:52:57.666554 (+150688us) raft_consensus.cc:1685] finished
0709 14:52:57.666586 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:57.666740 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":71330,"prepare.queue_time_us":120939,"prepare.run_cpu_time_us":77,"prepare.run_wall_time_us":79,"raft.queue_time_us":131404,"raft.run_cpu_time_us":431,"raft.run_wall_time_us":47614,"thread_start_us":368292,"threads_started":2,"wal-append.queue_time_us":235228}
I20260709 14:52:57.692701  7770 raft_consensus.cc:1240] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 14:52:57.697425  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:57.699360  7851 raft_consensus.cc:1275] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 14:52:57.615072 13108 raft_consensus.cc:740] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:52:57.725694  7775 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 3585) took 1047 ms. Trace:
W20260709 14:52:57.739297  7819 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.101.65:40587 timed out after 2.247s (SENT) [suppressed 26 similar messages]
I20260709 14:52:57.703984  7852 raft_consensus.cc:1240] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 15. Current term is 16. Ops: []
W20260709 14:52:57.737668  7893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:52:57.794626  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:57.794839  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:57.798635  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:57.824385  7846 raft_consensus.cc:3060] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Advancing to term 16
I20260709 14:52:57.811602  7853 raft_consensus.cc:1240] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 10. Current term is 11. Ops: []
I20260709 14:52:57.726080  7925 consensus_queue.cc:260] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:57.829701  7925 raft_consensus.cc:3060] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Advancing to term 11
W20260709 14:52:57.814448  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 345412us
I20260709 14:52:57.825992  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783e4874513449ef9084b833f188a6d3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:57.820376  7775 rpcz_store.cc:276] 0709 14:52:56.678219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:57.482940 (+804721us) service_pool.cc:224] Handling call
0709 14:52:57.483288 (+   348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:52:57.725001 (+241713us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 14:52:57.725152 (+   151us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:52:57.725225 (+    73us) raft_consensus.cc:1645] Marking committed up to 5
0709 14:52:57.725301 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:57.725410 (+   109us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:57.725607 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12066,"raft.queue_time_us":110715,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":116,"thread_start_us":190978,"threads_started":1}
W20260709 14:52:57.832929  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:57.817662  7919 raft_consensus.cc:606] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 LEADER]: Received request to transfer leadership to TS 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:52:57.686697 13084 raft_consensus.cc:493] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:57.839581  7926 raft_consensus.cc:1240] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 LEADER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 15. Current term is 16. Ops: []
I20260709 14:52:57.824510  7927 raft_consensus.cc:2468] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 17.
I20260709 14:52:57.847393  7770 raft_consensus.cc:1275] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 14:52:57.841107  7775 raft_consensus.cc:1240] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 15. Current term is 16. Ops: [15.9-15.9]
W20260709 14:52:57.844946  7744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:57.849514  7770 raft_consensus.cc:1275] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 14:52:57.852283  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:57.854249  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
W20260709 14:52:57.916190  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:57.854597  7850 raft_consensus.cc:2410] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 14:52:57.931918  6549 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 14:52:58.026309  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 221524us
I20260709 14:52:57.933455  7920 raft_consensus.cc:2468] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 17.
I20260709 14:52:57.934015  7775 raft_consensus.cc:1240] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 17. Current term is 18. Ops: []
I20260709 14:52:58.028199  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:57.934455  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:58.029031  7770 raft_consensus.cc:2468] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 13.
I20260709 14:52:57.936375  7779 raft_consensus.cc:1240] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 15. Current term is 16. Ops: [15.9-15.9]
W20260709 14:52:57.943274  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:58.030308  7779 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37136 (request call id 2779) took 1139 ms. Trace:
I20260709 14:52:57.829882 13000 raft_consensus.cc:493] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:57.973767  7925 raft_consensus.cc:2468] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 11.
I20260709 14:52:57.837612 13123 raft_consensus.cc:493] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:57.846331 13056 raft_consensus.cc:493] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:58.045825 13056 raft_consensus.cc:515] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:57.988715  7778 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 3554) took 1368 ms. Trace:
I20260709 14:52:58.049479  7778 rpcz_store.cc:276] 0709 14:52:56.620176 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:56.620366 (+   190us) service_pool.cc:224] Handling call
0709 14:52:56.620698 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:52:56.620938 (+   240us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 14:52:56.854729 (+233791us) log.cc:844] Serialized 14 byte log entry
0709 14:52:57.063006 (+208277us) log.cc:844] Serialized 14 byte log entry
0709 14:52:57.413310 (+350304us) spinlock_profiling.cc:243] Waited 8.88 ms on lock 0x7b180023d640. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb690c69de1 00007fb690c765b1 00007fb687d1bc0a 00007fb69145b219 00007fb687da3a40 00007fb687d9e4e4 00007fb687d9e455 00007fb68ae86060 00007fb68ae98716 00007fb68aea9287 00007fb68aea9208
0709 14:52:57.519058 (+105748us) log.cc:844] Serialized 14 byte log entry
0709 14:52:57.982135 (+463077us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:52:57.982204 (+    69us) raft_consensus.cc:1645] Marking committed up to 11
0709 14:52:57.982283 (+    79us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:57.982362 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:57.988624 (+  6262us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":369769,"prepare.queue_time_us":388369,"prepare.run_cpu_time_us":153,"prepare.run_wall_time_us":71887,"raft.queue_time_us":436004,"raft.run_cpu_time_us":265,"raft.run_wall_time_us":7733,"spinlock_wait_cycles":20418816,"thread_start_us":975479,"threads_started":4,"wal-append.queue_time_us":271399}
I20260709 14:52:58.052057  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:58.052811  7778 raft_consensus.cc:3060] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Advancing to term 17
W20260709 14:52:57.989306  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 250053us
I20260709 14:52:58.054863 12904 leader_election.cc:290] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:52:57.993976  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 171015us
I20260709 14:52:58.056828 13123 raft_consensus.cc:515] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:58.057510 12956 raft_consensus.cc:493] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:58.058176 12956 raft_consensus.cc:515] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:57.727108 13050 raft_consensus.cc:515] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:52:58.062579 13050 leader_election.cc:290] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68:42321)
W20260709 14:52:58.063426 12990 consensus_meta.cc:287] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent flushing consensus metadata: real 0.641s	user 0.010s	sys 0.003s
I20260709 14:52:58.064020 12990 raft_consensus.cc:515] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:58.065194  7928 raft_consensus.cc:1240] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 14:52:58.065227 12956 leader_election.cc:290] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:52:58.066350  7893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:58.033466  7745 leader_election.cc:304] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:58.052078  7771 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 3562) took 1429 ms. Trace:
I20260709 14:52:58.071208  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:58.072036  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:58.016710  7676 catalog_manager.cc:5697] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 15 to 16, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 16 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:52:57.929445 13084 raft_consensus.cc:3060] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Advancing to term 16
I20260709 14:52:58.076289  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:57.989012 12965 raft_consensus.cc:2749] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 14:52:58.035346 13065 leader_election.cc:290] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:58.035786 12724 raft_consensus.cc:3060] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Advancing to term 15
I20260709 14:52:58.030841  7779 rpcz_store.cc:276] 0709 14:52:56.891382 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:57.838927 (+947545us) service_pool.cc:224] Handling call
0709 14:52:57.936104 (+ 97177us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:52:58.030015 (+ 93911us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:58.030249 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 14:52:58.038827  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:58.040534  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:58.042384  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: true dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:58.044610 13133 raft_consensus.cc:493] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:58.089543  7770 raft_consensus.cc:3060] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:52:58.044996 13109 leader_election.cc:290] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:57.816313 13053 raft_consensus.cc:515] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:58.048938 13056 leader_election.cc:290] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:58.004156  7846 raft_consensus.cc:2468] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 16.
I20260709 14:52:58.074076  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:58.070777  7771 rpcz_store.cc:276] 0709 14:52:56.622329 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:56.921231 (+298902us) service_pool.cc:224] Handling call
0709 14:52:56.921877 (+   646us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:52:56.922314 (+   437us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:52:56.922347 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:52:56.953524 (+ 31177us) log.cc:844] Serialized 26 byte log entry
0709 14:52:57.243329 (+289805us) raft_consensus.cc:1645] Marking committed up to 8
0709 14:52:57.264690 (+ 21361us) log.cc:844] Serialized 14 byte log entry
0709 14:52:57.420309 (+155619us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:57.420416 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:52:57.536109 (+115693us) spinlock_profiling.cc:243] Waited 20.1 ms on lock 0x7b4400022b4c. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb687c29db1 00007fb687cc7c85 00007fb687cc86a2 00007fb68aa3a1db 00007fb68aa35aaf 00007fb68aa2986e 00007fb68aa28bb6 00007fb68aa287d8 00007fb68aa32221 00007fb68aa321d9 00007fb68aa32169
0709 14:52:58.036684 (+500575us) raft_consensus.cc:1685] finished
0709 14:52:58.051757 (+ 15073us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:58.051981 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":166006,"prepare.queue_time_us":21330,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":61,"raft.queue_time_us":157156,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":28323,"spinlock_wait_cycles":46289280,"thread_start_us":289314,"threads_started":1,"wal-append.queue_time_us":344781}
W20260709 14:52:58.055197  7819 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:52:58.070896  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:52:58.112711  7819 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:58.113569  7819 leader_election.cc:304] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
W20260709 14:52:58.053164 12996 consensus_meta.cc:287] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent flushing consensus metadata: real 0.623s	user 0.008s	sys 0.005s
I20260709 14:52:58.077144  7926 raft_consensus.cc:2468] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 18.
I20260709 14:52:58.082217  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:58.091180 13117 raft_consensus.cc:993] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0: : Instructing follower 1de5e20126fa4d8ca0793d19c7b847ed to start an election
I20260709 14:52:58.094916 12913 raft_consensus.cc:993] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0: : Instructing follower 1de5e20126fa4d8ca0793d19c7b847ed to start an election
I20260709 14:52:58.096374  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
W20260709 14:52:58.097203 13119 log.cc:927] Time spent T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.281s	user 0.000s	sys 0.001s
I20260709 14:52:58.071267 13000 raft_consensus.cc:515] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:57.991750 13108 consensus_queue.cc:260] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:58.105989  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:58.023980 12970 raft_consensus.cc:493] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:52:58.107312  7778 raft_consensus.cc:2468] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 17.
I20260709 14:52:58.112548  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:58.059803 13123 leader_election.cc:290] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:58.116638  7819 leader_election.cc:304] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:58.118584 13109 raft_consensus.cc:2804] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 14:52:58.154719  7771 raft_consensus.cc:3060] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Advancing to term 16
W20260709 14:52:58.148904 13127 log.cc:927] Time spent T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
W20260709 14:52:58.083774 13125 log.cc:927] Time spent T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.113s	user 0.002s	sys 0.000s
I20260709 14:52:58.121094 12996 raft_consensus.cc:515] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:58.109737 13133 raft_consensus.cc:515] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:58.122359 12862 raft_consensus.cc:1081] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 LEADER]: Signalling peer 1de5e20126fa4d8ca0793d19c7b847ed to start an election
I20260709 14:52:58.108188 12805 consensus_queue.cc:1048] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 14:52:58.130767 12990 leader_election.cc:290] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 17 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:58.131917 12904 raft_consensus.cc:493] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:52:58.133147  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 99796us
I20260709 14:52:58.133870 13128 raft_consensus.cc:2749] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 14:52:58.133945  7770 raft_consensus.cc:2468] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 11.
I20260709 14:52:58.135528  7777 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47054 (request call id 295) took 1247 ms. Trace:
I20260709 14:52:58.139616 13106 raft_consensus.cc:3055] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 LEADER]: Stepping down as leader of term 13
I20260709 14:52:58.146961 12913 raft_consensus.cc:1081] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 LEADER]: Signalling peer 1de5e20126fa4d8ca0793d19c7b847ed to start an election
I20260709 14:52:58.116575  7893 leader_election.cc:304] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:52:58.177765  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 61285.6us
I20260709 14:52:58.147568  7779 raft_consensus.cc:2376] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 16. Re-sending same reply.
I20260709 14:52:58.152171  7920 raft_consensus.cc:2393] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 14: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
W20260709 14:52:58.120325 12879 consensus_meta.cc:287] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent flushing consensus metadata: real 0.704s	user 0.007s	sys 0.006s
I20260709 14:52:58.159284  7819 leader_election.cc:304] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:58.160085  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:58.118659  8639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9441e831627143a991a1556dcdce71e3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9418391fa82a42c79c6cad13ba91d964" is_pre_election: true
I20260709 14:52:58.167778  7771 raft_consensus.cc:2468] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 16.
W20260709 14:52:58.171356  8598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 325250us
I20260709 14:52:58.171337  7745 leader_election.cc:304] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:58.183184  7774 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 3595) took 1422 ms. Trace:
I20260709 14:52:58.175390  7845 raft_consensus.cc:1240] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 15. Current term is 16. Ops: []
I20260709 14:52:58.180446  7778 raft_consensus.cc:3060] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Advancing to term 16
I20260709 14:52:58.157354 13109 raft_consensus.cc:493] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:58.197392  7745 leader_election.cc:304] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:58.181721  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:58.174127  7777 rpcz_store.cc:276] 0709 14:52:56.888548 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:57.612328 (+723780us) service_pool.cc:224] Handling call
0709 14:52:57.612760 (+   432us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:52:58.064105 (+451345us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:52:58.064142 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:52:58.064188 (+    46us) raft_consensus.cc:1645] Marking committed up to 8
0709 14:52:58.064222 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:58.135134 (+ 70912us) spinlock_profiling.cc:243] Waited 451 ms on lock 0x7b5400323f54. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae8ee01 00007fb68ae8d83e 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2 00007fb6891c948c 00007fb6891c88c6
0709 14:52:58.135201 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:58.135434 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1037362560}
W20260709 14:52:58.183182  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:58.198800  7745 leader_election.cc:304] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:58.184194  7774 rpcz_store.cc:276] 0709 14:52:56.760425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:57.533105 (+772680us) service_pool.cc:224] Handling call
0709 14:52:57.562627 (+ 29522us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:52:57.563223 (+   596us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:52:57.563262 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:52:57.564019 (+   757us) log.cc:844] Serialized 26 byte log entry
0709 14:52:57.628454 (+ 64435us) raft_consensus.cc:1645] Marking committed up to 8
0709 14:52:57.668623 (+ 40169us) log.cc:844] Serialized 14 byte log entry
0709 14:52:57.668886 (+   263us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:57.668965 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:52:58.182876 (+513911us) raft_consensus.cc:1685] finished
0709 14:52:58.182895 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:58.183110 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1030,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":58,"raft.queue_time_us":51782,"raft.run_cpu_time_us":221,"raft.run_wall_time_us":224,"thread_start_us":63784,"threads_started":1,"wal-append.queue_time_us":289437}
I20260709 14:52:58.198249  7770 raft_consensus.cc:2468] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 18.
I20260709 14:52:58.166694 13123 raft_consensus.cc:2804] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Leader election won for term 18
I20260709 14:52:58.194557  7778 raft_consensus.cc:2468] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 16.
I20260709 14:52:58.203330  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:58.184706  7819 leader_election.cc:304] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:58.198865  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783e4874513449ef9084b833f188a6d3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:58.204530  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:58.201725  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:58.204530  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:58.205827  7770 raft_consensus.cc:2468] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 18.
I20260709 14:52:58.206188  7778 raft_consensus.cc:3060] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Advancing to term 16
I20260709 14:52:58.215296  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:58.158687 12970 raft_consensus.cc:515] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:58.221868  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:58.174983 13106 raft_consensus.cc:740] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:52:58.224176  7778 raft_consensus.cc:2468] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 16.
I20260709 14:52:58.224843  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:58.226019  7770 raft_consensus.cc:2468] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 14.
I20260709 14:52:58.225594  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783e4874513449ef9084b833f188a6d3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:58.224961  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:58.197450 12990 raft_consensus.cc:3060] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Advancing to term 18
W20260709 14:52:58.234705  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:58.183703 13107 raft_consensus.cc:493] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:58.222224 13126 raft_consensus.cc:493] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:58.222595 12977 consensus_queue.cc:1048] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.016s
I20260709 14:52:58.206750 13109 raft_consensus.cc:3060] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Advancing to term 15
I20260709 14:52:58.241602  7770 raft_consensus.cc:1275] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 14:52:58.207628 13065 raft_consensus.cc:2804] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 14:52:58.205386 13121 raft_consensus.cc:2749] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 14:52:58.240794  7776 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 3580) took 1606 ms. Trace:
I20260709 14:52:58.205605 13050 raft_consensus.cc:2749] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 14:52:58.232704 12962 consensus_queue.cc:1048] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 14:52:58.251729 13000 leader_election.cc:290] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:58.175021 12904 raft_consensus.cc:515] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:58.208900 13132 raft_consensus.cc:2749] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 14:52:58.257507 13126 raft_consensus.cc:515] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:58.215193 12879 raft_consensus.cc:2749] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 14:52:58.258653 12977 raft_consensus.cc:493] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:58.258795 13133 leader_election.cc:290] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:58.225565 13123 raft_consensus.cc:697] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:52:58.292763  7770 raft_consensus.cc:1240] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 13. Current term is 14. Ops: []
W20260709 14:52:58.301640 13129 log.cc:927] Time spent T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.264s	user 0.001s	sys 0.003s
I20260709 14:52:58.229864 12997 consensus_queue.cc:1048] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.064s
I20260709 14:52:58.233929 12878 consensus_queue.cc:1048] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.062s
I20260709 14:52:58.295066 13131 raft_consensus.cc:493] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:58.260135 13107 raft_consensus.cc:515] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:58.327617  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 105829us
I20260709 14:52:58.260915  7772 raft_consensus.cc:3060] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:52:58.330250  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:58.289386 13065 raft_consensus.cc:493] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:58.247833 13073 consensus_queue.cc:1059] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.056s
I20260709 14:52:58.293851  7776 rpcz_store.cc:276] 0709 14:52:56.634397 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:57.404966 (+770569us) service_pool.cc:224] Handling call
0709 14:52:57.405473 (+   507us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:52:57.475982 (+ 70509us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:52:57.476020 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:52:57.476555 (+   535us) log.cc:844] Serialized 26 byte log entry
0709 14:52:57.530825 (+ 54270us) spinlock_profiling.cc:243] Waited 4.68 ms on lock 0x7b480006c3d8. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68fdb7aa1 00007fb68fdaeb37 00007fb68fdae9ca 00007fb68fea626f 00007fb68fea5f37 00007fb68feba55c 00007fb68feba508 00007fb68feba488 00007fb68feba443 00007fb68feb96ec 00007fb68ede3a96
0709 14:52:57.622573 (+ 91748us) raft_consensus.cc:1645] Marking committed up to 11
0709 14:52:57.622624 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:57.622711 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:52:58.215546 (+592835us) raft_consensus.cc:1685] finished
0709 14:52:58.215580 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:58.240706 (+ 25126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":70044,"raft.queue_time_us":80683,"raft.run_cpu_time_us":1949,"raft.run_wall_time_us":36515,"spinlock_wait_cycles":10768128,"thread_start_us":114612,"threads_started":1,"wal-append.queue_time_us":268569}
I20260709 14:52:58.333622  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9441e831627143a991a1556dcdce71e3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:58.318399  7771 raft_consensus.cc:2468] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 15.
I20260709 14:52:58.322005  7770 raft_consensus.cc:1275] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 14:52:58.260788 12998 consensus_queue.cc:1048] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.068s
I20260709 14:52:58.331911  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:52:58.340610  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 111466us
I20260709 14:52:58.331058  7849 raft_consensus.cc:2468] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 14.
I20260709 14:52:58.317183  7777 raft_consensus.cc:2468] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 13.
I20260709 14:52:58.341828  7893 leader_election.cc:304] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:58.356881  7770 raft_consensus.cc:1240] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 10. Current term is 11. Ops: []
I20260709 14:52:58.365382  7772 raft_consensus.cc:2468] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 9.
I20260709 14:52:58.366115  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:58.366991  7850 raft_consensus.cc:2468] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 17.
I20260709 14:52:58.365701  7770 raft_consensus.cc:1240] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 16. Current term is 17. Ops: [14.9-16.10]
W20260709 14:52:58.388932  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 47206.7us
I20260709 14:52:58.316840 12977 raft_consensus.cc:515] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:58.335244 13065 raft_consensus.cc:3060] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Advancing to term 13
W20260709 14:52:58.391575  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:58.328009 13131 raft_consensus.cc:515] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:58.259567 13106 consensus_queue.cc:260] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:58.427313 12904 leader_election.cc:290] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:58.429808 13140 consensus_queue.cc:1048] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 14:52:58.387223 12996 leader_election.cc:290] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 16 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:58.379338 13123 consensus_queue.cc:237] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:58.386021  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 95652.6us
W20260709 14:52:58.401608  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 55686.7us
I20260709 14:52:58.340167 12724 raft_consensus.cc:493] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:58.404073 12962 consensus_queue.cc:1059] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.018s
I20260709 14:52:58.425715 12970 leader_election.cc:290] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:52:58.446187  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:58.446372  7819 leader_election.cc:304] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:58.464355 12990 raft_consensus.cc:2749] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 14:52:58.437407 13139 consensus_queue.cc:1048] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 14:52:58.448536 12996 raft_consensus.cc:493] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:58.438973 13126 leader_election.cc:290] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:58.450493 12904 raft_consensus.cc:493] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:58.452481 13131 leader_election.cc:290] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:58.453611 12878 raft_consensus.cc:493] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:58.456614  7771 raft_consensus.cc:1275] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
W20260709 14:52:58.427244 13122 log.cc:927] Time spent T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.378s	user 0.004s	sys 0.001s
I20260709 14:52:58.427136 13107 leader_election.cc:290] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:58.403450 12805 raft_consensus.cc:2804] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 14:52:58.465009  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 51583.3us
I20260709 14:52:58.465775 13138 consensus_queue.cc:1059] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 14:52:58.403193 12879 consensus_queue.cc:1059] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 14:52:58.512804 12879 raft_consensus.cc:3055] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 LEADER]: Stepping down as leader of term 8
I20260709 14:52:58.469955 12724 raft_consensus.cc:515] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:58.464071 13053 leader_election.cc:290] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:58.405565 13133 consensus_queue.cc:1059] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.068s
I20260709 14:52:58.437194 13084 raft_consensus.cc:515] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:58.514576 13133 raft_consensus.cc:3055] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 LEADER]: Stepping down as leader of term 15
I20260709 14:52:58.515271 13133 raft_consensus.cc:740] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:52:58.516048 12724 leader_election.cc:290] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:58.485948  7771 raft_consensus.cc:1275] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 14:52:58.468088 13073 raft_consensus.cc:3055] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 LEADER]: Stepping down as leader of term 17
I20260709 14:52:58.491582 13149 raft_consensus.cc:3055] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 LEADER]: Stepping down as leader of term 15
I20260709 14:52:58.516978 13149 raft_consensus.cc:740] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:52:58.518688 13149 consensus_queue.cc:260] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:58.520156 13149 raft_consensus.cc:3060] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Advancing to term 16
I20260709 14:52:58.492286 13145 raft_consensus.cc:2749] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 14:52:58.509392 12878 raft_consensus.cc:515] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:58.522032 13073 raft_consensus.cc:740] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:52:58.497402 13000 raft_consensus.cc:493] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:58.495836 13108 raft_consensus.cc:3060] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Advancing to term 15
I20260709 14:52:58.483273 12904 raft_consensus.cc:515] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:58.476331 12996 raft_consensus.cc:515] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:58.474231  7819 leader_election.cc:304] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:58.525913 12904 leader_election.cc:290] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:58.513404 12879 raft_consensus.cc:740] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:52:58.480512 12962 raft_consensus.cc:493] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:58.527055 13145 raft_consensus.cc:2804] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 14:52:58.516588  7779 raft_consensus.cc:2393] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 16: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:52:58.527729 12962 raft_consensus.cc:515] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:58.527635 13145 raft_consensus.cc:493] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:58.529603 13145 raft_consensus.cc:3060] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Advancing to term 16
I20260709 14:52:58.530084 12962 leader_election.cc:290] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:52:58.526633  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 52516us
I20260709 14:52:58.540354  7745 leader_election.cc:304] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 3876b8ee8d744cb18e91d97aae93b1ac, 9418391fa82a42c79c6cad13ba91d964
I20260709 14:52:58.543012  7745 leader_election.cc:304] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:58.547503  7774 raft_consensus.cc:1240] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 8. Current term is 9. Ops: []
I20260709 14:52:58.551772  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:58.547914  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:58.555400  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:58.578625  7777 raft_consensus.cc:2468] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 16.
I20260709 14:52:58.580327  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:58.552667  6549 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 14:52:58.584237  7676 catalog_manager.cc:5697] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
W20260709 14:52:58.588011  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:58.586846  7676 catalog_manager.cc:5697] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 12 to 17, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 17 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:52:58.586697  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:58.581509  7779 raft_consensus.cc:2468] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 19.
I20260709 14:52:58.594004  7771 raft_consensus.cc:2376] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 17. Re-sending same reply.
I20260709 14:52:58.591908  7676 catalog_manager.cc:5697] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 13 to 14, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 14 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
W20260709 14:52:58.597723  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 54799.7us
I20260709 14:52:58.603950 11963 consensus_queue.cc:1048] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 14:52:58.525817 12996 leader_election.cc:290] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:58.555735 12904 raft_consensus.cc:2749] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 14:52:58.557739  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 50537.5us
I20260709 14:52:58.516428 13133 consensus_queue.cc:260] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:58.523227 13000 raft_consensus.cc:515] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:58.626308  7774 raft_consensus.cc:1240] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 14:52:58.627708  7745 leader_election.cc:304] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:58.518937 13084 leader_election.cc:290] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 16 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:52:58.664848  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 47952.7us
I20260709 14:52:58.527371 12879 consensus_queue.cc:260] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:58.624711 12724 raft_consensus.cc:2804] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 14:52:58.662432 12970 raft_consensus.cc:2804] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 14:52:58.699620  7773 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 3564) took 2076 ms. Trace:
I20260709 14:52:58.635921 13148 raft_consensus.cc:493] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:58.523252 13073 consensus_queue.cc:260] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:58.726954  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:58.727325  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:58.686322 13133 raft_consensus.cc:3060] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Advancing to term 16
I20260709 14:52:58.730999  7771 raft_consensus.cc:2468] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 17.
I20260709 14:52:58.716732  7773 rpcz_store.cc:276] 0709 14:52:56.622868 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:57.217303 (+594435us) service_pool.cc:224] Handling call
0709 14:52:57.217776 (+   473us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:52:57.420048 (+202272us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:52:57.420083 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:52:57.421025 (+   942us) log.cc:844] Serialized 26 byte log entry
0709 14:52:57.482210 (+ 61185us) raft_consensus.cc:1645] Marking committed up to 10
0709 14:52:57.521796 (+ 39586us) log.cc:844] Serialized 14 byte log entry
0709 14:52:57.787569 (+265773us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:57.787664 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:52:58.048498 (+260834us) spinlock_profiling.cc:243] Waited 9.62 ms on lock 0x7b1800444ac0. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb690c69de1 00007fb690c765b1 00007fb687da13f3 00007fb687da37c1 00007fb687da3779 00007fb687da3709 00007fb687da36d1 00007fb687da29cd 0000000000396ad4 0000000000396919 00007fb687d8483a
0709 14:52:58.426328 (+377830us) spinlock_profiling.cc:243] Waited 34.7 ms on lock 0x7b4400022b4c. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb687c29db1 00007fb687cc7c85 00007fb687cc86a2 00007fb68aa3a1db 00007fb68aa35aaf 00007fb68aa2986e 00007fb68aa28bb6 00007fb68aa287d8 00007fb68aa32221 00007fb68aa321d9 00007fb68aa32169
0709 14:52:58.699303 (+272975us) raft_consensus.cc:1685] finished
0709 14:52:58.699334 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:58.699531 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":201761,"prepare.queue_time_us":33082,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":57,"raft.queue_time_us":276541,"raft.run_cpu_time_us":222,"raft.run_wall_time_us":222,"spinlock_wait_cycles":101859456,"thread_start_us":324228,"threads_started":2,"wal-append.queue_time_us":197963}
I20260709 14:52:58.730931  7778 raft_consensus.cc:2468] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 18.
I20260709 14:52:58.745630 12998 consensus_queue.cc:1048] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 14:52:58.746264 13109 raft_consensus.cc:515] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:58.747498 13000 leader_election.cc:290] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:58.693608 12805 raft_consensus.cc:697] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:58.704569 12962 raft_consensus.cc:493] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:58.734910 13084 raft_consensus.cc:493] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:58.729807 12996 raft_consensus.cc:493] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:58.749686 13140 consensus_queue.cc:1048] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.057s
I20260709 14:52:58.750202 13147 raft_consensus.cc:493] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
W20260709 14:52:58.752693 13130 log.cc:927] Time spent T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.719s	user 0.006s	sys 0.001s
I20260709 14:52:58.797191  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:58.806368  7853 raft_consensus.cc:2410] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for term 19 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 14:52:58.799615 12996 raft_consensus.cc:515] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:58.809850 12996 leader_election.cc:290] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:58.801610 13147 raft_consensus.cc:515] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:58.811862 12878 leader_election.cc:290] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:58.812763 13147 leader_election.cc:290] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:58.819068 13131 raft_consensus.cc:493] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:58.820008 13131 raft_consensus.cc:515] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:58.820911 13050 raft_consensus.cc:493] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:58.821718 13050 raft_consensus.cc:515] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:58.822714 13131 leader_election.cc:290] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:58.733999 12977 leader_election.cc:290] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:58.761957 13138 raft_consensus.cc:493] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:58.824343 13138 raft_consensus.cc:515] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:58.768071 13139 raft_consensus.cc:493] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:58.768927  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:58.769732  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:58.826732 13138 leader_election.cc:290] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:58.826152 13139 raft_consensus.cc:515] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:58.827773 12862 raft_consensus.cc:3055] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 14:52:58.828245 12862 raft_consensus.cc:740] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:58.770339 12724 raft_consensus.cc:493] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Starting leader election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:52:58.771653 12879 raft_consensus.cc:3060] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 8 FOLLOWER]: Advancing to term 9
I20260709 14:52:58.772647  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783e4874513449ef9084b833f188a6d3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:58.830775 12977 raft_consensus.cc:493] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:52:58.754382 13073 raft_consensus.cc:3060] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Advancing to term 18
I20260709 14:52:58.838231 12977 raft_consensus.cc:515] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:52:58.748790 13109 leader_election.cc:290] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:58.774191  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:58.775528  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:58.782078  7819 leader_election.cc:304] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:58.783407  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:52:58.784578 13136 log.cc:927] Time spent T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.395s	user 0.006s	sys 0.000s
I20260709 14:52:58.786746  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:58.843063  8639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18d29d52d304c87b930d4fb5eaf50b1" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9418391fa82a42c79c6cad13ba91d964" is_pre_election: true
I20260709 14:52:58.843502  7851 raft_consensus.cc:2393] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 17: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:52:58.844062  7923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38516 (request call id 2789) took 1217 ms. Trace:
I20260709 14:52:58.844362 13065 raft_consensus.cc:515] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:58.791323 13084 raft_consensus.cc:515] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:58.831266 12724 raft_consensus.cc:3060] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Advancing to term 14
I20260709 14:52:58.842676  7848 raft_consensus.cc:2393] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 17: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:52:58.847231 13084 leader_election.cc:290] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:58.732836 12970 raft_consensus.cc:493] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:58.740595 13106 raft_consensus.cc:3060] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Advancing to term 14
I20260709 14:52:58.829072 13139 leader_election.cc:290] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:58.819190 13053 raft_consensus.cc:493] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:58.763027  7674 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54364 (request call id 345) took 6887 ms. Trace:
I20260709 14:52:58.795279  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:58.841930  7854 raft_consensus.cc:2410] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for term 18 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
W20260709 14:52:58.842484  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 60547.7us
I20260709 14:52:58.849578 13053 raft_consensus.cc:515] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:58.853983  7819 leader_election.cc:304] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:58.734833 13148 raft_consensus.cc:515] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:58.844604  7923 rpcz_store.cc:276] 0709 14:52:57.626855 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:57.838006 (+211151us) service_pool.cc:224] Handling call
0709 14:52:57.943151 (+105145us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:52:58.049602 (+106451us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:52:58.049634 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:52:58.050138 (+   504us) log.cc:844] Serialized 26 byte log entry
0709 14:52:58.168113 (+117975us) raft_consensus.cc:1645] Marking committed up to 10
0709 14:52:58.168154 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:58.168225 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:52:58.626926 (+458701us) spinlock_profiling.cc:243] Waited 2.63 ms on lock 0x7b4400022b4c. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb687c29db1 00007fb687cc7c85 00007fb687cc86a2 00007fb68aa3a1db 00007fb68aa35aaf 00007fb68aa2986e 00007fb68aa28bb6 00007fb68aa287d8 00007fb68aa32221 00007fb68aa321d9 00007fb68aa32169
0709 14:52:58.843723 (+216797us) raft_consensus.cc:1685] finished
0709 14:52:58.843751 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:58.844007 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":105900,"raft.queue_time_us":107364,"raft.run_cpu_time_us":295,"raft.run_wall_time_us":279,"spinlock_wait_cycles":6059776,"thread_start_us":117641,"threads_started":1,"wal-append.queue_time_us":285298}
I20260709 14:52:58.855959 13053 leader_election.cc:290] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:58.841777 12977 leader_election.cc:290] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68:42321)
I20260709 14:52:58.855978  7819 leader_election.cc:304] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:58.859531  7819 leader_election.cc:304] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:58.837867  7849 raft_consensus.cc:2468] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 12.
I20260709 14:52:58.861477  7775 raft_consensus.cc:2468] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 15.
I20260709 14:52:58.861656 12878 raft_consensus.cc:2804] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 14:52:58.862144 12878 raft_consensus.cc:493] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:58.862565 12878 raft_consensus.cc:3060] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Advancing to term 19
I20260709 14:52:58.864701 12996 raft_consensus.cc:2804] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Leader election won for term 16
I20260709 14:52:58.858114 13148 leader_election.cc:290] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:58.865687 12996 raft_consensus.cc:697] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:52:58.849526  7674 rpcz_store.cc:276] 0709 14:52:51.879199 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:51.885670 (+  6471us) service_pool.cc:224] Handling call
0709 14:52:58.762925 (+6877255us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 14:52:53.651531 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 14:52:53.721673 (+ 70142us) write_op.cc:432] Acquiring schema lock in shared mode
0709 14:52:53.721718 (+    45us) write_op.cc:435] Acquired schema lock
0709 14:52:53.721738 (+    20us) tablet.cc:662] Decoding operations
0709 14:52:53.723164 (+  1426us) write_op.cc:620] Acquiring the partition lock for write op
0709 14:52:53.723289 (+   125us) write_op.cc:641] Partition lock acquired for write op
0709 14:52:53.723323 (+    34us) tablet.cc:685] Acquiring locks for 10 operations
0709 14:52:53.724211 (+   888us) tablet.cc:701] Row locks acquired
0709 14:52:53.724233 (+    22us) write_op.cc:260] PREPARE: finished
0709 14:52:53.724471 (+   238us) write_op.cc:270] Start()
0709 14:52:53.724631 (+   160us) write_op.cc:276] Timestamp: P: 1783608773724385 usec, L: 0
0709 14:52:53.724657 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 14:52:53.794313 (+ 69656us) log.cc:844] Serialized 4000 byte log entry
0709 14:52:55.033466 (+1239153us) op_driver.cc:464] REPLICATION: finished
0709 14:52:55.150024 (+116558us) write_op.cc:301] APPLY: starting
0709 14:52:55.150139 (+   115us) tablet.cc:1367] starting BulkCheckPresence
0709 14:52:55.292362 (+142223us) tablet.cc:1370] finished BulkCheckPresence
0709 14:52:55.309914 (+ 17552us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 14:52:55.867615 (+557701us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 14:52:55.867984 (+   369us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=20,key_file_lookups=20,delta_file_lookups=20,mrs_lookups=0
0709 14:52:55.868228 (+   244us) write_op.cc:312] APPLY: finished
0709 14:52:55.868679 (+   451us) log.cc:844] Serialized 97 byte log entry
0709 14:52:55.868964 (+   285us) write_op.cc:489] Releasing partition, row and schema locks
0709 14:52:55.869174 (+   210us) write_op.cc:454] Released schema lock
0709 14:52:55.869293 (+   119us) write_op.cc:341] FINISH: Updating metrics
0709 14:52:55.961450 (+ 92157us) write_op.cc:489] Releasing partition, row and schema locks
0709 14:52:55.965181 (+  3731us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":56396,"reported_tablets":43,"child_traces":[["op",{"apply.queue_time_us":101728,"apply.run_cpu_time_us":24091,"apply.run_wall_time_us":789055,"cfile_cache_hit":42,"cfile_cache_hit_bytes":45807,"mutex_wait_us":35964,"num_ops":10,"prepare.queue_time_us":108652,"prepare.run_cpu_time_us":41440,"prepare.run_wall_time_us":446642,"raft.queue_time_us":185350,"raft.run_cpu_time_us":4376,"raft.run_wall_time_us":187957,"replication_time_us":1263383,"thread_start_us":449281,"threads_started":4,"wal-append.queue_time_us":349009,"wal-append.run_cpu_time_us":24833,"wal-append.run_wall_time_us":2740480}]]}
I20260709 14:52:58.868901 13139 raft_consensus.cc:2804] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Leader election won for term 17
I20260709 14:52:58.829200 12862 consensus_queue.cc:260] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:58.870501 12862 raft_consensus.cc:3060] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 14:52:58.869740 13139 raft_consensus.cc:697] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:52:58.861304  7819 leader_election.cc:304] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:58.881230  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:58.885143  7819 leader_election.cc:304] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:58.847157 13050 leader_election.cc:290] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:58.909663  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:58.873155 12962 raft_consensus.cc:515] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:58.910837  7770 raft_consensus.cc:2468] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 12.
I20260709 14:52:58.920029  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:58.921314  7770 raft_consensus.cc:2468] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 13.
I20260709 14:52:58.879863 12970 raft_consensus.cc:3060] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Advancing to term 19
W20260709 14:52:58.925810  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:58.847985 13065 leader_election.cc:290] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:58.927228  7819 leader_election.cc:304] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:58.857861 12977 raft_consensus.cc:2804] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader election won for term 11
W20260709 14:52:58.939837  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:58.888131 13109 raft_consensus.cc:2749] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 14:52:58.883664 13131 raft_consensus.cc:493] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:58.885485 13053 raft_consensus.cc:493] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:58.961639  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
W20260709 14:52:58.967469  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:58.867110 12996 consensus_queue.cc:237] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:58.987694 13150 consensus_queue.cc:1048] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 14:52:58.980775 12977 raft_consensus.cc:697] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:52:58.990032 12977 consensus_queue.cc:237] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:58.933653 13147 raft_consensus.cc:2804] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 14:52:58.948805 13148 raft_consensus.cc:493] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:58.954303 13050 raft_consensus.cc:493] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:58.984541 13065 raft_consensus.cc:2804] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 14:52:59.012105  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:52:59.016659  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 349666us
I20260709 14:52:58.997385 13147 raft_consensus.cc:493] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Starting leader election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:52:58.983155 13131 raft_consensus.cc:515] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:59.005400 13132 raft_consensus.cc:493] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:59.032953 13132 raft_consensus.cc:515] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:59.036109 13132 leader_election.cc:290] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:58.982769 13053 raft_consensus.cc:515] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:59.031042 13147 raft_consensus.cc:3060] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Advancing to term 18
I20260709 14:52:59.009153 13065 raft_consensus.cc:493] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
W20260709 14:52:59.041675  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:59.003568 13148 raft_consensus.cc:515] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:59.023159 13084 raft_consensus.cc:493] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
W20260709 14:52:59.026304 13123 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.004s	sys 0.017s
W20260709 14:52:59.049865  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 537805us
I20260709 14:52:58.999897 12805 consensus_queue.cc:237] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:59.004932 13050 raft_consensus.cc:515] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:59.044941 13065 raft_consensus.cc:3060] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Advancing to term 15
I20260709 14:52:59.018183 13145 raft_consensus.cc:515] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:59.066195  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:59.004352 13139 consensus_queue.cc:237] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:59.068893  7893 leader_election.cc:304] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:52:59.051745 13157 consensus_queue.cc:1059] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 14:52:59.061784 13084 raft_consensus.cc:515] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:59.082980 12962 leader_election.cc:290] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:59.087980  7845 raft_consensus.cc:2468] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 9.
I20260709 14:52:59.090909 13053 leader_election.cc:290] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:59.055811 13132 raft_consensus.cc:493] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:59.092530  7776 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 3606) took 1152 ms. Trace:
W20260709 14:52:59.109658  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 137854us
I20260709 14:52:59.111037  7852 raft_consensus.cc:2393] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 16: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
W20260709 14:52:59.112246  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 43483.8us
I20260709 14:52:59.093520 12724 raft_consensus.cc:515] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:59.116070 12724 leader_election.cc:290] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 14 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:59.117223 13166 consensus_queue.cc:1059] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 14:52:59.118029 13157 raft_consensus.cc:3055] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 14:52:59.094468 13108 raft_consensus.cc:493] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:59.095188 13148 leader_election.cc:290] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:59.119153 13108 raft_consensus.cc:515] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:59.125166 13050 leader_election.cc:290] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:59.128058 13117 raft_consensus.cc:993] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0: : Instructing follower 1de5e20126fa4d8ca0793d19c7b847ed to start an election
I20260709 14:52:59.128669 13117 raft_consensus.cc:1081] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 LEADER]: Signalling peer 1de5e20126fa4d8ca0793d19c7b847ed to start an election
I20260709 14:52:59.129647 13108 leader_election.cc:290] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:59.118428 13166 raft_consensus.cc:3055] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 14:52:59.130614 13166 raft_consensus.cc:740] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:59.131183 12998 raft_consensus.cc:2804] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 14:52:59.131765 12998 raft_consensus.cc:493] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:59.131906 13166 consensus_queue.cc:260] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:59.133616 13166 raft_consensus.cc:3060] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 14:52:59.108956  7776 rpcz_store.cc:276] 0709 14:52:57.939796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:58.354725 (+414929us) service_pool.cc:224] Handling call
0709 14:52:58.355305 (+   580us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:52:58.355887 (+   582us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 14:52:58.662002 (+306115us) log.cc:844] Serialized 14 byte log entry
0709 14:52:58.884131 (+222129us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:52:58.884889 (+   758us) log.cc:844] Serialized 26 byte log entry
0709 14:52:58.885052 (+   163us) raft_consensus.cc:1645] Marking committed up to 9
0709 14:52:58.886884 (+  1832us) log.cc:844] Serialized 14 byte log entry
0709 14:52:58.887290 (+   406us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:52:58.887395 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:52:58.892817 (+  5422us) spinlock_profiling.cc:243] Waited 2.61 ms on lock 0x7b1800364c60. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb690c69de1 00007fb690c765b1 00007fb687da13f3 00007fb687da37c1 00007fb687da3779 00007fb687da3709 00007fb687da36d1 00007fb687da29cd 0000000000396ad4 0000000000396919 00007fb687d8483a
0709 14:52:58.989661 (+ 96844us) spinlock_profiling.cc:243] Waited 3.39 ms on lock 0x7b1800364c60. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb690c69de1 00007fb690c765b1 00007fb687da1522 00007fb687da37c1 00007fb687da3779 00007fb687da3709 00007fb687da36d1 00007fb687da29cd 0000000000396ad4 0000000000396919 00007fb687d8483a
0709 14:52:59.092262 (+102601us) raft_consensus.cc:1685] finished
0709 14:52:59.092286 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:52:59.092440 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":101550,"prepare.run_cpu_time_us":222,"prepare.run_wall_time_us":218,"raft.queue_time_us":3078,"raft.run_cpu_time_us":525,"raft.run_wall_time_us":14566,"spinlock_wait_cycles":15485824,"thread_start_us":466680,"threads_started":2,"wal-append.queue_time_us":416207}
I20260709 14:52:59.105896 12970 raft_consensus.cc:515] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:59.132146 12998 raft_consensus.cc:3060] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 14:52:59.097476 13131 leader_election.cc:290] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:52:59.069149 13123 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.595s	user 0.006s	sys 0.019s
I20260709 14:52:59.132016 13145 leader_election.cc:290] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 16 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:59.112152  7819 leader_election.cc:304] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:59.112702  7894 leader_election.cc:304] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:59.143296 13132 raft_consensus.cc:515] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:59.145833  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:59.146138  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:59.146826  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:59.147310  7928 raft_consensus.cc:2393] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 18: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:52:59.147608  7920 raft_consensus.cc:2393] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 15: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:52:59.148449 12970 leader_election.cc:290] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:59.148622  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:59.148730  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:59.149646  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783e4874513449ef9084b833f188a6d3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:59.150456  7921 raft_consensus.cc:2393] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 13: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:52:59.151539  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:59.151718  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:59.153578 13132 leader_election.cc:290] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:59.153796 13155 consensus_queue.cc:1059] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 14:52:59.154593 12990 raft_consensus.cc:493] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:59.154693 13155 raft_consensus.cc:3055] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 14:52:59.155090 12990 raft_consensus.cc:515] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:59.093320 12878 raft_consensus.cc:515] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:59.156473  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:59.118717 13157 raft_consensus.cc:740] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:59.146322 13050 raft_consensus.cc:493] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:59.158327 12990 leader_election.cc:290] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:59.131281  7893 leader_election.cc:304] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:59.158833  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:59.158471 13157 consensus_queue.cc:260] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:59.158471 13050 raft_consensus.cc:515] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:59.160629 13157 raft_consensus.cc:3060] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 14:52:59.157591 12878 leader_election.cc:290] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 19 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:59.155119 13155 raft_consensus.cc:740] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:59.162190  7893 leader_election.cc:304] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:59.162884 13050 leader_election.cc:290] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:59.159243  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:59.163514 13155 consensus_queue.cc:260] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:59.163378 12990 raft_consensus.cc:2804] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 14:52:59.164775 13155 raft_consensus.cc:3060] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 14:52:59.165230 12990 raft_consensus.cc:697] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:59.166143 12990 consensus_queue.cc:237] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:59.163029 12997 raft_consensus.cc:2804] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 14:52:59.169957 12997 raft_consensus.cc:697] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:59.170737 13065 raft_consensus.cc:515] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:59.171018 12997 consensus_queue.cc:237] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:59.149968  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:59.174636  7893 leader_election.cc:304] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:52:59.176618  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 64608.9us
W20260709 14:52:59.179814  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:59.180111  7848 raft_consensus.cc:1275] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 14:52:59.186383  7923 raft_consensus.cc:2468] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 17.
I20260709 14:52:59.150848 13141 raft_consensus.cc:2804] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 14:52:59.194295  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:59.195041  7854 raft_consensus.cc:1275] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 14:52:59.177474  7819 leader_election.cc:304] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:59.195084  7849 raft_consensus.cc:2468] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 17.
I20260709 14:52:59.150799 13084 leader_election.cc:290] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:59.198596  7845 raft_consensus.cc:1275] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 11. (term mismatch)
I20260709 14:52:59.200193  7845 pending_rounds.cc:85] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting all ops after (but not including) 10
I20260709 14:52:59.200420  7845 pending_rounds.cc:107] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting uncommitted NO_OP operation due to leader change: 18.11
I20260709 14:52:59.200765  7845 raft_consensus.cc:2889] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:52:59.199123 11963 consensus_queue.cc:1048] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.003s
W20260709 14:52:59.197724  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:59.205603  7846 raft_consensus.cc:1240] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 12. Current term is 13. Ops: []
I20260709 14:52:59.207113  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:52:59.209494 13169 raft_consensus.cc:2804] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 14:52:59.210125 13169 raft_consensus.cc:493] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting leader election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:52:59.210593 13169 raft_consensus.cc:3060] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Advancing to term 13
I20260709 14:52:59.211853  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:59.213243  7893 leader_election.cc:304] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:59.213788 11963 consensus_queue.cc:1048] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 14:52:59.216463  7744 leader_election.cc:304] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:59.218142  7744 leader_election.cc:304] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:59.223371  7847 raft_consensus.cc:1240] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 14. Current term is 15. Ops: []
I20260709 14:52:59.224738  7744 leader_election.cc:304] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:59.201918  7819 leader_election.cc:304] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:59.229532  7744 leader_election.cc:304] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:52:59.234139  7776 raft_consensus.cc:1275] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 14:52:59.237303  7776 raft_consensus.cc:1275] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 14:52:59.194937 13050 raft_consensus.cc:493] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:59.242858  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:52:59.206070 13117 raft_consensus.cc:2749] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 14:52:59.197482 13141 raft_consensus.cc:697] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:59.196866 13145 raft_consensus.cc:2804] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 14:52:59.195433 13065 leader_election.cc:290] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:59.249099  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:59.269140  7774 raft_consensus.cc:2468] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 17.
I20260709 14:52:59.228096 13138 raft_consensus.cc:2804] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 14:52:59.238318  7819 leader_election.cc:304] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:59.225201 13084 raft_consensus.cc:2749] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 14:52:59.264562  7849 raft_consensus.cc:1240] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 18. Current term is 19. Ops: []
I20260709 14:52:59.232717 12996 raft_consensus.cc:2804] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 14:52:59.250022 13132 raft_consensus.cc:2749] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 14:52:59.254186 11963 raft_consensus.cc:493] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:59.270947  7775 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3"
dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:37144
I20260709 14:52:59.300307  7775 raft_consensus.cc:493] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:52:59.300774  7775 raft_consensus.cc:3060] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Advancing to term 14
I20260709 14:52:59.247798 12970 raft_consensus.cc:2749] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 14:52:59.229458 12878 raft_consensus.cc:493] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:59.228241 13131 raft_consensus.cc:2749] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 14:52:59.293318  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 56017.7us
I20260709 14:52:59.325510  7819 leader_election.cc:304] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:52:59.292593  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:59.295337  7779 raft_consensus.cc:1240] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260709 14:52:59.284988  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:59.329831  7772 raft_consensus.cc:2468] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 16.
I20260709 14:52:59.330873  7772 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044"
dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:37144
I20260709 14:52:59.271703  7777 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a"
dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:37144
I20260709 14:52:59.228722 12862 consensus_queue.cc:1048] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 14:52:59.298888 11963 raft_consensus.cc:515] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:59.263065 13145 raft_consensus.cc:493] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Starting leader election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:52:59.327919  7819 leader_election.cc:304] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:59.332340  7772 raft_consensus.cc:493] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:52:59.333009  7777 raft_consensus.cc:493] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:52:59.341492  7777 raft_consensus.cc:3060] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Advancing to term 20
I20260709 14:52:59.319531 13138 raft_consensus.cc:697] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:59.305938 12996 raft_consensus.cc:493] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:59.345645  7819 leader_election.cc:304] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:59.340943  7772 raft_consensus.cc:3060] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:52:59.360761  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:52:59.361658  7849 raft_consensus.cc:2468] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 14.
I20260709 14:52:59.359594  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:52:59.350744  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:59.303987 13065 raft_consensus.cc:2804] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 14:52:59.261281 13050 raft_consensus.cc:515] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:59.341995 13123 raft_consensus.cc:2804] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 14:52:59.369716  7819 leader_election.cc:304] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:59.372089  7775 raft_consensus.cc:515] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:59.379627  7819 leader_election.cc:304] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:59.380535  7819 leader_election.cc:304] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:52:59.370925 11963 leader_election.cc:290] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:59.338323 13139 raft_consensus.cc:2804] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Leader election won for term 17
I20260709 14:52:59.349668 13145 raft_consensus.cc:3060] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Advancing to term 15
I20260709 14:52:59.390033  7845 raft_consensus.cc:1240] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 LEADER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260709 14:52:59.397464  7772 raft_consensus.cc:515] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:59.367645 12996 raft_consensus.cc:3060] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Advancing to term 17
I20260709 14:52:59.359899 13131 raft_consensus.cc:493] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:59.396070  7777 raft_consensus.cc:515] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:59.413583  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:59.373018 13065 raft_consensus.cc:493] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:52:59.327955 12878 raft_consensus.cc:515] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:59.411314  7775 leader_election.cc:290] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 14 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:52:59.434134  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:59.378613 13123 raft_consensus.cc:493] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:59.339439 12998 raft_consensus.cc:515] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:59.433983  7772 leader_election.cc:290] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 12 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:59.391479 13133 raft_consensus.cc:2804] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 14:52:59.397513 13106 raft_consensus.cc:2804] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 14:52:59.400715 12962 raft_consensus.cc:2804] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 14:52:59.416435 13139 raft_consensus.cc:697] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:52:59.461735  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:59.468410  7777 leader_election.cc:290] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 20 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:59.482120  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:59.482563  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:59.484823  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:59.486334  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:59.482890  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:59.483609  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783e4874513449ef9084b833f188a6d3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:59.483980  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:59.484251  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:59.484941  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:59.485646  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:59.433075 13065 raft_consensus.cc:3060] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Advancing to term 20
I20260709 14:52:59.530511  7924 raft_consensus.cc:2393] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 17: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:52:59.531783  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:59.532305  7923 raft_consensus.cc:2393] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 17: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:52:59.531890  7925 raft_consensus.cc:2468] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 13.
I20260709 14:52:59.534703  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:59.536150  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:59.535189  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:52:59.448860 13123 raft_consensus.cc:3060] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Advancing to term 18
I20260709 14:52:59.537861  7922 raft_consensus.cc:1240] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 14:52:59.540870  7926 raft_consensus.cc:2393] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 14: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:52:59.532842  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:59.542059  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:59.539068  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:59.540165  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:59.530896  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:59.542585  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258d6c2dda954bf5b65930fde8ecb9f3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:59.544696  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:59.450685 13133 raft_consensus.cc:493] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Starting leader election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:52:59.546936  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c563cc7cfbe4d59be4ffc5cf847ce56" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:59.545606  7927 raft_consensus.cc:3060] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Advancing to term 19
W20260709 14:52:59.548514  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:52:59.551545  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:59.388567 13141 consensus_queue.cc:237] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:59.462644 12962 raft_consensus.cc:493] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:59.443511 13131 raft_consensus.cc:515] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:59.562676 12998 leader_election.cc:290] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:52:59.554527 13133 raft_consensus.cc:3060] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Advancing to term 15
I20260709 14:52:59.564579  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:52:59.472986 13106 raft_consensus.cc:493] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:59.586944  7920 raft_consensus.cc:2468] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 16.
I20260709 14:52:59.594870  7927 raft_consensus.cc:2468] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 19.
I20260709 14:52:59.596984  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: true dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:59.597569  7926 raft_consensus.cc:3055] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 14:52:59.597885  7926 raft_consensus.cc:740] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:52:59.598554  7926 consensus_queue.cc:260] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:59.599339  7926 raft_consensus.cc:3060] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 14:52:59.583956 13148 raft_consensus.cc:2804] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 14:52:59.585508 12962 raft_consensus.cc:3060] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Advancing to term 14
I20260709 14:52:59.609861  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: true dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:52:59.615322 12878 leader_election.cc:290] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:59.616312  7927 raft_consensus.cc:3055] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 14:52:59.539512  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:00.031891  7772 raft_consensus.cc:2393] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 12: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
W20260709 14:53:00.027024  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 624289us
I20260709 14:53:00.146775  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:00.047207  7777 raft_consensus.cc:2468] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 16.
I20260709 14:53:00.148887  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18d29d52d304c87b930d4fb5eaf50b1" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:00.082836 13202 raft_consensus.cc:493] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:52:59.967717  6549 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 14:53:00.068297  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:53:00.055253  7779 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.658s	user 0.020s	sys 0.022s
I20260709 14:53:00.063616 13204 raft_consensus.cc:493] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:53:00.076894  7770 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.628s	user 0.000s	sys 0.010s
I20260709 14:53:00.089679  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: true dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:00.091825  7926 raft_consensus.cc:2468] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 14.
W20260709 14:53:00.094663  7854 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.663s	user 0.000s	sys 0.009s
I20260709 14:53:00.095417  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
W20260709 14:53:00.089718  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:00.111001 13200 raft_consensus.cc:493] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
W20260709 14:53:00.112685  7894 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.849s	user 0.003s	sys 0.003s
I20260709 14:53:00.115296 13206 raft_consensus.cc:493] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:52:59.596415 13106 raft_consensus.cc:3060] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Advancing to term 13
I20260709 14:52:59.641716 13050 leader_election.cc:290] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:59.873173 13123 raft_consensus.cc:515] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:59.529650 13138 consensus_queue.cc:237] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:59.730647 13131 leader_election.cc:290] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:52:59.886638 13133 raft_consensus.cc:515] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:00.182613 13200 raft_consensus.cc:515] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:59.616698 13139 consensus_queue.cc:237] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:52:59.864004 13145 raft_consensus.cc:515] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:59.716166 13147 consensus_meta.cc:287] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent flushing consensus metadata: real 0.667s	user 0.010s	sys 0.000s
I20260709 14:52:59.689900 13148 raft_consensus.cc:493] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:00.192720 13147 raft_consensus.cc:515] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:59.708889 13155 consensus_meta.cc:287] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent flushing consensus metadata: real 0.544s	user 0.007s	sys 0.004s
W20260709 14:52:59.888237 13169 consensus_meta.cc:287] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent flushing consensus metadata: real 0.677s	user 0.011s	sys 0.004s
I20260709 14:53:00.198549 13145 leader_election.cc:290] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:52:59.632933 13172 log.cc:927] Time spent T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.224s	user 0.001s	sys 0.000s
I20260709 14:53:00.201335 13147 leader_election.cc:290] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 18 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:52:59.691561 13173 log.cc:927] Time spent T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.147s	user 0.000s	sys 0.001s
I20260709 14:53:00.186532 13202 raft_consensus.cc:515] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:52:59.692246 13176 log.cc:927] Time spent T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.295s	user 0.000s	sys 0.002s
W20260709 14:52:59.674139 13178 log.cc:927] Time spent T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.195s	user 0.003s	sys 0.000s
W20260709 14:52:59.698954 13181 log.cc:927] Time spent T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
W20260709 14:52:59.693703 13183 log.cc:927] Time spent T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
W20260709 14:52:59.698361 13184 log.cc:927] Time spent T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
W20260709 14:52:59.694958 13185 log.cc:927] Time spent T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
W20260709 14:52:59.697096 13187 log.cc:927] Time spent T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 14:53:00.129982 12965 raft_consensus.cc:493] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
W20260709 14:53:00.133909 13065 consensus_meta.cc:287] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent flushing consensus metadata: real 0.587s	user 0.007s	sys 0.005s
I20260709 14:53:00.129029 12862 raft_consensus.cc:493] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:00.137452 13132 raft_consensus.cc:493] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:00.194517 13148 raft_consensus.cc:3060] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Advancing to term 19
I20260709 14:53:00.215054 13132 raft_consensus.cc:515] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:00.141423 13000 raft_consensus.cc:493] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:00.216349 12862 raft_consensus.cc:515] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:00.213894  7927 raft_consensus.cc:740] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:00.217334 13000 raft_consensus.cc:515] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:00.219184 12862 leader_election.cc:290] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:00.140251 12977 raft_consensus.cc:493] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:00.176994 12724 raft_consensus.cc:493] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:00.220929 12977 raft_consensus.cc:515] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:00.221011 12724 raft_consensus.cc:515] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:00.151360 13084 raft_consensus.cc:493] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:00.226603  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:00.153502  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:00.152550  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258d6c2dda954bf5b65930fde8ecb9f3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:00.212301 12965 raft_consensus.cc:515] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:00.232471 13000 leader_election.cc:290] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:00.165227  7920 raft_consensus.cc:3055] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 LEADER]: Stepping down as leader of term 19
W20260709 14:53:00.164999  7779 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.768s	user 0.027s	sys 0.024s
W20260709 14:53:00.165846  7894 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.903s	user 0.004s	sys 0.004s
W20260709 14:53:00.163471  7770 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.720s	user 0.001s	sys 0.010s
I20260709 14:53:00.233422  7920 raft_consensus.cc:740] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:00.233789 12965 leader_election.cc:290] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:00.234834  7920 consensus_queue.cc:260] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:00.236526  7920 raft_consensus.cc:3060] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Advancing to term 20
I20260709 14:53:00.239375  7927 consensus_queue.cc:260] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:00.238742  7893 leader_election.cc:304] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:53:00.243494 13141 raft_consensus.cc:493] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:00.230041  7772 raft_consensus.cc:2468] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 16.
I20260709 14:53:00.244762 13141 raft_consensus.cc:515] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:00.245555 13155 raft_consensus.cc:493] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:00.246429 13155 raft_consensus.cc:515] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:00.198907 13169 raft_consensus.cc:515] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:00.248652 13141 leader_election.cc:290] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:53:00.152748  7819 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.621s	user 0.000s	sys 0.009s
W20260709 14:53:00.168478  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:53:00.168255  7854 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.754s	user 0.001s	sys 0.010s
I20260709 14:53:00.171968  7925 raft_consensus.cc:2468] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 16.
I20260709 14:53:00.150743  7745 leader_election.cc:304] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:00.170009 13204 raft_consensus.cc:515] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:00.177167 12913 consensus_queue.cc:1048] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.012s
I20260709 14:53:00.195678  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:00.184979 13133 leader_election.cc:290] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:00.181003 13123 leader_election.cc:290] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 18 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:00.149223 12997 consensus_queue.cc:1048] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 14:53:00.215242 13065 raft_consensus.cc:515] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:00.267650 13065 leader_election.cc:290] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 20 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:00.141677 11963 raft_consensus.cc:493] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:00.234755 12965 raft_consensus.cc:493] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:00.268935 11963 raft_consensus.cc:515] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:53:00.220043  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:00.061998 13199 raft_consensus.cc:493] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:00.269665  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:00.270885  7852 raft_consensus.cc:2410] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for term 16 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 14:53:00.270452 13199 raft_consensus.cc:515] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:00.272514  7848 raft_consensus.cc:1275] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 14:53:00.229235  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
W20260709 14:53:00.256944  7819 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.725s	user 0.000s	sys 0.010s
I20260709 14:53:00.264520 13169 leader_election.cc:290] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:00.269824 12965 raft_consensus.cc:515] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:00.263814  7853 raft_consensus.cc:1240] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 14. Current term is 15. Ops: []
I20260709 14:53:00.205125 13202 leader_election.cc:290] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:00.206046 12990 raft_consensus.cc:493] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:00.287328  7854 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 4209) took 1040 ms. Trace:
W20260709 14:53:00.289443  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 139193us
I20260709 14:53:00.288093  7854 rpcz_store.cc:276] 0709 14:52:59.246483 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:59.387557 (+141074us) service_pool.cc:224] Handling call
0709 14:52:59.388224 (+   667us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:52:59.401290 (+ 13066us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:52:59.401326 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:52:59.414324 (+ 12998us) log.cc:844] Serialized 26 byte log entry
0709 14:53:00.256407 (+842083us) raft_consensus.cc:1645] Marking committed up to 11
0709 14:53:00.260745 (+  4338us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:53:00.260919 (+   174us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:53:00.260996 (+    77us) raft_consensus.cc:1685] finished
0709 14:53:00.261012 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:53:00.287247 (+ 26235us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12348,"raft.queue_time_us":12476,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":23726,"thread_start_us":836745,"threads_started":1,"wal-append.queue_time_us":435573}
I20260709 14:53:00.290743  7745 leader_election.cc:304] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:00.282253 12862 raft_consensus.cc:2804] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 14:53:00.292832 12862 raft_consensus.cc:493] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:00.293277 12862 raft_consensus.cc:3060] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 14:53:00.281546 13065 raft_consensus.cc:493] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
W20260709 14:53:00.296826 12962 consensus_meta.cc:287] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent flushing consensus metadata: real 0.663s	user 0.013s	sys 0.002s
I20260709 14:53:00.302874 12962 raft_consensus.cc:515] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:00.271539 13204 leader_election.cc:290] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:00.298208  7771 raft_consensus.cc:2393] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 16: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:53:00.298647 11963 leader_election.cc:290] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:00.299657 13133 raft_consensus.cc:493] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:00.263993 12913 raft_consensus.cc:493] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:00.311010 12913 raft_consensus.cc:515] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:00.312083 12962 leader_election.cc:290] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 14 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:00.301432  7927 raft_consensus.cc:3060] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:53:00.303368 12724 leader_election.cc:290] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:00.296334 13065 raft_consensus.cc:515] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:00.321125 13200 leader_election.cc:290] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:00.248914 13155 leader_election.cc:290] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:00.319042 12970 raft_consensus.cc:2749] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 14:53:00.319337 13204 raft_consensus.cc:493] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:00.226599 13084 raft_consensus.cc:515] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:00.308861 13050 raft_consensus.cc:2749] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 14:53:00.318928  7675 catalog_manager.cc:5697] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 14 to 15, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 15 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:53:00.330286  7779 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 3638) took 1046 ms. Trace:
W20260709 14:53:00.314517  7776 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.691s	user 0.013s	sys 0.010s
I20260709 14:53:00.343654  7920 raft_consensus.cc:2468] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 20.
W20260709 14:53:00.342051  7774 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.787s	user 0.006s	sys 0.016s
I20260709 14:53:00.326326 13199 leader_election.cc:290] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:00.331856 13065 leader_election.cc:290] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:00.335826 13133 raft_consensus.cc:515] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:00.355885  7850 raft_consensus.cc:1275] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 14:53:00.333392 13204 raft_consensus.cc:515] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:53:00.357844  7776 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.878s	user 0.014s	sys 0.010s
W20260709 14:53:00.342298  7778 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.829s	user 0.002s	sys 0.042s
W20260709 14:53:00.342975  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 811453us
I20260709 14:53:00.335366 13084 leader_election.cc:290] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:53:00.360421  7774 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.976s	user 0.007s	sys 0.016s
I20260709 14:53:00.367899 13204 leader_election.cc:290] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:00.327639 13132 leader_election.cc:290] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:00.327648 12977 leader_election.cc:290] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:00.363685  7675 catalog_manager.cc:5697] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 14 to 16, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 16 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:53:00.273715 13206 raft_consensus.cc:515] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:53:00.375769  7778 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.034s	user 0.003s	sys 0.043s
I20260709 14:53:00.355885 12913 leader_election.cc:290] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:00.378525  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:00.361641 12990 raft_consensus.cc:515] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:00.387625 13133 leader_election.cc:290] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:00.388850  7773 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 3643) took 1099 ms. Trace:
I20260709 14:53:00.389354 12990 leader_election.cc:290] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:00.391923  7745 leader_election.cc:304] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:00.395576 12862 raft_consensus.cc:515] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:00.398103  7776 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 3626) took 1123 ms. Trace:
I20260709 14:53:00.398969  7776 rpcz_store.cc:276] 0709 14:52:59.274546 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:59.280755 (+  6209us) service_pool.cc:224] Handling call
0709 14:52:59.281134 (+   379us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:52:59.282185 (+  1051us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:52:59.282217 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:52:59.282694 (+   477us) log.cc:844] Serialized 26 byte log entry
0709 14:52:59.439642 (+156948us) raft_consensus.cc:1645] Marking committed up to 10
0709 14:53:00.370563 (+930921us) log.cc:844] Serialized 14 byte log entry
0709 14:53:00.397590 (+ 27027us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:53:00.397724 (+   134us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:53:00.397776 (+    52us) raft_consensus.cc:1685] finished
0709 14:53:00.397788 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:53:00.397996 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7822,"prepare.queue_time_us":162205,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":53,"thread_start_us":982237,"threads_started":2,"wal-append.queue_time_us":280761}
I20260709 14:53:00.343241  7779 rpcz_store.cc:276] 0709 14:52:59.284015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:59.330304 (+ 46289us) service_pool.cc:224] Handling call
0709 14:52:59.330958 (+   654us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:52:59.368629 (+ 37671us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 14:52:59.396554 (+ 27925us) log.cc:844] Serialized 14 byte log entry
0709 14:52:59.647423 (+250869us) spinlock_profiling.cc:243] Waited 6.15 ms on lock 0x7b18002dc760. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb690c69de1 00007fb690c765b1 00007fb687d1bc0a 00007fb69145b219 00007fb68ed6258f 00007fb687da1571 00007fb687da37c1 00007fb687da3779 00007fb687da3709 00007fb687da36d1 00007fb687da29cd
0709 14:52:59.696260 (+ 48837us) spinlock_profiling.cc:243] Waited 2.34 ms on lock 0x7b4400022b4c. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb687c29db1 00007fb687cc7c85 00007fb687cc86a2 00007fb68aa3a1db 00007fb68aa35aaf 00007fb68aa2986e 00007fb68aa28bb6 00007fb68aa287d8 00007fb68aa32221 00007fb68aa321d9 00007fb68aa32169
0709 14:53:00.235131 (+538871us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:53:00.236141 (+  1010us) log.cc:844] Serialized 26 byte log entry
0709 14:53:00.236422 (+   281us) raft_consensus.cc:1645] Marking committed up to 11
0709 14:53:00.236840 (+   418us) log.cc:844] Serialized 14 byte log entry
0709 14:53:00.237078 (+   238us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:53:00.237208 (+   130us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:53:00.306414 (+ 69206us) raft_consensus.cc:1685] finished
0709 14:53:00.306441 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:53:00.330210 (+ 23769us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":69726,"prepare.queue_time_us":32223,"prepare.run_cpu_time_us":155,"prepare.run_wall_time_us":155,"raft.queue_time_us":40806,"raft.run_cpu_time_us":522,"raft.run_wall_time_us":16734,"spinlock_wait_cycles":19526784,"thread_start_us":837845,"threads_started":1,"wal-append.queue_time_us":197716}
I20260709 14:53:00.401669 13204 raft_consensus.cc:2749] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 14:53:00.411675 13206 leader_election.cc:290] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:00.411504 12862 leader_election.cc:290] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 18 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:00.414669 13148 raft_consensus.cc:515] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:00.422741  7852 raft_consensus.cc:1240] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 15. Current term is 16. Ops: []
I20260709 14:53:00.424278 13133 raft_consensus.cc:493] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:00.422751  7919 raft_consensus.cc:2468] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 16.
I20260709 14:53:00.425158 13133 raft_consensus.cc:515] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:00.427230  7819 leader_election.cc:304] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:00.389554  7773 rpcz_store.cc:276] 0709 14:52:59.289464 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:53:00.239984 (+950520us) service_pool.cc:224] Handling call
0709 14:53:00.240953 (+   969us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:53:00.313395 (+ 72442us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:53:00.313434 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:53:00.328619 (+ 15185us) log.cc:844] Serialized 26 byte log entry
0709 14:53:00.370080 (+ 41461us) raft_consensus.cc:1645] Marking committed up to 10
0709 14:53:00.370124 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:53:00.370214 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:53:00.388450 (+ 18236us) raft_consensus.cc:1685] finished
0709 14:53:00.388471 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:53:00.388652 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":32297,"raft.run_cpu_time_us":237,"raft.run_wall_time_us":239,"thread_start_us":40771,"threads_started":1,"wal-append.queue_time_us":56816}
W20260709 14:53:00.429438  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 110997us
I20260709 14:53:00.432400  7745 leader_election.cc:304] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:00.424476 12977 consensus_queue.cc:1048] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.009s
I20260709 14:53:00.434760 13133 leader_election.cc:290] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:53:00.435462  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 70714.9us
I20260709 14:53:00.436672  7919 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38516 (request call id 2800) took 1288 ms. Trace:
I20260709 14:53:00.437194  7919 rpcz_store.cc:276] 0709 14:52:59.147769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:59.149723 (+  1954us) service_pool.cc:224] Handling call
0709 14:53:00.436245 (+1286522us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b54001e4954. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae922fa 00007fb68fe53b17 00007fb6893ce6d4 00007fb6893ce662 00007fb6893ce591 00007fb6893ce50c 00007fb6893cd7c2 00007fb6891c948c 00007fb6891c88c6 00007fb6891c826f
0709 14:53:00.436462 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2347706624}
I20260709 14:53:00.438860  7853 raft_consensus.cc:1275] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 10. (term mismatch)
I20260709 14:53:00.439255  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:00.441121  7854 raft_consensus.cc:2410] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 14:53:00.443437 13148 leader_election.cc:290] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 19 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:00.417580  7675 catalog_manager.cc:5697] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 12 to 13, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 13 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
W20260709 14:53:00.446871  7894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:00.396998  7893 leader_election.cc:304] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:53:00.452992  7675 catalog_manager.cc:5697] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 12 to 13, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 13 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
W20260709 14:53:00.454864  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 58049.8us
I20260709 14:53:00.455581 12913 raft_consensus.cc:2804] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 14:53:00.456262 12913 raft_consensus.cc:493] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:00.456746 12913 raft_consensus.cc:3060] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 14:53:00.455945  7675 catalog_manager.cc:5697] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 16 to 17, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 17 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:53:00.457948  7770 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 3640) took 1173 ms. Trace:
I20260709 14:53:00.458518  7770 rpcz_store.cc:276] 0709 14:52:59.284509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:59.343192 (+ 58683us) service_pool.cc:224] Handling call
0709 14:52:59.343602 (+   410us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:52:59.406922 (+ 63320us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 14:53:00.234016 (+827094us) log.cc:844] Serialized 14 byte log entry
0709 14:53:00.363256 (+129240us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:53:00.364278 (+  1022us) log.cc:844] Serialized 26 byte log entry
0709 14:53:00.364566 (+   288us) raft_consensus.cc:1645] Marking committed up to 7
0709 14:53:00.380028 (+ 15462us) log.cc:844] Serialized 14 byte log entry
0709 14:53:00.380273 (+   245us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:53:00.448522 (+ 68249us) spinlock_profiling.cc:243] Waited 63 ms on lock 0x7b5400115154. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae8ee01 00007fb68ae8d83e 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2 00007fb6891c948c 00007fb6891c88c6
0709 14:53:00.448589 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:53:00.457537 (+  8948us) raft_consensus.cc:1685] finished
0709 14:53:00.457564 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:53:00.457869 (+   305us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":71912,"prepare.queue_time_us":137378,"prepare.run_cpu_time_us":125,"prepare.run_wall_time_us":132,"raft.queue_time_us":12317,"raft.run_cpu_time_us":724,"raft.run_wall_time_us":728,"spinlock_wait_cycles":144799488,"thread_start_us":907661,"threads_started":2,"wal-append.queue_time_us":214697}
I20260709 14:53:00.461072 13169 raft_consensus.cc:2749] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 14:53:00.459985  7675 catalog_manager.cc:5697] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 7 to 8, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 8 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:53:00.450770 12965 leader_election.cc:290] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:00.447043  7778 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 3625) took 1178 ms. Trace:
I20260709 14:53:00.466984  7778 rpcz_store.cc:276] 0709 14:52:59.268325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:59.274363 (+  6038us) service_pool.cc:224] Handling call
0709 14:52:59.274763 (+   400us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:52:59.338523 (+ 63760us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:52:59.338558 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:52:59.339108 (+   550us) log.cc:844] Serialized 26 byte log entry
0709 14:53:00.445611 (+1106503us) raft_consensus.cc:1645] Marking committed up to 9
0709 14:53:00.445686 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:53:00.446473 (+   787us) spinlock_profiling.cc:243] Waited 63.2 ms on lock 0x7b54001211d4. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae8ee01 00007fb68ae8d83e 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2 00007fb6891c948c 00007fb6891c88c6
0709 14:53:00.446534 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:53:00.446590 (+    56us) raft_consensus.cc:1685] finished
0709 14:53:00.446601 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:53:00.446971 (+   370us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4179,"raft.queue_time_us":4330,"raft.run_cpu_time_us":216,"raft.run_wall_time_us":15646,"spinlock_wait_cycles":145304832,"thread_start_us":1036369,"threads_started":1,"wal-append.queue_time_us":932527}
I20260709 14:53:00.437703  7744 leader_election.cc:304] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:00.439492  7853 pending_rounds.cc:85] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting all ops after (but not including) 9
W20260709 14:53:00.469991  7894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:00.470840  7853 pending_rounds.cc:107] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting uncommitted NO_OP operation due to leader change: 15.10
W20260709 14:53:00.471397  7894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:00.472440 13206 raft_consensus.cc:2804] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 14:53:00.473059 13206 raft_consensus.cc:493] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:00.473599 13206 raft_consensus.cc:3060] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Advancing to term 14
I20260709 14:53:00.474100  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258d6c2dda954bf5b65930fde8ecb9f3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:00.467482  7675 catalog_manager.cc:5697] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 12 to 13, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 13 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:53:00.476938  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:00.483705  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:00.477479  7676 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54344 (request call id 376) took 8791 ms. Trace:
W20260709 14:53:00.478057 12996 consensus_meta.cc:287] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent flushing consensus metadata: real 1.035s	user 0.010s	sys 0.010s
I20260709 14:53:00.485427  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:00.478562  7774 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 3627) took 1203 ms. Trace:
I20260709 14:53:00.479390 13199 raft_consensus.cc:3060] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Advancing to term 17
I20260709 14:53:00.486020 12996 raft_consensus.cc:515] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:00.489499 12990 consensus_queue.cc:1048] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 14:53:00.490402 12913 raft_consensus.cc:515] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:00.491304 12990 consensus_queue.cc:1048] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 14:53:00.480352  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:00.480803  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:00.481132  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:00.482059  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:00.471590  7853 raft_consensus.cc:2889] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 14:53:00.482990  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 50729.5us
W20260709 14:53:00.482039  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 44648us
I20260709 14:53:00.484620  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:00.464469 13106 raft_consensus.cc:515] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:00.497035  7927 raft_consensus.cc:2468] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 12.
I20260709 14:53:00.498337  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:00.500070  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:00.465179  7819 leader_election.cc:304] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:53:00.485321  7676 rpcz_store.cc:276] 0709 14:52:51.625501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:51.630802 (+  5301us) service_pool.cc:224] Handling call
0709 14:53:00.416666 (+8785864us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 14:52:59.076128 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 14:52:59.076805 (+   677us) write_op.cc:432] Acquiring schema lock in shared mode
0709 14:52:59.076842 (+    37us) write_op.cc:435] Acquired schema lock
0709 14:52:59.076860 (+    18us) tablet.cc:662] Decoding operations
0709 14:52:59.088859 (+ 11999us) write_op.cc:620] Acquiring the partition lock for write op
0709 14:52:59.088936 (+    77us) write_op.cc:641] Partition lock acquired for write op
0709 14:52:59.088968 (+    32us) tablet.cc:685] Acquiring locks for 5 operations
0709 14:52:59.138385 (+ 49417us) tablet.cc:701] Row locks acquired
0709 14:52:59.138413 (+    28us) write_op.cc:260] PREPARE: finished
0709 14:52:59.138592 (+   179us) write_op.cc:270] Start()
0709 14:52:59.138734 (+   142us) write_op.cc:276] Timestamp: P: 1783608779138537 usec, L: 0
0709 14:52:59.138758 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 14:52:59.139587 (+   829us) log.cc:844] Serialized 2079 byte log entry
0709 14:52:59.407878 (+268291us) op_driver.cc:464] REPLICATION: finished
0709 14:52:59.655611 (+247733us) write_op.cc:301] APPLY: starting
0709 14:52:59.677988 (+ 22377us) tablet.cc:1367] starting BulkCheckPresence
0709 14:52:59.704068 (+ 26080us) tablet.cc:1370] finished BulkCheckPresence
0709 14:52:59.704218 (+   150us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 14:52:59.853135 (+148917us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 14:52:59.853433 (+   298us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=10,key_file_lookups=10,delta_file_lookups=10,mrs_lookups=0
0709 14:52:59.853485 (+    52us) write_op.cc:312] APPLY: finished
0709 14:52:59.853820 (+   335us) log.cc:844] Serialized 57 byte log entry
0709 14:52:59.854061 (+   241us) write_op.cc:489] Releasing partition, row and schema locks
0709 14:52:59.854208 (+   147us) write_op.cc:454] Released schema lock
0709 14:52:59.854269 (+    61us) write_op.cc:341] FINISH: Updating metrics
0709 14:52:59.854867 (+   598us) write_op.cc:489] Releasing partition, row and schema locks
0709 14:52:59.854898 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1122768,"reported_tablets":23,"child_traces":[["op",{"apply.queue_time_us":206105,"apply.run_cpu_time_us":10326,"apply.run_wall_time_us":203850,"cfile_cache_hit":22,"cfile_cache_hit_bytes":24967,"num_ops":5,"prepare.queue_time_us":310814,"prepare.run_cpu_time_us":11781,"prepare.run_wall_time_us":175660,"raft.queue_time_us":97964,"raft.run_cpu_time_us":31954,"raft.run_wall_time_us":261102,"replication_time_us":239080,"thread_start_us":502931,"threads_started":4,"wal-append.queue_time_us":94789}]]}
I20260709 14:53:00.486908  7774 rpcz_store.cc:276] 0709 14:52:59.274863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:59.275733 (+   870us) service_pool.cc:224] Handling call
0709 14:52:59.318238 (+ 42505us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 14:52:59.323737 (+  5499us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:52:59.323781 (+    44us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 14:52:59.324576 (+   795us) log.cc:844] Serialized 52 byte log entry
0709 14:53:00.401401 (+1076825us) raft_consensus.cc:1645] Marking committed up to 9
0709 14:53:00.453647 (+ 52246us) log.cc:844] Serialized 14 byte log entry
0709 14:53:00.477851 (+ 24204us) log.cc:844] Serialized 14 byte log entry
0709 14:53:00.478105 (+   254us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:53:00.478234 (+   129us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:53:00.478300 (+    66us) raft_consensus.cc:1685] finished
0709 14:53:00.478310 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:53:00.478505 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":89066,"prepare.queue_time_us":52356,"prepare.run_cpu_time_us":119,"prepare.run_wall_time_us":95,"raft.queue_time_us":31303,"raft.run_cpu_time_us":348,"raft.run_wall_time_us":355,"spinlock_wait_cycles":3968,"thread_start_us":976634,"threads_started":1,"wal-append.queue_time_us":851568}
I20260709 14:53:00.505167  7777 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 3642) took 1220 ms. Trace:
I20260709 14:53:00.507088 13199 raft_consensus.cc:2749] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 14:53:00.506292  7675 catalog_manager.cc:5697] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 13 to 17, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 17 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:53:00.529080  7777 rpcz_store.cc:276] 0709 14:52:59.285090 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:53:00.231799 (+946709us) service_pool.cc:224] Handling call
0709 14:53:00.232473 (+   674us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 14:53:00.233188 (+   715us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:53:00.233220 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 14:53:00.322167 (+ 88947us) log.cc:844] Serialized 52 byte log entry
0709 14:53:00.375872 (+ 53705us) raft_consensus.cc:1645] Marking committed up to 11
0709 14:53:00.452826 (+ 76954us) log.cc:844] Serialized 14 byte log entry
0709 14:53:00.504456 (+ 51630us) spinlock_profiling.cc:243] Waited 18.3 ms on lock 0x7b540030dca0. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae09733 00007fb68ae8edbf 00007fb68ae8d83e 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2 00007fb6891c948c
0709 14:53:00.504533 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:53:00.504647 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:53:00.504713 (+    66us) raft_consensus.cc:1685] finished
0709 14:53:00.504839 (+   126us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:53:00.505051 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28063,"prepare.queue_time_us":76843,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":52,"raft.queue_time_us":24800,"raft.run_cpu_time_us":302,"raft.run_wall_time_us":304,"spinlock_wait_cycles":42172800,"thread_start_us":52590,"threads_started":1,"wal-append.queue_time_us":83088}
I20260709 14:53:00.531855  7675 catalog_manager.cc:5697] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:53:00.507944  7745 leader_election.cc:304] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:00.507616  7744 leader_election.cc:304] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:00.534886  7745 leader_election.cc:304] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:00.536322 13204 raft_consensus.cc:2764] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 14:53:00.533138  7775 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37136 (request call id 2835) took 1069 ms. Trace:
I20260709 14:53:00.537832  7775 rpcz_store.cc:276] 0709 14:52:59.463790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:53:00.305970 (+842180us) service_pool.cc:224] Handling call
0709 14:53:00.403638 (+ 97668us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:53:00.407781 (+  4143us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:53:00.407828 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:53:00.408978 (+  1150us) log.cc:844] Serialized 26 byte log entry
0709 14:53:00.500231 (+ 91253us) raft_consensus.cc:1645] Marking committed up to 9
0709 14:53:00.500286 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:53:00.500364 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:53:00.532778 (+ 32414us) raft_consensus.cc:1685] finished
0709 14:53:00.532812 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:53:00.533059 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":198,"raft.run_cpu_time_us":415,"raft.run_wall_time_us":416,"thread_start_us":90506,"threads_started":1,"wal-append.queue_time_us":121460}
I20260709 14:53:00.537369 13204 raft_consensus.cc:3060] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Advancing to term 17
I20260709 14:53:00.537453 13132 raft_consensus.cc:2749] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 14:53:00.542865 13199 raft_consensus.cc:493] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:00.543797 13199 raft_consensus.cc:515] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:00.545077 13106 leader_election.cc:290] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:53:00.546793  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 81781.1us
I20260709 14:53:00.549055 13169 raft_consensus.cc:2804] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Leader election won for term 17
I20260709 14:53:00.549790 13169 raft_consensus.cc:697] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:53:00.551167 13169 consensus_queue.cc:237] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:00.537938  7675 catalog_manager.cc:5697] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 16 to 17, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 17 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:53:00.556690  7675 catalog_manager.cc:5697] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 14 to 15, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 15 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:53:00.558552 13106 consensus_queue.cc:1059] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 14:53:00.560902 13148 raft_consensus.cc:3055] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 LEADER]: Stepping down as leader of term 16
I20260709 14:53:00.561595 13148 raft_consensus.cc:740] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:53:00.563016 13148 consensus_queue.cc:260] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:00.564275 13148 raft_consensus.cc:3060] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Advancing to term 17
I20260709 14:53:00.569535 12990 consensus_queue.cc:1048] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 14:53:00.559005  7675 catalog_manager.cc:5697] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:53:00.579573 12996 leader_election.cc:290] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 17 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:00.584168 12990 raft_consensus.cc:493] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:00.585394 12990 raft_consensus.cc:515] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:00.551066 13199 leader_election.cc:290] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:00.590047 12990 leader_election.cc:290] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:53:00.590461  7893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:00.593915 12862 consensus_queue.cc:1059] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 14:53:00.590758 13204 raft_consensus.cc:2749] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 14:53:00.593464 12990 consensus_queue.cc:1059] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 14:53:00.595041 12862 raft_consensus.cc:3055] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 14:53:00.596441 12862 raft_consensus.cc:740] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:00.597677 12862 consensus_queue.cc:260] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:00.599371 12862 raft_consensus.cc:3060] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 14:53:00.565819 12913 leader_election.cc:290] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 17 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:53:00.601905  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:00.604439 13155 raft_consensus.cc:493] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:00.605473 13155 raft_consensus.cc:515] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:00.608235 13155 leader_election.cc:290] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:00.609661 13204 raft_consensus.cc:493] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9418391fa82a42c79c6cad13ba91d964)
I20260709 14:53:00.610637 13204 raft_consensus.cc:515] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:53:00.618129  8639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce9c0ef2db24c13a8b1402f21819458" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9418391fa82a42c79c6cad13ba91d964" is_pre_election: true
I20260709 14:53:00.618366 13206 raft_consensus.cc:515] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:00.613564 12913 raft_consensus.cc:3055] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 14:53:00.623572  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
W20260709 14:53:00.613432  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 55498.2us
I20260709 14:53:00.588872  7744 leader_election.cc:304] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:00.594218  7894 leader_election.cc:304] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:00.632107  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:00.637702 13199 raft_consensus.cc:2749] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 14:53:00.631806  7675 catalog_manager.cc:5697] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 12 to 16, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 16 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
W20260709 14:53:00.639218  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:53:00.640775  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 46681.5us
W20260709 14:53:00.638037  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 49515us
I20260709 14:53:00.642314 13206 leader_election.cc:290] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 14 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:00.642916  7744 leader_election.cc:304] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:53:00.642532  7675 catalog_manager.cc:5697] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 14 to 15, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 15 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:53:00.644004  7744 leader_election.cc:304] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:53:00.644356  7675 catalog_manager.cc:5697] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 15 to 16, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 16 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:53:00.632658 13204 leader_election.cc:290] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785), 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68:42321)
I20260709 14:53:00.632479 12913 raft_consensus.cc:740] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:00.652890 13138 raft_consensus.cc:2749] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 14:53:00.643939 13206 raft_consensus.cc:2804] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 14:53:00.649825  7675 catalog_manager.cc:5697] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:53:00.664958  7675 catalog_manager.cc:5697] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 14 to 15, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 15 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:53:00.655967 13206 raft_consensus.cc:493] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting leader election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:00.666853 13206 raft_consensus.cc:3060] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Advancing to term 17
I20260709 14:53:00.654120 12913 consensus_queue.cc:260] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:00.654759 13199 raft_consensus.cc:2804] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Leader election won for term 19
I20260709 14:53:00.659320  7744 leader_election.cc:304] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:53:00.678030  7675 catalog_manager.cc:5697] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:53:00.682696 13204 raft_consensus.cc:2804] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader election won for term 14
I20260709 14:53:00.687268  7675 catalog_manager.cc:5697] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 14 to 16, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 16 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:53:00.690656 13155 consensus_queue.cc:1059] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 14:53:00.683769 13204 raft_consensus.cc:697] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:53:00.683904 13199 raft_consensus.cc:697] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:53:00.691824 13138 raft_consensus.cc:3055] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 14:53:00.695204 13138 raft_consensus.cc:740] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:00.695667 13204 consensus_queue.cc:237] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:00.688079 12913 raft_consensus.cc:3060] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 14:53:00.696739 13138 consensus_queue.cc:260] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:00.694135  7744 leader_election.cc:304] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:53:00.699898 13138 raft_consensus.cc:3060] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Advancing to term 19
I20260709 14:53:00.702116  7894 leader_election.cc:304] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:53:00.694711  7675 catalog_manager.cc:5697] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 13 to 14, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 14 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:53:00.707301  7819 leader_election.cc:304] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:00.709165 13132 raft_consensus.cc:2804] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 14:53:00.709728 13132 raft_consensus.cc:493] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:00.710119 13132 raft_consensus.cc:3060] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Advancing to term 16
I20260709 14:53:00.715216  7675 catalog_manager.cc:5697] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 14 to 15, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 15 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:53:00.706429 13155 raft_consensus.cc:493] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:00.717808 13155 raft_consensus.cc:515] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:00.720358 13155 leader_election.cc:290] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:00.720636 12862 raft_consensus.cc:2804] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 14:53:00.721104 12862 raft_consensus.cc:493] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:00.723446 12862 raft_consensus.cc:3060] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 14:53:00.724082 13199 consensus_queue.cc:237] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:00.724992 13169 raft_consensus.cc:2749] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 14:53:00.726449 13132 raft_consensus.cc:515] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:00.740455  7819 leader_election.cc:304] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:00.741868  7675 catalog_manager.cc:5697] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 15 to 16, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 16 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:53:00.744481  7675 catalog_manager.cc:5697] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 13 to 14, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 14 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:53:00.746023 13169 raft_consensus.cc:2749] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 14:53:00.749573  7819 leader_election.cc:304] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:00.747772  7744 leader_election.cc:304] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
W20260709 14:53:00.761415  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 66169.4us
I20260709 14:53:00.759718 12965 raft_consensus.cc:2804] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Leader election won for term 20
I20260709 14:53:00.764209 12965 raft_consensus.cc:697] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:53:00.764331 13169 raft_consensus.cc:2749] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 14:53:00.760404 12862 raft_consensus.cc:515] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:00.765861 12965 consensus_queue.cc:237] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:00.767884 11963 consensus_queue.cc:1048] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 14:53:00.763248 13132 leader_election.cc:290] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 16 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:00.778126  7744 leader_election.cc:304] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:53:00.770287 12862 leader_election.cc:290] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 15 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:53:00.780287  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:00.797570 12965 raft_consensus.cc:493] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:00.798882 13204 raft_consensus.cc:2804] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader election won for term 12
I20260709 14:53:00.799794  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:00.803984 12990 consensus_queue.cc:1059] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 14:53:00.804930  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 55754.6us
I20260709 14:53:00.807626  7775 raft_consensus.cc:2410] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for term 16 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 14:53:00.807638 13204 raft_consensus.cc:697] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:53:00.810199 12862 consensus_queue.cc:1048] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.009s
I20260709 14:53:00.817436 13132 raft_consensus.cc:493] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:00.815644 12989 raft_consensus.cc:3055] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 14:53:00.824090 13144 consensus_queue.cc:1059] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 14:53:00.821864 13169 consensus_queue.cc:1059] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 14:53:00.820556 13132 raft_consensus.cc:515] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:00.828302 13204 consensus_queue.cc:237] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:00.830085  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:00.830884  7777 raft_consensus.cc:3060] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Advancing to term 14
I20260709 14:53:00.826161 13169 raft_consensus.cc:3055] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 LEADER]: Stepping down as leader of term 13
I20260709 14:53:00.831645 13169 raft_consensus.cc:740] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:53:00.832717 13169 consensus_queue.cc:260] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:00.834378 13169 raft_consensus.cc:3060] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Advancing to term 14
I20260709 14:53:00.836035  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:00.837890  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:00.838707  7854 raft_consensus.cc:2468] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 17.
I20260709 14:53:00.840332  7777 raft_consensus.cc:2410] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 14:53:00.824491 12989 raft_consensus.cc:740] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:00.825351 13144 raft_consensus.cc:3055] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 14:53:00.841029  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:00.843647  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:00.816707 12965 raft_consensus.cc:515] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:00.856069  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:00.857704  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:00.859010  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:00.859858  7848 raft_consensus.cc:3060] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Advancing to term 15
I20260709 14:53:00.860320  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:00.861941  7854 raft_consensus.cc:1240] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 14:53:00.862089  7853 raft_consensus.cc:1240] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 19. Current term is 20. Ops: [19.11-19.11]
I20260709 14:53:00.844398 13144 raft_consensus.cc:740] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:00.863724  7854 raft_consensus.cc:1275] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 14:53:00.863750 13144 consensus_queue.cc:260] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:00.867255 13144 raft_consensus.cc:3060] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 14:53:00.844071 12862 consensus_queue.cc:1048] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 14:53:00.870124 13199 raft_consensus.cc:493] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:00.864815  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:00.873078  7894 leader_election.cc:304] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:00.856886  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:00.873615  7845 raft_consensus.cc:2468] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 18.
W20260709 14:53:00.918870  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 44017.8us
I20260709 14:53:00.899964 13199 raft_consensus.cc:515] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:00.929569 13162 raft_consensus.cc:2804] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 14:53:00.930088 13162 raft_consensus.cc:493] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:00.930605 13162 raft_consensus.cc:3060] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 14:53:00.842554 13206 raft_consensus.cc:515] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:00.931994 13199 leader_election.cc:290] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:00.931198 12965 leader_election.cc:290] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:00.952044  7778 raft_consensus.cc:1275] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 14:53:00.958424  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:00.965705  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:00.967613 13132 leader_election.cc:290] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:00.956122 12724 raft_consensus.cc:493] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:00.973491 12989 consensus_queue.cc:260] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:00.974335 12724 raft_consensus.cc:515] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:00.975256 12989 raft_consensus.cc:3060] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 14:53:00.991139  7854 raft_consensus.cc:2393] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 14: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:53:01.003527  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:00.955273 13199 raft_consensus.cc:493] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
W20260709 14:53:00.997850 13217 log.cc:927] Time spent T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.185s	user 0.000s	sys 0.002s
W20260709 14:53:01.009810  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 89213.8us
I20260709 14:53:01.018762  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:53:01.013679  7893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:00.977139 12724 leader_election.cc:290] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:53:01.019941  7893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:01.019516  7849 raft_consensus.cc:2468] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 16.
I20260709 14:53:01.025024  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:01.015525  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258d6c2dda954bf5b65930fde8ecb9f3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:01.033784  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:00.998097 13155 raft_consensus.cc:493] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:53:01.035399  7774 raft_consensus.cc:1240] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 15. Current term is 16. Ops: []
I20260709 14:53:01.038388  7778 raft_consensus.cc:1275] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 14:53:01.041846  7851 raft_consensus.cc:2393] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 13: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:53:01.043247  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:01.050019  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:01.050096  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:01.031534 12724 raft_consensus.cc:493] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:01.049521 13132 raft_consensus.cc:493] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:01.057861 13132 raft_consensus.cc:515] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:01.060536  7854 raft_consensus.cc:2410] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for term 17 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 14:53:01.063439  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:01.064523  7851 raft_consensus.cc:3060] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Advancing to term 19
I20260709 14:53:01.069783 11963 consensus_queue.cc:1059] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 14:53:01.070693  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:01.071633  7845 raft_consensus.cc:2393] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 16: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:53:01.046923 13199 raft_consensus.cc:515] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:01.074581 12990 raft_consensus.cc:3055] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 14:53:01.075239 12990 raft_consensus.cc:740] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:01.076179  7777 raft_consensus.cc:1240] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 LEADER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 11. Current term is 12. Ops: []
I20260709 14:53:01.076756 12990 consensus_queue.cc:260] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:01.099382  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:01.100593  7774 raft_consensus.cc:2468] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 17.
I20260709 14:53:01.104910  7848 raft_consensus.cc:2468] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 15.
I20260709 14:53:01.106135  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:01.116456  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:01.117770  7849 raft_consensus.cc:2468] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 11.
I20260709 14:53:01.121198  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:01.121598  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c563cc7cfbe4d59be4ffc5cf847ce56" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:01.125358  7845 raft_consensus.cc:2468] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 9.
I20260709 14:53:01.122103  7778 raft_consensus.cc:2468] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 17.
I20260709 14:53:01.045529 13155 raft_consensus.cc:515] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:01.131656 13155 leader_election.cc:290] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:01.133585  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:01.134147 13132 leader_election.cc:290] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:01.135401 13199 leader_election.cc:290] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:01.140234 13206 leader_election.cc:290] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:01.140599  7851 raft_consensus.cc:2468] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 19.
W20260709 14:53:01.144533  7893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:01.151396  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: true dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:01.152392  7845 raft_consensus.cc:3060] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:53:01.156414  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:01.160171  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: true dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:01.164230  7851 raft_consensus.cc:2393] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 14: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
W20260709 14:53:01.165797  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 146281us
W20260709 14:53:01.166213  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:01.168431  7778 raft_consensus.cc:1275] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 14:53:01.169473 13144 consensus_queue.cc:1048] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 14:53:01.122574 12724 raft_consensus.cc:515] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:01.178174  7777 raft_consensus.cc:2410] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 14:53:01.177330  7894 leader_election.cc:304] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:01.181733  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:01.183457  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:01.184237  7779 raft_consensus.cc:2468] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 18.
I20260709 14:53:01.194494  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: true dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:01.195218  7851 raft_consensus.cc:3060] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Advancing to term 20
I20260709 14:53:01.197520  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:01.199517  7773 raft_consensus.cc:3060] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Advancing to term 18
I20260709 14:53:01.203188  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:01.204658  7852 raft_consensus.cc:2410] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 14:53:01.204957  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:01.205967  7849 raft_consensus.cc:2393] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 16: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:53:01.205729  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:01.197858  7778 raft_consensus.cc:2468] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 16.
I20260709 14:53:01.198226  7894 leader_election.cc:304] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:01.212074  7846 raft_consensus.cc:2468] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 10.
I20260709 14:53:01.213806  7773 raft_consensus.cc:2468] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 18.
I20260709 14:53:01.216696 11963 raft_consensus.cc:2804] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 14:53:01.193106 13148 raft_consensus.cc:493] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:01.231251 13148 raft_consensus.cc:515] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:01.234679  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:01.235539  7848 raft_consensus.cc:2468] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 17.
I20260709 14:53:01.221084 11963 raft_consensus.cc:697] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:01.207460 13225 raft_consensus.cc:2804] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 14:53:01.222890  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:01.236896 13225 raft_consensus.cc:493] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:01.237401 13225 raft_consensus.cc:3060] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Advancing to term 19
I20260709 14:53:01.225848  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:01.227075  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:01.240490  7852 raft_consensus.cc:2393] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 15: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:53:01.227896  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:01.225174  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:01.237309 11963 consensus_queue.cc:237] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:01.247370 12724 leader_election.cc:290] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:01.180490 12913 consensus_queue.cc:1059] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 14:53:01.248659 12913 raft_consensus.cc:3055] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 14:53:01.249069 12913 raft_consensus.cc:740] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:01.249143  7851 raft_consensus.cc:2468] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 20.
I20260709 14:53:01.250379 12913 consensus_queue.cc:260] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:01.251767 12913 raft_consensus.cc:3060] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Advancing to term 20
I20260709 14:53:01.257228  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:01.258354  7848 raft_consensus.cc:2468] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 14.
I20260709 14:53:01.259591  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:01.268380 13225 raft_consensus.cc:515] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:53:01.269413  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:53:01.270929 13222 log.cc:927] Time spent T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.240s	user 0.000s	sys 0.001s
I20260709 14:53:01.273196 13225 leader_election.cc:290] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:01.274842  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:01.279428  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:01.280377  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:01.280889  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:01.281204  7776 raft_consensus.cc:2468] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 17.
I20260709 14:53:01.281908  7772 raft_consensus.cc:1275] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 14:53:01.280403  7775 raft_consensus.cc:2468] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 14.
I20260709 14:53:01.283059  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:01.284003  7771 raft_consensus.cc:3060] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Advancing to term 15
I20260709 14:53:01.289688  7779 raft_consensus.cc:2468] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 11.
W20260709 14:53:01.290500  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:01.297839  7771 raft_consensus.cc:2468] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 15.
I20260709 14:53:01.319361  7745 leader_election.cc:304] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:01.320914 12724 raft_consensus.cc:2749] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 14:53:01.323725 13148 leader_election.cc:290] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:01.331276  7745 leader_election.cc:304] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:01.333331 13206 raft_consensus.cc:2804] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 14:53:01.333815 13206 raft_consensus.cc:493] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:01.334198 13206 raft_consensus.cc:3060] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:53:01.335781  7745 leader_election.cc:304] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
W20260709 14:53:01.334095  8599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 108025us
I20260709 14:53:01.353629  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:01.367492  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:01.337649 13148 raft_consensus.cc:493] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:01.369829  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:01.350096 12990 raft_consensus.cc:3060] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 14:53:01.376828 13148 raft_consensus.cc:515] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:01.346643 12724 raft_consensus.cc:2804] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 14:53:01.342007  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:01.362222  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:01.341037  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:01.340315  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:01.346029  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783e4874513449ef9084b833f188a6d3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:01.261072  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:53:01.337409  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:01.346741  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:01.400584  7845 raft_consensus.cc:2468] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 12.
I20260709 14:53:01.338058 13169 raft_consensus.cc:493] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:01.376969  7745 leader_election.cc:304] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:01.405992  7854 raft_consensus.cc:2410] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for term 17 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 14:53:01.401886  7846 raft_consensus.cc:2393] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 13: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
W20260709 14:53:01.378849 13224 log.cc:927] Time spent T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.202s	user 0.001s	sys 0.001s
I20260709 14:53:01.379688  7849 raft_consensus.cc:2376] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 19. Re-sending same reply.
I20260709 14:53:01.402737  7850 raft_consensus.cc:3060] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Advancing to term 14
I20260709 14:53:01.403213  7848 raft_consensus.cc:2393] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 19: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:53:01.414228  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:01.409353  7745 leader_election.cc:304] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:01.408740  7852 raft_consensus.cc:2393] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 16: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:53:01.417054  7853 raft_consensus.cc:2368] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 14. Current term is 15.
W20260709 14:53:01.421526  7893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:01.420816  7819 leader_election.cc:304] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:53:01.421695  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:01.424129  7854 raft_consensus.cc:2468] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 11.
I20260709 14:53:01.420781  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c563cc7cfbe4d59be4ffc5cf847ce56" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:01.423311  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:01.426278  7851 raft_consensus.cc:2468] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 9.
I20260709 14:53:01.429219  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:01.433215  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:01.411422 13169 raft_consensus.cc:515] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:01.435086  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:01.436100  7848 raft_consensus.cc:2393] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 18: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:53:01.399997 12724 raft_consensus.cc:493] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting leader election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:01.439805  7777 raft_consensus.cc:1275] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 14:53:01.430195  7849 raft_consensus.cc:2468] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 15.
I20260709 14:53:01.437783  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:01.439107  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:01.445530  7771 raft_consensus.cc:3060] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Advancing to term 19
I20260709 14:53:01.437944  7819 leader_election.cc:304] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:01.441591  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:01.444612  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:01.442480  7845 raft_consensus.cc:2468] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 12.
I20260709 14:53:01.442050  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:01.411739 13199 raft_consensus.cc:2764] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 14:53:01.445096  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:01.447853  7846 raft_consensus.cc:2468] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 16.
I20260709 14:53:01.450173  7852 raft_consensus.cc:2410] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for term 17 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 14:53:01.437179  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:01.452138  7848 raft_consensus.cc:2393] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 14: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:53:01.453402  7854 raft_consensus.cc:2393] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 16: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
W20260709 14:53:01.453994  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 44826.8us
I20260709 14:53:01.457229  7853 raft_consensus.cc:2393] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 15: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:53:01.437179 13169 leader_election.cc:290] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:01.441510 13204 raft_consensus.cc:2749] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 14:53:01.435195 12996 raft_consensus.cc:2804] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Leader election won for term 16
I20260709 14:53:01.457927  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:01.471566  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:01.472445  7848 raft_consensus.cc:2393] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 17: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:53:01.445046 12724 raft_consensus.cc:3060] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Advancing to term 17
I20260709 14:53:01.472472  7927 raft_consensus.cc:2393] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 16: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:53:01.466567  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:01.467360  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:01.467622  7851 raft_consensus.cc:2393] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 13: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:53:01.468277  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258d6c2dda954bf5b65930fde8ecb9f3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:01.469482  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:01.478062  7854 raft_consensus.cc:1275] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 14:53:01.464202 13162 consensus_meta.cc:287] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent flushing consensus metadata: real 0.532s	user 0.011s	sys 0.003s
I20260709 14:53:01.481343  7852 raft_consensus.cc:2410] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for term 19 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 14:53:01.490823  7771 raft_consensus.cc:2468] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 19.
I20260709 14:53:01.484236  7853 raft_consensus.cc:1275] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 14:53:01.482883 13162 raft_consensus.cc:515] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:01.510632 13162 leader_election.cc:290] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 18 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:01.514086  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:01.515188  7927 raft_consensus.cc:2468] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 14.
W20260709 14:53:01.517570  7893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:01.522723  7850 raft_consensus.cc:2468] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 14.
W20260709 14:53:01.515121 13233 log.cc:927] Time spent T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 14:53:01.484889 12996 raft_consensus.cc:697] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:53:01.534910  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:01.536859  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:01.534943  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:01.541404  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:01.543229  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:01.544646  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:01.545564  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:01.546757  7922 raft_consensus.cc:2393] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 14: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:53:01.550820  7926 raft_consensus.cc:2393] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 17: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:53:01.539674  7928 raft_consensus.cc:2468] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 15.
I20260709 14:53:01.550460  7923 raft_consensus.cc:2468] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 11.
I20260709 14:53:01.557586  7850 raft_consensus.cc:1275] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 14:53:01.560531  7850 raft_consensus.cc:1240] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 17. Current term is 18. Ops: []
W20260709 14:53:01.562583  7894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:01.569851  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:01.574681  7852 raft_consensus.cc:1275] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 10. (term mismatch)
I20260709 14:53:01.558486 13148 leader_election.cc:290] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:01.574563  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:01.582173  7848 raft_consensus.cc:3060] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Advancing to term 19
I20260709 14:53:01.583757  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:01.575184  7852 pending_rounds.cc:85] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting all ops after (but not including) 9
I20260709 14:53:01.583812  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:01.584625  7852 pending_rounds.cc:107] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting uncommitted NO_OP operation due to leader change: 15.10
I20260709 14:53:01.585376  7852 raft_consensus.cc:2889] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:53:01.591281  7845 raft_consensus.cc:1240] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 18. Current term is 19. Ops: []
I20260709 14:53:01.596613 13226 consensus_queue.cc:1059] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 14:53:01.597292  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
W20260709 14:53:01.598336 13235 log.cc:927] Time spent T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.128s	user 0.000s	sys 0.001s
I20260709 14:53:01.567934 13206 raft_consensus.cc:515] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:01.594616 13162 consensus_queue.cc:1048] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 14:53:01.606592  7848 raft_consensus.cc:2468] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 19.
I20260709 14:53:01.629209  6549 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 14:53:01.630975 13239 log.cc:927] Time spent T 00000000000000000000000000000000 P 133636659113430cb53b321cb0b1d9ee: Append to log took a long time: real 0.071s	user 0.003s	sys 0.000s
I20260709 14:53:01.635735  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:01.638398  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:01.638688  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:01.639394  7852 raft_consensus.cc:3060] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Advancing to term 18
I20260709 14:53:01.638459  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:01.640849  7928 raft_consensus.cc:1275] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 14:53:01.642270  7924 raft_consensus.cc:2368] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 18. Current term is 19.
I20260709 14:53:01.643203 13206 leader_election.cc:290] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:01.640723  7919 raft_consensus.cc:2393] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 15: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:53:01.638459  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:01.645164  7922 raft_consensus.cc:2368] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 17. Current term is 18.
I20260709 14:53:01.648398  7923 raft_consensus.cc:2410] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for term 17 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
W20260709 14:53:01.649187  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:01.651983 13144 raft_consensus.cc:3055] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 14:53:01.652650 13144 raft_consensus.cc:740] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:01.654255  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
W20260709 14:53:01.654397  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 216547us
I20260709 14:53:01.656635  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:01.640940  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783e4874513449ef9084b833f188a6d3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:01.673383  7921 raft_consensus.cc:2393] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 13: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:53:01.674968  7927 raft_consensus.cc:2393] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 15: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:53:01.679350  7925 raft_consensus.cc:1275] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 11. (term mismatch)
I20260709 14:53:01.681739 13240 raft_consensus.cc:2749] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 14:53:01.679891  7925 pending_rounds.cc:85] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0: Aborting all ops after (but not including) 10
I20260709 14:53:01.686779  7925 pending_rounds.cc:107] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0: Aborting uncommitted NO_OP operation due to leader change: 15.11
I20260709 14:53:01.687068  7925 raft_consensus.cc:2889] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:53:01.687343  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
W20260709 14:53:01.687947  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:01.688369  7920 raft_consensus.cc:2410] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for term 20 because replica has last-logged OpId of term: 19 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 14:53:01.640300 12996 consensus_queue.cc:237] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:01.694662 13144 consensus_queue.cc:260] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:01.652240 12724 raft_consensus.cc:515] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:01.711330  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:01.714526  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:01.714706  7920 raft_consensus.cc:2393] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 14: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:53:01.715919  7925 raft_consensus.cc:2393] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 19: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:53:01.719846  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:01.723460  7771 raft_consensus.cc:1275] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 14:53:01.724604 12724 leader_election.cc:290] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:01.724917  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783e4874513449ef9084b833f188a6d3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:01.725807  7771 raft_consensus.cc:2368] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 13. Current term is 14.
I20260709 14:53:01.725945  7770 raft_consensus.cc:1240] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 13. Current term is 14. Ops: []
I20260709 14:53:01.726670  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:01.726948  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:01.727521  7770 raft_consensus.cc:2468] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 16.
I20260709 14:53:01.727679  7779 raft_consensus.cc:1275] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 14:53:01.728497  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:01.728705  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:01.714071 13144 raft_consensus.cc:3060] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 14:53:01.733904  7777 raft_consensus.cc:1240] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 16. Current term is 17. Ops: []
I20260709 14:53:01.713148 13206 raft_consensus.cc:493] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:01.744133 13206 raft_consensus.cc:515] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:01.744179  7920 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
mode: GRACEFUL
new_leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:48676
I20260709 14:53:01.746588 13206 leader_election.cc:290] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:01.749338 12724 raft_consensus.cc:493] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9418391fa82a42c79c6cad13ba91d964)
I20260709 14:53:01.750039 12724 raft_consensus.cc:515] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:53:01.753232  7745 leader_election.cc:304] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:01.755865 13241 raft_consensus.cc:2749] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 14:53:01.757376  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:01.758572  7926 raft_consensus.cc:1240] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 14:53:01.758765  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:01.760566  7893 leader_election.cc:304] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:01.761715 13225 raft_consensus.cc:2749] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 14:53:01.762771  7893 leader_election.cc:304] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:01.763700 13247 raft_consensus.cc:2749] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 14:53:01.764379  8639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9441e831627143a991a1556dcdce71e3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9418391fa82a42c79c6cad13ba91d964" is_pre_election: true
I20260709 14:53:01.764619 13247 consensus_queue.cc:1048] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 14:53:01.767120 12724 leader_election.cc:290] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68:42321)
I20260709 14:53:01.736562  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:01.774519  7925 raft_consensus.cc:2393] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 20: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:53:01.737913  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:01.775749  7775 raft_consensus.cc:3060] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Advancing to term 18
I20260709 14:53:01.740797  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:01.741572  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
W20260709 14:53:01.779016  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:01.788023  7852 raft_consensus.cc:2468] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 18.
I20260709 14:53:01.797130  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:01.798530  7776 raft_consensus.cc:2393] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 19: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:53:01.798417  7745 leader_election.cc:304] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:01.800483 13206 raft_consensus.cc:3060] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Advancing to term 13
I20260709 14:53:01.805373  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:01.807036  7921 raft_consensus.cc:1275] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 14:53:01.807989  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:01.808467  7927 raft_consensus.cc:1275] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 14:53:01.809544  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:01.810190  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:01.808578  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:01.810515  7926 raft_consensus.cc:2410] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for term 17 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 14:53:01.809439  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:01.823760  7853 raft_consensus.cc:1240] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 12. Current term is 13. Ops: []
I20260709 14:53:01.827716  7920 raft_consensus.cc:606] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 LEADER]: Received request to transfer leadership to TS 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:53:01.838662  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:01.842568  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:01.844610  7745 leader_election.cc:400] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 14 election: Vote denied by peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529) with higher term. Message: Invalid argument: T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 14. Current term is 15.
I20260709 14:53:01.845137  7745 leader_election.cc:403] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 14:53:01.848218  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:01.851222  7920 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
mode: GRACEFUL
new_leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:48676
I20260709 14:53:01.854863  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:01.855309  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:01.855701  7777 raft_consensus.cc:3060] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Advancing to term 19
I20260709 14:53:01.851907  7920 raft_consensus.cc:606] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 LEADER]: Received request to transfer leadership to TS 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:53:01.851069 13162 consensus_queue.cc:1048] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.007s
I20260709 14:53:01.866930  7893 leader_election.cc:304] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:01.869786  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
W20260709 14:53:01.871178  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:01.880580  7778 raft_consensus.cc:2468] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 15.
I20260709 14:53:01.882377  7893 leader_election.cc:304] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:01.884158  7772 raft_consensus.cc:2468] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 15.
I20260709 14:53:01.894654  7776 raft_consensus.cc:1240] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 17. Current term is 18. Ops: []
I20260709 14:53:01.890131 12724 raft_consensus.cc:2749] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529) with higher term. Message: Invalid argument: T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 14. Current term is 15.
I20260709 14:53:01.890493 13225 raft_consensus.cc:2749] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 14:53:01.897616  7928 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "258d6c2dda954bf5b65930fde8ecb9f3"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
mode: GRACEFUL
new_leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:48676
I20260709 14:53:01.898051 13162 raft_consensus.cc:493] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:01.898442  7928 raft_consensus.cc:606] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 LEADER]: Received request to transfer leadership to TS 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:01.898602 13162 raft_consensus.cc:515] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:01.902706 12724 raft_consensus.cc:493] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:01.903508 12724 raft_consensus.cc:515] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:01.903728  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:01.904723  7772 raft_consensus.cc:2468] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 17.
W20260709 14:53:01.894413  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 78095.7us
I20260709 14:53:01.905833  7745 leader_election.cc:304] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:01.907100  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:01.908030  7928 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
mode: GRACEFUL
new_leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:48676
I20260709 14:53:01.908473 13241 raft_consensus.cc:2804] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 14:53:01.908109  7776 raft_consensus.cc:2468] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 16.
I20260709 14:53:01.908982 13241 raft_consensus.cc:493] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
W20260709 14:53:01.914955  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 74959.5us
I20260709 14:53:01.911695  7772 raft_consensus.cc:1275] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 14:53:01.908836  7928 raft_consensus.cc:606] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Received request to transfer leadership to TS 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:53:01.915674  7893 leader_election.cc:304] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:01.916077  7777 raft_consensus.cc:2468] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 19.
I20260709 14:53:01.916208  7928 raft_consensus.cc:614] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 14:53:01.917784  7778 raft_consensus.cc:1275] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 14:53:01.917124  7745 leader_election.cc:304] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:01.913142  7775 raft_consensus.cc:2468] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 18.
I20260709 14:53:01.920248 13246 raft_consensus.cc:2804] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 14:53:01.920629 13199 raft_consensus.cc:2804] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 14:53:01.921231 13199 raft_consensus.cc:493] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:01.921708 13199 raft_consensus.cc:3060] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:53:01.920858 13246 raft_consensus.cc:493] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:01.918871 13225 consensus_queue.cc:1048] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.006s
I20260709 14:53:01.924419 13246 raft_consensus.cc:3060] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 14:53:01.918653 13144 raft_consensus.cc:2804] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 14:53:01.925905 13144 raft_consensus.cc:493] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:01.926359 13144 raft_consensus.cc:3060] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 14:53:01.916729 13241 raft_consensus.cc:3060] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:53:01.930197 12724 leader_election.cc:290] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:01.931367  7928 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
mode: GRACEFUL
new_leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:48676
I20260709 14:53:01.932139  7928 raft_consensus.cc:606] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 LEADER]: Received request to transfer leadership to TS 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:01.919085 13162 leader_election.cc:290] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:01.934177  6549 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 14:53:01.934365  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:01.935101  7775 raft_consensus.cc:2468] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 9.
I20260709 14:53:01.936501  6549 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 14:53:01.938921 13246 raft_consensus.cc:515] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:01.936635  7893 leader_election.cc:304] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:01.942325  7745 leader_election.cc:304] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:01.943877 13162 raft_consensus.cc:2804] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 14:53:01.944212  7745 leader_election.cc:304] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:01.913923 13206 raft_consensus.cc:2749] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 14:53:01.945169 12965 raft_consensus.cc:2749] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 14:53:01.946137 13206 raft_consensus.cc:2804] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 14:53:01.944981 13162 raft_consensus.cc:697] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:01.944873 13241 raft_consensus.cc:515] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:01.947434  7745 leader_election.cc:304] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:01.955189  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:01.956218  7778 raft_consensus.cc:3060] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Advancing to term 18
I20260709 14:53:01.957578 12965 raft_consensus.cc:2804] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 14:53:01.958089 12965 raft_consensus.cc:493] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:01.958508 12965 raft_consensus.cc:3060] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Advancing to term 13
I20260709 14:53:01.958947  7744 leader_election.cc:304] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:01.959901 12724 raft_consensus.cc:3060] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Advancing to term 16
I20260709 14:53:01.957825  7745 leader_election.cc:304] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:01.963512  7744 leader_election.cc:304] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:01.964465  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:01.964579  7853 raft_consensus.cc:1275] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 14:53:01.947120 13206 raft_consensus.cc:493] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:01.965783  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:01.968123  7846 raft_consensus.cc:1275] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 14:53:01.964884  7744 leader_election.cc:304] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:01.965358  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:01.969326  7850 raft_consensus.cc:2468] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 15.
I20260709 14:53:01.971539  7819 leader_election.cc:304] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:01.974115  7778 raft_consensus.cc:2468] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 18.
I20260709 14:53:01.974933 13204 raft_consensus.cc:2804] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 14:53:01.976441  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9441e831627143a991a1556dcdce71e3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:01.975804 13204 raft_consensus.cc:493] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:01.967260 13132 raft_consensus.cc:2804] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 14:53:01.981726  7894 leader_election.cc:304] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:01.987131 11963 raft_consensus.cc:2804] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 14:53:01.970283 13206 raft_consensus.cc:3060] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Advancing to term 16
I20260709 14:53:01.989137 11963 raft_consensus.cc:697] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:01.988133  7745 leader_election.cc:304] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:01.983891 13247 consensus_queue.cc:1059] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.008s
I20260709 14:53:01.994055 11963 consensus_queue.cc:237] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:01.998111 13229 raft_consensus.cc:993] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0: : Instructing follower 3876b8ee8d744cb18e91d97aae93b1ac to start an election
I20260709 14:53:01.998957 13229 raft_consensus.cc:1081] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 LEADER]: Signalling peer 3876b8ee8d744cb18e91d97aae93b1ac to start an election
I20260709 14:53:01.988933 13132 raft_consensus.cc:493] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting leader election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:02.003085 13247 raft_consensus.cc:3055] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 14:53:02.003677 13247 raft_consensus.cc:740] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:02.003090 13132 raft_consensus.cc:3060] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Advancing to term 15
I20260709 14:53:02.007015 12965 raft_consensus.cc:515] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:01.986186 13204 raft_consensus.cc:3060] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Advancing to term 17
I20260709 14:53:02.004825 13144 raft_consensus.cc:515] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:02.012814 13225 consensus_queue.cc:1048] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 14:53:02.016589 12965 leader_election.cc:290] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:02.017989 12965 raft_consensus.cc:2749] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 14:53:02.004735 13247 consensus_queue.cc:260] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:02.019550 13247 raft_consensus.cc:3060] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Advancing to term 19
I20260709 14:53:02.024216 12965 raft_consensus.cc:2749] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 14:53:02.026180 13144 leader_election.cc:290] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 18 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:02.026034 13199 raft_consensus.cc:515] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:02.023548 13132 raft_consensus.cc:515] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:02.028461 13199 leader_election.cc:290] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 10 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:01.989876 12996 raft_consensus.cc:2749] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 14:53:02.036093  7819 leader_election.cc:304] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:02.037465 13245 raft_consensus.cc:2749] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 14:53:02.038036  7819 leader_election.cc:304] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:02.033671 13162 consensus_queue.cc:237] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:02.039005 13245 raft_consensus.cc:2804] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 14:53:02.039500 13245 raft_consensus.cc:493] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:02.039923 13245 raft_consensus.cc:3060] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Advancing to term 17
I20260709 14:53:02.035027  7852 raft_consensus.cc:2468] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 17.
I20260709 14:53:02.043535 13241 leader_election.cc:290] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 12 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:53:02.049840  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 61790us
I20260709 14:53:02.036127 12724 raft_consensus.cc:2749] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 14:53:02.039655  7819 leader_election.cc:304] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:02.050835  7745 leader_election.cc:304] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:02.053992 12724 raft_consensus.cc:2749] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 LEADER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 14:53:02.053699  7893 leader_election.cc:304] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:02.052759  7894 leader_election.cc:304] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:02.055349 12913 raft_consensus.cc:2804] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 14:53:02.055924 12913 raft_consensus.cc:697] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:02.055946 12989 raft_consensus.cc:993] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0: : Instructing follower 3876b8ee8d744cb18e91d97aae93b1ac to start an election
I20260709 14:53:02.056957 12913 consensus_queue.cc:237] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:02.057940 12862 consensus_queue.cc:1059] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 14:53:02.057417 13248 raft_consensus.cc:1081] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 LEADER]: Signalling peer 3876b8ee8d744cb18e91d97aae93b1ac to start an election
I20260709 14:53:02.031379 13246 leader_election.cc:290] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 17 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:02.059093 12862 raft_consensus.cc:3055] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 14:53:02.059527 12862 raft_consensus.cc:740] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:02.061750  7745 leader_election.cc:304] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:02.074638  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:02.075245  7851 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "258d6c2dda954bf5b65930fde8ecb9f3"
dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:49946
I20260709 14:53:02.075973  7851 raft_consensus.cc:493] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:53:02.076326  7851 raft_consensus.cc:3060] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Advancing to term 13
I20260709 14:53:02.078718  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:02.081346  7852 raft_consensus.cc:2468] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 16.
I20260709 14:53:02.083066  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:02.087349  7851 raft_consensus.cc:515] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:02.088594  7848 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6"
dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:49946
I20260709 14:53:02.092000  7848 raft_consensus.cc:493] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:53:02.092521  7848 raft_consensus.cc:3060] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Advancing to term 17
I20260709 14:53:02.096130 13226 raft_consensus.cc:493] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:02.096992 13226 raft_consensus.cc:515] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:02.099650 13226 leader_election.cc:290] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:53:02.101938  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:02.102192  7848 raft_consensus.cc:515] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:02.101909  7894 leader_election.cc:304] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:02.103803 12990 raft_consensus.cc:2804] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 14:53:02.104251 12990 raft_consensus.cc:493] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:02.104592 12990 raft_consensus.cc:3060] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 14:53:02.104727  7851 leader_election.cc:290] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:02.106892  7848 leader_election.cc:290] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 17 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:53:02.121764  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 60637.9us
I20260709 14:53:02.132685  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:02.133985  7848 raft_consensus.cc:2468] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 19.
I20260709 14:53:02.134764  7893 leader_election.cc:304] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:02.142262 12724 raft_consensus.cc:2749] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 14:53:02.145363  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 83700.4us
I20260709 14:53:02.139636 13248 raft_consensus.cc:2749] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 14:53:02.150565  7745 leader_election.cc:304] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:02.150794 12724 consensus_queue.cc:1048] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 14:53:02.150168  7893 leader_election.cc:304] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:53:02.153489  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 113936us
I20260709 14:53:02.142729 12996 raft_consensus.cc:2749] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 14:53:02.154323  7893 leader_election.cc:304] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:02.154867 11963 raft_consensus.cc:2804] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 14:53:02.144675 13132 leader_election.cc:290] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:02.155205 13241 consensus_queue.cc:1048] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.007s
I20260709 14:53:02.155105 12965 raft_consensus.cc:2804] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader election won for term 14
I20260709 14:53:02.158833 13226 consensus_queue.cc:1048] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 14:53:02.146842 12862 consensus_queue.cc:260] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:02.156009 11963 raft_consensus.cc:493] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:02.170248 11963 raft_consensus.cc:3060] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 14:53:02.166384 12965 raft_consensus.cc:697] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:53:02.184978 11963 raft_consensus.cc:515] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:02.147922 13204 raft_consensus.cc:515] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:02.192822 13204 leader_election.cc:290] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:02.189673 11963 leader_election.cc:290] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 15 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:02.194124 12965 consensus_queue.cc:237] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:53:02.198154  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 43900.3us
I20260709 14:53:02.155969 13144 raft_consensus.cc:2804] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 14:53:02.212301  7894 leader_election.cc:304] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:02.203739 13229 raft_consensus.cc:2804] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 14:53:02.220335 13155 raft_consensus.cc:2804] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 14:53:02.220925 13155 raft_consensus.cc:493] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:02.221329 13155 raft_consensus.cc:3060] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Advancing to term 20
I20260709 14:53:02.206521 13144 raft_consensus.cc:493] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:02.226315  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
W20260709 14:53:02.251121  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 44901.9us
I20260709 14:53:02.230959 13245 raft_consensus.cc:515] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:53:02.252378  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 50037.5us
I20260709 14:53:02.226305 13229 raft_consensus.cc:493] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:02.254050 13229 raft_consensus.cc:3060] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:53:02.249028 13144 raft_consensus.cc:3060] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 14:53:02.263324  7819 leader_election.cc:400] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 election: Vote denied by peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587) with higher term. Message: Invalid argument: T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 13. Current term is 14.
I20260709 14:53:02.262028  7893 leader_election.cc:304] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:02.263773  7819 leader_election.cc:403] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 14:53:02.268967  7893 leader_election.cc:304] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:02.277684  7851 raft_consensus.cc:1240] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 16. Current term is 17. Ops: []
I20260709 14:53:02.288035 12862 raft_consensus.cc:3060] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 14:53:02.290830 13245 leader_election.cc:290] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 17 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:02.291800 13245 consensus_queue.cc:1048] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 14:53:02.272579 13206 raft_consensus.cc:515] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:02.295543 13206 leader_election.cc:290] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 16 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:02.282320 13162 raft_consensus.cc:2749] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 14:53:02.299024 13268 raft_consensus.cc:2749] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587) with higher term. Message: Invalid argument: T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 13. Current term is 14.
I20260709 14:53:02.301200 12990 raft_consensus.cc:515] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:02.318701 13229 raft_consensus.cc:515] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:02.279548 12989 raft_consensus.cc:2749] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 14:53:02.325349  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 62710.7us
I20260709 14:53:02.321041 13229 leader_election.cc:290] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:02.339648  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:02.333119 13206 raft_consensus.cc:493] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
W20260709 14:53:02.336762  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:02.326787 13247 consensus_queue.cc:1048] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 14:53:02.346474  7819 leader_election.cc:304] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:02.347918 13270 raft_consensus.cc:493] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:02.348650 13270 raft_consensus.cc:515] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:02.351253 13270 leader_election.cc:290] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:02.354403 13268 raft_consensus.cc:2804] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 14:53:02.355002 13268 raft_consensus.cc:493] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:02.355388 13268 raft_consensus.cc:3060] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Advancing to term 17
I20260709 14:53:02.358423 12990 leader_election.cc:290] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 17 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:02.359264 12996 consensus_queue.cc:1048] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 14:53:02.362460  7819 leader_election.cc:304] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:02.367926 12990 raft_consensus.cc:493] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:02.374168  7819 leader_election.cc:304] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:02.368676 12990 raft_consensus.cc:515] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:02.379853 12990 leader_election.cc:290] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:02.346474 13206 raft_consensus.cc:515] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:02.383657 13206 leader_election.cc:290] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:02.384408 13206 raft_consensus.cc:493] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:02.384958 13206 raft_consensus.cc:515] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:02.387616 13246 consensus_queue.cc:1059] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.002s
W20260709 14:53:02.397275  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 432404us
I20260709 14:53:02.398269  7744 leader_election.cc:304] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:02.400969  7744 leader_election.cc:304] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:02.403252  7744 leader_election.cc:304] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:02.405027 13261 raft_consensus.cc:2804] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 14:53:02.405943 13261 raft_consensus.cc:493] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:02.406397 13261 raft_consensus.cc:3060] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Advancing to term 15
I20260709 14:53:02.409705 13241 raft_consensus.cc:2749] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 14:53:02.410189 12989 raft_consensus.cc:3055] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 14:53:02.410843 12989 raft_consensus.cc:740] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:02.411903 12989 consensus_queue.cc:260] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:02.402928 12996 raft_consensus.cc:2804] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Leader election won for term 15
I20260709 14:53:02.418000 12996 raft_consensus.cc:697] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:53:02.420266  7744 leader_election.cc:304] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:02.423627 11963 raft_consensus.cc:493] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:02.424606 11963 raft_consensus.cc:515] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:02.423604  7744 leader_election.cc:304] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:02.430040  7744 leader_election.cc:304] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:02.402865 13245 raft_consensus.cc:2804] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Leader election won for term 15
I20260709 14:53:02.436936 13245 raft_consensus.cc:697] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
W20260709 14:53:02.441418  7893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:53:02.448732  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 80193us
I20260709 14:53:02.403187 12965 raft_consensus.cc:2749] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 14:53:02.421677 12989 raft_consensus.cc:3060] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 14:53:02.454754 11963 leader_election.cc:290] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:02.458273 13132 raft_consensus.cc:3060] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Advancing to term 17
I20260709 14:53:02.427376 13241 raft_consensus.cc:2804] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 14:53:02.464682 13241 raft_consensus.cc:493] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:02.469475  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:02.476421  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce9c0ef2db24c13a8b1402f21819458" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:02.474192  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:02.476663  7777 raft_consensus.cc:1240] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 18. Current term is 19. Ops: []
I20260709 14:53:02.440654 12862 raft_consensus.cc:493] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:02.439129 13204 raft_consensus.cc:2749] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 14:53:02.481510  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783e4874513449ef9084b833f188a6d3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:02.478294  7928 raft_consensus.cc:2468] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 13.
W20260709 14:53:02.480492  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 106441us
I20260709 14:53:02.482203  7920 raft_consensus.cc:3060] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 14:53:02.483762  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:02.484068  7772 raft_consensus.cc:1240] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 14:53:02.485914  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:02.486734  7777 raft_consensus.cc:2468] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 16.
I20260709 14:53:02.486974  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:02.487191  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:02.488281  7848 raft_consensus.cc:3060] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Advancing to term 17
I20260709 14:53:02.488610  7926 raft_consensus.cc:2368] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 16. Current term is 17.
I20260709 14:53:02.463423 13206 leader_election.cc:290] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:02.487759  7850 raft_consensus.cc:2468] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 14.
I20260709 14:53:02.499540  7776 raft_consensus.cc:1275] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 14:53:02.485154  7819 leader_election.cc:304] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:02.487974  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:02.467907 13270 raft_consensus.cc:493] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:02.506650  7849 raft_consensus.cc:1240] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 12. Current term is 13. Ops: []
I20260709 14:53:02.465224 13241 raft_consensus.cc:3060] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:53:02.438164 13245 consensus_queue.cc:237] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:02.505964  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:02.506333  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:02.509126  7773 raft_consensus.cc:2468] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 18.
I20260709 14:53:02.508636  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:02.511282  7777 raft_consensus.cc:3060] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Advancing to term 18
I20260709 14:53:02.505220 13138 raft_consensus.cc:493] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:02.512485  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:02.513657  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:02.514678  7771 raft_consensus.cc:3060] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Advancing to term 17
I20260709 14:53:02.519774 13155 raft_consensus.cc:515] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:02.488448 12862 raft_consensus.cc:515] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:02.528065 12862 leader_election.cc:290] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:02.528381  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:02.529026 13272 raft_consensus.cc:2804] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 14:53:02.490154 12996 consensus_queue.cc:237] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:02.514503 13270 raft_consensus.cc:515] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:02.535346 13144 raft_consensus.cc:515] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:02.536628 13270 leader_election.cc:290] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:02.490010 13277 consensus_queue.cc:1059] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 14:53:02.540439 13277 consensus_queue.cc:1243] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer 1de5e20126fa4d8ca0793d19c7b847ed log is divergent from this leader: its last log entry 14.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 14:53:02.541050 13277 raft_consensus.cc:3055] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 LEADER]: Stepping down as leader of term 17
I20260709 14:53:02.544840  7920 raft_consensus.cc:2468] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 14.
I20260709 14:53:02.510730  7819 leader_election.cc:304] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:02.542204  7922 raft_consensus.cc:2468] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 15.
I20260709 14:53:02.551877  7852 raft_consensus.cc:1275] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 14:53:02.529654 13272 raft_consensus.cc:493] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:02.557828 13272 raft_consensus.cc:3060] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Advancing to term 18
I20260709 14:53:02.561985  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:02.562870  7920 raft_consensus.cc:2368] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 19. Current term is 20.
I20260709 14:53:02.570101  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:02.571022  7849 raft_consensus.cc:2468] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 15.
I20260709 14:53:02.562666 13132 raft_consensus.cc:2749] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 14:53:02.573709  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:02.573567  7894 leader_election.cc:304] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:02.544401 13277 raft_consensus.cc:740] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:53:02.554922 13243 raft_consensus.cc:2764] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 14:53:02.544564 13138 raft_consensus.cc:515] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:02.556293  7819 leader_election.cc:304] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:02.556941 13281 consensus_queue.cc:1048] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 14:53:02.643982  7848 raft_consensus.cc:2468] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 17.
I20260709 14:53:02.645066 13276 raft_consensus.cc:2804] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 14:53:02.645684 13276 raft_consensus.cc:493] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:02.646065 13276 raft_consensus.cc:3060] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 14:53:02.574858  7846 raft_consensus.cc:2468] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 13.
I20260709 14:53:02.576270  7852 raft_consensus.cc:1275] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 14:53:02.577167  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:02.553352  7771 raft_consensus.cc:2468] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 17.
I20260709 14:53:02.583909  7777 raft_consensus.cc:2468] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 18.
I20260709 14:53:02.574119 12862 raft_consensus.cc:493] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:02.610205  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:02.610446  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
W20260709 14:53:02.643911  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 70458.7us
I20260709 14:53:02.658097  7920 raft_consensus.cc:2468] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 18.
I20260709 14:53:02.652133  7850 raft_consensus.cc:2468] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 16.
I20260709 14:53:02.564710 13206 raft_consensus.cc:493] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:02.608093 13132 raft_consensus.cc:493] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:02.682601 11963 consensus_queue.cc:1059] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 14:53:02.684562  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:02.685904  7920 raft_consensus.cc:2393] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 17: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:53:02.687038  7894 leader_election.cc:304] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:02.707306  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:02.708138  7922 raft_consensus.cc:2468] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 15.
I20260709 14:53:02.711608 11963 raft_consensus.cc:2804] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 14:53:02.712268 11963 raft_consensus.cc:493] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:02.712630 11963 raft_consensus.cc:3060] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 14:53:02.666522 13144 leader_election.cc:290] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 18 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:02.674494 13243 raft_consensus.cc:2804] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Leader election won for term 19
I20260709 14:53:02.725831  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
W20260709 14:53:02.720765  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 164566us
I20260709 14:53:02.705979 12990 raft_consensus.cc:3055] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 14:53:02.663239 12862 raft_consensus.cc:515] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:02.665879 13261 raft_consensus.cc:515] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:02.751528  7920 raft_consensus.cc:1275] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 14:53:02.673955 13206 raft_consensus.cc:515] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:53:02.742641 13287 log.cc:927] Time spent T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 14:53:02.724800 13248 raft_consensus.cc:493] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:02.732440  7819 leader_election.cc:304] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:02.764436  7675 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54350 (request call id 377) took 5372 ms. Trace:
I20260709 14:53:02.705610 13225 consensus_queue.cc:1048] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.047s
I20260709 14:53:02.686645 13132 raft_consensus.cc:515] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:02.681782 13268 raft_consensus.cc:515] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:02.795377 13268 leader_election.cc:290] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 17 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:02.766806  7675 rpcz_store.cc:276] 0709 14:52:57.384277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:52:57.384444 (+   167us) service_pool.cc:224] Handling call
0709 14:53:02.756571 (+5372127us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 14:53:01.120413 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 14:53:01.297449 (+177036us) write_op.cc:432] Acquiring schema lock in shared mode
0709 14:53:01.297528 (+    79us) write_op.cc:435] Acquired schema lock
0709 14:53:01.297541 (+    13us) tablet.cc:662] Decoding operations
0709 14:53:01.299733 (+  2192us) write_op.cc:620] Acquiring the partition lock for write op
0709 14:53:01.299840 (+   107us) write_op.cc:641] Partition lock acquired for write op
0709 14:53:01.299877 (+    37us) tablet.cc:685] Acquiring locks for 23 operations
0709 14:53:01.373980 (+ 74103us) tablet.cc:701] Row locks acquired
0709 14:53:01.374035 (+    55us) write_op.cc:260] PREPARE: finished
0709 14:53:01.374600 (+   565us) write_op.cc:270] Start()
0709 14:53:01.374799 (+   199us) write_op.cc:276] Timestamp: P: 1783608781374446 usec, L: 0
0709 14:53:01.374833 (+    34us) op_driver.cc:348] REPLICATION: starting
0709 14:53:01.375993 (+  1160us) log.cc:844] Serialized 9005 byte log entry
0709 14:53:01.891798 (+515805us) op_driver.cc:464] REPLICATION: finished
0709 14:53:01.953549 (+ 61751us) write_op.cc:301] APPLY: starting
0709 14:53:01.953672 (+   123us) tablet.cc:1367] starting BulkCheckPresence
0709 14:53:02.172996 (+219324us) tablet.cc:1370] finished BulkCheckPresence
0709 14:53:02.173153 (+   157us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 14:53:02.460723 (+287570us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 14:53:02.461437 (+   714us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=46,key_file_lookups=46,delta_file_lookups=46,mrs_lookups=0
0709 14:53:02.461570 (+   133us) write_op.cc:312] APPLY: finished
0709 14:53:02.462614 (+  1044us) log.cc:844] Serialized 204 byte log entry
0709 14:53:02.492697 (+ 30083us) write_op.cc:489] Releasing partition, row and schema locks
0709 14:53:02.515612 (+ 22915us) write_op.cc:454] Released schema lock
0709 14:53:02.553082 (+ 37470us) write_op.cc:341] FINISH: Updating metrics
0709 14:53:02.555100 (+  2018us) write_op.cc:489] Releasing partition, row and schema locks
0709 14:53:02.555132 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":137082,"reported_tablets":38,"child_traces":[["op",{"apply.queue_time_us":61393,"apply.run_cpu_time_us":45407,"apply.run_wall_time_us":601556,"cfile_cache_hit":94,"cfile_cache_hit_bytes":99991,"num_ops":23,"prepare.queue_time_us":211568,"prepare.run_cpu_time_us":52479,"prepare.run_wall_time_us":412897,"raft.queue_time_us":258614,"raft.run_cpu_time_us":6678,"raft.run_wall_time_us":58332,"replication_time_us":516684,"thread_start_us":366515,"threads_started":4,"wal-append.queue_time_us":127966}]]}
I20260709 14:53:02.739327 13245 consensus_queue.cc:1048] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.063s
I20260709 14:53:02.806010 12862 leader_election.cc:290] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:02.808568 13138 leader_election.cc:290] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:02.747442 13243 raft_consensus.cc:697] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:53:02.810576 13243 consensus_queue.cc:237] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:02.773766 13280 raft_consensus.cc:493] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:02.774927 13281 raft_consensus.cc:2804] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Leader election won for term 18
I20260709 14:53:02.774730  7819 leader_election.cc:304] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:02.774695  7674 catalog_manager.cc:5697] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:53:02.725580 13277 consensus_queue.cc:260] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:02.748958 12990 raft_consensus.cc:740] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:02.753729 13155 leader_election.cc:290] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 20 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:02.819465  7920 raft_consensus.cc:1275] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
W20260709 14:53:02.824195  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 49581.7us
I20260709 14:53:02.760324 13144 raft_consensus.cc:493] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:02.824404  7674 catalog_manager.cc:5697] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:53:02.830670 11963 raft_consensus.cc:515] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:02.831800  7674 catalog_manager.cc:5697] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 13 to 14, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 14 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:53:02.814857 13248 raft_consensus.cc:515] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:02.845436 12990 consensus_queue.cc:260] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:02.847002 12990 raft_consensus.cc:3060] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 14:53:02.847878 13248 leader_election.cc:290] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:02.848098 13204 consensus_queue.cc:1048] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 14:53:02.850680 13261 leader_election.cc:290] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:02.826339 13280 raft_consensus.cc:515] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:02.854944  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:02.856107 13280 leader_election.cc:290] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:02.859234 13206 leader_election.cc:290] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:02.862316 13132 leader_election.cc:290] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:02.829759 13281 raft_consensus.cc:697] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:53:02.828716 13245 raft_consensus.cc:2804] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 14:53:02.864985 13281 consensus_queue.cc:237] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:02.869364  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:02.870569  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:02.871592  7926 raft_consensus.cc:2393] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 17: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:53:02.871997  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c563cc7cfbe4d59be4ffc5cf847ce56" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:02.872644 13144 raft_consensus.cc:515] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:02.871059  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:02.873099  7924 raft_consensus.cc:1275] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 14:53:02.874282  7919 raft_consensus.cc:2468] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 15.
I20260709 14:53:02.873366  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:02.875690  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:02.866071 13245 raft_consensus.cc:493] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:02.877143 13245 raft_consensus.cc:3060] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:53:02.878007  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:02.878906  7922 raft_consensus.cc:2410] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for term 17 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 14:53:02.879460  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:02.879848  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:02.879920  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:02.880677  7921 raft_consensus.cc:2468] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 20.
I20260709 14:53:02.833767  7745 leader_election.cc:304] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
W20260709 14:53:02.881745  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 48038.3us
I20260709 14:53:02.880260  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:02.882194  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:02.882699  7919 raft_consensus.cc:3060] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 14:53:02.883132  7926 raft_consensus.cc:2410] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for term 17 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 14:53:02.883741 13144 leader_election.cc:290] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:02.884374 13259 raft_consensus.cc:2804] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 14:53:02.884814 13259 raft_consensus.cc:493] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:02.885141 13259 raft_consensus.cc:3060] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Advancing to term 16
I20260709 14:53:02.885753  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:02.871613  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:02.887511 11963 leader_election.cc:290] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:02.881968  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:02.828089 13241 raft_consensus.cc:515] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:02.892547 13241 leader_election.cc:290] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 12 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:02.892680  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:02.893479  7777 raft_consensus.cc:3060] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Advancing to term 17
I20260709 14:53:02.894773 13272 raft_consensus.cc:515] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:02.895990  7847 raft_consensus.cc:1240] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 17. Current term is 18. Ops: []
I20260709 14:53:02.896265  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:02.893323  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:02.893746 13277 raft_consensus.cc:3060] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Advancing to term 18
I20260709 14:53:02.901268 13290 consensus_queue.cc:1048] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 14:53:02.900163  7775 raft_consensus.cc:2393] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 12: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:53:02.906714  7925 raft_consensus.cc:2468] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 15.
I20260709 14:53:02.907192  7777 raft_consensus.cc:2468] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 17.
I20260709 14:53:02.911746  7919 raft_consensus.cc:2468] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 16.
I20260709 14:53:02.913882  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:02.925112  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258d6c2dda954bf5b65930fde8ecb9f3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: true dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:02.924597  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18d29d52d304c87b930d4fb5eaf50b1" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:02.923669  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:02.926369  7775 raft_consensus.cc:3060] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Advancing to term 15
I20260709 14:53:02.920912 13272 leader_election.cc:290] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 18 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:02.925664  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:02.924245  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:02.925865  7770 raft_consensus.cc:3060] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Advancing to term 13
I20260709 14:53:02.923103  7778 raft_consensus.cc:2468] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 16.
I20260709 14:53:02.932119  7772 raft_consensus.cc:1275] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 14:53:02.899884  7745 leader_election.cc:304] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 3876b8ee8d744cb18e91d97aae93b1ac, 9418391fa82a42c79c6cad13ba91d964
I20260709 14:53:02.934232 13241 raft_consensus.cc:2749] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 14:53:02.929898  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: true dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:02.938922  6549 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 14:53:02.838694  7674 catalog_manager.cc:5697] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:53:02.942281  7819 leader_election.cc:304] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:02.918324 13276 raft_consensus.cc:515] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:02.943452  7674 catalog_manager.cc:5697] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 11 to 12, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 12 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
W20260709 14:53:02.946050  7894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:53:02.947420  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:02.951856  7779 raft_consensus.cc:1240] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 14:53:02.953652  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:02.957468  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:02.958684  7772 raft_consensus.cc:2393] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 17: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:53:02.939983  7745 leader_election.cc:304] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:02.965329  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:02.966368  7777 raft_consensus.cc:3060] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Advancing to term 13
I20260709 14:53:02.953329  7674 catalog_manager.cc:5697] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 13 to 14, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 14 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:53:02.971628  7674 catalog_manager.cc:5697] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:53:02.948257  7775 raft_consensus.cc:2468] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 15.
I20260709 14:53:02.948411  7770 raft_consensus.cc:2468] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 13.
I20260709 14:53:02.974511  7674 catalog_manager.cc:5697] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 10 to 12, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 12 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:53:02.977329  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
W20260709 14:53:02.967607  7744 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.101.67:40785 timed out after 1.526s (SENT) [suppressed 22 similar messages]
I20260709 14:53:02.981040  7920 raft_consensus.cc:1240] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 14. Current term is 15. Ops: []
I20260709 14:53:02.982493  7778 raft_consensus.cc:1240] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 16. Current term is 17. Ops: []
I20260709 14:53:02.985181  7775 raft_consensus.cc:1240] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 17. Current term is 18. Ops: [17.12-17.12]
I20260709 14:53:02.985455  7774 raft_consensus.cc:1240] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 14:53:02.977329  7674 catalog_manager.cc:5697] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:53:02.975406 13206 raft_consensus.cc:2804] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader election won for term 17
W20260709 14:53:02.992455  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 50266.8us
I20260709 14:53:02.995183  7819 leader_election.cc:400] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 18 election: Vote denied by peer 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785) with higher term. Message: Invalid argument: T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 18. Current term is 19.
I20260709 14:53:02.995632  7819 leader_election.cc:403] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
I20260709 14:53:02.996912  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:02.997766  7847 raft_consensus.cc:3060] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Advancing to term 20
I20260709 14:53:02.998493 13276 leader_election.cc:290] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 15 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:02.986860 13268 raft_consensus.cc:2749] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 14:53:02.999264 13289 consensus_queue.cc:1048] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 14:53:03.002607 13206 raft_consensus.cc:697] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:53:03.003990 13206 consensus_queue.cc:237] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:03.010097  7778 raft_consensus.cc:1240] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 11. Current term is 12. Ops: []
I20260709 14:53:03.011991 13268 raft_consensus.cc:2749] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785) with higher term. Message: Invalid argument: T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 18. Current term is 19.
I20260709 14:53:03.064067 13245 raft_consensus.cc:515] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:03.070607  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:02.988902  7674 catalog_manager.cc:5697] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 17 to 18, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 18 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:53:03.072353  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:03.073323  7848 raft_consensus.cc:2410] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for term 18 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 14:53:03.073011  7674 catalog_manager.cc:5697] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 13 to 16, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 16 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:53:03.076263  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 20 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:03.077312  7848 raft_consensus.cc:2410] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for term 20 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 14:53:03.071631  7850 raft_consensus.cc:2468] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 12.
I20260709 14:53:03.094935  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:03.096040  7846 raft_consensus.cc:2468] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 20.
I20260709 14:53:03.095701 13245 leader_election.cc:290] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 10 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:03.105971  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:03.105784  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: true dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:03.106833  7925 raft_consensus.cc:3055] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 14:53:03.107213  7925 raft_consensus.cc:740] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:03.108302  7928 raft_consensus.cc:1275] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 14:53:03.108101  7925 consensus_queue.cc:260] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:03.074581  7674 catalog_manager.cc:5697] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:53:03.109162  7925 raft_consensus.cc:3060] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 14:53:03.110276  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
W20260709 14:53:03.113127  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 118303us
I20260709 14:53:03.115046  7851 raft_consensus.cc:1240] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 16. Current term is 17. Ops: []
I20260709 14:53:03.107899  7894 leader_election.cc:304] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:03.120193  7847 raft_consensus.cc:2468] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 20.
I20260709 14:53:03.125227  7920 raft_consensus.cc:1240] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 LEADER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 17. Current term is 18. Ops: []
I20260709 14:53:03.127059  7819 leader_election.cc:400] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 17 election: Vote denied by peer 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785) with higher term. Message: Invalid argument: T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 17. Current term is 18.
I20260709 14:53:03.127763  7819 leader_election.cc:403] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 14:53:03.128156  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:03.129541  7847 raft_consensus.cc:3060] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Advancing to term 16
I20260709 14:53:03.117033  7894 leader_election.cc:304] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:03.109890  7674 catalog_manager.cc:5697] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 19 to 20, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 20 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:53:03.130746 11963 raft_consensus.cc:2804] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 14:53:03.134408  7777 raft_consensus.cc:2468] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 13.
I20260709 14:53:03.135010  7925 raft_consensus.cc:2468] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 17.
I20260709 14:53:03.146512  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:03.151561  7851 raft_consensus.cc:2468] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 17.
I20260709 14:53:03.147383 11963 raft_consensus.cc:697] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:03.147225  7845 raft_consensus.cc:1240] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 9. Current term is 10. Ops: []
I20260709 14:53:03.103354 13132 raft_consensus.cc:493] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:03.131302  7894 leader_election.cc:304] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:03.122838 12862 raft_consensus.cc:2804] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 14:53:03.158553  7893 leader_election.cc:304] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:03.161371  7893 leader_election.cc:304] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:03.165582  7893 leader_election.cc:304] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:53:03.166499  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 198953us
I20260709 14:53:03.167747  7744 leader_election.cc:304] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:03.170276  7893 leader_election.cc:304] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:03.175414  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258d6c2dda954bf5b65930fde8ecb9f3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: true dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:03.177935  7847 raft_consensus.cc:2468] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 16.
I20260709 14:53:03.178166  7744 leader_election.cc:304] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:03.172513 11963 consensus_queue.cc:237] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:03.192451  7893 leader_election.cc:304] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:03.193686 13281 raft_consensus.cc:2749] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785) with higher term. Message: Invalid argument: T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 17. Current term is 18.
I20260709 14:53:03.194322 13278 raft_consensus.cc:2749] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 14:53:03.149084 13138 consensus_queue.cc:1048] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 14:53:03.158416 12996 raft_consensus.cc:493] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:03.163686 12862 raft_consensus.cc:493] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:03.167514 13248 raft_consensus.cc:2749] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 14:53:03.165217 12989 raft_consensus.cc:2804] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 14:53:03.205009 13276 raft_consensus.cc:2804] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 14:53:03.220587 13276 raft_consensus.cc:493] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:03.194898  7744 leader_election.cc:400] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 16 election: Vote denied by peer 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785) with higher term. Message: Invalid argument: T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 16. Current term is 17.
I20260709 14:53:03.196208  7894 leader_election.cc:304] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:03.173538 13162 raft_consensus.cc:2804] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 14:53:03.173758 13229 raft_consensus.cc:2804] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 14:53:03.229312 13229 raft_consensus.cc:697] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:03.230793 13229 consensus_queue.cc:237] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:03.231626 12996 raft_consensus.cc:515] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:03.152128 13292 consensus_queue.cc:1048] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.074s
W20260709 14:53:03.224810  7893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:03.221040 13276 raft_consensus.cc:3060] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 14:53:03.198155 13206 raft_consensus.cc:2764] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
W20260709 14:53:03.227169  8598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 103999us
I20260709 14:53:03.200019 13304 raft_consensus.cc:493] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:03.228075 13162 raft_consensus.cc:697] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:03.226928 13270 raft_consensus.cc:493] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:03.243495 13270 raft_consensus.cc:515] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:03.224805  7744 leader_election.cc:403] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 14:53:03.190063 13261 raft_consensus.cc:2749] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 14:53:03.217905 12862 raft_consensus.cc:3060] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 14:53:03.249727  7853 raft_consensus.cc:1275] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 9. (term mismatch)
I20260709 14:53:03.250217  7853 pending_rounds.cc:85] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting all ops after (but not including) 8
I20260709 14:53:03.250481  7853 pending_rounds.cc:107] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting uncommitted NO_OP operation due to leader change: 17.9
I20260709 14:53:03.250728  7853 raft_consensus.cc:2889] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:53:03.234293  7925 raft_consensus.cc:1275] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 14:53:03.227373  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:03.253623  7920 raft_consensus.cc:2393] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 12: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:53:03.237598  7894 leader_election.cc:304] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:03.257025 13248 raft_consensus.cc:2804] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 14:53:03.257309  7894 leader_election.cc:304] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:03.257771 13248 raft_consensus.cc:493] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:03.257948 13269 consensus_queue.cc:1059] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.024s
I20260709 14:53:03.260468 12913 raft_consensus.cc:2804] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 14:53:03.243057 13162 consensus_queue.cc:237] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:03.260875 13280 raft_consensus.cc:3055] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 14:53:03.261371 13280 raft_consensus.cc:740] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:03.261655  7894 leader_election.cc:304] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:03.240430 12990 raft_consensus.cc:2804] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 14:53:03.263432 12990 raft_consensus.cc:493] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:03.263816 12990 raft_consensus.cc:3060] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 14:53:03.263962  7894 leader_election.cc:304] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:03.265978 13155 raft_consensus.cc:2804] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 14:53:03.266492 12913 raft_consensus.cc:697] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:03.191847 13259 raft_consensus.cc:515] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:03.266772 13138 consensus_queue.cc:1059] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 14:53:03.267920 13138 raft_consensus.cc:3055] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 14:53:03.267721 12913 consensus_queue.cc:237] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:03.268360 13138 raft_consensus.cc:740] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:03.266562 13155 raft_consensus.cc:493] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:03.269793 13155 raft_consensus.cc:3060] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 14:53:03.262512 13248 raft_consensus.cc:3060] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Advancing to term 21
I20260709 14:53:03.273909 13226 raft_consensus.cc:993] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0: : Instructing follower 1de5e20126fa4d8ca0793d19c7b847ed to start an election
I20260709 14:53:03.274541 13226 raft_consensus.cc:1081] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 LEADER]: Signalling peer 1de5e20126fa4d8ca0793d19c7b847ed to start an election
I20260709 14:53:03.281769 13293 raft_consensus.cc:493] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:03.282573 13293 raft_consensus.cc:515] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:03.283998 13304 raft_consensus.cc:515] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:53:03.240993  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 125949us
I20260709 14:53:03.225327 12989 raft_consensus.cc:493] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 14:53:03.243100 13298 log.cc:927] Time spent T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 14:53:03.172066 13132 raft_consensus.cc:515] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:03.292237  7819 leader_election.cc:304] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:03.291483  7919 raft_consensus.cc:2468] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 13.
W20260709 14:53:03.297390  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 102691us
I20260709 14:53:03.303856  7848 raft_consensus.cc:1240] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 16. Current term is 17. Ops: []
I20260709 14:53:03.305799  7744 leader_election.cc:400] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 pre-election: Vote denied by peer 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785) with higher term. Message: Invalid argument: T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 19. Current term is 20.
I20260709 14:53:03.306342  7744 leader_election.cc:403] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 pre-election: Cancelling election due to peer responding with higher term
I20260709 14:53:03.306912  7922 raft_consensus.cc:2468] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 17.
I20260709 14:53:03.320195  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:03.320860  7852 raft_consensus.cc:3060] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Advancing to term 15
I20260709 14:53:03.319766  7819 leader_election.cc:304] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:03.299199 12989 raft_consensus.cc:3060] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 14:53:03.300884 13292 raft_consensus.cc:2804] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 14:53:03.325402 13245 raft_consensus.cc:2749] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 14:53:03.325932 13292 raft_consensus.cc:697] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:03.300698 13261 raft_consensus.cc:2749] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785) with higher term. Message: Invalid argument: T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 16. Current term is 17.
I20260709 14:53:03.303157 13278 consensus_queue.cc:1048] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 14:53:03.328125 13281 consensus_queue.cc:1048] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 14:53:03.329356  7851 raft_consensus.cc:1275] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 14:53:03.334609 13292 consensus_queue.cc:237] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:03.337360 12996 leader_election.cc:290] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:03.338958 13259 leader_election.cc:290] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 16 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:03.262346 13280 consensus_queue.cc:260] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:03.342391  7744 leader_election.cc:304] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:03.350780  7819 leader_election.cc:304] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:03.351447  7744 leader_election.cc:304] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:03.353906  7819 leader_election.cc:304] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:03.358973 13291 raft_consensus.cc:2764] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 14:53:03.349754 13259 raft_consensus.cc:3060] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Advancing to term 20
I20260709 14:53:03.366117  7852 raft_consensus.cc:2468] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 15.
I20260709 14:53:03.367149  7744 leader_election.cc:304] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:03.368786 13245 raft_consensus.cc:2749] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 14:53:03.372988 13243 consensus_queue.cc:1059] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 14:53:03.374042 13243 raft_consensus.cc:3055] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 LEADER]: Stepping down as leader of term 16
I20260709 14:53:03.374404 13243 raft_consensus.cc:740] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:53:03.375299 13243 consensus_queue.cc:260] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:03.376622 13243 raft_consensus.cc:3060] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Advancing to term 17
I20260709 14:53:03.377390 13291 raft_consensus.cc:2749] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 14:53:03.379282 13293 leader_election.cc:290] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:03.369659 13247 raft_consensus.cc:493] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:03.380520 13247 raft_consensus.cc:515] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:03.384155 13247 leader_election.cc:290] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:03.386672 13270 leader_election.cc:290] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:03.370260 13281 raft_consensus.cc:2749] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 14:53:03.391849 13294 consensus_queue.cc:1059] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 14:53:03.399140 13294 raft_consensus.cc:3055] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 14:53:03.399631 13294 raft_consensus.cc:740] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:03.400627 13294 consensus_queue.cc:260] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:03.404845 13294 raft_consensus.cc:3060] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 14:53:03.341203 13280 raft_consensus.cc:3060] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 14:53:03.357668 13138 consensus_queue.cc:260] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:03.413363 13138 raft_consensus.cc:3060] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:53:03.343482 13304 leader_election.cc:290] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:03.341668 13132 leader_election.cc:290] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:53:03.424256  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 57259.7us
I20260709 14:53:03.426863  7744 leader_election.cc:304] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:03.371697  7819 leader_election.cc:304] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
W20260709 14:53:03.429761  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 58192.8us
I20260709 14:53:03.431691  7819 leader_election.cc:304] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:03.433779  7819 leader_election.cc:304] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:03.427574  7894 leader_election.cc:304] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:03.444729  7744 leader_election.cc:304] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:03.452937  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:03.454813  7852 raft_consensus.cc:2410] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 14:53:03.434639 13281 raft_consensus.cc:2749] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 14:53:03.472533  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:03.474218  7744 leader_election.cc:304] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:53:03.475153  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:03.477813 13289 consensus_queue.cc:1048] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 14:53:03.478632  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:03.479612 13277 consensus_queue.cc:1048] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 14:53:03.438120 13132 raft_consensus.cc:2764] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 14:53:03.465116 13245 raft_consensus.cc:2749] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 14:53:03.483284 12990 raft_consensus.cc:515] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:03.435132 13304 raft_consensus.cc:2749] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 14:53:03.463914 13206 consensus_queue.cc:1048] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 14:53:03.439560 13291 consensus_queue.cc:1048] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.047s
I20260709 14:53:03.437631 13261 raft_consensus.cc:2749] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 14:53:03.462173 13293 raft_consensus.cc:2804] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 14:53:03.488463 13293 raft_consensus.cc:697] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:03.489322 13155 raft_consensus.cc:515] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:03.489533 13293 consensus_queue.cc:237] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:03.493081 13276 raft_consensus.cc:515] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:03.493810 12862 raft_consensus.cc:515] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:03.496659  7851 raft_consensus.cc:2468] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 13.
I20260709 14:53:03.500784 13259 raft_consensus.cc:2749] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: Vote denied by peer 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785) with higher term. Message: Invalid argument: T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 19. Current term is 20.
I20260709 14:53:03.469997  7819 leader_election.cc:304] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:03.506605 13289 raft_consensus.cc:2749] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 14:53:03.504437 13248 raft_consensus.cc:515] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:03.509575  7854 raft_consensus.cc:2468] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 20.
W20260709 14:53:03.511880  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:03.513616 13308 consensus_queue.cc:1048] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 14:53:03.515028  7744 leader_election.cc:304] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:53:03.437867 13247 consensus_queue.cc:1048] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.078s
I20260709 14:53:03.521643  7819 leader_election.cc:304] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
W20260709 14:53:03.524901  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 59826.6us
I20260709 14:53:03.524753  7744 leader_election.cc:304] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:53:03.509755 13132 raft_consensus.cc:2804] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 14:53:03.516666 13204 raft_consensus.cc:2749] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 14:53:03.534606  7819 leader_election.cc:304] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:03.538187  7819 leader_election.cc:304] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:03.518462 12996 raft_consensus.cc:2749] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 14:53:03.534139  7894 leader_election.cc:304] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:03.541671  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:03.542163  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c563cc7cfbe4d59be4ffc5cf847ce56" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:03.544809  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:03.546749  7776 raft_consensus.cc:1240] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 12. Current term is 13. Ops: []
I20260709 14:53:03.547640  7777 raft_consensus.cc:1275] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 14:53:03.548684  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:03.549031  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:03.549774  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:03.550431  7776 raft_consensus.cc:2468] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 16.
I20260709 14:53:03.552246  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:03.552520  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:03.552397  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:03.553369  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:03.554762  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:03.555999  7847 raft_consensus.cc:2468] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 16.
I20260709 14:53:03.556955  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:03.557564  7853 raft_consensus.cc:1240] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 14:53:03.541724  7894 leader_election.cc:304] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:03.558804  7779 raft_consensus.cc:1240] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 10. Current term is 11. Ops: []
I20260709 14:53:03.554757  7776 raft_consensus.cc:3060] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Advancing to term 16
I20260709 14:53:03.563743  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:03.564675  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:03.557627 13245 raft_consensus.cc:2804] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Leader election won for term 13
I20260709 14:53:03.566089  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:03.566501  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:03.537405 13308 raft_consensus.cc:2804] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader election won for term 16
I20260709 14:53:03.568017  7852 raft_consensus.cc:1275] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 14:53:03.568850  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:03.564141  7772 raft_consensus.cc:1240] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 9. Current term is 10. Ops: []
I20260709 14:53:03.569864  7777 raft_consensus.cc:1275] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 14:53:03.563831  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:03.542829 13261 consensus_queue.cc:1059] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 14:53:03.564332 12989 raft_consensus.cc:515] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:03.566224  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 20 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:03.537915 13290 raft_consensus.cc:2804] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader election won for term 15
I20260709 14:53:03.586264  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:03.587198  7847 raft_consensus.cc:2393] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 20: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:53:03.588969  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:03.535966 13132 raft_consensus.cc:493] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:03.620568  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:03.540580 13272 raft_consensus.cc:2804] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Leader election won for term 17
I20260709 14:53:03.538801 13304 raft_consensus.cc:2804] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Leader election won for term 17
I20260709 14:53:03.523983 13289 consensus_queue.cc:1048] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.061s
I20260709 14:53:03.635576  7778 raft_consensus.cc:2468] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 20.
I20260709 14:53:03.575924 13162 raft_consensus.cc:2804] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 14:53:03.574333 13268 raft_consensus.cc:493] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:03.637283  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:03.638441  7771 raft_consensus.cc:2468] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 17.
I20260709 14:53:03.584990 13269 raft_consensus.cc:2804] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 14:53:03.575464 13204 raft_consensus.cc:493] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:03.651381  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:03.653708 11963 raft_consensus.cc:493] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:03.623122 13248 leader_election.cc:290] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 21 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:03.628922 13132 raft_consensus.cc:3060] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Advancing to term 20
I20260709 14:53:03.576188 13291 consensus_queue.cc:1048] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.064s
I20260709 14:53:03.658231  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:03.627907 13308 raft_consensus.cc:697] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:53:03.666935  7778 raft_consensus.cc:1275] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 14:53:03.637368 13162 raft_consensus.cc:493] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:03.645773 13245 raft_consensus.cc:697] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:53:03.654574 11963 raft_consensus.cc:515] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:03.645083 13269 raft_consensus.cc:493] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:03.653673 13241 raft_consensus.cc:493] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:03.649320 13268 raft_consensus.cc:515] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:03.690148 13162 raft_consensus.cc:3060] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 14:53:03.690662 12989 leader_election.cc:290] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 17 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:03.712630  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:03.719422  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:03.720234  7778 raft_consensus.cc:2468] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 13.
I20260709 14:53:03.722123  7850 raft_consensus.cc:1275] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 14:53:03.722527  7777 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775"
dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:37144
I20260709 14:53:03.722891  7819 leader_election.cc:304] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:03.723352  7777 raft_consensus.cc:493] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:53:03.724270  7777 raft_consensus.cc:3060] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Advancing to term 17
I20260709 14:53:03.725821  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:03.654069 13204 raft_consensus.cc:515] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:03.699193 13269 raft_consensus.cc:3060] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Advancing to term 21
I20260709 14:53:03.712285 13272 raft_consensus.cc:697] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:53:03.730602 11963 leader_election.cc:290] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:03.735337  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:03.736385  7773 raft_consensus.cc:3060] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Advancing to term 18
I20260709 14:53:03.746452  7819 leader_election.cc:304] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:03.704768 13241 raft_consensus.cc:515] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:03.751621  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:03.749513 13304 raft_consensus.cc:697] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:53:03.764798  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:03.765640  7778 raft_consensus.cc:3060] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Advancing to term 14
I20260709 14:53:03.745836 13289 raft_consensus.cc:2749] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 14:53:03.773337  7893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:03.773291  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:03.781147  7778 raft_consensus.cc:2468] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 14.
I20260709 14:53:03.776664  7777 raft_consensus.cc:515] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:03.787369  7770 raft_consensus.cc:2410] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 14:53:03.791543  7777 leader_election.cc:290] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:03.793054 13304 consensus_queue.cc:237] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:03.801139  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:03.822293  7850 raft_consensus.cc:3060] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Advancing to term 21
I20260709 14:53:03.804198  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:03.825083  7846 raft_consensus.cc:2393] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 15: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:53:03.823032  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:03.829147  7779 raft_consensus.cc:3060] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Advancing to term 17
I20260709 14:53:03.796710 13206 raft_consensus.cc:3055] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 LEADER]: Stepping down as leader of term 14
I20260709 14:53:03.845525  7773 raft_consensus.cc:2468] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 18.
W20260709 14:53:03.855852  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 109496us
I20260709 14:53:03.864094  7850 raft_consensus.cc:2468] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 21.
I20260709 14:53:03.857823  7819 leader_election.cc:304] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:03.840229 13226 raft_consensus.cc:493] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:03.873596  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:03.877981  7773 raft_consensus.cc:3060] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Advancing to term 17
I20260709 14:53:03.883392  7776 raft_consensus.cc:2468] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 16.
I20260709 14:53:03.770885 13272 consensus_queue.cc:237] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:03.847867 13206 raft_consensus.cc:740] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
W20260709 14:53:03.873551 13316 log.cc:927] Time spent T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.179s	user 0.001s	sys 0.001s
I20260709 14:53:03.889473  7819 leader_election.cc:304] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 9418391fa82a42c79c6cad13ba91d964
I20260709 14:53:03.771231 13245 consensus_queue.cc:237] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:03.909883 13277 raft_consensus.cc:2749] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 14:53:03.910156 13204 leader_election.cc:290] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:03.912966 13317 raft_consensus.cc:2749] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 14:53:03.914875 12862 leader_election.cc:290] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:03.763585 13308 consensus_queue.cc:237] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:03.886914 13226 raft_consensus.cc:515] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:03.917795 13241 leader_election.cc:290] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:03.917719  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:03.923650  7779 raft_consensus.cc:2468] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 17.
I20260709 14:53:03.926888  7773 raft_consensus.cc:2468] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 17.
I20260709 14:53:03.935866  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:03.938519  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:03.941233  7779 raft_consensus.cc:1240] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 15. Current term is 16. Ops: []
I20260709 14:53:03.943679  7779 raft_consensus.cc:1275] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 14:53:03.944693  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:03.946592  7850 raft_consensus.cc:3060] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Advancing to term 17
I20260709 14:53:03.950394  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:03.951009  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:03.952579  7779 raft_consensus.cc:1275] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 14:53:03.875836 13290 raft_consensus.cc:697] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:53:03.953708  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:03.973292  7849 raft_consensus.cc:1275] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
W20260709 14:53:03.975826  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 86474.5us
W20260709 14:53:03.978134  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:03.974334 13268 leader_election.cc:290] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:03.962582 13206 consensus_queue.cc:260] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:03.987707  7819 leader_election.cc:304] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
W20260709 14:53:04.016778  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:04.017474  7819 leader_election.cc:304] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:04.021266  7849 raft_consensus.cc:1275] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
W20260709 14:53:03.987432  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 59358.5us
W20260709 14:53:04.024340  7745 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:04.034650  7850 raft_consensus.cc:2468] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 17.
I20260709 14:53:04.035112  7745 leader_election.cc:304] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:53:04.106827  7742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:04.106369 11963 raft_consensus.cc:493] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:53:04.105763  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 47484.9us
W20260709 14:53:04.106184  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:04.068053  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
W20260709 14:53:03.990904 13328 log.cc:927] Time spent T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.070s	user 0.000s	sys 0.003s
I20260709 14:53:04.117772 11963 raft_consensus.cc:515] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:04.116425 13241 raft_consensus.cc:493] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:03.998829 13155 leader_election.cc:290] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 18 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:04.047766  7846 raft_consensus.cc:1275] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 14:53:04.116685  7894 leader_election.cc:304] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:04.120353  7847 raft_consensus.cc:3060] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Advancing to term 14
I20260709 14:53:04.125443  7773 raft_consensus.cc:1240] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 LEADER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 15. Current term is 16. Ops: []
I20260709 14:53:04.060662  7819 leader_election.cc:304] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:04.063522 13206 raft_consensus.cc:3060] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Advancing to term 15
I20260709 14:53:03.970166 13323 raft_consensus.cc:2749] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 14:53:04.063824 13315 log.cc:927] Time spent T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.381s	user 0.000s	sys 0.009s
I20260709 14:53:04.097604 13331 raft_consensus.cc:2749] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 14:53:04.147282 11963 leader_election.cc:290] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:04.014139 12990 leader_election.cc:290] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 13 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:03.990027 12996 consensus_queue.cc:1048] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.137s
I20260709 14:53:04.037884 13268 raft_consensus.cc:2764] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Leader election decision vote started in defunct term 15: won
I20260709 14:53:03.999150 13245 consensus_queue.cc:1059] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.144s
W20260709 14:53:04.157445  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 97030us
I20260709 14:53:04.123577 13162 raft_consensus.cc:515] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:04.061728 13332 raft_consensus.cc:493] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:04.037307 13132 raft_consensus.cc:515] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:53:04.125838  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 90836.8us
I20260709 14:53:04.153056 13308 raft_consensus.cc:493] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:04.153856 13270 consensus_queue.cc:1048] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 14:53:04.026895 13204 raft_consensus.cc:493] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:03.998456 13290 consensus_queue.cc:237] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:53:04.130683  8598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 123258us
I20260709 14:53:04.146595 12862 raft_consensus.cc:2804] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 14:53:04.169221  7745 leader_election.cc:304] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:04.066571 13317 consensus_queue.cc:1059] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.093s
I20260709 14:53:04.175450  7894 leader_election.cc:304] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:04.069975 13272 consensus_queue.cc:1059] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.095s
I20260709 14:53:04.183501  7847 raft_consensus.cc:2468] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 14.
I20260709 14:53:04.184767  7774 raft_consensus.cc:2468] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 20.
I20260709 14:53:04.143069 13269 raft_consensus.cc:515] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:04.187664  7745 leader_election.cc:304] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:04.142891 13241 raft_consensus.cc:515] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:04.192142  7745 leader_election.cc:304] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:04.174258 13155 consensus_queue.cc:1048] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 14:53:04.196451 13333 raft_consensus.cc:2749] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 14:53:04.199595 13276 leader_election.cc:290] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 17 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:04.203431  7745 leader_election.cc:304] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:04.186223 13281 raft_consensus.cc:2764] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Leader election decision vote started in defunct term 13: won
I20260709 14:53:04.206396  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:04.188927 12862 raft_consensus.cc:697] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:04.190483 13291 raft_consensus.cc:2749] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 14:53:04.209124  7894 leader_election.cc:304] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:04.180397 13204 raft_consensus.cc:515] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:04.176136 13308 raft_consensus.cc:515] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:04.193097 12965 raft_consensus.cc:2764] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 14:53:04.211935  6549 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 14:53:04.222311  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:04.204664 13225 raft_consensus.cc:2804] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 14:53:04.176743 13332 raft_consensus.cc:515] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:04.219959  7922 raft_consensus.cc:1240] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 15. Current term is 16. Ops: []
I20260709 14:53:04.221978  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:04.210448 13333 raft_consensus.cc:2749] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 14:53:04.230360  7928 raft_consensus.cc:1240] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 LEADER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 14:53:04.233868  7922 raft_consensus.cc:1240] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 LEADER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 17. Current term is 18. Ops: [17.12-17.12]
I20260709 14:53:04.239176  7920 raft_consensus.cc:1275] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 14:53:04.238066  7924 raft_consensus.cc:1240] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 14:53:04.244633  7925 raft_consensus.cc:2468] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 10.
I20260709 14:53:04.246567  7922 raft_consensus.cc:1240] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 14. Current term is 15. Ops: []
I20260709 14:53:04.246775  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:04.247936  7925 raft_consensus.cc:2468] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 17.
I20260709 14:53:04.248641  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:04.251452  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:04.251806  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:04.252699  7847 raft_consensus.cc:3060] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Advancing to term 18
I20260709 14:53:04.258430  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:04.259286  7926 raft_consensus.cc:2468] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 14.
I20260709 14:53:04.223366 13304 raft_consensus.cc:3055] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 LEADER]: Stepping down as leader of term 17
I20260709 14:53:04.262820  7921 raft_consensus.cc:1240] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 14:53:04.222463 13245 raft_consensus.cc:493] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:04.263533  7923 raft_consensus.cc:1240] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 14:53:04.208053 13268 consensus_queue.cc:1059] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 14:53:04.266000  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:04.228041 12989 raft_consensus.cc:2804] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 14:53:04.214051 13155 consensus_queue.cc:1048] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.045s
I20260709 14:53:04.270776  7852 raft_consensus.cc:2410] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for term 18 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
W20260709 14:53:04.262051  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 58733.7us
I20260709 14:53:04.270644  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:04.272223  7745 leader_election.cc:304] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:04.276935 13319 raft_consensus.cc:3055] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 LEADER]: Stepping down as leader of term 11
I20260709 14:53:04.276659 13348 raft_consensus.cc:2749] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 14:53:04.278970 13339 log.cc:927] Time spent T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.112s	user 0.002s	sys 0.000s
I20260709 14:53:04.279273 13226 leader_election.cc:290] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:04.283702 13276 raft_consensus.cc:493] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:53:04.284381 13276 raft_consensus.cc:515] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:04.286742 12965 consensus_queue.cc:1048] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 14:53:04.289324 13241 leader_election.cc:290] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:04.218340 13243 consensus_queue.cc:1048] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.046s
I20260709 14:53:04.306658  7770 raft_consensus.cc:1240] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 16. Current term is 17. Ops: []
I20260709 14:53:04.306828  7773 raft_consensus.cc:1275] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 14:53:04.308260  7779 raft_consensus.cc:1275] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 14:53:04.312001  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:04.312850  7773 raft_consensus.cc:3060] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Advancing to term 14
I20260709 14:53:04.343889 12989 raft_consensus.cc:697] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:04.315797  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:04.344779 13269 leader_election.cc:290] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 21 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:04.344913  7779 raft_consensus.cc:2468] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 19.
I20260709 14:53:04.264575 13304 raft_consensus.cc:740] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:53:04.345278 12989 consensus_queue.cc:237] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:04.259290 13291 raft_consensus.cc:2749] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 14:53:04.350546  7775 raft_consensus.cc:1275] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 14:53:04.310468  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:04.352671  7770 raft_consensus.cc:2410] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for term 18 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
W20260709 14:53:04.354822  7893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:04.356706  7771 raft_consensus.cc:1275] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 14:53:04.259266 13225 raft_consensus.cc:697] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:04.358028  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:04.358978  7921 raft_consensus.cc:3060] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 14:53:04.216941 13318 consensus_queue.cc:1048] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.055s
I20260709 14:53:04.361863  7847 raft_consensus.cc:2468] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 18.
I20260709 14:53:04.362368  7925 raft_consensus.cc:1240] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 20. Current term is 21. Ops: [20.12-20.12]
W20260709 14:53:04.364389  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 89449.2us
I20260709 14:53:04.365337  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: true dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:04.365957  7928 raft_consensus.cc:3055] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 14:53:04.266000 12996 raft_consensus.cc:3055] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 LEADER]: Stepping down as leader of term 15
I20260709 14:53:04.366585  7745 leader_election.cc:304] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:04.368335  7922 raft_consensus.cc:1275] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 14:53:04.366552  7928 raft_consensus.cc:740] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:04.375720  7773 raft_consensus.cc:2468] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 14.
I20260709 14:53:04.381119  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce9c0ef2db24c13a8b1402f21819458" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:04.277567 13319 raft_consensus.cc:740] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:53:04.395982  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:04.383285  7919 raft_consensus.cc:2468] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 18.
I20260709 14:53:04.384727  7774 raft_consensus.cc:1275] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 14:53:04.382823  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:04.369951 13162 leader_election.cc:290] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:53:04.393698  8599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 209836us
I20260709 14:53:04.392985  7928 consensus_queue.cc:260] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:04.367780 13320 raft_consensus.cc:493] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:04.369994 13241 raft_consensus.cc:2749] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 14:53:04.371078 12996 raft_consensus.cc:740] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:53:04.411907  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:04.413513 13332 leader_election.cc:290] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:04.413753 13204 leader_election.cc:290] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:04.346495 13304 consensus_queue.cc:260] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:04.273789 13245 raft_consensus.cc:515] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:53:04.422448 13340 log.cc:927] Time spent T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.204s	user 0.001s	sys 0.000s
I20260709 14:53:04.360752 12862 consensus_queue.cc:237] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:04.423316 13348 raft_consensus.cc:493] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:04.465346 12996 consensus_queue.cc:260] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:04.466392 13348 raft_consensus.cc:515] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:04.467675 13304 raft_consensus.cc:3060] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Advancing to term 18
I20260709 14:53:04.469293 13225 consensus_queue.cc:237] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:04.411197 13291 consensus_queue.cc:1048] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.059s
I20260709 14:53:04.408296 13278 consensus_queue.cc:1059] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 14:53:04.471602 13278 raft_consensus.cc:3055] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 14:53:04.472002 13278 raft_consensus.cc:740] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:04.423521 13276 leader_election.cc:290] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:04.489444  7846 raft_consensus.cc:1275] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 12. (term mismatch)
I20260709 14:53:04.490196  7849 raft_consensus.cc:3055] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 LEADER]: Stepping down as leader of term 16
I20260709 14:53:04.490625  7849 raft_consensus.cc:740] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:53:04.492133  7849 consensus_queue.cc:260] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:04.425994  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:04.431778  7923 raft_consensus.cc:2468] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 14.
I20260709 14:53:04.430707  7921 raft_consensus.cc:2468] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 16.
I20260709 14:53:04.404909 13331 raft_consensus.cc:493] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:04.497148  7926 raft_consensus.cc:2393] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 18: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:53:04.508944  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:04.510823  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:04.511637  7854 raft_consensus.cc:3060] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Advancing to term 14
I20260709 14:53:04.464494  7919 raft_consensus.cc:1275] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 14:53:04.513785  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:04.422338 13132 leader_election.cc:290] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 20 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:04.466898 12996 raft_consensus.cc:3060] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Advancing to term 16
I20260709 14:53:04.422241 13320 raft_consensus.cc:515] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:04.423980 13308 leader_election.cc:290] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:53:04.459102 13316 log.cc:927] Time spent T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 14:53:04.488870 13311 log.cc:927] Time spent T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 14:53:04.490245  7846 pending_rounds.cc:85] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting all ops after (but not including) 11
I20260709 14:53:04.547183  7846 pending_rounds.cc:107] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting uncommitted NO_OP operation due to leader change: 17.12
I20260709 14:53:04.547533  7846 raft_consensus.cc:2889] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:53:04.495572  7849 raft_consensus.cc:3060] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Advancing to term 17
W20260709 14:53:04.474903  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 74668.9us
I20260709 14:53:04.468945 13348 leader_election.cc:290] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:04.499004 13206 raft_consensus.cc:493] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:04.563311  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: true dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:04.564483  7851 raft_consensus.cc:3060] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Advancing to term 17
I20260709 14:53:04.564986  7893 leader_election.cc:304] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:53:04.563311  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 162397us
I20260709 14:53:04.565346  7774 raft_consensus.cc:1240] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 14:53:04.568827  7779 raft_consensus.cc:1240] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 14:53:04.570070 11963 consensus_queue.cc:1048] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 14:53:04.571066  7775 raft_consensus.cc:1240] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 11. Current term is 12. Ops: [11.7-11.7]
W20260709 14:53:04.574651  8598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 389452us
I20260709 14:53:04.577605  7819 leader_election.cc:304] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:04.579437 13243 raft_consensus.cc:2749] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 14:53:04.579530 13304 consensus_queue.cc:1059] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 14:53:04.580588  7819 leader_election.cc:304] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:53:04.582243  7773 raft_consensus.cc:1240] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 14. Current term is 15. Ops: []
I20260709 14:53:04.583132  7745 leader_election.cc:304] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:04.590407  7919 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
mode: GRACEFUL
new_leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:48676
I20260709 14:53:04.591289  7919 raft_consensus.cc:606] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 LEADER]: Received request to transfer leadership to TS 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:53:04.521217 13331 raft_consensus.cc:515] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:04.612594  7893 leader_election.cc:304] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:04.600273 12862 raft_consensus.cc:2749] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 14:53:04.581189 13304 raft_consensus.cc:3055] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 LEADER]: Stepping down as leader of term 15
I20260709 14:53:04.614491  7893 leader_election.cc:304] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:04.627288 11963 consensus_queue.cc:1059] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 14:53:04.629223  7819 leader_election.cc:304] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:04.590195 13243 raft_consensus.cc:2804] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader election won for term 10
I20260709 14:53:04.589814 13356 raft_consensus.cc:493] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:04.635684  7819 leader_election.cc:304] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed
W20260709 14:53:04.637044  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:04.638542 11963 consensus_queue.cc:1048] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 14:53:04.639322 11963 consensus_queue.cc:1243] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer 1de5e20126fa4d8ca0793d19c7b847ed log is divergent from this leader: its last log entry 14.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 14:53:04.640826 11963 raft_consensus.cc:3055] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 14:53:04.641131 11963 raft_consensus.cc:740] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:04.594151 13204 raft_consensus.cc:2749] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 14:53:04.563529 13206 raft_consensus.cc:515] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:04.574004 13293 consensus_queue.cc:1059] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.062s
I20260709 14:53:04.631383 13280 raft_consensus.cc:2749] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 14:53:04.677294  7893 leader_election.cc:304] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:04.520308 13319 consensus_queue.cc:260] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:04.675251 11963 consensus_queue.cc:260] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:04.688795 11963 raft_consensus.cc:3060] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:53:04.692386  7851 raft_consensus.cc:2468] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 17.
I20260709 14:53:04.635939 13132 raft_consensus.cc:493] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:04.683106  7894 leader_election.cc:304] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:04.632290 13304 raft_consensus.cc:740] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:53:04.649956 13243 raft_consensus.cc:697] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:53:04.682274 13269 raft_consensus.cc:2749] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 14:53:04.681440 13245 leader_election.cc:290] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:04.633919 13317 consensus_queue.cc:1059] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.065s
I20260709 14:53:04.676744 13318 consensus_queue.cc:1059] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 14:53:04.682255 12990 consensus_queue.cc:1048] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.039s
I20260709 14:53:04.696327  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:04.559161 13278 consensus_queue.cc:260] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:04.632477 12989 consensus_queue.cc:1059] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.062s
I20260709 14:53:04.712848 13280 raft_consensus.cc:2749] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 14:53:04.703624 13281 consensus_queue.cc:1059] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 14:53:04.744917 13331 leader_election.cc:290] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:04.731068 13293 raft_consensus.cc:2804] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 14:53:04.749581 13243 consensus_queue.cc:237] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:04.750936 13206 leader_election.cc:290] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:04.752388 13278 raft_consensus.cc:3060] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:53:04.652846 13356 raft_consensus.cc:515] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:04.756801 13356 leader_election.cc:290] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:04.741364 13349 raft_consensus.cc:2804] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 14:53:04.758107 12989 raft_consensus.cc:3055] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 14:53:04.768508  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 118881us
I20260709 14:53:04.721678 13204 raft_consensus.cc:493] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:04.744671 13270 raft_consensus.cc:3055] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 14:53:04.709820 13132 raft_consensus.cc:515] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:04.746284  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:04.770089  7819 leader_election.cc:304] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed
W20260709 14:53:04.747468 13358 log.cc:927] Time spent T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 14:53:04.768214 13349 raft_consensus.cc:493] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 14:53:04.782737 13354 log.cc:927] Time spent T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 14:53:04.772480 13204 raft_consensus.cc:515] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:04.772529 13317 consensus_queue.cc:1059] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 14:53:04.769550 12989 raft_consensus.cc:740] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:04.781535 13320 leader_election.cc:290] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:04.768069 13304 consensus_queue.cc:260] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:04.745371 13363 raft_consensus.cc:2804] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 14:53:04.810410  7893 leader_election.cc:304] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:53:04.790565  7854 raft_consensus.cc:2468] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 14.
I20260709 14:53:04.804816  7849 raft_consensus.cc:1275] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 11. (term mismatch)
I20260709 14:53:04.767810 13293 raft_consensus.cc:697] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:04.814961  7849 pending_rounds.cc:85] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting all ops after (but not including) 10
I20260709 14:53:04.814756  7893 leader_election.cc:304] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:04.815433  7849 pending_rounds.cc:107] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting uncommitted NO_OP operation due to leader change: 16.11
I20260709 14:53:04.815933  7849 raft_consensus.cc:2889] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:53:04.817099 12990 raft_consensus.cc:2804] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 14:53:04.817741 12990 raft_consensus.cc:697] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:04.818715 12990 consensus_queue.cc:237] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:04.820405 13318 consensus_queue.cc:1059] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.004s
I20260709 14:53:04.771435 13270 raft_consensus.cc:740] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:04.782788 13349 raft_consensus.cc:3060] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Advancing to term 15
I20260709 14:53:04.829289  7893 leader_election.cc:304] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:53:04.819051 13277 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 17 current term: 17 is higher.
I20260709 14:53:04.812507 13363 raft_consensus.cc:493] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:04.911803  7893 leader_election.cc:304] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:04.852599 13292 raft_consensus.cc:2749] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 14:53:04.885426  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:53:04.821770 13365 log.cc:927] Time spent T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
I20260709 14:53:04.859015 13304 raft_consensus.cc:3060] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Advancing to term 16
I20260709 14:53:04.851624 13268 consensus_queue.cc:1059] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.063s
I20260709 14:53:04.858677 13332 raft_consensus.cc:493] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
W20260709 14:53:04.944868  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 89592.3us
I20260709 14:53:04.864676 13280 raft_consensus.cc:2749] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 14:53:04.946972  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:04.970338  7893 leader_election.cc:304] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:04.857798 13245 consensus_queue.cc:1059] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.082s
I20260709 14:53:04.973485  7771 raft_consensus.cc:1275] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 14:53:04.974371  7893 leader_election.cc:304] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:53:04.911902 13363 raft_consensus.cc:3060] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Advancing to term 18
I20260709 14:53:04.915992 13162 consensus_queue.cc:1059] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.053s
I20260709 14:53:04.977452 11963 raft_consensus.cc:2804] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 14:53:04.979946  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:04.982816  7771 raft_consensus.cc:2468] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 17.
I20260709 14:53:04.980189  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783e4874513449ef9084b833f188a6d3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:04.821226 13293 consensus_queue.cc:237] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:04.947047 13138 raft_consensus.cc:2804] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 14:53:04.968568 13332 raft_consensus.cc:515] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:04.980598 13374 raft_consensus.cc:2804] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Leader election won for term 18
I20260709 14:53:04.912922 13356 consensus_queue.cc:1048] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.059s
I20260709 14:53:04.822363 12989 consensus_queue.cc:260] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:05.001609 13280 consensus_queue.cc:1048] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 14:53:05.002627 11963 raft_consensus.cc:697] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:05.036691 11963 consensus_queue.cc:237] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:05.039770 13204 leader_election.cc:290] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:53:04.827989 13331 consensus_queue.cc:1175] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" responder_term: 16 status { last_received { term: 16 index: 9 } last_committed_idx: 7 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 15. Current term is 16. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 14:53:05.004618 13357 consensus_queue.cc:1059] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 14:53:05.005803 13376 log.cc:927] Time spent T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 14:53:05.007834  7744 leader_election.cc:304] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 9418391fa82a42c79c6cad13ba91d964
I20260709 14:53:04.916277 13269 consensus_queue.cc:1048] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.060s
I20260709 14:53:05.044382  7744 leader_election.cc:304] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:05.046316  7744 leader_election.cc:304] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:53:05.047247  7744 leader_election.cc:304] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:05.049018 12965 raft_consensus.cc:2749] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 14:53:04.976583 13292 consensus_queue.cc:1048] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 14:53:05.014462  7924 raft_consensus.cc:1240] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 14:53:04.980135 12990 raft_consensus.cc:2749] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 14:53:04.972273 13226 consensus_queue.cc:1048] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.055s
I20260709 14:53:04.981060 13348 raft_consensus.cc:493] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:05.067837  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:05.052016  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:05.054083  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:05.054925  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:05.056201  7779 raft_consensus.cc:1275] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 9. (term mismatch)
I20260709 14:53:05.069785  7779 pending_rounds.cc:85] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed: Aborting all ops after (but not including) 8
I20260709 14:53:05.070073  7779 pending_rounds.cc:107] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 14:53:05.070359  7779 raft_consensus.cc:2889] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:53:05.056134  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:04.990240 13138 raft_consensus.cc:493] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:05.058645  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:05.059583  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:05.059927  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:05.059652  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:05.056475  7772 pending_rounds.cc:85] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed: Aborting all ops after (but not including) 6
I20260709 14:53:05.082437  7772 pending_rounds.cc:107] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed: Aborting uncommitted NO_OP operation due to leader change: 14.7
I20260709 14:53:05.082798  7772 raft_consensus.cc:2889] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:53:05.072108  7926 raft_consensus.cc:2393] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 10: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:53:05.049461 13291 raft_consensus.cc:2804] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 14:53:05.050206 13241 raft_consensus.cc:2749] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 14:53:05.034662 12989 raft_consensus.cc:3060] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:53:05.065739 13357 raft_consensus.cc:2804] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader election won for term 16
W20260709 14:53:05.073972 13382 log.cc:927] Time spent T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.060s	user 0.004s	sys 0.003s
I20260709 14:53:05.074520  7924 raft_consensus.cc:1275] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 14:53:05.060454 13383 raft_consensus.cc:493] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
W20260709 14:53:05.087960  7819 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:05.079770 13308 raft_consensus.cc:493] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:05.065315 13268 raft_consensus.cc:493] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
W20260709 14:53:05.094043  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 411056us
I20260709 14:53:05.097281  7846 raft_consensus.cc:1275] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 14:53:05.084712 13132 leader_election.cc:290] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:04.976920 13270 consensus_queue.cc:260] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:05.084590 13138 raft_consensus.cc:3060] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Advancing to term 20
I20260709 14:53:05.101094  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:05.061661 13247 raft_consensus.cc:493] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:05.084362 13374 raft_consensus.cc:697] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:53:05.088419 13291 raft_consensus.cc:493] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:05.068503 13206 consensus_queue.cc:1048] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 14:53:05.090453 13281 raft_consensus.cc:493] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:05.139300  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:05.091235 13280 consensus_queue.cc:1048] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 14:53:05.143852  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c563cc7cfbe4d59be4ffc5cf847ce56" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:05.145341  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:05.084295 13348 raft_consensus.cc:515] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:05.150095  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:05.109808 13357 raft_consensus.cc:697] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:53:05.150921  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:05.158561  7847 raft_consensus.cc:2368] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 20. Current term is 21.
I20260709 14:53:05.157984  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:05.160357  7819 leader_election.cc:304] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:05.161661  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:05.163172  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:05.163905  7845 raft_consensus.cc:2468] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 17.
I20260709 14:53:05.138780 13291 raft_consensus.cc:3060] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Advancing to term 15
I20260709 14:53:05.169327  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:05.108927 13308 raft_consensus.cc:515] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:05.111599 13268 raft_consensus.cc:515] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:05.174264  7894 leader_election.cc:304] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:05.178972 13245 raft_consensus.cc:2804] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 14:53:05.179585 13245 raft_consensus.cc:493] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:05.180012 13245 raft_consensus.cc:3060] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Advancing to term 18
I20260709 14:53:05.182858 13348 leader_election.cc:290] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:05.185932 13357 consensus_queue.cc:237] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:05.138520 13247 raft_consensus.cc:515] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:05.166720 13270 raft_consensus.cc:3060] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 14:53:05.140432 13362 consensus_queue.cc:1048] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.164s
I20260709 14:53:05.103438 13383 raft_consensus.cc:515] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:05.141396 13281 raft_consensus.cc:515] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:05.209631 13293 raft_consensus.cc:2749] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 14:53:05.171628 13277 consensus_queue.cc:1048] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 14:53:05.238606  7894 leader_election.cc:304] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:05.244827 13162 raft_consensus.cc:2749] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 14:53:05.234172 13390 raft_consensus.cc:493] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:53:05.238179 13389 raft_consensus.cc:493] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
W20260709 14:53:05.308902  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 43596.9us
I20260709 14:53:05.272346 13206 raft_consensus.cc:493] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:05.264128 13293 consensus_queue.cc:1048] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.044s
I20260709 14:53:05.262564 13329 consensus_queue.cc:1048] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.046s
I20260709 14:53:05.274605 13269 consensus_queue.cc:1048] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 14:53:05.307763 13318 raft_consensus.cc:493] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:05.371639 13392 raft_consensus.cc:3055] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 LEADER]: Stepping down as leader of term 20
I20260709 14:53:05.235105 13374 consensus_queue.cc:237] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:05.361112 12913 raft_consensus.cc:493] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:05.385972 13308 leader_election.cc:290] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:05.270874 13390 raft_consensus.cc:515] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:05.362682 12996 raft_consensus.cc:493] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:53:05.372202 13392 raft_consensus.cc:740] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:53:05.389503 13331 raft_consensus.cc:493] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:05.355391 13206 raft_consensus.cc:515] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:53:05.394130  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 307885us
I20260709 14:53:05.372294 13247 leader_election.cc:290] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:05.406163  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:05.318032 13389 raft_consensus.cc:515] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:05.415334  7775 raft_consensus.cc:2468] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 17.
I20260709 14:53:05.423153  7776 raft_consensus.cc:1275] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 14:53:05.390394 12913 raft_consensus.cc:515] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:05.401327 13331 raft_consensus.cc:515] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:05.372394 13318 raft_consensus.cc:515] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:05.396104 12996 raft_consensus.cc:515] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:53:05.442926  7894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:05.403081 13308 consensus_queue.cc:1059] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 14:53:05.426170 13268 leader_election.cc:290] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:05.427415 13388 raft_consensus.cc:493] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
W20260709 14:53:05.475646  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 77749.9us
W20260709 14:53:05.460055 13386 log.cc:927] Time spent T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.136s	user 0.001s	sys 0.000s
I20260709 14:53:05.468591 13206 leader_election.cc:290] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:05.496162  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:05.500728  7776 raft_consensus.cc:2393] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 13: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:53:05.455713 13383 leader_election.cc:290] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:05.511721  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
W20260709 14:53:05.508519 13398 log.cc:927] Time spent T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.139s	user 0.002s	sys 0.000s
W20260709 14:53:05.515261 13400 log.cc:927] Time spent T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 14:53:05.516080  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258d6c2dda954bf5b65930fde8ecb9f3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:05.517673  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:05.518882 13359 raft_consensus.cc:493] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:53:05.519623 13359 raft_consensus.cc:515] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:53:05.521286  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258d6c2dda954bf5b65930fde8ecb9f3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:05.522286  7924 raft_consensus.cc:2468] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 13.
I20260709 14:53:05.518617  7849 raft_consensus.cc:2468] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 15.
I20260709 14:53:05.525492  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:05.526527  7849 raft_consensus.cc:2410] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for term 19 because replica has last-logged OpId of term: 18 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 12.
I20260709 14:53:05.527639  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:05.529695  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:05.442951 13392 consensus_queue.cc:260] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:05.530706  7849 raft_consensus.cc:2468] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 15.
I20260709 14:53:05.531790 13392 raft_consensus.cc:3060] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Advancing to term 21
I20260709 14:53:05.534493 12996 leader_election.cc:290] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:05.536703  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:05.539273  7927 raft_consensus.cc:1240] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 20. Current term is 21. Ops: [20.12-20.12]
I20260709 14:53:05.530859 13318 leader_election.cc:290] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:53:05.529500 13401 log.cc:927] Time spent T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.070s	user 0.001s	sys 0.001s
I20260709 14:53:05.538249  7745 leader_election.cc:304] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:05.555260  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
W20260709 14:53:05.527547 13363 consensus_meta.cc:287] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent flushing consensus metadata: real 0.516s	user 0.010s	sys 0.001s
I20260709 14:53:05.570979 13308 raft_consensus.cc:493] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:05.467274 13388 raft_consensus.cc:515] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:05.574009  7745 leader_election.cc:304] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:05.575784  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:05.576833  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:05.536087 12913 leader_election.cc:290] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:05.582175  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:05.522394 13390 leader_election.cc:290] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:05.512220 13206 raft_consensus.cc:493] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:05.587672  7745 leader_election.cc:304] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:05.561738 12996 raft_consensus.cc:493] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:05.614837  7745 leader_election.cc:304] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:53:05.617877 13391 log.cc:927] Time spent T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.178s	user 0.000s	sys 0.002s
I20260709 14:53:05.641763  7745 leader_election.cc:400] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 20 election: Vote denied by peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529) with higher term. Message: Invalid argument: T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 20. Current term is 21.
I20260709 14:53:05.655110  7745 leader_election.cc:403] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 20 election: Cancelling election due to peer responding with higher term
I20260709 14:53:05.600817 13410 raft_consensus.cc:493] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:05.581063 13363 raft_consensus.cc:515] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:53:05.740278  7819 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:05.645118 12996 raft_consensus.cc:515] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:05.744071 13408 raft_consensus.cc:493] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:05.744763 13408 raft_consensus.cc:515] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:05.745855 12996 leader_election.cc:290] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:05.609793 13206 raft_consensus.cc:515] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:05.612301 13245 raft_consensus.cc:515] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:53:05.722072 13304 consensus_meta.cc:287] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent flushing consensus metadata: real 0.753s	user 0.015s	sys 0.000s
I20260709 14:53:05.587395 13308 raft_consensus.cc:515] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:05.788096  7845 raft_consensus.cc:1240] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 14:53:05.788349  7847 raft_consensus.cc:1275] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 9. (term mismatch)
I20260709 14:53:05.790774  7847 pending_rounds.cc:85] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting all ops after (but not including) 8
I20260709 14:53:05.791167  7847 pending_rounds.cc:107] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting uncommitted NO_OP operation due to leader change: 15.9
I20260709 14:53:05.792466  7847 raft_consensus.cc:2889] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:53:05.720610 13411 raft_consensus.cc:2749] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 14:53:05.742091 13331 leader_election.cc:290] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:05.757515 12996 raft_consensus.cc:493] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:53:05.796257 12989 consensus_meta.cc:287] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent flushing consensus metadata: real 0.693s	user 0.015s	sys 0.000s
I20260709 14:53:05.818763  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:05.822115  7922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38532 (request call id 3716) took 1454 ms. Trace:
W20260709 14:53:05.825416 13412 log.cc:927] Time spent T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
W20260709 14:53:05.831544 13420 log.cc:927] Time spent T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
W20260709 14:53:05.832358 13395 log.cc:927] Time spent T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.180s	user 0.002s	sys 0.000s
I20260709 14:53:05.832877 13407 consensus_queue.cc:1048] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.281s
I20260709 14:53:05.837900 13388 leader_election.cc:290] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:05.838930 13388 raft_consensus.cc:493] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:05.839715 13206 leader_election.cc:290] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:05.840818 13417 raft_consensus.cc:493] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:05.841516 13417 raft_consensus.cc:515] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:05.844677 13417 leader_election.cc:290] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:05.845463 13414 raft_consensus.cc:3060] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Advancing to term 18
W20260709 14:53:05.805814 13349 consensus_meta.cc:287] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent flushing consensus metadata: real 0.934s	user 0.008s	sys 0.007s
I20260709 14:53:05.822485  7922 rpcz_store.cc:276] 0709 14:53:04.367411 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:53:05.818406 (+1450995us) service_pool.cc:224] Handling call
0709 14:53:05.822031 (+  3625us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 14:53:05.791687 13389 leader_election.cc:290] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:05.801860 13132 raft_consensus.cc:2804] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader election won for term 17
I20260709 14:53:05.803283 13323 raft_consensus.cc:493] T 9441e831627143a991a1556dcdce71e3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9418391fa82a42c79c6cad13ba91d964)
I20260709 14:53:05.841642 13363 leader_election.cc:290] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 18 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:53:05.874118  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 256763us
I20260709 14:53:05.845938 13359 leader_election.cc:290] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:05.741696 13410 raft_consensus.cc:515] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:05.873596 13323 raft_consensus.cc:515] T 9441e831627143a991a1556dcdce71e3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:53:05.892818 13289 raft_consensus.cc:3055] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 LEADER]: Stepping down as leader of term 14
I20260709 14:53:05.893361 13289 raft_consensus.cc:740] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:53:05.894610 13289 consensus_queue.cc:260] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:05.895810 13289 raft_consensus.cc:3060] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Advancing to term 15
W20260709 14:53:05.899128 13413 log.cc:927] Time spent T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.232s	user 0.000s	sys 0.010s
I20260709 14:53:05.880609 13407 raft_consensus.cc:493] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:05.900766 13407 raft_consensus.cc:515] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:05.901496 13363 raft_consensus.cc:493] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:53:05.902379 13363 raft_consensus.cc:515] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:53:05.906550 13415 raft_consensus.cc:3060] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Advancing to term 21
I20260709 14:53:05.867451 13383 raft_consensus.cc:493] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:05.912405 13383 raft_consensus.cc:515] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:05.879097  7745 leader_election.cc:304] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:05.839509 13388 raft_consensus.cc:515] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:05.886392 13409 raft_consensus.cc:2749] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 14:53:05.888085 13418 log.cc:927] Time spent T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 14:53:05.873517 13132 raft_consensus.cc:697] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:53:05.890821 13408 leader_election.cc:290] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:05.968806 13132 consensus_queue.cc:237] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:05.972368 13423 raft_consensus.cc:493] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9418391fa82a42c79c6cad13ba91d964)
I20260709 14:53:05.973060 13423 raft_consensus.cc:515] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:53:05.975854  7773 raft_consensus.cc:3060] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Advancing to term 17
W20260709 14:53:05.879161 13138 consensus_meta.cc:287] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent flushing consensus metadata: real 0.740s	user 0.016s	sys 0.000s
I20260709 14:53:05.992033 13138 raft_consensus.cc:515] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:05.818205 12996 raft_consensus.cc:515] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:05.880395 13304 raft_consensus.cc:493] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:05.862560 13349 raft_consensus.cc:515] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:05.965664 13389 raft_consensus.cc:2804] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 14:53:06.045670 13422 raft_consensus.cc:493] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:06.082660 13322 raft_consensus.cc:493] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:06.083459 13322 raft_consensus.cc:515] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:53:06.085511  7743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:06.086494 13411 raft_consensus.cc:493] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:06.043395 13331 raft_consensus.cc:493] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:06.120451  7851 raft_consensus.cc:2393] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 15: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:53:06.061033 13389 raft_consensus.cc:493] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:06.087014 13411 raft_consensus.cc:515] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:06.087532 13304 raft_consensus.cc:515] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:06.140947 13389 raft_consensus.cc:3060] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Advancing to term 18
W20260709 14:53:06.213593  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:06.128912 13331 raft_consensus.cc:515] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:53:06.212627 13387 log.cc:927] Time spent T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.978s	user 0.003s	sys 0.000s
I20260709 14:53:06.284824  7845 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49948 (request call id 4115) took 1133 ms. Trace:
I20260709 14:53:06.253733 13362 raft_consensus.cc:493] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:06.294826 12913 raft_consensus.cc:493] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:06.305179 13333 raft_consensus.cc:493] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:06.213127 13268 raft_consensus.cc:493] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:06.297060  7845 rpcz_store.cc:276] 0709 14:53:05.151550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:53:05.164583 (+ 13033us) service_pool.cc:224] Handling call
0709 14:53:05.178584 (+ 14001us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:53:05.788688 (+610104us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:53:06.284364 (+495676us) spinlock_profiling.cc:243] Waited 608 ms on lock 0x7b54000d3c54. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae8ee01 00007fb68ae8d83e 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2 00007fb6891c948c 00007fb6891c88c6
0709 14:53:06.284681 (+   317us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1397650176}
I20260709 14:53:06.246610 13409 raft_consensus.cc:493] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9418391fa82a42c79c6cad13ba91d964)
I20260709 14:53:06.341302 13362 raft_consensus.cc:515] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:06.418581  7848 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49948 (request call id 4120) took 1265 ms. Trace:
I20260709 14:53:06.422433 13403 raft_consensus.cc:3055] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 LEADER]: Stepping down as leader of term 12
I20260709 14:53:06.430182  7854 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 4400) took 1334 ms. Trace:
I20260709 14:53:06.434769  7854 rpcz_store.cc:276] 0709 14:53:05.095557 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:53:05.095683 (+   126us) service_pool.cc:224] Handling call
0709 14:53:05.096062 (+   379us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:53:05.245047 (+148985us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:53:05.245083 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:53:05.245129 (+    46us) raft_consensus.cc:1645] Marking committed up to 8
0709 14:53:05.245161 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:53:06.429819 (+1184658us) spinlock_profiling.cc:243] Waited 149 ms on lock 0x7b54000d5554. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae8ee01 00007fb68ae8d83e 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2 00007fb6891c948c 00007fb6891c88c6
0709 14:53:06.429881 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:53:06.430089 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":342086016}
I20260709 14:53:06.327322 12965 raft_consensus.cc:493] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:06.325352 13428 raft_consensus.cc:493] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:06.492100 13317 raft_consensus.cc:3055] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 LEADER]: Stepping down as leader of term 16
I20260709 14:53:06.492776 13317 raft_consensus.cc:740] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:53:06.493813 13317 consensus_queue.cc:260] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:53:06.519851  7851 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 4105) took 1957 ms (client timeout 1895 ms). Trace:
W20260709 14:53:06.520409  7851 rpcz_store.cc:269] 0709 14:53:04.562363 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:53:04.695535 (+133172us) service_pool.cc:224] Handling call
0709 14:53:06.519457 (+1823922us) spinlock_profiling.cc:243] Waited 1.38 s on lock 0x7b54000956d4. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae922fa 00007fb68fe53b17 00007fb6893ce6d4 00007fb6893ce662 00007fb6893ce591 00007fb6893ce50c 00007fb6893cd7c2 00007fb6891c948c 00007fb6891c88c6 00007fb6891c826f
0709 14:53:06.519636 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3184110464}
I20260709 14:53:06.512825  7847 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49948 (request call id 4116) took 1361 ms. Trace:
I20260709 14:53:06.535796  7847 rpcz_store.cc:276] 0709 14:53:05.151803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:53:05.172775 (+ 20972us) service_pool.cc:224] Handling call
0709 14:53:05.173290 (+   515us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:53:05.793183 (+619893us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:53:06.512411 (+719228us) spinlock_profiling.cc:243] Waited 603 ms on lock 0x7b54000d5a54. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae8ee01 00007fb68ae8d83e 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2 00007fb6891c948c 00007fb6891c88c6
0709 14:53:06.512731 (+   320us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1387385728}
I20260709 14:53:06.549790  7928 raft_consensus.cc:3060] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 14:53:06.434206 13243 raft_consensus.cc:493] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:53:06.355702 12913 raft_consensus.cc:515] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:06.452363 13403 raft_consensus.cc:740] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:53:06.570608 13241 raft_consensus.cc:493] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:06.129689 13422 raft_consensus.cc:515] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:06.589612 13241 raft_consensus.cc:515] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:53:06.555809 13402 log.cc:927] Time spent T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 1.251s	user 0.000s	sys 0.006s
I20260709 14:53:06.356107 13333 raft_consensus.cc:515] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:06.356346 13268 raft_consensus.cc:515] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:06.595381 13331 leader_election.cc:290] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:06.597369 12965 raft_consensus.cc:515] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:06.598508 13422 leader_election.cc:290] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:53:06.602010 13270 consensus_meta.cc:287] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent flushing consensus metadata: real 1.390s	user 0.050s	sys 0.066s
W20260709 14:53:06.603724  7773 consensus_meta.cc:287] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent flushing consensus metadata: real 0.627s	user 0.013s	sys 0.048s
I20260709 14:53:06.607446 13436 raft_consensus.cc:493] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:53:06.607944  7819 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.005s	sys 0.005s
I20260709 14:53:06.639830  7773 raft_consensus.cc:1275] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 14:53:06.611495 13362 leader_election.cc:290] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:53:06.611964  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:06.612937 13437 raft_consensus.cc:493] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:06.613201 13162 raft_consensus.cc:493] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:06.613482 13375 raft_consensus.cc:493] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:06.419140  7848 rpcz_store.cc:276] 0709 14:53:05.152775 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:53:05.185067 (+ 32292us) service_pool.cc:224] Handling call
0709 14:53:05.185666 (+   599us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:53:05.185968 (+   302us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 14:53:05.235948 (+ 49980us) log.cc:844] Serialized 14 byte log entry
0709 14:53:06.417953 (+1182005us) spinlock_profiling.cc:243] Waited 1.62 ms on lock 0x7b18003d5220. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb690c69de1 00007fb690c765b1 00007fb68aa364bc 00007fb687d8448b 00007fb690bdeab9 00007fb687da069b 00007fb687d9e93f 00007fb687d9e455 00007fb68ae86060 00007fb68ae98716 00007fb68aea9287
0709 14:53:06.418119 (+   166us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:53:06.418188 (+    69us) raft_consensus.cc:1645] Marking committed up to 12
0709 14:53:06.418245 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:53:06.418332 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:53:06.418501 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14722,"prepare.queue_time_us":121767,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":2786,"raft.queue_time_us":60682,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":1768,"spinlock_wait_cycles":3720064,"thread_start_us":248078,"threads_started":3,"wal-append.queue_time_us":201048}
I20260709 14:53:06.616374 12996 leader_election.cc:290] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:06.618604 13388 leader_election.cc:290] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:06.619318  7921 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
mode: GRACEFUL
new_leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:48676
I20260709 14:53:06.620178 13411 leader_election.cc:290] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:06.621914 13138 leader_election.cc:290] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 20 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:53:06.622673  7820 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.865s	user 0.035s	sys 0.108s
W20260709 14:53:06.629750  7743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:06.636754 13426 raft_consensus.cc:493] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9418391fa82a42c79c6cad13ba91d964)
I20260709 14:53:06.612625 13245 leader_election.cc:290] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 18 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:53:06.639849  7819 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.559s	user 0.005s	sys 0.005s
I20260709 14:53:06.533684 13428 raft_consensus.cc:515] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:06.632746 13319 raft_consensus.cc:3060] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Advancing to term 12
W20260709 14:53:06.658557 13372 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.752s	user 0.020s	sys 0.045s
I20260709 14:53:06.593593  7745 leader_election.cc:304] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
W20260709 14:53:06.702270  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 756467us
W20260709 14:53:06.671947  7820 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.917s	user 0.036s	sys 0.108s
W20260709 14:53:06.674057  7771 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.138s	user 0.017s	sys 0.061s
W20260709 14:53:06.703858  7771 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.168s	user 0.017s	sys 0.061s
I20260709 14:53:06.650918 13308 leader_election.cc:290] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:06.619249 13409 raft_consensus.cc:515] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:53:06.585518 13243 raft_consensus.cc:515] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:06.635262 13349 leader_election.cc:290] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:53:06.666424 13374 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.805s	user 0.027s	sys 0.043s
W20260709 14:53:06.706768  7920 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.915s	user 0.044s	sys 0.099s
I20260709 14:53:06.657603 13162 raft_consensus.cc:515] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:06.671582 13422 raft_consensus.cc:493] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:06.672279 13323 leader_election.cc:290] T 9441e831627143a991a1556dcdce71e3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68:42321)
I20260709 14:53:06.699692 13245 raft_consensus.cc:493] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:06.674047 13417 raft_consensus.cc:493] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
W20260709 14:53:06.722807  7920 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.931s	user 0.044s	sys 0.099s
I20260709 14:53:06.722419  8639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9441e831627143a991a1556dcdce71e3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9418391fa82a42c79c6cad13ba91d964" is_pre_election: true
I20260709 14:53:06.654800 13436 raft_consensus.cc:515] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:53:06.706138 13356 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.731s	user 0.011s	sys 0.024s
W20260709 14:53:06.709538  7819 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:53:06.708946 13372 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.795s	user 0.020s	sys 0.045s
I20260709 14:53:06.705924 13290 raft_consensus.cc:493] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
W20260709 14:53:06.714159  7744 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.002s	user 0.034s	sys 0.072s
W20260709 14:53:06.714869 13357 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.448s	user 0.030s	sys 0.019s
I20260709 14:53:06.710893 12996 raft_consensus.cc:493] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:53:06.726128 13374 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.876s	user 0.027s	sys 0.044s
I20260709 14:53:06.662678 13375 raft_consensus.cc:515] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:06.716899 13388 raft_consensus.cc:2804] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 14:53:06.735939 13392 consensus_meta.cc:287] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent flushing consensus metadata: real 1.197s	user 0.015s	sys 0.008s
I20260709 14:53:06.755565  7773 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37136 (request call id 2900) took 2157 ms. Trace:
W20260709 14:53:06.753432  7744 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.041s	user 0.035s	sys 0.072s
I20260709 14:53:06.659869 13437 raft_consensus.cc:515] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:06.779870  8639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18d29d52d304c87b930d4fb5eaf50b1" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9418391fa82a42c79c6cad13ba91d964" is_pre_election: true
I20260709 14:53:06.799302  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:06.795140  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:06.797544  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:06.799746  7921 raft_consensus.cc:606] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Received request to transfer leadership to TS 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:53:06.790020  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:06.795217  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:06.813999  7924 raft_consensus.cc:2468] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 11.
I20260709 14:53:06.814128  7926 raft_consensus.cc:2468] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 17.
I20260709 14:53:06.795658  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:06.798310  7923 raft_consensus.cc:1240] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 14:53:06.814114  7928 raft_consensus.cc:2468] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 17.
W20260709 14:53:06.745536 13356 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.771s	user 0.011s	sys 0.024s
I20260709 14:53:06.740897 13363 leader_election.cc:290] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68:42321)
I20260709 14:53:06.748343 13323 raft_consensus.cc:493] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:53:06.760921 13291 consensus_meta.cc:287] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent flushing consensus metadata: real 1.583s	user 0.035s	sys 0.039s
I20260709 14:53:06.814042  7921 raft_consensus.cc:614] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 14:53:06.777932  7773 rpcz_store.cc:276] 0709 14:53:04.595787 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:53:04.596031 (+   244us) service_pool.cc:224] Handling call
0709 14:53:04.596485 (+   454us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:53:06.640382 (+2043897us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:53:06.746102 (+105720us) spinlock_profiling.cc:243] Waited 1.38 s on lock 0x7b54002558d4. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae8ee01 00007fb68ae8d83e 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2 00007fb6891c948c 00007fb6891c88c6
0709 14:53:06.746345 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3171899264}
W20260709 14:53:06.832448  7928 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38532 (request call id 3715) took 2451 ms (client timeout 1791 ms). Trace:
I20260709 14:53:06.752151 13383 leader_election.cc:290] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:06.746176 13322 leader_election.cc:290] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:06.837755  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18d29d52d304c87b930d4fb5eaf50b1" candidate_uuid: "9418391fa82a42c79c6cad13ba91d964" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:06.731158 13411 consensus_queue.cc:1059] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.059s
I20260709 14:53:06.814845  7925 raft_consensus.cc:2468] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 17.
I20260709 14:53:06.798346 12913 leader_election.cc:290] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:06.801127 13375 leader_election.cc:290] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:06.844192  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:06.839090 13374 raft_consensus.cc:493] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:53:06.844233  7928 rpcz_store.cc:269] 0709 14:53:04.364945 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:53:04.365064 (+   119us) service_pool.cc:224] Handling call
0709 14:53:06.549175 (+2184111us) spinlock_profiling.cc:243] Waited 873 ms on lock 0x7b58002957d0. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68adea0aa 00007fb68ae6c447 00007fb68ae84fe7 00007fb68ae867de 00007fb68ae9227c 00007fb68fe53b17 00007fb6893ce6d4 00007fb6893ce662 00007fb6893ce591 00007fb6893ce50c
0709 14:53:06.816576 (+267401us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2007149312}
I20260709 14:53:06.752418 13349 raft_consensus.cc:493] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:53:06.752020 13429 raft_consensus.cc:493] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:06.851933  7777 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 3765) took 1796 ms. Trace:
I20260709 14:53:06.770761 13241 leader_election.cc:290] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:06.915230  7848 raft_consensus.cc:2468] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9418391fa82a42c79c6cad13ba91d964 in term 11.
I20260709 14:53:06.766707 12965 leader_election.cc:290] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:06.777786 13407 leader_election.cc:290] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:06.749832 13422 raft_consensus.cc:515] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:06.751187 13417 raft_consensus.cc:515] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:06.947213  8599 leader_election.cc:304] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac, 9418391fa82a42c79c6cad13ba91d964; no voters: 
W20260709 14:53:06.756680 13357 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.515s	user 0.031s	sys 0.019s
I20260709 14:53:06.773027 13388 raft_consensus.cc:493] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:06.759124 13204 consensus_queue.cc:1048] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.092s
W20260709 14:53:06.847527  7744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:06.972770 13268 leader_election.cc:290] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:06.836661 13392 raft_consensus.cc:493] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:06.973985 13392 raft_consensus.cc:515] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:06.932178  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:06.977643 13392 leader_election.cc:290] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:06.753631 13245 raft_consensus.cc:515] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:06.928362  7924 raft_consensus.cc:2468] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 13.
I20260709 14:53:06.685174 13426 raft_consensus.cc:515] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:53:06.979611 13388 raft_consensus.cc:3060] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Advancing to term 16
I20260709 14:53:06.932323  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:06.763725 13290 raft_consensus.cc:515] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:06.942444  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:06.778172 12996 raft_consensus.cc:515] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:53:06.989372 13434 log.cc:927] Time spent T 00000000000000000000000000000000 P 133636659113430cb53b321cb0b1d9ee: Append to log took a long time: real 0.210s	user 0.000s	sys 0.001s
I20260709 14:53:06.990649 13162 leader_election.cc:290] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:06.991246 12996 leader_election.cc:290] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:06.991488 13268 raft_consensus.cc:493] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:06.992065 13268 raft_consensus.cc:515] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:06.966253 12965 raft_consensus.cc:3055] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 LEADER]: Stepping down as leader of term 17
I20260709 14:53:06.993647 12965 raft_consensus.cc:740] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:53:06.994481 13268 leader_election.cc:290] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:06.917791 13362 raft_consensus.cc:493] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:06.931849 13138 raft_consensus.cc:493] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9418391fa82a42c79c6cad13ba91d964)
I20260709 14:53:06.948173 13349 raft_consensus.cc:515] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:06.932438 13144 raft_consensus.cc:493] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:06.910626 13323 raft_consensus.cc:515] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:06.980801  7926 raft_consensus.cc:2468] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 17.
I20260709 14:53:06.910926 13291 raft_consensus.cc:515] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:53:06.968102 13318 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.732s	user 0.020s	sys 0.050s
I20260709 14:53:06.980391 13245 leader_election.cc:290] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:06.994832 12965 consensus_queue.cc:260] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:06.986368 13352 raft_consensus.cc:2804] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 14:53:07.014037  7771 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 3770) took 1939 ms. Trace:
I20260709 14:53:06.944053  7777 rpcz_store.cc:276] 0709 14:53:05.055028 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:53:05.057365 (+  2337us) service_pool.cc:224] Handling call
0709 14:53:05.079453 (+ 22088us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 14:53:05.220581 (+141128us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 14:53:05.238305 (+ 17724us) log.cc:844] Serialized 14 byte log entry
0709 14:53:05.304332 (+ 66027us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 14:53:05.314739 (+ 10407us) log.cc:844] Serialized 52 byte log entry
0709 14:53:05.314946 (+   207us) raft_consensus.cc:1645] Marking committed up to 12
0709 14:53:05.315218 (+   272us) log.cc:844] Serialized 14 byte log entry
0709 14:53:05.352489 (+ 37271us) log.cc:844] Serialized 14 byte log entry
0709 14:53:05.353840 (+  1351us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:53:05.353930 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:53:05.871487 (+517557us) spinlock_profiling.cc:243] Waited 3.54 ms on lock 0x7b18003f0be0. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb690c69de1 00007fb690c765b1 00007fb687da13f3 00007fb687da37c1 00007fb687da3779 00007fb687da3709 00007fb687da36d1 00007fb687da29cd 0000000000396ad4 0000000000396919 00007fb687d8483a
0709 14:53:05.977006 (+105519us) spinlock_profiling.cc:243] Waited 7.81 ms on lock 0x7b18003f0be0. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb690c69de1 00007fb690c765b1 00007fb687da1522 00007fb687da37c1 00007fb687da3779 00007fb687da3709 00007fb687da36d1 00007fb687da29cd 0000000000396ad4 0000000000396919 00007fb687d8483a
0709 14:53:06.508323 (+531317us) spinlock_profiling.cc:243] Waited 31.1 ms on lock 0x7b18003f0be0. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb690c69de1 00007fb690c765b1 00007fb687da13f3 00007fb687da37c1 00007fb687da3779 00007fb687da3709 00007fb687da36d1 00007fb687da29cd 0000000000396ad4 0000000000396919 00007fb687d8483a
0709 14:53:06.516294 (+  7971us) spinlock_profiling.cc:243] Waited 50.3 ms on lock 0x7b4400022b4c. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb687c29db1 00007fb687cc7c85 00007fb687cc86a2 00007fb68aa3a1db 00007fb68aa35aaf 00007fb68aa2986e 00007fb68aa28bb6 00007fb68aa287d8 00007fb68aa32221 00007fb68aa321d9 00007fb68aa32169
0709 14:53:06.851645 (+335351us) raft_consensus.cc:1685] finished
0709 14:53:06.851677 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:53:06.851840 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":51924,"prepare.queue_time_us":1220706,"prepare.run_cpu_time_us":180,"prepare.run_wall_time_us":1932,"raft.queue_time_us":82205,"raft.run_cpu_time_us":853,"raft.run_wall_time_us":53598,"spinlock_wait_cycles":213314944,"thread_start_us":173521,"threads_started":2,"wal-append.queue_time_us":46192}
W20260709 14:53:07.006978 13389 consensus_meta.cc:287] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent flushing consensus metadata: real 0.704s	user 0.010s	sys 0.001s
I20260709 14:53:07.004534 13422 leader_election.cc:290] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:07.006207 13417 leader_election.cc:290] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:06.948984 13411 raft_consensus.cc:493] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:06.990911 13426 leader_election.cc:290] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785), 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68:42321)
W20260709 14:53:06.998706  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:07.016011  7771 rpcz_store.cc:276] 0709 14:53:05.074938 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:53:05.077110 (+  2172us) service_pool.cc:224] Handling call
0709 14:53:05.077520 (+   410us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:53:05.535119 (+457599us) spinlock_profiling.cc:243] Waited 20.7 ms on lock 0x7b18003b9080. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb690c69de1 00007fb690c765b1 00007fb68aa364bc 00007fb687d8448b 00007fb690bdeab9 00007fb687da069b 00007fb687d9e93f 00007fb687d9e455 00007fb68ae86060 00007fb68ae86bfb 00007fb68ae9164b
0709 14:53:05.535300 (+   181us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:53:05.535324 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:53:05.535873 (+   549us) log.cc:844] Serialized 26 byte log entry
0709 14:53:06.278453 (+742580us) spinlock_profiling.cc:243] Waited 5.41 ms on lock 0x7b18003b9080. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb690c69de1 00007fb690c765b1 00007fb687da1522 00007fb687da37c1 00007fb687da3779 00007fb687da3709 00007fb687da36d1 00007fb687da29cd 0000000000396ad4 0000000000396919 00007fb687d8483a
0709 14:53:06.704348 (+425895us) raft_consensus.cc:1645] Marking committed up to 11
0709 14:53:06.704398 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:53:06.704502 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:53:07.013745 (+309243us) raft_consensus.cc:1685] finished
0709 14:53:07.013784 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:53:07.013950 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5061,"raft.queue_time_us":28662,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":8816,"spinlock_wait_cycles":60081792,"thread_start_us":1188754,"threads_started":2,"wal-append.queue_time_us":1241366}
I20260709 14:53:06.942756 13374 raft_consensus.cc:515] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:07.005527 13362 raft_consensus.cc:515] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:53:07.024278  7745 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:07.006860 13138 raft_consensus.cc:515] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
W20260709 14:53:07.017773 13318 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.799s	user 0.021s	sys 0.051s
I20260709 14:53:07.021483 13389 raft_consensus.cc:515] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:07.017994 13352 raft_consensus.cc:493] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:53:07.037423  8640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce9c0ef2db24c13a8b1402f21819458" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9418391fa82a42c79c6cad13ba91d964" is_pre_election: true
I20260709 14:53:07.032194 12965 raft_consensus.cc:3060] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Advancing to term 18
I20260709 14:53:07.021747 13333 leader_election.cc:290] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:07.013417 13144 raft_consensus.cc:515] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:07.084141  7774 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 3760) took 2035 ms. Trace:
I20260709 14:53:07.084638  7774 rpcz_store.cc:276] 0709 14:53:05.049190 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:53:05.049366 (+   176us) service_pool.cc:224] Handling call
0709 14:53:05.049761 (+   395us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:53:05.173658 (+123897us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:53:05.173689 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:53:05.173747 (+    58us) raft_consensus.cc:1645] Marking committed up to 11
0709 14:53:05.173776 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:53:07.083888 (+1910112us) spinlock_profiling.cc:243] Waited 124 ms on lock 0x7b54002dd2d4. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae8ee01 00007fb68ae8d83e 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2 00007fb6891c948c 00007fb6891c88c6
0709 14:53:07.083942 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:53:07.084080 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":284477696}
I20260709 14:53:07.032778 13308 raft_consensus.cc:493] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:53:07.087167  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:06.952337 13429 raft_consensus.cc:515] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:53:07.094163  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 121044us
I20260709 14:53:07.080180 13318 raft_consensus.cc:3055] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 LEADER]: Stepping down as leader of term 17
I20260709 14:53:07.107576  7774 raft_consensus.cc:1240] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 14:53:07.100340  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:07.110144 13437 leader_election.cc:290] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:07.111904 13409 leader_election.cc:290] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68:42321)
I20260709 14:53:07.112210 13317 raft_consensus.cc:3060] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Advancing to term 17
I20260709 14:53:07.076526 13352 raft_consensus.cc:3060] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 [term 11 FOLLOWER]: Advancing to term 12
W20260709 14:53:07.083153 13438 log.cc:927] Time spent T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.233s	user 0.002s	sys 0.000s
W20260709 14:53:07.087280 13430 log.cc:927] Time spent T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.100s	user 0.002s	sys 0.000s
W20260709 14:53:07.087019 13414 consensus_meta.cc:287] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent flushing consensus metadata: real 1.241s	user 0.043s	sys 0.025s
I20260709 14:53:07.031052 13411 raft_consensus.cc:515] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:07.084043 13428 leader_election.cc:290] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:53:07.211390  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:07.114049 13432 raft_consensus.cc:493] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:07.094175 13333 raft_consensus.cc:493] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:07.114228 13318 raft_consensus.cc:740] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:53:07.117328 13389 leader_election.cc:290] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:07.165485 13426 raft_consensus.cc:493] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:07.167346 13444 raft_consensus.cc:493] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:07.235625 13437 raft_consensus.cc:493] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:07.260936  7770 raft_consensus.cc:2410] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for term 19 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 9.
W20260709 14:53:07.253486 13289 consensus_meta.cc:287] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent flushing consensus metadata: real 1.357s	user 0.012s	sys 0.008s
I20260709 14:53:07.242683 13414 raft_consensus.cc:2749] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 14:53:07.097081 13308 raft_consensus.cc:515] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:07.253021 13392 raft_consensus.cc:493] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:07.252192 13204 raft_consensus.cc:493] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:07.244881 13138 leader_election.cc:290] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68:42321)
I20260709 14:53:07.252597 13409 raft_consensus.cc:493] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:07.255342 13241 raft_consensus.cc:493] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:07.257383 12989 raft_consensus.cc:493] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:53:07.290294 13446 log.cc:927] Time spent T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.206s	user 0.000s	sys 0.001s
I20260709 14:53:07.255087 13225 raft_consensus.cc:493] T 9ce9c0ef2db24c13a8b1402f21819458 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9418391fa82a42c79c6cad13ba91d964)
I20260709 14:53:07.327766  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:07.334427  7775 raft_consensus.cc:2468] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 16.
I20260709 14:53:07.306799 13349 leader_election.cc:290] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:07.341660 13429 leader_election.cc:290] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:07.257663 13432 raft_consensus.cc:515] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:07.302510 13447 raft_consensus.cc:493] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:07.350596 11963 raft_consensus.cc:493] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:07.353704 11963 raft_consensus.cc:515] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:07.269831 13333 raft_consensus.cc:515] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:07.364194  7852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49948 (request call id 4119) took 2204 ms. Trace:
I20260709 14:53:07.333170 13138 raft_consensus.cc:493] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:07.303617 13437 raft_consensus.cc:515] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:07.298437 13426 raft_consensus.cc:515] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:07.371402  7852 rpcz_store.cc:276] 0709 14:53:05.152542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:53:05.182846 (+ 30304us) service_pool.cc:224] Handling call
0709 14:53:05.183253 (+   407us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:53:05.409181 (+225928us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 14:53:05.427848 (+ 18667us) log.cc:844] Serialized 14 byte log entry
0709 14:53:06.353021 (+925173us) spinlock_profiling.cc:243] Waited 4.36 ms on lock 0x7b18003561a0. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb690c69de1 00007fb690c765b1 00007fb687d83e07 00007fb690bdeab9 00007fb687da069b 00007fb687d9e93f 00007fb687da0c02 00007fb68aa2820b 00007fb68aa2dd23 00007fb68aa2e23a 00007fb68ae98a2a
0709 14:53:06.672310 (+319289us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:53:06.672376 (+    66us) raft_consensus.cc:1645] Marking committed up to 12
0709 14:53:06.672430 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:53:07.356259 (+683829us) spinlock_profiling.cc:243] Waited 226 ms on lock 0x7b540013f954. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae8ee01 00007fb68ae8d83e 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2 00007fb6891c948c 00007fb6891c88c6
0709 14:53:07.356331 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:53:07.356535 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14759,"prepare.queue_time_us":20308,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":54,"raft.queue_time_us":10554,"raft.run_cpu_time_us":209,"raft.run_wall_time_us":16880,"spinlock_wait_cycles":529079808,"thread_start_us":308994,"threads_started":1,"wal-append.queue_time_us":1323925}
I20260709 14:53:07.403162 11963 leader_election.cc:290] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:53:07.373718  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:07.356854 13291 leader_election.cc:290] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:07.356783 13323 leader_election.cc:290] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:07.345386 13357 raft_consensus.cc:493] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:07.345619 13389 raft_consensus.cc:493] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:07.312544 13204 raft_consensus.cc:515] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:07.414723 13374 leader_election.cc:290] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:07.332552 13409 raft_consensus.cc:515] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:07.416348 13204 leader_election.cc:290] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:07.308300 13392 raft_consensus.cc:515] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:07.417275 13349 raft_consensus.cc:493] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:07.417995 13349 raft_consensus.cc:515] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:07.419082 13392 leader_election.cc:290] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:07.343859 13318 consensus_queue.cc:260] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:07.420179 13349 leader_election.cc:290] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:07.420322 13318 raft_consensus.cc:3060] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Advancing to term 18
I20260709 14:53:07.301326 13444 raft_consensus.cc:515] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:07.359495 12989 raft_consensus.cc:515] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:07.349773 13294 raft_consensus.cc:493] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:53:07.415007 13144 leader_election.cc:290] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:07.423496 13294 raft_consensus.cc:515] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:07.424513 12989 leader_election.cc:290] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:07.426066 13294 leader_election.cc:290] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:53:07.427920  7745 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:07.359963  8640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1f7722fdea49e0b5e9c5d96633eaf9" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9418391fa82a42c79c6cad13ba91d964" is_pre_election: true
I20260709 14:53:07.430339 13437 leader_election.cc:290] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:07.430898  8637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9441e831627143a991a1556dcdce71e3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9418391fa82a42c79c6cad13ba91d964" is_pre_election: true
I20260709 14:53:07.417305 13409 leader_election.cc:290] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:07.332310 13241 raft_consensus.cc:515] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:53:07.404131 13435 log.cc:927] Time spent T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.310s	user 0.001s	sys 0.002s
I20260709 14:53:07.438874 13444 leader_election.cc:290] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:53:07.440778 13415 consensus_meta.cc:287] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent flushing consensus metadata: real 1.533s	user 0.005s	sys 0.017s
I20260709 14:53:07.443953 13374 raft_consensus.cc:493] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:07.445514 13323 raft_consensus.cc:493] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:07.454525 13308 leader_election.cc:290] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:07.456691 13333 leader_election.cc:290] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:07.457995 13318 raft_consensus.cc:493] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:07.460065  7920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38532 (request call id 3710) took 3073 ms. Trace:
I20260709 14:53:07.522944 13415 raft_consensus.cc:2749] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Leader election lost for term 20. Reason: Vote denied by peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529) with higher term. Message: Invalid argument: T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 20. Current term is 21.
W20260709 14:53:07.525064  8598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 178907us
I20260709 14:53:07.457893 13411 leader_election.cc:290] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:07.345781 13225 raft_consensus.cc:515] T 9ce9c0ef2db24c13a8b1402f21819458 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
W20260709 14:53:07.436254 13443 log.cc:927] Time spent T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.395s	user 0.002s	sys 0.000s
I20260709 14:53:07.458263 13389 raft_consensus.cc:515] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:07.433751 13426 leader_election.cc:290] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:53:07.541157  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:07.458799 13362 leader_election.cc:290] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:53:07.522742 13450 log.cc:927] Time spent T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 14:53:07.407684 13138 raft_consensus.cc:515] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:07.360916 13447 raft_consensus.cc:515] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:53:07.505637  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:07.437283 13357 raft_consensus.cc:515] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:07.545011 13144 raft_consensus.cc:493] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:07.547329  7920 rpcz_store.cc:276] 0709 14:53:04.361158 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:53:04.361335 (+   177us) service_pool.cc:224] Handling call
0709 14:53:05.652739 (+1291404us) spinlock_profiling.cc:243] Waited 6.7 ms on lock 0x7b5800200198. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb687c29db1 00007fb687d69b71 00007fb687d69a22 00007fb690c82c09 00007fb68fddcee0 00007fb68fea60ab 00007fb68fea6131 00007fb68fe67fc0 00007fb68fe52929 00007fb68fe523d2 00007fb6893c9bd4
0709 14:53:05.653036 (+   297us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 14:53:05.719378 (+ 66342us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:53:05.719419 (+    41us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 14:53:05.736554 (+ 17135us) log.cc:844] Serialized 52 byte log entry
0709 14:53:06.741341 (+1004787us) raft_consensus.cc:1645] Marking committed up to 11
0709 14:53:06.841725 (+100384us) log.cc:844] Serialized 14 byte log entry
0709 14:53:06.850516 (+  8791us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:53:06.850616 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:53:07.409372 (+558756us) raft_consensus.cc:1685] finished
0709 14:53:07.434658 (+ 25286us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:53:07.434822 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":72946,"prepare.queue_time_us":267041,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":44,"raft.queue_time_us":146247,"raft.run_cpu_time_us":213,"raft.run_wall_time_us":11509,"spinlock_wait_cycles":26837248,"thread_start_us":1023980,"threads_started":2,"wal-append.queue_time_us":1161896}
I20260709 14:53:07.562573  7774 raft_consensus.cc:1275] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 14:53:07.563855  7921 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
mode: GRACEFUL
new_leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:48676
I20260709 14:53:07.577622  7921 raft_consensus.cc:606] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 LEADER]: Received request to transfer leadership to TS 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:53:07.578068  7778 raft_consensus.cc:1275] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 14:53:07.578812  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:07.579972  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:07.580863  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:07.572695  7927 raft_consensus.cc:1275] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 14:53:07.573091  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:07.582172  7922 raft_consensus.cc:1240] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 19. Current term is 20. Ops: []
I20260709 14:53:07.583446  7928 raft_consensus.cc:2468] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 15.
I20260709 14:53:07.582521  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783e4874513449ef9084b833f188a6d3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:07.584558  7928 raft_consensus.cc:1240] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 14. Current term is 15. Ops: []
I20260709 14:53:07.583081  7927 raft_consensus.cc:1240] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 14:53:07.573897  7924 raft_consensus.cc:1275] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 14:53:07.581461  7921 raft_consensus.cc:2468] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 13.
I20260709 14:53:07.576133  7777 raft_consensus.cc:1275] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 14:53:07.576948  7772 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 3766) took 2521 ms. Trace:
I20260709 14:53:07.549196 13323 raft_consensus.cc:515] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:07.555225 13455 raft_consensus.cc:493] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:53:07.594600  7924 raft_consensus.cc:1275] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 14:53:07.595229  7922 raft_consensus.cc:1275] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 14:53:07.595896  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:07.596467  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:07.596603  7777 raft_consensus.cc:2468] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 17.
I20260709 14:53:07.552280 13318 raft_consensus.cc:515] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:07.598201  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:07.599288  7771 raft_consensus.cc:2468] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 12.
I20260709 14:53:07.600399  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:07.600955  7771 raft_consensus.cc:2468] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 9.
I20260709 14:53:07.602818  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:07.603179  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:07.605396  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:07.608863 13389 leader_election.cc:290] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:07.609057  7922 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
mode: GRACEFUL
new_leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:48676
I20260709 14:53:07.609902  7922 raft_consensus.cc:606] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Received request to transfer leadership to TS 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:53:07.610278 13432 leader_election.cc:290] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:07.612221 13447 leader_election.cc:290] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:07.613901  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c563cc7cfbe4d59be4ffc5cf847ce56" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:07.589092 13144 raft_consensus.cc:515] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:07.610328  7922 raft_consensus.cc:614] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 14:53:07.614521  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:07.617806  7770 raft_consensus.cc:3060] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Advancing to term 20
I20260709 14:53:07.603688  7924 raft_consensus.cc:2468] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 15.
I20260709 14:53:07.618462  7923 raft_consensus.cc:1275] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 14:53:07.614679  7777 raft_consensus.cc:2468] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 10.
I20260709 14:53:07.546715 13374 raft_consensus.cc:515] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:07.621055  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:07.621870  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:07.623278  7924 raft_consensus.cc:2468] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 12.
I20260709 14:53:07.624629  7744 leader_election.cc:304] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:07.628352  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:07.631815 13374 leader_election.cc:290] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:07.631959 11963 raft_consensus.cc:493] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:07.632697 11963 raft_consensus.cc:515] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:53:07.618954 13319 consensus_meta.cc:287] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent flushing consensus metadata: real 0.912s	user 0.016s	sys 0.001s
I20260709 14:53:07.637292 11963 leader_election.cc:290] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:07.639256  7744 leader_election.cc:304] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:07.636340  7771 raft_consensus.cc:2410] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for term 19 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 14:53:07.612334 13318 leader_election.cc:290] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:07.643121  7744 leader_election.cc:304] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:07.645653  7744 leader_election.cc:304] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:07.649111  7770 raft_consensus.cc:2410] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for term 20 because replica has last-logged OpId of term: 19 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
I20260709 14:53:07.597647 13455 raft_consensus.cc:515] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:07.650141  7922 raft_consensus.cc:1240] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 LEADER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 14:53:07.650154  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:07.651540  7771 raft_consensus.cc:2468] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 15.
I20260709 14:53:07.655418  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:07.656203  7770 raft_consensus.cc:2468] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 18.
I20260709 14:53:07.645804 13447 raft_consensus.cc:3060] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:53:07.658258 13225 leader_election.cc:290] T 9ce9c0ef2db24c13a8b1402f21819458 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68:42321)
I20260709 14:53:07.652032 13241 leader_election.cc:290] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:07.661659  8637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce9c0ef2db24c13a8b1402f21819458" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9418391fa82a42c79c6cad13ba91d964" is_pre_election: true
W20260709 14:53:07.662225 13457 log.cc:927] Time spent T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 14:53:07.644598 13459 raft_consensus.cc:2749] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 14:53:07.662935 13323 leader_election.cc:290] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:07.663554 13144 leader_election.cc:290] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:07.664310 13138 leader_election.cc:290] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:07.664769  7925 raft_consensus.cc:2410] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
W20260709 14:53:07.669180 13388 consensus_meta.cc:287] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent flushing consensus metadata: real 0.689s	user 0.015s	sys 0.000s
I20260709 14:53:07.616111 13352 raft_consensus.cc:515] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:53:07.669835 13388 raft_consensus.cc:515] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:07.671312  7773 raft_consensus.cc:1240] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 14:53:07.645920 13383 raft_consensus.cc:493] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:07.672232 13352 leader_election.cc:290] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 [CANDIDATE]: Term 12 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:07.672130 13383 raft_consensus.cc:515] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:53:07.673480  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:07.651105 13389 raft_consensus.cc:2749] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 14:53:07.665119 13455 leader_election.cc:290] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:07.646800 13403 consensus_queue.cc:260] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:07.648002 13432 raft_consensus.cc:2749] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 14:53:07.674681 13204 consensus_queue.cc:1048] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 14:53:07.675437 13403 raft_consensus.cc:3060] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Advancing to term 13
I20260709 14:53:07.676167  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
W20260709 14:53:07.677310 12965 consensus_meta.cc:287] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent flushing consensus metadata: real 0.594s	user 0.011s	sys 0.004s
I20260709 14:53:07.667122 13357 leader_election.cc:290] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:07.679875  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18d29d52d304c87b930d4fb5eaf50b1" candidate_uuid: "9418391fa82a42c79c6cad13ba91d964" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:07.680282  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:07.681666  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:07.679865  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
W20260709 14:53:07.682662 13442 log.cc:927] Time spent T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.717s	user 0.004s	sys 0.005s
I20260709 14:53:07.682896  7924 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
mode: GRACEFUL
new_leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:48676
I20260709 14:53:07.683214  7777 raft_consensus.cc:2468] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 18.
I20260709 14:53:07.684094  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:07.689163  7922 raft_consensus.cc:3060] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 14:53:07.680656  7852 raft_consensus.cc:3060] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:53:07.689931  7924 raft_consensus.cc:606] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 LEADER]: Received request to transfer leadership to TS 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:53:07.653901  7744 leader_election.cc:304] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:07.682500  7920 raft_consensus.cc:3060] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 14:53:07.684965 13388 leader_election.cc:290] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 16 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:07.687305  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:07.691740  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:07.687906  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:07.696792  7771 raft_consensus.cc:2468] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 12.
I20260709 14:53:07.693205  7744 leader_election.cc:304] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:53:07.698783  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 122876us
I20260709 14:53:07.700313  6549 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 14:53:07.701297 13281 leader_election.cc:290] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:53:07.703987 13433 log.cc:927] Time spent T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.767s	user 0.001s	sys 0.001s
I20260709 14:53:07.705094 13447 raft_consensus.cc:2749] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 14:53:07.706559  7770 raft_consensus.cc:1275] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 14:53:07.708115  7819 leader_election.cc:304] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:07.710503  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1f7722fdea49e0b5e9c5d96633eaf9" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:07.700361 13323 raft_consensus.cc:493] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:07.713656  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:07.712648 13318 raft_consensus.cc:2804] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 14:53:07.709874 13281 raft_consensus.cc:493] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:07.718786 13332 leader_election.cc:290] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:07.722651  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:07.732673  7851 raft_consensus.cc:2393] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 17: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:53:07.733204  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:07.733834  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:07.733933  7846 raft_consensus.cc:2468] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 17.
I20260709 14:53:07.734357  7853 raft_consensus.cc:1275] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
W20260709 14:53:07.729580  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:07.734519  7850 raft_consensus.cc:2468] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 14.
I20260709 14:53:07.736084  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:07.734252  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:07.734920  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:07.738092  7854 raft_consensus.cc:2468] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 16.
I20260709 14:53:07.736872  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:07.736800  7846 raft_consensus.cc:2468] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 12.
I20260709 14:53:07.706055 13388 raft_consensus.cc:2804] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 14:53:07.741675  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:07.742478  7850 raft_consensus.cc:2468] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 15.
I20260709 14:53:07.743654  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:07.744549  7850 raft_consensus.cc:2468] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 16.
I20260709 14:53:07.741047  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:07.746405  7846 raft_consensus.cc:2468] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 10.
I20260709 14:53:07.739507  7853 raft_consensus.cc:2468] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 12.
I20260709 14:53:07.725116  7920 raft_consensus.cc:2468] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 15.
I20260709 14:53:07.749343  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:07.749926  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:07.750094  7845 raft_consensus.cc:2468] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 17.
I20260709 14:53:07.750801  7851 raft_consensus.cc:2410] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for term 18 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 14:53:07.744987  7852 raft_consensus.cc:2468] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9418391fa82a42c79c6cad13ba91d964 in term 12.
I20260709 14:53:07.748792  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:07.750687  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:07.751895  7847 raft_consensus.cc:1240] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 11. Current term is 12. Ops: []
I20260709 14:53:07.714311 13323 raft_consensus.cc:515] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:07.721995 13318 raft_consensus.cc:493] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:07.754829 13318 raft_consensus.cc:3060] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Advancing to term 18
I20260709 14:53:07.756110 13323 leader_election.cc:290] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:07.722354 13281 raft_consensus.cc:515] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:07.760076 13281 leader_election.cc:290] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:07.751682  7850 raft_consensus.cc:2468] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 17.
I20260709 14:53:07.762400  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:07.763129  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9441e831627143a991a1556dcdce71e3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:07.763190  7845 raft_consensus.cc:3060] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Advancing to term 18
I20260709 14:53:07.748723  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:07.765436  8599 leader_election.cc:304] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac, 9418391fa82a42c79c6cad13ba91d964; no voters: 
I20260709 14:53:07.770195  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:07.770936 13423 leader_election.cc:290] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785), 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68:42321)
I20260709 14:53:07.772948  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:07.774711 13343 raft_consensus.cc:2804] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 14:53:07.780099 13432 raft_consensus.cc:2749] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 14:53:07.781728  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:07.586360  7772 rpcz_store.cc:276] 0709 14:53:05.055343 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:53:05.055565 (+   222us) service_pool.cc:224] Handling call
0709 14:53:05.056198 (+   633us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 14:53:05.088923 (+ 32725us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:53:05.088958 (+    35us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 14:53:05.089794 (+   836us) log.cc:844] Serialized 78 byte log entry
0709 14:53:06.798025 (+1708231us) spinlock_profiling.cc:243] Waited 3.66 ms on lock 0x7b18003f4ea0. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb690c69de1 00007fb690c765b1 00007fb68aa364bc 00007fb687d8448b 00007fb690bdeab9 00007fb687da069b 00007fb687d9e93f 00007fb687da0c02 00007fb68aa2820b 00007fb68aa2dd23 00007fb68aa2e0d1
0709 14:53:06.798221 (+   196us) raft_consensus.cc:1645] Marking committed up to 9
0709 14:53:06.798577 (+   356us) log.cc:844] Serialized 14 byte log entry
0709 14:53:06.837634 (+ 39057us) log.cc:844] Serialized 14 byte log entry
0709 14:53:07.452263 (+614629us) spinlock_profiling.cc:243] Waited 1.81 ms on lock 0x7b18003f4ea0. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb690c69de1 00007fb690c765b1 00007fb687d83e07 00007fb690bdeab9 00007fb687da069b 00007fb687d9e93f 00007fb687d9e455 00007fb68ae86060 00007fb68ae98716 00007fb68aea9287 00007fb68aea9208
0709 14:53:07.571411 (+119148us) log.cc:844] Serialized 14 byte log entry
0709 14:53:07.576404 (+  4993us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:53:07.576492 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:53:07.576537 (+    45us) raft_consensus.cc:1685] finished
0709 14:53:07.576550 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:53:07.576811 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28082,"prepare.queue_time_us":4986,"prepare.run_cpu_time_us":86,"prepare.run_wall_time_us":91,"raft.queue_time_us":228624,"raft.run_cpu_time_us":614,"raft.run_wall_time_us":36797,"spinlock_wait_cycles":12637568,"thread_start_us":172114,"threads_started":2,"wal-append.queue_time_us":161955}
I20260709 14:53:07.831914  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:07.832767  7846 raft_consensus.cc:2393] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 15: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:53:07.784001  7922 raft_consensus.cc:2410] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for term 18 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 14:53:07.721509  7744 leader_election.cc:304] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:53:07.834717  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 113523us
I20260709 14:53:07.749526 13388 raft_consensus.cc:493] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:07.785990  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:07.838764  7850 raft_consensus.cc:2468] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 17.
I20260709 14:53:07.839825  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:07.790822  8637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1f7722fdea49e0b5e9c5d96633eaf9" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9418391fa82a42c79c6cad13ba91d964" is_pre_election: true
I20260709 14:53:07.841105  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c563cc7cfbe4d59be4ffc5cf847ce56" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:07.763273 13410 leader_election.cc:290] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:53:07.801141  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:07.801378 13436 leader_election.cc:290] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:07.804183  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:07.808749  7845 raft_consensus.cc:2468] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 18.
I20260709 14:53:07.813822  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:07.845466  7847 raft_consensus.cc:2468] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 12.
I20260709 14:53:07.845613  7853 raft_consensus.cc:2468] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 16.
I20260709 14:53:07.815367  7851 raft_consensus.cc:1275] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 10. (term mismatch)
I20260709 14:53:07.846207  7851 pending_rounds.cc:85] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting all ops after (but not including) 9
I20260709 14:53:07.846478  7851 pending_rounds.cc:107] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting uncommitted NO_OP operation due to leader change: 15.10
I20260709 14:53:07.828042  7745 leader_election.cc:304] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:07.832922  7852 raft_consensus.cc:2468] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 18.
I20260709 14:53:07.837095  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:07.847770  7846 raft_consensus.cc:2468] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 20.
I20260709 14:53:07.848167  7745 leader_election.cc:304] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:07.836145  7744 leader_election.cc:304] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:07.837816 13343 raft_consensus.cc:697] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 [term 12 LEADER]: Becoming Leader. State: Replica: 9418391fa82a42c79c6cad13ba91d964, State: Running, Role: LEADER
I20260709 14:53:07.841822  7923 raft_consensus.cc:2468] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 10.
I20260709 14:53:07.841048  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:07.846736  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:07.848790  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:07.850111  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:07.855062  7852 raft_consensus.cc:3060] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Advancing to term 16
I20260709 14:53:07.855232  7853 raft_consensus.cc:2468] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 15.
I20260709 14:53:07.856253  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:07.857060  7853 raft_consensus.cc:2410] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 14:53:07.846733  7851 raft_consensus.cc:2889] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:53:07.848894  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:07.849982  7745 leader_election.cc:304] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:07.858493  7846 raft_consensus.cc:2468] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 14.
I20260709 14:53:07.852080  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:07.859791  7845 raft_consensus.cc:2468] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 18.
I20260709 14:53:07.854426  7744 leader_election.cc:304] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:53:07.866658  7852 raft_consensus.cc:2468] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 16.
W20260709 14:53:07.867900  7819 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:07.869750 13332 raft_consensus.cc:2804] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 14:53:07.870319 13332 raft_consensus.cc:493] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:07.870678 13332 raft_consensus.cc:3060] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Advancing to term 15
I20260709 14:53:07.872004 12965 raft_consensus.cc:2749] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 14:53:07.874430 13447 consensus_queue.cc:1048] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 14:53:07.842772 13403 raft_consensus.cc:2749] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 14:53:07.882808 13132 raft_consensus.cc:2804] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 14:53:07.883213 13132 raft_consensus.cc:493] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:07.883424 13304 leader_election.cc:290] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:07.884032  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:07.883839 13343 consensus_queue.cc:237] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:53:07.884833  7923 raft_consensus.cc:2468] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 17.
I20260709 14:53:07.878824  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:07.880584  7744 leader_election.cc:304] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:53:07.889919 13459 raft_consensus.cc:2804] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 14:53:07.890439 13459 raft_consensus.cc:493] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:07.890776 13459 raft_consensus.cc:3060] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Advancing to term 18
I20260709 14:53:07.842286 13388 raft_consensus.cc:3060] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Advancing to term 14
I20260709 14:53:07.882681 13447 raft_consensus.cc:2804] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 14:53:07.892947 13447 raft_consensus.cc:493] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:07.878914 13204 raft_consensus.cc:493] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:07.894086 13204 raft_consensus.cc:515] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:07.896914 13204 leader_election.cc:290] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:07.893440 13447 raft_consensus.cc:3060] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Advancing to term 17
I20260709 14:53:07.901576  7744 leader_election.cc:304] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:07.906912 13290 leader_election.cc:290] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:07.912094 13290 raft_consensus.cc:2804] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 14:53:07.912611 13290 raft_consensus.cc:493] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:07.912986 13290 raft_consensus.cc:3060] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Advancing to term 17
I20260709 14:53:07.883546 13132 raft_consensus.cc:3060] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:53:07.881035  7745 leader_election.cc:304] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
W20260709 14:53:07.918506  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:07.918869 13432 raft_consensus.cc:2804] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 14:53:07.919495 13432 raft_consensus.cc:493] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:07.919919 13432 raft_consensus.cc:3060] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Advancing to term 14
W20260709 14:53:07.927258  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 46424.5us
I20260709 14:53:07.928367  7745 leader_election.cc:304] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:07.932170 13318 raft_consensus.cc:515] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:07.933667 13204 raft_consensus.cc:2804] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 14:53:07.933909  7848 raft_consensus.cc:2393] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 18: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:53:07.935606 13204 raft_consensus.cc:493] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:07.935940 13318 leader_election.cc:290] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 18 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:07.941020  7745 leader_election.cc:304] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:07.937443  6549 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 14:53:07.957612  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 46043.8us
I20260709 14:53:07.915333 13383 leader_election.cc:290] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:07.947582  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:07.948370  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:07.974252  7922 raft_consensus.cc:2468] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 17.
I20260709 14:53:07.950034  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:07.936208 13204 raft_consensus.cc:3060] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Advancing to term 16
I20260709 14:53:07.936843 13243 leader_election.cc:290] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:07.939621 13388 raft_consensus.cc:515] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:07.966692  7745 leader_election.cc:304] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
W20260709 14:53:07.998622  7819 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.101.67:40785 timed out after 1.825s (SENT) [suppressed 12 similar messages]
I20260709 14:53:08.005852  7745 leader_election.cc:304] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:08.007834  7674 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54344 (request call id 377) took 6534 ms. Trace:
I20260709 14:53:07.992399 13403 raft_consensus.cc:2804] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 14:53:08.011404 13403 raft_consensus.cc:493] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:08.011938 13403 raft_consensus.cc:3060] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Advancing to term 17
I20260709 14:53:08.014936  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:08.016571  7923 raft_consensus.cc:2468] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 11.
I20260709 14:53:08.015554  7745 leader_election.cc:304] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:08.021534  7676 catalog_manager.cc:5697] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 15 to 16, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 16 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:53:08.025524  7745 leader_election.cc:304] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 3876b8ee8d744cb18e91d97aae93b1ac, 9418391fa82a42c79c6cad13ba91d964
I20260709 14:53:07.945834 13447 raft_consensus.cc:515] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:08.023108 13362 raft_consensus.cc:2749] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 14:53:08.060457  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
W20260709 14:53:08.062165  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:08.013702  7674 rpcz_store.cc:276] 0709 14:53:01.480095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:53:01.484401 (+  4306us) service_pool.cc:224] Handling call
0709 14:53:08.007742 (+6523341us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 14:53:03.634879 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 14:53:03.722323 (+ 87444us) write_op.cc:432] Acquiring schema lock in shared mode
0709 14:53:03.729737 (+  7414us) write_op.cc:435] Acquired schema lock
0709 14:53:03.732049 (+  2312us) tablet.cc:662] Decoding operations
0709 14:53:03.815576 (+ 83527us) write_op.cc:620] Acquiring the partition lock for write op
0709 14:53:03.815699 (+   123us) write_op.cc:641] Partition lock acquired for write op
0709 14:53:03.815734 (+    35us) tablet.cc:685] Acquiring locks for 13 operations
0709 14:53:03.817541 (+  1807us) tablet.cc:701] Row locks acquired
0709 14:53:03.817580 (+    39us) write_op.cc:260] PREPARE: finished
0709 14:53:03.817889 (+   309us) write_op.cc:270] Start()
0709 14:53:03.818069 (+   180us) write_op.cc:276] Timestamp: P: 1783608783817797 usec, L: 0
0709 14:53:03.818094 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 14:53:03.819113 (+  1019us) log.cc:844] Serialized 5159 byte log entry
0709 14:53:04.589544 (+770431us) op_driver.cc:464] REPLICATION: finished
0709 14:53:04.775463 (+185919us) write_op.cc:301] APPLY: starting
0709 14:53:04.775594 (+   131us) tablet.cc:1367] starting BulkCheckPresence
0709 14:53:05.032339 (+256745us) tablet.cc:1370] finished BulkCheckPresence
0709 14:53:05.032471 (+   132us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 14:53:05.844854 (+812383us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 14:53:05.845212 (+   358us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=26,key_file_lookups=26,delta_file_lookups=26,mrs_lookups=0
0709 14:53:05.905899 (+ 60687us) write_op.cc:312] APPLY: finished
0709 14:53:05.906398 (+   499us) log.cc:844] Serialized 121 byte log entry
0709 14:53:06.761388 (+854990us) write_op.cc:489] Releasing partition, row and schema locks
0709 14:53:06.761783 (+   395us) write_op.cc:454] Released schema lock
0709 14:53:06.761899 (+   116us) write_op.cc:341] FINISH: Updating metrics
0709 14:53:06.763002 (+  1103us) write_op.cc:489] Releasing partition, row and schema locks
0709 14:53:06.763035 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":5742,"reported_tablets":38,"child_traces":[["op",{"apply.queue_time_us":180941,"apply.run_cpu_time_us":99896,"apply.run_wall_time_us":1987316,"cfile_cache_hit":54,"cfile_cache_hit_bytes":58311,"num_ops":13,"prepare.queue_time_us":264291,"prepare.run_cpu_time_us":15921,"prepare.run_wall_time_us":440852,"raft.queue_time_us":325838,"raft.run_cpu_time_us":29404,"raft.run_wall_time_us":168041,"replication_time_us":742471,"thread_start_us":1567577,"threads_started":5,"wal-append.queue_time_us":1123040,"wal-append.run_cpu_time_us":56669,"wal-append.run_wall_time_us":2591057}]]}
W20260709 14:53:08.108255  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:08.136314  7676 catalog_manager.cc:5697] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:53:08.138406 13459 raft_consensus.cc:515] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:08.150267  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:08.140628  8637 raft_consensus.cc:1240] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 [term 12 LEADER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 11. Current term is 12. Ops: []
I20260709 14:53:08.151382  7676 catalog_manager.cc:5697] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 14 to 15, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 15 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:53:08.150060  7923 raft_consensus.cc:2393] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 13: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:53:08.154353  7676 catalog_manager.cc:5697] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
W20260709 14:53:08.155524  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:08.158213  7676 catalog_manager.cc:5697] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 15 to 16, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 16 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:53:08.162590  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18d29d52d304c87b930d4fb5eaf50b1" candidate_uuid: "9418391fa82a42c79c6cad13ba91d964" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:08.162889  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
W20260709 14:53:08.163405  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:08.163940  7779 raft_consensus.cc:2393] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 16: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:53:08.163021  7674 catalog_manager.cc:5697] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 reported cstate change: term changed from 11 to 12, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68). New cstate: current_term: 12 leader_uuid: "9418391fa82a42c79c6cad13ba91d964" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 14:53:08.014062 13451 raft_consensus.cc:2804] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 14:53:08.152427 13459 leader_election.cc:290] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:08.169189  7775 raft_consensus.cc:1240] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 14. Current term is 15. Ops: []
I20260709 14:53:08.169960  7773 raft_consensus.cc:1240] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 14:53:08.183650  7745 leader_election.cc:304] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:08.185938  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18d29d52d304c87b930d4fb5eaf50b1" candidate_uuid: "9418391fa82a42c79c6cad13ba91d964" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:08.166718  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:08.165388  7676 catalog_manager.cc:5697] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 15 to 16, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 16 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:53:08.220846  7779 raft_consensus.cc:2393] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 12: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:53:08.221066  7676 catalog_manager.cc:5697] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 8 to 9, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 9 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:53:08.224136  7745 leader_election.cc:304] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:08.224995  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
W20260709 14:53:08.252558  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:08.246160  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:08.213814 13415 raft_consensus.cc:2804] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 14:53:08.175868 13411 raft_consensus.cc:2749] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 14:53:08.175196 13317 raft_consensus.cc:493] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:08.291603  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9441e831627143a991a1556dcdce71e3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:08.247114  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:08.270267 13388 leader_election.cc:290] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 14 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:08.270498  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:08.271591  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:08.162851 13290 raft_consensus.cc:515] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:08.273102  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:08.279520  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:08.343218  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
W20260709 14:53:08.347285  7819 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:08.281561  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:08.349050  7776 raft_consensus.cc:2410] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for term 18 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 14:53:08.172654 13451 raft_consensus.cc:493] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:08.247586 13362 raft_consensus.cc:2804] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 14:53:08.183931 13426 consensus_queue.cc:1059] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.131s
I20260709 14:53:08.296366  7923 raft_consensus.cc:2410] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for term 17 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 14:53:08.363049  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:08.366442  7925 raft_consensus.cc:2468] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 17.
I20260709 14:53:08.171063 13132 raft_consensus.cc:515] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:08.372814 13132 leader_election.cc:290] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 12 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:08.378134 13204 raft_consensus.cc:515] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:08.380625 13204 leader_election.cc:290] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 16 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:53:08.260715 13463 log.cc:927] Time spent T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.218s	user 0.000s	sys 0.005s
I20260709 14:53:08.273324 13447 leader_election.cc:290] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:08.184679 13432 raft_consensus.cc:515] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:08.247335 13332 raft_consensus.cc:515] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:08.369344 13389 raft_consensus.cc:2804] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 14:53:08.295348 13415 raft_consensus.cc:493] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:08.400017  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:08.354915 13451 raft_consensus.cc:3060] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Advancing to term 13
I20260709 14:53:08.364847 13362 raft_consensus.cc:493] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:08.403360  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:08.405575  7779 raft_consensus.cc:1240] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 19. Current term is 20. Ops: []
I20260709 14:53:08.410398 13411 consensus_queue.cc:1059] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.009s
I20260709 14:53:08.354669 13317 raft_consensus.cc:515] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:08.418067 13411 consensus_queue.cc:1243] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer 9418391fa82a42c79c6cad13ba91d964 log is divergent from this leader: its last log entry 12.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 14:53:08.403502 13415 raft_consensus.cc:3060] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Advancing to term 18
I20260709 14:53:08.419905  7854 raft_consensus.cc:1275] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Refusing update from remote peer 9418391fa82a42c79c6cad13ba91d964: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 14:53:08.398530 13389 raft_consensus.cc:493] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:08.427060  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:08.439877  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:08.443003 13317 leader_election.cc:290] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:08.408178 13362 raft_consensus.cc:3060] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Advancing to term 18
I20260709 14:53:08.445778  7779 raft_consensus.cc:2393] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 15: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:53:08.454180  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 22 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:08.425810 13132 raft_consensus.cc:3055] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 LEADER]: Stepping down as leader of term 11
I20260709 14:53:08.434602 13389 raft_consensus.cc:3060] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Advancing to term 13
I20260709 14:53:08.466602  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:08.468906  7779 raft_consensus.cc:2393] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 16: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:53:08.476437  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783e4874513449ef9084b833f188a6d3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:08.477561  7925 raft_consensus.cc:2410] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 14:53:08.440270 13343 consensus_queue.cc:1048] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.029s
I20260709 14:53:08.462046 13132 raft_consensus.cc:740] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
W20260709 14:53:08.531523  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:08.531173  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:08.532915  7925 raft_consensus.cc:2468] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 16.
I20260709 14:53:08.534952  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:08.535840  7777 raft_consensus.cc:2468] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 17.
I20260709 14:53:08.546396  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:08.479264 13403 raft_consensus.cc:515] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:08.556346  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:08.558578  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:08.559757  7777 raft_consensus.cc:2410] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for term 19 because replica has last-logged OpId of term: 18 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
I20260709 14:53:08.562382  7925 raft_consensus.cc:2468] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 15.
W20260709 14:53:08.574227  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:08.578595  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:08.580612  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:08.583412  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:08.560887 13290 leader_election.cc:290] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:08.590078  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:08.593384  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:08.548590 13132 consensus_queue.cc:260] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:53:08.599655  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:08.600136  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:08.591245  7923 raft_consensus.cc:2468] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 13.
I20260709 14:53:08.573310 13332 leader_election.cc:290] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:08.600632  7924 raft_consensus.cc:2468] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 15.
I20260709 14:53:08.597074  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
W20260709 14:53:08.605329  7742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.68:42321, user_credentials={real_user=slave}} blocked reactor thread for 415901us
I20260709 14:53:08.605705  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:08.607035  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:08.607383  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:08.608224  7920 raft_consensus.cc:2393] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 21: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:53:08.608355  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:08.607334  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:08.610086  7922 raft_consensus.cc:2410] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for term 18 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 14:53:08.609309  7923 raft_consensus.cc:2468] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 12.
I20260709 14:53:08.612413  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:08.612733  7849 raft_consensus.cc:1240] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 16. Current term is 17. Ops: []
I20260709 14:53:08.614442  7924 raft_consensus.cc:2468] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 12.
I20260709 14:53:08.615290  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:08.622309  7853 raft_consensus.cc:1240] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 17. Current term is 18. Ops: [17.11-17.11]
W20260709 14:53:08.625316  7742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:08.625144  7850 raft_consensus.cc:1240] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 14:53:08.592721 13432 leader_election.cc:290] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 14 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:08.627159 13332 raft_consensus.cc:493] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:08.637297  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18d29d52d304c87b930d4fb5eaf50b1" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:08.640224 13277 consensus_queue.cc:1048] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 14:53:08.642287 13317 consensus_queue.cc:1059] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 14:53:08.643430 13317 raft_consensus.cc:3055] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 LEADER]: Stepping down as leader of term 19
I20260709 14:53:08.643792 13317 raft_consensus.cc:740] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:53:08.645314  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:08.647106  7772 raft_consensus.cc:2393] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 18: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:53:08.610893  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:08.648607  7777 raft_consensus.cc:2468] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 18.
I20260709 14:53:08.653050  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:08.661989  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 22 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:08.663636  7776 raft_consensus.cc:2410] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for term 22 because replica has last-logged OpId of term: 19 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 14:53:08.665773 13243 consensus_queue.cc:1048] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 14:53:08.667771 13243 consensus_queue.cc:1048] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 14:53:08.672329 13132 raft_consensus.cc:3060] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:53:08.673791 13403 leader_election.cc:290] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:08.634660 13332 raft_consensus.cc:515] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:53:08.687821  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 462165us
I20260709 14:53:08.691365  7772 raft_consensus.cc:1240] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 14:53:08.692873  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:08.694288  7850 raft_consensus.cc:2468] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 17.
I20260709 14:53:08.692734  7745 leader_election.cc:304] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:08.699139  7745 leader_election.cc:304] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:08.706887  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c563cc7cfbe4d59be4ffc5cf847ce56" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:08.707343  7745 leader_election.cc:304] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:08.707914  7772 raft_consensus.cc:2393] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 10: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:53:08.708283  7745 leader_election.cc:304] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:08.708861 13290 raft_consensus.cc:2804] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 14:53:08.709358 13290 raft_consensus.cc:493] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:08.709769 13290 raft_consensus.cc:3060] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Advancing to term 22
W20260709 14:53:08.709571  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:08.711617  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:08.708900  7778 raft_consensus.cc:1275] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 14:53:08.712721  7848 raft_consensus.cc:1275] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 14:53:08.714018  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:08.715713  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:08.676970 13432 raft_consensus.cc:493] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
W20260709 14:53:08.717343  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:08.717533  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:08.719333  7849 raft_consensus.cc:1275] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 14:53:08.720502  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:08.720485  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:08.726096  7773 raft_consensus.cc:2468] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 17.
I20260709 14:53:08.722218  7848 raft_consensus.cc:1275] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
W20260709 14:53:08.717540  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 413676us
I20260709 14:53:08.727936  7850 raft_consensus.cc:1240] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 17. Current term is 18. Ops: []
I20260709 14:53:08.714279  7745 leader_election.cc:304] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:08.732177  7773 raft_consensus.cc:1275] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 14:53:08.732969  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:08.732319  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:08.733970  7772 raft_consensus.cc:2468] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 13.
I20260709 14:53:08.735406  7774 raft_consensus.cc:2368] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 11. Current term is 12.
I20260709 14:53:08.734961  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:08.736202  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:08.737907  7772 raft_consensus.cc:2393] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 15: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:53:08.713868 13403 raft_consensus.cc:2804] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 14:53:08.740201  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:08.741657  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:08.740649  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:08.746279  7773 raft_consensus.cc:2468] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 14.
I20260709 14:53:08.688038 13277 consensus_queue.cc:1048] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 14:53:08.688704 13415 raft_consensus.cc:515] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:08.748811  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:08.758471  7777 raft_consensus.cc:2468] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 20.
I20260709 14:53:08.728820 13447 raft_consensus.cc:2804] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader election won for term 18
I20260709 14:53:08.724604 13241 raft_consensus.cc:2804] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 14:53:08.760679  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:08.754796  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:08.762517  7778 raft_consensus.cc:2410] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for term 19 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 14:53:08.765836  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:08.766793  7773 raft_consensus.cc:2468] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 14.
I20260709 14:53:08.768160  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:08.769033  7845 raft_consensus.cc:2468] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 11.
I20260709 14:53:08.683921 13317 consensus_queue.cc:260] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:08.777524  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:08.779597  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:08.779654  7745 leader_election.cc:304] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:08.790758  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:08.790967  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1f7722fdea49e0b5e9c5d96633eaf9" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:08.749387 13403 raft_consensus.cc:493] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting leader election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:08.751014 12965 raft_consensus.cc:2804] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 14:53:08.735102 13432 raft_consensus.cc:515] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:08.795282  7745 leader_election.cc:304] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:08.802153  7845 raft_consensus.cc:1275] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 14:53:08.803536  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:08.804291  7773 raft_consensus.cc:2468] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 19.
I20260709 14:53:08.760596 13241 raft_consensus.cc:493] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:08.787899 13317 raft_consensus.cc:3060] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Advancing to term 20
I20260709 14:53:08.789057 13447 raft_consensus.cc:697] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:53:08.808262  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:08.835464  7745 leader_election.cc:304] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:08.806846 13411 raft_consensus.cc:2804] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 14:53:08.798632 13476 raft_consensus.cc:2804] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 14:53:08.799158 13403 raft_consensus.cc:3060] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Advancing to term 18
I20260709 14:53:08.841020  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:08.801023 12965 raft_consensus.cc:493] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 14:53:08.839519  8598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 285390us
I20260709 14:53:08.843348 13426 raft_consensus.cc:2804] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader election won for term 16
I20260709 14:53:08.845942  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:08.846306 13426 raft_consensus.cc:697] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:53:08.847003  7845 raft_consensus.cc:2410] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for term 19 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 14:53:08.841902 13411 raft_consensus.cc:493] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:08.847668 13411 raft_consensus.cc:3060] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Advancing to term 19
I20260709 14:53:08.847358 13426 consensus_queue.cc:237] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:08.821902 13241 raft_consensus.cc:3060] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Advancing to term 17
I20260709 14:53:08.850191  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:08.851716  7745 leader_election.cc:304] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:08.852139  7853 raft_consensus.cc:1275] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 10. (term mismatch)
I20260709 14:53:08.852561  7853 pending_rounds.cc:85] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting all ops after (but not including) 9
I20260709 14:53:08.852777  7853 pending_rounds.cc:107] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting uncommitted NO_OP operation due to leader change: 16.10
I20260709 14:53:08.853128  7853 raft_consensus.cc:2889] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:53:08.844246  7775 raft_consensus.cc:2468] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 12.
I20260709 14:53:08.857390  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9441e831627143a991a1556dcdce71e3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:08.840435 13476 raft_consensus.cc:493] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:08.807868 13451 raft_consensus.cc:515] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:08.880823  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:08.881909  7775 raft_consensus.cc:2410] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for term 18 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 14:53:08.882404 13477 raft_consensus.cc:3060] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Advancing to term 18
I20260709 14:53:08.882570  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:08.796088 13474 consensus_queue.cc:1048] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.071s
I20260709 14:53:08.876492  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:08.874078  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c563cc7cfbe4d59be4ffc5cf847ce56" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:08.894345  7849 raft_consensus.cc:2468] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 9.
I20260709 14:53:08.894642  7853 raft_consensus.cc:2410] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
W20260709 14:53:08.892014  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 209195us
I20260709 14:53:08.897553  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:08.898598  7819 leader_election.cc:304] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:08.851437 12965 raft_consensus.cc:3060] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Advancing to term 16
I20260709 14:53:08.849722 13447 consensus_queue.cc:237] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:08.914114  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:08.953594  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258d6c2dda954bf5b65930fde8ecb9f3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:08.952411  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:08.903170  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:08.958276  7853 raft_consensus.cc:2468] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 15.
I20260709 14:53:08.958889  7774 raft_consensus.cc:2393] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 12: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:53:08.898459  7775 raft_consensus.cc:2468] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 17.
I20260709 14:53:08.959066  7845 raft_consensus.cc:2393] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 18: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:53:08.932340  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:08.963574  7850 raft_consensus.cc:2410] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for term 22 because replica has last-logged OpId of term: 20 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 11.
W20260709 14:53:08.959329  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:08.899938  7819 leader_election.cc:304] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
W20260709 14:53:08.966815  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 66525.6us
I20260709 14:53:08.879477 13476 raft_consensus.cc:3060] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Advancing to term 15
I20260709 14:53:08.981393  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
W20260709 14:53:08.992440  7894 connection.cc:256] RPC call timeout handler was delayed by -1.6419566940001005s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1844s for a response
I20260709 14:53:08.994431  7894 leader_election.cc:304] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed
W20260709 14:53:08.984331 13389 consensus_meta.cc:287] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent flushing consensus metadata: real 0.501s	user 0.010s	sys 0.005s
I20260709 14:53:08.901974 13332 leader_election.cc:290] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:09.001775  7850 raft_consensus.cc:1275] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 14:53:09.007207  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:09.024370  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783e4874513449ef9084b833f188a6d3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:08.915063 13277 consensus_queue.cc:1048] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.084s
I20260709 14:53:09.020975 13389 raft_consensus.cc:515] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:09.037955 13277 raft_consensus.cc:2804] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 14:53:09.039143 13277 raft_consensus.cc:493] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Starting leader election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:53:09.041851 13489 raft_consensus.cc:493] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:09.042402  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:09.042778 13489 raft_consensus.cc:515] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:09.036041  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce9c0ef2db24c13a8b1402f21819458" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:09.040591 13277 raft_consensus.cc:3060] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Advancing to term 18
I20260709 14:53:09.045758 13432 leader_election.cc:290] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:09.054697  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258d6c2dda954bf5b65930fde8ecb9f3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
W20260709 14:53:09.055487 13362 consensus_meta.cc:287] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent flushing consensus metadata: real 0.594s	user 0.012s	sys 0.001s
I20260709 14:53:09.055621  7774 raft_consensus.cc:2393] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 14: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:53:09.056022 13362 raft_consensus.cc:515] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:09.058266 13486 raft_consensus.cc:493] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:53:09.058876 13486 raft_consensus.cc:515] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:09.057703  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:09.061600  7779 raft_consensus.cc:2468] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 12.
I20260709 14:53:09.062400  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783e4874513449ef9084b833f188a6d3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:09.064996  7774 raft_consensus.cc:1240] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 17. Current term is 18. Ops: []
I20260709 14:53:09.070899 13483 raft_consensus.cc:2804] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 14:53:09.071732 13483 raft_consensus.cc:493] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:09.072167 13483 raft_consensus.cc:3060] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 14:53:08.998891 13484 raft_consensus.cc:2804] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 14:53:09.073733 13484 raft_consensus.cc:493] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:09.074156 13484 raft_consensus.cc:3060] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [term 9 FOLLOWER]: Advancing to term 10
I20260709 14:53:09.077136 13451 leader_election.cc:290] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:09.074111  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
W20260709 14:53:09.091779  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 123381us
W20260709 14:53:09.091172  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 103035us
I20260709 14:53:09.099223  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18d29d52d304c87b930d4fb5eaf50b1" candidate_uuid: "9418391fa82a42c79c6cad13ba91d964" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:09.093075  7819 leader_election.cc:304] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
W20260709 14:53:09.102466  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 108293us
W20260709 14:53:09.082151 13482 log.cc:927] Time spent T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 14:53:09.104619  7819 leader_election.cc:304] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:09.061116 13486 leader_election.cc:290] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:09.109797  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:09.110559  7777 raft_consensus.cc:2468] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 17.
I20260709 14:53:09.113497 13290 raft_consensus.cc:515] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:09.119092  6549 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 14:53:09.121748  7773 raft_consensus.cc:2368] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 21. Current term is 22.
I20260709 14:53:09.114688 13489 leader_election.cc:290] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:09.153410  7775 raft_consensus.cc:1275] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Refusing update from remote peer 9418391fa82a42c79c6cad13ba91d964: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 14:53:09.158516 13362 leader_election.cc:290] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:09.161072 13241 raft_consensus.cc:515] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:09.163928 13241 leader_election.cc:290] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:09.167127 13492 raft_consensus.cc:2804] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 14:53:09.167959 13496 raft_consensus.cc:2804] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 14:53:09.168330 13492 raft_consensus.cc:493] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:09.169082 13492 raft_consensus.cc:3060] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Advancing to term 18
I20260709 14:53:09.168889 13496 raft_consensus.cc:493] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:09.192297 13496 raft_consensus.cc:3060] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:53:09.123374 13476 raft_consensus.cc:515] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:09.210356 13343 consensus_queue.cc:1048] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 14:53:09.213016 13403 raft_consensus.cc:515] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:09.216934  7847 raft_consensus.cc:2410] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for term 20 because replica has last-logged OpId of term: 19 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
W20260709 14:53:09.221585  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:09.223163 13415 leader_election.cc:290] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:09.225221 13290 leader_election.cc:290] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 22 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:09.226783 13484 raft_consensus.cc:515] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:09.190934 13241 raft_consensus.cc:493] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:53:09.232839  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 129199us
W20260709 14:53:09.250984  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 147163us
I20260709 14:53:09.195359 13277 raft_consensus.cc:515] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:09.265518 13277 leader_election.cc:290] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 18 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:09.266695 13389 leader_election.cc:290] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:09.213056 12965 raft_consensus.cc:515] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:09.269554 12965 leader_election.cc:290] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 16 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:09.245743 13241 raft_consensus.cc:515] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:09.272425 13241 leader_election.cc:290] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:09.169142 13411 raft_consensus.cc:515] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:09.284096  7819 leader_election.cc:304] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:09.309068  7819 leader_election.cc:304] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:09.260459 13483 raft_consensus.cc:515] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:09.268889 13492 raft_consensus.cc:515] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:09.265736 13476 leader_election.cc:290] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:09.302944 13477 raft_consensus.cc:2749] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 14:53:09.304284 13484 leader_election.cc:290] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 10 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:09.306200 13411 leader_election.cc:290] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:09.318665 13403 leader_election.cc:290] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:09.309894 13277 raft_consensus.cc:2804] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 14:53:09.322059 13277 raft_consensus.cc:493] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:09.322445 13277 raft_consensus.cc:3060] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Advancing to term 18
W20260709 14:53:09.310590  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 205700us
W20260709 14:53:09.313326  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:09.317833 13492 leader_election.cc:290] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 18 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:53:09.333134  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 57865us
I20260709 14:53:09.333837  7819 leader_election.cc:304] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:09.336563  7776 raft_consensus.cc:2468] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 18.
I20260709 14:53:09.338604  7819 leader_election.cc:304] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:09.339051 13486 consensus_queue.cc:1059] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.019s
I20260709 14:53:09.360495 13483 leader_election.cc:290] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:09.337872 13492 raft_consensus.cc:2749] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 14:53:09.341897 13484 raft_consensus.cc:2804] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 14:53:09.364601 13484 raft_consensus.cc:493] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:09.365088 13484 raft_consensus.cc:3060] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Advancing to term 17
I20260709 14:53:09.361402 13502 raft_consensus.cc:2749] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 14:53:09.368637  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:09.376813  7819 leader_election.cc:304] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:53:09.380590  7819 leader_election.cc:304] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:09.383183  7819 leader_election.cc:304] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:53:09.384599  7819 leader_election.cc:304] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:53:09.385496 13502 raft_consensus.cc:2804] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 14:53:09.386068 13502 raft_consensus.cc:493] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Starting leader election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:53:09.386498 13502 raft_consensus.cc:3060] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Advancing to term 16
I20260709 14:53:09.388221  7674 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51352 (request call id 154) took 1227 ms. Trace:
I20260709 14:53:09.391234 13317 raft_consensus.cc:2804] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 14:53:09.397646 13317 raft_consensus.cc:493] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:09.398033 13317 raft_consensus.cc:3060] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Advancing to term 13
I20260709 14:53:09.401921 13501 consensus_queue.cc:1059] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 14:53:09.402791 13505 raft_consensus.cc:3055] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 14:53:09.403927 13505 raft_consensus.cc:740] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:09.389834 13485 raft_consensus.cc:2804] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 14:53:09.406738 13485 raft_consensus.cc:493] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:09.407155 13485 raft_consensus.cc:3060] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Advancing to term 16
I20260709 14:53:09.408267 13496 raft_consensus.cc:515] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:09.388654  7674 rpcz_store.cc:276] 0709 14:53:08.160433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:53:08.160608 (+   175us) service_pool.cc:224] Handling call
0709 14:53:09.388093 (+1227485us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 14:53:08.715405 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 14:53:08.715964 (+   559us) write_op.cc:432] Acquiring schema lock in shared mode
0709 14:53:08.716002 (+    38us) write_op.cc:435] Acquired schema lock
0709 14:53:08.716019 (+    17us) tablet.cc:662] Decoding operations
0709 14:53:08.716374 (+   355us) write_op.cc:620] Acquiring the partition lock for write op
0709 14:53:08.716452 (+    78us) write_op.cc:641] Partition lock acquired for write op
0709 14:53:08.716481 (+    29us) tablet.cc:685] Acquiring locks for 1 operations
0709 14:53:08.716659 (+   178us) tablet.cc:701] Row locks acquired
0709 14:53:08.716684 (+    25us) write_op.cc:260] PREPARE: finished
0709 14:53:08.716839 (+   155us) write_op.cc:270] Start()
0709 14:53:08.716957 (+   118us) write_op.cc:276] Timestamp: P: 1783608788716785 usec, L: 0
0709 14:53:08.716978 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 14:53:08.838767 (+121789us) log.cc:844] Serialized 533 byte log entry
0709 14:53:09.268591 (+429824us) spinlock_profiling.cc:243] Waited 24.5 ms on lock 0x7b5400349f20. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae0c343 00007fb68ae0fd75 00007fb68ae0fd09 00007fb68ae0fc99 00007fb68ae0fc61 00007fb68ae0ef5d 0000000000396ad4 0000000000396919 00007fb687da1475 00007fb687da37c1
0709 14:53:09.268991 (+   400us) op_driver.cc:464] REPLICATION: finished
0709 14:53:09.350233 (+ 81242us) write_op.cc:301] APPLY: starting
0709 14:53:09.358123 (+  7890us) tablet.cc:1367] starting BulkCheckPresence
0709 14:53:09.359298 (+  1175us) tablet.cc:1370] finished BulkCheckPresence
0709 14:53:09.359321 (+    23us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 14:53:09.360020 (+   699us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 14:53:09.360203 (+   183us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 14:53:09.360247 (+    44us) write_op.cc:312] APPLY: finished
0709 14:53:09.360463 (+   216us) log.cc:844] Serialized 25 byte log entry
0709 14:53:09.360671 (+   208us) write_op.cc:489] Releasing partition, row and schema locks
0709 14:53:09.360745 (+    74us) write_op.cc:454] Released schema lock
0709 14:53:09.360787 (+    42us) write_op.cc:341] FINISH: Updating metrics
0709 14:53:09.363599 (+  2812us) write_op.cc:489] Releasing partition, row and schema locks
0709 14:53:09.364950 (+  1351us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":80896,"apply.run_cpu_time_us":3294,"apply.run_wall_time_us":11011,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8295,"num_ops":1,"prepare.queue_time_us":526043,"prepare.run_cpu_time_us":15748,"prepare.run_wall_time_us":282747,"raft.queue_time_us":189150,"raft.run_cpu_time_us":6184,"raft.run_wall_time_us":84872,"replication_time_us":551823,"spinlock_wait_cycles":56264960,"thread_start_us":591070,"threads_started":4,"wal-append.queue_time_us":195280}]]}
W20260709 14:53:09.405975  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 67483us
I20260709 14:53:09.413074 13483 consensus_queue.cc:1059] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 14:53:09.418764  7894 leader_election.cc:304] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:09.390411 13492 raft_consensus.cc:2749] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 14:53:09.428023  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:09.428555  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:09.429190  7776 raft_consensus.cc:2393] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 16: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:53:09.429644  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:09.430508  7775 raft_consensus.cc:3060] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Advancing to term 18
I20260709 14:53:09.431524  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 22 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:09.432488  7779 raft_consensus.cc:2410] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for term 22 because replica has last-logged OpId of term: 19 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
W20260709 14:53:09.432664  7819 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:09.429175  7772 raft_consensus.cc:2468] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 17.
I20260709 14:53:09.435132  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:09.435614  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:09.436398  7779 raft_consensus.cc:2393] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 18: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:53:09.437703  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:09.438906  7776 raft_consensus.cc:3060] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Advancing to term 18
I20260709 14:53:09.447788  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:09.448688  7773 raft_consensus.cc:2393] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 15: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:53:09.454035  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c563cc7cfbe4d59be4ffc5cf847ce56" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:09.455776  7777 raft_consensus.cc:2393] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 10: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:53:09.398051 13277 raft_consensus.cc:515] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:09.461841  7819 leader_election.cc:304] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:09.443063 13500 raft_consensus.cc:2804] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 14:53:09.444463 13491 consensus_queue.cc:1048] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.014s
I20260709 14:53:09.471211 13277 leader_election.cc:290] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 18 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:09.473835 13510 consensus_queue.cc:1048] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 14:53:09.475649 13510 consensus_queue.cc:1048] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 14:53:09.466274 13501 consensus_queue.cc:1048] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 14:53:09.477072 13403 raft_consensus.cc:493] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:09.477888 13403 raft_consensus.cc:515] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:09.478236 13497 raft_consensus.cc:2749] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 14:53:09.468333 13496 leader_election.cc:290] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 11 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:09.479280 13484 raft_consensus.cc:515] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:09.480654 13403 leader_election.cc:290] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:09.434073 13505 consensus_queue.cc:260] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:09.482326 13505 raft_consensus.cc:3060] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 14:53:09.484315 13317 raft_consensus.cc:515] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:09.463821 13492 consensus_queue.cc:1048] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.006s
I20260709 14:53:09.485409 13500 raft_consensus.cc:493] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:09.502573 13500 raft_consensus.cc:3060] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 14:53:09.484174 13485 raft_consensus.cc:515] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:09.493204 13489 raft_consensus.cc:3055] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 14:53:09.506716 13489 raft_consensus.cc:740] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:09.508016 13489 consensus_queue.cc:260] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:09.465440  7776 raft_consensus.cc:2468] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 18.
I20260709 14:53:09.499761  7775 raft_consensus.cc:2468] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 18.
W20260709 14:53:09.509672  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 67300.2us
I20260709 14:53:09.513710  7894 leader_election.cc:304] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:09.523283  7894 leader_election.cc:304] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac, 9418391fa82a42c79c6cad13ba91d964
I20260709 14:53:09.522640  7675 catalog_manager.cc:5697] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 16 to 17, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 17 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:53:09.529050  7675 catalog_manager.cc:5697] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 16 to 17, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 17 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:53:09.530333  7819 leader_election.cc:304] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:09.521459 13317 leader_election.cc:290] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:09.533195  7819 leader_election.cc:304] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:09.527019 13489 raft_consensus.cc:3060] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 14:53:09.526228 13486 raft_consensus.cc:2804] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 14:53:09.534458  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 89755us
I20260709 14:53:09.533550 13491 raft_consensus.cc:2749] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 14:53:09.538702 13496 raft_consensus.cc:2749] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 14:53:09.535882 13277 raft_consensus.cc:2804] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 14:53:09.540321  7894 leader_election.cc:304] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:09.495853 13502 raft_consensus.cc:515] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:09.538074  7893 leader_election.cc:304] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:09.545332  7894 leader_election.cc:304] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:09.531234 13492 consensus_queue.cc:1059] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 14:53:09.537138 13501 consensus_queue.cc:1048] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.012s
I20260709 14:53:09.542605  7819 leader_election.cc:304] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:09.526036 13509 consensus_queue.cc:1059] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.018s
I20260709 14:53:09.537516 13486 raft_consensus.cc:493] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:09.550843  7893 leader_election.cc:304] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:09.553011  7819 leader_election.cc:304] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:09.544426 13484 leader_election.cc:290] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 17 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:09.551223 13496 raft_consensus.cc:2749] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 14:53:09.544085 13277 raft_consensus.cc:493] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:09.546732 13483 raft_consensus.cc:2804] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 14:53:09.543881 13507 consensus_queue.cc:1048] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 14:53:09.559101  7819 leader_election.cc:304] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:09.545606 13317 consensus_queue.cc:1048] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 14:53:09.556226  7676 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54364 (request call id 346) took 8889 ms. Trace:
I20260709 14:53:09.570173 13505 raft_consensus.cc:2749] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 14:53:09.571710 13497 raft_consensus.cc:3055] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 LEADER]: Stepping down as leader of term 13
I20260709 14:53:09.575294 13497 raft_consensus.cc:740] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:53:09.572815  7819 leader_election.cc:304] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:09.551630 13491 raft_consensus.cc:2804] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 14:53:09.576715 13497 consensus_queue.cc:260] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:09.572793 13509 raft_consensus.cc:3055] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 14:53:09.553407 13514 raft_consensus.cc:2804] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 14:53:09.555287  7675 catalog_manager.cc:5697] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 16 to 17, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 17 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:53:09.558270 13490 raft_consensus.cc:2749] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 14:53:09.570732 13277 raft_consensus.cc:3060] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Advancing to term 19
I20260709 14:53:09.572460 13483 raft_consensus.cc:493] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:09.580780  7819 leader_election.cc:304] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:09.553341 13486 raft_consensus.cc:3060] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 14:53:09.563758 13485 leader_election.cc:290] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 16 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:09.583964  7675 catalog_manager.cc:5697] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 17 to 18, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 18 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:53:09.574352  7676 rpcz_store.cc:276] 0709 14:53:00.667272 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:53:00.667523 (+   251us) service_pool.cc:224] Handling call
0709 14:53:09.556049 (+8888526us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 14:53:09.032634 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 14:53:09.039204 (+  6570us) write_op.cc:432] Acquiring schema lock in shared mode
0709 14:53:09.039244 (+    40us) write_op.cc:435] Acquired schema lock
0709 14:53:09.039262 (+    18us) tablet.cc:662] Decoding operations
0709 14:53:09.040054 (+   792us) write_op.cc:620] Acquiring the partition lock for write op
0709 14:53:09.040102 (+    48us) write_op.cc:641] Partition lock acquired for write op
0709 14:53:09.040142 (+    40us) tablet.cc:685] Acquiring locks for 7 operations
0709 14:53:09.040614 (+   472us) tablet.cc:701] Row locks acquired
0709 14:53:09.040632 (+    18us) write_op.cc:260] PREPARE: finished
0709 14:53:09.040818 (+   186us) write_op.cc:270] Start()
0709 14:53:09.040967 (+   149us) write_op.cc:276] Timestamp: P: 1783608789040747 usec, L: 0
0709 14:53:09.040992 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 14:53:09.083682 (+ 42690us) log.cc:844] Serialized 2849 byte log entry
0709 14:53:09.314036 (+230354us) op_driver.cc:464] REPLICATION: finished
0709 14:53:09.365443 (+ 51407us) write_op.cc:301] APPLY: starting
0709 14:53:09.365531 (+    88us) tablet.cc:1367] starting BulkCheckPresence
0709 14:53:09.450937 (+ 85406us) tablet.cc:1370] finished BulkCheckPresence
0709 14:53:09.451054 (+   117us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 14:53:09.469044 (+ 17990us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 14:53:09.486824 (+ 17780us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=14,key_file_lookups=14,delta_file_lookups=14,mrs_lookups=0
0709 14:53:09.486881 (+    57us) write_op.cc:312] APPLY: finished
0709 14:53:09.487197 (+   316us) log.cc:844] Serialized 73 byte log entry
0709 14:53:09.488078 (+   881us) write_op.cc:489] Releasing partition, row and schema locks
0709 14:53:09.488209 (+   131us) write_op.cc:454] Released schema lock
0709 14:53:09.488255 (+    46us) write_op.cc:341] FINISH: Updating metrics
0709 14:53:09.501767 (+ 13512us) write_op.cc:489] Releasing partition, row and schema locks
0709 14:53:09.501801 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":38356,"reported_tablets":39,"child_traces":[["op",{"apply.queue_time_us":51150,"apply.run_cpu_time_us":13505,"apply.run_wall_time_us":136251,"cfile_cache_hit":28,"cfile_cache_hit_bytes":29176,"num_ops":7,"prepare.queue_time_us":762487,"prepare.run_cpu_time_us":3858,"prepare.run_wall_time_us":56047,"replication_time_us":272888,"thread_start_us":90746,"threads_started":1}]]}
I20260709 14:53:09.574129 13484 raft_consensus.cc:2804] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 14:53:09.570410 13243 consensus_queue.cc:1048] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.019s
I20260709 14:53:09.578805 13496 raft_consensus.cc:2749] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 14:53:09.579128 13491 raft_consensus.cc:493] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:09.603756 13491 raft_consensus.cc:3060] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:53:09.598855  7675 catalog_manager.cc:5697] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 9 to 10, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 10 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:53:09.581698 13509 raft_consensus.cc:740] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:09.583161 13514 raft_consensus.cc:493] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:09.590463 13497 raft_consensus.cc:3060] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Advancing to term 14
I20260709 14:53:09.613515  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:09.609023  7675 catalog_manager.cc:5697] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 13 to 15, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 15 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:53:09.606009 13502 leader_election.cc:290] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 16 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:09.600718 13490 raft_consensus.cc:3060] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Advancing to term 15
I20260709 14:53:09.588572 13483 raft_consensus.cc:3060] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:53:09.614954  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:09.612076  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:53:09.615438  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 64701.9us
I20260709 14:53:09.624023  7851 raft_consensus.cc:2393] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 16: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:53:09.597383 13507 consensus_queue.cc:1048] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 14:53:09.623905  7847 raft_consensus.cc:2468] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 19.
I20260709 14:53:09.625056  7893 leader_election.cc:304] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:09.599843 13484 raft_consensus.cc:493] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting leader election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:53:09.614588 13514 raft_consensus.cc:3060] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 14:53:09.630980  7893 leader_election.cc:304] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:09.629442  7675 catalog_manager.cc:5697] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 18 to 19, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 19 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:53:09.631124 13501 raft_consensus.cc:2804] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 14:53:09.638078 13501 raft_consensus.cc:493] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:09.639005 13501 raft_consensus.cc:3060] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Advancing to term 19
I20260709 14:53:09.628185 13484 raft_consensus.cc:3060] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Advancing to term 13
I20260709 14:53:09.653434  7675 catalog_manager.cc:5697] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:53:09.637696 13515 raft_consensus.cc:2804] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 14:53:09.657349 13515 raft_consensus.cc:493] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:09.656584 13511 consensus_queue.cc:1048] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 14:53:09.657729 13515 raft_consensus.cc:3060] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 14:53:09.644580 13491 raft_consensus.cc:515] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:09.662998 13491 leader_election.cc:290] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 11 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:09.655871  7675 catalog_manager.cc:5697] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 15 to 18, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 18 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
W20260709 14:53:09.674811  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 94716.2us
I20260709 14:53:09.675871  7819 leader_election.cc:304] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:09.675874  7675 catalog_manager.cc:5697] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 17 to 18, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 18 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:53:09.682220  7675 catalog_manager.cc:5697] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:53:09.688313  7819 leader_election.cc:304] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:09.690668  7675 catalog_manager.cc:5697] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 12 to 13, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 13 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:53:09.698793  7819 leader_election.cc:400] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 11 pre-election: Vote denied by peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587) with higher term. Message: Invalid argument: T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 11. Current term is 12.
I20260709 14:53:09.705080  7675 catalog_manager.cc:5697] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 15 to 18, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 18 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:53:09.713023  7675 catalog_manager.cc:5697] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 17 to 19, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 19 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:53:09.717196  7675 catalog_manager.cc:5697] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:53:09.721531  7819 leader_election.cc:304] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
W20260709 14:53:09.719678  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 68612.5us
I20260709 14:53:09.721207  7675 catalog_manager.cc:5697] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:53:09.674188 13510 consensus_queue.cc:1048] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 14:53:09.696365 13496 raft_consensus.cc:2804] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 14:53:09.634171 13509 consensus_queue.cc:260] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:09.725885 13403 raft_consensus.cc:493] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:09.744025  7819 leader_election.cc:304] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:09.691352 13507 consensus_queue.cc:1048] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 14:53:09.763190  7819 leader_election.cc:304] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:09.766255  7819 leader_election.cc:304] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:09.709141 13500 raft_consensus.cc:515] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:09.768517 13243 raft_consensus.cc:2749] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 14:53:09.757397 13502 raft_consensus.cc:2749] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 14:53:09.783666 13502 raft_consensus.cc:2749] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 14:53:09.763017 13403 raft_consensus.cc:515] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:09.769438 13317 raft_consensus.cc:2804] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 14:53:09.787985 13317 raft_consensus.cc:493] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:09.788918 13317 raft_consensus.cc:3060] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Advancing to term 15
I20260709 14:53:09.789367 13509 raft_consensus.cc:3060] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 14:53:09.756349 13411 raft_consensus.cc:493] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:09.791640 13411 raft_consensus.cc:515] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:09.769771 13491 raft_consensus.cc:993] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0: : Instructing follower 1de5e20126fa4d8ca0793d19c7b847ed to start an election
I20260709 14:53:09.736406 13496 raft_consensus.cc:493] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:09.774190 13485 raft_consensus.cc:2804] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 14:53:09.774793 12965 raft_consensus.cc:493] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:09.775310 13483 raft_consensus.cc:515] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:09.796207  7819 leader_election.cc:304] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:09.816949  7819 leader_election.cc:304] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:09.804060 13277 raft_consensus.cc:515] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:09.759094 13477 raft_consensus.cc:493] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:09.823060  7819 leader_election.cc:304] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:09.827867  7819 leader_election.cc:304] T 9441e831627143a991a1556dcdce71e3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 9418391fa82a42c79c6cad13ba91d964
I20260709 14:53:09.824040 13489 raft_consensus.cc:1081] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 LEADER]: Signalling peer 1de5e20126fa4d8ca0793d19c7b847ed to start an election
I20260709 14:53:09.806735 13411 leader_election.cc:290] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:09.833823  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:09.835633  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:09.836820  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:09.788024 13500 leader_election.cc:290] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 18 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:09.839854  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:09.840284  7927 raft_consensus.cc:1240] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 14:53:09.840786  7921 raft_consensus.cc:2376] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 15. Re-sending same reply.
I20260709 14:53:09.813779 13496 raft_consensus.cc:3060] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Advancing to term 21
I20260709 14:53:09.813946 13485 raft_consensus.cc:493] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:09.845072  7819 leader_election.cc:304] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:09.845516  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:09.894804  7924 raft_consensus.cc:3060] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 14:53:09.831585 13502 raft_consensus.cc:2749] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 14:53:09.832647 13477 raft_consensus.cc:515] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:09.817844 12965 raft_consensus.cc:515] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:53:09.852941 13523 log.cc:927] Time spent T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.056s	user 0.004s	sys 0.000s
I20260709 14:53:09.824651 13492 raft_consensus.cc:2804] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 14:53:09.861833  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c563cc7cfbe4d59be4ffc5cf847ce56" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:09.905004  7919 raft_consensus.cc:2368] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 10. Current term is 11.
I20260709 14:53:09.837452 13517 raft_consensus.cc:2749] T 9441e831627143a991a1556dcdce71e3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 14:53:09.866389  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:09.869415 13484 raft_consensus.cc:515] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:09.869665  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1f7722fdea49e0b5e9c5d96633eaf9" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:09.875417 13277 leader_election.cc:290] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 19 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:09.876235 13501 raft_consensus.cc:515] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:09.880021 13514 raft_consensus.cc:515] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:09.881317  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:09.859491 13403 leader_election.cc:290] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:53:09.888105  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 163737us
I20260709 14:53:09.832707 13243 raft_consensus.cc:2804] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 14:53:09.848328  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:09.899802  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
W20260709 14:53:09.900162 13521 log.cc:927] Time spent T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.070s	user 0.006s	sys 0.002s
I20260709 14:53:09.891639 13485 raft_consensus.cc:3060] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Advancing to term 15
I20260709 14:53:09.913769  7893 leader_election.cc:304] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:09.927219  7928 raft_consensus.cc:2393] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 18: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:53:09.929895  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:09.930851  7846 raft_consensus.cc:2393] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 18: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:53:09.956293  7894 leader_election.cc:304] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:09.907984 13492 raft_consensus.cc:493] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:09.934767  7854 raft_consensus.cc:2410] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for term 14 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 14:53:09.960005  7927 raft_consensus.cc:1240] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 18. Current term is 19. Ops: [18.13-18.13]
I20260709 14:53:09.967000 13515 raft_consensus.cc:515] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:09.969491  7853 raft_consensus.cc:1240] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 18. Current term is 19. Ops: []
I20260709 14:53:09.970978 13514 leader_election.cc:290] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:09.925498 13243 raft_consensus.cc:493] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:09.924414 13502 raft_consensus.cc:2804] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 14:53:09.972707 13243 raft_consensus.cc:3060] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Advancing to term 13
I20260709 14:53:09.974169 13484 leader_election.cc:290] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:53:09.987643  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 142645us
W20260709 14:53:09.958488 13522 log.cc:927] Time spent T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 14:53:10.001545  7819 leader_election.cc:400] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 21 pre-election: Vote denied by peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587) with higher term. Message: Invalid argument: T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 21. Current term is 22.
I20260709 14:53:10.002779  7819 leader_election.cc:403] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 21 pre-election: Cancelling election due to peer responding with higher term
I20260709 14:53:10.004316  7819 leader_election.cc:304] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:09.995555  7893 leader_election.cc:304] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:10.005712  7819 leader_election.cc:304] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:09.964483 13505 raft_consensus.cc:2764] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 14:53:09.958361 13491 raft_consensus.cc:493] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:53:09.963649 13492 raft_consensus.cc:3060] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Advancing to term 20
I20260709 14:53:10.022157 13484 raft_consensus.cc:2749] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 14:53:10.023262 13484 raft_consensus.cc:2804] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Leader election won for term 18
I20260709 14:53:10.023948 13484 raft_consensus.cc:697] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:53:10.024533 13491 raft_consensus.cc:515] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:10.027338 13491 leader_election.cc:290] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:10.028017 13515 leader_election.cc:290] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 13 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:09.971138 12965 leader_election.cc:290] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:10.007905 13516 raft_consensus.cc:2804] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 14:53:09.988691 13501 leader_election.cc:290] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:10.035852 13317 raft_consensus.cc:515] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:10.040270 13477 leader_election.cc:290] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:09.986413 13502 raft_consensus.cc:493] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:10.042758 13502 raft_consensus.cc:3060] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Advancing to term 18
I20260709 14:53:10.044132 13483 leader_election.cc:290] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 11 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:10.032611 13516 raft_consensus.cc:493] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:53:10.049638 13516 raft_consensus.cc:3060] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Advancing to term 20
I20260709 14:53:10.007148 13517 raft_consensus.cc:3060] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Advancing to term 22
I20260709 14:53:10.024959 13484 consensus_queue.cc:237] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:53:10.067224  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 71786.8us
I20260709 14:53:10.068571  7893 leader_election.cc:304] T 9ce9c0ef2db24c13a8b1402f21819458 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 9418391fa82a42c79c6cad13ba91d964
W20260709 14:53:10.078887  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 73251.1us
I20260709 14:53:10.072307 13513 raft_consensus.cc:2749] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 14:53:10.072752 12965 raft_consensus.cc:493] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:10.099128  7893 leader_election.cc:304] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:53:10.088927  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 93379.1us
I20260709 14:53:10.074667 13477 raft_consensus.cc:493] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:10.095425  7819 leader_election.cc:304] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:10.104425  7819 leader_election.cc:304] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:10.113041  7819 leader_election.cc:304] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:10.113759  7893 leader_election.cc:304] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:10.103616 13514 raft_consensus.cc:2749] T 9ce9c0ef2db24c13a8b1402f21819458 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 14:53:10.115821 13530 raft_consensus.cc:2804] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 14:53:10.133524  7893 leader_election.cc:304] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:10.134462 13403 raft_consensus.cc:493] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:10.135210 13483 raft_consensus.cc:2749] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 14:53:10.112846 13536 raft_consensus.cc:2749] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 14:53:10.116358 13524 raft_consensus.cc:3060] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 14:53:10.115953 13277 raft_consensus.cc:493] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:10.118798 13500 consensus_queue.cc:1059] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 18.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 14:53:10.132195 13530 raft_consensus.cc:493] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:10.153098  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c563cc7cfbe4d59be4ffc5cf847ce56" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:10.155311  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:10.157626 13485 raft_consensus.cc:515] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:10.159670  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:10.162793  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:10.127139 13497 raft_consensus.cc:3060] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Advancing to term 18
I20260709 14:53:10.170133  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:10.188956  7850 raft_consensus.cc:2468] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 16.
I20260709 14:53:10.175196  7893 leader_election.cc:304] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:10.193282  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce9c0ef2db24c13a8b1402f21819458" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:10.196034  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:10.196759  7927 raft_consensus.cc:1275] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 14:53:10.197813  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:10.105599 13477 raft_consensus.cc:515] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:53:10.221601 13486 consensus_meta.cc:287] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0: Time spent flushing consensus metadata: real 0.621s	user 0.000s	sys 0.016s
I20260709 14:53:10.222450 13486 raft_consensus.cc:515] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:10.182821  7923 raft_consensus.cc:2468] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 18.
I20260709 14:53:10.183266  7852 raft_consensus.cc:3060] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Advancing to term 16
I20260709 14:53:10.184054  7849 raft_consensus.cc:3060] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:53:10.103480 12965 raft_consensus.cc:515] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:53:10.206776  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 93794.7us
I20260709 14:53:10.236056  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:10.237200  7819 leader_election.cc:304] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:10.211953  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:10.212672  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:10.180578  7924 raft_consensus.cc:2468] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 18.
I20260709 14:53:10.217556  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:10.239792  7926 raft_consensus.cc:2468] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 21.
I20260709 14:53:10.230768  7848 raft_consensus.cc:1240] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 14:53:10.210537  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: true dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:10.241108  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:10.239660  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:10.242265  7919 raft_consensus.cc:2410] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for term 18 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 14:53:10.243202  7921 raft_consensus.cc:1240] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 17. Current term is 18. Ops: []
I20260709 14:53:10.182631 13513 raft_consensus.cc:2749] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 14:53:10.246989  7925 raft_consensus.cc:2393] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 15: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:53:10.248327  7894 leader_election.cc:304] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:10.250006 13486 leader_election.cc:290] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 13 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:10.250695 13511 raft_consensus.cc:2804] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 14:53:10.184293 13530 raft_consensus.cc:3060] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Advancing to term 18
I20260709 14:53:10.200388 13507 raft_consensus.cc:2749] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 14:53:10.231351 13490 consensus_meta.cc:287] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent flushing consensus metadata: real 0.607s	user 0.012s	sys 0.003s
I20260709 14:53:10.182200 13514 consensus_queue.cc:1059] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.062s
I20260709 14:53:10.252334  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:10.252960  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:10.269630  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:10.185346 13403 raft_consensus.cc:515] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:10.188053 13277 raft_consensus.cc:515] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:10.288157  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:10.203711 13496 raft_consensus.cc:515] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:10.256330 13511 raft_consensus.cc:493] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:53:10.262326 13536 raft_consensus.cc:2804] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Leader election won for term 18
I20260709 14:53:10.282332  7849 raft_consensus.cc:2468] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 11.
I20260709 14:53:10.263608 13317 leader_election.cc:290] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:10.275048 13490 raft_consensus.cc:2749] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 14:53:10.250993  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:10.253733  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:10.270690  7922 raft_consensus.cc:2393] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 20: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:53:10.298662  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:10.304111  7849 raft_consensus.cc:3060] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Advancing to term 13
I20260709 14:53:10.304116 13485 leader_election.cc:290] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:10.311906 13403 leader_election.cc:290] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:10.312961  7850 raft_consensus.cc:1240] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 14. Current term is 15. Ops: []
I20260709 14:53:10.318320  7928 raft_consensus.cc:2393] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 16: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:53:10.262027 13243 raft_consensus.cc:515] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:53:10.298066  8598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 219720us
I20260709 14:53:10.277521  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:10.319566  7845 raft_consensus.cc:1240] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 20. Current term is 21. Ops: []
W20260709 14:53:10.324154  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:10.296574  7852 raft_consensus.cc:2468] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 16.
I20260709 14:53:10.255373  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:10.332515  7925 raft_consensus.cc:2393] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 18: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:53:10.336719  7849 raft_consensus.cc:2468] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 13.
I20260709 14:53:10.338375  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:10.297420 13511 raft_consensus.cc:3060] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 14:53:10.351193  7925 raft_consensus.cc:1240] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 15. Current term is 16. Ops: [15.9-15.9]
W20260709 14:53:10.357861 13487 log.cc:927] Time spent T 00000000000000000000000000000000 P 133636659113430cb53b321cb0b1d9ee: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 14:53:10.350150  7894 leader_election.cc:304] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:10.288522 13516 raft_consensus.cc:515] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:10.361732  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
W20260709 14:53:10.347679 13527 log.cc:927] Time spent T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.228s	user 0.002s	sys 0.000s
I20260709 14:53:10.330276 13535 raft_consensus.cc:3055] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 14:53:10.318475 13536 raft_consensus.cc:697] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:53:10.366844 12965 leader_election.cc:290] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:10.367115 13243 leader_election.cc:290] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:10.367865  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:10.370581 13477 leader_election.cc:290] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:10.371037 13519 raft_consensus.cc:2804] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 14:53:10.370864 13514 consensus_queue.cc:1059] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 14:53:10.374193 13496 leader_election.cc:290] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 21 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:10.373891 13277 leader_election.cc:290] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:10.330178 13502 raft_consensus.cc:515] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:10.376212 13486 consensus_queue.cc:1059] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 14:53:10.367908 13516 leader_election.cc:290] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 20 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:10.371539 13535 raft_consensus.cc:740] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:10.392536 13519 raft_consensus.cc:697] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:10.399051 13514 raft_consensus.cc:3055] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 14:53:10.399612 13514 raft_consensus.cc:740] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:10.399798 13519 consensus_queue.cc:237] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:10.401670 13536 consensus_queue.cc:237] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:10.403546 13492 raft_consensus.cc:515] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:10.406313 13492 leader_election.cc:290] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 20 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:10.406824 13502 leader_election.cc:290] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 18 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:10.390717 13517 raft_consensus.cc:2749] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 22 FOLLOWER]: Leader pre-election lost for term 21. Reason: Vote denied by peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587) with higher term. Message: Invalid argument: T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 21. Current term is 22.
I20260709 14:53:10.411842 13514 consensus_queue.cc:260] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:10.417923 13514 raft_consensus.cc:3060] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 14:53:10.417158 13535 consensus_queue.cc:260] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:10.418905 13535 raft_consensus.cc:3060] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Advancing to term 19
W20260709 14:53:10.471143  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 233543us
I20260709 14:53:10.484579  7848 raft_consensus.cc:1240] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 17. Current term is 18. Ops: []
I20260709 14:53:10.486340  7846 raft_consensus.cc:2393] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 13: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:53:10.379683  7919 raft_consensus.cc:2393] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 13: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:53:10.493681  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258d6c2dda954bf5b65930fde8ecb9f3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:10.495786  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:10.498535  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:10.499667  7921 raft_consensus.cc:3060] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 14:53:10.378499  7923 raft_consensus.cc:2410] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for term 16 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 14:53:10.503407  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:10.513455 13516 raft_consensus.cc:493] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:10.514953 13516 raft_consensus.cc:515] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:10.520854 13510 raft_consensus.cc:493] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:10.522068 13510 raft_consensus.cc:515] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:10.531474 13497 raft_consensus.cc:2749] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 14:53:10.534929 13477 raft_consensus.cc:493] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:10.536477 13477 raft_consensus.cc:515] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:10.538568  6549 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 14:53:10.430980 13530 raft_consensus.cc:515] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:10.554953  7854 raft_consensus.cc:1240] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 17. Current term is 18. Ops: []
I20260709 14:53:10.555548 13516 leader_election.cc:290] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:10.556303 13530 leader_election.cc:290] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 18 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:10.534848  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:10.541868  7853 raft_consensus.cc:1240] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 17. Current term is 18. Ops: []
I20260709 14:53:10.508147  7819 leader_election.cc:304] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:10.545038  7925 raft_consensus.cc:1240] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 19. Current term is 20. Ops: []
I20260709 14:53:10.546344  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:10.563583  7923 raft_consensus.cc:3060] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:53:10.547971  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:10.566095  7920 raft_consensus.cc:2368] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 17. Current term is 18.
I20260709 14:53:10.565397  7894 leader_election.cc:304] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:10.548355  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:10.549636  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:10.575356  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:10.576407  7919 raft_consensus.cc:3060] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 14:53:10.582928  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:10.584527  7853 raft_consensus.cc:3060] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Advancing to term 20
I20260709 14:53:10.588718  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
W20260709 14:53:10.589692  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 81858.1us
I20260709 14:53:10.592051  7854 raft_consensus.cc:1240] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 14:53:10.592814  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:10.593945  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:10.594641  7923 raft_consensus.cc:2468] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 12.
I20260709 14:53:10.597169  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258d6c2dda954bf5b65930fde8ecb9f3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:10.598449  7847 raft_consensus.cc:2410] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for term 14 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 6.
I20260709 14:53:10.595716  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:10.599164 13530 raft_consensus.cc:2804] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Leader election won for term 18
I20260709 14:53:10.599947 13530 raft_consensus.cc:697] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:53:10.600085  7852 raft_consensus.cc:2393] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 18: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:53:10.600265  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:10.595968  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
W20260709 14:53:10.603137 13556 log.cc:927] Time spent T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.167s	user 0.001s	sys 0.000s
I20260709 14:53:10.604903  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:10.607872  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:10.610989  7923 raft_consensus.cc:2393] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 18: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
W20260709 14:53:10.614868  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 122993us
I20260709 14:53:10.614959  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:10.615675 13500 raft_consensus.cc:2804] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 14:53:10.616416  7894 leader_election.cc:304] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:10.619937  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:10.616869 13526 raft_consensus.cc:3055] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 14:53:10.623427  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:10.529122 13510 leader_election.cc:290] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:10.621815  7848 raft_consensus.cc:1240] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 17. Current term is 18. Ops: [17.12-17.12]
I20260709 14:53:10.621040  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:10.647214  7921 raft_consensus.cc:2468] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 18.
I20260709 14:53:10.617000 13500 raft_consensus.cc:697] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:10.638584 13525 raft_consensus.cc:2804] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 14:53:10.619239  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:10.620373  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:10.615561 13477 leader_election.cc:290] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:10.644093 13526 raft_consensus.cc:740] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:10.654088  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:10.654949 13525 raft_consensus.cc:697] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:10.655146  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:10.644791 13515 consensus_queue.cc:1059] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.012s
I20260709 14:53:10.662009 13515 raft_consensus.cc:3055] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 14:53:10.662685 13515 raft_consensus.cc:740] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:10.662287 13525 consensus_queue.cc:237] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:10.664287 13515 consensus_queue.cc:260] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:10.662698  7848 raft_consensus.cc:1240] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 15. Current term is 16. Ops: []
I20260709 14:53:10.666750 13515 raft_consensus.cc:3060] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 14:53:10.667729  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:10.656306 13519 raft_consensus.cc:493] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:10.639505 13514 consensus_queue.cc:1059] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.018s
I20260709 14:53:10.680088  7847 raft_consensus.cc:3060] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:53:10.680102 13519 raft_consensus.cc:515] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:10.620472 13530 consensus_queue.cc:237] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:10.658880 13500 consensus_queue.cc:237] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:10.660218 13526 consensus_queue.cc:260] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:10.685696 13526 raft_consensus.cc:3060] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 14:53:10.656000  7846 raft_consensus.cc:3060] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Advancing to term 14
I20260709 14:53:10.672587  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:10.658804  7849 raft_consensus.cc:2393] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 21: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:53:10.679080  7852 raft_consensus.cc:2468] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 15.
I20260709 14:53:10.681617  7845 raft_consensus.cc:3060] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Advancing to term 16
I20260709 14:53:10.688860 13519 leader_election.cc:290] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:10.704157  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:10.710769  7848 raft_consensus.cc:1240] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 14:53:10.712082  7919 raft_consensus.cc:2468] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 14.
I20260709 14:53:10.711772 13514 raft_consensus.cc:3055] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 14:53:10.713348 13514 raft_consensus.cc:740] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:10.714775 13514 consensus_queue.cc:260] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:10.716922 13514 raft_consensus.cc:3060] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Advancing to term 21
I20260709 14:53:10.739913  7846 raft_consensus.cc:2468] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 14.
W20260709 14:53:10.745025  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 44969.3us
I20260709 14:53:10.746471 13491 raft_consensus.cc:3055] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 14:53:10.747180 13491 raft_consensus.cc:740] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:10.752285  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:10.753324  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
W20260709 14:53:10.755926 13524 consensus_meta.cc:287] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent flushing consensus metadata: real 0.571s	user 0.011s	sys 0.017s
I20260709 14:53:10.719493  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:10.719993  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:10.720572  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:10.761216  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:10.769868  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:10.770721  7922 raft_consensus.cc:2410] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 14:53:10.772517  7920 raft_consensus.cc:1275] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 9. (term mismatch)
I20260709 14:53:10.721174  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:10.721619  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:10.772517  7922 raft_consensus.cc:1275] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 11. (term mismatch)
I20260709 14:53:10.722312  7853 raft_consensus.cc:2468] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 20.
I20260709 14:53:10.735275  7847 raft_consensus.cc:2468] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 12.
I20260709 14:53:10.757748  7921 raft_consensus.cc:3060] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Advancing to term 22
I20260709 14:53:10.760406  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:10.760169  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:10.718832  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:10.720836  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:10.772809  7927 raft_consensus.cc:2393] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 18: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:53:10.752276  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:10.774207  7922 pending_rounds.cc:85] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0: Aborting all ops after (but not including) 10
I20260709 14:53:10.773708  7920 pending_rounds.cc:85] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0: Aborting all ops after (but not including) 8
I20260709 14:53:10.779798  7920 pending_rounds.cc:107] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0: Aborting uncommitted NO_OP operation due to leader change: 15.9
I20260709 14:53:10.779347  7922 pending_rounds.cc:107] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0: Aborting uncommitted NO_OP operation due to leader change: 17.11
I20260709 14:53:10.780843  7922 raft_consensus.cc:2889] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:53:10.781188  7846 raft_consensus.cc:1240] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 19. Current term is 20. Ops: []
I20260709 14:53:10.780203  7920 raft_consensus.cc:2889] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:53:10.784147  7925 raft_consensus.cc:2468] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 18.
I20260709 14:53:10.749055 13491 consensus_queue.cc:260] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:10.789526  7852 raft_consensus.cc:2468] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 18.
I20260709 14:53:10.797948  7845 raft_consensus.cc:2468] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 16.
I20260709 14:53:10.801790  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:10.803149  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:10.807986 13513 consensus_queue.cc:1059] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 14:53:10.811116 13525 consensus_queue.cc:1059] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 14:53:10.809968 13500 raft_consensus.cc:3055] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 14:53:10.812708 13500 raft_consensus.cc:740] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:10.814021 13519 raft_consensus.cc:3055] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 14:53:10.814545 13519 raft_consensus.cc:740] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:10.815771 13519 consensus_queue.cc:260] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:10.815963 13500 consensus_queue.cc:260] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:10.820145 13519 raft_consensus.cc:3060] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 14:53:10.823460  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:10.783162 13524 raft_consensus.cc:2749] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 14:53:10.825028  7848 raft_consensus.cc:2393] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 15: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:53:10.827495 13511 raft_consensus.cc:515] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:10.829416  7924 raft_consensus.cc:1240] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 16. Current term is 17. Ops: []
W20260709 14:53:10.838837  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:10.843111 13491 raft_consensus.cc:3060] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 14:53:10.851477 13500 raft_consensus.cc:3060] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Advancing to term 18
W20260709 14:53:10.835274  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 227251us
I20260709 14:53:10.863611 13511 leader_election.cc:290] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 17 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:10.850471  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:10.874756  7921 raft_consensus.cc:2468] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 22.
I20260709 14:53:10.880872  7846 raft_consensus.cc:2393] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 16: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:53:10.885509  7849 raft_consensus.cc:2468] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 22.
W20260709 14:53:10.887317  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:10.884229  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:10.889326  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:10.892073  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:10.891729  7894 leader_election.cc:304] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
W20260709 14:53:10.889281  7744 leader_election.cc:336] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785): Timed out: RequestConsensusVote RPC to 127.6.101.67:40785 timed out after 1.791s (SENT)
I20260709 14:53:10.908345  7850 raft_consensus.cc:2468] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 18.
I20260709 14:53:10.912006 13483 raft_consensus.cc:2804] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 14:53:10.912981 13483 raft_consensus.cc:697] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:10.913825  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c563cc7cfbe4d59be4ffc5cf847ce56" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:10.914499 13483 consensus_queue.cc:237] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:10.912149 13497 raft_consensus.cc:493] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:10.919063  7848 raft_consensus.cc:1275] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 14:53:10.918766  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:10.920092  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:10.920508  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:10.918746 13497 raft_consensus.cc:515] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:53:10.920712  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 49661.7us
I20260709 14:53:10.923064  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c563cc7cfbe4d59be4ffc5cf847ce56" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:10.929543  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:10.934271  7851 raft_consensus.cc:2468] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 18.
I20260709 14:53:10.936160  7847 raft_consensus.cc:2393] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 11: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:53:10.936233  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:10.938076 13477 raft_consensus.cc:493] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:10.939327 13477 raft_consensus.cc:515] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:10.942740  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:10.923398 13497 leader_election.cc:290] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:10.945722  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
W20260709 14:53:10.947845  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:10.948834  7849 raft_consensus.cc:1275] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 14:53:10.951584  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:10.952309  7846 raft_consensus.cc:2393] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 12: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:53:10.954106  7924 raft_consensus.cc:2393] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 19: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:53:10.955968  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:10.951145  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:10.959259  7845 raft_consensus.cc:2393] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 17: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:53:10.960034  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:10.959259  7848 raft_consensus.cc:2410] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for term 19 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 14:53:10.962328  7847 raft_consensus.cc:1240] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 19. Current term is 20. Ops: []
I20260709 14:53:10.964999  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
W20260709 14:53:10.965857  7894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:10.970126  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:10.972885  7922 raft_consensus.cc:2393] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 11: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:53:10.975054  7854 raft_consensus.cc:1240] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 14. Current term is 15. Ops: []
I20260709 14:53:10.978331  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:10.991981  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:10.998544  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:11.006023  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:11.017436  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:11.013850 13513 raft_consensus.cc:493] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:11.023173 13513 raft_consensus.cc:515] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:11.030448  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:11.037681  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:11.038534  7851 raft_consensus.cc:2376] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 12. Re-sending same reply.
I20260709 14:53:11.043393  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:11.048403  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:11.054220  7848 raft_consensus.cc:2393] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 13: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:53:11.054979 13477 leader_election.cc:290] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:11.074548  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:11.077512  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:11.084911  7851 raft_consensus.cc:2393] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 19: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:53:11.076403 13515 consensus_queue.cc:1059] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.008s
I20260709 14:53:11.088554  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:53:11.089526  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:11.090292 13513 leader_election.cc:290] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:11.093763  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:11.094599  7924 raft_consensus.cc:2376] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 12. Re-sending same reply.
I20260709 14:53:11.095991  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:11.096860  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:11.097160  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:11.097716  7923 raft_consensus.cc:2376] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 22 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 22. Re-sending same reply.
I20260709 14:53:11.097095  7921 raft_consensus.cc:2393] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 18: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:53:11.099332  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:11.121356 13515 raft_consensus.cc:3055] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 14:53:11.121937 13515 raft_consensus.cc:740] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:11.123576 13515 consensus_queue.cc:260] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:11.126546 13515 raft_consensus.cc:3060] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Advancing to term 20
W20260709 14:53:11.127944  7819 connection.cc:256] RPC call timeout handler was delayed by -1.5947367669999721s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1809s for a response
W20260709 14:53:11.128571  7819 connection.cc:256] RPC call timeout handler was delayed by -1.5407367669999985s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1869s for a response
W20260709 14:53:11.129019  7819 connection.cc:256] RPC call timeout handler was delayed by -1.320236766999983s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2114s for a response
W20260709 14:53:11.129429  7819 connection.cc:256] RPC call timeout handler was delayed by -1.2143198559999746s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1825s for a response
W20260709 14:53:11.129891  7819 connection.cc:256] RPC call timeout handler was delayed by -1.2075078730000541s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1612s for a response
W20260709 14:53:11.130250  7819 connection.cc:256] RPC call timeout handler was delayed by -1.0700367670000333s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2392s for a response
I20260709 14:53:11.132797  7819 leader_election.cc:304] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:11.134388 13497 raft_consensus.cc:2749] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 14:53:11.121781  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:11.138677  7819 leader_election.cc:304] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:53:11.139110 13477 consensus_queue.cc:1059] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 14:53:11.139678 13497 raft_consensus.cc:2764] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
W20260709 14:53:11.143950  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 58100.9us
I20260709 14:53:11.160687  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:11.161607  7848 raft_consensus.cc:2468] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 16.
I20260709 14:53:11.168356  7924 raft_consensus.cc:2468] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 20.
W20260709 14:53:11.168967  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:11.170816  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:11.171800  7922 raft_consensus.cc:2368] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 11. Current term is 12.
I20260709 14:53:11.178117  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:11.181350  7922 raft_consensus.cc:2393] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 18: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:53:11.154913 13477 raft_consensus.cc:3055] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 LEADER]: Stepping down as leader of term 15
I20260709 14:53:11.182961 13477 raft_consensus.cc:740] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:53:11.184576 13477 consensus_queue.cc:260] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:11.186540 13477 raft_consensus.cc:3060] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Advancing to term 16
I20260709 14:53:11.186861  7819 leader_election.cc:304] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:11.188287 13497 raft_consensus.cc:2749] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 14:53:11.190018  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:11.189921  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:11.192086  7922 raft_consensus.cc:2368] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 13. Current term is 14.
I20260709 14:53:11.197222 13497 consensus_queue.cc:1059] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 14:53:11.198836 13530 raft_consensus.cc:3055] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 LEADER]: Stepping down as leader of term 10
I20260709 14:53:11.199375 13530 raft_consensus.cc:740] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:53:11.200915 13530 consensus_queue.cc:260] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:11.202819 13530 raft_consensus.cc:3060] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:53:11.206278  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:11.207250  7922 raft_consensus.cc:3060] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 14:53:11.207463  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:11.207867  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:11.209339  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:11.209717  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:11.210320  7921 raft_consensus.cc:2410] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 14:53:11.210536  7924 raft_consensus.cc:2393] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 16: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:53:11.211561  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:11.212517  7920 raft_consensus.cc:2393] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 13: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:53:11.212093  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:11.213171  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:11.214133  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:11.214849  7919 raft_consensus.cc:2468] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 20.
I20260709 14:53:11.214385  7927 raft_consensus.cc:2393] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 13: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:53:11.217404  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:11.223045  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:11.198046  7673 catalog_manager.cc:5697] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:53:11.197342  7819 leader_election.cc:304] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed
W20260709 14:53:11.224915  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 60360.4us
I20260709 14:53:11.228703  7923 raft_consensus.cc:2468] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 19.
W20260709 14:53:11.235870  7744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:11.237950  7925 raft_consensus.cc:2468] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 15.
I20260709 14:53:11.242709 13497 raft_consensus.cc:2804] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Leader election won for term 15
I20260709 14:53:11.245131  7922 raft_consensus.cc:2468] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 17.
I20260709 14:53:11.245776 13567 consensus_queue.cc:1059] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.008s
I20260709 14:53:11.245859  7673 catalog_manager.cc:5697] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 14 to 15, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 15 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:53:11.253729  7673 catalog_manager.cc:5697] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
W20260709 14:53:11.257475  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:11.257957 13569 consensus_queue.cc:1059] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 14:53:11.261780  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:11.266000  7927 raft_consensus.cc:2468] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 21.
I20260709 14:53:11.268760 13567 raft_consensus.cc:493] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:53:11.275462  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 78292.9us
I20260709 14:53:11.277870 13568 raft_consensus.cc:3055] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 LEADER]: Stepping down as leader of term 17
I20260709 14:53:11.278506 13568 raft_consensus.cc:740] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:53:11.279713 13568 consensus_queue.cc:260] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:11.269505 13567 raft_consensus.cc:515] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:11.282663  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:11.283021  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258d6c2dda954bf5b65930fde8ecb9f3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:11.284176 13567 leader_election.cc:290] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:11.276881  7819 leader_election.cc:304] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:11.294287  7919 raft_consensus.cc:2468] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 20.
I20260709 14:53:11.296159  7675 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54350 (request call id 378) took 2709 ms. Trace:
I20260709 14:53:11.298470  7673 catalog_manager.cc:5697] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 14 to 18. New cstate: current_term: 18 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:53:11.306273  7923 raft_consensus.cc:2468] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 18.
I20260709 14:53:11.306301  7745 leader_election.cc:304] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:11.306183  7894 leader_election.cc:304] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:11.311723  7922 raft_consensus.cc:2468] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 18.
I20260709 14:53:11.313691  7927 raft_consensus.cc:3055] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 14:53:11.314332  7927 raft_consensus.cc:740] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:11.310742 13515 raft_consensus.cc:493] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:11.316684 13519 raft_consensus.cc:2804] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 14:53:11.317312 13519 raft_consensus.cc:493] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:11.316955 13515 raft_consensus.cc:515] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:11.317727 13519 raft_consensus.cc:3060] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 14:53:11.318120 13530 raft_consensus.cc:2749] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 14:53:11.321177  7673 catalog_manager.cc:5697] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:53:11.323051  7673 catalog_manager.cc:5697] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 14 to 18, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 18 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:53:11.319952 13515 leader_election.cc:290] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:53:11.331326  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:11.329583 13568 raft_consensus.cc:3060] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Advancing to term 18
W20260709 14:53:11.334617  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 85088.2us
I20260709 14:53:11.342904  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 19 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:11.344244  7850 raft_consensus.cc:2468] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 18.
I20260709 14:53:11.336572  7927 consensus_queue.cc:260] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:11.350387  7894 leader_election.cc:304] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:11.334367 13497 raft_consensus.cc:697] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:53:11.362195 13497 consensus_queue.cc:237] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:11.304960  7675 rpcz_store.cc:276] 0709 14:53:08.586435 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:53:08.586602 (+   167us) service_pool.cc:224] Handling call
0709 14:53:11.295908 (+2709306us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 14:53:10.081083 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 14:53:10.159297 (+ 78214us) write_op.cc:432] Acquiring schema lock in shared mode
0709 14:53:10.159349 (+    52us) write_op.cc:435] Acquired schema lock
0709 14:53:10.159382 (+    33us) tablet.cc:662] Decoding operations
0709 14:53:10.167534 (+  8152us) write_op.cc:620] Acquiring the partition lock for write op
0709 14:53:10.167651 (+   117us) write_op.cc:641] Partition lock acquired for write op
0709 14:53:10.167681 (+    30us) tablet.cc:685] Acquiring locks for 16 operations
0709 14:53:10.169033 (+  1352us) tablet.cc:701] Row locks acquired
0709 14:53:10.169057 (+    24us) write_op.cc:260] PREPARE: finished
0709 14:53:10.173417 (+  4360us) write_op.cc:270] Start()
0709 14:53:10.185105 (+ 11688us) write_op.cc:276] Timestamp: P: 1783608790169194 usec, L: 0
0709 14:53:10.187666 (+  2561us) op_driver.cc:348] REPLICATION: starting
0709 14:53:10.290428 (+102762us) log.cc:844] Serialized 6310 byte log entry
0709 14:53:10.433484 (+143056us) op_driver.cc:464] REPLICATION: finished
0709 14:53:10.434980 (+  1496us) write_op.cc:301] APPLY: starting
0709 14:53:10.435074 (+    94us) tablet.cc:1367] starting BulkCheckPresence
0709 14:53:10.833068 (+397994us) tablet.cc:1370] finished BulkCheckPresence
0709 14:53:10.833286 (+   218us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 14:53:11.039380 (+206094us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 14:53:11.039889 (+   509us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=32,key_file_lookups=32,delta_file_lookups=32,mrs_lookups=0
0709 14:53:11.039964 (+    75us) write_op.cc:312] APPLY: finished
0709 14:53:11.040758 (+   794us) log.cc:844] Serialized 148 byte log entry
0709 14:53:11.068181 (+ 27423us) write_op.cc:489] Releasing partition, row and schema locks
0709 14:53:11.091542 (+ 23361us) write_op.cc:454] Released schema lock
0709 14:53:11.091712 (+   170us) write_op.cc:341] FINISH: Updating metrics
0709 14:53:11.092669 (+   957us) write_op.cc:489] Releasing partition, row and schema locks
0709 14:53:11.092714 (+    45us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":40443,"reported_tablets":38,"child_traces":[["op",{"apply.queue_time_us":1218,"apply.run_cpu_time_us":39378,"apply.run_wall_time_us":657608,"cfile_cache_hit":66,"cfile_cache_hit_bytes":70815,"num_ops":16,"prepare.queue_time_us":215631,"prepare.run_cpu_time_us":8259,"prepare.run_wall_time_us":215931,"replication_time_us":245626,"thread_start_us":137091,"threads_started":2}]]}
I20260709 14:53:11.357208 13515 raft_consensus.cc:2804] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 14:53:11.370731  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:11.373411 13569 consensus_queue.cc:1059] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 14:53:11.374769 13477 raft_consensus.cc:3055] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 LEADER]: Stepping down as leader of term 15
I20260709 14:53:11.375506 13477 raft_consensus.cc:740] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:53:11.362043 13571 raft_consensus.cc:2804] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader election won for term 15
I20260709 14:53:11.374701 13569 raft_consensus.cc:3055] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 LEADER]: Stepping down as leader of term 16
I20260709 14:53:11.371232 13515 raft_consensus.cc:493] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:11.379118 13569 raft_consensus.cc:740] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:53:11.387635 13571 raft_consensus.cc:697] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:53:11.388226  7927 raft_consensus.cc:3060] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 14:53:11.389441  7745 leader_election.cc:304] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:11.382645 13515 raft_consensus.cc:3060] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Advancing to term 19
I20260709 14:53:11.400858  7745 leader_election.cc:304] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:11.408010 13572 raft_consensus.cc:2804] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader election won for term 14
I20260709 14:53:11.409400 13572 raft_consensus.cc:697] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:53:11.411469  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:11.412777  7775 raft_consensus.cc:2393] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 18: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:53:11.410773  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:11.413934  7776 raft_consensus.cc:2368] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 11. Current term is 12.
W20260709 14:53:11.415827  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:53:11.422696  7894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:11.388419 13569 consensus_queue.cc:260] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:53:11.428331  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 151651us
I20260709 14:53:11.430724  7927 raft_consensus.cc:1275] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 14:53:11.430104  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18d29d52d304c87b930d4fb5eaf50b1" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:11.412439 13572 consensus_queue.cc:237] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:11.433507 13567 raft_consensus.cc:2804] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader election won for term 18
I20260709 14:53:11.434347 13567 raft_consensus.cc:697] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:53:11.436889 13567 consensus_queue.cc:237] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:11.381518 13477 consensus_queue.cc:260] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:11.442530 13477 raft_consensus.cc:3060] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Advancing to term 16
I20260709 14:53:11.388939 13571 consensus_queue.cc:237] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:11.457835 13569 raft_consensus.cc:3060] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Advancing to term 17
I20260709 14:53:11.459070  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:11.460054 13519 raft_consensus.cc:515] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:11.460099  7776 raft_consensus.cc:2393] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 17: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:53:11.468513 13519 leader_election.cc:290] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 17 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:11.482939  7819 leader_election.cc:400] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 10 election: Vote denied by peer 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785) with higher term. Message: Invalid argument: T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 10. Current term is 11.
I20260709 14:53:11.483771  7819 leader_election.cc:403] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
W20260709 14:53:11.486294  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 85606.9us
I20260709 14:53:11.486689  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:11.488651  7776 raft_consensus.cc:2393] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 18: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:53:11.490339  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:11.490933  7850 raft_consensus.cc:3060] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Advancing to term 17
I20260709 14:53:11.480083 13519 raft_consensus.cc:493] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:11.501511  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:11.502995  7776 raft_consensus.cc:2410] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for term 19 because replica has last-logged OpId of term: 18 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
I20260709 14:53:11.517791 13519 raft_consensus.cc:515] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:11.480736 13515 raft_consensus.cc:515] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:11.530105  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
W20260709 14:53:11.531075 13579 log.cc:927] Time spent T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 14:53:11.525911 13497 raft_consensus.cc:2749] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785) with higher term. Message: Invalid argument: T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 10. Current term is 11.
I20260709 14:53:11.538302  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:11.541589  7775 raft_consensus.cc:2410] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for term 17 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 14:53:11.545176  7927 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
mode: GRACEFUL
new_leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:48676
I20260709 14:53:11.546265  7927 raft_consensus.cc:606] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Received request to transfer leadership to TS 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:53:11.546679  7927 raft_consensus.cc:614] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 14:53:11.553763  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:11.554721  7775 raft_consensus.cc:2410] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for term 16 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 14:53:11.528908 13477 consensus_queue.cc:1059] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.024s
I20260709 14:53:11.556859  7850 raft_consensus.cc:2468] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 17.
I20260709 14:53:11.559386  7894 leader_election.cc:304] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
W20260709 14:53:11.560477  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:11.561861 13524 raft_consensus.cc:2804] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 14:53:11.564705 13571 raft_consensus.cc:3055] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 LEADER]: Stepping down as leader of term 19
I20260709 14:53:11.564955  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:11.565418 13571 raft_consensus.cc:740] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:53:11.567103  7927 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
mode: GRACEFUL
new_leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:48676
I20260709 14:53:11.568131  7927 raft_consensus.cc:606] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Received request to transfer leadership to TS 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:53:11.565414 13524 raft_consensus.cc:697] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:11.568657  7927 raft_consensus.cc:614] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 14:53:11.569677 13524 consensus_queue.cc:237] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:11.570935 13571 consensus_queue.cc:260] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:11.573184  7745 leader_election.cc:304] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:11.573714 13571 raft_consensus.cc:3060] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Advancing to term 20
I20260709 14:53:11.575338  7927 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9c563cc7cfbe4d59be4ffc5cf847ce56"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
mode: GRACEFUL
new_leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:48676
I20260709 14:53:11.576159  7927 raft_consensus.cc:606] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 LEADER]: Received request to transfer leadership to TS 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:53:11.579929 13515 leader_election.cc:290] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:11.580859 13519 leader_election.cc:290] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:53:11.563724  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 130987us
I20260709 14:53:11.582336  7819 leader_election.cc:304] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 9418391fa82a42c79c6cad13ba91d964
I20260709 14:53:11.585842  7927 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
mode: GRACEFUL
new_leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:48676
I20260709 14:53:11.586730  7927 raft_consensus.cc:606] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 LEADER]: Received request to transfer leadership to TS 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:11.586889 13477 raft_consensus.cc:2804] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 14:53:11.587529 13477 raft_consensus.cc:493] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:11.588047 13477 raft_consensus.cc:3060] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Advancing to term 19
I20260709 14:53:11.587507 13569 consensus_queue.cc:1048] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.004s
I20260709 14:53:11.592746  7927 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
mode: GRACEFUL
new_leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:48676
I20260709 14:53:11.594376  7927 raft_consensus.cc:606] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Received request to transfer leadership to TS 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:11.594725  7927 raft_consensus.cc:614] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 14:53:11.598754  7779 raft_consensus.cc:2468] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 16.
W20260709 14:53:11.601560  7894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:11.603760  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 19 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
W20260709 14:53:11.602670  7894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:11.603771  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:11.604687  7848 raft_consensus.cc:3060] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Advancing to term 19
I20260709 14:53:11.602317 13573 raft_consensus.cc:2749] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 14:53:11.621309 13515 raft_consensus.cc:493] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:53:11.623890  7743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:11.621435 13570 consensus_queue.cc:1059] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.009s
I20260709 14:53:11.625574  7819 leader_election.cc:304] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:53:11.627813 13570 raft_consensus.cc:3055] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 LEADER]: Stepping down as leader of term 18
I20260709 14:53:11.628305 13570 raft_consensus.cc:740] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:53:11.629496 13573 raft_consensus.cc:2804] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Leader election won for term 18
I20260709 14:53:11.636869 13515 raft_consensus.cc:515] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:11.639624 13515 leader_election.cc:290] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:11.640524 13570 consensus_queue.cc:260] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:11.642521 13570 raft_consensus.cc:3060] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Advancing to term 19
W20260709 14:53:11.645092  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:11.636760  7745 leader_election.cc:304] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:11.653995  7819 leader_election.cc:400] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 11 election: Vote denied by peer 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785) with higher term. Message: Invalid argument: T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 11. Current term is 12.
I20260709 14:53:11.654496  7819 leader_election.cc:403] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 14:53:11.656870  6549 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 14:53:11.657905 13569 raft_consensus.cc:2804] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader election won for term 18
I20260709 14:53:11.658847 13569 raft_consensus.cc:697] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:53:11.659806  6549 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 14:53:11.661800 13477 raft_consensus.cc:515] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:11.665019  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:11.666180  7773 raft_consensus.cc:3060] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Advancing to term 19
I20260709 14:53:11.667603  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:11.668462  7772 raft_consensus.cc:3060] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Advancing to term 15
I20260709 14:53:11.660473 13569 consensus_queue.cc:237] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:11.670047  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:11.679723  7848 raft_consensus.cc:2468] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 19.
W20260709 14:53:11.682233  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 48358.1us
I20260709 14:53:11.703938  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:11.706732  7772 raft_consensus.cc:2468] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 15.
I20260709 14:53:11.694296  7894 leader_election.cc:304] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
W20260709 14:53:11.711992  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:11.713877  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:11.715026  7846 raft_consensus.cc:2468] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 15.
I20260709 14:53:11.688297 13530 raft_consensus.cc:2749] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785) with higher term. Message: Invalid argument: T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 11. Current term is 12.
I20260709 14:53:11.728988  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:11.730327  7819 leader_election.cc:400] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 election: Vote denied by peer 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785) with higher term. Message: Invalid argument: T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 13. Current term is 14.
I20260709 14:53:11.730751  7819 leader_election.cc:403] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 14:53:11.707916 13568 consensus_queue.cc:1048] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 14:53:11.733716  7776 raft_consensus.cc:2468] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 20.
I20260709 14:53:11.734258  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:11.735055  7778 raft_consensus.cc:3060] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Advancing to term 13
I20260709 14:53:11.741210  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:11.742235  7776 raft_consensus.cc:3060] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Advancing to term 21
I20260709 14:53:11.742722  7779 raft_consensus.cc:2393] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 15: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:53:11.702649 13573 raft_consensus.cc:697] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:53:11.749331  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:11.754951  7773 raft_consensus.cc:2468] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 19.
I20260709 14:53:11.729569 13514 raft_consensus.cc:2804] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 14:53:11.733887 13477 leader_election.cc:290] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:11.760422  7772 raft_consensus.cc:3060] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Advancing to term 20
I20260709 14:53:11.763474  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258d6c2dda954bf5b65930fde8ecb9f3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:11.762266  7894 leader_election.cc:304] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:11.746240 13530 raft_consensus.cc:493] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:11.774209  7772 raft_consensus.cc:2468] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 20.
I20260709 14:53:11.775302 13524 raft_consensus.cc:2804] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 14:53:11.776198 13524 raft_consensus.cc:493] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:11.776644 13524 raft_consensus.cc:3060] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Advancing to term 16
W20260709 14:53:11.777371  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:11.778496  7779 raft_consensus.cc:1275] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 14:53:11.780184  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:11.781106  7771 raft_consensus.cc:3060] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Advancing to term 18
I20260709 14:53:11.782208  7745 leader_election.cc:304] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:11.770535  7773 raft_consensus.cc:2468] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 14.
W20260709 14:53:11.790162  7893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:11.792932 13573 consensus_queue.cc:237] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:11.795017  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:11.793004  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:11.796267  7774 raft_consensus.cc:3060] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Advancing to term 18
I20260709 14:53:11.796438  7779 raft_consensus.cc:2468] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 20.
I20260709 14:53:11.801282  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:11.802819  7777 raft_consensus.cc:2468] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 13.
I20260709 14:53:11.802106  7779 raft_consensus.cc:1240] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 14. Current term is 15. Ops: []
I20260709 14:53:11.805066  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:11.805802  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:11.806051  7779 raft_consensus.cc:2468] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 12.
I20260709 14:53:11.806937  7772 raft_consensus.cc:2410] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for term 20 because replica has last-logged OpId of term: 19 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
I20260709 14:53:11.809731  7776 raft_consensus.cc:2468] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 21.
I20260709 14:53:11.770179 13514 raft_consensus.cc:697] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:11.818070 13514 consensus_queue.cc:237] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:11.818737  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:11.819583  7772 raft_consensus.cc:2410] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for term 16 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
W20260709 14:53:11.821571  7893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:11.823659  7775 raft_consensus.cc:1240] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 14:53:11.807502  7778 raft_consensus.cc:2468] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 13.
I20260709 14:53:11.825766  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:11.828799 13524 raft_consensus.cc:515] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:53:11.830971  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:11.770716 13530 raft_consensus.cc:515] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:11.793929 13589 raft_consensus.cc:2749] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785) with higher term. Message: Invalid argument: T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 13. Current term is 14.
I20260709 14:53:11.831928  7777 raft_consensus.cc:1240] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 20. Current term is 21. Ops: []
I20260709 14:53:11.837182  7771 raft_consensus.cc:2468] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 18.
W20260709 14:53:11.838708  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:11.821571  7772 raft_consensus.cc:1240] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 17. Current term is 18. Ops: []
I20260709 14:53:11.838424  7779 raft_consensus.cc:1240] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260709 14:53:11.842617  7846 raft_consensus.cc:1240] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 15. Current term is 16. Ops: []
I20260709 14:53:11.838605  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:11.845909 13516 consensus_queue.cc:1059] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 14:53:11.806236 13477 raft_consensus.cc:2804] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader election won for term 12
I20260709 14:53:11.846750  7773 raft_consensus.cc:2410] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for term 14 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
W20260709 14:53:11.833076  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 60332.7us
I20260709 14:53:11.854350  7846 raft_consensus.cc:1240] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 14. Current term is 15. Ops: []
I20260709 14:53:11.855378 13530 leader_election.cc:290] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:11.850688  7819 leader_election.cc:304] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:11.845208 13519 raft_consensus.cc:493] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:11.856568 13530 raft_consensus.cc:2804] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 14:53:11.856443 13519 raft_consensus.cc:515] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:11.857089 13530 raft_consensus.cc:493] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:11.857547 13530 raft_consensus.cc:3060] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Advancing to term 21
I20260709 14:53:11.860895  7779 raft_consensus.cc:1240] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 15. Current term is 16. Ops: []
I20260709 14:53:11.869488 13477 raft_consensus.cc:697] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:53:11.869736  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:11.871767  7927 raft_consensus.cc:2376] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 22 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 22. Re-sending same reply.
I20260709 14:53:11.874389  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:11.875337  7927 raft_consensus.cc:2468] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 18.
I20260709 14:53:11.880364 13516 consensus_queue.cc:1059] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 14:53:11.881444  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:11.882033 13516 raft_consensus.cc:3055] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 14:53:11.882563 13516 raft_consensus.cc:740] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:11.882813  7852 raft_consensus.cc:1275] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 14:53:11.882557  7927 raft_consensus.cc:2393] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 19: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:53:11.883610 13516 consensus_queue.cc:260] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:11.884455  7848 raft_consensus.cc:1275] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
W20260709 14:53:11.886125  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:11.886518  7850 raft_consensus.cc:1275] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 14:53:11.881695  7846 raft_consensus.cc:1275] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 14:53:11.863423 13519 leader_election.cc:290] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:11.889468  7819 leader_election.cc:304] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:11.889634  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:11.882385  7774 raft_consensus.cc:2468] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 18.
I20260709 14:53:11.891557  7779 raft_consensus.cc:1240] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 17. Current term is 18. Ops: []
I20260709 14:53:11.892426  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:11.892882  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:11.895895 13583 raft_consensus.cc:2804] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Leader election won for term 19
I20260709 14:53:11.893018  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:11.870925 13477 consensus_queue.cc:237] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:11.898190  7923 raft_consensus.cc:2468] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 17.
I20260709 14:53:11.898376  7775 raft_consensus.cc:1240] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 16. Current term is 17. Ops: []
I20260709 14:53:11.900643 13515 consensus_queue.cc:1048] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 14:53:11.895936  7922 raft_consensus.cc:2393] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 20: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:53:11.891815  7819 leader_election.cc:304] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:11.912416  7774 raft_consensus.cc:1240] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 18. Current term is 19. Ops: [18.11-18.11]
W20260709 14:53:11.914709  7745 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:53:11.915175  7745 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:11.885149 13516 raft_consensus.cc:3060] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 14:53:11.897316 13583 raft_consensus.cc:697] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:53:11.918157  7819 leader_election.cc:304] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:11.920003  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:11.920877  7851 raft_consensus.cc:3060] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Advancing to term 16
I20260709 14:53:11.923643  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:11.912056 13524 leader_election.cc:290] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:11.914145 13497 raft_consensus.cc:2804] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Leader election won for term 15
I20260709 14:53:11.928503  7775 raft_consensus.cc:1240] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 17. Current term is 18. Ops: []
I20260709 14:53:11.931816 13573 raft_consensus.cc:2804] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Leader election won for term 17
I20260709 14:53:11.932606 13573 raft_consensus.cc:697] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:53:11.933673 13573 consensus_queue.cc:237] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:11.913681 13513 consensus_queue.cc:1048] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 14:53:11.935909 13497 raft_consensus.cc:697] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:53:11.908165 13500 consensus_queue.cc:1048] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.015s
I20260709 14:53:11.909919 13519 consensus_queue.cc:1048] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.015s
I20260709 14:53:11.946403  7775 raft_consensus.cc:1240] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 12. Current term is 13. Ops: []
I20260709 14:53:11.939625  7819 leader_election.cc:304] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:11.947899  7774 raft_consensus.cc:2393] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 18: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:53:11.959249 13590 raft_consensus.cc:2804] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Leader election won for term 21
I20260709 14:53:11.960248 13590 raft_consensus.cc:697] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:53:11.943514 13514 raft_consensus.cc:493] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:11.952996 13491 raft_consensus.cc:3055] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 14:53:11.970497  7775 raft_consensus.cc:1240] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 LEADER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 14. Current term is 15. Ops: []
I20260709 14:53:11.937510 13497 consensus_queue.cc:237] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:11.978288  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c563cc7cfbe4d59be4ffc5cf847ce56" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:11.979236  7774 raft_consensus.cc:3060] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Advancing to term 11
I20260709 14:53:11.967456  7819 leader_election.cc:304] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
W20260709 14:53:11.986537  7894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:11.974519 13491 raft_consensus.cc:740] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:11.993602  7775 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f"
dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:37144
I20260709 14:53:11.994591  7775 raft_consensus.cc:493] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:53:11.995024  7775 raft_consensus.cc:3060] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Advancing to term 15
I20260709 14:53:11.988312  7779 raft_consensus.cc:1240] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 19. Current term is 20. Ops: []
I20260709 14:53:11.961915 13590 consensus_queue.cc:237] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:11.946271 13583 consensus_queue.cc:237] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:11.971124 13514 raft_consensus.cc:515] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:11.998834  7851 raft_consensus.cc:2468] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 16.
I20260709 14:53:12.005456 13514 leader_election.cc:290] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:12.006296 13500 raft_consensus.cc:493] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
W20260709 14:53:12.008227  7894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:53:12.010232  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 55953.3us
I20260709 14:53:12.011431  7819 leader_election.cc:304] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:12.009135  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:12.013140  7779 raft_consensus.cc:2393] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 16: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:53:12.015393 13570 raft_consensus.cc:2804] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Leader election won for term 20
I20260709 14:53:12.017443  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:12.025215  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:12.027809  7894 leader_election.cc:304] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:12.029768  7819 leader_election.cc:304] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:12.033587 13589 raft_consensus.cc:2804] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Leader election won for term 18
I20260709 14:53:12.033857 13491 consensus_queue.cc:260] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:12.036031 13491 raft_consensus.cc:3060] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 14:53:12.046263  7774 raft_consensus.cc:2468] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 11.
I20260709 14:53:12.052273 13514 raft_consensus.cc:2804] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 14:53:12.053543 13514 raft_consensus.cc:697] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:12.054917 13514 consensus_queue.cc:237] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:12.074942  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
W20260709 14:53:12.076524  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 46859.5us
I20260709 14:53:12.080160  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:12.080339  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:12.081872  7851 raft_consensus.cc:2376] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 22 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 22. Re-sending same reply.
I20260709 14:53:12.083199  7779 raft_consensus.cc:2393] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 13: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:53:12.085664  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
W20260709 14:53:12.087692  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:12.087710  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:12.089049  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:12.091419  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:12.030768 13500 raft_consensus.cc:515] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:12.102272  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:12.092438  7845 raft_consensus.cc:2393] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 18: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:53:12.058830 13589 raft_consensus.cc:697] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:53:12.106846  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:12.109716  7851 raft_consensus.cc:2368] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 15. Current term is 16.
I20260709 14:53:12.109807  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:12.108922  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:12.113340  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:12.073608 13477 raft_consensus.cc:493] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9418391fa82a42c79c6cad13ba91d964)
W20260709 14:53:12.114320  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:12.081096 13570 raft_consensus.cc:697] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:53:12.114125  7851 raft_consensus.cc:2376] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 16. Re-sending same reply.
I20260709 14:53:12.127853  7779 raft_consensus.cc:1240] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 12. Current term is 13. Ops: []
I20260709 14:53:12.103101 13519 raft_consensus.cc:493] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:12.131382  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:12.132395  7845 raft_consensus.cc:3060] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Advancing to term 19
I20260709 14:53:12.134776  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:12.135501  7773 raft_consensus.cc:3060] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Advancing to term 13
W20260709 14:53:12.138412 13591 log.cc:927] Time spent T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.153s	user 0.001s	sys 0.000s
I20260709 14:53:12.141646  7849 raft_consensus.cc:1240] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 14:53:12.137497  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:12.142529  7779 raft_consensus.cc:1240] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 LEADER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 17. Current term is 18. Ops: []
I20260709 14:53:12.145810  7851 raft_consensus.cc:1240] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 14:53:12.147503  7854 raft_consensus.cc:2468] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 13.
I20260709 14:53:12.152089  7779 raft_consensus.cc:1240] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 18. Current term is 19. Ops: []
W20260709 14:53:12.155509  7743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:12.155843  7745 leader_election.cc:304] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
W20260709 14:53:12.156394  7894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:53:12.157086  7894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:12.158912  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:12.165666  7922 raft_consensus.cc:1275] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 14:53:12.171741  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:12.139098 13601 raft_consensus.cc:2804] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Leader election won for term 18
I20260709 14:53:12.175664  7775 raft_consensus.cc:515] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:12.172714  7927 raft_consensus.cc:2468] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 18.
I20260709 14:53:12.131942 13477 raft_consensus.cc:515] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
W20260709 14:53:12.199501  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:53:12.204871  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:12.137758 13606 consensus_queue.cc:1048] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 14:53:12.145280 13519 raft_consensus.cc:515] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:12.237850  7845 raft_consensus.cc:2468] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 19.
I20260709 14:53:12.178372 13568 raft_consensus.cc:2804] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 22 FOLLOWER]: Leader election won for term 22
I20260709 14:53:12.238627  7773 raft_consensus.cc:2468] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 13.
I20260709 14:53:12.241987  7775 leader_election.cc:290] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:12.243345  7776 raft_consensus.cc:1240] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 16. Current term is 17. Ops: []
I20260709 14:53:12.255659  7779 raft_consensus.cc:2468] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 20.
I20260709 14:53:12.258353  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
W20260709 14:53:12.277458  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:12.278538  7745 leader_election.cc:400] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 election: Vote denied by peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529) with higher term. Message: Invalid argument: T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 15. Current term is 16.
I20260709 14:53:12.279031  7745 leader_election.cc:403] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 14:53:12.280946  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
W20260709 14:53:12.282393  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:12.283044  7779 raft_consensus.cc:2410] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for term 17 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 14:53:12.238196 13601 raft_consensus.cc:697] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
W20260709 14:53:12.291774  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 101845us
I20260709 14:53:12.299057  7774 raft_consensus.cc:1240] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 17. Current term is 18. Ops: [15.9-17.10]
I20260709 14:53:12.300467  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:12.301517  7775 raft_consensus.cc:2410] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for term 19 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
W20260709 14:53:12.304232 13596 log.cc:927] Time spent T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.267s	user 0.000s	sys 0.002s
I20260709 14:53:12.315515  7745 leader_election.cc:304] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:12.240658 13589 consensus_queue.cc:237] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:12.339232  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:12.313664 13569 raft_consensus.cc:3060] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Advancing to term 16
I20260709 14:53:12.314070 13524 raft_consensus.cc:493] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:12.273929 13570 consensus_queue.cc:237] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:12.345716  7819 leader_election.cc:304] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:12.350548  7775 raft_consensus.cc:1275] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 14:53:12.351440  7845 raft_consensus.cc:1275] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 14:53:12.343726 13500 leader_election.cc:290] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:53:12.354278  7893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:12.355088  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:12.357455  7849 raft_consensus.cc:3060] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Advancing to term 15
W20260709 14:53:12.359172 13598 log.cc:927] Time spent T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
W20260709 14:53:12.362681 13610 log.cc:927] Time spent T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 14:53:12.365814 13606 consensus_queue.cc:1048] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 14:53:12.367419 13606 raft_consensus.cc:2804] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 14:53:12.367828 13606 raft_consensus.cc:493] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:12.368182 13606 raft_consensus.cc:3060] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Advancing to term 18
I20260709 14:53:12.373661 13477 leader_election.cc:290] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68:42321)
I20260709 14:53:12.374670 13477 raft_consensus.cc:493] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9418391fa82a42c79c6cad13ba91d964)
I20260709 14:53:12.356174  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
W20260709 14:53:12.400761  7893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:12.410596  7849 raft_consensus.cc:2468] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 15.
I20260709 14:53:12.346702 13571 raft_consensus.cc:2804] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader election won for term 16
I20260709 14:53:12.431751  7775 raft_consensus.cc:1275] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 14:53:12.434222 13601 consensus_queue.cc:237] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:53:12.435341  8599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 198188us
I20260709 14:53:12.353905 13573 raft_consensus.cc:493] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:53:12.457880  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 19 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:12.461683  8637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9441e831627143a991a1556dcdce71e3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9418391fa82a42c79c6cad13ba91d964" is_pre_election: true
I20260709 14:53:12.352581 13524 raft_consensus.cc:515] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:12.467386  7774 raft_consensus.cc:1275] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 14:53:12.467213  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:12.483366  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:12.484036  7779 raft_consensus.cc:2393] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 16: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:53:12.468088  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:12.468464  7776 raft_consensus.cc:1275] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 14:53:12.469144  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:12.469931  7777 raft_consensus.cc:1240] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 16. Current term is 17. Ops: []
I20260709 14:53:12.468746  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 19 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:12.470319  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
W20260709 14:53:12.470746 13487 log.cc:927] Time spent T 00000000000000000000000000000000 P 133636659113430cb53b321cb0b1d9ee: Append to log took a long time: real 0.079s	user 0.000s	sys 0.003s
W20260709 14:53:12.476648 13612 log.cc:927] Time spent T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.104s	user 0.000s	sys 0.004s
W20260709 14:53:12.478699 13611 log.cc:927] Time spent T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
W20260709 14:53:12.488090  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:53:12.491930  7894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:12.503360  7777 raft_consensus.cc:3055] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 LEADER]: Stepping down as leader of term 18
I20260709 14:53:12.503760  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:12.472597 13571 raft_consensus.cc:697] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:53:12.473626 13568 raft_consensus.cc:697] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 22 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:53:12.504012  7777 raft_consensus.cc:740] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:53:12.515094  7776 raft_consensus.cc:3055] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 LEADER]: Stepping down as leader of term 16
I20260709 14:53:12.515126  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:12.498106 13569 raft_consensus.cc:2749] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529) with higher term. Message: Invalid argument: T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 15. Current term is 16.
I20260709 14:53:12.533263  7771 raft_consensus.cc:2468] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 16.
I20260709 14:53:12.533427 13515 raft_consensus.cc:493] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:12.534108 13515 raft_consensus.cc:515] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:12.527936  7776 raft_consensus.cc:740] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:53:12.405953 13477 raft_consensus.cc:515] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:53:12.532250  7774 raft_consensus.cc:2468] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 18.
W20260709 14:53:12.505223 13600 log.cc:927] Time spent T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.206s	user 0.000s	sys 0.004s
I20260709 14:53:12.500834 13583 raft_consensus.cc:493] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:53:12.544397  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:53:12.520373 13516 consensus_meta.cc:287] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent flushing consensus metadata: real 0.602s	user 0.012s	sys 0.000s
I20260709 14:53:12.547706  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:12.506610 13519 leader_election.cc:290] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:12.513691 13614 raft_consensus.cc:493] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:53:12.561535  7745 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:12.560354  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
W20260709 14:53:12.562649  7745 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:12.560814  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:12.485924 13573 raft_consensus.cc:515] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:12.562999  7927 raft_consensus.cc:2368] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 17. Current term is 18.
I20260709 14:53:12.540477  7777 consensus_queue.cc:260] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:12.563494  7923 raft_consensus.cc:2468] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 13.
I20260709 14:53:12.540858 13515 leader_election.cc:290] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:12.533555 13524 leader_election.cc:290] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:12.564806  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce9c0ef2db24c13a8b1402f21819458" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:12.579226  7745 leader_election.cc:304] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:12.579072  7777 raft_consensus.cc:3060] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Advancing to term 19
I20260709 14:53:12.561566  7776 consensus_queue.cc:260] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:12.586011  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:12.587710  7919 raft_consensus.cc:2393] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 15: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
W20260709 14:53:12.586769 13622 consensus_queue.cc:1175] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" responder_term: 19 status { last_received { term: 14 index: 10 } last_committed_idx: 10 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 18. Current term is 19. Ops: [18.11-18.11]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 14:53:12.588677 13618 raft_consensus.cc:493] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:53:12.594769 13568 consensus_queue.cc:237] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:12.558645 13583 raft_consensus.cc:515] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:12.598316 13583 leader_election.cc:290] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:12.601824 13571 consensus_queue.cc:237] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:12.603052 13477 leader_election.cc:290] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68:42321)
I20260709 14:53:12.605042  7745 leader_election.cc:304] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
W20260709 14:53:12.607832  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:12.600803 13627 raft_consensus.cc:2804] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 14:53:12.612998  7745 leader_election.cc:304] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:12.613888  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
W20260709 14:53:12.618597  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 82530.3us
I20260709 14:53:12.619122  8637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18d29d52d304c87b930d4fb5eaf50b1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9418391fa82a42c79c6cad13ba91d964" is_pre_election: true
I20260709 14:53:12.620869  7848 raft_consensus.cc:1240] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 14. Current term is 15. Ops: []
I20260709 14:53:12.622444  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:12.602890 13573 leader_election.cc:290] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:53:12.632814  7743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:53:12.611917 13491 consensus_meta.cc:287] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0: Time spent flushing consensus metadata: real 0.554s	user 0.009s	sys 0.006s
I20260709 14:53:12.612130 13569 consensus_queue.cc:1059] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 14:53:12.641623  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
W20260709 14:53:12.641906  7894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:53:12.642351  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:12.648613  7923 raft_consensus.cc:2393] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 18: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:53:12.644977  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:12.647781  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:12.640751  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
W20260709 14:53:12.650090  7894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:12.614113 13477 raft_consensus.cc:2804] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Leader election won for term 19
I20260709 14:53:12.625980 13627 raft_consensus.cc:493] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:12.654666  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:12.656956  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:12.655093  7846 raft_consensus.cc:2393] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 16: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:53:12.669646  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:12.610239 13618 raft_consensus.cc:515] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:12.674862  7921 raft_consensus.cc:2376] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 18. Re-sending same reply.
I20260709 14:53:12.679646  7777 raft_consensus.cc:1275] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 11. (term mismatch)
I20260709 14:53:12.680322  7777 pending_rounds.cc:85] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed: Aborting all ops after (but not including) 10
I20260709 14:53:12.680668  7777 pending_rounds.cc:107] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed: Aborting uncommitted NO_OP operation due to leader change: 18.11
I20260709 14:53:12.682317  7777 raft_consensus.cc:2889] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:53:12.681481  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:12.568205 13614 raft_consensus.cc:515] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:12.688557  7848 raft_consensus.cc:2410] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for term 19 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 14:53:12.696661 13632 raft_consensus.cc:2804] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader election won for term 15
I20260709 14:53:12.697851 13632 raft_consensus.cc:697] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
W20260709 14:53:12.698453 13631 log.cc:927] Time spent T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.152s	user 0.001s	sys 0.000s
I20260709 14:53:12.699553 13632 consensus_queue.cc:237] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:53:12.700680  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:12.704249  7924 raft_consensus.cc:2468] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 18.
I20260709 14:53:12.672533 13628 consensus_queue.cc:1048] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.026s
W20260709 14:53:12.711051  7894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:12.668682  6549 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 14:53:12.678463 13627 raft_consensus.cc:3060] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Advancing to term 14
I20260709 14:53:12.716791  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258d6c2dda954bf5b65930fde8ecb9f3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:53:12.721793  7742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:53:12.727809  7894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:12.723424  7848 raft_consensus.cc:2468] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 14.
W20260709 14:53:12.736078  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 71539.8us
I20260709 14:53:12.743989  7920 raft_consensus.cc:1275] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 14:53:12.746361  7923 raft_consensus.cc:1275] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
W20260709 14:53:12.741655 13530 consensus_meta.cc:287] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent flushing consensus metadata: real 0.883s	user 0.016s	sys 0.002s
I20260709 14:53:12.759140  7928 raft_consensus.cc:1275] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
W20260709 14:53:12.765472  7743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:12.766666 13606 raft_consensus.cc:515] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:12.773265 13530 raft_consensus.cc:515] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:12.784111  7676 catalog_manager.cc:5697] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 19 to 20, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 20 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:53:12.777540  7926 raft_consensus.cc:1275] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
W20260709 14:53:12.788786  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 51002.5us
I20260709 14:53:12.789361  7848 raft_consensus.cc:1275] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
W20260709 14:53:12.789937  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:53:12.802851  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:53:12.810173  7744 connection.cc:256] RPC call timeout handler was delayed by -1.0721958860000314s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2564s for a response
I20260709 14:53:12.821003  7676 catalog_manager.cc:5697] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 14 to 16, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 16 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:53:12.823405  7676 catalog_manager.cc:5697] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:53:12.828835  7676 catalog_manager.cc:5697] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:53:12.842154 13614 leader_election.cc:290] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:12.842589  7894 leader_election.cc:304] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:12.843894 13607 raft_consensus.cc:2804] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 14:53:12.844389 13607 raft_consensus.cc:493] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:12.845009 13607 raft_consensus.cc:3060] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 14:53:12.849674  7676 catalog_manager.cc:5697] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
W20260709 14:53:12.860342  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 247380us
W20260709 14:53:12.861557  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 232028us
I20260709 14:53:12.853821  7676 catalog_manager.cc:5697] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:53:12.880319  7845 raft_consensus.cc:1275] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 14:53:12.888717  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:12.844376 13618 leader_election.cc:290] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:53:12.891757  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:12.892649  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783e4874513449ef9084b833f188a6d3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:12.859320 13477 raft_consensus.cc:697] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:53:12.900092 13613 consensus_queue.cc:1048] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 14:53:12.903281 13630 consensus_queue.cc:1048] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 14:53:12.905804  7673 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54344 (request call id 378) took 3436 ms. Trace:
W20260709 14:53:12.906864  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 164517us
W20260709 14:53:12.908481  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 93454.3us
I20260709 14:53:12.912149 13477 consensus_queue.cc:237] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:12.915076  7893 leader_election.cc:304] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:12.923362  7819 leader_election.cc:304] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
W20260709 14:53:12.926976  7744 connection.cc:256] RPC call timeout handler was delayed by -1.0200022669999953s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.27999999999999997s for a response
I20260709 14:53:12.917110 13530 leader_election.cc:290] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 21 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:12.906337  7673 rpcz_store.cc:276] 0709 14:53:09.469762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:53:09.470030 (+   268us) service_pool.cc:224] Handling call
0709 14:53:12.905717 (+3435687us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 14:53:11.514161 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 14:53:11.515006 (+   845us) write_op.cc:432] Acquiring schema lock in shared mode
0709 14:53:11.515060 (+    54us) write_op.cc:435] Acquired schema lock
0709 14:53:11.515078 (+    18us) tablet.cc:662] Decoding operations
0709 14:53:11.522304 (+  7226us) write_op.cc:620] Acquiring the partition lock for write op
0709 14:53:11.522412 (+   108us) write_op.cc:641] Partition lock acquired for write op
0709 14:53:11.522439 (+    27us) tablet.cc:685] Acquiring locks for 6 operations
0709 14:53:11.523251 (+   812us) tablet.cc:701] Row locks acquired
0709 14:53:11.523323 (+    72us) write_op.cc:260] PREPARE: finished
0709 14:53:11.530636 (+  7313us) write_op.cc:270] Start()
0709 14:53:11.543263 (+ 12627us) write_op.cc:276] Timestamp: P: 1783608791525797 usec, L: 0
0709 14:53:11.543297 (+    34us) op_driver.cc:348] REPLICATION: starting
0709 14:53:11.544244 (+   947us) log.cc:844] Serialized 2464 byte log entry
0709 14:53:11.584099 (+ 39855us) spinlock_profiling.cc:243] Waited 10.4 ms on lock 0x7b5400349f20. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf8090 00007fb68ae056b8 00007fb68ae052fa 00007fb68ae89965 00007fb68ae89e09 00007fb68e8c4581 00007fb68e8c3d58 00007fb68e8c89f1 00007fb68e8c89a9 00007fb68e8c8939 00007fb68e8c8901
0709 14:53:11.729166 (+145067us) op_driver.cc:464] REPLICATION: finished
0709 14:53:11.845934 (+116768us) write_op.cc:301] APPLY: starting
0709 14:53:11.846112 (+   178us) tablet.cc:1367] starting BulkCheckPresence
0709 14:53:11.974478 (+128366us) tablet.cc:1370] finished BulkCheckPresence
0709 14:53:11.975515 (+  1037us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 14:53:12.370467 (+394952us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 14:53:12.370713 (+   246us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=12,key_file_lookups=12,delta_file_lookups=12,mrs_lookups=0
0709 14:53:12.370757 (+    44us) write_op.cc:312] APPLY: finished
0709 14:53:12.371016 (+   259us) log.cc:844] Serialized 65 byte log entry
0709 14:53:12.371321 (+   305us) write_op.cc:489] Releasing partition, row and schema locks
0709 14:53:12.371441 (+   120us) write_op.cc:454] Released schema lock
0709 14:53:12.371488 (+    47us) write_op.cc:341] FINISH: Updating metrics
0709 14:53:12.371969 (+   481us) write_op.cc:489] Releasing partition, row and schema locks
0709 14:53:12.371997 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":33593,"reported_tablets":31,"child_traces":[["op",{"apply.queue_time_us":102200,"apply.run_cpu_time_us":17557,"apply.run_wall_time_us":526028,"cfile_cache_hit":26,"cfile_cache_hit_bytes":29135,"num_ops":6,"prepare.queue_time_us":86398,"prepare.run_cpu_time_us":8348,"prepare.run_wall_time_us":70320,"replication_time_us":145070,"spinlock_wait_cycles":24032128,"thread_start_us":115677,"threads_started":2}]]}
I20260709 14:53:12.950560 13609 consensus_queue.cc:1059] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.121s
I20260709 14:53:12.951514  7819 leader_election.cc:400] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 11 election: Vote denied by peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587) with higher term. Message: Invalid argument: T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 11. Current term is 12.
I20260709 14:53:12.927561 13570 consensus_queue.cc:1048] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.027s
I20260709 14:53:12.936163 13500 raft_consensus.cc:2749] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 14:53:12.922643 13630 consensus_queue.cc:1048] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.022s
I20260709 14:53:12.958736  7926 raft_consensus.cc:1275] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 14:53:12.924924 13606 leader_election.cc:290] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 18 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:12.925748 13524 raft_consensus.cc:493] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:12.960726  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:12.965451 13633 consensus_queue.cc:1048] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.050s
I20260709 14:53:12.960992 13628 raft_consensus.cc:493] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:12.994252  7925 raft_consensus.cc:2393] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 17: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:53:12.993991 13524 raft_consensus.cc:515] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:12.994902 13628 raft_consensus.cc:515] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:12.996675 13524 leader_election.cc:290] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:12.962203  7927 raft_consensus.cc:1275] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 14:53:12.964303  7776 raft_consensus.cc:3060] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Advancing to term 17
I20260709 14:53:12.949841 13629 consensus_queue.cc:1048] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.042s
W20260709 14:53:12.965286  7744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:12.949759 13617 raft_consensus.cc:2749] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 14:53:12.972975  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:12.977056  7819 leader_election.cc:304] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 9418391fa82a42c79c6cad13ba91d964
W20260709 14:53:12.978873  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 63909.5us
W20260709 14:53:12.986152 13646 log.cc:927] Time spent T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 14:53:12.987659 13569 raft_consensus.cc:493] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:12.988250 13632 raft_consensus.cc:493] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:13.021083 13630 raft_consensus.cc:2749] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 14:53:13.020833 13632 raft_consensus.cc:515] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:13.023726 13632 leader_election.cc:290] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:12.961629  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:13.025650 13603 raft_consensus.cc:493] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:13.025767  7919 raft_consensus.cc:2468] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 15.
I20260709 14:53:12.994295 13609 raft_consensus.cc:3055] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 14:53:13.026587 13609 raft_consensus.cc:740] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:13.026310 13603 raft_consensus.cc:515] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:13.027832 13609 consensus_queue.cc:260] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:13.001987  7846 raft_consensus.cc:1275] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 14:53:13.024915 13569 raft_consensus.cc:515] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:13.031612 13524 raft_consensus.cc:493] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:13.032449 13569 leader_election.cc:290] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:13.032266 13524 raft_consensus.cc:515] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:53:13.013500  7744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:13.033735 13614 raft_consensus.cc:493] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:13.034272 13614 raft_consensus.cc:515] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:13.034924 13607 raft_consensus.cc:515] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:13.036718 13614 leader_election.cc:290] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:13.019994  7819 leader_election.cc:304] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
W20260709 14:53:13.033485  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:13.039896  7819 leader_election.cc:304] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:13.040105 13606 raft_consensus.cc:3060] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Advancing to term 17
I20260709 14:53:13.036916  7744 leader_election.cc:304] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:13.014554 13627 raft_consensus.cc:515] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:13.042557 13609 raft_consensus.cc:3060] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 14:53:13.046171  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:13.056972  7776 raft_consensus.cc:1275] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 9. (term mismatch)
I20260709 14:53:13.057919  7776 pending_rounds.cc:85] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed: Aborting all ops after (but not including) 8
I20260709 14:53:13.058290  7776 pending_rounds.cc:107] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed: Aborting uncommitted NO_OP operation due to leader change: 16.9
I20260709 14:53:13.058861  7776 raft_consensus.cc:2889] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 14:53:13.062067  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:53:13.064435  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:13.029055 13603 leader_election.cc:290] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:13.078189  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:13.079095  7848 raft_consensus.cc:2393] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 19: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:53:13.055294 13607 leader_election.cc:290] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 15 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:13.054528 13614 raft_consensus.cc:493] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:13.054910 13569 raft_consensus.cc:2749] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 14:53:13.083752  7894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:13.093149 13614 raft_consensus.cc:515] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:13.077881 13628 leader_election.cc:290] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:13.084839  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258d6c2dda954bf5b65930fde8ecb9f3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:13.095006  7846 raft_consensus.cc:3060] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Advancing to term 15
I20260709 14:53:13.095588 13614 leader_election.cc:290] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:13.081815 13601 raft_consensus.cc:493] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:13.063216 13516 consensus_queue.cc:1048] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 14:53:13.062668 13570 raft_consensus.cc:2749] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 14:53:13.103605  7893 leader_election.cc:304] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:53:13.108495  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 71716.5us
W20260709 14:53:13.117161  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 77478.6us
W20260709 14:53:13.120837  7894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:53:13.121552  7894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:13.121531  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:53:13.134999  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:13.134961  7846 raft_consensus.cc:2468] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 15.
I20260709 14:53:13.105170 13601 raft_consensus.cc:515] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:13.124193 13607 raft_consensus.cc:2749] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 14:53:13.146037  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 49176.6us
I20260709 14:53:13.144928  7819 leader_election.cc:304] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:13.139750 13614 raft_consensus.cc:493] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:13.138789 13601 leader_election.cc:290] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:13.149822  7893 leader_election.cc:304] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:13.152499 13524 leader_election.cc:290] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:13.157610 13607 raft_consensus.cc:2749] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 14:53:13.159247  7744 leader_election.cc:304] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:13.160211  7893 leader_election.cc:304] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:13.166148 13571 raft_consensus.cc:2749] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 14:53:13.169440 13652 log.cc:927] Time spent T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.083s	user 0.004s	sys 0.000s
I20260709 14:53:13.182031 13627 leader_election.cc:290] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 14 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:13.152339 13601 raft_consensus.cc:2749] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 14:53:13.149724 13614 raft_consensus.cc:515] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:53:13.177574  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:13.171696  7744 leader_election.cc:304] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:13.175973  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:13.174717  7894 leader_election.cc:304] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
W20260709 14:53:13.200793  7743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:13.205614 13627 raft_consensus.cc:2749] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 14:53:13.206521  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:53:13.208019  7894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:13.208321 13618 raft_consensus.cc:2804] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 14:53:13.208865 13618 raft_consensus.cc:697] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:13.212734 13614 leader_election.cc:290] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:13.205513 13524 raft_consensus.cc:2749] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 14:53:13.186574 13653 log.cc:927] Time spent T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.070s	user 0.003s	sys 0.000s
I20260709 14:53:13.204807  7893 leader_election.cc:304] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:13.209867 13618 consensus_queue.cc:237] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:13.232240 13629 consensus_queue.cc:1048] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 14:53:13.225193  7744 leader_election.cc:304] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:13.235037  7819 leader_election.cc:304] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:13.238129 13607 raft_consensus.cc:493] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:13.238698 13607 raft_consensus.cc:515] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:13.241490 13627 raft_consensus.cc:2749] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 14:53:13.242676  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:13.236996  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:13.246588  7845 raft_consensus.cc:2468] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 16.
I20260709 14:53:13.256806 13524 consensus_queue.cc:1059] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 14:53:13.260744 13524 raft_consensus.cc:3055] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 14:53:13.261163 13524 raft_consensus.cc:740] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:13.262560 13524 consensus_queue.cc:260] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:13.253459 13629 raft_consensus.cc:2804] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Leader election won for term 13
I20260709 14:53:13.250355 13633 consensus_queue.cc:1059] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.018s
I20260709 14:53:13.270532  7744 leader_election.cc:304] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:13.257779  7894 leader_election.cc:304] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:13.241236 13607 leader_election.cc:290] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:13.244818 13606 raft_consensus.cc:2749] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 14:53:13.274847 13515 raft_consensus.cc:2804] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 14:53:13.279309 13515 raft_consensus.cc:493] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:13.280228 13515 raft_consensus.cc:3060] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 14:53:13.275234 13614 raft_consensus.cc:3055] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 14:53:13.282606 13614 raft_consensus.cc:740] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:13.285847  7849 raft_consensus.cc:1240] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 16. Current term is 17. Ops: []
I20260709 14:53:13.288293 13627 raft_consensus.cc:2749] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 14:53:13.289346  7744 leader_election.cc:304] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:13.284062 13614 consensus_queue.cc:260] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:13.290402 13627 raft_consensus.cc:2749] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 14:53:13.249537 13609 raft_consensus.cc:2749] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 14:53:13.292544 13627 consensus_queue.cc:1059] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 14:53:13.293416  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 58467.3us
I20260709 14:53:13.293992 13627 raft_consensus.cc:3055] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 LEADER]: Stepping down as leader of term 16
I20260709 14:53:13.294469 13627 raft_consensus.cc:740] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:53:13.295200  7819 leader_election.cc:304] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:13.264953 13524 raft_consensus.cc:3060] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Advancing to term 19
I20260709 14:53:13.296250 13627 consensus_queue.cc:260] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:13.272075 13629 raft_consensus.cc:697] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:53:13.298434 13627 raft_consensus.cc:3060] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Advancing to term 17
I20260709 14:53:13.298847 13629 consensus_queue.cc:237] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:13.305464  7744 leader_election.cc:304] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:13.300025 13614 raft_consensus.cc:3060] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 14:53:13.307350 13613 consensus_queue.cc:1059] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 14:53:13.309567 13606 raft_consensus.cc:2804] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Leader election won for term 13
I20260709 14:53:13.322109  7893 leader_election.cc:304] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:13.328238 13633 raft_consensus.cc:2749] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 14:53:13.321373 13607 raft_consensus.cc:3055] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 14:53:13.334107 13607 raft_consensus.cc:740] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:13.335250 13607 consensus_queue.cc:260] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:13.319856 13571 raft_consensus.cc:2749] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 14:53:13.340402  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:13.339967  7744 leader_election.cc:304] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:13.321401 13606 raft_consensus.cc:697] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:53:13.349093  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9441e831627143a991a1556dcdce71e3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:13.349959  7853 raft_consensus.cc:1275] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 14:53:13.350706  7921 raft_consensus.cc:1275] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 14:53:13.351665  7849 raft_consensus.cc:1275] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 14:53:13.352087 13571 raft_consensus.cc:2749] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 LEADER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 14:53:13.352936  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:13.351737  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:13.355085  7919 raft_consensus.cc:3060] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Advancing to term 21
I20260709 14:53:13.354489  7920 raft_consensus.cc:2468] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 11.
I20260709 14:53:13.356227 13515 raft_consensus.cc:515] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:13.347518 13603 raft_consensus.cc:493] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:13.354527  7893 leader_election.cc:304] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:13.359454  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18d29d52d304c87b930d4fb5eaf50b1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:13.362418  7921 raft_consensus.cc:1275] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 14:53:13.363668  7926 raft_consensus.cc:1275] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 14:53:13.364552  7849 raft_consensus.cc:1275] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 14:53:13.342621 13570 raft_consensus.cc:493] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:13.358032 13606 consensus_queue.cc:237] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:13.367769  7920 raft_consensus.cc:1275] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 14:53:13.366887  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:13.369597  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:13.366441 13570 raft_consensus.cc:515] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:13.370625  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:13.371351  7854 raft_consensus.cc:2468] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 16.
I20260709 14:53:13.371922 13570 leader_election.cc:290] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:13.373332  7927 raft_consensus.cc:2468] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 18.
I20260709 14:53:13.374770  7854 raft_consensus.cc:1275] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 14:53:13.375660 13515 leader_election.cc:290] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 17 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:53:13.378170  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 50656.7us
I20260709 14:53:13.379698  7919 raft_consensus.cc:2468] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 21.
I20260709 14:53:13.380347  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:13.381969  7926 raft_consensus.cc:2393] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 17: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:53:13.357869 13603 raft_consensus.cc:515] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:13.385764 13613 raft_consensus.cc:2749] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 14:53:13.386796  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:13.390328  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:13.390545  7744 leader_election.cc:304] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:13.391073  7846 raft_consensus.cc:3060] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Advancing to term 17
W20260709 14:53:13.393090  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 45997.8us
I20260709 14:53:13.402299  7854 raft_consensus.cc:1275] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 22 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 14:53:13.413166  7846 raft_consensus.cc:2468] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 17.
I20260709 14:53:13.421057  7744 leader_election.cc:304] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:13.410002 13628 raft_consensus.cc:2749] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 14:53:13.437402  7744 leader_election.cc:304] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:13.432976 13477 raft_consensus.cc:2749] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 14:53:13.446564 13569 raft_consensus.cc:2749] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 14:53:13.447646 13630 raft_consensus.cc:493] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:13.448307 13630 raft_consensus.cc:515] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:13.449496 13603 leader_election.cc:290] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:13.451215 13630 leader_election.cc:290] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:13.454316  7894 leader_election.cc:304] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
W20260709 14:53:13.455427  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 66015.6us
I20260709 14:53:13.456408 13491 raft_consensus.cc:2804] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 14:53:13.457073 13491 raft_consensus.cc:697] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:13.457957 13607 raft_consensus.cc:3060] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 14:53:13.458854 13629 consensus_queue.cc:1048] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 14:53:13.461035 13617 consensus_queue.cc:1048] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 14:53:13.461640  7819 leader_election.cc:304] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:13.463450 13570 raft_consensus.cc:2804] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 14:53:13.464246 13570 raft_consensus.cc:493] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:13.458361 13491 consensus_queue.cc:237] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:13.464993 13570 raft_consensus.cc:3060] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Advancing to term 16
I20260709 14:53:13.464287  7819 leader_election.cc:304] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:13.485982  7893 leader_election.cc:304] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:53:13.496390  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 59157.8us
I20260709 14:53:13.485445 13603 raft_consensus.cc:2804] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 14:53:13.490811 13606 consensus_queue.cc:1048] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.008s
I20260709 14:53:13.491233 13616 raft_consensus.cc:2749] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 14:53:13.484740 13500 consensus_queue.cc:1059] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.025s
I20260709 14:53:13.523149 13500 raft_consensus.cc:3055] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 14:53:13.523604 13500 raft_consensus.cc:740] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:13.524688 13500 consensus_queue.cc:260] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:13.472613 13609 consensus_queue.cc:1059] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
W20260709 14:53:13.500131 13662 log.cc:927] Time spent T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260709 14:53:13.479557 13629 consensus_queue.cc:1048] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.019s
I20260709 14:53:13.532032 13617 raft_consensus.cc:493] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:13.532763 13617 raft_consensus.cc:515] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:13.530609 13603 raft_consensus.cc:493] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:13.534576 13603 raft_consensus.cc:3060] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:53:13.535573 13617 leader_election.cc:290] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:53:13.552470  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RunLeaderElection -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 63091.1us
I20260709 14:53:13.553517  7744 leader_election.cc:304] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:13.558413  7893 leader_election.cc:304] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:13.560061  7893 leader_election.cc:304] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:13.566157 13477 raft_consensus.cc:3060] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Advancing to term 19
I20260709 14:53:13.555325 13673 consensus_queue.cc:1048] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.016s
I20260709 14:53:13.573884  7744 leader_election.cc:304] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:13.563961 13609 raft_consensus.cc:2749] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 14:53:13.579906 13515 consensus_queue.cc:1048] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 14:53:13.576300 13614 consensus_queue.cc:1048] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 14:53:13.591300 13500 raft_consensus.cc:3060] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 14:53:13.581000 13616 raft_consensus.cc:3055] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 14:53:13.593508 13616 raft_consensus.cc:740] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:13.594097  7744 leader_election.cc:304] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:13.585826 13618 consensus_queue.cc:1048] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 14:53:13.571625 13524 raft_consensus.cc:2749] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 14:53:13.597168  7744 leader_election.cc:304] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:13.595162 13569 raft_consensus.cc:2749] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 14:53:13.578667 13627 raft_consensus.cc:3060] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [term 10 FOLLOWER]: Advancing to term 11
W20260709 14:53:13.601016  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 120481us
I20260709 14:53:13.602092  7893 leader_election.cc:304] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:13.603916  7819 leader_election.cc:304] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:13.606191 13530 raft_consensus.cc:2804] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Leader election won for term 18
I20260709 14:53:13.606880 13530 raft_consensus.cc:697] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:53:13.607800 13530 consensus_queue.cc:237] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:13.600047 13571 raft_consensus.cc:2749] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 14:53:13.604765  7819 leader_election.cc:304] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:13.611594  7893 leader_election.cc:304] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:13.614188  7744 leader_election.cc:304] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:13.618904 13629 raft_consensus.cc:2804] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Leader election won for term 21
I20260709 14:53:13.601287 13633 consensus_queue.cc:1048] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.018s
I20260709 14:53:13.612820 13524 consensus_queue.cc:1059] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.011s
I20260709 14:53:13.612988 13617 consensus_queue.cc:1048] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.009s
I20260709 14:53:13.595101 13616 consensus_queue.cc:260] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:13.626765 13616 raft_consensus.cc:3060] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 14:53:13.627933  7893 leader_election.cc:304] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:13.630448 13515 raft_consensus.cc:3060] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 14:53:13.639168 13618 raft_consensus.cc:2749] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 14:53:13.639483  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:13.640235  7924 raft_consensus.cc:2468] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 19.
I20260709 14:53:13.641295  7893 leader_election.cc:304] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:13.646449  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:13.647646  7924 raft_consensus.cc:2468] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 18.
I20260709 14:53:13.647886  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:13.648896  7922 raft_consensus.cc:2468] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 12.
I20260709 14:53:13.661419 13629 raft_consensus.cc:697] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
W20260709 14:53:13.663170  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 49049.6us
I20260709 14:53:13.664600  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:13.615255 13491 raft_consensus.cc:2749] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 14:53:13.678265  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:13.678463  7744 leader_election.cc:304] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:13.679286  7927 raft_consensus.cc:2468] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 14.
W20260709 14:53:13.674424  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 47815.2us
I20260709 14:53:13.681474  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:13.682313  7923 raft_consensus.cc:3060] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Advancing to term 19
I20260709 14:53:13.600737 13570 raft_consensus.cc:515] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:13.684149  7927 raft_consensus.cc:1275] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 14:53:13.726581  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:13.739957  7927 raft_consensus.cc:2468] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 15.
I20260709 14:53:13.730238  7745 leader_election.cc:304] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 3876b8ee8d744cb18e91d97aae93b1ac, 9418391fa82a42c79c6cad13ba91d964
I20260709 14:53:13.674458 13614 raft_consensus.cc:2804] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 14:53:13.753950  7923 raft_consensus.cc:2468] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 19.
I20260709 14:53:13.755880  7845 raft_consensus.cc:1275] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 14:53:13.754985  7846 raft_consensus.cc:1275] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 14:53:13.729194 13571 raft_consensus.cc:2749] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 14:53:13.763396  7920 raft_consensus.cc:1275] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 14:53:13.782301 13618 raft_consensus.cc:3055] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 14:53:13.783027 13618 raft_consensus.cc:740] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:13.790670 13570 leader_election.cc:290] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 16 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:13.728040 13569 consensus_queue.cc:1048] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 14:53:13.724246 13628 consensus_queue.cc:1048] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 14:53:13.723973 13603 raft_consensus.cc:515] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:13.758718 13675 raft_consensus.cc:493] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:13.809551 13627 raft_consensus.cc:2749] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 14:53:13.818485 13676 log.cc:927] Time spent T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
I20260709 14:53:13.808677 13629 consensus_queue.cc:237] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:13.822804 13603 leader_election.cc:290] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 12 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:53:13.824579 13681 log.cc:927] Time spent T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 14:53:13.814657 13675 raft_consensus.cc:515] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:13.784119 13618 consensus_queue.cc:260] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:13.800993 13571 raft_consensus.cc:2749] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 14:53:13.901612  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 171482us
W20260709 14:53:13.880633 13671 log.cc:927] Time spent T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.194s	user 0.000s	sys 0.003s
I20260709 14:53:13.894143 13515 raft_consensus.cc:2749] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 14:53:13.948577  7854 raft_consensus.cc:1275] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 14:53:13.951484 13628 consensus_queue.cc:1048] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 14:53:13.904814 13627 raft_consensus.cc:2749] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 14:53:13.949499  7745 leader_election.cc:304] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 3876b8ee8d744cb18e91d97aae93b1ac, 9418391fa82a42c79c6cad13ba91d964
I20260709 14:53:13.958436  7745 leader_election.cc:304] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:13.919984 13618 raft_consensus.cc:3060] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Advancing to term 17
W20260709 14:53:13.962234 13669 log.cc:927] Time spent T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 14:53:13.964748 13571 raft_consensus.cc:2749] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 14:53:14.002779  7819 leader_election.cc:304] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:14.011224 13692 raft_consensus.cc:2804] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 14:53:14.012223 13692 raft_consensus.cc:493] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:14.013082 13692 raft_consensus.cc:3060] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Advancing to term 20
W20260709 14:53:14.014808 13682 log.cc:927] Time spent T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 14:53:14.016889  7819 leader_election.cc:304] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:14.020311  7819 leader_election.cc:304] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:13.962934 13614 raft_consensus.cc:493] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:14.026990  7819 leader_election.cc:304] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:14.029013 13679 raft_consensus.cc:2804] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 14:53:14.029692 13679 raft_consensus.cc:493] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:14.030125 13679 raft_consensus.cc:3060] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Advancing to term 15
I20260709 14:53:14.031677 13603 raft_consensus.cc:2804] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 14:53:14.032265 13603 raft_consensus.cc:493] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Starting leader election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:53:14.032793 13603 raft_consensus.cc:3060] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Advancing to term 19
I20260709 14:53:14.033457 13530 raft_consensus.cc:2804] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 14:53:14.033936 13530 raft_consensus.cc:493] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:14.034305 13530 raft_consensus.cc:3060] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Advancing to term 13
W20260709 14:53:14.036432  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 372009us
I20260709 14:53:14.039736  7744 leader_election.cc:304] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:14.039958 13673 raft_consensus.cc:493] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:14.040458 13673 raft_consensus.cc:515] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:14.041471 13627 consensus_queue.cc:1048] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 14:53:14.051010 13609 consensus_queue.cc:1048] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 14:53:13.989689 13693 raft_consensus.cc:2804] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 14:53:14.027125 13614 raft_consensus.cc:3060] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Advancing to term 19
W20260709 14:53:14.070555  7893 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.101.65:40587 timed out after 1.991s (SENT) [suppressed 81 similar messages]
W20260709 14:53:14.107343 13500 consensus_meta.cc:287] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent flushing consensus metadata: real 0.515s	user 0.017s	sys 0.000s
I20260709 14:53:14.110596  7744 leader_election.cc:304] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:14.114359 13569 raft_consensus.cc:2764] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
I20260709 14:53:14.115298 13615 raft_consensus.cc:493] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:14.116149 13615 raft_consensus.cc:515] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:53:14.121805 13686 log.cc:927] Time spent T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
I20260709 14:53:14.133693 13687 raft_consensus.cc:493] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:14.134632 13687 raft_consensus.cc:515] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:13.899897  6549 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 14:53:14.142719 13683 log.cc:927] Time spent T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 14:53:14.024364 13628 consensus_queue.cc:1048] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.072s
I20260709 14:53:14.146903  7673 catalog_manager.cc:5697] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 16 to 19, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 19 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:53:14.149380 13675 leader_election.cc:290] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:14.150599 13571 raft_consensus.cc:2749] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 14:53:14.083649 13693 raft_consensus.cc:493] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:14.152191 13693 raft_consensus.cc:3060] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Advancing to term 17
I20260709 14:53:14.148805 13601 raft_consensus.cc:493] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:14.153023  7673 catalog_manager.cc:5697] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 17 to 18, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 18 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:53:14.153901 13601 raft_consensus.cc:515] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:14.155575  7673 catalog_manager.cc:5697] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 15 to 16, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 16 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
W20260709 14:53:14.148095 13477 consensus_meta.cc:287] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent flushing consensus metadata: real 0.581s	user 0.004s	sys 0.011s
I20260709 14:53:14.158100 13477 raft_consensus.cc:2749] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 14:53:14.159905  7854 raft_consensus.cc:1275] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 14:53:14.165848 13601 leader_election.cc:290] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:14.167071 13673 leader_election.cc:290] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:14.170275 13615 leader_election.cc:290] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:14.116570  7744 leader_election.cc:304] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:53:14.195354  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 214571us
I20260709 14:53:14.195417  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 23 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:53:14.200254  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 171241us
I20260709 14:53:14.198729  7673 catalog_manager.cc:5697] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 20 to 22. New cstate: current_term: 22 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:53:14.203332  7854 raft_consensus.cc:2410] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for term 23 because replica has last-logged OpId of term: 20 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 11.
I20260709 14:53:14.201288  7676 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54364 (request call id 347) took 2839 ms. Trace:
I20260709 14:53:14.203727  7673 catalog_manager.cc:5697] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 14 to 15, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 15 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:53:14.205916  7673 catalog_manager.cc:5697] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 12 to 14, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 14 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:53:14.186367 13687 leader_election.cc:290] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:14.208566  7673 catalog_manager.cc:5697] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 10 to 12, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 12 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:53:14.219215  7673 catalog_manager.cc:5697] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 16 to 18, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 18 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:53:14.202577 13477 raft_consensus.cc:2804] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 14:53:14.223964  7673 catalog_manager.cc:5697] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 14 to 15, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 15 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
W20260709 14:53:14.229732  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 158622us
I20260709 14:53:14.234072  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:14.251991  7926 raft_consensus.cc:3060] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 14:53:14.236721  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:14.253010  7927 raft_consensus.cc:3060] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:53:14.235515  7922 raft_consensus.cc:1275] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 14:53:14.234757 13571 consensus_queue.cc:1048] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 14:53:14.237165 13696 consensus_queue.cc:1048] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.022s
I20260709 14:53:14.234472 13691 raft_consensus.cc:493] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:14.189491 13615 consensus_queue.cc:1048] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.032s
I20260709 14:53:14.204130  7676 rpcz_store.cc:276] 0709 14:53:11.362230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:53:11.363500 (+  1270us) service_pool.cc:224] Handling call
0709 14:53:14.201179 (+2837679us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 14:53:13.119007 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 14:53:13.161444 (+ 42437us) write_op.cc:432] Acquiring schema lock in shared mode
0709 14:53:13.161485 (+    41us) write_op.cc:435] Acquired schema lock
0709 14:53:13.161508 (+    23us) tablet.cc:662] Decoding operations
0709 14:53:13.162381 (+   873us) write_op.cc:620] Acquiring the partition lock for write op
0709 14:53:13.162436 (+    55us) write_op.cc:641] Partition lock acquired for write op
0709 14:53:13.162461 (+    25us) tablet.cc:685] Acquiring locks for 6 operations
0709 14:53:13.162983 (+   522us) tablet.cc:701] Row locks acquired
0709 14:53:13.163002 (+    19us) write_op.cc:260] PREPARE: finished
0709 14:53:13.163186 (+   184us) write_op.cc:270] Start()
0709 14:53:13.163310 (+   124us) write_op.cc:276] Timestamp: P: 1783608793163106 usec, L: 0
0709 14:53:13.163330 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 14:53:13.164074 (+   744us) log.cc:844] Serialized 2460 byte log entry
0709 14:53:13.289971 (+125897us) op_driver.cc:464] REPLICATION: finished
0709 14:53:13.328427 (+ 38456us) write_op.cc:301] APPLY: starting
0709 14:53:13.328535 (+   108us) tablet.cc:1367] starting BulkCheckPresence
0709 14:53:13.512013 (+183478us) tablet.cc:1370] finished BulkCheckPresence
0709 14:53:13.512182 (+   169us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 14:53:13.584001 (+ 71819us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 14:53:13.584283 (+   282us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=12,key_file_lookups=12,delta_file_lookups=12,mrs_lookups=0
0709 14:53:13.595677 (+ 11394us) write_op.cc:312] APPLY: finished
0709 14:53:13.616082 (+ 20405us) log.cc:844] Serialized 65 byte log entry
0709 14:53:13.654343 (+ 38261us) write_op.cc:489] Releasing partition, row and schema locks
0709 14:53:13.675003 (+ 20660us) write_op.cc:454] Released schema lock
0709 14:53:13.682286 (+  7283us) write_op.cc:341] FINISH: Updating metrics
0709 14:53:13.769102 (+ 86816us) write_op.cc:489] Releasing partition, row and schema locks
0709 14:53:13.771335 (+  2233us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":23614,"reported_tablets":36,"child_traces":[["op",{"apply.queue_time_us":38110,"apply.run_cpu_time_us":24654,"apply.run_wall_time_us":423543,"cfile_cache_hit":26,"cfile_cache_hit_bytes":29135,"num_ops":6,"prepare.queue_time_us":155366,"prepare.run_cpu_time_us":4344,"prepare.run_wall_time_us":82263,"replication_time_us":118093,"thread_start_us":76359,"threads_started":2}]]}
I20260709 14:53:14.272972  7927 raft_consensus.cc:2468] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 12.
I20260709 14:53:14.282095  7922 raft_consensus.cc:1275] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 14:53:14.291265  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 174749us
I20260709 14:53:14.230576 13477 raft_consensus.cc:493] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting leader election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:14.337888  7744 leader_election.cc:304] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:14.338593  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:14.339258  7925 raft_consensus.cc:2468] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 15.
I20260709 14:53:14.340512  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:14.345227  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:14.346210  7925 raft_consensus.cc:2468] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 18.
I20260709 14:53:14.350193  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:14.350996  7922 raft_consensus.cc:2468] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 22.
I20260709 14:53:14.319506 13569 raft_consensus.cc:493] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:14.343081 13477 raft_consensus.cc:3060] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Advancing to term 19
I20260709 14:53:14.364926 13571 raft_consensus.cc:2749] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 14:53:14.382480  7922 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
mode: GRACEFUL
new_leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:48676
I20260709 14:53:14.384974  7922 raft_consensus.cc:606] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Received request to transfer leadership to TS 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:53:14.385696  7922 raft_consensus.cc:614] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 14:53:14.291429 13691 raft_consensus.cc:515] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:14.355436 13692 raft_consensus.cc:515] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:14.363603 13569 raft_consensus.cc:515] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:14.372426 13614 raft_consensus.cc:515] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:14.414445 13696 raft_consensus.cc:493] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:14.438983 13569 leader_election.cc:290] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:14.429829 13613 raft_consensus.cc:493] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:14.440805 13613 raft_consensus.cc:515] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:14.443832 13613 leader_election.cc:290] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:14.384543 13603 raft_consensus.cc:515] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:14.446805  7922 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
mode: GRACEFUL
new_leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:48676
I20260709 14:53:14.459954  7922 raft_consensus.cc:606] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Received request to transfer leadership to TS 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:53:14.460559  7922 raft_consensus.cc:614] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 14:53:14.430356 13699 log.cc:927] Time spent T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.093s	user 0.002s	sys 0.000s
I20260709 14:53:14.390061 13530 raft_consensus.cc:515] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:14.429772 13630 raft_consensus.cc:493] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:14.466356  7926 raft_consensus.cc:2468] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 16.
I20260709 14:53:14.471748  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:14.473569  7846 raft_consensus.cc:2468] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 17.
I20260709 14:53:14.432552 13679 raft_consensus.cc:515] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:14.496380  7926 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
mode: GRACEFUL
new_leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:48676
I20260709 14:53:14.497218  7926 raft_consensus.cc:606] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Received request to transfer leadership to TS 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:53:14.497777  7926 raft_consensus.cc:614] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 14:53:14.464359 13696 raft_consensus.cc:515] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:53:14.498895 13701 log.cc:927] Time spent T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.145s	user 0.001s	sys 0.000s
I20260709 14:53:14.495820  7894 leader_election.cc:304] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:14.502527 13601 raft_consensus.cc:493] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:14.505905 13601 raft_consensus.cc:515] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:53:14.506656 13704 log.cc:927] Time spent T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
W20260709 14:53:14.507863 13703 log.cc:927] Time spent T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 14:53:14.509392 13613 raft_consensus.cc:2804] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 14:53:14.509833 13613 raft_consensus.cc:493] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:14.510211 13613 raft_consensus.cc:3060] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 14:53:14.472329 13630 raft_consensus.cc:515] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:14.474896 13569 raft_consensus.cc:493] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:14.508847 13601 leader_election.cc:290] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:14.516813  7926 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
mode: GRACEFUL
new_leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:48676
I20260709 14:53:14.518836 13696 leader_election.cc:290] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:14.518543 13569 raft_consensus.cc:515] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:14.520782  7926 raft_consensus.cc:606] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 LEADER]: Received request to transfer leadership to TS 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:53:14.527460  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 240926us
I20260709 14:53:14.531112  7848 raft_consensus.cc:1240] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 14. Current term is 15. Ops: [14.9-14.9]
W20260709 14:53:14.534493  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 196713us
I20260709 14:53:14.526680 13607 raft_consensus.cc:493] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:14.541213 13607 raft_consensus.cc:515] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:14.542047 13630 leader_election.cc:290] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:14.535662  7744 leader_election.cc:304] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:14.545560  7853 raft_consensus.cc:1240] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 18. Current term is 19. Ops: []
I20260709 14:53:14.546137  7846 raft_consensus.cc:1240] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 14:53:14.547334  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:14.548339  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:14.533456 13603 leader_election.cc:290] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 19 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:14.555315  7848 raft_consensus.cc:1240] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 14:53:14.556125  7920 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9c563cc7cfbe4d59be4ffc5cf847ce56"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
mode: GRACEFUL
new_leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:48676
I20260709 14:53:14.556806  7920 raft_consensus.cc:606] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 LEADER]: Received request to transfer leadership to TS 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:14.562021  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:14.562788  7920 raft_consensus.cc:2468] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 19.
I20260709 14:53:14.564388  7923 raft_consensus.cc:1275] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 14:53:14.566418  6549 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 14:53:14.566823  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:14.567589  7926 raft_consensus.cc:3060] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Advancing to term 19
I20260709 14:53:14.568511  6549 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 14:53:14.565925 13696 consensus_queue.cc:1059] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.005s
I20260709 14:53:14.571061 13696 raft_consensus.cc:3055] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 LEADER]: Stepping down as leader of term 18
I20260709 14:53:14.571472 13696 raft_consensus.cc:740] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:53:14.572365 13696 consensus_queue.cc:260] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:14.576558  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:14.577589  7923 raft_consensus.cc:2410] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for term 20 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 14:53:14.556543 13627 raft_consensus.cc:2804] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 14:53:14.592664  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 57104.4us
I20260709 14:53:14.593845  7744 leader_election.cc:304] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:14.629838  7819 leader_election.cc:304] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:14.627511  7926 raft_consensus.cc:2468] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 19.
I20260709 14:53:14.639259 13569 leader_election.cc:290] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:14.643496  7744 leader_election.cc:304] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:14.593878 13627 raft_consensus.cc:493] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting leader election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:14.621721 13696 raft_consensus.cc:3060] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Advancing to term 19
I20260709 14:53:14.625005 13691 leader_election.cc:290] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:14.648524  7819 leader_election.cc:304] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:14.651921  7744 leader_election.cc:304] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 9418391fa82a42c79c6cad13ba91d964
I20260709 14:53:14.661150  7819 leader_election.cc:304] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:14.641064 13571 raft_consensus.cc:2749] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 14:53:14.666179  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:14.624420 13678 consensus_queue.cc:1048] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 14:53:14.646143 13617 raft_consensus.cc:2804] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader election won for term 12
I20260709 14:53:14.677678  7819 leader_election.cc:304] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:14.685087  7744 leader_election.cc:400] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 election: Vote denied by peer 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785) with higher term. Message: Invalid argument: T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 17. Current term is 18.
I20260709 14:53:14.648576 13627 raft_consensus.cc:3060] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Advancing to term 18
I20260709 14:53:14.649751 13569 raft_consensus.cc:2749] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 14:53:14.685631  7744 leader_election.cc:403] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 14:53:14.648481 13601 consensus_queue.cc:1048] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 14:53:14.689990  7744 leader_election.cc:304] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:14.679780 13691 raft_consensus.cc:2749] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 14:53:14.692013 13691 raft_consensus.cc:2749] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785) with higher term. Message: Invalid argument: T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 17. Current term is 18.
I20260709 14:53:14.660172 13692 leader_election.cc:290] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 20 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:14.592859 13607 leader_election.cc:290] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:14.685447  7819 leader_election.cc:304] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:14.680557 13687 raft_consensus.cc:2804] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 14:53:14.593050 13628 consensus_queue.cc:1059] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.098s
I20260709 14:53:14.587468 13712 consensus_queue.cc:1059] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.150s
I20260709 14:53:14.705753 13691 raft_consensus.cc:2749] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 14:53:14.690452 13601 raft_consensus.cc:493] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:14.709456 13617 raft_consensus.cc:697] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:53:14.715816 13630 raft_consensus.cc:2804] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 14:53:14.717918 13687 raft_consensus.cc:493] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:14.733749  7819 leader_election.cc:304] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:14.718489 13690 raft_consensus.cc:2804] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 14:53:14.768016  7819 leader_election.cc:304] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:14.724438 13629 raft_consensus.cc:2804] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Leader election won for term 16
I20260709 14:53:14.778395  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:14.762645 13687 raft_consensus.cc:3060] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Advancing to term 19
I20260709 14:53:14.769413 13603 raft_consensus.cc:2804] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 14:53:14.789674 13629 raft_consensus.cc:697] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:53:14.773524 13571 raft_consensus.cc:3055] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 LEADER]: Stepping down as leader of term 15
W20260709 14:53:14.786319 13695 log.cc:927] Time spent T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 14:53:14.731567 13601 raft_consensus.cc:515] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:14.781122 13697 raft_consensus.cc:2804] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Leader election won for term 19
I20260709 14:53:14.770915 13570 consensus_queue.cc:1048] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 14:53:14.793795 13530 leader_election.cc:290] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:14.798062 13603 raft_consensus.cc:493] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:14.818794 13603 raft_consensus.cc:3060] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Advancing to term 19
I20260709 14:53:14.800998 13607 raft_consensus.cc:493] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:14.808936 13712 consensus_queue.cc:1059] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.005s
W20260709 14:53:14.815203 13715 log.cc:927] Time spent T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
I20260709 14:53:14.799896 13571 raft_consensus.cc:740] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:53:14.830329 13571 consensus_queue.cc:260] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:14.831969 13571 raft_consensus.cc:3060] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Advancing to term 16
I20260709 14:53:14.824968 13607 raft_consensus.cc:515] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:14.835103 13601 leader_election.cc:290] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:14.826380 13629 consensus_queue.cc:237] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:14.828809 13630 raft_consensus.cc:493] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 22 FOLLOWER]: Starting leader election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:53:14.807531 13679 leader_election.cc:290] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:14.843488  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:14.852017  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:53:14.856509  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 166668us
I20260709 14:53:14.859131 13725 raft_consensus.cc:493] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:14.859635 13569 raft_consensus.cc:3055] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 LEADER]: Stepping down as leader of term 14
I20260709 14:53:14.860663 13569 raft_consensus.cc:740] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
W20260709 14:53:14.861603 13693 consensus_meta.cc:287] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent flushing consensus metadata: real 0.709s	user 0.010s	sys 0.006s
I20260709 14:53:14.862114 13693 raft_consensus.cc:515] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:14.862443 13477 raft_consensus.cc:515] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:14.864394 13690 raft_consensus.cc:493] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Starting leader election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:53:14.864622 13628 raft_consensus.cc:493] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:14.865643 13628 raft_consensus.cc:515] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:14.866385 13691 raft_consensus.cc:3055] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 LEADER]: Stepping down as leader of term 12
I20260709 14:53:14.866868 13691 raft_consensus.cc:740] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:53:14.867739 13691 consensus_queue.cc:260] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:14.865079 13690 raft_consensus.cc:3060] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Advancing to term 16
I20260709 14:53:14.868757 13628 leader_election.cc:290] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:14.812386 13697 raft_consensus.cc:697] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:53:14.821295 13678 raft_consensus.cc:493] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:14.879982  7744 leader_election.cc:304] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:14.859867 13725 raft_consensus.cc:515] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:14.883906 13614 leader_election.cc:290] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:14.810243 13617 consensus_queue.cc:237] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:14.885474 13697 consensus_queue.cc:237] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:14.892361  7845 raft_consensus.cc:1240] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 14:53:14.855465 13630 raft_consensus.cc:3060] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 22 FOLLOWER]: Advancing to term 23
I20260709 14:53:14.895592 13725 leader_election.cc:290] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:14.869122 13691 raft_consensus.cc:3060] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Advancing to term 13
I20260709 14:53:14.892882 13569 consensus_queue.cc:260] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:14.837136 13607 leader_election.cc:290] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:14.910307 13693 leader_election.cc:290] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:14.919770 13693 raft_consensus.cc:476] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 LEADER]: Not starting pre-election -- already a leader
W20260709 14:53:14.921061  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 66518.5us
I20260709 14:53:14.930543  7924 raft_consensus.cc:1240] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 18. Current term is 19. Ops: []
I20260709 14:53:14.930891  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:14.818239 13613 raft_consensus.cc:515] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:14.928869  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:14.934715  7922 raft_consensus.cc:3060] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Advancing to term 20
I20260709 14:53:14.939671  7925 raft_consensus.cc:1275] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 14:53:14.942905  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:14.944059  7848 raft_consensus.cc:3060] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Advancing to term 17
W20260709 14:53:14.945132  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 87442us
I20260709 14:53:14.945784  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:14.948530  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:53:14.948556  7819 leader_election.cc:336] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Timed out: RequestConsensusVote RPC to 127.6.101.65:40587 timed out after 1.510s (SENT)
I20260709 14:53:14.956983  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:14.962052  7924 raft_consensus.cc:3060] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 14:53:14.955966  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:14.964046  7849 raft_consensus.cc:2468] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 16.
I20260709 14:53:14.905655 13569 raft_consensus.cc:3060] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Advancing to term 15
I20260709 14:53:14.967998  7744 leader_election.cc:304] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:14.973057  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:14.973945  7927 raft_consensus.cc:3060] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Advancing to term 15
W20260709 14:53:14.975545  7819 leader_election.cc:336] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Timed out: RequestConsensusVote RPC to 127.6.101.65:40587 timed out after 1.511s (SENT)
I20260709 14:53:14.976253  7819 leader_election.cc:304] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:14.905539 13678 raft_consensus.cc:515] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:14.984151  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:14.985729  7926 raft_consensus.cc:2468] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 13.
W20260709 14:53:14.986791  7819 leader_election.cc:336] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Timed out: RequestConsensusVote RPC to 127.6.101.65:40587 timed out after 1.531s (SENT)
I20260709 14:53:14.949565 13693 raft_consensus.cc:2749] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 14:53:15.010659  7922 raft_consensus.cc:2468] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 20.
I20260709 14:53:15.016443  7927 raft_consensus.cc:2468] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 15.
I20260709 14:53:15.019305  7924 raft_consensus.cc:2468] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 13.
W20260709 14:53:15.032166  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 45439.2us
W20260709 14:53:15.033047  7819 leader_election.cc:336] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Timed out: RequestConsensusVote RPC to 127.6.101.65:40587 timed out after 1.577s (SENT)
I20260709 14:53:15.010689 13530 raft_consensus.cc:2749] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 14:53:14.972294 13697 raft_consensus.cc:493] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:14.949672 13627 raft_consensus.cc:515] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:14.982654 13477 leader_election.cc:290] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:53:15.041158  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 80540.9us
I20260709 14:53:15.044682  7848 raft_consensus.cc:2468] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 17.
I20260709 14:53:15.037213  7819 leader_election.cc:304] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:15.063170  7745 leader_election.cc:304] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:15.069542  7745 leader_election.cc:304] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:15.058085 13628 raft_consensus.cc:2749] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 14:53:15.060541 13606 raft_consensus.cc:2749] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 14:53:15.098626  7819 leader_election.cc:336] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Timed out: RequestConsensusVote RPC to 127.6.101.65:40587 timed out after 1.650s (SENT)
I20260709 14:53:15.099327  7819 leader_election.cc:304] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
W20260709 14:53:15.100597  7819 leader_election.cc:336] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Timed out: RequestConsensusVote RPC to 127.6.101.65:40587 timed out after 1.654s (SENT)
I20260709 14:53:15.047923 13693 consensus_queue.cc:1059] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.033s
I20260709 14:53:15.113617 13729 raft_consensus.cc:493] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:15.059116 13697 raft_consensus.cc:515] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:15.118427 13603 raft_consensus.cc:515] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:15.092890 13530 raft_consensus.cc:493] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:15.114454 13729 raft_consensus.cc:515] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:15.134794 13740 raft_consensus.cc:2804] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 14:53:15.136313 13712 raft_consensus.cc:2804] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader election won for term 17
I20260709 14:53:15.138446 13627 leader_election.cc:290] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:15.107757 13617 raft_consensus.cc:2749] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 14:53:15.119940 13687 raft_consensus.cc:515] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:15.148962  7854 raft_consensus.cc:1240] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 14:53:15.117059 13735 raft_consensus.cc:493] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:15.152808  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:15.151216 13693 raft_consensus.cc:3055] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 LEADER]: Stepping down as leader of term 16
W20260709 14:53:15.163816  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 196671us
I20260709 14:53:15.160744  7819 leader_election.cc:304] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:15.179311  7744 leader_election.cc:304] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:15.136811 13530 raft_consensus.cc:515] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:15.183843 13530 leader_election.cc:290] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:15.150019 13740 raft_consensus.cc:493] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:15.208573  7819 leader_election.cc:304] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:15.209823  7819 leader_election.cc:304] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:15.152985 13628 raft_consensus.cc:493] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:15.160332 13712 raft_consensus.cc:697] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:53:15.173401 13627 raft_consensus.cc:493] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:15.178577 13693 raft_consensus.cc:740] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:53:15.210947 13530 raft_consensus.cc:2804] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 14:53:15.206714 13613 leader_election.cc:290] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 18 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:15.215683 13673 raft_consensus.cc:2804] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Leader election won for term 20
I20260709 14:53:15.177791 13629 consensus_queue.cc:1048] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.054s
I20260709 14:53:15.211162 13740 raft_consensus.cc:3060] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Advancing to term 18
I20260709 14:53:15.178184 13601 consensus_queue.cc:1059] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.053s
W20260709 14:53:15.252364  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 71604.8us
I20260709 14:53:15.253624  7744 leader_election.cc:304] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:15.236287 13617 raft_consensus.cc:2804] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Leader election won for term 15
I20260709 14:53:15.237766 13571 raft_consensus.cc:2749] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 14:53:15.239137 13678 leader_election.cc:290] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:15.189713 13735 raft_consensus.cc:515] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:15.239333 13530 raft_consensus.cc:493] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:15.229014 13628 raft_consensus.cc:515] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:15.256225 13736 raft_consensus.cc:493] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:15.257301 13737 raft_consensus.cc:493] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:53:15.298420  7893 leader_election.cc:336] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Timed out: RequestConsensusVote RPC to 127.6.101.65:40587 timed out after 1.551s (SENT)
W20260709 14:53:15.298422  7743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:15.301105  7893 leader_election.cc:304] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:15.238497 13627 raft_consensus.cc:515] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:15.280613 13729 leader_election.cc:290] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:15.269446 13673 raft_consensus.cc:697] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:53:15.280853 13679 raft_consensus.cc:3055] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 LEADER]: Stepping down as leader of term 18
I20260709 14:53:15.319408 13679 raft_consensus.cc:740] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:53:15.320600 13679 consensus_queue.cc:260] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:15.322316 13679 raft_consensus.cc:3060] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Advancing to term 19
I20260709 14:53:15.323150 13697 leader_election.cc:290] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:15.309906 13712 consensus_queue.cc:237] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:15.286262 13617 raft_consensus.cc:697] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:53:15.298130 13571 raft_consensus.cc:493] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:15.329608 13731 raft_consensus.cc:2749] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 14:53:15.330068 13673 consensus_queue.cc:237] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:15.320595 13491 raft_consensus.cc:993] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0: : Instructing follower 3876b8ee8d744cb18e91d97aae93b1ac to start an election
I20260709 14:53:15.331534 13603 leader_election.cc:290] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 19 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:15.329682 13617 consensus_queue.cc:237] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:15.310349 13736 raft_consensus.cc:515] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:15.282531 13530 raft_consensus.cc:3060] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Advancing to term 13
W20260709 14:53:15.333480 13733 log.cc:927] Time spent T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.162s	user 0.002s	sys 0.000s
I20260709 14:53:15.330138 13571 raft_consensus.cc:515] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:15.335374 13690 raft_consensus.cc:515] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:15.290498 13739 raft_consensus.cc:2804] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader election won for term 18
I20260709 14:53:15.342353 13745 raft_consensus.cc:493] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:15.376288 13745 raft_consensus.cc:515] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:15.347885  7776 raft_consensus.cc:1275] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 14:53:15.351939  7777 raft_consensus.cc:1275] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 14:53:15.354485  7778 raft_consensus.cc:1275] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 14:53:15.379206 13735 leader_election.cc:290] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:15.361506 13630 raft_consensus.cc:515] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:15.380873  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:15.384876 13571 leader_election.cc:290] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:15.365710  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:15.366456  7770 raft_consensus.cc:1275] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 10. (term mismatch)
I20260709 14:53:15.392696  7771 raft_consensus.cc:2393] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 18: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:53:15.368714 13627 leader_election.cc:290] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:15.370116  7774 raft_consensus.cc:1275] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 12. (term mismatch)
I20260709 14:53:15.371093  7779 raft_consensus.cc:1275] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 14:53:15.371498  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:15.344790 13737 raft_consensus.cc:515] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:53:15.374282 13730 log.cc:927] Time spent T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.229s	user 0.002s	sys 0.000s
I20260709 14:53:15.375589 13500 raft_consensus.cc:993] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0: : Instructing follower 3876b8ee8d744cb18e91d97aae93b1ac to start an election
I20260709 14:53:15.385424 13687 leader_election.cc:290] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 19 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:15.387566 13628 leader_election.cc:290] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:15.387751 13745 leader_election.cc:290] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:15.430156  7777 raft_consensus.cc:1275] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
W20260709 14:53:15.376297 13738 log.cc:927] Time spent T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 14:53:15.388509 13630 leader_election.cc:290] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 23 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:15.382441  7773 raft_consensus.cc:2410] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for term 16 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 14:53:15.399082  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:15.400100  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
W20260709 14:53:15.402246  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 192500us
W20260709 14:53:15.410483  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:15.395237  7774 pending_rounds.cc:85] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed: Aborting all ops after (but not including) 11
I20260709 14:53:15.392542  7770 pending_rounds.cc:85] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed: Aborting all ops after (but not including) 9
I20260709 14:53:15.427704  7848 raft_consensus.cc:1240] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 15. Current term is 16. Ops: []
I20260709 14:53:15.430989  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:15.284004 13693 consensus_queue.cc:260] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:15.355564 13491 raft_consensus.cc:1081] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 LEADER]: Signalling peer 3876b8ee8d744cb18e91d97aae93b1ac to start an election
I20260709 14:53:15.442003  7779 raft_consensus.cc:1275] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 14:53:15.482743  7770 pending_rounds.cc:107] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed: Aborting uncommitted NO_OP operation due to leader change: 16.10
I20260709 14:53:15.483202  7774 pending_rounds.cc:107] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed: Aborting uncommitted NO_OP operation due to leader change: 17.12
I20260709 14:53:15.485898  7774 raft_consensus.cc:2889] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:53:15.487309  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:15.484925  7770 raft_consensus.cc:2889] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:53:15.482867  7819 leader_election.cc:304] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:15.484851  7778 raft_consensus.cc:2393] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 18: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:53:15.494325  7776 raft_consensus.cc:2368] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 15. Current term is 16.
I20260709 14:53:15.409051 13735 raft_consensus.cc:493] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:15.494659  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:15.441781 13614 raft_consensus.cc:1081] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 LEADER]: Signalling peer 3876b8ee8d744cb18e91d97aae93b1ac to start an election
I20260709 14:53:15.508287  7777 raft_consensus.cc:2376] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 16. Re-sending same reply.
I20260709 14:53:15.514052  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:15.515169  7779 raft_consensus.cc:2376] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 19. Re-sending same reply.
I20260709 14:53:15.499348  7771 raft_consensus.cc:3060] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Advancing to term 21
I20260709 14:53:15.516474  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258d6c2dda954bf5b65930fde8ecb9f3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:15.517208  7773 raft_consensus.cc:2468] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 14.
I20260709 14:53:15.518407  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:15.519142  7776 raft_consensus.cc:2376] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 15. Re-sending same reply.
I20260709 14:53:15.501343  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
W20260709 14:53:15.502566  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 269766us
W20260709 14:53:15.504209  7745 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:15.426855 13477 consensus_queue.cc:1048] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.070s
I20260709 14:53:15.574623  7776 raft_consensus.cc:1275] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
W20260709 14:53:15.501156 13730 log.cc:927] Time spent T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 14:53:15.597105  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:15.597942  7777 raft_consensus.cc:2468] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 19.
W20260709 14:53:15.577190  7745 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:15.577854 13693 raft_consensus.cc:3060] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Advancing to term 17
I20260709 14:53:15.584420 13614 raft_consensus.cc:493] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:15.591449  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:15.520984  7778 raft_consensus.cc:2410] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for term 19 because replica has last-logged OpId of term: 18 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 14:53:15.592190 13745 raft_consensus.cc:493] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:15.592790 13628 raft_consensus.cc:493] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:15.593685  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:15.593899  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:15.601087  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:15.608805  7849 raft_consensus.cc:3060] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Advancing to term 18
I20260709 14:53:15.500590 13629 raft_consensus.cc:2804] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Leader election won for term 13
I20260709 14:53:15.602232  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:15.609542  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:15.603909  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:15.610155  7773 raft_consensus.cc:2410] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for term 13 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 14:53:15.610131  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:15.611269  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:15.611444  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:15.613606  7770 raft_consensus.cc:2393] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 13: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:53:15.615341  7847 raft_consensus.cc:1240] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 23 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 22. Current term is 23. Ops: []
I20260709 14:53:15.599380 13731 raft_consensus.cc:493] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:15.630450 13731 raft_consensus.cc:515] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:53:15.633566 13743 log.cc:927] Time spent T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 14:53:15.636135  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:15.638447  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:15.639835  7777 raft_consensus.cc:2393] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 18: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
W20260709 14:53:15.629112 13748 log.cc:927] Time spent T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
I20260709 14:53:15.627628 13736 leader_election.cc:290] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:15.636260 13628 raft_consensus.cc:515] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:15.663277 13740 raft_consensus.cc:515] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:15.663975 13628 leader_election.cc:290] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:15.636135  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:15.641724 13629 raft_consensus.cc:697] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:53:15.666153 13629 consensus_queue.cc:237] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:15.641196  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:15.668262  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:15.652691  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:15.692600  7773 raft_consensus.cc:2468] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 13.
I20260709 14:53:15.651337  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:15.675076  7771 raft_consensus.cc:2468] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 21.
I20260709 14:53:15.688970  7849 raft_consensus.cc:2468] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 18.
I20260709 14:53:15.697139  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:15.697892  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:15.698194  7849 raft_consensus.cc:2410] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for term 20 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
W20260709 14:53:15.649580 13569 consensus_meta.cc:287] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent flushing consensus metadata: real 0.666s	user 0.012s	sys 0.004s
I20260709 14:53:15.716156  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c563cc7cfbe4d59be4ffc5cf847ce56" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:15.713114  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:15.551760 13735 raft_consensus.cc:515] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:15.717762  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:15.718447  7778 raft_consensus.cc:2393] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 13: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:53:15.719206  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:15.720059  7771 raft_consensus.cc:2393] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 18: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:53:15.723018  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:15.725979  7775 raft_consensus.cc:2368] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 17. Current term is 18.
I20260709 14:53:15.726332  7777 raft_consensus.cc:2410] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 14:53:15.728199  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
W20260709 14:53:15.729547 13749 log.cc:927] Time spent T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.093s	user 0.003s	sys 0.000s
I20260709 14:53:15.730193  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:15.650617 13690 leader_election.cc:290] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 16 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:53:15.733151 13751 log.cc:927] Time spent T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.113s	user 0.003s	sys 0.000s
I20260709 14:53:15.644878 13530 raft_consensus.cc:515] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:15.735102 13731 leader_election.cc:290] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:15.648736 13737 leader_election.cc:290] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:15.736274 13530 leader_election.cc:290] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:53:15.708038 13738 log.cc:927] Time spent T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.057s	user 0.001s	sys 0.001s
I20260709 14:53:15.737797  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:15.710263 13736 raft_consensus.cc:493] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9418391fa82a42c79c6cad13ba91d964)
I20260709 14:53:15.738715  7778 raft_consensus.cc:2393] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 19: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:53:15.739135 13736 raft_consensus.cc:515] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:53:15.614957 13745 raft_consensus.cc:515] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:15.739845  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:15.740254 13740 leader_election.cc:290] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:15.612265 13614 raft_consensus.cc:515] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:15.740717  7774 raft_consensus.cc:2468] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 11.
I20260709 14:53:15.741964 13745 leader_election.cc:290] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:15.742622 13614 leader_election.cc:290] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:15.744848 13735 leader_election.cc:290] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:15.745489 13735 consensus_queue.cc:1059] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 22.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 14:53:15.747221 13737 consensus_queue.cc:1059] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 14:53:15.748281 13752 raft_consensus.cc:3055] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 LEADER]: Stepping down as leader of term 15
I20260709 14:53:15.748663 13752 raft_consensus.cc:740] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:53:15.749720 13752 consensus_queue.cc:260] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:15.750065  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:15.751015  7773 raft_consensus.cc:2393] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 19: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:53:15.751559 13752 raft_consensus.cc:3060] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Advancing to term 16
I20260709 14:53:15.752051  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:15.753923 13736 leader_election.cc:290] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68:42321)
I20260709 14:53:15.757143  7778 raft_consensus.cc:2393] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 17: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:53:15.757562  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:15.758399  7773 raft_consensus.cc:3060] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Advancing to term 20
I20260709 14:53:15.759838  7770 raft_consensus.cc:2468] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 19.
I20260709 14:53:15.700800 13691 raft_consensus.cc:493] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:15.761888  8637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9441e831627143a991a1556dcdce71e3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9418391fa82a42c79c6cad13ba91d964" is_pre_election: true
I20260709 14:53:15.763135  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:15.720923 13739 raft_consensus.cc:697] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:53:15.762472  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:15.765724  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:15.771831  7778 raft_consensus.cc:2393] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 17: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:53:15.785043  7773 raft_consensus.cc:2468] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 20.
I20260709 14:53:15.765506  7770 raft_consensus.cc:2376] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 21. Re-sending same reply.
W20260709 14:53:15.766891  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 423606us
I20260709 14:53:15.791070  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:15.796027  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:15.797019  7776 raft_consensus.cc:2410] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for term 13 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 14:53:15.798303  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:15.799391  7776 raft_consensus.cc:2410] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for term 16 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 14:53:15.772581 13739 consensus_queue.cc:237] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:53:15.803339  7893 leader_election.cc:336] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Timed out: RequestConsensusVote RPC to 127.6.101.65:40587 timed out after 1.612s (SENT)
I20260709 14:53:15.803892  7893 leader_election.cc:304] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:15.791968  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:15.808707 13614 raft_consensus.cc:2749] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 14:53:15.765307 13691 raft_consensus.cc:515] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:15.812821  7773 raft_consensus.cc:1275] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 14:53:15.814888  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:15.815778  7854 raft_consensus.cc:3060] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Advancing to term 18
I20260709 14:53:15.820080  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9441e831627143a991a1556dcdce71e3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:15.820412  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:15.820875  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:15.825819  7777 raft_consensus.cc:1240] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 18. Current term is 19. Ops: []
I20260709 14:53:15.826414  7773 raft_consensus.cc:1275] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 14:53:15.829133  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:53:15.832583  7744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:15.833784  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:15.815794 13706 raft_consensus.cc:493] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9418391fa82a42c79c6cad13ba91d964)
I20260709 14:53:15.834671  7848 raft_consensus.cc:2468] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 16.
I20260709 14:53:15.838640  7919 raft_consensus.cc:1240] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 14. Current term is 15. Ops: []
I20260709 14:53:15.837654  7772 raft_consensus.cc:1240] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 17. Current term is 18. Ops: []
I20260709 14:53:15.842849  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:15.843477  7919 raft_consensus.cc:2376] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 19. Re-sending same reply.
I20260709 14:53:15.843670  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:15.844899  7925 raft_consensus.cc:2368] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 18. Current term is 19.
I20260709 14:53:15.845232  7773 raft_consensus.cc:1275] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 14:53:15.850803  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:15.846611  7777 raft_consensus.cc:1240] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 13. Current term is 14. Ops: []
I20260709 14:53:15.831585 13691 leader_election.cc:290] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:15.826218 13530 consensus_queue.cc:1048] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.019s
W20260709 14:53:15.855568  7742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:15.856958  7779 raft_consensus.cc:2410] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for term 17 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 14:53:15.857883  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:15.858661  7926 raft_consensus.cc:2368] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 15. Current term is 16.
I20260709 14:53:15.829332 13687 consensus_queue.cc:1048] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.019s
I20260709 14:53:15.837054 13736 raft_consensus.cc:493] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:15.845572 13628 raft_consensus.cc:493] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:15.842789  7772 raft_consensus.cc:1275] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 14:53:15.845868 13754 consensus_queue.cc:1048] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.076s
I20260709 14:53:15.845772 13758 raft_consensus.cc:493] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:15.921958  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:15.948019  7773 raft_consensus.cc:2368] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 12. Current term is 13.
I20260709 14:53:15.841042 13731 consensus_queue.cc:1048] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.026s
I20260709 14:53:15.840875 13692 consensus_queue.cc:1048] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.026s
I20260709 14:53:15.923080  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783e4874513449ef9084b833f188a6d3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:15.930490  7819 leader_election.cc:304] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:15.943538  7770 raft_consensus.cc:1275] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 14:53:15.944854  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:15.840612 13729 consensus_queue.cc:1048] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 14:53:15.922488  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:15.960139  7819 leader_election.cc:304] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:15.956887  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:15.960399  7777 raft_consensus.cc:2468] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 15.
I20260709 14:53:15.961758  7819 leader_election.cc:304] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:15.849216 13617 consensus_queue.cc:1048] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.096s
I20260709 14:53:15.844792 13706 raft_consensus.cc:515] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:53:15.843921 13675 consensus_queue.cc:1048] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.075s
I20260709 14:53:15.970160  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:15.971850  7926 raft_consensus.cc:2468] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 16.
I20260709 14:53:15.942807 13614 raft_consensus.cc:493] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:15.861171 13673 consensus_queue.cc:1048] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.103s
I20260709 14:53:15.980042  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:15.918423 13601 consensus_queue.cc:1048] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.056s
I20260709 14:53:15.923800 13606 consensus_queue.cc:1048] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.054s
I20260709 14:53:15.967437 13629 raft_consensus.cc:2804] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 14:53:16.010383 13629 raft_consensus.cc:493] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:16.011013 13629 raft_consensus.cc:3060] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Advancing to term 14
I20260709 14:53:15.964635 13679 raft_consensus.cc:2749] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 14:53:15.948736 13628 raft_consensus.cc:515] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:15.987649  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:15.992112  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258d6c2dda954bf5b65930fde8ecb9f3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:15.958858 13758 raft_consensus.cc:515] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:16.007063 13737 raft_consensus.cc:493] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:16.023645  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:15.945076 13736 raft_consensus.cc:515] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:16.024560  7919 raft_consensus.cc:2376] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 18. Re-sending same reply.
I20260709 14:53:16.030917  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:16.033545  7770 raft_consensus.cc:2468] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 18.
I20260709 14:53:16.031540  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:16.034603  7775 raft_consensus.cc:2468] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 17.
I20260709 14:53:16.037132  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:16.037446  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:16.039466  7773 raft_consensus.cc:2393] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 13: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:53:16.039681  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:16.045760  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:16.046562  7775 raft_consensus.cc:2468] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 18.
I20260709 14:53:16.046902  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:16.048770  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:16.049666  7775 raft_consensus.cc:2393] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 13: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:53:16.047721  7770 raft_consensus.cc:3060] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Advancing to term 18
I20260709 14:53:16.050227  7926 raft_consensus.cc:1275] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 14:53:16.051973  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:16.052958  7776 raft_consensus.cc:2468] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 19.
I20260709 14:53:15.990671 13614 raft_consensus.cc:515] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:53:16.059911  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:16.055253  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:16.062129  7926 raft_consensus.cc:1275] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 22 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 14:53:16.058234  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:16.064072  7771 raft_consensus.cc:2468] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 16.
I20260709 14:53:16.064371  7773 raft_consensus.cc:2468] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 20.
I20260709 14:53:16.024693 13737 raft_consensus.cc:515] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:53:16.070369  7745 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:16.071543  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
W20260709 14:53:16.071708  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 110034us
I20260709 14:53:16.070230  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:16.072116  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:16.072968  7775 raft_consensus.cc:2468] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 16.
I20260709 14:53:16.080467  7925 raft_consensus.cc:1240] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 18. Current term is 19. Ops: []
I20260709 14:53:16.081012  7854 raft_consensus.cc:2468] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 18.
I20260709 14:53:16.084787  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:16.085582  7849 raft_consensus.cc:2468] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 16.
I20260709 14:53:16.086720  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:16.088521 13530 consensus_queue.cc:1048] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 14:53:16.091735  7850 raft_consensus.cc:2393] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 17: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:53:16.064761 13628 leader_election.cc:290] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:16.094866  7770 raft_consensus.cc:2468] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 18.
I20260709 14:53:16.094175  7854 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f"
dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:49946
I20260709 14:53:16.089406  7847 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9c563cc7cfbe4d59be4ffc5cf847ce56"
dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:49946
I20260709 14:53:16.122550  7847 raft_consensus.cc:493] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:53:16.123013  7847 raft_consensus.cc:3060] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:53:16.098078  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:16.101975  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:16.089346 13706 leader_election.cc:290] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68:42321)
I20260709 14:53:16.105525 13736 leader_election.cc:290] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:16.134656  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:16.109678 13731 raft_consensus.cc:493] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:16.110353  8637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18d29d52d304c87b930d4fb5eaf50b1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9418391fa82a42c79c6cad13ba91d964" is_pre_election: true
I20260709 14:53:16.110716 13500 raft_consensus.cc:493] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:16.112900 13737 leader_election.cc:290] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:16.115399 13740 raft_consensus.cc:3055] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 22 LEADER]: Stepping down as leader of term 22
I20260709 14:53:16.118086  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:16.139001  7779 raft_consensus.cc:2410] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 14:53:16.125389  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:16.125494  7775 raft_consensus.cc:2376] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 19. Re-sending same reply.
I20260709 14:53:16.125741  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:16.140293  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:16.140897  7926 raft_consensus.cc:2410] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for term 19 because replica has last-logged OpId of term: 18 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 14:53:16.140642  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:16.141135  7923 raft_consensus.cc:3060] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 14:53:16.133682  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:16.142659  7776 raft_consensus.cc:2410] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for term 17 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 14:53:16.133158  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:16.134552  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:16.143497  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:16.083559 13750 raft_consensus.cc:2749] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 14:53:16.133181  7773 raft_consensus.cc:2468] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 13.
I20260709 14:53:16.137954  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:16.146461  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:16.147116  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258d6c2dda954bf5b65930fde8ecb9f3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:16.148020  7776 raft_consensus.cc:3060] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Advancing to term 15
I20260709 14:53:16.149281  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:16.151722  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:16.154393  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:16.155603  7773 raft_consensus.cc:2410] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for term 17 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 14:53:16.155946  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:16.155422  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:16.159673  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c563cc7cfbe4d59be4ffc5cf847ce56" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:16.160604  7776 raft_consensus.cc:2468] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 15.
I20260709 14:53:16.161805  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:16.162863  7922 raft_consensus.cc:2410] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for term 20 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 14:53:16.163929  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:16.167390  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:16.169332  7745 leader_election.cc:304] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 3876b8ee8d744cb18e91d97aae93b1ac, 9418391fa82a42c79c6cad13ba91d964
I20260709 14:53:16.171156 13737 raft_consensus.cc:2749] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 14:53:16.171886  7847 raft_consensus.cc:515] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:16.161805  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:16.164597  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:16.176103  7921 raft_consensus.cc:2393] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 12: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:53:16.175922  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:16.177016  7922 raft_consensus.cc:2410] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for term 19 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 14:53:16.171204  7745 leader_election.cc:304] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
W20260709 14:53:16.178471  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 67384.3us
I20260709 14:53:16.177114  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:16.179524  7924 raft_consensus.cc:2468] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 17.
I20260709 14:53:16.176124  7923 raft_consensus.cc:2468] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 17.
I20260709 14:53:16.179729  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:16.181324  7775 raft_consensus.cc:2410] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for term 16 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 14:53:16.169234  7928 raft_consensus.cc:1275] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 14:53:16.135495 13628 raft_consensus.cc:493] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:16.153708 13740 raft_consensus.cc:740] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:53:16.183838  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:16.153486 13729 consensus_queue.cc:1048] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.059s
I20260709 14:53:16.183374  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258d6c2dda954bf5b65930fde8ecb9f3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:16.181989  7745 leader_election.cc:304] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:16.186393  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:16.202157  7779 raft_consensus.cc:2376] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 15. Re-sending same reply.
I20260709 14:53:16.202761  7773 raft_consensus.cc:2393] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 19: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:53:16.179586 13675 consensus_queue.cc:1048] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.008s
I20260709 14:53:16.126339 13617 consensus_queue.cc:1059] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.056s
I20260709 14:53:16.189505  7778 raft_consensus.cc:3060] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:53:16.189919 13614 leader_election.cc:290] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:16.137111 13530 consensus_queue.cc:1059] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.053s
I20260709 14:53:16.193910  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 23 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:16.194926  7774 raft_consensus.cc:1275] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 9. (term mismatch)
I20260709 14:53:16.210096  7774 pending_rounds.cc:85] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed: Aborting all ops after (but not including) 8
I20260709 14:53:16.210433  7774 pending_rounds.cc:107] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed: Aborting uncommitted NO_OP operation due to leader change: 15.9
I20260709 14:53:16.210791  7774 raft_consensus.cc:2889] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:53:16.183406  7847 leader_election.cc:290] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 12 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:16.121310 13630 consensus_queue.cc:1048] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.060s
W20260709 14:53:16.195358 13767 log.cc:927] Time spent T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
I20260709 14:53:16.207253  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:16.218150  7775 raft_consensus.cc:2468] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 15.
I20260709 14:53:16.184852 13736 raft_consensus.cc:2804] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 14:53:16.161345 13678 consensus_queue.cc:1059] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.051s
I20260709 14:53:16.154372 13500 raft_consensus.cc:515] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:16.252245  7773 raft_consensus.cc:1275] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 14:53:16.153543 13731 raft_consensus.cc:515] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:53:16.266010  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 60393us
I20260709 14:53:16.272140  7744 leader_election.cc:400] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 election: Vote denied by peer 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785) with higher term. Message: Invalid argument: T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 18. Current term is 19.
I20260709 14:53:16.209308 13571 raft_consensus.cc:2804] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader election won for term 18
I20260709 14:53:16.214325 13614 raft_consensus.cc:493] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:16.220461 13736 raft_consensus.cc:493] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:16.251096 13737 raft_consensus.cc:493] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:16.278218  7744 leader_election.cc:304] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:16.195986 13628 raft_consensus.cc:515] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:53:16.285346  7742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:16.286173  7927 raft_consensus.cc:2468] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 17.
I20260709 14:53:16.257826 13609 raft_consensus.cc:493] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:16.291261 13609 raft_consensus.cc:515] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:16.294267 13724 raft_consensus.cc:493] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:16.295030 13724 raft_consensus.cc:515] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:16.295532 13628 leader_election.cc:290] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:53:16.296197 13764 log.cc:927] Time spent T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.231s	user 0.002s	sys 0.000s
I20260709 14:53:16.296963  7778 raft_consensus.cc:1275] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 14:53:16.297230  7770 raft_consensus.cc:2468] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 17.
I20260709 14:53:16.273146 13758 leader_election.cc:290] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:53:16.302110  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 117772us
I20260709 14:53:16.311573  7744 leader_election.cc:400] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 election: Vote denied by peer 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785) with higher term. Message: Invalid argument: T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 15. Current term is 16.
W20260709 14:53:16.313524  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 108088us
I20260709 14:53:16.288233 13736 raft_consensus.cc:3060] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Advancing to term 18
I20260709 14:53:16.318280  7894 leader_election.cc:304] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:16.208554 13740 consensus_queue.cc:260] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:16.326987  7850 raft_consensus.cc:1240] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 23 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 22. Current term is 23. Ops: []
I20260709 14:53:16.327651  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:16.328531  7853 raft_consensus.cc:2468] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 16.
I20260709 14:53:16.321352  7847 raft_consensus.cc:1240] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 18. Current term is 19. Ops: []
I20260709 14:53:16.323032  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18d29d52d304c87b930d4fb5eaf50b1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:16.323596  7852 raft_consensus.cc:1275] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 14:53:16.301868 13628 raft_consensus.cc:2749] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 14:53:16.343024  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:16.347252  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:16.357878  7774 raft_consensus.cc:1275] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 14:53:16.360023  7853 raft_consensus.cc:2468] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 16.
I20260709 14:53:16.357182  7745 leader_election.cc:304] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:16.344859  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 20 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:16.359432  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:16.288101 13614 raft_consensus.cc:515] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:16.294183 13629 raft_consensus.cc:515] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:16.309530 13571 raft_consensus.cc:697] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:53:16.367980  7774 raft_consensus.cc:1275] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 13. (term mismatch)
I20260709 14:53:16.301765 13737 raft_consensus.cc:515] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:16.371538  7745 leader_election.cc:304] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 3876b8ee8d744cb18e91d97aae93b1ac, 9418391fa82a42c79c6cad13ba91d964
W20260709 14:53:16.381686  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 59416.2us
I20260709 14:53:16.387120  7744 leader_election.cc:304] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:16.383764  7774 pending_rounds.cc:85] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed: Aborting all ops after (but not including) 12
I20260709 14:53:16.389653  7774 pending_rounds.cc:107] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed: Aborting uncommitted NO_OP operation due to leader change: 16.13
I20260709 14:53:16.389945  7774 raft_consensus.cc:2889] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:53:16.391296  7854 raft_consensus.cc:493] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:53:16.392064  7854 raft_consensus.cc:3060] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Advancing to term 15
I20260709 14:53:16.367178 13609 leader_election.cc:290] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:16.370630 13691 raft_consensus.cc:2804] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 14:53:16.400754 13627 raft_consensus.cc:493] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:16.378298 13500 leader_election.cc:290] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:16.379298 13740 raft_consensus.cc:3060] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 22 FOLLOWER]: Advancing to term 23
I20260709 14:53:16.408735  7744 leader_election.cc:304] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:16.381698 13772 raft_consensus.cc:2804] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 14:53:16.381592 13739 raft_consensus.cc:493] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:16.389460 13735 raft_consensus.cc:2749] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 14:53:16.409876  7854 raft_consensus.cc:515] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:16.381814 13752 consensus_queue.cc:1059] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.026s
I20260709 14:53:16.391610 13706 consensus_queue.cc:1048] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 14:53:16.450683 13758 raft_consensus.cc:2749] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 14:53:16.451782 13724 leader_election.cc:290] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:16.452144 13769 raft_consensus.cc:3055] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 LEADER]: Stepping down as leader of term 18
I20260709 14:53:16.405289 13691 raft_consensus.cc:493] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 14:53:16.479295  7893 leader_election.cc:336] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Timed out: RequestConsensusVote RPC to 127.6.101.65:40587 timed out after 1.991s (SENT)
I20260709 14:53:16.435075 13772 raft_consensus.cc:697] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
W20260709 14:53:16.573884  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:16.581838  7847 raft_consensus.cc:1240] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 11. Current term is 12. Ops: []
I20260709 14:53:16.415414 13627 raft_consensus.cc:515] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:53:16.592582  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 183897us
I20260709 14:53:16.593983  7744 leader_election.cc:304] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:53:16.598706  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 270255us
W20260709 14:53:16.599130  7742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:16.600373  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:16.612511  7927 raft_consensus.cc:2468] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 18.
I20260709 14:53:16.432818 13739 raft_consensus.cc:515] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:16.476301 13769 raft_consensus.cc:740] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:53:16.577267 13691 raft_consensus.cc:3060] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Advancing to term 17
I20260709 14:53:16.611482  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:16.622059  7919 raft_consensus.cc:2468] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 17.
I20260709 14:53:16.495643 13731 leader_election.cc:290] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:16.579375 13724 raft_consensus.cc:493] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:16.621626  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:16.634645  7921 raft_consensus.cc:2468] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 17.
I20260709 14:53:16.596462 13628 raft_consensus.cc:2749] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 14:53:16.638598  7744 leader_election.cc:304] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:53:16.687563  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 49012us
I20260709 14:53:16.690589  7774 raft_consensus.cc:1275] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 9. (term mismatch)
I20260709 14:53:16.691130  7774 pending_rounds.cc:85] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed: Aborting all ops after (but not including) 8
I20260709 14:53:16.691373  7774 pending_rounds.cc:107] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 14:53:16.691648  7774 raft_consensus.cc:2889] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:53:16.694944  7744 leader_election.cc:304] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:16.477212 13571 consensus_queue.cc:237] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:16.696204  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
W20260709 14:53:16.692584 13779 log.cc:927] Time spent T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.295s	user 0.003s	sys 0.002s
I20260709 14:53:16.641290 13724 raft_consensus.cc:515] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:16.728513 13783 raft_consensus.cc:493] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:16.729619  7744 leader_election.cc:304] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:16.736515  7771 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37136 (request call id 3070) took 1032 ms. Trace:
I20260709 14:53:16.737082  7771 rpcz_store.cc:276] 0709 14:53:15.704219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:53:15.759283 (+ 55064us) service_pool.cc:224] Handling call
0709 14:53:16.736215 (+976932us) spinlock_profiling.cc:243] Waited 256 ms on lock 0x7b54002fc454. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae922fa 00007fb68fe53b17 00007fb6893ce6d4 00007fb6893ce662 00007fb6893ce591 00007fb6893ce50c 00007fb6893cd7c2 00007fb6891c948c 00007fb6891c88c6 00007fb6891c826f
0709 14:53:16.736404 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":588846848}
I20260709 14:53:16.708736 13628 raft_consensus.cc:2749] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 14:53:16.721423 13629 leader_election.cc:290] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 14 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:16.719501 13771 raft_consensus.cc:493] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:16.729269 13783 raft_consensus.cc:515] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:16.769755 13614 leader_election.cc:290] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:16.788522 13737 leader_election.cc:290] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:16.826380  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:16.709349 13769 consensus_queue.cc:260] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:16.709522 13772 consensus_queue.cc:237] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:16.835775  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:16.836726  7919 raft_consensus.cc:3060] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 22 FOLLOWER]: Advancing to term 23
I20260709 14:53:16.827615  7745 leader_election.cc:304] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:16.777070 13786 raft_consensus.cc:2749] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 14:53:16.848984 13614 raft_consensus.cc:493] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:15.576099  6549 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 14:53:16.851274 13754 raft_consensus.cc:493] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:16.851864 13754 raft_consensus.cc:515] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:16.854179  7675 catalog_manager.cc:5697] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 16 to 18, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 18 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:53:16.804857 13771 raft_consensus.cc:515] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:53:16.878301 13793 log.cc:927] Time spent T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 14:53:16.879155 13771 leader_election.cc:290] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:16.881631 13724 leader_election.cc:290] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:16.826107 13758 raft_consensus.cc:2749] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 14:53:16.885874  7673 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54344 (request call id 379) took 3656 ms. Trace:
I20260709 14:53:16.849854 13614 raft_consensus.cc:515] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:16.843084 13628 raft_consensus.cc:2749] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 14:53:16.902683  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 173112us
I20260709 14:53:16.856878  7675 catalog_manager.cc:5697] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:53:16.913221  7744 leader_election.cc:304] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:16.919755  7675 catalog_manager.cc:5697] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 17 to 18, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 18 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:53:16.923096  7675 catalog_manager.cc:5697] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 17 to 18, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 18 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:53:16.886768  7673 rpcz_store.cc:276] 0709 14:53:13.229854 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:53:13.230139 (+   285us) service_pool.cc:224] Handling call
0709 14:53:16.885768 (+3655629us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 14:53:14.467349 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 14:53:14.509288 (+ 41939us) write_op.cc:432] Acquiring schema lock in shared mode
0709 14:53:14.509334 (+    46us) write_op.cc:435] Acquired schema lock
0709 14:53:14.509351 (+    17us) tablet.cc:662] Decoding operations
0709 14:53:14.510270 (+   919us) write_op.cc:620] Acquiring the partition lock for write op
0709 14:53:14.510353 (+    83us) write_op.cc:641] Partition lock acquired for write op
0709 14:53:14.510380 (+    27us) tablet.cc:685] Acquiring locks for 9 operations
0709 14:53:14.511564 (+  1184us) tablet.cc:701] Row locks acquired
0709 14:53:14.511599 (+    35us) write_op.cc:260] PREPARE: finished
0709 14:53:14.511794 (+   195us) write_op.cc:270] Start()
0709 14:53:14.511931 (+   137us) write_op.cc:276] Timestamp: P: 1783608794511732 usec, L: 0
0709 14:53:14.511948 (+    17us) op_driver.cc:348] REPLICATION: starting
0709 14:53:14.512864 (+   916us) log.cc:844] Serialized 3619 byte log entry
0709 14:53:14.809645 (+296781us) op_driver.cc:464] REPLICATION: finished
0709 14:53:15.068036 (+258391us) write_op.cc:301] APPLY: starting
0709 14:53:15.070665 (+  2629us) tablet.cc:1367] starting BulkCheckPresence
0709 14:53:15.333592 (+262927us) tablet.cc:1370] finished BulkCheckPresence
0709 14:53:15.333723 (+   131us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 14:53:15.370989 (+ 37266us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 14:53:15.371291 (+   302us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=18,key_file_lookups=18,delta_file_lookups=18,mrs_lookups=0
0709 14:53:15.371338 (+    47us) write_op.cc:312] APPLY: finished
0709 14:53:15.373747 (+  2409us) log.cc:844] Serialized 89 byte log entry
0709 14:53:15.375496 (+  1749us) write_op.cc:489] Releasing partition, row and schema locks
0709 14:53:15.375704 (+   208us) write_op.cc:454] Released schema lock
0709 14:53:15.375783 (+    79us) write_op.cc:341] FINISH: Updating metrics
0709 14:53:15.428365 (+ 52582us) write_op.cc:489] Releasing partition, row and schema locks
0709 14:53:15.443890 (+ 15525us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":286115,"reported_tablets":14,"child_traces":[["op",{"apply.queue_time_us":226289,"apply.run_cpu_time_us":18565,"apply.run_wall_time_us":359052,"cfile_cache_hit":38,"cfile_cache_hit_bytes":41639,"num_ops":9,"prepare.queue_time_us":79026,"prepare.run_cpu_time_us":4940,"prepare.run_wall_time_us":76924,"replication_time_us":286188,"thread_start_us":176794,"threads_started":2}]]}
I20260709 14:53:16.935770  7927 raft_consensus.cc:1275] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 14:53:16.929734  7675 catalog_manager.cc:5697] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:53:16.941569  7675 catalog_manager.cc:5697] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 17 to 18, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 18 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:53:16.952229  7919 raft_consensus.cc:2468] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 23.
I20260709 14:53:16.881640 13739 leader_election.cc:290] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:53:16.964460  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 350570us
I20260709 14:53:16.924424 13792 raft_consensus.cc:493] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:16.896418 13791 raft_consensus.cc:493] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:16.975222  7928 raft_consensus.cc:2468] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 19.
W20260709 14:53:16.955502 13782 log.cc:927] Time spent T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.251s	user 0.001s	sys 0.001s
I20260709 14:53:16.977424  7846 raft_consensus.cc:1275] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
W20260709 14:53:16.979705  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 66618us
I20260709 14:53:16.925207 13737 raft_consensus.cc:2804] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 14:53:16.978258  7779 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.003s	sys 0.010s
I20260709 14:53:16.980295  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:16.980522  7744 leader_election.cc:304] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:53:16.989167  7779 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.533s	user 0.003s	sys 0.010s
I20260709 14:53:17.001751  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:17.001470  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:16.965804 13627 leader_election.cc:290] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:16.977520 13724 raft_consensus.cc:493] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
W20260709 14:53:17.016970  7819 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:16.982223 13737 raft_consensus.cc:493] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:17.019186  7744 leader_election.cc:304] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:17.026144 13754 leader_election.cc:290] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:16.995784 13795 raft_consensus.cc:493] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:16.995043 13739 raft_consensus.cc:2749] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 14:53:17.028018  7744 leader_election.cc:304] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:53:17.022011 13780 log.cc:927] Time spent T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.301s	user 0.000s	sys 0.002s
I20260709 14:53:17.007978 13601 raft_consensus.cc:493] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:17.004770 13801 raft_consensus.cc:493] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:16.979599 13792 raft_consensus.cc:515] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:17.033005  7773 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 3892) took 1185 ms. Trace:
I20260709 14:53:17.035187  7744 leader_election.cc:304] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:17.032747  7919 raft_consensus.cc:1275] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 14:53:17.021981 13771 raft_consensus.cc:493] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:17.027707 13737 raft_consensus.cc:3060] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Advancing to term 18
I20260709 14:53:17.070803  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:17.034924 13795 raft_consensus.cc:515] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:17.074224 13795 leader_election.cc:290] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:17.077687 13614 leader_election.cc:290] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:17.041692 13477 raft_consensus.cc:2749] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 14:53:17.078553 13614 raft_consensus.cc:493] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:17.078954  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:17.079989  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:17.080451  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:17.081390  7850 raft_consensus.cc:2468] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 19.
I20260709 14:53:17.080596  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:17.080991  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:17.083151  7851 raft_consensus.cc:2393] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 18: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:53:16.979972 13791 raft_consensus.cc:515] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:17.030350 13758 raft_consensus.cc:2749] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 14:53:17.028264 13796 raft_consensus.cc:2749] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 14:53:17.043310 13601 raft_consensus.cc:515] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:17.087867 13791 leader_election.cc:290] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:17.088271  7925 raft_consensus.cc:1275] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 14:53:17.077718  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:17.026832 13724 raft_consensus.cc:515] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:17.088621 13601 leader_election.cc:290] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:17.092159 13724 leader_election.cc:290] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:17.032464 13794 raft_consensus.cc:493] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:17.093762 13794 raft_consensus.cc:515] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:17.096251 13794 leader_election.cc:290] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:17.072816  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c563cc7cfbe4d59be4ffc5cf847ce56" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: true dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:17.058828 13801 raft_consensus.cc:515] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:17.080902  7848 raft_consensus.cc:2393] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 19: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:53:17.080053  7852 raft_consensus.cc:2468] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 16.
I20260709 14:53:17.100490 13801 leader_election.cc:290] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:53:17.056381  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:17.060729  7854 leader_election.cc:290] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:17.100340  7847 raft_consensus.cc:1240] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 13. Current term is 15. Ops: []
I20260709 14:53:17.097666  7927 raft_consensus.cc:3055] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 14:53:17.106194  7927 raft_consensus.cc:740] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:17.107522  7927 consensus_queue.cc:260] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:17.109484  7927 raft_consensus.cc:3060] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:53:17.115978  7854 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:49946 (request call id 4651) took 1021 ms. Trace:
W20260709 14:53:17.116261  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 81204us
I20260709 14:53:17.117570  7744 leader_election.cc:304] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:17.120535  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:17.120553  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:53:17.126910 13736 consensus_meta.cc:287] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent flushing consensus metadata: real 0.800s	user 0.013s	sys 0.002s
I20260709 14:53:17.127604 13736 raft_consensus.cc:515] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:17.131244  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:17.079346 13614 raft_consensus.cc:515] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:17.133111  7925 raft_consensus.cc:1275] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 14:53:17.116547  7854 rpcz_store.cc:276] 0709 14:53:16.082413 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:53:16.093731 (+ 11318us) service_pool.cc:224] Handling call
0709 14:53:17.034256 (+940525us) spinlock_profiling.cc:243] Waited 258 ms on lock 0x7b54001405d4. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae85a3d 00007fb68fe55cd0 00007fb6893da254 00007fb6893da1e2 00007fb6893da111 00007fb6893da08c 00007fb6893d9342 00007fb6891c948c 00007fb6891c88c6 00007fb6891c826f
0709 14:53:17.104179 (+ 69923us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":212,"spinlock_wait_cycles":594419072}
I20260709 14:53:17.135260 13614 leader_election.cc:290] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:17.033066 13627 consensus_queue.cc:1048] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.104s
W20260709 14:53:17.139489 13740 consensus_meta.cc:287] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent flushing consensus metadata: real 0.707s	user 0.015s	sys 0.000s
I20260709 14:53:17.143436 13792 leader_election.cc:290] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:53:17.143769 13766 log.cc:927] Time spent T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 1.056s	user 0.008s	sys 0.008s
I20260709 14:53:17.120949 13794 raft_consensus.cc:2749] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 14:53:17.147230  7776 raft_consensus.cc:2410] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for term 23 because replica has last-logged OpId of term: 22 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 11.
I20260709 14:53:17.152432  7920 raft_consensus.cc:2468] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 13.
I20260709 14:53:17.083108 13783 leader_election.cc:290] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:17.157773  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:17.158102  7744 leader_election.cc:304] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:17.159807  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:17.160269  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:17.164613  7846 raft_consensus.cc:2468] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 13.
W20260709 14:53:17.164587  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:17.166654  7744 leader_election.cc:304] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:17.160230  7819 leader_election.cc:304] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:53:17.162719  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:17.167975  7919 raft_consensus.cc:3060] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 14:53:17.169612  7819 leader_election.cc:304] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:53:17.059943  7773 rpcz_store.cc:276] 0709 14:53:15.847566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:53:16.258539 (+410973us) service_pool.cc:224] Handling call
0709 14:53:16.281819 (+ 23280us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:53:16.289893 (+  8074us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:53:16.289933 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:53:16.299946 (+ 10013us) log.cc:844] Serialized 26 byte log entry
0709 14:53:16.423248 (+123302us) raft_consensus.cc:1645] Marking committed up to 13
0709 14:53:16.608404 (+185156us) log.cc:844] Serialized 14 byte log entry
0709 14:53:16.612188 (+  3784us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:53:16.612279 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:53:17.032750 (+420471us) raft_consensus.cc:1685] finished
0709 14:53:17.032774 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:53:17.032933 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11042,"prepare.queue_time_us":216580,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":50,"raft.queue_time_us":124290,"raft.run_cpu_time_us":263,"raft.run_wall_time_us":263,"thread_start_us":240233,"threads_started":2,"wal-append.queue_time_us":281458}
I20260709 14:53:17.171749  7744 leader_election.cc:304] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:17.040189 13500 raft_consensus.cc:493] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
W20260709 14:53:17.148788 13804 log.cc:927] Time spent T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.074s	user 0.002s	sys 0.000s
I20260709 14:53:17.187129  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:17.188776  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:17.190061  7854 raft_consensus.cc:2468] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 13.
I20260709 14:53:17.194625  7744 leader_election.cc:304] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:17.196023  7819 leader_election.cc:304] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:53:17.199612  7744 leader_election.cc:304] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:17.146533 13628 raft_consensus.cc:2749] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 14:53:17.198691  7894 leader_election.cc:304] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:17.161473 13617 raft_consensus.cc:493] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:17.170132 13729 raft_consensus.cc:493] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:17.213758 13627 raft_consensus.cc:2749] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 14:53:17.216107 13691 consensus_meta.cc:287] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent flushing consensus metadata: real 0.574s	user 0.012s	sys 0.000s
I20260709 14:53:17.209784  7894 leader_election.cc:304] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:17.204603 13783 raft_consensus.cc:2749] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 14:53:17.217491 13724 raft_consensus.cc:2804] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 14:53:17.201668 13797 log.cc:927] Time spent T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
I20260709 14:53:17.190872 13500 raft_consensus.cc:515] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:17.193805 13794 raft_consensus.cc:2749] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 14:53:17.218310 13724 raft_consensus.cc:493] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:17.219077 13781 raft_consensus.cc:2804] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 14:53:17.219668 13724 raft_consensus.cc:3060] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Advancing to term 20
I20260709 14:53:17.219961 13781 raft_consensus.cc:493] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:17.220427 13781 raft_consensus.cc:3060] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 14:53:17.190975 13614 raft_consensus.cc:493] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:17.114403 13771 raft_consensus.cc:515] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:17.234263  7927 raft_consensus.cc:2468] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 12.
I20260709 14:53:17.186288 13740 raft_consensus.cc:2749] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 14:53:17.224468  7894 leader_election.cc:304] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:17.203437 13775 raft_consensus.cc:493] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:17.208281 13629 raft_consensus.cc:2804] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 14:53:17.190246 13792 raft_consensus.cc:2749] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 14:53:17.237967  7744 leader_election.cc:304] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:17.238806  7919 raft_consensus.cc:2468] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 16.
I20260709 14:53:17.216753 13691 raft_consensus.cc:515] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:17.224545 13617 raft_consensus.cc:515] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:17.235100 13614 raft_consensus.cc:515] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:17.245944 13615 raft_consensus.cc:2804] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 14:53:17.246377 13798 log.cc:927] Time spent T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.144s	user 0.001s	sys 0.000s
I20260709 14:53:17.247007 13773 raft_consensus.cc:2804] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 14:53:17.247680 13687 raft_consensus.cc:3055] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 LEADER]: Stepping down as leader of term 13
I20260709 14:53:17.282428 13687 raft_consensus.cc:740] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:53:17.282984 13771 leader_election.cc:290] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:17.282266 13773 raft_consensus.cc:493] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:17.284096 13773 raft_consensus.cc:3060] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Advancing to term 17
I20260709 14:53:17.283632 13687 consensus_queue.cc:260] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:17.249445 13791 consensus_queue.cc:1059] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 14:53:17.285274 13736 leader_election.cc:290] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:17.285902 13791 raft_consensus.cc:3055] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 14:53:17.286362 13791 raft_consensus.cc:740] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:17.287918 13737 raft_consensus.cc:515] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:17.257115 13629 raft_consensus.cc:493] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:17.289738 13629 raft_consensus.cc:3060] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Advancing to term 17
I20260709 14:53:17.267246 13794 raft_consensus.cc:2749] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 14:53:17.231600 13729 raft_consensus.cc:515] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:17.288839 13615 raft_consensus.cc:493] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:17.263393 13775 raft_consensus.cc:515] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:17.264994  7744 leader_election.cc:304] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:53:17.327024  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 62188.9us
I20260709 14:53:17.328905  7744 leader_election.cc:304] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:53:17.330650  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 107250us
I20260709 14:53:17.287662 13617 leader_election.cc:290] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:53:17.343879  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 102170us
I20260709 14:53:17.339965  7744 leader_election.cc:304] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:17.325891 13687 raft_consensus.cc:3060] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Advancing to term 14
I20260709 14:53:17.341681  7819 leader_election.cc:304] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
W20260709 14:53:17.335325 13798 log.cc:927] Time spent T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 14:53:17.326283 13615 raft_consensus.cc:3060] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 14:53:17.353384  7894 leader_election.cc:304] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:17.339504 13628 raft_consensus.cc:2749] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 14:53:17.339205 13737 leader_election.cc:290] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:17.335451 13740 raft_consensus.cc:493] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:17.349030 13691 leader_election.cc:290] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:17.351725 13601 raft_consensus.cc:2804] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 14:53:17.355459 13783 raft_consensus.cc:2749] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 14:53:17.384575  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:17.384016  7775 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37136 (request call id 3079) took 1208 ms. Trace:
I20260709 14:53:17.356181 13693 raft_consensus.cc:2749] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 14:53:17.288043 13791 consensus_queue.cc:260] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:17.380265 13801 raft_consensus.cc:2804] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 14:53:17.389022  7775 rpcz_store.cc:276] 0709 14:53:16.175855 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:53:16.709583 (+533728us) service_pool.cc:224] Handling call
0709 14:53:16.723947 (+ 14364us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:53:16.803682 (+ 79735us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:53:16.803720 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:53:16.804721 (+  1001us) log.cc:844] Serialized 26 byte log entry
0709 14:53:16.962076 (+157355us) raft_consensus.cc:1645] Marking committed up to 10
0709 14:53:16.997970 (+ 35894us) log.cc:844] Serialized 14 byte log entry
0709 14:53:17.019871 (+ 21901us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:53:17.019954 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:53:17.383670 (+363716us) raft_consensus.cc:1685] finished
0709 14:53:17.383695 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:53:17.383924 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":108557,"prepare.queue_time_us":35578,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":702,"raft.queue_time_us":133673,"raft.run_cpu_time_us":462,"raft.run_wall_time_us":13675,"thread_start_us":220820,"threads_started":2,"wal-append.queue_time_us":287816}
I20260709 14:53:17.358922 13627 consensus_queue.cc:1048] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 14:53:17.392714 13617 raft_consensus.cc:2749] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 14:53:17.409391 13773 raft_consensus.cc:515] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:17.397472 13801 raft_consensus.cc:493] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 14:53:17.442305  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 83927.9us
I20260709 14:53:17.444399  7819 leader_election.cc:304] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:53:17.445358 13813 raft_consensus.cc:2804] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 23 FOLLOWER]: Leader election won for term 23
I20260709 14:53:17.426546 13791 raft_consensus.cc:3060] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Advancing to term 15
I20260709 14:53:17.445895 13813 raft_consensus.cc:697] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 23 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:53:17.446872 13813 consensus_queue.cc:237] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:17.447651 13729 leader_election.cc:290] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:17.407684 13617 raft_consensus.cc:493] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:17.451529  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 21 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:17.451733  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:17.390981 13740 raft_consensus.cc:515] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:17.450851  7819 leader_election.cc:304] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:53:17.454789  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: true dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:17.455078  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:17.455797  7921 raft_consensus.cc:2468] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 19.
I20260709 14:53:17.485159  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:17.487269 13775 leader_election.cc:290] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:53:17.490904  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:17.493412 13724 raft_consensus.cc:515] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:17.495674 13724 leader_election.cc:290] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 20 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:17.489570 13609 raft_consensus.cc:493] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:17.450378 13801 raft_consensus.cc:3060] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 14:53:17.497762 13614 leader_election.cc:290] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:17.501384  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:17.503154 13773 leader_election.cc:290] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 17 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:17.489741 13815 raft_consensus.cc:493] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:17.497905 13609 raft_consensus.cc:515] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:17.502064 13775 raft_consensus.cc:2804] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Leader election won for term 19
W20260709 14:53:17.506263  7894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:17.507218 13609 leader_election.cc:290] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:17.424947 13690 consensus_queue.cc:1048] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.065s
I20260709 14:53:17.505264 13815 raft_consensus.cc:515] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:17.502453  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:17.516130  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:53:17.620289  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 137325us
I20260709 14:53:17.420162 13781 raft_consensus.cc:515] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:17.514993 13609 raft_consensus.cc:493] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:17.663291  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:17.663677 13609 raft_consensus.cc:515] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:17.643028 13740 leader_election.cc:290] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:17.650357 13500 leader_election.cc:290] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:17.661075 13629 raft_consensus.cc:515] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:17.662281  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:17.633687 13729 raft_consensus.cc:493] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:17.666893 13609 leader_election.cc:290] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:17.667424 13729 raft_consensus.cc:515] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:17.669441 13615 raft_consensus.cc:515] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:17.670105 13729 leader_election.cc:290] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:17.673025 13629 leader_election.cc:290] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 17 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:17.679015 13815 leader_election.cc:290] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:17.619843 13775 raft_consensus.cc:697] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:53:17.680780 13775 consensus_queue.cc:237] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:17.683432  7924 raft_consensus.cc:1275] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
W20260709 14:53:17.686878  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 65827.3us
I20260709 14:53:17.490731 13617 raft_consensus.cc:515] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:17.690653  7920 raft_consensus.cc:2468] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 15.
I20260709 14:53:17.692013  7924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38516 (request call id 3062) took 1082 ms. Trace:
I20260709 14:53:17.692827  7924 rpcz_store.cc:276] 0709 14:53:16.602025 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:53:16.602192 (+   167us) service_pool.cc:224] Handling call
0709 14:53:17.682841 (+1080649us) spinlock_profiling.cc:243] Waited 12.1 ms on lock 0x7b5800200198. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb687c29db1 00007fb687d69b71 00007fb687d69a22 00007fb690c82c09 00007fb68fddcee0 00007fb68fea60ab 00007fb68fea6131 00007fb68fe67fc0 00007fb68fe52929 00007fb68fe523d2 00007fb6893c9bd4
0709 14:53:17.683047 (+   206us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:53:17.684462 (+  1415us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:53:17.684701 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":27721600}
I20260709 14:53:17.699945  7848 raft_consensus.cc:1275] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 14:53:17.701710  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:17.691921 13678 consensus_queue.cc:1048] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.011s
I20260709 14:53:17.703904 13774 consensus_queue.cc:1048] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 14:53:17.706779 13777 log.cc:927] Time spent T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 1.130s	user 0.001s	sys 0.004s
I20260709 14:53:17.711418 13781 leader_election.cc:290] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 18 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:17.714272  7819 leader_election.cc:304] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:17.715708  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:17.706480 13615 leader_election.cc:290] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 17 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:17.714742 13773 consensus_queue.cc:1048] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.005s
I20260709 14:53:17.721503 13617 leader_election.cc:290] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:17.710011 13774 raft_consensus.cc:493] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:53:17.724603  7770 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37144 (request call id 3905) took 1872 ms (client timeout 2183 ms). Trace:
I20260709 14:53:17.731362 13601 raft_consensus.cc:493] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Starting leader election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:53:17.732420 13601 raft_consensus.cc:3060] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Advancing to term 19
W20260709 14:53:17.738734 13785 log.cc:927] Time spent T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.992s	user 0.006s	sys 0.000s
W20260709 14:53:17.729014  7770 rpcz_store.cc:269] 0709 14:53:15.851875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:53:16.132266 (+280391us) service_pool.cc:224] Handling call
0709 14:53:17.724321 (+1592055us) spinlock_profiling.cc:243] Waited 152 ms on lock 0x7b54001d01d4. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae922fa 00007fb68fe53b17 00007fb6893ce6d4 00007fb6893ce662 00007fb6893ce591 00007fb6893ce50c 00007fb6893cd7c2 00007fb6891c948c 00007fb6891c88c6 00007fb6891c826f
0709 14:53:17.724478 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":348695808}
I20260709 14:53:17.740598  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:17.740707 13617 raft_consensus.cc:2804] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Leader election won for term 13
I20260709 14:53:17.742471 13769 raft_consensus.cc:3060] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Advancing to term 19
I20260709 14:53:17.742971 13774 raft_consensus.cc:515] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:17.747869  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:17.742524 13617 raft_consensus.cc:697] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:53:17.749646 13617 consensus_queue.cc:237] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:17.754441  7776 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37144 (request call id 3899) took 1904 ms. Trace:
I20260709 14:53:17.754906  7776 rpcz_store.cc:276] 0709 14:53:15.849771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:53:16.182922 (+333151us) service_pool.cc:224] Handling call
0709 14:53:17.754161 (+1571239us) spinlock_profiling.cc:243] Waited 937 ms on lock 0x7b540037d554. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae922fa 00007fb68fe53b17 00007fb6893ce6d4 00007fb6893ce662 00007fb6893ce591 00007fb6893ce50c 00007fb6893cd7c2 00007fb6891c948c 00007fb6891c88c6 00007fb6891c826f
0709 14:53:17.754363 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2155442944}
I20260709 14:53:17.756145  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:17.757097  7845 raft_consensus.cc:3060] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Advancing to term 17
I20260709 14:53:17.758921  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:17.759584  7852 raft_consensus.cc:3060] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Advancing to term 18
I20260709 14:53:17.756361  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:17.763187  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:17.748651  7923 raft_consensus.cc:2468] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 13.
I20260709 14:53:17.764760  7923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38516 (request call id 3061) took 1163 ms. Trace:
I20260709 14:53:17.762060 13801 raft_consensus.cc:515] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:17.765053  7923 rpcz_store.cc:276] 0709 14:53:16.601109 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:53:16.610120 (+  9011us) service_pool.cc:224] Handling call
0709 14:53:17.747695 (+1137575us) spinlock_profiling.cc:243] Waited 5 ms on lock 0x7b5800200198. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb687c29db1 00007fb687d69b71 00007fb687d69a22 00007fb690c82c09 00007fb68fddcee0 00007fb68fea60ab 00007fb68fea6131 00007fb68fe540a0 00007fb68fe53984 00007fb6893ce6d4 00007fb6893ce662
0709 14:53:17.764675 (+ 16980us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11510016}
I20260709 14:53:17.768404  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:17.769287  7922 raft_consensus.cc:1275] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
W20260709 14:53:17.770556  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:17.772151  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:17.773228  7852 raft_consensus.cc:2468] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 18.
I20260709 14:53:17.743602  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c563cc7cfbe4d59be4ffc5cf847ce56" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: true dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:17.774574  7770 raft_consensus.cc:3060] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [term 11 FOLLOWER]: Advancing to term 12
I20260709 14:53:17.777155  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:17.777956  7921 raft_consensus.cc:2468] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 17.
I20260709 14:53:17.778187  7919 raft_consensus.cc:1275] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 14:53:17.777021  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:17.779125  7923 raft_consensus.cc:2468] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 13.
I20260709 14:53:17.781023  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:17.796264  7924 raft_consensus.cc:2393] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 17: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:53:17.783458  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:17.797109  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:17.798040  7925 raft_consensus.cc:2468] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 15.
I20260709 14:53:17.798820  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:17.799178  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:17.799458  7924 raft_consensus.cc:3060] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 14:53:17.793557  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:17.800666  7893 leader_election.cc:304] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:17.797825  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:17.802722  7925 raft_consensus.cc:2393] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 18: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:53:17.805008  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 20 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:17.816113  7921 raft_consensus.cc:2468] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 16.
I20260709 14:53:17.806576  7772 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37136 (request call id 3084) took 1629 ms. Trace:
I20260709 14:53:17.806890  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:17.807471  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:17.808532  7926 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38532 (request call id 3872) took 1650 ms. Trace:
W20260709 14:53:17.809880  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:17.810565  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:17.818284  7845 raft_consensus.cc:2468] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 17.
I20260709 14:53:17.811655  7779 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 3891) took 1959 ms. Trace:
I20260709 14:53:17.746011 13774 leader_election.cc:290] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:17.815312  7770 raft_consensus.cc:2468] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 12.
I20260709 14:53:17.811774  7819 leader_election.cc:304] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:17.819970  7922 raft_consensus.cc:2393] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 14: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:53:17.821043  7778 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 3893) took 1973 ms. Trace:
I20260709 14:53:17.821496  7819 leader_election.cc:304] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:17.818071  7926 rpcz_store.cc:276] 0709 14:53:16.158372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:53:16.158785 (+   413us) service_pool.cc:224] Handling call
0709 14:53:16.159232 (+   447us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:53:16.280160 (+120928us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:53:16.280196 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:53:16.280711 (+   515us) log.cc:844] Serialized 26 byte log entry
0709 14:53:16.410254 (+129543us) raft_consensus.cc:1645] Marking committed up to 11
0709 14:53:16.410308 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:53:17.803283 (+1392975us) spinlock_profiling.cc:243] Waited 120 ms on lock 0x7b54000fa354. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae8ee01 00007fb68ae8d83e 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2 00007fb6891c948c 00007fb6891c88c6
0709 14:53:17.803350 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:53:17.803407 (+    57us) raft_consensus.cc:1685] finished
0709 14:53:17.803421 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:53:17.808443 (+  5022us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":833,"raft.run_cpu_time_us":232,"raft.run_wall_time_us":8805,"spinlock_wait_cycles":276842240,"thread_start_us":113633,"threads_started":1,"wal-append.queue_time_us":308559}
I20260709 14:53:17.817062  7772 rpcz_store.cc:276] 0709 14:53:16.177121 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:53:17.267967 (+1090846us) service_pool.cc:224] Handling call
0709 14:53:17.268698 (+   731us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:53:17.269201 (+   503us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:53:17.269235 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:53:17.274728 (+  5493us) log.cc:844] Serialized 26 byte log entry
0709 14:53:17.339923 (+ 65195us) raft_consensus.cc:1645] Marking committed up to 11
0709 14:53:17.364760 (+ 24837us) log.cc:844] Serialized 14 byte log entry
0709 14:53:17.381960 (+ 17200us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:53:17.382075 (+   115us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:53:17.655494 (+273419us) spinlock_profiling.cc:243] Waited 4.57 ms on lock 0x7b1800306d00. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb690c69de1 00007fb690c765b1 00007fb687da13f3 00007fb687da37c1 00007fb687da3779 00007fb687da3709 00007fb687da36d1 00007fb687da29cd 0000000000396ad4 0000000000396919 00007fb687d8483a
0709 14:53:17.804271 (+148777us) raft_consensus.cc:1685] finished
0709 14:53:17.806331 (+  2060us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:53:17.806494 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11582,"prepare.queue_time_us":30477,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":48,"raft.queue_time_us":12579,"raft.run_cpu_time_us":527,"raft.run_wall_time_us":10218,"spinlock_wait_cycles":15901824,"thread_start_us":49866,"threads_started":1,"wal-append.queue_time_us":95832}
I20260709 14:53:17.818717  7927 raft_consensus.cc:2393] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 17: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:53:17.823180  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: true dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:17.823030  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783e4874513449ef9084b833f188a6d3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:17.824139  7770 raft_consensus.cc:3060] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Advancing to term 15
I20260709 14:53:17.821496  7778 rpcz_store.cc:276] 0709 14:53:15.847812 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:53:16.310697 (+462885us) service_pool.cc:224] Handling call
0709 14:53:16.311196 (+   499us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:53:16.316323 (+  5127us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:53:16.316363 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:53:16.355591 (+ 39228us) log.cc:844] Serialized 26 byte log entry
0709 14:53:16.479310 (+123719us) raft_consensus.cc:1645] Marking committed up to 8
0709 14:53:16.706686 (+227376us) log.cc:844] Serialized 14 byte log entry
0709 14:53:16.729797 (+ 23111us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:53:16.729895 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:53:17.737571 (+1007676us) spinlock_profiling.cc:243] Waited 26.3 ms on lock 0x7b4400022b4c. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb687c29db1 00007fb687cc7c85 00007fb687cc86a2 00007fb68aa3a1db 00007fb68aa35aaf 00007fb68aa2986e 00007fb68aa28bb6 00007fb68aa287d8 00007fb68aa32221 00007fb68aa321d9 00007fb68aa32169
0709 14:53:17.807592 (+ 70021us) raft_consensus.cc:1685] finished
0709 14:53:17.820811 (+ 13219us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:53:17.820973 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":131032,"prepare.queue_time_us":217185,"prepare.run_cpu_time_us":102,"prepare.run_wall_time_us":6056,"raft.queue_time_us":112583,"raft.run_cpu_time_us":388,"raft.run_wall_time_us":16059,"spinlock_wait_cycles":60474112,"thread_start_us":158821,"threads_started":2,"wal-append.queue_time_us":297385}
I20260709 14:53:17.827826  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:17.818974  7779 rpcz_store.cc:276] 0709 14:53:15.847304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:53:16.250854 (+403550us) service_pool.cc:224] Handling call
0709 14:53:16.271369 (+ 20515us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:53:16.402739 (+131370us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:53:16.402771 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:53:16.406526 (+  3755us) log.cc:844] Serialized 26 byte log entry
0709 14:53:16.999417 (+592891us) raft_consensus.cc:1645] Marking committed up to 9
0709 14:53:17.029575 (+ 30158us) log.cc:844] Serialized 14 byte log entry
0709 14:53:17.030111 (+   536us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:53:17.803928 (+773817us) spinlock_profiling.cc:243] Waited 131 ms on lock 0x7b54002562d4. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae8ee01 00007fb68ae8d83e 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2 00007fb6891c948c 00007fb6891c88c6
0709 14:53:17.803983 (+    55us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:53:17.804034 (+    51us) raft_consensus.cc:1685] finished
0709 14:53:17.806447 (+  2413us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:53:17.806579 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19418,"prepare.queue_time_us":75615,"prepare.run_cpu_time_us":92,"prepare.run_wall_time_us":92,"raft.queue_time_us":6461,"raft.run_cpu_time_us":403,"raft.run_wall_time_us":21697,"spinlock_wait_cycles":300751616,"thread_start_us":534058,"threads_started":1,"wal-append.queue_time_us":694567}
I20260709 14:53:17.828872  7778 raft_consensus.cc:2468] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 18.
I20260709 14:53:17.829813  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:17.830320  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:17.830818  7772 raft_consensus.cc:2468] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 21.
I20260709 14:53:17.832729  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:17.832909  7770 raft_consensus.cc:2468] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 15.
I20260709 14:53:17.833616  7778 raft_consensus.cc:2393] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 17: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:53:17.836777  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:17.832890  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:17.837990  7772 raft_consensus.cc:2468] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 17.
W20260709 14:53:17.830646 13752 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.369s	user 0.025s	sys 0.021s
I20260709 14:53:17.840555  7893 leader_election.cc:304] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:17.838850  7819 leader_election.cc:304] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:17.835057 13609 raft_consensus.cc:2749] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 14:53:17.845944 13603 raft_consensus.cc:2804] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 14:53:17.850975  7819 leader_election.cc:304] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:53:17.835489 13813 raft_consensus.cc:2804] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Leader election won for term 16
I20260709 14:53:17.850068  7894 leader_election.cc:304] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:17.835621 13774 raft_consensus.cc:2804] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader election won for term 12
W20260709 14:53:17.842859 13752 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.387s	user 0.026s	sys 0.021s
I20260709 14:53:17.858646  7924 raft_consensus.cc:2468] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 18.
I20260709 14:53:17.860994 13826 consensus_queue.cc:1048] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 14:53:17.862377 13773 raft_consensus.cc:2804] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 14:53:17.880409 13773 raft_consensus.cc:493] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:17.880965 13773 raft_consensus.cc:3060] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Advancing to term 13
I20260709 14:53:17.884239 13735 raft_consensus.cc:3055] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 LEADER]: Stepping down as leader of term 18
I20260709 14:53:17.884915 13735 raft_consensus.cc:740] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:53:17.854126 13603 raft_consensus.cc:493] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:17.872150  7771 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37136 (request call id 3081) took 1695 ms. Trace:
I20260709 14:53:17.874559  7774 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37136 (request call id 3082) took 1697 ms. Trace:
I20260709 14:53:17.834095 13692 raft_consensus.cc:3055] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 LEADER]: Stepping down as leader of term 17
I20260709 14:53:17.863729 13801 leader_election.cc:290] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:17.892584  7774 rpcz_store.cc:276] 0709 14:53:16.176623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:53:17.144174 (+967551us) service_pool.cc:224] Handling call
0709 14:53:17.144571 (+   397us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 14:53:17.145038 (+   467us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:53:17.145067 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 14:53:17.145740 (+   673us) log.cc:844] Serialized 52 byte log entry
0709 14:53:17.352729 (+206989us) raft_consensus.cc:1645] Marking committed up to 11
0709 14:53:17.389945 (+ 37216us) log.cc:844] Serialized 14 byte log entry
0709 14:53:17.873959 (+484014us) log.cc:844] Serialized 14 byte log entry
0709 14:53:17.874176 (+   217us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:53:17.874259 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:53:17.874304 (+    45us) raft_consensus.cc:1685] finished
0709 14:53:17.874316 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:53:17.874466 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":948149,"prepare.queue_time_us":40128,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":81,"raft.queue_time_us":522005,"raft.run_cpu_time_us":208,"raft.run_wall_time_us":20023,"thread_start_us":206508,"threads_started":1,"wal-append.queue_time_us":252933}
I20260709 14:53:17.894800  7773 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37136 (request call id 3083) took 1717 ms. Trace:
I20260709 14:53:17.890347  7771 rpcz_store.cc:276] 0709 14:53:16.176394 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:53:17.130320 (+953926us) service_pool.cc:224] Handling call
0709 14:53:17.131003 (+   683us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:53:17.131537 (+   534us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 14:53:17.132065 (+   528us) log.cc:844] Serialized 14 byte log entry
0709 14:53:17.303031 (+170966us) log.cc:844] Serialized 14 byte log entry
0709 14:53:17.371374 (+ 68343us) log.cc:844] Serialized 14 byte log entry
0709 14:53:17.375081 (+  3707us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:53:17.375824 (+   743us) log.cc:844] Serialized 26 byte log entry
0709 14:53:17.376016 (+   192us) raft_consensus.cc:1645] Marking committed up to 9
0709 14:53:17.378982 (+  2966us) log.cc:844] Serialized 14 byte log entry
0709 14:53:17.749187 (+370205us) spinlock_profiling.cc:243] Waited 7.53 ms on lock 0x7b1800160a20. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb690c69de1 00007fb690c765b1 00007fb687da13f3 00007fb687da37c1 00007fb687da3779 00007fb687da3709 00007fb687da36d1 00007fb687da29cd 0000000000396ad4 0000000000396919 00007fb687d8483a
0709 14:53:17.871368 (+122181us) spinlock_profiling.cc:243] Waited 2.96 ms on lock 0x7b1800160a20. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb690c69de1 00007fb690c765b1 00007fb687d1bc0a 00007fb69145b219 00007fb687da3a40 00007fb687d9e4e4 00007fb687d9e455 00007fb68ae86060 00007fb68ae98716 00007fb68aea9287 00007fb68aea9208
0709 14:53:17.871702 (+   334us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:53:17.871822 (+   120us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:53:17.871872 (+    50us) raft_consensus.cc:1685] finished
0709 14:53:17.871886 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:53:17.872072 (+   186us) inbound_call.cc:177] Queueing success response
0709 14:53:17.873623 (+  1551us) spinlock_profiling.cc:243] Waited 1.84 ms on lock 0x7b1800160a20. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb690c69de1 00007fb690c765b1 00007fb687da1522 00007fb687da37c1 00007fb687da3779 00007fb687da3709 00007fb687da36d1 00007fb687da29cd 0000000000396ad4 0000000000396919 00007fb687d8483a
Metrics: {"mutex_wait_us":548571,"prepare.queue_time_us":522002,"prepare.run_cpu_time_us":225,"prepare.run_wall_time_us":2937,"raft.queue_time_us":571432,"raft.run_cpu_time_us":917,"raft.run_wall_time_us":9726,"spinlock_wait_cycles":28364032,"thread_start_us":168614,"threads_started":1,"wal-append.queue_time_us":255329}
W20260709 14:53:17.905550  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 65050.9us
I20260709 14:53:17.906673  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:17.907617  7771 raft_consensus.cc:2468] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 19.
I20260709 14:53:17.904695  7773 rpcz_store.cc:276] 0709 14:53:16.176859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:53:17.194337 (+1017478us) service_pool.cc:224] Handling call
0709 14:53:17.220172 (+ 25835us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:53:17.220629 (+   457us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:53:17.220662 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:53:17.233123 (+ 12461us) log.cc:844] Serialized 26 byte log entry
0709 14:53:17.382109 (+148986us) raft_consensus.cc:1645] Marking committed up to 10
0709 14:53:17.400733 (+ 18624us) log.cc:844] Serialized 14 byte log entry
0709 14:53:17.894427 (+493694us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:53:17.894518 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:53:17.894565 (+    47us) raft_consensus.cc:1685] finished
0709 14:53:17.894577 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:53:17.894736 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":496546,"prepare.queue_time_us":484180,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":49,"raft.queue_time_us":505657,"raft.run_cpu_time_us":227,"raft.run_wall_time_us":5274,"thread_start_us":123138,"threads_started":2,"wal-append.queue_time_us":227470}
I20260709 14:53:17.908823  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:17.912024  7771 raft_consensus.cc:2410] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for term 14 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 14:53:17.902277 13813 raft_consensus.cc:697] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:53:17.913650 13813 consensus_queue.cc:237] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:17.917634 13774 raft_consensus.cc:697] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:53:17.918006 13601 raft_consensus.cc:515] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:17.919026 13774 consensus_queue.cc:237] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:17.903143  7894 leader_election.cc:304] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:17.924760  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:17.926481  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:17.929512  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:17.933487  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:17.934333  7771 raft_consensus.cc:2468] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 21.
I20260709 14:53:17.935889  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:17.936108  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:17.937711  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:17.937032  7920 raft_consensus.cc:1275] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 14:53:17.938656  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:17.938587  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:17.931357  7774 raft_consensus.cc:2468] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 18.
I20260709 14:53:17.939723  7924 raft_consensus.cc:2368] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 17. Current term is 18.
I20260709 14:53:17.940542  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:17.940704  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:17.941300  7774 raft_consensus.cc:2468] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 15.
I20260709 14:53:17.941713  7771 raft_consensus.cc:2376] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 18. Re-sending same reply.
I20260709 14:53:17.942641  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:17.942950  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:17.944835  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:17.945827  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:17.946229  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:17.947382  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:17.947889  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:17.948606  7774 raft_consensus.cc:2468] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 16.
I20260709 14:53:17.949658  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:17.949648  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:17.951251  7774 raft_consensus.cc:2376] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 18. Re-sending same reply.
I20260709 14:53:17.952437  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:17.952457  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:17.955052  7771 raft_consensus.cc:2393] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 18: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:53:17.897387 13603 raft_consensus.cc:3060] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Advancing to term 20
I20260709 14:53:17.953212  7774 raft_consensus.cc:2468] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 18.
I20260709 14:53:17.937022  7893 leader_election.cc:304] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:17.893934 13692 raft_consensus.cc:740] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:53:17.963301  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:17.966902  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:17.925068 13815 raft_consensus.cc:2804] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 14:53:17.925704 13795 raft_consensus.cc:493] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:17.974591  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:17.976696  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:17.977134  7771 raft_consensus.cc:2468] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 14.
I20260709 14:53:17.978413  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:17.981652  7928 raft_consensus.cc:2468] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 17.
I20260709 14:53:17.983769  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:17.984490  7771 raft_consensus.cc:3060] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Advancing to term 19
I20260709 14:53:17.988211  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:17.989066  7774 raft_consensus.cc:3060] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Advancing to term 20
I20260709 14:53:17.994451  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:17.924741 13771 consensus_queue.cc:1048] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.057s
I20260709 14:53:17.928325 13731 consensus_queue.cc:1048] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.071s
I20260709 14:53:17.966576 13500 raft_consensus.cc:2804] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 14:53:18.013386  7819 leader_election.cc:304] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:18.022480  6549 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 14:53:17.987285 13675 consensus_queue.cc:1048] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 14:53:17.956781 13791 consensus_queue.cc:1048] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.058s
I20260709 14:53:18.064519  7771 raft_consensus.cc:2468] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 19.
I20260709 14:53:17.963333 13799 consensus_queue.cc:1048] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.055s
I20260709 14:53:18.070771  7745 leader_election.cc:304] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:17.967226 13679 consensus_queue.cc:1048] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.052s
I20260709 14:53:18.071017 13739 raft_consensus.cc:493] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9418391fa82a42c79c6cad13ba91d964)
I20260709 14:53:18.070740  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:18.019658 13724 raft_consensus.cc:2749] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 14:53:18.085553  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 115402us
I20260709 14:53:18.089160  7847 raft_consensus.cc:2468] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 19.
I20260709 14:53:18.080571  7771 raft_consensus.cc:2468] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 18.
I20260709 14:53:18.092031  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:18.093048  7771 raft_consensus.cc:2368] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 17. Current term is 18.
I20260709 14:53:18.020979 13829 raft_consensus.cc:493] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:17.993340 13690 consensus_queue.cc:1048] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.073s
I20260709 14:53:18.080928  7774 raft_consensus.cc:2468] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 20.
W20260709 14:53:18.076862  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 139922us
I20260709 14:53:18.094167  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:18.007802 13673 consensus_queue.cc:1048] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.070s
I20260709 14:53:17.998984 13795 raft_consensus.cc:515] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:18.108924  7893 leader_election.cc:304] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:18.073730 13500 raft_consensus.cc:697] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:18.112738  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:18.080386 13630 raft_consensus.cc:2749] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 14:53:18.162416  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 58067.9us
W20260709 14:53:18.162691  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 53847.5us
I20260709 14:53:18.166589  7774 raft_consensus.cc:2393] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 19: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:53:17.993762 13735 consensus_queue.cc:260] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:18.083078 13750 raft_consensus.cc:493] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:53:18.087114 13792 raft_consensus.cc:493] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:18.107246 13737 raft_consensus.cc:2804] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 14:53:18.168839  7893 leader_election.cc:304] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:18.179637  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:18.110471 13628 raft_consensus.cc:493] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:18.194977  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:18.086674 13739 raft_consensus.cc:515] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
W20260709 14:53:18.202862  8598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 204653us
I20260709 14:53:18.073437 13692 consensus_queue.cc:260] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:18.214812 13787 raft_consensus.cc:493] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9418391fa82a42c79c6cad13ba91d964)
I20260709 14:53:18.215752 13787 raft_consensus.cc:515] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:53:18.217926 13615 raft_consensus.cc:2749] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 14:53:18.221982 13500 consensus_queue.cc:237] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:18.227918 13692 raft_consensus.cc:3060] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Advancing to term 18
I20260709 14:53:18.112113 13829 raft_consensus.cc:515] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:18.232751 13829 leader_election.cc:290] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:53:18.209885 13814 log.cc:927] Time spent T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 14:53:18.239504 13795 leader_election.cc:290] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:18.185902 13815 raft_consensus.cc:697] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
W20260709 14:53:18.244094  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 75730.2us
I20260709 14:53:18.180647 13737 raft_consensus.cc:493] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:18.246539  7893 leader_election.cc:304] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:18.188244 13770 raft_consensus.cc:2804] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 14:53:18.274593  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:18.198447 13735 raft_consensus.cc:3060] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Advancing to term 19
I20260709 14:53:18.286554  7893 leader_election.cc:304] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:18.292948  7774 raft_consensus.cc:2468] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 17.
I20260709 14:53:18.184105 13792 raft_consensus.cc:515] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:18.176797 13750 raft_consensus.cc:515] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:18.299878  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:18.221222 13615 raft_consensus.cc:493] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:18.322072  7774 raft_consensus.cc:2468] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 16.
I20260709 14:53:18.268760 13737 raft_consensus.cc:3060] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Advancing to term 14
W20260709 14:53:18.330641  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:18.278293 13770 raft_consensus.cc:493] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:18.200441 13628 raft_consensus.cc:515] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:18.345654  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
W20260709 14:53:18.349756  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 59449.3us
W20260709 14:53:18.374752  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 88265.6us
I20260709 14:53:18.376026  7774 raft_consensus.cc:2393] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 18: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:53:18.375916  7771 raft_consensus.cc:2468] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 13.
I20260709 14:53:18.376484  7893 leader_election.cc:304] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:53:18.374675  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 350107us
I20260709 14:53:18.294690 13731 raft_consensus.cc:2804] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 14:53:18.381611  7847 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49946 (request call id 4673) took 1244 ms. Trace:
I20260709 14:53:18.283859 13841 raft_consensus.cc:3060] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 14:53:18.385757  7847 rpcz_store.cc:276] 0709 14:53:17.119886 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:53:17.120093 (+   207us) service_pool.cc:224] Handling call
0709 14:53:18.363801 (+1243708us) spinlock_profiling.cc:243] Waited 965 ms on lock 0x7b540020e9d4. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae922fa 00007fb68fe53b17 00007fb6893ce6d4 00007fb6893ce662 00007fb6893ce591 00007fb6893ce50c 00007fb6893cd7c2 00007fb6891c948c 00007fb6891c88c6 00007fb6891c826f
0709 14:53:18.364037 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2220129536}
I20260709 14:53:18.379321  7819 leader_election.cc:304] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
W20260709 14:53:18.373314 13847 log.cc:927] Time spent T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
W20260709 14:53:18.432253  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 56723.4us
I20260709 14:53:18.430222  7819 leader_election.cc:304] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:18.374330 13770 raft_consensus.cc:3060] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Advancing to term 16
W20260709 14:53:18.440478  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 64050.5us
I20260709 14:53:18.441751  7893 leader_election.cc:304] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:18.384740 13771 raft_consensus.cc:3060] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Advancing to term 19
I20260709 14:53:18.443149  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:18.450400  7819 leader_election.cc:304] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:18.385326 13731 raft_consensus.cc:493] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:18.435110 13812 raft_consensus.cc:2804] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Leader election won for term 15
I20260709 14:53:18.457463  7893 leader_election.cc:304] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:18.341919 13615 raft_consensus.cc:515] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:18.445716 13690 raft_consensus.cc:2764] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 14:53:18.489838  7819 leader_election.cc:304] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:18.478319 13731 raft_consensus.cc:3060] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Advancing to term 22
I20260709 14:53:18.481878 13821 raft_consensus.cc:2804] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 14:53:18.513509 13821 raft_consensus.cc:493] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:18.514035 13821 raft_consensus.cc:3060] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Advancing to term 22
I20260709 14:53:18.517515 13823 raft_consensus.cc:2749] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 14:53:18.491609 13614 raft_consensus.cc:2749] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 14:53:18.349188 13815 consensus_queue.cc:237] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:18.503654  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:18.500972  7893 leader_election.cc:304] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:18.510679 13628 leader_election.cc:290] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:18.522833  7819 leader_election.cc:304] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:18.524350  7773 raft_consensus.cc:2393] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 18: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
W20260709 14:53:18.495364 13840 log.cc:927] Time spent T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 14:53:18.531399  7893 leader_election.cc:304] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:18.536230  7893 leader_election.cc:304] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:18.503295 13812 raft_consensus.cc:697] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
W20260709 14:53:18.527158 13833 log.cc:927] Time spent T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.354s	user 0.000s	sys 0.001s
I20260709 14:53:18.547041 13812 consensus_queue.cc:237] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:18.542546  7819 leader_election.cc:400] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 17 election: Vote denied by peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587) with higher term. Message: Invalid argument: T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 17. Current term is 18.
I20260709 14:53:18.544198 13843 raft_consensus.cc:2804] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 14:53:18.548942  7819 leader_election.cc:403] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 14:53:18.506326 13787 leader_election.cc:290] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68:42321)
W20260709 14:53:18.544991 13846 log.cc:927] Time spent T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 14:53:18.545779 13792 leader_election.cc:290] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:18.560210  7893 leader_election.cc:304] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:18.548524 13843 raft_consensus.cc:493] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:18.529963 13690 raft_consensus.cc:2804] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 14:53:18.589958  7893 leader_election.cc:304] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:53:18.586886  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 51741.6us
I20260709 14:53:18.598183  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:18.598956  7773 raft_consensus.cc:2468] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 17.
I20260709 14:53:18.600513  7847 raft_consensus.cc:1275] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 14:53:18.600278  7893 leader_election.cc:304] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:18.601675  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:18.602968  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:18.548722 13601 leader_election.cc:290] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 19 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:18.593865 13852 raft_consensus.cc:2749] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 14:53:18.595676  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:18.606717  7778 raft_consensus.cc:2468] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 18.
I20260709 14:53:18.607424  7893 leader_election.cc:304] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:18.608263  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258d6c2dda954bf5b65930fde8ecb9f3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:18.609519 13823 raft_consensus.cc:2749] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 14:53:18.596052 13844 raft_consensus.cc:2804] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 14:53:18.611128 13844 raft_consensus.cc:493] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:18.611728 13844 raft_consensus.cc:3060] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Advancing to term 19
I20260709 14:53:18.591799 13614 raft_consensus.cc:2804] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 14:53:18.596370  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:18.614560  7779 raft_consensus.cc:2376] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 17. Re-sending same reply.
I20260709 14:53:18.615775  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258d6c2dda954bf5b65930fde8ecb9f3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:18.613780 13614 raft_consensus.cc:493] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:18.617817 13614 raft_consensus.cc:3060] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 14:53:18.534029 13692 raft_consensus.cc:493] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:53:18.617074  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:18.730121  7779 raft_consensus.cc:2393] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 17: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:53:18.634595  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:18.731745  7849 raft_consensus.cc:2393] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 18: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:53:18.636320  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:18.639539 13750 leader_election.cc:290] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:18.598455 13739 leader_election.cc:290] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785), 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68:42321)
I20260709 14:53:18.598977 13690 raft_consensus.cc:493] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:18.653808  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 21 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:18.588182 13843 raft_consensus.cc:3060] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Advancing to term 19
I20260709 14:53:18.678213 13849 raft_consensus.cc:2749] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 14:53:18.679283  7893 leader_election.cc:304] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:18.681198  7775 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37136 (request call id 3086) took 2500 ms. Trace:
I20260709 14:53:18.681604  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:18.684237  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:18.684719 13615 leader_election.cc:290] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:18.599920 13570 raft_consensus.cc:3060] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Advancing to term 18
W20260709 14:53:18.694237 13842 log.cc:927] Time spent T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.190s	user 0.000s	sys 0.001s
I20260709 14:53:18.659365 13835 raft_consensus.cc:2749] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 14:53:18.658646 13848 raft_consensus.cc:2749] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 14:53:18.700461  8599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 212296us
W20260709 14:53:18.710740  7742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:18.609138  7778 raft_consensus.cc:2376] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 15. Re-sending same reply.
I20260709 14:53:18.733487  7848 raft_consensus.cc:2393] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 17: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:53:18.737006  7772 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37136 (request call id 3089) took 1020 ms. Trace:
I20260709 14:53:18.711690 13783 raft_consensus.cc:493] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:18.749047  7770 raft_consensus.cc:2410] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for term 13 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 14:53:18.747565  7775 rpcz_store.cc:276] 0709 14:53:16.180665 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:53:17.398173 (+1217508us) service_pool.cc:224] Handling call
0709 14:53:17.449931 (+ 51758us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 14:53:17.896386 (+446455us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:53:17.896422 (+    36us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 14:53:17.921824 (+ 25402us) log.cc:844] Serialized 52 byte log entry
0709 14:53:18.163011 (+241187us) raft_consensus.cc:1645] Marking committed up to 11
0709 14:53:18.202703 (+ 39692us) log.cc:844] Serialized 14 byte log entry
0709 14:53:18.588505 (+385802us) spinlock_profiling.cc:243] Waited 2.9 ms on lock 0x7b18001b50e0. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb690c69de1 00007fb690c765b1 00007fb687d1bc0a 00007fb69145b219 00007fb687da3a40 00007fb687d9e4e4 00007fb687d9e455 00007fb68ae86060 00007fb68ae98716 00007fb68aea9287 00007fb68aea9208
0709 14:53:18.599075 (+ 10570us) log.cc:844] Serialized 14 byte log entry
0709 14:53:18.599289 (+   214us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:53:18.599374 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:53:18.680963 (+ 81589us) raft_consensus.cc:1685] finished
0709 14:53:18.680983 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:53:18.681138 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":556451,"prepare.queue_time_us":41107,"prepare.run_cpu_time_us":142,"prepare.run_wall_time_us":59605,"raft.queue_time_us":963119,"raft.run_cpu_time_us":424,"raft.run_wall_time_us":25494,"spinlock_wait_cycles":6752384,"thread_start_us":189649,"threads_started":1,"wal-append.queue_time_us":585813}
I20260709 14:53:18.787727  7772 rpcz_store.cc:276] 0709 14:53:17.716066 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:53:17.839042 (+122976us) service_pool.cc:224] Handling call
0709 14:53:17.839526 (+   484us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 14:53:17.979737 (+140211us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:53:17.979780 (+    43us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 14:53:17.980259 (+   479us) log.cc:844] Serialized 52 byte log entry
0709 14:53:18.164966 (+184707us) raft_consensus.cc:1645] Marking committed up to 6
0709 14:53:18.165014 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:53:18.165117 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:53:18.736754 (+571637us) raft_consensus.cc:1685] finished
0709 14:53:18.736777 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:53:18.736936 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":139529,"raft.queue_time_us":175643,"spinlock_wait_cycles":85555072,"thread_start_us":102349,"threads_started":1,"wal-append.queue_time_us":320614}
I20260709 14:53:18.750602 13731 raft_consensus.cc:515] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:18.715384 13693 raft_consensus.cc:493] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:18.722110 13740 raft_consensus.cc:493] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
W20260709 14:53:18.759285  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 80109.6us
W20260709 14:53:18.824862 13857 log.cc:927] Time spent T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.127s	user 0.000s	sys 0.002s
I20260709 14:53:18.732270 13628 raft_consensus.cc:493] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:18.791646  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:18.793637  8637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9441e831627143a991a1556dcdce71e3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9418391fa82a42c79c6cad13ba91d964" is_pre_election: true
W20260709 14:53:18.794275 13845 log.cc:927] Time spent T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.225s	user 0.001s	sys 0.000s
I20260709 14:53:18.800148  8640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce9c0ef2db24c13a8b1402f21819458" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9418391fa82a42c79c6cad13ba91d964" is_pre_election: true
I20260709 14:53:18.746904 13690 raft_consensus.cc:3060] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Advancing to term 15
I20260709 14:53:18.720108 13737 raft_consensus.cc:515] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:18.820947  7775 raft_consensus.cc:1275] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 9. (term mismatch)
I20260709 14:53:18.923166  7775 pending_rounds.cc:85] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed: Aborting all ops after (but not including) 8
I20260709 14:53:18.923540  7775 pending_rounds.cc:107] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed: Aborting uncommitted NO_OP operation due to leader change: 12.9
I20260709 14:53:18.923842  7775 raft_consensus.cc:2889] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:53:18.825664  7893 leader_election.cc:304] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:53:18.926061  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 100503us
I20260709 14:53:18.927498  7893 leader_election.cc:304] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:18.760906  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:18.829492 13693 raft_consensus.cc:515] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:18.830637  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9441e831627143a991a1556dcdce71e3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:18.831074 13863 raft_consensus.cc:493] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:18.822479  7772 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37136 (request call id 3095) took 1063 ms. Trace:
I20260709 14:53:18.753144 13739 raft_consensus.cc:493] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
W20260709 14:53:18.784646 13773 consensus_meta.cc:287] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent flushing consensus metadata: real 0.897s	user 0.016s	sys 0.000s
I20260709 14:53:18.851440  7778 raft_consensus.cc:2393] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 19: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:53:18.852187  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:18.782734 13849 raft_consensus.cc:2749] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 14:53:18.820600 13603 consensus_meta.cc:287] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent flushing consensus metadata: real 0.831s	user 0.014s	sys 0.001s
W20260709 14:53:18.839064 13500 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.597s	user 0.006s	sys 0.049s
I20260709 14:53:18.746053 13692 raft_consensus.cc:515] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:18.801221 13829 raft_consensus.cc:493] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:18.933916  7893 leader_election.cc:304] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:18.821606 13752 raft_consensus.cc:493] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
W20260709 14:53:18.963235  7921 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.769s	user 0.052s	sys 0.089s
I20260709 14:53:18.946424  7772 rpcz_store.cc:276] 0709 14:53:17.758634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:53:18.811114 (+1052480us) service_pool.cc:224] Handling call
0709 14:53:18.821822 (+ 10708us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:53:18.822072 (+   250us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:53:18.822100 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:53:18.822148 (+    48us) raft_consensus.cc:1645] Marking committed up to 12
0709 14:53:18.822180 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:53:18.822238 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:53:18.822385 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 14:53:18.838641 13787 raft_consensus.cc:493] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
W20260709 14:53:18.955319  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:18.846879 13795 raft_consensus.cc:493] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:18.958899  7778 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37144 (request call id 3939) took 1100 ms. Trace:
I20260709 14:53:18.959811  7779 raft_consensus.cc:2410] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for term 16 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 14:53:18.846405 13801 raft_consensus.cc:493] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:18.824746 13740 raft_consensus.cc:515] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:18.965063  7774 raft_consensus.cc:2393] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 14: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:53:19.002869  7819 leader_election.cc:400] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 17 election: Vote denied by peer 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785) with higher term. Message: Invalid argument: T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 17. Current term is 18.
I20260709 14:53:18.836582 13783 raft_consensus.cc:515] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:18.924768  7775 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37136 (request call id 3094) took 1166 ms. Trace:
I20260709 14:53:19.008085  7779 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37144 (request call id 3937) took 1150 ms. Trace:
I20260709 14:53:18.965998 13603 raft_consensus.cc:515] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:53:18.966038 13500 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.724s	user 0.006s	sys 0.050s
I20260709 14:53:18.966722 13697 raft_consensus.cc:493] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:18.975275 13754 raft_consensus.cc:2804] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 14:53:18.969204  7893 leader_election.cc:304] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:53:18.971644  7921 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.786s	user 0.052s	sys 0.090s
I20260709 14:53:18.972422  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
W20260709 14:53:18.980230 13858 log.cc:927] Time spent T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.135s	user 0.000s	sys 0.001s
I20260709 14:53:18.947082 13836 raft_consensus.cc:2804] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 14:53:18.986280  7776 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.672s	user 0.015s	sys 0.002s
W20260709 14:53:18.981530 13860 log.cc:927] Time spent T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.157s	user 0.000s	sys 0.000s
I20260709 14:53:18.995441  7778 rpcz_store.cc:276] 0709 14:53:17.858650 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:53:18.791143 (+932493us) service_pool.cc:224] Handling call
0709 14:53:18.958802 (+167659us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 14:53:19.009217  7779 rpcz_store.cc:276] 0709 14:53:17.858102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:53:18.770343 (+912241us) service_pool.cc:224] Handling call
0709 14:53:19.008003 (+237660us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 14:53:19.011425  7819 leader_election.cc:304] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:53:18.958421 13773 raft_consensus.cc:515] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:18.899564 13628 raft_consensus.cc:515] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:53:18.986863 13813 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.703s	user 0.001s	sys 0.015s
W20260709 14:53:19.041024 13839 log.cc:927] Time spent T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.056s	user 0.004s	sys 0.000s
W20260709 14:53:19.032327  7776 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.718s	user 0.015s	sys 0.002s
W20260709 14:53:19.033167  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 64188.3us
I20260709 14:53:18.998400 13627 raft_consensus.cc:493] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:18.994786 13752 raft_consensus.cc:515] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:19.047832 13754 raft_consensus.cc:697] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:19.049427  7845 raft_consensus.cc:2368] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 19. Current term is 20.
I20260709 14:53:18.954993 13863 raft_consensus.cc:515] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:19.020618  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:19.065948  7893 leader_election.cc:304] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:19.035408 13837 raft_consensus.cc:2749] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 14:53:19.003782  7775 rpcz_store.cc:276] 0709 14:53:17.758258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:53:18.809493 (+1051235us) service_pool.cc:224] Handling call
0709 14:53:18.809814 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:53:18.924414 (+114600us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:53:18.924690 (+   276us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 14:53:19.063891 13813 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.798s	user 0.001s	sys 0.016s
I20260709 14:53:19.078172  7779 raft_consensus.cc:1275] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 14:53:19.097689  7893 leader_election.cc:304] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:18.960017 13739 raft_consensus.cc:515] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:19.035866 13836 raft_consensus.cc:493] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:18.999101 13787 raft_consensus.cc:515] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:19.022339 13691 consensus_queue.cc:1048] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.045s
I20260709 14:53:18.982493 13829 raft_consensus.cc:515] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:19.004863 13795 raft_consensus.cc:515] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:19.044274 13848 raft_consensus.cc:2804] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 14:53:19.086750  7773 raft_consensus.cc:2410] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for term 21 because replica has last-logged OpId of term: 18 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 12.
I20260709 14:53:19.019798 13678 consensus_queue.cc:1048] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 14:53:19.004762 13801 raft_consensus.cc:515] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:53:19.093472  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 169011us
W20260709 14:53:19.135265  7744 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.101.67:40785 timed out after 1.635s (SENT) [suppressed 29 similar messages]
I20260709 14:53:19.092839  7925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38516 (request call id 3102) took 1134 ms. Trace:
I20260709 14:53:19.099589  7775 raft_consensus.cc:1240] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 17. Current term is 18. Ops: []
I20260709 14:53:19.141119  7775 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37136 (request call id 3105) took 1239 ms. Trace:
I20260709 14:53:19.141719  7775 rpcz_store.cc:276] 0709 14:53:17.901642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:53:19.085009 (+1183367us) service_pool.cc:224] Handling call
0709 14:53:19.094807 (+  9798us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:53:19.140599 (+ 45792us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:53:19.140882 (+   283us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 14:53:19.098052  7779 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 3946) took 1237 ms. Trace:
I20260709 14:53:19.145377  7779 rpcz_store.cc:276] 0709 14:53:17.860300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:53:19.045960 (+1185660us) service_pool.cc:224] Handling call
0709 14:53:19.065378 (+ 19418us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:53:19.097722 (+ 32344us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:53:19.097979 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 14:53:19.055807 13601 raft_consensus.cc:2804] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 14:53:19.053856 13692 leader_election.cc:290] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:19.099507  7893 leader_election.cc:304] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:53:19.155815  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 56425.8us
I20260709 14:53:19.157069  7893 leader_election.cc:304] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:19.036744 13697 raft_consensus.cc:515] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:53:19.106377 13735 consensus_meta.cc:287] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent flushing consensus metadata: real 0.816s	user 0.017s	sys 0.000s
I20260709 14:53:19.097322 13500 raft_consensus.cc:2749] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 14:53:19.150962 13614 consensus_meta.cc:287] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent flushing consensus metadata: real 0.533s	user 0.003s	sys 0.013s
I20260709 14:53:19.100823 13849 raft_consensus.cc:2749] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 14:53:19.115131 13740 leader_election.cc:290] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:19.080211 13627 raft_consensus.cc:515] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:19.165166 13813 raft_consensus.cc:493] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:19.173957 13731 leader_election.cc:290] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 22 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:19.176867 13783 leader_election.cc:290] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:19.118539 13603 leader_election.cc:290] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 20 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:19.120173 13863 leader_election.cc:290] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:19.160972 13697 leader_election.cc:290] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:19.167435  7848 raft_consensus.cc:2468] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 14.
I20260709 14:53:19.203044  7774 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37144 (request call id 3921) took 1348 ms. Trace:
I20260709 14:53:19.138149  7925 rpcz_store.cc:276] 0709 14:53:17.958244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:53:17.958470 (+   226us) service_pool.cc:224] Handling call
0709 14:53:17.959008 (+   538us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 14:53:17.969304 (+ 10296us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:53:17.969336 (+    32us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 14:53:17.975694 (+  6358us) log.cc:844] Serialized 78 byte log entry
0709 14:53:18.102825 (+127131us) raft_consensus.cc:1645] Marking committed up to 11
0709 14:53:18.173284 (+ 70459us) log.cc:844] Serialized 14 byte log entry
0709 14:53:18.184680 (+ 11396us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:53:18.184774 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:53:18.591549 (+406775us) spinlock_profiling.cc:243] Waited 18.9 ms on lock 0x7b48001ec258. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68fdb7aa1 00007fb68fdaeb37 00007fb68fdae9ca 00007fb68fea626f 00007fb68fea5f37 00007fb68feba55c 00007fb68feba508 00007fb68feba488 00007fb68feba443 00007fb68feb96ec 00007fb68ede3a96
0709 14:53:18.690678 (+ 99129us) spinlock_profiling.cc:243] Waited 28.5 ms on lock 0x7b180038efc0. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb690c69de1 00007fb690c765b1 00007fb687da13f3 00007fb687da37c1 00007fb687da3779 00007fb687da3709 00007fb687da36d1 00007fb687da29cd 0000000000396ad4 0000000000396919 00007fb687d8483a
0709 14:53:19.092525 (+401847us) raft_consensus.cc:1685] finished
0709 14:53:19.092554 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:53:19.092751 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20744,"prepare.queue_time_us":73518,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"raft.queue_time_us":60652,"raft.run_cpu_time_us":9299,"raft.run_wall_time_us":620400,"spinlock_wait_cycles":108982784,"thread_start_us":83239,"threads_started":1,"wal-append.queue_time_us":439448}
I20260709 14:53:19.252140  7774 rpcz_store.cc:276] 0709 14:53:17.854803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:53:18.384877 (+530074us) service_pool.cc:224] Handling call
0709 14:53:19.202672 (+817795us) spinlock_profiling.cc:243] Waited 513 ms on lock 0x7b54002549d4. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae922fa 00007fb68fe53b17 00007fb6893ce6d4 00007fb6893ce662 00007fb6893ce591 00007fb6893ce50c 00007fb6893cd7c2 00007fb6891c948c 00007fb6891c88c6 00007fb6891c826f
0709 14:53:19.202932 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1180066176}
I20260709 14:53:19.185128  7894 leader_election.cc:304] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:53:19.222837  7776 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 3909) took 3041 ms. Trace:
W20260709 14:53:19.223472  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:19.224557  7779 raft_consensus.cc:1275] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 23 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 14:53:19.253420  7776 rpcz_store.cc:276] 0709 14:53:16.181028 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:53:17.755912 (+1574884us) service_pool.cc:224] Handling call
0709 14:53:17.756282 (+   370us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:53:17.979037 (+222755us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:53:17.979070 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:53:17.979537 (+   467us) log.cc:844] Serialized 26 byte log entry
0709 14:53:18.314397 (+334860us) spinlock_profiling.cc:243] Waited 1.1 ms on lock 0x7b1800007ae0. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb690c69de1 00007fb690c765b1 00007fb687d83e07 00007fb690bdeab9 00007fb687da069b 00007fb687d9e93f 00007fb687da0c02 00007fb68aa2820b 00007fb68aa2dd23 00007fb68aa2e0d1 00007fb68ae49a0f
0709 14:53:19.076511 (+762114us) raft_consensus.cc:1645] Marking committed up to 9
0709 14:53:19.127909 (+ 51398us) log.cc:844] Serialized 14 byte log entry
0709 14:53:19.155153 (+ 27244us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:53:19.155254 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:53:19.215623 (+ 60369us) raft_consensus.cc:1685] finished
0709 14:53:19.222583 (+  6960us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:53:19.222762 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":235001,"prepare.queue_time_us":51017,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":71,"raft.queue_time_us":279900,"raft.run_cpu_time_us":372,"raft.run_wall_time_us":20678,"spinlock_wait_cycles":3953152,"thread_start_us":748824,"threads_started":1,"wal-append.queue_time_us":1075556}
I20260709 14:53:19.213819  7922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38516 (request call id 3103) took 1255 ms. Trace:
W20260709 14:53:19.214005  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 46884.9us
W20260709 14:53:19.166414 13844 consensus_meta.cc:287] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent flushing consensus metadata: real 0.554s	user 0.004s	sys 0.012s
I20260709 14:53:19.105201 13836 raft_consensus.cc:3060] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Advancing to term 19
W20260709 14:53:19.175097 13868 log.cc:927] Time spent T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 14:53:19.221520  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
W20260709 14:53:19.183911 13851 log.cc:927] Time spent T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.637s	user 0.003s	sys 0.006s
W20260709 14:53:19.233376  7742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:19.154641 13601 raft_consensus.cc:493] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:19.282933 13601 raft_consensus.cc:3060] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Advancing to term 19
I20260709 14:53:19.121654 13773 leader_election.cc:290] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:19.150049 13794 raft_consensus.cc:493] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:19.286167 13794 raft_consensus.cc:515] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:53:19.201216 13841 consensus_meta.cc:287] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent flushing consensus metadata: real 0.766s	user 0.004s	sys 0.005s
I20260709 14:53:19.287794 13841 raft_consensus.cc:2749] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 14:53:19.182807 13823 raft_consensus.cc:2804] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 14:53:19.289103 13823 raft_consensus.cc:493] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:19.289819 13823 raft_consensus.cc:3060] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 14:53:19.203329 13693 leader_election.cc:290] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:19.294029 13693 raft_consensus.cc:493] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:19.294894 13693 raft_consensus.cc:515] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:19.183084 13628 leader_election.cc:290] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:19.200481 13739 leader_election.cc:290] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:19.250645  7772 raft_consensus.cc:1240] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 14:53:19.226823 13617 raft_consensus.cc:493] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:19.298986 13617 raft_consensus.cc:515] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:19.299857  7921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38516 (request call id 3105) took 1340 ms. Trace:
I20260709 14:53:19.207278 13801 leader_election.cc:290] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:19.300613  7772 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37136 (request call id 3096) took 1541 ms. Trace:
I20260709 14:53:19.255987  7922 rpcz_store.cc:276] 0709 14:53:17.958601 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:53:17.958857 (+   256us) service_pool.cc:224] Handling call
0709 14:53:17.959411 (+   554us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 14:53:18.339389 (+379978us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:53:18.339421 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 14:53:18.349369 (+  9948us) log.cc:844] Serialized 52 byte log entry
0709 14:53:18.534083 (+184714us) raft_consensus.cc:1645] Marking committed up to 12
0709 14:53:18.534121 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:53:18.534197 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:53:19.213535 (+679338us) raft_consensus.cc:1685] finished
0709 14:53:19.213558 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:53:19.213747 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10569,"raft.queue_time_us":61549,"raft.run_cpu_time_us":230,"raft.run_wall_time_us":37643,"thread_start_us":440730,"threads_started":2,"wal-append.queue_time_us":356301}
W20260709 14:53:19.266376  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 81576.5us
W20260709 14:53:19.232990 13866 log.cc:927] Time spent T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.199s	user 0.000s	sys 0.002s
I20260709 14:53:19.215163 13614 raft_consensus.cc:515] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:53:19.271204 13770 consensus_meta.cc:287] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent flushing consensus metadata: real 0.812s	user 0.011s	sys 0.004s
I20260709 14:53:19.273051 13844 raft_consensus.cc:515] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:19.204561 13795 leader_election.cc:290] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:53:19.273999 13821 consensus_meta.cc:287] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent flushing consensus metadata: real 0.759s	user 0.014s	sys 0.000s
W20260709 14:53:19.275997 13771 consensus_meta.cc:287] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0: Time spent flushing consensus metadata: real 0.816s	user 0.007s	sys 0.005s
I20260709 14:53:19.208539 13754 consensus_queue.cc:237] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:19.254738 13787 leader_election.cc:290] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:19.287287 13843 raft_consensus.cc:515] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:19.166579 13615 raft_consensus.cc:3060] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 14:53:19.328469 13614 leader_election.cc:290] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:19.308996  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:19.308406  7771 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37144 (request call id 3938) took 1450 ms. Trace:
I20260709 14:53:19.336419  7771 rpcz_store.cc:276] 0709 14:53:17.858364 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:53:18.093820 (+235456us) service_pool.cc:224] Handling call
0709 14:53:19.308194 (+1214374us) spinlock_profiling.cc:243] Waited 260 ms on lock 0x7b5400115154. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae922fa 00007fb68fe53b17 00007fb6893ce6d4 00007fb6893ce662 00007fb6893ce591 00007fb6893ce50c 00007fb6893cd7c2 00007fb6891c948c 00007fb6891c88c6 00007fb6891c826f
0709 14:53:19.308328 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":598284672}
I20260709 14:53:19.308422  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c563cc7cfbe4d59be4ffc5cf847ce56" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:19.337942  7773 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37144 (request call id 3922) took 1482 ms. Trace:
I20260709 14:53:19.312489  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:19.338405  7773 rpcz_store.cc:276] 0709 14:53:17.855015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:53:18.599616 (+744601us) service_pool.cc:224] Handling call
0709 14:53:19.337666 (+738050us) spinlock_profiling.cc:243] Waited 341 ms on lock 0x7b54002553d4. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae922fa 00007fb68fe53b17 00007fb6893ce6d4 00007fb6893ce662 00007fb6893ce591 00007fb6893ce50c 00007fb6893cd7c2 00007fb6891c948c 00007fb6891c88c6 00007fb6891c826f
0709 14:53:19.337842 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":785020160}
I20260709 14:53:19.319173 13770 raft_consensus.cc:515] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:19.301222  7772 rpcz_store.cc:276] 0709 14:53:17.758924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:53:19.040151 (+1281227us) service_pool.cc:224] Handling call
0709 14:53:19.040622 (+   471us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:53:19.298376 (+257754us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:53:19.300214 (+  1838us) spinlock_profiling.cc:243] Waited 203 ms on lock 0x7b5400324e54. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae8ee01 00007fb68ae8d83e 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2 00007fb6891c948c 00007fb6891c88c6
0709 14:53:19.300519 (+   305us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":467576192}
I20260709 14:53:19.345957  7772 raft_consensus.cc:1240] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 19. Current term is 20. Ops: []
I20260709 14:53:19.283231  7777 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37136 (request call id 3085) took 3105 ms. Trace:
I20260709 14:53:19.273626 13849 raft_consensus.cc:2804] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 14:53:19.300344  7921 rpcz_store.cc:276] 0709 14:53:17.959191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:53:17.959313 (+   122us) service_pool.cc:224] Handling call
0709 14:53:17.959615 (+   302us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:53:18.081544 (+121929us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:53:18.081580 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:53:18.104569 (+ 22989us) log.cc:844] Serialized 26 byte log entry
0709 14:53:19.029498 (+924929us) raft_consensus.cc:1645] Marking committed up to 8
0709 14:53:19.029552 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:53:19.029820 (+   268us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:53:19.137765 (+107945us) spinlock_profiling.cc:243] Waited 7.23 ms on lock 0x7b48001ec258. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68fdb7aa1 00007fb68fdaeb37 00007fb68fdae9ca 00007fb68fea626f 00007fb68fea5f37 00007fb68feba55c 00007fb68feba508 00007fb68feba488 00007fb68feba443 00007fb68feb96ec 00007fb68ede3a96
0709 14:53:19.280529 (+142764us) spinlock_profiling.cc:243] Waited 2.85 ms on lock 0x7b18003d3d20. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb690c69de1 00007fb690c765b1 00007fb687da1522 00007fb687da37c1 00007fb687da3779 00007fb687da3709 00007fb687da36d1 00007fb687da29cd 0000000000396ad4 0000000000396919 00007fb687d8483a
0709 14:53:19.299589 (+ 19060us) raft_consensus.cc:1685] finished
0709 14:53:19.299615 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:53:19.299788 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12514,"raft.queue_time_us":71305,"raft.run_cpu_time_us":37276,"raft.run_wall_time_us":1102096,"spinlock_wait_cycles":23174272,"thread_start_us":952604,"threads_started":2,"wal-append.queue_time_us":981168}
I20260709 14:53:19.303982 13829 leader_election.cc:290] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:19.354550  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:19.362959  7925 raft_consensus.cc:3060] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Advancing to term 19
I20260709 14:53:19.346555  7777 rpcz_store.cc:276] 0709 14:53:16.178210 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:53:17.377418 (+1199208us) service_pool.cc:224] Handling call
0709 14:53:17.390786 (+ 13368us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:53:17.878507 (+487721us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:53:17.878544 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:53:17.886145 (+  7601us) log.cc:844] Serialized 26 byte log entry
0709 14:53:18.300473 (+414328us) raft_consensus.cc:1645] Marking committed up to 12
0709 14:53:18.344690 (+ 44217us) log.cc:844] Serialized 14 byte log entry
0709 14:53:18.546433 (+201743us) spinlock_profiling.cc:243] Waited 6.12 ms on lock 0x7b1800149320. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb690c69de1 00007fb690c765b1 00007fb687da13f3 00007fb687da37c1 00007fb687da3779 00007fb687da3709 00007fb687da36d1 00007fb687da29cd 0000000000396ad4 0000000000396919 00007fb687d8483a
0709 14:53:18.966741 (+420308us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:53:18.966847 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:53:19.180266 (+213419us) spinlock_profiling.cc:243] Waited 7.05 ms on lock 0x7b4400022b4c. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb687c29db1 00007fb687cc7c85 00007fb687cc86a2 00007fb68aa3a1db 00007fb68aa35aaf 00007fb68aa2986e 00007fb68aa28bb6 00007fb68aa287d8 00007fb68aa32221 00007fb68aa321d9 00007fb68aa32169
0709 14:53:19.282945 (+102679us) raft_consensus.cc:1685] finished
0709 14:53:19.282974 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:53:19.283159 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":984166,"prepare.queue_time_us":44442,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":51,"raft.queue_time_us":887242,"raft.run_cpu_time_us":642,"raft.run_wall_time_us":25933,"spinlock_wait_cycles":30291584,"thread_start_us":678586,"threads_started":2,"wal-append.queue_time_us":543143}
I20260709 14:53:19.319481 13783 raft_consensus.cc:493] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:19.348338  7845 raft_consensus.cc:1240] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 18. Current term is 19. Ops: []
I20260709 14:53:19.232059 13813 raft_consensus.cc:515] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:19.371155  7927 raft_consensus.cc:1240] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 15. Current term is 16. Ops: []
W20260709 14:53:19.373288  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 320099us
I20260709 14:53:19.336550 13801 raft_consensus.cc:493] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:19.336050 13794 leader_election.cc:290] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:19.342759 13617 leader_election.cc:290] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:19.386240  7819 leader_election.cc:304] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:19.347827 13849 raft_consensus.cc:493] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:19.326228 13771 raft_consensus.cc:2749] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 14:53:19.394771  8598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 233762us
I20260709 14:53:19.367204 13848 raft_consensus.cc:697] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:19.476655  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:19.477809  7928 raft_consensus.cc:2468] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 19.
I20260709 14:53:19.419481  7921 raft_consensus.cc:1275] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 14:53:19.408008  7819 leader_election.cc:304] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
W20260709 14:53:19.483923  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 56279.5us
I20260709 14:53:19.325744 13821 raft_consensus.cc:515] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:19.493924  7894 leader_election.cc:304] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:19.482185 13739 raft_consensus.cc:493] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:19.495085  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
W20260709 14:53:19.502449  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 94595.4us
I20260709 14:53:19.401829 13849 raft_consensus.cc:3060] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Advancing to term 19
I20260709 14:53:19.502869  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
W20260709 14:53:19.509737  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:19.396705 13628 raft_consensus.cc:493] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:19.402619 13693 leader_election.cc:290] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:53:19.542522  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 385568us
I20260709 14:53:19.571429  7850 raft_consensus.cc:1240] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 22 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 21. Current term is 22. Ops: []
I20260709 14:53:19.372450 13783 raft_consensus.cc:515] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:19.540867  7925 raft_consensus.cc:2468] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 19.
W20260709 14:53:19.533416 13570 consensus_meta.cc:287] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent flushing consensus metadata: real 0.776s	user 0.009s	sys 0.005s
I20260709 14:53:19.492432 13794 raft_consensus.cc:493] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:19.540984 13500 raft_consensus.cc:493] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:19.496248 13853 raft_consensus.cc:493] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:19.503847 13770 leader_election.cc:290] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:19.596597 13752 leader_election.cc:290] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:19.394234 13801 raft_consensus.cc:515] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:19.611271  7893 leader_election.cc:304] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:19.553141 13771 raft_consensus.cc:2804] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 14:53:19.597895  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 90246.8us
I20260709 14:53:19.570463 13820 raft_consensus.cc:2804] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 14:53:19.569598 13735 raft_consensus.cc:493] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
W20260709 14:53:19.605667 13873 log.cc:927] Time spent T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260709 14:53:19.412997 13617 raft_consensus.cc:2804] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 14:53:19.611662 13691 raft_consensus.cc:493] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:19.645937  7893 leader_election.cc:304] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:19.671253  7893 leader_election.cc:304] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:19.546434 13739 raft_consensus.cc:515] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:19.618086 13570 raft_consensus.cc:2749] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587) with higher term. Message: Invalid argument: T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 17. Current term is 18.
I20260709 14:53:19.591641 13628 raft_consensus.cc:515] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:53:19.679225  7742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:19.683717 13628 leader_election.cc:290] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:53:19.691164 13874 log.cc:927] Time spent T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.322s	user 0.001s	sys 0.000s
I20260709 14:53:19.621580 13794 raft_consensus.cc:515] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:19.672560 13735 raft_consensus.cc:515] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:19.705452 13837 raft_consensus.cc:2749] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 14:53:19.705766 13821 leader_election.cc:290] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 22 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:53:19.709661 13876 log.cc:927] Time spent T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.318s	user 0.001s	sys 0.000s
W20260709 14:53:19.710959 13875 log.cc:927] Time spent T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.234s	user 0.001s	sys 0.001s
I20260709 14:53:19.713725 13627 leader_election.cc:290] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:19.715854 13813 leader_election.cc:290] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:19.651628 13835 raft_consensus.cc:2749] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 14:53:19.723960 13690 consensus_meta.cc:287] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent flushing consensus metadata: real 0.777s	user 0.009s	sys 0.005s
I20260709 14:53:19.724713 13690 raft_consensus.cc:515] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:19.726310  7847 raft_consensus.cc:1240] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 14. Current term is 15. Ops: []
I20260709 14:53:19.727069 13844 leader_election.cc:290] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 19 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:19.680860 13843 leader_election.cc:290] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:19.738251  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:19.651995 13820 raft_consensus.cc:493] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:19.754323  7852 raft_consensus.cc:2468] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 18.
I20260709 14:53:19.648701 13771 raft_consensus.cc:493] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:19.634945 13500 raft_consensus.cc:515] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:19.677476 13770 raft_consensus.cc:2749] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 14:53:19.705093 13737 leader_election.cc:290] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 14 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:53:19.777382  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 96835us
I20260709 14:53:19.646881 13853 raft_consensus.cc:515] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:19.632827 13848 consensus_queue.cc:237] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:19.762104 13820 raft_consensus.cc:3060] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Advancing to term 19
I20260709 14:53:19.765570 13771 raft_consensus.cc:3060] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Advancing to term 14
W20260709 14:53:19.839959  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:19.845611 13690 leader_election.cc:290] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:19.848627 13783 leader_election.cc:290] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:19.749956 13617 raft_consensus.cc:493] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:19.789031 13859 raft_consensus.cc:2804] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 14:53:19.807615 13739 leader_election.cc:290] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:53:19.800060 13601 consensus_meta.cc:287] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent flushing consensus metadata: real 0.516s	user 0.013s	sys 0.001s
I20260709 14:53:19.800276 13735 leader_election.cc:290] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:19.821314  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:19.823431  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:19.823719  7921 raft_consensus.cc:1275] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 14:53:19.824581  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:19.729694 13691 raft_consensus.cc:515] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:53:19.773630 13874 log.cc:927] Time spent T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.080s	user 0.003s	sys 0.000s
I20260709 14:53:19.863325  7928 raft_consensus.cc:2468] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 23.
I20260709 14:53:19.882661  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce9c0ef2db24c13a8b1402f21819458" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
W20260709 14:53:19.858867  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 206664us
I20260709 14:53:19.886649  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:19.888531  7893 leader_election.cc:304] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:19.883565  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:19.882899  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:19.892115  7893 leader_election.cc:304] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:19.894052  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:19.896515  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:19.897630  7923 raft_consensus.cc:2376] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 18. Re-sending same reply.
I20260709 14:53:19.904878  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:19.905165  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:19.907596  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:19.882107 13601 raft_consensus.cc:515] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:19.837548 13852 consensus_queue.cc:1048] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.105s
I20260709 14:53:19.860776 13737 raft_consensus.cc:493] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:19.920161  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
W20260709 14:53:19.894879 13878 log.cc:927] Time spent T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.242s	user 0.003s	sys 0.001s
W20260709 14:53:19.894784 13891 log.cc:927] Time spent T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.097s	user 0.005s	sys 0.016s
I20260709 14:53:19.911988  7921 raft_consensus.cc:2393] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 16: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:53:19.909408  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
W20260709 14:53:19.894290 13889 log.cc:927] Time spent T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.123s	user 0.002s	sys 0.002s
I20260709 14:53:19.913861  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:19.921096  7774 raft_consensus.cc:2393] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 14: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:53:19.922212  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:19.917625  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:19.931299  7928 raft_consensus.cc:2468] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 19.
I20260709 14:53:19.862670 13617 raft_consensus.cc:3060] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Advancing to term 17
I20260709 14:53:19.934409  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:19.935045  7928 raft_consensus.cc:2468] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 17.
I20260709 14:53:19.901872 13882 raft_consensus.cc:2749] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 14:53:19.934163  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:19.893420 13735 raft_consensus.cc:493] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:19.949515  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:19.928285  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:19.943687  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:19.910238 13835 raft_consensus.cc:2804] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 14:53:19.963371  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:19.914499 13770 raft_consensus.cc:493] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:19.968319  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:19.947389  7774 raft_consensus.cc:3060] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Advancing to term 16
I20260709 14:53:19.958431  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:19.973213  7744 leader_election.cc:304] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:19.974647 13628 consensus_queue.cc:1048] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 14:53:19.905822 13844 consensus_queue.cc:1048] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.056s
I20260709 14:53:19.991820  7923 raft_consensus.cc:2393] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 14: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:53:19.993001  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:19.961516 13813 raft_consensus.cc:493] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:19.963869 13835 raft_consensus.cc:493] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:20.003012  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:20.030298  7774 raft_consensus.cc:2468] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 16.
I20260709 14:53:20.001305  7744 leader_election.cc:304] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:20.036185  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:20.044333 13691 leader_election.cc:290] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:19.927855 13886 consensus_queue.cc:1059] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 8, Time since last communication: 0.120s
W20260709 14:53:20.045984 13836 consensus_meta.cc:287] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent flushing consensus metadata: real 0.772s	user 0.013s	sys 0.000s
I20260709 14:53:19.982792 13770 raft_consensus.cc:515] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:20.046845 13836 raft_consensus.cc:515] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:20.048604  7927 raft_consensus.cc:1240] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 18. Current term is 19. Ops: []
I20260709 14:53:20.051383  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:19.997918 13783 raft_consensus.cc:2749] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 14:53:19.949090 13739 consensus_queue.cc:1048] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.055s
I20260709 14:53:20.054085 13835 raft_consensus.cc:3060] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 14:53:19.920465 13885 consensus_queue.cc:1048] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.090s
I20260709 14:53:20.058971  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:20.038461  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:20.056813  7775 raft_consensus.cc:2393] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 14: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:53:20.056854  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:19.991289 13794 leader_election.cc:290] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:20.056870  7744 leader_election.cc:304] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:19.934634 13737 raft_consensus.cc:515] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:53:20.051198 13615 consensus_meta.cc:287] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0: Time spent flushing consensus metadata: real 0.723s	user 0.012s	sys 0.000s
I20260709 14:53:20.071086  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:20.072961  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c563cc7cfbe4d59be4ffc5cf847ce56" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:20.074120  7774 raft_consensus.cc:2410] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for term 17 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 14:53:20.073925  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:19.966382 13735 raft_consensus.cc:515] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:20.081990  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:20.071440  7744 leader_election.cc:304] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:53:20.082834  7927 raft_consensus.cc:2468] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 16.
I20260709 14:53:20.055388 13752 raft_consensus.cc:2749] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 14:53:20.098835  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:20.100018  7773 raft_consensus.cc:3060] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Advancing to term 22
I20260709 14:53:20.086869  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:20.087404  7744 leader_election.cc:304] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 9418391fa82a42c79c6cad13ba91d964
I20260709 14:53:20.103021  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:20.109687  7744 leader_election.cc:304] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:53:20.079264 13739 raft_consensus.cc:2749] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 14:53:20.116294  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:20.113730  7744 leader_election.cc:304] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:53:20.081377 13615 raft_consensus.cc:2749] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 14:53:20.056500 13813 raft_consensus.cc:515] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:20.097090 13794 raft_consensus.cc:2804] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 14:53:20.068780 13795 consensus_queue.cc:1048] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 14:53:20.118198 13628 raft_consensus.cc:2804] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader election won for term 18
I20260709 14:53:20.136301  7923 raft_consensus.cc:2468] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 18.
I20260709 14:53:20.114305 13783 raft_consensus.cc:2749] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 14:53:20.137620  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:53:20.131752 13888 log.cc:927] Time spent T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.345s	user 0.001s	sys 0.001s
W20260709 14:53:20.145038 13892 log.cc:927] Time spent T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
I20260709 14:53:20.128659 13752 raft_consensus.cc:2804] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 14:53:20.156634 13601 leader_election.cc:290] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 19 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:20.177706 13752 raft_consensus.cc:493] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:20.178210 13752 raft_consensus.cc:3060] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Advancing to term 20
I20260709 14:53:20.160944 13628 raft_consensus.cc:697] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:53:20.181555 13628 consensus_queue.cc:237] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:53:20.182544 13823 consensus_meta.cc:287] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0: Time spent flushing consensus metadata: real 0.892s	user 0.015s	sys 0.000s
I20260709 14:53:20.183084 13823 raft_consensus.cc:515] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:20.184441  7919 raft_consensus.cc:2393] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 18: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:53:20.130676 13853 leader_election.cc:290] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:20.186436  7771 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37136 (request call id 3113) took 1027 ms. Trace:
I20260709 14:53:20.186980  7771 rpcz_store.cc:276] 0709 14:53:19.158821 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:53:19.342817 (+183996us) service_pool.cc:224] Handling call
0709 14:53:19.343256 (+   439us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:53:19.343740 (+   484us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 14:53:19.343769 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:53:19.344302 (+   533us) log.cc:844] Serialized 26 byte log entry
0709 14:53:19.595369 (+251067us) raft_consensus.cc:1645] Marking committed up to 6
0709 14:53:19.599109 (+  3740us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:53:19.599636 (+   527us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:53:20.186148 (+586512us) raft_consensus.cc:1685] finished
0709 14:53:20.186176 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:53:20.186337 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1315,"raft.queue_time_us":1234,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":17087,"thread_start_us":249423,"threads_started":1,"wal-append.queue_time_us":404101}
I20260709 14:53:20.162988 13813 leader_election.cc:290] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:20.163368 13735 leader_election.cc:290] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:20.172350  7778 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 3911) took 2412 ms. Trace:
I20260709 14:53:20.193768  7778 rpcz_store.cc:276] 0709 14:53:17.760160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:53:19.044121 (+1283961us) service_pool.cc:224] Handling call
0709 14:53:19.044520 (+   399us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:53:19.044950 (+   430us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:53:19.044978 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:53:19.052671 (+  7693us) log.cc:844] Serialized 26 byte log entry
0709 14:53:19.403878 (+351207us) raft_consensus.cc:1645] Marking committed up to 11
0709 14:53:20.171570 (+767692us) log.cc:844] Serialized 14 byte log entry
0709 14:53:20.171909 (+   339us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:53:20.172009 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:53:20.172053 (+    44us) raft_consensus.cc:1685] finished
0709 14:53:20.172063 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:53:20.172258 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":767144,"prepare.queue_time_us":773766,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":74,"raft.queue_time_us":1984,"raft.run_cpu_time_us":317,"raft.run_wall_time_us":15473,"thread_start_us":301854,"threads_started":1,"wal-append.queue_time_us":527597}
I20260709 14:53:20.196271  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:20.198812  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:20.199851  7778 raft_consensus.cc:2468] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 14.
I20260709 14:53:20.200965  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
W20260709 14:53:20.175606 13849 consensus_meta.cc:287] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent flushing consensus metadata: real 0.605s	user 0.015s	sys 0.000s
W20260709 14:53:20.176792 13900 log.cc:927] Time spent T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 14:53:20.135367 13794 raft_consensus.cc:493] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:20.201759  7778 raft_consensus.cc:2468] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 18.
I20260709 14:53:20.205720 13737 leader_election.cc:290] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:20.206548  7772 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37136 (request call id 3115) took 1047 ms. Trace:
I20260709 14:53:20.207291  7772 rpcz_store.cc:276] 0709 14:53:19.159294 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:53:19.362713 (+203419us) service_pool.cc:224] Handling call
0709 14:53:19.363037 (+   324us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:53:19.367205 (+  4168us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:53:19.367236 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:53:19.368307 (+  1071us) log.cc:844] Serialized 26 byte log entry
0709 14:53:19.831024 (+462717us) spinlock_profiling.cc:243] Waited 5.98 ms on lock 0x7b180025f720. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb690c69de1 00007fb690c765b1 00007fb687d83e07 00007fb690bdeab9 00007fb687da069b 00007fb687d9e93f 00007fb687da0c02 00007fb68aa2820b 00007fb68aa2dd23 00007fb68aa2e0d1 00007fb68ae49a0f
0709 14:53:19.940136 (+109112us) raft_consensus.cc:1645] Marking committed up to 8
0709 14:53:19.940212 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:53:19.940315 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:53:20.206146 (+265831us) raft_consensus.cc:1685] finished
0709 14:53:20.206174 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:53:20.206469 (+   295us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4512,"raft.run_cpu_time_us":240,"raft.run_wall_time_us":14024,"spinlock_wait_cycles":13761920,"thread_start_us":108615,"threads_started":1,"wal-append.queue_time_us":693428}
I20260709 14:53:20.210263  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:20.210165  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:20.211364  7772 raft_consensus.cc:3060] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Advancing to term 22
I20260709 14:53:20.212144  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:20.214483  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:20.216320  7770 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37136 (request call id 3092) took 2499 ms. Trace:
I20260709 14:53:20.220043  7770 rpcz_store.cc:276] 0709 14:53:17.716843 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:53:18.808031 (+1091188us) service_pool.cc:224] Handling call
0709 14:53:18.808535 (+   504us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 14:53:18.858002 (+ 49467us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:53:18.858047 (+    45us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 14:53:18.859395 (+  1348us) log.cc:844] Serialized 78 byte log entry
0709 14:53:19.149665 (+290270us) raft_consensus.cc:1645] Marking committed up to 11
0709 14:53:19.370649 (+220984us) log.cc:844] Serialized 14 byte log entry
0709 14:53:19.377449 (+  6800us) log.cc:844] Serialized 14 byte log entry
0709 14:53:20.168492 (+791043us) spinlock_profiling.cc:243] Waited 72.9 ms on lock 0x7b18004283e0. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb690c69de1 00007fb690c765b1 00007fb687d1bc0a 00007fb69145b219 00007fb687da3a40 00007fb687d9e4e4 00007fb687d9e455 00007fb68e8863c7 00007fb68ae989a7 00007fb68aea80bf 00007fb68aea8038
0709 14:53:20.169014 (+   522us) log.cc:844] Serialized 14 byte log entry
0709 14:53:20.188279 (+ 19265us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:53:20.215811 (+ 27532us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:53:20.215888 (+    77us) raft_consensus.cc:1685] finished
0709 14:53:20.215927 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:53:20.216224 (+   297us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":743955,"prepare.queue_time_us":857398,"prepare.run_cpu_time_us":132,"prepare.run_wall_time_us":5713,"raft.queue_time_us":54544,"raft.run_cpu_time_us":462,"raft.run_wall_time_us":107116,"spinlock_wait_cycles":181494400,"thread_start_us":341277,"threads_started":2,"wal-append.queue_time_us":347139}
I20260709 14:53:20.222826  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:20.223912  7770 raft_consensus.cc:2393] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 13: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:53:20.138136 13500 leader_election.cc:290] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:20.230238 13735 raft_consensus.cc:493] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:20.231424 13735 raft_consensus.cc:515] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:20.217012 13823 leader_election.cc:290] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 18 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:20.219211 13820 raft_consensus.cc:515] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:20.234525  7848 raft_consensus.cc:1240] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 18. Current term is 19. Ops: []
I20260709 14:53:20.224933  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:20.239754  7770 raft_consensus.cc:3060] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Advancing to term 15
I20260709 14:53:20.213088  7771 raft_consensus.cc:3060] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Advancing to term 20
I20260709 14:53:20.243220  7778 raft_consensus.cc:3060] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Advancing to term 19
I20260709 14:53:20.249078  7772 raft_consensus.cc:2468] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 22.
I20260709 14:53:20.258671  7773 raft_consensus.cc:2468] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 22.
I20260709 14:53:20.207386 13794 raft_consensus.cc:3060] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 23 FOLLOWER]: Advancing to term 24
I20260709 14:53:20.273061  7771 raft_consensus.cc:2468] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 20.
I20260709 14:53:20.275727  7926 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38516 (request call id 3108) took 1430 ms. Trace:
I20260709 14:53:20.276386  7926 rpcz_store.cc:276] 0709 14:53:18.845287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:53:18.845492 (+   205us) service_pool.cc:224] Handling call
0709 14:53:18.845895 (+   403us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:53:18.849167 (+  3272us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:53:18.849208 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:53:19.392127 (+542919us) spinlock_profiling.cc:243] Waited 5.04 ms on lock 0x7b2c0010d148. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb689787a11 00007fb689797372 00007fb68aec9a01 00007fb68ae8e43a 00007fb68ae8d83e 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2
0709 14:53:19.392726 (+   599us) log.cc:844] Serialized 26 byte log entry
0709 14:53:19.782400 (+389674us) raft_consensus.cc:1645] Marking committed up to 8
0709 14:53:19.782445 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:53:19.782634 (+   189us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:53:20.268182 (+485548us) raft_consensus.cc:1685] finished
0709 14:53:20.268217 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:53:20.275624 (+  7407us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5076,"raft.queue_time_us":2891,"raft.run_cpu_time_us":297,"raft.run_wall_time_us":41070,"spinlock_wait_cycles":11602688,"thread_start_us":240465,"threads_started":1,"wal-append.queue_time_us":449243}
I20260709 14:53:20.291594  7770 raft_consensus.cc:2468] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 15.
I20260709 14:53:20.292874  7772 raft_consensus.cc:1240] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 14. Current term is 15. Ops: []
I20260709 14:53:20.296029  7778 raft_consensus.cc:2468] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 19.
I20260709 14:53:20.299695  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:20.305475  7773 raft_consensus.cc:1240] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 18. Current term is 19. Ops: []
I20260709 14:53:20.219280 13849 raft_consensus.cc:515] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:20.310593  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:20.311998  7773 raft_consensus.cc:1240] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 22 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 21. Current term is 22. Ops: []
I20260709 14:53:20.317409  7921 raft_consensus.cc:2468] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 19.
I20260709 14:53:20.317445  7773 raft_consensus.cc:1240] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 15. Current term is 16. Ops: []
I20260709 14:53:20.317835  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:20.301544 13630 raft_consensus.cc:493] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9418391fa82a42c79c6cad13ba91d964)
I20260709 14:53:20.322268  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:20.324018  7773 raft_consensus.cc:1240] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 13. Current term is 14. Ops: []
I20260709 14:53:20.309010 13835 raft_consensus.cc:515] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:20.329994  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258d6c2dda954bf5b65930fde8ecb9f3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:20.319432 13735 leader_election.cc:290] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:20.332696  7773 raft_consensus.cc:1275] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 14:53:20.322392 13630 raft_consensus.cc:515] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:53:20.342667  7926 raft_consensus.cc:1275] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 14:53:20.346091  7926 raft_consensus.cc:1240] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 22 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 21. Current term is 22. Ops: []
I20260709 14:53:20.332775 13907 raft_consensus.cc:493] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:20.348608  7924 raft_consensus.cc:2368] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 13. Current term is 14.
I20260709 14:53:20.343906 13795 raft_consensus.cc:493] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:20.346141 13731 raft_consensus.cc:493] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:20.352018 13849 leader_election.cc:290] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:20.351547 13795 raft_consensus.cc:515] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:20.352226 13771 raft_consensus.cc:515] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:20.354844 13771 leader_election.cc:290] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:20.355764  7928 raft_consensus.cc:2468] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 14.
I20260709 14:53:20.351578 13731 raft_consensus.cc:515] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:20.362255 13859 raft_consensus.cc:493] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:20.362825 13859 raft_consensus.cc:3060] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 14:53:20.363976 13630 leader_election.cc:290] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785), 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68:42321)
I20260709 14:53:20.364734 13617 raft_consensus.cc:515] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:20.366925 13603 raft_consensus.cc:3055] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 LEADER]: Stepping down as leader of term 19
I20260709 14:53:20.334051 13820 leader_election.cc:290] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 19 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:20.367547 13603 raft_consensus.cc:740] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
W20260709 14:53:20.372588 13904 log.cc:927] Time spent T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 14:53:20.350307 13907 raft_consensus.cc:515] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:20.376068 13752 raft_consensus.cc:515] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:20.383332  7921 raft_consensus.cc:1240] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 14:53:20.378854 13907 leader_election.cc:290] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:20.367426 13835 leader_election.cc:290] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:20.385004  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:20.386577  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:20.391080  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:20.395059  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:20.395947  7849 raft_consensus.cc:3060] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Advancing to term 14
I20260709 14:53:20.397723  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:20.397723  8640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1f7722fdea49e0b5e9c5d96633eaf9" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9418391fa82a42c79c6cad13ba91d964" is_pre_election: true
I20260709 14:53:20.364396 13731 leader_election.cc:290] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:20.429698  7921 raft_consensus.cc:1275] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 23 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 14:53:20.426106  7744 leader_election.cc:304] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:53:20.445871  7848 raft_consensus.cc:2468] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 19.
W20260709 14:53:20.449754  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 56296.9us
I20260709 14:53:20.453294 13735 raft_consensus.cc:2804] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 14:53:20.453905 13735 raft_consensus.cc:493] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting leader election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:20.454301 13735 raft_consensus.cc:3060] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Advancing to term 17
I20260709 14:53:20.455825 13795 leader_election.cc:290] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:20.458101  7845 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 4715) took 1153 ms. Trace:
I20260709 14:53:20.458583  7845 rpcz_store.cc:276] 0709 14:53:19.304272 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:53:19.304461 (+   189us) service_pool.cc:224] Handling call
0709 14:53:19.304766 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:53:19.369754 (+ 64988us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:53:20.457743 (+1087989us) spinlock_profiling.cc:243] Waited 43.3 ms on lock 0x7b540013b0d4. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae8ee01 00007fb68ae8d83e 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2 00007fb6891c948c 00007fb6891c88c6
0709 14:53:20.457984 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":99636608}
I20260709 14:53:20.460176 13771 raft_consensus.cc:493] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:53:20.461439 13731 consensus_queue.cc:1059] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 14:53:20.463013 13731 raft_consensus.cc:3055] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 14:53:20.463426 13731 raft_consensus.cc:740] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:20.446673  7744 leader_election.cc:304] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:53:20.468225  7926 raft_consensus.cc:1240] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 17. Current term is 18. Ops: []
I20260709 14:53:20.468794  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
W20260709 14:53:20.469072 13899 log.cc:927] Time spent T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.262s	user 0.000s	sys 0.001s
I20260709 14:53:20.368773 13603 consensus_queue.cc:260] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:20.475133  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:20.475688  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:20.476552  7772 raft_consensus.cc:2468] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 15.
I20260709 14:53:20.464425 13731 consensus_queue.cc:260] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:20.477010 13752 leader_election.cc:290] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 20 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:20.470778 13795 raft_consensus.cc:2804] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 14:53:20.478108 13731 raft_consensus.cc:3060] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 14:53:20.478679  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:20.461191 13771 raft_consensus.cc:515] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:20.478152 13836 leader_election.cc:290] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:20.483960 13771 leader_election.cc:290] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:20.484625  7928 raft_consensus.cc:1240] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 18. Current term is 19. Ops: []
I20260709 14:53:20.486085  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:20.508172  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:20.489528 13692 raft_consensus.cc:493] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:20.476728  7779 raft_consensus.cc:3060] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Advancing to term 19
I20260709 14:53:20.491470  7851 raft_consensus.cc:2468] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 14.
I20260709 14:53:20.492293  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:20.480968  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:20.494814  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:20.496914  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:20.522231  7770 raft_consensus.cc:2393] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 14: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:53:20.509830  7773 raft_consensus.cc:3060] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Advancing to term 14
I20260709 14:53:20.509807  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:20.525063  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:20.526100  7925 raft_consensus.cc:2410] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 14:53:20.511821  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:20.520181  7894 leader_election.cc:304] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:20.527362  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:20.529347  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:20.531436  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:20.534953  7849 raft_consensus.cc:2468] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 14.
I20260709 14:53:20.531360  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:20.477977 13795 raft_consensus.cc:493] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:20.544003  7928 raft_consensus.cc:2393] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 16: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:53:20.549425  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:20.551743  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 20 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:20.435024 13794 raft_consensus.cc:515] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:20.558773 13794 leader_election.cc:290] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 24 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:20.542523 13795 raft_consensus.cc:3060] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Advancing to term 20
I20260709 14:53:20.526273 13852 consensus_queue.cc:1059] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.039s
I20260709 14:53:20.565891 13852 raft_consensus.cc:3055] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 14:53:20.566354 13852 raft_consensus.cc:740] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:20.567410 13852 consensus_queue.cc:260] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:20.568574 13617 leader_election.cc:290] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 17 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:20.541512  7894 leader_election.cc:304] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:20.550421  7923 raft_consensus.cc:2468] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 15.
I20260709 14:53:20.577667  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
W20260709 14:53:20.589999  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 48595.3us
I20260709 14:53:20.591478  7894 leader_election.cc:304] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:20.594692  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:20.594987  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:20.596112  7851 raft_consensus.cc:2393] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 14: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:53:20.596771  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:20.597548  7846 raft_consensus.cc:2468] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 20.
I20260709 14:53:20.598393  7854 raft_consensus.cc:1240] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 18. Current term is 19. Ops: []
I20260709 14:53:20.598707  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:20.601467  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:20.601616  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:20.586171  7779 raft_consensus.cc:2468] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 19.
I20260709 14:53:20.569191 13852 raft_consensus.cc:3060] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Advancing to term 19
I20260709 14:53:20.612514  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:20.615221 13630 raft_consensus.cc:493] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:53:20.615931 13630 raft_consensus.cc:515] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:20.612778  7893 leader_election.cc:304] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:20.623901  7773 raft_consensus.cc:2468] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 14.
I20260709 14:53:20.624154  7893 leader_election.cc:304] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:20.627288  7923 raft_consensus.cc:1240] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 18. Current term is 19. Ops: [16.10-18.11]
I20260709 14:53:20.627802  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:20.547901 13781 raft_consensus.cc:2804] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 14:53:20.633304  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:20.635341  7928 raft_consensus.cc:2393] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 19: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:53:20.571802 13801 leader_election.cc:290] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:20.626677 13820 raft_consensus.cc:493] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:20.647162  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:20.647939  7928 raft_consensus.cc:3060] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 23 FOLLOWER]: Advancing to term 24
I20260709 14:53:20.642791  7923 raft_consensus.cc:2393] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 19: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:53:20.635675  7893 leader_election.cc:304] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:20.528362 13692 raft_consensus.cc:515] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:20.649834  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:20.547112 13835 consensus_queue.cc:1059] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.094s
I20260709 14:53:20.659535  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:20.627796 13771 raft_consensus.cc:2804] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 14:53:20.630080 13791 raft_consensus.cc:2749] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 14:53:20.662177  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:20.640014 13615 raft_consensus.cc:2804] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 14:53:20.672237  7922 raft_consensus.cc:1240] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 LEADER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 19. Current term is 20. Ops: []
I20260709 14:53:20.681573 13692 leader_election.cc:290] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:20.659505 13820 raft_consensus.cc:515] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:20.685424 13771 raft_consensus.cc:697] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:20.687593 13615 raft_consensus.cc:697] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:20.652498 13781 raft_consensus.cc:697] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:20.690225 13781 consensus_queue.cc:237] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:20.669219 13849 raft_consensus.cc:2804] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 14:53:20.693378  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:20.696838  7851 raft_consensus.cc:1240] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 18. Current term is 19. Ops: [18.10-18.10]
W20260709 14:53:20.699628 13903 log.cc:927] Time spent T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.481s	user 0.002s	sys 0.002s
I20260709 14:53:20.697808  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:20.700467 13630 leader_election.cc:290] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:20.700906  7848 raft_consensus.cc:2410] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for term 15 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 14:53:20.698134  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:20.701380 13849 raft_consensus.cc:697] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:20.701980  7854 raft_consensus.cc:2468] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 18.
I20260709 14:53:20.698745  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:20.699481  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:20.703400  7846 raft_consensus.cc:2468] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 19.
I20260709 14:53:20.697396  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258d6c2dda954bf5b65930fde8ecb9f3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:20.702348  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:20.719409  7928 raft_consensus.cc:2468] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 24.
W20260709 14:53:20.739152  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 112878us
I20260709 14:53:20.740617  7893 leader_election.cc:304] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:20.746807  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:20.747581  7928 raft_consensus.cc:3060] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Advancing to term 20
I20260709 14:53:20.702594 13849 consensus_queue.cc:237] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:53:20.741954 13911 log.cc:927] Time spent T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
W20260709 14:53:20.742856 13910 log.cc:927] Time spent T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.065s	user 0.000s	sys 0.002s
I20260709 14:53:20.688881 13615 consensus_queue.cc:237] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:20.745698 13836 raft_consensus.cc:3055] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 14:53:20.743640 13791 raft_consensus.cc:2749] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 14:53:20.768931  7928 raft_consensus.cc:2468] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 20.
I20260709 14:53:20.758543 13801 raft_consensus.cc:2749] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 14:53:20.687584 13771 consensus_queue.cc:237] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:20.791479 13603 raft_consensus.cc:3060] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Advancing to term 20
I20260709 14:53:20.766196 13820 leader_election.cc:290] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:20.796030 13859 raft_consensus.cc:515] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:20.798589 13859 leader_election.cc:290] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 17 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:20.764053 13836 raft_consensus.cc:740] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:20.800168 13836 consensus_queue.cc:260] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:20.801622 13836 raft_consensus.cc:3060] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Advancing to term 19
W20260709 14:53:20.783078 13905 log.cc:927] Time spent T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.567s	user 0.004s	sys 0.000s
I20260709 14:53:20.784485 13770 leader_election.cc:290] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:20.817397 13735 raft_consensus.cc:515] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:20.820313 13735 leader_election.cc:290] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:20.824575 13795 raft_consensus.cc:515] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:20.827579 13795 leader_election.cc:290] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 20 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:20.886157  7771 raft_consensus.cc:2368] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 19. Current term is 20.
I20260709 14:53:20.899338  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:20.902168  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:20.902323  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:20.904492  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:20.904423  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:20.906685  7846 raft_consensus.cc:2468] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 17.
I20260709 14:53:20.909001  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:20.912513  7850 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 4722) took 1599 ms. Trace:
I20260709 14:53:20.914012  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:20.915678  7854 raft_consensus.cc:2368] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 19. Current term is 20.
I20260709 14:53:20.912254  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:20.913204  7850 rpcz_store.cc:276] 0709 14:53:19.313408 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:53:19.313668 (+   260us) service_pool.cc:224] Handling call
0709 14:53:19.314035 (+   367us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:53:19.609711 (+295676us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:53:20.911574 (+1301863us) spinlock_profiling.cc:243] Waited 257 ms on lock 0x7b5400140fd4. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae8ee01 00007fb68ae8d83e 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2 00007fb6891c948c 00007fb6891c88c6
0709 14:53:20.912223 (+   649us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":591336704}
W20260709 14:53:20.915843  7852 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49948 (request call id 4305) took 2316 ms (client timeout 1724 ms). Trace:
W20260709 14:53:20.919840  7852 rpcz_store.cc:269] 0709 14:53:18.599041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:53:18.601362 (+  2321us) service_pool.cc:224] Handling call
0709 14:53:20.915246 (+2313884us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b54000947d4. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae922fa 00007fb68fe53b17 00007fb6893ce6d4 00007fb6893ce662 00007fb6893ce591 00007fb6893ce50c 00007fb6893cd7c2 00007fb6891c948c 00007fb6891c88c6 00007fb6891c826f
0709 14:53:20.915552 (+   306us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2491735424}
I20260709 14:53:20.906939  7847 raft_consensus.cc:2468] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 19.
I20260709 14:53:20.930578  7819 leader_election.cc:304] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:53:20.934695  7893 leader_election.cc:304] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:53:20.936668  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:53:20.939113  7920 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38516 (request call id 3100) took 2986 ms (client timeout 1535 ms). Trace:
I20260709 14:53:20.943308  7923 raft_consensus.cc:2410] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for term 19 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 14:53:20.946417  7925 raft_consensus.cc:2393] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 17: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:53:21.014464 13603 raft_consensus.cc:493] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:21.015764 13603 raft_consensus.cc:515] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:53:21.018097  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:21.023571  7745 leader_election.cc:304] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 3876b8ee8d744cb18e91d97aae93b1ac, 9418391fa82a42c79c6cad13ba91d964
I20260709 14:53:21.026295  7926 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38516 (request call id 3126) took 1096 ms. Trace:
I20260709 14:53:21.026947  7926 rpcz_store.cc:276] 0709 14:53:19.929693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:53:20.348314 (+418621us) service_pool.cc:224] Handling call
0709 14:53:20.467963 (+119649us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:53:20.469015 (+  1052us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:53:21.025723 (+556708us) spinlock_profiling.cc:243] Waited 119 ms on lock 0x7b5400311fd0. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae8d8ad 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2 00007fb6891c948c 00007fb6891c88c6 00007fb6891c826f
0709 14:53:21.026017 (+   294us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":274235648}
I20260709 14:53:21.032100 13630 consensus_queue.cc:1059] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 14:53:21.048825 13894 raft_consensus.cc:2804] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 14:53:21.034960 13530 raft_consensus.cc:493] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9418391fa82a42c79c6cad13ba91d964)
W20260709 14:53:20.960417  7920 rpcz_store.cc:269] 0709 14:53:17.952098 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:53:17.952222 (+   124us) service_pool.cc:224] Handling call
0709 14:53:20.938332 (+2986110us) spinlock_profiling.cc:243] Waited 1.9 s on lock 0x7b5400132ed4. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae922fa 00007fb68fe53b17 00007fb6893ce6d4 00007fb6893ce662 00007fb6893ce591 00007fb6893ce50c 00007fb6893cd7c2 00007fb6891c948c 00007fb6891c88c6 00007fb6891c826f
0709 14:53:20.938742 (+   410us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4361825664}
I20260709 14:53:21.034228 13795 raft_consensus.cc:493] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9418391fa82a42c79c6cad13ba91d964)
W20260709 14:53:21.147053  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 217204us
W20260709 14:53:21.162667  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:21.164373 13835 raft_consensus.cc:493] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:21.165441 13801 raft_consensus.cc:493] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:21.166126 13835 raft_consensus.cc:515] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:21.166563 13801 raft_consensus.cc:515] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:21.165668 13823 raft_consensus.cc:493] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:21.169624 13770 raft_consensus.cc:493] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:21.170236 13823 raft_consensus.cc:515] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:21.170591 13770 raft_consensus.cc:515] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:21.157783 13894 raft_consensus.cc:493] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Starting leader election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:53:21.169162 13835 leader_election.cc:290] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:21.179046 13801 leader_election.cc:290] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:53:21.225394  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 60495us
I20260709 14:53:21.220258 13894 raft_consensus.cc:3060] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Advancing to term 20
I20260709 14:53:21.251076 13770 leader_election.cc:290] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:53:21.268795  8598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 210131us
I20260709 14:53:21.277915 13821 consensus_queue.cc:1048] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 14:53:21.279633 13692 raft_consensus.cc:493] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:21.280642 13692 raft_consensus.cc:515] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:53:21.282032  7744 leader_election.cc:336] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785): Timed out: RequestConsensusVote RPC to 127.6.101.67:40785 timed out after 1.635s (SENT)
I20260709 14:53:21.283138  7744 leader_election.cc:304] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:21.283741  7675 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54350 (request call id 379) took 9262 ms. Trace:
W20260709 14:53:21.285298  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:21.233378 13530 raft_consensus.cc:515] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:53:21.289343 13773 raft_consensus.cc:493] T 9441e831627143a991a1556dcdce71e3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9418391fa82a42c79c6cad13ba91d964)
I20260709 14:53:21.278570 13673 raft_consensus.cc:493] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
W20260709 14:53:21.263868  7894 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.018s	sys 0.033s
W20260709 14:53:21.306046  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 371986us
I20260709 14:53:21.307785  7893 leader_election.cc:304] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:21.309111  7819 leader_election.cc:304] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed
W20260709 14:53:21.311021  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 58480.2us
I20260709 14:53:21.296696 13823 leader_election.cc:290] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:21.313035 13735 raft_consensus.cc:2749] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 14:53:21.314124 13735 raft_consensus.cc:2749] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 14:53:21.264782 13731 raft_consensus.cc:493] T 9ce9c0ef2db24c13a8b1402f21819458 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9418391fa82a42c79c6cad13ba91d964)
I20260709 14:53:21.291179 13673 raft_consensus.cc:515] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:21.317276 13731 raft_consensus.cc:515] T 9ce9c0ef2db24c13a8b1402f21819458 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:53:21.320091 13673 leader_election.cc:290] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:21.320317 13731 leader_election.cc:290] T 9ce9c0ef2db24c13a8b1402f21819458 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68:42321)
I20260709 14:53:21.320967  7922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38516 (request call id 3121) took 1901 ms. Trace:
I20260709 14:53:21.321440  7922 rpcz_store.cc:276] 0709 14:53:19.400268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:53:19.400406 (+   138us) service_pool.cc:224] Handling call
0709 14:53:19.400787 (+   381us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:53:20.673116 (+1272329us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:53:21.251028 (+577912us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b540041d2d4. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae8ee01 00007fb68ae8d83e 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2 00007fb6891c948c 00007fb6891c88c6
0709 14:53:21.300886 (+ 49858us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2923519872}
I20260709 14:53:21.264263 13852 raft_consensus.cc:2749] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 14:53:21.313946 13697 raft_consensus.cc:2804] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Leader election won for term 19
I20260709 14:53:21.326527 13697 raft_consensus.cc:697] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
W20260709 14:53:21.302255  7894 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.668s	user 0.019s	sys 0.033s
I20260709 14:53:21.289080 13530 leader_election.cc:290] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68:42321)
I20260709 14:53:21.248656 13795 raft_consensus.cc:515] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:53:21.327749  7819 leader_election.cc:304] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:21.302255 13603 leader_election.cc:290] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:21.360512  8640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18d29d52d304c87b930d4fb5eaf50b1" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9418391fa82a42c79c6cad13ba91d964" is_pre_election: true
I20260709 14:53:21.290606 13773 raft_consensus.cc:515] T 9441e831627143a991a1556dcdce71e3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
W20260709 14:53:21.366169  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 774720us
I20260709 14:53:21.366601 13820 raft_consensus.cc:3055] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 LEADER]: Stepping down as leader of term 15
I20260709 14:53:21.284507  7675 rpcz_store.cc:276] 0709 14:53:12.020690 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:53:12.020894 (+   204us) service_pool.cc:224] Handling call
0709 14:53:21.283429 (+9262535us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 14:53:17.201467 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 14:53:17.248285 (+ 46818us) write_op.cc:432] Acquiring schema lock in shared mode
0709 14:53:17.248327 (+    42us) write_op.cc:435] Acquired schema lock
0709 14:53:17.248346 (+    19us) tablet.cc:662] Decoding operations
0709 14:53:17.249447 (+  1101us) write_op.cc:620] Acquiring the partition lock for write op
0709 14:53:17.249526 (+    79us) write_op.cc:641] Partition lock acquired for write op
0709 14:53:17.249556 (+    30us) tablet.cc:685] Acquiring locks for 6 operations
0709 14:53:17.250123 (+   567us) tablet.cc:701] Row locks acquired
0709 14:53:17.250143 (+    20us) write_op.cc:260] PREPARE: finished
0709 14:53:17.250344 (+   201us) write_op.cc:270] Start()
0709 14:53:17.250488 (+   144us) write_op.cc:276] Timestamp: P: 1783608797250275 usec, L: 0
0709 14:53:17.250511 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 14:53:17.251397 (+   886us) log.cc:844] Serialized 2464 byte log entry
0709 14:53:17.741648 (+490251us) op_driver.cc:464] REPLICATION: finished
0709 14:53:17.864461 (+122813us) write_op.cc:301] APPLY: starting
0709 14:53:17.864554 (+    93us) tablet.cc:1367] starting BulkCheckPresence
0709 14:53:18.161585 (+297031us) tablet.cc:1370] finished BulkCheckPresence
0709 14:53:18.170370 (+  8785us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 14:53:18.476833 (+306463us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 14:53:18.503625 (+ 26792us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=12,key_file_lookups=12,delta_file_lookups=12,mrs_lookups=0
0709 14:53:18.507614 (+  3989us) write_op.cc:312] APPLY: finished
0709 14:53:18.507919 (+   305us) log.cc:844] Serialized 65 byte log entry
0709 14:53:18.508227 (+   308us) write_op.cc:489] Releasing partition, row and schema locks
0709 14:53:18.508347 (+   120us) write_op.cc:454] Released schema lock
0709 14:53:18.508401 (+    54us) write_op.cc:341] FINISH: Updating metrics
0709 14:53:18.508896 (+   495us) write_op.cc:489] Releasing partition, row and schema locks
0709 14:53:18.508928 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1469551,"reported_tablets":21,"child_traces":[["op",{"apply.queue_time_us":122524,"apply.run_cpu_time_us":16974,"apply.run_wall_time_us":644438,"cfile_cache_hit":26,"cfile_cache_hit_bytes":29135,"num_ops":6,"prepare.queue_time_us":180106,"prepare.run_cpu_time_us":40686,"prepare.run_wall_time_us":218501,"raft.queue_time_us":230840,"raft.run_cpu_time_us":7069,"raft.run_wall_time_us":96518,"replication_time_us":490932,"thread_start_us":457676,"threads_started":4,"wal-append.queue_time_us":192869,"wal-append.run_cpu_time_us":146145,"wal-append.run_wall_time_us":2147429}]]}
W20260709 14:53:21.373476  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 60875.9us
W20260709 14:53:21.360635  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 337396us
I20260709 14:53:21.381304 13823 raft_consensus.cc:2749] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 14:53:21.383798 13615 raft_consensus.cc:493] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:21.385113 13615 raft_consensus.cc:515] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:21.388798 13615 leader_election.cc:290] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:21.389226 13773 leader_election.cc:290] T 9441e831627143a991a1556dcdce71e3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68:42321)
I20260709 14:53:21.400290 13603 raft_consensus.cc:2804] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 14:53:21.396226  8637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce9c0ef2db24c13a8b1402f21819458" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9418391fa82a42c79c6cad13ba91d964" is_pre_election: true
I20260709 14:53:21.405587  7924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38516 (request call id 3137) took 1385 ms. Trace:
I20260709 14:53:21.378099 13820 raft_consensus.cc:740] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:53:21.406910  8640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9441e831627143a991a1556dcdce71e3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9418391fa82a42c79c6cad13ba91d964" is_pre_election: true
W20260709 14:53:21.412451 13922 log.cc:927] Time spent T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.068s	user 0.002s	sys 0.000s
I20260709 14:53:21.405685  7919 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38516 (request call id 3135) took 1416 ms. Trace:
W20260709 14:53:21.421381  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 113803us
I20260709 14:53:21.417891  7919 rpcz_store.cc:276] 0709 14:53:19.988784 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:53:20.466935 (+478151us) service_pool.cc:224] Handling call
0709 14:53:20.467308 (+   373us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:53:20.467551 (+   243us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 14:53:20.937004 (+469453us) log.cc:844] Serialized 14 byte log entry
0709 14:53:21.308848 (+371844us) log.cc:844] Serialized 14 byte log entry
0709 14:53:21.394535 (+ 85687us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:53:21.394623 (+    88us) raft_consensus.cc:1645] Marking committed up to 14
0709 14:53:21.400301 (+  5678us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:53:21.400431 (+   130us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:53:21.405438 (+  5007us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":216162,"prepare.queue_time_us":219884,"prepare.run_cpu_time_us":93,"prepare.run_wall_time_us":95,"raft.queue_time_us":122308,"raft.run_cpu_time_us":460,"raft.run_wall_time_us":28158,"thread_start_us":610951,"threads_started":2,"wal-append.queue_time_us":390282}
I20260709 14:53:21.425150  7893 leader_election.cc:304] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:21.406291 13603 raft_consensus.cc:493] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Starting leader election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
W20260709 14:53:21.419075  8599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 258299us
I20260709 14:53:21.438868 13603 raft_consensus.cc:3060] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Advancing to term 18
I20260709 14:53:21.444370  8640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18d29d52d304c87b930d4fb5eaf50b1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9418391fa82a42c79c6cad13ba91d964" is_pre_election: true
I20260709 14:53:21.410868  7924 rpcz_store.cc:276] 0709 14:53:20.019883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:53:20.479758 (+459875us) service_pool.cc:224] Handling call
0709 14:53:20.480142 (+   384us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:53:20.480399 (+   257us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 14:53:20.944705 (+464306us) log.cc:844] Serialized 14 byte log entry
0709 14:53:21.315931 (+371226us) log.cc:844] Serialized 14 byte log entry
0709 14:53:21.400715 (+ 84784us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:53:21.404574 (+  3859us) raft_consensus.cc:1645] Marking committed up to 13
0709 14:53:21.404686 (+   112us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:53:21.404851 (+   165us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:53:21.405371 (+   520us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":261936,"prepare.queue_time_us":239938,"prepare.run_cpu_time_us":138,"prepare.run_wall_time_us":2540,"raft.queue_time_us":103991,"raft.run_cpu_time_us":509,"raft.run_wall_time_us":25311,"thread_start_us":658628,"threads_started":2}
I20260709 14:53:21.445681 13820 consensus_queue.cc:260] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:21.417567 13795 leader_election.cc:290] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68:42321)
I20260709 14:53:21.447667 13820 raft_consensus.cc:3060] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Advancing to term 16
I20260709 14:53:21.409924 13692 leader_election.cc:290] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:53:21.450902  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:21.412250 13697 consensus_queue.cc:237] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:53:21.457664  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 51682.7us
I20260709 14:53:21.483536 13781 raft_consensus.cc:2749] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 14:53:21.486304  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 306675us
I20260709 14:53:21.491878  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
W20260709 14:53:21.496044  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 73304.8us
I20260709 14:53:21.477056 13692 consensus_queue.cc:1059] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.024s
I20260709 14:53:21.505630  7674 catalog_manager.cc:5697] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 18 to 19, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 19 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:53:21.514293  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783e4874513449ef9084b833f188a6d3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:21.515177 13829 raft_consensus.cc:493] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:21.521834 13829 raft_consensus.cc:515] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:21.523893 13937 raft_consensus.cc:493] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:21.529105 13937 raft_consensus.cc:515] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:21.531160  7928 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38532 (request call id 3939) took 1042 ms. Trace:
I20260709 14:53:21.534245  7893 leader_election.cc:304] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:21.536131 13731 raft_consensus.cc:2804] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 14:53:21.536900 13731 raft_consensus.cc:697] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 22 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:21.538785 13530 raft_consensus.cc:3055] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 LEADER]: Stepping down as leader of term 18
W20260709 14:53:21.540359  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:21.538419 13731 consensus_queue.cc:237] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:21.533708  7928 rpcz_store.cc:276] 0709 14:53:20.488557 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:53:20.772177 (+283620us) service_pool.cc:224] Handling call
0709 14:53:20.772802 (+   625us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:53:20.773276 (+   474us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 14:53:20.947559 (+174283us) log.cc:844] Serialized 14 byte log entry
0709 14:53:21.492731 (+545172us) spinlock_profiling.cc:243] Waited 6.55 ms on lock 0x7b18002dc880. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb690c69de1 00007fb690c765b1 00007fb68aa364bc 00007fb687d8448b 00007fb690bdeab9 00007fb687da069b 00007fb687d9e93f 00007fb687da0c02 00007fb68aa2820b 00007fb68aa2dd23 00007fb68aa2e23a
0709 14:53:21.494951 (+  2220us) log.cc:844] Serialized 14 byte log entry
0709 14:53:21.500369 (+  5418us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:53:21.521547 (+ 21178us) log.cc:844] Serialized 26 byte log entry
0709 14:53:21.521884 (+   337us) raft_consensus.cc:1645] Marking committed up to 9
0709 14:53:21.521946 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:53:21.522120 (+   174us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:53:21.530348 (+  8228us) raft_consensus.cc:1685] finished
0709 14:53:21.530379 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:53:21.530918 (+   539us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":69121,"prepare.queue_time_us":401478,"prepare.run_cpu_time_us":133,"prepare.run_wall_time_us":4526,"raft.queue_time_us":1182,"raft.run_cpu_time_us":550,"raft.run_wall_time_us":4082,"spinlock_wait_cycles":15058816,"thread_start_us":282583,"threads_started":1,"wal-append.queue_time_us":487434}
I20260709 14:53:21.545548 13629 consensus_queue.cc:1059] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 14:53:21.546525 13673 consensus_queue.cc:1059] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 14:53:21.545024 13773 consensus_queue.cc:1048] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 14:53:21.550266 13829 leader_election.cc:290] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:21.554029 13530 raft_consensus.cc:740] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:53:21.557229 13629 raft_consensus.cc:3055] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 LEADER]: Stepping down as leader of term 21
I20260709 14:53:21.563772  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:21.559548  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:21.568926 13812 raft_consensus.cc:493] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:21.568693 13882 raft_consensus.cc:493] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:21.570173 13882 raft_consensus.cc:515] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:21.570168 13812 raft_consensus.cc:515] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:21.572888  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:21.573827  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:53:21.573203  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:21.578111  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:21.578302 13812 leader_election.cc:290] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:21.578442 13882 leader_election.cc:290] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:21.579746  7775 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775"
dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
mode: GRACEFUL
new_leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:58612
I20260709 14:53:21.580744  7775 raft_consensus.cc:606] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Received request to transfer leadership to TS 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:21.581175  7775 raft_consensus.cc:614] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 14:53:21.585564  7674 catalog_manager.cc:5697] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 20 to 21, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 21 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:53:21.588438  7674 catalog_manager.cc:5697] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 17 to 18, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 18 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
W20260709 14:53:21.595950  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 61989.4us
W20260709 14:53:21.589978  7745 leader_election.cc:336] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 1.571s (SENT)
I20260709 14:53:21.596689  7745 leader_election.cc:304] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:21.598276 13894 raft_consensus.cc:515] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:21.599587 13829 raft_consensus.cc:2749] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 14:53:21.593981  7847 raft_consensus.cc:1240] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 19. Current term is 20. Ops: []
I20260709 14:53:21.590986 13530 consensus_queue.cc:260] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:21.561183 13629 raft_consensus.cc:740] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:53:21.595463 13630 raft_consensus.cc:3055] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 LEADER]: Stepping down as leader of term 15
I20260709 14:53:21.563930 13692 consensus_queue.cc:1048] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.030s
I20260709 14:53:21.595822 13603 raft_consensus.cc:515] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:21.594340 13937 leader_election.cc:290] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:21.607549 13894 leader_election.cc:290] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 20 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:21.612655  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:53:21.616263  7745 leader_election.cc:336] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 1.645s (SENT)
I20260709 14:53:21.616888  7745 leader_election.cc:304] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:21.617913 13852 raft_consensus.cc:493] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:21.621356 13852 raft_consensus.cc:515] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:21.624070 13852 leader_election.cc:290] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:53:21.622005  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:21.638154 13882 raft_consensus.cc:493] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:21.625590  7819 leader_election.cc:400] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 election: Vote denied by peer 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785) with higher term. Message: Invalid argument: T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 13. Current term is 14.
I20260709 14:53:21.654059  7819 leader_election.cc:403] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
W20260709 14:53:21.654752  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 95813.6us
I20260709 14:53:21.655800  7819 leader_election.cc:304] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:21.603492 13630 raft_consensus.cc:740] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:53:21.658218 13630 consensus_queue.cc:260] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:21.659906 13630 raft_consensus.cc:3060] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Advancing to term 16
I20260709 14:53:21.641019 13937 raft_consensus.cc:493] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:21.662395 13937 raft_consensus.cc:515] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:21.641883 13795 raft_consensus.cc:2749] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 14:53:21.642676  7745 leader_election.cc:336] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 1.724s (SENT)
I20260709 14:53:21.643049 13603 leader_election.cc:290] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 18 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:21.638278 13852 consensus_queue.cc:1059] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.008s
I20260709 14:53:21.650452  7893 leader_election.cc:304] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:21.657018  7819 leader_election.cc:304] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:21.666059 13673 raft_consensus.cc:2749] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785) with higher term. Message: Invalid argument: T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 13. Current term is 14.
I20260709 14:53:21.668159 13882 raft_consensus.cc:515] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:21.670794 13882 leader_election.cc:290] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:21.671394 13882 raft_consensus.cc:493] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:21.638345 13629 consensus_queue.cc:260] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:21.672358 13773 raft_consensus.cc:2804] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 14:53:21.673178 13773 raft_consensus.cc:493] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:21.673594 13820 consensus_queue.cc:1059] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 14:53:21.674808 13629 raft_consensus.cc:3060] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Advancing to term 22
I20260709 14:53:21.675387  7893 leader_election.cc:304] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:53:21.673718 13773 raft_consensus.cc:3060] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Advancing to term 19
I20260709 14:53:21.674811 13771 consensus_queue.cc:1059] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.002s
I20260709 14:53:21.677698 13823 raft_consensus.cc:2804] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 14:53:21.678185 13823 raft_consensus.cc:493] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:21.678750 13823 raft_consensus.cc:3060] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 14:53:21.676148 13821 raft_consensus.cc:3055] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 LEADER]: Stepping down as leader of term 18
I20260709 14:53:21.674011 13835 raft_consensus.cc:2749] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 14:53:21.680328 13821 raft_consensus.cc:740] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:53:21.681573 13821 consensus_queue.cc:260] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:21.682562 13937 leader_election.cc:290] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:21.683218 13821 raft_consensus.cc:3060] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Advancing to term 19
I20260709 14:53:21.676777  7893 leader_election.cc:304] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:21.671624 13603 raft_consensus.cc:493] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:21.685345 13603 raft_consensus.cc:515] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:21.686658 13836 raft_consensus.cc:3055] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 14:53:21.687107 13836 raft_consensus.cc:740] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:21.688233 13836 consensus_queue.cc:260] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:21.685899 13692 raft_consensus.cc:2804] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 14:53:21.690994 13692 raft_consensus.cc:493] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:21.691980 13692 raft_consensus.cc:3060] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Advancing to term 15
I20260709 14:53:21.672017 13882 raft_consensus.cc:515] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:21.690552 13836 raft_consensus.cc:3060] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Advancing to term 22
I20260709 14:53:21.696399  7819 leader_election.cc:304] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:21.697192 13673 consensus_queue.cc:1059] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 14:53:21.697816 13781 consensus_queue.cc:1059] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 14:53:21.708423 13781 raft_consensus.cc:3055] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 14:53:21.709056 13781 raft_consensus.cc:740] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:21.710254 13781 consensus_queue.cc:260] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:21.711632 13781 raft_consensus.cc:3060] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Advancing to term 20
I20260709 14:53:21.712304 13820 raft_consensus.cc:2749] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 14:53:21.700313 13852 raft_consensus.cc:2749] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 14:53:21.701043  7893 leader_election.cc:304] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:53:21.715236  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:21.706029 13530 raft_consensus.cc:3060] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Advancing to term 19
I20260709 14:53:21.706040 13882 leader_election.cc:290] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:21.701566 13603 leader_election.cc:290] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:21.697043  7674 catalog_manager.cc:5697] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 18 to 19, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 19 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:53:21.722141 13852 raft_consensus.cc:2749] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 14:53:21.729653  7674 catalog_manager.cc:5697] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 12 to 15, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 15 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
W20260709 14:53:21.730897  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:21.731487  7674 catalog_manager.cc:5697] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 15 to 18, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 18 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:53:21.733776  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:21.735345  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:21.736506  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:21.737321  7853 raft_consensus.cc:2468] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 15.
I20260709 14:53:21.737772  7845 raft_consensus.cc:1240] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 16. Current term is 17. Ops: []
I20260709 14:53:21.736752  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:21.740717  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:21.742194 13894 raft_consensus.cc:3055] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 LEADER]: Stepping down as leader of term 17
I20260709 14:53:21.742663 13894 raft_consensus.cc:740] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
W20260709 14:53:21.743212  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:21.744560 13894 consensus_queue.cc:260] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:21.746255 13894 raft_consensus.cc:3060] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Advancing to term 18
I20260709 14:53:21.747145  7893 leader_election.cc:304] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:21.750528 13773 raft_consensus.cc:515] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:21.753465 13773 leader_election.cc:290] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 19 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:21.757735 13937 raft_consensus.cc:493] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:21.758544 13937 raft_consensus.cc:515] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:21.759886 13823 raft_consensus.cc:515] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:53:21.762413  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 66176us
I20260709 14:53:21.765986  7775 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f"
dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
mode: GRACEFUL
new_leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:58612
I20260709 14:53:21.766724  7775 raft_consensus.cc:606] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Received request to transfer leadership to TS 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:21.767061  7775 raft_consensus.cc:614] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 14:53:21.750432 13731 raft_consensus.cc:2804] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 14:53:21.761550 13937 leader_election.cc:290] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:21.764442  7674 catalog_manager.cc:5697] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 19 to 20, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 20 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:53:21.778672  7775 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e"
dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
mode: GRACEFUL
new_leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:58612
I20260709 14:53:21.779512  7775 raft_consensus.cc:606] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 LEADER]: Received request to transfer leadership to TS 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:21.784255  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:21.784592  7851 raft_consensus.cc:1275] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 14:53:21.780213 13731 raft_consensus.cc:697] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:21.787365 13731 consensus_queue.cc:237] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:21.789093  7928 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
mode: GRACEFUL
new_leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:48676
I20260709 14:53:21.789837  7928 raft_consensus.cc:606] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 22 LEADER]: Received request to transfer leadership to TS 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:21.793478  7928 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
mode: GRACEFUL
new_leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:48676
W20260709 14:53:21.793830  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 44842.8us
I20260709 14:53:21.794170  7928 raft_consensus.cc:606] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Received request to transfer leadership to TS 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:21.794560  7928 raft_consensus.cc:614] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 14:53:21.774159 13823 leader_election.cc:290] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:21.793478  7674 catalog_manager.cc:5697] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 12 to 16. New cstate: current_term: 16 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:53:21.801195  6549 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 14:53:21.804639  6549 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 14:53:21.813478  7893 leader_election.cc:400] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 election: Vote denied by peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587) with higher term. Message: Invalid argument: T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 19. Current term is 20.
I20260709 14:53:21.813414  7894 leader_election.cc:304] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:21.815409 13937 raft_consensus.cc:493] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:21.819152 13795 raft_consensus.cc:493] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:21.817416 13781 raft_consensus.cc:2804] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 14:53:21.821319 13852 consensus_queue.cc:1059] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.003s
I20260709 14:53:21.822230 13795 raft_consensus.cc:515] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:21.826210 13852 raft_consensus.cc:3055] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 14:53:21.827708  7775 raft_consensus.cc:1240] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 22 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 21. Current term is 22. Ops: []
I20260709 14:53:21.828025 13795 leader_election.cc:290] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:21.819796 13937 raft_consensus.cc:515] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:21.823676 13781 raft_consensus.cc:493] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:21.829610 13781 raft_consensus.cc:3060] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 14:53:21.831024  7674 catalog_manager.cc:5697] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 16 to 17, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 17 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:53:21.833478  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:21.840124  7778 raft_consensus.cc:2468] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 16.
I20260709 14:53:21.831184 13937 leader_election.cc:290] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:21.842105  7674 catalog_manager.cc:5697] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 16 to 17, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 17 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:53:21.843034  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
W20260709 14:53:21.846467  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:21.847817  7778 raft_consensus.cc:1240] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 24 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 23. Current term is 24. Ops: [23.14-23.14]
I20260709 14:53:21.849521  7674 catalog_manager.cc:5697] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 13 to 15, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 15 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:53:21.826797 13852 raft_consensus.cc:740] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:21.859352  7851 raft_consensus.cc:1275] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 14:53:21.857496 13823 consensus_queue.cc:1048] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 14:53:21.863920  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:21.864861  7771 raft_consensus.cc:2393] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 20: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:53:21.864940  7778 raft_consensus.cc:1240] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 18. Current term is 19. Ops: []
I20260709 14:53:21.855057 13692 raft_consensus.cc:515] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:53:21.873431  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 72726.2us
I20260709 14:53:21.878188  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:21.879411  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783e4874513449ef9084b833f188a6d3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
W20260709 14:53:21.883890  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:21.880545 13852 consensus_queue.cc:260] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:21.888283 13852 raft_consensus.cc:3060] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 14:53:21.889873  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:21.883827  7744 leader_election.cc:304] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:21.896727 13937 raft_consensus.cc:2749] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 14:53:21.899583  7744 leader_election.cc:304] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:21.875320 13692 leader_election.cc:290] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:21.910713  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:21.914074  7674 catalog_manager.cc:5697] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 16 to 17, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 17 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:53:21.908437 13937 raft_consensus.cc:2749] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 14:53:21.910223 13882 consensus_queue.cc:1048] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.010s
I20260709 14:53:21.922966  7928 raft_consensus.cc:2393] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 20: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:53:21.934689  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:21.943444  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1f7722fdea49e0b5e9c5d96633eaf9" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:21.947218 13937 raft_consensus.cc:493] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:21.948101 13937 raft_consensus.cc:515] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:21.948410  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:21.950917 13937 leader_election.cc:290] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:21.955536 13836 raft_consensus.cc:493] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:21.956389 13836 raft_consensus.cc:515] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:21.940958  7919 raft_consensus.cc:1240] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 13. Current term is 14. Ops: []
I20260709 14:53:21.959035 13836 leader_election.cc:290] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:21.962462  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:21.963809 13781 raft_consensus.cc:515] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:21.968559 13731 raft_consensus.cc:493] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
W20260709 14:53:21.986883  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 87485.3us
I20260709 14:53:21.975325  7853 raft_consensus.cc:1275] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 22 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
W20260709 14:53:21.991997  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:21.987275 13882 raft_consensus.cc:493] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:21.993021 13731 raft_consensus.cc:515] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:21.994398 13937 consensus_queue.cc:1059] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 14:53:21.995451 13882 raft_consensus.cc:515] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:21.996281 13937 raft_consensus.cc:3055] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 LEADER]: Stepping down as leader of term 18
I20260709 14:53:21.994679 13823 consensus_queue.cc:1048] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.002s
I20260709 14:53:21.998150  7745 leader_election.cc:304] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:21.999644 13795 raft_consensus.cc:2749] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 14:53:22.000314  7924 raft_consensus.cc:1240] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 15. Current term is 16. Ops: []
I20260709 14:53:22.000793 13731 leader_election.cc:290] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:22.010028  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:22.016420 13882 leader_election.cc:290] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:22.017765  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:22.020177  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:22.008589 13937 raft_consensus.cc:740] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:53:22.026487 13937 consensus_queue.cc:260] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:22.028072 13937 raft_consensus.cc:3060] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Advancing to term 19
I20260709 14:53:22.039745 13781 leader_election.cc:290] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:22.041597  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:22.042659  7853 raft_consensus.cc:3060] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Advancing to term 16
I20260709 14:53:22.048444 13795 consensus_queue.cc:1059] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 14:53:22.048697  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783e4874513449ef9084b833f188a6d3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:22.050159 13829 raft_consensus.cc:3055] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 LEADER]: Stepping down as leader of term 18
I20260709 14:53:22.050587 13829 raft_consensus.cc:740] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:53:22.051101  7745 leader_election.cc:304] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:22.051576 13829 consensus_queue.cc:260] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:22.052944 13795 raft_consensus.cc:2804] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 14:53:22.053526 13795 raft_consensus.cc:493] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:22.054116 13795 raft_consensus.cc:3060] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Advancing to term 19
I20260709 14:53:22.054589 13829 raft_consensus.cc:3060] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Advancing to term 19
W20260709 14:53:22.057992  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:22.066056  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:22.067013  7775 raft_consensus.cc:3060] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Advancing to term 19
I20260709 14:53:22.068710  7921 raft_consensus.cc:2468] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 17.
I20260709 14:53:22.074258  7928 raft_consensus.cc:2468] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 19.
W20260709 14:53:22.074829  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:22.086899  7853 raft_consensus.cc:2468] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 16.
I20260709 14:53:22.090283  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:22.092355  7776 raft_consensus.cc:3060] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Advancing to term 17
I20260709 14:53:22.100364  7775 raft_consensus.cc:2468] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 19.
I20260709 14:53:22.112972  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:22.116403  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783e4874513449ef9084b833f188a6d3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:22.116428  7894 leader_election.cc:304] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:22.117818  7744 leader_election.cc:304] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:22.122211  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:22.123709  7745 leader_election.cc:304] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:22.125430  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:22.126273  7773 raft_consensus.cc:2468] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 17.
I20260709 14:53:22.134451 13795 raft_consensus.cc:515] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:22.123322 13781 raft_consensus.cc:2804] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 14:53:22.156575  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:22.156895 13795 leader_election.cc:290] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:22.157709  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258d6c2dda954bf5b65930fde8ecb9f3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:22.189841  7776 raft_consensus.cc:2468] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 17.
I20260709 14:53:22.193986 13781 raft_consensus.cc:697] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:22.200029  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:22.194268 13955 raft_consensus.cc:2749] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 14:53:22.216910  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:22.220396  7923 raft_consensus.cc:1240] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 16. Current term is 17. Ops: []
I20260709 14:53:22.222075  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:22.231729 13781 consensus_queue.cc:237] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:53:22.232631  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:22.239691  7927 raft_consensus.cc:3060] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Advancing to term 20
W20260709 14:53:22.241990  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 124298us
W20260709 14:53:22.243091  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 147583us
I20260709 14:53:22.244603  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:22.246306  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:22.243209  7744 leader_election.cc:304] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:22.260499  7853 raft_consensus.cc:1275] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 12. (term mismatch)
I20260709 14:53:22.262252  7853 pending_rounds.cc:85] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting all ops after (but not including) 11
I20260709 14:53:22.262492  7853 pending_rounds.cc:107] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting uncommitted NO_OP operation due to leader change: 19.12
I20260709 14:53:22.262849  7853 raft_consensus.cc:2889] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:53:22.267527 13957 raft_consensus.cc:493] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:22.271193 13957 raft_consensus.cc:515] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:22.268388  7745 leader_election.cc:304] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:22.273159  7925 raft_consensus.cc:1240] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 24 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 23. Current term is 24. Ops: [20.12-23.14]
I20260709 14:53:22.274719  7927 raft_consensus.cc:2468] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 20.
I20260709 14:53:22.280009  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c563cc7cfbe4d59be4ffc5cf847ce56" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
W20260709 14:53:22.280821  7743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:22.273692 13957 leader_election.cc:290] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:22.276015 13795 raft_consensus.cc:2749] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 14:53:22.277307  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:22.277534 13829 raft_consensus.cc:2749] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 14:53:22.278477  7745 leader_election.cc:304] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:22.284730 13829 raft_consensus.cc:2804] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 14:53:22.285815  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:22.279911  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:22.285338 13829 raft_consensus.cc:493] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:22.264189 13955 raft_consensus.cc:493] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:22.257301 13956 raft_consensus.cc:2749] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 14:53:22.274149 13731 raft_consensus.cc:493] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:22.292873 13829 raft_consensus.cc:3060] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Advancing to term 18
I20260709 14:53:22.297622  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:22.295691  7922 raft_consensus.cc:2468] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 17.
W20260709 14:53:22.301185  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:22.303146  7925 raft_consensus.cc:2393] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 17: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:53:22.286192 13823 raft_consensus.cc:493] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:22.304577 13823 raft_consensus.cc:515] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:22.307832  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:22.312893  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:22.311136  7920 raft_consensus.cc:2468] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 12.
I20260709 14:53:22.313719  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
W20260709 14:53:22.315160  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:53:22.316480  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:22.316928  7819 leader_election.cc:304] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:22.320235  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:22.332901 13894 raft_consensus.cc:2749] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 14:53:22.325480 13731 raft_consensus.cc:515] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:22.342588  7927 raft_consensus.cc:2468] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 18.
I20260709 14:53:22.344060 13731 leader_election.cc:290] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:22.301054 13955 raft_consensus.cc:515] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:22.359980 13836 raft_consensus.cc:993] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0: : Instructing follower 3876b8ee8d744cb18e91d97aae93b1ac to start an election
W20260709 14:53:22.363481  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 50543.2us
I20260709 14:53:22.367370  7921 raft_consensus.cc:1275] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 14:53:22.368150 13956 raft_consensus.cc:993] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed: : Instructing follower 3876b8ee8d744cb18e91d97aae93b1ac to start an election
I20260709 14:53:22.368788 13956 raft_consensus.cc:1081] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 LEADER]: Signalling peer 3876b8ee8d744cb18e91d97aae93b1ac to start an election
I20260709 14:53:22.370323 13955 leader_election.cc:290] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:22.373153 13852 raft_consensus.cc:1081] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 22 LEADER]: Signalling peer 3876b8ee8d744cb18e91d97aae93b1ac to start an election
I20260709 14:53:22.383220 13795 raft_consensus.cc:493] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:22.384030 13795 raft_consensus.cc:515] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:22.383904 13823 leader_election.cc:290] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:53:22.393198  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:22.392835  7893 leader_election.cc:304] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:22.395632 13795 leader_election.cc:290] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:22.396137 13829 raft_consensus.cc:515] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:22.396739 13836 raft_consensus.cc:2749] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 14:53:22.398157 13836 raft_consensus.cc:493] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:53:22.398847 13836 raft_consensus.cc:515] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:53:22.404660  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 143611us
I20260709 14:53:22.406291  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:22.407539  7928 raft_consensus.cc:3060] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Advancing to term 19
I20260709 14:53:22.415306  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:22.417819  7847 raft_consensus.cc:2468] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 18.
I20260709 14:53:22.417892 13882 consensus_queue.cc:1048] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.004s
I20260709 14:53:22.423038  7928 raft_consensus.cc:2468] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 19.
I20260709 14:53:22.425414  7852 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9"
dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:49946
I20260709 14:53:22.426371  7852 raft_consensus.cc:493] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 22 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:53:22.426775  7852 raft_consensus.cc:3060] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 22 FOLLOWER]: Advancing to term 23
I20260709 14:53:22.429363 13829 leader_election.cc:290] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:22.431625  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:22.432518  7853 raft_consensus.cc:2468] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 20.
I20260709 14:53:22.440308  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:22.443264  7853 raft_consensus.cc:1275] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
W20260709 14:53:22.442994  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 199929us
I20260709 14:53:22.443941  7851 raft_consensus.cc:1240] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 14. Current term is 15. Ops: []
I20260709 14:53:22.442384  7894 leader_election.cc:304] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:22.450872  7847 raft_consensus.cc:1275] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
W20260709 14:53:22.451295  7742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:22.452150  7850 raft_consensus.cc:2393] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 19: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:53:22.452044 13781 raft_consensus.cc:2804] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 14:53:22.452728 13781 raft_consensus.cc:493] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:22.453362 13781 raft_consensus.cc:3060] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Advancing to term 19
I20260709 14:53:22.417804 13836 leader_election.cc:290] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:22.449450  7894 leader_election.cc:304] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:22.459046  7852 raft_consensus.cc:515] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 23 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:53:22.465191  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:22.463693 13882 raft_consensus.cc:2804] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 14:53:22.465715 13823 consensus_queue.cc:1048] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.003s
I20260709 14:53:22.470348 13962 consensus_queue.cc:1048] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 14:53:22.466058 13967 consensus_queue.cc:1059] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 14:53:22.473413  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 67366.3us
I20260709 14:53:22.474143 13852 raft_consensus.cc:3055] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 14:53:22.474571 13852 raft_consensus.cc:740] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:22.475502 13852 consensus_queue.cc:260] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:22.476696 13852 raft_consensus.cc:3060] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 14:53:22.466958 13882 raft_consensus.cc:493] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:22.468344  7744 leader_election.cc:304] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:22.477226  7819 leader_election.cc:304] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:22.478171 13882 raft_consensus.cc:3060] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Advancing to term 21
I20260709 14:53:22.479277  7852 leader_election.cc:290] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 23 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:22.480459 13829 raft_consensus.cc:3060] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Advancing to term 16
I20260709 14:53:22.482127 13894 raft_consensus.cc:2804] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 22 FOLLOWER]: Leader election won for term 22
I20260709 14:53:22.482975 13894 raft_consensus.cc:697] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 22 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:53:22.484037 13894 consensus_queue.cc:237] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:22.492075 13781 raft_consensus.cc:515] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:53:22.498395  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:22.499583  7819 leader_election.cc:304] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:22.504092  7744 leader_election.cc:304] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:53:22.505182 13795 raft_consensus.cc:2804] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 14:53:22.505805 13795 raft_consensus.cc:493] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:22.505538 13882 raft_consensus.cc:515] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:22.506685 13795 raft_consensus.cc:3060] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Advancing to term 16
I20260709 14:53:22.505750  7744 leader_election.cc:304] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:22.516438 13964 raft_consensus.cc:2749] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 14:53:22.518667 13773 raft_consensus.cc:2804] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Leader election won for term 20
I20260709 14:53:22.519503 13773 raft_consensus.cc:697] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:53:22.519570 13795 raft_consensus.cc:515] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:22.520578 13773 consensus_queue.cc:237] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:22.522410  7819 leader_election.cc:304] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:22.523808 13692 raft_consensus.cc:2764] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Leader election decision vote started in defunct term 15: won
I20260709 14:53:22.524482  7819 leader_election.cc:304] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:22.525401 13692 raft_consensus.cc:2804] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Leader election won for term 19
I20260709 14:53:22.525913 13692 raft_consensus.cc:697] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:53:22.521468  7744 leader_election.cc:304] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:53:22.528550 13692 consensus_queue.cc:237] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:22.529582 13955 raft_consensus.cc:2804] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 24 FOLLOWER]: Leader election won for term 24
I20260709 14:53:22.530637 13955 raft_consensus.cc:697] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 24 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:53:22.532203 13955 consensus_queue.cc:237] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:22.534269 13829 raft_consensus.cc:2749] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 14:53:22.535786  7744 leader_election.cc:304] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:53:22.537739 13829 raft_consensus.cc:2804] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Leader election won for term 20
I20260709 14:53:22.542217 13829 raft_consensus.cc:697] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:53:22.543605 13829 consensus_queue.cc:237] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:22.550405  7744 leader_election.cc:304] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:22.558187 13956 raft_consensus.cc:3060] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Advancing to term 17
I20260709 14:53:22.560820  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:22.562413  7850 raft_consensus.cc:3060] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Advancing to term 19
I20260709 14:53:22.568783 13962 raft_consensus.cc:493] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:53:22.569553 13962 raft_consensus.cc:515] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:22.571849 13962 leader_election.cc:290] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:22.569094  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:22.573104  7847 raft_consensus.cc:3060] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Advancing to term 21
I20260709 14:53:22.575718 13795 leader_election.cc:290] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 16 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:22.587471 13956 raft_consensus.cc:2749] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 14:53:22.590391  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:22.590859 13781 leader_election.cc:290] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:22.593806  7744 leader_election.cc:304] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:53:22.595651  7744 leader_election.cc:304] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:53:22.596201 13964 raft_consensus.cc:2804] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 14:53:22.596675 13937 raft_consensus.cc:2804] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 14:53:22.597186 13937 raft_consensus.cc:493] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting leader election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:22.597654 13937 raft_consensus.cc:3060] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Advancing to term 13
I20260709 14:53:22.600586  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:22.601773  7851 raft_consensus.cc:2393] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 18: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
W20260709 14:53:22.615746  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:22.588173 13836 raft_consensus.cc:493] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:22.630661  7850 raft_consensus.cc:2468] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 19.
I20260709 14:53:22.634972  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:22.638464  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:22.640275  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:22.641086  7778 raft_consensus.cc:2468] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 21.
I20260709 14:53:22.596710 13964 raft_consensus.cc:493] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting leader election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:22.627756  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:22.645051  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce9c0ef2db24c13a8b1402f21819458" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:22.647887  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:22.646397  7894 leader_election.cc:304] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:22.645583  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:22.648027  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:22.649060  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:22.650053  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:22.650192  7775 raft_consensus.cc:2468] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 20.
I20260709 14:53:22.647578  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:22.650830  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:22.651886  7923 raft_consensus.cc:2468] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 22.
I20260709 14:53:22.651775  7920 raft_consensus.cc:2468] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 19.
W20260709 14:53:22.653825  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 95319.8us
I20260709 14:53:22.655740  7924 raft_consensus.cc:2393] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 16: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:53:22.656947  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:22.633512 13852 raft_consensus.cc:493] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:22.661914 13835 raft_consensus.cc:2804] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 14:53:22.661774 13852 raft_consensus.cc:515] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:22.659003  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:22.609647 13795 consensus_queue.cc:1048] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.041s
I20260709 14:53:22.669679  7919 raft_consensus.cc:2393] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 19: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:53:22.660115  7778 raft_consensus.cc:1240] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 19. Current term is 20. Ops: []
I20260709 14:53:22.675258  7773 raft_consensus.cc:1275] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 14:53:22.675705  7779 raft_consensus.cc:1275] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 14:53:22.659070 13882 leader_election.cc:290] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 21 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:22.650856 13964 raft_consensus.cc:3060] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Advancing to term 18
I20260709 14:53:22.680830 13692 consensus_queue.cc:1059] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 14:53:22.643189 13836 raft_consensus.cc:515] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:22.684783 13894 consensus_queue.cc:1048] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 14:53:22.702509  7847 raft_consensus.cc:2468] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 21.
W20260709 14:53:22.703102  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 56805.4us
I20260709 14:53:22.705801  7775 raft_consensus.cc:1275] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 14:53:22.727530  7776 raft_consensus.cc:1275] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 14:53:22.730593  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:22.731289  7773 raft_consensus.cc:2468] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 15.
I20260709 14:53:22.737347  7775 raft_consensus.cc:1240] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 16. Current term is 17. Ops: []
I20260709 14:53:22.750499  7819 leader_election.cc:304] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:22.757340  7774 raft_consensus.cc:1240] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 19. Current term is 20. Ops: []
I20260709 14:53:22.764518  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:22.765628  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:22.767355  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:22.768471  7777 raft_consensus.cc:2468] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 15.
I20260709 14:53:22.772177  7894 leader_election.cc:304] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:22.753748  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:22.780683  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:22.781780  7772 raft_consensus.cc:2393] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 16: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:53:22.786078 13852 leader_election.cc:290] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:22.777158 13773 raft_consensus.cc:2804] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 14:53:22.797134 13836 leader_election.cc:290] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:22.793298 13852 raft_consensus.cc:2804] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 14:53:22.798422 13852 raft_consensus.cc:697] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:22.799736 13852 consensus_queue.cc:237] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:53:22.809052  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:22.812459  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:22.794943 13773 raft_consensus.cc:493] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:22.816497 13773 raft_consensus.cc:3060] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Advancing to term 17
I20260709 14:53:22.818058 13530 raft_consensus.cc:3055] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 LEADER]: Stepping down as leader of term 13
I20260709 14:53:22.818692 13530 raft_consensus.cc:740] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:53:22.827502 13835 raft_consensus.cc:697] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:22.812741  6549 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 14:53:22.838454 13981 log.cc:927] Time spent T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.114s	user 0.002s	sys 0.000s
W20260709 14:53:22.859560  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 87473.7us
I20260709 14:53:22.863745  7847 raft_consensus.cc:1240] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 23 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 22. Current term is 23. Ops: []
I20260709 14:53:22.864871  7852 raft_consensus.cc:1275] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
W20260709 14:53:22.871033  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 100377us
I20260709 14:53:22.874302  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:22.875808  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:22.871613  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:22.883253  7774 raft_consensus.cc:2468] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 20.
I20260709 14:53:22.825328 13530 consensus_queue.cc:260] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:53:22.896234  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:22.912691  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
W20260709 14:53:22.912900  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:22.913539  7774 raft_consensus.cc:3060] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Advancing to term 16
I20260709 14:53:22.915647 13982 consensus_queue.cc:1048] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.010s
I20260709 14:53:22.917306  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:22.918112  7775 raft_consensus.cc:2468] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 19.
I20260709 14:53:22.906183 13781 consensus_queue.cc:1059] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 22.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.014s
I20260709 14:53:22.923345 13937 raft_consensus.cc:515] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:22.925436  7772 raft_consensus.cc:2393] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 13: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:53:22.928129  7674 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54364 (request call id 348) took 7888 ms. Trace:
I20260709 14:53:22.928671  7674 rpcz_store.cc:276] 0709 14:53:15.039788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:53:15.040009 (+   221us) service_pool.cc:224] Handling call
0709 14:53:22.928011 (+7888002us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 14:53:22.102038 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 14:53:22.102838 (+   800us) write_op.cc:432] Acquiring schema lock in shared mode
0709 14:53:22.102890 (+    52us) write_op.cc:435] Acquired schema lock
0709 14:53:22.102909 (+    19us) tablet.cc:662] Decoding operations
0709 14:53:22.135302 (+ 32393us) write_op.cc:620] Acquiring the partition lock for write op
0709 14:53:22.135438 (+   136us) write_op.cc:641] Partition lock acquired for write op
0709 14:53:22.135466 (+    28us) tablet.cc:685] Acquiring locks for 12 operations
0709 14:53:22.178266 (+ 42800us) tablet.cc:701] Row locks acquired
0709 14:53:22.178329 (+    63us) write_op.cc:260] PREPARE: finished
0709 14:53:22.178591 (+   262us) write_op.cc:270] Start()
0709 14:53:22.178776 (+   185us) write_op.cc:276] Timestamp: P: 1783608802178506 usec, L: 0
0709 14:53:22.178813 (+    37us) op_driver.cc:348] REPLICATION: starting
0709 14:53:22.179701 (+   888us) log.cc:844] Serialized 4770 byte log entry
0709 14:53:22.468774 (+289073us) op_driver.cc:464] REPLICATION: finished
0709 14:53:22.513679 (+ 44905us) write_op.cc:301] APPLY: starting
0709 14:53:22.513799 (+   120us) tablet.cc:1367] starting BulkCheckPresence
0709 14:53:22.533980 (+ 20181us) tablet.cc:1370] finished BulkCheckPresence
0709 14:53:22.534125 (+   145us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 14:53:22.647279 (+113154us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 14:53:22.676047 (+ 28768us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=24,key_file_lookups=24,delta_file_lookups=24,mrs_lookups=0
0709 14:53:22.678010 (+  1963us) write_op.cc:312] APPLY: finished
0709 14:53:22.678620 (+   610us) log.cc:844] Serialized 113 byte log entry
0709 14:53:22.678917 (+   297us) write_op.cc:489] Releasing partition, row and schema locks
0709 14:53:22.679160 (+   243us) write_op.cc:454] Released schema lock
0709 14:53:22.679254 (+    94us) write_op.cc:341] FINISH: Updating metrics
0709 14:53:22.679920 (+   666us) write_op.cc:489] Releasing partition, row and schema locks
0709 14:53:22.679954 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":765,"reported_tablets":23,"child_traces":[["op",{"apply.queue_time_us":44580,"apply.run_cpu_time_us":22393,"apply.run_wall_time_us":166196,"cfile_cache_hit":50,"cfile_cache_hit_bytes":54143,"num_ops":12,"prepare.queue_time_us":77295,"prepare.run_cpu_time_us":21224,"prepare.run_wall_time_us":221670,"raft.queue_time_us":72028,"raft.run_cpu_time_us":2719,"raft.run_wall_time_us":32060,"replication_time_us":289771,"thread_start_us":292350,"threads_started":4,"wal-append.queue_time_us":174123}]]}
I20260709 14:53:22.934420  7675 catalog_manager.cc:5697] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 15 to 16, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 16 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:53:22.899017 13894 consensus_queue.cc:1059] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 22.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.039s
I20260709 14:53:22.946812  7675 catalog_manager.cc:5697] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 11 to 12, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 12 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:53:22.944553 13530 raft_consensus.cc:3060] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Advancing to term 14
I20260709 14:53:22.954376  7675 catalog_manager.cc:5697] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:53:22.951515 13829 raft_consensus.cc:493] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:22.965682 13829 raft_consensus.cc:515] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:22.966420  7772 raft_consensus.cc:1275] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 22 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 14:53:22.906442 13835 consensus_queue.cc:237] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:22.968058  7775 raft_consensus.cc:1240] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 17. Current term is 18. Ops: []
I20260709 14:53:22.968434  7776 raft_consensus.cc:1275] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 14:53:22.971982  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:22.971139  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:22.976831 13829 leader_election.cc:290] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:22.988930  7675 catalog_manager.cc:5697] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:53:22.993046  7675 catalog_manager.cc:5697] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:53:23.006537 13988 raft_consensus.cc:493] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:23.007290 13988 raft_consensus.cc:515] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:22.941147 13773 raft_consensus.cc:515] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:23.017163  7853 raft_consensus.cc:1240] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 16. Current term is 17. Ops: []
I20260709 14:53:23.017918  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:23.006282 13835 raft_consensus.cc:493] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:23.018755  7779 raft_consensus.cc:2468] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 19.
I20260709 14:53:23.019200 13835 raft_consensus.cc:515] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:23.019956  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:23.021023  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:23.021772  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:23.021935  7771 raft_consensus.cc:2468] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 19.
I20260709 14:53:23.023135  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:23.023430  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 17 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:23.023958  7778 raft_consensus.cc:2468] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 14.
I20260709 14:53:23.024211  7847 raft_consensus.cc:2410] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for term 17 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 14:53:23.021772  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:23.030431 13982 raft_consensus.cc:3055] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 14:53:23.030862  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18d29d52d304c87b930d4fb5eaf50b1" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:23.031090 13982 raft_consensus.cc:740] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:23.032534  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:23.032331 13982 consensus_queue.cc:260] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:23.025995 13835 leader_election.cc:290] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:23.034426 13984 consensus_queue.cc:1059] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 14:53:23.036433 13984 raft_consensus.cc:3055] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 14:53:23.032617  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258d6c2dda954bf5b65930fde8ecb9f3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:22.999861  7675 catalog_manager.cc:5697] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:53:23.012856 13937 leader_election.cc:290] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:23.041695  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
W20260709 14:53:23.042623  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 121088us
I20260709 14:53:22.984279 13894 raft_consensus.cc:3055] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 23 LEADER]: Stepping down as leader of term 23
I20260709 14:53:23.044804 13894 raft_consensus.cc:740] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:53:23.042479  7774 raft_consensus.cc:2468] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 16.
I20260709 14:53:23.036970 13984 raft_consensus.cc:740] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:23.047472  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9441e831627143a991a1556dcdce71e3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:23.049201  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:23.050007  7778 raft_consensus.cc:2468] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 20.
I20260709 14:53:23.047688  7675 catalog_manager.cc:5697] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:53:23.018452 13773 leader_election.cc:290] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 17 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:23.052315 13982 raft_consensus.cc:3060] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 22 FOLLOWER]: Advancing to term 23
I20260709 14:53:23.061964 13988 leader_election.cc:290] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:23.034725 13964 raft_consensus.cc:515] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:23.064478  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:23.064913 13964 leader_election.cc:290] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:23.065318  7853 raft_consensus.cc:2468] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 19.
I20260709 14:53:23.067302  7894 leader_election.cc:304] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:23.069006  7675 catalog_manager.cc:5697] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 10 to 13, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 13 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:53:23.070559 13984 consensus_queue.cc:260] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:23.072182 13984 raft_consensus.cc:3060] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 14:53:23.071579  7675 catalog_manager.cc:5697] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 14 to 15, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 15 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
W20260709 14:53:23.074424  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:23.075716 13988 raft_consensus.cc:493] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:23.079061 13988 raft_consensus.cc:515] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:53:23.080307  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:23.076630 13835 raft_consensus.cc:2804] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 14:53:23.078192  7819 leader_election.cc:304] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:23.081662 13835 raft_consensus.cc:493] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:23.082041 13993 raft_consensus.cc:2804] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Leader election won for term 19
I20260709 14:53:23.083117 13993 raft_consensus.cc:697] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:53:23.082631  7675 catalog_manager.cc:5697] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:53:23.084179 13993 consensus_queue.cc:237] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:23.084199  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:23.088528  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:23.088996  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:23.089643  7853 raft_consensus.cc:2468] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 19.
I20260709 14:53:23.090698  7775 raft_consensus.cc:2393] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 19: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:53:23.092063  7819 leader_election.cc:304] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:23.091979  7894 leader_election.cc:304] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:23.093065 13773 raft_consensus.cc:2804] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 14:53:23.093561 13773 raft_consensus.cc:493] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:23.093925 13773 raft_consensus.cc:3060] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Advancing to term 18
I20260709 14:53:23.094502 13982 raft_consensus.cc:2804] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 14:53:23.096941  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:23.096087  7893 leader_election.cc:304] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:23.098219 13967 raft_consensus.cc:2804] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 14:53:23.098820 13967 raft_consensus.cc:493] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:23.090574  7675 catalog_manager.cc:5697] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:53:23.099361 13835 raft_consensus.cc:3060] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Advancing to term 20
I20260709 14:53:23.098932  7893 leader_election.cc:304] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:23.066346 13894 consensus_queue.cc:260] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.14, Last appended by leader: 14, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:23.097167 13982 raft_consensus.cc:493] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:23.100714  7675 catalog_manager.cc:5697] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 17 to 18, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 18 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:53:23.102427  7893 leader_election.cc:304] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:23.099355 13967 raft_consensus.cc:3060] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Advancing to term 22
I20260709 14:53:23.106304  7819 leader_election.cc:304] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:23.105659  7675 catalog_manager.cc:5697] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 15 to 17, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 17 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:53:23.107455 13987 raft_consensus.cc:2804] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Leader election won for term 17
I20260709 14:53:23.107693  7675 catalog_manager.cc:5697] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 16 to 18, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 18 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:53:23.110033  7675 catalog_manager.cc:5697] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 16 to 18, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 18 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:53:23.113368 13962 raft_consensus.cc:2749] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 14:53:23.122896  7893 leader_election.cc:304] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:23.116353 13967 raft_consensus.cc:515] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:23.118643  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:23.131933  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:23.119130  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:23.134115  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:23.136157  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:23.136561  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:23.127969 13731 raft_consensus.cc:2804] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 14:53:23.117230 13982 raft_consensus.cc:3060] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Advancing to term 21
I20260709 14:53:23.119809  7675 catalog_manager.cc:5697] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 18 to 19, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 19 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:53:23.138388  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:23.103564 13988 leader_election.cc:290] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:23.140029  7893 leader_election.cc:304] T 9ce9c0ef2db24c13a8b1402f21819458 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 9418391fa82a42c79c6cad13ba91d964
I20260709 14:53:23.141378  7851 raft_consensus.cc:2468] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 19.
I20260709 14:53:23.158234  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:23.140158 13731 raft_consensus.cc:493] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:23.139249 13979 raft_consensus.cc:2749] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 14:53:23.144796  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:23.140166 13987 raft_consensus.cc:697] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:53:23.146029  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:23.160434 13731 raft_consensus.cc:3060] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Advancing to term 21
I20260709 14:53:23.163426  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:23.163872 13773 raft_consensus.cc:515] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:23.147114  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18d29d52d304c87b930d4fb5eaf50b1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:53:23.147236  7745 leader_election.cc:336] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 1.552s (SENT)
I20260709 14:53:23.166258  7745 leader_election.cc:304] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:23.166474  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:23.168001  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:53:23.168459  7745 leader_election.cc:336] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 1.556s (SENT)
I20260709 14:53:23.169746 13964 raft_consensus.cc:2749] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 14:53:23.161832  7893 leader_election.cc:304] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:23.169018  7745 leader_election.cc:304] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:23.148475  7846 raft_consensus.cc:1240] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 18. Current term is 19. Ops: []
I20260709 14:53:23.148304  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:23.149698  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:23.153802 13894 raft_consensus.cc:3060] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 23 FOLLOWER]: Advancing to term 24
I20260709 14:53:23.189342  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:23.140079  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:23.228099  7847 raft_consensus.cc:3060] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Advancing to term 20
I20260709 14:53:23.230355  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:23.230822  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:53:23.233547  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 71797.1us
I20260709 14:53:23.232215  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:23.161902 13988 raft_consensus.cc:2749] T 9ce9c0ef2db24c13a8b1402f21819458 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 14:53:23.240461  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:23.240971  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:23.241479  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:53:23.230197 13995 log.cc:927] Time spent T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.242s	user 0.000s	sys 0.006s
I20260709 14:53:23.240583  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:23.242895  7893 leader_election.cc:304] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:23.166533 13773 leader_election.cc:290] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 18 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:23.243355  7744 leader_election.cc:304] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:53:23.246372  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:23.252710  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c563cc7cfbe4d59be4ffc5cf847ce56" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:23.252979  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:23.255780  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:23.238541 13979 raft_consensus.cc:2749] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 14:53:23.243713 13795 raft_consensus.cc:2749] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 14:53:23.244161 13882 consensus_queue.cc:1048] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 14:53:23.262534  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:23.262534  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:23.269551  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:23.267406 13795 raft_consensus.cc:2804] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 14:53:23.269886  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:23.270432 13795 raft_consensus.cc:493] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Starting leader election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:23.270970 13795 raft_consensus.cc:3060] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Advancing to term 20
I20260709 14:53:23.245203 13852 consensus_queue.cc:1048] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 14:53:23.271814  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:23.273442  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:23.273840  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:23.265980 13980 raft_consensus.cc:2804] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 14:53:23.277156  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:23.273483  7846 raft_consensus.cc:1240] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 17. Current term is 18. Ops: []
I20260709 14:53:23.271018  7848 raft_consensus.cc:2393] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 19: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:53:23.274849  7845 raft_consensus.cc:2393] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 15: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:53:23.282850  7893 leader_election.cc:304] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:23.288754  7848 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e"
dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
 from {username='slave'} at 127.0.0.1:49948
I20260709 14:53:23.289992  7848 raft_consensus.cc:493] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:53:23.244366 13781 consensus_queue.cc:1059] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.034s
I20260709 14:53:23.290509  7849 raft_consensus.cc:1240] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 19. Current term is 21. Ops: []
I20260709 14:53:23.244581 13963 consensus_queue.cc:1048] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.034s
W20260709 14:53:23.291173  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 47903.8us
I20260709 14:53:23.290642  7848 raft_consensus.cc:3060] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Advancing to term 19
I20260709 14:53:23.292009  7847 raft_consensus.cc:2468] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 20.
I20260709 14:53:23.295063  7744 leader_election.cc:304] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
W20260709 14:53:23.300649  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 132165us
I20260709 14:53:23.300848  7893 leader_election.cc:304] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:23.277698 13980 raft_consensus.cc:493] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
W20260709 14:53:23.303140  7745 leader_election.cc:336] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 1.564s (SENT)
I20260709 14:53:23.301891 13979 raft_consensus.cc:2749] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 14:53:23.306476  7893 leader_election.cc:304] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:53:23.307291 13994 log.cc:927] Time spent T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 14:53:23.308460 13882 raft_consensus.cc:2749] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 14:53:23.314756 13967 leader_election.cc:290] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 22 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:23.316717 13962 raft_consensus.cc:3055] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 14:53:23.317354 13962 raft_consensus.cc:740] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:23.320653 13962 consensus_queue.cc:260] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:23.325312 13962 raft_consensus.cc:3060] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Advancing to term 20
I20260709 14:53:23.326592 13980 raft_consensus.cc:3060] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 14:53:23.330336  7850 raft_consensus.cc:2410] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for term 15 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 14:53:23.299978 13982 raft_consensus.cc:515] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:23.340229 13982 leader_election.cc:290] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 21 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:23.343364 13988 raft_consensus.cc:2749] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 14:53:23.344172  7893 leader_election.cc:304] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:23.345985 13852 consensus_queue.cc:1059] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 14:53:23.348183 13882 raft_consensus.cc:2749] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 14:53:23.348690  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:23.352216  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:23.349822  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:23.354712  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:23.355589  7853 raft_consensus.cc:2468] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 19.
I20260709 14:53:23.351903  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:23.299929 13987 consensus_queue.cc:237] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:23.351193  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:23.362287  7854 raft_consensus.cc:2410] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for term 24 because replica has last-logged OpId of term: 23 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 13.
W20260709 14:53:23.364501  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 66430.8us
I20260709 14:53:23.370143  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:23.370829  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:23.305863  7745 leader_election.cc:304] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:23.371906  7778 raft_consensus.cc:1275] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 14:53:23.373739 14003 raft_consensus.cc:2804] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 14:53:23.375361 13530 raft_consensus.cc:493] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:23.376367 13530 raft_consensus.cc:515] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:23.379395 13530 leader_election.cc:290] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:53:23.380934  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 77855.6us
I20260709 14:53:23.381232 13829 raft_consensus.cc:2749] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 14:53:23.386893  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 17 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:23.387967  7774 raft_consensus.cc:2410] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for term 17 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 14:53:23.371506  7775 raft_consensus.cc:2468] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 18.
I20260709 14:53:23.374361 14003 raft_consensus.cc:493] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:23.406478  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:23.406461  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
W20260709 14:53:23.413764  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 67010.5us
W20260709 14:53:23.413726  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 68319.7us
I20260709 14:53:23.415567  7893 leader_election.cc:304] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:23.417722  7893 leader_election.cc:304] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:23.420437  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:23.421149  7893 leader_election.cc:304] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:23.423461  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18d29d52d304c87b930d4fb5eaf50b1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:23.423964 13984 raft_consensus.cc:2804] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 14:53:23.407701 14003 raft_consensus.cc:3060] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 22 FOLLOWER]: Advancing to term 23
W20260709 14:53:23.456585  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:23.458205  7845 raft_consensus.cc:1275] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 24 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 24 index: 14. (term mismatch)
W20260709 14:53:23.464107  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:23.464286  7845 pending_rounds.cc:85] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting all ops after (but not including) 13
I20260709 14:53:23.461524 13984 raft_consensus.cc:493] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:23.442757 13795 raft_consensus.cc:515] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:23.464951 13984 raft_consensus.cc:3060] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Advancing to term 21
I20260709 14:53:23.467186 13795 leader_election.cc:290] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 20 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:23.421799 13988 raft_consensus.cc:2804] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 14:53:23.467762 13988 raft_consensus.cc:493] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:23.462141 13852 consensus_queue.cc:1048] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.005s
I20260709 14:53:23.429729  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:23.468196 13988 raft_consensus.cc:3060] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Advancing to term 20
I20260709 14:53:23.408586 13835 raft_consensus.cc:515] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:23.463078  7848 raft_consensus.cc:515] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:23.471810  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 21 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:23.472061  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:23.472430  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:23.472754  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:23.472936  7845 pending_rounds.cc:107] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting uncommitted NO_OP operation due to leader change: 23.14
I20260709 14:53:23.476733  7849 raft_consensus.cc:1275] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 14:53:23.482707  7845 raft_consensus.cc:2889] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:53:23.483104 13980 raft_consensus.cc:515] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:23.484297 13835 leader_election.cc:290] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 20 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:23.470559  7854 raft_consensus.cc:3060] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Advancing to term 21
I20260709 14:53:23.479610  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:23.428552 13967 raft_consensus.cc:3060] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 14:53:23.496160  7848 leader_election.cc:290] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 19 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:23.501423  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:23.502796  7893 leader_election.cc:304] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:23.505064 13836 raft_consensus.cc:3055] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 14:53:23.508853 13836 raft_consensus.cc:740] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:23.509527 13731 raft_consensus.cc:515] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:23.511320 13795 raft_consensus.cc:493] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:23.512149 13795 raft_consensus.cc:515] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:23.513468 13731 leader_election.cc:290] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 21 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:23.516739 13795 leader_election.cc:290] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:23.517638 13781 raft_consensus.cc:2804] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 14:53:23.518205 13781 raft_consensus.cc:493] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:53:23.518862 13781 raft_consensus.cc:3060] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Advancing to term 19
I20260709 14:53:23.523494  7849 raft_consensus.cc:1240] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 17. Current term is 19. Ops: []
I20260709 14:53:23.525597  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:23.525777  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:23.529721  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:23.526993  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:23.530491  7853 raft_consensus.cc:2468] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 18.
I20260709 14:53:23.528185  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:23.516861  7893 leader_election.cc:304] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:23.534336  7893 leader_election.cc:304] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:23.536989  7893 leader_election.cc:304] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:23.538165 13882 raft_consensus.cc:2804] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 14:53:23.538659 13882 raft_consensus.cc:493] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:23.539014 13882 raft_consensus.cc:3060] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 14:53:23.541780 13835 raft_consensus.cc:3060] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 14:53:23.535071 13852 raft_consensus.cc:2804] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 14:53:23.545881 13852 raft_consensus.cc:493] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:23.546675 13852 raft_consensus.cc:3060] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Advancing to term 20
I20260709 14:53:23.428774 13979 consensus_queue.cc:1059] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.070s
I20260709 14:53:23.552333 13836 consensus_queue.cc:260] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:23.553180 13795 raft_consensus.cc:493] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:23.554189 13836 raft_consensus.cc:3060] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 14:53:23.553812 13795 raft_consensus.cc:515] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:53:23.559289  7745 leader_election.cc:336] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 1.767s (SENT)
I20260709 14:53:23.559881 13835 raft_consensus.cc:2749] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 14:53:23.561355  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:23.576225 13795 leader_election.cc:290] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:23.570804 13980 leader_election.cc:290] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:23.540961  7893 leader_election.cc:304] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:23.574136 13781 raft_consensus.cc:515] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:23.575115  7745 leader_election.cc:304] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:53:23.581640  7745 leader_election.cc:336] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 1.836s (SENT)
I20260709 14:53:23.582173  7745 leader_election.cc:304] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:23.583213 14001 raft_consensus.cc:2749] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 14:53:23.584412 13964 raft_consensus.cc:2749] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 14:53:23.584441 14001 raft_consensus.cc:493] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:23.587142 14001 raft_consensus.cc:515] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:23.591822 14001 leader_election.cc:290] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:23.595430 13967 raft_consensus.cc:2749] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 14:53:23.596472 13967 consensus_queue.cc:1048] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 14:53:23.598088  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:23.598922  7774 raft_consensus.cc:3060] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Advancing to term 15
I20260709 14:53:23.601800 13781 leader_election.cc:290] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:23.606937  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
W20260709 14:53:23.608637  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 104866us
I20260709 14:53:23.640954  7772 raft_consensus.cc:3060] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Advancing to term 22
I20260709 14:53:23.613893  7854 raft_consensus.cc:2468] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 21.
I20260709 14:53:23.600044 13852 raft_consensus.cc:515] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:23.645022  7847 raft_consensus.cc:1240] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 20. Current term is 21. Ops: []
I20260709 14:53:23.647619 13852 leader_election.cc:290] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 20 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:23.621593  7779 raft_consensus.cc:1275] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 14:53:23.649709  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:23.650403  7779 raft_consensus.cc:3060] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Advancing to term 20
I20260709 14:53:23.623682  7771 raft_consensus.cc:1240] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 19. Current term is 20. Ops: []
I20260709 14:53:23.654641  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:23.655493  7771 raft_consensus.cc:3060] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Advancing to term 21
I20260709 14:53:23.624627 13967 raft_consensus.cc:493] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:23.661033 13967 raft_consensus.cc:515] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:23.663386 13967 leader_election.cc:290] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:23.608984  7774 raft_consensus.cc:2468] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 15.
I20260709 14:53:23.626614  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: true dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:23.664191  7770 raft_consensus.cc:3060] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 22 FOLLOWER]: Advancing to term 23
I20260709 14:53:23.664512  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:23.668772  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:23.634856  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
W20260709 14:53:23.670977  7745 leader_election.cc:336] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 1.961s (SENT)
I20260709 14:53:23.671726  7745 leader_election.cc:304] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:23.673775  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:23.674155 14001 raft_consensus.cc:2749] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 14:53:23.639142 13988 raft_consensus.cc:515] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:23.582373 13962 raft_consensus.cc:2749] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 14:53:23.671399  7847 raft_consensus.cc:1275] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 14:53:23.625305  7773 raft_consensus.cc:1240] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 12. Current term is 13. Ops: []
I20260709 14:53:23.676410  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:23.677114  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:23.677748  7845 raft_consensus.cc:3060] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Advancing to term 20
I20260709 14:53:23.678628  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:23.679399  7854 raft_consensus.cc:2393] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 19: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:53:23.682653 13979 consensus_queue.cc:1048] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 14:53:23.683179 13980 raft_consensus.cc:493] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:23.683727 13980 raft_consensus.cc:515] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:23.683777 13852 raft_consensus.cc:493] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:23.686774 13980 leader_election.cc:290] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:23.686678  7924 raft_consensus.cc:1240] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 12. Current term is 13. Ops: []
I20260709 14:53:23.687068 13852 raft_consensus.cc:515] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:23.685678  7776 raft_consensus.cc:3055] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 LEADER]: Stepping down as leader of term 19
I20260709 14:53:23.688325  7776 raft_consensus.cc:740] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:53:23.689491  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:23.689945 13852 leader_election.cc:290] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:23.690567  7923 raft_consensus.cc:2410] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for term 15 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 14:53:23.691946  7776 consensus_queue.cc:260] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:23.696980  7923 raft_consensus.cc:1240] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 LEADER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 14:53:23.697441  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:23.701231  7776 raft_consensus.cc:3060] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Advancing to term 21
I20260709 14:53:23.706074  7773 raft_consensus.cc:1240] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 14:53:23.708016  7773 raft_consensus.cc:1240] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 14:53:23.698443  7920 raft_consensus.cc:1240] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 20. Current term is 21. Ops: []
I20260709 14:53:23.716850  7920 raft_consensus.cc:1275] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 22 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 14:53:23.717764  7926 raft_consensus.cc:1240] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 19. Current term is 20. Ops: []
I20260709 14:53:23.698200 13988 leader_election.cc:290] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 20 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:23.719381  7920 raft_consensus.cc:1275] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 12. (term mismatch)
I20260709 14:53:23.676812  7770 raft_consensus.cc:2468] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 23.
I20260709 14:53:23.709400  7772 raft_consensus.cc:2468] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 22.
W20260709 14:53:23.710253  7745 leader_election.cc:336] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 2.001s (SENT)
I20260709 14:53:23.723513  7845 raft_consensus.cc:2468] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 20.
I20260709 14:53:23.698184  7774 raft_consensus.cc:3055] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 LEADER]: Stepping down as leader of term 18
I20260709 14:53:23.714346  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: true dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:23.714612  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:23.696919  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 21 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:23.727131  7921 raft_consensus.cc:1275] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 14:53:23.696378 13979 raft_consensus.cc:493] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:23.717583 13980 raft_consensus.cc:493] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:23.728698  7923 raft_consensus.cc:1240] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 19. Current term is 20. Ops: []
I20260709 14:53:23.728538 13979 raft_consensus.cc:515] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:23.729470 14003 raft_consensus.cc:515] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:23.730425  7745 leader_election.cc:304] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:23.731102 13979 leader_election.cc:290] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:23.730826 13882 raft_consensus.cc:515] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:23.719913  7920 pending_rounds.cc:85] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0: Aborting all ops after (but not including) 11
I20260709 14:53:23.731808  7920 pending_rounds.cc:107] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0: Aborting uncommitted NO_OP operation due to leader change: 19.12
I20260709 14:53:23.732045  7920 raft_consensus.cc:2889] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:53:23.725889  7774 raft_consensus.cc:740] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:53:23.733315 13882 leader_election.cc:290] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 15 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:23.730629  7770 raft_consensus.cc:1240] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 23 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 22. Current term is 23. Ops: []
I20260709 14:53:23.731365  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:23.712375  7927 raft_consensus.cc:2468] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 13.
I20260709 14:53:23.741389  7776 raft_consensus.cc:1275] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 14:53:23.742739  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
W20260709 14:53:23.743089  7744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:23.742966  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:23.744827  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:23.745815  7779 raft_consensus.cc:2468] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 20.
I20260709 14:53:23.747462  7927 raft_consensus.cc:1240] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 17. Current term is 18. Ops: []
I20260709 14:53:23.749692  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:23.749635  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:23.750377  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:23.754519  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:23.748027  7771 raft_consensus.cc:2468] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 21.
I20260709 14:53:23.751144  7923 raft_consensus.cc:2393] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 20: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:53:23.680179 13984 raft_consensus.cc:515] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:23.758105  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:23.758880 13882 raft_consensus.cc:493] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:23.759060  7920 raft_consensus.cc:2468] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 19.
I20260709 14:53:23.759605 13984 leader_election.cc:290] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 21 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:23.760545  7924 raft_consensus.cc:1240] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 20. Current term is 21. Ops: []
I20260709 14:53:23.763092  7928 raft_consensus.cc:1275] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 24 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 14:53:23.756109  7894 leader_election.cc:304] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:23.762081  7777 raft_consensus.cc:1240] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 20. Current term is 21. Ops: []
I20260709 14:53:23.751443  7845 raft_consensus.cc:2468] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 18.
I20260709 14:53:23.767794  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:23.769758  7745 leader_election.cc:304] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:23.771332  7745 leader_election.cc:304] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:23.734071  7774 consensus_queue.cc:260] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:23.773985  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: true dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:23.774664  7779 raft_consensus.cc:3055] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 LEADER]: Stepping down as leader of term 17
I20260709 14:53:23.774973  7779 raft_consensus.cc:740] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:53:23.773399  7927 raft_consensus.cc:1240] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 LEADER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 19. Current term is 21. Ops: []
I20260709 14:53:23.765919  7776 raft_consensus.cc:2393] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 18: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:53:23.768678  7919 raft_consensus.cc:2468] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 20.
I20260709 14:53:23.777137 13979 raft_consensus.cc:2804] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 14:53:23.777832  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:23.777990 13795 consensus_queue.cc:1059] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 14:53:23.778666 13964 raft_consensus.cc:2749] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 14:53:23.779153  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:23.780089  7777 raft_consensus.cc:2468] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 20.
I20260709 14:53:23.765618  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:23.782662  7779 consensus_queue.cc:260] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:23.783540  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:23.785415  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:23.783905  7779 raft_consensus.cc:3060] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Advancing to term 19
I20260709 14:53:23.786222  7770 raft_consensus.cc:2468] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 17.
I20260709 14:53:23.787232  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:23.781066  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:23.787812  7770 raft_consensus.cc:2468] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 17.
I20260709 14:53:23.788642  7922 raft_consensus.cc:2468] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 23.
I20260709 14:53:23.788755  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:23.792311  7770 raft_consensus.cc:2393] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 20: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:53:23.747959 14001 raft_consensus.cc:2749] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 14:53:23.788061  7777 raft_consensus.cc:2468] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 17.
I20260709 14:53:23.793452  7921 raft_consensus.cc:2393] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 18: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:53:23.797740  7770 raft_consensus.cc:1240] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 17. Current term is 18. Ops: []
I20260709 14:53:23.799605  7776 raft_consensus.cc:1240] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 22 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 21. Current term is 22. Ops: []
I20260709 14:53:23.799882  7771 raft_consensus.cc:2468] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 19.
I20260709 14:53:23.811367  7778 raft_consensus.cc:3060] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Advancing to term 20
I20260709 14:53:23.747870 13980 raft_consensus.cc:515] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:23.793756 13979 raft_consensus.cc:697] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:23.810478  7744 leader_election.cc:304] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
W20260709 14:53:23.817198  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 45953.7us
I20260709 14:53:23.807960  7779 raft_consensus.cc:2468] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 19.
I20260709 14:53:23.819689  7745 leader_election.cc:304] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:23.802873 14002 raft_consensus.cc:2749] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 14:53:23.759523 13882 raft_consensus.cc:515] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:23.829097  7745 leader_election.cc:304] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:23.814574 13964 consensus_queue.cc:1059] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.016s
I20260709 14:53:23.831252 13964 consensus_queue.cc:1243] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Peer 1e9289592458429bbddb19c2e7b7b7b0 log is divergent from this leader: its last log entry 19.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 14:53:23.832021 13964 raft_consensus.cc:2749] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 14:53:23.837574 14001 raft_consensus.cc:2804] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader election won for term 13
I20260709 14:53:23.841727 14001 raft_consensus.cc:697] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:53:23.842855 14005 raft_consensus.cc:493] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:23.833123  7745 leader_election.cc:304] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:23.843667 14005 raft_consensus.cc:515] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:23.845634 13937 raft_consensus.cc:2749] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 14:53:23.848527  7745 leader_election.cc:304] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:23.850097  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:23.852283 13894 raft_consensus.cc:493] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:23.842922 14001 consensus_queue.cc:237] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:53:23.860780  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 53921.8us
I20260709 14:53:23.837811  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:23.839349  7774 raft_consensus.cc:3060] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Advancing to term 19
I20260709 14:53:23.855427  7819 leader_election.cc:304] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:23.810683 13984 consensus_queue.cc:1048] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.048s
I20260709 14:53:23.858314 13894 raft_consensus.cc:515] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:23.841095  7893 leader_election.cc:304] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:23.817009 13829 consensus_queue.cc:1059] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.043s
I20260709 14:53:23.870895  7893 leader_election.cc:304] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:23.871515 13829 raft_consensus.cc:3055] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 LEADER]: Stepping down as leader of term 20
I20260709 14:53:23.872473 13829 raft_consensus.cc:740] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:53:23.866176  7771 raft_consensus.cc:3060] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Advancing to term 15
I20260709 14:53:23.873885 14007 raft_consensus.cc:2804] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 14:53:23.874781 14007 raft_consensus.cc:697] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 22 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:23.876783 13982 raft_consensus.cc:2749] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 14:53:23.878443 13829 consensus_queue.cc:260] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:53:23.879388  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:23.888010  7771 raft_consensus.cc:2468] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 15.
I20260709 14:53:23.883256 13955 raft_consensus.cc:2749] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 14:53:23.886865 13894 leader_election.cc:290] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:23.898450 13882 leader_election.cc:290] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:23.898986 13829 raft_consensus.cc:3060] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Advancing to term 21
I20260709 14:53:23.899605 13979 consensus_queue.cc:237] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:23.899988 13984 consensus_queue.cc:1048] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 14:53:23.863755  7894 leader_election.cc:304] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:23.906576 13982 raft_consensus.cc:2804] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 14:53:23.907450 13982 raft_consensus.cc:697] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
W20260709 14:53:23.909456  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 61006.7us
I20260709 14:53:23.926865  7925 raft_consensus.cc:2468] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 17.
W20260709 14:53:23.927467  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 72141.3us
I20260709 14:53:23.928442  7819 leader_election.cc:304] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:23.912809  7894 leader_election.cc:304] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:23.880812 14007 consensus_queue.cc:237] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:23.906976 13894 raft_consensus.cc:2749] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 14:53:23.916519  7893 leader_election.cc:304] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:23.858260 14003 leader_election.cc:290] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 23 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:23.852198 13980 leader_election.cc:290] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:23.935443  7778 raft_consensus.cc:2468] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 20.
I20260709 14:53:23.920652 13795 raft_consensus.cc:2749] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 14:53:23.949914  7774 raft_consensus.cc:1275] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 11. (term mismatch)
I20260709 14:53:23.950428  7774 pending_rounds.cc:85] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed: Aborting all ops after (but not including) 10
I20260709 14:53:23.950667  7774 pending_rounds.cc:107] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed: Aborting uncommitted NO_OP operation due to leader change: 18.11
I20260709 14:53:23.951143  7774 raft_consensus.cc:2889] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:53:23.959537  7819 leader_election.cc:304] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 9418391fa82a42c79c6cad13ba91d964
I20260709 14:53:23.961583 13998 raft_consensus.cc:2749] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 14:53:23.962211  7745 leader_election.cc:304] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:23.938710 13530 raft_consensus.cc:2749] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 14:53:23.967458  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: true dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:23.968192  7922 raft_consensus.cc:3060] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Advancing to term 19
I20260709 14:53:23.946373 13984 raft_consensus.cc:2804] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 14:53:23.978119 13984 raft_consensus.cc:493] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:23.978621 13984 raft_consensus.cc:3060] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Advancing to term 19
I20260709 14:53:23.980165  7922 raft_consensus.cc:2468] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 19.
I20260709 14:53:23.981668 14003 raft_consensus.cc:2749] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 14:53:23.964113  7745 leader_election.cc:304] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:23.997612  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
W20260709 14:53:23.998320  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 81911.5us
I20260709 14:53:23.999732  7893 leader_election.cc:304] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:24.001755 13967 raft_consensus.cc:2804] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 14:53:24.010830  7893 leader_election.cc:304] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:24.012971  7819 leader_election.cc:304] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:23.909088 13982 consensus_queue.cc:237] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:24.020179  7893 leader_election.cc:304] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:24.022717  7893 leader_election.cc:304] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:24.015790 13963 raft_consensus.cc:2804] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 14:53:24.024185 13731 raft_consensus.cc:2749] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 14:53:24.024326 13530 raft_consensus.cc:2749] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 14:53:24.018296 13829 raft_consensus.cc:2749] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 14:53:24.028653  7893 leader_election.cc:304] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:53:24.021397 13967 raft_consensus.cc:697] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:24.033838  7819 leader_election.cc:304] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:24.025559 13852 raft_consensus.cc:2804] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 14:53:24.085817  7893 leader_election.cc:304] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:24.037376 14005 leader_election.cc:290] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:24.087013 13980 consensus_queue.cc:1048] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 14:53:24.032696 13882 raft_consensus.cc:2804] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Leader election won for term 19
W20260709 14:53:24.086694  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 122679us
I20260709 14:53:24.104712 13984 raft_consensus.cc:515] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:24.095005 13967 consensus_queue.cc:237] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:24.124512  7744 leader_election.cc:304] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:53:24.124656  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:24.030720 13963 raft_consensus.cc:493] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:24.096014 13962 raft_consensus.cc:2804] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 14:53:24.106799  7742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:24.113385 13975 consensus_queue.cc:1059] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.100s
I20260709 14:53:24.119606  7745 leader_election.cc:304] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:24.149781  7921 raft_consensus.cc:2393] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 19: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
W20260709 14:53:24.123855  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 90253.8us
I20260709 14:53:24.116524 13852 raft_consensus.cc:493] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:24.147949  7744 leader_election.cc:304] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:53:24.094573 14006 raft_consensus.cc:493] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:24.123005 13731 raft_consensus.cc:2804] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 14:53:24.154918  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:24.155687  7778 raft_consensus.cc:2468] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 13.
I20260709 14:53:24.152520  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:24.156735  7922 raft_consensus.cc:3060] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 22 FOLLOWER]: Advancing to term 23
W20260709 14:53:24.154053 14020 log.cc:927] Time spent T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.120s	user 0.000s	sys 0.001s
W20260709 14:53:24.159533 14024 log.cc:927] Time spent T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 14:53:24.160027  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c563cc7cfbe4d59be4ffc5cf847ce56" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:24.161413  7745 leader_election.cc:304] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:24.163453 13984 leader_election.cc:290] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:24.164583 14025 raft_consensus.cc:2804] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 14:53:24.165215 14025 raft_consensus.cc:493] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:24.129472 13998 raft_consensus.cc:2749] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 14:53:24.128523 14001 raft_consensus.cc:2804] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 14:53:24.135948 13963 raft_consensus.cc:3060] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Advancing to term 21
I20260709 14:53:24.166714  7745 leader_election.cc:304] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:24.165608 14025 raft_consensus.cc:3060] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Advancing to term 21
I20260709 14:53:24.150686 13829 consensus_queue.cc:1048] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.024s
I20260709 14:53:24.166167 14006 raft_consensus.cc:515] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:24.175585 14003 raft_consensus.cc:2749] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 14:53:24.175846  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:24.176693 13955 raft_consensus.cc:2749] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 14:53:24.180464  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:24.181340  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:24.203359  7845 raft_consensus.cc:3060] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Advancing to term 15
I20260709 14:53:24.204614  7745 leader_election.cc:304] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:24.152204 13852 raft_consensus.cc:3060] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 14:53:24.182101  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:24.186051  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:24.191862  7922 raft_consensus.cc:2468] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 23.
I20260709 14:53:24.212325  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:24.213719  7772 raft_consensus.cc:2393] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 17: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:53:24.214746  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:24.215667  7771 raft_consensus.cc:3060] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Advancing to term 19
I20260709 14:53:24.220712  7925 raft_consensus.cc:2468] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 18.
W20260709 14:53:24.231020  7744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:53:24.243788 14027 log.cc:927] Time spent T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 14:53:24.187099 14001 raft_consensus.cc:493] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:24.246268 14001 raft_consensus.cc:3060] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Advancing to term 20
I20260709 14:53:24.247830 14006 leader_election.cc:290] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:24.251479  7771 raft_consensus.cc:2468] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 19.
I20260709 14:53:24.217921  7893 leader_election.cc:304] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:53:24.254827 13963 raft_consensus.cc:515] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:24.256982 13980 raft_consensus.cc:2804] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 14:53:24.258744 13530 raft_consensus.cc:3055] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 LEADER]: Stepping down as leader of term 15
I20260709 14:53:24.258526 13980 raft_consensus.cc:493] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:24.259740 13980 raft_consensus.cc:3060] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 14:53:24.262604 13963 leader_election.cc:290] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 21 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:24.267346  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c563cc7cfbe4d59be4ffc5cf847ce56" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:24.232398  7744 leader_election.cc:304] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
W20260709 14:53:24.273732  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 69230.9us
I20260709 14:53:24.300009  7745 leader_election.cc:304] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:24.303452  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:53:24.305588  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 73343.1us
I20260709 14:53:24.275192  7845 raft_consensus.cc:2410] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for term 15 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 14:53:24.280215  6549 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 14:53:24.270974 14002 raft_consensus.cc:2749] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 14:53:24.259415 13530 raft_consensus.cc:740] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:53:24.289400 13962 raft_consensus.cc:697] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
W20260709 14:53:24.315447 14026 log.cc:927] Time spent T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 14:53:24.315857 13530 consensus_queue.cc:260] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:24.316370 13962 consensus_queue.cc:237] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:24.292409  7819 leader_election.cc:304] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
W20260709 14:53:24.295328  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:24.313174  7745 leader_election.cc:304] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
W20260709 14:53:24.330904  8598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 136765us
I20260709 14:53:24.289431 13882 raft_consensus.cc:697] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:24.333897  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:24.334172  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:24.338130  7847 raft_consensus.cc:3060] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Advancing to term 19
I20260709 14:53:24.303622 14003 raft_consensus.cc:2749] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 14:53:24.323050 13795 raft_consensus.cc:493] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:24.326020 13829 raft_consensus.cc:2804] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 23 FOLLOWER]: Leader election won for term 23
I20260709 14:53:24.322341 13937 raft_consensus.cc:2749] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 14:53:24.347262  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:24.347046  7893 leader_election.cc:304] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:53:24.366015  7774 raft_consensus.cc:2468] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 19.
I20260709 14:53:24.305970 13975 consensus_queue.cc:1059] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 14:53:24.330626 13731 raft_consensus.cc:697] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:24.354784 14002 raft_consensus.cc:2764] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260709 14:53:24.367482 13530 raft_consensus.cc:3060] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Advancing to term 16
W20260709 14:53:24.398829  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 51843.9us
I20260709 14:53:24.371136 13987 raft_consensus.cc:2764] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Leader election decision vote started in defunct term 20: won
I20260709 14:53:24.401437  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:24.405037  7847 raft_consensus.cc:2468] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 19.
W20260709 14:53:24.406277  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 93236.6us
I20260709 14:53:24.380892 13829 raft_consensus.cc:697] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 23 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:53:24.368330 13795 raft_consensus.cc:515] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:24.422221  7894 leader_election.cc:304] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:24.425706 14032 raft_consensus.cc:2749] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 14:53:24.429224  7893 leader_election.cc:304] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:53:24.430681 14010 raft_consensus.cc:2804] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 14:53:24.431223 14010 raft_consensus.cc:493] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:24.431586 14010 raft_consensus.cc:3060] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Advancing to term 20
I20260709 14:53:24.437938  7776 raft_consensus.cc:1275] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 22 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 14:53:24.439184 13731 consensus_queue.cc:237] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:24.440575  7777 raft_consensus.cc:1275] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 13. (term mismatch)
I20260709 14:53:24.441118  7777 pending_rounds.cc:85] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed: Aborting all ops after (but not including) 12
I20260709 14:53:24.441390  7777 pending_rounds.cc:107] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed: Aborting uncommitted NO_OP operation due to leader change: 20.13
I20260709 14:53:24.441627  7777 raft_consensus.cc:2889] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:53:24.442015 13829 consensus_queue.cc:237] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:24.444615 13993 raft_consensus.cc:3055] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 LEADER]: Stepping down as leader of term 16
I20260709 14:53:24.445214 13993 raft_consensus.cc:740] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:53:24.417502 13882 consensus_queue.cc:237] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:24.446635 13993 consensus_queue.cc:260] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:24.447993 13993 raft_consensus.cc:3060] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Advancing to term 17
I20260709 14:53:24.449807 14034 raft_consensus.cc:2804] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 14:53:24.450525 14034 raft_consensus.cc:697] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:24.451504 14034 consensus_queue.cc:237] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:24.456969  7894 leader_election.cc:304] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:53:24.460961  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:53:24.471696  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 47500.4us
I20260709 14:53:24.469457  7745 leader_election.cc:304] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:53:24.477710  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 158186us
I20260709 14:53:24.474561 13982 raft_consensus.cc:2749] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 14:53:24.483314  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:24.487166 14041 raft_consensus.cc:2749] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 14:53:24.489108  7745 leader_election.cc:304] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:24.492818 14041 raft_consensus.cc:2749] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 14:53:24.494081  7819 leader_election.cc:304] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:24.494827  7745 leader_election.cc:304] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:24.495317 14042 raft_consensus.cc:2764] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260709 14:53:24.495700 14041 raft_consensus.cc:2749] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 14:53:24.496194  7819 leader_election.cc:304] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:24.497084 14042 raft_consensus.cc:2804] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Leader election won for term 19
I20260709 14:53:24.497946 14042 raft_consensus.cc:697] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:53:24.498905 13835 consensus_queue.cc:1048] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 14:53:24.499246 14042 consensus_queue.cc:237] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:24.498687 13882 consensus_queue.cc:1048] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.002s
I20260709 14:53:24.496989  7745 leader_election.cc:304] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:24.504477 13964 raft_consensus.cc:2749] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 14:53:24.508647  7745 leader_election.cc:304] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 3876b8ee8d744cb18e91d97aae93b1ac, 9418391fa82a42c79c6cad13ba91d964
I20260709 14:53:24.514657  7745 leader_election.cc:304] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:24.519907 13852 raft_consensus.cc:515] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:24.527298 14005 raft_consensus.cc:493] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:24.530186  7922 raft_consensus.cc:1275] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 14:53:24.536341 13852 leader_election.cc:290] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 18 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:24.528267 14005 raft_consensus.cc:515] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:24.539122  7922 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
mode: GRACEFUL
new_leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:48676
I20260709 14:53:24.540017  7922 raft_consensus.cc:606] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 LEADER]: Received request to transfer leadership to TS 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:53:24.543067 14003 consensus_queue.cc:1048] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 14:53:24.543972  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:24.545071  7774 raft_consensus.cc:3060] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Advancing to term 18
I20260709 14:53:24.545536  7894 leader_election.cc:304] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:24.519758 13964 raft_consensus.cc:2749] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 14:53:24.552284  7894 leader_election.cc:304] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:24.533510 14041 raft_consensus.cc:2749] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 14:53:24.562441  7745 leader_election.cc:304] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:24.563742  7854 raft_consensus.cc:1275] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 14:53:24.564201  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:24.516491 14042 consensus_queue.cc:1059] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 14:53:24.567443  7921 raft_consensus.cc:2468] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 17.
I20260709 14:53:24.557964 13882 raft_consensus.cc:2749] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 14:53:24.559365 13987 consensus_queue.cc:1048] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.014s
W20260709 14:53:24.573385 14038 log.cc:927] Time spent T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.055s	user 0.002s	sys 0.000s
I20260709 14:53:24.574433 13955 raft_consensus.cc:2749] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 14:53:24.557729 13979 raft_consensus.cc:3060] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 14:53:24.550693 13795 leader_election.cc:290] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:53:24.564741 14037 log.cc:927] Time spent T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 14:53:24.562611 14032 raft_consensus.cc:493] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:53:24.594117  7742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:24.599086  7774 raft_consensus.cc:2468] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 18.
I20260709 14:53:24.600651  7922 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "939996e77ee64e9fab21aef50758b706"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
mode: GRACEFUL
new_leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:48676
I20260709 14:53:24.602110  7922 raft_consensus.cc:606] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 LEADER]: Received request to transfer leadership to TS 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:53:24.603087  7744 leader_election.cc:304] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:53:24.609519  7774 raft_consensus.cc:1275] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 14:53:24.616961  7745 leader_election.cc:304] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:24.620748  7745 leader_election.cc:304] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:24.624061  7745 leader_election.cc:304] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:24.564836 13980 raft_consensus.cc:515] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:24.563864 13975 consensus_queue.cc:1059] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.051s
I20260709 14:53:24.615799 13795 raft_consensus.cc:2804] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 14:53:24.620994  7893 leader_election.cc:304] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:53:24.585919 13894 consensus_queue.cc:1048] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 14:53:24.594898 13964 consensus_queue.cc:1048] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.035s
I20260709 14:53:24.629740 14041 raft_consensus.cc:2749] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 14:53:24.618757 13829 raft_consensus.cc:2749] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 14:53:24.629292 14003 raft_consensus.cc:2764] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 14:53:24.644603  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:24.636785 13795 raft_consensus.cc:493] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 14:53:24.679216  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 119215us
I20260709 14:53:24.680812 14042 consensus_queue.cc:1059] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 14:53:24.680784 14010 raft_consensus.cc:515] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:53:24.682060  7744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:24.682473 13975 raft_consensus.cc:3055] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 LEADER]: Stepping down as leader of term 19
I20260709 14:53:24.682941 13975 raft_consensus.cc:740] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:53:24.683956 13975 consensus_queue.cc:260] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:24.685343 13975 raft_consensus.cc:3060] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Advancing to term 20
I20260709 14:53:24.685743 14010 leader_election.cc:290] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 20 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:24.686113  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:24.613886 14032 raft_consensus.cc:515] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:24.691569 14032 leader_election.cc:290] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:53:24.692353 14031 log.cc:927] Time spent T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.164s	user 0.002s	sys 0.000s
I20260709 14:53:24.694547 13998 consensus_queue.cc:1048] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 14:53:24.695495 14001 raft_consensus.cc:515] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:24.696606 13998 consensus_queue.cc:1059] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 14:53:24.635201 14025 raft_consensus.cc:515] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:24.697891 14042 raft_consensus.cc:3055] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 LEADER]: Stepping down as leader of term 20
I20260709 14:53:24.698320 14042 raft_consensus.cc:740] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:53:24.699594 14025 leader_election.cc:290] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 21 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:24.699684 13980 leader_election.cc:290] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:24.699255 14042 consensus_queue.cc:260] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:24.644930 13984 consensus_queue.cc:1048] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.024s
I20260709 14:53:24.700918 14005 leader_election.cc:290] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:24.701538  7819 leader_election.cc:304] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:24.655292 13795 raft_consensus.cc:3060] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Advancing to term 18
I20260709 14:53:24.702567  7819 leader_election.cc:304] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:24.703569  7819 leader_election.cc:304] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:24.700769 14042 raft_consensus.cc:3060] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Advancing to term 21
I20260709 14:53:24.655846 13835 raft_consensus.cc:2804] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 14:53:24.706090 13835 raft_consensus.cc:697] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:24.707269 13835 consensus_queue.cc:237] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:24.702688  7775 raft_consensus.cc:2393] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 21: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:53:24.711824  7852 raft_consensus.cc:1275] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 14:53:24.705034 14001 leader_election.cc:290] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 20 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:24.718853  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:24.711824 13975 raft_consensus.cc:2804] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 23 FOLLOWER]: Leader election won for term 23
I20260709 14:53:24.736919  7819 leader_election.cc:304] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:24.741410  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:24.742324  7852 raft_consensus.cc:2468] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 19.
I20260709 14:53:24.744705  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:24.746810  7854 raft_consensus.cc:2468] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 15.
W20260709 14:53:24.750919  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 130027us
I20260709 14:53:24.733882 13980 consensus_queue.cc:1048] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.026s
I20260709 14:53:24.761408  7894 leader_election.cc:304] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:24.747701 13979 raft_consensus.cc:2749] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 14:53:24.745904 14001 raft_consensus.cc:493] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:24.774904 14001 raft_consensus.cc:515] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:24.776603 14062 raft_consensus.cc:2804] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Leader election won for term 18
I20260709 14:53:24.774010 14061 raft_consensus.cc:2804] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Leader election won for term 19
I20260709 14:53:24.777740 14062 raft_consensus.cc:697] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:53:24.779642 14062 consensus_queue.cc:237] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:24.778208 14061 raft_consensus.cc:697] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:53:24.783200 14061 consensus_queue.cc:237] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:24.788543 14001 leader_election.cc:290] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:24.781663 14059 raft_consensus.cc:493] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:24.791201 13979 raft_consensus.cc:2804] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 14:53:24.784946 14055 raft_consensus.cc:2804] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Leader election won for term 17
W20260709 14:53:24.794588  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:53:24.795096  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:24.796654  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:24.797389  7919 raft_consensus.cc:3060] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Advancing to term 20
W20260709 14:53:24.810271  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 73457.8us
I20260709 14:53:24.811549  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:24.811846  7819 leader_election.cc:304] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 9418391fa82a42c79c6cad13ba91d964
I20260709 14:53:24.812362  7921 raft_consensus.cc:2393] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 21: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:53:24.807135  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:24.817823  7927 raft_consensus.cc:2468] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 16.
I20260709 14:53:24.820926  7919 raft_consensus.cc:2468] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 20.
I20260709 14:53:24.822337  7819 leader_election.cc:304] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:24.823668  7819 leader_election.cc:304] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:24.825759  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:24.825918  7819 leader_election.cc:304] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:24.828137  7819 leader_election.cc:304] T 9441e831627143a991a1556dcdce71e3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 9418391fa82a42c79c6cad13ba91d964
I20260709 14:53:24.828557  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:24.826648  7774 raft_consensus.cc:3060] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Advancing to term 20
I20260709 14:53:24.829478  7778 raft_consensus.cc:2468] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 20.
I20260709 14:53:24.794641 13979 raft_consensus.cc:493] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:24.842128  7774 raft_consensus.cc:2468] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 20.
I20260709 14:53:24.845201  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:24.844974 13979 raft_consensus.cc:3060] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Advancing to term 21
I20260709 14:53:24.851109  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:24.851961  7773 raft_consensus.cc:3060] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Advancing to term 14
I20260709 14:53:24.809916 14059 raft_consensus.cc:515] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:24.854278  7779 raft_consensus.cc:1275] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 14:53:24.855726 14059 leader_election.cc:290] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:24.858242  7847 raft_consensus.cc:1275] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 10. (term mismatch)
I20260709 14:53:24.858744  7847 pending_rounds.cc:85] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting all ops after (but not including) 9
I20260709 14:53:24.858912  7847 pending_rounds.cc:107] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting uncommitted NO_OP operation due to leader change: 13.10
I20260709 14:53:24.859251  7847 raft_consensus.cc:2889] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:53:24.846966  7777 raft_consensus.cc:2468] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 15.
I20260709 14:53:24.820604 13975 raft_consensus.cc:697] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 23 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:53:24.819401 14055 raft_consensus.cc:697] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:53:24.870427 14059 raft_consensus.cc:2749] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 14:53:24.873221 14059 raft_consensus.cc:2749] T 9441e831627143a991a1556dcdce71e3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 14:53:24.807982 14005 consensus_queue.cc:1048] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.039s
I20260709 14:53:24.886930  7894 leader_election.cc:304] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:24.857560 13993 raft_consensus.cc:2749] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 14:53:24.893318  7744 leader_election.cc:304] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:53:24.896109  7744 leader_election.cc:304] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:53:24.901484 13964 raft_consensus.cc:2804] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Leader election won for term 20
I20260709 14:53:24.881681 14069 raft_consensus.cc:2749] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 14:53:24.901846 14025 raft_consensus.cc:2804] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 14:53:24.906617 14025 raft_consensus.cc:493] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:24.907101 14025 raft_consensus.cc:3060] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Advancing to term 17
I20260709 14:53:24.906446 14055 consensus_queue.cc:237] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:24.904973 13964 raft_consensus.cc:697] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:53:24.909322 13964 consensus_queue.cc:237] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:24.917567  7777 raft_consensus.cc:1275] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 14:53:24.922016 13982 raft_consensus.cc:2804] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 14:53:24.922868 13982 raft_consensus.cc:493] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:24.923331 13982 raft_consensus.cc:3060] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Advancing to term 16
W20260709 14:53:24.930732  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:53:24.937292  7745 leader_election.cc:336] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 1.554s (SENT)
I20260709 14:53:24.887455 13979 raft_consensus.cc:515] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:24.938753 13987 raft_consensus.cc:3055] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 LEADER]: Stepping down as leader of term 19
I20260709 14:53:24.988754  7854 raft_consensus.cc:1275] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
W20260709 14:53:24.999858  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 171714us
I20260709 14:53:25.001539  7819 leader_election.cc:304] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:25.006512  7819 leader_election.cc:304] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:24.975116 13987 raft_consensus.cc:740] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:53:24.962541 13795 raft_consensus.cc:515] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:25.042888 14061 raft_consensus.cc:2804] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 14:53:25.011852 14055 raft_consensus.cc:2749] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 LEADER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 14:53:25.065954  7819 leader_election.cc:304] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
W20260709 14:53:25.119408  7745 leader_election.cc:336] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 1.550s (SENT)
I20260709 14:53:25.151744  7745 leader_election.cc:304] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:53:25.152035  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 86350.3us
I20260709 14:53:25.064777 14022 raft_consensus.cc:2749] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 14:53:25.042364 13963 raft_consensus.cc:493] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:24.957438 13975 consensus_queue.cc:237] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:25.135087 14061 raft_consensus.cc:493] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
W20260709 14:53:25.154017  7745 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 1.515s (SENT) [suppressed 42 similar messages]
I20260709 14:53:25.047104 14069 consensus_queue.cc:1059] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 11, Time since last communication: 0.110s
I20260709 14:53:25.120755 13795 leader_election.cc:290] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:53:25.163089  7742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:53:25.156987 14051 log.cc:927] Time spent T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
W20260709 14:53:25.181691  8599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 52813.9us
W20260709 14:53:25.168169 14027 log.cc:927] Time spent T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 14:53:25.156551 13964 raft_consensus.cc:2749] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 14:53:25.161446 14003 raft_consensus.cc:493] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:25.161058 14041 raft_consensus.cc:493] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:25.182439 14061 raft_consensus.cc:3060] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Advancing to term 21
I20260709 14:53:25.173229 14062 consensus_queue.cc:1059] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.031s
W20260709 14:53:25.224690  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 70715.9us
W20260709 14:53:25.230232  7745 leader_election.cc:336] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Timed out: RequestConsensusVote RPC to 127.6.101.66:34529 timed out after 2.158s (SENT)
I20260709 14:53:25.197448  7819 leader_election.cc:304] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:25.131933 14068 consensus_queue.cc:1059] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.107s
I20260709 14:53:25.179407 13963 raft_consensus.cc:515] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:53:25.242317  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 44946.8us
I20260709 14:53:25.232103 14001 raft_consensus.cc:493] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:25.255434 14001 raft_consensus.cc:515] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:25.243088 14062 raft_consensus.cc:2764] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260709 14:53:25.258631 14001 leader_election.cc:290] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:25.244254 14075 raft_consensus.cc:2804] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Leader election won for term 15
I20260709 14:53:25.228111 13955 raft_consensus.cc:493] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:25.260488 14075 raft_consensus.cc:697] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:53:25.260402 13955 raft_consensus.cc:515] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:53:25.245456 14066 log.cc:927] Time spent T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.183s	user 0.000s	sys 0.001s
I20260709 14:53:25.262002 13987 consensus_queue.cc:260] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:25.263710 13955 leader_election.cc:290] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:53:25.246351  7744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:25.223238 14007 raft_consensus.cc:493] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:25.249723 13979 leader_election.cc:290] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 21 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:25.238489 13781 raft_consensus.cc:993] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0: : Instructing follower 1de5e20126fa4d8ca0793d19c7b847ed to start an election
W20260709 14:53:25.250806 14074 log.cc:927] Time spent T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.109s	user 0.000s	sys 0.001s
I20260709 14:53:25.186591 14055 consensus_queue.cc:1059] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.055s
I20260709 14:53:25.208081 14069 consensus_queue.cc:1059] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.044s
I20260709 14:53:25.251904  7922 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
mode: GRACEFUL
new_leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:48676
I20260709 14:53:25.225478 14003 raft_consensus.cc:515] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:25.273164 14078 raft_consensus.cc:493] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:25.278530  7922 raft_consensus.cc:606] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 LEADER]: Received request to transfer leadership to TS 1de5e20126fa4d8ca0793d19c7b847ed
W20260709 14:53:25.284292 14073 log.cc:927] Time spent T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.307s	user 0.002s	sys 0.000s
I20260709 14:53:25.284209  7773 raft_consensus.cc:2468] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 14.
I20260709 14:53:25.285652 14078 raft_consensus.cc:515] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:25.286852 14003 leader_election.cc:290] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:25.226919 14041 raft_consensus.cc:515] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:25.288357 14078 leader_election.cc:290] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:25.171514 14071 consensus_queue.cc:1048] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.240s
I20260709 14:53:25.298108 13963 leader_election.cc:290] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:25.300160 14069 raft_consensus.cc:3055] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 22 LEADER]: Stepping down as leader of term 22
I20260709 14:53:25.300742 14069 raft_consensus.cc:740] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:53:25.301764 14069 consensus_queue.cc:260] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:25.283310 14033 raft_consensus.cc:1081] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 LEADER]: Signalling peer 1de5e20126fa4d8ca0793d19c7b847ed to start an election
I20260709 14:53:25.274147 14007 raft_consensus.cc:515] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:25.306937 14069 raft_consensus.cc:3060] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 22 FOLLOWER]: Advancing to term 23
I20260709 14:53:25.275800 14025 raft_consensus.cc:515] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:25.322603 14022 raft_consensus.cc:3055] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 LEADER]: Stepping down as leader of term 16
I20260709 14:53:25.330091 14022 raft_consensus.cc:740] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:53:25.330616 14068 raft_consensus.cc:3055] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 LEADER]: Stepping down as leader of term 20
I20260709 14:53:25.290458 14041 leader_election.cc:290] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:25.262094 14075 consensus_queue.cc:237] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:53:25.332459  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 397613us
W20260709 14:53:25.333782  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 60843.9us
W20260709 14:53:25.305074 14082 log.cc:927] Time spent T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 14:53:25.341619 14078 raft_consensus.cc:493] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:25.331342 14025 leader_election.cc:290] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:25.342128 14056 raft_consensus.cc:493] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:25.342454 14078 raft_consensus.cc:515] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:25.341781 14062 consensus_queue.cc:1059] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.003s
I20260709 14:53:25.344018 14071 raft_consensus.cc:3055] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 LEADER]: Stepping down as leader of term 17
I20260709 14:53:25.344468 14071 raft_consensus.cc:740] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:53:25.342514  7922 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
mode: GRACEFUL
new_leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:48676
I20260709 14:53:25.345423  7922 raft_consensus.cc:606] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 LEADER]: Received request to transfer leadership to TS 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:53:25.345778 14071 consensus_queue.cc:260] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:25.347254 14071 raft_consensus.cc:3060] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Advancing to term 18
I20260709 14:53:25.332101 14068 raft_consensus.cc:740] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:53:25.349606 14068 consensus_queue.cc:260] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:25.351034  7922 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
mode: GRACEFUL
new_leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:48676
I20260709 14:53:25.351914  7922 raft_consensus.cc:606] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Received request to transfer leadership to TS 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:53:25.353600  7922 raft_consensus.cc:614] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 14:53:25.354635 14062 consensus_queue.cc:1059] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 14:53:25.356312 14055 raft_consensus.cc:3055] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 LEADER]: Stepping down as leader of term 21
I20260709 14:53:25.356791 14055 raft_consensus.cc:740] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:53:25.309007 14007 leader_election.cc:290] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:25.358325 14055 consensus_queue.cc:260] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:25.360553 14055 raft_consensus.cc:3060] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Advancing to term 22
I20260709 14:53:25.340673  7893 leader_election.cc:304] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:25.353296 14061 raft_consensus.cc:515] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:25.363835  7893 leader_election.cc:304] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:25.377722  7854 raft_consensus.cc:1275] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 14:53:25.382717  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:25.389310  7848 raft_consensus.cc:3060] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Advancing to term 21
I20260709 14:53:25.387027  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:25.387583  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:25.347254 13982 raft_consensus.cc:515] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:25.401667 13982 leader_election.cc:290] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:25.403678 13987 raft_consensus.cc:3060] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Advancing to term 20
I20260709 14:53:25.394245 13530 raft_consensus.cc:3055] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 LEADER]: Stepping down as leader of term 12
I20260709 14:53:25.405640 13530 raft_consensus.cc:740] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:53:25.387203 14005 raft_consensus.cc:2804] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 14:53:25.407501 13530 consensus_queue.cc:260] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:25.350978 14068 raft_consensus.cc:3060] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Advancing to term 21
W20260709 14:53:25.435537  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 71832.4us
I20260709 14:53:25.425372  7675 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54344 (request call id 380) took 3666 ms. Trace:
I20260709 14:53:25.426378  7745 leader_election.cc:304] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:25.427546  7773 raft_consensus.cc:1240] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 13. Current term is 14. Ops: []
I20260709 14:53:25.429286  7779 raft_consensus.cc:1240] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 19. Current term is 20. Ops: []
I20260709 14:53:25.431046  7777 raft_consensus.cc:1240] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 16. Current term is 18. Ops: []
I20260709 14:53:25.441985  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:25.443010  7846 raft_consensus.cc:2410] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for term 17 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 14:53:25.368466 14025 raft_consensus.cc:493] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:25.437567  7675 rpcz_store.cc:276] 0709 14:53:21.730264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:53:21.730464 (+   200us) service_pool.cc:224] Handling call
0709 14:53:25.396231 (+3665767us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 14:53:23.284203 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 14:53:23.345123 (+ 60920us) write_op.cc:432] Acquiring schema lock in shared mode
0709 14:53:23.345166 (+    43us) write_op.cc:435] Acquired schema lock
0709 14:53:23.345183 (+    17us) tablet.cc:662] Decoding operations
0709 14:53:23.346685 (+  1502us) write_op.cc:620] Acquiring the partition lock for write op
0709 14:53:23.346780 (+    95us) write_op.cc:641] Partition lock acquired for write op
0709 14:53:23.346809 (+    29us) tablet.cc:685] Acquiring locks for 16 operations
0709 14:53:23.348252 (+  1443us) tablet.cc:701] Row locks acquired
0709 14:53:23.348274 (+    22us) write_op.cc:260] PREPARE: finished
0709 14:53:23.348436 (+   162us) write_op.cc:270] Start()
0709 14:53:23.348558 (+   122us) write_op.cc:276] Timestamp: P: 1783608803348378 usec, L: 0
0709 14:53:23.348578 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 14:53:23.383484 (+ 34906us) log.cc:844] Serialized 6314 byte log entry
0709 14:53:23.623900 (+240416us) op_driver.cc:464] REPLICATION: finished
0709 14:53:23.650382 (+ 26482us) write_op.cc:301] APPLY: starting
0709 14:53:23.650496 (+   114us) tablet.cc:1367] starting BulkCheckPresence
0709 14:53:23.987808 (+337312us) tablet.cc:1370] finished BulkCheckPresence
0709 14:53:23.987975 (+   167us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 14:53:24.441109 (+453134us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 14:53:24.513924 (+ 72815us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=32,key_file_lookups=32,delta_file_lookups=32,mrs_lookups=0
0709 14:53:24.530334 (+ 16410us) write_op.cc:312] APPLY: finished
0709 14:53:24.536432 (+  6098us) log.cc:844] Serialized 148 byte log entry
0709 14:53:24.536633 (+   201us) write_op.cc:489] Releasing partition, row and schema locks
0709 14:53:24.536830 (+   197us) write_op.cc:454] Released schema lock
0709 14:53:24.536891 (+    61us) write_op.cc:341] FINISH: Updating metrics
0709 14:53:24.550458 (+ 13567us) write_op.cc:489] Releasing partition, row and schema locks
0709 14:53:24.554239 (+  3781us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":41,"child_traces":[["op",{"apply.queue_time_us":26151,"apply.run_cpu_time_us":34118,"apply.run_wall_time_us":887095,"cfile_cache_hit":66,"cfile_cache_hit_bytes":70815,"num_ops":16,"prepare.queue_time_us":110071,"prepare.run_cpu_time_us":6357,"prepare.run_wall_time_us":121751,"replication_time_us":275116,"thread_start_us":110500,"threads_started":2}]]}
I20260709 14:53:25.387914 13894 raft_consensus.cc:493] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:25.464636  7777 raft_consensus.cc:1275] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 14:53:25.468369  7775 raft_consensus.cc:1240] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 LEADER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 19. Current term is 20. Ops: [19.12-19.12]
I20260709 14:53:25.433689 13731 raft_consensus.cc:493] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:25.331336 14022 consensus_queue.cc:260] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:25.407626 14005 raft_consensus.cc:697] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
W20260709 14:53:25.472806  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 62974.7us
I20260709 14:53:25.434134 14034 raft_consensus.cc:493] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:25.473747  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:25.481292  7776 raft_consensus.cc:2393] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 17: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:53:25.474247  7848 raft_consensus.cc:2468] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 21.
I20260709 14:53:25.433821 14060 raft_consensus.cc:2749] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 14:53:25.480755  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:25.443696 14003 raft_consensus.cc:2749] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 14:53:25.482082  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:25.343321 14056 raft_consensus.cc:515] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:25.477479  7777 raft_consensus.cc:1275] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 14:53:25.482906  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:25.492489  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:25.471994 13530 raft_consensus.cc:3060] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Advancing to term 13
I20260709 14:53:25.485146  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:25.495045  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:25.516041  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:25.485625  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:25.480239  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:25.495143  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:25.523200  7779 raft_consensus.cc:2468] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 15.
I20260709 14:53:25.496367 14061 leader_election.cc:290] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 21 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:25.497089  7846 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258"
dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
mode: GRACEFUL
new_leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
 from {username='slave'} at 127.0.0.1:41662
I20260709 14:53:25.497334 14056 leader_election.cc:290] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:25.504101 13975 consensus_queue.cc:1059] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 14:53:25.487313 14035 consensus_queue.cc:1048] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.022s
I20260709 14:53:25.506953 14065 consensus_queue.cc:1059] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 14:53:25.478895 13731 raft_consensus.cc:515] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:25.511868 14078 leader_election.cc:290] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:25.508659 14059 consensus_queue.cc:1048] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.004s
I20260709 14:53:25.516494  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
W20260709 14:53:25.488401  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:25.540509  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:25.471472 14025 raft_consensus.cc:515] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:25.470679 13894 raft_consensus.cc:515] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:25.543078  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:25.544610  7848 raft_consensus.cc:3060] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Advancing to term 17
I20260709 14:53:25.523265 14022 raft_consensus.cc:3060] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Advancing to term 17
W20260709 14:53:25.592638 14089 log.cc:927] Time spent T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.070s	user 0.000s	sys 0.004s
W20260709 14:53:25.544121  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 50902.4us
I20260709 14:53:25.541532  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:25.545051  7894 leader_election.cc:304] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:25.549089  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:53:25.545171  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:53:25.594911  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:25.520902 14010 consensus_queue.cc:1048] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 14:53:25.568174 13731 leader_election.cc:290] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:25.548086 14056 consensus_queue.cc:1048] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 14:53:25.574278 13975 raft_consensus.cc:3055] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 LEADER]: Stepping down as leader of term 19
I20260709 14:53:25.574671  7848 raft_consensus.cc:2468] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 17.
I20260709 14:53:25.601109 13975 raft_consensus.cc:740] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
W20260709 14:53:25.602377  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:25.602882 13975 consensus_queue.cc:260] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:25.604420 13975 raft_consensus.cc:3060] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Advancing to term 20
I20260709 14:53:25.575362 14005 consensus_queue.cc:237] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:25.576083 14025 leader_election.cc:290] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:25.550711  7850 raft_consensus.cc:3060] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Advancing to term 18
I20260709 14:53:25.610204  7851 raft_consensus.cc:2410] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for term 23 because replica has last-logged OpId of term: 22 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 12.
I20260709 14:53:25.611289  7893 leader_election.cc:304] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:25.516157 14060 consensus_queue.cc:1048] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.036s
W20260709 14:53:25.613567  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 68593.3us
I20260709 14:53:25.613343 13980 raft_consensus.cc:2804] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 14:53:25.615082 13980 raft_consensus.cc:697] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:25.488322 14034 raft_consensus.cc:515] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:25.586053 14007 raft_consensus.cc:993] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0: : Instructing follower 1de5e20126fa4d8ca0793d19c7b847ed to start an election
I20260709 14:53:25.617012 14007 raft_consensus.cc:1081] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 LEADER]: Signalling peer 1de5e20126fa4d8ca0793d19c7b847ed to start an election
I20260709 14:53:25.588354 13894 leader_election.cc:290] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:25.596669 14041 raft_consensus.cc:493] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:25.619066 14034 leader_election.cc:290] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:25.578348  7673 catalog_manager.cc:5697] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 13 to 15, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 15 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:53:25.618625 14041 raft_consensus.cc:515] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:25.600330 14065 raft_consensus.cc:3055] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 LEADER]: Stepping down as leader of term 13
I20260709 14:53:25.619994 14065 raft_consensus.cc:740] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:53:25.621843 14041 leader_election.cc:290] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:25.624390 13982 consensus_queue.cc:1048] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 14:53:25.624171  7673 catalog_manager.cc:5697] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 22 to 23, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 23 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:53:25.621840 14065 consensus_queue.cc:260] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:25.626230  7777 raft_consensus.cc:1275] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 14:53:25.626823  7673 catalog_manager.cc:5697] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 12 to 13, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 13 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:53:25.628763  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:25.631577  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:25.633183  7845 raft_consensus.cc:1275] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 23 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 23 index: 13. (term mismatch)
I20260709 14:53:25.633678  7845 pending_rounds.cc:85] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting all ops after (but not including) 12
I20260709 14:53:25.633932  7845 pending_rounds.cc:107] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting uncommitted NO_OP operation due to leader change: 22.13
I20260709 14:53:25.634171  7845 raft_consensus.cc:2889] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:53:25.638090  7847 raft_consensus.cc:1275] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 22 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 14:53:25.627692 14065 raft_consensus.cc:3060] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Advancing to term 14
I20260709 14:53:25.614938 14060 raft_consensus.cc:2804] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 14:53:25.644223 14060 raft_consensus.cc:697] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:25.645236 14060 consensus_queue.cc:237] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:25.646759  7850 raft_consensus.cc:2468] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 18.
I20260709 14:53:25.652304  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:25.653385  7773 raft_consensus.cc:3060] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Advancing to term 21
I20260709 14:53:25.653499  7777 raft_consensus.cc:1275] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 14:53:25.598708  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:25.662392  7854 raft_consensus.cc:2376] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 18. Re-sending same reply.
I20260709 14:53:25.662891  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:25.618770 13980 consensus_queue.cc:237] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:25.667196  7673 catalog_manager.cc:5697] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 18 to 19, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 19 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:53:25.666222  7848 raft_consensus.cc:3055] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 LEADER]: Stepping down as leader of term 17
I20260709 14:53:25.670879  7775 raft_consensus.cc:1275] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 14:53:25.678746  7848 raft_consensus.cc:740] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:53:25.678772  7770 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16"
dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:37144
I20260709 14:53:25.672281  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:25.680377  7774 raft_consensus.cc:2468] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 18.
I20260709 14:53:25.675096  7919 raft_consensus.cc:1240] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 LEADER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 17. Current term is 18. Ops: []
I20260709 14:53:25.677763  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:25.679785  7770 raft_consensus.cc:493] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:53:25.684619  7770 raft_consensus.cc:3060] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Advancing to term 20
W20260709 14:53:25.686578  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 178994us
I20260709 14:53:25.681872  7673 catalog_manager.cc:5697] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 12 to 13, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 13 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:53:25.665800  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:25.692574  7925 raft_consensus.cc:1240] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 15. Current term is 16. Ops: []
I20260709 14:53:25.693101  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:25.694409  7778 raft_consensus.cc:2468] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 16.
I20260709 14:53:25.679898  7848 consensus_queue.cc:260] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:25.686160  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:25.695778  7848 raft_consensus.cc:3060] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Advancing to term 18
I20260709 14:53:25.696491  7921 raft_consensus.cc:2468] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 16.
I20260709 14:53:25.692770  7673 catalog_manager.cc:5697] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 15 to 16, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 16 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:53:25.706198  7849 raft_consensus.cc:1275] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 14:53:25.725518  7819 leader_election.cc:304] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:25.730400  7773 raft_consensus.cc:2468] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 21.
I20260709 14:53:25.692689  7850 raft_consensus.cc:2468] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 18.
I20260709 14:53:25.695832 13982 raft_consensus.cc:493] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:25.742473  7848 raft_consensus.cc:1275] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 11. (term mismatch)
I20260709 14:53:25.746058  7848 pending_rounds.cc:85] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting all ops after (but not including) 10
I20260709 14:53:25.746604  7848 pending_rounds.cc:107] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting uncommitted NO_OP operation due to leader change: 17.11
I20260709 14:53:25.746817  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:25.747239  7848 raft_consensus.cc:2889] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:53:25.747661  7919 raft_consensus.cc:3060] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 14:53:25.749431  7924 raft_consensus.cc:1240] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 LEADER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 20. Current term is 21. Ops: []
I20260709 14:53:25.753127  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:25.757302  7773 raft_consensus.cc:3060] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Advancing to term 16
I20260709 14:53:25.758566  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:25.762068  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:25.763191  7771 raft_consensus.cc:2393] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 18: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:53:25.704218 14041 raft_consensus.cc:493] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:25.764804  7924 raft_consensus.cc:1275] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 23 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 14:53:25.771308  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c563cc7cfbe4d59be4ffc5cf847ce56" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:25.771351  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:25.777684  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:25.785365  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:25.765610  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:25.779706  7745 leader_election.cc:304] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:25.780429  7772 raft_consensus.cc:1240] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 17. Current term is 18. Ops: []
I20260709 14:53:25.787159  7771 raft_consensus.cc:3060] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Advancing to term 17
I20260709 14:53:25.787595  7772 raft_consensus.cc:1240] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 20. Current term is 21. Ops: []
W20260709 14:53:25.780787  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:53:25.781514  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:25.694723 13894 consensus_queue.cc:1059] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.034s
I20260709 14:53:25.803531  7919 raft_consensus.cc:2468] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 18.
I20260709 14:53:25.775449  7770 raft_consensus.cc:515] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:25.810204  7922 raft_consensus.cc:1240] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 LEADER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 19. Current term is 20. Ops: []
I20260709 14:53:25.816273  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:25.815800  7919 raft_consensus.cc:1240] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 16. Current term is 17. Ops: []
I20260709 14:53:25.817163  7924 raft_consensus.cc:2468] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 13.
I20260709 14:53:25.835373  7773 raft_consensus.cc:2468] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 16.
I20260709 14:53:25.761318 14032 raft_consensus.cc:493] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:25.790951 14025 raft_consensus.cc:493] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:25.742240 13998 consensus_queue.cc:1048] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.095s
I20260709 14:53:25.840832  7770 leader_election.cc:290] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 20 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:25.842386  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:25.852550  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:25.853057  7928 raft_consensus.cc:2468] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 19.
I20260709 14:53:25.809578 14059 raft_consensus.cc:2804] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 14:53:25.846181  7771 raft_consensus.cc:1275] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 14:53:25.858146  7924 raft_consensus.cc:2393] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 16: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:53:25.762990 13982 raft_consensus.cc:515] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:25.845500 13894 consensus_queue.cc:1243] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer 1de5e20126fa4d8ca0793d19c7b847ed log is divergent from this leader: its last log entry 20.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 14:53:25.911424  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:25.912948  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:25.916062  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c563cc7cfbe4d59be4ffc5cf847ce56" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:25.912936  7848 raft_consensus.cc:3055] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 LEADER]: Stepping down as leader of term 19
I20260709 14:53:25.917443  7848 raft_consensus.cc:740] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:53:25.918315  7848 consensus_queue.cc:260] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:25.919694  7848 raft_consensus.cc:3060] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Advancing to term 20
I20260709 14:53:25.878490  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
W20260709 14:53:25.889137 14091 log.cc:927] Time spent T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 14:53:25.856334 14032 raft_consensus.cc:515] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:25.896265  7846 raft_consensus.cc:606] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Received request to transfer leadership to TS 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:25.934032  7846 raft_consensus.cc:614] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 14:53:25.865929 14025 raft_consensus.cc:515] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:25.866654 14059 raft_consensus.cc:493] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:25.899873  7927 raft_consensus.cc:1240] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 23 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 22. Current term is 23. Ops: [22.13-22.13]
I20260709 14:53:25.900794  7923 raft_consensus.cc:1240] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 20. Current term is 21. Ops: [20.12-20.12]
I20260709 14:53:25.901911  7926 raft_consensus.cc:1240] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 22 LEADER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 21. Current term is 22. Ops: []
I20260709 14:53:25.807591 14041 raft_consensus.cc:515] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:25.905098 13982 leader_election.cc:290] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:53:25.921476  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:25.916069  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
W20260709 14:53:25.950352  7817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:25.928263 13962 raft_consensus.cc:493] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:53:25.928944 14053 log.cc:927] Time spent T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.064s	user 0.001s	sys 0.003s
W20260709 14:53:25.934721  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:25.936280  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:25.936506  7848 raft_consensus.cc:1275] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 12. (term mismatch)
I20260709 14:53:25.950305  7928 raft_consensus.cc:3060] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 14:53:25.961072  7848 pending_rounds.cc:85] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting all ops after (but not including) 11
I20260709 14:53:25.961488  7848 pending_rounds.cc:107] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting uncommitted NO_OP operation due to leader change: 19.12
I20260709 14:53:25.949869  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:25.957293  7927 raft_consensus.cc:1275] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 14:53:25.963838  7927 raft_consensus.cc:1240] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 19. Current term is 20. Ops: [16.10-19.12]
I20260709 14:53:25.958654  7923 raft_consensus.cc:1275] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 14:53:25.961746  7848 raft_consensus.cc:2889] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:53:25.969502  7924 raft_consensus.cc:1275] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 14:53:25.973407  7927 raft_consensus.cc:1240] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 19. Current term is 20. Ops: []
I20260709 14:53:25.946321 14059 raft_consensus.cc:3060] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Advancing to term 16
W20260709 14:53:25.978399  7819 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:25.985606  7893 leader_election.cc:304] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:25.977402  7894 leader_election.cc:304] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:25.947366 13731 consensus_queue.cc:1048] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.043s
W20260709 14:53:25.989218 14097 log.cc:927] Time spent T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.057s	user 0.002s	sys 0.000s
I20260709 14:53:25.949321 13835 consensus_queue.cc:1048] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.042s
W20260709 14:53:25.978539 14061 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 20 current term: 20 is higher.
W20260709 14:53:26.037762  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:25.977907 13984 consensus_queue.cc:1048] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.043s
I20260709 14:53:25.960566 13962 raft_consensus.cc:515] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:25.997697 14077 consensus_queue.cc:1048] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.051s
I20260709 14:53:26.073904 14057 raft_consensus.cc:493] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:53:26.074476  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:26.076470  6549 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 14:53:26.077872 14032 leader_election.cc:290] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:26.078832  6549 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 14:53:26.081491 14041 leader_election.cc:290] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:26.082962 14025 leader_election.cc:290] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:53:26.094813  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:26.099112  7928 raft_consensus.cc:2468] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 17.
I20260709 14:53:25.996356 14081 raft_consensus.cc:2804] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 14:53:26.004715 14088 raft_consensus.cc:2804] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 14:53:26.116029  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:26.125144 13731 raft_consensus.cc:493] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:26.126681 13731 raft_consensus.cc:515] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:26.092764 14042 raft_consensus.cc:493] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:26.100710 14069 raft_consensus.cc:493] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:26.115198 14081 raft_consensus.cc:493] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:26.114158 14088 raft_consensus.cc:493] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:26.094192 14078 consensus_queue.cc:1048] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.047s
I20260709 14:53:26.093189 14057 raft_consensus.cc:515] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:53:26.141744 14022 consensus_meta.cc:287] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent flushing consensus metadata: real 0.551s	user 0.014s	sys 0.000s
W20260709 14:53:26.189689  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 194958us
I20260709 14:53:26.166841 14081 raft_consensus.cc:3060] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Advancing to term 19
I20260709 14:53:26.155961 14071 raft_consensus.cc:493] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:26.166343 14088 raft_consensus.cc:3060] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 14:53:26.209781  7847 raft_consensus.cc:1275] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
W20260709 14:53:26.210918  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 222912us
I20260709 14:53:26.212080  7926 raft_consensus.cc:1240] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 12. Current term is 13. Ops: []
I20260709 14:53:26.212460  7845 raft_consensus.cc:1240] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 20. Current term is 21. Ops: []
I20260709 14:53:26.156244 14042 raft_consensus.cc:515] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:26.215536  7920 raft_consensus.cc:1240] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 LEADER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 13. Current term is 14. Ops: []
I20260709 14:53:26.219621  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:26.225206  7924 raft_consensus.cc:1275] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 23 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 14:53:26.225924  7925 raft_consensus.cc:1275] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 14:53:26.227538  7922 raft_consensus.cc:1275] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 14:53:26.228607  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:26.167415 14069 raft_consensus.cc:515] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:26.230563  7819 leader_election.cc:304] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:53:26.212883  7893 leader_election.cc:304] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:26.241330  7919 raft_consensus.cc:1240] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 15. Current term is 16. Ops: []
I20260709 14:53:26.217000 13955 raft_consensus.cc:2749] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 14:53:26.227121 13963 raft_consensus.cc:993] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0: : Instructing follower 1de5e20126fa4d8ca0793d19c7b847ed to start an election
I20260709 14:53:26.235038 14025 raft_consensus.cc:493] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:26.249854  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:26.251127  7851 raft_consensus.cc:1275] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 14. (term mismatch)
I20260709 14:53:26.259195  7847 raft_consensus.cc:1275] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 12. (term mismatch)
I20260709 14:53:26.260931  7851 pending_rounds.cc:85] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting all ops after (but not including) 13
I20260709 14:53:26.260854  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:26.261585  7847 pending_rounds.cc:85] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting all ops after (but not including) 11
I20260709 14:53:26.261720  7851 pending_rounds.cc:107] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting uncommitted NO_OP operation due to leader change: 19.14
I20260709 14:53:26.262413  7847 pending_rounds.cc:107] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting uncommitted NO_OP operation due to leader change: 19.12
I20260709 14:53:26.262512  7851 raft_consensus.cc:2889] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:53:26.260450  7845 raft_consensus.cc:2468] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 23.
I20260709 14:53:26.245015 14065 raft_consensus.cc:2764] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 14:53:26.263258  7847 raft_consensus.cc:2889] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:53:26.225585 14071 raft_consensus.cc:515] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:53:26.273919  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 62169.1us
I20260709 14:53:26.277338  7893 leader_election.cc:304] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:26.264430 14060 raft_consensus.cc:493] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:26.245201 13975 consensus_queue.cc:1059] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
W20260709 14:53:26.289172  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 44616.1us
I20260709 14:53:26.269215 14041 raft_consensus.cc:493] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:26.267005 13962 leader_election.cc:290] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:26.290534 13835 raft_consensus.cc:2749] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 14:53:26.265687 14025 raft_consensus.cc:515] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:53:26.314055 14103 log.cc:927] Time spent T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 14:53:26.315623 14025 leader_election.cc:290] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:26.316568 14055 consensus_queue.cc:1048] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 14:53:26.318737 14042 leader_election.cc:290] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:26.319430 14035 raft_consensus.cc:493] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:26.320066 14035 raft_consensus.cc:515] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:26.321136 13962 raft_consensus.cc:2804] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 14:53:26.321636 13962 raft_consensus.cc:493] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:26.322005 13962 raft_consensus.cc:3060] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 14:53:26.322904 14032 consensus_queue.cc:1059] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 14:53:26.293015 14041 raft_consensus.cc:515] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:26.315649 14064 consensus_queue.cc:1059] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.010s
I20260709 14:53:26.325402 13984 raft_consensus.cc:1081] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 LEADER]: Signalling peer 1de5e20126fa4d8ca0793d19c7b847ed to start an election
I20260709 14:53:26.326392 14071 leader_election.cc:290] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:26.306277 14110 consensus_queue.cc:1048] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.030s
I20260709 14:53:26.325769 14033 raft_consensus.cc:3055] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 LEADER]: Stepping down as leader of term 20
W20260709 14:53:26.337123 14115 log.cc:927] Time spent T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.050s	user 0.000s	sys 0.001s
I20260709 14:53:26.343500 13955 raft_consensus.cc:493] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:26.353639 13955 raft_consensus.cc:515] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:26.348898 14033 raft_consensus.cc:740] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:26.356468 13955 leader_election.cc:290] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:26.339025 14022 consensus_queue.cc:1048] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 14:53:26.295153 14060 raft_consensus.cc:515] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:26.355926 14033 consensus_queue.cc:260] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:26.364420 14093 consensus_queue.cc:1048] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 14:53:26.447957  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 170776us
I20260709 14:53:26.457584 14108 raft_consensus.cc:3055] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 LEADER]: Stepping down as leader of term 15
I20260709 14:53:26.458212 14108 raft_consensus.cc:740] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:53:26.350821 14025 raft_consensus.cc:493] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:26.344472 14065 consensus_queue.cc:1048] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.104s
I20260709 14:53:26.450264 13955 raft_consensus.cc:493] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:26.476997 13955 raft_consensus.cc:515] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:53:26.479168  7745 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.666s	user 0.018s	sys 0.042s
W20260709 14:53:26.479648  7745 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.667s	user 0.018s	sys 0.042s
I20260709 14:53:26.448498 14069 leader_election.cc:290] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:53:26.480324  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 700679us
I20260709 14:53:26.482995 14041 leader_election.cc:290] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:26.480192 14108 consensus_queue.cc:260] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:26.484769  7745 leader_election.cc:304] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:26.485906 14041 raft_consensus.cc:2804] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader election won for term 17
I20260709 14:53:26.486938 14041 raft_consensus.cc:697] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:53:26.488065 14041 consensus_queue.cc:237] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:26.480509 13962 raft_consensus.cc:515] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:26.492478 14042 raft_consensus.cc:3055] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 LEADER]: Stepping down as leader of term 20
I20260709 14:53:26.495519 14042 raft_consensus.cc:740] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:53:26.495674 14059 raft_consensus.cc:515] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:26.497121  7854 raft_consensus.cc:1240] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 14:53:26.496820 14042 consensus_queue.cc:260] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:26.498387 14042 raft_consensus.cc:3060] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Advancing to term 21
I20260709 14:53:26.499624 13731 leader_election.cc:290] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:26.373546 14055 consensus_queue.cc:1048] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.102s
I20260709 14:53:26.503089 14081 raft_consensus.cc:515] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:26.470992 14025 raft_consensus.cc:515] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:26.511133  7745 leader_election.cc:304] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:26.470077 14033 raft_consensus.cc:3060] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Advancing to term 21
W20260709 14:53:26.554179  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 257158us
W20260709 14:53:26.558436  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 84102.3us
I20260709 14:53:26.560731  7893 leader_election.cc:304] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:26.533725 14035 leader_election.cc:290] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:26.571792 14003 raft_consensus.cc:493] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:26.554513 14117 raft_consensus.cc:2804] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader election won for term 18
I20260709 14:53:26.561422 14109 consensus_queue.cc:1048] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 14:53:26.532542 14118 consensus_queue.cc:1048] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.046s
I20260709 14:53:26.573530 14060 leader_election.cc:290] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:26.582285 14123 raft_consensus.cc:2749] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 14:53:26.585384 14003 raft_consensus.cc:515] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:26.591090 14041 raft_consensus.cc:493] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:26.610038  7776 raft_consensus.cc:1275] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 14:53:26.610287 14005 raft_consensus.cc:493] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:26.612401 14059 leader_election.cc:290] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 16 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:53:26.615415  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:26.574857 14119 consensus_queue.cc:1048] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 14:53:26.630632  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:26.600443 13955 leader_election.cc:290] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:26.640799  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:26.641729  7774 raft_consensus.cc:2468] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 16.
I20260709 14:53:26.642582  7776 raft_consensus.cc:1240] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 15. Current term is 16. Ops: []
I20260709 14:53:26.645396  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:26.646626  7893 leader_election.cc:304] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:26.623255 13962 leader_election.cc:290] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 17 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:26.655938  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:26.654732  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:26.655074  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:26.656821  7925 raft_consensus.cc:2468] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 17.
I20260709 14:53:26.657225  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:26.657737  7893 leader_election.cc:304] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:26.663932  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:26.637585 14083 raft_consensus.cc:493] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:26.682340  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:26.683363  7919 raft_consensus.cc:2393] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 21: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:53:26.678124  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:26.639501 13955 raft_consensus.cc:493] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:26.686280 14007 raft_consensus.cc:2804] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 14:53:26.637382 14041 raft_consensus.cc:515] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:26.701910 14007 raft_consensus.cc:697] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:26.702956 14007 consensus_queue.cc:237] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:26.703845 14041 leader_election.cc:290] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:26.704535 14041 raft_consensus.cc:493] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:26.705050 14041 raft_consensus.cc:515] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:26.660521 14056 raft_consensus.cc:2749] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 14:53:26.626184 14005 raft_consensus.cc:515] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:26.710867  7927 raft_consensus.cc:2468] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 18.
W20260709 14:53:26.711462 14122 log.cc:927] Time spent T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.250s	user 0.000s	sys 0.002s
I20260709 14:53:26.713410 14003 leader_election.cc:290] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:26.714327 14003 consensus_queue.cc:1048] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 14:53:26.708726 14041 leader_election.cc:290] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:26.652611 14088 raft_consensus.cc:515] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:53:26.723635  7819 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:53:26.725502 14101 log.cc:927] Time spent T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 14:53:26.650471 14109 raft_consensus.cc:493] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:26.731087  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:26.738651  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:26.739821  7850 raft_consensus.cc:2468] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 21.
W20260709 14:53:26.740617  7819 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:26.742162  7819 leader_election.cc:304] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:26.743755  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:26.744647  7850 raft_consensus.cc:2468] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 20.
I20260709 14:53:26.744988  7819 leader_election.cc:304] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:26.681951 14118 raft_consensus.cc:493] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:26.747548 14042 raft_consensus.cc:2749] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 14:53:26.701562 13955 raft_consensus.cc:515] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:26.742199 14109 raft_consensus.cc:515] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:26.696203 14083 raft_consensus.cc:515] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:26.755618 14055 consensus_queue.cc:1048] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 14:53:26.769268 14025 leader_election.cc:290] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:26.755120 14118 raft_consensus.cc:515] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:26.783885  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:26.751925 14075 raft_consensus.cc:2749] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 14:53:26.846462  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 187759us
I20260709 14:53:26.847007  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
W20260709 14:53:26.849046  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 94056.1us
I20260709 14:53:26.850219 14129 raft_consensus.cc:493] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:26.853343  7851 raft_consensus.cc:3060] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Advancing to term 17
I20260709 14:53:26.828002 14117 raft_consensus.cc:697] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:53:26.854682  7744 leader_election.cc:304] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:26.867326  7744 leader_election.cc:304] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:26.868830  7744 leader_election.cc:304] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:26.874030  7744 leader_election.cc:304] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:26.875403  7744 leader_election.cc:304] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:26.878742  7850 raft_consensus.cc:1275] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 14:53:26.864135 14129 raft_consensus.cc:515] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:26.873147 14119 raft_consensus.cc:2804] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 14:53:26.873400 14041 raft_consensus.cc:2804] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 14:53:26.952903  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 86333.1us
I20260709 14:53:26.982949 14129 leader_election.cc:290] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:26.988459 14109 leader_election.cc:290] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:26.963387 14131 raft_consensus.cc:3060] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Advancing to term 16
I20260709 14:53:26.992321  7924 raft_consensus.cc:2468] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 21.
I20260709 14:53:26.983160 13955 leader_election.cc:290] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:26.883684 14075 consensus_queue.cc:1048] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.095s
W20260709 14:53:27.001463 14114 log.cc:927] Time spent T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.684s	user 0.000s	sys 0.003s
I20260709 14:53:27.004184  7853 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49948 (request call id 4411) took 1522 ms. Trace:
I20260709 14:53:27.004941  7853 rpcz_store.cc:276] 0709 14:53:25.481637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:53:25.595991 (+114354us) service_pool.cc:224] Handling call
0709 14:53:25.596396 (+   405us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:53:25.600363 (+  3967us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 14:53:25.854732 (+254369us) log.cc:844] Serialized 14 byte log entry
0709 14:53:26.081049 (+226317us) spinlock_profiling.cc:243] Waited 40.9 ms on lock 0x7b180043eb20. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb690c69de1 00007fb690c765b1 00007fb687d83e07 00007fb690bdeab9 00007fb687da069b 00007fb687d9e93f 00007fb687da0c02 00007fb68aa2820b 00007fb68aa2dd23 00007fb68aa2e23a 00007fb68ae98a2a
0709 14:53:26.238651 (+157602us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:53:26.239272 (+   621us) log.cc:844] Serialized 26 byte log entry
0709 14:53:26.239429 (+   157us) raft_consensus.cc:1645] Marking committed up to 13
0709 14:53:26.239463 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:53:26.240353 (+   890us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:53:27.000635 (+760282us) spinlock_profiling.cc:243] Waited 22.2 ms on lock 0x7b4400022b4c. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb687c29db1 00007fb687cc7c85 00007fb687cc86a2 00007fb68aa3a1db 00007fb68aa35aaf 00007fb68aa2986e 00007fb68aa28bb6 00007fb68aa287d8 00007fb68aa32221 00007fb68aa321d9 00007fb68aa32169
0709 14:53:27.003686 (+  3051us) raft_consensus.cc:1685] finished
0709 14:53:27.003725 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:53:27.004081 (+   356us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46011,"prepare.queue_time_us":246165,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":65,"raft.queue_time_us":27737,"raft.run_cpu_time_us":258,"raft.run_wall_time_us":7369,"spinlock_wait_cycles":145201280,"thread_start_us":386128,"threads_started":2,"wal-append.queue_time_us":385150}
I20260709 14:53:27.022071  7819 leader_election.cc:304] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
W20260709 14:53:27.051000  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:26.949292 14119 raft_consensus.cc:493] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Starting leader election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:27.006371 14088 leader_election.cc:290] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 18 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:26.953904 14041 raft_consensus.cc:493] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Starting leader election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:27.059487  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: true dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:27.060344  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:27.060595  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:27.060786  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:27.056016  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:27.061738  7850 raft_consensus.cc:2468] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 21.
I20260709 14:53:27.060384  7853 raft_consensus.cc:3060] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Advancing to term 20
I20260709 14:53:27.065467  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:27.066021  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:27.072719  7926 raft_consensus.cc:2393] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 17: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:53:27.073547  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:27.074509  7848 raft_consensus.cc:2393] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 21: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
W20260709 14:53:27.049839 14132 log.cc:927] Time spent T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.103s	user 0.000s	sys 0.001s
I20260709 14:53:27.076224  7745 leader_election.cc:304] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
W20260709 14:53:27.050333 14136 log.cc:927] Time spent T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
W20260709 14:53:27.049602 14135 log.cc:927] Time spent T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
I20260709 14:53:27.025545 14025 raft_consensus.cc:2749] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 14:53:27.046214 14129 raft_consensus.cc:493] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:27.024842 14133 raft_consensus.cc:2749] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 14:53:27.093994  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:27.086428  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:27.088213  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:27.092990  7853 raft_consensus.cc:2468] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 20.
I20260709 14:53:26.892424 14117 consensus_queue.cc:237] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:27.111171  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:53:27.112969 14130 log.cc:927] Time spent T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 14:53:27.113219  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:27.110188  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:27.119349 14133 raft_consensus.cc:2804] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 14:53:27.119865 14133 raft_consensus.cc:493] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Starting leader election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:27.120253 14133 raft_consensus.cc:3060] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Advancing to term 21
I20260709 14:53:27.122032  7851 raft_consensus.cc:2410] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for term 17 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 14:53:27.059290 14119 raft_consensus.cc:3060] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Advancing to term 14
I20260709 14:53:27.110327 14025 raft_consensus.cc:493] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:27.081991 14041 raft_consensus.cc:3060] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Advancing to term 20
I20260709 14:53:27.102910 14129 raft_consensus.cc:515] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:27.122759  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:27.137059 14075 raft_consensus.cc:2764] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 14:53:27.048604 14065 consensus_queue.cc:1059] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.048s
I20260709 14:53:27.102706  7852 raft_consensus.cc:2410] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for term 18 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 14:53:27.152392 14109 raft_consensus.cc:493] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
W20260709 14:53:27.185616  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 310285us
I20260709 14:53:27.213155  7744 leader_election.cc:304] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:27.220553  7772 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37136 (request call id 3210) took 1439 ms. Trace:
I20260709 14:53:27.227160  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:27.151387 14025 raft_consensus.cc:515] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:27.229425  7772 rpcz_store.cc:276] 0709 14:53:25.788576 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:53:26.607188 (+818612us) service_pool.cc:224] Handling call
0709 14:53:26.607539 (+   351us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:53:26.607905 (+   366us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:53:26.607933 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:53:26.608432 (+   499us) log.cc:844] Serialized 26 byte log entry
0709 14:53:26.783315 (+174883us) raft_consensus.cc:1645] Marking committed up to 11
0709 14:53:26.783360 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:53:26.783803 (+   443us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:53:27.220242 (+436439us) raft_consensus.cc:1685] finished
0709 14:53:27.220270 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:53:27.220474 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":133,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":137,"thread_start_us":174279,"threads_started":1,"wal-append.queue_time_us":259110}
I20260709 14:53:27.189851 14143 raft_consensus.cc:493] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
W20260709 14:53:27.247103 14116 log.cc:927] Time spent T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.935s	user 0.012s	sys 0.009s
I20260709 14:53:27.216936 14118 leader_election.cc:290] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:27.184021 14059 consensus_queue.cc:1059] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.066s
I20260709 14:53:27.223222 14003 raft_consensus.cc:493] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:27.219609 14057 leader_election.cc:290] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:27.273542 14059 consensus_queue.cc:1243] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer 1e9289592458429bbddb19c2e7b7b7b0 log is divergent from this leader: its last log entry 14.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 14:53:27.268568 14003 raft_consensus.cc:515] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:27.276441 14147 consensus_queue.cc:1048] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 14:53:27.277536 14118 raft_consensus.cc:2749] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 14:53:27.278402 14118 raft_consensus.cc:493] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
W20260709 14:53:27.278584 14139 log.cc:927] Time spent T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 14:53:27.279333  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:27.259160 14056 raft_consensus.cc:493] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:27.280571 14056 raft_consensus.cc:515] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:27.267026 14033 raft_consensus.cc:493] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:27.289443 14033 raft_consensus.cc:515] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:27.292404 14033 leader_election.cc:290] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:27.292879 14003 leader_election.cc:290] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:27.293445 14007 raft_consensus.cc:493] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:53:27.294260 14003 raft_consensus.cc:493] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:27.294925 14003 raft_consensus.cc:515] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:27.229734 14109 raft_consensus.cc:515] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:27.293754  7848 raft_consensus.cc:2468] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 18.
I20260709 14:53:27.259294 14149 raft_consensus.cc:493] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:53:27.298219  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 223423us
I20260709 14:53:27.301798  7745 leader_election.cc:304] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
W20260709 14:53:27.309643  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 94096us
W20260709 14:53:27.313972  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 60082.9us
I20260709 14:53:27.314627 14117 raft_consensus.cc:493] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:27.330775  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:27.263653 14143 raft_consensus.cc:515] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:27.294170 14007 raft_consensus.cc:515] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:27.335017  7848 raft_consensus.cc:1275] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 14:53:27.334950  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:27.336104  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:27.336340  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:27.336889  7851 raft_consensus.cc:2468] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 20.
I20260709 14:53:27.297590 14118 raft_consensus.cc:515] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:27.311465 14033 raft_consensus.cc:493] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:53:27.315583 14117 raft_consensus.cc:515] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:27.346102  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:27.311676 14056 leader_election.cc:290] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:27.356436  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:27.304991 14149 raft_consensus.cc:515] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:27.379568 14003 leader_election.cc:290] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:27.380396 14133 raft_consensus.cc:515] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:27.394726 14118 leader_election.cc:290] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:27.404799 14007 leader_election.cc:290] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:27.407586 14133 leader_election.cc:290] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 21 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:27.409118  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:27.364727 14025 leader_election.cc:290] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:27.352222 14033 raft_consensus.cc:515] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:27.391498 14146 raft_consensus.cc:2804] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Leader election won for term 20
I20260709 14:53:27.392733 14003 raft_consensus.cc:493] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
W20260709 14:53:27.444499  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 111036us
I20260709 14:53:27.445566  7744 leader_election.cc:304] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:53:27.448395  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 107146us
I20260709 14:53:27.445640 14003 raft_consensus.cc:515] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:27.452490 14025 raft_consensus.cc:493] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:27.453094 14025 raft_consensus.cc:515] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:27.440106 14155 raft_consensus.cc:493] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:27.444046 14146 raft_consensus.cc:697] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:53:27.441826 14133 raft_consensus.cc:493] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:27.448629 14149 leader_election.cc:290] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:27.471089  7744 leader_election.cc:304] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:53:27.454233 14148 log.cc:927] Time spent T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.113s	user 0.001s	sys 0.001s
I20260709 14:53:27.478048  7744 leader_election.cc:304] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:27.454700 14003 leader_election.cc:290] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:27.455200 14109 leader_election.cc:290] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:27.455300 14025 leader_election.cc:290] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:27.453230 14129 leader_election.cc:290] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:27.489513 14117 leader_election.cc:290] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:27.489725 14169 raft_consensus.cc:2749] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 14:53:27.468547 14161 raft_consensus.cc:493] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:27.455578 14155 raft_consensus.cc:515] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:27.511632  7744 leader_election.cc:304] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:27.519467 14129 raft_consensus.cc:2804] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 14:53:27.520023 14129 raft_consensus.cc:493] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:27.520356 14129 raft_consensus.cc:3060] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Advancing to term 19
I20260709 14:53:27.522764 14033 leader_election.cc:290] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:27.524878  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783e4874513449ef9084b833f188a6d3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:27.468684 14133 raft_consensus.cc:515] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:27.526330 14146 consensus_queue.cc:237] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:27.526417 14143 leader_election.cc:290] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:27.531692 14041 raft_consensus.cc:515] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:27.528932 14133 leader_election.cc:290] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:27.535077 14155 leader_election.cc:290] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:27.546641  7774 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "939996e77ee64e9fab21aef50758b706"
dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:37144
I20260709 14:53:27.478467 14158 raft_consensus.cc:2804] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 14:53:27.499930 14003 raft_consensus.cc:2749] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 14:53:27.547294  7774 raft_consensus.cc:493] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:53:27.547262 14158 raft_consensus.cc:493] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:27.547814  7774 raft_consensus.cc:3060] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Advancing to term 19
I20260709 14:53:27.547288 14081 leader_election.cc:290] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:27.525136 14161 raft_consensus.cc:515] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:27.549716  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:27.494671 14162 raft_consensus.cc:493] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:27.498941 14109 raft_consensus.cc:493] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:27.547823 14158 raft_consensus.cc:3060] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Advancing to term 18
I20260709 14:53:27.552953  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:27.545583 14005 leader_election.cc:290] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:27.565958  7779 raft_consensus.cc:2468] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 23.
I20260709 14:53:27.512514 14117 raft_consensus.cc:493] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:27.572362  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:27.578523  7774 raft_consensus.cc:515] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:27.583078  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:27.588786  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:27.526460 14119 raft_consensus.cc:515] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:27.596518  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:27.611238  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:27.614785 14041 leader_election.cc:290] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 20 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:27.573626 14109 raft_consensus.cc:515] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:27.595772  7774 leader_election.cc:290] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:53:27.631927 14131 consensus_meta.cc:287] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent flushing consensus metadata: real 0.641s	user 0.015s	sys 0.000s
I20260709 14:53:27.586264 14117 raft_consensus.cc:515] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:27.633612  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:27.693054  7770 raft_consensus.cc:1275] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 23 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 14:53:27.649896 14005 raft_consensus.cc:493] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:27.661971 14108 raft_consensus.cc:3060] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Advancing to term 16
I20260709 14:53:27.668431  7854 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 4928) took 1462 ms. Trace:
I20260709 14:53:27.693451  7777 raft_consensus.cc:2468] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 21.
I20260709 14:53:27.573904 14162 raft_consensus.cc:515] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:27.706056  7770 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37136 (request call id 3213) took 1089 ms. Trace:
I20260709 14:53:27.707469  7771 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37136 (request call id 3215) took 1090 ms. Trace:
I20260709 14:53:27.702368  7854 rpcz_store.cc:276] 0709 14:53:26.206413 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:53:26.206598 (+   185us) service_pool.cc:224] Handling call
0709 14:53:26.228533 (+ 21935us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:53:26.497645 (+269112us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:53:27.667871 (+1170226us) spinlock_profiling.cc:243] Waited 268 ms on lock 0x7b540034e254. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae8ee01 00007fb68ae8d83e 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2 00007fb6891c948c 00007fb6891c88c6
0709 14:53:27.668321 (+   450us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":617015168}
I20260709 14:53:27.706570  7770 rpcz_store.cc:276] 0709 14:53:26.604291 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:53:26.605421 (+  1130us) service_pool.cc:224] Handling call
0709 14:53:27.692473 (+1087052us) spinlock_profiling.cc:243] Waited 1.09 ms on lock 0x7b5800002a98. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb687c29db1 00007fb687d69b71 00007fb687d69a22 00007fb690c82c09 00007fb68fddcee0 00007fb68fea60ab 00007fb68fea6131 00007fb68fe67fc0 00007fb68fe52929 00007fb68fe523d2 00007fb6893c9bd4
0709 14:53:27.692722 (+   249us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:53:27.693550 (+   828us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:53:27.693963 (+   413us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2500352}
I20260709 14:53:27.707877  7771 rpcz_store.cc:276] 0709 14:53:26.604844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:53:26.605333 (+   489us) service_pool.cc:224] Handling call
0709 14:53:26.605629 (+   296us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:53:26.628305 (+ 22676us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:53:26.628334 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:53:26.628707 (+   373us) log.cc:844] Serialized 26 byte log entry
0709 14:53:26.745546 (+116839us) raft_consensus.cc:1645] Marking committed up to 10
0709 14:53:26.745593 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:53:27.679716 (+934123us) spinlock_profiling.cc:243] Waited 22.3 ms on lock 0x7b54000f0854. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae8ee01 00007fb68ae8d83e 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2 00007fb6891c948c 00007fb6891c88c6
0709 14:53:27.679789 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:53:27.679894 (+   105us) raft_consensus.cc:1685] finished
0709 14:53:27.679911 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:53:27.695387 (+ 15476us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":108,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":8248,"spinlock_wait_cycles":51379072,"thread_start_us":97422,"threads_started":1,"wal-append.queue_time_us":218977}
I20260709 14:53:27.712944  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:27.716748  7770 raft_consensus.cc:2468] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 20.
I20260709 14:53:27.721077 14109 leader_election.cc:290] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:27.722867 14117 leader_election.cc:290] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:27.710333 14126 raft_consensus.cc:493] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:27.724076 14126 raft_consensus.cc:515] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:27.696764 14131 raft_consensus.cc:2749] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 14:53:27.733493 14126 leader_election.cc:290] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:27.735446  7777 raft_consensus.cc:1240] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 18. Current term is 19. Ops: []
W20260709 14:53:27.705322 14140 log.cc:927] Time spent T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.647s	user 0.002s	sys 0.005s
I20260709 14:53:27.740310  7923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38516 (request call id 3225) took 1007 ms. Trace:
I20260709 14:53:27.740871  7923 rpcz_store.cc:276] 0709 14:53:26.732901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:53:26.733046 (+   145us) service_pool.cc:224] Handling call
0709 14:53:26.733410 (+   364us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:53:26.740300 (+  6890us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:53:26.740332 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:53:26.740860 (+   528us) log.cc:844] Serialized 26 byte log entry
0709 14:53:26.859622 (+118762us) raft_consensus.cc:1645] Marking committed up to 11
0709 14:53:26.859666 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:53:26.859733 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:53:27.672905 (+813172us) spinlock_profiling.cc:243] Waited 7.81 ms on lock 0x7b24001e5948. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb687c29db1 00007fb687c279c4 00007fb687c25acb 00007fb687de0dc9 00007fb687de0a55 00007fb687de009d 00007fb68aa1210e 00007fb68aa2988c 00007fb68aa28bb6 00007fb68aa287d8 00007fb68aa32221
0709 14:53:27.739862 (+ 66957us) raft_consensus.cc:1685] finished
0709 14:53:27.739895 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:53:27.740217 (+   322us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3112,"raft.run_cpu_time_us":204,"raft.run_wall_time_us":8390,"spinlock_wait_cycles":17956224,"thread_start_us":112069,"threads_started":1,"wal-append.queue_time_us":145518}
I20260709 14:53:27.711474 14005 raft_consensus.cc:515] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:27.744997 14065 raft_consensus.cc:3055] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 LEADER]: Stepping down as leader of term 15
I20260709 14:53:27.745499 14065 raft_consensus.cc:740] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:53:27.746047 14162 leader_election.cc:290] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:27.746443 14065 consensus_queue.cc:260] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:27.747273 14005 leader_election.cc:290] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:27.747972 14065 raft_consensus.cc:3060] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Advancing to term 16
I20260709 14:53:27.747714 14061 raft_consensus.cc:493] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:27.748310 14055 raft_consensus.cc:493] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:27.748790 14061 raft_consensus.cc:515] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:27.723320 14161 leader_election.cc:290] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:27.749166 14055 raft_consensus.cc:515] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:27.751400  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:27.752550  7928 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38516 (request call id 3221) took 1109 ms. Trace:
I20260709 14:53:27.753137  7928 rpcz_store.cc:276] 0709 14:53:26.643373 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:53:26.643631 (+   258us) service_pool.cc:224] Handling call
0709 14:53:27.751114 (+1107483us) spinlock_profiling.cc:243] Waited 4.33 ms on lock 0x7b5800200198. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb687c29db1 00007fb687d69b71 00007fb687d69a22 00007fb690c82c09 00007fb68fddcee0 00007fb68fea60ab 00007fb68fea6131 00007fb68fe540a0 00007fb68fe53984 00007fb6893ce6d4 00007fb6893ce662
0709 14:53:27.752427 (+  1313us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9967872}
I20260709 14:53:27.751605 14061 leader_election.cc:290] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:27.760926  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:27.744139  7894 leader_election.cc:304] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:27.756532  7776 raft_consensus.cc:1275] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 14:53:27.733605 14111 raft_consensus.cc:993] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0: : Instructing follower 1de5e20126fa4d8ca0793d19c7b847ed to start an election
I20260709 14:53:27.761683  7772 raft_consensus.cc:1275] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 14:53:27.765332  7771 raft_consensus.cc:1240] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 LEADER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 19. Current term is 20. Ops: []
I20260709 14:53:27.766844  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:27.767022  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c563cc7cfbe4d59be4ffc5cf847ce56" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:27.767733  7777 raft_consensus.cc:3060] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Advancing to term 17
I20260709 14:53:27.768406  7774 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956"
dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:37144
I20260709 14:53:27.769168  7774 raft_consensus.cc:493] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:53:27.769596  7774 raft_consensus.cc:3060] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Advancing to term 15
I20260709 14:53:27.744050 14119 leader_election.cc:290] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 14 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:27.762547 14069 raft_consensus.cc:493] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:27.778918 14077 raft_consensus.cc:1081] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 LEADER]: Signalling peer 1de5e20126fa4d8ca0793d19c7b847ed to start an election
I20260709 14:53:27.793809  7771 raft_consensus.cc:1275] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 14:53:27.802822  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
W20260709 14:53:27.801005  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 350375us
I20260709 14:53:27.801623  7774 raft_consensus.cc:515] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:27.780908 14088 raft_consensus.cc:2804] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 14:53:27.810225  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: true dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:27.811986  7920 raft_consensus.cc:3055] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 14:53:27.812147  7745 leader_election.cc:304] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:27.815091 14161 raft_consensus.cc:2804] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 14:53:27.815934 14161 raft_consensus.cc:493] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:27.816037  7774 leader_election.cc:290] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:27.817703 14161 raft_consensus.cc:3060] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Advancing to term 21
I20260709 14:53:27.802651 14069 raft_consensus.cc:515] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:27.812593  7920 raft_consensus.cc:740] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:27.831586  7920 consensus_queue.cc:260] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:27.832998  7920 raft_consensus.cc:3060] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Advancing to term 20
I20260709 14:53:27.834379  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:27.835117  7776 raft_consensus.cc:2468] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 17.
I20260709 14:53:27.836220  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:27.840112  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:27.843537  7771 raft_consensus.cc:2393] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 18: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:53:27.783010 14005 consensus_queue.cc:1048] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 14:53:27.841046  7894 leader_election.cc:304] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:27.832468 14069 leader_election.cc:290] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:27.847182  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:27.794495 13836 consensus_queue.cc:1048] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.054s
I20260709 14:53:27.854132  7920 raft_consensus.cc:2468] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 20.
I20260709 14:53:27.856401  7920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38532 (request call id 4001) took 1205 ms. Trace:
I20260709 14:53:27.856748  7920 rpcz_store.cc:276] 0709 14:53:26.650682 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:53:26.651846 (+  1164us) service_pool.cc:224] Handling call
0709 14:53:27.809908 (+1158062us) spinlock_profiling.cc:243] Waited 4.87 ms on lock 0x7b5800200198. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb687c29db1 00007fb687d69b71 00007fb687d69a22 00007fb690c82c09 00007fb68fddcee0 00007fb68fea60ab 00007fb68fea6131 00007fb68fe540a0 00007fb68fe53984 00007fb6893ce6d4 00007fb6893ce662
0709 14:53:27.856332 (+ 46424us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11191168}
I20260709 14:53:27.862026  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783e4874513449ef9084b833f188a6d3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:27.853927 14161 raft_consensus.cc:515] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:53:27.863699  7819 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:27.870162  7894 leader_election.cc:304] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:27.871233 14126 raft_consensus.cc:2804] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 14:53:27.840036 14088 raft_consensus.cc:493] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:27.881278 13835 raft_consensus.cc:2804] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 14:53:27.886586 13835 raft_consensus.cc:493] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:27.886966 13835 raft_consensus.cc:3060] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Advancing to term 21
I20260709 14:53:27.889945 14083 leader_election.cc:290] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:27.888665 14158 raft_consensus.cc:515] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:27.896981 14158 leader_election.cc:290] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:27.910059  7777 raft_consensus.cc:2468] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 17.
I20260709 14:53:27.910471  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:27.912067  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c563cc7cfbe4d59be4ffc5cf847ce56" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:27.913018  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:27.912251  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:27.856189 14159 raft_consensus.cc:493] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:27.912856  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:27.918431  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:27.915155  7771 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c"
dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:37144
I20260709 14:53:27.915596  7845 raft_consensus.cc:2468] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 22.
I20260709 14:53:27.915064  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:27.923115  7775 raft_consensus.cc:2393] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 18: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:53:27.922017  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:27.924582  7771 raft_consensus.cc:493] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:53:27.926007  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:27.927402  7923 raft_consensus.cc:1275] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 14:53:27.925660  7771 raft_consensus.cc:3060] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Advancing to term 21
I20260709 14:53:27.930030 14035 consensus_queue.cc:1048] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.002s
I20260709 14:53:27.930399  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:27.964352  7928 raft_consensus.cc:2410] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for term 18 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 14:53:27.931064  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:27.932055  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:27.932571  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:27.877959 14126 raft_consensus.cc:493] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:27.849216 14129 raft_consensus.cc:515] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:27.932637  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:27.975407  7854 raft_consensus.cc:2468] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 16.
I20260709 14:53:27.976717  7772 raft_consensus.cc:2393] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 19: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
W20260709 14:53:27.887009 14175 log.cc:927] Time spent T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 14:53:27.877626 14088 raft_consensus.cc:3060] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 23 FOLLOWER]: Advancing to term 24
I20260709 14:53:27.989748  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
W20260709 14:53:27.935482 14112 log.cc:927] Time spent T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 1.616s	user 0.008s	sys 0.018s
I20260709 14:53:27.937794  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:27.938508  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:27.938570  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:27.995908  7894 leader_election.cc:304] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:27.953447 14173 raft_consensus.cc:476] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 LEADER]: Not starting pre-election -- already a leader
I20260709 14:53:27.954947 14111 raft_consensus.cc:493] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9418391fa82a42c79c6cad13ba91d964)
W20260709 14:53:27.959410  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:28.000851  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:27.914805 14022 raft_consensus.cc:493] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:28.001955 14022 raft_consensus.cc:515] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:28.002424  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:28.003656  7850 raft_consensus.cc:2468] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 20.
I20260709 14:53:28.004693 14022 leader_election.cc:290] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:27.928681 14055 leader_election.cc:290] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:28.012959  7776 raft_consensus.cc:1240] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260709 14:53:27.972078 14176 raft_consensus.cc:493] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:27.963068 14087 raft_consensus.cc:493] T 9ce9c0ef2db24c13a8b1402f21819458 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9418391fa82a42c79c6cad13ba91d964)
I20260709 14:53:27.937938 14159 raft_consensus.cc:515] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:53:27.997567  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:28.007139  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:28.007288  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:28.029501  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:28.037076  7775 raft_consensus.cc:1240] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 18. Current term is 19. Ops: [18.10-18.10]
I20260709 14:53:28.009184  7744 leader_election.cc:304] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:28.046833  7744 leader_election.cc:304] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:28.048455  7744 leader_election.cc:304] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:27.967265 14147 raft_consensus.cc:493] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:28.049645 14169 raft_consensus.cc:2749] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 14:53:28.040592  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:28.050558 14147 raft_consensus.cc:515] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:28.008838  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 21 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:28.017545  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:28.019560  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: true dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:28.052206  7846 raft_consensus.cc:3060] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Advancing to term 19
I20260709 14:53:28.052891 14147 leader_election.cc:290] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:27.976995 14129 leader_election.cc:290] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:27.972013 14126 raft_consensus.cc:3060] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Advancing to term 22
I20260709 14:53:28.046876 14143 raft_consensus.cc:2804] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 14:53:28.058060 14143 raft_consensus.cc:493] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:28.058472 14143 raft_consensus.cc:3060] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Advancing to term 21
I20260709 14:53:28.024363  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:28.059872  7848 raft_consensus.cc:2468] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 20.
I20260709 14:53:28.025533  7849 raft_consensus.cc:2468] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 16.
I20260709 14:53:28.028126  7773 raft_consensus.cc:1240] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 19. Current term is 20. Ops: []
W20260709 14:53:28.044320 14180 log.cc:927] Time spent T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.236s	user 0.002s	sys 0.000s
I20260709 14:53:28.020535  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:28.016669  7853 raft_consensus.cc:2468] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 21.
I20260709 14:53:28.073686  7846 raft_consensus.cc:2468] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 19.
I20260709 14:53:28.075479  7744 leader_election.cc:304] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:53:28.075935  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 59924.7us
I20260709 14:53:28.080237  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:28.081188  7744 leader_election.cc:304] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:28.082274  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:28.083078  7847 raft_consensus.cc:2468] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 19.
I20260709 14:53:28.087365 14169 raft_consensus.cc:2749] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 14:53:28.088626 14118 raft_consensus.cc:2749] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 14:53:28.095657 13835 raft_consensus.cc:515] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:28.106209 13835 leader_election.cc:290] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 21 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:28.014524 14111 raft_consensus.cc:515] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:53:28.121614 14111 leader_election.cc:290] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68:42321)
I20260709 14:53:28.104285 14088 raft_consensus.cc:515] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:28.109311  7771 raft_consensus.cc:515] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:28.122135  8640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1f7722fdea49e0b5e9c5d96633eaf9" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9418391fa82a42c79c6cad13ba91d964" is_pre_election: true
I20260709 14:53:28.027176 13836 raft_consensus.cc:2804] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Leader election won for term 18
W20260709 14:53:28.133496 14187 log.cc:927] Time spent T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 14:53:28.135012 14161 leader_election.cc:290] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 21 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:28.135462 14059 raft_consensus.cc:493] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:28.139897 14147 raft_consensus.cc:2749] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 14:53:28.140126  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 57051.1us
I20260709 14:53:28.140652 14129 consensus_queue.cc:1048] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 14:53:28.014935 14173 raft_consensus.cc:493] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:28.071053 14176 raft_consensus.cc:515] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:28.150905  7924 raft_consensus.cc:1240] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 24 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 23. Current term is 24. Ops: [23.13-23.13]
I20260709 14:53:28.081476  7852 raft_consensus.cc:2468] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 16.
I20260709 14:53:28.112385 14159 leader_election.cc:290] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:28.071507 14087 raft_consensus.cc:515] T 9ce9c0ef2db24c13a8b1402f21819458 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:53:28.153491 14055 raft_consensus.cc:493] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:28.159693  7894 leader_election.cc:304] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:28.170874  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:28.184381  7847 raft_consensus.cc:2468] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 18.
W20260709 14:53:28.177840  8598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 272068us
I20260709 14:53:28.164546  7771 leader_election.cc:290] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 21 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:28.196373  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:28.197297  7850 raft_consensus.cc:3060] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Advancing to term 21
I20260709 14:53:28.163908 14060 consensus_queue.cc:1059] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 14:53:28.166651 13836 raft_consensus.cc:697] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
W20260709 14:53:28.181144 14107 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.868s	user 0.022s	sys 0.059s
I20260709 14:53:28.195600 14055 raft_consensus.cc:515] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:28.207922  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1f7722fdea49e0b5e9c5d96633eaf9" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:28.162870 13980 consensus_queue.cc:1048] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 14:53:28.209290  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 21 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:28.208197  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:28.220660  7852 raft_consensus.cc:2468] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 17.
I20260709 14:53:28.194962 14111 raft_consensus.cc:2804] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 14:53:28.205667 14118 raft_consensus.cc:493] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9418391fa82a42c79c6cad13ba91d964)
I20260709 14:53:28.194988 14162 raft_consensus.cc:493] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9418391fa82a42c79c6cad13ba91d964)
I20260709 14:53:28.178959 14161 raft_consensus.cc:493] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:28.176136 14059 raft_consensus.cc:515] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:28.227291  7850 raft_consensus.cc:2468] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 21.
I20260709 14:53:28.232590  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:28.234336  7925 raft_consensus.cc:2468] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 18.
I20260709 14:53:28.179168 14173 raft_consensus.cc:515] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:28.242276  7846 raft_consensus.cc:1275] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 14:53:28.243156  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:28.244164 14173 leader_election.cc:290] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:28.244701  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: true dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:28.246518 14126 raft_consensus.cc:515] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:28.245908  7920 raft_consensus.cc:1240] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 18. Current term is 19. Ops: []
I20260709 14:53:28.249992  7846 raft_consensus.cc:3060] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Advancing to term 15
I20260709 14:53:28.247406  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:28.240448 14143 raft_consensus.cc:515] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:28.250946 13836 consensus_queue.cc:237] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:28.251600  7847 raft_consensus.cc:2468] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 14.
I20260709 14:53:28.252065 14059 leader_election.cc:290] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:28.254046 14143 leader_election.cc:290] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 21 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:28.244819  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:28.254810  8640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce9c0ef2db24c13a8b1402f21819458" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9418391fa82a42c79c6cad13ba91d964" is_pre_election: true
I20260709 14:53:28.250103 14087 leader_election.cc:290] T 9ce9c0ef2db24c13a8b1402f21819458 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68:42321)
I20260709 14:53:28.258196 14005 raft_consensus.cc:493] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:28.258888 14005 raft_consensus.cc:515] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:28.260774  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
W20260709 14:53:28.215999 14107 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.906s	user 0.022s	sys 0.060s
I20260709 14:53:28.262416 14162 raft_consensus.cc:515] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:53:28.225272 14118 raft_consensus.cc:515] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:53:28.276988 14161 raft_consensus.cc:515] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:28.287245 14161 leader_election.cc:290] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:28.224830 14111 raft_consensus.cc:493] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:28.288722 14111 raft_consensus.cc:3060] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 14:53:28.279927  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:28.295495  6549 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 14:53:28.287433 14118 leader_election.cc:290] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68:42321)
I20260709 14:53:28.303731 14088 leader_election.cc:290] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 24 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:28.304409  7676 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51352 (request call id 172) took 1042 ms. Trace:
I20260709 14:53:28.265409 14117 raft_consensus.cc:493] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9418391fa82a42c79c6cad13ba91d964)
W20260709 14:53:28.264945 14192 log.cc:927] Time spent T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260709 14:53:28.305017  7676 rpcz_store.cc:276] 0709 14:53:27.262125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:53:27.265893 (+  3768us) service_pool.cc:224] Handling call
0709 14:53:28.302843 (+1036950us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b54003499d4. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf8090 00007fb68ae96f3a 00007fb690c4d1cc 00007fb690d4b37e 00007fb68f20c2a4 00007fb68f20c232 00007fb68f20c161 00007fb68f20c0dc 00007fb68f20b392 00007fb6891c948c 00007fb6891c88c6
0709 14:53:28.304183 (+  1340us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":0,"spinlock_wait_cycles":2331095936}
I20260709 14:53:28.269637 14083 raft_consensus.cc:3055] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 14:53:28.306187 14083 raft_consensus.cc:740] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:28.307106 14083 consensus_queue.cc:260] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:28.309768  8640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9441e831627143a991a1556dcdce71e3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9418391fa82a42c79c6cad13ba91d964" is_pre_election: true
I20260709 14:53:28.311309 14176 leader_election.cc:290] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:28.318845 14162 leader_election.cc:290] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68:42321)
I20260709 14:53:28.321132 14117 raft_consensus.cc:515] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:53:28.324303 14117 leader_election.cc:290] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785), 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68:42321)
I20260709 14:53:28.257226 14056 raft_consensus.cc:493] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
W20260709 14:53:28.329911  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 386023us
I20260709 14:53:28.281097  7846 raft_consensus.cc:2468] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 15.
I20260709 14:53:28.342893  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:28.344298  7771 raft_consensus.cc:3060] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Advancing to term 21
I20260709 14:53:28.366387  7744 leader_election.cc:304] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:28.366454  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:28.367419  7772 raft_consensus.cc:3060] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Advancing to term 22
I20260709 14:53:28.360471 14126 leader_election.cc:290] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 22 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:28.368042  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce9c0ef2db24c13a8b1402f21819458" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:28.327046 14083 raft_consensus.cc:3060] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 14:53:28.368943  7773 raft_consensus.cc:2468] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 2.
I20260709 14:53:28.351243  7894 leader_election.cc:304] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac, 9418391fa82a42c79c6cad13ba91d964
I20260709 14:53:28.370163  7778 raft_consensus.cc:1240] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 14. Current term is 15. Ops: []
I20260709 14:53:28.370735  7894 leader_election.cc:304] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:28.370909 14057 raft_consensus.cc:2749] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 14:53:28.371598  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 22 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:28.358340  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:28.373121  7894 leader_election.cc:304] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:28.374445 14032 raft_consensus.cc:2804] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 14:53:28.375084 14032 raft_consensus.cc:697] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:28.375839  8637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce9c0ef2db24c13a8b1402f21819458" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9418391fa82a42c79c6cad13ba91d964" is_pre_election: true
I20260709 14:53:28.376125 14032 consensus_queue.cc:237] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:28.367812  8640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18d29d52d304c87b930d4fb5eaf50b1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9418391fa82a42c79c6cad13ba91d964" is_pre_election: true
I20260709 14:53:28.371977 14057 raft_consensus.cc:2804] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 14:53:28.381448 14057 raft_consensus.cc:493] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:28.382270 14057 raft_consensus.cc:3060] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 14:53:28.382603  7777 raft_consensus.cc:2468] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 21.
I20260709 14:53:28.385367  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: true dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:28.386337  7852 raft_consensus.cc:3060] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Advancing to term 21
I20260709 14:53:28.261229 14005 leader_election.cc:290] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:28.390259  7744 leader_election.cc:304] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:28.393993  7772 raft_consensus.cc:2468] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 22.
I20260709 14:53:28.394310  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:28.350620 14176 raft_consensus.cc:493] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:28.396932 14117 raft_consensus.cc:2749] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 14:53:28.397852  7846 raft_consensus.cc:2393] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 21: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:53:28.398108  7744 leader_election.cc:304] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:28.414060  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:28.395912  7771 raft_consensus.cc:2468] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 21.
I20260709 14:53:28.416083  7744 leader_election.cc:304] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:28.419165  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9441e831627143a991a1556dcdce71e3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:28.419380  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 22 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:28.420275  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:28.420534  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:28.421167  7846 raft_consensus.cc:2410] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for term 22 because replica has last-logged OpId of term: 20 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
I20260709 14:53:28.421077  7850 raft_consensus.cc:3060] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Advancing to term 22
I20260709 14:53:28.426055  7893 leader_election.cc:304] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:28.391075 14118 raft_consensus.cc:2749] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 14:53:28.440798  7744 leader_election.cc:304] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:28.349884 14056 raft_consensus.cc:515] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:28.443885  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:28.476784  7846 raft_consensus.cc:2468] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 18.
I20260709 14:53:28.480783  7852 raft_consensus.cc:2468] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 21.
I20260709 14:53:28.414467 14126 raft_consensus.cc:493] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:28.449741  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 22 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:28.448174  7850 raft_consensus.cc:2468] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 22.
I20260709 14:53:28.488894  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18d29d52d304c87b930d4fb5eaf50b1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:28.454573 14117 raft_consensus.cc:2749] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 14:53:28.442590 13955 raft_consensus.cc:2749] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 14:53:28.413233 14176 raft_consensus.cc:515] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:28.478791 14162 raft_consensus.cc:2749] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 14:53:28.475221 14159 raft_consensus.cc:493] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:28.541986  7848 raft_consensus.cc:1275] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 14:53:28.553910  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:28.555276  7745 leader_election.cc:304] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:28.555362  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:28.560242  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:28.564064  7846 raft_consensus.cc:1275] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 14:53:28.579903  7774 raft_consensus.cc:2468] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 21.
I20260709 14:53:28.580864  7846 raft_consensus.cc:1240] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 14. Current term is 15. Ops: []
I20260709 14:53:28.482357 14161 consensus_queue.cc:1059] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.058s
I20260709 14:53:28.539256 14126 raft_consensus.cc:515] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:28.589303 14117 raft_consensus.cc:2804] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 14:53:28.622170  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:28.622932  7774 raft_consensus.cc:2468] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 17.
I20260709 14:53:28.631376  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:28.639063  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:28.641181  7771 raft_consensus.cc:2393] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 15: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:53:28.640822  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:28.642303  7774 raft_consensus.cc:2468] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 21.
I20260709 14:53:28.651938  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:28.660485  7819 leader_election.cc:304] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:28.583384 14159 raft_consensus.cc:515] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:28.673813 14173 raft_consensus.cc:493] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:53:28.677461 14148 log.cc:927] Time spent T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 14:53:28.622568 14117 raft_consensus.cc:493] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 22 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:28.681951 14059 raft_consensus.cc:2804] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 14:53:28.710979 14117 raft_consensus.cc:3060] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 22 FOLLOWER]: Advancing to term 23
I20260709 14:53:28.750165  7745 leader_election.cc:304] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:28.751653  7745 leader_election.cc:304] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:28.754321 14161 raft_consensus.cc:2804] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 14:53:28.754906 14161 raft_consensus.cc:493] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:28.755287 14161 raft_consensus.cc:3060] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Advancing to term 17
I20260709 14:53:28.755851 14111 raft_consensus.cc:515] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:28.757063  7922 raft_consensus.cc:1240] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 15. Current term is 17. Ops: []
I20260709 14:53:28.757596 13955 raft_consensus.cc:2804] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 14:53:28.758147 13955 raft_consensus.cc:493] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:28.758514 13955 raft_consensus.cc:3060] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Advancing to term 21
I20260709 14:53:28.710592 14059 raft_consensus.cc:493] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 14:53:28.723486 14196 log.cc:927] Time spent T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.164s	user 0.000s	sys 0.001s
I20260709 14:53:28.723816 14126 leader_election.cc:290] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:53:28.724431 14195 log.cc:927] Time spent T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.136s	user 0.000s	sys 0.000s
I20260709 14:53:28.707486 14173 raft_consensus.cc:515] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:28.713994 14176 leader_election.cc:290] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:28.769956  7772 raft_consensus.cc:1240] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 13. Current term is 14. Ops: []
I20260709 14:53:28.714054 14142 consensus_queue.cc:1059] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.055s
I20260709 14:53:28.753084 14071 raft_consensus.cc:493] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:53:28.764567 14059 raft_consensus.cc:3060] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Advancing to term 19
I20260709 14:53:28.782696 14056 leader_election.cc:290] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:28.786015  7745 leader_election.cc:304] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
W20260709 14:53:28.800746  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 361091us
I20260709 14:53:28.793572 14162 raft_consensus.cc:2764] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Leader pre-election decision vote started in defunct term 20: won
W20260709 14:53:28.832332  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:53:28.823467  8598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 264506us
W20260709 14:53:28.822325  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 394535us
I20260709 14:53:28.834048  7893 leader_election.cc:304] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:28.794699  7745 leader_election.cc:304] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:28.785539 14071 raft_consensus.cc:515] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:28.803767 14142 raft_consensus.cc:3055] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 LEADER]: Stepping down as leader of term 18
I20260709 14:53:28.845178 14005 raft_consensus.cc:2749] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 14:53:28.845898 14057 raft_consensus.cc:515] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:28.848757 14057 leader_election.cc:290] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 18 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:28.858855 14055 leader_election.cc:290] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:28.859512 14055 raft_consensus.cc:493] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:28.860003 14055 raft_consensus.cc:515] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:28.842553 14142 raft_consensus.cc:740] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:53:28.863088 14142 consensus_queue.cc:260] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:28.864585 14142 raft_consensus.cc:3060] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Advancing to term 19
W20260709 14:53:28.866935 14197 log.cc:927] Time spent T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.101s	user 0.003s	sys 0.000s
I20260709 14:53:28.868674 14159 leader_election.cc:290] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:28.869611 14159 raft_consensus.cc:493] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:28.870143 14159 raft_consensus.cc:515] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:28.873718 14118 raft_consensus.cc:3055] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 23 LEADER]: Stepping down as leader of term 23
I20260709 14:53:28.874621 14118 raft_consensus.cc:740] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:53:28.876101 14118 consensus_queue.cc:260] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:28.878418 14118 raft_consensus.cc:3060] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 23 FOLLOWER]: Advancing to term 24
I20260709 14:53:28.894344 14173 leader_election.cc:290] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:28.895498 14162 raft_consensus.cc:2764] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 22 FOLLOWER]: Leader election decision vote started in defunct term 21: won
I20260709 14:53:28.897508 14111 leader_election.cc:290] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 17 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:53:28.903509  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 60014.1us
W20260709 14:53:28.903494  8599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 315406us
W20260709 14:53:28.923032  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 83169.7us
I20260709 14:53:28.924211  7894 leader_election.cc:304] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:28.943012  7893 leader_election.cc:304] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:28.944880 14035 raft_consensus.cc:2749] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 14:53:28.947753 14081 consensus_queue.cc:1048] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 14:53:28.945019 14077 raft_consensus.cc:2804] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 14:53:28.987949 14032 consensus_queue.cc:1048] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 14:53:28.993865 14207 consensus_queue.cc:1059] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 14:53:28.999209 14060 raft_consensus.cc:2804] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 14:53:29.000572 14211 consensus_queue.cc:1048] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 14:53:28.998934  7893 leader_election.cc:304] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:28.944864 14087 consensus_queue.cc:1059] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.035s
W20260709 14:53:28.998932 14199 log.cc:927] Time spent T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
W20260709 14:53:29.007508 14205 log.cc:927] Time spent T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.135s	user 0.000s	sys 0.002s
I20260709 14:53:29.031123 14118 raft_consensus.cc:493] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:29.032174 14118 raft_consensus.cc:515] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:29.009500 14159 leader_election.cc:290] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:29.041563 14077 raft_consensus.cc:697] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 22 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:29.034788 14118 leader_election.cc:290] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:29.043138 14077 consensus_queue.cc:237] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:53:29.054543  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 55738.4us
I20260709 14:53:29.040537 14055 leader_election.cc:290] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:29.034857 14161 raft_consensus.cc:515] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:53:29.062013  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 74791.5us
I20260709 14:53:29.046844 14162 raft_consensus.cc:493] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:29.029876 13955 raft_consensus.cc:515] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:29.056681 14071 leader_election.cc:290] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:29.072124  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:29.057785 14057 raft_consensus.cc:2749] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 14:53:29.073521  7846 raft_consensus.cc:1275] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
W20260709 14:53:29.078888  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 370093us
I20260709 14:53:29.080371  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:29.075362  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:29.081933  7852 raft_consensus.cc:3060] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Advancing to term 18
I20260709 14:53:29.077235  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:29.084090  7848 raft_consensus.cc:1275] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 14:53:29.077342  7851 raft_consensus.cc:1240] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 20. Current term is 21. Ops: []
I20260709 14:53:29.087764  7819 leader_election.cc:304] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:29.089322 14159 raft_consensus.cc:2749] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 14:53:29.089948 14214 log.cc:927] Time spent T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.250s	user 0.001s	sys 0.002s
I20260709 14:53:29.091475 14161 leader_election.cc:290] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:29.091624  7819 leader_election.cc:304] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:29.081101  7850 raft_consensus.cc:3060] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Advancing to term 17
I20260709 14:53:29.077435  7845 raft_consensus.cc:1240] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 18. Current term is 19. Ops: []
W20260709 14:53:29.103339  7894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:29.092808 14159 raft_consensus.cc:2749] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 14:53:29.084632 14060 raft_consensus.cc:493] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:29.071619 14162 raft_consensus.cc:515] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:29.098342 14161 raft_consensus.cc:493] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
W20260709 14:53:29.116650  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 322094us
I20260709 14:53:29.125586  7745 leader_election.cc:304] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:29.126839  7745 leader_election.cc:304] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:29.128322  7745 leader_election.cc:304] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:29.128754  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:29.132908  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:29.121165  7893 leader_election.cc:304] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:29.134011  7925 raft_consensus.cc:2393] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 18: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:53:29.134441  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:29.135406  7927 raft_consensus.cc:2468] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 17.
I20260709 14:53:29.137858  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:29.139460  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:29.136610  7852 raft_consensus.cc:2468] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 18.
I20260709 14:53:29.139406  7850 raft_consensus.cc:2468] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 17.
I20260709 14:53:29.144146  7893 leader_election.cc:304] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:53:29.145924  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 49174.1us
I20260709 14:53:29.146522  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:29.101051 14173 consensus_queue.cc:1048] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.030s
I20260709 14:53:29.147789  7924 raft_consensus.cc:2468] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 21.
I20260709 14:53:29.150830  7893 leader_election.cc:304] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:29.117444 14060 raft_consensus.cc:3060] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 23 FOLLOWER]: Advancing to term 24
I20260709 14:53:29.158823  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:29.159512  7819 leader_election.cc:304] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
W20260709 14:53:29.147205 14210 log.cc:927] Time spent T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.167s	user 0.000s	sys 0.002s
I20260709 14:53:29.143203 14118 raft_consensus.cc:2804] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Leader election won for term 19
I20260709 14:53:29.151678 14126 raft_consensus.cc:2749] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 14:53:29.157471 14088 raft_consensus.cc:2804] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 14:53:29.160817 13836 raft_consensus.cc:493] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:29.179147  7819 leader_election.cc:304] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:29.170608 14209 raft_consensus.cc:2749] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 14:53:29.144886 14161 raft_consensus.cc:515] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:29.179593 14071 raft_consensus.cc:2749] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 14:53:29.206185  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 78085.1us
I20260709 14:53:29.207355  7745 leader_election.cc:304] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:29.217034 14223 raft_consensus.cc:2804] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 14:53:29.217888 14223 raft_consensus.cc:493] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:29.218369 14223 raft_consensus.cc:3060] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Advancing to term 17
I20260709 14:53:29.188438 14220 raft_consensus.cc:2804] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 14:53:29.222064 14220 raft_consensus.cc:493] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:29.222532 14220 raft_consensus.cc:3060] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Advancing to term 20
I20260709 14:53:29.201716 14088 raft_consensus.cc:697] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:29.192574 14117 raft_consensus.cc:515] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:29.194350 13980 consensus_queue.cc:1048] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 14:53:29.199180 13836 raft_consensus.cc:515] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:29.199777 14059 raft_consensus.cc:515] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:29.237524 13955 leader_election.cc:290] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 21 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:29.238358 14208 raft_consensus.cc:3055] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 14:53:29.238716 13955 raft_consensus.cc:2804] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 14:53:29.239111 14208 raft_consensus.cc:740] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:29.239530 14059 leader_election.cc:290] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 19 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:53:29.244248 14217 log.cc:927] Time spent T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 14:53:29.245455 14161 leader_election.cc:290] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:29.246352 14161 raft_consensus.cc:493] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:29.246980 14161 raft_consensus.cc:515] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:29.253825 14117 leader_election.cc:290] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 23 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:53:29.258975  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 108494us
I20260709 14:53:29.228132 14142 raft_consensus.cc:2749] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 14:53:29.271891 14162 leader_election.cc:290] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:29.255360 13980 consensus_queue.cc:1243] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer 3876b8ee8d744cb18e91d97aae93b1ac log is divergent from this leader: its last log entry 15.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
W20260709 14:53:29.246255 14216 log.cc:927] Time spent T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
W20260709 14:53:29.274998  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 96027.4us
I20260709 14:53:29.280946  7894 leader_election.cc:304] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:29.244153 13836 leader_election.cc:290] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:29.233573 14219 raft_consensus.cc:493] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:29.286454  7894 leader_election.cc:304] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:29.279268 14118 raft_consensus.cc:697] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:53:29.239933 14211 raft_consensus.cc:3055] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 LEADER]: Stepping down as leader of term 18
W20260709 14:53:29.289283  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 81998.4us
I20260709 14:53:29.239549 13955 raft_consensus.cc:493] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:29.294929 14219 raft_consensus.cc:515] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:29.295356 14142 consensus_queue.cc:1059] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 14:53:29.296253 14059 consensus_queue.cc:1059] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 14:53:29.301451  7745 leader_election.cc:304] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:29.319571 14162 raft_consensus.cc:2804] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 14:53:29.320067 14162 raft_consensus.cc:493] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:29.320421 14162 raft_consensus.cc:3060] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Advancing to term 15
I20260709 14:53:29.298144  7819 leader_election.cc:304] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:29.233817 14222 consensus_queue.cc:1059] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.063s
I20260709 14:53:29.323097  7850 raft_consensus.cc:1240] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 14. Current term is 15. Ops: []
I20260709 14:53:29.324178  7745 leader_election.cc:304] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:29.328084  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:29.328931  7848 raft_consensus.cc:2468] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 21.
I20260709 14:53:29.329999 14117 raft_consensus.cc:2804] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader election won for term 15
I20260709 14:53:29.330813 14117 raft_consensus.cc:697] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:53:29.331970 14117 consensus_queue.cc:237] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:53:29.345569  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 47478.7us
I20260709 14:53:29.346752  7819 leader_election.cc:304] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:29.329993  7745 leader_election.cc:304] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 3876b8ee8d744cb18e91d97aae93b1ac, 9418391fa82a42c79c6cad13ba91d964
I20260709 14:53:29.282562 14005 consensus_queue.cc:1059] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.035s
I20260709 14:53:29.313792 13955 raft_consensus.cc:3060] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Advancing to term 19
I20260709 14:53:29.284327 14056 consensus_queue.cc:1059] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.049s
I20260709 14:53:29.355633  7847 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 4991) took 1074 ms. Trace:
I20260709 14:53:29.299196 14211 raft_consensus.cc:740] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:29.290201 14111 consensus_queue.cc:1048] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.051s
I20260709 14:53:29.359266  7745 leader_election.cc:304] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:29.359952  7847 rpcz_store.cc:276] 0709 14:53:28.281410 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:53:28.491891 (+210481us) service_pool.cc:224] Handling call
0709 14:53:28.564405 (+ 72514us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:53:28.564860 (+   455us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:53:28.564898 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:53:28.565576 (+   678us) log.cc:844] Serialized 26 byte log entry
0709 14:53:28.977124 (+411548us) raft_consensus.cc:1645] Marking committed up to 8
0709 14:53:28.977194 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:53:28.977324 (+   130us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:53:29.355079 (+377755us) raft_consensus.cc:1685] finished
0709 14:53:29.355106 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:53:29.355514 (+   408us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":108,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":7699,"thread_start_us":378216,"threads_started":1,"wal-append.queue_time_us":540229}
I20260709 14:53:29.369972  7893 leader_election.cc:304] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:29.333768 14225 raft_consensus.cc:2804] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 14:53:29.342383 14161 leader_election.cc:290] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:29.358991 14088 consensus_queue.cc:237] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:53:29.398094  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 69546.5us
I20260709 14:53:29.357843 14227 raft_consensus.cc:2804] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 14:53:29.402856  7848 raft_consensus.cc:1217] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Deduplicated request from leader. Original: 12.9->[13.10-16.12]   Dedup: 13.10->[14.11-16.12]
I20260709 14:53:29.403661  7848 pending_rounds.cc:85] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting all ops after (but not including) 10
I20260709 14:53:29.404070  7848 pending_rounds.cc:107] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting uncommitted NO_OP operation due to leader change: 15.11
I20260709 14:53:29.404342  7848 raft_consensus.cc:2889] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:53:29.337513 14232 consensus_queue.cc:1048] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.079s
I20260709 14:53:29.406143 14230 raft_consensus.cc:2804] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 14:53:29.410998  7742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:29.392369 14161 raft_consensus.cc:493] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:29.414713 14161 raft_consensus.cc:515] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:29.383309 14159 raft_consensus.cc:2764] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 14:53:29.419190 14161 leader_election.cc:290] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:29.391726 14229 raft_consensus.cc:3055] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 LEADER]: Stepping down as leader of term 19
I20260709 14:53:29.421581 14229 raft_consensus.cc:740] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:53:29.422686 14229 consensus_queue.cc:260] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:29.424144 14229 raft_consensus.cc:3060] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Advancing to term 20
I20260709 14:53:29.388082 14231 raft_consensus.cc:2749] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 14:53:29.404659 14225 raft_consensus.cc:697] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:29.427480 14225 consensus_queue.cc:237] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:29.430529 14219 leader_election.cc:290] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:29.402558 14005 raft_consensus.cc:3055] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 14:53:29.431689 14162 raft_consensus.cc:515] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:29.432266 14005 raft_consensus.cc:740] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:29.474943  6549 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 14:53:29.351722 14208 consensus_queue.cc:260] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:53:29.495770  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 136613us
I20260709 14:53:29.505362 14232 raft_consensus.cc:493] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:29.506026 14232 raft_consensus.cc:515] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:29.506394 14162 leader_election.cc:290] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:53:29.499370  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 114897us
I20260709 14:53:29.501523  7745 leader_election.cc:304] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
W20260709 14:53:29.507611  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 95926us
I20260709 14:53:29.407617 14230 raft_consensus.cc:493] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:29.512744 14230 raft_consensus.cc:3060] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Advancing to term 19
I20260709 14:53:29.513916 14232 leader_election.cc:290] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:29.508962  7893 leader_election.cc:304] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:29.411733 13980 raft_consensus.cc:3060] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 14:53:29.433182 14005 consensus_queue.cc:260] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:29.525169 14126 raft_consensus.cc:2749] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 14:53:29.528714 14005 raft_consensus.cc:3060] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Advancing to term 21
I20260709 14:53:29.508991  7894 leader_election.cc:304] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
W20260709 14:53:29.551282  7894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:29.513039 14245 raft_consensus.cc:493] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
W20260709 14:53:29.553696  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 43491.2us
I20260709 14:53:29.557734  7893 leader_election.cc:304] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:53:29.554333  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 206451us
W20260709 14:53:29.563974  7894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:29.507426 14227 raft_consensus.cc:697] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:29.511502 14162 raft_consensus.cc:2804] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Leader election won for term 21
I20260709 14:53:29.563926  7819 leader_election.cc:304] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
W20260709 14:53:29.589365  7894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:29.545483 14208 raft_consensus.cc:3060] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 14:53:29.600800  7893 leader_election.cc:304] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:29.410089 14118 consensus_queue.cc:237] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:29.588308  7745 leader_election.cc:304] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 3876b8ee8d744cb18e91d97aae93b1ac, 9418391fa82a42c79c6cad13ba91d964
I20260709 14:53:29.560321 14239 raft_consensus.cc:2804] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 14:53:29.635777 14239 raft_consensus.cc:493] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:29.636313 14239 raft_consensus.cc:3060] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Advancing to term 22
I20260709 14:53:29.607079 14233 raft_consensus.cc:2804] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 14:53:29.564445 14245 raft_consensus.cc:515] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:29.640784 14233 raft_consensus.cc:493] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:29.616060 14162 raft_consensus.cc:697] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:53:29.641371 14233 raft_consensus.cc:3060] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Advancing to term 22
I20260709 14:53:29.642530 14162 consensus_queue.cc:237] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:29.613420 14173 consensus_queue.cc:1059] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 14:53:29.657673 14241 raft_consensus.cc:2749] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 14:53:29.613921 14081 raft_consensus.cc:3060] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Advancing to term 19
W20260709 14:53:29.672672  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 84531.4us
W20260709 14:53:29.681128  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 170514us
I20260709 14:53:29.650728 14173 raft_consensus.cc:3055] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 LEADER]: Stepping down as leader of term 13
W20260709 14:53:29.680140  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 79503.1us
I20260709 14:53:29.661790 14230 raft_consensus.cc:515] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:29.690726 14207 raft_consensus.cc:2749] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 14:53:29.689976 14227 consensus_queue.cc:237] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:29.542686 14211 consensus_queue.cc:260] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:29.685070 14231 raft_consensus.cc:493] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:29.668134 14055 raft_consensus.cc:3055] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 LEADER]: Stepping down as leader of term 18
I20260709 14:53:29.697578 14220 raft_consensus.cc:515] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:53:29.553220 14083 consensus_queue.cc:1175] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" responder_term: 15 status { last_received { term: 14 index: 8 } last_committed_idx: 8 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 14. Current term is 15. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 14:53:29.709705  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 112974us
I20260709 14:53:29.716256  7893 leader_election.cc:304] T 9ce9c0ef2db24c13a8b1402f21819458 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 9418391fa82a42c79c6cad13ba91d964
I20260709 14:53:29.710806 14232 raft_consensus.cc:493] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:29.721202 14241 consensus_queue.cc:1048] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 14:53:29.723274 14236 raft_consensus.cc:3055] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 LEADER]: Stepping down as leader of term 17
I20260709 14:53:29.723616 13955 raft_consensus.cc:515] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:29.761787  7819 leader_election.cc:304] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:53:29.739610  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:29.739351  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:29.703905 14173 raft_consensus.cc:740] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:53:29.745344  7893 leader_election.cc:304] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:29.732565 14142 raft_consensus.cc:493] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:29.740890  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:29.762959  7771 raft_consensus.cc:2468] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 19.
I20260709 14:53:29.762971  7772 raft_consensus.cc:2468] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 17.
I20260709 14:53:29.771747  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:29.775904  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:29.776752  7772 raft_consensus.cc:2468] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 19.
I20260709 14:53:29.756172 14056 raft_consensus.cc:2804] T 9ce9c0ef2db24c13a8b1402f21819458 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 14:53:29.778687 14056 raft_consensus.cc:493] T 9ce9c0ef2db24c13a8b1402f21819458 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9418391fa82a42c79c6cad13ba91d964)
I20260709 14:53:29.779137 14245 leader_election.cc:290] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:29.779592  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:29.779624 14056 raft_consensus.cc:3060] T 9ce9c0ef2db24c13a8b1402f21819458 P 1e9289592458429bbddb19c2e7b7b7b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:53:29.781219 14243 raft_consensus.cc:2804] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 14:53:29.783663 14243 raft_consensus.cc:493] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:29.784200 14243 raft_consensus.cc:3060] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Advancing to term 18
I20260709 14:53:29.734269 14055 raft_consensus.cc:740] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:53:29.785391 14142 raft_consensus.cc:515] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:29.781841  7819 leader_election.cc:304] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:29.786408 14055 consensus_queue.cc:260] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:29.787953 14142 leader_election.cc:290] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:29.788725 14142 raft_consensus.cc:2749] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 14:53:29.761066 14071 raft_consensus.cc:2804] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 14:53:29.793843  7819 leader_election.cc:304] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:29.780269 14245 raft_consensus.cc:493] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:29.779155  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:29.799747  7819 leader_election.cc:304] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
W20260709 14:53:29.800832  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 55620.1us
I20260709 14:53:29.803808  7777 raft_consensus.cc:2468] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 21.
I20260709 14:53:29.804433  7893 leader_election.cc:304] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:29.718528 14161 consensus_queue.cc:1048] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.055s
I20260709 14:53:29.757967 14236 raft_consensus.cc:740] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:53:29.823093  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:29.829107  7776 raft_consensus.cc:2468] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 16.
I20260709 14:53:29.756122 14232 raft_consensus.cc:515] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:29.812136 14111 raft_consensus.cc:2749] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 14:53:29.810405 14240 raft_consensus.cc:2749] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 14:53:29.809607 14219 raft_consensus.cc:2749] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 14:53:29.844601 13835 raft_consensus.cc:2804] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 14:53:29.845669 14251 log.cc:927] Time spent T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.115s	user 0.001s	sys 0.000s
I20260709 14:53:29.848284 14055 raft_consensus.cc:3060] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Advancing to term 19
W20260709 14:53:29.851727  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 138654us
I20260709 14:53:29.744285 14231 raft_consensus.cc:515] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:29.855527  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:29.855818  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:29.857803  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
W20260709 14:53:29.858793  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 54438.2us
I20260709 14:53:29.870178  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
W20260709 14:53:29.861820  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 62154.1us
I20260709 14:53:29.862231  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:29.871462  7925 raft_consensus.cc:2468] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 13.
I20260709 14:53:29.863770  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:29.872558  7922 raft_consensus.cc:3060] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Advancing to term 19
I20260709 14:53:29.879809  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:29.880125  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:29.881135  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:29.881955  7920 raft_consensus.cc:2468] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 20.
I20260709 14:53:29.882962  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:29.879832  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:29.897307  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:29.808640 14245 raft_consensus.cc:515] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:29.905575 14056 raft_consensus.cc:515] T 9ce9c0ef2db24c13a8b1402f21819458 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:53:29.908533 13980 raft_consensus.cc:2749] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 14:53:29.867738 14173 consensus_queue.cc:260] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:29.910564 14173 raft_consensus.cc:3060] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Advancing to term 14
I20260709 14:53:29.911466 14245 leader_election.cc:290] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:29.858516 13835 raft_consensus.cc:493] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 14:53:29.921000  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 50925.9us
I20260709 14:53:29.923686  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:29.924220  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:29.924947  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:29.925005  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:29.926172  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:29.928851  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:29.931743  7922 raft_consensus.cc:2468] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 19.
I20260709 14:53:29.935159  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:29.941315  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:29.916023 14231 leader_election.cc:290] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:29.948184  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:29.953562  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:29.954771  7849 raft_consensus.cc:2393] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 16: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:53:29.928170 13835 raft_consensus.cc:3060] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Advancing to term 22
I20260709 14:53:29.966593  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:29.958357  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:29.973796  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: true dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:29.974776  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:29.973097  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:29.976245  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:29.976974  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:29.967585  7926 raft_consensus.cc:1240] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 18. Current term is 19. Ops: []
I20260709 14:53:29.955111  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:29.968039  8640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce9c0ef2db24c13a8b1402f21819458" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9418391fa82a42c79c6cad13ba91d964"
I20260709 14:53:29.980285  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:29.981683  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:29.984481  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: true dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
W20260709 14:53:29.987258 14250 log.cc:927] Time spent T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 14:53:29.937719 14245 raft_consensus.cc:493] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:29.990111  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258d6c2dda954bf5b65930fde8ecb9f3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:29.992060  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:29.992686  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:29.993484  7850 raft_consensus.cc:2468] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 19.
I20260709 14:53:29.994670  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:29.995112  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:29.996095  7922 raft_consensus.cc:2410] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for term 18 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
I20260709 14:53:29.994217  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:29.934361 14056 leader_election.cc:290] T 9ce9c0ef2db24c13a8b1402f21819458 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 3 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68:42321)
I20260709 14:53:29.991776  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
W20260709 14:53:29.963502 14257 log.cc:927] Time spent T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 14:53:30.031883  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 22 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:30.032776  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:30.030179  7775 raft_consensus.cc:1240] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 18. Current term is 19. Ops: [18.10-18.10]
I20260709 14:53:30.037581  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:30.038625  7776 raft_consensus.cc:2468] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 21.
I20260709 14:53:29.916978 14236 consensus_queue.cc:260] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:30.043380 14236 raft_consensus.cc:3060] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Advancing to term 18
I20260709 14:53:30.043648  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
W20260709 14:53:30.062353 14005 consensus_meta.cc:287] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0: Time spent flushing consensus metadata: real 0.533s	user 0.010s	sys 0.003s
I20260709 14:53:30.066964  7926 raft_consensus.cc:1240] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 17. Current term is 18. Ops: []
W20260709 14:53:30.068651 14223 consensus_meta.cc:287] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent flushing consensus metadata: real 0.837s	user 0.009s	sys 0.003s
W20260709 14:53:30.046692 14060 consensus_meta.cc:287] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0: Time spent flushing consensus metadata: real 0.873s	user 0.012s	sys 0.002s
I20260709 14:53:30.069937 14060 raft_consensus.cc:515] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:30.027819 14240 raft_consensus.cc:493] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:30.073638 14240 raft_consensus.cc:515] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:30.074290 14232 leader_election.cc:290] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:30.078348 14220 leader_election.cc:290] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 20 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:30.078663 14060 leader_election.cc:290] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 24 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:30.079160  7926 raft_consensus.cc:1275] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 14:53:30.084468  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:30.085829  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:30.086514  7848 raft_consensus.cc:2468] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 18.
I20260709 14:53:30.094754  7847 raft_consensus.cc:1240] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 18. Current term is 19. Ops: [18.10-18.10]
I20260709 14:53:30.095649  7926 raft_consensus.cc:1240] T 9ce9c0ef2db24c13a8b1402f21819458 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Rejecting Update request from peer 9418391fa82a42c79c6cad13ba91d964 for earlier term 2. Current term is 3. Ops: []
I20260709 14:53:30.096997  7920 raft_consensus.cc:2468] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 21.
I20260709 14:53:30.099272  7919 raft_consensus.cc:1240] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 24 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 23. Current term is 24. Ops: []
I20260709 14:53:30.101187  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:30.105803 14258 raft_consensus.cc:493] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:30.076906 14240 leader_election.cc:290] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:53:30.113451  7894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:30.120467 14105 consensus_queue.cc:1059] T 9ce9c0ef2db24c13a8b1402f21819458 P 9418391fa82a42c79c6cad13ba91d964 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 14:53:30.113669  7745 leader_election.cc:304] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:30.110926 14219 raft_consensus.cc:493] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:30.142434 14105 raft_consensus.cc:3055] T 9ce9c0ef2db24c13a8b1402f21819458 P 9418391fa82a42c79c6cad13ba91d964 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 14:53:30.114018  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: true dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:30.142875 14105 raft_consensus.cc:740] T 9ce9c0ef2db24c13a8b1402f21819458 P 9418391fa82a42c79c6cad13ba91d964 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9418391fa82a42c79c6cad13ba91d964, State: Running, Role: LEADER
I20260709 14:53:30.142565 14219 raft_consensus.cc:515] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:30.143834 14105 consensus_queue.cc:260] T 9ce9c0ef2db24c13a8b1402f21819458 P 9418391fa82a42c79c6cad13ba91d964 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:53:30.122907 14258 raft_consensus.cc:515] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:30.145330 14219 leader_election.cc:290] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:30.147449 14258 leader_election.cc:290] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:30.148059 14258 raft_consensus.cc:2804] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 14:53:30.148464 14258 raft_consensus.cc:493] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting leader election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:30.085047 14081 raft_consensus.cc:2749] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 14:53:30.133734 13835 raft_consensus.cc:515] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:30.027312 14245 raft_consensus.cc:515] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:30.128026  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:30.162181  7776 raft_consensus.cc:2393] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 19: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:53:30.152956  7847 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775"
dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
mode: GRACEFUL
new_leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:41662
I20260709 14:53:30.111685 14218 raft_consensus.cc:493] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:53:30.148968 14258 raft_consensus.cc:3060] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Advancing to term 19
W20260709 14:53:30.122292 14260 log.cc:927] Time spent T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.084s	user 0.000s	sys 0.005s
W20260709 14:53:30.156219  7744 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.101.67:40785 timed out after 1.722s (SENT) [suppressed 16 similar messages]
W20260709 14:53:30.215648  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 59483.6us
I20260709 14:53:30.158444  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:30.162766  7847 raft_consensus.cc:606] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Received request to transfer leadership to TS 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:53:30.218634  7847 raft_consensus.cc:614] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 14:53:30.153148  7819 leader_election.cc:304] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
W20260709 14:53:30.219660  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 66648.1us
I20260709 14:53:30.220479  7819 leader_election.cc:304] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:30.222018 14240 raft_consensus.cc:2804] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 14:53:30.222179  7819 leader_election.cc:304] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:30.224139 14219 raft_consensus.cc:2804] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 14:53:30.159569 14229 consensus_meta.cc:287] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent flushing consensus metadata: real 0.735s	user 0.011s	sys 0.011s
I20260709 14:53:30.069173 14223 raft_consensus.cc:515] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:30.230201  7819 leader_election.cc:304] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:30.237879  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:30.240239  7819 leader_election.cc:304] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:30.223232 14173 raft_consensus.cc:2804] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 14:53:30.223261 14240 raft_consensus.cc:493] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:30.226742 14105 raft_consensus.cc:3060] T 9ce9c0ef2db24c13a8b1402f21819458 P 9418391fa82a42c79c6cad13ba91d964 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:53:30.246459  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce9c0ef2db24c13a8b1402f21819458" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:30.231091 14219 raft_consensus.cc:493] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:30.208971 14243 raft_consensus.cc:515] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:30.256726  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:30.245450 14142 raft_consensus.cc:2804] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 14:53:30.243966 14229 raft_consensus.cc:2804] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 14:53:30.260617  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:30.250645 14240 raft_consensus.cc:3060] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Advancing to term 20
I20260709 14:53:30.245361 14173 raft_consensus.cc:493] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:30.229411 14218 raft_consensus.cc:515] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:30.302201  7845 raft_consensus.cc:1240] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260709 14:53:30.252552 14219 raft_consensus.cc:3060] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Advancing to term 20
I20260709 14:53:30.314162  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:30.308043  7819 leader_election.cc:304] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:30.314824  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:30.258970 14059 raft_consensus.cc:493] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:53:30.292192 14142 raft_consensus.cc:493] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:30.329514  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:30.330262  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:30.332075  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:30.332901  7926 raft_consensus.cc:2468] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 16.
I20260709 14:53:30.333454  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:30.334043  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:30.334734  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:30.302882 14162 raft_consensus.cc:493] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:30.303664 14229 raft_consensus.cc:493] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:30.315698 14173 raft_consensus.cc:3060] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Advancing to term 18
I20260709 14:53:30.345947 14229 raft_consensus.cc:3060] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Advancing to term 22
I20260709 14:53:30.350879  7819 leader_election.cc:304] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed
W20260709 14:53:30.340741 14239 consensus_meta.cc:287] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0: Time spent flushing consensus metadata: real 0.704s	user 0.011s	sys 0.005s
I20260709 14:53:30.352541 14239 raft_consensus.cc:515] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:30.355285 14239 leader_election.cc:290] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 22 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:30.336386 14142 raft_consensus.cc:3060] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Advancing to term 17
I20260709 14:53:30.357292  7923 raft_consensus.cc:2468] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 15.
I20260709 14:53:30.360750  7819 leader_election.cc:304] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:30.328637 14071 raft_consensus.cc:493] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:30.362715  7819 leader_election.cc:304] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:53:30.357591  7928 raft_consensus.cc:2393] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 22: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:53:30.356910  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:30.358846  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:30.368637  7927 raft_consensus.cc:2393] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 19: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:53:30.369206  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: true dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:30.331765 14059 raft_consensus.cc:515] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:30.372524  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258d6c2dda954bf5b65930fde8ecb9f3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:30.374207  7819 leader_election.cc:304] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:53:30.347220 14162 raft_consensus.cc:515] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:30.384619  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:30.390937 14219 raft_consensus.cc:515] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:30.392535 14245 leader_election.cc:290] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:30.362165 14055 raft_consensus.cc:493] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:30.399286 14243 leader_election.cc:290] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 18 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:30.399799 14219 leader_election.cc:290] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 20 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:30.400089 14243 raft_consensus.cc:2804] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 14:53:30.400556 14243 raft_consensus.cc:493] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Starting leader election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:53:30.401113 14219 raft_consensus.cc:2749] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 14:53:30.403039 14219 raft_consensus.cc:2804] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 14:53:30.403457 14219 raft_consensus.cc:493] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Starting leader election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:53:30.403918 14219 raft_consensus.cc:3060] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Advancing to term 21
I20260709 14:53:30.363459 14071 raft_consensus.cc:3060] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Advancing to term 22
I20260709 14:53:30.406129 14223 leader_election.cc:290] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:30.398941 14055 raft_consensus.cc:515] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:30.418845  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
W20260709 14:53:30.364797 14233 consensus_meta.cc:287] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent flushing consensus metadata: real 0.722s	user 0.011s	sys 0.008s
I20260709 14:53:30.360234 14176 raft_consensus.cc:2804] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 14:53:30.424752  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:30.431110  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:30.431094  7847 raft_consensus.cc:1275] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 14:53:30.434406 14223 raft_consensus.cc:493] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:30.436626 14223 raft_consensus.cc:515] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:30.439188 14223 leader_election.cc:290] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:30.401054 14243 raft_consensus.cc:3060] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 13 FOLLOWER]: Advancing to term 14
W20260709 14:53:30.441634  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 67459.8us
I20260709 14:53:30.444517  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:30.427264 14176 raft_consensus.cc:493] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:30.451244  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:30.441707 14277 raft_consensus.cc:2804] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Leader election won for term 19
I20260709 14:53:30.456516  7745 leader_election.cc:304] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:30.458356  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:30.463668  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:30.475946  7776 raft_consensus.cc:3060] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Advancing to term 20
I20260709 14:53:30.458909  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:30.477533  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:30.474596  7926 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
mode: GRACEFUL
new_leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:48676
I20260709 14:53:30.480051  7926 raft_consensus.cc:606] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Received request to transfer leadership to TS 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:53:30.480360  7926 raft_consensus.cc:614] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 14:53:30.482250 14239 consensus_queue.cc:1048] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 14:53:30.482764 14277 raft_consensus.cc:697] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:53:30.465437 14055 leader_election.cc:290] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:30.459086 14245 consensus_queue.cc:1059] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 14:53:30.433385 14233 raft_consensus.cc:515] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:30.484522 14245 raft_consensus.cc:3055] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 LEADER]: Stepping down as leader of term 18
I20260709 14:53:30.484987 14245 raft_consensus.cc:740] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:53:30.486219 14245 consensus_queue.cc:260] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:30.458931 14220 raft_consensus.cc:2804] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 14:53:30.451726 14176 raft_consensus.cc:3060] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Advancing to term 22
I20260709 14:53:30.495333  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:30.497313 14220 raft_consensus.cc:493] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:30.498171 14220 raft_consensus.cc:3060] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Advancing to term 19
W20260709 14:53:30.500340 14270 log.cc:927] Time spent T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.242s	user 0.003s	sys 0.000s
W20260709 14:53:30.492045  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:30.490419  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:30.502933  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:30.503571  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:30.504308  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:30.505157  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:30.511758  7777 raft_consensus.cc:2468] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 17.
I20260709 14:53:30.511981  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:30.516356  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:30.519079  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:30.520778  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:30.522603  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:30.523841  7922 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
mode: GRACEFUL
new_leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:48676
I20260709 14:53:30.524511  7922 raft_consensus.cc:606] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Received request to transfer leadership to TS 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:53:30.525332 14059 leader_election.cc:290] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:30.527041  7922 raft_consensus.cc:614] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 14:53:30.527436  7776 raft_consensus.cc:2468] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 20.
I20260709 14:53:30.534220  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 22 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:30.535439  7922 raft_consensus.cc:2393] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 22: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:53:30.536154  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:30.537335  7770 raft_consensus.cc:1275] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 14:53:30.537573  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:30.539239  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:30.540949  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:30.541795  7775 raft_consensus.cc:3060] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Advancing to term 18
I20260709 14:53:30.548628  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:30.549299  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:30.549508  7770 raft_consensus.cc:3060] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Advancing to term 17
I20260709 14:53:30.553557  7922 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
mode: GRACEFUL
new_leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:48676
I20260709 14:53:30.554556  7922 raft_consensus.cc:606] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 22 FOLLOWER]: Received request to transfer leadership to TS 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:53:30.555132  7922 raft_consensus.cc:614] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 22 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 14:53:30.481508 14279 consensus_queue.cc:1059] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 23.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.058s
I20260709 14:53:30.561369 14233 leader_election.cc:290] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 22 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:30.562561  7770 raft_consensus.cc:2468] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 17.
I20260709 14:53:30.538055 14245 raft_consensus.cc:3060] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Advancing to term 19
I20260709 14:53:30.568764  7770 raft_consensus.cc:1240] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 14:53:30.569638  7922 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
mode: GRACEFUL
new_leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:48676
I20260709 14:53:30.570338  7922 raft_consensus.cc:606] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 LEADER]: Received request to transfer leadership to TS 1de5e20126fa4d8ca0793d19c7b847ed
W20260709 14:53:30.576990  7743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:30.577172  7775 raft_consensus.cc:2468] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 18.
I20260709 14:53:30.578812  7770 raft_consensus.cc:1240] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 20. Current term is 21. Ops: [20.12-20.12]
I20260709 14:53:30.579643  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:30.579953  7772 raft_consensus.cc:1240] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 16. Current term is 17. Ops: []
I20260709 14:53:30.580716  7770 raft_consensus.cc:1240] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 19. Current term is 20. Ops: []
I20260709 14:53:30.580374  7774 raft_consensus.cc:2468] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 21.
I20260709 14:53:30.583706  6549 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 14:53:30.483863 14277 consensus_queue.cc:237] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:30.586020  6549 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 14:53:30.589929  7773 raft_consensus.cc:1240] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 23 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 22. Current term is 23. Ops: []
I20260709 14:53:30.590970  7819 leader_election.cc:304] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:30.592444 14055 raft_consensus.cc:3060] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Advancing to term 19
I20260709 14:53:30.595247  7819 leader_election.cc:304] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:30.596315 14233 raft_consensus.cc:2804] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 14:53:30.596730 14233 raft_consensus.cc:493] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:30.597057 14233 raft_consensus.cc:3060] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Advancing to term 18
I20260709 14:53:30.597556 13835 leader_election.cc:290] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 22 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:30.585453 14117 raft_consensus.cc:493] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:30.601043 14117 raft_consensus.cc:515] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:30.602046 14211 raft_consensus.cc:3060] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Advancing to term 19
I20260709 14:53:30.603736 14117 leader_election.cc:290] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:30.606871  7921 raft_consensus.cc:1275] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 14:53:30.621102  7850 raft_consensus.cc:1275] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 14:53:30.581806 14236 raft_consensus.cc:3055] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 23 LEADER]: Stepping down as leader of term 23
I20260709 14:53:30.553684 14219 raft_consensus.cc:515] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:30.621582  7819 leader_election.cc:304] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:30.640550  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 22 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:30.641816  7852 raft_consensus.cc:2393] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 22: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:53:30.609195 14218 leader_election.cc:290] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:30.647918  7773 raft_consensus.cc:1240] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 18. Current term is 19. Ops: []
I20260709 14:53:30.649035  7774 raft_consensus.cc:1240] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 16. Current term is 17. Ops: []
I20260709 14:53:30.633406 14236 raft_consensus.cc:740] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:53:30.644766 14276 raft_consensus.cc:2804] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Leader election won for term 20
I20260709 14:53:30.666075  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce9c0ef2db24c13a8b1402f21819458" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:30.614969 14071 raft_consensus.cc:515] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:30.613147 14240 raft_consensus.cc:515] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:30.614523 14243 raft_consensus.cc:515] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:30.663355  7770 raft_consensus.cc:1275] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 22 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 14:53:30.679075  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783e4874513449ef9084b833f188a6d3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:30.686053  7773 raft_consensus.cc:1240] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 19. Current term is 20. Ops: []
I20260709 14:53:30.686515  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:30.689787  7923 raft_consensus.cc:2393] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 22: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:53:30.691167  7773 raft_consensus.cc:1240] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 20. Current term is 21. Ops: []
I20260709 14:53:30.692559  7770 raft_consensus.cc:1275] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 14:53:30.661829 14055 raft_consensus.cc:2749] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 14:53:30.716969  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:30.899649  7853 raft_consensus.cc:1240] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 18. Current term is 19. Ops: []
I20260709 14:53:30.720741  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:30.693085 14276 raft_consensus.cc:697] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:53:30.901808 14276 consensus_queue.cc:237] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:30.902853 14230 leader_election.cc:290] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:30.877489  7848 raft_consensus.cc:1240] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 19. Current term is 20. Ops: []
W20260709 14:53:30.880708 14173 consensus_meta.cc:287] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent flushing consensus metadata: real 0.521s	user 0.012s	sys 0.004s
I20260709 14:53:30.675843 14083 raft_consensus.cc:493] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:30.881137  7849 raft_consensus.cc:1240] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 22 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 21. Current term is 22. Ops: []
W20260709 14:53:30.881747 14258 consensus_meta.cc:287] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed: Time spent flushing consensus metadata: real 0.648s	user 0.013s	sys 0.010s
I20260709 14:53:30.744143 14236 consensus_queue.cc:260] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:30.672428 14035 raft_consensus.cc:493] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:30.896358 14243 leader_election.cc:290] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 14 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:30.891535  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:30.892333  7925 raft_consensus.cc:2468] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 19.
I20260709 14:53:30.889150 14240 leader_election.cc:290] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 20 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:53:30.888228 14229 consensus_meta.cc:287] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent flushing consensus metadata: real 0.522s	user 0.006s	sys 0.009s
I20260709 14:53:30.906728  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 22 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:30.960282  7773 raft_consensus.cc:3060] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Advancing to term 22
I20260709 14:53:30.917836  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:30.961943  7778 raft_consensus.cc:3060] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Advancing to term 22
W20260709 14:53:30.891563 14281 log.cc:927] Time spent T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.207s	user 0.003s	sys 0.007s
I20260709 14:53:30.966988  7770 raft_consensus.cc:1240] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 18. Current term is 19. Ops: []
I20260709 14:53:30.918841 14279 raft_consensus.cc:493] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:30.921229 13955 leader_election.cc:290] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:30.904604 14255 raft_consensus.cc:493] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:30.916275 14258 raft_consensus.cc:515] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:53:30.892846 14142 consensus_meta.cc:287] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac: Time spent flushing consensus metadata: real 0.525s	user 0.012s	sys 0.006s
I20260709 14:53:30.883904 14219 leader_election.cc:290] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 21 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:30.884941 14071 leader_election.cc:290] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 22 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:30.971787  7777 raft_consensus.cc:1275] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 14:53:30.973557  7770 raft_consensus.cc:1275] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 14:53:30.992074  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783e4874513449ef9084b833f188a6d3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:30.992663  7773 raft_consensus.cc:2468] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 22.
I20260709 14:53:30.973726  7893 leader_election.cc:304] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:30.959607 14229 raft_consensus.cc:515] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:30.988266  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:30.914721 14056 raft_consensus.cc:493] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:30.994935  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:30.880788 14176 raft_consensus.cc:515] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:30.995275  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:30.992930  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:30.997223  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:31.004439  7770 raft_consensus.cc:2393] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 22: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:53:30.888362 14233 raft_consensus.cc:515] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:31.002498  7778 raft_consensus.cc:2468] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 22.
I20260709 14:53:31.000000  7927 raft_consensus.cc:2468] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 24.
I20260709 14:53:31.001569  7893 leader_election.cc:304] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:31.003925  7744 leader_election.cc:304] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:30.955024 14083 raft_consensus.cc:515] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:30.956152 14220 raft_consensus.cc:515] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:30.944087 14173 raft_consensus.cc:515] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:31.011227  7893 leader_election.cc:304] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:31.012476  7846 raft_consensus.cc:2393] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 22: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:53:31.012454 14245 raft_consensus.cc:2749] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 14:53:30.989192 14142 raft_consensus.cc:515] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:31.013984 14229 leader_election.cc:290] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 22 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:31.016220 14258 leader_election.cc:290] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:53:31.017277 14288 log.cc:927] Time spent T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 14:53:30.990402 14255 raft_consensus.cc:515] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:31.019312 14225 raft_consensus.cc:2749] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 14:53:30.977756 14227 consensus_queue.cc:1048] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 14:53:30.959744 14035 raft_consensus.cc:515] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:31.034724 14083 leader_election.cc:290] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:30.976270 14279 raft_consensus.cc:515] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:31.042460 14233 leader_election.cc:290] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 18 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:30.997799 13835 raft_consensus.cc:2749] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 14:53:31.007241 14239 consensus_queue.cc:1048] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 14:53:31.046914  7776 raft_consensus.cc:1240] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 18. Current term is 19. Ops: []
W20260709 14:53:31.052992  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 139900us
I20260709 14:53:31.049829 14173 leader_election.cc:290] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 18 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:31.050876  7854 raft_consensus.cc:1240] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 16. Current term is 17. Ops: []
I20260709 14:53:31.052353  7893 leader_election.cc:304] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:53:31.048368  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 44578.3us
I20260709 14:53:31.077589  7744 leader_election.cc:304] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:31.044956 14176 leader_election.cc:290] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 22 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:31.048085 14220 leader_election.cc:290] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:31.006445 14056 raft_consensus.cc:515] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:31.085942 14118 raft_consensus.cc:2749] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 14:53:31.069461  7920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38532 (request call id 4029) took 1127 ms. Trace:
I20260709 14:53:31.086939  7920 rpcz_store.cc:276] 0709 14:53:29.942095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:53:29.942374 (+   279us) service_pool.cc:224] Handling call
0709 14:53:31.068988 (+1126614us) spinlock_profiling.cc:243] Waited 122 ms on lock 0x7b540031fbd4. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae922fa 00007fb68fe53b17 00007fb6893ce6d4 00007fb6893ce662 00007fb6893ce591 00007fb6893ce50c 00007fb6893cd7c2 00007fb6891c948c 00007fb6891c88c6 00007fb6891c826f
0709 14:53:31.069211 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":281544448}
I20260709 14:53:31.052678 14211 raft_consensus.cc:2749] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 14:53:31.088271 14056 leader_election.cc:290] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:31.003526 14219 raft_consensus.cc:493] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:31.089210 14219 raft_consensus.cc:515] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:31.084760 13835 raft_consensus.cc:2749] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 14:53:31.075698 14229 raft_consensus.cc:493] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:31.050669 14142 leader_election.cc:290] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 17 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:31.094956 14229 raft_consensus.cc:515] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:31.107384 14173 raft_consensus.cc:493] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:31.108457 14173 raft_consensus.cc:515] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:31.108999 14035 leader_election.cc:290] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:31.109777 14225 consensus_queue.cc:1059] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 14:53:31.061640 14255 leader_election.cc:290] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:31.140333  7845 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49948 (request call id 4492) took 1155 ms. Trace:
I20260709 14:53:31.139573  7744 leader_election.cc:304] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:31.093045 14219 leader_election.cc:290] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:31.160097  7744 leader_election.cc:304] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:31.111100 14229 leader_election.cc:290] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:53:31.163750  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 84190us
I20260709 14:53:31.174039  7852 raft_consensus.cc:1240] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 17. Current term is 18. Ops: []
I20260709 14:53:31.140954  7845 rpcz_store.cc:276] 0709 14:53:29.985922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:53:29.989035 (+  3113us) service_pool.cc:224] Handling call
0709 14:53:29.989544 (+   509us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:53:30.321342 (+331798us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:53:31.139978 (+818636us) spinlock_profiling.cc:243] Waited 312 ms on lock 0x7b54000d5554. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae8ee01 00007fb68ae8d83e 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2 00007fb6891c948c 00007fb6891c88c6
0709 14:53:31.140250 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":718285568}
I20260709 14:53:31.163157  7846 raft_consensus.cc:1275] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 22 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 14:53:31.126406 13835 raft_consensus.cc:3055] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 14:53:31.162314  7744 leader_election.cc:304] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:31.177878 13835 raft_consensus.cc:740] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:31.179157  7744 leader_election.cc:304] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:31.180655  7744 leader_election.cc:304] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:31.182004  7744 leader_election.cc:304] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:31.181995 14117 raft_consensus.cc:2749] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 14:53:31.163935 14118 raft_consensus.cc:2749] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 14:53:31.141721 14258 consensus_queue.cc:1048] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.041s
I20260709 14:53:31.166384 14223 raft_consensus.cc:2749] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 14:53:31.182077 14222 raft_consensus.cc:493] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:31.183949 13835 consensus_queue.cc:260] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:31.191277 13835 raft_consensus.cc:3060] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Advancing to term 15
W20260709 14:53:31.194358 14290 log.cc:927] Time spent T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 14:53:31.197734 14173 leader_election.cc:290] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:31.181865 13955 raft_consensus.cc:2749] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 14:53:31.163931 14255 consensus_queue.cc:1059] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.024s
I20260709 14:53:31.180655 14230 raft_consensus.cc:2749] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 14:53:31.203688 14117 raft_consensus.cc:2804] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 14:53:31.206046 14279 leader_election.cc:290] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:31.204353 14117 raft_consensus.cc:493] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:31.210990 13980 consensus_queue.cc:1059] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 14:53:31.211548 14255 consensus_queue.cc:1059] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 14:53:31.212118 14239 raft_consensus.cc:3055] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 LEADER]: Stepping down as leader of term 21
W20260709 14:53:31.218261  7925 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38532 (request call id 4034) took 1252 ms (client timeout 1587 ms). Trace:
I20260709 14:53:31.229789  7819 leader_election.cc:304] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:31.229676  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:31.231729 14173 raft_consensus.cc:2749] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 14:53:31.232430 14228 raft_consensus.cc:3055] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 14:53:31.232925 14228 raft_consensus.cc:740] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:31.234356 14228 consensus_queue.cc:260] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:31.235548  7819 leader_election.cc:304] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:31.236145 14228 raft_consensus.cc:3060] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 14:53:31.236409 14229 raft_consensus.cc:2749] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 14:53:31.228744 14239 raft_consensus.cc:740] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:31.240039  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:31.241171  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:31.241930  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
W20260709 14:53:31.229132  7925 rpcz_store.cc:269] 0709 14:53:29.965422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:53:29.973380 (+  7958us) service_pool.cc:224] Handling call
0709 14:53:31.217960 (+1244580us) spinlock_profiling.cc:243] Waited 909 ms on lock 0x7b5400311ad4. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae922fa 00007fb68fe53b17 00007fb6893ce6d4 00007fb6893ce662 00007fb6893ce591 00007fb6893ce50c 00007fb6893cd7c2 00007fb6891c948c 00007fb6891c88c6 00007fb6891c826f
0709 14:53:31.218083 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2091602176}
I20260709 14:53:31.244020  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:31.249702 14173 raft_consensus.cc:493] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:31.246448  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:31.250483  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:31.249598  7922 raft_consensus.cc:3060] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Advancing to term 21
I20260709 14:53:31.250761  7919 raft_consensus.cc:2393] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 22: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:53:31.241621  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:31.252789  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:31.255391  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:31.224974 14117 raft_consensus.cc:3060] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Advancing to term 16
I20260709 14:53:31.253836 14296 raft_consensus.cc:3055] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 14:53:31.190873 14222 raft_consensus.cc:515] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:31.249450 14219 raft_consensus.cc:493] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:53:31.268924 14239 consensus_queue.cc:260] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:31.269016 14219 raft_consensus.cc:515] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:31.270289 14239 raft_consensus.cc:3060] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Advancing to term 22
I20260709 14:53:31.270524 14222 leader_election.cc:290] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:31.266147 14296 raft_consensus.cc:740] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:31.271266  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:31.262378 14173 raft_consensus.cc:515] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:31.272277 14219 leader_election.cc:290] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:31.272272  7920 raft_consensus.cc:2468] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 19.
I20260709 14:53:31.272375 14296 consensus_queue.cc:260] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:31.277673 14296 raft_consensus.cc:3060] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Advancing to term 21
I20260709 14:53:31.281810  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:31.283058  7921 raft_consensus.cc:2468] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 18.
I20260709 14:53:31.273850 14173 leader_election.cc:290] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:31.236213 14162 leader_election.cc:290] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:31.291555 14227 consensus_queue.cc:1059] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 14:53:31.288560  7922 raft_consensus.cc:2468] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 21.
I20260709 14:53:31.314524 14117 raft_consensus.cc:515] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:31.318162 14117 leader_election.cc:290] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 16 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:31.415628  7846 raft_consensus.cc:1240] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 17. Current term is 18. Ops: []
I20260709 14:53:31.408396  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:31.418335  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:31.419150  7850 raft_consensus.cc:1240] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 22 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 21. Current term is 22. Ops: []
I20260709 14:53:31.419860  7854 raft_consensus.cc:2468] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 20.
I20260709 14:53:31.423287  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:31.430688  7853 raft_consensus.cc:2468] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 19.
W20260709 14:53:31.404721  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 222541us
I20260709 14:53:31.431052  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 17 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:31.439765  7922 raft_consensus.cc:2410] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for term 17 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 14:53:31.434370  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:31.436249  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:31.442250  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
W20260709 14:53:31.427639  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 133843us
I20260709 14:53:31.439792  7744 leader_election.cc:304] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:31.444196  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
W20260709 14:53:31.430775  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:31.450534  7893 leader_election.cc:304] T 9ce9c0ef2db24c13a8b1402f21819458 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 9418391fa82a42c79c6cad13ba91d964
I20260709 14:53:31.447271  7744 leader_election.cc:304] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:31.460359  7744 leader_election.cc:304] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:53:31.470570  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:31.479043  7744 leader_election.cc:304] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:31.490886  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:31.492949 14035 raft_consensus.cc:493] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:53:31.495342 14056 consensus_queue.cc:1059] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 22.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.002s
I20260709 14:53:31.496140 13980 consensus_queue.cc:1059] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 14:53:31.498008 14071 raft_consensus.cc:493] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:31.497879 13835 consensus_queue.cc:1059] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.002s
I20260709 14:53:31.501979 14083 raft_consensus.cc:2749] T 9ce9c0ef2db24c13a8b1402f21819458 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 14:53:31.503171 14032 consensus_queue.cc:1048] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 14:53:31.503717 14117 consensus_queue.cc:1059] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 14:53:31.505172 14162 raft_consensus.cc:493] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:31.511180 14173 raft_consensus.cc:493] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:31.512880 14176 raft_consensus.cc:493] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:53:31.513729 14118 raft_consensus.cc:2749] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 14:53:31.496886 14055 raft_consensus.cc:493] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:31.521347  7893 leader_election.cc:304] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:31.522883 14220 raft_consensus.cc:2749] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 14:53:31.498268 13955 raft_consensus.cc:493] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9418391fa82a42c79c6cad13ba91d964)
I20260709 14:53:31.522933  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:31.535621  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:31.537225  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:31.520464 14088 consensus_queue.cc:1059] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.016s
I20260709 14:53:31.524689 14230 raft_consensus.cc:2749] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 14:53:31.547137  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:31.547483  7921 raft_consensus.cc:2468] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 19.
I20260709 14:53:31.548465 14220 raft_consensus.cc:3055] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 LEADER]: Stepping down as leader of term 17
I20260709 14:53:31.547807 14071 raft_consensus.cc:515] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:31.525385 14238 consensus_queue.cc:1059] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.024s
I20260709 14:53:31.549347  7922 raft_consensus.cc:2393] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 24: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:53:31.548138 14035 raft_consensus.cc:515] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:31.549449 14245 raft_consensus.cc:2749] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 14:53:31.558028 14220 raft_consensus.cc:740] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:53:31.551393 14176 raft_consensus.cc:515] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:31.561359 14035 leader_election.cc:290] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:31.550194 14173 raft_consensus.cc:515] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:31.561627 14220 consensus_queue.cc:260] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:31.563390 14176 leader_election.cc:290] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:31.563885 14220 raft_consensus.cc:3060] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Advancing to term 18
I20260709 14:53:31.564699 14173 leader_election.cc:290] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:31.551604  7853 raft_consensus.cc:2393] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 18: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:53:31.552270 14244 raft_consensus.cc:3055] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 14:53:31.553647 13955 raft_consensus.cc:515] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:53:31.554035 14088 raft_consensus.cc:493] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:53:31.554834 14055 raft_consensus.cc:515] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:31.525103 14255 consensus_queue.cc:1048] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 14:53:31.535764 14162 raft_consensus.cc:515] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:31.566603 14244 raft_consensus.cc:740] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:31.571894 14238 raft_consensus.cc:3055] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 14:53:31.573657 14238 raft_consensus.cc:740] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:31.574874 14244 consensus_queue.cc:260] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:31.578474 14071 leader_election.cc:290] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:31.579543  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:31.580714  7849 raft_consensus.cc:2393] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 17: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:53:31.583405  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:31.583200 14238 consensus_queue.cc:260] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:31.587132 14238 raft_consensus.cc:3060] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Advancing to term 21
I20260709 14:53:31.587922 14244 raft_consensus.cc:3060] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Advancing to term 19
I20260709 14:53:31.591143 14291 raft_consensus.cc:2749] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 14:53:31.591527  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:53:31.593986  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 91428.1us
I20260709 14:53:31.597143  7849 raft_consensus.cc:2468] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 23.
I20260709 14:53:31.598485  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:31.599937  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:31.603345 14055 leader_election.cc:290] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:31.590013 14162 leader_election.cc:290] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:31.605206  7850 raft_consensus.cc:1240] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 13. Current term is 14. Ops: []
I20260709 14:53:31.610460  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 22 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:31.607184  7846 raft_consensus.cc:1275] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 14:53:31.610383  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:31.626364  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:31.627485  7819 leader_election.cc:304] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:31.627878  8640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9441e831627143a991a1556dcdce71e3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9418391fa82a42c79c6cad13ba91d964" is_pre_election: true
I20260709 14:53:31.629225  7852 raft_consensus.cc:1275] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 14:53:31.608938 14291 consensus_queue.cc:1059] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.022s
I20260709 14:53:31.631796 14291 raft_consensus.cc:3055] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 14:53:31.632249 14291 raft_consensus.cc:740] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:31.635258 14296 raft_consensus.cc:3055] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 14:53:31.635824 14296 raft_consensus.cc:740] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:31.638411  7846 raft_consensus.cc:1275] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 14:53:31.591516  6549 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 14:53:31.641130 14296 consensus_queue.cc:260] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:31.617545 13955 leader_election.cc:290] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68:42321)
I20260709 14:53:31.644405 14296 raft_consensus.cc:3060] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 22 FOLLOWER]: Advancing to term 23
I20260709 14:53:31.641544 14071 raft_consensus.cc:493] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:31.646133 14071 raft_consensus.cc:515] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:31.647502  7853 raft_consensus.cc:2393] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 16: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:53:31.641687  7849 raft_consensus.cc:2393] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 22: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:53:31.650872 13835 raft_consensus.cc:3055] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 14:53:31.656389 13835 raft_consensus.cc:740] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:31.657877 13835 consensus_queue.cc:260] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:31.658656  7846 raft_consensus.cc:1240] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 20. Current term is 21. Ops: []
I20260709 14:53:31.660352 13835 raft_consensus.cc:3060] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 14:53:31.661628 14071 leader_election.cc:290] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:31.663411  7848 raft_consensus.cc:2468] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 19.
I20260709 14:53:31.665758 14088 raft_consensus.cc:515] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:31.671633 14295 raft_consensus.cc:3055] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 14:53:31.677561 14071 raft_consensus.cc:2804] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 14:53:31.678136 14071 raft_consensus.cc:493] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:31.651290 14081 raft_consensus.cc:493] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:53:31.678579 14071 raft_consensus.cc:3060] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Advancing to term 20
I20260709 14:53:31.679284 14081 raft_consensus.cc:515] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:31.680233 14236 raft_consensus.cc:3060] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 23 FOLLOWER]: Advancing to term 24
I20260709 14:53:31.681079 14208 raft_consensus.cc:3055] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 14:53:31.681732 14208 raft_consensus.cc:740] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:31.683000 14208 consensus_queue.cc:260] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:31.683477 14081 leader_election.cc:290] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:31.684285 14208 raft_consensus.cc:3060] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Advancing to term 20
W20260709 14:53:31.675565  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 48494.7us
I20260709 14:53:31.685956  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:31.686609  7819 leader_election.cc:304] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:31.686988  7849 raft_consensus.cc:2393] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 14: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:53:31.687537  7851 raft_consensus.cc:1240] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 22 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 21. Current term is 22. Ops: []
I20260709 14:53:31.688115 14055 raft_consensus.cc:2804] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 14:53:31.675704 14295 raft_consensus.cc:740] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:31.689750 14055 raft_consensus.cc:493] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:31.690523 14055 raft_consensus.cc:3060] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Advancing to term 19
I20260709 14:53:31.691180  7819 leader_election.cc:304] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:31.697683 14295 consensus_queue.cc:260] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:31.699940 14295 raft_consensus.cc:3060] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Advancing to term 20
I20260709 14:53:31.676488  7854 raft_consensus.cc:2468] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 19.
W20260709 14:53:31.703387  7893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:53:31.705338  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 184642us
I20260709 14:53:31.706010 14176 raft_consensus.cc:2804] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Leader election won for term 21
I20260709 14:53:31.706622  7744 leader_election.cc:304] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:31.707060 14176 raft_consensus.cc:697] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:53:31.707612 14220 raft_consensus.cc:493] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:31.711642 14220 raft_consensus.cc:515] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:31.712177 14176 consensus_queue.cc:237] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:53:31.713407 14276 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.619s	user 0.018s	sys 0.010s
W20260709 14:53:31.713958 14276 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.694s	user 0.018s	sys 0.010s
I20260709 14:53:31.715337  7845 raft_consensus.cc:1240] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 LEADER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 19. Current term is 20. Ops: []
I20260709 14:53:31.712030 14211 raft_consensus.cc:493] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:31.734112 14211 raft_consensus.cc:515] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:31.737639 14211 leader_election.cc:290] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:53:31.740473  7893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:53:31.747124  7893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:53:31.748416  7893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:31.753111 14220 leader_election.cc:290] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:53:31.754526  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 48148.4us
I20260709 14:53:31.755080 14249 raft_consensus.cc:493] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:31.756096 13955 raft_consensus.cc:2749] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 14:53:31.756052 14249 raft_consensus.cc:515] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:31.751516  7675 catalog_manager.cc:5697] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 19 to 21, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 21 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:53:31.762382  7675 catalog_manager.cc:5697] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 18 to 21, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 21 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:53:31.760111 14249 leader_election.cc:290] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:31.759932 14071 raft_consensus.cc:515] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:31.759418  7744 leader_election.cc:304] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:31.716009 14088 leader_election.cc:290] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:31.776791 14071 leader_election.cc:290] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 20 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:31.668867 14291 consensus_queue.cc:260] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:31.781563 14220 raft_consensus.cc:2749] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 14:53:31.785861  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 92539.3us
I20260709 14:53:31.788405 14291 raft_consensus.cc:3060] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Advancing to term 19
W20260709 14:53:31.772365  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 50091.4us
I20260709 14:53:31.776628  7744 leader_election.cc:304] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:31.774575 14238 raft_consensus.cc:493] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:53:31.795974 14238 raft_consensus.cc:515] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:31.796561  7819 leader_election.cc:304] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:31.797086  7744 leader_election.cc:304] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:31.798130 14162 raft_consensus.cc:2749] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 14:53:31.808223 14238 leader_election.cc:290] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:31.808885  7744 leader_election.cc:304] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:31.807130  7675 catalog_manager.cc:5697] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 21 to 23, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 23 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:53:31.814532 14176 raft_consensus.cc:2804] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 14:53:31.829798 14176 raft_consensus.cc:493] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:31.830442 14176 raft_consensus.cc:3060] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Advancing to term 21
I20260709 14:53:31.830904 14162 raft_consensus.cc:2749] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 14:53:31.833438  7744 leader_election.cc:304] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:53:31.821583  7743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:31.797492 14220 raft_consensus.cc:2749] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 14:53:31.839148 14244 consensus_queue.cc:1059] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 14:53:31.841908 14220 raft_consensus.cc:2749] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 14:53:31.839745 14208 consensus_queue.cc:1059] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 14:53:31.842273 14244 raft_consensus.cc:3055] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 14:53:31.842921 14208 consensus_queue.cc:1243] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer 3876b8ee8d744cb18e91d97aae93b1ac log is divergent from this leader: its last log entry 15.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 14:53:31.843313 14238 consensus_queue.cc:1048] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 14:53:31.843688 14296 raft_consensus.cc:3055] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 14:53:31.844390 14296 raft_consensus.cc:740] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:31.846199  7744 leader_election.cc:304] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:31.845835 14296 consensus_queue.cc:260] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:31.848125 14296 raft_consensus.cc:3060] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 14:53:31.848528 14162 raft_consensus.cc:3060] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Advancing to term 18
I20260709 14:53:31.822309 14055 raft_consensus.cc:515] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:31.858659 14162 raft_consensus.cc:2749] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 14:53:31.860612 14055 leader_election.cc:290] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 19 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:31.861758  7744 leader_election.cc:304] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:31.862267  7675 catalog_manager.cc:5697] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 21 to 22, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 22 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:53:31.870129  7745 leader_election.cc:304] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:31.879210 14162 raft_consensus.cc:2749] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 14:53:31.880183  7745 leader_election.cc:304] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:31.873431 14244 raft_consensus.cc:740] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:31.882751 14220 raft_consensus.cc:2804] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 14:53:31.883852 14162 raft_consensus.cc:2749] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 14:53:31.886233  7744 leader_election.cc:304] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:31.887681 14162 raft_consensus.cc:2749] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 14:53:31.891703  7745 leader_election.cc:304] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:31.892112 13955 consensus_queue.cc:1059] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 14:53:31.893229 14220 raft_consensus.cc:493] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:31.894407 14220 raft_consensus.cc:3060] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 24 FOLLOWER]: Advancing to term 25
I20260709 14:53:31.892529 14162 consensus_queue.cc:1048] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 14:53:31.893221 14055 raft_consensus.cc:493] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:53:31.895402  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 43882.4us
I20260709 14:53:31.911033 14055 raft_consensus.cc:515] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:31.912974 14230 consensus_queue.cc:1048] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 14:53:31.913493 14295 consensus_queue.cc:1059] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 21.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 14:53:31.914873 14295 raft_consensus.cc:3055] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 14:53:31.915390 14295 raft_consensus.cc:740] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:31.915704 14081 consensus_queue.cc:1059] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 14:53:31.916985 14081 raft_consensus.cc:3055] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 14:53:31.916814 14295 consensus_queue.cc:260] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:31.917472 14081 raft_consensus.cc:740] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:31.918776 14295 raft_consensus.cc:3060] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Advancing to term 22
I20260709 14:53:31.894949 13955 raft_consensus.cc:3055] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 LEADER]: Stepping down as leader of term 13
I20260709 14:53:31.897578  7675 catalog_manager.cc:5697] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 19 to 20, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 20 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:53:31.899837 14291 consensus_queue.cc:1059] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 14:53:31.901388  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:31.903219 13835 consensus_queue.cc:1048] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 14:53:31.886185 14244 consensus_queue.cc:260] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:31.905493 14296 consensus_queue.cc:1048] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 14:53:31.905362  7673 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54350 (request call id 380) took 9936 ms. Trace:
I20260709 14:53:31.909687 14176 raft_consensus.cc:515] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:31.915313  7894 leader_election.cc:304] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:31.936000  7894 leader_election.cc:304] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:31.924064  7893 leader_election.cc:304] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:31.937440 14208 raft_consensus.cc:2804] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 14:53:31.937990 14208 raft_consensus.cc:493] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:31.938392 14208 raft_consensus.cc:3060] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Advancing to term 20
I20260709 14:53:31.924752 14081 consensus_queue.cc:260] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:31.921875 13955 raft_consensus.cc:740] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:53:31.940227 14081 raft_consensus.cc:3060] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 14:53:31.940335 13955 consensus_queue.cc:260] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:31.941632 14238 raft_consensus.cc:2804] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 14:53:31.942128 13955 raft_consensus.cc:3060] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [term 13 FOLLOWER]: Advancing to term 14
I20260709 14:53:31.942950 14088 raft_consensus.cc:2804] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 14:53:31.943646 14088 raft_consensus.cc:697] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 22 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:31.926259 14291 raft_consensus.cc:3055] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 14:53:31.929523  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9441e831627143a991a1556dcdce71e3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:31.931620  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:31.945708  7854 raft_consensus.cc:2468] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 24.
I20260709 14:53:31.931357  7675 catalog_manager.cc:5697] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 15 to 16, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 16 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:53:31.944370 14291 raft_consensus.cc:740] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:31.932592 14244 raft_consensus.cc:3060] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Advancing to term 20
I20260709 14:53:31.948302  7675 catalog_manager.cc:5697] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 18 to 19, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 19 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:53:31.932547  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:31.950402  7845 raft_consensus.cc:2468] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 22.
I20260709 14:53:31.949338 14291 consensus_queue.cc:260] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:31.952862 14291 raft_consensus.cc:3060] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 14:53:31.936059 14230 raft_consensus.cc:2749] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 14:53:31.942144 14238 raft_consensus.cc:493] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:31.944855 14088 consensus_queue.cc:237] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:31.954207 14238 raft_consensus.cc:3060] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Advancing to term 20
I20260709 14:53:31.913666 14055 leader_election.cc:290] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:31.935515 14176 leader_election.cc:290] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 21 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:31.959800  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:31.961139  7853 raft_consensus.cc:2393] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 18: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:53:31.964977  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:31.961619  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:31.965884  7675 catalog_manager.cc:5697] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 12 to 13, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 13 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:53:31.967116  7852 raft_consensus.cc:2468] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 14.
I20260709 14:53:31.963850  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:31.970697  7845 raft_consensus.cc:2468] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 21.
W20260709 14:53:31.977174  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:31.968523  7675 catalog_manager.cc:5697] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:53:31.978798  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783e4874513449ef9084b833f188a6d3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:53:31.984915  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 54149.9us
I20260709 14:53:31.986334 14162 consensus_queue.cc:1048] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 14:53:32.005612  7819 leader_election.cc:304] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:32.006868 14236 raft_consensus.cc:2749] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 14:53:31.989182  7675 catalog_manager.cc:5697] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:53:32.013200 13835 raft_consensus.cc:493] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:32.028514  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:32.031783  7921 raft_consensus.cc:2468] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 13.
I20260709 14:53:32.033712 13835 raft_consensus.cc:515] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:32.037137 13835 leader_election.cc:290] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:32.042383  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:32.025189  7675 catalog_manager.cc:5697] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:53:32.043071  7926 raft_consensus.cc:2468] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 20.
I20260709 14:53:32.046283  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:32.047784  7921 raft_consensus.cc:2468] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 21.
I20260709 14:53:32.054633  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:32.051445  7745 leader_election.cc:304] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:32.053078  7675 catalog_manager.cc:5697] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 23 to 24, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 24 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
W20260709 14:53:32.063877  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:32.066622  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:32.063277  7675 catalog_manager.cc:5697] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 18 to 19, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 19 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:53:32.068607 14162 raft_consensus.cc:2749] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 14:53:32.079087  7926 raft_consensus.cc:2468] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 19.
I20260709 14:53:32.056391 14238 raft_consensus.cc:515] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:32.084385  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:32.084681  7921 raft_consensus.cc:2468] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 15.
I20260709 14:53:32.090425  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:32.091707 14230 raft_consensus.cc:493] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:32.098549  7921 raft_consensus.cc:3060] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Advancing to term 19
I20260709 14:53:32.068858 14208 raft_consensus.cc:515] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:32.100489  7922 raft_consensus.cc:3060] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Advancing to term 20
I20260709 14:53:32.092794 14230 raft_consensus.cc:515] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:32.089427 14220 raft_consensus.cc:515] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:32.115252  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:31.930855  7673 rpcz_store.cc:276] 0709 14:53:21.969040 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:53:21.969354 (+   314us) service_pool.cc:224] Handling call
0709 14:53:31.905034 (+9935680us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 14:53:26.130865 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 14:53:26.131750 (+   885us) write_op.cc:432] Acquiring schema lock in shared mode
0709 14:53:26.131799 (+    49us) write_op.cc:435] Acquired schema lock
0709 14:53:26.131821 (+    22us) tablet.cc:662] Decoding operations
0709 14:53:26.132785 (+   964us) write_op.cc:620] Acquiring the partition lock for write op
0709 14:53:26.132907 (+   122us) write_op.cc:641] Partition lock acquired for write op
0709 14:53:26.132933 (+    26us) tablet.cc:685] Acquiring locks for 6 operations
0709 14:53:26.188709 (+ 55776us) tablet.cc:701] Row locks acquired
0709 14:53:26.190820 (+  2111us) write_op.cc:260] PREPARE: finished
0709 14:53:26.204692 (+ 13872us) write_op.cc:270] Start()
0709 14:53:26.217374 (+ 12682us) write_op.cc:276] Timestamp: P: 1783608806200126 usec, L: 0
0709 14:53:26.223958 (+  6584us) op_driver.cc:348] REPLICATION: starting
0709 14:53:26.291603 (+ 67645us) log.cc:844] Serialized 2460 byte log entry
0709 14:53:27.754940 (+1463337us) spinlock_profiling.cc:243] Waited 26.3 ms on lock 0x7b4400022b4c. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb687c29db1 00007fb687cc7c85 00007fb687cc86a2 00007fb68aa3a1db 00007fb68aa35aaf 00007fb687d840ac 00007fb690bdeab9 00007fb687da069b 00007fb687d9e93f 00007fb687da0c02 00007fb68aa2820b
0709 14:53:28.948577 (+1193637us) op_driver.cc:464] REPLICATION: finished
0709 14:53:29.220147 (+271570us) write_op.cc:301] APPLY: starting
0709 14:53:29.226904 (+  6757us) tablet.cc:1367] starting BulkCheckPresence
0709 14:53:29.645711 (+418807us) tablet.cc:1370] finished BulkCheckPresence
0709 14:53:29.645748 (+    37us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 14:53:31.013853 (+1368105us) spinlock_profiling.cc:243] Waited 1.24 ms on lock 0x7b18001229e0. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb690c69de1 00007fb690c765b1 00007fb68abcd0ec 00007fb68abcfaf7 00007fb68abd0fb0 00007fb68e8e51bb 00007fb68e92c5d4 00007fb68e7d88da 00007fb68e7db3cb 00007fb68e7dafd3 00007fb68e8d9e34
0709 14:53:31.016249 (+  2396us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 14:53:31.016508 (+   259us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=12,key_file_lookups=12,delta_file_lookups=12,mrs_lookups=0
0709 14:53:31.016562 (+    54us) write_op.cc:312] APPLY: finished
0709 14:53:31.016901 (+   339us) log.cc:844] Serialized 65 byte log entry
0709 14:53:31.114944 (+ 98043us) write_op.cc:489] Releasing partition, row and schema locks
0709 14:53:31.139090 (+ 24146us) write_op.cc:454] Released schema lock
0709 14:53:31.149488 (+ 10398us) write_op.cc:341] FINISH: Updating metrics
0709 14:53:31.185660 (+ 36172us) write_op.cc:489] Releasing partition, row and schema locks
0709 14:53:31.204705 (+ 19045us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":11824,"reported_tablets":44,"child_traces":[["op",{"apply.queue_time_us":246923,"apply.run_cpu_time_us":54077,"apply.run_wall_time_us":1969054,"cfile_cache_hit":26,"cfile_cache_hit_bytes":29135,"num_ops":6,"prepare.queue_time_us":278869,"prepare.run_cpu_time_us":90257,"prepare.run_wall_time_us":2155085,"raft.queue_time_us":550436,"raft.run_cpu_time_us":21987,"raft.run_wall_time_us":196899,"replication_time_us":2724395,"spinlock_wait_cycles":63257216,"thread_start_us":2815571,"threads_started":5,"wal-append.queue_time_us":2150669,"wal-append.run_cpu_time_us":49734,"wal-append.run_wall_time_us":1486703}]]}
I20260709 14:53:32.116387  7819 leader_election.cc:304] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:32.116387  7920 raft_consensus.cc:2468] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 24.
I20260709 14:53:32.124277  7926 raft_consensus.cc:1275] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 14:53:32.121716 14162 consensus_queue.cc:1059] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.008s
I20260709 14:53:32.128746  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:32.128157  7745 leader_election.cc:304] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:32.129700  7919 raft_consensus.cc:3060] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Advancing to term 21
I20260709 14:53:32.129408 14162 raft_consensus.cc:3055] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 LEADER]: Stepping down as leader of term 20
I20260709 14:53:32.136360 14245 raft_consensus.cc:2804] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Leader election won for term 19
I20260709 14:53:32.142584  7819 leader_election.cc:304] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:32.132855 14071 raft_consensus.cc:2749] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 14:53:32.133077 14162 raft_consensus.cc:740] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:53:32.147542  7819 leader_election.cc:304] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:32.149756  7894 leader_election.cc:304] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:32.157827  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:32.153786  7819 leader_election.cc:304] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:32.166056  7894 leader_election.cc:304] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:32.141884 14208 leader_election.cc:290] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 20 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:53:32.164425  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 44102.4us
I20260709 14:53:32.164814  7819 leader_election.cc:304] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:32.153354 14236 raft_consensus.cc:2804] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 14:53:32.175930  7893 leader_election.cc:304] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:32.161165 14071 raft_consensus.cc:2804] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 14:53:32.164285 14276 raft_consensus.cc:2804] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 14:53:32.180424 14276 raft_consensus.cc:493] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:32.183648 14276 raft_consensus.cc:3060] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Advancing to term 22
I20260709 14:53:32.171612 14296 raft_consensus.cc:2804] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 14:53:32.172048 14211 raft_consensus.cc:2804] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 14:53:32.189730  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:32.190042  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:32.174415 14236 raft_consensus.cc:493] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:32.197949  7852 raft_consensus.cc:2368] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 20. Current term is 21.
I20260709 14:53:32.198408 14173 raft_consensus.cc:2804] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 14:53:32.197197  7853 raft_consensus.cc:3060] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Advancing to term 20
I20260709 14:53:32.199120 14230 leader_election.cc:290] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:32.179258 14238 leader_election.cc:290] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 20 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:32.178937 14071 raft_consensus.cc:493] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Starting leader election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:53:32.186825 14220 leader_election.cc:290] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 25 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:32.216595 14162 consensus_queue.cc:260] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:32.196666 14292 raft_consensus.cc:493] T 9ce9c0ef2db24c13a8b1402f21819458 P 9418391fa82a42c79c6cad13ba91d964 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:32.194700 14296 raft_consensus.cc:493] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:32.205699 14173 raft_consensus.cc:493] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:32.207576 14236 raft_consensus.cc:3060] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Advancing to term 15
I20260709 14:53:32.204087 14211 raft_consensus.cc:493] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:32.246239  7894 leader_election.cc:400] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 20 election: Vote denied by peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529) with higher term. Message: Invalid argument: T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 20. Current term is 21.
W20260709 14:53:32.252161  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 87472.3us
I20260709 14:53:32.252079  7894 leader_election.cc:403] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 20 election: Cancelling election due to peer responding with higher term
I20260709 14:53:32.220052 14071 raft_consensus.cc:3060] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Advancing to term 21
I20260709 14:53:32.253489  7819 leader_election.cc:304] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:32.259572  7919 raft_consensus.cc:2468] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 21.
I20260709 14:53:32.210116 14245 raft_consensus.cc:697] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:53:32.242853 14296 raft_consensus.cc:3060] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 14:53:32.245924 14173 raft_consensus.cc:3060] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Advancing to term 20
I20260709 14:53:32.269860 13835 raft_consensus.cc:2749] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Leader election lost for term 20. Reason: Vote denied by peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529) with higher term. Message: Invalid argument: T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 20. Current term is 21.
I20260709 14:53:32.276305 14306 consensus_queue.cc:1048] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.014s
I20260709 14:53:32.251952 14295 raft_consensus.cc:2804] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 22 FOLLOWER]: Leader election won for term 22
W20260709 14:53:32.277627  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:32.277786 14295 raft_consensus.cc:697] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 22 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:32.279028 14295 consensus_queue.cc:237] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:32.256063 14211 raft_consensus.cc:3060] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Advancing to term 22
W20260709 14:53:32.276738  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 124268us
I20260709 14:53:32.287568  7819 leader_election.cc:304] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:32.291460 14162 raft_consensus.cc:3060] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Advancing to term 21
I20260709 14:53:32.299403 14276 raft_consensus.cc:515] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:32.302870 14276 leader_election.cc:290] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 22 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:53:32.304478 14303 log.cc:927] Time spent T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.158s	user 0.000s	sys 0.001s
W20260709 14:53:32.318213 14305 log.cc:927] Time spent T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.103s	user 0.000s	sys 0.004s
I20260709 14:53:32.253361 14292 raft_consensus.cc:515] T 9ce9c0ef2db24c13a8b1402f21819458 P 9418391fa82a42c79c6cad13ba91d964 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:53:32.334131 14313 raft_consensus.cc:2804] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 14:53:32.334692 14313 raft_consensus.cc:493] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:32.335068 14313 raft_consensus.cc:3060] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Advancing to term 16
I20260709 14:53:32.338070  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:32.339035  7919 raft_consensus.cc:2368] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 19. Current term is 20.
I20260709 14:53:32.339372  7853 raft_consensus.cc:2468] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 20.
W20260709 14:53:32.342432  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 54971.3us
I20260709 14:53:32.346351  7922 raft_consensus.cc:2468] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 20.
I20260709 14:53:32.349627 14276 raft_consensus.cc:2804] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 14:53:32.350317 14276 raft_consensus.cc:493] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:32.350445  7920 raft_consensus.cc:1275] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 14:53:32.350900  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:32.352774 14276 raft_consensus.cc:3060] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 24 FOLLOWER]: Advancing to term 25
I20260709 14:53:32.361047  7921 raft_consensus.cc:2468] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 19.
I20260709 14:53:32.360560  7894 leader_election.cc:304] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
W20260709 14:53:32.367317  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 190227us
I20260709 14:53:32.372886 14245 consensus_queue.cc:237] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:32.375501  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:32.383773  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:32.386060 14081 raft_consensus.cc:493] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:53:32.387362  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:32.387146 14081 raft_consensus.cc:515] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:32.388404 14056 raft_consensus.cc:493] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:32.389233 14056 raft_consensus.cc:515] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:32.391501 14292 leader_election.cc:290] T 9ce9c0ef2db24c13a8b1402f21819458 P 9418391fa82a42c79c6cad13ba91d964 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:32.370674 14291 raft_consensus.cc:2804] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 14:53:32.394625 14291 raft_consensus.cc:697] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:32.396059 14291 consensus_queue.cc:237] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:32.385236  7923 raft_consensus.cc:2368] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 19. Current term is 20.
I20260709 14:53:32.398936  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: true dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:32.398985  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:32.400130  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:32.404402  7924 raft_consensus.cc:2468] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 17.
I20260709 14:53:32.399880  7920 raft_consensus.cc:2376] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 15. Re-sending same reply.
I20260709 14:53:32.409808  7745 leader_election.cc:304] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
W20260709 14:53:32.412984  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 66929.4us
I20260709 14:53:32.415971  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce9c0ef2db24c13a8b1402f21819458" candidate_uuid: "9418391fa82a42c79c6cad13ba91d964" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:32.416937  7923 raft_consensus.cc:2468] T 9ce9c0ef2db24c13a8b1402f21819458 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9418391fa82a42c79c6cad13ba91d964 in term 3.
I20260709 14:53:32.417353 13955 raft_consensus.cc:493] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:32.417955 13955 raft_consensus.cc:515] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:32.420328 13955 leader_election.cc:290] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:32.421051 14176 consensus_queue.cc:1048] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 14:53:32.427717  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 47021.2us
I20260709 14:53:32.430372  7745 leader_election.cc:304] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 3876b8ee8d744cb18e91d97aae93b1ac, 9418391fa82a42c79c6cad13ba91d964
W20260709 14:53:32.431739  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:32.433234  8598 leader_election.cc:304] T 9ce9c0ef2db24c13a8b1402f21819458 P 9418391fa82a42c79c6cad13ba91d964 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 9418391fa82a42c79c6cad13ba91d964; no voters: 
I20260709 14:53:32.433705  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:32.433991 14296 raft_consensus.cc:515] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:32.434671  7923 raft_consensus.cc:2468] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 20.
I20260709 14:53:32.435075 14306 raft_consensus.cc:2749] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 14:53:32.435464 14081 leader_election.cc:290] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:32.435918 14292 raft_consensus.cc:2804] T 9ce9c0ef2db24c13a8b1402f21819458 P 9418391fa82a42c79c6cad13ba91d964 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 14:53:32.436580 14292 raft_consensus.cc:493] T 9ce9c0ef2db24c13a8b1402f21819458 P 9418391fa82a42c79c6cad13ba91d964 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:32.437151 14292 raft_consensus.cc:3060] T 9ce9c0ef2db24c13a8b1402f21819458 P 9418391fa82a42c79c6cad13ba91d964 [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:53:32.437341  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:32.439522 14056 leader_election.cc:290] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:32.440366 14071 raft_consensus.cc:515] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:32.441524  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:32.434402 13955 raft_consensus.cc:2804] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Leader election won for term 19
I20260709 14:53:32.444988  7745 leader_election.cc:304] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:32.455534  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:32.458667 14236 raft_consensus.cc:515] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:32.465837  7922 raft_consensus.cc:2393] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 14: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:53:32.467078 14296 leader_election.cc:290] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:32.468708  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:32.469707  7847 raft_consensus.cc:2368] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 14. Current term is 15.
I20260709 14:53:32.471520  7894 leader_election.cc:400] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 election: Vote denied by peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529) with higher term. Message: Invalid argument: T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 14. Current term is 15.
I20260709 14:53:32.472052  7894 leader_election.cc:403] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 14:53:32.473001 14296 raft_consensus.cc:3060] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 14:53:32.482013 14071 leader_election.cc:290] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 21 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:32.483171 14296 raft_consensus.cc:2749] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529) with higher term. Message: Invalid argument: T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 14. Current term is 15.
I20260709 14:53:32.485630  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce9c0ef2db24c13a8b1402f21819458" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:32.486603  7920 raft_consensus.cc:2393] T 9ce9c0ef2db24c13a8b1402f21819458 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 3: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:53:32.487273  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:32.487980  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:32.488332  7919 raft_consensus.cc:2410] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for term 21 because replica has last-logged OpId of term: 20 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 13.
I20260709 14:53:32.488986  7924 raft_consensus.cc:2410] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for term 19 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 14:53:32.489603  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: true dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:32.486402  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:32.490433  7921 raft_consensus.cc:2376] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 15. Re-sending same reply.
I20260709 14:53:32.493690 14173 raft_consensus.cc:515] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:32.499892  7923 raft_consensus.cc:1240] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 20. Current term is 21. Ops: [20.12-20.12]
I20260709 14:53:32.504688 14313 raft_consensus.cc:515] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:32.515087  7853 raft_consensus.cc:1275] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 22 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 12. (term mismatch)
I20260709 14:53:32.515561  7853 pending_rounds.cc:85] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting all ops after (but not including) 11
I20260709 14:53:32.515820  7853 pending_rounds.cc:107] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting uncommitted NO_OP operation due to leader change: 20.12
I20260709 14:53:32.516109  7853 raft_consensus.cc:2889] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:53:32.518289 14056 consensus_queue.cc:1048] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 14:53:32.500118 14173 leader_election.cc:290] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 20 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:53:32.523604  7893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:53:32.530433  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 85527.8us
I20260709 14:53:32.531275  7745 leader_election.cc:304] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
W20260709 14:53:32.533372  7742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:32.508718 14276 raft_consensus.cc:515] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:32.540758 14236 leader_election.cc:290] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:32.540663 14220 raft_consensus.cc:2804] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 23 FOLLOWER]: Leader pre-election won for term 24
W20260709 14:53:32.546864  7745 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:32.549752 14306 raft_consensus.cc:493] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:32.550330 14245 raft_consensus.cc:493] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:32.551106 14245 raft_consensus.cc:515] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:32.551959 14220 raft_consensus.cc:493] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 23 FOLLOWER]: Starting leader election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:32.552489 14220 raft_consensus.cc:3060] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 23 FOLLOWER]: Advancing to term 24
I20260709 14:53:32.535966 13955 raft_consensus.cc:697] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:53:32.555599 14245 leader_election.cc:290] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:32.550518 14306 raft_consensus.cc:515] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:32.556774 13955 consensus_queue.cc:237] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:32.559119 14306 leader_election.cc:290] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:32.560273 14310 raft_consensus.cc:493] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
W20260709 14:53:32.561882  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 138714us
I20260709 14:53:32.540983 14162 raft_consensus.cc:2804] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 14:53:32.571094  7819 leader_election.cc:304] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:32.577158  7819 leader_election.cc:304] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:32.582209 14311 raft_consensus.cc:2804] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Leader election won for term 20
I20260709 14:53:32.583088 14311 raft_consensus.cc:697] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:53:32.586265 14306 raft_consensus.cc:493] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:32.581421 14236 raft_consensus.cc:2804] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Leader election won for term 21
I20260709 14:53:32.587221 14306 raft_consensus.cc:515] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:53:32.588198  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:32.574156 14162 raft_consensus.cc:493] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:32.589074 14162 raft_consensus.cc:3060] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 22 FOLLOWER]: Advancing to term 23
I20260709 14:53:32.589716 14276 leader_election.cc:290] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 25 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:32.590034  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:32.590662  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:32.561298 14310 raft_consensus.cc:515] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:32.588070 14236 raft_consensus.cc:697] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:53:32.592084 14236 consensus_queue.cc:237] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:32.593178 14310 leader_election.cc:290] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:32.593766  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:32.594511  7922 raft_consensus.cc:2468] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 23.
I20260709 14:53:32.590917  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:32.582289  7819 leader_election.cc:304] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:32.596692  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:32.597733  7922 raft_consensus.cc:2393] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 24: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:53:32.594901  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:32.601589  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:32.592634 14292 raft_consensus.cc:515] T 9ce9c0ef2db24c13a8b1402f21819458 P 9418391fa82a42c79c6cad13ba91d964 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:53:32.608161 14292 leader_election.cc:290] T 9ce9c0ef2db24c13a8b1402f21819458 P 9418391fa82a42c79c6cad13ba91d964 [CANDIDATE]: Term 4 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:32.610392  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce9c0ef2db24c13a8b1402f21819458" candidate_uuid: "9418391fa82a42c79c6cad13ba91d964" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:32.611205  7922 raft_consensus.cc:3060] T 9ce9c0ef2db24c13a8b1402f21819458 P 1e9289592458429bbddb19c2e7b7b7b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:53:32.618723  7921 raft_consensus.cc:2410] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for term 21 because replica has last-logged OpId of term: 20 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
I20260709 14:53:32.628592  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:32.632323  7922 raft_consensus.cc:2468] T 9ce9c0ef2db24c13a8b1402f21819458 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9418391fa82a42c79c6cad13ba91d964 in term 4.
I20260709 14:53:32.621429 14276 raft_consensus.cc:2804] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Leader election won for term 19
I20260709 14:53:32.634486  7919 raft_consensus.cc:1275] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 14:53:32.635982  8598 leader_election.cc:304] T 9ce9c0ef2db24c13a8b1402f21819458 P 9418391fa82a42c79c6cad13ba91d964 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 9418391fa82a42c79c6cad13ba91d964; no voters: 
I20260709 14:53:32.584349 14081 consensus_queue.cc:1059] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.047s
I20260709 14:53:32.645080  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:32.646181  7921 raft_consensus.cc:3060] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Advancing to term 20
I20260709 14:53:32.647818  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:32.648531  7919 raft_consensus.cc:3060] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 24 FOLLOWER]: Advancing to term 25
I20260709 14:53:32.651731  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:32.652494  7774 raft_consensus.cc:2468] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 18.
I20260709 14:53:32.654475 14173 raft_consensus.cc:493] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:32.655310 14173 raft_consensus.cc:515] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:32.654560  7923 raft_consensus.cc:2468] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 16.
I20260709 14:53:32.659662 14295 raft_consensus.cc:493] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:32.660326 14295 raft_consensus.cc:515] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:32.661703  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:32.661998 14173 leader_election.cc:290] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:32.662473 14306 leader_election.cc:290] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:32.663537  7919 raft_consensus.cc:2468] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 25.
I20260709 14:53:32.660765 14319 raft_consensus.cc:493] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:32.667788  7925 raft_consensus.cc:3060] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Advancing to term 21
I20260709 14:53:32.637416 14311 consensus_queue.cc:237] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:32.679122  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:32.680123  7776 raft_consensus.cc:2393] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 20: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:53:32.681504 14071 raft_consensus.cc:493] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:32.682236 14071 raft_consensus.cc:515] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:32.682497 14322 raft_consensus.cc:493] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:32.683288 14322 raft_consensus.cc:515] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:32.648561 14292 raft_consensus.cc:2804] T 9ce9c0ef2db24c13a8b1402f21819458 P 9418391fa82a42c79c6cad13ba91d964 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 14:53:32.685577 14071 leader_election.cc:290] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:32.683416 14055 raft_consensus.cc:493] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:32.686795 14055 raft_consensus.cc:515] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:53:32.688874  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:32.689196 14055 leader_election.cc:290] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:32.689790 14313 leader_election.cc:290] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 16 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:32.650703 14276 raft_consensus.cc:697] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:53:32.692801 14276 consensus_queue.cc:237] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:32.688910  7925 raft_consensus.cc:2468] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 21.
I20260709 14:53:32.686002 14292 raft_consensus.cc:697] T 9ce9c0ef2db24c13a8b1402f21819458 P 9418391fa82a42c79c6cad13ba91d964 [term 4 LEADER]: Becoming Leader. State: Replica: 9418391fa82a42c79c6cad13ba91d964, State: Running, Role: LEADER
I20260709 14:53:32.697956 14292 consensus_queue.cc:237] T 9ce9c0ef2db24c13a8b1402f21819458 P 9418391fa82a42c79c6cad13ba91d964 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:53:32.701383 14319 raft_consensus.cc:515] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:32.704458 14319 leader_election.cc:290] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:32.706894  7921 raft_consensus.cc:2468] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 20.
W20260709 14:53:32.722757  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 82453.7us
I20260709 14:53:32.719591 14319 raft_consensus.cc:493] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:32.728190 14319 raft_consensus.cc:515] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:32.731141  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:32.734591  7853 raft_consensus.cc:1240] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 14:53:32.732395  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:32.716899 14211 raft_consensus.cc:515] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:32.724406 14296 raft_consensus.cc:493] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:32.744848  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:32.750093  7845 raft_consensus.cc:3060] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 23 FOLLOWER]: Advancing to term 25
I20260709 14:53:32.743228  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:32.751410  7853 raft_consensus.cc:2393] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 22: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:53:32.752498  7926 raft_consensus.cc:1240] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 22 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 21. Current term is 22. Ops: []
I20260709 14:53:32.754032  7847 raft_consensus.cc:1240] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 22 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 21. Current term is 22. Ops: [21.14-21.14]
I20260709 14:53:32.753806 14220 raft_consensus.cc:515] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:32.754956 14211 leader_election.cc:290] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 22 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:32.756281 14295 leader_election.cc:290] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:32.758317  7854 raft_consensus.cc:1240] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 20. Current term is 21. Ops: []
I20260709 14:53:32.758373  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:32.763716  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:32.764472  7853 raft_consensus.cc:2393] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 18: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:53:32.761504  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:32.734469 14162 raft_consensus.cc:515] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:32.765787  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c563cc7cfbe4d59be4ffc5cf847ce56" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:32.767630  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:32.768700  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:32.770928  7770 raft_consensus.cc:2468] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 19.
I20260709 14:53:32.763873 14296 raft_consensus.cc:515] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:32.795599  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:32.772373  7849 raft_consensus.cc:2368] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 24. Current term is 25.
I20260709 14:53:32.766229 14306 raft_consensus.cc:493] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
W20260709 14:53:32.843168  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:32.846575  7776 raft_consensus.cc:1240] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 19. Current term is 20. Ops: []
I20260709 14:53:32.848563  7854 raft_consensus.cc:2393] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 20: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
W20260709 14:53:32.849422  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:32.851402  7770 raft_consensus.cc:1240] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 17. Current term is 18. Ops: [17.9-17.9]
I20260709 14:53:32.850633  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:32.852723  7777 raft_consensus.cc:1240] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 23 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 22. Current term is 23. Ops: [22.15-22.15]
I20260709 14:53:32.855983 14319 leader_election.cc:290] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:53:32.858779 14324 log.cc:927] Time spent T 00000000000000000000000000000000 P 133636659113430cb53b321cb0b1d9ee: Append to log took a long time: real 0.086s	user 0.003s	sys 0.000s
I20260709 14:53:32.860767 14310 consensus_queue.cc:1059] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 14:53:32.861963 14310 raft_consensus.cc:3055] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 LEADER]: Stepping down as leader of term 15
I20260709 14:53:32.862337 14310 raft_consensus.cc:740] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:53:32.863340 14310 consensus_queue.cc:260] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:32.865005 14310 raft_consensus.cc:3060] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Advancing to term 16
I20260709 14:53:32.846128 14244 raft_consensus.cc:493] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:53:32.849056 14303 log.cc:927] Time spent T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 14:53:32.853396  7778 raft_consensus.cc:2468] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 14.
I20260709 14:53:32.873409 14307 consensus_queue.cc:1059] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 14:53:32.846761 13955 raft_consensus.cc:493] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:32.848431 14220 leader_election.cc:290] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 24 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:32.884205  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:32.884990 14307 raft_consensus.cc:3055] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 LEADER]: Stepping down as leader of term 21
I20260709 14:53:32.885665 14307 raft_consensus.cc:740] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:53:32.884240 13955 raft_consensus.cc:515] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:32.887020  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:32.888091  7779 raft_consensus.cc:2393] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 14: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:53:32.890295  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:32.877077 14244 raft_consensus.cc:515] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:32.886538 14220 consensus_queue.cc:1059] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 14:53:32.892005  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783e4874513449ef9084b833f188a6d3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:32.892503 14220 raft_consensus.cc:3055] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 LEADER]: Stepping down as leader of term 20
I20260709 14:53:32.893131 14220 raft_consensus.cc:740] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:53:32.899494 14244 leader_election.cc:290] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:32.878780  7845 raft_consensus.cc:2468] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 25.
W20260709 14:53:32.913810 14329 log.cc:927] Time spent T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.058s	user 0.000s	sys 0.002s
W20260709 14:53:32.913901 14325 log.cc:927] Time spent T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
W20260709 14:53:32.925846 14330 log.cc:927] Time spent T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.063s	user 0.000s	sys 0.002s
I20260709 14:53:32.930490  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:32.931802  7845 raft_consensus.cc:2393] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 22: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
W20260709 14:53:32.931943 14326 log.cc:927] Time spent T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.084s	user 0.002s	sys 0.000s
I20260709 14:53:32.939402  7922 raft_consensus.cc:2468] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 15.
W20260709 14:53:32.940857  7742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:32.941687  7852 raft_consensus.cc:1240] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 19. Current term is 20. Ops: [19.13-19.13]
I20260709 14:53:32.935441  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:32.945921  7770 raft_consensus.cc:2468] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 18.
I20260709 14:53:32.948936  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:32.949569  7926 raft_consensus.cc:3060] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 14:53:32.950304  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:32.951205  7924 raft_consensus.cc:2468] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 15.
I20260709 14:53:32.951603  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:32.952247  7851 raft_consensus.cc:2468] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 20.
I20260709 14:53:32.952961  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:32.953562  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:32.952247  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:32.954567  7921 raft_consensus.cc:2468] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 17.
I20260709 14:53:32.954608  7920 raft_consensus.cc:2468] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 17.
I20260709 14:53:32.956954  7845 raft_consensus.cc:2468] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 16.
I20260709 14:53:32.958390  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:32.959239  6549 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 14:53:32.959667  7848 raft_consensus.cc:1275] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 22 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 14:53:32.962749  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:32.963551  7919 raft_consensus.cc:2468] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 20.
I20260709 14:53:32.960464  7819 leader_election.cc:304] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:32.909786 14306 raft_consensus.cc:515] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:32.948624 14291 raft_consensus.cc:3055] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 14:53:32.968818  7925 raft_consensus.cc:2468] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 21.
I20260709 14:53:32.966313  7819 leader_election.cc:304] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:32.947808 14236 raft_consensus.cc:493] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:32.979856  7848 raft_consensus.cc:1275] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 14:53:32.979024  7819 leader_election.cc:304] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:32.970644 14313 raft_consensus.cc:2804] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 25 FOLLOWER]: Leader election won for term 25
I20260709 14:53:32.965049 14176 consensus_queue.cc:1048] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.024s
I20260709 14:53:32.988413 14230 raft_consensus.cc:493] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:32.983549 14071 raft_consensus.cc:2804] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Leader election won for term 21
I20260709 14:53:33.016120  7926 raft_consensus.cc:2468] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 16.
I20260709 14:53:32.978014 14291 raft_consensus.cc:740] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:32.984748 14173 raft_consensus.cc:2804] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Leader election won for term 20
I20260709 14:53:33.032634 14230 raft_consensus.cc:515] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:33.035802 14230 leader_election.cc:290] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:33.036360  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:33.036588  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:33.037431  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:33.037842  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:33.038098  7777 raft_consensus.cc:2410] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for term 20 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
I20260709 14:53:33.003968 14322 leader_election.cc:290] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:33.039033  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:33.040149  7778 raft_consensus.cc:2393] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 14: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:53:33.041841  7776 raft_consensus.cc:1275] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 22 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 14:53:33.038538  7779 raft_consensus.cc:2468] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 17.
I20260709 14:53:33.003955 14236 raft_consensus.cc:515] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:33.045677 14236 leader_election.cc:290] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:33.015432 14313 raft_consensus.cc:697] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 25 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:53:33.047631 14313 consensus_queue.cc:237] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:33.050007  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:33.051144  7770 raft_consensus.cc:2393] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 20: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:53:33.053059 14162 leader_election.cc:290] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 23 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:53:33.058871  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:33.056684  7894 leader_election.cc:304] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:33.070245  7894 leader_election.cc:304] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:33.070925 14295 raft_consensus.cc:2804] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 14:53:33.071169  7779 raft_consensus.cc:1240] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Rejecting Update request from peer 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 18. Current term is 19. Ops: []
I20260709 14:53:33.071960 14081 raft_consensus.cc:2804] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 14:53:33.072400 14081 raft_consensus.cc:493] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:33.073048 14295 raft_consensus.cc:493] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 14:53:33.067778  7893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:33.072481  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:33.073398  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:33.072994  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
W20260709 14:53:33.072808  7745 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:33.072845 14081 raft_consensus.cc:3060] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 14:53:33.038331  7772 raft_consensus.cc:2468] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 18.
I20260709 14:53:33.073738 14088 consensus_queue.cc:1048] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.003s
I20260709 14:53:33.076547  7776 raft_consensus.cc:2468] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 16.
I20260709 14:53:33.077728 14307 consensus_queue.cc:260] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:33.073561 14244 consensus_queue.cc:1048] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.005s
I20260709 14:53:33.076177  7778 raft_consensus.cc:1275] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 22 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
W20260709 14:53:33.084367  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:33.084637  7745 leader_election.cc:400] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 24 election: Vote denied by peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529) with higher term. Message: Invalid argument: T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 24. Current term is 25.
I20260709 14:53:33.088395 14220 consensus_queue.cc:260] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:33.073496 14295 raft_consensus.cc:3060] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Advancing to term 22
I20260709 14:53:33.099097  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:33.100109  7779 raft_consensus.cc:2468] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 21.
I20260709 14:53:33.097965  7745 leader_election.cc:403] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 24 election: Cancelling election due to peer responding with higher term
I20260709 14:53:33.108160  7673 catalog_manager.cc:5697] T 9ce9c0ef2db24c13a8b1402f21819458 P 9418391fa82a42c79c6cad13ba91d964 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "9418391fa82a42c79c6cad13ba91d964" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 14:53:33.073817 14071 raft_consensus.cc:697] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:53:33.115942  7778 raft_consensus.cc:3055] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 LEADER]: Stepping down as leader of term 19
I20260709 14:53:33.111490 14173 raft_consensus.cc:697] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:53:33.130105  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:33.131321  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce9c0ef2db24c13a8b1402f21819458" candidate_uuid: "9418391fa82a42c79c6cad13ba91d964" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:33.122120 14220 raft_consensus.cc:3060] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Advancing to term 21
I20260709 14:53:33.130726  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:33.124325  7778 raft_consensus.cc:740] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:53:33.134502  7776 raft_consensus.cc:3060] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Advancing to term 22
I20260709 14:53:33.123447 14307 raft_consensus.cc:3060] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Advancing to term 22
I20260709 14:53:33.125141 14291 consensus_queue.cc:260] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:33.126013 14306 leader_election.cc:290] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:33.127158 13955 leader_election.cc:290] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:33.129669  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:33.129892 14296 leader_election.cc:290] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:33.132432  7777 raft_consensus.cc:2468] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 21.
W20260709 14:53:33.144052  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 59544.4us
I20260709 14:53:33.146718  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce9c0ef2db24c13a8b1402f21819458" candidate_uuid: "9418391fa82a42c79c6cad13ba91d964" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:33.142688  7772 raft_consensus.cc:2468] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9418391fa82a42c79c6cad13ba91d964 in term 2.
I20260709 14:53:33.152029  7851 raft_consensus.cc:2468] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 22.
I20260709 14:53:33.153538 14173 consensus_queue.cc:237] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:33.153012  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:33.135038  7778 consensus_queue.cc:260] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:53:33.161047  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 179039us
I20260709 14:53:33.162395  7778 raft_consensus.cc:3060] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Advancing to term 20
I20260709 14:53:33.171033  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:33.159639 14306 raft_consensus.cc:3060] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 24 FOLLOWER]: Advancing to term 25
I20260709 14:53:33.185304 14071 consensus_queue.cc:237] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:33.199693  7819 leader_election.cc:304] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:33.206413  7894 leader_election.cc:304] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:33.221104  7819 leader_election.cc:304] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:33.206466 14291 raft_consensus.cc:3060] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Advancing to term 19
I20260709 14:53:33.210558 14296 raft_consensus.cc:2804] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 14:53:33.227713  7773 raft_consensus.cc:2468] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 21.
W20260709 14:53:33.232709  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 73633.6us
I20260709 14:53:33.254602  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:33.258401  7772 raft_consensus.cc:2468] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 14.
I20260709 14:53:33.266690 14056 raft_consensus.cc:493] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:33.267298 14056 raft_consensus.cc:515] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:53:33.268760  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:33.270191  7819 leader_election.cc:304] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:33.271062  7819 leader_election.cc:304] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:33.271790  7819 leader_election.cc:304] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:33.272276 14347 raft_consensus.cc:2804] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 14:53:33.272964 14347 raft_consensus.cc:493] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:33.273481 14347 raft_consensus.cc:3060] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Advancing to term 17
I20260709 14:53:33.274971 14350 raft_consensus.cc:2804] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 14:53:33.275015  7819 leader_election.cc:304] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:33.276263 14350 raft_consensus.cc:493] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:33.277079 14350 raft_consensus.cc:3060] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Advancing to term 17
I20260709 14:53:33.287587  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:33.288539  7773 raft_consensus.cc:2393] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 22: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:53:33.230786 14296 raft_consensus.cc:493] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:33.289285  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:33.288679  7777 raft_consensus.cc:3060] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Advancing to term 22
I20260709 14:53:33.296100  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:33.229979 14311 raft_consensus.cc:493] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:33.245477 14244 raft_consensus.cc:493] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:33.306035  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:33.246299 14055 raft_consensus.cc:2804] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 14:53:33.306830  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:33.256973 13835 raft_consensus.cc:493] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:33.231024 14341 raft_consensus.cc:2804] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Leader election won for term 15
I20260709 14:53:33.314779  7779 raft_consensus.cc:2468] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 18.
I20260709 14:53:33.304517 14296 raft_consensus.cc:3060] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 22 FOLLOWER]: Advancing to term 23
W20260709 14:53:33.320009  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 45109.2us
W20260709 14:53:33.322954  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:53:33.357460  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:33.357380  7819 leader_election.cc:304] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:33.310648 14055 raft_consensus.cc:493] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:33.358433 14055 raft_consensus.cc:3060] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Advancing to term 15
I20260709 14:53:33.358721 14351 raft_consensus.cc:2804] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 14:53:33.359526 14351 raft_consensus.cc:493] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:33.359962 14351 raft_consensus.cc:3060] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Advancing to term 20
I20260709 14:53:33.303488 14056 leader_election.cc:290] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:33.304080 14088 raft_consensus.cc:493] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:33.361761 14088 raft_consensus.cc:515] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:33.364387 14088 leader_election.cc:290] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:33.373613  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 17 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:33.374900  7779 raft_consensus.cc:2410] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for term 17 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 14:53:33.374439 14350 raft_consensus.cc:515] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:33.316275 13835 raft_consensus.cc:515] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:53:33.379309  7742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:33.380085 13835 leader_election.cc:290] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:33.312485 14244 raft_consensus.cc:515] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:33.382681 14088 raft_consensus.cc:493] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:33.385862 14088 raft_consensus.cc:515] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:33.361389  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:33.387171 14244 leader_election.cc:290] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:33.387351  7775 raft_consensus.cc:2468] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 19.
W20260709 14:53:33.388218  7742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:33.388444 14088 leader_election.cc:290] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:33.310765 14311 raft_consensus.cc:515] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:33.390933 14311 leader_election.cc:290] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:33.350005 14341 raft_consensus.cc:697] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:53:33.348812 14081 raft_consensus.cc:515] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:33.385076 14350 leader_election.cc:290] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 17 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:33.399252 14081 leader_election.cc:290] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 17 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:33.306242 14295 raft_consensus.cc:515] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:33.401657  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:33.395566 14341 consensus_queue.cc:237] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:33.460647  7778 raft_consensus.cc:1275] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 13. (term mismatch)
I20260709 14:53:33.461216  7778 pending_rounds.cc:85] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed: Aborting all ops after (but not including) 12
I20260709 14:53:33.461614  7778 pending_rounds.cc:107] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed: Aborting uncommitted NO_OP operation due to leader change: 19.13
I20260709 14:53:33.462070  7778 raft_consensus.cc:2889] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:53:33.443463 14351 raft_consensus.cc:515] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:33.459746  7776 raft_consensus.cc:2468] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 22.
I20260709 14:53:33.460888  7770 raft_consensus.cc:2393] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 21: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:53:33.468688  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:33.469903  7778 raft_consensus.cc:2368] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 24. Current term is 25.
W20260709 14:53:33.477370  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:33.481535  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:33.482300  7775 raft_consensus.cc:2468] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 20.
I20260709 14:53:33.458840  7675 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54344 (request call id 381) took 7573 ms. Trace:
W20260709 14:53:33.486896  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 129632us
I20260709 14:53:33.496588  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:33.497510  7925 raft_consensus.cc:2468] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 23.
I20260709 14:53:33.500223  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:33.501626  7776 raft_consensus.cc:2393] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 23: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:53:33.497185  7745 leader_election.cc:304] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:33.487502  7675 rpcz_store.cc:276] 0709 14:53:25.885776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:53:25.887720 (+  1944us) service_pool.cc:224] Handling call
0709 14:53:33.458671 (+7570951us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 14:53:32.454736 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 14:53:32.503454 (+ 48718us) write_op.cc:432] Acquiring schema lock in shared mode
0709 14:53:32.503525 (+    71us) write_op.cc:435] Acquired schema lock
0709 14:53:32.503551 (+    26us) tablet.cc:662] Decoding operations
0709 14:53:32.505319 (+  1768us) write_op.cc:620] Acquiring the partition lock for write op
0709 14:53:32.505460 (+   141us) write_op.cc:641] Partition lock acquired for write op
0709 14:53:32.505496 (+    36us) tablet.cc:685] Acquiring locks for 13 operations
0709 14:53:32.507235 (+  1739us) tablet.cc:701] Row locks acquired
0709 14:53:32.507299 (+    64us) write_op.cc:260] PREPARE: finished
0709 14:53:32.507584 (+   285us) write_op.cc:270] Start()
0709 14:53:32.524026 (+ 16442us) write_op.cc:276] Timestamp: P: 1783608812507481 usec, L: 0
0709 14:53:32.530898 (+  6872us) op_driver.cc:348] REPLICATION: starting
0709 14:53:32.587566 (+ 56668us) log.cc:844] Serialized 5159 byte log entry
0709 14:53:32.857162 (+269596us) spinlock_profiling.cc:243] Waited 69.7 ms on lock 0x7b4400022b4c. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb687c29db1 00007fb687cc7c85 00007fb687cc86a2 00007fb68aa3a1db 00007fb68aa35aaf 00007fb68aa2986e 00007fb68aa28bb6 00007fb68aa287d8 00007fb68aa32221 00007fb68aa321d9 00007fb68aa32169
0709 14:53:33.122877 (+265715us) op_driver.cc:464] REPLICATION: finished
0709 14:53:33.302988 (+180111us) write_op.cc:301] APPLY: starting
0709 14:53:33.310157 (+  7169us) tablet.cc:1367] starting BulkCheckPresence
0709 14:53:33.422166 (+112009us) tablet.cc:1370] finished BulkCheckPresence
0709 14:53:33.422224 (+    58us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 14:53:33.431360 (+  9136us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 14:53:33.431810 (+   450us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=26,key_file_lookups=26,delta_file_lookups=26,mrs_lookups=0
0709 14:53:33.431875 (+    65us) write_op.cc:312] APPLY: finished
0709 14:53:33.432355 (+   480us) log.cc:844] Serialized 121 byte log entry
0709 14:53:33.433568 (+  1213us) write_op.cc:489] Releasing partition, row and schema locks
0709 14:53:33.433762 (+   194us) write_op.cc:454] Released schema lock
0709 14:53:33.433854 (+    92us) write_op.cc:341] FINISH: Updating metrics
0709 14:53:33.434435 (+   581us) write_op.cc:489] Releasing partition, row and schema locks
0709 14:53:33.434469 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":62869,"reported_tablets":21,"child_traces":[["op",{"apply.queue_time_us":137179,"apply.run_cpu_time_us":22446,"apply.run_wall_time_us":131478,"cfile_cache_hit":54,"cfile_cache_hit_bytes":58311,"num_ops":13,"prepare.queue_time_us":175809,"prepare.run_cpu_time_us":41521,"prepare.run_wall_time_us":264270,"raft.queue_time_us":171228,"raft.run_cpu_time_us":38332,"raft.run_wall_time_us":99804,"replication_time_us":586395,"spinlock_wait_cycles":160241536,"thread_start_us":355218,"threads_started":4,"wal-append.queue_time_us":144648}]]}
I20260709 14:53:33.462226 14353 raft_consensus.cc:2804] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 14:53:33.468559 14306 raft_consensus.cc:2749] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 25 FOLLOWER]: Leader election lost for term 24. Reason: Vote denied by peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529) with higher term. Message: Invalid argument: T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 24. Current term is 25.
W20260709 14:53:33.529930  7745 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:53:33.515244 14348 log.cc:927] Time spent T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.100s	user 0.003s	sys 0.000s
I20260709 14:53:33.410717 14055 raft_consensus.cc:515] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:33.484830 14276 raft_consensus.cc:493] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:33.518064 14296 raft_consensus.cc:515] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:33.521750  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:33.530089  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:33.542909  7777 raft_consensus.cc:2468] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 22.
I20260709 14:53:33.542793  7926 raft_consensus.cc:2468] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 19.
I20260709 14:53:33.522639  7921 raft_consensus.cc:1275] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 14:53:33.543905  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:33.544678  7776 raft_consensus.cc:2468] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 21.
W20260709 14:53:33.531163  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:33.503508 14350 raft_consensus.cc:2804] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Leader election won for term 16
I20260709 14:53:33.521997 14244 raft_consensus.cc:493] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:33.521592 14307 raft_consensus.cc:2804] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 25 FOLLOWER]: Leader election won for term 25
I20260709 14:53:33.532943 14353 raft_consensus.cc:493] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:33.554394  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:33.556260  7921 raft_consensus.cc:1275] T 9ce9c0ef2db24c13a8b1402f21819458 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Refusing update from remote peer 9418391fa82a42c79c6cad13ba91d964: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 14:53:33.558035  7777 raft_consensus.cc:2468] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 14.
I20260709 14:53:33.558703  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 25 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:33.521134 14347 raft_consensus.cc:515] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:33.562736  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:33.565526  7847 raft_consensus.cc:2468] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 18.
I20260709 14:53:33.568317  7851 raft_consensus.cc:2393] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 25: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:53:33.569027  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:33.540212 14220 consensus_queue.cc:1059] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.026s
I20260709 14:53:33.592152 14351 leader_election.cc:290] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 20 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:33.592618 14220 raft_consensus.cc:3055] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 LEADER]: Stepping down as leader of term 19
I20260709 14:53:33.557163 14244 raft_consensus.cc:515] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:33.559331 14295 leader_election.cc:290] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 22 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:33.581311 14292 consensus_queue.cc:1048] T 9ce9c0ef2db24c13a8b1402f21819458 P 9418391fa82a42c79c6cad13ba91d964 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 14:53:33.587167  7745 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:33.580690  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:33.596108  7852 raft_consensus.cc:2468] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 18.
I20260709 14:53:33.598762  7778 raft_consensus.cc:1275] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 10. (term mismatch)
I20260709 14:53:33.599217  7778 pending_rounds.cc:85] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed: Aborting all ops after (but not including) 9
I20260709 14:53:33.593036 14220 raft_consensus.cc:740] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:53:33.599538  7778 pending_rounds.cc:107] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed: Aborting uncommitted NO_OP operation due to leader change: 18.10
I20260709 14:53:33.599855  7778 raft_consensus.cc:2889] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:53:33.595450 14244 leader_election.cc:290] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:33.600744  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:33.562956 14307 raft_consensus.cc:697] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 25 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:53:33.601711  7775 raft_consensus.cc:2410] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for term 22 because replica has last-logged OpId of term: 21 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 13.
I20260709 14:53:33.600649 14220 consensus_queue.cc:260] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:33.602375  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:33.601894  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:33.603461  7779 raft_consensus.cc:3060] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Advancing to term 20
I20260709 14:53:33.603291  7774 raft_consensus.cc:2468] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 25.
I20260709 14:53:33.604694 14296 leader_election.cc:290] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 23 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:33.605381 14220 raft_consensus.cc:3060] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Advancing to term 20
I20260709 14:53:33.589685  7674 catalog_manager.cc:5697] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:53:33.601404  7778 raft_consensus.cc:1275] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 14:53:33.598567  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:33.591286  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:33.602424  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:33.598946  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:33.610090  7773 raft_consensus.cc:3060] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Advancing to term 19
I20260709 14:53:33.609969  7772 raft_consensus.cc:3060] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Advancing to term 21
I20260709 14:53:33.611503  7771 raft_consensus.cc:2468] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 18.
I20260709 14:53:33.614446 14347 leader_election.cc:290] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 17 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:33.550218 14276 raft_consensus.cc:515] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:33.617571  7770 raft_consensus.cc:2410] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for term 16 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 14:53:33.619565 14276 leader_election.cc:290] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:33.558895 14350 raft_consensus.cc:697] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:53:33.621522  7779 raft_consensus.cc:2468] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 20.
I20260709 14:53:33.623857  7773 raft_consensus.cc:2468] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 19.
I20260709 14:53:33.602216 14307 consensus_queue.cc:237] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:33.627768 13835 raft_consensus.cc:493] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:33.632745 13835 raft_consensus.cc:515] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:33.636438  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:33.637905  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:33.619859 14055 leader_election.cc:290] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:33.560802 14353 raft_consensus.cc:3060] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Advancing to term 21
I20260709 14:53:33.643419  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:33.644807  7778 raft_consensus.cc:2393] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 17: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:53:33.629351 14350 consensus_queue.cc:237] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:33.644950  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:33.646857  7774 raft_consensus.cc:2393] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 17: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:53:33.645931  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:33.637889  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:33.647792  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:33.649046  7779 raft_consensus.cc:2410] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for term 16 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 14:53:33.650864  7778 raft_consensus.cc:2393] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 20: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:53:33.648516  7854 raft_consensus.cc:2468] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 19.
I20260709 14:53:33.647521  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:33.653580  7775 raft_consensus.cc:3060] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Advancing to term 15
I20260709 14:53:33.653962  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:33.657439  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:33.659054  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:33.662214 14295 raft_consensus.cc:493] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:33.665740  7771 raft_consensus.cc:2393] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 15: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:53:33.666165  7772 raft_consensus.cc:2468] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 21.
I20260709 14:53:33.668373  7776 raft_consensus.cc:2393] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 21: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
W20260709 14:53:33.670154  7745 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:53:33.670995  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:33.671483  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:33.672938  7845 raft_consensus.cc:3060] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Advancing to term 17
I20260709 14:53:33.660995  7924 raft_consensus.cc:2468] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 17.
I20260709 14:53:33.678834  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:53:33.686082  7893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:33.688963  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:33.690798  7773 raft_consensus.cc:2468] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 21.
I20260709 14:53:33.685425  7854 raft_consensus.cc:2468] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 18.
W20260709 14:53:33.698077  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 204951us
I20260709 14:53:33.701188  7771 raft_consensus.cc:2393] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 22: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:53:33.663040 14295 raft_consensus.cc:515] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:33.704927  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:33.714048  7773 raft_consensus.cc:2393] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 19: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:53:33.724821  7845 raft_consensus.cc:2468] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 17.
I20260709 14:53:33.727034  7674 catalog_manager.cc:5697] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 18 to 20, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 20 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:53:33.731940  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:33.732967  7845 raft_consensus.cc:3060] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Advancing to term 22
I20260709 14:53:33.744644  7674 catalog_manager.cc:5697] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 18 to 19, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 19 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:53:33.749012  7674 catalog_manager.cc:5697] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 13 to 15, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 15 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:53:33.750797  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:33.751624  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:33.752151 14244 raft_consensus.cc:493] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:33.753232 14244 raft_consensus.cc:515] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:33.754714  7674 catalog_manager.cc:5697] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 20 to 21, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 21 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:53:33.752362  7851 raft_consensus.cc:3060] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 22 FOLLOWER]: Advancing to term 23
I20260709 14:53:33.776304 14244 leader_election.cc:290] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:33.780424 13835 leader_election.cc:290] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:33.783424  7894 leader_election.cc:304] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:33.785493 13835 raft_consensus.cc:2804] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 14:53:33.786011 13835 raft_consensus.cc:493] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:33.786386 13835 raft_consensus.cc:3060] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Advancing to term 19
I20260709 14:53:33.796193 14353 raft_consensus.cc:515] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:53:33.796891  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 59383.4us
I20260709 14:53:33.801533 14295 leader_election.cc:290] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:33.805511  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:33.807382  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:33.807382  7853 raft_consensus.cc:1240] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 22 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 21. Current term is 22. Ops: [21.14-21.14]
I20260709 14:53:33.811007  7770 raft_consensus.cc:2468] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 25.
I20260709 14:53:33.806263  7854 raft_consensus.cc:2468] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 22.
I20260709 14:53:33.814654  7894 leader_election.cc:304] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:33.817951  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:33.819012  7851 raft_consensus.cc:2468] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 23.
I20260709 14:53:33.818933  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:33.823429  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:33.829650  7853 raft_consensus.cc:1240] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 19. Current term is 20. Ops: []
I20260709 14:53:33.822158  7775 raft_consensus.cc:2468] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 15.
I20260709 14:53:33.822157  7846 raft_consensus.cc:2468] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 20.
I20260709 14:53:33.816704  7894 leader_election.cc:304] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:33.832734 14081 raft_consensus.cc:2804] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 14:53:33.832181 14306 raft_consensus.cc:493] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:33.836119  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:53:33.868379  7742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:33.853811  7777 raft_consensus.cc:2410] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for term 20 because replica has last-logged OpId of term: 19 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 12.
I20260709 14:53:33.854110  7854 raft_consensus.cc:2468] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 17.
I20260709 14:53:33.851807 14306 raft_consensus.cc:515] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:33.878790  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:33.843014  7775 raft_consensus.cc:1275] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 14:53:33.879756  7773 raft_consensus.cc:2393] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 17: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:53:33.884143  7845 raft_consensus.cc:2468] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 22.
I20260709 14:53:33.886197  7770 raft_consensus.cc:1275] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 14:53:33.836074  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:33.839905 14291 raft_consensus.cc:2804] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 14:53:33.848016 14081 raft_consensus.cc:493] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:33.835119  7894 leader_election.cc:304] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
W20260709 14:53:33.901579  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:53:33.902935  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 67904.7us
I20260709 14:53:33.861068 14353 leader_election.cc:290] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 21 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:33.902397 14291 raft_consensus.cc:493] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:33.905308 14081 raft_consensus.cc:3060] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Advancing to term 20
I20260709 14:53:33.925307  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
W20260709 14:53:33.926721  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:33.927314  7777 raft_consensus.cc:2393] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 23: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:53:33.908759 14295 raft_consensus.cc:2804] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 14:53:33.931950  7892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:33.931887 13835 raft_consensus.cc:515] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:33.922863 14306 leader_election.cc:290] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:33.953006 13835 leader_election.cc:290] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:33.926661 14291 raft_consensus.cc:3060] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Advancing to term 20
I20260709 14:53:33.931414 14295 raft_consensus.cc:493] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:33.961712 14295 raft_consensus.cc:3060] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Advancing to term 19
I20260709 14:53:33.974642  7745 leader_election.cc:304] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
W20260709 14:53:33.983467  7745 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:33.977968 14220 raft_consensus.cc:2804] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 14:53:33.991044 14220 raft_consensus.cc:493] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:33.991532 14220 raft_consensus.cc:3060] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 23 FOLLOWER]: Advancing to term 24
W20260709 14:53:34.005470  7742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:34.007802  7777 raft_consensus.cc:1275] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 14:53:34.011055 14088 raft_consensus.cc:493] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:53:34.012586 14088 raft_consensus.cc:515] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:34.016345  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:34.017010  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:34.017449  7770 raft_consensus.cc:2393] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 17: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:53:34.018425  7777 raft_consensus.cc:2393] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 20: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:53:34.015308  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:34.021641  7773 raft_consensus.cc:2410] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for term 19 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 14:53:34.025681  7771 raft_consensus.cc:1275] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 13. (term mismatch)
I20260709 14:53:34.026482  7771 pending_rounds.cc:85] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed: Aborting all ops after (but not including) 12
I20260709 14:53:34.026818  7771 pending_rounds.cc:107] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed: Aborting uncommitted NO_OP operation due to leader change: 19.13
I20260709 14:53:34.027248  7771 raft_consensus.cc:2889] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:53:34.028183  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:34.029181  7775 raft_consensus.cc:2393] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 15: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
W20260709 14:53:34.029790  8598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 123726us
W20260709 14:53:34.029742  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 114575us
I20260709 14:53:34.035327  7894 leader_election.cc:304] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:34.040345 13835 raft_consensus.cc:2804] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 14:53:34.040804  7745 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:34.041735 14088 leader_election.cc:290] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:34.042457  7775 raft_consensus.cc:1275] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 25 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
I20260709 14:53:34.049712 13835 raft_consensus.cc:697] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:34.060889 13835 consensus_queue.cc:237] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:34.062337  7819 leader_election.cc:304] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:34.063741  7847 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c"
dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
mode: GRACEFUL
new_leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:41662
I20260709 14:53:34.064924  7847 raft_consensus.cc:606] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Received request to transfer leadership to TS 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:53:34.065337  7847 raft_consensus.cc:614] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 14:53:34.066334  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:34.066560  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 17 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:34.067528  7775 raft_consensus.cc:2410] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for term 17 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 14:53:34.068581  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:34.069171 14306 raft_consensus.cc:493] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:34.069828  7770 raft_consensus.cc:2376] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 22 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 22. Re-sending same reply.
I20260709 14:53:34.070205 14306 raft_consensus.cc:515] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:34.071390  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:34.073428 14306 leader_election.cc:290] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:34.074201 14220 raft_consensus.cc:515] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:34.077981 14220 leader_election.cc:290] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 24 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:53:34.079669  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:34.070600  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:34.081048  7773 raft_consensus.cc:2376] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 21. Re-sending same reply.
I20260709 14:53:34.087414  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:34.089411  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:34.090991  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:34.091187  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:34.091553  7819 leader_election.cc:304] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:34.091895  7927 raft_consensus.cc:3060] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 24 FOLLOWER]: Advancing to term 25
I20260709 14:53:34.092825  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:34.094630  7924 raft_consensus.cc:2468] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 22.
I20260709 14:53:34.094900  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:34.095875  7926 raft_consensus.cc:2368] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 24. Current term is 25.
I20260709 14:53:34.096619  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c563cc7cfbe4d59be4ffc5cf847ce56" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
W20260709 14:53:34.096252  7891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:34.098989  7928 raft_consensus.cc:1240] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 14:53:34.089318 14353 raft_consensus.cc:2804] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 14:53:34.104326  7894 leader_election.cc:304] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:34.109822 14056 raft_consensus.cc:2804] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 23 FOLLOWER]: Leader election won for term 23
W20260709 14:53:34.117435  7745 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:34.120095 14291 raft_consensus.cc:515] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:34.114271 14055 consensus_queue.cc:1048] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.008s
I20260709 14:53:34.123050 14291 leader_election.cc:290] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 20 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:34.112753 14350 raft_consensus.cc:2804] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 14:53:34.126019 14350 raft_consensus.cc:493] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:34.126915 14350 raft_consensus.cc:3060] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Advancing to term 19
I20260709 14:53:34.113118  7819 leader_election.cc:304] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:34.142666  7927 raft_consensus.cc:2468] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 25.
I20260709 14:53:34.110379 14353 raft_consensus.cc:493] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 22 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:34.138599 14056 raft_consensus.cc:697] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 23 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:34.142695 14341 raft_consensus.cc:2804] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Leader election won for term 17
I20260709 14:53:34.153080  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:34.160326  7920 raft_consensus.cc:2468] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 20.
W20260709 14:53:34.152410  7744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:53:34.159312  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 55060.8us
I20260709 14:53:34.162530  7894 leader_election.cc:304] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
W20260709 14:53:34.165565  7745 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:34.148767 14353 raft_consensus.cc:3060] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 22 FOLLOWER]: Advancing to term 23
I20260709 14:53:34.176785 14374 raft_consensus.cc:2804] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 14:53:34.177597 14374 raft_consensus.cc:493] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:34.177995 14374 raft_consensus.cc:3060] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Advancing to term 21
I20260709 14:53:34.148564 14244 consensus_queue.cc:1059] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.009s
I20260709 14:53:34.140887 14081 raft_consensus.cc:515] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:34.173593 14341 raft_consensus.cc:697] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:53:34.151811 14291 raft_consensus.cc:493] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:34.182713  7893 leader_election.cc:304] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:34.190472 13835 raft_consensus.cc:2749] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 14:53:34.192505  7893 leader_election.cc:304] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:34.195446 13835 consensus_queue.cc:1048] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 14:53:34.197218 13835 raft_consensus.cc:2804] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 14:53:34.196858 14056 consensus_queue.cc:237] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:34.197539  7927 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "939996e77ee64e9fab21aef50758b706"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
mode: GRACEFUL
new_leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:48676
I20260709 14:53:34.198365  7927 raft_consensus.cc:606] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Received request to transfer leadership to TS 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:53:34.198784  7927 raft_consensus.cc:614] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 14:53:34.194629 14307 raft_consensus.cc:493] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:34.183308 14088 raft_consensus.cc:3055] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 14:53:34.202913 14088 raft_consensus.cc:740] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:34.200877 14307 raft_consensus.cc:515] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:34.200188 14295 raft_consensus.cc:515] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:34.209157  7921 raft_consensus.cc:2368] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 18. Current term is 19.
I20260709 14:53:34.211369 14306 raft_consensus.cc:493] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:34.197701 13835 raft_consensus.cc:493] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:34.212450 13835 raft_consensus.cc:3060] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 14:53:34.212237 14306 raft_consensus.cc:515] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:34.195209 14220 raft_consensus.cc:493] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:34.215036 14220 raft_consensus.cc:515] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:34.195266 14291 raft_consensus.cc:515] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:34.218456 14291 leader_election.cc:290] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:34.218552 14081 leader_election.cc:290] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 20 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:34.219678 14306 leader_election.cc:290] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:34.223089  7927 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea"
dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
mode: GRACEFUL
new_leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:48676
I20260709 14:53:34.224185  7927 raft_consensus.cc:606] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Received request to transfer leadership to TS 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:53:34.224773  7927 raft_consensus.cc:614] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 14:53:34.215781 14244 raft_consensus.cc:493] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:34.206303 14307 leader_election.cc:290] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:34.226316 14295 leader_election.cc:290] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:34.232692  7744 leader_election.cc:400] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 election: Vote denied by peer 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785) with higher term. Message: Invalid argument: T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 19. Current term is 20.
I20260709 14:53:34.232631  7893 leader_election.cc:304] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:34.236055 13835 raft_consensus.cc:515] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:34.204252 14088 consensus_queue.cc:260] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:34.254859  7893 leader_election.cc:304] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:53:34.263489  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 101096us
I20260709 14:53:34.266685 13835 leader_election.cc:290] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 18 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:34.230216 14220 leader_election.cc:290] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:34.229688 14306 raft_consensus.cc:493] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:34.268006  7894 leader_election.cc:304] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:34.270936  7744 leader_election.cc:304] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:34.212802 14341 consensus_queue.cc:237] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:34.278957  7673 catalog_manager.cc:5697] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 16 to 19. New cstate: current_term: 19 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:53:34.237663 14244 raft_consensus.cc:515] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:34.263134 14307 raft_consensus.cc:493] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:34.282369  7673 catalog_manager.cc:5697] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 18 to 22, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 22 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:53:34.269191 14081 raft_consensus.cc:2804] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 14:53:34.266673 14295 raft_consensus.cc:2749] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 14:53:34.236063 14350 raft_consensus.cc:515] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:34.288218 13835 raft_consensus.cc:2804] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 14:53:34.288803 13835 raft_consensus.cc:493] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:34.289306 13835 raft_consensus.cc:3060] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 14:53:34.286033  7673 catalog_manager.cc:5697] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:53:34.292892  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:34.291184  7673 catalog_manager.cc:5697] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 15 to 17, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 17 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:53:34.298913  7919 raft_consensus.cc:1275] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 25 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
I20260709 14:53:34.296128  7926 raft_consensus.cc:1240] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 19. Current term is 20. Ops: []
I20260709 14:53:34.300839  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:34.302291  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:34.304008  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:34.305047  7925 raft_consensus.cc:2468] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 23.
I20260709 14:53:34.308025  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:34.311255  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:34.312813  7674 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54364 (request call id 349) took 8230 ms. Trace:
I20260709 14:53:34.313345  7674 rpcz_store.cc:276] 0709 14:53:26.067947 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:53:26.068434 (+   487us) service_pool.cc:224] Handling call
0709 14:53:34.297937 (+8229503us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 14:53:33.760086 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 14:53:33.760602 (+   516us) write_op.cc:432] Acquiring schema lock in shared mode
0709 14:53:33.760637 (+    35us) write_op.cc:435] Acquired schema lock
0709 14:53:33.760653 (+    16us) tablet.cc:662] Decoding operations
0709 14:53:33.761316 (+   663us) write_op.cc:620] Acquiring the partition lock for write op
0709 14:53:33.761390 (+    74us) write_op.cc:641] Partition lock acquired for write op
0709 14:53:33.761417 (+    27us) tablet.cc:685] Acquiring locks for 5 operations
0709 14:53:33.761934 (+   517us) tablet.cc:701] Row locks acquired
0709 14:53:33.761951 (+    17us) write_op.cc:260] PREPARE: finished
0709 14:53:33.762107 (+   156us) write_op.cc:270] Start()
0709 14:53:33.762221 (+   114us) write_op.cc:276] Timestamp: P: 1783608813762053 usec, L: 0
0709 14:53:33.762241 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 14:53:33.762894 (+   653us) log.cc:844] Serialized 2075 byte log entry
0709 14:53:33.766183 (+  3289us) op_driver.cc:464] REPLICATION: finished
0709 14:53:33.766745 (+   562us) write_op.cc:301] APPLY: starting
0709 14:53:33.766832 (+    87us) tablet.cc:1367] starting BulkCheckPresence
0709 14:53:33.791234 (+ 24402us) tablet.cc:1370] finished BulkCheckPresence
0709 14:53:33.791402 (+   168us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 14:53:33.932402 (+141000us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 14:53:33.969311 (+ 36909us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=10,key_file_lookups=10,delta_file_lookups=10,mrs_lookups=0
0709 14:53:33.969368 (+    57us) write_op.cc:312] APPLY: finished
0709 14:53:33.969639 (+   271us) log.cc:844] Serialized 57 byte log entry
0709 14:53:33.969824 (+   185us) write_op.cc:489] Releasing partition, row and schema locks
0709 14:53:33.969936 (+   112us) write_op.cc:454] Released schema lock
0709 14:53:33.969985 (+    49us) write_op.cc:341] FINISH: Updating metrics
0709 14:53:33.970653 (+   668us) write_op.cc:489] Releasing partition, row and schema locks
0709 14:53:33.970711 (+    58us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":38383,"reported_tablets":41,"child_traces":[["op",{"apply.queue_time_us":301,"apply.run_cpu_time_us":14113,"apply.run_wall_time_us":203698,"cfile_cache_hit":22,"cfile_cache_hit_bytes":24967,"num_ops":5,"prepare.queue_time_us":148,"prepare.run_cpu_time_us":3112,"prepare.run_wall_time_us":5778,"replication_time_us":3792}]]}
I20260709 14:53:34.319443 14350 leader_election.cc:290] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 19 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:34.288866 14081 raft_consensus.cc:493] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:34.320613 14081 raft_consensus.cc:3060] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Advancing to term 19
I20260709 14:53:34.323016 14353 raft_consensus.cc:515] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:34.294988  7673 catalog_manager.cc:5697] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 16 to 19, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 19 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:53:34.312305  7924 raft_consensus.cc:2468] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 20.
I20260709 14:53:34.336367  7673 catalog_manager.cc:5697] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
W20260709 14:53:34.339865  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 75136.9us
I20260709 14:53:34.337370 14353 leader_election.cc:290] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 23 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:34.294420 14378 raft_consensus.cc:2749] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 14:53:34.340598  7744 leader_election.cc:400] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 election: Vote denied by peer 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785) with higher term. Message: Invalid argument: T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 19. Current term is 20.
I20260709 14:53:34.345520  7744 leader_election.cc:403] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 14:53:34.281529 14376 consensus_queue.cc:1048] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.064s
I20260709 14:53:34.344601  7673 catalog_manager.cc:5697] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 21 to 25. New cstate: current_term: 25 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:53:34.345502 13835 raft_consensus.cc:515] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:34.297801 14088 raft_consensus.cc:3060] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 22 FOLLOWER]: Advancing to term 23
I20260709 14:53:34.332252 14375 raft_consensus.cc:493] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:34.282136 14306 raft_consensus.cc:515] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:34.289947 14291 consensus_queue.cc:1048] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.055s
I20260709 14:53:34.351382  7673 catalog_manager.cc:5697] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:53:34.341607  7894 leader_election.cc:304] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:34.289179 14307 raft_consensus.cc:515] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:34.360090  7673 catalog_manager.cc:5697] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 19 to 20, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 20 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:53:34.361279  7819 leader_election.cc:304] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:34.365721  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:34.366770  7847 raft_consensus.cc:2468] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 22.
I20260709 14:53:34.372292 14244 leader_election.cc:290] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:34.359894 14220 raft_consensus.cc:2749] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785) with higher term. Message: Invalid argument: T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 19. Current term is 20.
I20260709 14:53:34.373468 14055 raft_consensus.cc:2749] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 14:53:34.374610  7744 leader_election.cc:304] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:34.356277 14375 raft_consensus.cc:515] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:34.352911 14374 raft_consensus.cc:515] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:34.361615 13835 leader_election.cc:290] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 18 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:34.384198 14342 consensus_queue.cc:1048] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.010s
I20260709 14:53:34.385357 14382 raft_consensus.cc:2804] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 14:53:34.395443 14382 raft_consensus.cc:697] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 22 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:34.384754  7673 catalog_manager.cc:5697] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 16 to 18, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 18 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:53:34.390820  7921 raft_consensus.cc:2410] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for term 23 because replica has last-logged OpId of term: 22 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 14.
I20260709 14:53:34.402114  7673 catalog_manager.cc:5697] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 20 to 21, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 21 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:53:34.404330  7673 catalog_manager.cc:5697] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 19 to 21, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 21 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:53:34.410316 14306 leader_election.cc:290] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:34.408546 14375 leader_election.cc:290] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:34.356778 14378 raft_consensus.cc:493] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:34.412662 14378 raft_consensus.cc:515] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:34.397404 14382 consensus_queue.cc:237] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:34.415575 14378 leader_election.cc:290] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:34.367817 14350 consensus_queue.cc:1048] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.045s
I20260709 14:53:34.419363  7819 leader_election.cc:304] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:34.387203 14374 leader_election.cc:290] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 21 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:34.406277  7673 catalog_manager.cc:5697] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 17 to 20, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 20 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:53:34.426887  7673 catalog_manager.cc:5697] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 17 to 19, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 19 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:53:34.411149 14306 raft_consensus.cc:493] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:34.388581 14307 leader_election.cc:290] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:34.397879 14220 raft_consensus.cc:2749] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 22 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 14:53:34.437810  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:34.434468  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:34.438428  7847 raft_consensus.cc:3060] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Advancing to term 19
I20260709 14:53:34.438791  7853 raft_consensus.cc:3060] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Advancing to term 20
I20260709 14:53:34.430200 14081 raft_consensus.cc:515] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:34.437486  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:34.440534  7919 raft_consensus.cc:2368] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 17. Current term is 18.
I20260709 14:53:34.431178 14350 raft_consensus.cc:2749] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 14:53:34.441767  7920 raft_consensus.cc:1275] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 14:53:34.444883  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:34.445453  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:34.446421  7851 raft_consensus.cc:3060] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Advancing to term 20
I20260709 14:53:34.451125  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:34.452770  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:34.459553  7924 raft_consensus.cc:1275] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 14:53:34.459815  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:34.460968  7849 raft_consensus.cc:3060] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Advancing to term 19
I20260709 14:53:34.461603  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:34.462561  7854 raft_consensus.cc:3060] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Advancing to term 18
I20260709 14:53:34.454397  7673 catalog_manager.cc:5697] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 14 to 16, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 16 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:53:34.465291  7673 catalog_manager.cc:5697] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 18 to 20, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 20 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:53:34.455930 14307 raft_consensus.cc:493] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:34.467970  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:34.468240 14307 raft_consensus.cc:515] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:34.470845 14307 leader_election.cc:290] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:34.467028  7851 raft_consensus.cc:2468] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 20.
I20260709 14:53:34.472349  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:34.473347  7921 raft_consensus.cc:2410] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for term 19 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 14:53:34.467200  7673 catalog_manager.cc:5697] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 20 to 22, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 22 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:53:34.482620  7924 raft_consensus.cc:1275] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 25 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
I20260709 14:53:34.484172  7673 catalog_manager.cc:5697] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 20 to 22. New cstate: current_term: 22 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
W20260709 14:53:34.485879  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 84103.5us
I20260709 14:53:34.486282  7925 raft_consensus.cc:2468] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 15.
I20260709 14:53:34.440033 14306 raft_consensus.cc:515] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:34.488075  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:34.494449  7673 catalog_manager.cc:5697] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 18 to 20, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 20 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:53:34.500883  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:34.501695  7851 raft_consensus.cc:3060] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Advancing to term 18
I20260709 14:53:34.512071  7921 raft_consensus.cc:1275] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 14:53:34.511572  7673 catalog_manager.cc:5697] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 19 to 21, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 21 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:53:34.513844  7673 catalog_manager.cc:5697] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:53:34.517462  7853 raft_consensus.cc:2468] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 20.
I20260709 14:53:34.519820  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:53:34.521332  7745 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:34.488900 14385 raft_consensus.cc:493] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:34.532316  7919 raft_consensus.cc:1240] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 18. Current term is 19. Ops: []
I20260709 14:53:34.534416  7854 raft_consensus.cc:2468] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 18.
I20260709 14:53:34.528563  7851 raft_consensus.cc:2468] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 18.
I20260709 14:53:34.532078  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:34.541147  7845 raft_consensus.cc:3060] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Advancing to term 21
I20260709 14:53:34.550776  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258d6c2dda954bf5b65930fde8ecb9f3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:34.517170 14055 consensus_queue.cc:1048] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.039s
I20260709 14:53:34.499439 14342 consensus_queue.cc:1048] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 14:53:34.556809  7928 raft_consensus.cc:2468] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 20.
I20260709 14:53:34.550827  7924 raft_consensus.cc:2468] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 21.
I20260709 14:53:34.495460 14341 consensus_queue.cc:1048] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.048s
I20260709 14:53:34.520735 14386 raft_consensus.cc:493] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:34.555037  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:34.506613 14276 consensus_queue.cc:1048] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 14:53:34.516373 14353 consensus_queue.cc:1048] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.038s
I20260709 14:53:34.576380  7849 raft_consensus.cc:2468] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 19.
I20260709 14:53:34.547685 14385 raft_consensus.cc:515] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:34.578889  7894 leader_election.cc:304] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:34.580473 14385 leader_election.cc:290] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:34.559152 14296 raft_consensus.cc:493] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:34.581547 14296 raft_consensus.cc:515] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:34.582913 14374 raft_consensus.cc:2804] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 14:53:34.567922  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:34.569569 14081 leader_election.cc:290] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:53:34.570734  7742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:34.573446 14220 raft_consensus.cc:493] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
W20260709 14:53:34.574928  7745 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:34.593211  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:34.584354  7894 leader_election.cc:304] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:34.594568  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:34.595371  7853 raft_consensus.cc:2393] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 20: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:53:34.596222  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:34.596726  7853 raft_consensus.cc:3060] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 23 FOLLOWER]: Advancing to term 24
W20260709 14:53:34.577497  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 61673.9us
I20260709 14:53:34.598052  7744 leader_election.cc:304] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:34.599524  7744 leader_election.cc:304] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:34.604969  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:34.605911  7854 raft_consensus.cc:2410] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for term 16 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 14:53:34.608569  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:34.579252  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:34.610460  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:34.611281  7849 raft_consensus.cc:2468] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 22.
I20260709 14:53:34.611581  7848 raft_consensus.cc:2368] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 17. Current term is 18.
I20260709 14:53:34.610483  7852 raft_consensus.cc:2468] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 18.
I20260709 14:53:34.591048  7845 raft_consensus.cc:2468] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 21.
I20260709 14:53:34.608662  7851 raft_consensus.cc:1275] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 25 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
I20260709 14:53:34.583369 14374 raft_consensus.cc:493] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:34.615185  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:34.598052 14307 raft_consensus.cc:493] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:34.625551 14374 raft_consensus.cc:3060] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 22 FOLLOWER]: Advancing to term 23
I20260709 14:53:34.617874  7850 raft_consensus.cc:2468] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 20.
I20260709 14:53:34.631309 14081 raft_consensus.cc:2804] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 14:53:34.625950 14307 raft_consensus.cc:515] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:34.607663 14220 raft_consensus.cc:515] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:34.644722 14220 leader_election.cc:290] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:34.645761 14081 raft_consensus.cc:697] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:34.608337 14378 raft_consensus.cc:2749] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 14:53:34.630642  7894 leader_election.cc:304] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:34.648033 14306 leader_election.cc:290] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:34.669703 14306 raft_consensus.cc:493] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9418391fa82a42c79c6cad13ba91d964)
I20260709 14:53:34.670384 14306 raft_consensus.cc:515] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:53:34.658985  7853 raft_consensus.cc:2468] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 24.
I20260709 14:53:34.663666  7819 leader_election.cc:400] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 17 election: Vote denied by peer 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785) with higher term. Message: Invalid argument: T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 17. Current term is 18.
I20260709 14:53:34.675488  7819 leader_election.cc:403] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 14:53:34.667441 14395 raft_consensus.cc:493] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:34.662096  7847 raft_consensus.cc:2468] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 19.
I20260709 14:53:34.584092 14386 raft_consensus.cc:515] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:34.673005 14306 leader_election.cc:290] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68:42321)
I20260709 14:53:34.668720 14220 raft_consensus.cc:2749] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 14:53:34.677057  8640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9441e831627143a991a1556dcdce71e3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9418391fa82a42c79c6cad13ba91d964" is_pre_election: true
I20260709 14:53:34.675321  7894 leader_election.cc:304] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:34.652608 14385 raft_consensus.cc:493] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:34.685133 14395 raft_consensus.cc:515] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:34.688645 14385 raft_consensus.cc:515] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:34.678750 14382 raft_consensus.cc:2804] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 14:53:34.690954 14395 leader_election.cc:290] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:34.682981  7819 leader_election.cc:304] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:34.691174 14385 leader_election.cc:290] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:34.700958 14382 raft_consensus.cc:697] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:34.701387  7894 leader_election.cc:304] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:34.701858 14385 raft_consensus.cc:2804] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 14:53:34.702433 14295 raft_consensus.cc:2804] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 14:53:34.703063 14295 raft_consensus.cc:697] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:34.703390 14341 consensus_queue.cc:1048] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 14:53:34.702471 14385 raft_consensus.cc:697] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:34.705171 14382 consensus_queue.cc:237] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:34.706655 14385 consensus_queue.cc:237] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:34.703464  7894 leader_election.cc:304] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:34.704504 14295 consensus_queue.cc:237] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:34.710093 14291 raft_consensus.cc:493] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:34.694067 14350 consensus_queue.cc:1048] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.016s
I20260709 14:53:34.710719 14394 raft_consensus.cc:2749] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 14:53:34.711217  7894 leader_election.cc:304] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:34.710741 14291 raft_consensus.cc:515] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:34.712188 13835 raft_consensus.cc:2804] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 14:53:34.712631 13835 raft_consensus.cc:493] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:34.712970 13835 raft_consensus.cc:3060] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Advancing to term 20
I20260709 14:53:34.684366 14353 raft_consensus.cc:2749] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785) with higher term. Message: Invalid argument: T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 17. Current term is 18.
I20260709 14:53:34.678301 14307 leader_election.cc:290] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:34.714986  7819 leader_election.cc:304] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:53:34.715696  7894 leader_election.cc:304] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:34.720829 14394 raft_consensus.cc:2804] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Leader election won for term 15
I20260709 14:53:34.721539 14394 raft_consensus.cc:697] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:53:34.722579 14394 consensus_queue.cc:237] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:34.725528  7845 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3"
dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
mode: GRACEFUL
new_leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:41662
I20260709 14:53:34.725759  7745 leader_election.cc:304] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:34.726244  7845 raft_consensus.cc:606] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Received request to transfer leadership to TS 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:53:34.727947  7845 raft_consensus.cc:614] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 14:53:34.731308  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:34.731747  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:34.731787  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9441e831627143a991a1556dcdce71e3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:34.732328  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:34.710345 14088 raft_consensus.cc:2804] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 14:53:34.693171 14296 leader_election.cc:290] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:34.699506 14276 consensus_queue.cc:1048] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 14:53:34.733925  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:34.734738 14386 leader_election.cc:290] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:34.735567 14295 raft_consensus.cc:493] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:34.735718 14307 raft_consensus.cc:2804] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 14:53:34.736300 14307 raft_consensus.cc:493] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:34.736788 14307 raft_consensus.cc:3060] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 22 FOLLOWER]: Advancing to term 23
I20260709 14:53:34.742079 14088 raft_consensus.cc:697] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:34.742739  7745 leader_election.cc:400] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 pre-election: Vote denied by peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529) with higher term. Message: Invalid argument: T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 17. Current term is 18.
I20260709 14:53:34.735621 14291 leader_election.cc:290] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:34.736213 14295 raft_consensus.cc:515] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:34.745069 14386 consensus_queue.cc:1048] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 14:53:34.709800 14081 consensus_queue.cc:237] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:34.748399 14295 leader_election.cc:290] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:34.743103  7745 leader_election.cc:403] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 14:53:34.755043  7745 leader_election.cc:304] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:34.754992 13835 raft_consensus.cc:515] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:34.753141  7894 leader_election.cc:304] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:34.758960  7745 leader_election.cc:304] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:34.763317 14391 consensus_queue.cc:1048] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 14:53:34.763953  7819 leader_election.cc:304] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:53:34.765291  7819 leader_election.cc:304] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:34.766330 14353 raft_consensus.cc:2804] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Leader election won for term 20
I20260709 14:53:34.766948 14353 raft_consensus.cc:697] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:53:34.768034 14353 consensus_queue.cc:237] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:34.768527  7919 raft_consensus.cc:1275] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 14:53:34.769487 14342 raft_consensus.cc:2804] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Leader election won for term 21
I20260709 14:53:34.770072  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:34.771095  7920 raft_consensus.cc:1275] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 14:53:34.771430  7924 raft_consensus.cc:1275] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 14:53:34.772212  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 26 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:34.772624  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:34.773126  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:34.774242  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:34.778142  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:34.771668  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:34.770159 14342 raft_consensus.cc:697] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:53:34.782204  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:34.782827 14342 consensus_queue.cc:237] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:34.772511  7851 raft_consensus.cc:1275] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 14:53:34.785585  7928 raft_consensus.cc:2468] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 23.
I20260709 14:53:34.754688 14244 raft_consensus.cc:2804] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 14:53:34.789207 13835 leader_election.cc:290] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 20 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:53:34.766553  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 167122us
I20260709 14:53:34.757803 14386 raft_consensus.cc:3060] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Advancing to term 18
I20260709 14:53:34.762331  7745 leader_election.cc:304] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 3876b8ee8d744cb18e91d97aae93b1ac, 9418391fa82a42c79c6cad13ba91d964
I20260709 14:53:34.758555 14395 raft_consensus.cc:2804] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 14:53:34.765659 14391 consensus_queue.cc:1059] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.025s
I20260709 14:53:34.743198 14088 consensus_queue.cc:237] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:34.787798 14306 raft_consensus.cc:2804] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 24 FOLLOWER]: Leader election won for term 24
W20260709 14:53:34.804899  7893 leader_election.cc:336] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Timed out: RequestConsensusVote RPC to 127.6.101.65:40587 timed out after 1.538s (SENT)
I20260709 14:53:34.805449 14055 consensus_queue.cc:1048] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 14:53:34.806018 14220 raft_consensus.cc:2749] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 14:53:34.791031 14382 raft_consensus.cc:2804] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 14:53:34.797988 14395 raft_consensus.cc:493] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:34.816756 14395 raft_consensus.cc:3060] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Advancing to term 21
I20260709 14:53:34.805059  7744 leader_election.cc:304] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 9418391fa82a42c79c6cad13ba91d964
I20260709 14:53:34.811122  7893 leader_election.cc:304] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:34.760485 14374 raft_consensus.cc:515] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:34.819391 13835 consensus_queue.cc:1048] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 14:53:34.823300  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:34.824221  7851 raft_consensus.cc:3060] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Advancing to term 20
I20260709 14:53:34.798681 14276 consensus_queue.cc:1048] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.026s
I20260709 14:53:34.820612 14382 raft_consensus.cc:697] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:34.831179 14398 raft_consensus.cc:3060] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [term 2 FOLLOWER]: Advancing to term 3
W20260709 14:53:34.845409  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 50820.3us
I20260709 14:53:34.841665  7851 raft_consensus.cc:2468] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 20.
I20260709 14:53:34.852648  7894 leader_election.cc:304] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:34.848985  7744 leader_election.cc:304] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:53:34.854048  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 49221.7us
I20260709 14:53:34.828647 14306 raft_consensus.cc:697] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 24 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:53:34.835350 14291 raft_consensus.cc:2749] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 14:53:34.862406  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 69499.6us
I20260709 14:53:34.858837 14375 raft_consensus.cc:2804] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 14:53:34.867938 14375 raft_consensus.cc:697] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:34.869226 14375 consensus_queue.cc:237] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:34.870644 14374 leader_election.cc:290] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 23 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:34.864442  7819 leader_election.cc:304] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:34.876626  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:34.876184  7851 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258"
dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
mode: GRACEFUL
new_leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
 from {username='slave'} at 127.0.0.1:41662
I20260709 14:53:34.878631  7851 raft_consensus.cc:606] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 22 FOLLOWER]: Received request to transfer leadership to TS 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:53:34.879354  7851 raft_consensus.cc:614] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 22 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 14:53:34.880554  6549 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 14:53:34.883986  6549 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 14:53:34.894556  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:34.858770 14378 raft_consensus.cc:2764] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
W20260709 14:53:34.902889  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 54097.9us
I20260709 14:53:34.901772  7928 raft_consensus.cc:1275] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
W20260709 14:53:34.897390  7893 leader_election.cc:336] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Timed out: RequestConsensusVote RPC to 127.6.101.65:40587 timed out after 1.529s (SENT)
I20260709 14:53:34.905911  7851 raft_consensus.cc:3060] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 22 FOLLOWER]: Advancing to term 23
I20260709 14:53:34.856803 14306 consensus_queue.cc:237] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:34.863628 14353 consensus_queue.cc:1048] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 14:53:34.837378 14244 raft_consensus.cc:697] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:34.909597 14382 consensus_queue.cc:237] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:34.915728  7744 leader_election.cc:304] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:34.894305 14276 raft_consensus.cc:2764] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 24 FOLLOWER]: Leader election decision vote started in defunct term 23: won
I20260709 14:53:34.930012  7851 raft_consensus.cc:2468] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 23.
W20260709 14:53:34.921144  7745 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:34.921869 14378 raft_consensus.cc:493] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:34.953914 14386 raft_consensus.cc:2749] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529) with higher term. Message: Invalid argument: T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 17. Current term is 18.
I20260709 14:53:34.955334 14386 raft_consensus.cc:2749] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 22 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 14:53:34.922986 14342 consensus_queue.cc:1048] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
W20260709 14:53:34.966194  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 53240.5us
I20260709 14:53:34.937498  7894 leader_election.cc:304] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
W20260709 14:53:34.990224  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 52796.2us
I20260709 14:53:35.001168  7849 raft_consensus.cc:1275] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 22 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 14:53:35.011639  7846 raft_consensus.cc:1275] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 23 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 14:53:34.996649 14244 consensus_queue.cc:237] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:34.966578 14378 raft_consensus.cc:515] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:35.007956 14376 raft_consensus.cc:2804] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 23 FOLLOWER]: Leader election won for term 23
W20260709 14:53:35.072137  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 49587.7us
I20260709 14:53:35.085377 14376 raft_consensus.cc:697] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 23 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:35.064390 14398 raft_consensus.cc:2749] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 14:53:35.118501  7928 raft_consensus.cc:1240] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 18. Current term is 19. Ops: []
I20260709 14:53:35.069670 14307 raft_consensus.cc:515] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:53:35.098644 14397 log.cc:927] Time spent T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.273s	user 0.001s	sys 0.003s
I20260709 14:53:35.073987 14395 raft_consensus.cc:515] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:35.083488 14081 consensus_queue.cc:1048] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.047s
I20260709 14:53:35.129961 14386 raft_consensus.cc:493] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:35.146080 14341 raft_consensus.cc:3055] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 LEADER]: Stepping down as leader of term 18
I20260709 14:53:35.088020 14295 consensus_queue.cc:1048] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.047s
I20260709 14:53:35.158321  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:53:35.192930  7742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:35.153156 14378 leader_election.cc:290] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:35.194729 14378 raft_consensus.cc:493] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:35.195539 14378 raft_consensus.cc:515] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:35.199148 14395 leader_election.cc:290] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 21 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:53:35.201444 14397 log.cc:927] Time spent T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 14:53:35.164458 14341 raft_consensus.cc:740] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
W20260709 14:53:35.204452  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 288838us
W20260709 14:53:35.193265 14411 log.cc:927] Time spent T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 14:53:35.172152 14386 raft_consensus.cc:515] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:53:35.212864  7893 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.101.65:40587 timed out after 1.803s (SENT) [suppressed 46 similar messages]
W20260709 14:53:35.220718  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 62584.7us
W20260709 14:53:35.217613 14419 log.cc:927] Time spent T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.083s	user 0.003s	sys 0.000s
I20260709 14:53:35.234503  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:35.237073  7744 leader_election.cc:304] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:35.241263  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:35.242857  7846 raft_consensus.cc:3060] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 22 FOLLOWER]: Advancing to term 23
I20260709 14:53:35.243954 14306 raft_consensus.cc:493] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
W20260709 14:53:35.277076  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 56910.2us
I20260709 14:53:35.278611  7744 leader_election.cc:304] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:35.280126  7744 leader_election.cc:304] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:35.281399 14398 raft_consensus.cc:2749] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 14:53:35.282342 14398 raft_consensus.cc:2804] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader election won for term 16
I20260709 14:53:35.282476  7744 leader_election.cc:304] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:35.282895 14398 raft_consensus.cc:697] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:53:35.283983 14398 consensus_queue.cc:237] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:35.244765 14306 raft_consensus.cc:515] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:35.297629 14386 leader_election.cc:290] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:35.298427 14386 raft_consensus.cc:2749] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 14:53:35.298620 14306 leader_election.cc:290] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:35.300738 14307 leader_election.cc:290] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 23 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:35.205663 14341 consensus_queue.cc:260] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:35.155150 14376 consensus_queue.cc:237] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:35.306000 14341 raft_consensus.cc:3060] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Advancing to term 19
I20260709 14:53:35.308869 14378 leader_election.cc:290] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:53:35.306339 14055 consensus_queue.cc:1175] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "1e9289592458429bbddb19c2e7b7b7b0" responder_term: 19 status { last_received { term: 18 index: 12 } last_committed_idx: 12 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 18. Current term is 19. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 14:53:35.286571 14395 raft_consensus.cc:2749] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 14:53:35.317137  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:35.317672  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:35.318171  7853 raft_consensus.cc:2468] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 18.
I20260709 14:53:35.329758  7745 leader_election.cc:304] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:35.335671  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:53:35.338353  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 55955.3us
I20260709 14:53:35.339510  7744 leader_election.cc:304] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:35.346897  7744 leader_election.cc:304] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:35.344837 14378 raft_consensus.cc:2804] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 14:53:35.354239 14423 raft_consensus.cc:2749] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 14:53:35.364254 14378 raft_consensus.cc:493] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:35.376955 14378 raft_consensus.cc:3060] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Advancing to term 19
I20260709 14:53:35.382205 14307 raft_consensus.cc:2764] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 22 FOLLOWER]: Leader pre-election decision vote started in defunct term 21: won
W20260709 14:53:35.388226  7893 leader_election.cc:336] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Timed out: RequestConsensusVote RPC to 127.6.101.65:40587 timed out after 1.750s (SENT)
W20260709 14:53:35.405490  7893 leader_election.cc:336] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Timed out: RequestConsensusVote RPC to 127.6.101.65:40587 timed out after 1.780s (SENT)
I20260709 14:53:35.406340  7744 leader_election.cc:400] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 24 election: Vote denied by peer 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785) with higher term. Message: Invalid argument: T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 24. Current term is 25.
I20260709 14:53:35.405808  7851 raft_consensus.cc:2468] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 19.
W20260709 14:53:35.396445  7819 leader_election.cc:336] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Timed out: RequestConsensusVote RPC to 127.6.101.65:40587 timed out after 1.535s (SENT)
I20260709 14:53:35.408373  7819 leader_election.cc:304] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:35.405997  7893 leader_election.cc:304] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:35.410034  7928 raft_consensus.cc:1275] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 14:53:35.410471  7927 raft_consensus.cc:1275] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 14:53:35.408470  7744 leader_election.cc:304] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:53:35.423444  7893 leader_election.cc:336] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Timed out: RequestConsensusVote RPC to 127.6.101.65:40587 timed out after 1.786s (SENT)
I20260709 14:53:35.423957 14295 raft_consensus.cc:2749] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 14:53:35.428243  7926 raft_consensus.cc:1275] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
W20260709 14:53:35.429138 14429 log.cc:927] Time spent T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
W20260709 14:53:35.425657 14427 log.cc:927] Time spent T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 14:53:35.435711  7847 raft_consensus.cc:1275] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 14:53:35.439267 14378 raft_consensus.cc:515] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:35.441455  7847 raft_consensus.cc:1275] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
W20260709 14:53:35.439136 14384 log.cc:927] Time spent T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 14:53:35.444111 14423 raft_consensus.cc:2749] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 14:53:35.444283 14395 raft_consensus.cc:493] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:35.445472 14395 raft_consensus.cc:515] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:35.447009  7744 leader_election.cc:304] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:53:35.447880  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 51496.3us
W20260709 14:53:35.449833  7819 leader_election.cc:336] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Timed out: RequestConsensusVote RPC to 127.6.101.65:40587 timed out after 1.537s (SENT)
I20260709 14:53:35.450341  7819 leader_election.cc:304] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:35.455024  7744 leader_election.cc:400] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 pre-election: Vote denied by peer 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785) with higher term. Message: Invalid argument: T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 18. Current term is 19.
I20260709 14:53:35.455919  7744 leader_election.cc:403] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 14:53:35.483191  7851 raft_consensus.cc:1275] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 14:53:35.484206  7744 leader_election.cc:304] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:35.483148  7846 raft_consensus.cc:2468] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 23.
I20260709 14:53:35.487895 14306 raft_consensus.cc:2749] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 14:53:35.489169 14306 consensus_queue.cc:1059] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 14:53:35.489473 14398 consensus_queue.cc:1048] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 14:53:35.490386 14306 consensus_queue.cc:1243] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer 1e9289592458429bbddb19c2e7b7b7b0 log is divergent from this leader: its last log entry 18.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 14:53:35.490988 14220 raft_consensus.cc:3055] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 LEADER]: Stepping down as leader of term 19
I20260709 14:53:35.491421 14220 raft_consensus.cc:740] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:53:35.491575  7744 leader_election.cc:304] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:35.499002  7744 leader_election.cc:304] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:35.464356 14341 raft_consensus.cc:2749] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 14:53:35.496480 14433 log.cc:927] Time spent T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.097s	user 0.003s	sys 0.000s
I20260709 14:53:35.485734 14423 raft_consensus.cc:2804] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 14:53:35.496345 14307 raft_consensus.cc:3060] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Advancing to term 19
I20260709 14:53:35.514969  7853 raft_consensus.cc:1275] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 14:53:35.508278  7744 leader_election.cc:304] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:35.502048 14386 raft_consensus.cc:2749] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 14:53:35.505177 14055 raft_consensus.cc:2749] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 14:53:35.514310 14306 raft_consensus.cc:2749] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 14:53:35.547914  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 98671.6us
I20260709 14:53:35.511085 14395 leader_election.cc:290] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:35.551921 14088 consensus_queue.cc:1048] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 14:53:35.552166 14296 consensus_queue.cc:1048] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 14:53:35.552567 14395 raft_consensus.cc:2749] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 14:53:35.558449 14378 leader_election.cc:290] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:35.547650 14220 consensus_queue.cc:260] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:35.516230 14423 raft_consensus.cc:493] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Starting leader election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:35.568369  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:35.569749  7854 raft_consensus.cc:2468] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 14.
W20260709 14:53:35.571257  7819 leader_election.cc:336] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Timed out: RequestConsensusVote RPC to 127.6.101.65:40587 timed out after 1.594s (SENT)
I20260709 14:53:35.563017 14423 raft_consensus.cc:3060] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Advancing to term 20
W20260709 14:53:35.572981  7819 leader_election.cc:336] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Timed out: RequestConsensusVote RPC to 127.6.101.65:40587 timed out after 1.595s (SENT)
I20260709 14:53:35.580376  7819 leader_election.cc:304] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:35.584748 14391 raft_consensus.cc:2749] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 23 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
W20260709 14:53:35.585650  7819 leader_election.cc:336] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Timed out: RequestConsensusVote RPC to 127.6.101.65:40587 timed out after 1.619s (SENT)
W20260709 14:53:35.582856  7893 leader_election.cc:336] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Timed out: RequestConsensusVote RPC to 127.6.101.65:40587 timed out after 1.500s (SENT)
I20260709 14:53:35.586519  7819 leader_election.cc:304] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:35.587741 14391 raft_consensus.cc:2749] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 14:53:35.624954  7847 raft_consensus.cc:1275] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 14:53:35.591213 14220 raft_consensus.cc:3060] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Advancing to term 20
W20260709 14:53:35.602555 14432 log.cc:927] Time spent T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.203s	user 0.000s	sys 0.010s
W20260709 14:53:35.638768  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:35.606158 14306 raft_consensus.cc:493] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:35.655064 14306 raft_consensus.cc:515] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:35.649796  7849 raft_consensus.cc:1275] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 14:53:35.622290 14386 raft_consensus.cc:493] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:35.575457 14295 consensus_queue.cc:1048] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.046s
I20260709 14:53:35.591683 14375 consensus_queue.cc:1048] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.063s
W20260709 14:53:35.676828 14419 log.cc:927] Time spent T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 14:53:35.670006 14056 consensus_queue.cc:1048] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.031s
I20260709 14:53:35.674305 14276 consensus_queue.cc:1048] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 14:53:35.689571 14353 consensus_queue.cc:1048] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.033s
I20260709 14:53:35.677295 14386 raft_consensus.cc:515] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:35.704720 14350 consensus_queue.cc:1048] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.022s
W20260709 14:53:35.743948  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 237430us
I20260709 14:53:35.746053  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 25 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:35.747730  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:35.748124  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:35.748948  7770 raft_consensus.cc:2468] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 18.
I20260709 14:53:35.749001  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:35.749804  7775 raft_consensus.cc:2468] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 19.
I20260709 14:53:35.750434 14306 leader_election.cc:290] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:35.747885  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:35.751223  7771 raft_consensus.cc:2468] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 19.
I20260709 14:53:35.751924  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:35.752849  7779 raft_consensus.cc:2368] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 22. Current term is 23.
I20260709 14:53:35.754199 14423 raft_consensus.cc:515] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:35.757826  7745 leader_election.cc:304] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:35.763042  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:35.763996  7773 raft_consensus.cc:2393] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 21: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:53:35.765928  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:35.767077  7772 raft_consensus.cc:2410] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for term 22 because replica has last-logged OpId of term: 20 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 11.
I20260709 14:53:35.769407 14306 raft_consensus.cc:2804] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 14:53:35.769912 14306 raft_consensus.cc:493] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting leader election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:35.770268 14306 raft_consensus.cc:3060] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Advancing to term 19
I20260709 14:53:35.771665 14307 raft_consensus.cc:2749] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785) with higher term. Message: Invalid argument: T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 18. Current term is 19.
I20260709 14:53:35.756687 14423 leader_election.cc:290] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 20 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:35.773604  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:35.774276  7776 raft_consensus.cc:3060] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 22 FOLLOWER]: Advancing to term 23
I20260709 14:53:35.771715  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:35.778329  7779 raft_consensus.cc:2468] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 19.
I20260709 14:53:35.779982  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:35.780893  7777 raft_consensus.cc:2410] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for term 20 because replica has last-logged OpId of term: 19 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
I20260709 14:53:35.780987  7770 raft_consensus.cc:2368] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 20. Current term is 21.
I20260709 14:53:35.785887  7745 leader_election.cc:304] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:35.789626 14423 raft_consensus.cc:493] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:35.796710 14423 raft_consensus.cc:515] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:35.797461 14386 leader_election.cc:290] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:35.794813  7776 raft_consensus.cc:2468] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 23.
I20260709 14:53:35.796132 14220 raft_consensus.cc:2804] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 23 FOLLOWER]: Leader election won for term 23
I20260709 14:53:35.798631  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:35.799376  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:35.800161  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:35.802256  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:35.802795  7775 raft_consensus.cc:3060] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Advancing to term 22
I20260709 14:53:35.803326  7776 raft_consensus.cc:2468] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 18.
I20260709 14:53:35.812556  7774 raft_consensus.cc:2368] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 14. Current term is 15.
I20260709 14:53:35.825948  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:35.826777  7777 raft_consensus.cc:2468] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 20.
W20260709 14:53:35.838862  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 147836us
I20260709 14:53:35.813330 14376 raft_consensus.cc:493] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:35.822520 14220 raft_consensus.cc:697] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 23 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
W20260709 14:53:35.879635  7819 leader_election.cc:336] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Timed out: RequestConsensusVote RPC to 127.6.101.65:40587 timed out after 1.589s (SENT)
I20260709 14:53:35.880573  7745 leader_election.cc:304] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:35.884177  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:35.886016  7774 raft_consensus.cc:2393] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 14: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:53:35.886821  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:35.887604  7854 raft_consensus.cc:3060] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Advancing to term 19
I20260709 14:53:35.889074  7775 raft_consensus.cc:2468] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 22.
I20260709 14:53:35.895308  7849 raft_consensus.cc:1275] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 24 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 14:53:35.896423  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:35.897459  7845 raft_consensus.cc:2368] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 20. Current term is 21.
I20260709 14:53:35.900473  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:35.903823  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:35.938237  6549 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 14:53:35.891358 14424 log.cc:927] Time spent T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 14:53:35.911232  7745 leader_election.cc:400] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 20 election: Vote denied by peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529) with higher term. Message: Invalid argument: T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 20. Current term is 21.
I20260709 14:53:35.881482 14423 leader_election.cc:290] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:35.941534  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:35.948508  7745 leader_election.cc:403] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 20 election: Cancelling election due to peer responding with higher term
I20260709 14:53:35.907196 14431 raft_consensus.cc:2804] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 14:53:35.961853  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:35.962674  7854 raft_consensus.cc:2468] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 19.
I20260709 14:53:35.876392 14376 raft_consensus.cc:515] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:35.963631  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:35.967757  7777 raft_consensus.cc:2468] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 18.
W20260709 14:53:35.973100  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 64834.6us
I20260709 14:53:35.971140  7774 raft_consensus.cc:2468] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 22.
I20260709 14:53:35.976188 14398 raft_consensus.cc:3060] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Advancing to term 21
I20260709 14:53:35.976320  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783e4874513449ef9084b833f188a6d3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:35.985984  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:35.986263  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:35.986999  7776 raft_consensus.cc:2368] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 14. Current term is 15.
I20260709 14:53:35.985996  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:35.988416  7779 raft_consensus.cc:2410] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for term 20 because replica has last-logged OpId of term: 19 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
I20260709 14:53:35.989351  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:35.993510  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:35.994249  7776 raft_consensus.cc:2468] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 20.
I20260709 14:53:35.964526  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:35.995251  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:35.995887  7776 raft_consensus.cc:3060] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Advancing to term 18
I20260709 14:53:35.938369 14307 consensus_queue.cc:1048] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.032s
I20260709 14:53:36.002666  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:36.018426  7770 raft_consensus.cc:2368] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 20. Current term is 21.
W20260709 14:53:36.003338 14448 log.cc:927] Time spent T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260709 14:53:36.001534  7775 raft_consensus.cc:2468] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 20.
I20260709 14:53:36.012174 14376 leader_election.cc:290] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:36.002924  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:36.021610  7779 raft_consensus.cc:3060] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Advancing to term 20
I20260709 14:53:36.026012  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:36.027067  7775 raft_consensus.cc:3060] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 22 FOLLOWER]: Advancing to term 23
I20260709 14:53:36.028175  7778 raft_consensus.cc:2468] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 19.
I20260709 14:53:36.037321  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:36.038638  7778 raft_consensus.cc:2468] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 18.
I20260709 14:53:36.040441  7770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:36.040705  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:36.043195  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:36.043762  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:36.043978  7771 raft_consensus.cc:3060] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Advancing to term 19
I20260709 14:53:36.044378  7778 raft_consensus.cc:3060] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Advancing to term 20
I20260709 14:53:36.045921  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:36.046581  7774 raft_consensus.cc:2376] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 19. Re-sending same reply.
I20260709 14:53:36.047435  7776 raft_consensus.cc:2468] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 18.
I20260709 14:53:36.048391  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:36.049285  7774 raft_consensus.cc:2376] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 22 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 22. Re-sending same reply.
I20260709 14:53:36.050246  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:36.050952  7774 raft_consensus.cc:2468] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 21.
I20260709 14:53:36.048444  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:36.052388  7776 raft_consensus.cc:2410] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for term 20 because replica has last-logged OpId of term: 19 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
I20260709 14:53:36.052582  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:36.053561  7777 raft_consensus.cc:2368] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 18. Current term is 19.
W20260709 14:53:36.063457  7893 leader_election.cc:336] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Timed out: RequestConsensusVote RPC to 127.6.101.65:40587 timed out after 1.884s (SENT)
I20260709 14:53:36.066606  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:36.066778  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
W20260709 14:53:36.058236  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 383569us
I20260709 14:53:36.082888  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:36.083779  7774 raft_consensus.cc:2468] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 20.
I20260709 14:53:36.085108  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:36.089797 14460 raft_consensus.cc:493] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:35.986434 14220 consensus_queue.cc:237] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:36.090677 14460 raft_consensus.cc:515] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:36.094096  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:36.084933  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:36.098027  7774 raft_consensus.cc:2468] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 21.
I20260709 14:53:36.102629 14431 raft_consensus.cc:493] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:36.103209 14431 raft_consensus.cc:3060] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Advancing to term 15
I20260709 14:53:36.105548 14081 consensus_queue.cc:1048] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 14:53:36.106241  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:36.045485 14398 raft_consensus.cc:2749] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Leader election lost for term 20. Reason: Vote denied by peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529) with higher term. Message: Invalid argument: T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 20. Current term is 21.
I20260709 14:53:36.109961  7854 raft_consensus.cc:1275] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 14:53:36.111207  7779 raft_consensus.cc:2468] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 20.
I20260709 14:53:36.112677  7775 raft_consensus.cc:2468] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 23.
I20260709 14:53:36.123646  7776 raft_consensus.cc:2468] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 18.
I20260709 14:53:36.140231  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:36.056093 14449 raft_consensus.cc:493] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:36.141918  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:36.118865  7745 leader_election.cc:304] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:36.155508  7778 raft_consensus.cc:2468] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 20.
I20260709 14:53:36.168684  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 26 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
W20260709 14:53:36.169576  7819 leader_election.cc:336] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Timed out: RequestConsensusVote RPC to 127.6.101.65:40587 timed out after 1.632s (SENT)
I20260709 14:53:36.169651  7779 raft_consensus.cc:2468] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 25.
I20260709 14:53:36.172766  7771 raft_consensus.cc:2468] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 19.
I20260709 14:53:36.180207  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:36.181975 14460 leader_election.cc:290] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:36.105008 14306 raft_consensus.cc:515] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:36.175168 14449 raft_consensus.cc:515] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:36.190353  7850 raft_consensus.cc:1275] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 23 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 14:53:36.191421  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:36.197911  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:36.226375  7773 raft_consensus.cc:3055] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 LEADER]: Stepping down as leader of term 16
I20260709 14:53:36.226756  7775 raft_consensus.cc:2468] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 15.
I20260709 14:53:36.199791  7852 raft_consensus.cc:1275] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 14:53:36.182297  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:36.226781  7773 raft_consensus.cc:740] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:53:36.228404  7920 raft_consensus.cc:3060] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 23 FOLLOWER]: Advancing to term 24
W20260709 14:53:36.211108  7819 leader_election.cc:336] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Timed out: RequestConsensusVote RPC to 127.6.101.65:40587 timed out after 1.647s (SENT)
W20260709 14:53:36.212123  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:36.225975  7849 raft_consensus.cc:2468] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 22.
W20260709 14:53:36.235944  7819 leader_election.cc:336] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Timed out: RequestConsensusVote RPC to 127.6.101.65:40587 timed out after 1.690s (SENT)
I20260709 14:53:36.230293  7773 consensus_queue.cc:260] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:36.176816 14307 raft_consensus.cc:2804] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Leader election won for term 19
I20260709 14:53:36.218155  7776 raft_consensus.cc:2468] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 23.
I20260709 14:53:36.240934  7773 raft_consensus.cc:3060] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Advancing to term 17
W20260709 14:53:36.240911  7819 leader_election.cc:336] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Timed out: RequestConsensusVote RPC to 127.6.101.65:40587 timed out after 1.690s (SENT)
I20260709 14:53:36.246253  7819 leader_election.cc:304] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:36.245978  7776 raft_consensus.cc:1275] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 22 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 14:53:36.254688  7777 raft_consensus.cc:2393] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 19: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:53:36.257817  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:36.249729 14307 raft_consensus.cc:697] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:53:36.256316  7776 raft_consensus.cc:1275] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 14:53:36.262814 14307 consensus_queue.cc:237] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:36.265534 14459 consensus_queue.cc:1048] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 14:53:36.268752 14452 log.cc:927] Time spent T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.428s	user 0.010s	sys 0.012s
I20260709 14:53:36.269225  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:36.271374  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:36.277552  7774 raft_consensus.cc:2468] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 18.
I20260709 14:53:36.279038  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:36.279884  7774 raft_consensus.cc:2376] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 21. Re-sending same reply.
I20260709 14:53:36.256966 14398 raft_consensus.cc:493] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:36.289126  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:36.290365  7779 raft_consensus.cc:1275] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 23 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 14:53:36.290612  7774 raft_consensus.cc:2368] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 22. Current term is 23.
I20260709 14:53:36.282454  7776 raft_consensus.cc:2468] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 20.
I20260709 14:53:36.309558  7770 raft_consensus.cc:2468] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 21.
I20260709 14:53:36.326906  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:36.327397  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:36.328158  7775 raft_consensus.cc:2376] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 19. Re-sending same reply.
I20260709 14:53:36.328215  7779 raft_consensus.cc:2368] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 17. Current term is 18.
I20260709 14:53:36.330541  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:36.331208  7779 raft_consensus.cc:2376] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 20. Re-sending same reply.
I20260709 14:53:36.331691  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:36.332158  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:36.333403  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
W20260709 14:53:36.334136  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 93264.5us
W20260709 14:53:36.335148  7819 leader_election.cc:336] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Timed out: RequestConsensusVote RPC to 127.6.101.65:40587 timed out after 1.748s (SENT)
I20260709 14:53:36.335690  7819 leader_election.cc:304] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:36.332572  7774 raft_consensus.cc:2376] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 25 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 25. Re-sending same reply.
I20260709 14:53:36.352617  7773 raft_consensus.cc:1275] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 11. (term mismatch)
I20260709 14:53:36.353420  7773 pending_rounds.cc:85] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed: Aborting all ops after (but not including) 10
I20260709 14:53:36.353749  7773 pending_rounds.cc:107] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed: Aborting uncommitted NO_OP operation due to leader change: 16.11
I20260709 14:53:36.354060  7773 raft_consensus.cc:2889] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:53:36.357609  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:36.360628  7776 raft_consensus.cc:2368] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 19. Current term is 20.
I20260709 14:53:36.371667  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:36.375602  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:36.376467  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:36.377776  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:36.377957  7776 raft_consensus.cc:2376] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 21. Re-sending same reply.
I20260709 14:53:36.378444  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:36.379885  7774 raft_consensus.cc:2393] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 21: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:53:36.383438  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:36.383929  7779 raft_consensus.cc:2376] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 15. Re-sending same reply.
W20260709 14:53:36.384424  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 76940.2us
I20260709 14:53:36.385857  7773 raft_consensus.cc:2376] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 19. Re-sending same reply.
I20260709 14:53:36.393069  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:36.393905  7776 raft_consensus.cc:2393] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 23: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:53:36.400180  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:36.445775 14453 raft_consensus.cc:2749] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 14:53:36.451362  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:36.453531  7776 raft_consensus.cc:2368] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 21. Current term is 22.
W20260709 14:53:36.454852  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 119745us
W20260709 14:53:36.455816  7819 leader_election.cc:336] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Timed out: RequestConsensusVote RPC to 127.6.101.65:40587 timed out after 1.751s (SENT)
I20260709 14:53:36.456547  7819 leader_election.cc:304] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
W20260709 14:53:36.457978  7819 leader_election.cc:336] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Timed out: RequestConsensusVote RPC to 127.6.101.65:40587 timed out after 1.769s (SENT)
I20260709 14:53:36.458653  7819 leader_election.cc:304] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
/apache/dev/git/kudu/src/kudu/master/auto_leader_rebalancer-test.cc:340: Failure
Failed
Bad status: Illegal state: leader_transfer_task size should be 0, but 6
I20260709 14:53:36.380544 14393 raft_consensus.cc:2749] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 23 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 14:53:36.467036  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:36.471938  7776 raft_consensus.cc:2376] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 20. Re-sending same reply.
I20260709 14:53:36.476501  7774 raft_consensus.cc:1275] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
/apache/dev/git/kudu/src/kudu/util/test_util.cc:402: Failure
Failed
Timed out waiting for assertion to pass.
I20260709 14:53:36.336552 14431 raft_consensus.cc:515] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:36.479133  7774 raft_consensus.cc:1275] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 14:53:36.326665 14398 raft_consensus.cc:515] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:36.481048  7776 raft_consensus.cc:1275] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 14:53:36.483860  7774 raft_consensus.cc:1275] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 14:53:36.486618  7774 raft_consensus.cc:1275] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 14:53:36.488478  7774 raft_consensus.cc:1275] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 14:53:36.490082  7774 raft_consensus.cc:3060] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:53:36.495127  7775 raft_consensus.cc:2368] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 14. Current term is 15.
I20260709 14:53:36.479341 14405 raft_consensus.cc:2749] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 14:53:36.496914  7819 leader_election.cc:336] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Timed out: RequestConsensusVote RPC to 127.6.101.65:40587 timed out after 1.771s (SENT)
I20260709 14:53:36.479043 14341 raft_consensus.cc:2749] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 25 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 14:53:36.552065  8599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 245483us
I20260709 14:53:36.523209  7894 leader_election.cc:304] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
W20260709 14:53:36.562064 14464 log.cc:927] Time spent T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
I20260709 14:53:36.563903 14462 consensus_queue.cc:1048] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 14:53:36.564818 14462 consensus_queue.cc:1243] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer 3876b8ee8d744cb18e91d97aae93b1ac log is divergent from this leader: its last log entry 15.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 14:53:36.567646 14307 raft_consensus.cc:493] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9418391fa82a42c79c6cad13ba91d964)
I20260709 14:53:36.568511 14307 raft_consensus.cc:515] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
W20260709 14:53:36.569752  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 46498.1us
I20260709 14:53:36.572831 14295 raft_consensus.cc:2804] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 14:53:36.573508 14459 consensus_queue.cc:1048] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 14:53:36.573909 14307 leader_election.cc:290] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68:42321)
W20260709 14:53:36.582706  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 85711.4us
W20260709 14:53:36.584664  7819 leader_election.cc:336] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Timed out: RequestConsensusVote RPC to 127.6.101.65:40587 timed out after 1.827s (SENT)
I20260709 14:53:36.556545  6549 tablet_server.cc:179] TabletServer@127.6.101.65:0 shutting down...
W20260709 14:53:36.589993  7819 leader_election.cc:336] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Timed out: RequestConsensusVote RPC to 127.6.101.65:40587 timed out after 1.848s (SENT)
I20260709 14:53:36.553088 14386 raft_consensus.cc:493] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:53:36.598703  7742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:36.579702 14295 raft_consensus.cc:493] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:36.603427  8640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18d29d52d304c87b930d4fb5eaf50b1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9418391fa82a42c79c6cad13ba91d964" is_pre_election: true
I20260709 14:53:36.596840 14306 leader_election.cc:290] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:53:36.614118 14421 log.cc:927] Time spent T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.100s	user 0.000s	sys 0.003s
I20260709 14:53:36.677846  7920 raft_consensus.cc:2468] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 24.
W20260709 14:53:36.690637 14478 log.cc:927] Time spent T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 14:53:36.614367 14295 raft_consensus.cc:3060] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 23 FOLLOWER]: Advancing to term 24
W20260709 14:53:36.695324 14471 log.cc:927] Time spent T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.213s	user 0.000s	sys 0.001s
I20260709 14:53:36.663973 14459 raft_consensus.cc:493] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:36.611352 14386 raft_consensus.cc:515] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:36.663086 14449 leader_election.cc:290] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:53:36.731477  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 132906us
W20260709 14:53:36.744786 14477 log.cc:927] Time spent T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.143s	user 0.001s	sys 0.000s
W20260709 14:53:36.753566 14476 log.cc:927] Time spent T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 14:53:36.719208  7774 raft_consensus.cc:1275] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Refusing update from remote peer 9418391fa82a42c79c6cad13ba91d964: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 14:53:36.723711  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 151294us
I20260709 14:53:36.767382  7847 pending_rounds.cc:85] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting all ops after (but not including) 8
I20260709 14:53:36.772668  7847 pending_rounds.cc:107] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac: Aborting uncommitted NO_OP operation due to leader change: 15.9
I20260709 14:53:36.772960  7847 raft_consensus.cc:2889] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:53:36.725288 14459 raft_consensus.cc:515] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:36.756323 14431 leader_election.cc:290] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:36.782771  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:36.788690  7848 raft_consensus.cc:2393] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 23: Already voted for candidate 1de5e20126fa4d8ca0793d19c7b847ed in this term.
I20260709 14:53:36.771888 14472 consensus_queue.cc:1048] T 9ce9c0ef2db24c13a8b1402f21819458 P 9418391fa82a42c79c6cad13ba91d964 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
W20260709 14:53:36.793409 14470 log.cc:927] Time spent T 00000000000000000000000000000000 P 133636659113430cb53b321cb0b1d9ee: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 14:53:36.793608 14459 leader_election.cc:290] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:36.776832 14398 leader_election.cc:290] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:36.776511 14307 raft_consensus.cc:493] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:36.800417  7744 leader_election.cc:304] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:53:36.804984  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 48117us
I20260709 14:53:36.816239  7774 raft_consensus.cc:1275] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 9. (term mismatch)
W20260709 14:53:36.815622  7893 leader_election.cc:336] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Timed out: RequestConsensusVote RPC to 127.6.101.65:40587 timed out after 2.092s (SENT)
I20260709 14:53:36.818949  7893 leader_election.cc:304] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:53:36.822659  7893 leader_election.cc:336] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Timed out: RequestConsensusVote RPC to 127.6.101.65:40587 timed out after 2.166s (SENT)
I20260709 14:53:36.823220  7893 leader_election.cc:304] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:53:36.865950  7893 leader_election.cc:336] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Timed out: RequestConsensusVote RPC to 127.6.101.65:40587 timed out after 2.183s (SENT)
I20260709 14:53:36.866493  7893 leader_election.cc:304] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:36.807580 14431 raft_consensus.cc:2749] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 14:53:36.913806  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 47896.8us
I20260709 14:53:36.816748  7774 pending_rounds.cc:85] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed: Aborting all ops after (but not including) 8
I20260709 14:53:36.917930  7774 pending_rounds.cc:107] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed: Aborting uncommitted NO_OP operation due to leader change: 15.9
I20260709 14:53:36.918265  7774 raft_consensus.cc:2889] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:53:36.876995 14449 raft_consensus.cc:2749] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 14:53:36.808104 14307 raft_consensus.cc:515] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:36.886245 14382 raft_consensus.cc:3060] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 14:53:36.915839 14467 raft_consensus.cc:2749] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 14:53:36.943148  7770 raft_consensus.cc:1275] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 14:53:36.941674 14306 raft_consensus.cc:493] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:36.946875 14306 raft_consensus.cc:515] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:36.935341  7774 raft_consensus.cc:1275] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 14:53:36.938715  7776 raft_consensus.cc:1275] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 14:53:36.949822 14488 raft_consensus.cc:493] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:36.950580 14488 raft_consensus.cc:515] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:36.956121 14306 leader_election.cc:290] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:36.955308 14488 leader_election.cc:290] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:53:36.973136  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 165555us
W20260709 14:53:36.985299  7742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:37.014034  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:36.973071 14386 leader_election.cc:290] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:53:37.028684  8598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 216563us
I20260709 14:53:37.033775  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:37.061790  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:37.064077  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:37.066308  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:37.067328  7920 raft_consensus.cc:2468] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 22.
W20260709 14:53:37.050698 14485 log.cc:927] Time spent T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.170s	user 0.002s	sys 0.000s
I20260709 14:53:37.090317  7776 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 4335) took 1039 ms. Trace:
I20260709 14:53:37.101708  7776 rpcz_store.cc:276] 0709 14:53:36.050539 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:53:36.488151 (+437612us) service_pool.cc:224] Handling call
0709 14:53:36.938307 (+450156us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:53:36.948572 (+ 10265us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:53:37.089882 (+141310us) spinlock_profiling.cc:243] Waited 449 ms on lock 0x7b54003e5b50. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae8d8ad 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2 00007fb6891c948c 00007fb6891c88c6 00007fb6891c826f
0709 14:53:37.090178 (+   296us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1033528704}
I20260709 14:53:37.098472 14489 raft_consensus.cc:493] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:37.112550  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:37.114710 14489 raft_consensus.cc:515] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:37.118851 14307 leader_election.cc:290] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:37.119412  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258d6c2dda954bf5b65930fde8ecb9f3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
W20260709 14:53:37.121165  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 98458.9us
I20260709 14:53:37.128172  7819 leader_election.cc:400] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 19 election: Vote denied by peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587) with higher term. Message: Invalid argument: T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 19. Current term is 20.
I20260709 14:53:37.128772  7819 leader_election.cc:403] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 14:53:37.139326  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:37.118960 14489 leader_election.cc:290] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:53:37.141953 14497 log.cc:927] Time spent T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.053s	user 0.002s	sys 0.000s
I20260709 14:53:37.142462  7819 leader_election.cc:304] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:37.146853 14489 raft_consensus.cc:2749] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 14:53:37.149300  7819 leader_election.cc:304] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:37.122133 14295 raft_consensus.cc:515] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:37.151098 14489 raft_consensus.cc:3060] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 22 FOLLOWER]: Advancing to term 23
I20260709 14:53:37.155346  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:37.159085  7819 leader_election.cc:400] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 21 pre-election: Vote denied by peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587) with higher term. Message: Invalid argument: T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 21. Current term is 22.
I20260709 14:53:37.162686  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:37.159605  7819 leader_election.cc:403] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 21 pre-election: Cancelling election due to peer responding with higher term
I20260709 14:53:37.166759  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:37.167781 14407 raft_consensus.cc:2749] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 22 FOLLOWER]: Leader pre-election lost for term 21. Reason: Vote denied by peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587) with higher term. Message: Invalid argument: T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 21. Current term is 22.
I20260709 14:53:37.168110  7921 raft_consensus.cc:2410] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for term 17 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
W20260709 14:53:37.173036  8598 consensus_peers.cc:597] T 9ce9c0ef2db24c13a8b1402f21819458 P 9418391fa82a42c79c6cad13ba91d964 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:53:37.174492  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
W20260709 14:53:37.174253  8598 consensus_peers.cc:597] T 9441e831627143a991a1556dcdce71e3 P 9418391fa82a42c79c6cad13ba91d964 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:53:37.175643  7921 raft_consensus.cc:2468] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 18.
I20260709 14:53:37.187652 14489 raft_consensus.cc:2749] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 14:53:37.188442  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:37.191210  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
W20260709 14:53:37.178869  8598 consensus_peers.cc:597] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:53:37.193657 14489 consensus_queue.cc:1048] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 14:53:37.196516  7851 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 5231) took 1588 ms. Trace:
I20260709 14:53:37.196787 14407 consensus_queue.cc:1048] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 14:53:37.197229  7851 rpcz_store.cc:276] 0709 14:53:35.607739 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:53:35.608076 (+   337us) service_pool.cc:224] Handling call
0709 14:53:35.608726 (+   650us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:53:35.667206 (+ 58480us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 14:53:35.876744 (+209538us) log.cc:844] Serialized 14 byte log entry
0709 14:53:35.998249 (+121505us) log.cc:844] Serialized 14 byte log entry
0709 14:53:36.015478 (+ 17229us) log.cc:844] Serialized 14 byte log entry
0709 14:53:36.031729 (+ 16251us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:53:36.056096 (+ 24367us) log.cc:844] Serialized 26 byte log entry
0709 14:53:36.056290 (+   194us) raft_consensus.cc:1645] Marking committed up to 12
0709 14:53:36.056334 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:53:36.056419 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:53:36.099252 (+ 42833us) spinlock_profiling.cc:243] Waited 9.14 ms on lock 0x7b18003c6a00. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb690c69de1 00007fb690c765b1 00007fb687da13f3 00007fb687da37c1 00007fb687da3779 00007fb687da3709 00007fb687da36d1 00007fb687da29cd 0000000000396ad4 0000000000396919 00007fb687d8483a
0709 14:53:36.106913 (+  7661us) spinlock_profiling.cc:243] Waited 3.19 ms on lock 0x7b18003c6a00. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb690c69de1 00007fb690c765b1 00007fb687da1522 00007fb687da37c1 00007fb687da3779 00007fb687da3709 00007fb687da36d1 00007fb687da29cd 0000000000396ad4 0000000000396919 00007fb687d8483a
0709 14:53:37.189161 (+1082248us) spinlock_profiling.cc:243] Waited 18.8 ms on lock 0x7b18003c6a00. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb690c69de1 00007fb690c765b1 00007fb687d6f2a6 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb690c69de1 00007fb690c765b1 00007fb687da13f3 00007fb687da37c1
0709 14:53:37.192362 (+  3201us) spinlock_profiling.cc:243] Waited 14.5 ms on lock 0x7b18003c6a00. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb690c69de1 00007fb690c765b1 00007fb687da13f3 00007fb687da37c1 00007fb687da3779 00007fb687da3709 00007fb687da36d1 00007fb687da29cd 0000000000396ad4 0000000000396919 00007fb687d8483a
0709 14:53:37.196197 (+  3835us) raft_consensus.cc:1685] finished
0709 14:53:37.196226 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:53:37.196408 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":119356,"prepare.queue_time_us":122066,"prepare.run_cpu_time_us":121,"prepare.run_wall_time_us":127,"raft.queue_time_us":111980,"raft.run_cpu_time_us":439,"raft.run_wall_time_us":18694,"spinlock_wait_cycles":104825984,"thread_start_us":166619,"threads_started":2,"wal-append.queue_time_us":93349}
I20260709 14:53:37.196844 14295 leader_election.cc:290] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 24 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:37.196547 14501 consensus_queue.cc:1048] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
W20260709 14:53:37.210629 14466 log.cc:927] Time spent T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.730s	user 0.009s	sys 0.009s
I20260709 14:53:37.211488  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18d29d52d304c87b930d4fb5eaf50b1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:37.213928  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:37.212847  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:37.220785  7849 raft_consensus.cc:3060] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Advancing to term 15
I20260709 14:53:37.221755  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:37.229089  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:37.231630  7850 raft_consensus.cc:1275] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 23 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 14:53:37.233450  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:37.244097  7847 raft_consensus.cc:1275] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 14:53:37.246856  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:37.247637  7927 raft_consensus.cc:2468] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 17.
W20260709 14:53:37.245191  7819 leader_election.cc:336] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Timed out: RequestConsensusVote RPC to 127.6.101.65:40587 timed out after 2.051s (SENT)
I20260709 14:53:37.250731  7819 leader_election.cc:304] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:37.256271  7853 raft_consensus.cc:2468] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 19.
I20260709 14:53:37.259779  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
W20260709 14:53:37.260980  7819 leader_election.cc:336] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Timed out: RequestConsensusVote RPC to 127.6.101.65:40587 timed out after 2.111s (SENT)
I20260709 14:53:37.262157  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:37.263003  7927 raft_consensus.cc:2393] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 19: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:53:37.258323 14407 raft_consensus.cc:2749] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 14:53:37.275267 14479 log.cc:927] Time spent T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.572s	user 0.004s	sys 0.005s
W20260709 14:53:37.277997 14474 log.cc:927] Time spent T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.612s	user 0.000s	sys 0.002s
W20260709 14:53:37.282387  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:37.290577  7849 raft_consensus.cc:2468] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 15.
I20260709 14:53:37.294476 14394 raft_consensus.cc:493] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:37.295047 14394 raft_consensus.cc:515] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:37.295619  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:37.297233  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:37.297669  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:37.299209 14382 raft_consensus.cc:2749] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 14:53:37.299863  7923 raft_consensus.cc:1275] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 24 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 14:53:37.301326  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:37.302066  7923 raft_consensus.cc:3060] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Advancing to term 19
I20260709 14:53:37.305555  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:37.307523  7745 leader_election.cc:304] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 3876b8ee8d744cb18e91d97aae93b1ac, 9418391fa82a42c79c6cad13ba91d964
I20260709 14:53:37.307559 14491 raft_consensus.cc:493] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9418391fa82a42c79c6cad13ba91d964)
I20260709 14:53:37.306559  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:37.314839  7845 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 5252) took 1085 ms. Trace:
I20260709 14:53:37.316148 14488 raft_consensus.cc:2749] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 14:53:37.317631  7924 raft_consensus.cc:2468] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 14.
I20260709 14:53:37.318440  7923 raft_consensus.cc:2468] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 19.
I20260709 14:53:37.320600  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:37.321810  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:37.322101  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:37.315521  7845 rpcz_store.cc:276] 0709 14:53:36.229693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:53:36.229952 (+   259us) service_pool.cc:224] Handling call
0709 14:53:36.230337 (+   385us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:53:36.245084 (+ 14747us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:53:36.245126 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:53:36.253632 (+  8506us) log.cc:844] Serialized 26 byte log entry
0709 14:53:36.479420 (+225788us) raft_consensus.cc:1645] Marking committed up to 9
0709 14:53:36.479473 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:53:36.479565 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:53:37.276954 (+797389us) spinlock_profiling.cc:243] Waited 37.2 ms on lock 0x7b4400022b4c. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb687c29db1 00007fb687cc7c85 00007fb687cc86a2 00007fb68aa3a1db 00007fb68aa35aaf 00007fb68aa2986e 00007fb68aa28bb6 00007fb68aa287d8 00007fb68aa32221 00007fb68aa321d9 00007fb68aa32169
0709 14:53:37.313973 (+ 37019us) raft_consensus.cc:1685] finished
0709 14:53:37.313998 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:53:37.314757 (+   759us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":54651,"raft.queue_time_us":15030,"raft.run_cpu_time_us":312,"raft.run_wall_time_us":31377,"spinlock_wait_cycles":85492480,"thread_start_us":215174,"threads_started":1,"wal-append.queue_time_us":302342}
I20260709 14:53:37.323637  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:37.325310  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:37.326807  7926 raft_consensus.cc:2393] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 19: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:53:37.327795  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:37.328729  7926 raft_consensus.cc:2410] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for term 17 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 14:53:37.329752  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:37.332875  7926 raft_consensus.cc:1240] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 LEADER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 16. Current term is 17. Ops: []
I20260709 14:53:37.331372  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:37.335085  7850 raft_consensus.cc:3060] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 23 FOLLOWER]: Advancing to term 24
I20260709 14:53:37.297223 14394 leader_election.cc:290] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:37.331066  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:37.319224 14491 raft_consensus.cc:515] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:53:37.336547  7744 leader_election.cc:304] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:37.345968  7926 raft_consensus.cc:3060] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 22 FOLLOWER]: Advancing to term 23
I20260709 14:53:37.346493  7923 raft_consensus.cc:1275] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 14:53:37.350672  7744 leader_election.cc:304] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:37.356784  7744 leader_election.cc:304] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:37.362215  7774 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37136 (request call id 3369) took 1050 ms. Trace:
I20260709 14:53:37.359426  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:37.362748  7774 rpcz_store.cc:276] 0709 14:53:36.311688 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:53:37.137471 (+825783us) service_pool.cc:224] Handling call
0709 14:53:37.137904 (+   433us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:53:37.138331 (+   427us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:53:37.138361 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:53:37.138900 (+   539us) log.cc:844] Serialized 26 byte log entry
0709 14:53:37.226465 (+ 87565us) raft_consensus.cc:1645] Marking committed up to 14
0709 14:53:37.226518 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:53:37.226602 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:53:37.361936 (+135334us) raft_consensus.cc:1685] finished
0709 14:53:37.361959 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:53:37.362144 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1492,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":3216,"thread_start_us":86306,"threads_started":1,"wal-append.queue_time_us":220740}
I20260709 14:53:37.363423  7744 leader_election.cc:304] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:37.368294  7744 leader_election.cc:304] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:53:37.342089  7893 connection.cc:256] RPC call timeout handler was delayed by -1.1656609090000529s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3204s for a response
I20260709 14:53:37.348507 14386 raft_consensus.cc:2749] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 14:53:37.378906  7893 connection.cc:256] RPC call timeout handler was delayed by -1.1536682570000494s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2093s for a response
I20260709 14:53:37.363044 14306 raft_consensus.cc:2749] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 14:53:37.382496  7893 connection.cc:256] RPC call timeout handler was delayed by -1.1160198910000645s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15710000000000002s for a response
W20260709 14:53:37.385154  7893 leader_election.cc:336] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Timed out: RequestConsensusVote RPC to 127.6.101.65:40587 timed out after 2.244s (SENT)
I20260709 14:53:37.366247 14431 raft_consensus.cc:2749] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 14:53:37.386921  7926 raft_consensus.cc:1275] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 23 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 14:53:37.401830  7744 leader_election.cc:304] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:37.388156 14386 raft_consensus.cc:493] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:37.379320 14487 raft_consensus.cc:2749] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 14:53:37.406136  7744 leader_election.cc:304] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:53:37.409709  7893 leader_election.cc:336] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Timed out: RequestConsensusVote RPC to 127.6.101.65:40587 timed out after 2.224s (SENT)
I20260709 14:53:37.410444  7893 leader_election.cc:304] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:37.410146  7744 leader_election.cc:304] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:53:37.420902  7893 connection.cc:256] RPC call timeout handler was delayed by -1.0957505710000532s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2028s for a response
W20260709 14:53:37.421846  7893 connection.cc:256] RPC call timeout handler was delayed by -1.0508438190000788s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15480000000000002s for a response
W20260709 14:53:37.422386  7893 connection.cc:256] RPC call timeout handler was delayed by -1.0201505710000447s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21120000000000003s for a response
I20260709 14:53:37.435597  7744 leader_election.cc:304] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:37.398226 14306 raft_consensus.cc:2749] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 14:53:37.406478 14431 raft_consensus.cc:2749] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 14:53:37.407922 14488 raft_consensus.cc:493] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:37.419698 14398 raft_consensus.cc:2749] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 14:53:37.432614 14376 raft_consensus.cc:2749] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 14:53:37.465582  7893 leader_election.cc:304] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:37.447307 14495 raft_consensus.cc:2749] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587) with higher term. Message: Invalid argument: T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 19. Current term is 20.
I20260709 14:53:37.462498 14487 raft_consensus.cc:2749] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 14:53:37.481395  7776 raft_consensus.cc:1240] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 18. Current term is 19. Ops: []
W20260709 14:53:37.491309  7742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:37.487226  7893 leader_election.cc:304] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:37.512742  7775 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37136 (request call id 3344) took 1239 ms. Trace:
I20260709 14:53:37.513121  7777 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37144 (request call id 4309) took 1473 ms. Trace:
W20260709 14:53:37.514990  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 220197us
W20260709 14:53:37.516232  7819 leader_election.cc:336] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 14:53:37.515280  7777 rpcz_store.cc:276] 0709 14:53:36.007348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:53:36.105817 (+ 98469us) service_pool.cc:224] Handling call
0709 14:53:37.480854 (+1375037us) spinlock_profiling.cc:243] Waited 143 ms on lock 0x7b54002dd2d4. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae922fa 00007fb68fe53b17 00007fb6893ce6d4 00007fb6893ce662 00007fb6893ce591 00007fb6893ce50c 00007fb6893cd7c2 00007fb6891c948c 00007fb6891c88c6 00007fb6891c826f
0709 14:53:37.481038 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":329433472}
I20260709 14:53:37.515051  7775 rpcz_store.cc:276] 0709 14:53:36.251340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:53:36.329030 (+ 77690us) service_pool.cc:224] Handling call
0709 14:53:37.490831 (+1161801us) spinlock_profiling.cc:243] Waited 118 ms on lock 0x7b5400324954. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae922fa 00007fb68fe53b17 00007fb6893ce6d4 00007fb6893ce662 00007fb6893ce591 00007fb6893ce50c 00007fb6893cd7c2 00007fb6891c948c 00007fb6891c88c6 00007fb6891c826f
0709 14:53:37.491067 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":272524160}
I20260709 14:53:37.419803 14386 raft_consensus.cc:515] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
W20260709 14:53:37.522166  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 139907us
I20260709 14:53:37.478543 14306 raft_consensus.cc:2804] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 14:53:37.519886 14431 raft_consensus.cc:493] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:53:37.541910  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 106390us
I20260709 14:53:37.478729 14488 raft_consensus.cc:515] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:37.547032  7744 leader_election.cc:304] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:37.555147  7744 leader_election.cc:304] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:37.533792 14459 raft_consensus.cc:2804] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 14:53:37.524732 14487 raft_consensus.cc:493] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:37.556778  7744 leader_election.cc:304] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:37.638224 14491 leader_election.cc:290] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785), 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68:42321)
W20260709 14:53:37.654820  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 98155us
W20260709 14:53:37.653911 14511 log.cc:927] Time spent T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.052s	user 0.002s	sys 0.000s
W20260709 14:53:37.656587 14481 log.cc:927] Time spent T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.870s	user 0.004s	sys 0.001s
I20260709 14:53:37.527767  7893 leader_election.cc:304] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:53:37.657683 14516 log.cc:927] Time spent T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.056s	user 0.001s	sys 0.001s
W20260709 14:53:37.658398  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 130750us
I20260709 14:53:37.559311  7779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed"
I20260709 14:53:37.657191  7846 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 5239) took 1541 ms. Trace:
I20260709 14:53:37.659387  7779 raft_consensus.cc:2368] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 18. Current term is 19.
I20260709 14:53:37.544516 14306 raft_consensus.cc:493] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting leader election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:37.534736 14088 raft_consensus.cc:2749] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 14:53:37.585906  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 68160.7us
I20260709 14:53:37.562716 14459 raft_consensus.cc:493] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
W20260709 14:53:37.585496 14476 log.cc:927] Time spent T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 14:53:37.589536  7850 raft_consensus.cc:2468] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 24.
I20260709 14:53:37.556593 14431 raft_consensus.cc:515] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:37.620070  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" is_pre_election: true
I20260709 14:53:37.640024 14522 raft_consensus.cc:2749] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 14:53:37.616997  8640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce9c0ef2db24c13a8b1402f21819458" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9418391fa82a42c79c6cad13ba91d964" is_pre_election: true
I20260709 14:53:37.644328  8637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1f7722fdea49e0b5e9c5d96633eaf9" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9418391fa82a42c79c6cad13ba91d964" is_pre_election: true
I20260709 14:53:37.646203  7770 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37136 (request call id 3371) took 1334 ms. Trace:
I20260709 14:53:37.678728  7770 rpcz_store.cc:276] 0709 14:53:36.312177 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:53:37.209017 (+896840us) service_pool.cc:224] Handling call
0709 14:53:37.209502 (+   485us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:53:37.210195 (+   693us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:53:37.210229 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:53:37.213728 (+  3499us) log.cc:844] Serialized 26 byte log entry
0709 14:53:37.446056 (+232328us) raft_consensus.cc:1645] Marking committed up to 10
0709 14:53:37.446107 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:53:37.446192 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:53:37.645687 (+199495us) raft_consensus.cc:1685] finished
0709 14:53:37.645720 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:53:37.646083 (+   363us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1255,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":130,"thread_start_us":231871,"threads_started":1,"wal-append.queue_time_us":383297}
W20260709 14:53:37.647012 14480 log.cc:927] Time spent T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.888s	user 0.004s	sys 0.000s
W20260709 14:53:37.609524 14509 log.cc:927] Time spent T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.081s	user 0.001s	sys 0.001s
I20260709 14:53:37.659919  7779 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37136 (request call id 3355) took 1384 ms. Trace:
I20260709 14:53:37.686203  7773 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37136 (request call id 3356) took 1410 ms. Trace:
I20260709 14:53:37.659130  7846 rpcz_store.cc:276] 0709 14:53:36.116069 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:53:36.121468 (+  5399us) service_pool.cc:224] Handling call
0709 14:53:36.121928 (+   460us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:53:36.142280 (+ 20352us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:53:36.142318 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:53:36.723690 (+581372us) spinlock_profiling.cc:243] Waited 17.9 ms on lock 0x7b18003c67c0. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb690c69de1 00007fb690c765b1 00007fb687d6f2a6 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb689787a11 00007fb689797372 00007fb68aec9a01 00007fb68ae8e43a
0709 14:53:37.215031 (+491341us) spinlock_profiling.cc:243] Waited 9.46 ms on lock 0x7b2c000552c8. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb689787a11 00007fb689797372 00007fb68aec9a01 00007fb68ae8e43a 00007fb68ae8d83e 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2
0709 14:53:37.215635 (+   604us) log.cc:844] Serialized 26 byte log entry
0709 14:53:37.447028 (+231393us) raft_consensus.cc:1645] Marking committed up to 12
0709 14:53:37.447069 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:53:37.447166 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:53:37.656960 (+209794us) raft_consensus.cc:1685] finished
0709 14:53:37.656981 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:53:37.657127 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30121,"raft.queue_time_us":28938,"raft.run_cpu_time_us":207,"raft.run_wall_time_us":13623,"spinlock_wait_cycles":62929152,"thread_start_us":230988,"threads_started":1,"wal-append.queue_time_us":303533}
I20260709 14:53:37.686694  7773 rpcz_store.cc:276] 0709 14:53:36.275313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:53:36.387465 (+112152us) service_pool.cc:224] Handling call
0709 14:53:37.619865 (+1232400us) spinlock_profiling.cc:243] Waited 73.4 ms on lock 0x7b5800002a98. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb687c29db1 00007fb687d69b71 00007fb687d69a22 00007fb690c82c09 00007fb68fddcee0 00007fb68fea60ab 00007fb68fea6131 00007fb68fe540a0 00007fb68fe53984 00007fb6893ce6d4 00007fb6893ce662
0709 14:53:37.686121 (+ 66256us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":168881920}
I20260709 14:53:37.688037  7928 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38516 (request call id 3407) took 1480 ms. Trace:
I20260709 14:53:37.688791  7773 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37136 (request call id 3378) took 1360 ms. Trace:
I20260709 14:53:37.661777  7893 leader_election.cc:304] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:37.661700 14307 raft_consensus.cc:2749] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 14:53:37.657018  7744 leader_election.cc:304] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:37.606499 14398 raft_consensus.cc:2749] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 14:53:37.614876 14386 leader_election.cc:290] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785), 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68:42321)
I20260709 14:53:37.689215  7773 rpcz_store.cc:276] 0709 14:53:36.328130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:53:37.687767 (+1359637us) service_pool.cc:224] Handling call
0709 14:53:37.688207 (+   440us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:53:37.688434 (+   227us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:53:37.688459 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:53:37.688514 (+    55us) raft_consensus.cc:1645] Marking committed up to 11
0709 14:53:37.688548 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:53:37.688609 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:53:37.688730 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 14:53:37.704634  7773 raft_consensus.cc:1275] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 14:53:37.705664  7773 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37136 (request call id 3379) took 1368 ms. Trace:
I20260709 14:53:37.686086  7779 rpcz_store.cc:276] 0709 14:53:36.275049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:53:36.386889 (+111840us) service_pool.cc:224] Handling call
0709 14:53:37.558974 (+1172085us) spinlock_profiling.cc:243] Waited 14.9 ms on lock 0x7b5800002a98. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb687c29db1 00007fb687d69b71 00007fb687d69a22 00007fb690c82c09 00007fb68fddcee0 00007fb68fea60ab 00007fb68fea6131 00007fb68fe540a0 00007fb68fe53984 00007fb6893ce6d4 00007fb6893ce662
0709 14:53:37.659841 (+100867us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":34230656}
I20260709 14:53:37.706195  7773 rpcz_store.cc:276] 0709 14:53:36.337605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:53:37.703846 (+1366241us) service_pool.cc:224] Handling call
0709 14:53:37.704230 (+   384us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:53:37.705218 (+   988us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:53:37.705589 (+   371us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 14:53:37.708209  7779 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37136 (request call id 3380) took 1370 ms. Trace:
I20260709 14:53:37.688498  7928 rpcz_store.cc:276] 0709 14:53:36.207770 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:53:36.207988 (+   218us) service_pool.cc:224] Handling call
0709 14:53:36.208519 (+   531us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:53:36.218614 (+ 10095us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:53:36.218651 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:53:36.223643 (+  4992us) log.cc:844] Serialized 26 byte log entry
0709 14:53:37.206372 (+982729us) spinlock_profiling.cc:243] Waited 2.43 ms on lock 0x7b1800332620. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb690c69de1 00007fb690c765b1 00007fb687d83e07 00007fb690bdeab9 00007fb687da069b 00007fb687d9e93f 00007fb687da0c02 00007fb68aa2820b 00007fb68aa2dd23 00007fb68aa2e0d1 00007fb68ae49a0f
0709 14:53:37.433777 (+227405us) raft_consensus.cc:1645] Marking committed up to 12
0709 14:53:37.433834 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:53:37.433934 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:53:37.687636 (+253702us) raft_consensus.cc:1685] finished
0709 14:53:37.687662 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:53:37.687927 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":140555,"raft.queue_time_us":16143,"raft.run_cpu_time_us":252,"raft.run_wall_time_us":15735,"spinlock_wait_cycles":5587712,"thread_start_us":227066,"threads_started":1,"wal-append.queue_time_us":1354434}
I20260709 14:53:37.708642  7779 rpcz_store.cc:276] 0709 14:53:36.337894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:53:37.707146 (+1369252us) service_pool.cc:224] Handling call
0709 14:53:37.707594 (+   448us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:53:37.707827 (+   233us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:53:37.707856 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:53:37.707904 (+    48us) raft_consensus.cc:1645] Marking committed up to 8
0709 14:53:37.707936 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:53:37.708004 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:53:37.708138 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":81152}
I20260709 14:53:37.710709  7779 raft_consensus.cc:1275] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 14:53:37.711288  7779 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37136 (request call id 3382) took 1372 ms. Trace:
I20260709 14:53:37.711623  7779 rpcz_store.cc:276] 0709 14:53:36.338393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:53:37.710026 (+1371633us) service_pool.cc:224] Handling call
0709 14:53:37.710366 (+   340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:53:37.711043 (+   677us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:53:37.711229 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 14:53:37.711668  7893 leader_election.cc:304] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:37.714259  7778 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 4303) took 1689 ms. Trace:
I20260709 14:53:37.713586  7779 raft_consensus.cc:1275] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 14:53:37.716476  7773 raft_consensus.cc:1240] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 20. Current term is 21. Ops: []
I20260709 14:53:37.717305  7773 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37136 (request call id 3381) took 1379 ms. Trace:
I20260709 14:53:37.717675  7773 rpcz_store.cc:276] 0709 14:53:36.338166 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:53:37.707260 (+1369094us) service_pool.cc:224] Handling call
0709 14:53:37.716273 (+  9013us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:53:37.717009 (+   736us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:53:37.717225 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 14:53:37.721067  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:37.722114  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:37.721305  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:53:37.722899  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:37.715677  7778 rpcz_store.cc:276] 0709 14:53:36.005823 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:53:36.217603 (+211780us) service_pool.cc:224] Handling call
0709 14:53:36.241841 (+ 24238us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:53:36.248980 (+  7139us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:53:36.249018 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:53:36.306477 (+ 57459us) log.cc:844] Serialized 26 byte log entry
0709 14:53:36.496518 (+190041us) raft_consensus.cc:1645] Marking committed up to 13
0709 14:53:36.550932 (+ 54414us) log.cc:844] Serialized 14 byte log entry
0709 14:53:36.560473 (+  9541us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:53:36.560577 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:53:37.645364 (+1084787us) spinlock_profiling.cc:243] Waited 1.92 ms on lock 0x7b4400022b4c. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb687c29db1 00007fb687cc7c85 00007fb687cc86a2 00007fb68aa3a1db 00007fb68aa35aaf 00007fb68aa2986e 00007fb68aa28bb6 00007fb68aa287d8 00007fb68aa32221 00007fb68aa321d9 00007fb68aa32169
0709 14:53:37.685068 (+ 39704us) raft_consensus.cc:1685] finished
0709 14:53:37.685222 (+   154us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:53:37.695505 (+ 10283us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11040,"prepare.queue_time_us":81705,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"raft.queue_time_us":3401,"raft.run_cpu_time_us":842,"raft.run_wall_time_us":23825,"spinlock_wait_cycles":4410112,"thread_start_us":103888,"threads_started":1,"wal-append.queue_time_us":360751}
I20260709 14:53:37.664048 14382 raft_consensus.cc:2804] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 14:53:37.715773  7779 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37136 (request call id 3383) took 1340 ms. Trace:
I20260709 14:53:37.665416 14306 raft_consensus.cc:3060] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Advancing to term 19
I20260709 14:53:37.731366  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:37.668677 14459 raft_consensus.cc:3060] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Advancing to term 22
I20260709 14:53:37.734301  7779 rpcz_store.cc:276] 0709 14:53:36.375340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:53:37.712632 (+1337292us) service_pool.cc:224] Handling call
0709 14:53:37.713005 (+   373us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:53:37.715469 (+  2464us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:53:37.715712 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 14:53:37.766597  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 109571us
W20260709 14:53:37.726352 14481 log.cc:927] Time spent T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 14:53:37.667165 14487 raft_consensus.cc:515] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:37.734184 14382 raft_consensus.cc:493] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
W20260709 14:53:37.783277 14474 log.cc:927] Time spent T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 14:53:37.841929  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1f7722fdea49e0b5e9c5d96633eaf9" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:37.714073 14518 raft_consensus.cc:2804] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 14:53:37.823199  7744 leader_election.cc:304] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:53:37.877444  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 109134us
I20260709 14:53:37.785584 14307 consensus_queue.cc:1048] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.051s
I20260709 14:53:37.836781  7772 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 4290) took 1852 ms. Trace:
I20260709 14:53:37.731703 14522 raft_consensus.cc:2749] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 14:53:37.879254  7772 rpcz_store.cc:276] 0709 14:53:35.984515 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:53:35.989216 (+  4701us) service_pool.cc:224] Handling call
0709 14:53:35.989626 (+   410us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:53:35.990095 (+   469us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 14:53:36.290977 (+300882us) log.cc:844] Serialized 14 byte log entry
0709 14:53:36.706524 (+415547us) log.cc:844] Serialized 14 byte log entry
0709 14:53:36.914963 (+208439us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:53:36.915547 (+   584us) log.cc:844] Serialized 26 byte log entry
0709 14:53:36.917107 (+  1560us) raft_consensus.cc:1645] Marking committed up to 12
0709 14:53:36.919587 (+  2480us) log.cc:844] Serialized 14 byte log entry
0709 14:53:36.937695 (+ 18108us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:53:36.937798 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:53:37.617784 (+679986us) spinlock_profiling.cc:243] Waited 21.1 ms on lock 0x7b4400022b4c. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb687c29db1 00007fb687cc7c85 00007fb687cc86a2 00007fb68aa3a1db 00007fb68aa35aaf 00007fb68aa2986e 00007fb68aa28bb6 00007fb68aa287d8 00007fb68aa32221 00007fb68aa321d9 00007fb68aa32169
0709 14:53:37.836527 (+218743us) raft_consensus.cc:1685] finished
0709 14:53:37.836552 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:53:37.836709 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":85947,"prepare.queue_time_us":203089,"prepare.run_cpu_time_us":151,"prepare.run_wall_time_us":1532,"raft.queue_time_us":26798,"raft.run_cpu_time_us":816,"raft.run_wall_time_us":58970,"spinlock_wait_cycles":48436096,"thread_start_us":621438,"threads_started":4,"wal-append.queue_time_us":388672}
I20260709 14:53:37.886884  7744 leader_election.cc:304] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:37.801919 14527 raft_consensus.cc:2804] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 25 FOLLOWER]: Leader pre-election won for term 26
W20260709 14:53:37.834602 14523 log.cc:927] Time spent T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.184s	user 0.000s	sys 0.001s
I20260709 14:53:37.890280  7894 leader_election.cc:304] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
W20260709 14:53:37.836335 14521 log.cc:927] Time spent T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.151s	user 0.002s	sys 0.000s
I20260709 14:53:37.823343 14398 raft_consensus.cc:493] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:37.882632 14518 raft_consensus.cc:493] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:37.909158 14518 raft_consensus.cc:3060] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Advancing to term 22
I20260709 14:53:37.901479 14220 raft_consensus.cc:2749] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 14:53:37.889526 14463 log.cc:927] Time spent T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.053s	user 0.002s	sys 0.005s
I20260709 14:53:37.877753 14382 raft_consensus.cc:3060] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Advancing to term 21
W20260709 14:53:37.923139  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 211637us
W20260709 14:53:37.932570  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 155854us
I20260709 14:53:37.943768  7776 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37136 (request call id 3373) took 1631 ms. Trace:
I20260709 14:53:37.893009 14527 raft_consensus.cc:493] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 25 FOLLOWER]: Starting leader election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:37.944639  7776 rpcz_store.cc:276] 0709 14:53:36.312622 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:53:37.310933 (+998311us) service_pool.cc:224] Handling call
0709 14:53:37.481075 (+170142us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:53:37.514165 (+ 33090us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:53:37.943518 (+429353us) spinlock_profiling.cc:243] Waited 170 ms on lock 0x7b54002dd2d0. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae8d8ad 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2 00007fb6891c948c 00007fb6891c88c6 00007fb6891c826f
0709 14:53:37.943683 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":390391680}
I20260709 14:53:37.914191 14489 raft_consensus.cc:493] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:37.916973 14295 raft_consensus.cc:2804] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 14:53:37.957129  7893 leader_election.cc:304] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:37.959820 14489 raft_consensus.cc:515] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:53:37.971822 14515 log.cc:927] Time spent T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
I20260709 14:53:37.952463 14527 raft_consensus.cc:3060] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 25 FOLLOWER]: Advancing to term 26
I20260709 14:53:37.916587 14488 leader_election.cc:290] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:37.919734 14398 raft_consensus.cc:515] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:37.919026 14407 raft_consensus.cc:493] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:37.906673 14534 consensus_queue.cc:1048] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.071s
W20260709 14:53:37.996207  7742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:37.989106 14376 raft_consensus.cc:2804] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 14:53:37.983686 14295 raft_consensus.cc:697] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 24 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
W20260709 14:53:38.022737  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 323755us
I20260709 14:53:38.009225 14341 raft_consensus.cc:493] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:53:38.038359  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 54070.1us
I20260709 14:53:38.045020 14488 raft_consensus.cc:493] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:38.045814 14488 raft_consensus.cc:515] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:38.049346 14488 leader_election.cc:290] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:38.050452 14488 raft_consensus.cc:493] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:38.051162 14488 raft_consensus.cc:515] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:37.989641 14407 raft_consensus.cc:515] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:38.029206 14376 raft_consensus.cc:493] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:38.055310  7893 leader_election.cc:304] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:53:38.063690  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 113251us
W20260709 14:53:38.060395 14473 log.cc:927] Time spent T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 1.207s	user 0.003s	sys 0.010s
I20260709 14:53:38.053875  7745 leader_election.cc:304] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:38.073874  7774 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37136 (request call id 3374) took 1761 ms. Trace:
I20260709 14:53:38.073726 14295 consensus_queue.cc:237] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:38.060823 14517 raft_consensus.cc:2749] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 14:53:38.064865 14376 raft_consensus.cc:3060] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 14:53:38.062465 14462 consensus_queue.cc:1048] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.016s
I20260709 14:53:38.092398  7745 leader_election.cc:304] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:38.054461 14341 raft_consensus.cc:515] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:38.063534 14056 consensus_queue.cc:1048] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.021s
I20260709 14:53:38.101416 14296 consensus_queue.cc:1048] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 14:53:38.076615  7774 rpcz_store.cc:276] 0709 14:53:36.312879 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:53:37.376273 (+1063394us) service_pool.cc:224] Handling call
0709 14:53:37.376814 (+   541us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 14:53:37.381204 (+  4390us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:53:37.381265 (+    61us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 14:53:37.385466 (+  4201us) log.cc:844] Serialized 52 byte log entry
0709 14:53:37.530351 (+144885us) raft_consensus.cc:1645] Marking committed up to 10
0709 14:53:37.567779 (+ 37428us) log.cc:844] Serialized 14 byte log entry
0709 14:53:37.835653 (+267874us) spinlock_profiling.cc:243] Waited 9.84 ms on lock 0x7b4400022b4c. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb687c29db1 00007fb687cc7c85 00007fb687cc86a2 00007fb68aa3a1db 00007fb68aa35aaf 00007fb68aa2986e 00007fb68aa28bb6 00007fb68aa287d8 00007fb68aa32221 00007fb68aa321d9 00007fb68aa32169
0709 14:53:38.008950 (+173297us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:53:38.009062 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:53:38.064836 (+ 55774us) raft_consensus.cc:1685] finished
0709 14:53:38.073431 (+  8595us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:53:38.073629 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":27468,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":66,"raft.queue_time_us":55605,"raft.run_cpu_time_us":362,"raft.run_wall_time_us":6566,"spinlock_wait_cycles":22622592,"thread_start_us":548281,"threads_started":2,"wal-append.queue_time_us":268896}
I20260709 14:53:38.074694 14487 leader_election.cc:290] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:38.114470 14526 consensus_queue.cc:1048] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.013s
I20260709 14:53:38.115510 14526 consensus_queue.cc:1243] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Peer 1de5e20126fa4d8ca0793d19c7b847ed log is divergent from this leader: its last log entry 19.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 14:53:38.093977 14534 raft_consensus.cc:2804] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader election won for term 15
I20260709 14:53:38.064594 14532 consensus_queue.cc:1048] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 14:53:38.103375 14460 consensus_queue.cc:1048] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 14:53:38.154852  7771 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 4302) took 2149 ms. Trace:
I20260709 14:53:38.108898 14541 raft_consensus.cc:2804] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 14:53:38.109505 14535 raft_consensus.cc:2804] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Leader election won for term 19
I20260709 14:53:38.102232 14467 consensus_queue.cc:1048] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.028s
I20260709 14:53:38.155454  7771 rpcz_store.cc:276] 0709 14:53:36.005580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:53:36.181346 (+175766us) service_pool.cc:224] Handling call
0709 14:53:36.181745 (+   399us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:53:36.212758 (+ 31013us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:53:36.212787 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:53:36.213236 (+   449us) log.cc:844] Serialized 26 byte log entry
0709 14:53:36.484391 (+271155us) raft_consensus.cc:1645] Marking committed up to 13
0709 14:53:36.496268 (+ 11877us) log.cc:844] Serialized 14 byte log entry
0709 14:53:36.496554 (+   286us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:53:36.496647 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:53:37.834175 (+1337528us) spinlock_profiling.cc:243] Waited 3.16 ms on lock 0x7b18003afb40. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb690c69de1 00007fb690c765b1 00007fb687da1557 00007fb687da37c1 00007fb687da3779 00007fb687da3709 00007fb687da36d1 00007fb687da29cd 0000000000396ad4 0000000000396919 00007fb687d8483a
0709 14:53:37.849649 (+ 15474us) spinlock_profiling.cc:243] Waited 20.7 ms on lock 0x7b4400022b4c. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb687c29db1 00007fb687cc7c85 00007fb687cc86a2 00007fb68aa3a1db 00007fb68aa35aaf 00007fb68aa2986e 00007fb68aa28bb6 00007fb68aa287d8 00007fb68aa32221 00007fb68aa321d9 00007fb68aa32169
0709 14:53:38.154536 (+304887us) raft_consensus.cc:1685] finished
0709 14:53:38.154563 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:53:38.154755 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30595,"prepare.queue_time_us":20082,"prepare.run_cpu_time_us":144,"prepare.run_wall_time_us":18019,"raft.queue_time_us":37349,"raft.run_cpu_time_us":331,"raft.run_wall_time_us":9788,"spinlock_wait_cycles":54849408,"thread_start_us":270450,"threads_started":1,"wal-append.queue_time_us":470347}
I20260709 14:53:38.125486 14489 leader_election.cc:290] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:38.105890 14449 consensus_queue.cc:1048] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.027s
I20260709 14:53:38.130333 14534 raft_consensus.cc:697] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
W20260709 14:53:38.180874 14529 log.cc:927] Time spent T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.192s	user 0.002s	sys 0.000s
W20260709 14:53:38.208463  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 101210us
W20260709 14:53:38.202595  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 83736.1us
I20260709 14:53:38.169050 14541 raft_consensus.cc:493] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
W20260709 14:53:38.215991  7893 leader_election.cc:336] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 14:53:38.200742 14306 raft_consensus.cc:515] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:38.237674  7777 raft_consensus.cc:1240] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 18. Current term is 19. Ops: []
I20260709 14:53:38.241920 14306 leader_election.cc:290] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:38.223417 14407 leader_election.cc:290] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:38.223594 14341 leader_election.cc:290] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:38.224280 14462 consensus_queue.cc:1048] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.006s
I20260709 14:53:38.228734 14483 consensus_queue.cc:1048] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.013s
I20260709 14:53:38.196857 14537 raft_consensus.cc:493] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:38.260109 14534 consensus_queue.cc:237] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:38.262784 14431 leader_election.cc:290] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:38.273572 14488 leader_election.cc:290] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:38.179396 14526 consensus_queue.cc:1048] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.044s
W20260709 14:53:38.245517 14538 log.cc:927] Time spent T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.180s	user 0.000s	sys 0.001s
W20260709 14:53:38.222558 14542 log.cc:927] Time spent T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
W20260709 14:53:38.244606 14536 log.cc:927] Time spent T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.169s	user 0.000s	sys 0.001s
I20260709 14:53:38.240168  7777 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37136 (request call id 3376) took 1913 ms. Trace:
I20260709 14:53:38.312984  7777 rpcz_store.cc:276] 0709 14:53:36.327165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:53:37.531975 (+1204810us) service_pool.cc:224] Handling call
0709 14:53:37.552637 (+ 20662us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:53:38.238206 (+685569us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:53:38.239810 (+  1604us) spinlock_profiling.cc:243] Waited 685 ms on lock 0x7b54002b70d4. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae8ee01 00007fb68ae8d83e 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2 00007fb6891c948c 00007fb6891c88c6
0709 14:53:38.240077 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1574716288}
I20260709 14:53:38.211891 14398 leader_election.cc:290] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:38.216933 14541 raft_consensus.cc:3060] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Advancing to term 19
W20260709 14:53:38.299753  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 82699.8us
I20260709 14:53:38.312242 14431 raft_consensus.cc:493] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:38.284873 14532 raft_consensus.cc:493] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9418391fa82a42c79c6cad13ba91d964)
W20260709 14:53:38.322117  7893 leader_election.cc:336] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 14:53:38.331284  7893 leader_election.cc:304] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:38.287595 14517 raft_consensus.cc:493] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:38.299655 14306 raft_consensus.cc:493] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:38.339264 14517 raft_consensus.cc:515] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:38.348239 14517 leader_election.cc:290] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:38.295328 14537 raft_consensus.cc:515] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:38.354967 14527 raft_consensus.cc:515] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:38.355688 14306 raft_consensus.cc:515] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:38.357718 14306 leader_election.cc:290] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:53:38.358423 14539 log.cc:927] Time spent T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
I20260709 14:53:38.359697  7775 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37136 (request call id 3375) took 2046 ms. Trace:
I20260709 14:53:38.360208  7775 rpcz_store.cc:276] 0709 14:53:36.326819 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:53:37.525214 (+1198395us) service_pool.cc:224] Handling call
0709 14:53:37.534254 (+  9040us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 14:53:37.732518 (+198264us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:53:37.732559 (+    41us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 14:53:37.783027 (+ 50468us) log.cc:844] Serialized 52 byte log entry
0709 14:53:37.980104 (+197077us) raft_consensus.cc:1645] Marking committed up to 10
0709 14:53:38.012383 (+ 32279us) log.cc:844] Serialized 14 byte log entry
0709 14:53:38.013678 (+  1295us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:53:38.100878 (+ 87200us) spinlock_profiling.cc:243] Waited 198 ms on lock 0x7b540014e1d4. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb68adf7571 00007fb68ae8ee01 00007fb68ae8d83e 00007fb68fe52419 00007fb6893c9bd4 00007fb6893c9b62 00007fb6893c9a91 00007fb6893c9a0c 00007fb6893c8cc2 00007fb6891c948c 00007fb6891c88c6
0709 14:53:38.100946 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:53:38.359224 (+258278us) raft_consensus.cc:1685] finished
0709 14:53:38.359376 (+   152us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:53:38.359607 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":30513,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":3437,"raft.queue_time_us":77389,"raft.run_cpu_time_us":425,"raft.run_wall_time_us":59779,"spinlock_wait_cycles":454684416,"thread_start_us":90370,"threads_started":1,"wal-append.queue_time_us":242351}
I20260709 14:53:38.362643 14382 raft_consensus.cc:515] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:38.363952  7925 raft_consensus.cc:1240] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 20. Current term is 21. Ops: []
I20260709 14:53:38.366089 14467 raft_consensus.cc:2749] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 14:53:38.337857  7893 leader_election.cc:336] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 14:53:38.367940  7893 leader_election.cc:336] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 14:53:38.368909  7893 leader_election.cc:336] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 14:53:38.339847 14532 raft_consensus.cc:515] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:53:38.372112 14532 leader_election.cc:290] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68:42321)
I20260709 14:53:38.334888 14431 raft_consensus.cc:515] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:38.374591  8637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9441e831627143a991a1556dcdce71e3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9418391fa82a42c79c6cad13ba91d964" is_pre_election: true
I20260709 14:53:38.378340  7893 leader_election.cc:304] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:53:38.331533 14459 consensus_meta.cc:287] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0: Time spent flushing consensus metadata: real 0.563s	user 0.007s	sys 0.008s
I20260709 14:53:38.386088  7770 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37136 (request call id 3377) took 2058 ms. Trace:
I20260709 14:53:38.387934  7770 rpcz_store.cc:276] 0709 14:53:36.327765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:53:37.680567 (+1352802us) service_pool.cc:224] Handling call
0709 14:53:37.680934 (+   367us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 14:53:37.917650 (+236716us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:53:37.917688 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 14:53:37.930117 (+ 12429us) log.cc:844] Serialized 26 byte log entry
0709 14:53:38.043298 (+113181us) raft_consensus.cc:1645] Marking committed up to 12
0709 14:53:38.043358 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:53:38.043454 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 14:53:38.385813 (+342359us) raft_consensus.cc:1685] finished
0709 14:53:38.385837 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:53:38.386019 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":33594,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":11803,"thread_start_us":319568,"threads_started":2,"wal-append.queue_time_us":152287}
W20260709 14:53:38.393582  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 134437us
I20260709 14:53:38.355034 14537 leader_election.cc:290] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:53:38.386826  7893 leader_election.cc:336] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 14:53:38.378223 14431 leader_election.cc:290] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:53:38.399065  8598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 100896us
I20260709 14:53:38.391664 14548 raft_consensus.cc:2749] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 14:53:38.404325  7893 leader_election.cc:336] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 14:53:38.407843  7893 leader_election.cc:304] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:38.414997 13835 raft_consensus.cc:2749] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 14:53:38.414788  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 105442us
I20260709 14:53:38.391847 14459 raft_consensus.cc:515] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:38.390826 14518 raft_consensus.cc:515] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:38.403611 14527 leader_election.cc:290] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 26 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:38.408388 14537 raft_consensus.cc:493] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:38.423259 13835 consensus_queue.cc:1048] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 14:53:38.423553  7893 leader_election.cc:336] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 14:53:38.426391  7893 leader_election.cc:304] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:38.435848  7744 leader_election.cc:304] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:38.438519  7744 leader_election.cc:304] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:38.429113 14527 raft_consensus.cc:2749] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 14:53:38.446466 14459 leader_election.cc:290] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 22 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:38.426812 14376 raft_consensus.cc:515] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:38.455329  7744 leader_election.cc:304] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:38.457265 14532 raft_consensus.cc:2749] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 14:53:38.458621 14524 log.cc:927] Time spent T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.565s	user 0.006s	sys 0.000s
I20260709 14:53:38.427177 14537 raft_consensus.cc:515] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:38.469043  7744 leader_election.cc:304] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:38.483754  7744 leader_election.cc:304] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:38.532238 14307 consensus_queue.cc:1048] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 14:53:38.533684 13835 raft_consensus.cc:493] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:38.534431 13835 raft_consensus.cc:515] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:38.535189  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c563cc7cfbe4d59be4ffc5cf847ce56" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:38.536439 13835 leader_election.cc:290] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:38.537000  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:38.541918  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce9c0ef2db24c13a8b1402f21819458" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:38.544574  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:38.546455  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:38.525780 14306 raft_consensus.cc:2749] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 14:53:38.549984  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 21 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:38.449014 14431 raft_consensus.cc:2749] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 14:53:38.558274  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:38.559924  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:38.560220  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:38.561012  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:38.561499  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:38.562093  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:38.562716  7923 raft_consensus.cc:2468] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 14.
I20260709 14:53:38.564047  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:38.565392  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:38.566051  7921 raft_consensus.cc:2376] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 19. Re-sending same reply.
I20260709 14:53:38.481952 14386 raft_consensus.cc:2749] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 14:53:38.478730 14341 raft_consensus.cc:493] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:38.577478  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:38.557611 14306 raft_consensus.cc:493] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:53:38.582748  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:38.557986 14398 raft_consensus.cc:493] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:38.534099 14307 consensus_queue.cc:1048] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.042s
I20260709 14:53:38.584029 14220 raft_consensus.cc:493] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:38.571101 14532 raft_consensus.cc:493] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:38.574977 14552 raft_consensus.cc:2749] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 14:53:38.597632 14467 raft_consensus.cc:493] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:53:38.601576 14467 raft_consensus.cc:515] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:38.602698 14537 leader_election.cc:290] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:38.604457 14467 leader_election.cc:290] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:38.611102  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:38.610965  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
W20260709 14:53:38.616539  7893 leader_election.cc:336] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 14:53:38.617955  7893 leader_election.cc:336] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 14:53:38.617859  7744 leader_election.cc:304] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 9418391fa82a42c79c6cad13ba91d964
I20260709 14:53:38.582511 14306 raft_consensus.cc:515] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:38.580566 14341 raft_consensus.cc:515] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:53:38.621959  7893 leader_election.cc:336] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 14:53:38.622363  7744 leader_election.cc:304] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:38.593312 14220 raft_consensus.cc:515] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:38.590332 14398 raft_consensus.cc:515] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:38.634639  7893 leader_election.cc:304] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:38.593048 14532 raft_consensus.cc:515] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:38.640513 14307 raft_consensus.cc:493] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:38.622601 14537 raft_consensus.cc:2749] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 14:53:38.638479 14534 raft_consensus.cc:493] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:38.630501 14552 raft_consensus.cc:2749] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 14:53:38.641366  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 25 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:53:38.647581  7893 consensus_peers.cc:597] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 14:53:38.650605  7893 leader_election.cc:336] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 14:53:38.658357  7893 leader_election.cc:304] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:38.651137 14534 raft_consensus.cc:515] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:38.642469 14518 leader_election.cc:290] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 22 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:38.655022 14541 raft_consensus.cc:515] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:38.666388  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783e4874513449ef9084b833f188a6d3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:38.648284 14459 raft_consensus.cc:2749] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 14:53:38.669343  7893 leader_election.cc:336] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 14:53:38.674050  7893 leader_election.cc:304] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:53:38.675788  7893 leader_election.cc:336] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 14:53:38.672600  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:38.664361 14376 leader_election.cc:290] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:38.683728  7926 raft_consensus.cc:1240] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 18. Current term is 19. Ops: []
I20260709 14:53:38.685148 14220 leader_election.cc:290] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:38.686686 14341 leader_election.cc:290] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:38.688805  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:38.691803 14532 leader_election.cc:290] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:38.667474 14244 raft_consensus.cc:2749] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 14:53:38.643584 14307 raft_consensus.cc:515] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:38.678089 14467 raft_consensus.cc:2749] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 14:53:38.711145  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 20 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:38.722873 14407 raft_consensus.cc:493] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:53:38.712235 14532 raft_consensus.cc:493] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:38.721091 14307 leader_election.cc:290] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:38.734282 14534 leader_election.cc:290] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:38.725862 14341 raft_consensus.cc:493] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:53:38.736933 14541 leader_election.cc:290] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:38.736843 14341 raft_consensus.cc:515] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:38.744606 14398 leader_election.cc:290] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:38.733220 14306 leader_election.cc:290] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:38.725386 14407 raft_consensus.cc:515] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:38.750413 14407 leader_election.cc:290] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:38.757139  7819 leader_election.cc:304] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 9418391fa82a42c79c6cad13ba91d964
I20260709 14:53:38.731758 14532 raft_consensus.cc:515] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:53:38.762116 14545 log.cc:927] Time spent T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.504s	user 0.003s	sys 0.001s
I20260709 14:53:38.762944 14405 raft_consensus.cc:2749] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 14:53:38.764559 14532 leader_election.cc:290] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:38.784982  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:38.800859  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c563cc7cfbe4d59be4ffc5cf847ce56" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:38.784154 14307 raft_consensus.cc:493] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:38.805757  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 21 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:38.801062 14081 raft_consensus.cc:493] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:38.808252 14081 raft_consensus.cc:515] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:38.809754  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:38.813684  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:38.807508 14382 leader_election.cc:290] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 21 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:38.816399 14341 leader_election.cc:290] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:38.821900  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:38.799902 14407 consensus_queue.cc:1059] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.026s
I20260709 14:53:38.826056  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:38.826162  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:38.833652  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:38.834583  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:53:38.842389  7893 consensus_peers.cc:597] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:53:38.842422  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
W20260709 14:53:38.844233  7893 consensus_peers.cc:597] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:53:38.784742 14394 consensus_queue.cc:1059] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.042s
I20260709 14:53:38.840262  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:38.853523  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:53:38.855387  7893 consensus_peers.cc:597] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:53:38.858215  7673 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54350 (request call id 381) took 4803 ms. Trace:
W20260709 14:53:38.861557  7893 consensus_peers.cc:597] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:53:38.871670  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:38.862002  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:38.875077  7854 raft_consensus.cc:1275] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 24 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 14:53:38.876075  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9441e831627143a991a1556dcdce71e3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:53:38.866928  7893 consensus_peers.cc:597] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 14:53:38.881207  7893 consensus_peers.cc:597] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:53:38.881400  7674 catalog_manager.cc:5697] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 20 to 22. New cstate: current_term: 22 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
W20260709 14:53:38.883829  7893 consensus_peers.cc:597] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:53:38.884184  7674 catalog_manager.cc:5697] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:53:38.878470 14394 raft_consensus.cc:3055] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 LEADER]: Stepping down as leader of term 20
I20260709 14:53:38.886575  7674 catalog_manager.cc:5697] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 12 to 18, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 18 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:53:38.897917  7674 catalog_manager.cc:5697] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 18 to 23, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 23 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
W20260709 14:53:38.899247  7893 consensus_peers.cc:597] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 14:53:38.900334  7893 consensus_peers.cc:597] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 14:53:38.901579  7893 consensus_peers.cc:597] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 14:53:38.902340  7893 leader_election.cc:336] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 14:53:38.902770  7893 leader_election.cc:304] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:38.902616 14526 consensus_queue.cc:1048] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 14:53:38.826956 14307 raft_consensus.cc:515] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:38.906821 14459 raft_consensus.cc:2749] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 14:53:38.908015 14307 leader_election.cc:290] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:53:38.917663  7893 consensus_peers.cc:597] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 14:53:38.919482  7893 leader_election.cc:336] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 14:53:38.900833  7674 catalog_manager.cc:5697] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:53:38.920167  7893 leader_election.cc:304] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:53:38.936633 14535 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.717s	user 0.030s	sys 0.028s
I20260709 14:53:38.886682 14394 raft_consensus.cc:740] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
W20260709 14:53:38.943435  7893 consensus_peers.cc:597] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:53:38.923866  7674 catalog_manager.cc:5697] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 21 to 23. New cstate: current_term: 23 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:53:38.859874  7673 rpcz_store.cc:276] 0709 14:53:34.055657 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:53:34.055895 (+   238us) service_pool.cc:224] Handling call
0709 14:53:38.858130 (+4802235us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 14:53:34.657180 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 14:53:34.657902 (+   722us) write_op.cc:432] Acquiring schema lock in shared mode
0709 14:53:34.657941 (+    39us) write_op.cc:435] Acquired schema lock
0709 14:53:34.657958 (+    17us) tablet.cc:662] Decoding operations
0709 14:53:34.659749 (+  1791us) write_op.cc:620] Acquiring the partition lock for write op
0709 14:53:34.659873 (+   124us) write_op.cc:641] Partition lock acquired for write op
0709 14:53:34.659906 (+    33us) tablet.cc:685] Acquiring locks for 21 operations
0709 14:53:34.661742 (+  1836us) tablet.cc:701] Row locks acquired
0709 14:53:34.661758 (+    16us) write_op.cc:260] PREPARE: finished
0709 14:53:34.661978 (+   220us) write_op.cc:270] Start()
0709 14:53:34.662100 (+   122us) write_op.cc:276] Timestamp: P: 1783608814661908 usec, L: 0
0709 14:53:34.662115 (+    15us) op_driver.cc:348] REPLICATION: starting
0709 14:53:34.663037 (+   922us) log.cc:844] Serialized 8239 byte log entry
0709 14:53:34.680685 (+ 17648us) op_driver.cc:464] REPLICATION: finished
0709 14:53:34.875915 (+195230us) write_op.cc:301] APPLY: starting
0709 14:53:34.880173 (+  4258us) tablet.cc:1367] starting BulkCheckPresence
0709 14:53:35.301326 (+421153us) tablet.cc:1370] finished BulkCheckPresence
0709 14:53:35.301581 (+   255us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 14:53:36.182166 (+880585us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 14:53:36.182505 (+   339us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=42,key_file_lookups=42,delta_file_lookups=42,mrs_lookups=0
0709 14:53:36.182556 (+    51us) write_op.cc:312] APPLY: finished
0709 14:53:36.182985 (+   429us) log.cc:844] Serialized 188 byte log entry
0709 14:53:36.493571 (+310586us) write_op.cc:489] Releasing partition, row and schema locks
0709 14:53:36.504916 (+ 11345us) write_op.cc:454] Released schema lock
0709 14:53:36.532415 (+ 27499us) write_op.cc:341] FINISH: Updating metrics
0709 14:53:36.665237 (+132822us) write_op.cc:489] Releasing partition, row and schema locks
0709 14:53:36.667470 (+  2233us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":92798,"reported_tablets":40,"child_traces":[["op",{"apply.queue_time_us":188089,"apply.run_cpu_time_us":111090,"apply.run_wall_time_us":1729476,"cfile_cache_hit":86,"cfile_cache_hit_bytes":91655,"num_ops":21,"prepare.queue_time_us":83726,"prepare.run_cpu_time_us":6273,"prepare.run_wall_time_us":10160,"replication_time_us":5987,"thread_start_us":550582,"threads_started":3,"wal-append.queue_time_us":483291,"wal-append.run_cpu_time_us":11371,"wal-append.run_wall_time_us":1146271}]]}
I20260709 14:53:38.927488  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:38.945705  7674 catalog_manager.cc:5697] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:53:38.950103 14532 raft_consensus.cc:493] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:38.949972  7674 catalog_manager.cc:5697] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:53:38.951442 14532 raft_consensus.cc:515] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:38.953120  7674 catalog_manager.cc:5697] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 17 to 20, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 20 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:53:38.952345 14405 raft_consensus.cc:3055] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 LEADER]: Stepping down as leader of term 18
I20260709 14:53:38.956998 14405 raft_consensus.cc:740] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:53:38.956126 14394 consensus_queue.cc:260] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:53:38.944520 14535 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.728s	user 0.030s	sys 0.028s
I20260709 14:53:38.960821  7676 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51352 (request call id 181) took 1610 ms. Trace:
I20260709 14:53:38.942982 14551 raft_consensus.cc:2749] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 14:53:38.961194  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 20 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:38.961300 14535 raft_consensus.cc:697] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:53:38.969005 14535 consensus_queue.cc:237] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:38.968921  7674 catalog_manager.cc:5697] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 15 to 17, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 17 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:53:38.958949 14081 leader_election.cc:290] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:38.957937 14405 consensus_queue.cc:260] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:53:38.944448  7893 consensus_peers.cc:597] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:53:38.975634 14405 raft_consensus.cc:3060] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Advancing to term 19
W20260709 14:53:38.975454  7893 consensus_peers.cc:597] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 14:53:38.976948  7893 consensus_peers.cc:597] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 14:53:38.977730  7893 leader_election.cc:336] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 14:53:38.978133  7893 leader_election.cc:304] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:38.981312 14459 raft_consensus.cc:2749] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 14:53:38.969393 14394 raft_consensus.cc:3060] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Advancing to term 21
W20260709 14:53:38.983011  7893 consensus_peers.cc:597] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 14:53:38.984068  7893 consensus_peers.cc:597] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 14:53:38.984948  7893 consensus_peers.cc:597] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 14:53:38.985572  7893 consensus_peers.cc:597] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 14:53:38.986172  7893 leader_election.cc:336] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 14:53:38.986562  7893 leader_election.cc:304] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:38.988452 14526 raft_consensus.cc:2749] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 14:53:38.988991  7893 consensus_peers.cc:597] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 14:53:38.989964  7893 leader_election.cc:336] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 14:53:38.990360  7893 leader_election.cc:304] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:38.991376 14526 raft_consensus.cc:2749] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 14:53:38.993505  7893 leader_election.cc:336] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 14:53:38.995611  7893 leader_election.cc:304] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:38.999351 14526 raft_consensus.cc:2749] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 14:53:38.999941  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:38.961406  7676 rpcz_store.cc:276] 0709 14:53:37.271077 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:53:37.271245 (+   168us) service_pool.cc:224] Handling call
0709 14:53:38.881455 (+1610210us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1450821,"reported_tablets":2}
I20260709 14:53:39.003130  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:39.005723  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:39.008688  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:39.016381  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:39.018165  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:39.022042  7845 raft_consensus.cc:1275] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 14:53:39.024766  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:39.027012  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:39.027444 14532 leader_election.cc:290] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:39.016569  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:39.059396  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258d6c2dda954bf5b65930fde8ecb9f3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:39.067034  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:39.072238  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 24 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:39.085834  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:39.086808  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:39.087918  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:39.088820  7926 raft_consensus.cc:2468] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 19.
I20260709 14:53:39.091553  7926 raft_consensus.cc:3060] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 14:53:39.092540  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:39.094144  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
W20260709 14:53:39.095664  7893 leader_election.cc:336] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 14:53:39.096581  7893 leader_election.cc:304] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:39.103121  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:39.104431  7920 raft_consensus.cc:2393] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 26: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:53:39.107106  7922 raft_consensus.cc:1240] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 22 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 21. Current term is 22. Ops: []
I20260709 14:53:39.117611  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
W20260709 14:53:39.118309  7893 leader_election.cc:336] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 14:53:39.118839  7893 leader_election.cc:304] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:39.123762  7927 raft_consensus.cc:2393] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 19: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:53:39.122385  7745 leader_election.cc:304] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:39.124615  7744 leader_election.cc:304] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0; no voters: 
I20260709 14:53:39.131713  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
W20260709 14:53:39.139737  7893 leader_election.cc:336] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 14:53:39.139463  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 20 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:39.140671  7893 leader_election.cc:304] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:39.140321  7745 leader_election.cc:304] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:39.150638  7745 leader_election.cc:304] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:39.152011  7745 leader_election.cc:304] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:39.154526  7927 raft_consensus.cc:1240] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 22 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 21. Current term is 22. Ops: []
I20260709 14:53:39.155237  7745 leader_election.cc:304] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:39.156198  7927 raft_consensus.cc:1240] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 26 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 25. Current term is 26. Ops: []
I20260709 14:53:39.139070 14382 raft_consensus.cc:2749] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 14:53:39.159533  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:39.117929 14386 raft_consensus.cc:493] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:39.121807 14462 raft_consensus.cc:2749] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 14:53:39.168021  7745 leader_election.cc:304] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:39.163858  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
W20260709 14:53:39.179090  7893 consensus_peers.cc:597] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:53:39.148404 14534 raft_consensus.cc:2749] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 14:53:39.149031 14431 raft_consensus.cc:2804] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 14:53:39.180076  7893 consensus_peers.cc:597] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 14:53:39.192188  7893 consensus_peers.cc:597] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:53:39.153700 14306 raft_consensus.cc:2749] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 14:53:39.157562 14376 raft_consensus.cc:2749] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 14:53:39.161387 14220 raft_consensus.cc:2749] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 14:53:39.158483 14398 raft_consensus.cc:2749] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 14:53:39.209326  7926 raft_consensus.cc:1275] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
W20260709 14:53:39.219340  7893 consensus_peers.cc:597] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:53:39.182642 14537 raft_consensus.cc:2749] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 14:53:39.153298 14540 consensus_queue.cc:1048] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.058s
I20260709 14:53:39.191016 14552 raft_consensus.cc:2749] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 14:53:39.197350 14431 raft_consensus.cc:493] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Starting leader election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:39.252861 14431 raft_consensus.cc:3060] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Advancing to term 20
I20260709 14:53:39.215055 14532 raft_consensus.cc:493] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9418391fa82a42c79c6cad13ba91d964)
I20260709 14:53:39.258006 14532 raft_consensus.cc:515] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:53:39.260601 14532 leader_election.cc:290] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68:42321)
I20260709 14:53:39.195936 14394 consensus_queue.cc:1048] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.068s
W20260709 14:53:39.242097 14566 log.cc:927] Time spent T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 14:53:39.183223 14386 raft_consensus.cc:515] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:39.268479 14386 leader_election.cc:290] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:39.340306  8637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18d29d52d304c87b930d4fb5eaf50b1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9418391fa82a42c79c6cad13ba91d964" is_pre_election: true
I20260709 14:53:39.318482 14540 raft_consensus.cc:493] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:53:39.343827  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 176021us
I20260709 14:53:39.348966  7745 leader_election.cc:304] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:39.351162  7745 leader_election.cc:304] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:53:39.358806  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 196596us
I20260709 14:53:39.377653  7745 leader_election.cc:304] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:53:39.390750  7820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:39.355800 14552 raft_consensus.cc:2749] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 14:53:39.394029  7745 leader_election.cc:304] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:39.345902 14535 raft_consensus.cc:493] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:39.379168 14532 raft_consensus.cc:2749] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 14:53:39.406625  7745 leader_election.cc:304] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 3876b8ee8d744cb18e91d97aae93b1ac, 9418391fa82a42c79c6cad13ba91d964
I20260709 14:53:39.399680 14220 raft_consensus.cc:2749] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 14:53:39.395030 14341 consensus_queue.cc:1048] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.013s
I20260709 14:53:39.392401 14491 raft_consensus.cc:493] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:39.410408 14491 raft_consensus.cc:515] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:39.411470 14534 raft_consensus.cc:2749] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 14:53:39.401867 14535 raft_consensus.cc:515] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:39.416630 14491 leader_election.cc:290] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:39.419467 14535 leader_election.cc:290] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:39.404021 14382 raft_consensus.cc:493] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:39.435998 14382 raft_consensus.cc:515] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:39.389999 14393 consensus_queue.cc:1059] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.064s
I20260709 14:53:39.356838 14540 raft_consensus.cc:515] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:39.392521 14564 raft_consensus.cc:493] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:39.457067 14564 raft_consensus.cc:515] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:53:39.457940 14568 log.cc:927] Time spent T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.071s	user 0.000s	sys 0.002s
I20260709 14:53:39.460038 14564 leader_election.cc:290] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:39.450001 14577 raft_consensus.cc:3055] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 LEADER]: Stepping down as leader of term 20
I20260709 14:53:39.460790 14577 raft_consensus.cc:740] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:53:39.457024  7847 raft_consensus.cc:2468] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 19.
I20260709 14:53:39.461848 14577 consensus_queue.cc:260] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:39.463442 14577 raft_consensus.cc:3060] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Advancing to term 21
I20260709 14:53:39.471195 14540 leader_election.cc:290] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:39.353720 14386 consensus_queue.cc:1048] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.050s
I20260709 14:53:39.477420 14382 leader_election.cc:290] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:53:39.482177  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 75784.4us
I20260709 14:53:39.483776  7745 leader_election.cc:304] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:39.486284 14576 raft_consensus.cc:2749] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 14:53:39.489434 14534 raft_consensus.cc:2749] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 14:53:39.493547 14535 raft_consensus.cc:493] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:39.494185 14535 raft_consensus.cc:515] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:39.498240 14575 raft_consensus.cc:493] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:39.498360 14564 raft_consensus.cc:493] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:39.499091 14522 raft_consensus.cc:493] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:39.499310 14564 raft_consensus.cc:515] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:39.499787 14522 raft_consensus.cc:515] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:39.502802 14564 leader_election.cc:290] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:39.485124  7745 leader_election.cc:304] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:39.506309  7745 leader_election.cc:304] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:39.508392 14552 raft_consensus.cc:2749] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 14:53:39.511732  7745 leader_election.cc:304] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:39.515731  7745 leader_election.cc:304] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:39.507091 14535 leader_election.cc:290] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:39.510167 14576 raft_consensus.cc:2749] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 14:53:39.398645 14431 raft_consensus.cc:515] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:39.508438 14564 raft_consensus.cc:493] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:39.520334  7745 leader_election.cc:304] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:39.521721 14535 raft_consensus.cc:2749] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 14:53:39.523654  7745 leader_election.cc:304] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:39.518034 14552 raft_consensus.cc:2749] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 14:53:39.515260 14398 raft_consensus.cc:3060] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 25 FOLLOWER]: Advancing to term 26
I20260709 14:53:39.498930 14575 raft_consensus.cc:515] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:39.520655 14522 leader_election.cc:290] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:39.522919 14564 raft_consensus.cc:515] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:39.541102 14220 raft_consensus.cc:2749] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 14:53:39.544265  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 148140us
W20260709 14:53:39.547986  7819 leader_election.cc:336] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 14:53:39.543630  7745 leader_election.cc:304] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:39.549063  7819 leader_election.cc:304] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
W20260709 14:53:39.551020  7819 consensus_peers.cc:597] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 14:53:39.551535  7819 consensus_peers.cc:597] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 14:53:39.552050  7819 consensus_peers.cc:597] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 14:53:39.552531  7819 consensus_peers.cc:597] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:53:39.556005 14537 raft_consensus.cc:2749] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 14:53:39.556932  7745 leader_election.cc:304] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:39.550009 14522 raft_consensus.cc:493] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:39.561524 14459 raft_consensus.cc:493] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:39.544903 14552 consensus_queue.cc:1048] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 14:53:39.585121 14535 raft_consensus.cc:493] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:39.585753 14459 raft_consensus.cc:515] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:39.587460 14575 leader_election.cc:290] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:39.588726 14564 leader_election.cc:290] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:39.557927 14581 raft_consensus.cc:2749] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 14:53:39.580624 14306 raft_consensus.cc:2749] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 14:53:39.604846  7819 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:39.569063 14577 consensus_queue.cc:1059] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.016s
I20260709 14:53:39.600678 14535 raft_consensus.cc:515] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:53:39.607789  7819 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:39.616171  7928 raft_consensus.cc:1240] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Rejecting Update request from peer 3876b8ee8d744cb18e91d97aae93b1ac for earlier term 15. Current term is 16. Ops: []
I20260709 14:53:39.618196  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:39.618906  7920 raft_consensus.cc:2468] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 15.
I20260709 14:53:39.618813  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:39.620193  7923 raft_consensus.cc:2468] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 19.
I20260709 14:53:39.621089 14575 raft_consensus.cc:493] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:39.581188 14522 raft_consensus.cc:515] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:39.624467  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:53:39.643425  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 67027.4us
I20260709 14:53:39.652195 14405 consensus_queue.cc:1059] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 21.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 14:53:39.654210 14577 consensus_queue.cc:1059] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 25.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 14:53:39.655040 14393 raft_consensus.cc:3055] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 LEADER]: Stepping down as leader of term 18
I20260709 14:53:39.655364 14577 raft_consensus.cc:3055] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 LEADER]: Stepping down as leader of term 21
I20260709 14:53:39.655542 14491 raft_consensus.cc:3055] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 25 LEADER]: Stepping down as leader of term 25
I20260709 14:53:39.656347 14577 raft_consensus.cc:740] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:53:39.656438 14491 raft_consensus.cc:740] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:53:39.661605 14581 consensus_queue.cc:1059] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 14:53:39.662847  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 44397.1us
I20260709 14:53:39.664961 14459 leader_election.cc:290] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:39.673552  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:39.638356 14431 leader_election.cc:290] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 20 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:39.677937 14535 leader_election.cc:290] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:39.686571  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18d29d52d304c87b930d4fb5eaf50b1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:39.687000  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:39.655608 14393 raft_consensus.cc:740] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:53:39.690292  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:39.693197  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:39.669625 14306 raft_consensus.cc:493] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:39.696724  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:39.623687 14575 raft_consensus.cc:515] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:39.661821 14394 consensus_queue.cc:1059] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.030s
I20260709 14:53:39.701220  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:39.701164  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:39.705154  7853 raft_consensus.cc:2468] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 21.
W20260709 14:53:39.707984  7819 leader_election.cc:336] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 14:53:39.717300  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 72214.4us
I20260709 14:53:39.716827  7745 leader_election.cc:304] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:39.720389  7819 leader_election.cc:304] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:39.706983 14386 raft_consensus.cc:493] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:39.713712 14581 raft_consensus.cc:3055] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 LEADER]: Stepping down as leader of term 21
I20260709 14:53:39.729449 14386 raft_consensus.cc:515] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:39.734220 14589 raft_consensus.cc:2804] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 14:53:39.735020 14589 raft_consensus.cc:493] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting leader election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:39.735468 14589 raft_consensus.cc:3060] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Advancing to term 19
I20260709 14:53:39.738619 14522 leader_election.cc:290] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:39.699878 14306 raft_consensus.cc:515] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:39.742357 14386 leader_election.cc:290] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:39.714588 14393 consensus_queue.cc:260] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:39.755739  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:39.756739 14393 raft_consensus.cc:3060] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Advancing to term 19
I20260709 14:53:39.743454 14306 leader_election.cc:290] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:39.730831 14581 raft_consensus.cc:740] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:53:39.730480 14394 raft_consensus.cc:2749] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 14:53:39.747066 14575 leader_election.cc:290] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:39.751222 14398 raft_consensus.cc:2749] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 14:53:39.755257  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:39.789738  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:53:39.727679  7819 consensus_peers.cc:597] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:53:39.761839  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:39.764876 14581 consensus_queue.cc:260] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:39.767758  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:39.795157 14581 raft_consensus.cc:3060] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Advancing to term 22
I20260709 14:53:39.795480  7928 raft_consensus.cc:2393] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 21: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
W20260709 14:53:39.766966  8598 consensus_peers.cc:597] T 9441e831627143a991a1556dcdce71e3 P 9418391fa82a42c79c6cad13ba91d964 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 14:53:39.770159  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:39.772046  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:39.773473  7922 raft_consensus.cc:1275] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 14:53:39.773707 14589 raft_consensus.cc:515] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:39.806839 14577 consensus_queue.cc:260] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:39.808382 14577 raft_consensus.cc:3060] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Advancing to term 22
I20260709 14:53:39.775053 14564 raft_consensus.cc:493] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:39.777807  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:39.769842  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:39.771256  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:39.799403 14491 consensus_queue.cc:260] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 25.15, Last appended by leader: 15, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:39.805132 14589 leader_election.cc:290] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:53:39.794344  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 66718.6us
I20260709 14:53:39.814672 14491 raft_consensus.cc:3060] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 25 FOLLOWER]: Advancing to term 26
I20260709 14:53:39.827543 14512 raft_consensus.cc:3055] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 LEADER]: Stepping down as leader of term 15
I20260709 14:53:39.828135 14512 raft_consensus.cc:740] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:53:39.810956 14564 raft_consensus.cc:515] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:39.829161 14512 consensus_queue.cc:260] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:39.830816 14512 raft_consensus.cc:3060] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Advancing to term 16
I20260709 14:53:39.830953 14564 leader_election.cc:290] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:53:39.820540  7819 consensus_peers.cc:597] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 14:53:39.833070  7819 consensus_peers.cc:597] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 14:53:39.836788  7819 leader_election.cc:336] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 14:53:39.837070  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258d6c2dda954bf5b65930fde8ecb9f3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:39.837275  7819 leader_election.cc:304] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:39.838012  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
W20260709 14:53:39.840957  7819 leader_election.cc:336] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 14:53:39.841745  7819 leader_election.cc:304] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:39.841089  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:39.843781  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 24 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
W20260709 14:53:39.843406  7819 leader_election.cc:336] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 14:53:39.844417  7819 leader_election.cc:304] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:39.845170  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:39.847404  7927 raft_consensus.cc:2393] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 19: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:53:39.855726 14405 raft_consensus.cc:2749] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 14:53:39.858971  7819 leader_election.cc:336] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 14:53:39.859648  7819 leader_election.cc:304] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:39.866130  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
W20260709 14:53:39.867486  7819 leader_election.cc:336] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 14:53:39.870465  7819 leader_election.cc:304] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:39.871855 14407 raft_consensus.cc:2749] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 14:53:39.884819  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:39.868656 14405 raft_consensus.cc:2749] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 14:53:39.872669 14564 consensus_queue.cc:1048] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.034s
I20260709 14:53:39.843662 14394 raft_consensus.cc:2749] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 14:53:39.913625  7819 consensus_peers.cc:597] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:53:39.843876 14393 raft_consensus.cc:2749] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 14:53:39.929893  7819 leader_election.cc:336] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 14:53:39.930614  7819 leader_election.cc:304] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:39.935953 14407 raft_consensus.cc:2749] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 14:53:39.953629  7745 leader_election.cc:304] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:39.956468 14564 raft_consensus.cc:2749] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 14:53:39.961773  7745 leader_election.cc:304] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:39.963969 14564 raft_consensus.cc:2749] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 14:53:39.997375  7818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 14:53:40.013562  7893 consensus_peers.cc:597] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:53:40.021662  7745 leader_election.cc:304] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 3876b8ee8d744cb18e91d97aae93b1ac, 9418391fa82a42c79c6cad13ba91d964
I20260709 14:53:40.030004 14589 raft_consensus.cc:2749] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 14:53:40.033746  7745 leader_election.cc:304] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:40.036245 14589 raft_consensus.cc:2749] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 14:53:40.028092 14564 raft_consensus.cc:493] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:40.045854  7745 leader_election.cc:304] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:40.052302  7745 leader_election.cc:304] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:40.048943 14564 raft_consensus.cc:515] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:40.053442 14589 raft_consensus.cc:2749] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 14:53:40.057471  7819 leader_election.cc:304] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:40.068971  7745 leader_election.cc:304] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:40.069968 14398 raft_consensus.cc:2749] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 14:53:40.074944  7819 leader_election.cc:304] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
W20260709 14:53:40.075423  7893 leader_election.cc:336] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 14:53:40.075943  7893 leader_election.cc:304] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:40.081951 14589 raft_consensus.cc:2804] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 14:53:40.079818  7745 leader_election.cc:304] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:40.076784 14577 raft_consensus.cc:2804] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 14:53:40.078845 14393 raft_consensus.cc:2804] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 14:53:40.082811 14589 raft_consensus.cc:493] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Starting leader election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:40.098830  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:40.100088  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:40.083436 14460 raft_consensus.cc:2749] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 14:53:40.113323  7893 leader_election.cc:336] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 14:53:40.114691  7893 leader_election.cc:304] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:40.118628  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258d6c2dda954bf5b65930fde8ecb9f3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:40.120639  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:40.097347 14535 raft_consensus.cc:2749] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 14:53:40.123416  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 24 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:40.109313 14393 raft_consensus.cc:493] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:40.108541 14589 raft_consensus.cc:3060] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Advancing to term 21
I20260709 14:53:40.098609 14577 raft_consensus.cc:493] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:40.112757 14575 raft_consensus.cc:493] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:40.134613  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:40.132925 14393 raft_consensus.cc:3060] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Advancing to term 20
I20260709 14:53:40.148862  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:40.151265  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:40.154458  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:40.124785 14467 raft_consensus.cc:2749] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 14:53:40.136408 14577 raft_consensus.cc:3060] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Advancing to term 16
I20260709 14:53:40.164542  7745 leader_election.cc:304] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:40.194278  7745 leader_election.cc:304] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:40.153497 14575 raft_consensus.cc:515] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:40.183384 14386 raft_consensus.cc:493] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:40.213084  7847 raft_consensus.cc:2468] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 19.
I20260709 14:53:40.213649  7745 leader_election.cc:304] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:40.204711 14588 raft_consensus.cc:493] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:40.205031 14306 raft_consensus.cc:493] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:40.204253 14535 raft_consensus.cc:2749] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 14:53:40.205624 14522 raft_consensus.cc:2749] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 14:53:40.238646  7745 leader_election.cc:304] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:40.243505 14564 leader_election.cc:290] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:40.251904 14564 raft_consensus.cc:493] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:40.252526 14564 raft_consensus.cc:515] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:40.246130 14431 raft_consensus.cc:2749] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 14:53:40.255074 14564 leader_election.cc:290] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:40.235671 14588 raft_consensus.cc:515] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:40.257690 14588 leader_election.cc:290] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:40.228542 14386 raft_consensus.cc:515] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:40.267568 14386 leader_election.cc:290] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:40.244619 14306 raft_consensus.cc:515] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:40.270665 14306 leader_election.cc:290] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:40.272095 14589 raft_consensus.cc:515] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:40.274329 14589 leader_election.cc:290] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 21 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:40.274061 14393 raft_consensus.cc:515] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:40.277144 14575 leader_election.cc:290] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:40.235536 14398 raft_consensus.cc:2749] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 14:53:40.294699  7819 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 133 similar messages]
W20260709 14:53:40.302954  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 83924us
W20260709 14:53:40.306281  7819 consensus_peers.cc:597] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:53:40.307008  7851 raft_consensus.cc:1240] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 19. Current term is 20. Ops: []
W20260709 14:53:40.307287  7819 consensus_peers.cc:597] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 14:53:40.311277  7819 leader_election.cc:336] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 14:53:40.313339  7819 consensus_peers.cc:597] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 14:53:40.314100  7819 leader_election.cc:336] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 14:53:40.320883  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:40.322017  7927 raft_consensus.cc:2393] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 22: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:53:40.321389  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
W20260709 14:53:40.316879  7819 consensus_peers.cc:597] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 14:53:40.323187  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 78165us
I20260709 14:53:40.324002  7745 leader_election.cc:304] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:40.324319  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:40.326090  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:40.327036  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:40.309917 14575 raft_consensus.cc:493] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:40.326435  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:40.331559  7919 raft_consensus.cc:2393] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 21: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
W20260709 14:53:40.333828  7819 consensus_peers.cc:597] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:53:40.337934 14575 raft_consensus.cc:515] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:40.346803  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:40.348050  7845 raft_consensus.cc:2468] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 22.
I20260709 14:53:40.374015 14602 raft_consensus.cc:2749] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 14:53:40.375674  7745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 51787.2us
I20260709 14:53:40.377584  7745 leader_election.cc:304] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:40.340898 14575 leader_election.cc:290] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:40.380075  7745 leader_election.cc:304] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:53:40.381855  7819 consensus_peers.cc:597] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:53:40.373040 14393 leader_election.cc:290] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 20 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:40.388453  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:40.388679 14398 raft_consensus.cc:2749] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 14:53:40.382570 14602 raft_consensus.cc:2749] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 14:53:40.400313  7745 leader_election.cc:304] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:53:40.405521  8598 consensus_peers.cc:597] T 9ce9c0ef2db24c13a8b1402f21819458 P 9418391fa82a42c79c6cad13ba91d964 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 14:53:40.406867  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
W20260709 14:53:40.410810 14596 log.cc:927] Time spent T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.113s	user 0.003s	sys 0.000s
I20260709 14:53:40.415230 14577 raft_consensus.cc:515] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:40.416488 14602 raft_consensus.cc:2749] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 14:53:40.418270  7848 raft_consensus.cc:1240] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 14:53:40.420526 14577 leader_election.cc:290] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 16 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:40.423418  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:40.432188  7745 leader_election.cc:304] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:40.449815 14575 raft_consensus.cc:2804] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Leader election won for term 19
I20260709 14:53:40.450459 14575 raft_consensus.cc:697] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:53:40.451423 14575 consensus_queue.cc:237] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:40.448858  7745 leader_election.cc:304] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:40.461814  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:40.465844 14602 raft_consensus.cc:2804] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 14:53:40.466650 14602 raft_consensus.cc:493] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Starting leader election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:40.467089 14602 raft_consensus.cc:3060] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Advancing to term 22
I20260709 14:53:40.472961  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:40.474413  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:40.474381  7845 raft_consensus.cc:2410] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for term 22 because replica has last-logged OpId of term: 20 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 13.
I20260709 14:53:40.475615  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:40.478102  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:40.479761  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:40.475919  7675 catalog_manager.cc:5697] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 23 to 25. New cstate: current_term: 25 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:53:40.485059  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:40.488133  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:40.490872  7745 leader_election.cc:304] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:40.489018 14535 consensus_queue.cc:1059] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 14:53:40.491029  7675 catalog_manager.cc:5697] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed reported cstate change: term changed from 17 to 19, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 19 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:53:40.483287 14576 consensus_queue.cc:1059] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.026s
I20260709 14:53:40.494987 14307 raft_consensus.cc:493] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:40.498862 14306 raft_consensus.cc:493] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:40.499502 14307 raft_consensus.cc:515] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:40.500238 14535 raft_consensus.cc:3055] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 LEADER]: Stepping down as leader of term 15
I20260709 14:53:40.500764 14535 raft_consensus.cc:740] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:53:40.501901 14535 consensus_queue.cc:260] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:40.502533 14307 leader_election.cc:290] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:40.493010  7674 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54364 (request call id 350) took 4411 ms. Trace:
I20260709 14:53:40.509052 14306 raft_consensus.cc:515] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:40.514984 14589 raft_consensus.cc:2749] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 14:53:40.516258 14398 raft_consensus.cc:3055] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 LEADER]: Stepping down as leader of term 19
I20260709 14:53:40.523478 14398 raft_consensus.cc:740] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:53:40.503742 14535 raft_consensus.cc:3060] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Advancing to term 16
I20260709 14:53:40.524472 14398 consensus_queue.cc:260] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:40.515748  7745 leader_election.cc:304] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:40.525940 14398 raft_consensus.cc:3060] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Advancing to term 20
I20260709 14:53:40.527159 14589 raft_consensus.cc:2749] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 14:53:40.529886  7745 leader_election.cc:304] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:40.522735  7674 rpcz_store.cc:276] 0709 14:53:36.081812 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:53:36.086826 (+  5014us) service_pool.cc:224] Handling call
0709 14:53:40.492930 (+4406104us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 14:53:39.333290 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 14:53:39.462334 (+129044us) write_op.cc:432] Acquiring schema lock in shared mode
0709 14:53:39.462379 (+    45us) write_op.cc:435] Acquired schema lock
0709 14:53:39.462400 (+    21us) tablet.cc:662] Decoding operations
0709 14:53:39.463403 (+  1003us) write_op.cc:620] Acquiring the partition lock for write op
0709 14:53:39.463472 (+    69us) write_op.cc:641] Partition lock acquired for write op
0709 14:53:39.463499 (+    27us) tablet.cc:685] Acquiring locks for 10 operations
0709 14:53:39.464518 (+  1019us) tablet.cc:701] Row locks acquired
0709 14:53:39.464537 (+    19us) write_op.cc:260] PREPARE: finished
0709 14:53:39.465067 (+   530us) write_op.cc:270] Start()
0709 14:53:39.465226 (+   159us) write_op.cc:276] Timestamp: P: 1783608819464994 usec, L: 0
0709 14:53:39.465272 (+    46us) op_driver.cc:348] REPLICATION: starting
0709 14:53:39.466056 (+   784us) log.cc:844] Serialized 4000 byte log entry
0709 14:53:39.828088 (+362032us) op_driver.cc:464] REPLICATION: finished
0709 14:53:40.059966 (+231878us) write_op.cc:301] APPLY: starting
0709 14:53:40.060253 (+   287us) tablet.cc:1367] starting BulkCheckPresence
0709 14:53:40.258902 (+198649us) tablet.cc:1370] finished BulkCheckPresence
0709 14:53:40.259225 (+   323us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 14:53:40.354797 (+ 95572us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 14:53:40.355134 (+   337us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=20,key_file_lookups=20,delta_file_lookups=20,mrs_lookups=0
0709 14:53:40.355182 (+    48us) write_op.cc:312] APPLY: finished
0709 14:53:40.355645 (+   463us) log.cc:844] Serialized 97 byte log entry
0709 14:53:40.355882 (+   237us) write_op.cc:489] Releasing partition, row and schema locks
0709 14:53:40.356046 (+   164us) write_op.cc:454] Released schema lock
0709 14:53:40.356105 (+    59us) write_op.cc:341] FINISH: Updating metrics
0709 14:53:40.379847 (+ 23742us) write_op.cc:489] Releasing partition, row and schema locks
0709 14:53:40.381610 (+  1763us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":39418,"reported_tablets":41,"child_traces":[["op",{"apply.queue_time_us":231032,"apply.run_cpu_time_us":24784,"apply.run_wall_time_us":297165,"cfile_cache_hit":42,"cfile_cache_hit_bytes":45807,"num_ops":10,"prepare.queue_time_us":339013,"prepare.run_cpu_time_us":12788,"prepare.run_wall_time_us":230736,"raft.queue_time_us":124318,"raft.run_cpu_time_us":174534,"raft.run_wall_time_us":228244,"replication_time_us":362592,"thread_start_us":618287,"threads_started":4,"wal-append.queue_time_us":169116}]]}
I20260709 14:53:40.533098  7745 leader_election.cc:304] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:40.537060  7745 leader_election.cc:304] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:53:40.541741  7819 leader_election.cc:336] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 14:53:40.542423  7819 leader_election.cc:304] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:40.558591  7745 leader_election.cc:304] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:40.559561  7851 raft_consensus.cc:2468] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 21.
I20260709 14:53:40.566128  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:40.573134  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 22 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:40.574757  7845 raft_consensus.cc:2410] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed for term 22 because replica has last-logged OpId of term: 21 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
I20260709 14:53:40.568058 14307 raft_consensus.cc:2749] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 14:53:40.567850 14220 raft_consensus.cc:2749] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 14:53:40.570638  7745 leader_election.cc:304] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:40.567292 14393 raft_consensus.cc:2749] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 14:53:40.584444 14522 raft_consensus.cc:2804] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Leader election won for term 21
I20260709 14:53:40.585021 14522 raft_consensus.cc:697] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:53:40.586047 14522 consensus_queue.cc:237] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:40.557066 14576 raft_consensus.cc:2749] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 14:53:40.596659 14306 leader_election.cc:290] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:40.567531 14386 raft_consensus.cc:493] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:40.597967 14386 raft_consensus.cc:515] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:40.600819 14386 leader_election.cc:290] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:40.567796 14589 raft_consensus.cc:2749] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 14:53:40.603989  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:53:40.603618  8598 consensus_peers.cc:597] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 14:53:40.629455  7819 leader_election.cc:336] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 14:53:40.630296  7819 leader_election.cc:304] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
W20260709 14:53:40.636713  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 148872us
I20260709 14:53:40.637750 14407 raft_consensus.cc:493] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:40.658922 14407 raft_consensus.cc:515] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:40.634768 14394 raft_consensus.cc:2749] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 14:53:40.643041 14602 raft_consensus.cc:515] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:40.668202 14602 leader_election.cc:290] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 22 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:40.677465 14407 leader_election.cc:290] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:40.721212  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:40.722216  7924 raft_consensus.cc:2468] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 20.
I20260709 14:53:40.742182  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:40.742380 14460 raft_consensus.cc:493] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:40.752440 14460 raft_consensus.cc:515] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:40.769208 14460 leader_election.cc:290] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:40.771387  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:40.787320  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:40.788251  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 22 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:40.796782  7923 raft_consensus.cc:2393] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 22: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:53:40.797997  7851 raft_consensus.cc:2468] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 26.
I20260709 14:53:40.794376 14603 raft_consensus.cc:493] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:40.799372 14603 raft_consensus.cc:515] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:40.799217 14459 raft_consensus.cc:493] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:40.800726 14459 raft_consensus.cc:515] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:40.803449 14459 leader_election.cc:290] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:40.812259 14603 leader_election.cc:290] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:40.813930 14467 raft_consensus.cc:493] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:40.817266 14467 raft_consensus.cc:515] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:40.819717 14467 leader_election.cc:290] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:40.815197  7894 leader_election.cc:304] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:40.816128  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:40.816479  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:40.822000  7923 raft_consensus.cc:2393] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 22: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:53:40.815215  7819 leader_election.cc:304] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:40.822664 14535 raft_consensus.cc:493] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:40.822220  7676 catalog_manager.cc:5697] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 22 to 24, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 24 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:53:40.832751 14394 raft_consensus.cc:2804] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 14:53:40.833328 14394 raft_consensus.cc:493] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:40.824769  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:40.827702  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:40.833858 14394 raft_consensus.cc:3060] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Advancing to term 22
I20260709 14:53:40.834282  7847 raft_consensus.cc:2468] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 21.
I20260709 14:53:40.835583  7848 raft_consensus.cc:2468] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 16.
I20260709 14:53:40.829957 14459 raft_consensus.cc:493] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:40.837801 14459 raft_consensus.cc:515] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:40.820950 14467 raft_consensus.cc:493] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:40.839887 14467 raft_consensus.cc:515] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:40.839620 14602 raft_consensus.cc:493] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:40.841080 14602 raft_consensus.cc:515] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:40.842870 14467 leader_election.cc:290] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:40.843457 14602 leader_election.cc:290] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:40.845108 14459 leader_election.cc:290] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:40.851362  7894 leader_election.cc:304] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:40.863272  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:40.863565 14459 raft_consensus.cc:2804] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 14:53:40.864037  7848 raft_consensus.cc:2468] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 19.
I20260709 14:53:40.864137 14459 raft_consensus.cc:493] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:40.832777 14535 raft_consensus.cc:515] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:53:40.866585  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 45481.8us
I20260709 14:53:40.866751 14602 raft_consensus.cc:493] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:40.860440  7744 leader_election.cc:304] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:40.868291 14535 leader_election.cc:290] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:40.867918 14602 raft_consensus.cc:515] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:40.868764 14576 raft_consensus.cc:2749] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 14:53:40.816255  7849 raft_consensus.cc:2468] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 22.
I20260709 14:53:40.869982  7745 leader_election.cc:304] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:40.870800 14576 raft_consensus.cc:2804] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 14:53:40.863348  7847 raft_consensus.cc:1275] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 14:53:40.822263 14603 raft_consensus.cc:2804] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 14:53:40.871287 14576 raft_consensus.cc:493] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:40.823323  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:40.872210 14576 raft_consensus.cc:3060] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Advancing to term 20
I20260709 14:53:40.872167 14603 raft_consensus.cc:493] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:40.872732  7851 raft_consensus.cc:2468] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 22.
I20260709 14:53:40.873961 14603 raft_consensus.cc:3060] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 26 FOLLOWER]: Advancing to term 27
I20260709 14:53:40.873564 14602 leader_election.cc:290] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:40.878831  7745 leader_election.cc:304] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:40.879848  7744 leader_election.cc:304] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:40.862197  7894 leader_election.cc:304] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:40.880739 14535 consensus_queue.cc:1048] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 14:53:40.885975 14459 raft_consensus.cc:3060] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Advancing to term 22
I20260709 14:53:40.888015 14589 raft_consensus.cc:3060] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Advancing to term 22
I20260709 14:53:40.897665 14460 raft_consensus.cc:2804] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 14:53:40.898335 14460 raft_consensus.cc:493] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:40.898716 14460 raft_consensus.cc:3060] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 14:53:40.819819  7675 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54344 (request call id 382) took 6511 ms. Trace:
I20260709 14:53:40.908053  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:40.908705  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:53:40.910804  7819 leader_election.cc:336] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 14:53:40.915158  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:40.883967 14576 raft_consensus.cc:515] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:40.879931 14602 raft_consensus.cc:2804] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 22 FOLLOWER]: Leader election won for term 22
I20260709 14:53:40.905666  7675 rpcz_store.cc:276] 0709 14:53:34.308405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:53:34.313707 (+  5302us) service_pool.cc:224] Handling call
0709 14:53:40.819733 (+6506026us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 14:53:40.574875 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 14:53:40.575537 (+   662us) write_op.cc:432] Acquiring schema lock in shared mode
0709 14:53:40.575581 (+    44us) write_op.cc:435] Acquired schema lock
0709 14:53:40.575600 (+    19us) tablet.cc:662] Decoding operations
0709 14:53:40.576092 (+   492us) write_op.cc:620] Acquiring the partition lock for write op
0709 14:53:40.576188 (+    96us) write_op.cc:641] Partition lock acquired for write op
0709 14:53:40.576217 (+    29us) tablet.cc:685] Acquiring locks for 2 operations
0709 14:53:40.576607 (+   390us) tablet.cc:701] Row locks acquired
0709 14:53:40.576627 (+    20us) write_op.cc:260] PREPARE: finished
0709 14:53:40.576814 (+   187us) write_op.cc:270] Start()
0709 14:53:40.576953 (+   139us) write_op.cc:276] Timestamp: P: 1783608820576759 usec, L: 0
0709 14:53:40.576976 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 14:53:40.628691 (+ 51715us) log.cc:844] Serialized 923 byte log entry
0709 14:53:40.734423 (+105732us) op_driver.cc:464] REPLICATION: finished
0709 14:53:40.736355 (+  1932us) write_op.cc:301] APPLY: starting
0709 14:53:40.736467 (+   112us) tablet.cc:1367] starting BulkCheckPresence
0709 14:53:40.738899 (+  2432us) tablet.cc:1370] finished BulkCheckPresence
0709 14:53:40.739225 (+   326us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 14:53:40.750450 (+ 11225us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 14:53:40.750628 (+   178us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=4,mrs_lookups=0
0709 14:53:40.750668 (+    40us) write_op.cc:312] APPLY: finished
0709 14:53:40.750899 (+   231us) log.cc:844] Serialized 33 byte log entry
0709 14:53:40.751195 (+   296us) write_op.cc:489] Releasing partition, row and schema locks
0709 14:53:40.751298 (+   103us) write_op.cc:454] Released schema lock
0709 14:53:40.751348 (+    50us) write_op.cc:341] FINISH: Updating metrics
0709 14:53:40.763250 (+ 11902us) write_op.cc:489] Releasing partition, row and schema locks
0709 14:53:40.763302 (+    52us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":23260,"reported_tablets":31,"child_traces":[["op",{"apply.queue_time_us":1364,"apply.run_cpu_time_us":6317,"apply.run_wall_time_us":26591,"cfile_cache_hit":8,"cfile_cache_hit_bytes":8336,"num_ops":2,"prepare.queue_time_us":77120,"prepare.run_cpu_time_us":4119,"prepare.run_wall_time_us":58294,"replication_time_us":145427,"thread_start_us":59924,"threads_started":1}]]}
I20260709 14:53:40.916255  7851 raft_consensus.cc:2468] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 22.
I20260709 14:53:40.920352 14602 raft_consensus.cc:697] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 22 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:53:40.913529 14535 raft_consensus.cc:493] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:40.921393 14602 consensus_queue.cc:237] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 21.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:40.921770 14535 raft_consensus.cc:515] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:53:40.924397  7742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 14:53:40.915083  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:40.938555  7849 raft_consensus.cc:2468] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 19.
I20260709 14:53:40.941758  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:40.947715 14603 raft_consensus.cc:515] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:40.947943  7894 leader_election.cc:304] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:40.969372 14526 raft_consensus.cc:2804] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 14:53:40.969946 14526 raft_consensus.cc:493] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:40.970111  7894 leader_election.cc:304] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:40.970520 14526 raft_consensus.cc:3060] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 22 FOLLOWER]: Advancing to term 23
I20260709 14:53:40.952230 14589 raft_consensus.cc:2749] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 14:53:40.971701  7744 leader_election.cc:304] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:40.971737  7894 leader_election.cc:304] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:40.911806  7676 catalog_manager.cc:5697] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:53:40.936556 14394 raft_consensus.cc:515] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:40.953056 14535 leader_election.cc:290] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:40.954051 14576 leader_election.cc:290] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 20 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:40.959281  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:40.978632  7849 raft_consensus.cc:3060] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Advancing to term 20
I20260709 14:53:40.975025  7676 catalog_manager.cc:5697] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 16 to 17, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 17 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:53:40.988147  7676 catalog_manager.cc:5697] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:53:40.977479 14551 raft_consensus.cc:2804] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 14:53:40.977124 14601 raft_consensus.cc:2804] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 14:53:40.975538 14575 raft_consensus.cc:2749] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 14:53:40.992179  7676 catalog_manager.cc:5697] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 18 to 21, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 21 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:53:40.966639 14459 raft_consensus.cc:515] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:41.001745  7676 catalog_manager.cc:5697] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 20 to 23, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 23 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:53:41.008888 14459 leader_election.cc:290] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 22 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:40.994019 14551 raft_consensus.cc:493] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:41.010637 14603 leader_election.cc:290] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 27 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:41.013880 14394 leader_election.cc:290] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 22 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:40.998716 14601 raft_consensus.cc:493] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:41.029825 14601 raft_consensus.cc:3060] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Advancing to term 19
I20260709 14:53:41.028330 14551 raft_consensus.cc:3060] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 22 FOLLOWER]: Advancing to term 23
I20260709 14:53:41.020187  7851 raft_consensus.cc:1275] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 14:53:41.039969 14601 raft_consensus.cc:515] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:41.041755 14526 raft_consensus.cc:515] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:41.023964  7849 raft_consensus.cc:2468] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 20.
I20260709 14:53:41.026984 14575 raft_consensus.cc:493] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:41.000627 14460 raft_consensus.cc:515] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:41.049203  7745 leader_election.cc:304] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:41.045902  7676 catalog_manager.cc:5697] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 22 to 24. New cstate: current_term: 24 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:53:41.067759  7676 catalog_manager.cc:5697] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:53:41.053450  6549 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 14:53:41.071895  7676 catalog_manager.cc:5697] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 15 to 19, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 19 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
W20260709 14:53:41.049156  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 63592.3us
I20260709 14:53:41.071589  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:41.076334  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:41.077162  7924 raft_consensus.cc:2468] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 19.
I20260709 14:53:41.078663  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:41.079356  7849 raft_consensus.cc:3060] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 26 FOLLOWER]: Advancing to term 27
I20260709 14:53:41.084429  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:41.085145  7848 raft_consensus.cc:3060] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Advancing to term 22
I20260709 14:53:41.085628  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:41.087212 14526 leader_election.cc:290] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 23 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:41.089509  7676 catalog_manager.cc:5697] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:53:41.054804 14460 leader_election.cc:290] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 17 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:41.095140  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:41.095882  7845 raft_consensus.cc:3060] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 22 FOLLOWER]: Advancing to term 23
I20260709 14:53:41.090656  7849 raft_consensus.cc:2468] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 27.
I20260709 14:53:41.093091  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:41.097695  7847 raft_consensus.cc:3060] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Advancing to term 17
I20260709 14:53:41.100560  7927 raft_consensus.cc:1275] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 14:53:41.101716  7848 raft_consensus.cc:2468] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 22.
W20260709 14:53:41.095861  7819 leader_election.cc:336] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 14:53:41.071914 14602 raft_consensus.cc:2804] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Leader election won for term 20
I20260709 14:53:41.046932 14522 consensus_queue.cc:1048] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.042s
I20260709 14:53:41.105921  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:41.120240  7924 raft_consensus.cc:3060] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Advancing to term 20
I20260709 14:53:41.048255 14575 raft_consensus.cc:515] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:41.107926  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:41.108233  6549 tablet_replica.cc:333] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed: stopping tablet replica
I20260709 14:53:41.112881 14601 leader_election.cc:290] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:41.117435  7847 raft_consensus.cc:2468] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 17.
I20260709 14:53:41.116505 14589 raft_consensus.cc:493] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:41.132484  7845 raft_consensus.cc:2468] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 23.
I20260709 14:53:41.134552 14589 raft_consensus.cc:515] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:41.102823 14306 raft_consensus.cc:493] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:41.146535  6549 raft_consensus.cc:2243] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 24 LEADER]: Raft consensus shutting down.
I20260709 14:53:41.151806  6549 raft_consensus.cc:2272] T 789f551efdf242eb9b285eebd8ea0f1a P 1de5e20126fa4d8ca0793d19c7b847ed [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 14:53:41.155717 14612 raft_consensus.cc:493] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:41.165755 14612 raft_consensus.cc:515] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:41.167939 14575 leader_election.cc:290] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:41.168401  7924 raft_consensus.cc:2468] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 20.
I20260709 14:53:41.169485  6549 tablet_replica.cc:333] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed: stopping tablet replica
I20260709 14:53:41.156447 14589 leader_election.cc:290] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:41.146214 14306 raft_consensus.cc:515] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:53:41.175591  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 57050.1us
I20260709 14:53:41.177012  7744 leader_election.cc:304] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:41.180286  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:41.181876  7849 raft_consensus.cc:1240] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 22 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 21. Current term is 22. Ops: [21.14-21.14]
I20260709 14:53:41.178220  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:41.183470  7845 raft_consensus.cc:2368] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 19. Current term is 20.
I20260709 14:53:41.186878  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:41.187616  7924 raft_consensus.cc:3060] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Advancing to term 22
W20260709 14:53:41.189894  7893 leader_election.cc:336] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 14:53:41.193691  6549 raft_consensus.cc:2243] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 14:53:41.198308  7744 leader_election.cc:304] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:53:41.198653  7893 leader_election.cc:336] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 14:53:41.201208  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:41.214916  6549 raft_consensus.cc:2272] T ff4c35543cc44c64a939eae4f3e5e258 P 1de5e20126fa4d8ca0793d19c7b847ed [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 14:53:41.210189  7894 leader_election.cc:304] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:41.216447  7894 leader_election.cc:304] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:41.219985 14619 consensus_queue.cc:1059] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 14:53:41.221150 14619 raft_consensus.cc:2749] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 14:53:41.222080 14619 raft_consensus.cc:3055] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 LEADER]: Stepping down as leader of term 21
I20260709 14:53:41.222522 14619 raft_consensus.cc:740] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:53:41.223397 14619 consensus_queue.cc:260] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:41.224731 14619 raft_consensus.cc:3060] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Advancing to term 22
I20260709 14:53:41.225059 14306 leader_election.cc:290] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:41.222069 14603 raft_consensus.cc:2804] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 14:53:41.227360 14603 raft_consensus.cc:697] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 22 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:41.228397 14603 consensus_queue.cc:237] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:41.238890  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:41.206723 14602 raft_consensus.cc:697] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:53:41.212815 14576 raft_consensus.cc:2749] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 14:53:41.247928 14551 raft_consensus.cc:515] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:41.251411  6549 tablet_replica.cc:333] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed: stopping tablet replica
I20260709 14:53:41.232189 14526 raft_consensus.cc:2804] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 14:53:41.231789 14612 leader_election.cc:290] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:53:41.271466  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 73386.2us
I20260709 14:53:41.273770  7924 raft_consensus.cc:2468] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 22.
W20260709 14:53:41.269024  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 52686.4us
I20260709 14:53:41.271333  6549 raft_consensus.cc:2243] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 14:53:41.275480  7744 leader_election.cc:304] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:41.275432  7894 leader_election.cc:304] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:41.276173 14589 consensus_queue.cc:1048] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.003s
I20260709 14:53:41.280140  6549 pending_rounds.cc:70] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed: Trying to abort 1 pending ops.
I20260709 14:53:41.279160 14460 raft_consensus.cc:2804] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 14:53:41.277582  7894 leader_election.cc:304] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:41.281091 14460 raft_consensus.cc:697] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:41.281824 14613 raft_consensus.cc:2804] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 14:53:41.282486 14613 raft_consensus.cc:697] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 23 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:41.282207 14460 consensus_queue.cc:237] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:41.283454 14613 consensus_queue.cc:237] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:41.286800 14551 leader_election.cc:290] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 23 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:41.280696  6549 pending_rounds.cc:77] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed: Aborting op as it isn't in flight: id { term: 21 index: 12 } timestamp: 7305661667944812544 op_type: NO_OP noop_request { }
I20260709 14:53:41.272923 14526 raft_consensus.cc:697] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 27 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:41.288604  6549 raft_consensus.cc:2889] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 14:53:41.289479  6549 raft_consensus.cc:2272] T 1cacfb5953cb4bf2a7fe431923ead129 P 1de5e20126fa4d8ca0793d19c7b847ed [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 14:53:41.302407  7894 leader_election.cc:400] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 election: Vote denied by peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529) with higher term. Message: Invalid argument: T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 19. Current term is 20.
I20260709 14:53:41.303135  7894 leader_election.cc:403] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 14:53:41.314899  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:41.315776  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
W20260709 14:53:41.316323  7893 leader_election.cc:336] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 14:53:41.320175  7893 leader_election.cc:336] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 14:53:41.301563 14575 raft_consensus.cc:2749] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 14:53:41.327099 14621 raft_consensus.cc:493] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:41.327265 14459 raft_consensus.cc:2749] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529) with higher term. Message: Invalid argument: T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 for earlier term 19. Current term is 20.
I20260709 14:53:41.327802 14621 raft_consensus.cc:515] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:41.330269 14602 consensus_queue.cc:237] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:41.333622  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:41.362702 14398 raft_consensus.cc:493] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:53:41.363297  7893 leader_election.cc:336] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 14:53:41.368059  6549 tablet_replica.cc:333] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed: stopping tablet replica
I20260709 14:53:41.380741  6549 raft_consensus.cc:2243] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 14:53:41.381649  6549 raft_consensus.cc:2272] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 14:53:41.378268 14398 raft_consensus.cc:515] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:41.289590 14526 consensus_queue.cc:237] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 25.15, Last appended by leader: 15, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:41.324174 14589 raft_consensus.cc:493] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9418391fa82a42c79c6cad13ba91d964)
I20260709 14:53:41.382994 14589 raft_consensus.cc:515] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
W20260709 14:53:41.385933  7893 leader_election.cc:336] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 14:53:41.391280  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:41.394201  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9441e831627143a991a1556dcdce71e3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:41.398765  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:41.399577  8637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9441e831627143a991a1556dcdce71e3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9418391fa82a42c79c6cad13ba91d964" is_pre_election: true
I20260709 14:53:41.402704  7923 raft_consensus.cc:1240] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 22 LEADER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 21. Current term is 22. Ops: []
I20260709 14:53:41.411365  7927 raft_consensus.cc:1240] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 23 LEADER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 22. Current term is 23. Ops: []
I20260709 14:53:41.417865  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:41.423424  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:41.424296  7851 raft_consensus.cc:3060] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 22 FOLLOWER]: Advancing to term 23
I20260709 14:53:41.385790 14589 leader_election.cc:290] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68:42321)
I20260709 14:53:41.379345 14621 leader_election.cc:290] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:41.428565  7744 leader_election.cc:304] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:41.434758  7744 leader_election.cc:304] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:41.442809  6549 tablet_replica.cc:333] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed: stopping tablet replica
I20260709 14:53:41.444224  6549 raft_consensus.cc:2243] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 14:53:41.444816 14622 raft_consensus.cc:493] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:41.445514 14622 raft_consensus.cc:515] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:41.447985 14622 leader_election.cc:290] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:41.454638  7851 raft_consensus.cc:2468] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 23.
I20260709 14:53:41.433789 14617 raft_consensus.cc:493] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:41.462725 14617 raft_consensus.cc:515] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:41.410202 14575 raft_consensus.cc:493] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:41.467145 14575 raft_consensus.cc:515] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:41.468416 14398 leader_election.cc:290] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:41.470790  7819 leader_election.cc:304] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:53:41.485607  7744 leader_election.cc:304] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:41.490588  6549 raft_consensus.cc:2272] T 696fba4415c046498d3e10fb37d1a67f P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 14:53:41.437624 14576 raft_consensus.cc:2749] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 14:53:41.527576  7894 leader_election.cc:304] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:41.529675  7744 leader_election.cc:304] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:41.483834 14619 raft_consensus.cc:2749] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 14:53:41.535168  8599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 124523us
I20260709 14:53:41.518069 14622 raft_consensus.cc:2749] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 14:53:41.519676 14407 raft_consensus.cc:2804] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 22 FOLLOWER]: Leader election won for term 22
I20260709 14:53:41.539955  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:41.540894  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c563cc7cfbe4d59be4ffc5cf847ce56" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:41.541615  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:41.536629  7742 leader_election.cc:304] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 3876b8ee8d744cb18e91d97aae93b1ac, 9418391fa82a42c79c6cad13ba91d964
W20260709 14:53:41.548837  7893 leader_election.cc:336] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 14:53:41.551007  7893 leader_election.cc:336] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 14:53:41.552309  7893 leader_election.cc:336] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 14:53:41.558069  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:41.558838  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:41.560091  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
W20260709 14:53:41.560961  7893 leader_election.cc:336] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 14:53:41.562188  7893 leader_election.cc:336] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 14:53:41.528996 14617 leader_election.cc:290] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:41.566044  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:41.569176  7854 raft_consensus.cc:2393] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 27: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:53:41.575598  6549 tablet_replica.cc:333] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed: stopping tablet replica
I20260709 14:53:41.540391 14306 raft_consensus.cc:2749] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 14:53:41.567286 14576 consensus_queue.cc:1059] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.018s
I20260709 14:53:41.567677 14407 raft_consensus.cc:697] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 22 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:53:41.553532 14459 raft_consensus.cc:2804] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 14:53:41.586274 14617 raft_consensus.cc:2749] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 14:53:41.591221  6549 raft_consensus.cc:2243] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Raft consensus shutting down.
W20260709 14:53:41.611214  7893 leader_election.cc:336] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 14:53:41.614203  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 86735.6us
I20260709 14:53:41.615286  7893 leader_election.cc:304] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:41.621840  6549 raft_consensus.cc:2272] T 1736a0500c6d452ea11b6d10b4034d86 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 14:53:41.596905 14575 leader_election.cc:290] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:41.601545 14576 consensus_queue.cc:1243] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Peer 1e9289592458429bbddb19c2e7b7b7b0 log is divergent from this leader: its last log entry 23.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 14:53:41.613451 14459 raft_consensus.cc:697] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 23 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:41.657666  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c563cc7cfbe4d59be4ffc5cf847ce56" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
W20260709 14:53:41.671315  8598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 93365.3us
I20260709 14:53:41.648504 14535 raft_consensus.cc:493] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:53:41.671015  7893 leader_election.cc:336] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 14:53:41.648129 14619 raft_consensus.cc:493] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
W20260709 14:53:41.677923  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 134985us
I20260709 14:53:41.654075 14613 raft_consensus.cc:2749] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 14:53:41.666801 14467 raft_consensus.cc:493] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:53:41.687170  7745 leader_election.cc:304] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:41.687556 14467 raft_consensus.cc:515] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:41.691851 14467 leader_election.cc:290] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:53:41.693054 14628 log.cc:927] Time spent T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.158s	user 0.002s	sys 0.000s
I20260709 14:53:41.686589 14619 raft_consensus.cc:515] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:41.701020 14459 consensus_queue.cc:237] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:41.707015 14602 raft_consensus.cc:3055] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 22 LEADER]: Stepping down as leader of term 22
I20260709 14:53:41.707756 14602 raft_consensus.cc:740] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:53:41.681289 14535 raft_consensus.cc:515] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:41.672482 14407 consensus_queue.cc:237] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:41.715778  7854 raft_consensus.cc:1240] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 23 FOLLOWER]: Rejecting Update request from peer 1de5e20126fa4d8ca0793d19c7b847ed for earlier term 22. Current term is 23. Ops: []
W20260709 14:53:41.723634 14632 log.cc:927] Time spent T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.070s	user 0.001s	sys 0.001s
I20260709 14:53:41.727803  7745 leader_election.cc:304] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:41.731823 14535 leader_election.cc:290] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:41.732481 14398 raft_consensus.cc:2749] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 14:53:41.733403 14306 raft_consensus.cc:2749] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 14:53:41.731900  7745 leader_election.cc:304] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:41.742594  7745 leader_election.cc:304] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:41.725395 14617 raft_consensus.cc:493] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:41.760159 14617 raft_consensus.cc:515] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:41.755627 14306 raft_consensus.cc:3060] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 26 FOLLOWER]: Advancing to term 27
I20260709 14:53:41.750319 14589 raft_consensus.cc:2749] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 14:53:41.708882 14602 consensus_queue.cc:260] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 22.12, Last appended by leader: 12, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:41.765489 14535 consensus_queue.cc:1059] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 14:53:41.767490 14619 leader_election.cc:290] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:41.768788 14602 raft_consensus.cc:3060] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 22 FOLLOWER]: Advancing to term 23
I20260709 14:53:41.770568 14617 leader_election.cc:290] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:41.790907 14306 raft_consensus.cc:2749] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 27 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 14:53:41.845932  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 122566us
I20260709 14:53:41.846623  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:41.849393  7854 raft_consensus.cc:2468] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 16.
I20260709 14:53:41.855544  6549 tablet_replica.cc:333] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed: stopping tablet replica
I20260709 14:53:41.902477  7745 leader_election.cc:304] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:41.913937 14589 raft_consensus.cc:2804] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 14:53:41.914767 14589 raft_consensus.cc:493] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:41.915442 14589 raft_consensus.cc:3060] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Advancing to term 17
I20260709 14:53:41.930086  6549 raft_consensus.cc:2243] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 14:53:41.938273  6549 pending_rounds.cc:70] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed: Trying to abort 1 pending ops.
I20260709 14:53:41.938755  6549 pending_rounds.cc:77] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed: Aborting op as it isn't in flight: id { term: 18 index: 11 } timestamp: 7305661664371793920 op_type: NO_OP noop_request { }
I20260709 14:53:41.947132  6549 raft_consensus.cc:2889] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 14:53:41.951252  6549 raft_consensus.cc:2272] T c6a7a532d2ca462ab2cdcd681e28661d P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 14:53:41.956112  6549 tablet_replica.cc:333] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed: stopping tablet replica
I20260709 14:53:41.962164  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:42.054127  7854 raft_consensus.cc:2393] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 16: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:53:41.968077  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:41.969059  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:42.056051  7925 raft_consensus.cc:2468] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 15.
I20260709 14:53:41.970220  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:41.978019 14398 raft_consensus.cc:493] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:41.982909  7852 raft_consensus.cc:1275] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 22 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 14:53:41.989799  7845 raft_consensus.cc:1275] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 27 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 25 index: 15. Preceding OpId from leader: term: 27 index: 16. (index mismatch)
I20260709 14:53:41.990878  7853 raft_consensus.cc:1275] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 23 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 23 index: 12. (index mismatch)
I20260709 14:53:42.007105  7850 raft_consensus.cc:1275] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 14:53:42.008507 14589 raft_consensus.cc:515] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:42.057973 14398 raft_consensus.cc:515] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:42.063167 14589 leader_election.cc:290] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:42.027150  7846 raft_consensus.cc:1275] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 14:53:42.025285  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:42.026118  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:42.063865 14398 leader_election.cc:290] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:42.067958  6549 raft_consensus.cc:2243] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 14:53:42.111240 14589 consensus_queue.cc:1048] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 14:53:42.113274  6549 raft_consensus.cc:2272] T 37d50517fdd04953b2868e01a0624afa P 1de5e20126fa4d8ca0793d19c7b847ed [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 14:53:42.115562  7745 leader_election.cc:304] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:42.118189 14589 raft_consensus.cc:2749] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 14:53:42.119829  7925 raft_consensus.cc:1275] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 14:53:42.122988  7745 leader_election.cc:304] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:42.126094 14589 raft_consensus.cc:2749] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 14:53:42.133512  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:42.134383  7847 raft_consensus.cc:3060] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Advancing to term 17
I20260709 14:53:42.145403 14589 raft_consensus.cc:493] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9418391fa82a42c79c6cad13ba91d964)
I20260709 14:53:42.146067  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:42.146312 14589 raft_consensus.cc:515] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:53:42.145764 14623 consensus_queue.cc:1048] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.003s
I20260709 14:53:42.152206  6549 tablet_replica.cc:333] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed: stopping tablet replica
I20260709 14:53:42.154353 14623 consensus_queue.cc:1048] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 14:53:42.154670  8637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18d29d52d304c87b930d4fb5eaf50b1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9418391fa82a42c79c6cad13ba91d964" is_pre_election: true
I20260709 14:53:42.158279 14635 consensus_queue.cc:1048] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 14:53:42.159643 14589 leader_election.cc:290] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68:42321)
I20260709 14:53:42.159811 14623 consensus_queue.cc:1048] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 14:53:42.165469  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18d29d52d304c87b930d4fb5eaf50b1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:42.172865  7676 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54350 (request call id 382) took 2585 ms. Trace:
I20260709 14:53:42.185837  7745 leader_election.cc:304] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 3876b8ee8d744cb18e91d97aae93b1ac, 9418391fa82a42c79c6cad13ba91d964
I20260709 14:53:42.191545  7847 raft_consensus.cc:2468] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 17.
I20260709 14:53:42.194085 14535 raft_consensus.cc:493] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:42.175853  6549 raft_consensus.cc:2243] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 14:53:42.201534  7674 catalog_manager.cc:5697] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:53:42.210426  7745 leader_election.cc:304] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:42.216387 14535 raft_consensus.cc:515] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:42.219524 14602 raft_consensus.cc:493] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:42.220098 14535 leader_election.cc:290] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:42.220903 14589 raft_consensus.cc:2749] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 14:53:42.220664 14602 raft_consensus.cc:515] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:53:42.225538 14602 leader_election.cc:290] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785), 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68:42321)
I20260709 14:53:42.226303  8637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce9c0ef2db24c13a8b1402f21819458" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9418391fa82a42c79c6cad13ba91d964" is_pre_election: true
I20260709 14:53:42.173636  7676 rpcz_store.cc:276] 0709 14:53:39.587473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:53:39.587673 (+   200us) service_pool.cc:224] Handling call
0709 14:53:42.172618 (+2584945us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 14:53:41.525523 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 14:53:41.648349 (+122826us) write_op.cc:432] Acquiring schema lock in shared mode
0709 14:53:41.653299 (+  4950us) write_op.cc:435] Acquired schema lock
0709 14:53:41.661940 (+  8641us) tablet.cc:662] Decoding operations
0709 14:53:41.704260 (+ 42320us) write_op.cc:620] Acquiring the partition lock for write op
0709 14:53:41.704620 (+   360us) write_op.cc:641] Partition lock acquired for write op
0709 14:53:41.704654 (+    34us) tablet.cc:685] Acquiring locks for 10 operations
0709 14:53:41.705859 (+  1205us) tablet.cc:701] Row locks acquired
0709 14:53:41.705885 (+    26us) write_op.cc:260] PREPARE: finished
0709 14:53:41.706070 (+   185us) write_op.cc:270] Start()
0709 14:53:41.706365 (+   295us) write_op.cc:276] Timestamp: P: 1783608821706005 usec, L: 0
0709 14:53:41.706389 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 14:53:41.707168 (+   779us) log.cc:844] Serialized 4000 byte log entry
0709 14:53:41.795758 (+ 88590us) op_driver.cc:464] REPLICATION: finished
0709 14:53:41.797954 (+  2196us) write_op.cc:301] APPLY: starting
0709 14:53:41.798049 (+    95us) tablet.cc:1367] starting BulkCheckPresence
0709 14:53:41.805197 (+  7148us) tablet.cc:1370] finished BulkCheckPresence
0709 14:53:41.805391 (+   194us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 14:53:41.958833 (+153442us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 14:53:41.959237 (+   404us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=20,key_file_lookups=20,delta_file_lookups=20,mrs_lookups=0
0709 14:53:41.959306 (+    69us) write_op.cc:312] APPLY: finished
0709 14:53:41.960160 (+   854us) log.cc:844] Serialized 97 byte log entry
0709 14:53:41.960604 (+   444us) write_op.cc:489] Releasing partition, row and schema locks
0709 14:53:41.961402 (+   798us) write_op.cc:454] Released schema lock
0709 14:53:41.961493 (+    91us) write_op.cc:341] FINISH: Updating metrics
0709 14:53:41.962300 (+   807us) write_op.cc:489] Releasing partition, row and schema locks
0709 14:53:41.962332 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":8644,"reported_tablets":34,"child_traces":[["op",{"apply.queue_time_us":1904,"apply.run_cpu_time_us":24788,"apply.run_wall_time_us":164208,"cfile_cache_hit":42,"cfile_cache_hit_bytes":45807,"num_ops":10,"prepare.queue_time_us":341059,"prepare.run_cpu_time_us":7341,"prepare.run_wall_time_us":241828,"replication_time_us":89098,"thread_start_us":297214,"threads_started":2}]]}
I20260709 14:53:42.255882  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:42.261664  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:42.263055  7921 raft_consensus.cc:3060] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Advancing to term 17
I20260709 14:53:42.241350 14306 raft_consensus.cc:2804] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader election won for term 17
I20260709 14:53:42.265903  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:42.279719  7927 raft_consensus.cc:1275] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 22 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 14:53:42.266032 14575 raft_consensus.cc:493] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:42.283950  7674 catalog_manager.cc:5697] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 19 to 20, leader changed from 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 20 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:53:42.288604 14575 raft_consensus.cc:515] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:42.292199 14575 leader_election.cc:290] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:42.305929 14407 raft_consensus.cc:493] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:53:42.307436 14407 raft_consensus.cc:515] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:42.311456 14407 leader_election.cc:290] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:42.294922 14306 raft_consensus.cc:697] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:53:42.319092 14306 consensus_queue.cc:237] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:42.321703  7921 raft_consensus.cc:2468] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 17.
I20260709 14:53:42.329581  6549 raft_consensus.cc:2272] T c05ad41456b24682a1e65d2c804d2956 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 14:53:42.334149 14535 raft_consensus.cc:493] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:42.341964 14398 consensus_queue.cc:1048] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.002s
I20260709 14:53:42.343566  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:42.343231 14535 raft_consensus.cc:515] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:42.347422 14535 leader_election.cc:290] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:42.361784 14589 raft_consensus.cc:493] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:42.362026  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:42.362711 14589 raft_consensus.cc:515] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:42.364629  6549 tablet_replica.cc:333] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed: stopping tablet replica
I20260709 14:53:42.365218 14589 leader_election.cc:290] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:42.371623  7674 catalog_manager.cc:5697] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 18 to 19, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 19 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:53:42.375398  6549 raft_consensus.cc:2243] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 25 LEADER]: Raft consensus shutting down.
I20260709 14:53:42.379588  6549 raft_consensus.cc:2272] T a766fdd282824a82bd600fc0ffb448ca P 1de5e20126fa4d8ca0793d19c7b847ed [term 25 FOLLOWER]: Raft consensus is shut down!
W20260709 14:53:42.375878  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 54215.1us
I20260709 14:53:42.386773  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:42.392112 14575 raft_consensus.cc:493] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:42.393283 14575 raft_consensus.cc:515] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:53:42.394459  8598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 77980.3us
I20260709 14:53:42.395954 14575 leader_election.cc:290] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:42.399823  7744 leader_election.cc:304] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:42.411134  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:42.416884  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce9c0ef2db24c13a8b1402f21819458" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:42.434621  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:42.442314  6549 tablet_replica.cc:333] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed: stopping tablet replica
I20260709 14:53:42.443847  6549 raft_consensus.cc:2243] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 14:53:42.445163  6549 raft_consensus.cc:2272] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 14:53:42.413599 14306 raft_consensus.cc:2749] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 14:53:42.454998  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
W20260709 14:53:42.473376 14654 log.cc:927] Time spent T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 14:53:42.478163 14393 consensus_queue.cc:1048] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 14:53:42.486409  6549 tablet_replica.cc:333] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed: stopping tablet replica
I20260709 14:53:42.487859  6549 raft_consensus.cc:2243] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 14:53:42.489689  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:42.490517  7927 raft_consensus.cc:2468] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 19.
I20260709 14:53:42.497908 14398 raft_consensus.cc:493] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:42.485023  7847 raft_consensus.cc:1275] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 23 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 14:53:42.502807  7744 leader_election.cc:304] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:42.502944  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:42.506796  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:42.510550  7744 leader_election.cc:304] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 9418391fa82a42c79c6cad13ba91d964
I20260709 14:53:42.509932 14575 raft_consensus.cc:2749] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 14:53:42.513655  6549 raft_consensus.cc:2272] T d1e70b78c0514fcda22ba3552f5e82ea P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 14:53:42.517307  7924 raft_consensus.cc:2393] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de5e20126fa4d8ca0793d19c7b847ed in current term 22: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:53:42.518785 14602 raft_consensus.cc:493] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:42.519896 14602 raft_consensus.cc:515] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:42.462117 14535 raft_consensus.cc:493] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:42.524658  7744 leader_election.cc:304] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:42.528743  7744 leader_election.cc:304] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:42.518383  6549 tablet_replica.cc:333] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed: stopping tablet replica
I20260709 14:53:42.535123  7851 raft_consensus.cc:2468] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 20.
I20260709 14:53:42.535326 14575 raft_consensus.cc:2749] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 14:53:42.536342 14306 raft_consensus.cc:2749] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 14:53:42.544672 14589 raft_consensus.cc:2749] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 14:53:42.498967 14398 raft_consensus.cc:515] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:42.552870 14306 raft_consensus.cc:493] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:42.573894 14398 leader_election.cc:290] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:42.550827 14535 raft_consensus.cc:515] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:53:42.590693  7819 consensus_peers.cc:597] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 14:53:42.591436  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 90192.4us
W20260709 14:53:42.592238  7819 leader_election.cc:336] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 14:53:42.593595 14602 leader_election.cc:290] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:42.594390 14306 raft_consensus.cc:515] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:42.601930  7745 leader_election.cc:304] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:42.609922 14306 leader_election.cc:290] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:42.631052 14459 raft_consensus.cc:493] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:53:42.631929 14459 raft_consensus.cc:515] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:42.633189 14398 raft_consensus.cc:493] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:42.634202 14398 raft_consensus.cc:515] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:42.646232 14398 leader_election.cc:290] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:42.622985 14306 raft_consensus.cc:2804] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 14:53:42.650712 14306 raft_consensus.cc:493] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:42.651193 14306 raft_consensus.cc:3060] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Advancing to term 21
W20260709 14:53:42.654598  8598 consensus_peers.cc:597] T 9441e831627143a991a1556dcdce71e3 P 9418391fa82a42c79c6cad13ba91d964 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 14:53:42.654881 14459 leader_election.cc:290] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:42.616989 14602 raft_consensus.cc:493] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:42.669392 14535 leader_election.cc:290] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:42.674777 14602 raft_consensus.cc:515] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:42.680058 14602 leader_election.cc:290] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:42.683032  6549 raft_consensus.cc:2243] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 14:53:42.685925  6549 raft_consensus.cc:2272] T 23d1003a47fa4cb19d9050eb07529044 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 14:53:42.689479 14602 raft_consensus.cc:493] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:42.703991  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:42.708464  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:42.712059  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:42.712416  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:42.714322  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:42.716939  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 20 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:42.721417 14602 raft_consensus.cc:515] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:42.722793 14535 raft_consensus.cc:493] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:42.723803 14535 raft_consensus.cc:515] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:42.728649 14535 leader_election.cc:290] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:53:42.730624  7893 leader_election.cc:336] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 14:53:42.733932  7819 consensus_peers.cc:597] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 14:53:42.739027  7893 leader_election.cc:304] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:42.743124 14306 raft_consensus.cc:515] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:42.748679 14306 leader_election.cc:290] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 21 election: Requested vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:42.753407  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:42.751722  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:42.735543 14602 leader_election.cc:290] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:42.753119  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:42.754108  7851 raft_consensus.cc:3060] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Advancing to term 21
W20260709 14:53:42.756879  7893 consensus_peers.cc:597] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 14:53:42.758273  7893 consensus_peers.cc:597] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 14:53:42.759189  7893 consensus_peers.cc:597] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 14:53:42.760417  7893 consensus_peers.cc:597] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:53:42.761497 14459 raft_consensus.cc:2749] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 14:53:42.761199  7893 consensus_peers.cc:597] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 14:53:42.768586  7893 consensus_peers.cc:597] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 14:53:42.769856  7893 consensus_peers.cc:597] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:53:42.771301  6549 tablet_replica.cc:333] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed: stopping tablet replica
I20260709 14:53:42.771858  7851 raft_consensus.cc:2468] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 21.
I20260709 14:53:42.773597  6549 raft_consensus.cc:2243] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 LEADER]: Raft consensus shutting down.
I20260709 14:53:42.774804  6549 raft_consensus.cc:2272] T 7a1707111d8045f2b8c2f219724e133d P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 14:53:42.779107 14306 raft_consensus.cc:493] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:42.779644  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:42.783304  7745 leader_election.cc:304] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:42.782878  7922 raft_consensus.cc:2468] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 24.
I20260709 14:53:42.779851 14306 raft_consensus.cc:515] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:42.790412 14398 raft_consensus.cc:493] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:42.791378 14398 raft_consensus.cc:515] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:42.799448  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:42.801833 14398 leader_election.cc:290] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:42.801669  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:42.793028 14306 leader_election.cc:290] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:42.798292 14535 raft_consensus.cc:2804] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Leader election won for term 21
I20260709 14:53:42.808693 14535 raft_consensus.cc:697] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 LEADER]: Becoming Leader. State: Replica: 1de5e20126fa4d8ca0793d19c7b847ed, State: Running, Role: LEADER
I20260709 14:53:42.810261 14535 consensus_queue.cc:237] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:42.801975  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:42.826552  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:42.832485  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:42.837767  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:42.838775  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:42.842926  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 20 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:42.848282  7744 leader_election.cc:304] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:42.854496 14306 raft_consensus.cc:3060] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Advancing to term 22
I20260709 14:53:42.855867 14398 raft_consensus.cc:493] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:42.858187 14623 consensus_queue.cc:1048] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 14:53:42.851181  6549 tablet_replica.cc:333] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed: stopping tablet replica
I20260709 14:53:42.861375  6549 raft_consensus.cc:2243] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 14:53:42.863052  6549 raft_consensus.cc:2272] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 14:53:42.872134  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:42.856596 14398 raft_consensus.cc:515] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:42.877367  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:42.878202  7848 raft_consensus.cc:2468] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 24.
I20260709 14:53:42.885233  7819 leader_election.cc:304] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:53:42.888674 14622 raft_consensus.cc:493] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:42.890093 14622 raft_consensus.cc:515] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:42.893224  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:42.904624  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:42.905299  7925 raft_consensus.cc:3060] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Advancing to term 21
I20260709 14:53:42.903913 14407 raft_consensus.cc:2804] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 14:53:42.913599 14407 raft_consensus.cc:493] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 24 FOLLOWER]: Starting leader election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:53:42.914062 14407 raft_consensus.cc:3060] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 24 FOLLOWER]: Advancing to term 25
I20260709 14:53:42.915150 14398 leader_election.cc:290] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:42.918998 14622 leader_election.cc:290] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:42.938886  6549 tablet_replica.cc:333] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed: stopping tablet replica
I20260709 14:53:42.940521  6549 raft_consensus.cc:2243] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 14:53:42.943130  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:42.943271  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:42.955663  7922 raft_consensus.cc:1275] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 14:53:42.955783  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:42.962450  6549 raft_consensus.cc:2272] T b30d297a612a4252bdf5eb6aa21c11ff P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 14:53:42.974007  7894 leader_election.cc:304] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
W20260709 14:53:42.973037  8598 consensus_peers.cc:597] T 9ce9c0ef2db24c13a8b1402f21819458 P 9418391fa82a42c79c6cad13ba91d964 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 14:53:42.952664 14306 raft_consensus.cc:2749] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 14:53:42.984249  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 83635.8us
I20260709 14:53:42.985667  7744 leader_election.cc:304] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:42.990064  7744 leader_election.cc:304] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:42.993053  7925 raft_consensus.cc:2468] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1de5e20126fa4d8ca0793d19c7b847ed in term 21.
I20260709 14:53:42.997816 14670 raft_consensus.cc:2804] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 14:53:42.998649 14670 raft_consensus.cc:493] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:53:42.999090 14670 raft_consensus.cc:3060] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 24 FOLLOWER]: Advancing to term 25
I20260709 14:53:43.001551 14622 raft_consensus.cc:2749] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 14:53:43.006184  7744 leader_election.cc:304] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:43.008862  7744 leader_election.cc:304] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:43.010044 14622 raft_consensus.cc:2749] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 14:53:43.011601  7744 leader_election.cc:304] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:43.008356 14535 raft_consensus.cc:2749] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 14:53:43.017433 14622 raft_consensus.cc:2749] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 14:53:43.007508 14306 raft_consensus.cc:2749] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 14:53:43.022696  7744 leader_election.cc:304] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:43.023680 14306 raft_consensus.cc:2749] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 14:53:43.024914  7893 consensus_peers.cc:597] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 14:53:43.011643 14407 raft_consensus.cc:515] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:43.029151  6549 tablet_replica.cc:333] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed: stopping tablet replica
I20260709 14:53:43.029820 14407 leader_election.cc:290] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 25 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:43.030910  6549 raft_consensus.cc:2243] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 14:53:43.032461  6549 raft_consensus.cc:2272] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 14:53:43.035172  7744 leader_election.cc:304] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:43.039294  7744 leader_election.cc:304] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:43.042173 14575 raft_consensus.cc:2749] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 14:53:43.046123 14575 raft_consensus.cc:2749] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 14:53:43.047463  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 24 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
W20260709 14:53:43.056733  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 66883.3us
I20260709 14:53:43.058341 14306 raft_consensus.cc:493] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:43.062812  7744 leader_election.cc:304] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:43.110889 14575 raft_consensus.cc:2749] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 14:53:43.111109  7744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 53732.6us
I20260709 14:53:43.083930  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:43.067788  6549 tablet_replica.cc:333] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed: stopping tablet replica
I20260709 14:53:43.112609  7744 leader_election.cc:304] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:43.098073  7676 catalog_manager.cc:5697] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 18 to 19, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 19 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:53:43.125805  6549 raft_consensus.cc:2243] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 LEADER]: Raft consensus shutting down.
I20260709 14:53:43.081840 14306 raft_consensus.cc:515] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:43.068168 14670 raft_consensus.cc:515] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:43.128521 14306 leader_election.cc:290] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:43.129158  7925 raft_consensus.cc:2393] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 25: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:53:43.132642 14670 leader_election.cc:290] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 25 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:43.135919  7676 catalog_manager.cc:5697] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 25 to 27, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 27 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:53:43.139528  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:43.139133  7676 catalog_manager.cc:5697] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 21 to 23, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 23 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:53:43.141610  7847 raft_consensus.cc:2393] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 25: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:53:43.141625  7676 catalog_manager.cc:5697] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 15 to 17, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 17 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:53:43.149971  7676 catalog_manager.cc:5697] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 18 to 20, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65). New cstate: current_term: 20 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:53:43.152366  6549 raft_consensus.cc:2272] T 783e4874513449ef9084b833f188a6d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 14:53:43.153818 14575 raft_consensus.cc:493] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:43.155349 14622 raft_consensus.cc:2749] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 14:53:43.158669  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
W20260709 14:53:43.164103  7819 consensus_peers.cc:597] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 14:53:43.177559 14306 consensus_queue.cc:1048] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 14:53:43.182587  7819 consensus_peers.cc:597] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 14:53:43.186122 14575 raft_consensus.cc:515] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:43.186707  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:43.187711  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:43.187021  7845 raft_consensus.cc:1275] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 14:53:43.186164  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 24 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:43.192808 14306 raft_consensus.cc:493] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:43.210909 14622 raft_consensus.cc:493] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:43.213708 14306 raft_consensus.cc:515] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:43.189004 14575 leader_election.cc:290] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:43.194272  6549 tablet_replica.cc:333] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed: stopping tablet replica
I20260709 14:53:43.225067  7745 leader_election.cc:304] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:43.227303  6549 raft_consensus.cc:2243] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 14:53:43.227564 14306 leader_election.cc:290] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:43.228219 14306 raft_consensus.cc:2749] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 14:53:43.228483  6549 raft_consensus.cc:2272] T 6c3288d48c284f02b3b49ffcefea563c P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 14:53:43.157661  7674 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54364 (request call id 351) took 2505 ms. Trace:
I20260709 14:53:43.231911 14622 raft_consensus.cc:515] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:43.235028  6549 tablet_replica.cc:333] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed: stopping tablet replica
I20260709 14:53:43.236603  6549 raft_consensus.cc:2243] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 14:53:43.237630  6549 raft_consensus.cc:2272] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 14:53:43.247651 14622 leader_election.cc:290] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:53:43.209368 14682 log.cc:927] Time spent T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 14:53:43.222134  7676 catalog_manager.cc:5697] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 20 to 22. New cstate: current_term: 22 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
I20260709 14:53:43.250695  6549 tablet_replica.cc:333] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed: stopping tablet replica
I20260709 14:53:43.256884  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:43.257799  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:43.258800 14575 consensus_queue.cc:1048] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 14:53:43.269130  7676 catalog_manager.cc:5697] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 20 to 22, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 22 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:53:43.268973  6549 raft_consensus.cc:2243] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 14:53:43.273142  6549 raft_consensus.cc:2272] T 6d2e94b7532d44c5bad6074beb44b463 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 14:53:43.259019  7745 leader_election.cc:304] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:43.256960  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258d6c2dda954bf5b65930fde8ecb9f3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:43.278976 14575 raft_consensus.cc:2749] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 14:53:43.229071  7674 rpcz_store.cc:276] 0709 14:53:40.651829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:53:40.653427 (+  1598us) service_pool.cc:224] Handling call
0709 14:53:43.157557 (+2504130us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 14:53:42.689885 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 14:53:42.703620 (+ 13735us) write_op.cc:432] Acquiring schema lock in shared mode
0709 14:53:42.741328 (+ 37708us) write_op.cc:435] Acquired schema lock
0709 14:53:42.741364 (+    36us) tablet.cc:662] Decoding operations
0709 14:53:42.742777 (+  1413us) write_op.cc:620] Acquiring the partition lock for write op
0709 14:53:42.742920 (+   143us) write_op.cc:641] Partition lock acquired for write op
0709 14:53:42.742954 (+    34us) tablet.cc:685] Acquiring locks for 3 operations
0709 14:53:42.743752 (+   798us) tablet.cc:701] Row locks acquired
0709 14:53:42.743818 (+    66us) write_op.cc:260] PREPARE: finished
0709 14:53:42.744101 (+   283us) write_op.cc:270] Start()
0709 14:53:42.744345 (+   244us) write_op.cc:276] Timestamp: P: 1783608822744005 usec, L: 0
0709 14:53:42.744371 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 14:53:42.770135 (+ 25764us) log.cc:844] Serialized 1308 byte log entry
0709 14:53:42.865971 (+ 95836us) op_driver.cc:464] REPLICATION: finished
0709 14:53:43.022127 (+156156us) write_op.cc:301] APPLY: starting
0709 14:53:43.022372 (+   245us) tablet.cc:1367] starting BulkCheckPresence
0709 14:53:43.049419 (+ 27047us) tablet.cc:1370] finished BulkCheckPresence
0709 14:53:43.049565 (+   146us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 14:53:43.070429 (+ 20864us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 14:53:43.070662 (+   233us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=6,mrs_lookups=0
0709 14:53:43.070714 (+    52us) write_op.cc:312] APPLY: finished
0709 14:53:43.070989 (+   275us) log.cc:844] Serialized 41 byte log entry
0709 14:53:43.071216 (+   227us) write_op.cc:489] Releasing partition, row and schema locks
0709 14:53:43.071336 (+   120us) write_op.cc:454] Released schema lock
0709 14:53:43.071391 (+    55us) write_op.cc:341] FINISH: Updating metrics
0709 14:53:43.071960 (+   569us) write_op.cc:489] Releasing partition, row and schema locks
0709 14:53:43.072026 (+    66us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":26835,"reported_tablets":45,"child_traces":[["op",{"apply.queue_time_us":155857,"apply.run_cpu_time_us":7922,"apply.run_wall_time_us":49780,"cfile_cache_hit":14,"cfile_cache_hit_bytes":16631,"num_ops":3,"prepare.queue_time_us":168014,"prepare.run_cpu_time_us":6090,"prepare.run_wall_time_us":86280,"replication_time_us":121408,"thread_start_us":248061,"threads_started":2}]]}
I20260709 14:53:43.282840  6549 tablet_replica.cc:333] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed: stopping tablet replica
I20260709 14:53:43.291172  6549 raft_consensus.cc:2243] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 14:53:43.292929  6549 pending_rounds.cc:70] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed: Trying to abort 1 pending ops.
I20260709 14:53:43.293442  6549 pending_rounds.cc:77] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed: Aborting op as it isn't in flight: id { term: 25 index: 15 } timestamp: 7305661698766520320 op_type: NO_OP noop_request { }
I20260709 14:53:43.308168  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258d6c2dda954bf5b65930fde8ecb9f3" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:43.313402  6549 raft_consensus.cc:2889] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 27 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 14:53:43.313966  6549 raft_consensus.cc:2272] T e145ae252e8041f9b5ad2dbebcf279c9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 14:53:43.320700  7744 leader_election.cc:304] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:43.321941  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
W20260709 14:53:43.330535  7744 raft_consensus.cc:2686] T 4ce6f5d59057468c923f98279ba0df4f P 1de5e20126fa4d8ca0793d19c7b847ed: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 14:53:43.333896  6549 tablet_replica.cc:333] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed: stopping tablet replica
I20260709 14:53:43.333699  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
W20260709 14:53:43.335907  7893 consensus_peers.cc:597] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 14:53:43.341320  6549 raft_consensus.cc:2243] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 LEADER]: Raft consensus shutting down.
W20260709 14:53:43.341481  7893 consensus_peers.cc:597] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 14:53:43.343076  7893 consensus_peers.cc:597] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 14:53:43.343823  7893 consensus_peers.cc:597] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 14:53:43.344388  7893 leader_election.cc:336] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 14:53:43.344707  7852 raft_consensus.cc:1275] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 14:53:43.343084  6549 pending_rounds.cc:70] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed: Trying to abort 1 pending ops.
I20260709 14:53:43.345286  6549 pending_rounds.cc:77] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed: Aborting op as it isn't in flight: id { term: 17 index: 11 } timestamp: 7305661736232083456 op_type: NO_OP noop_request { }
I20260709 14:53:43.345688  6549 raft_consensus.cc:2889] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 14:53:43.346045  6549 raft_consensus.cc:2272] T d90f7d5fb59843e0a06107c48f794b4c P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 14:53:43.352830  6549 tablet_replica.cc:333] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed: stopping tablet replica
I20260709 14:53:43.353911  6549 raft_consensus.cc:2243] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 14:53:43.354709  6549 raft_consensus.cc:2272] T f69c398b243d41308ddd552fcb6b657c P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 14:53:43.360026 14622 consensus_queue.cc:1048] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 14:53:43.362533  7893 consensus_peers.cc:597] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 14:53:43.365173  7893 consensus_peers.cc:597] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 14:53:43.367352  6549 tablet_replica.cc:333] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed: stopping tablet replica
I20260709 14:53:43.371284  6549 raft_consensus.cc:2243] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Raft consensus shutting down.
W20260709 14:53:43.376842  7893 consensus_peers.cc:597] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 14:53:43.405017  7819 consensus_peers.cc:597] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 14:53:43.407814  7819 consensus_peers.cc:597] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 14:53:43.410663  7819 consensus_peers.cc:597] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 14:53:43.414738  7924 raft_consensus.cc:1275] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Refusing update from remote peer 1de5e20126fa4d8ca0793d19c7b847ed: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 14:53:43.418467  7744 leader_election.cc:304] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:53:43.421496  7819 leader_election.cc:336] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 14:53:43.422210  7819 leader_election.cc:304] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:43.423617  6549 pending_rounds.cc:70] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed: Trying to abort 1 pending ops.
I20260709 14:53:43.424611  6549 pending_rounds.cc:77] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed: Aborting op as it isn't in flight: id { term: 19 index: 11 } timestamp: 7305661695930552320 op_type: NO_OP noop_request { }
I20260709 14:53:43.424924  6549 raft_consensus.cc:2889] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 14:53:43.425689  6549 raft_consensus.cc:2272] T 787a21690c744946b36b3d3baa26d8b6 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 14:53:43.428687 14602 raft_consensus.cc:2749] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 14:53:43.431876  7744 leader_election.cc:304] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:43.428004 14407 raft_consensus.cc:2749] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 14:53:43.433440  7744 leader_election.cc:304] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:43.435156 14535 raft_consensus.cc:2749] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 14:53:43.437786 14535 raft_consensus.cc:2749] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 14:53:43.441103  7893 consensus_peers.cc:597] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 14:53:43.442381 14622 consensus_queue.cc:1048] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 14:53:43.445541  7893 consensus_peers.cc:597] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 14:53:43.453076  6549 tablet_replica.cc:333] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed: stopping tablet replica
I20260709 14:53:43.454108  6549 raft_consensus.cc:2243] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 LEADER]: Raft consensus shutting down.
I20260709 14:53:43.455219  6549 raft_consensus.cc:2272] T 7a4c17373ec546d59a82ce33b6938268 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 14:53:43.461642  7893 consensus_peers.cc:597] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 14:53:43.463573  6549 tablet_replica.cc:333] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed: stopping tablet replica
I20260709 14:53:43.464615  6549 raft_consensus.cc:2243] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Raft consensus shutting down.
W20260709 14:53:43.465080  7893 consensus_peers.cc:597] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 14:53:43.469542  7893 consensus_peers.cc:597] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 14:53:43.470227  6549 raft_consensus.cc:2272] T 3dcde6b5a9614f56b6fee208e40eae0f P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 14:53:43.470511  7893 consensus_peers.cc:597] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 14:53:43.471508  7893 consensus_peers.cc:597] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 14:53:43.472265  7893 leader_election.cc:336] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 14:53:43.472782  7893 leader_election.cc:304] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:43.474010 14670 raft_consensus.cc:2749] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 14:53:43.473819  7674 catalog_manager.cc:5697] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 21 to 23, leader changed from 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 23 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
W20260709 14:53:43.474233  7893 consensus_peers.cc:597] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 14:53:43.482184  7893 consensus_peers.cc:597] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 14:53:43.483290  7893 consensus_peers.cc:597] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 14:53:43.483922  7893 consensus_peers.cc:597] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 14:53:43.488062  6549 tablet_replica.cc:333] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed: stopping tablet replica
I20260709 14:53:43.489517  6549 raft_consensus.cc:2243] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 14:53:43.490335  6549 raft_consensus.cc:2272] T 94c22c68d7d64909bc3be2a12cd51375 P 1de5e20126fa4d8ca0793d19c7b847ed [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 14:53:43.502333  7819 consensus_peers.cc:597] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 14:53:43.504523  6549 tablet_replica.cc:333] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed: stopping tablet replica
W20260709 14:53:43.509882  7893 consensus_peers.cc:597] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 14:53:43.525100  6549 raft_consensus.cc:2243] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 14:53:43.526686  6549 raft_consensus.cc:2272] T af383cb6c2e843c593c3d86266ffdfdf P 1de5e20126fa4d8ca0793d19c7b847ed [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 14:53:43.530488  7819 consensus_peers.cc:597] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 14:53:43.531112  6549 tablet_replica.cc:333] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed: stopping tablet replica
I20260709 14:53:43.532274  6549 raft_consensus.cc:2243] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 14:53:43.533674  6549 raft_consensus.cc:2272] T 46456e760e004d6c8f70251651e0b26b P 1de5e20126fa4d8ca0793d19c7b847ed [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 14:53:43.570188  6549 tablet_replica.cc:333] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed: stopping tablet replica
I20260709 14:53:43.565778 14602 raft_consensus.cc:493] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:43.579023 14602 raft_consensus.cc:515] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:43.582118  6549 raft_consensus.cc:2243] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 14:53:43.583487  6549 raft_consensus.cc:2272] T 80265d77f70046f997ce9c4fef0a107c P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 14:53:43.584501 14602 leader_election.cc:290] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:43.593329  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:43.602304  6549 tablet_replica.cc:333] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed: stopping tablet replica
I20260709 14:53:43.602981  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:43.603783  6549 raft_consensus.cc:2243] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 14:53:43.604687  6549 pending_rounds.cc:70] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed: Trying to abort 1 pending ops.
I20260709 14:53:43.605010  6549 pending_rounds.cc:77] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed: Aborting op as it isn't in flight: id { term: 20 index: 11 } timestamp: 7305661697843425280 op_type: NO_OP noop_request { }
I20260709 14:53:43.605468  6549 raft_consensus.cc:2889] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
W20260709 14:53:43.605057  7819 consensus_peers.cc:597] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 14:53:43.606276  6549 raft_consensus.cc:2272] T 9fd10baef95c4d73978299974e0dd8f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 14:53:43.607402  7819 consensus_peers.cc:597] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 14:53:43.613878  8598 consensus_peers.cc:597] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 14:53:43.618913  7674 catalog_manager.cc:5697] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:53:43.622515  6549 tablet_replica.cc:333] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed: stopping tablet replica
I20260709 14:53:43.626130  6549 raft_consensus.cc:2243] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 14:53:43.627779  6549 pending_rounds.cc:70] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed: Trying to abort 2 pending ops.
I20260709 14:53:43.624948  7674 catalog_manager.cc:5697] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } }
I20260709 14:53:43.628239  6549 pending_rounds.cc:77] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed: Aborting op as it isn't in flight: id { term: 22 index: 12 } timestamp: 7305661730559336448 op_type: NO_OP noop_request { }
I20260709 14:53:43.628918  6549 raft_consensus.cc:2889] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 14:53:43.629336  6549 pending_rounds.cc:77] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed: Aborting op as it isn't in flight: id { term: 21 index: 11 } timestamp: 7305661696679063552 op_type: NO_OP noop_request { }
I20260709 14:53:43.629773  6549 raft_consensus.cc:2889] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 14:53:43.630339  6549 raft_consensus.cc:2272] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1de5e20126fa4d8ca0793d19c7b847ed [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 14:53:43.633944  6549 tablet_replica.cc:333] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed: stopping tablet replica
I20260709 14:53:43.634680  7744 leader_election.cc:304] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:43.634948  6549 raft_consensus.cc:2243] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 14:53:43.637596 14602 raft_consensus.cc:2706] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Received pre-election callback for term 20 while not running: Illegal state: RaftConsensus is not running: State = Stopping
W20260709 14:53:43.640057  7893 consensus_peers.cc:597] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 14:53:43.644317  7819 consensus_peers.cc:597] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 14:53:43.651953 14341 raft_consensus.cc:493] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:53:43.652751 14341 raft_consensus.cc:515] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:43.659056  6549 pending_rounds.cc:70] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed: Trying to abort 1 pending ops.
I20260709 14:53:43.662138  6549 pending_rounds.cc:77] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed: Aborting op as it isn't in flight: id { term: 19 index: 11 } timestamp: 7305661697822302208 op_type: NO_OP noop_request { }
I20260709 14:53:43.664140  6549 raft_consensus.cc:2889] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 14:53:43.664710  6549 raft_consensus.cc:2272] T 5ad88b19ba074d7eb419542cddcebb51 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 14:53:43.661804 14341 leader_election.cc:290] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:43.668426  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:43.670598  6549 tablet_replica.cc:333] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed: stopping tablet replica
I20260709 14:53:43.676084  6549 raft_consensus.cc:2243] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 14:53:43.678016  6549 raft_consensus.cc:2272] T abd9bd9309aa456faee5ac298922892e P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 14:53:43.683331  6549 tablet_replica.cc:333] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed: stopping tablet replica
I20260709 14:53:43.686833  6549 raft_consensus.cc:2243] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 14:53:43.687985  6549 raft_consensus.cc:2272] T 6f693cee587949c6bde5463f4fd33b01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 14:53:43.693636  6549 tablet_replica.cc:333] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed: stopping tablet replica
I20260709 14:53:43.694926  6549 raft_consensus.cc:2243] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 14:53:43.696218  6549 raft_consensus.cc:2272] T 9441e831627143a991a1556dcdce71e3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 6 FOLLOWER]: Raft consensus is shut down!
W20260709 14:53:43.717895  7819 leader_election.cc:336] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 14:53:43.718802  7819 leader_election.cc:304] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:43.720719  6549 tablet_replica.cc:333] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed: stopping tablet replica
I20260709 14:53:43.722535  6549 raft_consensus.cc:2243] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 14:53:43.723285 14407 raft_consensus.cc:2749] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 14:53:43.723605  6549 raft_consensus.cc:2272] T 6d0d5c36f8664b1382cf3a23a559c621 P 1de5e20126fa4d8ca0793d19c7b847ed [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 14:53:43.729146  7819 consensus_peers.cc:597] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 14:53:43.729744  6549 tablet_replica.cc:333] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed: stopping tablet replica
I20260709 14:53:43.740655  6549 raft_consensus.cc:2243] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 14:53:43.741776  6549 pending_rounds.cc:70] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed: Trying to abort 1 pending ops.
I20260709 14:53:43.742089  6549 pending_rounds.cc:77] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed: Aborting op as it isn't in flight: id { term: 20 index: 14 } timestamp: 7305661663806468096 op_type: NO_OP noop_request { }
I20260709 14:53:43.742532  6549 raft_consensus.cc:2889] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 14:53:43.742928  6549 raft_consensus.cc:2272] T 7d45fb2f8502402780de3ab1d9588072 P 1de5e20126fa4d8ca0793d19c7b847ed [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 14:53:43.765503  6549 tablet_replica.cc:333] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed: stopping tablet replica
I20260709 14:53:43.766605  6549 raft_consensus.cc:2243] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 24 LEADER]: Raft consensus shutting down.
I20260709 14:53:43.767992  6549 raft_consensus.cc:2272] T f0813c88ccff4990b3b5d74b18a3e674 P 1de5e20126fa4d8ca0793d19c7b847ed [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 14:53:43.771286  6549 tablet_replica.cc:333] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed: stopping tablet replica
I20260709 14:53:43.772269  6549 raft_consensus.cc:2243] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Raft consensus shutting down.
W20260709 14:53:43.776324  7893 consensus_peers.cc:597] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 14:53:43.773154  6549 raft_consensus.cc:2272] T 0ad621bd873f4a429a62f9755f4cc775 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 14:53:43.786731  7893 consensus_peers.cc:597] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 14:53:43.838589 14407 raft_consensus.cc:493] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:53:43.839339 14407 raft_consensus.cc:515] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:53:43.840040  7819 consensus_peers.cc:597] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 14:53:43.841478  6549 tablet_replica.cc:333] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed: stopping tablet replica
I20260709 14:53:43.846652  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:43.842250 14407 leader_election.cc:290] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:43.853744  6549 raft_consensus.cc:2243] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 LEADER]: Raft consensus shutting down.
I20260709 14:53:43.862672  6549 raft_consensus.cc:2272] T 15359084dc6a466ca9280b7e4b63454b P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 14:53:43.866437  7819 leader_election.cc:336] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 14:53:43.867146  7819 leader_election.cc:304] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:43.869623 14407 raft_consensus.cc:2749] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 14:53:43.872499  6549 tablet_replica.cc:333] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed: stopping tablet replica
I20260709 14:53:43.882829  6549 raft_consensus.cc:2243] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 23 LEADER]: Raft consensus shutting down.
I20260709 14:53:43.885566  6549 raft_consensus.cc:2272] T a7960f2a6dc94357a722fa1a67e8383c P 1de5e20126fa4d8ca0793d19c7b847ed [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 14:53:43.904389  6549 tablet_replica.cc:333] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed: stopping tablet replica
I20260709 14:53:43.909600 14535 raft_consensus.cc:493] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:43.911010 14535 raft_consensus.cc:515] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:43.915719  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:43.915699 14535 leader_election.cc:290] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:43.917388  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:43.919056  6549 raft_consensus.cc:2243] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 14:53:43.920146  6549 raft_consensus.cc:2272] T 9cd6df0b766447119ea9e0acb887af01 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 14:53:43.919450  7744 leader_election.cc:304] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:43.923756 14535 raft_consensus.cc:2749] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 14:53:43.928581  6549 tablet_replica.cc:333] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed: stopping tablet replica
I20260709 14:53:43.937283  6549 raft_consensus.cc:2243] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 14:53:43.938030  6549 pending_rounds.cc:70] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed: Trying to abort 1 pending ops.
I20260709 14:53:43.938319  6549 pending_rounds.cc:77] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed: Aborting op as it isn't in flight: id { term: 15 index: 10 } timestamp: 7305661662514475008 op_type: NO_OP noop_request { }
I20260709 14:53:43.938715  6549 raft_consensus.cc:2889] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 14:53:43.939091  6549 raft_consensus.cc:2272] T ad8e261558b942c6b42c841689082c10 P 1de5e20126fa4d8ca0793d19c7b847ed [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 14:53:43.948876  6549 tablet_replica.cc:333] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed: stopping tablet replica
W20260709 14:53:43.972262  7893 consensus_peers.cc:597] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 14:53:43.977771  6549 raft_consensus.cc:2243] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 14:53:43.986907  6549 pending_rounds.cc:70] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed: Trying to abort 1 pending ops.
I20260709 14:53:43.997766  6549 pending_rounds.cc:77] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed: Aborting op as it isn't in flight: id { term: 21 index: 13 } timestamp: 7305661692918890496 op_type: NO_OP noop_request { }
I20260709 14:53:43.998340  6549 raft_consensus.cc:2889] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 14:53:44.003558  6549 raft_consensus.cc:2272] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 14:53:44.020871  6549 tablet_replica.cc:333] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed: stopping tablet replica
I20260709 14:53:44.022182  6549 raft_consensus.cc:2243] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 14:53:44.022950  6549 raft_consensus.cc:2272] T 9ce9c0ef2db24c13a8b1402f21819458 P 1de5e20126fa4d8ca0793d19c7b847ed [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 14:53:44.030820 14635 raft_consensus.cc:493] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:53:44.040819 14635 raft_consensus.cc:515] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:44.043767 14635 leader_election.cc:290] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:44.056953  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:44.057998  7852 raft_consensus.cc:2468] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 25.
I20260709 14:53:44.060204  6549 tablet_replica.cc:333] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed: stopping tablet replica
I20260709 14:53:44.061525  6549 raft_consensus.cc:2243] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 14:53:44.062784  6549 raft_consensus.cc:2272] T 4c5a5f4d6980405d99119f2f2e97df2f P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 14:53:44.078907  7894 leader_election.cc:304] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:44.083032 14613 raft_consensus.cc:2804] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 14:53:44.083547 14613 raft_consensus.cc:493] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 25 FOLLOWER]: Starting leader election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:53:44.084497 14613 raft_consensus.cc:3060] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 25 FOLLOWER]: Advancing to term 26
W20260709 14:53:44.106338  7893 leader_election.cc:336] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 14:53:44.126638 14613 raft_consensus.cc:515] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:44.131256  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:44.131948  7848 raft_consensus.cc:3060] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 25 FOLLOWER]: Advancing to term 26
I20260709 14:53:44.140563 14535 raft_consensus.cc:493] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:44.141479 14535 raft_consensus.cc:515] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:44.144819 14535 leader_election.cc:290] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:44.147244  6549 tablet_replica.cc:333] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed: stopping tablet replica
I20260709 14:53:44.156805  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:44.166910  6549 raft_consensus.cc:2243] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 LEADER]: Raft consensus shutting down.
I20260709 14:53:44.179260  7848 raft_consensus.cc:2468] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 26.
I20260709 14:53:44.180645  7894 leader_election.cc:304] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:44.182010 14670 raft_consensus.cc:2804] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 14:53:44.182440  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:44.182858 14670 raft_consensus.cc:697] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 26 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:44.184144 14670 consensus_queue.cc:237] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 25.14, Last appended by leader: 14, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:44.128943 14613 leader_election.cc:290] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 26 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:44.196684  7744 leader_election.cc:304] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5e20126fa4d8ca0793d19c7b847ed; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:44.204414 14535 raft_consensus.cc:2749] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 14:53:44.204577  6549 raft_consensus.cc:2272] T fd30845430df4f21a2512e25b0b9d0d3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 14:53:44.209774  6549 tablet_replica.cc:333] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed: stopping tablet replica
I20260709 14:53:44.210886  6549 raft_consensus.cc:2243] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 14:53:44.211598  6549 raft_consensus.cc:2272] T 3a01e716f85c42fca2d598794aa97828 P 1de5e20126fa4d8ca0793d19c7b847ed [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 14:53:44.215994  6549 tablet_replica.cc:333] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed: stopping tablet replica
I20260709 14:53:44.217023  6549 raft_consensus.cc:2243] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 14:53:44.222437  6549 raft_consensus.cc:2272] T a18d29d52d304c87b930d4fb5eaf50b1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 14:53:44.224531  7893 leader_election.cc:336] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 14:53:44.243499  6549 tablet_replica.cc:333] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed: stopping tablet replica
I20260709 14:53:44.252632  7674 catalog_manager.cc:5697] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 25 to 26, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 26 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:53:44.275492  6549 raft_consensus.cc:2243] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 14:53:44.277369  6549 raft_consensus.cc:2272] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 14:53:44.281134  6549 tablet_replica.cc:333] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed: stopping tablet replica
I20260709 14:53:44.289312  6549 raft_consensus.cc:2243] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 14:53:44.290036  6549 raft_consensus.cc:2272] T f8b780b4cd374bdfa269ff8079b90f9c P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 14:53:44.294698  6549 tablet_replica.cc:333] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed: stopping tablet replica
I20260709 14:53:44.295822  6549 raft_consensus.cc:2243] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 14:53:44.296633  6549 raft_consensus.cc:2272] T c05bb7d6a8bd42fcb27196db96044bb1 P 1de5e20126fa4d8ca0793d19c7b847ed [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 14:53:44.300752  6549 tablet_replica.cc:333] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed: stopping tablet replica
I20260709 14:53:44.301668  6549 raft_consensus.cc:2243] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 14:53:44.302632  6549 raft_consensus.cc:2272] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1de5e20126fa4d8ca0793d19c7b847ed [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 14:53:44.305959  6549 tablet_replica.cc:333] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed: stopping tablet replica
I20260709 14:53:44.306733  6549 raft_consensus.cc:2243] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 14:53:44.307534  6549 pending_rounds.cc:70] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed: Trying to abort 2 pending ops.
I20260709 14:53:44.307761  6549 pending_rounds.cc:77] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed: Aborting op as it isn't in flight: id { term: 21 index: 14 } timestamp: 7305661729131507712 op_type: NO_OP noop_request { }
I20260709 14:53:44.308109  6549 raft_consensus.cc:2889] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 14:53:44.308377  6549 pending_rounds.cc:77] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed: Aborting op as it isn't in flight: id { term: 20 index: 13 } timestamp: 7305661698744287232 op_type: NO_OP noop_request { }
I20260709 14:53:44.308743  6549 raft_consensus.cc:2889] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 14:53:44.309063  6549 raft_consensus.cc:2272] T 939996e77ee64e9fab21aef50758b706 P 1de5e20126fa4d8ca0793d19c7b847ed [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 14:53:44.312414  6549 tablet_replica.cc:333] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed: stopping tablet replica
I20260709 14:53:44.313406  6549 raft_consensus.cc:2243] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 14:53:44.314055  6549 raft_consensus.cc:2272] T b313d3d5be334c0697556ab7c8cabbf3 P 1de5e20126fa4d8ca0793d19c7b847ed [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 14:53:44.317816  6549 tablet_replica.cc:333] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed: stopping tablet replica
I20260709 14:53:44.318655  6549 raft_consensus.cc:2243] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 14:53:44.319465  6549 raft_consensus.cc:2272] T e63cef01f72446c09b46b48ebbbd714a P 1de5e20126fa4d8ca0793d19c7b847ed [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 14:53:44.347821 14670 raft_consensus.cc:493] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:53:44.348397 14670 raft_consensus.cc:515] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:44.350863 14670 leader_election.cc:290] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:44.352669  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:44.353552  7848 raft_consensus.cc:2468] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 19.
I20260709 14:53:44.370467  7894 leader_election.cc:304] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:44.371429 14670 raft_consensus.cc:2804] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 14:53:44.371917 14670 raft_consensus.cc:493] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:53:44.372512 14670 raft_consensus.cc:3060] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Advancing to term 20
W20260709 14:53:44.387373  7893 leader_election.cc:336] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 14:53:44.408767 14670 raft_consensus.cc:515] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:44.412906  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:44.413697  7848 raft_consensus.cc:3060] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Advancing to term 20
I20260709 14:53:44.435323 14670 leader_election.cc:290] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 20 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:44.442322  7848 raft_consensus.cc:2468] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 20.
I20260709 14:53:44.447873  7894 leader_election.cc:304] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:44.449090 14601 raft_consensus.cc:2804] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 14:53:44.449790 14601 raft_consensus.cc:697] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:44.450795 14601 consensus_queue.cc:237] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:44.469525 14670 raft_consensus.cc:493] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:53:44.470350 14670 raft_consensus.cc:515] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:44.502899  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783e4874513449ef9084b833f188a6d3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:53:44.507797  7893 leader_election.cc:336] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 14:53:44.511929  7674 catalog_manager.cc:5697] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 19 to 20, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 20 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:53:44.500931 14670 leader_election.cc:290] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:53:44.582666  7893 leader_election.cc:336] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 14:53:44.583240  7893 leader_election.cc:304] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:44.584091 14601 raft_consensus.cc:2749] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 14:53:44.691227  7846 raft_consensus.cc:1275] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 26 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 25 index: 14. Preceding OpId from leader: term: 26 index: 15. (index mismatch)
I20260709 14:53:44.693073 14341 raft_consensus.cc:493] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:53:44.693943 14341 raft_consensus.cc:515] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:44.704319  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783e4874513449ef9084b833f188a6d3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:44.705153  7922 raft_consensus.cc:2468] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 14.
I20260709 14:53:44.707226 14341 leader_election.cc:290] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:44.708591  7819 leader_election.cc:304] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:44.711356 14341 raft_consensus.cc:2804] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 14:53:44.715520 14341 raft_consensus.cc:493] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Starting leader election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:53:44.719941 14613 consensus_queue.cc:1048] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 14:53:44.720424 14341 raft_consensus.cc:3060] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 14 FOLLOWER]: Advancing to term 15
W20260709 14:53:44.717295  7744 connection.cc:466] server connection from 127.0.0.1:37144 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 4904) could send its response
W20260709 14:53:44.727756  7744 connection.cc:466] server connection from 127.0.0.1:37144 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 4905) could send its response
W20260709 14:53:44.728796  7744 connection.cc:466] server connection from 127.0.0.1:37144 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 4906) could send its response
W20260709 14:53:44.729979  7744 connection.cc:466] server connection from 127.0.0.1:37144 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 4907) could send its response
W20260709 14:53:44.731066  7744 connection.cc:466] server connection from 127.0.0.1:37144 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37144 (request call id 4908) could send its response
W20260709 14:53:44.738147  7819 connection.cc:573] client connection to 127.6.101.65:40587 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260709 14:53:44.738821  7819 leader_election.cc:336] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260709 14:53:44.759068 14407 raft_consensus.cc:493] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:53:44.759969 14407 raft_consensus.cc:515] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:44.764247 14341 raft_consensus.cc:515] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:44.770610 14407 leader_election.cc:290] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:44.767201 14341 leader_election.cc:290] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:44.804971  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783e4874513449ef9084b833f188a6d3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:44.805727  7922 raft_consensus.cc:3060] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 14:53:44.809628  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
W20260709 14:53:44.818544  7819 leader_election.cc:336] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
W20260709 14:53:44.819314  7819 leader_election.cc:336] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
I20260709 14:53:44.819782  7819 leader_election.cc:304] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:44.820721 14699 raft_consensus.cc:2749] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 14:53:44.836390  7922 raft_consensus.cc:2468] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 15.
I20260709 14:53:44.840378 14613 raft_consensus.cc:493] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:53:44.841881 14699 raft_consensus.cc:493] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:53:44.850204 14699 raft_consensus.cc:515] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:44.852653 14699 leader_election.cc:290] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:44.853799 14613 raft_consensus.cc:515] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:44.858659 14613 leader_election.cc:290] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:44.860076  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:44.860914  7852 raft_consensus.cc:2468] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 17.
I20260709 14:53:44.862299  7894 leader_election.cc:304] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:44.863583 14613 raft_consensus.cc:2804] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 14:53:44.864019 14613 raft_consensus.cc:493] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:53:44.864390 14613 raft_consensus.cc:3060] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 14:53:44.880101  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:44.884157  7819 leader_election.cc:304] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed
W20260709 14:53:44.885818  7893 consensus_peers.cc:597] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 14:53:44.886756  7893 leader_election.cc:336] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
I20260709 14:53:44.889618 14699 raft_consensus.cc:2804] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Leader election won for term 15
I20260709 14:53:44.890349 14699 raft_consensus.cc:697] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:53:44.891274 14699 consensus_queue.cc:237] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:44.899957 14613 raft_consensus.cc:515] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:53:44.901877  7819 leader_election.cc:336] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
I20260709 14:53:44.905165  7852 raft_consensus.cc:1275] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 14:53:44.909574 14670 consensus_queue.cc:1048] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 14:53:44.924796  7922 raft_consensus.cc:2393] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 18: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:53:44.927145 14613 leader_election.cc:290] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 18 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:53:44.928990  7819 consensus_peers.cc:597] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 14:53:44.935701  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:44.936684  7846 raft_consensus.cc:3060] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Advancing to term 18
I20260709 14:53:44.942782 14341 raft_consensus.cc:493] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:53:44.943637 14341 raft_consensus.cc:515] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:44.948827 14341 leader_election.cc:290] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:44.957854  7846 raft_consensus.cc:2468] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 18.
W20260709 14:53:44.966553  7893 leader_election.cc:336] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
I20260709 14:53:44.978586  7894 leader_election.cc:304] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:53:44.984035 14670 raft_consensus.cc:2804] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 14:53:44.984728 14670 raft_consensus.cc:697] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:44.985878 14670 consensus_queue.cc:237] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:45.006873  7819 leader_election.cc:304] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:44.994032 14664 raft_consensus.cc:493] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:53:45.004101 14635 raft_consensus.cc:493] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:53:45.013365 14664 raft_consensus.cc:515] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:45.016053 14664 leader_election.cc:290] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:53:45.017086  7819 leader_election.cc:336] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
I20260709 14:53:45.027172  7674 catalog_manager.cc:5697] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 14 to 15, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 15 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
W20260709 14:53:45.030988  7893 consensus_peers.cc:597] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 14:53:45.034848  7893 leader_election.cc:336] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
I20260709 14:53:45.022509 14699 raft_consensus.cc:2749] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 14:53:45.043004 14708 raft_consensus.cc:493] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:53:45.021950 14635 raft_consensus.cc:515] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:45.044373 14708 raft_consensus.cc:515] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:45.050539 14708 leader_election.cc:290] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:45.060227 14635 leader_election.cc:290] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:45.082034 14699 raft_consensus.cc:493] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:53:45.083362 14699 raft_consensus.cc:515] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:45.087031 14699 leader_election.cc:290] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:53:45.087886  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 79386.8us
I20260709 14:53:45.099545  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:45.100394  7852 raft_consensus.cc:2468] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 20.
I20260709 14:53:45.105294  7676 catalog_manager.cc:5697] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 17 to 18, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 18 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:53:45.107553  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:45.108428  7852 raft_consensus.cc:2468] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 21.
I20260709 14:53:45.110777  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:45.126035  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:45.126854 14696 raft_consensus.cc:493] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:45.127482 14696 raft_consensus.cc:515] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:53:45.128680  7819 leader_election.cc:336] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
I20260709 14:53:45.129973 14696 leader_election.cc:290] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:53:45.141494  7893 consensus_peers.cc:597] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 14:53:45.146716  7893 leader_election.cc:336] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
W20260709 14:53:45.147352  7893 leader_election.cc:336] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
W20260709 14:53:45.153282  8598 consensus_peers.cc:597] T 9441e831627143a991a1556dcdce71e3 P 9418391fa82a42c79c6cad13ba91d964 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 14:53:45.155820  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:45.156837  7927 raft_consensus.cc:2468] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 21.
I20260709 14:53:45.160997 14699 raft_consensus.cc:493] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:45.161808 14699 raft_consensus.cc:515] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:45.164252 14699 leader_election.cc:290] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:45.177914  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:53:45.178710  7893 leader_election.cc:336] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
I20260709 14:53:45.178771  7852 raft_consensus.cc:2468] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 25.
I20260709 14:53:45.186434  7819 leader_election.cc:304] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
W20260709 14:53:45.186837  7893 consensus_peers.cc:597] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 14:53:45.190138 14699 raft_consensus.cc:2749] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 14:53:45.200301  7893 consensus_peers.cc:597] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 14:53:45.189890  7894 leader_election.cc:304] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:53:45.202512 14711 raft_consensus.cc:2804] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 14:53:45.203054 14711 raft_consensus.cc:493] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:53:45.203199  7894 leader_election.cc:304] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:53:45.205279  7894 leader_election.cc:304] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:45.206214 14696 raft_consensus.cc:2804] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 14:53:45.207056 14696 raft_consensus.cc:493] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:53:45.197408  7819 leader_election.cc:304] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:53:45.207274 14670 raft_consensus.cc:2749] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 14:53:45.203469 14711 raft_consensus.cc:3060] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Advancing to term 21
I20260709 14:53:45.208671 14696 raft_consensus.cc:3060] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Advancing to term 22
I20260709 14:53:45.209575 14699 raft_consensus.cc:2804] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 14:53:45.210085 14699 raft_consensus.cc:493] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Starting leader election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:53:45.210466 14699 raft_consensus.cc:3060] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Advancing to term 22
W20260709 14:53:45.216933  7819 leader_election.cc:336] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
I20260709 14:53:45.227680 14341 raft_consensus.cc:493] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:53:45.228165 14696 raft_consensus.cc:515] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:45.228497 14341 raft_consensus.cc:515] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:45.231273 14341 leader_election.cc:290] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:45.227056  7894 leader_election.cc:304] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:53:45.233836 14635 raft_consensus.cc:2804] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 14:53:45.234654 14635 raft_consensus.cc:493] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:45.235143 14635 raft_consensus.cc:3060] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 25 FOLLOWER]: Advancing to term 26
I20260709 14:53:45.246764 14696 leader_election.cc:290] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 22 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:45.233790 14699 raft_consensus.cc:515] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:45.251250 14699 leader_election.cc:290] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 22 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:45.246421 14711 raft_consensus.cc:515] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:45.258221 14711 leader_election.cc:290] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 21 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:53:45.270655  7819 leader_election.cc:336] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
I20260709 14:53:45.280835 14635 raft_consensus.cc:515] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:53:45.282202  7893 leader_election.cc:336] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
W20260709 14:53:45.293886  7893 leader_election.cc:336] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
I20260709 14:53:45.294394  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:45.294561 14635 leader_election.cc:290] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 26 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:45.296082  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:45.296777  7924 raft_consensus.cc:2468] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 24.
I20260709 14:53:45.298554  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:45.295341  7927 raft_consensus.cc:2393] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 26: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:53:45.299404  7924 raft_consensus.cc:2393] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 22: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
W20260709 14:53:45.298660  7893 consensus_peers.cc:597] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 14:53:45.292865  7819 leader_election.cc:336] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
W20260709 14:53:45.299414  8598 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111) [suppressed 409 similar messages]
W20260709 14:53:45.302964  7893 leader_election.cc:336] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
I20260709 14:53:45.305140  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:45.306046  7852 raft_consensus.cc:2393] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 22: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:53:45.306319  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
W20260709 14:53:45.305047  8598 consensus_peers.cc:597] T 9ce9c0ef2db24c13a8b1402f21819458 P 9418391fa82a42c79c6cad13ba91d964 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 14:53:45.306941  7846 raft_consensus.cc:3060] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Advancing to term 21
I20260709 14:53:45.328218  7846 raft_consensus.cc:2468] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 21.
W20260709 14:53:45.334240  7893 consensus_peers.cc:597] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 14:53:45.340484  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:45.344182  7848 raft_consensus.cc:3060] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 25 FOLLOWER]: Advancing to term 26
I20260709 14:53:45.341475 14635 raft_consensus.cc:493] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:53:45.342813  7819 leader_election.cc:304] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:53:45.350061 14635 raft_consensus.cc:515] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:45.350893  7819 leader_election.cc:304] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:45.353523 14699 raft_consensus.cc:2804] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 14:53:45.353979 14699 raft_consensus.cc:493] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 24 FOLLOWER]: Starting leader election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:53:45.354351 14699 raft_consensus.cc:3060] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 24 FOLLOWER]: Advancing to term 25
I20260709 14:53:45.357558 14341 raft_consensus.cc:2749] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 14:53:45.358845 14341 raft_consensus.cc:493] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:53:45.359421 14341 raft_consensus.cc:515] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:45.362365 14711 raft_consensus.cc:493] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:53:45.352934  7819 leader_election.cc:304] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:45.362982 14711 raft_consensus.cc:515] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:45.352787 14635 leader_election.cc:290] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:45.363569 14341 leader_election.cc:290] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:45.367933  7848 raft_consensus.cc:2468] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 26.
I20260709 14:53:45.371150 14341 raft_consensus.cc:2749] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 14:53:45.372491  7893 leader_election.cc:336] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
I20260709 14:53:45.365424 14711 leader_election.cc:290] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:53:45.384855  7819 leader_election.cc:336] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
W20260709 14:53:45.385967  7819 consensus_peers.cc:597] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 14:53:45.386461  7893 leader_election.cc:336] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
I20260709 14:53:45.408593  7894 leader_election.cc:304] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:45.381039 14699 raft_consensus.cc:515] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:45.419342 14699 leader_election.cc:290] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 25 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:45.419945 14670 raft_consensus.cc:2749] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 14:53:45.436128  7894 leader_election.cc:304] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed
W20260709 14:53:45.439601  7819 leader_election.cc:336] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
I20260709 14:53:45.442134 14635 raft_consensus.cc:2804] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 14:53:45.442960 14635 raft_consensus.cc:697] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:45.445178 14635 consensus_queue.cc:237] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:45.455893  7894 leader_election.cc:304] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed
W20260709 14:53:45.460805  7819 consensus_peers.cc:597] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 14:53:45.461802 14670 raft_consensus.cc:2804] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 14:53:45.462679 14670 raft_consensus.cc:697] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 26 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:45.468091  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:45.467922 14670 consensus_queue.cc:237] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 14, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:45.468935  7848 raft_consensus.cc:2468] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 23.
I20260709 14:53:45.469537  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:45.470570  7845 raft_consensus.cc:2468] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 19.
I20260709 14:53:45.473109  7922 raft_consensus.cc:1275] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 14:53:45.473316  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:45.475867  7923 raft_consensus.cc:2468] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 19.
I20260709 14:53:45.479725  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:45.480448  7923 raft_consensus.cc:3060] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 24 FOLLOWER]: Advancing to term 25
I20260709 14:53:45.481453 14699 consensus_queue.cc:1048] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 14:53:45.489715  7819 leader_election.cc:304] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed
W20260709 14:53:45.489859  7893 consensus_peers.cc:597] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 14:53:45.491283 14699 raft_consensus.cc:2804] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 14:53:45.491817 14699 raft_consensus.cc:493] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Starting leader election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:53:45.492213 14699 raft_consensus.cc:3060] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Advancing to term 20
I20260709 14:53:45.496136  7894 leader_election.cc:304] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:53:45.497361 14713 raft_consensus.cc:2804] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 14:53:45.497851 14713 raft_consensus.cc:493] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:53:45.498091  7894 leader_election.cc:304] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:53:45.498260 14713 raft_consensus.cc:3060] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 23 FOLLOWER]: Advancing to term 24
I20260709 14:53:45.499022 14696 raft_consensus.cc:2804] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 14:53:45.499511 14696 raft_consensus.cc:493] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 1de5e20126fa4d8ca0793d19c7b847ed)
I20260709 14:53:45.501853 14696 raft_consensus.cc:3060] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Advancing to term 20
I20260709 14:53:45.505623  7923 raft_consensus.cc:2468] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 25.
I20260709 14:53:45.514778  7852 raft_consensus.cc:1275] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 14:53:45.516716  7819 leader_election.cc:304] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:53:45.518378 14717 raft_consensus.cc:2804] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 25 FOLLOWER]: Leader election won for term 25
I20260709 14:53:45.519083 14717 raft_consensus.cc:697] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 25 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:53:45.520169 14717 consensus_queue.cc:237] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.15, Last appended by leader: 15, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:45.525154 14711 consensus_queue.cc:1048] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.003s
I20260709 14:53:45.513718 14699 raft_consensus.cc:515] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:45.597294  7676 catalog_manager.cc:5697] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 20 to 21, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 21 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
I20260709 14:53:45.529783 14713 raft_consensus.cc:515] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:45.614454 14713 leader_election.cc:290] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 24 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:45.636423 14699 leader_election.cc:290] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 20 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:45.651628 14696 raft_consensus.cc:515] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:45.663878 14696 leader_election.cc:290] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 20 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:53:45.717598  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 178558us
W20260709 14:53:45.765318  6549 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 7800)
I20260709 14:53:45.780668  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:45.786149  7852 raft_consensus.cc:3060] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 23 FOLLOWER]: Advancing to term 24
I20260709 14:53:45.787686  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:45.788878  7853 raft_consensus.cc:2393] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9289592458429bbddb19c2e7b7b7b0 in current term 20: Already voted for candidate 3876b8ee8d744cb18e91d97aae93b1ac in this term.
I20260709 14:53:45.795974  7676 catalog_manager.cc:5697] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 24 to 25, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 25 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
W20260709 14:53:45.807288  7819 consensus_peers.cc:597] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 14:53:45.808209  7819 leader_election.cc:336] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
W20260709 14:53:45.809031  7819 consensus_peers.cc:597] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 14:53:45.814131  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:45.816296  7923 raft_consensus.cc:2393] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 3876b8ee8d744cb18e91d97aae93b1ac in current term 20: Already voted for candidate 1e9289592458429bbddb19c2e7b7b7b0 in this term.
I20260709 14:53:45.815687  7675 catalog_manager.cc:5697] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 24 to 26, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 26 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
W20260709 14:53:45.828293  7819 consensus_peers.cc:597] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 14:53:45.848822  7893 consensus_peers.cc:597] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 14:53:45.855995  7819 consensus_peers.cc:597] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 14:53:45.893451  7819 leader_election.cc:304] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:45.895813 14697 raft_consensus.cc:2749] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 14:53:45.901888  7893 leader_election.cc:336] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
I20260709 14:53:45.905682  7852 raft_consensus.cc:2468] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 24.
W20260709 14:53:45.922220  7893 consensus_peers.cc:597] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 14:53:45.924937  7893 consensus_peers.cc:597] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 14:53:45.930697  7893 consensus_peers.cc:597] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 14:53:45.934669  7893 leader_election.cc:336] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
I20260709 14:53:45.941355  7852 raft_consensus.cc:1275] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 26 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 26 index: 15. (index mismatch)
I20260709 14:53:45.941673  7893 leader_election.cc:304] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:45.943423 14696 raft_consensus.cc:2749] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 14:53:45.943507  7819 consensus_peers.cc:597] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 14:53:45.949363  7893 consensus_peers.cc:597] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 14:53:45.951730  7893 consensus_peers.cc:597] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 14:53:45.954007  7893 consensus_peers.cc:597] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 14:53:45.957446  7894 leader_election.cc:304] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:53:45.959040 14713 raft_consensus.cc:2804] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 24 FOLLOWER]: Leader election won for term 24
W20260709 14:53:45.968145  7819 consensus_peers.cc:597] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 14:53:45.975993 14713 raft_consensus.cc:697] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 24 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:45.977142 14713 consensus_queue.cc:237] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:53:45.995455  7893 consensus_peers.cc:597] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 14:53:45.996857  7893 consensus_peers.cc:597] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 14:53:46.001124  7893 consensus_peers.cc:597] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 14:53:46.001868  7893 consensus_peers.cc:597] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 14:53:46.002318  7893 consensus_peers.cc:597] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 14:53:46.002758  7893 consensus_peers.cc:597] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 14:53:46.005347 14711 consensus_queue.cc:1048] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 14:53:46.014909  7893 consensus_peers.cc:597] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 14:53:46.015715  7893 consensus_peers.cc:597] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 14:53:46.022169  7819 consensus_peers.cc:597] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 14:53:46.025174  7675 catalog_manager.cc:5697] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 23 to 24, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 24 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
W20260709 14:53:46.028479  7819 consensus_peers.cc:597] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 14:53:46.038062  7893 consensus_peers.cc:597] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 14:53:46.047003  7852 raft_consensus.cc:1275] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
W20260709 14:53:46.050431  7893 consensus_peers.cc:597] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 14:53:46.051126  7893 consensus_peers.cc:597] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 14:53:46.051570  7893 consensus_peers.cc:597] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 14:53:46.055778 14711 consensus_queue.cc:1048] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 14:53:46.065438  7819 consensus_peers.cc:597] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 14:53:46.069119  7893 consensus_peers.cc:597] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 14:53:46.069999  7893 consensus_peers.cc:597] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 14:53:46.070807  7893 consensus_peers.cc:597] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 14:53:46.144728  7927 raft_consensus.cc:1275] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 25 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260709 14:53:46.166812 14725 consensus_queue.cc:1048] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
W20260709 14:53:46.193765  7819 consensus_peers.cc:597] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 14:53:46.204563  7893 consensus_peers.cc:597] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 14:53:46.207151  7819 consensus_peers.cc:597] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 14:53:46.247241  7893 consensus_peers.cc:597] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 14:53:46.247959  7893 consensus_peers.cc:597] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 14:53:46.278609  7819 consensus_peers.cc:597] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 14:53:46.295135  7819 consensus_peers.cc:597] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 14:53:46.316619  8598 consensus_peers.cc:597] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 14:53:46.335294  7893 consensus_peers.cc:597] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 14:53:46.369692  7893 consensus_peers.cc:597] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 14:53:46.483585  7848 raft_consensus.cc:1275] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 24 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 14:53:46.486408 14714 consensus_queue.cc:1048] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
W20260709 14:53:46.580277  7893 consensus_peers.cc:597] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 14:53:46.673512  7893 consensus_peers.cc:597] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 14:53:46.771739  6549 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 7800)
W20260709 14:53:47.174717  7819 consensus_peers.cc:597] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 14:53:47.208902 14711 raft_consensus.cc:493] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:47.209761 14711 raft_consensus.cc:515] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:53:47.221982  7893 leader_election.cc:336] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
I20260709 14:53:47.223178 14711 leader_election.cc:290] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:47.227378  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:47.228364  7853 raft_consensus.cc:2468] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 22.
I20260709 14:53:47.230115  7894 leader_election.cc:304] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed
I20260709 14:53:47.231801 14714 raft_consensus.cc:2804] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 14:53:47.232349 14714 raft_consensus.cc:493] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:47.232946 14714 raft_consensus.cc:3060] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 22 FOLLOWER]: Advancing to term 23
I20260709 14:53:47.249771 14714 raft_consensus.cc:515] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:47.254256  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac"
I20260709 14:53:47.254956  7853 raft_consensus.cc:3060] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 22 FOLLOWER]: Advancing to term 23
I20260709 14:53:47.281208 14714 leader_election.cc:290] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 23 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:47.286936  7853 raft_consensus.cc:2468] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e9289592458429bbddb19c2e7b7b7b0 in term 23.
I20260709 14:53:47.295801  7894 leader_election.cc:304] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:47.297438 14711 raft_consensus.cc:2804] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 14:53:47.298280 14711 raft_consensus.cc:697] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 23 LEADER]: Becoming Leader. State: Replica: 1e9289592458429bbddb19c2e7b7b7b0, State: Running, Role: LEADER
I20260709 14:53:47.300746 14711 consensus_queue.cc:237] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:53:47.307536  7893 leader_election.cc:336] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
W20260709 14:53:47.308913  7893 consensus_peers.cc:597] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 14:53:47.382884  7675 catalog_manager.cc:5697] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 reported cstate change: term changed from 21 to 23, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67). New cstate: current_term: 23 leader_uuid: "1e9289592458429bbddb19c2e7b7b7b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: HEALTHY } } }
W20260709 14:53:47.424338  7893 consensus_peers.cc:597] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 14:53:47.457535  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 57481.6us
I20260709 14:53:47.493676 14748 raft_consensus.cc:493] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:53:47.494308 14748 raft_consensus.cc:515] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:47.514699 14748 leader_election.cc:290] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:47.549122  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:47.550033  7927 raft_consensus.cc:2468] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 20.
I20260709 14:53:47.567817  7819 leader_election.cc:304] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
W20260709 14:53:47.580349  7819 leader_election.cc:336] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
I20260709 14:53:47.580641 14697 raft_consensus.cc:2804] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 14:53:47.581696 14697 raft_consensus.cc:493] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:53:47.582069 14697 raft_consensus.cc:3060] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Advancing to term 21
W20260709 14:53:47.604842  7893 consensus_peers.cc:597] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 14:53:47.613875 14697 raft_consensus.cc:515] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:47.622376 14697 leader_election.cc:290] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 21 election: Requested vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:47.670397  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0"
I20260709 14:53:47.671227  7927 raft_consensus.cc:3060] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Advancing to term 21
I20260709 14:53:47.682331  7927 raft_consensus.cc:2468] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3876b8ee8d744cb18e91d97aae93b1ac in term 21.
W20260709 14:53:47.760217  8598 consensus_peers.cc:597] T 9ce9c0ef2db24c13a8b1402f21819458 P 9418391fa82a42c79c6cad13ba91d964 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 14:53:47.768024  7819 leader_election.cc:304] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0, 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 
I20260709 14:53:47.768980 14717 raft_consensus.cc:2804] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Leader election won for term 21
W20260709 14:53:47.771893  7893 consensus_peers.cc:597] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 14:53:47.772848  6549 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 7800)
I20260709 14:53:47.786365 14717 raft_consensus.cc:697] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 LEADER]: Becoming Leader. State: Replica: 3876b8ee8d744cb18e91d97aae93b1ac, State: Running, Role: LEADER
I20260709 14:53:47.787905 14717 consensus_queue.cc:237] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:53:47.809551  7819 leader_election.cc:336] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
I20260709 14:53:47.832882  7848 raft_consensus.cc:1275] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 23 FOLLOWER]: Refusing update from remote peer 1e9289592458429bbddb19c2e7b7b7b0: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 14:53:47.838495  7675 catalog_manager.cc:5697] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac reported cstate change: term changed from 19 to 21, leader changed from 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65) to 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66). New cstate: current_term: 21 leader_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } health_report { overall_health: UNKNOWN } } }
W20260709 14:53:47.854465  7893 consensus_peers.cc:597] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 14:53:47.856014 14754 consensus_queue.cc:1048] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 14:53:47.858881  7893 consensus_peers.cc:597] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 14:53:47.890522  7819 consensus_peers.cc:597] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 14:53:47.899099  8598 consensus_peers.cc:597] T 9441e831627143a991a1556dcdce71e3 P 9418391fa82a42c79c6cad13ba91d964 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 14:53:47.938651  7893 consensus_peers.cc:597] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 14:53:47.939384  7893 consensus_peers.cc:597] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 14:53:47.947682  7819 consensus_peers.cc:597] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 14:53:47.994979  7893 consensus_peers.cc:597] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 14:53:48.000047  7893 consensus_peers.cc:597] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 14:53:48.105573  7893 consensus_peers.cc:597] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 14:53:48.205636  7819 consensus_peers.cc:597] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 14:53:48.230060  7893 consensus_peers.cc:597] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 14:53:48.263509  7819 consensus_peers.cc:597] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 14:53:48.296083  7893 consensus_peers.cc:597] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 14:53:48.296871  7893 consensus_peers.cc:597] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 14:53:48.322697  7819 consensus_peers.cc:597] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 14:53:48.326360  7893 consensus_peers.cc:597] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 14:53:48.333030  7819 consensus_peers.cc:597] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 14:53:48.336009  7893 consensus_peers.cc:597] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 14:53:48.336730  7893 consensus_peers.cc:597] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 14:53:48.337491  7893 consensus_peers.cc:597] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 14:53:48.364210  7819 consensus_peers.cc:597] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 14:53:48.374888  7893 consensus_peers.cc:597] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 14:53:48.421501  7893 consensus_peers.cc:597] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 14:53:48.422883  7921 raft_consensus.cc:1275] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Refusing update from remote peer 3876b8ee8d744cb18e91d97aae93b1ac: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
W20260709 14:53:48.440963  7893 consensus_peers.cc:597] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 14:53:48.446779 14762 consensus_queue.cc:1048] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 14:53:48.449409  7893 consensus_peers.cc:597] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 14:53:48.451764  7893 consensus_peers.cc:597] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 14:53:48.492718  7819 consensus_peers.cc:597] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 14:53:48.512902  7893 consensus_peers.cc:597] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 14:53:48.558736  7819 consensus_peers.cc:597] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 14:53:48.562863  7893 consensus_peers.cc:597] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 14:53:48.573310  7893 consensus_peers.cc:597] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 14:53:48.576713  7893 consensus_peers.cc:597] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 14:53:48.597115  7893 consensus_peers.cc:597] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 14:53:48.598939  7893 consensus_peers.cc:597] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 14:53:48.584227  7819 consensus_peers.cc:597] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 14:53:48.665227  7893 consensus_peers.cc:597] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 14:53:48.681432  7893 consensus_peers.cc:597] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 14:53:48.732342  7819 consensus_peers.cc:597] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 14:53:48.773844  6549 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 7800)
W20260709 14:53:48.776005  7819 consensus_peers.cc:597] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 14:53:48.800978  7893 consensus_peers.cc:597] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 14:53:48.809633  7893 consensus_peers.cc:597] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 14:53:48.860273  7893 consensus_peers.cc:597] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 14:53:48.876561  7819 consensus_peers.cc:597] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 14:53:48.960153  7819 consensus_peers.cc:597] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 14:53:49.180845  7893 consensus_peers.cc:597] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 14:53:49.774489  6549 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 7800)
I20260709 14:53:49.813330 14768 raft_consensus.cc:493] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:49.814347 14768 raft_consensus.cc:515] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:49.854612 14768 leader_election.cc:290] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:53:50.036176  7708 debug-util.cc:398] Leaking SignalData structure 0x7b0800271620 after lost signal to thread 6552
W20260709 14:53:50.038297  7708 debug-util.cc:398] Leaking SignalData structure 0x7b08000db8c0 after lost signal to thread 7711
I20260709 14:53:50.050349 14768 raft_consensus.cc:493] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:50.051486 14768 raft_consensus.cc:515] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:50.075335 14766 raft_consensus.cc:493] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:50.077034 14766 raft_consensus.cc:515] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:50.080641 14766 leader_election.cc:290] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:50.206254 14766 raft_consensus.cc:493] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:50.206957 14766 raft_consensus.cc:515] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:50.210533 14766 leader_election.cc:290] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:50.235491 14768 leader_election.cc:290] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:50.236724 14768 raft_consensus.cc:493] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:50.237772 14768 raft_consensus.cc:515] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:50.239431 14766 raft_consensus.cc:493] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:50.317830 14769 raft_consensus.cc:493] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9418391fa82a42c79c6cad13ba91d964)
I20260709 14:53:50.329782 14766 raft_consensus.cc:515] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:50.329798 14769 raft_consensus.cc:515] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:53:50.332240 14768 leader_election.cc:290] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:50.332397 14766 leader_election.cc:290] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:50.333360 14768 raft_consensus.cc:493] T 9441e831627143a991a1556dcdce71e3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9418391fa82a42c79c6cad13ba91d964)
I20260709 14:53:50.334195 14766 raft_consensus.cc:493] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:50.334229 14768 raft_consensus.cc:515] T 9441e831627143a991a1556dcdce71e3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:53:50.335326 14766 raft_consensus.cc:515] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:50.335934 14769 leader_election.cc:290] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68:42321)
I20260709 14:53:50.336694 14769 raft_consensus.cc:493] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:50.337723 14768 leader_election.cc:290] T 9441e831627143a991a1556dcdce71e3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68:42321)
I20260709 14:53:50.337399 14769 raft_consensus.cc:515] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:50.339321 14768 raft_consensus.cc:493] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:50.340777 14769 leader_election.cc:290] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:50.340305 14768 raft_consensus.cc:515] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:50.341536 14769 raft_consensus.cc:493] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:50.342120 14769 raft_consensus.cc:515] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:50.343318 14768 leader_election.cc:290] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:50.337757 14766 leader_election.cc:290] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:50.343989 14768 raft_consensus.cc:493] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:50.344676 14768 raft_consensus.cc:515] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:50.344033 14769 leader_election.cc:290] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:50.347082 14768 leader_election.cc:290] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:50.368767 14769 raft_consensus.cc:493] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:50.369511 14769 raft_consensus.cc:515] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:50.371989 14769 leader_election.cc:290] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:53:50.387305  7893 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111) [suppressed 405 similar messages]
I20260709 14:53:50.429129 14756 raft_consensus.cc:493] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:50.570466 14756 raft_consensus.cc:515] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:50.455118 14768 raft_consensus.cc:493] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:50.572656 14768 raft_consensus.cc:515] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:50.575306 14768 leader_election.cc:290] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:50.471498 14713 raft_consensus.cc:493] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:50.576145 14713 raft_consensus.cc:515] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:50.579106 14713 leader_election.cc:290] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:50.580271 14768 raft_consensus.cc:493] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:50.581476 14768 raft_consensus.cc:515] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:50.598074 14768 leader_election.cc:290] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:50.624066 14756 leader_election.cc:290] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:53:50.694842  7893 leader_election.cc:336] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
W20260709 14:53:50.725061  7893 leader_election.cc:336] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
I20260709 14:53:50.724933 14756 raft_consensus.cc:493] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
W20260709 14:53:50.725922  7893 leader_election.cc:336] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
W20260709 14:53:50.726532  7893 leader_election.cc:336] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
W20260709 14:53:50.727116  7893 leader_election.cc:336] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
I20260709 14:53:50.726579 14756 raft_consensus.cc:515] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:50.724489 14768 raft_consensus.cc:493] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:50.730821 14756 leader_election.cc:290] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:50.728978 14768 raft_consensus.cc:515] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:53:50.732910  7893 leader_election.cc:336] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
W20260709 14:53:50.827389  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 94511.8us
W20260709 14:53:50.828084  7893 leader_election.cc:336] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
I20260709 14:53:50.743788 14773 raft_consensus.cc:493] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:50.755106 14775 raft_consensus.cc:493] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:50.765753 14778 raft_consensus.cc:493] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
W20260709 14:53:50.768333  8598 consensus_peers.cc:597] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 14:53:50.830988  8598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 62747.5us
I20260709 14:53:50.830634 14756 raft_consensus.cc:493] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:50.831748 14756 raft_consensus.cc:515] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:50.772550 14776 raft_consensus.cc:493] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:50.832717 14768 leader_election.cc:290] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:50.833048 14776 raft_consensus.cc:515] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:50.833869 14756 leader_election.cc:290] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:50.834456 14756 raft_consensus.cc:493] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:50.834909 14756 raft_consensus.cc:515] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:50.835278 14776 leader_election.cc:290] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:50.835928 14773 raft_consensus.cc:515] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:50.837183 14756 leader_election.cc:290] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:50.774338 14717 raft_consensus.cc:493] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:50.837994 14717 raft_consensus.cc:515] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:50.838435 14773 leader_election.cc:290] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:53:50.775087  6549 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 7800)
I20260709 14:53:50.780467 14762 raft_consensus.cc:493] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:50.840015 14762 raft_consensus.cc:515] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:50.784013  8637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9441e831627143a991a1556dcdce71e3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9418391fa82a42c79c6cad13ba91d964" is_pre_election: true
I20260709 14:53:50.790110 14769 raft_consensus.cc:493] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:50.791262 14726 raft_consensus.cc:493] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:50.805004 14779 raft_consensus.cc:493] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
W20260709 14:53:50.844218  7893 leader_election.cc:336] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
I20260709 14:53:50.808250 14755 raft_consensus.cc:493] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:50.810081 14713 raft_consensus.cc:493] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:50.812443 14783 raft_consensus.cc:493] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:50.816341 14772 raft_consensus.cc:493] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9418391fa82a42c79c6cad13ba91d964)
I20260709 14:53:50.832458 14714 raft_consensus.cc:493] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:50.839236 14768 raft_consensus.cc:493] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
W20260709 14:53:50.806416  7708 debug-util.cc:398] Leaking SignalData structure 0x7b0800034960 after lost signal to thread 7878
I20260709 14:53:50.851373 14714 raft_consensus.cc:515] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:53:50.900972  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 45538.6us
W20260709 14:53:50.925704  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 74939.1us
W20260709 14:53:50.926029  7708 debug-util.cc:398] Leaking SignalData structure 0x7b08001c3960 after lost signal to thread 7952
I20260709 14:53:50.928026 14714 leader_election.cc:290] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:53:50.930584  7708 debug-util.cc:398] Leaking SignalData structure 0x7b08003b6680 after lost signal to thread 8664
W20260709 14:53:50.931595  7708 debug-util.cc:398] Leaking SignalData structure 0x7b080035fd60 after lost signal to thread 14764
W20260709 14:53:50.939181  7893 consensus_peers.cc:597] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 14:53:50.941128  7893 consensus_peers.cc:597] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 14:53:50.935961 14756 raft_consensus.cc:493] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:50.930028 14776 raft_consensus.cc:493] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:50.852686 14713 raft_consensus.cc:515] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:50.849735 14769 raft_consensus.cc:515] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:50.957811 14781 raft_consensus.cc:493] T 9ce9c0ef2db24c13a8b1402f21819458 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9418391fa82a42c79c6cad13ba91d964)
I20260709 14:53:50.957954 14714 raft_consensus.cc:493] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:50.930485 14768 raft_consensus.cc:515] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:50.970448 14781 raft_consensus.cc:515] T 9ce9c0ef2db24c13a8b1402f21819458 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:53:50.970640 14714 raft_consensus.cc:515] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:50.959725 14782 raft_consensus.cc:493] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:50.972618 14768 leader_election.cc:290] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:50.972463 14782 raft_consensus.cc:515] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:50.852528 14726 raft_consensus.cc:515] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:50.974759 14714 leader_election.cc:290] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:50.900557 14783 raft_consensus.cc:515] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:50.901440 14755 raft_consensus.cc:515] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:50.921275 14772 raft_consensus.cc:515] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:53:50.842897 14775 raft_consensus.cc:515] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:50.954437 14762 leader_election.cc:290] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:50.956175 14773 raft_consensus.cc:493] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:50.955729 14756 raft_consensus.cc:515] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:50.852239 14779 raft_consensus.cc:515] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:53:50.989507  7819 consensus_peers.cc:597] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 14:53:50.982270 14717 leader_election.cc:290] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:50.991839 14772 leader_election.cc:290] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785), 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68:42321)
I20260709 14:53:50.973518 14776 raft_consensus.cc:515] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:50.997512 14775 leader_election.cc:290] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:50.995878 14780 raft_consensus.cc:493] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:50.998823 14780 raft_consensus.cc:515] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:50.999523 14717 raft_consensus.cc:493] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:51.000648 14717 raft_consensus.cc:515] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:51.001714 14779 leader_election.cc:290] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:50.992786 14762 raft_consensus.cc:493] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9418391fa82a42c79c6cad13ba91d964)
I20260709 14:53:50.993075 14768 raft_consensus.cc:493] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:50.995255 14783 leader_election.cc:290] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:51.003386 14768 raft_consensus.cc:515] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:51.002198 14780 leader_election.cc:290] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:51.004988 14717 leader_election.cc:290] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:51.005354 14773 raft_consensus.cc:515] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:51.006582 14772 raft_consensus.cc:493] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:51.007325 14772 raft_consensus.cc:515] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:51.001235 14784 raft_consensus.cc:493] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:50.992110 14781 leader_election.cc:290] T 9ce9c0ef2db24c13a8b1402f21819458 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68:42321)
I20260709 14:53:51.008746 14780 raft_consensus.cc:493] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:50.996271 14756 leader_election.cc:290] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:51.007606 14775 raft_consensus.cc:493] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:50.854205 14778 raft_consensus.cc:515] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:51.011744 14775 raft_consensus.cc:515] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:51.010042 14756 raft_consensus.cc:493] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:51.013648 14784 raft_consensus.cc:515] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:51.014991 14778 leader_election.cc:290] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:50.999396 14776 leader_election.cc:290] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:51.015609 14779 raft_consensus.cc:493] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:51.015834 14756 raft_consensus.cc:515] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:51.016407 14779 raft_consensus.cc:515] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:51.002867 14762 raft_consensus.cc:515] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:53:51.017179 14772 leader_election.cc:290] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:51.018518 14756 leader_election.cc:290] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:51.018908 14775 leader_election.cc:290] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:51.009585 14780 raft_consensus.cc:515] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:51.021505 14768 leader_election.cc:290] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:51.007818 14773 leader_election.cc:290] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:51.017042 14713 leader_election.cc:290] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:51.029016 14775 raft_consensus.cc:493] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:51.030509 14775 raft_consensus.cc:515] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:51.035421 14754 raft_consensus.cc:493] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:51.036355 14754 raft_consensus.cc:515] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:51.038394  8637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1f7722fdea49e0b5e9c5d96633eaf9" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9418391fa82a42c79c6cad13ba91d964" is_pre_election: true
I20260709 14:53:51.039273 14754 leader_election.cc:290] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:51.040002 14784 leader_election.cc:290] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:51.038486 14775 leader_election.cc:290] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:50.999567 14789 raft_consensus.cc:493] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:51.041215 14726 leader_election.cc:290] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:51.041865  8639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18d29d52d304c87b930d4fb5eaf50b1" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9418391fa82a42c79c6cad13ba91d964" is_pre_election: true
I20260709 14:53:51.040853  8640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1f7722fdea49e0b5e9c5d96633eaf9" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9418391fa82a42c79c6cad13ba91d964" is_pre_election: true
I20260709 14:53:51.041379 14789 raft_consensus.cc:515] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:51.026912 14768 raft_consensus.cc:493] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:51.044051 14768 raft_consensus.cc:515] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:51.027730 14788 raft_consensus.cc:493] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:53:51.045658 14788 raft_consensus.cc:515] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:51.047137 14789 leader_election.cc:290] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:51.020023 14762 leader_election.cc:290] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68:42321)
I20260709 14:53:50.998934 14755 leader_election.cc:290] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:51.046516 14768 leader_election.cc:290] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:51.042316 14769 leader_election.cc:290] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:51.049492 14788 leader_election.cc:290] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:51.050499  8640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce9c0ef2db24c13a8b1402f21819458" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9418391fa82a42c79c6cad13ba91d964" is_pre_election: true
I20260709 14:53:51.036832 14782 leader_election.cc:290] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:51.055585 14780 leader_election.cc:290] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:51.062649  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:51.063592  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1f7722fdea49e0b5e9c5d96633eaf9" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:51.040130 14754 raft_consensus.cc:493] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:53:51.065657  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:51.066242  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:51.066540  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:51.065124 14754 raft_consensus.cc:515] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:53:51.067288  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:51.068436  7845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c563cc7cfbe4d59be4ffc5cf847ce56" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:51.069658  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:51.042869 14779 leader_election.cc:290] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:53:51.073112  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:51.078431  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:51.097857  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:51.100489  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:51.103235  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:53:51.104305  7893 leader_election.cc:336] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
I20260709 14:53:51.104872  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783e4874513449ef9084b833f188a6d3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:53:51.106746  7893 leader_election.cc:336] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
I20260709 14:53:51.107353  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:51.069144 14754 leader_election.cc:290] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:53:51.112838  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:51.114949  7849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:51.120817  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:51.121044  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:51.122822  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:51.122717  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:51.124394  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:51.125780  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:53:51.136502  7894 leader_election.cc:304] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:53:51.143110  7893 leader_election.cc:336] T 9ce9c0ef2db24c13a8b1402f21819458 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
I20260709 14:53:51.143745  7893 leader_election.cc:304] T 9ce9c0ef2db24c13a8b1402f21819458 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 9418391fa82a42c79c6cad13ba91d964
I20260709 14:53:51.144335 14784 raft_consensus.cc:2749] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 14:53:51.144614 14754 raft_consensus.cc:2749] T 9ce9c0ef2db24c13a8b1402f21819458 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 14:53:51.146044  7893 leader_election.cc:336] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
I20260709 14:53:51.146175  7894 leader_election.cc:304] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac, 9418391fa82a42c79c6cad13ba91d964
W20260709 14:53:51.146727  7893 leader_election.cc:336] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
I20260709 14:53:51.147440 14754 raft_consensus.cc:2749] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 14:53:51.148025  7894 leader_election.cc:304] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:53:51.148175  7893 leader_election.cc:336] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
I20260709 14:53:51.149448 14754 raft_consensus.cc:2749] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 14:53:51.149744  7894 leader_election.cc:304] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:53:51.149102  7893 leader_election.cc:336] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
I20260709 14:53:51.150992 14754 raft_consensus.cc:2749] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 14:53:51.151240  7894 leader_election.cc:304] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
W20260709 14:53:51.151414  7893 leader_election.cc:336] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
W20260709 14:53:51.152427  7893 consensus_peers.cc:597] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 14:53:51.152696  7894 leader_election.cc:304] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:51.153069 14754 raft_consensus.cc:2749] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 14:53:51.153646 14784 raft_consensus.cc:2749] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 14:53:51.152810  7893 leader_election.cc:336] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
W20260709 14:53:51.154421  7893 leader_election.cc:336] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
I20260709 14:53:51.155153  7894 leader_election.cc:304] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:51.156060 14754 raft_consensus.cc:2749] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 14:53:51.157552  7894 leader_election.cc:304] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:51.158339 14754 raft_consensus.cc:2749] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 14:53:51.171006  7894 leader_election.cc:304] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:51.172467 14754 raft_consensus.cc:2749] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 14:53:51.183264  7894 leader_election.cc:304] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:51.184175 14754 raft_consensus.cc:2749] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 14:53:51.187089  7894 leader_election.cc:304] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:51.188465 14754 raft_consensus.cc:2749] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 14:53:51.190056  7894 leader_election.cc:304] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:51.190901 14754 raft_consensus.cc:2749] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 14:53:51.192271  7894 leader_election.cc:304] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:51.193130 14754 raft_consensus.cc:2749] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 14:53:51.195752  7894 leader_election.cc:304] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:51.196868 14754 raft_consensus.cc:2749] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 14:53:51.198501  7894 leader_election.cc:304] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:51.199455 14754 raft_consensus.cc:2749] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 14:53:51.204319  7894 leader_election.cc:304] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:51.205713 14754 raft_consensus.cc:2749] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 14:53:51.207762  7894 leader_election.cc:304] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:51.208837 14754 raft_consensus.cc:2749] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 14:53:51.210539  7894 leader_election.cc:304] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:53:51.211692 14754 raft_consensus.cc:2749] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 14:53:51.230657  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:51.233286  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:51.233952  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4c35543cc44c64a939eae4f3e5e258" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:51.235749  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:51.243464  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:51.244436  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:51.244740  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:51.246349  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:51.250730  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "179f6d5364ba445e8eb5aa330b4a0f04" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:51.253706  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:51.252880  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:51.253419  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1f7722fdea49e0b5e9c5d96633eaf9" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:51.253643  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:51.255378  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:51.254009  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:51.257001  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:51.258769  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:51.261226  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:51.264010  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 28 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:51.268155  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c5a5f4d6980405d99119f2f2e97df2f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:51.270609  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:51.272018  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af383cb6c2e843c593c3d86266ffdfdf" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:51.272957  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:51.275027  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7960f2a6dc94357a722fa1a67e8383c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:51.277940  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:51.279193  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:51.279759  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:51.281318  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:51.281867  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:51.276872  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:51.283481  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:51.284792  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:53:51.278265  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
W20260709 14:53:51.359586  8598 consensus_peers.cc:597] T 9441e831627143a991a1556dcdce71e3 P 9418391fa82a42c79c6cad13ba91d964 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 14:53:51.360853  7893 consensus_peers.cc:597] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 14:53:51.393026  7819 leader_election.cc:304] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1e9289592458429bbddb19c2e7b7b7b0, 9418391fa82a42c79c6cad13ba91d964
I20260709 14:53:51.423174 14782 raft_consensus.cc:2749] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 14:53:51.496011  7819 leader_election.cc:336] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
I20260709 14:53:51.496580  7819 leader_election.cc:304] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:51.512022 14782 raft_consensus.cc:2749] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 14:53:51.513550  7819 leader_election.cc:336] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
I20260709 14:53:51.514079  7819 leader_election.cc:304] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:51.514987 14786 raft_consensus.cc:2749] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 14:53:51.524150  7893 consensus_peers.cc:597] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 14:53:51.515132  7819 leader_election.cc:336] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
I20260709 14:53:51.525377  7819 leader_election.cc:304] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:51.526551 14782 raft_consensus.cc:2749] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 14:53:51.528403  7819 leader_election.cc:336] T 9441e831627143a991a1556dcdce71e3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
I20260709 14:53:51.529052  7819 leader_election.cc:304] T 9441e831627143a991a1556dcdce71e3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 9418391fa82a42c79c6cad13ba91d964
W20260709 14:53:51.533977  7819 leader_election.cc:336] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
I20260709 14:53:51.534461  7819 leader_election.cc:304] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:51.533797 14782 raft_consensus.cc:2749] T 9441e831627143a991a1556dcdce71e3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 14:53:51.548928  7819 leader_election.cc:336] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
I20260709 14:53:51.549422  7819 leader_election.cc:304] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
W20260709 14:53:51.550581  7819 consensus_peers.cc:597] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 14:53:51.551304  7819 leader_election.cc:336] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
I20260709 14:53:51.551837  7819 leader_election.cc:304] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
W20260709 14:53:51.552652  7819 leader_election.cc:336] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
I20260709 14:53:51.553032  7819 leader_election.cc:304] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
W20260709 14:53:51.554289  7819 leader_election.cc:336] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
I20260709 14:53:51.554785  7819 leader_election.cc:304] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:51.550837 14782 raft_consensus.cc:2749] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 14:53:51.552953 14786 raft_consensus.cc:2749] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 14:53:51.553696 14779 raft_consensus.cc:2749] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 14:53:51.554455 14788 raft_consensus.cc:2749] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 14:53:51.555967 14755 raft_consensus.cc:2749] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 14:53:51.555985  7819 leader_election.cc:336] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
I20260709 14:53:51.570152  7819 leader_election.cc:304] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:51.571103 14782 raft_consensus.cc:2749] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 14:53:51.572901  7819 leader_election.cc:336] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
I20260709 14:53:51.573484  7819 leader_election.cc:304] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:51.574419 14782 raft_consensus.cc:2749] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 14:53:51.575687  7819 leader_election.cc:336] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
I20260709 14:53:51.576210  7819 leader_election.cc:304] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:51.577050 14782 raft_consensus.cc:2749] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 14:53:51.578460  7819 leader_election.cc:336] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
I20260709 14:53:51.579216  7819 leader_election.cc:304] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:51.580106 14782 raft_consensus.cc:2749] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 14:53:51.581605  7819 leader_election.cc:336] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
I20260709 14:53:51.582124  7819 leader_election.cc:304] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:51.583220 14782 raft_consensus.cc:2749] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 14:53:51.584723  7819 leader_election.cc:336] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
I20260709 14:53:51.585273  7819 leader_election.cc:304] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:51.586136 14782 raft_consensus.cc:2749] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 14:53:51.587817  7819 leader_election.cc:336] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
I20260709 14:53:51.588326  7819 leader_election.cc:304] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:51.589128 14782 raft_consensus.cc:2749] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 14:53:51.590866  7819 leader_election.cc:336] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
I20260709 14:53:51.591454  7819 leader_election.cc:304] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:51.592445 14782 raft_consensus.cc:2749] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 14:53:51.593849  7819 leader_election.cc:336] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
I20260709 14:53:51.594471  7819 leader_election.cc:304] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:51.597191 14782 raft_consensus.cc:2749] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 14:53:51.598773  7819 leader_election.cc:336] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
I20260709 14:53:51.599309  7819 leader_election.cc:304] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:51.606827 14782 raft_consensus.cc:2749] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 14:53:51.608533  7819 leader_election.cc:336] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
I20260709 14:53:51.609146  7819 leader_election.cc:304] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:51.610050 14782 raft_consensus.cc:2749] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 14:53:51.611660  7819 leader_election.cc:336] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
I20260709 14:53:51.612596  7819 leader_election.cc:304] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:51.613754 14782 raft_consensus.cc:2749] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 14:53:51.615232  7819 leader_election.cc:336] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
I20260709 14:53:51.615824  7819 leader_election.cc:304] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:51.627449 14782 raft_consensus.cc:2749] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 14:53:51.631973  7819 leader_election.cc:336] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
I20260709 14:53:51.632588  7819 leader_election.cc:304] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:51.633433 14782 raft_consensus.cc:2749] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 14:53:51.634651  7819 leader_election.cc:336] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
I20260709 14:53:51.635138  7819 leader_election.cc:304] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:51.635974 14782 raft_consensus.cc:2749] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
W20260709 14:53:51.637733  7819 leader_election.cc:336] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
I20260709 14:53:51.638252  7819 leader_election.cc:304] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:51.639073 14782 raft_consensus.cc:2749] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 14:53:51.640779  7819 leader_election.cc:336] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
I20260709 14:53:51.641343  7819 leader_election.cc:304] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:51.642223 14782 raft_consensus.cc:2749] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 14:53:51.643496  7819 leader_election.cc:336] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
I20260709 14:53:51.644035  7819 leader_election.cc:304] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:51.657760 14782 raft_consensus.cc:2749] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 14:53:51.659524  7819 leader_election.cc:336] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
I20260709 14:53:51.660156  7819 leader_election.cc:304] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:51.661375 14782 raft_consensus.cc:2749] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 14:53:51.663194  7819 leader_election.cc:336] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
I20260709 14:53:51.663759  7819 leader_election.cc:304] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:51.666095 14782 raft_consensus.cc:2749] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 14:53:51.667591  7819 leader_election.cc:336] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
I20260709 14:53:51.668141  7819 leader_election.cc:304] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:51.669149 14782 raft_consensus.cc:2749] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 14:53:51.670564  7819 leader_election.cc:336] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
I20260709 14:53:51.671145  7819 leader_election.cc:304] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:51.672040 14782 raft_consensus.cc:2749] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 14:53:51.673595  7819 leader_election.cc:336] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
I20260709 14:53:51.674134  7819 leader_election.cc:304] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 9418391fa82a42c79c6cad13ba91d964
I20260709 14:53:51.675055 14782 raft_consensus.cc:2749] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 14:53:51.676820  7819 leader_election.cc:336] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
I20260709 14:53:51.677431  7819 leader_election.cc:304] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:51.678385 14782 raft_consensus.cc:2749] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 14:53:51.681811  7819 leader_election.cc:336] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
I20260709 14:53:51.682435  7819 leader_election.cc:304] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:51.688560 14782 raft_consensus.cc:2749] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 14:53:51.690188  7819 leader_election.cc:336] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
I20260709 14:53:51.690753  7819 leader_election.cc:304] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:51.694846 14782 raft_consensus.cc:2749] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 14:53:51.696499  7819 leader_election.cc:336] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
I20260709 14:53:51.697229  7819 leader_election.cc:304] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:51.707103 14782 raft_consensus.cc:2749] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 14:53:51.708787  7819 leader_election.cc:336] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
I20260709 14:53:51.709631  7819 leader_election.cc:304] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:51.710588 14782 raft_consensus.cc:2749] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 14:53:51.712093  7819 leader_election.cc:336] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
I20260709 14:53:51.712648  7819 leader_election.cc:304] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:51.713524 14782 raft_consensus.cc:2749] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 14:53:51.714980  7819 leader_election.cc:336] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
I20260709 14:53:51.715515  7819 leader_election.cc:304] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:53:51.716369 14782 raft_consensus.cc:2749] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 14:53:51.793453  7893 consensus_peers.cc:597] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 14:53:51.840569  6549 thread.cc:527] Waited for 7000ms trying to join with diag-logger (tid 7800)
W20260709 14:53:51.844136  7893 consensus_peers.cc:597] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 14:53:51.872426  7893 consensus_peers.cc:597] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 14:53:51.888288  7819 consensus_peers.cc:597] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 14:53:51.891155  8598 consensus_peers.cc:597] T 9ce9c0ef2db24c13a8b1402f21819458 P 9418391fa82a42c79c6cad13ba91d964 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 14:53:51.961119  7893 consensus_peers.cc:597] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 14:53:51.962803  7893 consensus_peers.cc:597] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 14:53:52.011238  7893 consensus_peers.cc:597] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 14:53:52.268358  7893 consensus_peers.cc:597] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 14:53:52.270452  7893 consensus_peers.cc:597] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 14:53:52.304898  8599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 46885.4us
W20260709 14:53:52.310298  7893 consensus_peers.cc:597] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 14:53:52.310997  7893 consensus_peers.cc:597] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 14:53:52.322863  7819 consensus_peers.cc:597] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 14:53:52.339848  7893 consensus_peers.cc:597] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 14:53:52.340927  7893 consensus_peers.cc:597] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 14:53:52.394245  7819 consensus_peers.cc:597] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 14:53:52.398877  7893 consensus_peers.cc:597] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 14:53:52.459640  7893 consensus_peers.cc:597] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 14:53:52.539966  7819 consensus_peers.cc:597] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 14:53:52.567703  7893 consensus_peers.cc:597] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 14:53:52.568728  7893 consensus_peers.cc:597] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 14:53:52.592640  7893 consensus_peers.cc:597] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 14:53:52.593670  7893 consensus_peers.cc:597] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 14:53:52.594369  7893 consensus_peers.cc:597] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 14:53:52.684134  7893 consensus_peers.cc:597] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 14:53:52.701915  7893 consensus_peers.cc:597] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 14:53:52.702857  7893 consensus_peers.cc:597] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 14:53:52.766637  8598 consensus_peers.cc:597] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 14:53:52.842873  6549 thread.cc:527] Waited for 8000ms trying to join with diag-logger (tid 7800)
W20260709 14:53:52.846783  7893 consensus_peers.cc:597] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 14:53:52.887993  7819 consensus_peers.cc:597] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 14:53:52.888792  7819 consensus_peers.cc:597] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 14:53:52.894083  7893 consensus_peers.cc:597] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 14:53:52.926970  7893 consensus_peers.cc:597] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 14:53:53.023844  7893 consensus_peers.cc:597] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 14:53:53.025692  7819 consensus_peers.cc:597] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 14:53:53.045087  7819 consensus_peers.cc:597] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 14:53:53.045231  7893 consensus_peers.cc:597] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 14:53:53.060842  7819 consensus_peers.cc:597] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 14:53:53.064332  7893 consensus_peers.cc:597] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 14:53:53.071619  7819 consensus_peers.cc:597] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 14:53:53.121268  7893 consensus_peers.cc:597] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 14:53:53.122196  7893 consensus_peers.cc:597] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 14:53:53.145227  7893 consensus_peers.cc:597] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 14:53:53.149049  7893 consensus_peers.cc:597] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 14:53:53.171931  7893 consensus_peers.cc:597] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 14:53:53.172672  7893 consensus_peers.cc:597] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 14:53:53.279464  7819 consensus_peers.cc:597] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 14:53:53.306674  7819 consensus_peers.cc:597] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 14:53:53.310487  7893 consensus_peers.cc:597] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 14:53:53.398511  7819 consensus_peers.cc:597] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 14:53:53.534701  7819 consensus_peers.cc:597] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 14:53:53.577705  7819 consensus_peers.cc:597] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 14:53:53.590818  7819 consensus_peers.cc:597] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 14:53:53.735523  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 69564.3us
W20260709 14:53:53.780267  8598 consensus_peers.cc:597] T 9441e831627143a991a1556dcdce71e3 P 9418391fa82a42c79c6cad13ba91d964 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 14:53:53.894567  6549 thread.cc:527] Waited for 9000ms trying to join with diag-logger (tid 7800)
W20260709 14:53:54.120479  7819 consensus_peers.cc:597] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 14:53:54.274138  7893 consensus_peers.cc:597] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 14:53:54.308792  7893 consensus_peers.cc:597] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 14:53:54.319671  7893 consensus_peers.cc:597] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 14:53:54.328074  8598 consensus_peers.cc:597] T 9ce9c0ef2db24c13a8b1402f21819458 P 9418391fa82a42c79c6cad13ba91d964 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 14:53:54.557346  7819 consensus_peers.cc:597] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 14:53:54.590196  7893 consensus_peers.cc:597] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 14:53:54.590973  7893 consensus_peers.cc:597] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 14:53:54.622100  7893 consensus_peers.cc:597] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 14:53:54.660434  7893 consensus_peers.cc:597] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 14:53:54.780589  7893 consensus_peers.cc:597] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 14:53:54.797227  7893 consensus_peers.cc:597] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 14:53:54.810474  7893 consensus_peers.cc:597] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 14:53:54.812846  7893 consensus_peers.cc:597] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 14:53:54.895653  6549 thread.cc:527] Waited for 10000ms trying to join with diag-logger (tid 7800)
W20260709 14:53:54.915289  7819 consensus_peers.cc:597] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 14:53:54.927424  7893 consensus_peers.cc:597] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 14:53:54.962913  7893 consensus_peers.cc:597] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 14:53:54.976148  7893 consensus_peers.cc:597] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 14:53:55.003844  7893 consensus_peers.cc:597] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 14:53:55.005872  7819 consensus_peers.cc:597] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 14:53:55.041976  7893 consensus_peers.cc:597] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 14:53:55.042769  7893 consensus_peers.cc:597] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 14:53:55.122720  7893 consensus_peers.cc:597] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 14:53:55.159088  7949 debug-util.cc:398] Leaking SignalData structure 0x7b08000a8980 after lost signal to thread 6552
W20260709 14:53:55.160666  7949 debug-util.cc:398] Leaking SignalData structure 0x7b0800085f20 after lost signal to thread 7711
W20260709 14:53:55.162712  7949 debug-util.cc:398] Leaking SignalData structure 0x7b080018f9e0 after lost signal to thread 7878
W20260709 14:53:55.164534  7949 debug-util.cc:398] Leaking SignalData structure 0x7b080011cfc0 after lost signal to thread 7952
W20260709 14:53:55.168828  7949 debug-util.cc:398] Leaking SignalData structure 0x7b08000b6d00 after lost signal to thread 8664
W20260709 14:53:55.169440  7893 consensus_peers.cc:597] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 14:53:55.176132  7893 consensus_peers.cc:597] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 14:53:55.176987  7819 consensus_peers.cc:597] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 14:53:55.214030  7893 consensus_peers.cc:597] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 14:53:55.217952  7893 consensus_peers.cc:597] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 14:53:55.284389  7893 consensus_peers.cc:597] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 14:53:55.308233  8598 consensus_peers.cc:597] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 14:53:55.367449  7893 consensus_peers.cc:597] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 14:53:55.397938  7819 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111) [suppressed 572 similar messages]
W20260709 14:53:55.400803  7893 consensus_peers.cc:597] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 14:53:55.401649  7819 consensus_peers.cc:597] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 14:53:55.556824  7819 consensus_peers.cc:597] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 14:53:55.634095  7893 consensus_peers.cc:597] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 14:53:55.640625  7819 consensus_peers.cc:597] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 14:53:55.662853  7893 consensus_peers.cc:597] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 14:53:55.682847  7893 consensus_peers.cc:597] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 14:53:55.718897  7893 consensus_peers.cc:597] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 14:53:55.720602  7819 consensus_peers.cc:597] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 14:53:55.725315  7893 consensus_peers.cc:597] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 14:53:55.736059  7893 consensus_peers.cc:597] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 14:53:55.807149  7893 consensus_peers.cc:597] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 14:53:55.839425  7893 consensus_peers.cc:597] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 14:53:55.896350  6549 thread.cc:527] Waited for 11000ms trying to join with diag-logger (tid 7800)
W20260709 14:53:56.032795  7819 consensus_peers.cc:597] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 14:53:56.036381  7819 consensus_peers.cc:597] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 14:53:56.143743  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 93961.5us
W20260709 14:53:56.323238  8598 consensus_peers.cc:597] T 9441e831627143a991a1556dcdce71e3 P 9418391fa82a42c79c6cad13ba91d964 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 14:53:56.348296  7819 consensus_peers.cc:597] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 14:53:56.354187  7819 consensus_peers.cc:597] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 14:53:56.354987  7819 consensus_peers.cc:597] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 14:53:56.383708  7819 consensus_peers.cc:597] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 14:53:56.401983  7819 consensus_peers.cc:597] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 14:53:56.400090  7893 consensus_peers.cc:597] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 14:53:56.406848  7893 consensus_peers.cc:597] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 14:53:56.444348  7893 consensus_peers.cc:597] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 14:53:56.453281  7893 consensus_peers.cc:597] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 14:53:56.505336  7819 consensus_peers.cc:597] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 14:53:56.515743  7893 consensus_peers.cc:597] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 14:53:56.525576  7819 consensus_peers.cc:597] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 14:53:56.595217  7893 consensus_peers.cc:597] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 14:53:56.855844  7893 consensus_peers.cc:597] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 14:53:56.897163  6549 thread.cc:527] Waited for 12000ms trying to join with diag-logger (tid 7800)
W20260709 14:53:56.906931  7893 consensus_peers.cc:597] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 14:53:56.920389  7893 consensus_peers.cc:597] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 14:53:56.979738  8598 consensus_peers.cc:597] T 9ce9c0ef2db24c13a8b1402f21819458 P 9418391fa82a42c79c6cad13ba91d964 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 14:53:56.988375  7819 consensus_peers.cc:597] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 14:53:57.132479  7893 consensus_peers.cc:597] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 14:53:57.139338  7875 debug-util.cc:398] Leaking SignalData structure 0x7b080015bb20 after lost signal to thread 6552
W20260709 14:53:57.140682  7875 debug-util.cc:398] Leaking SignalData structure 0x7b0800371040 after lost signal to thread 7711
W20260709 14:53:57.163331  7875 debug-util.cc:398] Leaking SignalData structure 0x7b0800106bc0 after lost signal to thread 7878
W20260709 14:53:57.173018  7875 debug-util.cc:398] Leaking SignalData structure 0x7b08000f6c20 after lost signal to thread 7952
W20260709 14:53:57.175347  7819 consensus_peers.cc:597] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 14:53:57.217442  7875 debug-util.cc:398] Leaking SignalData structure 0x7b080020d4c0 after lost signal to thread 8664
W20260709 14:53:57.318174  7893 consensus_peers.cc:597] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 14:53:57.329282  7893 consensus_peers.cc:597] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 14:53:57.400208  7893 consensus_peers.cc:597] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 14:53:57.564021  7893 consensus_peers.cc:597] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 14:53:57.568512  7893 consensus_peers.cc:597] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 14:53:57.587956  7819 consensus_peers.cc:597] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 14:53:57.614457  8598 consensus_peers.cc:597] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 14:53:57.616192  7893 consensus_peers.cc:597] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 14:53:57.654033  7893 consensus_peers.cc:597] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 14:53:57.664585  7893 consensus_peers.cc:597] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 14:53:57.721935  7893 consensus_peers.cc:597] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 14:53:57.734520  7893 consensus_peers.cc:597] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 14:53:57.745203  7819 consensus_peers.cc:597] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 14:53:57.770409  7893 consensus_peers.cc:597] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 14:53:57.771090  7893 consensus_peers.cc:597] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 14:53:57.831475  7893 consensus_peers.cc:597] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 14:53:57.852533  7893 consensus_peers.cc:597] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 14:53:57.875290  7893 consensus_peers.cc:597] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 14:53:57.897761  6549 thread.cc:527] Waited for 13000ms trying to join with diag-logger (tid 7800)
W20260709 14:53:57.904134  7819 consensus_peers.cc:597] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 14:53:58.046197  7819 consensus_peers.cc:597] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 14:53:58.132751  7893 consensus_peers.cc:597] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 14:53:58.133498  7893 consensus_peers.cc:597] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 14:53:58.134027  7893 consensus_peers.cc:597] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 14:53:58.134521  7893 consensus_peers.cc:597] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 14:53:58.188231  7893 consensus_peers.cc:597] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 14:53:58.316133  7819 consensus_peers.cc:597] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 14:53:58.323652  7893 consensus_peers.cc:597] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 14:53:58.331166  7819 consensus_peers.cc:597] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 14:53:58.375592  7893 consensus_peers.cc:597] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 14:53:58.376803  7893 consensus_peers.cc:597] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 14:53:58.379791  7893 consensus_peers.cc:597] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 14:53:58.410961  7893 consensus_peers.cc:597] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 14:53:58.414155  7819 consensus_peers.cc:597] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 14:53:58.414847  7893 consensus_peers.cc:597] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 14:53:58.485853  7893 consensus_peers.cc:597] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 14:53:58.498624  7819 consensus_peers.cc:597] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 14:53:58.683032  8598 consensus_peers.cc:597] T 9441e831627143a991a1556dcdce71e3 P 9418391fa82a42c79c6cad13ba91d964 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 14:53:58.719457  7819 consensus_peers.cc:597] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 14:53:58.719817  7893 consensus_peers.cc:597] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 14:53:58.757498  7893 consensus_peers.cc:597] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 14:53:58.757874  7819 consensus_peers.cc:597] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 14:53:58.759502  7819 consensus_peers.cc:597] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 14:53:58.818143  7819 consensus_peers.cc:597] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 14:53:58.878846  7893 consensus_peers.cc:597] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 14:53:58.882717  7893 consensus_peers.cc:597] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 14:53:58.902793  6549 thread.cc:527] Waited for 14000ms trying to join with diag-logger (tid 7800)
W20260709 14:53:58.902958  7893 consensus_peers.cc:597] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 14:53:58.917282  7819 consensus_peers.cc:597] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 14:53:59.034320  7819 consensus_peers.cc:597] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 14:53:59.130723  7893 consensus_peers.cc:597] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 14:53:59.139587  7819 consensus_peers.cc:597] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 14:53:59.201228  7893 consensus_peers.cc:597] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 14:53:59.276546  7893 consensus_peers.cc:597] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 14:53:59.328886  8598 consensus_peers.cc:597] T 9ce9c0ef2db24c13a8b1402f21819458 P 9418391fa82a42c79c6cad13ba91d964 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 14:53:59.396430  7893 consensus_peers.cc:597] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 14:53:59.531291  7819 consensus_peers.cc:597] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 14:53:59.571295  7893 consensus_peers.cc:597] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 14:53:59.728837  7893 consensus_peers.cc:597] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 14:53:59.744514  7819 consensus_peers.cc:597] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 14:53:59.748730  7893 consensus_peers.cc:597] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 14:53:59.798813  7893 consensus_peers.cc:597] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 14:53:59.819343  7893 consensus_peers.cc:597] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 14:53:59.863976  7893 consensus_peers.cc:597] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 14:53:59.893081  7893 consensus_peers.cc:597] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 14:53:59.903587  6549 thread.cc:527] Waited for 15000ms trying to join with diag-logger (tid 7800)
W20260709 14:53:59.963027  7893 consensus_peers.cc:597] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 14:54:00.003552  7819 consensus_peers.cc:597] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 14:54:00.904384  6549 thread.cc:527] Waited for 16000ms trying to join with diag-logger (tid 7800)
I20260709 14:54:01.146613 14845 raft_consensus.cc:493] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:54:01.148881 14845 raft_consensus.cc:515] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:54:01.153860 14845 leader_election.cc:290] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:54:01.160022 14844 raft_consensus.cc:493] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:54:01.160745 14844 raft_consensus.cc:515] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:54:01.163136 14844 leader_election.cc:290] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:54:01.163867 14847 raft_consensus.cc:493] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:54:01.164076 14844 raft_consensus.cc:493] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:54:01.164568 14847 raft_consensus.cc:515] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:54:01.164716 14844 raft_consensus.cc:515] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:54:01.169003 14844 leader_election.cc:290] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:54:01.169793 14847 leader_election.cc:290] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:54:01.170233 14844 raft_consensus.cc:493] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:54:01.170827 14844 raft_consensus.cc:515] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:54:01.172933 14844 leader_election.cc:290] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:54:01.175112  7846 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49946 (request call id 6662) took 1167 ms. Trace:
I20260709 14:54:01.175806 14846 raft_consensus.cc:493] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:54:01.175665  7846 rpcz_store.cc:276] 0709 14:54:01.124937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:54:01.174142 (+ 49205us) service_pool.cc:224] Handling call
0709 14:54:01.174481 (+   339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 14:54:01.174680 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 14:54:01.174704 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 14:54:01.174744 (+    40us) raft_consensus.cc:1645] Marking committed up to 13
0709 14:54:01.174787 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 14:54:01.174837 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 14:54:01.174934 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 14:54:01.176625 14846 raft_consensus.cc:515] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:54:01.179539 14846 leader_election.cc:290] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:54:01.186550 14846 raft_consensus.cc:493] T 9ce9c0ef2db24c13a8b1402f21819458 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9418391fa82a42c79c6cad13ba91d964)
I20260709 14:54:01.187161 14846 raft_consensus.cc:515] T 9ce9c0ef2db24c13a8b1402f21819458 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:54:01.190404 14846 leader_election.cc:290] T 9ce9c0ef2db24c13a8b1402f21819458 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68:42321)
I20260709 14:54:01.193910 14847 raft_consensus.cc:493] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:54:01.194787 14847 raft_consensus.cc:515] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:54:01.197306  7893 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111) [suppressed 510 similar messages]
I20260709 14:54:01.203770 14847 leader_election.cc:290] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:54:01.269233  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 64109.3us
W20260709 14:54:01.288717  7893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 91466.9us
I20260709 14:54:01.284462 14846 raft_consensus.cc:493] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:54:01.303107 14846 raft_consensus.cc:515] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:54:01.309430 14851 raft_consensus.cc:493] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:54:01.310266 14851 raft_consensus.cc:515] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:54:01.322896 14850 raft_consensus.cc:493] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:54:01.323804 14850 raft_consensus.cc:515] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:54:01.326380 14850 leader_election.cc:290] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:54:01.370548 14850 raft_consensus.cc:493] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:54:01.408347 14847 raft_consensus.cc:493] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:54:01.409654 14847 raft_consensus.cc:515] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:54:01.412701 14847 leader_election.cc:290] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:54:01.391892 14853 raft_consensus.cc:493] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9418391fa82a42c79c6cad13ba91d964)
I20260709 14:54:01.428122 14848 raft_consensus.cc:493] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:54:01.427757 14853 raft_consensus.cc:515] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:54:01.428915 14848 raft_consensus.cc:515] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:54:01.431015 14853 leader_election.cc:290] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529), 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68:42321)
I20260709 14:54:01.399498 14851 leader_election.cc:290] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:54:01.432760 14846 leader_election.cc:290] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:54:01.434310 14848 leader_election.cc:290] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:54:01.425769 14850 raft_consensus.cc:515] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:54:01.451599  7893 leader_election.cc:336] T 9ce9c0ef2db24c13a8b1402f21819458 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
W20260709 14:54:01.452744  7893 leader_election.cc:336] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
I20260709 14:54:01.461951 14862 raft_consensus.cc:493] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:54:01.462347 14854 raft_consensus.cc:493] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:54:01.463048 14854 raft_consensus.cc:515] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:54:01.462924 14862 raft_consensus.cc:515] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:54:01.461989 14852 raft_consensus.cc:493] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:54:01.466140 14852 raft_consensus.cc:515] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:54:01.467373 14862 leader_election.cc:290] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:54:01.445039 14855 raft_consensus.cc:493] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:54:01.468768 14852 leader_election.cc:290] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:54:01.468549 14855 raft_consensus.cc:515] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:54:01.460844 14866 raft_consensus.cc:493] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:54:01.470237 14854 leader_election.cc:290] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:54:01.474336 14866 raft_consensus.cc:515] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:54:01.478376 14850 leader_election.cc:290] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:54:01.479810 14855 leader_election.cc:290] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:54:01.490077  7893 consensus_peers.cc:597] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 14:54:01.493157  7893 leader_election.cc:336] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
W20260709 14:54:01.501703  7893 leader_election.cc:336] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
W20260709 14:54:01.504714  7893 consensus_peers.cc:597] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 14:54:01.504953 14854 raft_consensus.cc:493] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:54:01.527463 14847 raft_consensus.cc:493] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:54:01.537464 14847 raft_consensus.cc:515] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:54:01.537957 14852 raft_consensus.cc:493] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:54:01.538602 14863 raft_consensus.cc:493] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:54:01.529409 14853 raft_consensus.cc:493] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:54:01.530171 14848 raft_consensus.cc:493] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
W20260709 14:54:01.522444  7893 leader_election.cc:336] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
I20260709 14:54:01.534003 14856 raft_consensus.cc:493] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:54:01.540129 14853 raft_consensus.cc:515] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:54:01.540177 14869 raft_consensus.cc:493] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:54:01.534709 14855 raft_consensus.cc:493] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9418391fa82a42c79c6cad13ba91d964)
I20260709 14:54:01.534929 14871 raft_consensus.cc:493] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:54:01.505520 14846 raft_consensus.cc:493] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:54:01.539248 14863 raft_consensus.cc:515] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:54:01.542560  7893 leader_election.cc:336] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
I20260709 14:54:01.542639 14862 raft_consensus.cc:493] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
W20260709 14:54:01.548565  8598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40587, user_credentials={real_user=slave}} blocked reactor thread for 46009.3us
I20260709 14:54:01.519189 14866 leader_election.cc:290] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:54:01.555078  7893 leader_election.cc:336] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
I20260709 14:54:01.540829 14856 raft_consensus.cc:515] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:54:01.566097  7893 leader_election.cc:336] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
I20260709 14:54:01.559237 14847 leader_election.cc:290] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:54:01.569646 14870 raft_consensus.cc:493] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:54:01.541597 14869 raft_consensus.cc:515] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:54:01.558089 14853 leader_election.cc:290] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:54:01.551088 14845 raft_consensus.cc:493] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:54:01.535666 14854 raft_consensus.cc:515] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:54:01.554885 14848 raft_consensus.cc:515] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:54:01.588933 14864 raft_consensus.cc:493] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:54:01.589900 14864 raft_consensus.cc:515] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:54:01.590871 14854 leader_election.cc:290] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:54:01.557157 14855 raft_consensus.cc:515] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:54:01.559438 14862 raft_consensus.cc:515] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:54:01.594245 14855 leader_election.cc:290] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68:42321)
I20260709 14:54:01.584801 14870 raft_consensus.cc:515] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:54:01.595568 14862 leader_election.cc:290] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:54:01.538833 14852 raft_consensus.cc:515] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:54:01.558233 14871 raft_consensus.cc:515] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:54:01.599735 14865 raft_consensus.cc:493] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:54:01.600406 14865 raft_consensus.cc:515] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:54:01.602341 14848 leader_election.cc:290] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:54:01.604395 14870 leader_election.cc:290] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:54:01.603230 14845 raft_consensus.cc:515] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:54:01.559340 14846 raft_consensus.cc:515] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:54:01.610599 14856 leader_election.cc:290] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:54:01.559074 14863 leader_election.cc:290] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:54:01.603039 14865 leader_election.cc:290] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:54:01.627915  8640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18d29d52d304c87b930d4fb5eaf50b1" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9418391fa82a42c79c6cad13ba91d964" is_pre_election: true
I20260709 14:54:01.616957 14850 raft_consensus.cc:493] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:54:01.631773 14850 raft_consensus.cc:515] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:54:01.632731 14846 leader_election.cc:290] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:54:01.617447 14847 raft_consensus.cc:493] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:54:01.637821 14847 raft_consensus.cc:515] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:54:01.593080 14864 leader_election.cc:290] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:54:01.622855 14854 raft_consensus.cc:493] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:54:01.643393 14854 raft_consensus.cc:515] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:54:01.636946  7893 consensus_peers.cc:597] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 14:54:01.640996 14847 leader_election.cc:290] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:54:01.644734  7893 leader_election.cc:336] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
I20260709 14:54:01.610574 14871 leader_election.cc:290] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:54:01.625643 14855 raft_consensus.cc:493] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:54:01.647974 14845 leader_election.cc:290] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:54:01.649114 14870 raft_consensus.cc:493] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:54:01.649953 14870 raft_consensus.cc:515] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:54:01.650609 14869 leader_election.cc:290] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:54:01.651453 14869 raft_consensus.cc:493] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:54:01.652179 14869 raft_consensus.cc:515] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:54:01.652725 14870 leader_election.cc:290] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:54:01.653475 14870 raft_consensus.cc:493] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:54:01.654532 14870 raft_consensus.cc:515] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:54:01.655706 14850 leader_election.cc:290] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:54:01.656467 14850 raft_consensus.cc:493] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:54:01.656881 14870 leader_election.cc:290] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:54:01.653445 14862 raft_consensus.cc:493] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:54:01.654616 14854 leader_election.cc:290] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:54:01.649884 14852 leader_election.cc:290] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:54:01.661305 14856 raft_consensus.cc:493] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:54:01.663255 14855 raft_consensus.cc:515] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:54:01.645308  7893 leader_election.cc:336] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
I20260709 14:54:01.664143 14877 raft_consensus.cc:493] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:54:01.663884 14871 raft_consensus.cc:493] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:54:01.665067 14869 leader_election.cc:290] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:54:01.671634 14877 raft_consensus.cc:515] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:54:01.671665 14871 raft_consensus.cc:515] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:54:01.666713  8598 consensus_peers.cc:597] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 14:54:01.675911 14877 leader_election.cc:290] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:54:01.658171 14845 raft_consensus.cc:493] T 9441e831627143a991a1556dcdce71e3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9418391fa82a42c79c6cad13ba91d964)
I20260709 14:54:01.677170 14845 raft_consensus.cc:515] T 9441e831627143a991a1556dcdce71e3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "9418391fa82a42c79c6cad13ba91d964" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 42321 } attrs { promote: false } }
I20260709 14:54:01.667009 14878 raft_consensus.cc:493] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
W20260709 14:54:01.678803  7893 leader_election.cc:336] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
I20260709 14:54:01.668534 14862 raft_consensus.cc:515] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:54:01.679227 14878 raft_consensus.cc:515] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:54:01.679994  7893 leader_election.cc:336] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
I20260709 14:54:01.668522 14850 raft_consensus.cc:515] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:54:01.680570  7893 leader_election.cc:336] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
I20260709 14:54:01.681578 14862 leader_election.cc:290] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:54:01.682976 14850 leader_election.cc:290] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:54:01.678498 14855 leader_election.cc:290] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:54:01.682997  7893 leader_election.cc:336] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
I20260709 14:54:01.669682 14856 raft_consensus.cc:515] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:54:01.684602  8640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9441e831627143a991a1556dcdce71e3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9418391fa82a42c79c6cad13ba91d964" is_pre_election: true
I20260709 14:54:01.687996 14865 raft_consensus.cc:493] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:54:01.688814 14865 raft_consensus.cc:515] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:54:01.689996 14845 leader_election.cc:290] T 9441e831627143a991a1556dcdce71e3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 9418391fa82a42c79c6cad13ba91d964 (127.6.101.68:42321)
I20260709 14:54:01.690973 14856 leader_election.cc:290] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:54:01.676024 14871 leader_election.cc:290] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
I20260709 14:54:01.694823  8640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce9c0ef2db24c13a8b1402f21819458" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9418391fa82a42c79c6cad13ba91d964" is_pre_election: true
W20260709 14:54:01.717620  7893 consensus_peers.cc:597] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 14:54:01.720428  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b780b4cd374bdfa269ff8079b90f9c" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:54:01.696305 14864 raft_consensus.cc:493] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:54:01.722441 14864 raft_consensus.cc:515] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:54:01.725122 14864 leader_election.cc:290] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:54:01.697587 14865 leader_election.cc:290] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:54:01.697852  8639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1f7722fdea49e0b5e9c5d96633eaf9" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9418391fa82a42c79c6cad13ba91d964" is_pre_election: true
I20260709 14:54:01.706159 14856 raft_consensus.cc:493] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1e9289592458429bbddb19c2e7b7b7b0)
I20260709 14:54:01.726370 14856 raft_consensus.cc:515] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:54:01.728873 14856 leader_election.cc:290] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:54:01.731808  7893 leader_election.cc:336] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
W20260709 14:54:01.738049  7893 consensus_peers.cc:597] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 14:54:01.738631  7893 consensus_peers.cc:597] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 14:54:01.681553 14878 leader_election.cc:290] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785)
W20260709 14:54:01.739035  7893 leader_election.cc:336] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
W20260709 14:54:01.739612  7893 consensus_peers.cc:597] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 14:54:01.741537  7893 consensus_peers.cc:597] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 14:54:01.742182  7893 consensus_peers.cc:597] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 14:54:01.748275  7853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcde6b5a9614f56b6fee208e40eae0f" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:54:01.748732  7893 leader_election.cc:336] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
W20260709 14:54:01.756265  7893 consensus_peers.cc:597] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 14:54:01.788215 14865 raft_consensus.cc:493] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:54:01.788945 14865 raft_consensus.cc:515] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:54:01.792388 14865 leader_election.cc:290] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:54:01.793861  7891 leader_election.cc:304] T 9ce9c0ef2db24c13a8b1402f21819458 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 9418391fa82a42c79c6cad13ba91d964
I20260709 14:54:01.798517 14865 raft_consensus.cc:2749] T 9ce9c0ef2db24c13a8b1402f21819458 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 14:54:01.801604  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a01e716f85c42fca2d598794aa97828" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:54:01.806449  7893 leader_election.cc:336] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
W20260709 14:54:01.811354  7819 leader_election.cc:336] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
W20260709 14:54:01.812391  7819 leader_election.cc:336] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
W20260709 14:54:01.812896  7819 leader_election.cc:336] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
W20260709 14:54:01.813359  7819 leader_election.cc:336] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
I20260709 14:54:01.816498  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd9bd9309aa456faee5ac298922892e" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:54:01.821146  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813c88ccff4990b3b5d74b18a3e674" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:54:01.822455  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1f7722fdea49e0b5e9c5d96633eaf9" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:54:01.838774  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a766fdd282824a82bd600fc0ffb448ca" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:54:01.840047  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ad41456b24682a1e65d2c804d2956" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:54:01.840930  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8e261558b942c6b42c841689082c10" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:54:01.839929  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63cef01f72446c09b46b48ebbbd714a" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:54:01.842806  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f69c398b243d41308ddd552fcb6b657c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:54:01.847755  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd10baef95c4d73978299974e0dd8f3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:54:01.865828  7819 leader_election.cc:336] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
W20260709 14:54:01.866544  7819 consensus_peers.cc:597] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 14:54:01.873557  7819 leader_election.cc:336] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
W20260709 14:54:01.874138  7819 leader_election.cc:336] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
W20260709 14:54:01.874639  7819 leader_election.cc:336] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
W20260709 14:54:01.875093  7819 leader_election.cc:336] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
W20260709 14:54:01.875556  7819 leader_election.cc:336] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
W20260709 14:54:01.876022  7819 leader_election.cc:336] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
W20260709 14:54:01.876959  7819 leader_election.cc:336] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
W20260709 14:54:01.877653  7819 leader_election.cc:336] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
W20260709 14:54:01.878122  7819 leader_election.cc:336] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
I20260709 14:54:01.878361  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad88b19ba074d7eb419542cddcebb51" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:54:01.878470  7819 leader_election.cc:304] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 9418391fa82a42c79c6cad13ba91d964
I20260709 14:54:01.879803  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c22c68d7d64909bc3be2a12cd51375" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:54:01.880522  7819 leader_election.cc:336] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
W20260709 14:54:01.881011  7819 leader_election.cc:336] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
I20260709 14:54:01.881223 14856 raft_consensus.cc:2749] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 14:54:01.881947  7819 leader_election.cc:336] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
W20260709 14:54:01.883322  7819 leader_election.cc:336] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
W20260709 14:54:01.884189  7819 leader_election.cc:336] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
W20260709 14:54:01.884819  7819 leader_election.cc:336] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
W20260709 14:54:01.885461  7819 leader_election.cc:336] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
W20260709 14:54:01.885915  7819 leader_election.cc:336] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
W20260709 14:54:01.886523  7819 leader_election.cc:336] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
W20260709 14:54:01.886992  7819 leader_election.cc:336] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
W20260709 14:54:01.887753  7819 leader_election.cc:336] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
W20260709 14:54:01.888352  7819 leader_election.cc:336] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
W20260709 14:54:01.888849  7819 leader_election.cc:336] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
W20260709 14:54:01.889331  7819 leader_election.cc:336] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
W20260709 14:54:01.889796  7819 leader_election.cc:336] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
I20260709 14:54:01.889729  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30845430df4f21a2512e25b0b9d0d3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:54:01.891238  7819 leader_election.cc:336] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
W20260709 14:54:01.891800  7819 leader_election.cc:336] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
W20260709 14:54:01.892395  7819 leader_election.cc:336] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
W20260709 14:54:01.892838  7819 leader_election.cc:336] T 9441e831627143a991a1556dcdce71e3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
I20260709 14:54:01.893209  7819 leader_election.cc:304] T 9441e831627143a991a1556dcdce71e3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 9418391fa82a42c79c6cad13ba91d964
I20260709 14:54:01.894006 14878 raft_consensus.cc:2749] T 9441e831627143a991a1556dcdce71e3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 14:54:01.894253  7819 leader_election.cc:336] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
I20260709 14:54:01.895787  7846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e70b78c0514fcda22ba3552f5e82ea" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:54:01.905988  6549 thread.cc:527] Waited for 17000ms trying to join with diag-logger (tid 7800)
I20260709 14:54:01.899893  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e7a6b95b3947cba44740eb2a23e8d9" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:54:01.909864  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7a532d2ca462ab2cdcd681e28661d" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
W20260709 14:54:01.913996  7819 leader_election.cc:336] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
I20260709 14:54:01.917835  7852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c563cc7cfbe4d59be4ffc5cf847ce56" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:54:01.923026  7848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31abe772ad42e78f78a2f1d95bcb16" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:54:01.925405  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45fb2f8502402780de3ab1d9588072" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:54:01.925810  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d1003a47fa4cb19d9050eb07529044" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:54:01.925485  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0d5c36f8664b1382cf3a23a559c621" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:54:01.927765  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46456e760e004d6c8f70251651e0b26b" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:54:01.930740  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f693cee587949c6bde5463f4fd33b01" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:54:01.931317  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789f551efdf242eb9b285eebd8ea0f1a" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:54:01.932821  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f7d5fb59843e0a06107c48f794b4c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:54:01.930727  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b313d3d5be334c0697556ab7c8cabbf3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:54:01.933583  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca9650f2c8c4fe08e77c70ee08f3927" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:54:01.934710  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1707111d8045f2b8c2f219724e133d" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:54:01.935242  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd6df0b766447119ea9e0acb887af01" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:54:01.934134  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e145ae252e8041f9b5ad2dbebcf279c9" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 28 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:54:01.933178  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cacfb5953cb4bf2a7fe431923ead129" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:54:01.935206  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80265d77f70046f997ce9c4fef0a107c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:54:01.939602  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939996e77ee64e9fab21aef50758b706" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:54:01.942795  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "696fba4415c046498d3e10fb37d1a67f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:54:01.944581  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad621bd873f4a429a62f9755f4cc775" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:54:01.945017  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaec8a5f12b648c88c0b0c55c6ac3a92" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:54:01.943833  7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6f5d59057468c923f98279ba0df4f" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:54:01.944216  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4c17373ec546d59a82ce33b6938268" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:54:01.945868  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d50517fdd04953b2868e01a0624afa" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:54:01.946782  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05bb7d6a8bd42fcb27196db96044bb1" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:54:01.947592  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15359084dc6a466ca9280b7e4b63454b" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:54:01.948191  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3288d48c284f02b3b49ffcefea563c" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:54:01.948588  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258d6c2dda954bf5b65930fde8ecb9f3" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:54:01.949183  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30d297a612a4252bdf5eb6aa21c11ff" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:54:01.949501  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1736a0500c6d452ea11b6d10b4034d86" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
W20260709 14:54:01.951191  7819 consensus_peers.cc:597] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 14:54:01.952230  7819 consensus_peers.cc:597] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 14:54:01.952775  7819 consensus_peers.cc:597] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 14:54:01.947997  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a21690c744946b36b3d3baa26d8b6" candidate_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1e9289592458429bbddb19c2e7b7b7b0" is_pre_election: true
I20260709 14:54:01.963060  7894 leader_election.cc:304] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:54:01.964257 14865 raft_consensus.cc:2749] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 14:54:01.969929  7894 leader_election.cc:304] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:54:01.970930 14864 raft_consensus.cc:2749] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 14:54:01.971380  7894 leader_election.cc:304] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:54:01.972311 14864 raft_consensus.cc:2749] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 14:54:01.975808  7894 leader_election.cc:304] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:54:01.976841 14849 raft_consensus.cc:2749] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 14:54:01.978746  7894 leader_election.cc:304] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:54:01.980353  7894 leader_election.cc:304] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 3876b8ee8d744cb18e91d97aae93b1ac, 9418391fa82a42c79c6cad13ba91d964
I20260709 14:54:01.981969  7894 leader_election.cc:304] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:54:01.983326  7894 leader_election.cc:304] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:54:01.984431 14864 raft_consensus.cc:2749] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 14:54:01.985589 14864 raft_consensus.cc:2749] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 14:54:01.986325 14864 raft_consensus.cc:2749] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 14:54:01.987046 14882 raft_consensus.cc:2749] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 14:54:01.992326  7894 leader_election.cc:304] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:54:01.993966 14846 raft_consensus.cc:2749] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 14:54:01.995659  7894 leader_election.cc:304] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:54:01.996703 14846 raft_consensus.cc:2749] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 14:54:01.999670  7894 leader_election.cc:304] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:54:02.001052 14846 raft_consensus.cc:2749] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 14:54:02.003738  7894 leader_election.cc:304] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:54:02.005193 14846 raft_consensus.cc:2749] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 14:54:02.007328  7894 leader_election.cc:304] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:54:02.008400 14846 raft_consensus.cc:2749] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 14:54:02.010509  7894 leader_election.cc:304] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:54:02.011662 14864 raft_consensus.cc:2749] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 14:54:02.014038  7894 leader_election.cc:304] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:54:02.015380 14846 raft_consensus.cc:2749] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 14:54:02.022370  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783e4874513449ef9084b833f188a6d3" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:54:02.027504  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ea45807ea1741b8a66a73294b0f3bb1" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
I20260709 14:54:02.034880  7847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2e94b7532d44c5bad6074beb44b463" candidate_uuid: "1e9289592458429bbddb19c2e7b7b7b0" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" is_pre_election: true
W20260709 14:54:02.048132  7819 consensus_peers.cc:597] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 14:54:02.048880  7819 consensus_peers.cc:597] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 14:54:02.054425  7819 leader_election.cc:304] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:54:02.055377 14878 raft_consensus.cc:2749] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 14:54:02.056916  7819 leader_election.cc:304] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:54:02.057924 14878 raft_consensus.cc:2749] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 14:54:02.059165  7894 leader_election.cc:304] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:54:02.059410  7819 leader_election.cc:304] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:54:02.060268 14846 raft_consensus.cc:2749] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 14:54:02.060369 14878 raft_consensus.cc:2749] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 14:54:02.062292  7819 leader_election.cc:304] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:54:02.063416 14878 raft_consensus.cc:2749] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 14:54:02.064531  7894 leader_election.cc:304] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:54:02.075907 14846 raft_consensus.cc:2749] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 14:54:02.085114  7893 consensus_peers.cc:597] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 14:54:02.086169  7893 consensus_peers.cc:597] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 14:54:02.092875  7819 leader_election.cc:304] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:54:02.096764 14878 raft_consensus.cc:2749] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 14:54:02.105610  7893 consensus_peers.cc:597] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 14:54:02.118002  7819 leader_election.cc:304] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
W20260709 14:54:02.118402  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 54005.3us
I20260709 14:54:02.119784  7894 leader_election.cc:304] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:54:02.121064 14865 raft_consensus.cc:2749] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 14:54:02.126981 14856 raft_consensus.cc:2749] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 14:54:02.127401  7819 leader_election.cc:304] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:54:02.130527 14856 raft_consensus.cc:2749] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 14:54:02.132829  7819 leader_election.cc:304] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
W20260709 14:54:02.127004  7893 consensus_peers.cc:597] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 14:54:02.136226 14856 raft_consensus.cc:2749] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 14:54:02.137981  7819 leader_election.cc:304] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:54:02.144970 14856 raft_consensus.cc:2749] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 14:54:02.148200  7819 leader_election.cc:304] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:54:02.149602 14856 raft_consensus.cc:2749] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 14:54:02.152474  7819 leader_election.cc:304] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:54:02.155496 14856 raft_consensus.cc:2749] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 14:54:02.167279  7819 leader_election.cc:304] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:54:02.168486 14856 raft_consensus.cc:2749] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 14:54:02.172796  7819 leader_election.cc:304] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:54:02.181077 14856 raft_consensus.cc:2749] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 14:54:02.182997  7819 leader_election.cc:304] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:54:02.195894  7819 leader_election.cc:304] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:54:02.198390  7819 leader_election.cc:304] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:54:02.199486 14878 raft_consensus.cc:2749] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 14:54:02.199450 14856 raft_consensus.cc:2749] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 14:54:02.257022  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 58454.4us
I20260709 14:54:02.259423  7819 leader_election.cc:304] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:54:02.264029  7819 leader_election.cc:304] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:54:02.268035  7819 leader_election.cc:304] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:54:02.297760 14845 raft_consensus.cc:2749] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 14:54:02.297962 14871 raft_consensus.cc:2749] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 14:54:02.299616 14871 raft_consensus.cc:2749] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 14:54:02.299523 14845 raft_consensus.cc:2749] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 14:54:02.324327  7819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:40785, user_credentials={real_user=slave}} blocked reactor thread for 56720.6us
I20260709 14:54:02.325773  7819 leader_election.cc:304] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:54:02.327504 14871 raft_consensus.cc:2749] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 14:54:02.345664  7819 leader_election.cc:304] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:54:02.346832 14845 raft_consensus.cc:2749] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 14:54:02.350332  7819 leader_election.cc:304] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
W20260709 14:54:02.359732  7893 consensus_peers.cc:597] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 14:54:02.360790  7893 consensus_peers.cc:597] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 14:54:02.366333 14845 raft_consensus.cc:2749] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 14:54:02.370342  7819 leader_election.cc:304] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:54:02.371528 14845 raft_consensus.cc:2749] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 14:54:02.374341  7819 leader_election.cc:304] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:54:02.375830 14845 raft_consensus.cc:2749] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 14:54:02.384516  7819 leader_election.cc:304] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:54:02.385581 14845 raft_consensus.cc:2749] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 14:54:02.389007  7819 leader_election.cc:304] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
W20260709 14:54:02.389427  7893 consensus_peers.cc:597] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 14:54:02.390198 14845 raft_consensus.cc:2749] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 14:54:02.404595  7819 leader_election.cc:304] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:54:02.413354 14886 raft_consensus.cc:2749] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 14:54:02.421115  7819 leader_election.cc:304] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:54:02.427650 14886 raft_consensus.cc:2749] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 14:54:02.430984  7893 consensus_peers.cc:597] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 14:54:02.431556  7819 leader_election.cc:304] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
W20260709 14:54:02.432513  7893 consensus_peers.cc:597] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 14:54:02.439276 14886 raft_consensus.cc:2749] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 14:54:02.444087  7819 leader_election.cc:304] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
W20260709 14:54:02.445801  7893 consensus_peers.cc:597] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 14:54:02.447926 14886 raft_consensus.cc:2749] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 14:54:02.451558  7819 leader_election.cc:304] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:54:02.452768 14886 raft_consensus.cc:2749] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 14:54:02.455591  7893 consensus_peers.cc:597] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 14:54:02.457975  7819 leader_election.cc:304] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:54:02.459340 14886 raft_consensus.cc:2749] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 14:54:02.464809  7819 leader_election.cc:304] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3876b8ee8d744cb18e91d97aae93b1ac; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 1e9289592458429bbddb19c2e7b7b7b0
I20260709 14:54:02.465952 14886 raft_consensus.cc:2749] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 14:54:02.540236  8598 consensus_peers.cc:597] T 9441e831627143a991a1556dcdce71e3 P 9418391fa82a42c79c6cad13ba91d964 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 14:54:02.542030  7819 consensus_peers.cc:597] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 14:54:02.542965  7819 consensus_peers.cc:597] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 14:54:02.543589  7819 consensus_peers.cc:597] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 14:54:02.563767  7819 consensus_peers.cc:597] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 14:54:02.567736  7819 consensus_peers.cc:597] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 14:54:02.606671  8661 debug-util.cc:398] Leaking SignalData structure 0x7b080032aa60 after lost signal to thread 6552
W20260709 14:54:02.610441  8661 debug-util.cc:398] Leaking SignalData structure 0x7b08002e7620 after lost signal to thread 7711
W20260709 14:54:02.623733  8661 debug-util.cc:398] Leaking SignalData structure 0x7b08000d1d60 after lost signal to thread 7878
W20260709 14:54:02.629428  8661 debug-util.cc:398] Leaking SignalData structure 0x7b0800164e60 after lost signal to thread 7952
W20260709 14:54:02.633898  8661 debug-util.cc:398] Leaking SignalData structure 0x7b080028b480 after lost signal to thread 8664
W20260709 14:54:02.648702  7893 consensus_peers.cc:597] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 14:54:02.667142  7819 consensus_peers.cc:597] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 14:54:02.674854  7893 consensus_peers.cc:597] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 14:54:02.688285  7819 consensus_peers.cc:597] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 14:54:02.708329  7893 consensus_peers.cc:597] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 14:54:02.731249  8598 consensus_peers.cc:597] T 9ce9c0ef2db24c13a8b1402f21819458 P 9418391fa82a42c79c6cad13ba91d964 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 14:54:02.904860  7819 consensus_peers.cc:597] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 14:54:02.906895  6549 thread.cc:527] Waited for 18000ms trying to join with diag-logger (tid 7800)
W20260709 14:54:03.094133  7893 consensus_peers.cc:597] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 14:54:03.112847  7893 consensus_peers.cc:597] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 14:54:03.118405  7893 consensus_peers.cc:597] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 14:54:03.139305  7893 consensus_peers.cc:597] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 14:54:03.163987  7893 consensus_peers.cc:597] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 14:54:03.530287  7819 consensus_peers.cc:597] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 14:54:03.539361  7893 consensus_peers.cc:597] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 14:54:03.567876  7893 consensus_peers.cc:597] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 14:54:03.568830  7893 consensus_peers.cc:597] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 14:54:03.574268  7893 consensus_peers.cc:597] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 14:54:03.582670  7893 consensus_peers.cc:597] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 14:54:03.595109  7819 consensus_peers.cc:597] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 14:54:03.638342  7893 consensus_peers.cc:597] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 14:54:03.681517  7893 consensus_peers.cc:597] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 14:54:03.699591  7893 consensus_peers.cc:597] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 14:54:03.720583  7893 consensus_peers.cc:597] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 14:54:03.744059  7819 consensus_peers.cc:597] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 14:54:03.761736  7893 consensus_peers.cc:597] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 14:54:03.846935  7893 consensus_peers.cc:597] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 14:54:03.907573  6549 thread.cc:527] Waited for 19000ms trying to join with diag-logger (tid 7800)
W20260709 14:54:03.951632  7893 consensus_peers.cc:597] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 14:54:04.070482  7819 consensus_peers.cc:597] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 14:54:04.084245  7894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:34529, user_credentials={real_user=slave}} blocked reactor thread for 44178.7us
W20260709 14:54:04.089180  8598 consensus_peers.cc:597] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 14:54:04.140448  7893 consensus_peers.cc:597] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 14:54:04.189673  7819 consensus_peers.cc:597] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 14:54:04.226773  7893 consensus_peers.cc:597] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 14:54:04.241523  7893 consensus_peers.cc:597] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 14:54:04.316114  7819 consensus_peers.cc:597] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 14:54:04.425678  7893 consensus_peers.cc:597] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 14:54:04.447495  7893 consensus_peers.cc:597] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 14:54:04.459985  7875 debug-util.cc:398] Leaking SignalData structure 0x7b08000d73a0 after lost signal to thread 6552
W20260709 14:54:04.461421  7875 debug-util.cc:398] Leaking SignalData structure 0x7b08001f1160 after lost signal to thread 7711
W20260709 14:54:04.463201  7875 debug-util.cc:398] Leaking SignalData structure 0x7b0800218000 after lost signal to thread 7878
W20260709 14:54:04.465442  7875 debug-util.cc:398] Leaking SignalData structure 0x7b0800347580 after lost signal to thread 7952
W20260709 14:54:04.468284  7875 debug-util.cc:398] Leaking SignalData structure 0x7b08002878a0 after lost signal to thread 8664
W20260709 14:54:04.484365  7819 consensus_peers.cc:597] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 14:54:04.520328  7893 consensus_peers.cc:597] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 14:54:04.521137  7893 consensus_peers.cc:597] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 14:54:04.527249  7893 consensus_peers.cc:597] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 14:54:04.542996  7819 consensus_peers.cc:597] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 14:54:04.598191  7893 consensus_peers.cc:597] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 14:54:04.600925  7893 consensus_peers.cc:597] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 14:54:04.603739  7819 consensus_peers.cc:597] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 14:54:04.666216  7893 consensus_peers.cc:597] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 14:54:04.669157  7819 consensus_peers.cc:597] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 14:54:04.676258  7819 consensus_peers.cc:597] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 14:54:04.707914  7893 consensus_peers.cc:597] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 14:54:04.777051  7893 consensus_peers.cc:597] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 14:54:04.780879  7893 consensus_peers.cc:597] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 14:54:04.785622  7893 consensus_peers.cc:597] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 14:54:04.862838  7893 consensus_peers.cc:597] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 14:54:04.893203  7893 consensus_peers.cc:597] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 14:54:04.926071  7819 consensus_peers.cc:597] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 14:54:05.084661  6549 tablet_server.cc:196] TabletServer@127.6.101.65:0 shutdown complete.
W20260709 14:54:05.101755  7893 consensus_peers.cc:597] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 14:54:05.134867  7819 consensus_peers.cc:597] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 14:54:05.139396  7893 consensus_peers.cc:597] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 14:54:05.154343  7819 consensus_peers.cc:597] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 14:54:05.166996  8598 consensus_peers.cc:597] T 9441e831627143a991a1556dcdce71e3 P 9418391fa82a42c79c6cad13ba91d964 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 14:54:05.180190  7819 consensus_peers.cc:597] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 14:54:05.185166  7819 consensus_peers.cc:597] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 14:54:05.217768  7819 consensus_peers.cc:597] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 14:54:05.260852  7893 consensus_peers.cc:597] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 14:54:05.281961  6549 tablet_server.cc:179] TabletServer@127.6.101.66:0 shutting down...
W20260709 14:54:05.290549  8599 consensus_peers.cc:597] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 -> Peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Couldn't send request to peer 3876b8ee8d744cb18e91d97aae93b1ac. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 14:54:05.315608  7894 consensus_peers.cc:597] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Couldn't send request to peer 3876b8ee8d744cb18e91d97aae93b1ac. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 14:54:05.323791  7894 consensus_peers.cc:597] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Couldn't send request to peer 3876b8ee8d744cb18e91d97aae93b1ac. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 14:54:05.342216  7894 consensus_peers.cc:597] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Couldn't send request to peer 3876b8ee8d744cb18e91d97aae93b1ac. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 14:54:05.345593  7894 consensus_peers.cc:597] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Couldn't send request to peer 3876b8ee8d744cb18e91d97aae93b1ac. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 14:54:05.348841  7894 consensus_peers.cc:597] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Couldn't send request to peer 3876b8ee8d744cb18e91d97aae93b1ac. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:54:05.351102  6549 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 14:54:05.353076  6549 tablet_replica.cc:333] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac: stopping tablet replica
I20260709 14:54:05.354169  6549 raft_consensus.cc:2243] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:05.356406  6549 raft_consensus.cc:2272] T 789f551efdf242eb9b285eebd8ea0f1a P 3876b8ee8d744cb18e91d97aae93b1ac [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:05.359489  6549 tablet_replica.cc:333] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac: stopping tablet replica
I20260709 14:54:05.360329  6549 raft_consensus.cc:2243] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:05.361083  6549 raft_consensus.cc:2272] T ff4c35543cc44c64a939eae4f3e5e258 P 3876b8ee8d744cb18e91d97aae93b1ac [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:05.364410  6549 tablet_replica.cc:333] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac: stopping tablet replica
I20260709 14:54:05.365149  6549 raft_consensus.cc:2243] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 LEADER]: Raft consensus shutting down.
I20260709 14:54:05.366837  6549 raft_consensus.cc:2272] T c05ad41456b24682a1e65d2c804d2956 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:05.369930  6549 tablet_replica.cc:333] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac: stopping tablet replica
I20260709 14:54:05.370959  6549 raft_consensus.cc:2243] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:05.371819  6549 raft_consensus.cc:2272] T 179f6d5364ba445e8eb5aa330b4a0f04 P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:05.375151  6549 tablet_replica.cc:333] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac: stopping tablet replica
I20260709 14:54:05.375967  6549 raft_consensus.cc:2243] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:05.376852  6549 raft_consensus.cc:2272] T 696fba4415c046498d3e10fb37d1a67f P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:05.380264  6549 tablet_replica.cc:333] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac: stopping tablet replica
I20260709 14:54:05.381223  6549 raft_consensus.cc:2243] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:05.382133  6549 raft_consensus.cc:2272] T 1cacfb5953cb4bf2a7fe431923ead129 P 3876b8ee8d744cb18e91d97aae93b1ac [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 14:54:05.383236  7894 consensus_peers.cc:597] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Couldn't send request to peer 3876b8ee8d744cb18e91d97aae93b1ac. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:54:05.385036  6549 tablet_replica.cc:333] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac: stopping tablet replica
I20260709 14:54:05.386368  6549 raft_consensus.cc:2243] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:05.387259  6549 raft_consensus.cc:2272] T 1736a0500c6d452ea11b6d10b4034d86 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 14:54:05.388942  7893 consensus_peers.cc:597] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 14:54:05.390441  7894 consensus_peers.cc:597] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Couldn't send request to peer 3876b8ee8d744cb18e91d97aae93b1ac. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:54:05.390798  6549 tablet_replica.cc:333] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac: stopping tablet replica
I20260709 14:54:05.391886  6549 raft_consensus.cc:2243] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Raft consensus shutting down.
W20260709 14:54:05.392760  7894 consensus_peers.cc:597] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Couldn't send request to peer 3876b8ee8d744cb18e91d97aae93b1ac. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:54:05.393152  6549 raft_consensus.cc:2272] T c6a7a532d2ca462ab2cdcd681e28661d P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 14:54:05.395362  7894 consensus_peers.cc:597] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Couldn't send request to peer 3876b8ee8d744cb18e91d97aae93b1ac. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:54:05.397567  6549 tablet_replica.cc:333] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac: stopping tablet replica
I20260709 14:54:05.398538  6549 raft_consensus.cc:2243] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:05.399381  6549 raft_consensus.cc:2272] T 37d50517fdd04953b2868e01a0624afa P 3876b8ee8d744cb18e91d97aae93b1ac [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:05.401942  6549 tablet_replica.cc:333] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac: stopping tablet replica
I20260709 14:54:05.402729  6549 raft_consensus.cc:2243] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:05.403856  6549 raft_consensus.cc:2272] T a766fdd282824a82bd600fc0ffb448ca P 3876b8ee8d744cb18e91d97aae93b1ac [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:05.407260  6549 tablet_replica.cc:333] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac: stopping tablet replica
I20260709 14:54:05.408838  6549 raft_consensus.cc:2243] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:05.410171  6549 raft_consensus.cc:2272] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:05.413404  6549 tablet_replica.cc:333] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac: stopping tablet replica
W20260709 14:54:05.413632  7894 consensus_peers.cc:597] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Couldn't send request to peer 3876b8ee8d744cb18e91d97aae93b1ac. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:54:05.414176  6549 raft_consensus.cc:2243] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Raft consensus shutting down.
W20260709 14:54:05.414820  7894 consensus_peers.cc:597] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Couldn't send request to peer 3876b8ee8d744cb18e91d97aae93b1ac. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:54:05.414929  6549 raft_consensus.cc:2272] T 7a1707111d8045f2b8c2f219724e133d P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:05.418191  6549 tablet_replica.cc:333] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac: stopping tablet replica
I20260709 14:54:05.419065  6549 raft_consensus.cc:2243] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 LEADER]: Raft consensus shutting down.
I20260709 14:54:05.420389  6549 raft_consensus.cc:2272] T 7ea45807ea1741b8a66a73294b0f3bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:05.424126  6549 tablet_replica.cc:333] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac: stopping tablet replica
I20260709 14:54:05.425113  6549 raft_consensus.cc:2243] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 LEADER]: Raft consensus shutting down.
I20260709 14:54:05.427249  6549 raft_consensus.cc:2272] T d1e70b78c0514fcda22ba3552f5e82ea P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:05.430758  6549 tablet_replica.cc:333] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac: stopping tablet replica
W20260709 14:54:05.431818  7894 consensus_peers.cc:597] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Couldn't send request to peer 3876b8ee8d744cb18e91d97aae93b1ac. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:54:05.431867  6549 raft_consensus.cc:2243] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Raft consensus shutting down.
W20260709 14:54:05.433727  7894 consensus_peers.cc:597] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Couldn't send request to peer 3876b8ee8d744cb18e91d97aae93b1ac. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:54:05.434437  6549 raft_consensus.cc:2272] T 23d1003a47fa4cb19d9050eb07529044 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:05.437824  6549 tablet_replica.cc:333] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac: stopping tablet replica
W20260709 14:54:05.438066  7894 consensus_peers.cc:597] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Couldn't send request to peer 3876b8ee8d744cb18e91d97aae93b1ac. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:54:05.439263  6549 raft_consensus.cc:2243] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 LEADER]: Raft consensus shutting down.
I20260709 14:54:05.440728  6549 raft_consensus.cc:2272] T 6d2e94b7532d44c5bad6074beb44b463 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 14:54:05.442368  7894 consensus_peers.cc:597] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Couldn't send request to peer 3876b8ee8d744cb18e91d97aae93b1ac. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:54:05.445003  6549 tablet_replica.cc:333] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac: stopping tablet replica
I20260709 14:54:05.446677  6549 raft_consensus.cc:2243] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:05.447656  6549 raft_consensus.cc:2272] T 4ce6f5d59057468c923f98279ba0df4f P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:05.450232  6549 tablet_replica.cc:333] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac: stopping tablet replica
I20260709 14:54:05.450986  6549 raft_consensus.cc:2243] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 LEADER]: Raft consensus shutting down.
I20260709 14:54:05.452159  6549 raft_consensus.cc:2272] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:05.455291  6549 tablet_replica.cc:333] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac: stopping tablet replica
I20260709 14:54:05.456717  6549 raft_consensus.cc:2243] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:05.457480  6549 raft_consensus.cc:2272] T b30d297a612a4252bdf5eb6aa21c11ff P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:05.459841  6549 tablet_replica.cc:333] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac: stopping tablet replica
I20260709 14:54:05.460765  6549 raft_consensus.cc:2243] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:05.461525  6549 raft_consensus.cc:2272] T d90f7d5fb59843e0a06107c48f794b4c P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:05.464200  6549 tablet_replica.cc:333] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac: stopping tablet replica
I20260709 14:54:05.464924  6549 raft_consensus.cc:2243] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 LEADER]: Raft consensus shutting down.
I20260709 14:54:05.466715  6549 raft_consensus.cc:2272] T 783e4874513449ef9084b833f188a6d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:05.469331  6549 tablet_replica.cc:333] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac: stopping tablet replica
I20260709 14:54:05.470113  6549 raft_consensus.cc:2243] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:05.471114  6549 raft_consensus.cc:2272] T e145ae252e8041f9b5ad2dbebcf279c9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:05.474436  6549 tablet_replica.cc:333] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac: stopping tablet replica
I20260709 14:54:05.475267  6549 raft_consensus.cc:2243] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:05.475955  6549 raft_consensus.cc:2272] T 6c3288d48c284f02b3b49ffcefea563c P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:05.479413  6549 tablet_replica.cc:333] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac: stopping tablet replica
I20260709 14:54:05.480158  6549 raft_consensus.cc:2243] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:05.480927  6549 raft_consensus.cc:2272] T 0ad621bd873f4a429a62f9755f4cc775 P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:05.484337  6549 tablet_replica.cc:333] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac: stopping tablet replica
W20260709 14:54:05.484462  7894 consensus_peers.cc:597] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Couldn't send request to peer 3876b8ee8d744cb18e91d97aae93b1ac. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:54:05.485055  6549 raft_consensus.cc:2243] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:05.486433  6549 raft_consensus.cc:2272] T f69c398b243d41308ddd552fcb6b657c P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:05.489049  6549 tablet_replica.cc:333] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac: stopping tablet replica
I20260709 14:54:05.489868  6549 raft_consensus.cc:2243] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:05.490644  6549 raft_consensus.cc:2272] T 787a21690c744946b36b3d3baa26d8b6 P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 14:54:05.491298  7893 consensus_peers.cc:597] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 14:54:05.493556  6549 tablet_replica.cc:333] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac: stopping tablet replica
I20260709 14:54:05.494611  6549 raft_consensus.cc:2243] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:05.495347  6549 raft_consensus.cc:2272] T 7a4c17373ec546d59a82ce33b6938268 P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:05.499010  6549 tablet_replica.cc:333] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac: stopping tablet replica
I20260709 14:54:05.499954  6549 raft_consensus.cc:2243] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 LEADER]: Raft consensus shutting down.
I20260709 14:54:05.501096  6549 raft_consensus.cc:2272] T 3dcde6b5a9614f56b6fee208e40eae0f P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:05.504559  6549 tablet_replica.cc:333] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac: stopping tablet replica
W20260709 14:54:05.505153  8599 consensus_peers.cc:597] T 9441e831627143a991a1556dcdce71e3 P 9418391fa82a42c79c6cad13ba91d964 -> Peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Couldn't send request to peer 3876b8ee8d744cb18e91d97aae93b1ac. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:54:05.505581  6549 raft_consensus.cc:2243] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:05.506567  6549 raft_consensus.cc:2272] T af383cb6c2e843c593c3d86266ffdfdf P 3876b8ee8d744cb18e91d97aae93b1ac [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 14:54:05.508602  7893 consensus_peers.cc:597] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 14:54:05.509562  6549 tablet_replica.cc:333] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac: stopping tablet replica
I20260709 14:54:05.510352  6549 raft_consensus.cc:2243] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 22 LEADER]: Raft consensus shutting down.
I20260709 14:54:05.511966  6549 raft_consensus.cc:2272] T 94c22c68d7d64909bc3be2a12cd51375 P 3876b8ee8d744cb18e91d97aae93b1ac [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:05.514950  6549 tablet_replica.cc:333] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac: stopping tablet replica
I20260709 14:54:05.515720  6549 raft_consensus.cc:2243] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:05.516342  6549 raft_consensus.cc:2272] T 46456e760e004d6c8f70251651e0b26b P 3876b8ee8d744cb18e91d97aae93b1ac [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:05.519300  6549 tablet_replica.cc:333] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac: stopping tablet replica
I20260709 14:54:05.520087  6549 raft_consensus.cc:2243] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:05.520946  6549 raft_consensus.cc:2272] T 80265d77f70046f997ce9c4fef0a107c P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:05.525933  6549 tablet_replica.cc:333] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac: stopping tablet replica
I20260709 14:54:05.527093  6549 raft_consensus.cc:2243] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:05.527851  6549 raft_consensus.cc:2272] T 15359084dc6a466ca9280b7e4b63454b P 3876b8ee8d744cb18e91d97aae93b1ac [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:05.530833  6549 tablet_replica.cc:333] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac: stopping tablet replica
I20260709 14:54:05.531605  6549 raft_consensus.cc:2243] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:05.533056  6549 raft_consensus.cc:2272] T a7960f2a6dc94357a722fa1a67e8383c P 3876b8ee8d744cb18e91d97aae93b1ac [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:05.536207  6549 tablet_replica.cc:333] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac: stopping tablet replica
I20260709 14:54:05.537098  6549 raft_consensus.cc:2243] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:05.538226  6549 raft_consensus.cc:2272] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 3876b8ee8d744cb18e91d97aae93b1ac [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:05.541450  6549 tablet_replica.cc:333] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac: stopping tablet replica
I20260709 14:54:05.542507  6549 raft_consensus.cc:2243] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 LEADER]: Raft consensus shutting down.
I20260709 14:54:05.543615  6549 raft_consensus.cc:2272] T 5ad88b19ba074d7eb419542cddcebb51 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:05.546188  6549 tablet_replica.cc:333] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac: stopping tablet replica
I20260709 14:54:05.547043  6549 raft_consensus.cc:2243] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:05.547715  6549 raft_consensus.cc:2272] T 6f693cee587949c6bde5463f4fd33b01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:05.550575  6549 tablet_replica.cc:333] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac: stopping tablet replica
I20260709 14:54:05.551344  6549 raft_consensus.cc:2243] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 LEADER]: Raft consensus shutting down.
W20260709 14:54:05.551548  7894 consensus_peers.cc:597] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Couldn't send request to peer 3876b8ee8d744cb18e91d97aae93b1ac. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:54:05.552791  6549 raft_consensus.cc:2272] T abd9bd9309aa456faee5ac298922892e P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:05.556038  6549 tablet_replica.cc:333] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 3876b8ee8d744cb18e91d97aae93b1ac: stopping tablet replica
I20260709 14:54:05.556932  6549 raft_consensus.cc:2243] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:05.557876  6549 raft_consensus.cc:2272] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 14:54:05.557956  7893 consensus_peers.cc:597] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 14:54:05.560556  6549 tablet_replica.cc:333] T 9441e831627143a991a1556dcdce71e3 P 3876b8ee8d744cb18e91d97aae93b1ac: stopping tablet replica
I20260709 14:54:05.561681  6549 raft_consensus.cc:2243] T 9441e831627143a991a1556dcdce71e3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:05.562533  6549 raft_consensus.cc:2272] T 9441e831627143a991a1556dcdce71e3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:05.566085  6549 tablet_replica.cc:333] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac: stopping tablet replica
I20260709 14:54:05.567444  6549 raft_consensus.cc:2243] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:05.568361  6549 raft_consensus.cc:2272] T 6d0d5c36f8664b1382cf3a23a559c621 P 3876b8ee8d744cb18e91d97aae93b1ac [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:05.571909  6549 tablet_replica.cc:333] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac: stopping tablet replica
W20260709 14:54:05.572474  8598 consensus_peers.cc:597] T 9ce9c0ef2db24c13a8b1402f21819458 P 9418391fa82a42c79c6cad13ba91d964 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 14:54:05.572754  6549 raft_consensus.cc:2243] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:05.574021  6549 raft_consensus.cc:2272] T 7d45fb2f8502402780de3ab1d9588072 P 3876b8ee8d744cb18e91d97aae93b1ac [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:05.578612  6549 tablet_replica.cc:333] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac: stopping tablet replica
I20260709 14:54:05.579594  6549 raft_consensus.cc:2243] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 25 LEADER]: Raft consensus shutting down.
I20260709 14:54:05.580771  6549 raft_consensus.cc:2272] T f0813c88ccff4990b3b5d74b18a3e674 P 3876b8ee8d744cb18e91d97aae93b1ac [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:05.584256  6549 tablet_replica.cc:333] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac: stopping tablet replica
I20260709 14:54:05.585358  6549 raft_consensus.cc:2243] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 LEADER]: Raft consensus shutting down.
W20260709 14:54:05.586473  7894 consensus_peers.cc:597] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Couldn't send request to peer 3876b8ee8d744cb18e91d97aae93b1ac. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:54:05.586859  6549 raft_consensus.cc:2272] T 9fd10baef95c4d73978299974e0dd8f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:05.590899  6549 tablet_replica.cc:333] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac: stopping tablet replica
I20260709 14:54:05.591746  6549 raft_consensus.cc:2243] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Raft consensus shutting down.
W20260709 14:54:05.592293  8599 consensus_peers.cc:597] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 9418391fa82a42c79c6cad13ba91d964 -> Peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Couldn't send request to peer 3876b8ee8d744cb18e91d97aae93b1ac. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:54:05.593133  6549 raft_consensus.cc:2272] T 9cd6df0b766447119ea9e0acb887af01 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:05.596175  6549 tablet_replica.cc:333] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac: stopping tablet replica
I20260709 14:54:05.597190  6549 raft_consensus.cc:2243] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:05.598399  6549 raft_consensus.cc:2272] T 4c5a5f4d6980405d99119f2f2e97df2f P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:05.602059  6549 tablet_replica.cc:333] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac: stopping tablet replica
I20260709 14:54:05.603034  6549 raft_consensus.cc:2243] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 LEADER]: Raft consensus shutting down.
I20260709 14:54:05.604607  6549 raft_consensus.cc:2272] T fd30845430df4f21a2512e25b0b9d0d3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:05.607918  6549 tablet_replica.cc:333] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac: stopping tablet replica
W20260709 14:54:05.608394  7894 consensus_peers.cc:597] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Couldn't send request to peer 3876b8ee8d744cb18e91d97aae93b1ac. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:54:05.608873  6549 raft_consensus.cc:2243] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 LEADER]: Raft consensus shutting down.
W20260709 14:54:05.609606  7894 consensus_peers.cc:597] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Couldn't send request to peer 3876b8ee8d744cb18e91d97aae93b1ac. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:54:05.610219  6549 raft_consensus.cc:2272] T 3a01e716f85c42fca2d598794aa97828 P 3876b8ee8d744cb18e91d97aae93b1ac [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:05.613963  6549 tablet_replica.cc:333] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac: stopping tablet replica
I20260709 14:54:05.614920  6549 raft_consensus.cc:2243] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:05.615918  6549 raft_consensus.cc:2272] T a18d29d52d304c87b930d4fb5eaf50b1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 14:54:05.617635  7894 consensus_peers.cc:597] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Couldn't send request to peer 3876b8ee8d744cb18e91d97aae93b1ac. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:54:05.619511  6549 tablet_replica.cc:333] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac: stopping tablet replica
I20260709 14:54:05.620608  6549 raft_consensus.cc:2243] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 LEADER]: Raft consensus shutting down.
I20260709 14:54:05.622128  6549 raft_consensus.cc:2272] T c1e7a6b95b3947cba44740eb2a23e8d9 P 3876b8ee8d744cb18e91d97aae93b1ac [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:05.625393  6549 tablet_replica.cc:333] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac: stopping tablet replica
I20260709 14:54:05.626252  6549 raft_consensus.cc:2243] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:05.627230  6549 raft_consensus.cc:2272] T c05bb7d6a8bd42fcb27196db96044bb1 P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:05.629894  6549 tablet_replica.cc:333] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac: stopping tablet replica
I20260709 14:54:05.630635  6549 raft_consensus.cc:2243] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:05.631440  6549 raft_consensus.cc:2272] T 258d6c2dda954bf5b65930fde8ecb9f3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:05.635269  6549 tablet_replica.cc:333] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac: stopping tablet replica
I20260709 14:54:05.636466  6549 raft_consensus.cc:2243] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 LEADER]: Raft consensus shutting down.
I20260709 14:54:05.638698  6549 raft_consensus.cc:2272] T f8b780b4cd374bdfa269ff8079b90f9c P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:05.642400  6549 tablet_replica.cc:333] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac: stopping tablet replica
W20260709 14:54:05.642344  7894 consensus_peers.cc:597] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Couldn't send request to peer 3876b8ee8d744cb18e91d97aae93b1ac. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:54:05.643555  6549 raft_consensus.cc:2243] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 22 FOLLOWER]: Raft consensus shutting down.
W20260709 14:54:05.643954  7894 consensus_peers.cc:597] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Couldn't send request to peer 3876b8ee8d744cb18e91d97aae93b1ac. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:54:05.644826  6549 raft_consensus.cc:2272] T 939996e77ee64e9fab21aef50758b706 P 3876b8ee8d744cb18e91d97aae93b1ac [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:05.648602  6549 tablet_replica.cc:333] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac: stopping tablet replica
W20260709 14:54:05.648423  7894 consensus_peers.cc:597] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Couldn't send request to peer 3876b8ee8d744cb18e91d97aae93b1ac. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:54:05.649626  6549 raft_consensus.cc:2243] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 LEADER]: Raft consensus shutting down.
I20260709 14:54:05.651365  6549 raft_consensus.cc:2272] T 5a31abe772ad42e78f78a2f1d95bcb16 P 3876b8ee8d744cb18e91d97aae93b1ac [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:05.654418  6549 tablet_replica.cc:333] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac: stopping tablet replica
I20260709 14:54:05.655169  6549 raft_consensus.cc:2243] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:05.656204  6549 raft_consensus.cc:2272] T ad8e261558b942c6b42c841689082c10 P 3876b8ee8d744cb18e91d97aae93b1ac [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:05.659606  6549 tablet_replica.cc:333] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac: stopping tablet replica
I20260709 14:54:05.660457  6549 raft_consensus.cc:2243] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:05.661738  6549 raft_consensus.cc:2272] T b313d3d5be334c0697556ab7c8cabbf3 P 3876b8ee8d744cb18e91d97aae93b1ac [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:05.665443  6549 tablet_replica.cc:333] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac: stopping tablet replica
I20260709 14:54:05.666626  6549 raft_consensus.cc:2243] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:05.668855  6549 raft_consensus.cc:2272] T e63cef01f72446c09b46b48ebbbd714a P 3876b8ee8d744cb18e91d97aae93b1ac [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 14:54:05.669917  7894 consensus_peers.cc:597] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Couldn't send request to peer 3876b8ee8d744cb18e91d97aae93b1ac. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 14:54:05.671459  7894 consensus_peers.cc:597] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Couldn't send request to peer 3876b8ee8d744cb18e91d97aae93b1ac. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 14:54:05.674011  7894 consensus_peers.cc:597] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Couldn't send request to peer 3876b8ee8d744cb18e91d97aae93b1ac. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 14:54:05.696511  7894 consensus_peers.cc:597] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Couldn't send request to peer 3876b8ee8d744cb18e91d97aae93b1ac. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 14:54:05.701906  7894 consensus_peers.cc:597] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Couldn't send request to peer 3876b8ee8d744cb18e91d97aae93b1ac. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 14:54:05.728171  7894 consensus_peers.cc:597] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Couldn't send request to peer 3876b8ee8d744cb18e91d97aae93b1ac. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 14:54:05.729777  7894 consensus_peers.cc:597] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Couldn't send request to peer 3876b8ee8d744cb18e91d97aae93b1ac. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 14:54:05.737792  7893 consensus_peers.cc:597] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 14:54:05.740865  7894 consensus_peers.cc:597] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Couldn't send request to peer 3876b8ee8d744cb18e91d97aae93b1ac. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 14:54:05.745684  7894 consensus_peers.cc:597] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Couldn't send request to peer 3876b8ee8d744cb18e91d97aae93b1ac. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 14:54:05.748461  7894 consensus_peers.cc:597] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Couldn't send request to peer 3876b8ee8d744cb18e91d97aae93b1ac. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 14:54:05.767846  7894 consensus_peers.cc:597] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Couldn't send request to peer 3876b8ee8d744cb18e91d97aae93b1ac. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 14:54:05.789726  7893 consensus_peers.cc:597] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 14:54:05.824664  7894 consensus_peers.cc:597] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Couldn't send request to peer 3876b8ee8d744cb18e91d97aae93b1ac. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.66:34529: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 14:54:05.827934  7894 consensus_peers.cc:597] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Couldn't send request to peer 3876b8ee8d744cb18e91d97aae93b1ac. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.66:34529: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 14:54:05.855274  7893 consensus_peers.cc:597] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 14:54:05.881825  7894 consensus_peers.cc:597] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Couldn't send request to peer 3876b8ee8d744cb18e91d97aae93b1ac. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.66:34529: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 14:54:05.929836  7893 consensus_peers.cc:597] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 14:54:06.041929  7893 consensus_peers.cc:597] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 14:54:06.156296  7893 consensus_peers.cc:597] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 14:54:06.197427  7893 consensus_peers.cc:597] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 14:54:06.197991  7893 consensus_peers.cc:597] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 14:54:06.198365  7893 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111) [suppressed 665 similar messages]
W20260709 14:54:06.233496  7893 consensus_peers.cc:597] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 14:54:06.261597  7893 consensus_peers.cc:597] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 14:54:06.267134  7893 consensus_peers.cc:597] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 14:54:06.286674  7893 consensus_peers.cc:597] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 14:54:06.327072  7893 consensus_peers.cc:597] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 14:54:06.396236  7893 consensus_peers.cc:597] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 14:54:06.460372 14905 raft_consensus.cc:493] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:54:06.461126 14905 raft_consensus.cc:515] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:54:06.464133 14905 leader_election.cc:290] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:54:06.467725  7893 leader_election.cc:336] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
W20260709 14:54:06.469175  7894 leader_election.cc:336] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Network error: Client connection negotiation failed: client connection to 127.6.101.66:34529: connect: Connection refused (error 111)
I20260709 14:54:06.469679  7894 leader_election.cc:304] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:54:06.470440 14906 raft_consensus.cc:2749] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 14:54:06.545828 14906 raft_consensus.cc:493] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:54:06.546515 14906 raft_consensus.cc:515] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:54:06.549131 14906 leader_election.cc:290] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:54:06.552772  7893 leader_election.cc:336] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
W20260709 14:54:06.555215  7894 leader_election.cc:336] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Network error: Client connection negotiation failed: client connection to 127.6.101.66:34529: connect: Connection refused (error 111)
I20260709 14:54:06.555816  7894 leader_election.cc:304] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:54:06.556806 14906 raft_consensus.cc:2749] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 14:54:06.615686 14905 raft_consensus.cc:493] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:54:06.616415 14905 raft_consensus.cc:515] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:54:06.621843 14905 leader_election.cc:290] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:54:06.627256  7894 leader_election.cc:336] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Network error: Client connection negotiation failed: client connection to 127.6.101.66:34529: connect: Connection refused (error 111)
W20260709 14:54:06.627954  7893 leader_election.cc:336] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
I20260709 14:54:06.628402  7893 leader_election.cc:304] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:54:06.629074 14906 raft_consensus.cc:2749] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 14:54:06.666493 14906 raft_consensus.cc:493] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:54:06.667215 14906 raft_consensus.cc:515] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:54:06.669930 14906 leader_election.cc:290] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:54:06.679517 14906 raft_consensus.cc:493] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:54:06.680251 14906 raft_consensus.cc:515] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:54:06.683284 14906 leader_election.cc:290] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:54:06.685840  7893 leader_election.cc:336] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
W20260709 14:54:06.686406  7894 leader_election.cc:336] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Network error: Client connection negotiation failed: client connection to 127.6.101.66:34529: connect: Connection refused (error 111)
I20260709 14:54:06.687319  7894 leader_election.cc:304] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:54:06.689085 14905 raft_consensus.cc:2749] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 14:54:06.692730  7893 leader_election.cc:336] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
W20260709 14:54:06.695497  7894 leader_election.cc:336] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Network error: Client connection negotiation failed: client connection to 127.6.101.66:34529: connect: Connection refused (error 111)
I20260709 14:54:06.696033  7894 leader_election.cc:304] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:54:06.697095 14905 raft_consensus.cc:2749] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 14:54:06.697846 14906 raft_consensus.cc:493] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:54:06.698606 14906 raft_consensus.cc:515] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:54:06.701468 14906 leader_election.cc:290] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:54:06.709609  7893 leader_election.cc:336] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
I20260709 14:54:06.710701 14906 raft_consensus.cc:493] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:54:06.711264 14906 raft_consensus.cc:515] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:54:06.713654 14906 leader_election.cc:290] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:54:06.714347  7894 leader_election.cc:336] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Network error: Client connection negotiation failed: client connection to 127.6.101.66:34529: connect: Connection refused (error 111)
I20260709 14:54:06.714757  7894 leader_election.cc:304] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:54:06.716282 14906 raft_consensus.cc:2749] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 14:54:06.718559  7893 leader_election.cc:336] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
W20260709 14:54:06.721753  7894 leader_election.cc:336] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Network error: Client connection negotiation failed: client connection to 127.6.101.66:34529: connect: Connection refused (error 111)
I20260709 14:54:06.722486  7894 leader_election.cc:304] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:54:06.723309 14906 raft_consensus.cc:2749] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 14:54:06.743393  8598 consensus_peers.cc:597] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 14:54:06.780886  7893 consensus_peers.cc:597] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 14:54:06.780910  6549 tablet_server.cc:196] TabletServer@127.6.101.66:0 shutdown complete.
I20260709 14:54:06.789561 14906 raft_consensus.cc:493] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:54:06.790195 14906 raft_consensus.cc:515] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:54:06.792464 14906 leader_election.cc:290] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:54:06.797776  7893 leader_election.cc:336] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
W20260709 14:54:06.799553  7894 leader_election.cc:336] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Network error: Client connection negotiation failed: client connection to 127.6.101.66:34529: connect: Connection refused (error 111)
I20260709 14:54:06.800120  7894 leader_election.cc:304] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:54:06.801177 14906 raft_consensus.cc:2749] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 14:54:06.824986 14906 raft_consensus.cc:493] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:54:06.825865 14906 raft_consensus.cc:515] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:54:06.828540 14906 leader_election.cc:290] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:54:06.835821  7894 leader_election.cc:336] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Network error: Client connection negotiation failed: client connection to 127.6.101.66:34529: connect: Connection refused (error 111)
W20260709 14:54:06.836676  7893 leader_election.cc:336] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
I20260709 14:54:06.838105  7893 leader_election.cc:304] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:54:06.839190 14906 raft_consensus.cc:2749] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 14:54:06.852876 14906 raft_consensus.cc:493] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:54:06.852869 14899 raft_consensus.cc:493] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:54:06.853981 14906 raft_consensus.cc:515] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:54:06.854235 14899 raft_consensus.cc:515] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:54:06.858649 14906 leader_election.cc:290] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:54:06.860031 14899 leader_election.cc:290] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:54:06.863039  7893 leader_election.cc:336] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
W20260709 14:54:06.863606  7893 leader_election.cc:336] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
W20260709 14:54:06.868637  7894 leader_election.cc:336] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Network error: Client connection negotiation failed: client connection to 127.6.101.66:34529: connect: Connection refused (error 111)
I20260709 14:54:06.869333  7894 leader_election.cc:304] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:54:06.871106 14906 raft_consensus.cc:2749] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 14:54:06.872182  7894 leader_election.cc:336] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Network error: Client connection negotiation failed: client connection to 127.6.101.66:34529: connect: Connection refused (error 111)
I20260709 14:54:06.873037  7894 leader_election.cc:304] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:54:06.875468 14906 raft_consensus.cc:2749] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 14:54:06.906669 14899 raft_consensus.cc:493] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:54:06.907325 14899 raft_consensus.cc:515] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:54:06.910617 14899 leader_election.cc:290] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:54:06.912837  7893 consensus_peers.cc:597] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 14:54:06.919003  7893 leader_election.cc:336] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
I20260709 14:54:06.924786 14899 raft_consensus.cc:493] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
W20260709 14:54:06.926476  7894 leader_election.cc:336] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Network error: Client connection negotiation failed: client connection to 127.6.101.66:34529: connect: Connection refused (error 111)
I20260709 14:54:06.927433  7894 leader_election.cc:304] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:54:06.925679 14899 raft_consensus.cc:515] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
W20260709 14:54:06.929090  7893 consensus_peers.cc:597] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 14:54:06.930212 14906 raft_consensus.cc:2749] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 14:54:06.932224 14899 leader_election.cc:290] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:54:06.939867  7893 leader_election.cc:336] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
W20260709 14:54:06.941273  7894 leader_election.cc:336] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Network error: Client connection negotiation failed: client connection to 127.6.101.66:34529: connect: Connection refused (error 111)
I20260709 14:54:06.941979  7894 leader_election.cc:304] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:54:06.942896 14899 raft_consensus.cc:2749] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 14:54:06.946504  6549 tablet_server.cc:179] TabletServer@127.6.101.67:0 shutting down...
I20260709 14:54:06.982177 14905 raft_consensus.cc:493] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:54:06.983060 14905 raft_consensus.cc:515] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:54:06.986323 14905 leader_election.cc:290] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:54:06.992359  7894 leader_election.cc:336] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Network error: Client connection negotiation failed: client connection to 127.6.101.66:34529: connect: Connection refused (error 111)
W20260709 14:54:06.993441  7893 leader_election.cc:336] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
I20260709 14:54:06.993875  7893 leader_election.cc:304] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:54:06.994558 14905 raft_consensus.cc:2749] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 14:54:06.999812 14906 raft_consensus.cc:493] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:54:07.000986 14906 raft_consensus.cc:515] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:54:07.003542 14906 leader_election.cc:290] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
W20260709 14:54:07.007922  7893 consensus_peers.cc:597] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 14:54:07.008436  7894 leader_election.cc:336] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Network error: Client connection negotiation failed: client connection to 127.6.101.66:34529: connect: Connection refused (error 111)
W20260709 14:54:07.009140  7893 leader_election.cc:336] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
I20260709 14:54:07.009796  7893 leader_election.cc:304] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:54:07.010717 14906 raft_consensus.cc:2749] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 14:54:07.018436  7893 consensus_peers.cc:597] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 14:54:07.025655 14906 raft_consensus.cc:493] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:54:07.026225 14906 raft_consensus.cc:515] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:54:07.026860  6549 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 14:54:07.028204  6549 tablet_replica.cc:333] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0: stopping tablet replica
I20260709 14:54:07.028398 14906 leader_election.cc:290] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:54:07.029497  6549 raft_consensus.cc:2243] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 23 LEADER]: Raft consensus shutting down.
I20260709 14:54:07.030977  6549 raft_consensus.cc:2272] T ff4c35543cc44c64a939eae4f3e5e258 P 1e9289592458429bbddb19c2e7b7b7b0 [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 14:54:07.033118  7893 leader_election.cc:336] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
I20260709 14:54:07.034508  6549 tablet_replica.cc:333] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0: stopping tablet replica
I20260709 14:54:07.035481  6549 raft_consensus.cc:2243] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 26 LEADER]: Raft consensus shutting down.
I20260709 14:54:07.036880  6549 raft_consensus.cc:2272] T 789f551efdf242eb9b285eebd8ea0f1a P 1e9289592458429bbddb19c2e7b7b7b0 [term 26 FOLLOWER]: Raft consensus is shut down!
W20260709 14:54:07.037094  7894 leader_election.cc:336] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Network error: Client connection negotiation failed: client connection to 127.6.101.66:34529: connect: Connection refused (error 111)
I20260709 14:54:07.037621  7894 leader_election.cc:304] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:54:07.038344 14905 raft_consensus.cc:2749] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 14:54:07.039721  6549 tablet_replica.cc:333] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0: stopping tablet replica
I20260709 14:54:07.040547  6549 raft_consensus.cc:2243] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 LEADER]: Raft consensus shutting down.
I20260709 14:54:07.041745  6549 raft_consensus.cc:2272] T 1736a0500c6d452ea11b6d10b4034d86 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:07.044651  6549 tablet_replica.cc:333] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0: stopping tablet replica
I20260709 14:54:07.045598  6549 raft_consensus.cc:2243] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 LEADER]: Raft consensus shutting down.
I20260709 14:54:07.046761  6549 raft_consensus.cc:2272] T c6a7a532d2ca462ab2cdcd681e28661d P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 14:54:07.048077  7893 consensus_peers.cc:597] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 14:54:07.049834  6549 tablet_replica.cc:333] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0: stopping tablet replica
I20260709 14:54:07.051029  6549 raft_consensus.cc:2243] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 22 LEADER]: Raft consensus shutting down.
I20260709 14:54:07.052461  6549 raft_consensus.cc:2272] T 37d50517fdd04953b2868e01a0624afa P 1e9289592458429bbddb19c2e7b7b7b0 [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 14:54:07.052842  7893 consensus_peers.cc:597] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 14:54:07.055344  6549 tablet_replica.cc:333] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0: stopping tablet replica
I20260709 14:54:07.056236  6549 raft_consensus.cc:2243] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:07.056793  6549 raft_consensus.cc:2272] T c05ad41456b24682a1e65d2c804d2956 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 14:54:07.059091  7893 consensus_peers.cc:597] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 14:54:07.059224  6549 tablet_replica.cc:333] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0: stopping tablet replica
I20260709 14:54:07.059994  6549 raft_consensus.cc:2243] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 LEADER]: Raft consensus shutting down.
I20260709 14:54:07.061070  6549 raft_consensus.cc:2272] T 179f6d5364ba445e8eb5aa330b4a0f04 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:07.064170  6549 tablet_replica.cc:333] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0: stopping tablet replica
I20260709 14:54:07.065160  6549 raft_consensus.cc:2243] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 LEADER]: Raft consensus shutting down.
W20260709 14:54:07.066249  8598 consensus_peers.cc:597] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 9418391fa82a42c79c6cad13ba91d964 -> Peer 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785): Couldn't send request to peer 1e9289592458429bbddb19c2e7b7b7b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:54:07.066540  6549 raft_consensus.cc:2272] T 696fba4415c046498d3e10fb37d1a67f P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:07.070399  6549 tablet_replica.cc:333] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0: stopping tablet replica
I20260709 14:54:07.071350  6549 raft_consensus.cc:2243] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 26 LEADER]: Raft consensus shutting down.
I20260709 14:54:07.072751  6549 raft_consensus.cc:2272] T a766fdd282824a82bd600fc0ffb448ca P 1e9289592458429bbddb19c2e7b7b7b0 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:07.075234  6549 tablet_replica.cc:333] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0: stopping tablet replica
I20260709 14:54:07.075981  6549 raft_consensus.cc:2243] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 23 LEADER]: Raft consensus shutting down.
I20260709 14:54:07.077234  6549 raft_consensus.cc:2272] T 1cacfb5953cb4bf2a7fe431923ead129 P 1e9289592458429bbddb19c2e7b7b7b0 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:07.080022  6549 tablet_replica.cc:333] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0: stopping tablet replica
I20260709 14:54:07.080861  6549 raft_consensus.cc:2243] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 LEADER]: Raft consensus shutting down.
I20260709 14:54:07.082144  6549 raft_consensus.cc:2272] T aaec8a5f12b648c88c0b0c55c6ac3a92 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:07.085152  6549 tablet_replica.cc:333] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0: stopping tablet replica
I20260709 14:54:07.086028  6549 raft_consensus.cc:2243] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 LEADER]: Raft consensus shutting down.
I20260709 14:54:07.087154  6549 raft_consensus.cc:2272] T 7a1707111d8045f2b8c2f219724e133d P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:07.089049 14905 raft_consensus.cc:493] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 3876b8ee8d744cb18e91d97aae93b1ac)
I20260709 14:54:07.089794 14905 raft_consensus.cc:515] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5e20126fa4d8ca0793d19c7b847ed" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40587 } } peers { permanent_uuid: "3876b8ee8d744cb18e91d97aae93b1ac" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 34529 } } peers { permanent_uuid: "1e9289592458429bbddb19c2e7b7b7b0" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 40785 } }
I20260709 14:54:07.090862  6549 tablet_replica.cc:333] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0: stopping tablet replica
I20260709 14:54:07.093580  6549 raft_consensus.cc:2243] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:07.094136 14905 leader_election.cc:290] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587), 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529)
I20260709 14:54:07.094339  6549 raft_consensus.cc:2272] T 7ea45807ea1741b8a66a73294b0f3bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:07.099112  6549 tablet_replica.cc:333] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0: stopping tablet replica
I20260709 14:54:07.100064  6549 raft_consensus.cc:2243] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Raft consensus shutting down.
W20260709 14:54:07.101451  7893 leader_election.cc:336] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111)
I20260709 14:54:07.101784  6549 raft_consensus.cc:2272] T d1e70b78c0514fcda22ba3552f5e82ea P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 14:54:07.103629  7894 leader_election.cc:336] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Network error: Client connection negotiation failed: client connection to 127.6.101.66:34529: connect: Connection refused (error 111)
I20260709 14:54:07.104406  7894 leader_election.cc:304] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9289592458429bbddb19c2e7b7b7b0; no voters: 1de5e20126fa4d8ca0793d19c7b847ed, 3876b8ee8d744cb18e91d97aae93b1ac
I20260709 14:54:07.106287 14906 raft_consensus.cc:2749] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 14:54:07.107465  6549 tablet_replica.cc:333] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0: stopping tablet replica
I20260709 14:54:07.108467  6549 raft_consensus.cc:2243] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 LEADER]: Raft consensus shutting down.
I20260709 14:54:07.110605  6549 raft_consensus.cc:2272] T 23d1003a47fa4cb19d9050eb07529044 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:07.114574  6549 tablet_replica.cc:333] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0: stopping tablet replica
I20260709 14:54:07.115635  6549 raft_consensus.cc:2243] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:07.116437  6549 raft_consensus.cc:2272] T 6d2e94b7532d44c5bad6074beb44b463 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:07.119269  6549 tablet_replica.cc:333] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0: stopping tablet replica
I20260709 14:54:07.119956  6549 raft_consensus.cc:2243] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 LEADER]: Raft consensus shutting down.
I20260709 14:54:07.121558  6549 raft_consensus.cc:2272] T b30d297a612a4252bdf5eb6aa21c11ff P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:07.124557  6549 tablet_replica.cc:333] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0: stopping tablet replica
I20260709 14:54:07.125468  6549 raft_consensus.cc:2243] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:07.126236  6549 raft_consensus.cc:2272] T 783e4874513449ef9084b833f188a6d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:07.129317  6549 tablet_replica.cc:333] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0: stopping tablet replica
I20260709 14:54:07.130280  6549 raft_consensus.cc:2243] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:07.130977  6549 raft_consensus.cc:2272] T 9c563cc7cfbe4d59be4ffc5cf847ce56 P 1e9289592458429bbddb19c2e7b7b7b0 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:07.134482  6549 tablet_replica.cc:333] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0: stopping tablet replica
I20260709 14:54:07.135823  6549 raft_consensus.cc:2243] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 LEADER]: Raft consensus shutting down.
I20260709 14:54:07.137233  6549 raft_consensus.cc:2272] T 4ce6f5d59057468c923f98279ba0df4f P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:07.140475  6549 tablet_replica.cc:333] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0: stopping tablet replica
I20260709 14:54:07.141219  6549 raft_consensus.cc:2243] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 LEADER]: Raft consensus shutting down.
I20260709 14:54:07.142452  6549 raft_consensus.cc:2272] T 6c3288d48c284f02b3b49ffcefea563c P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:07.145357  6549 tablet_replica.cc:333] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0: stopping tablet replica
I20260709 14:54:07.146097  6549 raft_consensus.cc:2243] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 LEADER]: Raft consensus shutting down.
I20260709 14:54:07.147704  6549 raft_consensus.cc:2272] T d90f7d5fb59843e0a06107c48f794b4c P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:07.150458  6549 tablet_replica.cc:333] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0: stopping tablet replica
I20260709 14:54:07.151224  6549 raft_consensus.cc:2243] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 27 LEADER]: Raft consensus shutting down.
I20260709 14:54:07.152544  6549 raft_consensus.cc:2272] T e145ae252e8041f9b5ad2dbebcf279c9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:07.154806  6549 tablet_replica.cc:333] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0: stopping tablet replica
I20260709 14:54:07.155427  6549 raft_consensus.cc:2243] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 LEADER]: Raft consensus shutting down.
I20260709 14:54:07.156477  6549 raft_consensus.cc:2272] T f69c398b243d41308ddd552fcb6b657c P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:07.159440  6549 tablet_replica.cc:333] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0: stopping tablet replica
I20260709 14:54:07.160109  6549 raft_consensus.cc:2243] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 LEADER]: Raft consensus shutting down.
I20260709 14:54:07.161418  6549 raft_consensus.cc:2272] T 787a21690c744946b36b3d3baa26d8b6 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:07.164932  6549 tablet_replica.cc:333] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0: stopping tablet replica
I20260709 14:54:07.165971  6549 raft_consensus.cc:2243] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 LEADER]: Raft consensus shutting down.
I20260709 14:54:07.167155  6549 raft_consensus.cc:2272] T 7a4c17373ec546d59a82ce33b6938268 P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:07.170710  6549 tablet_replica.cc:333] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0: stopping tablet replica
I20260709 14:54:07.171865  6549 raft_consensus.cc:2243] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:07.172557  6549 raft_consensus.cc:2272] T 3dcde6b5a9614f56b6fee208e40eae0f P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:07.175417  6549 tablet_replica.cc:333] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0: stopping tablet replica
I20260709 14:54:07.176185  6549 raft_consensus.cc:2243] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:07.176899  6549 raft_consensus.cc:2272] T 94c22c68d7d64909bc3be2a12cd51375 P 1e9289592458429bbddb19c2e7b7b7b0 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:07.179288  6549 tablet_replica.cc:333] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0: stopping tablet replica
I20260709 14:54:07.180022  6549 raft_consensus.cc:2243] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 22 LEADER]: Raft consensus shutting down.
I20260709 14:54:07.181186  6549 raft_consensus.cc:2272] T af383cb6c2e843c593c3d86266ffdfdf P 1e9289592458429bbddb19c2e7b7b7b0 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:07.183995  6549 tablet_replica.cc:333] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0: stopping tablet replica
I20260709 14:54:07.185120  6549 raft_consensus.cc:2243] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 24 LEADER]: Raft consensus shutting down.
I20260709 14:54:07.186869  6549 raft_consensus.cc:2272] T 46456e760e004d6c8f70251651e0b26b P 1e9289592458429bbddb19c2e7b7b7b0 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:07.190665  6549 tablet_replica.cc:333] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0: stopping tablet replica
I20260709 14:54:07.191601  6549 raft_consensus.cc:2243] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 LEADER]: Raft consensus shutting down.
I20260709 14:54:07.192927  6549 raft_consensus.cc:2272] T 80265d77f70046f997ce9c4fef0a107c P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 14:54:07.195230  7893 consensus_peers.cc:597] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 14:54:07.197465  6549 tablet_replica.cc:333] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0: stopping tablet replica
I20260709 14:54:07.199826  6549 raft_consensus.cc:2243] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 LEADER]: Raft consensus shutting down.
I20260709 14:54:07.201187  6549 raft_consensus.cc:2272] T 9cd6df0b766447119ea9e0acb887af01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:07.204236  6549 tablet_replica.cc:333] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0: stopping tablet replica
I20260709 14:54:07.205173  6549 raft_consensus.cc:2243] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 LEADER]: Raft consensus shutting down.
I20260709 14:54:07.206398  6549 raft_consensus.cc:2272] T ad8e261558b942c6b42c841689082c10 P 1e9289592458429bbddb19c2e7b7b7b0 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:07.209486  6549 tablet_replica.cc:333] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0: stopping tablet replica
I20260709 14:54:07.210332  6549 raft_consensus.cc:2243] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:07.210989  6549 raft_consensus.cc:2272] T 5a31abe772ad42e78f78a2f1d95bcb16 P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:07.214174  6549 tablet_replica.cc:333] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0: stopping tablet replica
I20260709 14:54:07.215150  6549 raft_consensus.cc:2243] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 LEADER]: Raft consensus shutting down.
I20260709 14:54:07.216513  6549 raft_consensus.cc:2272] T 0ad621bd873f4a429a62f9755f4cc775 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:07.219542  6549 tablet_replica.cc:333] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0: stopping tablet replica
I20260709 14:54:07.220342  6549 raft_consensus.cc:2243] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 23 LEADER]: Raft consensus shutting down.
I20260709 14:54:07.221653  6549 raft_consensus.cc:2272] T 15359084dc6a466ca9280b7e4b63454b P 1e9289592458429bbddb19c2e7b7b7b0 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:07.224255  6549 tablet_replica.cc:333] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0: stopping tablet replica
I20260709 14:54:07.225023  6549 raft_consensus.cc:2243] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 24 LEADER]: Raft consensus shutting down.
I20260709 14:54:07.226344  6549 raft_consensus.cc:2272] T a7960f2a6dc94357a722fa1a67e8383c P 1e9289592458429bbddb19c2e7b7b7b0 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:07.228650  6549 tablet_replica.cc:333] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0: stopping tablet replica
I20260709 14:54:07.229369  6549 raft_consensus.cc:2243] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 23 LEADER]: Raft consensus shutting down.
I20260709 14:54:07.230536  6549 raft_consensus.cc:2272] T 9ca9650f2c8c4fe08e77c70ee08f3927 P 1e9289592458429bbddb19c2e7b7b7b0 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:07.232734  6549 tablet_replica.cc:333] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0: stopping tablet replica
I20260709 14:54:07.233433  6549 raft_consensus.cc:2243] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:07.233979  6549 raft_consensus.cc:2272] T 5ad88b19ba074d7eb419542cddcebb51 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:07.236081  6549 tablet_replica.cc:333] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0: stopping tablet replica
I20260709 14:54:07.236744  6549 raft_consensus.cc:2243] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 LEADER]: Raft consensus shutting down.
I20260709 14:54:07.237774  6549 raft_consensus.cc:2272] T 6f693cee587949c6bde5463f4fd33b01 P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:07.240114  6549 tablet_replica.cc:333] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0: stopping tablet replica
I20260709 14:54:07.241122  6549 raft_consensus.cc:2243] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:07.241927  6549 raft_consensus.cc:2272] T abd9bd9309aa456faee5ac298922892e P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:07.244287  6549 tablet_replica.cc:333] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1e9289592458429bbddb19c2e7b7b7b0: stopping tablet replica
I20260709 14:54:07.244936  6549 raft_consensus.cc:2243] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:07.245494  6549 raft_consensus.cc:2272] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:07.247786  6549 tablet_replica.cc:333] T 9ce9c0ef2db24c13a8b1402f21819458 P 1e9289592458429bbddb19c2e7b7b7b0: stopping tablet replica
I20260709 14:54:07.248445  6549 raft_consensus.cc:2243] T 9ce9c0ef2db24c13a8b1402f21819458 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:07.248980  6549 raft_consensus.cc:2272] T 9ce9c0ef2db24c13a8b1402f21819458 P 1e9289592458429bbddb19c2e7b7b7b0 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:07.251274  6549 tablet_replica.cc:333] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0: stopping tablet replica
I20260709 14:54:07.251905  6549 raft_consensus.cc:2243] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 LEADER]: Raft consensus shutting down.
I20260709 14:54:07.253005  6549 raft_consensus.cc:2272] T 4c5a5f4d6980405d99119f2f2e97df2f P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:07.256178  6549 tablet_replica.cc:333] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0: stopping tablet replica
I20260709 14:54:07.256850  6549 raft_consensus.cc:2243] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 LEADER]: Raft consensus shutting down.
I20260709 14:54:07.257977  6549 raft_consensus.cc:2272] T b313d3d5be334c0697556ab7c8cabbf3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:07.260468  6549 tablet_replica.cc:333] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0: stopping tablet replica
I20260709 14:54:07.261139  6549 raft_consensus.cc:2243] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 23 LEADER]: Raft consensus shutting down.
I20260709 14:54:07.262321  6549 raft_consensus.cc:2272] T e63cef01f72446c09b46b48ebbbd714a P 1e9289592458429bbddb19c2e7b7b7b0 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:07.264670  6549 tablet_replica.cc:333] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0: stopping tablet replica
I20260709 14:54:07.265323  6549 raft_consensus.cc:2243] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:07.265838  6549 raft_consensus.cc:2272] T 9fd10baef95c4d73978299974e0dd8f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:07.268230  6549 tablet_replica.cc:333] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0: stopping tablet replica
I20260709 14:54:07.268904  6549 raft_consensus.cc:2243] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 LEADER]: Raft consensus shutting down.
I20260709 14:54:07.269950  6549 raft_consensus.cc:2272] T 6d0d5c36f8664b1382cf3a23a559c621 P 1e9289592458429bbddb19c2e7b7b7b0 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:07.272745  6549 tablet_replica.cc:333] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0: stopping tablet replica
I20260709 14:54:07.273638  6549 raft_consensus.cc:2243] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 22 LEADER]: Raft consensus shutting down.
I20260709 14:54:07.274866  6549 raft_consensus.cc:2272] T 7d45fb2f8502402780de3ab1d9588072 P 1e9289592458429bbddb19c2e7b7b7b0 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:07.277799  6549 tablet_replica.cc:333] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0: stopping tablet replica
I20260709 14:54:07.278445  6549 raft_consensus.cc:2243] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:07.278942  6549 raft_consensus.cc:2272] T f0813c88ccff4990b3b5d74b18a3e674 P 1e9289592458429bbddb19c2e7b7b7b0 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:07.280982  6549 tablet_replica.cc:333] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0: stopping tablet replica
I20260709 14:54:07.281683  6549 raft_consensus.cc:2243] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:07.282464  6549 raft_consensus.cc:2272] T f8b780b4cd374bdfa269ff8079b90f9c P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:07.285168  6549 tablet_replica.cc:333] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0: stopping tablet replica
I20260709 14:54:07.285965  6549 raft_consensus.cc:2243] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 LEADER]: Raft consensus shutting down.
I20260709 14:54:07.286993  6549 raft_consensus.cc:2272] T 258d6c2dda954bf5b65930fde8ecb9f3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:07.289660  6549 tablet_replica.cc:333] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0: stopping tablet replica
I20260709 14:54:07.290359  6549 raft_consensus.cc:2243] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 LEADER]: Raft consensus shutting down.
I20260709 14:54:07.291332  6549 raft_consensus.cc:2272] T c05bb7d6a8bd42fcb27196db96044bb1 P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:07.293448  6549 tablet_replica.cc:333] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0: stopping tablet replica
I20260709 14:54:07.294009  6549 raft_consensus.cc:2243] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:07.294512  6549 raft_consensus.cc:2272] T c1e7a6b95b3947cba44740eb2a23e8d9 P 1e9289592458429bbddb19c2e7b7b7b0 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:07.296283  6549 tablet_replica.cc:333] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0: stopping tablet replica
I20260709 14:54:07.296772  6549 raft_consensus.cc:2243] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 22 LEADER]: Raft consensus shutting down.
I20260709 14:54:07.297677  6549 raft_consensus.cc:2272] T 939996e77ee64e9fab21aef50758b706 P 1e9289592458429bbddb19c2e7b7b7b0 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:07.300087  6549 tablet_replica.cc:333] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0: stopping tablet replica
I20260709 14:54:07.300750  6549 raft_consensus.cc:2243] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:07.301395  6549 raft_consensus.cc:2272] T fd30845430df4f21a2512e25b0b9d0d3 P 1e9289592458429bbddb19c2e7b7b7b0 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:07.303458  6549 tablet_replica.cc:333] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0: stopping tablet replica
I20260709 14:54:07.303972  6549 raft_consensus.cc:2243] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:07.304450  6549 raft_consensus.cc:2272] T 3a01e716f85c42fca2d598794aa97828 P 1e9289592458429bbddb19c2e7b7b7b0 [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 14:54:07.374557  8598 consensus_peers.cc:597] T 9ce9c0ef2db24c13a8b1402f21819458 P 9418391fa82a42c79c6cad13ba91d964 -> Peer 1e9289592458429bbddb19c2e7b7b7b0 (127.6.101.67:40785): Couldn't send request to peer 1e9289592458429bbddb19c2e7b7b7b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 14:54:07.612807  8598 consensus_peers.cc:597] T 9441e831627143a991a1556dcdce71e3 P 9418391fa82a42c79c6cad13ba91d964 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 14:54:07.831396  8599 consensus_peers.cc:597] T 9441e831627143a991a1556dcdce71e3 P 9418391fa82a42c79c6cad13ba91d964 -> Peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Couldn't send request to peer 3876b8ee8d744cb18e91d97aae93b1ac. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.66:34529: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 14:54:08.010758  8599 consensus_peers.cc:597] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 -> Peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Couldn't send request to peer 3876b8ee8d744cb18e91d97aae93b1ac. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.66:34529: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 14:54:08.107954  6549 tablet_server.cc:196] TabletServer@127.6.101.67:0 shutdown complete.
I20260709 14:54:08.216820  6549 tablet_server.cc:179] TabletServer@127.6.101.68:0 shutting down...
W20260709 14:54:08.233631  8599 consensus_peers.cc:597] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 9418391fa82a42c79c6cad13ba91d964 -> Peer 3876b8ee8d744cb18e91d97aae93b1ac (127.6.101.66:34529): Couldn't send request to peer 3876b8ee8d744cb18e91d97aae93b1ac. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.66:34529: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 14:54:08.249565  8598 consensus_peers.cc:597] T 9ce9c0ef2db24c13a8b1402f21819458 P 9418391fa82a42c79c6cad13ba91d964 -> Peer 1de5e20126fa4d8ca0793d19c7b847ed (127.6.101.65:40587): Couldn't send request to peer 1de5e20126fa4d8ca0793d19c7b847ed. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40587: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 14:54:08.272914  6549 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 14:54:08.274056  6549 tablet_replica.cc:333] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 9418391fa82a42c79c6cad13ba91d964: stopping tablet replica
I20260709 14:54:08.274847  6549 raft_consensus.cc:2243] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 9418391fa82a42c79c6cad13ba91d964 [term 4 LEADER]: Raft consensus shutting down.
I20260709 14:54:08.275897  6549 raft_consensus.cc:2272] T ae1f7722fdea49e0b5e9c5d96633eaf9 P 9418391fa82a42c79c6cad13ba91d964 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:08.278537  6549 tablet_replica.cc:333] T 9441e831627143a991a1556dcdce71e3 P 9418391fa82a42c79c6cad13ba91d964: stopping tablet replica
I20260709 14:54:08.279282  6549 raft_consensus.cc:2243] T 9441e831627143a991a1556dcdce71e3 P 9418391fa82a42c79c6cad13ba91d964 [term 6 LEADER]: Raft consensus shutting down.
I20260709 14:54:08.280335  6549 raft_consensus.cc:2272] T 9441e831627143a991a1556dcdce71e3 P 9418391fa82a42c79c6cad13ba91d964 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:08.282769  6549 tablet_replica.cc:333] T 9ce9c0ef2db24c13a8b1402f21819458 P 9418391fa82a42c79c6cad13ba91d964: stopping tablet replica
I20260709 14:54:08.283402  6549 raft_consensus.cc:2243] T 9ce9c0ef2db24c13a8b1402f21819458 P 9418391fa82a42c79c6cad13ba91d964 [term 4 LEADER]: Raft consensus shutting down.
I20260709 14:54:08.284761  6549 raft_consensus.cc:2272] T 9ce9c0ef2db24c13a8b1402f21819458 P 9418391fa82a42c79c6cad13ba91d964 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:08.287454  6549 tablet_replica.cc:333] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964: stopping tablet replica
I20260709 14:54:08.288162  6549 raft_consensus.cc:2243] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 [term 12 LEADER]: Raft consensus shutting down.
I20260709 14:54:08.289625  6549 raft_consensus.cc:2272] T a18d29d52d304c87b930d4fb5eaf50b1 P 9418391fa82a42c79c6cad13ba91d964 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:08.466437  6549 tablet_server.cc:196] TabletServer@127.6.101.68:0 shutdown complete.
I20260709 14:54:08.490272  6549 master.cc:562] Master@127.6.101.126:38743 shutting down...
I20260709 14:54:08.528520  6549 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 133636659113430cb53b321cb0b1d9ee [term 1 LEADER]: Raft consensus shutting down.
I20260709 14:54:08.529410  6549 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 133636659113430cb53b321cb0b1d9ee [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:08.529814  6549 tablet_replica.cc:333] T 00000000000000000000000000000000 P 133636659113430cb53b321cb0b1d9ee: stopping tablet replica
I20260709 14:54:08.685614  6549 master.cc:584] Master@127.6.101.126:38743 shutdown complete.
I20260709 14:54:08.736207  6549 test_util.cc:182] -----------------------------------------------
I20260709 14:54:08.736524  6549 test_util.cc:183] Had failures, leaving test files at /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783608571892863-6549-0
[  FAILED  ] LeaderRebalancerTest.AddTserver (244317 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 14:54:08.740852  6549 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.6.101.126:35373
I20260709 14:54:08.742234  6549 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 14:54:08.750274 14911 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 14:54:08.750303 14914 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 14:54:08.750301 14912 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 14:54:08.752822  6549 server_base.cc:1061] running on GCE node
I20260709 14:54:08.756219  6549 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 14:54:08.756489  6549 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 14:54:08.756665  6549 hybrid_clock.cc:648] HybridClock initialized: now 1783608848756646 us; error 0 us; skew 500 ppm
I20260709 14:54:08.757221  6549 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 14:54:08.760452  6549 webserver.cc:533] Webserver started at http://127.6.101.126:40727/ using document root <none> and password file <none>
I20260709 14:54:08.761053  6549 fs_manager.cc:362] Metadata directory not provided
I20260709 14:54:08.761297  6549 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 14:54:08.761597  6549 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 14:54:08.762864  6549 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783608571892863-6549-0/minicluster-data/master-0-root/instance:
uuid: "1087f77b67cc4cb1a841d6c146b1af47"
format_stamp: "Formatted at 2026-07-09 14:54:08 on dist-test-slave-lv34"
I20260709 14:54:08.768189  6549 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 14:54:08.773034 14919 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 14:54:08.774150  6549 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 14:54:08.774544  6549 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783608571892863-6549-0/minicluster-data/master-0-root
uuid: "1087f77b67cc4cb1a841d6c146b1af47"
format_stamp: "Formatted at 2026-07-09 14:54:08 on dist-test-slave-lv34"
I20260709 14:54:08.774986  6549 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783608571892863-6549-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783608571892863-6549-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783608571892863-6549-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 14:54:08.788820  6549 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 14:54:08.790691  6549 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 14:54:08.840337  6549 rpc_server.cc:307] RPC server started. Bound to: 127.6.101.126:35373
I20260709 14:54:08.840517 14970 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.101.126:35373 every 8 connection(s)
I20260709 14:54:08.845202 14971 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:08.859035 14971 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1087f77b67cc4cb1a841d6c146b1af47: Bootstrap starting.
I20260709 14:54:08.865207 14971 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1087f77b67cc4cb1a841d6c146b1af47: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:08.870841 14971 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1087f77b67cc4cb1a841d6c146b1af47: No bootstrap required, opened a new log
I20260709 14:54:08.874255 14971 raft_consensus.cc:359] T 00000000000000000000000000000000 P 1087f77b67cc4cb1a841d6c146b1af47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1087f77b67cc4cb1a841d6c146b1af47" member_type: VOTER }
I20260709 14:54:08.875031 14971 raft_consensus.cc:385] T 00000000000000000000000000000000 P 1087f77b67cc4cb1a841d6c146b1af47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:08.875344 14971 raft_consensus.cc:740] T 00000000000000000000000000000000 P 1087f77b67cc4cb1a841d6c146b1af47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1087f77b67cc4cb1a841d6c146b1af47, State: Initialized, Role: FOLLOWER
I20260709 14:54:08.876127 14971 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1087f77b67cc4cb1a841d6c146b1af47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1087f77b67cc4cb1a841d6c146b1af47" member_type: VOTER }
I20260709 14:54:08.876819 14971 raft_consensus.cc:399] T 00000000000000000000000000000000 P 1087f77b67cc4cb1a841d6c146b1af47 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 14:54:08.877454 14971 raft_consensus.cc:493] T 00000000000000000000000000000000 P 1087f77b67cc4cb1a841d6c146b1af47 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 14:54:08.877794 14971 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 1087f77b67cc4cb1a841d6c146b1af47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:08.885492 14971 raft_consensus.cc:515] T 00000000000000000000000000000000 P 1087f77b67cc4cb1a841d6c146b1af47 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1087f77b67cc4cb1a841d6c146b1af47" member_type: VOTER }
I20260709 14:54:08.886181 14971 leader_election.cc:304] T 00000000000000000000000000000000 P 1087f77b67cc4cb1a841d6c146b1af47 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1087f77b67cc4cb1a841d6c146b1af47; no voters: 
I20260709 14:54:08.887683 14971 leader_election.cc:290] T 00000000000000000000000000000000 P 1087f77b67cc4cb1a841d6c146b1af47 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 14:54:08.888079 14974 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 1087f77b67cc4cb1a841d6c146b1af47 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:54:08.889643 14974 raft_consensus.cc:697] T 00000000000000000000000000000000 P 1087f77b67cc4cb1a841d6c146b1af47 [term 1 LEADER]: Becoming Leader. State: Replica: 1087f77b67cc4cb1a841d6c146b1af47, State: Running, Role: LEADER
I20260709 14:54:08.890468 14974 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1087f77b67cc4cb1a841d6c146b1af47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1087f77b67cc4cb1a841d6c146b1af47" member_type: VOTER }
I20260709 14:54:08.891250 14971 sys_catalog.cc:565] T 00000000000000000000000000000000 P 1087f77b67cc4cb1a841d6c146b1af47 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 14:54:08.896440 14975 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1087f77b67cc4cb1a841d6c146b1af47 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1087f77b67cc4cb1a841d6c146b1af47" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1087f77b67cc4cb1a841d6c146b1af47" member_type: VOTER } }
I20260709 14:54:08.897786 14975 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1087f77b67cc4cb1a841d6c146b1af47 [sys.catalog]: This master's current role is: LEADER
I20260709 14:54:08.896466 14976 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1087f77b67cc4cb1a841d6c146b1af47 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1087f77b67cc4cb1a841d6c146b1af47. Latest consensus state: current_term: 1 leader_uuid: "1087f77b67cc4cb1a841d6c146b1af47" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1087f77b67cc4cb1a841d6c146b1af47" member_type: VOTER } }
I20260709 14:54:08.900730 14976 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1087f77b67cc4cb1a841d6c146b1af47 [sys.catalog]: This master's current role is: LEADER
I20260709 14:54:08.903834 14982 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 14:54:08.911671 14982 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 14:54:08.916113  6549 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 14:54:08.928238 14982 catalog_manager.cc:1383] Generated new cluster ID: 8af33927c7a4487a83f0412e0bb7b836
I20260709 14:54:08.928968 14982 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 14:54:08.966717 14982 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 14:54:08.968341 14982 catalog_manager.cc:1540] Loading token signing keys...
I20260709 14:54:08.999043 14982 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 1087f77b67cc4cb1a841d6c146b1af47: Generated new TSK 0
I20260709 14:54:08.999799 14982 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 14:54:09.050118  6549 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 14:54:09.058714 14992 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 14:54:09.060460 14993 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 14:54:09.064746 14995 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 14:54:09.065881  6549 server_base.cc:1061] running on GCE node
I20260709 14:54:09.068797  6549 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 14:54:09.069123  6549 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 14:54:09.069331  6549 hybrid_clock.cc:648] HybridClock initialized: now 1783608849069308 us; error 0 us; skew 500 ppm
I20260709 14:54:09.069909  6549 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 14:54:09.073639  6549 webserver.cc:533] Webserver started at http://127.6.101.65:42577/ using document root <none> and password file <none>
I20260709 14:54:09.074329  6549 fs_manager.cc:362] Metadata directory not provided
I20260709 14:54:09.074610  6549 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 14:54:09.074921  6549 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 14:54:09.076407  6549 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783608571892863-6549-0/minicluster-data/ts-0-root/instance:
uuid: "dbc2c92e49e346b5b3bd7705a229afc6"
format_stamp: "Formatted at 2026-07-09 14:54:09 on dist-test-slave-lv34"
I20260709 14:54:09.083889  6549 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.005s	sys 0.000s
I20260709 14:54:09.089404 15000 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 14:54:09.090672  6549 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 14:54:09.091246  6549 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783608571892863-6549-0/minicluster-data/ts-0-root
uuid: "dbc2c92e49e346b5b3bd7705a229afc6"
format_stamp: "Formatted at 2026-07-09 14:54:09 on dist-test-slave-lv34"
I20260709 14:54:09.091609  6549 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783608571892863-6549-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783608571892863-6549-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783608571892863-6549-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 14:54:09.117775  6549 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 14:54:09.119863  6549 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 14:54:09.122440  6549 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 14:54:09.125618  6549 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 14:54:09.125865  6549 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 14:54:09.126109  6549 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 14:54:09.126291  6549 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 14:54:09.192034  6549 rpc_server.cc:307] RPC server started. Bound to: 127.6.101.65:45477
I20260709 14:54:09.192314 15062 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.101.65:45477 every 8 connection(s)
I20260709 14:54:09.199671  6549 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 14:54:09.211295 15067 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 14:54:09.214901 15068 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 14:54:09.220112 15070 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 14:54:09.225045  6549 server_base.cc:1061] running on GCE node
I20260709 14:54:09.229285  6549 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 14:54:09.229822  6549 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 14:54:09.230034  6549 hybrid_clock.cc:648] HybridClock initialized: now 1783608849230012 us; error 0 us; skew 500 ppm
I20260709 14:54:09.230623  6549 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 14:54:09.230688 15063 heartbeater.cc:344] Connected to a master server at 127.6.101.126:35373
I20260709 14:54:09.232111 15063 heartbeater.cc:461] Registering TS with master...
I20260709 14:54:09.233841 15063 heartbeater.cc:507] Master 127.6.101.126:35373 requested a full tablet report, sending...
I20260709 14:54:09.234180  6549 webserver.cc:533] Webserver started at http://127.6.101.66:42815/ using document root <none> and password file <none>
I20260709 14:54:09.235100  6549 fs_manager.cc:362] Metadata directory not provided
I20260709 14:54:09.235412  6549 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 14:54:09.235798  6549 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 14:54:09.237107 14936 ts_manager.cc:194] Registered new tserver with Master: dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477)
I20260709 14:54:09.238042  6549 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783608571892863-6549-0/minicluster-data/ts-1-root/instance:
uuid: "7519e608fbb44d9db8ad30b9f10ae605"
format_stamp: "Formatted at 2026-07-09 14:54:09 on dist-test-slave-lv34"
I20260709 14:54:09.241029 14936 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53982
I20260709 14:54:09.246932  6549 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.005s	sys 0.004s
I20260709 14:54:09.252341 15075 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 14:54:09.253774  6549 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.000s
I20260709 14:54:09.254272  6549 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783608571892863-6549-0/minicluster-data/ts-1-root
uuid: "7519e608fbb44d9db8ad30b9f10ae605"
format_stamp: "Formatted at 2026-07-09 14:54:09 on dist-test-slave-lv34"
I20260709 14:54:09.254649  6549 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783608571892863-6549-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783608571892863-6549-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783608571892863-6549-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 14:54:09.269717  6549 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 14:54:09.271341  6549 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 14:54:09.273501  6549 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 14:54:09.276544  6549 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 14:54:09.276901  6549 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 14:54:09.277310  6549 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 14:54:09.277529  6549 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 14:54:09.344817  6549 rpc_server.cc:307] RPC server started. Bound to: 127.6.101.66:43177
I20260709 14:54:09.345186 15137 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.101.66:43177 every 8 connection(s)
I20260709 14:54:09.350898  6549 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 14:54:09.362001 15141 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 14:54:09.362954 15142 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 14:54:09.366731 15144 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 14:54:09.367026 15138 heartbeater.cc:344] Connected to a master server at 127.6.101.126:35373
I20260709 14:54:09.366976  6549 server_base.cc:1061] running on GCE node
I20260709 14:54:09.367636 15138 heartbeater.cc:461] Registering TS with master...
I20260709 14:54:09.368458  6549 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 14:54:09.368567 15138 heartbeater.cc:507] Master 127.6.101.126:35373 requested a full tablet report, sending...
W20260709 14:54:09.368772  6549 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 14:54:09.369094  6549 hybrid_clock.cc:648] HybridClock initialized: now 1783608849369068 us; error 0 us; skew 500 ppm
I20260709 14:54:09.369987  6549 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 14:54:09.371675 14936 ts_manager.cc:194] Registered new tserver with Master: 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177)
I20260709 14:54:09.373559  6549 webserver.cc:533] Webserver started at http://127.6.101.67:42619/ using document root <none> and password file <none>
I20260709 14:54:09.373931 14936 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53998
I20260709 14:54:09.374352  6549 fs_manager.cc:362] Metadata directory not provided
I20260709 14:54:09.374723  6549 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 14:54:09.375030  6549 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 14:54:09.376987  6549 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783608571892863-6549-0/minicluster-data/ts-2-root/instance:
uuid: "eaa34beb1b274443b1c46839afd0a484"
format_stamp: "Formatted at 2026-07-09 14:54:09 on dist-test-slave-lv34"
I20260709 14:54:09.383088  6549 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.001s
I20260709 14:54:09.387543 15149 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 14:54:09.388783  6549 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 14:54:09.389196  6549 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783608571892863-6549-0/minicluster-data/ts-2-root
uuid: "eaa34beb1b274443b1c46839afd0a484"
format_stamp: "Formatted at 2026-07-09 14:54:09 on dist-test-slave-lv34"
I20260709 14:54:09.389645  6549 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783608571892863-6549-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783608571892863-6549-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783608571892863-6549-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 14:54:09.402469  6549 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 14:54:09.404523  6549 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 14:54:09.406601  6549 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 14:54:09.409838  6549 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 14:54:09.410140  6549 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 14:54:09.410426  6549 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 14:54:09.410593  6549 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 14:54:09.477150  6549 rpc_server.cc:307] RPC server started. Bound to: 127.6.101.67:33805
I20260709 14:54:09.477372 15211 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.101.67:33805 every 8 connection(s)
I20260709 14:54:09.483393  6549 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 14:54:09.491962 15215 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 14:54:09.496016 15216 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 14:54:09.497579 15218 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 14:54:09.499663 15212 heartbeater.cc:344] Connected to a master server at 127.6.101.126:35373
I20260709 14:54:09.500198 15212 heartbeater.cc:461] Registering TS with master...
I20260709 14:54:09.502749  6549 server_base.cc:1061] running on GCE node
I20260709 14:54:09.503053 15212 heartbeater.cc:507] Master 127.6.101.126:35373 requested a full tablet report, sending...
I20260709 14:54:09.505292  6549 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 14:54:09.505930  6549 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 14:54:09.506325  6549 hybrid_clock.cc:648] HybridClock initialized: now 1783608849506295 us; error 0 us; skew 500 ppm
I20260709 14:54:09.507651  6549 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 14:54:09.508244 14936 ts_manager.cc:194] Registered new tserver with Master: eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805)
I20260709 14:54:09.511762 14936 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54008
I20260709 14:54:09.512971  6549 webserver.cc:533] Webserver started at http://127.6.101.68:46847/ using document root <none> and password file <none>
I20260709 14:54:09.513983  6549 fs_manager.cc:362] Metadata directory not provided
I20260709 14:54:09.514289  6549 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 14:54:09.514598  6549 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 14:54:09.515892  6549 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783608571892863-6549-0/minicluster-data/ts-3-root/instance:
uuid: "9cb8de0701f2482b99e51d5ac080aa13"
format_stamp: "Formatted at 2026-07-09 14:54:09 on dist-test-slave-lv34"
I20260709 14:54:09.521961  6549 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.008s	sys 0.000s
I20260709 14:54:09.526889 15223 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 14:54:09.527961  6549 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.001s
I20260709 14:54:09.528424  6549 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783608571892863-6549-0/minicluster-data/ts-3-root
uuid: "9cb8de0701f2482b99e51d5ac080aa13"
format_stamp: "Formatted at 2026-07-09 14:54:09 on dist-test-slave-lv34"
I20260709 14:54:09.528743  6549 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783608571892863-6549-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783608571892863-6549-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783608571892863-6549-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 14:54:09.551563  6549 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 14:54:09.553287  6549 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 14:54:09.555238  6549 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 14:54:09.558142  6549 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 14:54:09.558526  6549 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 14:54:09.558925  6549 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 14:54:09.559141  6549 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 14:54:09.627898  6549 rpc_server.cc:307] RPC server started. Bound to: 127.6.101.68:45493
I20260709 14:54:09.628041 15285 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.101.68:45493 every 8 connection(s)
I20260709 14:54:09.648193 15286 heartbeater.cc:344] Connected to a master server at 127.6.101.126:35373
I20260709 14:54:09.648808 15286 heartbeater.cc:461] Registering TS with master...
I20260709 14:54:09.649886 15286 heartbeater.cc:507] Master 127.6.101.126:35373 requested a full tablet report, sending...
I20260709 14:54:09.652719 14936 ts_manager.cc:194] Registered new tserver with Master: 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493)
I20260709 14:54:09.653699  6549 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.021772363s
I20260709 14:54:09.654719 14936 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54022
I20260709 14:54:09.696666 14936 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:54034:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 14:54:09.909482 14984 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 14:54:10.035804 15028 tablet_service.cc:1511] Processing CreateTablet for tablet 0284d9835221427ab285015d48a8040d (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 14:54:10.037794 15028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0284d9835221427ab285015d48a8040d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:10.039507 15027 tablet_service.cc:1511] Processing CreateTablet for tablet 7f2cd7c8159d43c080fd8302180ecfca (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 14:54:10.043704 15027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f2cd7c8159d43c080fd8302180ecfca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:10.048076 15026 tablet_service.cc:1511] Processing CreateTablet for tablet d6bcaee371174feaa06943f949efda49 (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 14:54:10.050345 15026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6bcaee371174feaa06943f949efda49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:10.057653 15024 tablet_service.cc:1511] Processing CreateTablet for tablet f706543d4d3e4e7291624a785ca4e747 (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 14:54:10.058215 15025 tablet_service.cc:1511] Processing CreateTablet for tablet 798d0882b1ea4b26b598c236de8f18c9 (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 14:54:10.060245 15024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f706543d4d3e4e7291624a785ca4e747. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:10.061307 15025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 798d0882b1ea4b26b598c236de8f18c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:10.064888 15023 tablet_service.cc:1511] Processing CreateTablet for tablet 98280a706ec54413830f342b48666f6e (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 14:54:10.066849 15023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98280a706ec54413830f342b48666f6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:10.084856 15022 tablet_service.cc:1511] Processing CreateTablet for tablet d354c94548fc411ab62b4281ed947944 (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 14:54:10.086818 15022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d354c94548fc411ab62b4281ed947944. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:10.101953 15021 tablet_service.cc:1511] Processing CreateTablet for tablet 7699ad132e12472180b6a9527951c397 (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 14:54:10.103730 15021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7699ad132e12472180b6a9527951c397. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:10.106644 15020 tablet_service.cc:1511] Processing CreateTablet for tablet d2c4ea1c33c64cd09ba04611fdbdc59d (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 14:54:10.110744 15019 tablet_service.cc:1511] Processing CreateTablet for tablet 263098160f604ae3aa31782c37e2fd52 (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 14:54:10.112414 15251 tablet_service.cc:1511] Processing CreateTablet for tablet 0284d9835221427ab285015d48a8040d (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 14:54:10.114459 15251 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0284d9835221427ab285015d48a8040d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:10.115020 15250 tablet_service.cc:1511] Processing CreateTablet for tablet d6bcaee371174feaa06943f949efda49 (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 14:54:10.117549 15244 tablet_service.cc:1511] Processing CreateTablet for tablet d2c4ea1c33c64cd09ba04611fdbdc59d (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 14:54:10.118273 15243 tablet_service.cc:1511] Processing CreateTablet for tablet b8d6b9cf24a24444b2a69fd526cd4b09 (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 14:54:10.118661 15242 tablet_service.cc:1511] Processing CreateTablet for tablet 054739df584d4b9db840777c2ae17555 (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 14:54:10.120352 15249 tablet_service.cc:1511] Processing CreateTablet for tablet 6cd07fbeb9f149a08fdbac2e0247eca4 (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 14:54:10.122787 15247 tablet_service.cc:1511] Processing CreateTablet for tablet 98280a706ec54413830f342b48666f6e (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 14:54:10.125460 15246 tablet_service.cc:1511] Processing CreateTablet for tablet 67409326aa124c52a5e9a650d7570a68 (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 14:54:10.133442 15248 tablet_service.cc:1511] Processing CreateTablet for tablet f706543d4d3e4e7291624a785ca4e747 (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 14:54:10.138747 15243 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8d6b9cf24a24444b2a69fd526cd4b09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:10.142338 15242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 054739df584d4b9db840777c2ae17555. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:10.143719 15247 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98280a706ec54413830f342b48666f6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:10.128003 15245 tablet_service.cc:1511] Processing CreateTablet for tablet 7699ad132e12472180b6a9527951c397 (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 14:54:10.109128 15020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2c4ea1c33c64cd09ba04611fdbdc59d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:10.146128 15249 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cd07fbeb9f149a08fdbac2e0247eca4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:10.162709 15103 tablet_service.cc:1511] Processing CreateTablet for tablet 0284d9835221427ab285015d48a8040d (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 14:54:10.164435 15103 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0284d9835221427ab285015d48a8040d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:10.167348 15102 tablet_service.cc:1511] Processing CreateTablet for tablet 7f2cd7c8159d43c080fd8302180ecfca (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 14:54:10.178364 15102 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f2cd7c8159d43c080fd8302180ecfca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:10.180017 15101 tablet_service.cc:1511] Processing CreateTablet for tablet 6cd07fbeb9f149a08fdbac2e0247eca4 (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 14:54:10.168962 15026 tablet_service.cc:1511] Processing CreateTablet for tablet 054739df584d4b9db840777c2ae17555 (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 14:54:10.169574 15246 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67409326aa124c52a5e9a650d7570a68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:10.188594 15019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 263098160f604ae3aa31782c37e2fd52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:10.197806 15248 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f706543d4d3e4e7291624a785ca4e747. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:10.201038 15100 tablet_service.cc:1511] Processing CreateTablet for tablet 798d0882b1ea4b26b598c236de8f18c9 (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 14:54:10.210040 15306 tablet_bootstrap.cc:492] T 798d0882b1ea4b26b598c236de8f18c9 P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap starting.
I20260709 14:54:10.210642 15100 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 798d0882b1ea4b26b598c236de8f18c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:10.210484 15025 tablet_service.cc:1511] Processing CreateTablet for tablet c61864fa2cd249d683f8fb90d8542480 (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 14:54:10.210151 15245 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7699ad132e12472180b6a9527951c397. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:10.222313 15099 tablet_service.cc:1511] Processing CreateTablet for tablet f706543d4d3e4e7291624a785ca4e747 (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 14:54:10.225164 15244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2c4ea1c33c64cd09ba04611fdbdc59d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:10.246526 15025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c61864fa2cd249d683f8fb90d8542480. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:10.247112 15063 heartbeater.cc:499] Master 127.6.101.126:35373 was elected leader, sending a full tablet report...
I20260709 14:54:10.258134 15250 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6bcaee371174feaa06943f949efda49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:10.265911 15101 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cd07fbeb9f149a08fdbac2e0247eca4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:10.267906 15023 tablet_service.cc:1511] Processing CreateTablet for tablet 5f5dbc86fc8f4ae5b77e0f23adfcd593 (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 14:54:10.269758 15099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f706543d4d3e4e7291624a785ca4e747. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:10.273681 15177 tablet_service.cc:1511] Processing CreateTablet for tablet 7f2cd7c8159d43c080fd8302180ecfca (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 14:54:10.276023 15177 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f2cd7c8159d43c080fd8302180ecfca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:10.278401 15098 tablet_service.cc:1511] Processing CreateTablet for tablet 67409326aa124c52a5e9a650d7570a68 (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 14:54:10.281006 15098 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67409326aa124c52a5e9a650d7570a68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:10.299844 15176 tablet_service.cc:1511] Processing CreateTablet for tablet d6bcaee371174feaa06943f949efda49 (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 14:54:10.302295 15176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6bcaee371174feaa06943f949efda49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:10.307675 15306 tablet_bootstrap.cc:654] T 798d0882b1ea4b26b598c236de8f18c9 P dbc2c92e49e346b5b3bd7705a229afc6: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:10.282485 15026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 054739df584d4b9db840777c2ae17555. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:10.285321 15097 tablet_service.cc:1511] Processing CreateTablet for tablet d354c94548fc411ab62b4281ed947944 (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 14:54:10.314546 15097 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d354c94548fc411ab62b4281ed947944. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:10.315778 15175 tablet_service.cc:1511] Processing CreateTablet for tablet 6cd07fbeb9f149a08fdbac2e0247eca4 (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 14:54:10.285776 15095 tablet_service.cc:1511] Processing CreateTablet for tablet b8d6b9cf24a24444b2a69fd526cd4b09 (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 14:54:10.317843 15175 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cd07fbeb9f149a08fdbac2e0247eca4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:10.318379 15095 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8d6b9cf24a24444b2a69fd526cd4b09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:10.287806 15096 tablet_service.cc:1511] Processing CreateTablet for tablet 7699ad132e12472180b6a9527951c397 (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 14:54:10.321755 15023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f5dbc86fc8f4ae5b77e0f23adfcd593. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:10.322587 15096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7699ad132e12472180b6a9527951c397. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:10.288400 15094 tablet_service.cc:1511] Processing CreateTablet for tablet 263098160f604ae3aa31782c37e2fd52 (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 14:54:10.327062 15094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 263098160f604ae3aa31782c37e2fd52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:10.330744 15173 tablet_service.cc:1511] Processing CreateTablet for tablet 98280a706ec54413830f342b48666f6e (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 14:54:10.330617 15174 tablet_service.cc:1511] Processing CreateTablet for tablet 798d0882b1ea4b26b598c236de8f18c9 (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 14:54:10.332762 15173 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98280a706ec54413830f342b48666f6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:10.337965 15174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 798d0882b1ea4b26b598c236de8f18c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:10.340116 15172 tablet_service.cc:1511] Processing CreateTablet for tablet 67409326aa124c52a5e9a650d7570a68 (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 14:54:10.343330 15172 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67409326aa124c52a5e9a650d7570a68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:10.302919 15249 tablet_service.cc:1511] Processing CreateTablet for tablet c61864fa2cd249d683f8fb90d8542480 (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 14:54:10.347561 15022 tablet_service.cc:1511] Processing CreateTablet for tablet d61f9ecebc3c4a028f5327bc9debf432 (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 14:54:10.349748 15022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d61f9ecebc3c4a028f5327bc9debf432. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:10.354360 15024 tablet_service.cc:1511] Processing CreateTablet for tablet 46ebd2bd84cc46e08c82a7b893e54578 (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 14:54:10.356577 15024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46ebd2bd84cc46e08c82a7b893e54578. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:10.347527 15247 tablet_service.cc:1511] Processing CreateTablet for tablet a018e41c89854091a15a6a8e4deffbdd (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 14:54:10.361123 15171 tablet_service.cc:1511] Processing CreateTablet for tablet d354c94548fc411ab62b4281ed947944 (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 14:54:10.365356 15170 tablet_service.cc:1511] Processing CreateTablet for tablet d2c4ea1c33c64cd09ba04611fdbdc59d (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 14:54:10.369313 15169 tablet_service.cc:1511] Processing CreateTablet for tablet b8d6b9cf24a24444b2a69fd526cd4b09 (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 14:54:10.374079 15249 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c61864fa2cd249d683f8fb90d8542480. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:10.397861 15171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d354c94548fc411ab62b4281ed947944. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:10.400074 15169 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8d6b9cf24a24444b2a69fd526cd4b09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:10.403863 15251 tablet_service.cc:1511] Processing CreateTablet for tablet d61f9ecebc3c4a028f5327bc9debf432 (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 14:54:10.391718 15138 heartbeater.cc:499] Master 127.6.101.126:35373 was elected leader, sending a full tablet report...
I20260709 14:54:10.407225 15170 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2c4ea1c33c64cd09ba04611fdbdc59d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:10.409507 15168 tablet_service.cc:1511] Processing CreateTablet for tablet 263098160f604ae3aa31782c37e2fd52 (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 14:54:10.434923 15168 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 263098160f604ae3aa31782c37e2fd52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:10.438879 15306 tablet_bootstrap.cc:492] T 798d0882b1ea4b26b598c236de8f18c9 P dbc2c92e49e346b5b3bd7705a229afc6: No bootstrap required, opened a new log
I20260709 14:54:10.439613 15306 ts_tablet_manager.cc:1403] T 798d0882b1ea4b26b598c236de8f18c9 P dbc2c92e49e346b5b3bd7705a229afc6: Time spent bootstrapping tablet: real 0.230s	user 0.021s	sys 0.004s
I20260709 14:54:10.444010 15243 tablet_service.cc:1511] Processing CreateTablet for tablet 46ebd2bd84cc46e08c82a7b893e54578 (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 14:54:10.454087 15027 tablet_service.cc:1511] Processing CreateTablet for tablet a1075567fc91458ca7cc9977cf02b170 (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 14:54:10.455665 15027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1075567fc91458ca7cc9977cf02b170. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:10.467573 15306 raft_consensus.cc:359] T 798d0882b1ea4b26b598c236de8f18c9 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:10.468608 15306 raft_consensus.cc:385] T 798d0882b1ea4b26b598c236de8f18c9 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:10.468937 15306 raft_consensus.cc:740] T 798d0882b1ea4b26b598c236de8f18c9 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbc2c92e49e346b5b3bd7705a229afc6, State: Initialized, Role: FOLLOWER
I20260709 14:54:10.420002 15028 tablet_service.cc:1511] Processing CreateTablet for tablet 966a06ab56a6479283ab2818c9439d4f (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 14:54:10.517513 15212 heartbeater.cc:499] Master 127.6.101.126:35373 was elected leader, sending a full tablet report...
I20260709 14:54:10.508265 15307 tablet_bootstrap.cc:492] T 0284d9835221427ab285015d48a8040d P 9cb8de0701f2482b99e51d5ac080aa13: Bootstrap starting.
I20260709 14:54:10.525794 15097 tablet_service.cc:1511] Processing CreateTablet for tablet a018e41c89854091a15a6a8e4deffbdd (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 14:54:10.527952 15097 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a018e41c89854091a15a6a8e4deffbdd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:10.531431 15096 tablet_service.cc:1511] Processing CreateTablet for tablet 054739df584d4b9db840777c2ae17555 (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 14:54:10.506780 15247 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a018e41c89854091a15a6a8e4deffbdd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:10.553156 15251 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d61f9ecebc3c4a028f5327bc9debf432. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:10.559059 15245 tablet_service.cc:1511] Processing CreateTablet for tablet f8b33962eab84819b17953e44eae71a1 (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 14:54:10.560596 15245 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8b33962eab84819b17953e44eae71a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:10.563755 15174 tablet_service.cc:1511] Processing CreateTablet for tablet c61864fa2cd249d683f8fb90d8542480 (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 14:54:10.575594 15242 tablet_service.cc:1511] Processing CreateTablet for tablet d86dfc13b2834d7e8b2ad5f975f08154 (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 14:54:10.580084 15095 tablet_service.cc:1511] Processing CreateTablet for tablet 5f5dbc86fc8f4ae5b77e0f23adfcd593 (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 14:54:10.534296 15306 consensus_queue.cc:260] T 798d0882b1ea4b26b598c236de8f18c9 P dbc2c92e49e346b5b3bd7705a229afc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:10.582806 15028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 966a06ab56a6479283ab2818c9439d4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:10.604729 15096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 054739df584d4b9db840777c2ae17555. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:10.601692 15174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c61864fa2cd249d683f8fb90d8542480. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:10.600164 15242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d86dfc13b2834d7e8b2ad5f975f08154. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:10.533623 15021 tablet_service.cc:1511] Processing CreateTablet for tablet d86dfc13b2834d7e8b2ad5f975f08154 (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 14:54:10.634611 15311 tablet_bootstrap.cc:492] T 98280a706ec54413830f342b48666f6e P eaa34beb1b274443b1c46839afd0a484: Bootstrap starting.
I20260709 14:54:10.637144 15095 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f5dbc86fc8f4ae5b77e0f23adfcd593. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:10.638372 15176 tablet_service.cc:1511] Processing CreateTablet for tablet f8b33962eab84819b17953e44eae71a1 (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 14:54:10.640173 15176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8b33962eab84819b17953e44eae71a1. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 14:54:10.641368 14923 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.6.101.65:45477, user_credentials={real_user=slave}} blocked reactor thread for 62084.4us
I20260709 14:54:10.617096 15172 tablet_service.cc:1511] Processing CreateTablet for tablet 5f5dbc86fc8f4ae5b77e0f23adfcd593 (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 14:54:10.623128 15175 tablet_service.cc:1511] Processing CreateTablet for tablet a018e41c89854091a15a6a8e4deffbdd (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 14:54:10.605726 15103 tablet_service.cc:1511] Processing CreateTablet for tablet f8b33962eab84819b17953e44eae71a1 (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 14:54:10.647464 15103 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8b33962eab84819b17953e44eae71a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:10.651394 15101 tablet_service.cc:1511] Processing CreateTablet for tablet 966a06ab56a6479283ab2818c9439d4f (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 14:54:10.643721 15250 tablet_service.cc:1511] Processing CreateTablet for tablet ca2aa2e1a8c646069cb8b23b0ebdb0c7 (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 14:54:10.666507 15172 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f5dbc86fc8f4ae5b77e0f23adfcd593. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:10.660331 15243 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46ebd2bd84cc46e08c82a7b893e54578. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:10.657091 15310 raft_consensus.cc:493] T 798d0882b1ea4b26b598c236de8f18c9 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:10.672792 15175 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a018e41c89854091a15a6a8e4deffbdd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:10.663426 15286 heartbeater.cc:499] Master 127.6.101.126:35373 was elected leader, sending a full tablet report...
I20260709 14:54:10.674628 15248 tablet_service.cc:1511] Processing CreateTablet for tablet 1159198eabeb409996ccbec0cac057f8 (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 14:54:10.626466 15249 tablet_service.cc:1511] Processing CreateTablet for tablet a1075567fc91458ca7cc9977cf02b170 (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 14:54:10.676586 15094 tablet_service.cc:1511] Processing CreateTablet for tablet a1075567fc91458ca7cc9977cf02b170 (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 14:54:10.676586 15025 tablet_service.cc:1511] Processing CreateTablet for tablet 70bc59fabcdc4359a84d584f36d18d01 (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 14:54:10.681182 15246 tablet_service.cc:1511] Processing CreateTablet for tablet cc6f522768894933b21bc94b41605166 (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 14:54:10.685555 15244 tablet_service.cc:1511] Processing CreateTablet for tablet 6b5bb32eee204f2b90b1f1f14875c579 (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 14:54:10.686336 15177 tablet_service.cc:1511] Processing CreateTablet for tablet 46ebd2bd84cc46e08c82a7b893e54578 (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 14:54:10.719810 15177 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46ebd2bd84cc46e08c82a7b893e54578. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:10.696144 15248 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1159198eabeb409996ccbec0cac057f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:10.698678 15309 tablet_bootstrap.cc:492] T b8d6b9cf24a24444b2a69fd526cd4b09 P 7519e608fbb44d9db8ad30b9f10ae605: Bootstrap starting.
I20260709 14:54:10.698838 15101 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 966a06ab56a6479283ab2818c9439d4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:10.727030 15169 tablet_service.cc:1511] Processing CreateTablet for tablet cc6f522768894933b21bc94b41605166 (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 14:54:10.729224 15100 tablet_service.cc:1511] Processing CreateTablet for tablet 70bc59fabcdc4359a84d584f36d18d01 (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 14:54:10.730554 15169 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc6f522768894933b21bc94b41605166. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:10.731484 15250 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca2aa2e1a8c646069cb8b23b0ebdb0c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:10.699822 15102 tablet_service.cc:1511] Processing CreateTablet for tablet d61f9ecebc3c4a028f5327bc9debf432 (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 14:54:10.700477 15171 tablet_service.cc:1511] Processing CreateTablet for tablet ca2aa2e1a8c646069cb8b23b0ebdb0c7 (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 14:54:10.681396 15310 raft_consensus.cc:515] T 798d0882b1ea4b26b598c236de8f18c9 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:10.742377 15170 tablet_service.cc:1511] Processing CreateTablet for tablet d86dfc13b2834d7e8b2ad5f975f08154 (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 14:54:10.744335 15170 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d86dfc13b2834d7e8b2ad5f975f08154. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:10.752741 15306 ts_tablet_manager.cc:1434] T 798d0882b1ea4b26b598c236de8f18c9 P dbc2c92e49e346b5b3bd7705a229afc6: Time spent starting tablet: real 0.313s	user 0.020s	sys 0.004s
I20260709 14:54:10.769066 15306 tablet_bootstrap.cc:492] T d6bcaee371174feaa06943f949efda49 P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap starting.
I20260709 14:54:10.734763 15024 tablet_service.cc:1511] Processing CreateTablet for tablet 1159198eabeb409996ccbec0cac057f8 (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 14:54:10.702996 15099 tablet_service.cc:1511] Processing CreateTablet for tablet ca2aa2e1a8c646069cb8b23b0ebdb0c7 (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 14:54:10.703074 15021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d86dfc13b2834d7e8b2ad5f975f08154. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:10.713003 15173 tablet_service.cc:1511] Processing CreateTablet for tablet 966a06ab56a6479283ab2818c9439d4f (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 14:54:10.700250 15307 tablet_bootstrap.cc:654] T 0284d9835221427ab285015d48a8040d P 9cb8de0701f2482b99e51d5ac080aa13: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:10.753953 15171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca2aa2e1a8c646069cb8b23b0ebdb0c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:10.777134 15026 tablet_service.cc:1511] Processing CreateTablet for tablet f389b12c6b304243905f28267dfaeed0 (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 14:54:10.756122 15249 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1075567fc91458ca7cc9977cf02b170. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:10.783710 15246 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc6f522768894933b21bc94b41605166. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:10.785929 15244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b5bb32eee204f2b90b1f1f14875c579. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:10.755034 15310 leader_election.cc:290] T 798d0882b1ea4b26b598c236de8f18c9 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177), eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805)
I20260709 14:54:10.787673 15019 tablet_service.cc:1511] Processing CreateTablet for tablet cc6f522768894933b21bc94b41605166 (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 14:54:10.730918 15100 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70bc59fabcdc4359a84d584f36d18d01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:10.789765 15094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1075567fc91458ca7cc9977cf02b170. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:10.791432 15102 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d61f9ecebc3c4a028f5327bc9debf432. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:10.774073 15025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70bc59fabcdc4359a84d584f36d18d01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:10.778357 15173 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 966a06ab56a6479283ab2818c9439d4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:10.760375 15311 tablet_bootstrap.cc:654] T 98280a706ec54413830f342b48666f6e P eaa34beb1b274443b1c46839afd0a484: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:10.735349 15168 tablet_service.cc:1511] Processing CreateTablet for tablet 70bc59fabcdc4359a84d584f36d18d01 (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 14:54:10.822489 15168 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70bc59fabcdc4359a84d584f36d18d01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:10.831266 15309 tablet_bootstrap.cc:654] T b8d6b9cf24a24444b2a69fd526cd4b09 P 7519e608fbb44d9db8ad30b9f10ae605: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:10.794376 15098 tablet_service.cc:1511] Processing CreateTablet for tablet 1159198eabeb409996ccbec0cac057f8 (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 14:54:10.841431 15099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca2aa2e1a8c646069cb8b23b0ebdb0c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:10.855449 15022 tablet_service.cc:1511] Processing CreateTablet for tablet 9275d24f141d455cb200b9784c470d33 (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 14:54:10.845321 15024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1159198eabeb409996ccbec0cac057f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:10.878408 15019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc6f522768894933b21bc94b41605166. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:10.885661 15098 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1159198eabeb409996ccbec0cac057f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:10.932649 15187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "798d0882b1ea4b26b598c236de8f18c9" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484" is_pre_election: true
I20260709 14:54:10.938109 15026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f389b12c6b304243905f28267dfaeed0. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 14:54:10.938854 15004 leader_election.cc:343] T 798d0882b1ea4b26b598c236de8f18c9 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:10.941175 15022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9275d24f141d455cb200b9784c470d33. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 14:54:10.951056 15064 tablet.cc:2406] T 798d0882b1ea4b26b598c236de8f18c9 P dbc2c92e49e346b5b3bd7705a229afc6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 14:54:10.961665 15096 tablet_service.cc:1511] Processing CreateTablet for tablet 6b5bb32eee204f2b90b1f1f14875c579 (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 14:54:10.963712 15096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b5bb32eee204f2b90b1f1f14875c579. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:10.982467 15176 tablet_service.cc:1511] Processing CreateTablet for tablet 6b5bb32eee204f2b90b1f1f14875c579 (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 14:54:10.990000 15113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "798d0882b1ea4b26b598c236de8f18c9" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605" is_pre_election: true
I20260709 14:54:10.991191 15097 tablet_service.cc:1511] Processing CreateTablet for tablet f389b12c6b304243905f28267dfaeed0 (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 14:54:10.994338 15097 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f389b12c6b304243905f28267dfaeed0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:11.004436 15247 tablet_service.cc:1511] Processing CreateTablet for tablet 9275d24f141d455cb200b9784c470d33 (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 14:54:11.006489 15307 tablet_bootstrap.cc:492] T 0284d9835221427ab285015d48a8040d P 9cb8de0701f2482b99e51d5ac080aa13: No bootstrap required, opened a new log
I20260709 14:54:11.009371 15176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b5bb32eee204f2b90b1f1f14875c579. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:11.158895 15170 tablet_service.cc:1511] Processing CreateTablet for tablet f389b12c6b304243905f28267dfaeed0 (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
W20260709 14:54:11.165992 14920 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.6.101.68:45493, user_credentials={real_user=slave}} blocked reactor thread for 71620.6us
I20260709 14:54:11.174167 15170 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f389b12c6b304243905f28267dfaeed0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:11.184389 15311 tablet_bootstrap.cc:492] T 98280a706ec54413830f342b48666f6e P eaa34beb1b274443b1c46839afd0a484: No bootstrap required, opened a new log
I20260709 14:54:11.185140 15311 ts_tablet_manager.cc:1403] T 98280a706ec54413830f342b48666f6e P eaa34beb1b274443b1c46839afd0a484: Time spent bootstrapping tablet: real 0.552s	user 0.024s	sys 0.018s
I20260709 14:54:11.189455 15311 raft_consensus.cc:359] T 98280a706ec54413830f342b48666f6e P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:11.190565 15311 raft_consensus.cc:385] T 98280a706ec54413830f342b48666f6e P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:11.190915 15311 raft_consensus.cc:740] T 98280a706ec54413830f342b48666f6e P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eaa34beb1b274443b1c46839afd0a484, State: Initialized, Role: FOLLOWER
I20260709 14:54:11.192078 15311 consensus_queue.cc:260] T 98280a706ec54413830f342b48666f6e P eaa34beb1b274443b1c46839afd0a484 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:11.194370 15247 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9275d24f141d455cb200b9784c470d33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:11.138072 15307 ts_tablet_manager.cc:1403] T 0284d9835221427ab285015d48a8040d P 9cb8de0701f2482b99e51d5ac080aa13: Time spent bootstrapping tablet: real 0.624s	user 0.026s	sys 0.009s
I20260709 14:54:11.214226 15251 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:51424 (request call id 12) took 1090 ms. Trace:
I20260709 14:54:11.215088 15251 rpcz_store.cc:276] 0709 14:54:10.124300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:54:10.401466 (+277166us) service_pool.cc:224] Handling call
0709 14:54:10.514322 (+112856us) spinlock_profiling.cc:243] Waited 1.62 ms on lock 0x7b5800054f98. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb687c29db1 00007fb687d69b71 00007fb687d69eee 000000000037fce9 00007fb68fddd1e0 00007fb68fec284c 00007fb68fe9fac3 00007fb68fe4e400 00007fb6892d3af4 00007fb6892d3a82 00007fb6892d39b1
0709 14:54:10.515018 (+   696us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 14:54:10.515106 (+    88us) ts_tablet_manager.cc:682] Creating new metadata...
0709 14:54:10.801141 (+286035us) tablet_metadata.cc:665] Metadata flushed
0709 14:54:11.213167 (+412026us) tablet_replica.cc:206] Creating consensus instance
0709 14:54:11.214106 (+   939us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3726720}
I20260709 14:54:11.219971 15251 tablet_service.cc:1511] Processing CreateTablet for tablet 42d6909533d14edbbfdad30a9972658d (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 14:54:11.231837 15251 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42d6909533d14edbbfdad30a9972658d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:11.238605 15307 raft_consensus.cc:359] T 0284d9835221427ab285015d48a8040d P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:11.247253 15245 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:51424 (request call id 14) took 1069 ms. Trace:
I20260709 14:54:11.248482 15173 tablet_service.cc:1511] Processing CreateTablet for tablet 42d6909533d14edbbfdad30a9972658d (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 14:54:11.256537 15173 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42d6909533d14edbbfdad30a9972658d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:11.249993 15307 raft_consensus.cc:385] T 0284d9835221427ab285015d48a8040d P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:11.258055 15307 raft_consensus.cc:740] T 0284d9835221427ab285015d48a8040d P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9cb8de0701f2482b99e51d5ac080aa13, State: Initialized, Role: FOLLOWER
I20260709 14:54:11.259644 15307 consensus_queue.cc:260] T 0284d9835221427ab285015d48a8040d P 9cb8de0701f2482b99e51d5ac080aa13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:11.253201 15243 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:51424 (request call id 13) took 1120 ms. Trace:
I20260709 14:54:11.250219 15245 rpcz_store.cc:276] 0709 14:54:10.177470 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:54:10.558067 (+380597us) service_pool.cc:224] Handling call
0709 14:54:10.560090 (+  2023us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 14:54:10.560213 (+   123us) ts_tablet_manager.cc:682] Creating new metadata...
0709 14:54:11.090597 (+530384us) tablet_metadata.cc:665] Metadata flushed
0709 14:54:11.246580 (+155983us) tablet_replica.cc:206] Creating consensus instance
0709 14:54:11.247174 (+   594us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 14:54:11.369696 15306 tablet_bootstrap.cc:700] T d6bcaee371174feaa06943f949efda49 P dbc2c92e49e346b5b3bd7705a229afc6: Time spent opening tablet: real 0.149s	user 0.004s	sys 0.000s
I20260709 14:54:11.371050 15306 tablet_bootstrap.cc:654] T d6bcaee371174feaa06943f949efda49 P dbc2c92e49e346b5b3bd7705a229afc6: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:11.368952 15307 ts_tablet_manager.cc:1434] T 0284d9835221427ab285015d48a8040d P 9cb8de0701f2482b99e51d5ac080aa13: Time spent starting tablet: real 0.155s	user 0.013s	sys 0.000s
W20260709 14:54:11.367246 14923 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.6.101.65:45477, user_credentials={real_user=slave}} blocked reactor thread for 101220us
I20260709 14:54:11.367141 15243 rpcz_store.cc:276] 0709 14:54:10.132787 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:54:10.442980 (+310193us) service_pool.cc:224] Handling call
0709 14:54:10.514524 (+ 71544us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 14:54:10.514679 (+   155us) ts_tablet_manager.cc:682] Creating new metadata...
0709 14:54:10.931221 (+416542us) tablet_metadata.cc:665] Metadata flushed
0709 14:54:11.168968 (+237747us) tablet_replica.cc:206] Creating consensus instance
0709 14:54:11.253122 (+ 84154us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 14:54:11.369695 15249 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:51424 (request call id 15) took 1157 ms. Trace:
I20260709 14:54:11.604247 15307 tablet_bootstrap.cc:492] T 6cd07fbeb9f149a08fdbac2e0247eca4 P 9cb8de0701f2482b99e51d5ac080aa13: Bootstrap starting.
I20260709 14:54:11.634560 15311 ts_tablet_manager.cc:1434] T 98280a706ec54413830f342b48666f6e P eaa34beb1b274443b1c46839afd0a484: Time spent starting tablet: real 0.449s	user 0.026s	sys 0.043s
I20260709 14:54:11.636214 15320 raft_consensus.cc:493] T 98280a706ec54413830f342b48666f6e P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:11.637094 15320 raft_consensus.cc:515] T 98280a706ec54413830f342b48666f6e P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:11.644177 15320 leader_election.cc:290] T 98280a706ec54413830f342b48666f6e P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493), dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477)
I20260709 14:54:11.617901 15321 raft_consensus.cc:493] T 0284d9835221427ab285015d48a8040d P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:11.647746 15321 raft_consensus.cc:515] T 0284d9835221427ab285015d48a8040d P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:11.593844 15249 rpcz_store.cc:276] 0709 14:54:10.212354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:54:10.568630 (+356276us) service_pool.cc:224] Handling call
0709 14:54:10.697888 (+129258us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 14:54:10.698014 (+   126us) ts_tablet_manager.cc:682] Creating new metadata...
0709 14:54:10.910037 (+212023us) tablet_metadata.cc:665] Metadata flushed
0709 14:54:11.368884 (+458847us) tablet_replica.cc:206] Creating consensus instance
0709 14:54:11.369605 (+   721us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 14:54:11.672902 15306 tablet_bootstrap.cc:492] T d6bcaee371174feaa06943f949efda49 P dbc2c92e49e346b5b3bd7705a229afc6: No bootstrap required, opened a new log
I20260709 14:54:11.674068 15306 ts_tablet_manager.cc:1403] T d6bcaee371174feaa06943f949efda49 P dbc2c92e49e346b5b3bd7705a229afc6: Time spent bootstrapping tablet: real 0.905s	user 0.030s	sys 0.009s
I20260709 14:54:11.678644 15306 raft_consensus.cc:359] T d6bcaee371174feaa06943f949efda49 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:11.679965 15306 raft_consensus.cc:385] T d6bcaee371174feaa06943f949efda49 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:11.680454 15306 raft_consensus.cc:740] T d6bcaee371174feaa06943f949efda49 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbc2c92e49e346b5b3bd7705a229afc6, State: Initialized, Role: FOLLOWER
I20260709 14:54:11.669783 15172 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:52576 (request call id 12) took 1259 ms. Trace:
I20260709 14:54:11.654934 15321 leader_election.cc:290] T 0284d9835221427ab285015d48a8040d P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477), 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177)
I20260709 14:54:11.679423 15242 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:51424 (request call id 16) took 1396 ms. Trace:
I20260709 14:54:11.683727 15311 tablet_bootstrap.cc:492] T 798d0882b1ea4b26b598c236de8f18c9 P eaa34beb1b274443b1c46839afd0a484: Bootstrap starting.
I20260709 14:54:11.691524 15171 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:52576 (request call id 17) took 1217 ms. Trace:
I20260709 14:54:11.683990 15242 rpcz_store.cc:276] 0709 14:54:10.282912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:54:10.574367 (+291455us) service_pool.cc:224] Handling call
0709 14:54:10.576806 (+  2439us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 14:54:10.576952 (+   146us) ts_tablet_manager.cc:682] Creating new metadata...
0709 14:54:11.158413 (+581461us) tablet_metadata.cc:665] Metadata flushed
0709 14:54:11.649207 (+490794us) tablet_replica.cc:206] Creating consensus instance
0709 14:54:11.679337 (+ 30130us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 14:54:11.697714 15307 tablet_bootstrap.cc:654] T 6cd07fbeb9f149a08fdbac2e0247eca4 P 9cb8de0701f2482b99e51d5ac080aa13: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:11.715431 15244 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:51424 (request call id 20) took 1038 ms. Trace:
I20260709 14:54:11.731361 15244 rpcz_store.cc:276] 0709 14:54:10.677182 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:54:10.684417 (+  7235us) service_pool.cc:224] Handling call
0709 14:54:10.717582 (+ 33165us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 14:54:10.717687 (+   105us) ts_tablet_manager.cc:682] Creating new metadata...
0709 14:54:11.215579 (+497892us) tablet_metadata.cc:665] Metadata flushed
0709 14:54:11.700505 (+484926us) tablet_replica.cc:206] Creating consensus instance
0709 14:54:11.715316 (+ 14811us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 14:54:11.718969 15019 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:34134 (request call id 20) took 1017 ms. Trace:
I20260709 14:54:11.681690 15172 rpcz_store.cc:276] 0709 14:54:10.407114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:54:10.602926 (+195812us) service_pool.cc:224] Handling call
0709 14:54:10.642808 (+ 39882us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 14:54:10.642929 (+   121us) ts_tablet_manager.cc:682] Creating new metadata...
0709 14:54:10.981785 (+338856us) tablet_metadata.cc:665] Metadata flushed
0709 14:54:11.597288 (+615503us) tablet_replica.cc:206] Creating consensus instance
0709 14:54:11.666654 (+ 69366us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6894}
W20260709 14:54:11.705323 15248 consensus_meta.cc:287] T 1159198eabeb409996ccbec0cac057f8 P 9cb8de0701f2482b99e51d5ac080aa13: Time spent flushing consensus metadata: real 0.549s	user 0.013s	sys 0.000s
I20260709 14:54:11.682061 15306 consensus_queue.cc:260] T d6bcaee371174feaa06943f949efda49 P dbc2c92e49e346b5b3bd7705a229afc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:11.703653 15171 rpcz_store.cc:276] 0709 14:54:10.474306 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:54:10.699537 (+225231us) service_pool.cc:224] Handling call
0709 14:54:10.741534 (+ 41997us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 14:54:10.741647 (+   113us) ts_tablet_manager.cc:682] Creating new metadata...
0709 14:54:11.243997 (+502350us) tablet_metadata.cc:665] Metadata flushed
0709 14:54:11.690846 (+446849us) tablet_replica.cc:206] Creating consensus instance
0709 14:54:11.691447 (+   601us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 14:54:11.733677 15311 tablet_bootstrap.cc:654] T 798d0882b1ea4b26b598c236de8f18c9 P eaa34beb1b274443b1c46839afd0a484: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:11.742523 15248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:51424 (request call id 18) took 1276 ms. Trace:
I20260709 14:54:11.743193 15248 rpcz_store.cc:276] 0709 14:54:10.466601 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:54:10.645012 (+178411us) service_pool.cc:224] Handling call
0709 14:54:10.695462 (+ 50450us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 14:54:10.695602 (+   140us) ts_tablet_manager.cc:682] Creating new metadata...
0709 14:54:11.090703 (+395101us) tablet_metadata.cc:665] Metadata flushed
0709 14:54:11.740806 (+650103us) tablet_replica.cc:206] Creating consensus instance
0709 14:54:11.742438 (+  1632us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 14:54:11.736209 15019 rpcz_store.cc:276] 0709 14:54:10.701716 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:54:10.705751 (+  4035us) service_pool.cc:224] Handling call
0709 14:54:10.834912 (+129161us) spinlock_profiling.cc:243] Waited 2.99 ms on lock 0x7b5800004298. stack: 00007fb687d6f343 00007fb687d6f240 00007fb6876fe1d4 00007fb69143c304 00007fb69143c299 00007fb687c29db1 00007fb687d69e9c 00007fb687d69a5b 00007fb690c82c09 00007fb68fddcee0 00007fb68fec2831 00007fb68fe9fac3 00007fb68fe4e400 00007fb6892d3af4 00007fb6892d3a82 00007fb6892d39b1
0709 14:54:10.844733 (+  9821us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 14:54:10.857321 (+ 12588us) ts_tablet_manager.cc:682] Creating new metadata...
0709 14:54:11.695586 (+838265us) tablet_metadata.cc:665] Metadata flushed
0709 14:54:11.718113 (+ 22527us) tablet_replica.cc:206] Creating consensus instance
0709 14:54:11.718878 (+   765us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6877440}
W20260709 14:54:11.779488 15309 thread.cc:641] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.932s	user 0.006s	sys 0.014s
W20260709 14:54:11.780179 15309 thread.cc:608] log-alloc [worker] (thread pool) Time spent starting thread: real 0.933s	user 0.006s	sys 0.014s
I20260709 14:54:11.790729 15309 tablet_bootstrap.cc:492] T b8d6b9cf24a24444b2a69fd526cd4b09 P 7519e608fbb44d9db8ad30b9f10ae605: No bootstrap required, opened a new log
I20260709 14:54:11.791522 15309 ts_tablet_manager.cc:1403] T b8d6b9cf24a24444b2a69fd526cd4b09 P 7519e608fbb44d9db8ad30b9f10ae605: Time spent bootstrapping tablet: real 1.177s	user 0.022s	sys 0.014s
I20260709 14:54:11.794060 15247 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:51424 (request call id 21) took 1116 ms. Trace:
W20260709 14:54:11.811729 15028 consensus_meta.cc:287] T 966a06ab56a6479283ab2818c9439d4f P dbc2c92e49e346b5b3bd7705a229afc6: Time spent flushing consensus metadata: real 0.812s	user 0.012s	sys 0.004s
I20260709 14:54:11.816237 15261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98280a706ec54413830f342b48666f6e" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13" is_pre_election: true
W20260709 14:54:11.817992 15001 leader_election.cc:343] T 798d0882b1ea4b26b598c236de8f18c9 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:11.822705 15001 leader_election.cc:304] T 798d0882b1ea4b26b598c236de8f18c9 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbc2c92e49e346b5b3bd7705a229afc6; no voters: 7519e608fbb44d9db8ad30b9f10ae605, eaa34beb1b274443b1c46839afd0a484
I20260709 14:54:11.820580 15306 ts_tablet_manager.cc:1434] T d6bcaee371174feaa06943f949efda49 P dbc2c92e49e346b5b3bd7705a229afc6: Time spent starting tablet: real 0.146s	user 0.037s	sys 0.045s
W20260709 14:54:11.824365 15150 leader_election.cc:343] T 98280a706ec54413830f342b48666f6e P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:11.824995 15247 rpcz_store.cc:276] 0709 14:54:10.677634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:54:11.002987 (+325353us) service_pool.cc:224] Handling call
0709 14:54:11.132395 (+129408us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 14:54:11.193782 (+ 61387us) ts_tablet_manager.cc:682] Creating new metadata...
0709 14:54:11.631392 (+437610us) tablet_metadata.cc:665] Metadata flushed
0709 14:54:11.793117 (+161725us) tablet_replica.cc:206] Creating consensus instance
0709 14:54:11.793975 (+   858us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 14:54:11.837139 15309 raft_consensus.cc:359] T b8d6b9cf24a24444b2a69fd526cd4b09 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:11.838465 15309 raft_consensus.cc:385] T b8d6b9cf24a24444b2a69fd526cd4b09 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:11.838848 15309 raft_consensus.cc:740] T b8d6b9cf24a24444b2a69fd526cd4b09 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7519e608fbb44d9db8ad30b9f10ae605, State: Initialized, Role: FOLLOWER
I20260709 14:54:11.840288 15306 tablet_bootstrap.cc:492] T 98280a706ec54413830f342b48666f6e P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap starting.
I20260709 14:54:11.915196 15309 consensus_queue.cc:260] T b8d6b9cf24a24444b2a69fd526cd4b09 P 7519e608fbb44d9db8ad30b9f10ae605 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:11.918790 15101 tablet_service.cc:1511] Processing CreateTablet for tablet 9275d24f141d455cb200b9784c470d33 (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 14:54:11.858536 15028 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:34134 (request call id 15) took 1442 ms. Trace:
I20260709 14:54:11.922784 15028 rpcz_store.cc:276] 0709 14:54:10.416545 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:54:10.418056 (+  1511us) service_pool.cc:224] Handling call
0709 14:54:10.495692 (+ 77636us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 14:54:10.503871 (+  8179us) ts_tablet_manager.cc:682] Creating new metadata...
0709 14:54:10.999685 (+495814us) tablet_metadata.cc:665] Metadata flushed
0709 14:54:11.829385 (+829700us) tablet_replica.cc:206] Creating consensus instance
0709 14:54:11.848460 (+ 19075us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 14:54:11.937129 15101 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9275d24f141d455cb200b9784c470d33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:11.944133 15307 tablet_bootstrap.cc:492] T 6cd07fbeb9f149a08fdbac2e0247eca4 P 9cb8de0701f2482b99e51d5ac080aa13: No bootstrap required, opened a new log
I20260709 14:54:11.834254 15331 raft_consensus.cc:2749] T 798d0882b1ea4b26b598c236de8f18c9 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:54:11.980588 15306 tablet_bootstrap.cc:654] T 98280a706ec54413830f342b48666f6e P dbc2c92e49e346b5b3bd7705a229afc6: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:11.988876 15311 tablet_bootstrap.cc:492] T 798d0882b1ea4b26b598c236de8f18c9 P eaa34beb1b274443b1c46839afd0a484: No bootstrap required, opened a new log
I20260709 14:54:11.990172 15311 ts_tablet_manager.cc:1403] T 798d0882b1ea4b26b598c236de8f18c9 P eaa34beb1b274443b1c46839afd0a484: Time spent bootstrapping tablet: real 0.332s	user 0.024s	sys 0.043s
I20260709 14:54:11.995319 15311 raft_consensus.cc:359] T 798d0882b1ea4b26b598c236de8f18c9 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:11.996721 15311 raft_consensus.cc:385] T 798d0882b1ea4b26b598c236de8f18c9 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:11.997612 15311 raft_consensus.cc:740] T 798d0882b1ea4b26b598c236de8f18c9 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eaa34beb1b274443b1c46839afd0a484, State: Initialized, Role: FOLLOWER
I20260709 14:54:11.999081 15311 consensus_queue.cc:260] T 798d0882b1ea4b26b598c236de8f18c9 P eaa34beb1b274443b1c46839afd0a484 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:12.003638 15311 ts_tablet_manager.cc:1434] T 798d0882b1ea4b26b598c236de8f18c9 P eaa34beb1b274443b1c46839afd0a484: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.005s
I20260709 14:54:12.005568 15311 tablet_bootstrap.cc:492] T 6cd07fbeb9f149a08fdbac2e0247eca4 P eaa34beb1b274443b1c46839afd0a484: Bootstrap starting.
I20260709 14:54:12.011062 14935 rpcz_store.cc:275] Call kudu.master.MasterService.IsCreateTableDone from 127.0.0.1:54034 (request call id 26) took 1184 ms. Trace:
I20260709 14:54:12.011874 14935 rpcz_store.cc:276] 0709 14:54:10.826168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:54:10.826331 (+   163us) service_pool.cc:224] Handling call
0709 14:54:10.826732 (+   401us) catalog_manager.cc:2419] Looking up, locking, and authorizing table
0709 14:54:12.010519 (+1183787us) catalog_manager.cc:2317] Verify if the table creation is in progress for test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]
0709 14:54:12.010761 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1183280}
I20260709 14:54:12.015793 15311 tablet_bootstrap.cc:654] T 6cd07fbeb9f149a08fdbac2e0247eca4 P eaa34beb1b274443b1c46839afd0a484: Neither blocks nor log segments found. Creating new log.
W20260709 14:54:12.019783 14984 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 14:54:12.031332 15021 consensus_meta.cc:287] T d86dfc13b2834d7e8b2ad5f975f08154 P dbc2c92e49e346b5b3bd7705a229afc6: Time spent flushing consensus metadata: real 1.052s	user 0.024s	sys 0.002s
I20260709 14:54:12.095254 15095 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:51792 (request call id 12) took 1804 ms. Trace:
I20260709 14:54:12.095975 15095 rpcz_store.cc:276] 0709 14:54:10.290947 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:54:10.578729 (+287782us) service_pool.cc:224] Handling call
0709 14:54:10.593721 (+ 14992us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 14:54:10.604475 (+ 10754us) ts_tablet_manager.cc:682] Creating new metadata...
0709 14:54:11.926072 (+1321597us) tablet_metadata.cc:665] Metadata flushed
0709 14:54:12.094531 (+168459us) tablet_replica.cc:206] Creating consensus instance
0709 14:54:12.095142 (+   611us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 14:54:12.122627 15335 raft_consensus.cc:493] T b8d6b9cf24a24444b2a69fd526cd4b09 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:12.123535 15335 raft_consensus.cc:515] T b8d6b9cf24a24444b2a69fd526cd4b09 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:12.108675 15021 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:34134 (request call id 17) took 1637 ms. Trace:
I20260709 14:54:12.130957 15021 rpcz_store.cc:276] 0709 14:54:10.470641 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:54:10.480033 (+  9392us) service_pool.cc:224] Handling call
0709 14:54:10.629637 (+149604us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 14:54:10.656170 (+ 26533us) ts_tablet_manager.cc:682] Creating new metadata...
0709 14:54:10.978567 (+322397us) tablet_metadata.cc:665] Metadata flushed
0709 14:54:12.032194 (+1053627us) tablet_replica.cc:206] Creating consensus instance
0709 14:54:12.107848 (+ 75654us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 14:54:12.163414 15335 leader_election.cc:290] T b8d6b9cf24a24444b2a69fd526cd4b09 P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805), 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493)
I20260709 14:54:12.220125 15101 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:51792 (request call id 22) took 1493 ms. Trace:
I20260709 14:54:12.240242 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0284d9835221427ab285015d48a8040d" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" is_pre_election: true
I20260709 14:54:12.268496 15021 tablet_service.cc:1511] Processing CreateTablet for tablet 42d6909533d14edbbfdad30a9972658d (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 14:54:12.270260 15021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42d6909533d14edbbfdad30a9972658d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 14:54:12.274829 15227 leader_election.cc:343] T 0284d9835221427ab285015d48a8040d P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:12.220775 15101 rpcz_store.cc:276] 0709 14:54:10.726466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:54:11.180780 (+454314us) service_pool.cc:224] Handling call
0709 14:54:11.936406 (+755626us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 14:54:11.936540 (+   134us) ts_tablet_manager.cc:682] Creating new metadata...
0709 14:54:12.098046 (+161506us) tablet_metadata.cc:665] Metadata flushed
0709 14:54:12.219387 (+121341us) tablet_replica.cc:206] Creating consensus instance
0709 14:54:12.220032 (+   645us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 14:54:12.309288 15024 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:34134 (request call id 19) took 1614 ms. Trace:
I20260709 14:54:12.310016 15024 rpcz_store.cc:276] 0709 14:54:10.694689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:54:10.733546 (+ 38857us) service_pool.cc:224] Handling call
0709 14:54:10.770068 (+ 36522us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 14:54:10.770193 (+   125us) ts_tablet_manager.cc:682] Creating new metadata...
0709 14:54:11.993125 (+1222932us) tablet_metadata.cc:665] Metadata flushed
0709 14:54:12.308079 (+314954us) tablet_replica.cc:206] Creating consensus instance
0709 14:54:12.309078 (+   999us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 14:54:12.330847 15098 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:51792 (request call id 19) took 1825 ms. Trace:
I20260709 14:54:12.331665 15096 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:51792 (request call id 20) took 1696 ms. Trace:
I20260709 14:54:12.337936 15096 rpcz_store.cc:276] 0709 14:54:10.635730 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:54:10.947673 (+311943us) service_pool.cc:224] Handling call
0709 14:54:10.963023 (+ 15350us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 14:54:10.963174 (+   151us) ts_tablet_manager.cc:682] Creating new metadata...
0709 14:54:12.190453 (+1227279us) tablet_metadata.cc:665] Metadata flushed
0709 14:54:12.330620 (+140167us) tablet_replica.cc:206] Creating consensus instance
0709 14:54:12.331590 (+   970us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 14:54:12.336823 15098 rpcz_store.cc:276] 0709 14:54:10.513151 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:54:10.745622 (+232471us) service_pool.cc:224] Handling call
0709 14:54:10.834723 (+ 89101us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 14:54:10.834852 (+   129us) ts_tablet_manager.cc:682] Creating new metadata...
0709 14:54:12.210728 (+1375876us) tablet_metadata.cc:665] Metadata flushed
0709 14:54:12.330172 (+119444us) tablet_replica.cc:206] Creating consensus instance
0709 14:54:12.330761 (+   589us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 14:54:12.340788 15100 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:51792 (request call id 18) took 1902 ms. Trace:
I20260709 14:54:12.342944 15100 rpcz_store.cc:276] 0709 14:54:10.438620 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:54:10.691304 (+252684us) service_pool.cc:224] Handling call
0709 14:54:10.730197 (+ 38893us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 14:54:10.730278 (+    81us) ts_tablet_manager.cc:682] Creating new metadata...
0709 14:54:12.276425 (+1546147us) tablet_metadata.cc:665] Metadata flushed
0709 14:54:12.323674 (+ 47249us) tablet_replica.cc:206] Creating consensus instance
0709 14:54:12.329305 (+  5631us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 14:54:12.354241 15100 tablet_service.cc:1511] Processing CreateTablet for tablet 0b12879f49fa4d52a477be2e490f2b38 (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 14:54:12.356734 15100 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b12879f49fa4d52a477be2e490f2b38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:12.427511 15022 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:34134 (request call id 22) took 1574 ms. Trace:
I20260709 14:54:12.428051 15022 rpcz_store.cc:276] 0709 14:54:10.853693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:54:10.853952 (+   259us) service_pool.cc:224] Handling call
0709 14:54:10.901991 (+ 48039us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 14:54:10.917512 (+ 15521us) ts_tablet_manager.cc:682] Creating new metadata...
0709 14:54:12.342304 (+1424792us) tablet_metadata.cc:665] Metadata flushed
0709 14:54:12.426866 (+ 84562us) tablet_replica.cc:206] Creating consensus instance
0709 14:54:12.427432 (+   566us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 14:54:12.432276 15102 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:51792 (request call id 13) took 2141 ms. Trace:
I20260709 14:54:12.432876 15102 rpcz_store.cc:276] 0709 14:54:10.291312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:54:10.622887 (+331575us) service_pool.cc:224] Handling call
0709 14:54:10.740651 (+117764us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 14:54:10.740792 (+   141us) ts_tablet_manager.cc:682] Creating new metadata...
0709 14:54:12.420048 (+1679256us) tablet_metadata.cc:665] Metadata flushed
0709 14:54:12.430994 (+ 10946us) tablet_replica.cc:206] Creating consensus instance
0709 14:54:12.432188 (+  1194us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2071}
W20260709 14:54:12.435494 15309 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.030s	sys 0.084s
W20260709 14:54:12.436035 15309 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.516s	user 0.030s	sys 0.084s
I20260709 14:54:12.437835 15309 ts_tablet_manager.cc:1434] T b8d6b9cf24a24444b2a69fd526cd4b09 P 7519e608fbb44d9db8ad30b9f10ae605: Time spent starting tablet: real 0.646s	user 0.040s	sys 0.086s
W20260709 14:54:12.438381 15309 ts_tablet_manager.cc:1467] T b8d6b9cf24a24444b2a69fd526cd4b09 P 7519e608fbb44d9db8ad30b9f10ae605: Tablet startup took 646ms
I20260709 14:54:12.438489 15094 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:51792 (request call id 16) took 2110 ms. Trace:
I20260709 14:54:12.439023 15094 rpcz_store.cc:276] 0709 14:54:10.328575 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:54:10.660927 (+332352us) service_pool.cc:224] Handling call
0709 14:54:10.716201 (+ 55274us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 14:54:10.716545 (+   344us) ts_tablet_manager.cc:682] Creating new metadata...
0709 14:54:12.415468 (+1698923us) tablet_metadata.cc:665] Metadata flushed
0709 14:54:12.437701 (+ 22233us) tablet_replica.cc:206] Creating consensus instance
0709 14:54:12.438412 (+   711us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 14:54:12.438889 15309 ts_tablet_manager.cc:1469] T b8d6b9cf24a24444b2a69fd526cd4b09 P 7519e608fbb44d9db8ad30b9f10ae605: Trace:
0709 14:54:10.284417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:54:10.284573 (+   156us) service_pool.cc:224] Handling call
0709 14:54:10.317774 (+ 33201us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 14:54:10.317885 (+   111us) ts_tablet_manager.cc:682] Creating new metadata...
0709 14:54:10.403551 (+ 85666us) tablet_metadata.cc:665] Metadata flushed
0709 14:54:10.463140 (+ 59589us) tablet_replica.cc:206] Creating consensus instance
0709 14:54:10.537379 (+ 74239us) inbound_call.cc:177] Queueing success response
0709 14:54:10.610187 (+ 72808us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 14:54:11.792082 (+1181895us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 14:54:11.793055 (+   973us) tablet_replica.cc:261] Starting instrumentation
0709 14:54:11.820211 (+ 27156us) tablet_replica.cc:280] Starting consensus
Metrics: {"raft.queue_time_us":248086,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":141,"tablet-open.queue_time_us":146435,"thread_start_us":563393,"threads_started":2}
I20260709 14:54:12.442761 15309 tablet_bootstrap.cc:492] T d354c94548fc411ab62b4281ed947944 P 7519e608fbb44d9db8ad30b9f10ae605: Bootstrap starting.
I20260709 14:54:12.443778 15311 tablet_bootstrap.cc:492] T 6cd07fbeb9f149a08fdbac2e0247eca4 P eaa34beb1b274443b1c46839afd0a484: No bootstrap required, opened a new log
I20260709 14:54:12.444499 15311 ts_tablet_manager.cc:1403] T 6cd07fbeb9f149a08fdbac2e0247eca4 P eaa34beb1b274443b1c46839afd0a484: Time spent bootstrapping tablet: real 0.439s	user 0.025s	sys 0.001s
I20260709 14:54:12.444831 15331 raft_consensus.cc:493] T d6bcaee371174feaa06943f949efda49 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:12.445463 15331 raft_consensus.cc:515] T d6bcaee371174feaa06943f949efda49 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:12.448104 15331 leader_election.cc:290] T d6bcaee371174feaa06943f949efda49 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805), 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493)
I20260709 14:54:12.448120 15306 tablet_bootstrap.cc:492] T 98280a706ec54413830f342b48666f6e P dbc2c92e49e346b5b3bd7705a229afc6: No bootstrap required, opened a new log
I20260709 14:54:12.449566 15311 raft_consensus.cc:359] T 6cd07fbeb9f149a08fdbac2e0247eca4 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:12.449921 15306 ts_tablet_manager.cc:1403] T 98280a706ec54413830f342b48666f6e P dbc2c92e49e346b5b3bd7705a229afc6: Time spent bootstrapping tablet: real 0.610s	user 0.058s	sys 0.060s
I20260709 14:54:12.453980 15306 raft_consensus.cc:359] T 98280a706ec54413830f342b48666f6e P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:12.454861 15306 raft_consensus.cc:385] T 98280a706ec54413830f342b48666f6e P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:12.455194 15306 raft_consensus.cc:740] T 98280a706ec54413830f342b48666f6e P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbc2c92e49e346b5b3bd7705a229afc6, State: Initialized, Role: FOLLOWER
I20260709 14:54:12.455523 15309 tablet_bootstrap.cc:654] T d354c94548fc411ab62b4281ed947944 P 7519e608fbb44d9db8ad30b9f10ae605: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:12.456044 15306 consensus_queue.cc:260] T 98280a706ec54413830f342b48666f6e P dbc2c92e49e346b5b3bd7705a229afc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:12.457461 15311 raft_consensus.cc:385] T 6cd07fbeb9f149a08fdbac2e0247eca4 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:12.457907 15311 raft_consensus.cc:740] T 6cd07fbeb9f149a08fdbac2e0247eca4 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eaa34beb1b274443b1c46839afd0a484, State: Initialized, Role: FOLLOWER
I20260709 14:54:12.458694 15306 ts_tablet_manager.cc:1434] T 98280a706ec54413830f342b48666f6e P dbc2c92e49e346b5b3bd7705a229afc6: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 14:54:12.459121 15311 consensus_queue.cc:260] T 6cd07fbeb9f149a08fdbac2e0247eca4 P eaa34beb1b274443b1c46839afd0a484 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:12.460212 15306 tablet_bootstrap.cc:492] T d354c94548fc411ab62b4281ed947944 P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap starting.
I20260709 14:54:12.462424 15311 ts_tablet_manager.cc:1434] T 6cd07fbeb9f149a08fdbac2e0247eca4 P eaa34beb1b274443b1c46839afd0a484: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.007s
I20260709 14:54:12.463738 15311 tablet_bootstrap.cc:492] T d6bcaee371174feaa06943f949efda49 P eaa34beb1b274443b1c46839afd0a484: Bootstrap starting.
I20260709 14:54:12.519078 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98280a706ec54413830f342b48666f6e" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" is_pre_election: true
I20260709 14:54:12.523463 15322 raft_consensus.cc:493] T 798d0882b1ea4b26b598c236de8f18c9 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:12.524230 15038 raft_consensus.cc:2468] T 98280a706ec54413830f342b48666f6e P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa34beb1b274443b1c46839afd0a484 in term 0.
I20260709 14:54:12.525328 15322 raft_consensus.cc:515] T 798d0882b1ea4b26b598c236de8f18c9 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:12.532398 15187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6bcaee371174feaa06943f949efda49" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484" is_pre_election: true
W20260709 14:54:12.536334 15004 leader_election.cc:343] T d6bcaee371174feaa06943f949efda49 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:12.538723 15113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0284d9835221427ab285015d48a8040d" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605" is_pre_election: true
I20260709 14:54:12.542032 15322 leader_election.cc:290] T 798d0882b1ea4b26b598c236de8f18c9 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477), 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177)
I20260709 14:54:12.545847 15261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8d6b9cf24a24444b2a69fd526cd4b09" candidate_uuid: "7519e608fbb44d9db8ad30b9f10ae605" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13" is_pre_election: true
W20260709 14:54:12.551391 15224 leader_election.cc:343] T 0284d9835221427ab285015d48a8040d P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:12.552552 15224 leader_election.cc:304] T 0284d9835221427ab285015d48a8040d P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cb8de0701f2482b99e51d5ac080aa13; no voters: 7519e608fbb44d9db8ad30b9f10ae605, dbc2c92e49e346b5b3bd7705a229afc6
I20260709 14:54:12.561758 15311 tablet_bootstrap.cc:654] T d6bcaee371174feaa06943f949efda49 P eaa34beb1b274443b1c46839afd0a484: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:12.528363 15153 leader_election.cc:304] T 98280a706ec54413830f342b48666f6e P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dbc2c92e49e346b5b3bd7705a229afc6, eaa34beb1b274443b1c46839afd0a484; no voters: 9cb8de0701f2482b99e51d5ac080aa13
I20260709 14:54:12.568094 15306 tablet_bootstrap.cc:654] T d354c94548fc411ab62b4281ed947944 P dbc2c92e49e346b5b3bd7705a229afc6: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:12.569736 15322 raft_consensus.cc:2804] T 98280a706ec54413830f342b48666f6e P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:54:12.570547 15322 raft_consensus.cc:493] T 98280a706ec54413830f342b48666f6e P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:54:12.570976 15322 raft_consensus.cc:3060] T 98280a706ec54413830f342b48666f6e P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:12.572866 15309 tablet_bootstrap.cc:492] T d354c94548fc411ab62b4281ed947944 P 7519e608fbb44d9db8ad30b9f10ae605: No bootstrap required, opened a new log
I20260709 14:54:12.574556 15309 ts_tablet_manager.cc:1403] T d354c94548fc411ab62b4281ed947944 P 7519e608fbb44d9db8ad30b9f10ae605: Time spent bootstrapping tablet: real 0.132s	user 0.016s	sys 0.006s
W20260709 14:54:12.576531 15076 leader_election.cc:343] T b8d6b9cf24a24444b2a69fd526cd4b09 P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:12.580113 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "798d0882b1ea4b26b598c236de8f18c9" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" is_pre_election: true
I20260709 14:54:12.582094 15038 raft_consensus.cc:2468] T 798d0882b1ea4b26b598c236de8f18c9 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa34beb1b274443b1c46839afd0a484 in term 0.
I20260709 14:54:12.592876 15309 raft_consensus.cc:359] T d354c94548fc411ab62b4281ed947944 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:12.594274 15309 raft_consensus.cc:385] T d354c94548fc411ab62b4281ed947944 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:12.594703 15309 raft_consensus.cc:740] T d354c94548fc411ab62b4281ed947944 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7519e608fbb44d9db8ad30b9f10ae605, State: Initialized, Role: FOLLOWER
I20260709 14:54:12.597036 15153 leader_election.cc:304] T 798d0882b1ea4b26b598c236de8f18c9 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dbc2c92e49e346b5b3bd7705a229afc6, eaa34beb1b274443b1c46839afd0a484; no voters: 
I20260709 14:54:12.600731 15309 consensus_queue.cc:260] T d354c94548fc411ab62b4281ed947944 P 7519e608fbb44d9db8ad30b9f10ae605 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
W20260709 14:54:12.634732 15224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:43177, user_credentials={real_user=slave}} blocked reactor thread for 83856.9us
I20260709 14:54:12.631254 15346 raft_consensus.cc:2749] T 0284d9835221427ab285015d48a8040d P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:54:12.638201 15336 raft_consensus.cc:493] T d354c94548fc411ab62b4281ed947944 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:12.639060 15336 raft_consensus.cc:515] T d354c94548fc411ab62b4281ed947944 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:12.641608 15309 ts_tablet_manager.cc:1434] T d354c94548fc411ab62b4281ed947944 P 7519e608fbb44d9db8ad30b9f10ae605: Time spent starting tablet: real 0.066s	user 0.018s	sys 0.001s
I20260709 14:54:12.654481 15349 raft_consensus.cc:2804] T 798d0882b1ea4b26b598c236de8f18c9 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:54:11.945171 15307 ts_tablet_manager.cc:1403] T 6cd07fbeb9f149a08fdbac2e0247eca4 P 9cb8de0701f2482b99e51d5ac080aa13: Time spent bootstrapping tablet: real 0.394s	user 0.010s	sys 0.031s
I20260709 14:54:12.662249 15349 raft_consensus.cc:493] T 798d0882b1ea4b26b598c236de8f18c9 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:54:12.663415 15349 raft_consensus.cc:3060] T 798d0882b1ea4b26b598c236de8f18c9 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:12.667034 14934 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53982 (request call id 4) took 1836 ms. Trace:
I20260709 14:54:12.643011 15336 leader_election.cc:290] T d354c94548fc411ab62b4281ed947944 P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477), eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805)
I20260709 14:54:12.661481 15309 tablet_bootstrap.cc:492] T 7699ad132e12472180b6a9527951c397 P 7519e608fbb44d9db8ad30b9f10ae605: Bootstrap starting.
I20260709 14:54:12.665100 14936 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54022 (request call id 2) took 1980 ms. Trace:
I20260709 14:54:12.676676 15311 tablet_bootstrap.cc:492] T d6bcaee371174feaa06943f949efda49 P eaa34beb1b274443b1c46839afd0a484: No bootstrap required, opened a new log
I20260709 14:54:12.678087 15307 raft_consensus.cc:359] T 6cd07fbeb9f149a08fdbac2e0247eca4 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:12.659994 15322 raft_consensus.cc:515] T 98280a706ec54413830f342b48666f6e P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:12.687842 15311 ts_tablet_manager.cc:1403] T d6bcaee371174feaa06943f949efda49 P eaa34beb1b274443b1c46839afd0a484: Time spent bootstrapping tablet: real 0.224s	user 0.015s	sys 0.020s
I20260709 14:54:12.690732 15170 tablet_service.cc:1511] Processing CreateTablet for tablet 0b12879f49fa4d52a477be2e490f2b38 (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 14:54:12.693869 15170 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b12879f49fa4d52a477be2e490f2b38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:12.694964 15026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:34134 (request call id 21) took 1953 ms. Trace:
I20260709 14:54:12.667654 14934 rpcz_store.cc:276] 0709 14:54:10.830974 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:54:10.831248 (+   274us) service_pool.cc:224] Handling call
0709 14:54:12.666785 (+1835537us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1592293,"reported_tablets":1}
I20260709 14:54:12.700279 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98280a706ec54413830f342b48666f6e" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc2c92e49e346b5b3bd7705a229afc6"
I20260709 14:54:12.701359 15038 raft_consensus.cc:3060] T 98280a706ec54413830f342b48666f6e P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:12.694133 15307 raft_consensus.cc:385] T 6cd07fbeb9f149a08fdbac2e0247eca4 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:12.702768 15307 raft_consensus.cc:740] T 6cd07fbeb9f149a08fdbac2e0247eca4 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9cb8de0701f2482b99e51d5ac080aa13, State: Initialized, Role: FOLLOWER
I20260709 14:54:12.697041 15261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98280a706ec54413830f342b48666f6e" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13"
I20260709 14:54:12.669572 14936 rpcz_store.cc:276] 0709 14:54:10.684491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:54:10.684690 (+   199us) service_pool.cc:224] Handling call
0709 14:54:12.664772 (+1980082us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1186006,"reported_tablets":10}
W20260709 14:54:12.707353 15150 leader_election.cc:343] T 98280a706ec54413830f342b48666f6e P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:12.713670 15026 rpcz_store.cc:276] 0709 14:54:10.741183 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:54:10.746235 (+  5052us) service_pool.cc:224] Handling call
0709 14:54:10.779510 (+ 33275us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 14:54:10.809648 (+ 30138us) ts_tablet_manager.cc:682] Creating new metadata...
0709 14:54:12.584714 (+1775066us) tablet_metadata.cc:665] Metadata flushed
0709 14:54:12.693691 (+108977us) tablet_replica.cc:206] Creating consensus instance
0709 14:54:12.694520 (+   829us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 14:54:12.716166 15022 tablet_service.cc:1511] Processing CreateTablet for tablet 8bae8108fe2a4ce0ba3e35746c7ec9d1 (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 14:54:12.694438 15247 tablet_service.cc:1511] Processing CreateTablet for tablet 0b12879f49fa4d52a477be2e490f2b38 (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 14:54:12.718626 15022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8bae8108fe2a4ce0ba3e35746c7ec9d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:12.719684 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d354c94548fc411ab62b4281ed947944" candidate_uuid: "7519e608fbb44d9db8ad30b9f10ae605" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" is_pre_election: true
I20260709 14:54:12.722950 15261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6bcaee371174feaa06943f949efda49" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13" is_pre_election: true
I20260709 14:54:12.704396 15307 consensus_queue.cc:260] T 6cd07fbeb9f149a08fdbac2e0247eca4 P 9cb8de0701f2482b99e51d5ac080aa13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:12.725909 15247 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b12879f49fa4d52a477be2e490f2b38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:12.726768 15187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8d6b9cf24a24444b2a69fd526cd4b09" candidate_uuid: "7519e608fbb44d9db8ad30b9f10ae605" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484" is_pre_election: true
I20260709 14:54:12.728128 15307 ts_tablet_manager.cc:1434] T 6cd07fbeb9f149a08fdbac2e0247eca4 P 9cb8de0701f2482b99e51d5ac080aa13: Time spent starting tablet: real 0.066s	user 0.009s	sys 0.001s
I20260709 14:54:12.729070 15186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d354c94548fc411ab62b4281ed947944" candidate_uuid: "7519e608fbb44d9db8ad30b9f10ae605" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484" is_pre_election: true
W20260709 14:54:12.732703 15079 leader_election.cc:343] T b8d6b9cf24a24444b2a69fd526cd4b09 P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:12.733737 15079 leader_election.cc:304] T b8d6b9cf24a24444b2a69fd526cd4b09 P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7519e608fbb44d9db8ad30b9f10ae605; no voters: 9cb8de0701f2482b99e51d5ac080aa13, eaa34beb1b274443b1c46839afd0a484
W20260709 14:54:12.736132 15079 leader_election.cc:343] T d354c94548fc411ab62b4281ed947944 P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:12.736243 15025 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:34134 (request call id 18) took 2069 ms. Trace:
W20260709 14:54:12.737165 15079 leader_election.cc:343] T d354c94548fc411ab62b4281ed947944 P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:12.739207 15079 leader_election.cc:304] T d354c94548fc411ab62b4281ed947944 P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7519e608fbb44d9db8ad30b9f10ae605; no voters: dbc2c92e49e346b5b3bd7705a229afc6, eaa34beb1b274443b1c46839afd0a484
I20260709 14:54:12.739640 15307 tablet_bootstrap.cc:492] T 98280a706ec54413830f342b48666f6e P 9cb8de0701f2482b99e51d5ac080aa13: Bootstrap starting.
I20260709 14:54:12.737725 15336 raft_consensus.cc:2749] T b8d6b9cf24a24444b2a69fd526cd4b09 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:54:12.742194 15336 raft_consensus.cc:2749] T d354c94548fc411ab62b4281ed947944 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:54:12.746013 15171 tablet_service.cc:1511] Processing CreateTablet for tablet 8bae8108fe2a4ce0ba3e35746c7ec9d1 (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 14:54:12.749800 15171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8bae8108fe2a4ce0ba3e35746c7ec9d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:12.749883 15322 leader_election.cc:290] T 98280a706ec54413830f342b48666f6e P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 election: Requested vote from peers 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493), dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477)
I20260709 14:54:12.736976 15025 rpcz_store.cc:276] 0709 14:54:10.672239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:54:10.673186 (+   947us) service_pool.cc:224] Handling call
0709 14:54:10.715128 (+ 41942us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 14:54:10.715248 (+   120us) ts_tablet_manager.cc:682] Creating new metadata...
0709 14:54:12.652264 (+1937016us) tablet_metadata.cc:665] Metadata flushed
0709 14:54:12.734805 (+ 82541us) tablet_replica.cc:206] Creating consensus instance
0709 14:54:12.736023 (+  1218us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 14:54:12.733480 15001 leader_election.cc:343] T d6bcaee371174feaa06943f949efda49 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:12.757736 15001 leader_election.cc:304] T d6bcaee371174feaa06943f949efda49 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbc2c92e49e346b5b3bd7705a229afc6; no voters: 9cb8de0701f2482b99e51d5ac080aa13, eaa34beb1b274443b1c46839afd0a484
I20260709 14:54:12.759433 15331 raft_consensus.cc:2749] T d6bcaee371174feaa06943f949efda49 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:54:12.738240 14933 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54008 (request call id 3) took 1061 ms. Trace:
I20260709 14:54:12.761879 14933 rpcz_store.cc:276] 0709 14:54:11.676509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:54:11.676742 (+   233us) service_pool.cc:224] Handling call
0709 14:54:12.737961 (+1061219us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":955742,"reported_tablets":1}
I20260709 14:54:12.753453 15038 raft_consensus.cc:2468] T 98280a706ec54413830f342b48666f6e P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa34beb1b274443b1c46839afd0a484 in term 1.
I20260709 14:54:12.756999 15309 tablet_bootstrap.cc:654] T 7699ad132e12472180b6a9527951c397 P 7519e608fbb44d9db8ad30b9f10ae605: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:12.781648 15322 raft_consensus.cc:493] T 6cd07fbeb9f149a08fdbac2e0247eca4 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:12.782863 15306 tablet_bootstrap.cc:492] T d354c94548fc411ab62b4281ed947944 P dbc2c92e49e346b5b3bd7705a229afc6: No bootstrap required, opened a new log
I20260709 14:54:12.782420 15251 tablet_service.cc:1511] Processing CreateTablet for tablet b7c363a305d3434092ef6016b7064eb3 (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 14:54:12.783990 15306 ts_tablet_manager.cc:1403] T d354c94548fc411ab62b4281ed947944 P dbc2c92e49e346b5b3bd7705a229afc6: Time spent bootstrapping tablet: real 0.324s	user 0.017s	sys 0.017s
I20260709 14:54:12.784487 15251 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7c363a305d3434092ef6016b7064eb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:12.782568 15322 raft_consensus.cc:515] T 6cd07fbeb9f149a08fdbac2e0247eca4 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:12.793810 15322 leader_election.cc:290] T 6cd07fbeb9f149a08fdbac2e0247eca4 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177), 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493)
I20260709 14:54:12.793289 15153 leader_election.cc:304] T 98280a706ec54413830f342b48666f6e P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dbc2c92e49e346b5b3bd7705a229afc6, eaa34beb1b274443b1c46839afd0a484; no voters: 9cb8de0701f2482b99e51d5ac080aa13
I20260709 14:54:12.795640 15322 raft_consensus.cc:2804] T 98280a706ec54413830f342b48666f6e P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:54:12.796866 15261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd07fbeb9f149a08fdbac2e0247eca4" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13" is_pre_election: true
I20260709 14:54:12.798691 15261 raft_consensus.cc:2468] T 6cd07fbeb9f149a08fdbac2e0247eca4 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa34beb1b274443b1c46839afd0a484 in term 0.
I20260709 14:54:12.753537 15349 raft_consensus.cc:515] T 798d0882b1ea4b26b598c236de8f18c9 P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:12.800457 15150 leader_election.cc:304] T 6cd07fbeb9f149a08fdbac2e0247eca4 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cb8de0701f2482b99e51d5ac080aa13, eaa34beb1b274443b1c46839afd0a484; no voters: 
I20260709 14:54:12.789465 15306 raft_consensus.cc:359] T d354c94548fc411ab62b4281ed947944 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
W20260709 14:54:12.801855 15079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:45477, user_credentials={real_user=slave}} blocked reactor thread for 64728.8us
I20260709 14:54:12.692828 15311 raft_consensus.cc:359] T d6bcaee371174feaa06943f949efda49 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:12.813696 15311 raft_consensus.cc:385] T d6bcaee371174feaa06943f949efda49 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:12.814245 15311 raft_consensus.cc:740] T d6bcaee371174feaa06943f949efda49 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eaa34beb1b274443b1c46839afd0a484, State: Initialized, Role: FOLLOWER
I20260709 14:54:12.814956 15349 leader_election.cc:290] T 798d0882b1ea4b26b598c236de8f18c9 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 election: Requested vote from peers dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477), 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177)
I20260709 14:54:12.815691 15307 tablet_bootstrap.cc:654] T 98280a706ec54413830f342b48666f6e P 9cb8de0701f2482b99e51d5ac080aa13: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:12.815289 15311 consensus_queue.cc:260] T d6bcaee371174feaa06943f949efda49 P eaa34beb1b274443b1c46839afd0a484 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:12.817099 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "798d0882b1ea4b26b598c236de8f18c9" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc2c92e49e346b5b3bd7705a229afc6"
I20260709 14:54:12.818153 15352 raft_consensus.cc:2804] T 6cd07fbeb9f149a08fdbac2e0247eca4 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:54:12.818024 15038 raft_consensus.cc:3060] T 798d0882b1ea4b26b598c236de8f18c9 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:12.819031 15352 raft_consensus.cc:493] T 6cd07fbeb9f149a08fdbac2e0247eca4 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:54:12.820165 15113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "798d0882b1ea4b26b598c236de8f18c9" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605" is_pre_election: true
I20260709 14:54:12.818408 15311 ts_tablet_manager.cc:1434] T d6bcaee371174feaa06943f949efda49 P eaa34beb1b274443b1c46839afd0a484: Time spent starting tablet: real 0.130s	user 0.010s	sys 0.000s
I20260709 14:54:12.817975 15094 tablet_service.cc:1511] Processing CreateTablet for tablet 8bae8108fe2a4ce0ba3e35746c7ec9d1 (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 14:54:12.840510 15094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8bae8108fe2a4ce0ba3e35746c7ec9d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:12.824450 15111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "798d0882b1ea4b26b598c236de8f18c9" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605"
W20260709 14:54:12.825776 15150 leader_election.cc:343] T 798d0882b1ea4b26b598c236de8f18c9 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:12.828637 15025 tablet_service.cc:1511] Processing CreateTablet for tablet b7c363a305d3434092ef6016b7064eb3 (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 14:54:12.825621 15112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd07fbeb9f149a08fdbac2e0247eca4" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605" is_pre_election: true
I20260709 14:54:12.823055 15352 raft_consensus.cc:3060] T 6cd07fbeb9f149a08fdbac2e0247eca4 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:12.831017 15102 tablet_service.cc:1511] Processing CreateTablet for tablet b7c363a305d3434092ef6016b7064eb3 (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 14:54:12.845422 15102 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7c363a305d3434092ef6016b7064eb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:12.849941 15025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7c363a305d3434092ef6016b7064eb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:12.858443 15311 tablet_bootstrap.cc:492] T 67409326aa124c52a5e9a650d7570a68 P eaa34beb1b274443b1c46839afd0a484: Bootstrap starting.
I20260709 14:54:12.811873 15306 raft_consensus.cc:385] T d354c94548fc411ab62b4281ed947944 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:12.858857 15248 tablet_service.cc:1511] Processing CreateTablet for tablet 3b4c50fac37a43c0988d5ea911d09f43 (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 14:54:12.861709 15306 raft_consensus.cc:740] T d354c94548fc411ab62b4281ed947944 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbc2c92e49e346b5b3bd7705a229afc6, State: Initialized, Role: FOLLOWER
I20260709 14:54:12.862883 15248 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b4c50fac37a43c0988d5ea911d09f43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:12.862985 15306 consensus_queue.cc:260] T d354c94548fc411ab62b4281ed947944 P dbc2c92e49e346b5b3bd7705a229afc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:12.867247 15171 tablet_service.cc:1511] Processing CreateTablet for tablet 3b4c50fac37a43c0988d5ea911d09f43 (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
W20260709 14:54:12.869819 15150 leader_election.cc:343] T 798d0882b1ea4b26b598c236de8f18c9 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177): Illegal state: must be running to vote when last-logged opid is not known
W20260709 14:54:12.871119 15150 leader_election.cc:343] T 6cd07fbeb9f149a08fdbac2e0247eca4 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:12.872113 15306 ts_tablet_manager.cc:1434] T d354c94548fc411ab62b4281ed947944 P dbc2c92e49e346b5b3bd7705a229afc6: Time spent starting tablet: real 0.088s	user 0.009s	sys 0.000s
I20260709 14:54:12.874804 15331 raft_consensus.cc:493] T d354c94548fc411ab62b4281ed947944 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:12.875705 15331 raft_consensus.cc:515] T d354c94548fc411ab62b4281ed947944 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:12.872161 15171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b4c50fac37a43c0988d5ea911d09f43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:12.804896 15322 raft_consensus.cc:697] T 98280a706ec54413830f342b48666f6e P eaa34beb1b274443b1c46839afd0a484 [term 1 LEADER]: Becoming Leader. State: Replica: eaa34beb1b274443b1c46839afd0a484, State: Running, Role: LEADER
I20260709 14:54:12.882151 15322 consensus_queue.cc:237] T 98280a706ec54413830f342b48666f6e P eaa34beb1b274443b1c46839afd0a484 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:12.895190 15112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d354c94548fc411ab62b4281ed947944" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605" is_pre_election: true
I20260709 14:54:12.898864 15112 raft_consensus.cc:2468] T d354c94548fc411ab62b4281ed947944 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbc2c92e49e346b5b3bd7705a229afc6 in term 0.
I20260709 14:54:12.900665 15001 leader_election.cc:304] T d354c94548fc411ab62b4281ed947944 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7519e608fbb44d9db8ad30b9f10ae605, dbc2c92e49e346b5b3bd7705a229afc6; no voters: 
I20260709 14:54:12.895531 15038 raft_consensus.cc:2468] T 798d0882b1ea4b26b598c236de8f18c9 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa34beb1b274443b1c46839afd0a484 in term 1.
I20260709 14:54:12.896354 15309 tablet_bootstrap.cc:492] T 7699ad132e12472180b6a9527951c397 P 7519e608fbb44d9db8ad30b9f10ae605: No bootstrap required, opened a new log
I20260709 14:54:12.897740 15026 tablet_service.cc:1511] Processing CreateTablet for tablet 3b4c50fac37a43c0988d5ea911d09f43 (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 14:54:12.909756 15309 ts_tablet_manager.cc:1403] T 7699ad132e12472180b6a9527951c397 P 7519e608fbb44d9db8ad30b9f10ae605: Time spent bootstrapping tablet: real 0.262s	user 0.031s	sys 0.008s
I20260709 14:54:12.912318 15100 tablet_service.cc:1511] Processing CreateTablet for tablet c7d360d2b84b4f0aa38f5c325f4521c1 (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 14:54:12.914363 15309 raft_consensus.cc:359] T 7699ad132e12472180b6a9527951c397 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:12.915026 15100 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7d360d2b84b4f0aa38f5c325f4521c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:12.915495 15309 raft_consensus.cc:385] T 7699ad132e12472180b6a9527951c397 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:12.917335 15172 tablet_service.cc:1511] Processing CreateTablet for tablet c7d360d2b84b4f0aa38f5c325f4521c1 (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 14:54:12.920249 15172 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7d360d2b84b4f0aa38f5c325f4521c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:12.925522 15026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b4c50fac37a43c0988d5ea911d09f43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:12.915970 15311 tablet_bootstrap.cc:654] T 67409326aa124c52a5e9a650d7570a68 P eaa34beb1b274443b1c46839afd0a484: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:12.944059 15153 leader_election.cc:304] T 798d0882b1ea4b26b598c236de8f18c9 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dbc2c92e49e346b5b3bd7705a229afc6, eaa34beb1b274443b1c46839afd0a484; no voters: 7519e608fbb44d9db8ad30b9f10ae605
I20260709 14:54:12.950244 15353 raft_consensus.cc:2804] T 798d0882b1ea4b26b598c236de8f18c9 P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:54:12.950966 15353 raft_consensus.cc:697] T 798d0882b1ea4b26b598c236de8f18c9 P eaa34beb1b274443b1c46839afd0a484 [term 1 LEADER]: Becoming Leader. State: Replica: eaa34beb1b274443b1c46839afd0a484, State: Running, Role: LEADER
I20260709 14:54:12.952157 15353 consensus_queue.cc:237] T 798d0882b1ea4b26b598c236de8f18c9 P eaa34beb1b274443b1c46839afd0a484 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:12.956171 15306 tablet_bootstrap.cc:492] T 0284d9835221427ab285015d48a8040d P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap starting.
I20260709 14:54:12.957902 15307 tablet_bootstrap.cc:492] T 98280a706ec54413830f342b48666f6e P 9cb8de0701f2482b99e51d5ac080aa13: No bootstrap required, opened a new log
I20260709 14:54:12.957892 15331 leader_election.cc:290] T d354c94548fc411ab62b4281ed947944 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177), eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805)
I20260709 14:54:12.959372 15307 ts_tablet_manager.cc:1403] T 98280a706ec54413830f342b48666f6e P 9cb8de0701f2482b99e51d5ac080aa13: Time spent bootstrapping tablet: real 0.220s	user 0.041s	sys 0.024s
I20260709 14:54:12.960345 15186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d354c94548fc411ab62b4281ed947944" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484" is_pre_election: true
I20260709 14:54:12.959731 15357 raft_consensus.cc:2804] T d354c94548fc411ab62b4281ed947944 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:54:12.918182 15309 raft_consensus.cc:740] T 7699ad132e12472180b6a9527951c397 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7519e608fbb44d9db8ad30b9f10ae605, State: Initialized, Role: FOLLOWER
I20260709 14:54:12.961530 15244 tablet_service.cc:1511] Processing CreateTablet for tablet c7d360d2b84b4f0aa38f5c325f4521c1 (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
W20260709 14:54:12.962556 15004 leader_election.cc:343] T d354c94548fc411ab62b4281ed947944 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:12.967581 15244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7d360d2b84b4f0aa38f5c325f4521c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:12.971303 15022 tablet_service.cc:1511] Processing CreateTablet for tablet 91c9f89fcb8b45ff9be43f535cafffde (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 14:54:12.974164 15022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91c9f89fcb8b45ff9be43f535cafffde. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:12.975587 15307 raft_consensus.cc:359] T 98280a706ec54413830f342b48666f6e P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:12.976603 15307 raft_consensus.cc:385] T 98280a706ec54413830f342b48666f6e P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:12.976931 15307 raft_consensus.cc:740] T 98280a706ec54413830f342b48666f6e P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9cb8de0701f2482b99e51d5ac080aa13, State: Initialized, Role: FOLLOWER
I20260709 14:54:12.981781 15307 consensus_queue.cc:260] T 98280a706ec54413830f342b48666f6e P 9cb8de0701f2482b99e51d5ac080aa13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:12.964159 15357 raft_consensus.cc:493] T d354c94548fc411ab62b4281ed947944 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:54:12.991212 15357 raft_consensus.cc:3060] T d354c94548fc411ab62b4281ed947944 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:12.995573 15098 tablet_service.cc:1511] Processing CreateTablet for tablet 91c9f89fcb8b45ff9be43f535cafffde (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 14:54:12.997514 15098 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91c9f89fcb8b45ff9be43f535cafffde. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:12.978232 15309 consensus_queue.cc:260] T 7699ad132e12472180b6a9527951c397 P 7519e608fbb44d9db8ad30b9f10ae605 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:13.007968 15309 ts_tablet_manager.cc:1434] T 7699ad132e12472180b6a9527951c397 P 7519e608fbb44d9db8ad30b9f10ae605: Time spent starting tablet: real 0.098s	user 0.007s	sys 0.002s
I20260709 14:54:12.985051 15307 ts_tablet_manager.cc:1434] T 98280a706ec54413830f342b48666f6e P 9cb8de0701f2482b99e51d5ac080aa13: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 14:54:13.030061 15352 raft_consensus.cc:515] T 6cd07fbeb9f149a08fdbac2e0247eca4 P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:13.036465 15306 tablet_bootstrap.cc:654] T 0284d9835221427ab285015d48a8040d P dbc2c92e49e346b5b3bd7705a229afc6: Neither blocks nor log segments found. Creating new log.
W20260709 14:54:13.042832 14984 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 14:54:13.043489 15134 debug-util.cc:398] Leaking SignalData structure 0x7b0800243000 after lost signal to thread 6552
W20260709 14:54:13.045151 15134 debug-util.cc:398] Leaking SignalData structure 0x7b0800247ca0 after lost signal to thread 14970
I20260709 14:54:13.044948 15171 tablet_service.cc:1511] Processing CreateTablet for tablet 91c9f89fcb8b45ff9be43f535cafffde (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 14:54:13.046790 15171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91c9f89fcb8b45ff9be43f535cafffde. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:13.051178 15352 leader_election.cc:290] T 6cd07fbeb9f149a08fdbac2e0247eca4 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 election: Requested vote from peers 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177), 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493)
I20260709 14:54:13.052964 15112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd07fbeb9f149a08fdbac2e0247eca4" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605"
I20260709 14:54:13.053663 15357 raft_consensus.cc:515] T d354c94548fc411ab62b4281ed947944 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:13.055333 15261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd07fbeb9f149a08fdbac2e0247eca4" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13"
W20260709 14:54:13.055631 15150 leader_election.cc:343] T 6cd07fbeb9f149a08fdbac2e0247eca4 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:13.055979 15357 leader_election.cc:290] T d354c94548fc411ab62b4281ed947944 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 election: Requested vote from peers 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177), eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805)
I20260709 14:54:13.056139 15261 raft_consensus.cc:3060] T 6cd07fbeb9f149a08fdbac2e0247eca4 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:13.057873 15112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d354c94548fc411ab62b4281ed947944" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605"
I20260709 14:54:13.058681 15112 raft_consensus.cc:3060] T d354c94548fc411ab62b4281ed947944 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:13.058830 15186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d354c94548fc411ab62b4281ed947944" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484"
I20260709 14:54:13.057900 15309 tablet_bootstrap.cc:492] T 0284d9835221427ab285015d48a8040d P 7519e608fbb44d9db8ad30b9f10ae605: Bootstrap starting.
W20260709 14:54:13.064216 15004 leader_election.cc:343] T d354c94548fc411ab62b4281ed947944 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:13.069020 14936 catalog_manager.cc:5697] T 98280a706ec54413830f342b48666f6e P eaa34beb1b274443b1c46839afd0a484 reported cstate change: term changed from 0 to 1, leader changed from <none> to eaa34beb1b274443b1c46839afd0a484 (127.6.101.67). New cstate: current_term: 1 leader_uuid: "eaa34beb1b274443b1c46839afd0a484" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } health_report { overall_health: UNKNOWN } } }
I20260709 14:54:13.071671 15346 raft_consensus.cc:493] T 98280a706ec54413830f342b48666f6e P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:13.080631 15346 raft_consensus.cc:515] T 98280a706ec54413830f342b48666f6e P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:13.081427 15309 tablet_bootstrap.cc:654] T 0284d9835221427ab285015d48a8040d P 7519e608fbb44d9db8ad30b9f10ae605: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:13.064657 15311 tablet_bootstrap.cc:492] T 67409326aa124c52a5e9a650d7570a68 P eaa34beb1b274443b1c46839afd0a484: No bootstrap required, opened a new log
I20260709 14:54:13.085415 15311 ts_tablet_manager.cc:1403] T 67409326aa124c52a5e9a650d7570a68 P eaa34beb1b274443b1c46839afd0a484: Time spent bootstrapping tablet: real 0.227s	user 0.030s	sys 0.039s
I20260709 14:54:13.089915 15307 tablet_bootstrap.cc:492] T b8d6b9cf24a24444b2a69fd526cd4b09 P 9cb8de0701f2482b99e51d5ac080aa13: Bootstrap starting.
I20260709 14:54:13.104735 15346 leader_election.cc:290] T 98280a706ec54413830f342b48666f6e P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805), dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477)
I20260709 14:54:13.105943 15311 raft_consensus.cc:359] T 67409326aa124c52a5e9a650d7570a68 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:13.107126 15026 tablet_service.cc:1511] Processing CreateTablet for tablet 5585b0f6bbf04c10865d2463767621dc (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 14:54:13.115345 15026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5585b0f6bbf04c10865d2463767621dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:13.116753 15306 tablet_bootstrap.cc:492] T 0284d9835221427ab285015d48a8040d P dbc2c92e49e346b5b3bd7705a229afc6: No bootstrap required, opened a new log
I20260709 14:54:13.100782 15261 raft_consensus.cc:2468] T 6cd07fbeb9f149a08fdbac2e0247eca4 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa34beb1b274443b1c46839afd0a484 in term 1.
I20260709 14:54:13.109488 15311 raft_consensus.cc:385] T 67409326aa124c52a5e9a650d7570a68 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:13.118978 15311 raft_consensus.cc:740] T 67409326aa124c52a5e9a650d7570a68 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eaa34beb1b274443b1c46839afd0a484, State: Initialized, Role: FOLLOWER
I20260709 14:54:13.117359 15100 tablet_service.cc:1511] Processing CreateTablet for tablet 5585b0f6bbf04c10865d2463767621dc (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 14:54:13.119949 15311 consensus_queue.cc:260] T 67409326aa124c52a5e9a650d7570a68 P eaa34beb1b274443b1c46839afd0a484 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:13.120849 15100 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5585b0f6bbf04c10865d2463767621dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:13.131570 15112 raft_consensus.cc:2468] T d354c94548fc411ab62b4281ed947944 P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbc2c92e49e346b5b3bd7705a229afc6 in term 1.
I20260709 14:54:13.117465 15306 ts_tablet_manager.cc:1403] T 0284d9835221427ab285015d48a8040d P dbc2c92e49e346b5b3bd7705a229afc6: Time spent bootstrapping tablet: real 0.162s	user 0.009s	sys 0.013s
I20260709 14:54:13.134133 15150 leader_election.cc:304] T 6cd07fbeb9f149a08fdbac2e0247eca4 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9cb8de0701f2482b99e51d5ac080aa13, eaa34beb1b274443b1c46839afd0a484; no voters: 7519e608fbb44d9db8ad30b9f10ae605
I20260709 14:54:13.134407 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98280a706ec54413830f342b48666f6e" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" is_pre_election: true
I20260709 14:54:13.135690 15038 raft_consensus.cc:2393] T 98280a706ec54413830f342b48666f6e P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9cb8de0701f2482b99e51d5ac080aa13 in current term 1: Already voted for candidate eaa34beb1b274443b1c46839afd0a484 in this term.
I20260709 14:54:13.136668 15352 raft_consensus.cc:2804] T 6cd07fbeb9f149a08fdbac2e0247eca4 P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:54:13.137084 15244 tablet_service.cc:1511] Processing CreateTablet for tablet 5585b0f6bbf04c10865d2463767621dc (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 14:54:13.138005 15306 raft_consensus.cc:359] T 0284d9835221427ab285015d48a8040d P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:13.139045 15306 raft_consensus.cc:385] T 0284d9835221427ab285015d48a8040d P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:13.137712 15352 raft_consensus.cc:697] T 6cd07fbeb9f149a08fdbac2e0247eca4 P eaa34beb1b274443b1c46839afd0a484 [term 1 LEADER]: Becoming Leader. State: Replica: eaa34beb1b274443b1c46839afd0a484, State: Running, Role: LEADER
I20260709 14:54:13.139531 15306 raft_consensus.cc:740] T 0284d9835221427ab285015d48a8040d P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbc2c92e49e346b5b3bd7705a229afc6, State: Initialized, Role: FOLLOWER
I20260709 14:54:13.140457 15352 consensus_queue.cc:237] T 6cd07fbeb9f149a08fdbac2e0247eca4 P eaa34beb1b274443b1c46839afd0a484 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:13.143744 15172 tablet_service.cc:1511] Processing CreateTablet for tablet d178b88fdab54a29b05fb98e05ffe8c5 (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 14:54:13.134559 15307 tablet_bootstrap.cc:654] T b8d6b9cf24a24444b2a69fd526cd4b09 P 9cb8de0701f2482b99e51d5ac080aa13: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:13.145830 15001 leader_election.cc:304] T d354c94548fc411ab62b4281ed947944 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7519e608fbb44d9db8ad30b9f10ae605, dbc2c92e49e346b5b3bd7705a229afc6; no voters: eaa34beb1b274443b1c46839afd0a484
I20260709 14:54:13.147424 15357 raft_consensus.cc:2804] T d354c94548fc411ab62b4281ed947944 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:54:13.148058 15357 raft_consensus.cc:697] T d354c94548fc411ab62b4281ed947944 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 LEADER]: Becoming Leader. State: Replica: dbc2c92e49e346b5b3bd7705a229afc6, State: Running, Role: LEADER
I20260709 14:54:13.147846 15022 tablet_service.cc:1511] Processing CreateTablet for tablet d178b88fdab54a29b05fb98e05ffe8c5 (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 14:54:13.138669 15244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5585b0f6bbf04c10865d2463767621dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:13.150084 15357 consensus_queue.cc:237] T d354c94548fc411ab62b4281ed947944 P dbc2c92e49e346b5b3bd7705a229afc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:13.153616 15170 tablet_service.cc:1511] Processing CreateTablet for tablet 342798bf4325470fa3991757eadb0764 (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 14:54:13.132375 15311 ts_tablet_manager.cc:1434] T 67409326aa124c52a5e9a650d7570a68 P eaa34beb1b274443b1c46839afd0a484: Time spent starting tablet: real 0.045s	user 0.007s	sys 0.002s
I20260709 14:54:13.149610 15172 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d178b88fdab54a29b05fb98e05ffe8c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:13.159335 15022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d178b88fdab54a29b05fb98e05ffe8c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:13.168076 15170 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 342798bf4325470fa3991757eadb0764. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:13.168896 15102 tablet_service.cc:1511] Processing CreateTablet for tablet 342798bf4325470fa3991757eadb0764 (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 14:54:13.170336 15102 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 342798bf4325470fa3991757eadb0764. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:13.170369 15025 tablet_service.cc:1511] Processing CreateTablet for tablet 9f90ac0a3b004f6ca430ff2fc5198678 (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 14:54:13.140692 15306 consensus_queue.cc:260] T 0284d9835221427ab285015d48a8040d P dbc2c92e49e346b5b3bd7705a229afc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:13.178323 15025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f90ac0a3b004f6ca430ff2fc5198678. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:13.188201 15306 ts_tablet_manager.cc:1434] T 0284d9835221427ab285015d48a8040d P dbc2c92e49e346b5b3bd7705a229afc6: Time spent starting tablet: real 0.054s	user 0.009s	sys 0.001s
I20260709 14:54:13.197642 15247 tablet_service.cc:1511] Processing CreateTablet for tablet 342798bf4325470fa3991757eadb0764 (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 14:54:13.200124 15173 tablet_service.cc:1511] Processing CreateTablet for tablet 9f90ac0a3b004f6ca430ff2fc5198678 (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 14:54:13.202126 15173 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f90ac0a3b004f6ca430ff2fc5198678. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:13.204337 15311 tablet_bootstrap.cc:492] T 7f2cd7c8159d43c080fd8302180ecfca P eaa34beb1b274443b1c46839afd0a484: Bootstrap starting.
I20260709 14:54:13.188593 15248 tablet_service.cc:1511] Processing CreateTablet for tablet d178b88fdab54a29b05fb98e05ffe8c5 (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 14:54:13.207981 15098 tablet_service.cc:1511] Processing CreateTablet for tablet 9f90ac0a3b004f6ca430ff2fc5198678 (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 14:54:13.199751 15247 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 342798bf4325470fa3991757eadb0764. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:13.210644 15306 tablet_bootstrap.cc:492] T f706543d4d3e4e7291624a785ca4e747 P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap starting.
I20260709 14:54:13.224927 15021 tablet_service.cc:1511] Processing CreateTablet for tablet dd44b332dc744f94a5f7cfffc06f3956 (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 14:54:13.226356 15251 tablet_service.cc:1511] Processing CreateTablet for tablet dd44b332dc744f94a5f7cfffc06f3956 (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 14:54:13.227813 15248 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d178b88fdab54a29b05fb98e05ffe8c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:13.232721 15251 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd44b332dc744f94a5f7cfffc06f3956. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:13.235035 15307 tablet_bootstrap.cc:492] T b8d6b9cf24a24444b2a69fd526cd4b09 P 9cb8de0701f2482b99e51d5ac080aa13: No bootstrap required, opened a new log
I20260709 14:54:13.236076 15307 ts_tablet_manager.cc:1403] T b8d6b9cf24a24444b2a69fd526cd4b09 P 9cb8de0701f2482b99e51d5ac080aa13: Time spent bootstrapping tablet: real 0.147s	user 0.013s	sys 0.011s
I20260709 14:54:13.230666 15021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd44b332dc744f94a5f7cfffc06f3956. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:13.242909 15186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98280a706ec54413830f342b48666f6e" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484" is_pre_election: true
I20260709 14:54:13.247270 15094 tablet_service.cc:1511] Processing CreateTablet for tablet dd44b332dc744f94a5f7cfffc06f3956 (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 14:54:13.247643 14934 catalog_manager.cc:5697] T d354c94548fc411ab62b4281ed947944 P dbc2c92e49e346b5b3bd7705a229afc6 reported cstate change: term changed from 0 to 1, leader changed from <none> to dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65). New cstate: current_term: 1 leader_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } health_report { overall_health: UNKNOWN } } }
I20260709 14:54:13.231550 15098 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f90ac0a3b004f6ca430ff2fc5198678. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:13.251725 15227 leader_election.cc:304] T 98280a706ec54413830f342b48666f6e P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cb8de0701f2482b99e51d5ac080aa13; no voters: dbc2c92e49e346b5b3bd7705a229afc6, eaa34beb1b274443b1c46839afd0a484
I20260709 14:54:13.260685 15346 raft_consensus.cc:3060] T 98280a706ec54413830f342b48666f6e P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:13.261933 15309 tablet_bootstrap.cc:492] T 0284d9835221427ab285015d48a8040d P 7519e608fbb44d9db8ad30b9f10ae605: No bootstrap required, opened a new log
I20260709 14:54:13.262861 15309 ts_tablet_manager.cc:1403] T 0284d9835221427ab285015d48a8040d P 7519e608fbb44d9db8ad30b9f10ae605: Time spent bootstrapping tablet: real 0.205s	user 0.009s	sys 0.014s
I20260709 14:54:13.265789 15094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd44b332dc744f94a5f7cfffc06f3956. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:13.286785 15171 tablet_service.cc:1511] Processing CreateTablet for tablet 594083b10772433f90560d387bbbeabe (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 14:54:13.289636 15242 tablet_service.cc:1511] Processing CreateTablet for tablet 594083b10772433f90560d387bbbeabe (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 14:54:13.293650 15024 tablet_service.cc:1511] Processing CreateTablet for tablet 594083b10772433f90560d387bbbeabe (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 14:54:13.294745 15242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 594083b10772433f90560d387bbbeabe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:13.295493 15024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 594083b10772433f90560d387bbbeabe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:13.292263 15171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 594083b10772433f90560d387bbbeabe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:13.273195 15346 raft_consensus.cc:2749] T 98280a706ec54413830f342b48666f6e P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:54:13.307327 15351 raft_consensus.cc:493] T 7699ad132e12472180b6a9527951c397 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:13.308338 15351 raft_consensus.cc:515] T 7699ad132e12472180b6a9527951c397 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:13.309613 15307 raft_consensus.cc:359] T b8d6b9cf24a24444b2a69fd526cd4b09 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:13.310771 15307 raft_consensus.cc:385] T b8d6b9cf24a24444b2a69fd526cd4b09 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:13.311240 15307 raft_consensus.cc:740] T b8d6b9cf24a24444b2a69fd526cd4b09 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9cb8de0701f2482b99e51d5ac080aa13, State: Initialized, Role: FOLLOWER
I20260709 14:54:13.313292 15261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7699ad132e12472180b6a9527951c397" candidate_uuid: "7519e608fbb44d9db8ad30b9f10ae605" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13" is_pre_election: true
W20260709 14:54:13.317147 15076 leader_election.cc:343] T 7699ad132e12472180b6a9527951c397 P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:13.307649 15352 raft_consensus.cc:493] T d6bcaee371174feaa06943f949efda49 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:13.319866 15352 raft_consensus.cc:515] T d6bcaee371174feaa06943f949efda49 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:13.320436 15351 leader_election.cc:290] T 7699ad132e12472180b6a9527951c397 P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493), dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477)
I20260709 14:54:13.321233 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7699ad132e12472180b6a9527951c397" candidate_uuid: "7519e608fbb44d9db8ad30b9f10ae605" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" is_pre_election: true
W20260709 14:54:13.323824 15079 leader_election.cc:343] T 7699ad132e12472180b6a9527951c397 P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:13.324541 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6bcaee371174feaa06943f949efda49" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" is_pre_election: true
I20260709 14:54:13.324908 15079 leader_election.cc:304] T 7699ad132e12472180b6a9527951c397 P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7519e608fbb44d9db8ad30b9f10ae605; no voters: 9cb8de0701f2482b99e51d5ac080aa13, dbc2c92e49e346b5b3bd7705a229afc6
I20260709 14:54:13.325573 15038 raft_consensus.cc:2468] T d6bcaee371174feaa06943f949efda49 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa34beb1b274443b1c46839afd0a484 in term 0.
I20260709 14:54:13.329635 15351 raft_consensus.cc:2749] T 7699ad132e12472180b6a9527951c397 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:54:13.322819 15352 leader_election.cc:290] T d6bcaee371174feaa06943f949efda49 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493), dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477)
I20260709 14:54:13.331131 15153 leader_election.cc:304] T d6bcaee371174feaa06943f949efda49 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dbc2c92e49e346b5b3bd7705a229afc6, eaa34beb1b274443b1c46839afd0a484; no voters: 
I20260709 14:54:13.334623 15100 tablet_service.cc:1511] Processing CreateTablet for tablet e43bf64543ef494790c2f7a4a063fdd1 (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 14:54:13.336735 15100 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e43bf64543ef494790c2f7a4a063fdd1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:13.329221 15261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6bcaee371174feaa06943f949efda49" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13" is_pre_election: true
W20260709 14:54:13.340869 15150 leader_election.cc:343] T d6bcaee371174feaa06943f949efda49 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:13.341684 15352 raft_consensus.cc:2804] T d6bcaee371174feaa06943f949efda49 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:54:13.342402 15352 raft_consensus.cc:493] T d6bcaee371174feaa06943f949efda49 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:54:13.342834 15352 raft_consensus.cc:3060] T d6bcaee371174feaa06943f949efda49 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:13.306551 15306 tablet_bootstrap.cc:654] T f706543d4d3e4e7291624a785ca4e747 P dbc2c92e49e346b5b3bd7705a229afc6: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:13.347589 15311 tablet_bootstrap.cc:654] T 7f2cd7c8159d43c080fd8302180ecfca P eaa34beb1b274443b1c46839afd0a484: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:13.287652 15309 raft_consensus.cc:359] T 0284d9835221427ab285015d48a8040d P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:13.312247 15307 consensus_queue.cc:260] T b8d6b9cf24a24444b2a69fd526cd4b09 P 9cb8de0701f2482b99e51d5ac080aa13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:13.348810 15176 tablet_service.cc:1511] Processing CreateTablet for tablet e43bf64543ef494790c2f7a4a063fdd1 (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 14:54:13.349504 15309 raft_consensus.cc:385] T 0284d9835221427ab285015d48a8040d P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:13.350219 15309 raft_consensus.cc:740] T 0284d9835221427ab285015d48a8040d P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7519e608fbb44d9db8ad30b9f10ae605, State: Initialized, Role: FOLLOWER
I20260709 14:54:13.350849 15176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e43bf64543ef494790c2f7a4a063fdd1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:13.391583 15353 consensus_queue.cc:1048] T 98280a706ec54413830f342b48666f6e P eaa34beb1b274443b1c46839afd0a484 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:54:13.398859 15249 tablet_service.cc:1511] Processing CreateTablet for tablet e43bf64543ef494790c2f7a4a063fdd1 (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 14:54:13.401786 15249 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e43bf64543ef494790c2f7a4a063fdd1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:13.406831 15309 consensus_queue.cc:260] T 0284d9835221427ab285015d48a8040d P 7519e608fbb44d9db8ad30b9f10ae605 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:13.407805 15021 tablet_service.cc:1511] Processing CreateTablet for tablet 5e8a01e27eab492bb73df3359e500627 (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 14:54:13.409762 15021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e8a01e27eab492bb73df3359e500627. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:13.413133 15309 ts_tablet_manager.cc:1434] T 0284d9835221427ab285015d48a8040d P 7519e608fbb44d9db8ad30b9f10ae605: Time spent starting tablet: real 0.150s	user 0.012s	sys 0.006s
I20260709 14:54:13.438928 15309 tablet_bootstrap.cc:492] T f706543d4d3e4e7291624a785ca4e747 P 7519e608fbb44d9db8ad30b9f10ae605: Bootstrap starting.
I20260709 14:54:13.416863 15353 consensus_queue.cc:1048] T 98280a706ec54413830f342b48666f6e P eaa34beb1b274443b1c46839afd0a484 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:54:13.432425 15306 tablet_bootstrap.cc:492] T f706543d4d3e4e7291624a785ca4e747 P dbc2c92e49e346b5b3bd7705a229afc6: No bootstrap required, opened a new log
I20260709 14:54:13.414480 15307 ts_tablet_manager.cc:1434] T b8d6b9cf24a24444b2a69fd526cd4b09 P 9cb8de0701f2482b99e51d5ac080aa13: Time spent starting tablet: real 0.178s	user 0.009s	sys 0.007s
I20260709 14:54:13.449586 15311 tablet_bootstrap.cc:492] T 7f2cd7c8159d43c080fd8302180ecfca P eaa34beb1b274443b1c46839afd0a484: No bootstrap required, opened a new log
I20260709 14:54:13.454303 15352 raft_consensus.cc:515] T d6bcaee371174feaa06943f949efda49 P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:13.445799 15306 ts_tablet_manager.cc:1403] T f706543d4d3e4e7291624a785ca4e747 P dbc2c92e49e346b5b3bd7705a229afc6: Time spent bootstrapping tablet: real 0.235s	user 0.018s	sys 0.003s
I20260709 14:54:13.456177 15311 ts_tablet_manager.cc:1403] T 7f2cd7c8159d43c080fd8302180ecfca P eaa34beb1b274443b1c46839afd0a484: Time spent bootstrapping tablet: real 0.270s	user 0.013s	sys 0.010s
I20260709 14:54:13.474925 15353 consensus_queue.cc:1048] T 798d0882b1ea4b26b598c236de8f18c9 P eaa34beb1b274443b1c46839afd0a484 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:54:13.485651 15170 tablet_service.cc:1511] Processing CreateTablet for tablet 5e8a01e27eab492bb73df3359e500627 (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 14:54:13.487658 15251 tablet_service.cc:1511] Processing CreateTablet for tablet bdf08eed05854470954a5e9dd17dfb27 (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 14:54:13.489115 15170 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e8a01e27eab492bb73df3359e500627. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:13.488850 15025 tablet_service.cc:1511] Processing CreateTablet for tablet bdf08eed05854470954a5e9dd17dfb27 (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 14:54:13.490391 15025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bdf08eed05854470954a5e9dd17dfb27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:13.492637 15096 tablet_service.cc:1511] Processing CreateTablet for tablet bdf08eed05854470954a5e9dd17dfb27 (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 14:54:13.493125 15172 tablet_service.cc:1511] Processing CreateTablet for tablet 4abdbdda3ce149a9904e919be18e7a3f (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 14:54:13.494937 15172 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4abdbdda3ce149a9904e919be18e7a3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:13.490257 15251 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bdf08eed05854470954a5e9dd17dfb27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:13.496253 15306 raft_consensus.cc:359] T f706543d4d3e4e7291624a785ca4e747 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:13.495085 15096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bdf08eed05854470954a5e9dd17dfb27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:13.487463 15102 tablet_service.cc:1511] Processing CreateTablet for tablet 5e8a01e27eab492bb73df3359e500627 (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 14:54:13.501842 15102 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e8a01e27eab492bb73df3359e500627. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:13.468787 15311 raft_consensus.cc:359] T 7f2cd7c8159d43c080fd8302180ecfca P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:13.500614 15307 tablet_bootstrap.cc:492] T 054739df584d4b9db840777c2ae17555 P 9cb8de0701f2482b99e51d5ac080aa13: Bootstrap starting.
I20260709 14:54:13.497138 15306 raft_consensus.cc:385] T f706543d4d3e4e7291624a785ca4e747 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:13.509341 15306 raft_consensus.cc:740] T f706543d4d3e4e7291624a785ca4e747 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbc2c92e49e346b5b3bd7705a229afc6, State: Initialized, Role: FOLLOWER
I20260709 14:54:13.512306 15260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6bcaee371174feaa06943f949efda49" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13"
W20260709 14:54:13.514742 15150 leader_election.cc:343] T d6bcaee371174feaa06943f949efda49 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:13.515787 15306 consensus_queue.cc:260] T f706543d4d3e4e7291624a785ca4e747 P dbc2c92e49e346b5b3bd7705a229afc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:13.516523 15352 leader_election.cc:290] T d6bcaee371174feaa06943f949efda49 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 election: Requested vote from peers 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493), dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477)
I20260709 14:54:13.518082 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6bcaee371174feaa06943f949efda49" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc2c92e49e346b5b3bd7705a229afc6"
I20260709 14:54:13.518989 15038 raft_consensus.cc:3060] T d6bcaee371174feaa06943f949efda49 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:13.522980 15306 ts_tablet_manager.cc:1434] T f706543d4d3e4e7291624a785ca4e747 P dbc2c92e49e346b5b3bd7705a229afc6: Time spent starting tablet: real 0.062s	user 0.008s	sys 0.000s
I20260709 14:54:13.524829 15306 tablet_bootstrap.cc:492] T 7f2cd7c8159d43c080fd8302180ecfca P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap starting.
I20260709 14:54:13.505059 15311 raft_consensus.cc:385] T 7f2cd7c8159d43c080fd8302180ecfca P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:13.525555 15311 raft_consensus.cc:740] T 7f2cd7c8159d43c080fd8302180ecfca P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eaa34beb1b274443b1c46839afd0a484, State: Initialized, Role: FOLLOWER
I20260709 14:54:13.526852 15311 consensus_queue.cc:260] T 7f2cd7c8159d43c080fd8302180ecfca P eaa34beb1b274443b1c46839afd0a484 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:13.532824 15357 raft_consensus.cc:493] T 0284d9835221427ab285015d48a8040d P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:13.533666 15357 raft_consensus.cc:515] T 0284d9835221427ab285015d48a8040d P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:13.538030 15357 leader_election.cc:290] T 0284d9835221427ab285015d48a8040d P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493), 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177)
I20260709 14:54:13.538810 15024 tablet_service.cc:1511] Processing CreateTablet for tablet 4abdbdda3ce149a9904e919be18e7a3f (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 14:54:13.539330 15357 consensus_queue.cc:1048] T d354c94548fc411ab62b4281ed947944 P dbc2c92e49e346b5b3bd7705a229afc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:54:13.540750 15024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4abdbdda3ce149a9904e919be18e7a3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:13.541015 15112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0284d9835221427ab285015d48a8040d" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605" is_pre_election: true
I20260709 14:54:13.541885 15112 raft_consensus.cc:2468] T 0284d9835221427ab285015d48a8040d P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbc2c92e49e346b5b3bd7705a229afc6 in term 0.
I20260709 14:54:13.542549 15098 tablet_service.cc:1511] Processing CreateTablet for tablet b97c761f72c14075b65e501c4b3ae0fb (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 14:54:13.543802 15260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0284d9835221427ab285015d48a8040d" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13" is_pre_election: true
I20260709 14:54:13.544811 15098 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b97c761f72c14075b65e501c4b3ae0fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:13.544643 15260 raft_consensus.cc:2468] T 0284d9835221427ab285015d48a8040d P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbc2c92e49e346b5b3bd7705a229afc6 in term 0.
I20260709 14:54:13.574911 15369 raft_consensus.cc:493] T b8d6b9cf24a24444b2a69fd526cd4b09 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:13.575636 15369 raft_consensus.cc:515] T b8d6b9cf24a24444b2a69fd526cd4b09 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:13.581687 15111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8d6b9cf24a24444b2a69fd526cd4b09" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605" is_pre_election: true
I20260709 14:54:13.582544 15111 raft_consensus.cc:2468] T b8d6b9cf24a24444b2a69fd526cd4b09 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cb8de0701f2482b99e51d5ac080aa13 in term 0.
I20260709 14:54:13.544553 15001 leader_election.cc:304] T 0284d9835221427ab285015d48a8040d P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7519e608fbb44d9db8ad30b9f10ae605, dbc2c92e49e346b5b3bd7705a229afc6; no voters: 
I20260709 14:54:13.586051 15173 tablet_service.cc:1511] Processing CreateTablet for tablet b97c761f72c14075b65e501c4b3ae0fb (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 14:54:13.587750 15173 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b97c761f72c14075b65e501c4b3ae0fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:13.585135 15224 leader_election.cc:304] T b8d6b9cf24a24444b2a69fd526cd4b09 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7519e608fbb44d9db8ad30b9f10ae605, 9cb8de0701f2482b99e51d5ac080aa13; no voters: 
I20260709 14:54:13.590026 15346 raft_consensus.cc:2804] T b8d6b9cf24a24444b2a69fd526cd4b09 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:54:13.590590 15346 raft_consensus.cc:493] T b8d6b9cf24a24444b2a69fd526cd4b09 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:54:13.590961 15369 leader_election.cc:290] T b8d6b9cf24a24444b2a69fd526cd4b09 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177), eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805)
I20260709 14:54:13.591176 15346 raft_consensus.cc:3060] T b8d6b9cf24a24444b2a69fd526cd4b09 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:13.581280 15247 tablet_service.cc:1511] Processing CreateTablet for tablet 4abdbdda3ce149a9904e919be18e7a3f (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 14:54:13.589994 15357 raft_consensus.cc:2804] T 0284d9835221427ab285015d48a8040d P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:54:13.593927 15357 raft_consensus.cc:493] T 0284d9835221427ab285015d48a8040d P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:54:13.594369 15357 raft_consensus.cc:3060] T 0284d9835221427ab285015d48a8040d P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:13.596517 15248 tablet_service.cc:1511] Processing CreateTablet for tablet b97c761f72c14075b65e501c4b3ae0fb (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 14:54:13.599424 15186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8d6b9cf24a24444b2a69fd526cd4b09" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484" is_pre_election: true
I20260709 14:54:13.607031 15311 ts_tablet_manager.cc:1434] T 7f2cd7c8159d43c080fd8302180ecfca P eaa34beb1b274443b1c46839afd0a484: Time spent starting tablet: real 0.144s	user 0.009s	sys 0.000s
I20260709 14:54:13.570974 15309 tablet_bootstrap.cc:654] T f706543d4d3e4e7291624a785ca4e747 P 7519e608fbb44d9db8ad30b9f10ae605: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:13.594395 15247 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4abdbdda3ce149a9904e919be18e7a3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:13.608906 15311 tablet_bootstrap.cc:492] T d354c94548fc411ab62b4281ed947944 P eaa34beb1b274443b1c46839afd0a484: Bootstrap starting.
I20260709 14:54:13.608659 15038 raft_consensus.cc:2468] T d6bcaee371174feaa06943f949efda49 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa34beb1b274443b1c46839afd0a484 in term 1.
I20260709 14:54:13.630400 15248 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b97c761f72c14075b65e501c4b3ae0fb. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 14:54:13.632362 15227 leader_election.cc:343] T b8d6b9cf24a24444b2a69fd526cd4b09 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:13.640733 15376 raft_consensus.cc:493] T 7f2cd7c8159d43c080fd8302180ecfca P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:13.641907 15376 raft_consensus.cc:515] T 7f2cd7c8159d43c080fd8302180ecfca P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
W20260709 14:54:13.653756 15150 consensus_peers.cc:597] T 798d0882b1ea4b26b598c236de8f18c9 P eaa34beb1b274443b1c46839afd0a484 -> Peer 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177): Couldn't send request to peer 7519e608fbb44d9db8ad30b9f10ae605. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:54:13.655860 15111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2cd7c8159d43c080fd8302180ecfca" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605" is_pre_election: true
W20260709 14:54:13.659298 15004 consensus_peers.cc:597] T d354c94548fc411ab62b4281ed947944 P dbc2c92e49e346b5b3bd7705a229afc6 -> Peer eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805): Couldn't send request to peer eaa34beb1b274443b1c46839afd0a484. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:54:13.658663 15306 tablet_bootstrap.cc:654] T 7f2cd7c8159d43c080fd8302180ecfca P dbc2c92e49e346b5b3bd7705a229afc6: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:13.663154 15374 raft_consensus.cc:493] T 67409326aa124c52a5e9a650d7570a68 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:13.664364 15374 raft_consensus.cc:515] T 67409326aa124c52a5e9a650d7570a68 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:13.668440 15094 tablet_service.cc:1511] Processing CreateTablet for tablet db39b7ffe995451885f4074ddf16028d (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 14:54:13.669124 15022 tablet_service.cc:1511] Processing CreateTablet for tablet db39b7ffe995451885f4074ddf16028d (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 14:54:13.670066 15374 leader_election.cc:290] T 67409326aa124c52a5e9a650d7570a68 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177), 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493)
I20260709 14:54:13.670308 15094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db39b7ffe995451885f4074ddf16028d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:13.670806 15022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db39b7ffe995451885f4074ddf16028d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:13.673805 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2cd7c8159d43c080fd8302180ecfca" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" is_pre_election: true
W20260709 14:54:13.659298 15150 leader_election.cc:343] T 7f2cd7c8159d43c080fd8302180ecfca P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:13.681005 15111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67409326aa124c52a5e9a650d7570a68" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605" is_pre_election: true
I20260709 14:54:13.682487 15311 tablet_bootstrap.cc:654] T d354c94548fc411ab62b4281ed947944 P eaa34beb1b274443b1c46839afd0a484: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:13.682852 15261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67409326aa124c52a5e9a650d7570a68" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13" is_pre_election: true
W20260709 14:54:13.685209 15150 leader_election.cc:343] T 67409326aa124c52a5e9a650d7570a68 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493): Illegal state: must be running to vote when last-logged opid is not known
W20260709 14:54:13.686111 15150 leader_election.cc:343] T 67409326aa124c52a5e9a650d7570a68 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:13.686550 15150 leader_election.cc:304] T 67409326aa124c52a5e9a650d7570a68 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa34beb1b274443b1c46839afd0a484; no voters: 7519e608fbb44d9db8ad30b9f10ae605, 9cb8de0701f2482b99e51d5ac080aa13
I20260709 14:54:13.686770 15153 leader_election.cc:304] T d6bcaee371174feaa06943f949efda49 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dbc2c92e49e346b5b3bd7705a229afc6, eaa34beb1b274443b1c46839afd0a484; no voters: 9cb8de0701f2482b99e51d5ac080aa13
I20260709 14:54:13.687654 15353 raft_consensus.cc:2749] T 67409326aa124c52a5e9a650d7570a68 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:54:13.688618 15353 raft_consensus.cc:2804] T d6bcaee371174feaa06943f949efda49 P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:54:13.689998 15353 raft_consensus.cc:697] T d6bcaee371174feaa06943f949efda49 P eaa34beb1b274443b1c46839afd0a484 [term 1 LEADER]: Becoming Leader. State: Replica: eaa34beb1b274443b1c46839afd0a484, State: Running, Role: LEADER
I20260709 14:54:13.691192 15353 consensus_queue.cc:237] T d6bcaee371174feaa06943f949efda49 P eaa34beb1b274443b1c46839afd0a484 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
W20260709 14:54:13.692461 15150 consensus_peers.cc:597] T 6cd07fbeb9f149a08fdbac2e0247eca4 P eaa34beb1b274443b1c46839afd0a484 -> Peer 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177): Couldn't send request to peer 7519e608fbb44d9db8ad30b9f10ae605. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 14:54:13.688565 15153 leader_election.cc:343] T 7f2cd7c8159d43c080fd8302180ecfca P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Illegal state: must be running to vote when last-logged opid is not known
W20260709 14:54:13.697948 15377 log.cc:927] Time spent T d354c94548fc411ab62b4281ed947944 P 7519e608fbb44d9db8ad30b9f10ae605: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
I20260709 14:54:13.662177 15376 leader_election.cc:290] T 7f2cd7c8159d43c080fd8302180ecfca P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477), 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177)
I20260709 14:54:13.711800 15307 tablet_bootstrap.cc:654] T 054739df584d4b9db840777c2ae17555 P 9cb8de0701f2482b99e51d5ac080aa13: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:13.694283 15153 leader_election.cc:304] T 7f2cd7c8159d43c080fd8302180ecfca P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa34beb1b274443b1c46839afd0a484; no voters: 7519e608fbb44d9db8ad30b9f10ae605, dbc2c92e49e346b5b3bd7705a229afc6
I20260709 14:54:13.741681 15376 raft_consensus.cc:2749] T 7f2cd7c8159d43c080fd8302180ecfca P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:54:13.753369 15176 tablet_service.cc:1511] Processing CreateTablet for tablet db39b7ffe995451885f4074ddf16028d (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 14:54:13.755227 15176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db39b7ffe995451885f4074ddf16028d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:13.730645 15346 raft_consensus.cc:515] T b8d6b9cf24a24444b2a69fd526cd4b09 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:13.750195 15026 tablet_service.cc:1511] Processing CreateTablet for tablet 8974e5ab032b4fba92bfc577280778bf (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
W20260709 14:54:13.751430 15153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:45477, user_credentials={real_user=slave}} blocked reactor thread for 62933.9us
I20260709 14:54:13.779187 15100 tablet_service.cc:1511] Processing CreateTablet for tablet 8974e5ab032b4fba92bfc577280778bf (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 14:54:13.781100 15100 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8974e5ab032b4fba92bfc577280778bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:13.790997 15026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8974e5ab032b4fba92bfc577280778bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:13.783550 15357 raft_consensus.cc:515] T 0284d9835221427ab285015d48a8040d P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:13.801986 15357 leader_election.cc:290] T 0284d9835221427ab285015d48a8040d P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 election: Requested vote from peers 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493), 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177)
I20260709 14:54:13.804204 15260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0284d9835221427ab285015d48a8040d" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13"
I20260709 14:54:13.804529 15111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0284d9835221427ab285015d48a8040d" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605"
I20260709 14:54:13.805150 15111 raft_consensus.cc:3060] T 0284d9835221427ab285015d48a8040d P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:13.805383 15242 tablet_service.cc:1511] Processing CreateTablet for tablet 5b9f8063585c4e5faddebd56fbe1aa01 (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 14:54:13.807751 15346 leader_election.cc:290] T b8d6b9cf24a24444b2a69fd526cd4b09 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 election: Requested vote from peers 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177), eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805)
I20260709 14:54:13.807602 15242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b9f8063585c4e5faddebd56fbe1aa01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:13.787024 15249 tablet_service.cc:1511] Processing CreateTablet for tablet 8974e5ab032b4fba92bfc577280778bf (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 14:54:13.814713 15096 tablet_service.cc:1511] Processing CreateTablet for tablet ff73c3d51e5e480c920d1aca00b9b40d (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 14:54:13.816133 15249 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8974e5ab032b4fba92bfc577280778bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:13.816679 15096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff73c3d51e5e480c920d1aca00b9b40d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:13.818434 15113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8d6b9cf24a24444b2a69fd526cd4b09" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605"
I20260709 14:54:13.826839 15113 raft_consensus.cc:3060] T b8d6b9cf24a24444b2a69fd526cd4b09 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:13.830866 15171 tablet_service.cc:1511] Processing CreateTablet for tablet 5b9f8063585c4e5faddebd56fbe1aa01 (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 14:54:13.841012 15171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b9f8063585c4e5faddebd56fbe1aa01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:13.833886 15260 raft_consensus.cc:3060] T 0284d9835221427ab285015d48a8040d P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:13.869290 15111 raft_consensus.cc:2468] T 0284d9835221427ab285015d48a8040d P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbc2c92e49e346b5b3bd7705a229afc6 in term 1.
I20260709 14:54:13.871949 15001 leader_election.cc:304] T 0284d9835221427ab285015d48a8040d P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7519e608fbb44d9db8ad30b9f10ae605, dbc2c92e49e346b5b3bd7705a229afc6; no voters: 
I20260709 14:54:13.885099 15251 tablet_service.cc:1511] Processing CreateTablet for tablet ff73c3d51e5e480c920d1aca00b9b40d (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 14:54:13.886991 15251 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff73c3d51e5e480c920d1aca00b9b40d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:13.892488 15113 raft_consensus.cc:2468] T b8d6b9cf24a24444b2a69fd526cd4b09 P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cb8de0701f2482b99e51d5ac080aa13 in term 1.
I20260709 14:54:13.898664 15021 tablet_service.cc:1511] Processing CreateTablet for tablet 5b9f8063585c4e5faddebd56fbe1aa01 (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 14:54:13.900693 15021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b9f8063585c4e5faddebd56fbe1aa01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:13.900739 15025 tablet_service.cc:1511] Processing CreateTablet for tablet a9dab1878c4b4550880f5680c6d48c67 (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 14:54:13.910149 15357 raft_consensus.cc:493] T f706543d4d3e4e7291624a785ca4e747 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:13.910816 15357 raft_consensus.cc:515] T f706543d4d3e4e7291624a785ca4e747 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:13.914958 15224 leader_election.cc:304] T b8d6b9cf24a24444b2a69fd526cd4b09 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7519e608fbb44d9db8ad30b9f10ae605, 9cb8de0701f2482b99e51d5ac080aa13; no voters: 
I20260709 14:54:13.916082 15346 raft_consensus.cc:2804] T b8d6b9cf24a24444b2a69fd526cd4b09 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:54:13.916687 15346 raft_consensus.cc:697] T b8d6b9cf24a24444b2a69fd526cd4b09 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 LEADER]: Becoming Leader. State: Replica: 9cb8de0701f2482b99e51d5ac080aa13, State: Running, Role: LEADER
I20260709 14:54:13.918464 15346 consensus_queue.cc:237] T b8d6b9cf24a24444b2a69fd526cd4b09 P 9cb8de0701f2482b99e51d5ac080aa13 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:13.924335 15261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f706543d4d3e4e7291624a785ca4e747" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13" is_pre_election: true
I20260709 14:54:13.925590 15357 leader_election.cc:290] T f706543d4d3e4e7291624a785ca4e747 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493), 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177)
I20260709 14:54:13.926532 15113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f706543d4d3e4e7291624a785ca4e747" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605" is_pre_election: true
W20260709 14:54:13.926637 15001 leader_election.cc:343] T f706543d4d3e4e7291624a785ca4e747 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493): Illegal state: must be running to vote when last-logged opid is not known
W20260709 14:54:13.954944 15001 leader_election.cc:343] T f706543d4d3e4e7291624a785ca4e747 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:13.955842 15001 leader_election.cc:304] T f706543d4d3e4e7291624a785ca4e747 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbc2c92e49e346b5b3bd7705a229afc6; no voters: 7519e608fbb44d9db8ad30b9f10ae605, 9cb8de0701f2482b99e51d5ac080aa13
I20260709 14:54:13.966339 15357 raft_consensus.cc:2749] T f706543d4d3e4e7291624a785ca4e747 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:54:13.957633 15309 tablet_bootstrap.cc:492] T f706543d4d3e4e7291624a785ca4e747 P 7519e608fbb44d9db8ad30b9f10ae605: No bootstrap required, opened a new log
I20260709 14:54:13.960279 15025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9dab1878c4b4550880f5680c6d48c67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:13.988453 15186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8d6b9cf24a24444b2a69fd526cd4b09" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484"
I20260709 14:54:13.994755 15244 tablet_service.cc:1511] Processing CreateTablet for tablet 4f709a060be148029cf72f1af6f79714 (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 14:54:13.996618 15244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f709a060be148029cf72f1af6f79714. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:14.001778 15311 tablet_bootstrap.cc:492] T d354c94548fc411ab62b4281ed947944 P eaa34beb1b274443b1c46839afd0a484: No bootstrap required, opened a new log
I20260709 14:54:14.002493 15311 ts_tablet_manager.cc:1403] T d354c94548fc411ab62b4281ed947944 P eaa34beb1b274443b1c46839afd0a484: Time spent bootstrapping tablet: real 0.394s	user 0.026s	sys 0.018s
I20260709 14:54:14.005455 15094 tablet_service.cc:1511] Processing CreateTablet for tablet a9dab1878c4b4550880f5680c6d48c67 (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 14:54:14.008034 15094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9dab1878c4b4550880f5680c6d48c67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:13.991714 15383 raft_consensus.cc:2804] T 0284d9835221427ab285015d48a8040d P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:54:14.011632 15383 raft_consensus.cc:697] T 0284d9835221427ab285015d48a8040d P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 LEADER]: Becoming Leader. State: Replica: dbc2c92e49e346b5b3bd7705a229afc6, State: Running, Role: LEADER
I20260709 14:54:14.018729 15024 tablet_service.cc:1511] Processing CreateTablet for tablet 4f709a060be148029cf72f1af6f79714 (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 14:54:14.020850 15024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f709a060be148029cf72f1af6f79714. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:14.021962 15176 tablet_service.cc:1511] Processing CreateTablet for tablet ff73c3d51e5e480c920d1aca00b9b40d (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 14:54:14.023391 15172 tablet_service.cc:1511] Processing CreateTablet for tablet a9dab1878c4b4550880f5680c6d48c67 (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
W20260709 14:54:14.026021 15227 leader_election.cc:343] T b8d6b9cf24a24444b2a69fd526cd4b09 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:13.979446 15309 ts_tablet_manager.cc:1403] T f706543d4d3e4e7291624a785ca4e747 P 7519e608fbb44d9db8ad30b9f10ae605: Time spent bootstrapping tablet: real 0.538s	user 0.023s	sys 0.006s
W20260709 14:54:14.047564 14984 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 14:54:14.054334 15101 tablet_service.cc:1511] Processing CreateTablet for tablet 4f709a060be148029cf72f1af6f79714 (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 14:54:14.056746 15101 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f709a060be148029cf72f1af6f79714. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:14.062067 15311 raft_consensus.cc:359] T d354c94548fc411ab62b4281ed947944 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:14.063076 15311 raft_consensus.cc:385] T d354c94548fc411ab62b4281ed947944 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:14.063446 15311 raft_consensus.cc:740] T d354c94548fc411ab62b4281ed947944 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eaa34beb1b274443b1c46839afd0a484, State: Initialized, Role: FOLLOWER
I20260709 14:54:14.064327 15311 consensus_queue.cc:260] T d354c94548fc411ab62b4281ed947944 P eaa34beb1b274443b1c46839afd0a484 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:14.064944 15028 tablet_service.cc:1511] Processing CreateTablet for tablet d2463fd792b240e9911c6b38bcb453b8 (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 14:54:14.066686 15028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2463fd792b240e9911c6b38bcb453b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:14.068390 15095 tablet_service.cc:1511] Processing CreateTablet for tablet 1193461bc272409e8a1e719ecdb38e7f (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 14:54:14.070012 15095 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1193461bc272409e8a1e719ecdb38e7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:14.011724 15306 tablet_bootstrap.cc:492] T 7f2cd7c8159d43c080fd8302180ecfca P dbc2c92e49e346b5b3bd7705a229afc6: No bootstrap required, opened a new log
I20260709 14:54:14.072047 15306 ts_tablet_manager.cc:1403] T 7f2cd7c8159d43c080fd8302180ecfca P dbc2c92e49e346b5b3bd7705a229afc6: Time spent bootstrapping tablet: real 0.548s	user 0.012s	sys 0.037s
I20260709 14:54:14.087168 15260 raft_consensus.cc:2468] T 0284d9835221427ab285015d48a8040d P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbc2c92e49e346b5b3bd7705a229afc6 in term 1.
I20260709 14:54:14.014194 15383 consensus_queue.cc:237] T 0284d9835221427ab285015d48a8040d P dbc2c92e49e346b5b3bd7705a229afc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:14.090500 15243 tablet_service.cc:1511] Processing CreateTablet for tablet 1193461bc272409e8a1e719ecdb38e7f (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 14:54:14.092208 15243 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1193461bc272409e8a1e719ecdb38e7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:14.062682 15248 tablet_service.cc:1511] Processing CreateTablet for tablet d2463fd792b240e9911c6b38bcb453b8 (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 14:54:14.100508 15248 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2463fd792b240e9911c6b38bcb453b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:14.024580 15176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff73c3d51e5e480c920d1aca00b9b40d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:14.103348 15376 consensus_queue.cc:1048] T 6cd07fbeb9f149a08fdbac2e0247eca4 P eaa34beb1b274443b1c46839afd0a484 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:54:14.104503 14933 catalog_manager.cc:5697] T b8d6b9cf24a24444b2a69fd526cd4b09 P 9cb8de0701f2482b99e51d5ac080aa13 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68). New cstate: current_term: 1 leader_uuid: "9cb8de0701f2482b99e51d5ac080aa13" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } health_report { overall_health: HEALTHY } } }
I20260709 14:54:14.103948 15172 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9dab1878c4b4550880f5680c6d48c67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:14.109701 15309 raft_consensus.cc:359] T f706543d4d3e4e7291624a785ca4e747 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:14.111114 15309 raft_consensus.cc:385] T f706543d4d3e4e7291624a785ca4e747 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:14.111547 15309 raft_consensus.cc:740] T f706543d4d3e4e7291624a785ca4e747 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7519e608fbb44d9db8ad30b9f10ae605, State: Initialized, Role: FOLLOWER
I20260709 14:54:14.114055 15311 ts_tablet_manager.cc:1434] T d354c94548fc411ab62b4281ed947944 P eaa34beb1b274443b1c46839afd0a484: Time spent starting tablet: real 0.110s	user 0.012s	sys 0.000s
I20260709 14:54:14.115662 15307 tablet_bootstrap.cc:492] T 054739df584d4b9db840777c2ae17555 P 9cb8de0701f2482b99e51d5ac080aa13: No bootstrap required, opened a new log
I20260709 14:54:14.116427 15307 ts_tablet_manager.cc:1403] T 054739df584d4b9db840777c2ae17555 P 9cb8de0701f2482b99e51d5ac080aa13: Time spent bootstrapping tablet: real 0.616s	user 0.035s	sys 0.030s
W20260709 14:54:14.114118 15391 log.cc:927] Time spent T b8d6b9cf24a24444b2a69fd526cd4b09 P 9cb8de0701f2482b99e51d5ac080aa13: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 14:54:14.139310 15173 tablet_service.cc:1511] Processing CreateTablet for tablet d2463fd792b240e9911c6b38bcb453b8 (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 14:54:14.141024 15173 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2463fd792b240e9911c6b38bcb453b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:14.142433 15311 tablet_bootstrap.cc:492] T d2c4ea1c33c64cd09ba04611fdbdc59d P eaa34beb1b274443b1c46839afd0a484: Bootstrap starting.
I20260709 14:54:14.050947 14934 catalog_manager.cc:5697] T 6cd07fbeb9f149a08fdbac2e0247eca4 P eaa34beb1b274443b1c46839afd0a484 reported cstate change: term changed from 0 to 1, leader changed from <none> to eaa34beb1b274443b1c46839afd0a484 (127.6.101.67). New cstate: current_term: 1 leader_uuid: "eaa34beb1b274443b1c46839afd0a484" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } health_report { overall_health: UNKNOWN } } }
I20260709 14:54:14.146613 15022 tablet_service.cc:1511] Processing CreateTablet for tablet d326f264e68d41d69b5007023083ed9e (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 14:54:14.152488 15169 tablet_service.cc:1511] Processing CreateTablet for tablet d326f264e68d41d69b5007023083ed9e (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 14:54:14.154436 15102 tablet_service.cc:1511] Processing CreateTablet for tablet d326f264e68d41d69b5007023083ed9e (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 14:54:14.076159 15306 raft_consensus.cc:359] T 7f2cd7c8159d43c080fd8302180ecfca P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:14.161935 15306 raft_consensus.cc:385] T 7f2cd7c8159d43c080fd8302180ecfca P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:14.162364 15306 raft_consensus.cc:740] T 7f2cd7c8159d43c080fd8302180ecfca P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbc2c92e49e346b5b3bd7705a229afc6, State: Initialized, Role: FOLLOWER
I20260709 14:54:14.163371 15306 consensus_queue.cc:260] T 7f2cd7c8159d43c080fd8302180ecfca P dbc2c92e49e346b5b3bd7705a229afc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:14.166663 15246 tablet_service.cc:1511] Processing CreateTablet for tablet d2273a1ad13e4c54ae2101a15a7e56e1 (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 14:54:14.167629 15170 tablet_service.cc:1511] Processing CreateTablet for tablet 1193461bc272409e8a1e719ecdb38e7f (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 14:54:14.168399 15246 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2273a1ad13e4c54ae2101a15a7e56e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:14.170056 15169 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d326f264e68d41d69b5007023083ed9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:14.169764 15309 consensus_queue.cc:260] T f706543d4d3e4e7291624a785ca4e747 P 7519e608fbb44d9db8ad30b9f10ae605 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:14.173306 15309 ts_tablet_manager.cc:1434] T f706543d4d3e4e7291624a785ca4e747 P 7519e608fbb44d9db8ad30b9f10ae605: Time spent starting tablet: real 0.143s	user 0.009s	sys 0.001s
I20260709 14:54:14.175666 14934 catalog_manager.cc:5697] T d6bcaee371174feaa06943f949efda49 P eaa34beb1b274443b1c46839afd0a484 reported cstate change: term changed from 0 to 1, leader changed from <none> to eaa34beb1b274443b1c46839afd0a484 (127.6.101.67). New cstate: current_term: 1 leader_uuid: "eaa34beb1b274443b1c46839afd0a484" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } health_report { overall_health: UNKNOWN } } }
I20260709 14:54:14.177964 15022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d326f264e68d41d69b5007023083ed9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:14.178200 14934 catalog_manager.cc:5697] T 798d0882b1ea4b26b598c236de8f18c9 P eaa34beb1b274443b1c46839afd0a484 reported cstate change: term changed from 0 to 1, leader changed from <none> to eaa34beb1b274443b1c46839afd0a484 (127.6.101.67). New cstate: current_term: 1 leader_uuid: "eaa34beb1b274443b1c46839afd0a484" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } health_report { overall_health: HEALTHY } } }
I20260709 14:54:14.132769 15307 raft_consensus.cc:359] T 054739df584d4b9db840777c2ae17555 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:14.180441 15307 raft_consensus.cc:385] T 054739df584d4b9db840777c2ae17555 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:14.180816 15307 raft_consensus.cc:740] T 054739df584d4b9db840777c2ae17555 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9cb8de0701f2482b99e51d5ac080aa13, State: Initialized, Role: FOLLOWER
I20260709 14:54:14.181752 15307 consensus_queue.cc:260] T 054739df584d4b9db840777c2ae17555 P 9cb8de0701f2482b99e51d5ac080aa13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:14.188426 15307 ts_tablet_manager.cc:1434] T 054739df584d4b9db840777c2ae17555 P 9cb8de0701f2482b99e51d5ac080aa13: Time spent starting tablet: real 0.072s	user 0.008s	sys 0.004s
I20260709 14:54:14.194378 15102 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d326f264e68d41d69b5007023083ed9e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 14:54:14.195262 15150 consensus_peers.cc:597] T d6bcaee371174feaa06943f949efda49 P eaa34beb1b274443b1c46839afd0a484 -> Peer 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493): Couldn't send request to peer 9cb8de0701f2482b99e51d5ac080aa13. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:54:14.196853 15025 tablet_service.cc:1511] Processing CreateTablet for tablet d2273a1ad13e4c54ae2101a15a7e56e1 (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 14:54:14.204586 15170 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1193461bc272409e8a1e719ecdb38e7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:14.207667 15309 tablet_bootstrap.cc:492] T 7f2cd7c8159d43c080fd8302180ecfca P 7519e608fbb44d9db8ad30b9f10ae605: Bootstrap starting.
I20260709 14:54:14.166239 15306 ts_tablet_manager.cc:1434] T 7f2cd7c8159d43c080fd8302180ecfca P dbc2c92e49e346b5b3bd7705a229afc6: Time spent starting tablet: real 0.094s	user 0.007s	sys 0.002s
I20260709 14:54:14.211385 15306 tablet_bootstrap.cc:492] T 7699ad132e12472180b6a9527951c397 P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap starting.
I20260709 14:54:14.234826 15171 tablet_service.cc:1511] Processing CreateTablet for tablet 46a35b81512c4e8c8ec6b83d4c768e1f (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 14:54:14.236516 15171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46a35b81512c4e8c8ec6b83d4c768e1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:14.237476 15025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2273a1ad13e4c54ae2101a15a7e56e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:14.258245 15311 tablet_bootstrap.cc:654] T d2c4ea1c33c64cd09ba04611fdbdc59d P eaa34beb1b274443b1c46839afd0a484: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:14.264701 15309 tablet_bootstrap.cc:654] T 7f2cd7c8159d43c080fd8302180ecfca P 7519e608fbb44d9db8ad30b9f10ae605: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:14.277793 15351 raft_consensus.cc:493] T f706543d4d3e4e7291624a785ca4e747 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:14.247334 15307 tablet_bootstrap.cc:492] T 7699ad132e12472180b6a9527951c397 P 9cb8de0701f2482b99e51d5ac080aa13: Bootstrap starting.
I20260709 14:54:14.279770 15351 raft_consensus.cc:515] T f706543d4d3e4e7291624a785ca4e747 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:14.283908 15351 leader_election.cc:290] T f706543d4d3e4e7291624a785ca4e747 P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493), dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477)
I20260709 14:54:14.284788 15261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f706543d4d3e4e7291624a785ca4e747" candidate_uuid: "7519e608fbb44d9db8ad30b9f10ae605" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13" is_pre_election: true
W20260709 14:54:14.287166 15076 leader_election.cc:343] T f706543d4d3e4e7291624a785ca4e747 P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:14.288439 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f706543d4d3e4e7291624a785ca4e747" candidate_uuid: "7519e608fbb44d9db8ad30b9f10ae605" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" is_pre_election: true
I20260709 14:54:14.300303 15021 tablet_service.cc:1511] Processing CreateTablet for tablet 46a35b81512c4e8c8ec6b83d4c768e1f (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 14:54:14.300817 15095 tablet_service.cc:1511] Processing CreateTablet for tablet d2273a1ad13e4c54ae2101a15a7e56e1 (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 14:54:14.302665 15095 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2273a1ad13e4c54ae2101a15a7e56e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:14.290696 15037 raft_consensus.cc:2468] T f706543d4d3e4e7291624a785ca4e747 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7519e608fbb44d9db8ad30b9f10ae605 in term 0.
I20260709 14:54:14.306002 15374 consensus_queue.cc:1048] T d6bcaee371174feaa06943f949efda49 P eaa34beb1b274443b1c46839afd0a484 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:54:14.306248 15079 leader_election.cc:304] T f706543d4d3e4e7291624a785ca4e747 P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7519e608fbb44d9db8ad30b9f10ae605, dbc2c92e49e346b5b3bd7705a229afc6; no voters: 9cb8de0701f2482b99e51d5ac080aa13
I20260709 14:54:14.319193 15021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46a35b81512c4e8c8ec6b83d4c768e1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:14.329324 15346 raft_consensus.cc:493] T 054739df584d4b9db840777c2ae17555 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:14.330030 15346 raft_consensus.cc:515] T 054739df584d4b9db840777c2ae17555 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:14.334381 15113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "054739df584d4b9db840777c2ae17555" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605" is_pre_election: true
I20260709 14:54:14.335554 15383 raft_consensus.cc:493] T 7f2cd7c8159d43c080fd8302180ecfca P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:14.336555 15383 raft_consensus.cc:515] T 7f2cd7c8159d43c080fd8302180ecfca P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:14.337903 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "054739df584d4b9db840777c2ae17555" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" is_pre_election: true
I20260709 14:54:14.339084 15346 leader_election.cc:290] T 054739df584d4b9db840777c2ae17555 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477), 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177)
W20260709 14:54:14.340667 15224 leader_election.cc:343] T 054739df584d4b9db840777c2ae17555 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177): Illegal state: must be running to vote when last-logged opid is not known
W20260709 14:54:14.342520 15227 consensus_peers.cc:597] T b8d6b9cf24a24444b2a69fd526cd4b09 P 9cb8de0701f2482b99e51d5ac080aa13 -> Peer eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805): Couldn't send request to peer eaa34beb1b274443b1c46839afd0a484. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:54:14.342692 15186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2cd7c8159d43c080fd8302180ecfca" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484" is_pre_election: true
I20260709 14:54:14.343803 15186 raft_consensus.cc:2468] T 7f2cd7c8159d43c080fd8302180ecfca P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbc2c92e49e346b5b3bd7705a229afc6 in term 0.
I20260709 14:54:14.345682 15004 leader_election.cc:304] T 7f2cd7c8159d43c080fd8302180ecfca P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dbc2c92e49e346b5b3bd7705a229afc6, eaa34beb1b274443b1c46839afd0a484; no voters: 
I20260709 14:54:14.346612 15357 raft_consensus.cc:2804] T 7f2cd7c8159d43c080fd8302180ecfca P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:54:14.347015 15357 raft_consensus.cc:493] T 7f2cd7c8159d43c080fd8302180ecfca P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:54:14.347364 15357 raft_consensus.cc:3060] T 7f2cd7c8159d43c080fd8302180ecfca P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Advancing to term 1
W20260709 14:54:14.343824 15227 leader_election.cc:343] T 054739df584d4b9db840777c2ae17555 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:14.348676 15227 leader_election.cc:304] T 054739df584d4b9db840777c2ae17555 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cb8de0701f2482b99e51d5ac080aa13; no voters: 7519e608fbb44d9db8ad30b9f10ae605, dbc2c92e49e346b5b3bd7705a229afc6
I20260709 14:54:14.350461 15383 leader_election.cc:290] T 7f2cd7c8159d43c080fd8302180ecfca P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805), 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177)
I20260709 14:54:14.351827 15243 tablet_service.cc:1511] Processing CreateTablet for tablet 46a35b81512c4e8c8ec6b83d4c768e1f (DEFAULT_TABLE table=test-workload [id=4be2e4a1719a46dbb2835714bf0cb051]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 14:54:14.353433 15243 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46a35b81512c4e8c8ec6b83d4c768e1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:14.354249 15346 raft_consensus.cc:2749] T 054739df584d4b9db840777c2ae17555 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:54:14.355741 15113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2cd7c8159d43c080fd8302180ecfca" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605" is_pre_election: true
W20260709 14:54:14.358376 15001 leader_election.cc:343] T 7f2cd7c8159d43c080fd8302180ecfca P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:14.317307 15351 raft_consensus.cc:2804] T f706543d4d3e4e7291624a785ca4e747 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:54:14.359913 15351 raft_consensus.cc:493] T f706543d4d3e4e7291624a785ca4e747 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:54:14.360365 15351 raft_consensus.cc:3060] T f706543d4d3e4e7291624a785ca4e747 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:14.391419 15307 tablet_bootstrap.cc:654] T 7699ad132e12472180b6a9527951c397 P 9cb8de0701f2482b99e51d5ac080aa13: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:14.396492 15311 tablet_bootstrap.cc:492] T d2c4ea1c33c64cd09ba04611fdbdc59d P eaa34beb1b274443b1c46839afd0a484: No bootstrap required, opened a new log
I20260709 14:54:14.397286 15311 ts_tablet_manager.cc:1403] T d2c4ea1c33c64cd09ba04611fdbdc59d P eaa34beb1b274443b1c46839afd0a484: Time spent bootstrapping tablet: real 0.282s	user 0.015s	sys 0.013s
I20260709 14:54:14.400838 14935 catalog_manager.cc:5697] T 0284d9835221427ab285015d48a8040d P dbc2c92e49e346b5b3bd7705a229afc6 reported cstate change: term changed from 0 to 1, leader changed from <none> to dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65). New cstate: current_term: 1 leader_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } health_report { overall_health: UNKNOWN } } }
I20260709 14:54:14.403206 15306 tablet_bootstrap.cc:654] T 7699ad132e12472180b6a9527951c397 P dbc2c92e49e346b5b3bd7705a229afc6: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:14.402915 15357 raft_consensus.cc:515] T 7f2cd7c8159d43c080fd8302180ecfca P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:14.408468 15113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2cd7c8159d43c080fd8302180ecfca" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605"
I20260709 14:54:14.408465 15186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2cd7c8159d43c080fd8302180ecfca" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484"
I20260709 14:54:14.410588 15186 raft_consensus.cc:3060] T 7f2cd7c8159d43c080fd8302180ecfca P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:14.411721 15311 raft_consensus.cc:359] T d2c4ea1c33c64cd09ba04611fdbdc59d P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:14.412752 15311 raft_consensus.cc:385] T d2c4ea1c33c64cd09ba04611fdbdc59d P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:14.413082 15311 raft_consensus.cc:740] T d2c4ea1c33c64cd09ba04611fdbdc59d P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eaa34beb1b274443b1c46839afd0a484, State: Initialized, Role: FOLLOWER
W20260709 14:54:14.416293 15001 leader_election.cc:343] T 7f2cd7c8159d43c080fd8302180ecfca P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:14.421561 15311 consensus_queue.cc:260] T d2c4ea1c33c64cd09ba04611fdbdc59d P eaa34beb1b274443b1c46839afd0a484 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:14.411897 15357 leader_election.cc:290] T 7f2cd7c8159d43c080fd8302180ecfca P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 election: Requested vote from peers eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805), 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177)
I20260709 14:54:14.437690 15351 raft_consensus.cc:515] T f706543d4d3e4e7291624a785ca4e747 P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:14.438212 15186 raft_consensus.cc:2468] T 7f2cd7c8159d43c080fd8302180ecfca P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbc2c92e49e346b5b3bd7705a229afc6 in term 1.
I20260709 14:54:14.440563 15004 leader_election.cc:304] T 7f2cd7c8159d43c080fd8302180ecfca P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dbc2c92e49e346b5b3bd7705a229afc6, eaa34beb1b274443b1c46839afd0a484; no voters: 7519e608fbb44d9db8ad30b9f10ae605
I20260709 14:54:14.445968 15374 raft_consensus.cc:493] T d354c94548fc411ab62b4281ed947944 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:14.447029 15357 raft_consensus.cc:2804] T 7f2cd7c8159d43c080fd8302180ecfca P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:54:14.446760 15374 raft_consensus.cc:515] T d354c94548fc411ab62b4281ed947944 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:14.449874 15260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f706543d4d3e4e7291624a785ca4e747" candidate_uuid: "7519e608fbb44d9db8ad30b9f10ae605" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13"
I20260709 14:54:14.451072 15374 leader_election.cc:290] T d354c94548fc411ab62b4281ed947944 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477), 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177)
W20260709 14:54:14.451892 15076 leader_election.cc:343] T f706543d4d3e4e7291624a785ca4e747 P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:14.454519 15113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d354c94548fc411ab62b4281ed947944" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605" is_pre_election: true
I20260709 14:54:14.458753 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d354c94548fc411ab62b4281ed947944" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" is_pre_election: true
I20260709 14:54:14.457231 15351 leader_election.cc:290] T f706543d4d3e4e7291624a785ca4e747 P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 1 election: Requested vote from peers 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493), dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477)
I20260709 14:54:14.459631 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f706543d4d3e4e7291624a785ca4e747" candidate_uuid: "7519e608fbb44d9db8ad30b9f10ae605" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc2c92e49e346b5b3bd7705a229afc6"
I20260709 14:54:14.460342 15037 raft_consensus.cc:3060] T f706543d4d3e4e7291624a785ca4e747 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:14.460866 15311 ts_tablet_manager.cc:1434] T d2c4ea1c33c64cd09ba04611fdbdc59d P eaa34beb1b274443b1c46839afd0a484: Time spent starting tablet: real 0.063s	user 0.009s	sys 0.000s
I20260709 14:54:14.468883 15153 leader_election.cc:304] T d354c94548fc411ab62b4281ed947944 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa34beb1b274443b1c46839afd0a484; no voters: 7519e608fbb44d9db8ad30b9f10ae605, dbc2c92e49e346b5b3bd7705a229afc6
I20260709 14:54:14.472048 15374 raft_consensus.cc:2749] T d354c94548fc411ab62b4281ed947944 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:54:14.474538 15311 tablet_bootstrap.cc:492] T b8d6b9cf24a24444b2a69fd526cd4b09 P eaa34beb1b274443b1c46839afd0a484: Bootstrap starting.
I20260709 14:54:14.476298 15307 tablet_bootstrap.cc:492] T 7699ad132e12472180b6a9527951c397 P 9cb8de0701f2482b99e51d5ac080aa13: No bootstrap required, opened a new log
I20260709 14:54:14.477162 15307 ts_tablet_manager.cc:1403] T 7699ad132e12472180b6a9527951c397 P 9cb8de0701f2482b99e51d5ac080aa13: Time spent bootstrapping tablet: real 0.260s	user 0.009s	sys 0.014s
I20260709 14:54:14.480268 15037 raft_consensus.cc:2468] T f706543d4d3e4e7291624a785ca4e747 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7519e608fbb44d9db8ad30b9f10ae605 in term 1.
I20260709 14:54:14.498061 15311 tablet_bootstrap.cc:654] T b8d6b9cf24a24444b2a69fd526cd4b09 P eaa34beb1b274443b1c46839afd0a484: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:14.488973 15309 tablet_bootstrap.cc:492] T 7f2cd7c8159d43c080fd8302180ecfca P 7519e608fbb44d9db8ad30b9f10ae605: No bootstrap required, opened a new log
I20260709 14:54:14.502863 15309 ts_tablet_manager.cc:1403] T 7f2cd7c8159d43c080fd8302180ecfca P 7519e608fbb44d9db8ad30b9f10ae605: Time spent bootstrapping tablet: real 0.296s	user 0.013s	sys 0.011s
I20260709 14:54:14.489476 15346 consensus_queue.cc:1048] T b8d6b9cf24a24444b2a69fd526cd4b09 P 9cb8de0701f2482b99e51d5ac080aa13 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 14:54:14.498782 15079 leader_election.cc:304] T f706543d4d3e4e7291624a785ca4e747 P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7519e608fbb44d9db8ad30b9f10ae605, dbc2c92e49e346b5b3bd7705a229afc6; no voters: 9cb8de0701f2482b99e51d5ac080aa13
I20260709 14:54:14.483599 15307 raft_consensus.cc:359] T 7699ad132e12472180b6a9527951c397 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:14.507604 15307 raft_consensus.cc:385] T 7699ad132e12472180b6a9527951c397 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:14.507256 15351 raft_consensus.cc:2804] T f706543d4d3e4e7291624a785ca4e747 P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:54:14.508000 15307 raft_consensus.cc:740] T 7699ad132e12472180b6a9527951c397 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9cb8de0701f2482b99e51d5ac080aa13, State: Initialized, Role: FOLLOWER
I20260709 14:54:14.509953 15357 raft_consensus.cc:697] T 7f2cd7c8159d43c080fd8302180ecfca P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 LEADER]: Becoming Leader. State: Replica: dbc2c92e49e346b5b3bd7705a229afc6, State: Running, Role: LEADER
I20260709 14:54:14.510924 15307 consensus_queue.cc:260] T 7699ad132e12472180b6a9527951c397 P 9cb8de0701f2482b99e51d5ac080aa13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:14.510962 15309 raft_consensus.cc:359] T 7f2cd7c8159d43c080fd8302180ecfca P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:14.516989 15309 raft_consensus.cc:385] T 7f2cd7c8159d43c080fd8302180ecfca P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:14.517488 15309 raft_consensus.cc:740] T 7f2cd7c8159d43c080fd8302180ecfca P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7519e608fbb44d9db8ad30b9f10ae605, State: Initialized, Role: FOLLOWER
I20260709 14:54:14.518883 15309 consensus_queue.cc:260] T 7f2cd7c8159d43c080fd8302180ecfca P 7519e608fbb44d9db8ad30b9f10ae605 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:14.520118 15306 tablet_bootstrap.cc:492] T 7699ad132e12472180b6a9527951c397 P dbc2c92e49e346b5b3bd7705a229afc6: No bootstrap required, opened a new log
I20260709 14:54:14.520617 15306 ts_tablet_manager.cc:1403] T 7699ad132e12472180b6a9527951c397 P dbc2c92e49e346b5b3bd7705a229afc6: Time spent bootstrapping tablet: real 0.310s	user 0.017s	sys 0.006s
I20260709 14:54:14.524788 15186 raft_consensus.cc:3060] T d354c94548fc411ab62b4281ed947944 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:14.526369 15306 raft_consensus.cc:359] T 7699ad132e12472180b6a9527951c397 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:14.528568 15306 raft_consensus.cc:385] T 7699ad132e12472180b6a9527951c397 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:14.528833 15306 raft_consensus.cc:740] T 7699ad132e12472180b6a9527951c397 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbc2c92e49e346b5b3bd7705a229afc6, State: Initialized, Role: FOLLOWER
I20260709 14:54:14.513355 15357 consensus_queue.cc:237] T 7f2cd7c8159d43c080fd8302180ecfca P dbc2c92e49e346b5b3bd7705a229afc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:14.536537 15311 tablet_bootstrap.cc:492] T b8d6b9cf24a24444b2a69fd526cd4b09 P eaa34beb1b274443b1c46839afd0a484: No bootstrap required, opened a new log
I20260709 14:54:14.537464 15311 ts_tablet_manager.cc:1403] T b8d6b9cf24a24444b2a69fd526cd4b09 P eaa34beb1b274443b1c46839afd0a484: Time spent bootstrapping tablet: real 0.065s	user 0.026s	sys 0.000s
I20260709 14:54:14.540714 15306 consensus_queue.cc:260] T 7699ad132e12472180b6a9527951c397 P dbc2c92e49e346b5b3bd7705a229afc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:14.541095 15311 raft_consensus.cc:359] T b8d6b9cf24a24444b2a69fd526cd4b09 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:14.542400 15311 raft_consensus.cc:385] T b8d6b9cf24a24444b2a69fd526cd4b09 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:14.542676 15311 raft_consensus.cc:740] T b8d6b9cf24a24444b2a69fd526cd4b09 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eaa34beb1b274443b1c46839afd0a484, State: Initialized, Role: FOLLOWER
I20260709 14:54:14.545701 15307 ts_tablet_manager.cc:1434] T 7699ad132e12472180b6a9527951c397 P 9cb8de0701f2482b99e51d5ac080aa13: Time spent starting tablet: real 0.068s	user 0.009s	sys 0.001s
I20260709 14:54:14.546761 15306 ts_tablet_manager.cc:1434] T 7699ad132e12472180b6a9527951c397 P dbc2c92e49e346b5b3bd7705a229afc6: Time spent starting tablet: real 0.026s	user 0.008s	sys 0.000s
I20260709 14:54:14.547144 15307 tablet_bootstrap.cc:492] T d6bcaee371174feaa06943f949efda49 P 9cb8de0701f2482b99e51d5ac080aa13: Bootstrap starting.
I20260709 14:54:14.548177 15306 tablet_bootstrap.cc:492] T c61864fa2cd249d683f8fb90d8542480 P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap starting.
I20260709 14:54:14.542145 15351 raft_consensus.cc:697] T f706543d4d3e4e7291624a785ca4e747 P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 LEADER]: Becoming Leader. State: Replica: 7519e608fbb44d9db8ad30b9f10ae605, State: Running, Role: LEADER
I20260709 14:54:14.550143 15351 consensus_queue.cc:237] T f706543d4d3e4e7291624a785ca4e747 P 7519e608fbb44d9db8ad30b9f10ae605 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:14.556329 15311 consensus_queue.cc:260] T b8d6b9cf24a24444b2a69fd526cd4b09 P eaa34beb1b274443b1c46839afd0a484 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:14.559190 15307 tablet_bootstrap.cc:654] T d6bcaee371174feaa06943f949efda49 P 9cb8de0701f2482b99e51d5ac080aa13: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:14.561887 15311 ts_tablet_manager.cc:1434] T b8d6b9cf24a24444b2a69fd526cd4b09 P eaa34beb1b274443b1c46839afd0a484: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 14:54:14.563361 15311 tablet_bootstrap.cc:492] T 263098160f604ae3aa31782c37e2fd52 P eaa34beb1b274443b1c46839afd0a484: Bootstrap starting.
I20260709 14:54:14.568681 15309 ts_tablet_manager.cc:1434] T 7f2cd7c8159d43c080fd8302180ecfca P 7519e608fbb44d9db8ad30b9f10ae605: Time spent starting tablet: real 0.065s	user 0.012s	sys 0.007s
I20260709 14:54:14.574707 15374 raft_consensus.cc:493] T d2c4ea1c33c64cd09ba04611fdbdc59d P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:14.583513 15311 tablet_bootstrap.cc:654] T 263098160f604ae3aa31782c37e2fd52 P eaa34beb1b274443b1c46839afd0a484: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:14.585685 15374 raft_consensus.cc:515] T d2c4ea1c33c64cd09ba04611fdbdc59d P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:14.603479 15309 tablet_bootstrap.cc:492] T 6cd07fbeb9f149a08fdbac2e0247eca4 P 7519e608fbb44d9db8ad30b9f10ae605: Bootstrap starting.
I20260709 14:54:14.604350 15374 leader_election.cc:290] T d2c4ea1c33c64cd09ba04611fdbdc59d P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493), dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477)
I20260709 14:54:14.606597 15307 tablet_bootstrap.cc:492] T d6bcaee371174feaa06943f949efda49 P 9cb8de0701f2482b99e51d5ac080aa13: No bootstrap required, opened a new log
I20260709 14:54:14.607352 15307 ts_tablet_manager.cc:1403] T d6bcaee371174feaa06943f949efda49 P 9cb8de0701f2482b99e51d5ac080aa13: Time spent bootstrapping tablet: real 0.060s	user 0.016s	sys 0.010s
I20260709 14:54:14.607638 15260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2c4ea1c33c64cd09ba04611fdbdc59d" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13" is_pre_election: true
W20260709 14:54:14.615549 15150 leader_election.cc:343] T d2c4ea1c33c64cd09ba04611fdbdc59d P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:14.616843 15309 tablet_bootstrap.cc:654] T 6cd07fbeb9f149a08fdbac2e0247eca4 P 7519e608fbb44d9db8ad30b9f10ae605: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:14.619122 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2c4ea1c33c64cd09ba04611fdbdc59d" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" is_pre_election: true
W20260709 14:54:14.621516 15153 leader_election.cc:343] T d2c4ea1c33c64cd09ba04611fdbdc59d P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:14.622174 15153 leader_election.cc:304] T d2c4ea1c33c64cd09ba04611fdbdc59d P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa34beb1b274443b1c46839afd0a484; no voters: 9cb8de0701f2482b99e51d5ac080aa13, dbc2c92e49e346b5b3bd7705a229afc6
I20260709 14:54:14.623114 15374 raft_consensus.cc:2749] T d2c4ea1c33c64cd09ba04611fdbdc59d P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:54:14.634264 15306 tablet_bootstrap.cc:654] T c61864fa2cd249d683f8fb90d8542480 P dbc2c92e49e346b5b3bd7705a229afc6: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:14.639168 15307 raft_consensus.cc:359] T d6bcaee371174feaa06943f949efda49 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:14.640192 15307 raft_consensus.cc:385] T d6bcaee371174feaa06943f949efda49 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:14.640651 15307 raft_consensus.cc:740] T d6bcaee371174feaa06943f949efda49 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9cb8de0701f2482b99e51d5ac080aa13, State: Initialized, Role: FOLLOWER
I20260709 14:54:14.643302 15374 raft_consensus.cc:493] T b8d6b9cf24a24444b2a69fd526cd4b09 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:14.644017 15374 raft_consensus.cc:515] T b8d6b9cf24a24444b2a69fd526cd4b09 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:14.646622 15374 leader_election.cc:290] T b8d6b9cf24a24444b2a69fd526cd4b09 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177), 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493)
I20260709 14:54:14.649369 15260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8d6b9cf24a24444b2a69fd526cd4b09" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13" is_pre_election: true
I20260709 14:54:14.640009 15311 tablet_bootstrap.cc:492] T 263098160f604ae3aa31782c37e2fd52 P eaa34beb1b274443b1c46839afd0a484: No bootstrap required, opened a new log
I20260709 14:54:14.655632 15311 ts_tablet_manager.cc:1403] T 263098160f604ae3aa31782c37e2fd52 P eaa34beb1b274443b1c46839afd0a484: Time spent bootstrapping tablet: real 0.093s	user 0.021s	sys 0.000s
I20260709 14:54:14.658808 15113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8d6b9cf24a24444b2a69fd526cd4b09" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605" is_pre_election: true
I20260709 14:54:14.664707 15309 tablet_bootstrap.cc:492] T 6cd07fbeb9f149a08fdbac2e0247eca4 P 7519e608fbb44d9db8ad30b9f10ae605: No bootstrap required, opened a new log
I20260709 14:54:14.665868 15309 ts_tablet_manager.cc:1403] T 6cd07fbeb9f149a08fdbac2e0247eca4 P 7519e608fbb44d9db8ad30b9f10ae605: Time spent bootstrapping tablet: real 0.063s	user 0.013s	sys 0.009s
I20260709 14:54:14.666935 15311 raft_consensus.cc:359] T 263098160f604ae3aa31782c37e2fd52 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:14.667829 15311 raft_consensus.cc:385] T 263098160f604ae3aa31782c37e2fd52 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:14.668159 15311 raft_consensus.cc:740] T 263098160f604ae3aa31782c37e2fd52 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eaa34beb1b274443b1c46839afd0a484, State: Initialized, Role: FOLLOWER
I20260709 14:54:14.669034 15311 consensus_queue.cc:260] T 263098160f604ae3aa31782c37e2fd52 P eaa34beb1b274443b1c46839afd0a484 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:14.671430 15311 ts_tablet_manager.cc:1434] T 263098160f604ae3aa31782c37e2fd52 P eaa34beb1b274443b1c46839afd0a484: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 14:54:14.673488 15311 tablet_bootstrap.cc:492] T f8b33962eab84819b17953e44eae71a1 P eaa34beb1b274443b1c46839afd0a484: Bootstrap starting.
I20260709 14:54:14.674612 15150 leader_election.cc:304] T b8d6b9cf24a24444b2a69fd526cd4b09 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa34beb1b274443b1c46839afd0a484; no voters: 7519e608fbb44d9db8ad30b9f10ae605, 9cb8de0701f2482b99e51d5ac080aa13
I20260709 14:54:14.641924 14934 catalog_manager.cc:5697] T f706543d4d3e4e7291624a785ca4e747 P 7519e608fbb44d9db8ad30b9f10ae605 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66). New cstate: current_term: 1 leader_uuid: "7519e608fbb44d9db8ad30b9f10ae605" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } health_report { overall_health: HEALTHY } } }
I20260709 14:54:14.676352 15376 raft_consensus.cc:2749] T b8d6b9cf24a24444b2a69fd526cd4b09 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:54:14.681011 15311 tablet_bootstrap.cc:654] T f8b33962eab84819b17953e44eae71a1 P eaa34beb1b274443b1c46839afd0a484: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:14.669661 15309 raft_consensus.cc:359] T 6cd07fbeb9f149a08fdbac2e0247eca4 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:14.683034 15309 raft_consensus.cc:385] T 6cd07fbeb9f149a08fdbac2e0247eca4 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:14.683689 15309 raft_consensus.cc:740] T 6cd07fbeb9f149a08fdbac2e0247eca4 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7519e608fbb44d9db8ad30b9f10ae605, State: Initialized, Role: FOLLOWER
I20260709 14:54:14.683797 15357 consensus_queue.cc:1048] T 0284d9835221427ab285015d48a8040d P dbc2c92e49e346b5b3bd7705a229afc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:54:14.654207 15307 consensus_queue.cc:260] T d6bcaee371174feaa06943f949efda49 P 9cb8de0701f2482b99e51d5ac080aa13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:14.702229 15307 ts_tablet_manager.cc:1434] T d6bcaee371174feaa06943f949efda49 P 9cb8de0701f2482b99e51d5ac080aa13: Time spent starting tablet: real 0.094s	user 0.012s	sys 0.000s
I20260709 14:54:14.698325 15309 consensus_queue.cc:260] T 6cd07fbeb9f149a08fdbac2e0247eca4 P 7519e608fbb44d9db8ad30b9f10ae605 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:14.705852 15351 raft_consensus.cc:493] T 6cd07fbeb9f149a08fdbac2e0247eca4 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:14.706583 15351 raft_consensus.cc:515] T 6cd07fbeb9f149a08fdbac2e0247eca4 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:14.717502 15357 consensus_queue.cc:1048] T 0284d9835221427ab285015d48a8040d P dbc2c92e49e346b5b3bd7705a229afc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:54:14.724869 15186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd07fbeb9f149a08fdbac2e0247eca4" candidate_uuid: "7519e608fbb44d9db8ad30b9f10ae605" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484" is_pre_election: true
I20260709 14:54:14.725313 15351 leader_election.cc:290] T 6cd07fbeb9f149a08fdbac2e0247eca4 P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805), 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493)
I20260709 14:54:14.716226 14935 catalog_manager.cc:5697] T 7f2cd7c8159d43c080fd8302180ecfca P dbc2c92e49e346b5b3bd7705a229afc6 reported cstate change: term changed from 0 to 1, leader changed from <none> to dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65). New cstate: current_term: 1 leader_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } health_report { overall_health: UNKNOWN } } }
I20260709 14:54:14.731874 15309 ts_tablet_manager.cc:1434] T 6cd07fbeb9f149a08fdbac2e0247eca4 P 7519e608fbb44d9db8ad30b9f10ae605: Time spent starting tablet: real 0.066s	user 0.007s	sys 0.004s
I20260709 14:54:14.736030 15309 tablet_bootstrap.cc:492] T 263098160f604ae3aa31782c37e2fd52 P 7519e608fbb44d9db8ad30b9f10ae605: Bootstrap starting.
I20260709 14:54:14.736397 15306 tablet_bootstrap.cc:492] T c61864fa2cd249d683f8fb90d8542480 P dbc2c92e49e346b5b3bd7705a229afc6: No bootstrap required, opened a new log
I20260709 14:54:14.737025 15306 ts_tablet_manager.cc:1403] T c61864fa2cd249d683f8fb90d8542480 P dbc2c92e49e346b5b3bd7705a229afc6: Time spent bootstrapping tablet: real 0.189s	user 0.014s	sys 0.005s
I20260709 14:54:14.739282 15259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cd07fbeb9f149a08fdbac2e0247eca4" candidate_uuid: "7519e608fbb44d9db8ad30b9f10ae605" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13" is_pre_election: true
I20260709 14:54:14.741703 15076 leader_election.cc:304] T 6cd07fbeb9f149a08fdbac2e0247eca4 P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7519e608fbb44d9db8ad30b9f10ae605; no voters: 9cb8de0701f2482b99e51d5ac080aa13, eaa34beb1b274443b1c46839afd0a484
I20260709 14:54:14.743533 15351 raft_consensus.cc:2749] T 6cd07fbeb9f149a08fdbac2e0247eca4 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:54:14.743640 15306 raft_consensus.cc:359] T c61864fa2cd249d683f8fb90d8542480 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:14.746408 15306 raft_consensus.cc:385] T c61864fa2cd249d683f8fb90d8542480 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:14.746795 15306 raft_consensus.cc:740] T c61864fa2cd249d683f8fb90d8542480 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbc2c92e49e346b5b3bd7705a229afc6, State: Initialized, Role: FOLLOWER
I20260709 14:54:14.751647 15186 raft_consensus.cc:3060] T b8d6b9cf24a24444b2a69fd526cd4b09 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:14.749632 15307 tablet_bootstrap.cc:492] T c61864fa2cd249d683f8fb90d8542480 P 9cb8de0701f2482b99e51d5ac080aa13: Bootstrap starting.
I20260709 14:54:14.755060 15306 consensus_queue.cc:260] T c61864fa2cd249d683f8fb90d8542480 P dbc2c92e49e346b5b3bd7705a229afc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:14.768474 15306 ts_tablet_manager.cc:1434] T c61864fa2cd249d683f8fb90d8542480 P dbc2c92e49e346b5b3bd7705a229afc6: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.002s
I20260709 14:54:14.769140 15311 tablet_bootstrap.cc:492] T f8b33962eab84819b17953e44eae71a1 P eaa34beb1b274443b1c46839afd0a484: No bootstrap required, opened a new log
I20260709 14:54:14.770417 15306 tablet_bootstrap.cc:492] T 263098160f604ae3aa31782c37e2fd52 P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap starting.
I20260709 14:54:14.770249 15311 ts_tablet_manager.cc:1403] T f8b33962eab84819b17953e44eae71a1 P eaa34beb1b274443b1c46839afd0a484: Time spent bootstrapping tablet: real 0.097s	user 0.030s	sys 0.014s
I20260709 14:54:14.784989 15307 tablet_bootstrap.cc:654] T c61864fa2cd249d683f8fb90d8542480 P 9cb8de0701f2482b99e51d5ac080aa13: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:14.775009 15311 raft_consensus.cc:359] T f8b33962eab84819b17953e44eae71a1 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:14.794541 15311 raft_consensus.cc:385] T f8b33962eab84819b17953e44eae71a1 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:14.795047 15311 raft_consensus.cc:740] T f8b33962eab84819b17953e44eae71a1 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eaa34beb1b274443b1c46839afd0a484, State: Initialized, Role: FOLLOWER
I20260709 14:54:14.785712 15309 tablet_bootstrap.cc:654] T 263098160f604ae3aa31782c37e2fd52 P 7519e608fbb44d9db8ad30b9f10ae605: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:14.795964 15311 consensus_queue.cc:260] T f8b33962eab84819b17953e44eae71a1 P eaa34beb1b274443b1c46839afd0a484 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:14.802505 15311 ts_tablet_manager.cc:1434] T f8b33962eab84819b17953e44eae71a1 P eaa34beb1b274443b1c46839afd0a484: Time spent starting tablet: real 0.031s	user 0.010s	sys 0.001s
I20260709 14:54:14.804020 15311 tablet_bootstrap.cc:492] T d86dfc13b2834d7e8b2ad5f975f08154 P eaa34beb1b274443b1c46839afd0a484: Bootstrap starting.
I20260709 14:54:14.787720 15306 tablet_bootstrap.cc:654] T 263098160f604ae3aa31782c37e2fd52 P dbc2c92e49e346b5b3bd7705a229afc6: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:14.846290 15311 tablet_bootstrap.cc:654] T d86dfc13b2834d7e8b2ad5f975f08154 P eaa34beb1b274443b1c46839afd0a484: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:14.850832 15306 tablet_bootstrap.cc:492] T 263098160f604ae3aa31782c37e2fd52 P dbc2c92e49e346b5b3bd7705a229afc6: No bootstrap required, opened a new log
I20260709 14:54:14.851585 15306 ts_tablet_manager.cc:1403] T 263098160f604ae3aa31782c37e2fd52 P dbc2c92e49e346b5b3bd7705a229afc6: Time spent bootstrapping tablet: real 0.082s	user 0.024s	sys 0.017s
I20260709 14:54:14.860939 15309 tablet_bootstrap.cc:492] T 263098160f604ae3aa31782c37e2fd52 P 7519e608fbb44d9db8ad30b9f10ae605: No bootstrap required, opened a new log
I20260709 14:54:14.861860 15309 ts_tablet_manager.cc:1403] T 263098160f604ae3aa31782c37e2fd52 P 7519e608fbb44d9db8ad30b9f10ae605: Time spent bootstrapping tablet: real 0.126s	user 0.014s	sys 0.003s
I20260709 14:54:14.863794 15307 tablet_bootstrap.cc:492] T c61864fa2cd249d683f8fb90d8542480 P 9cb8de0701f2482b99e51d5ac080aa13: No bootstrap required, opened a new log
I20260709 14:54:14.864729 15307 ts_tablet_manager.cc:1403] T c61864fa2cd249d683f8fb90d8542480 P 9cb8de0701f2482b99e51d5ac080aa13: Time spent bootstrapping tablet: real 0.116s	user 0.021s	sys 0.009s
I20260709 14:54:14.865408 15346 raft_consensus.cc:493] T 7699ad132e12472180b6a9527951c397 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:14.866071 15346 raft_consensus.cc:515] T 7699ad132e12472180b6a9527951c397 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:14.868479 15307 raft_consensus.cc:359] T c61864fa2cd249d683f8fb90d8542480 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:14.869365 15307 raft_consensus.cc:385] T c61864fa2cd249d683f8fb90d8542480 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:14.869676 15307 raft_consensus.cc:740] T c61864fa2cd249d683f8fb90d8542480 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9cb8de0701f2482b99e51d5ac080aa13, State: Initialized, Role: FOLLOWER
I20260709 14:54:14.870220 15111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7699ad132e12472180b6a9527951c397" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605" is_pre_election: true
I20260709 14:54:14.865936 15309 raft_consensus.cc:359] T 263098160f604ae3aa31782c37e2fd52 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:14.872910 15309 raft_consensus.cc:385] T 263098160f604ae3aa31782c37e2fd52 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:14.871446 15306 raft_consensus.cc:359] T 263098160f604ae3aa31782c37e2fd52 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:14.871325 15346 leader_election.cc:290] T 7699ad132e12472180b6a9527951c397 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477), 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177)
I20260709 14:54:14.872996 15111 raft_consensus.cc:2468] T 7699ad132e12472180b6a9527951c397 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cb8de0701f2482b99e51d5ac080aa13 in term 0.
I20260709 14:54:14.874141 15306 raft_consensus.cc:385] T 263098160f604ae3aa31782c37e2fd52 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:14.874549 15306 raft_consensus.cc:740] T 263098160f604ae3aa31782c37e2fd52 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbc2c92e49e346b5b3bd7705a229afc6, State: Initialized, Role: FOLLOWER
I20260709 14:54:14.874811 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7699ad132e12472180b6a9527951c397" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" is_pre_election: true
I20260709 14:54:14.875349 15224 leader_election.cc:304] T 7699ad132e12472180b6a9527951c397 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7519e608fbb44d9db8ad30b9f10ae605, 9cb8de0701f2482b99e51d5ac080aa13; no voters: 
I20260709 14:54:14.875536 15306 consensus_queue.cc:260] T 263098160f604ae3aa31782c37e2fd52 P dbc2c92e49e346b5b3bd7705a229afc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:14.876864 15346 raft_consensus.cc:2804] T 7699ad132e12472180b6a9527951c397 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:54:14.877367 15346 raft_consensus.cc:493] T 7699ad132e12472180b6a9527951c397 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:54:14.877727 15346 raft_consensus.cc:3060] T 7699ad132e12472180b6a9527951c397 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:14.875615 15037 raft_consensus.cc:2468] T 7699ad132e12472180b6a9527951c397 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cb8de0701f2482b99e51d5ac080aa13 in term 0.
I20260709 14:54:14.870814 15307 consensus_queue.cc:260] T c61864fa2cd249d683f8fb90d8542480 P 9cb8de0701f2482b99e51d5ac080aa13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:14.886852 15307 ts_tablet_manager.cc:1434] T c61864fa2cd249d683f8fb90d8542480 P 9cb8de0701f2482b99e51d5ac080aa13: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.002s
I20260709 14:54:14.873476 15309 raft_consensus.cc:740] T 263098160f604ae3aa31782c37e2fd52 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7519e608fbb44d9db8ad30b9f10ae605, State: Initialized, Role: FOLLOWER
I20260709 14:54:14.889616 15306 ts_tablet_manager.cc:1434] T 263098160f604ae3aa31782c37e2fd52 P dbc2c92e49e346b5b3bd7705a229afc6: Time spent starting tablet: real 0.038s	user 0.007s	sys 0.005s
I20260709 14:54:14.891261 15306 tablet_bootstrap.cc:492] T 46ebd2bd84cc46e08c82a7b893e54578 P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap starting.
I20260709 14:54:14.891366 15309 consensus_queue.cc:260] T 263098160f604ae3aa31782c37e2fd52 P 7519e608fbb44d9db8ad30b9f10ae605 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:14.900596 15309 ts_tablet_manager.cc:1434] T 263098160f604ae3aa31782c37e2fd52 P 7519e608fbb44d9db8ad30b9f10ae605: Time spent starting tablet: real 0.038s	user 0.010s	sys 0.000s
I20260709 14:54:14.903200 15307 tablet_bootstrap.cc:492] T f706543d4d3e4e7291624a785ca4e747 P 9cb8de0701f2482b99e51d5ac080aa13: Bootstrap starting.
I20260709 14:54:14.906374 15311 tablet_bootstrap.cc:492] T d86dfc13b2834d7e8b2ad5f975f08154 P eaa34beb1b274443b1c46839afd0a484: No bootstrap required, opened a new log
I20260709 14:54:14.911130 15309 tablet_bootstrap.cc:492] T 798d0882b1ea4b26b598c236de8f18c9 P 7519e608fbb44d9db8ad30b9f10ae605: Bootstrap starting.
I20260709 14:54:14.912567 15311 ts_tablet_manager.cc:1403] T d86dfc13b2834d7e8b2ad5f975f08154 P eaa34beb1b274443b1c46839afd0a484: Time spent bootstrapping tablet: real 0.109s	user 0.029s	sys 0.020s
I20260709 14:54:14.916450 15311 raft_consensus.cc:359] T d86dfc13b2834d7e8b2ad5f975f08154 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:14.917426 15311 raft_consensus.cc:385] T d86dfc13b2834d7e8b2ad5f975f08154 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:14.917754 15311 raft_consensus.cc:740] T d86dfc13b2834d7e8b2ad5f975f08154 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eaa34beb1b274443b1c46839afd0a484, State: Initialized, Role: FOLLOWER
I20260709 14:54:14.918552 15311 consensus_queue.cc:260] T d86dfc13b2834d7e8b2ad5f975f08154 P eaa34beb1b274443b1c46839afd0a484 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:14.918869 15346 raft_consensus.cc:515] T 7699ad132e12472180b6a9527951c397 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:14.925556 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7699ad132e12472180b6a9527951c397" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc2c92e49e346b5b3bd7705a229afc6"
I20260709 14:54:14.926525 15037 raft_consensus.cc:3060] T 7699ad132e12472180b6a9527951c397 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:14.931622 15311 ts_tablet_manager.cc:1434] T d86dfc13b2834d7e8b2ad5f975f08154 P eaa34beb1b274443b1c46839afd0a484: Time spent starting tablet: real 0.019s	user 0.000s	sys 0.007s
I20260709 14:54:14.936985 15307 tablet_bootstrap.cc:654] T f706543d4d3e4e7291624a785ca4e747 P 9cb8de0701f2482b99e51d5ac080aa13: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:14.937600 15311 tablet_bootstrap.cc:492] T a018e41c89854091a15a6a8e4deffbdd P eaa34beb1b274443b1c46839afd0a484: Bootstrap starting.
I20260709 14:54:14.938901 15037 raft_consensus.cc:2468] T 7699ad132e12472180b6a9527951c397 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cb8de0701f2482b99e51d5ac080aa13 in term 1.
I20260709 14:54:14.943485 15227 leader_election.cc:304] T 7699ad132e12472180b6a9527951c397 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cb8de0701f2482b99e51d5ac080aa13, dbc2c92e49e346b5b3bd7705a229afc6; no voters: 
I20260709 14:54:14.940238 15306 tablet_bootstrap.cc:654] T 46ebd2bd84cc46e08c82a7b893e54578 P dbc2c92e49e346b5b3bd7705a229afc6: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:14.945685 15311 tablet_bootstrap.cc:654] T a018e41c89854091a15a6a8e4deffbdd P eaa34beb1b274443b1c46839afd0a484: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:14.945902 15369 raft_consensus.cc:2804] T 7699ad132e12472180b6a9527951c397 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:54:14.962957 15309 tablet_bootstrap.cc:654] T 798d0882b1ea4b26b598c236de8f18c9 P 7519e608fbb44d9db8ad30b9f10ae605: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:14.959408 15369 raft_consensus.cc:697] T 7699ad132e12472180b6a9527951c397 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 LEADER]: Becoming Leader. State: Replica: 9cb8de0701f2482b99e51d5ac080aa13, State: Running, Role: LEADER
I20260709 14:54:14.962525 15383 consensus_queue.cc:1048] T 7f2cd7c8159d43c080fd8302180ecfca P dbc2c92e49e346b5b3bd7705a229afc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
W20260709 14:54:14.976727 15076 consensus_peers.cc:597] T f706543d4d3e4e7291624a785ca4e747 P 7519e608fbb44d9db8ad30b9f10ae605 -> Peer 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493): Couldn't send request to peer 9cb8de0701f2482b99e51d5ac080aa13. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:54:14.976454 15111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7699ad132e12472180b6a9527951c397" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605"
I20260709 14:54:14.978003 15111 raft_consensus.cc:3060] T 7699ad132e12472180b6a9527951c397 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:14.983999 15376 raft_consensus.cc:493] T d86dfc13b2834d7e8b2ad5f975f08154 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:14.985356 15376 raft_consensus.cc:515] T d86dfc13b2834d7e8b2ad5f975f08154 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:14.966025 15346 leader_election.cc:290] T 7699ad132e12472180b6a9527951c397 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 election: Requested vote from peers dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477), 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177)
I20260709 14:54:14.991824 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86dfc13b2834d7e8b2ad5f975f08154" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" is_pre_election: true
W20260709 14:54:14.996389 15153 leader_election.cc:343] T d86dfc13b2834d7e8b2ad5f975f08154 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:14.998418 15260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86dfc13b2834d7e8b2ad5f975f08154" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13" is_pre_election: true
I20260709 14:54:14.999795 15111 raft_consensus.cc:2468] T 7699ad132e12472180b6a9527951c397 P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cb8de0701f2482b99e51d5ac080aa13 in term 1.
I20260709 14:54:14.983994 15369 consensus_queue.cc:237] T 7699ad132e12472180b6a9527951c397 P 9cb8de0701f2482b99e51d5ac080aa13 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
W20260709 14:54:15.001962 15150 leader_election.cc:343] T d86dfc13b2834d7e8b2ad5f975f08154 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:15.002655 15150 leader_election.cc:304] T d86dfc13b2834d7e8b2ad5f975f08154 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa34beb1b274443b1c46839afd0a484; no voters: 9cb8de0701f2482b99e51d5ac080aa13, dbc2c92e49e346b5b3bd7705a229afc6
I20260709 14:54:15.002841 15376 leader_election.cc:290] T d86dfc13b2834d7e8b2ad5f975f08154 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493), dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477)
I20260709 14:54:15.003916 15352 raft_consensus.cc:2749] T d86dfc13b2834d7e8b2ad5f975f08154 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:54:15.009486 15351 raft_consensus.cc:493] T 7f2cd7c8159d43c080fd8302180ecfca P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:15.010242 15351 raft_consensus.cc:515] T 7f2cd7c8159d43c080fd8302180ecfca P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:15.023307 15111 raft_consensus.cc:3060] T 7f2cd7c8159d43c080fd8302180ecfca P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:15.028349 15306 tablet_bootstrap.cc:492] T 46ebd2bd84cc46e08c82a7b893e54578 P dbc2c92e49e346b5b3bd7705a229afc6: No bootstrap required, opened a new log
I20260709 14:54:15.030026 15306 ts_tablet_manager.cc:1403] T 46ebd2bd84cc46e08c82a7b893e54578 P dbc2c92e49e346b5b3bd7705a229afc6: Time spent bootstrapping tablet: real 0.139s	user 0.025s	sys 0.003s
I20260709 14:54:15.032182 15352 raft_consensus.cc:493] T 263098160f604ae3aa31782c37e2fd52 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:15.032779 15351 leader_election.cc:290] T 7f2cd7c8159d43c080fd8302180ecfca P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805), dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477)
I20260709 14:54:15.033903 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2cd7c8159d43c080fd8302180ecfca" candidate_uuid: "7519e608fbb44d9db8ad30b9f10ae605" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" is_pre_election: true
I20260709 14:54:15.033178 15352 raft_consensus.cc:515] T 263098160f604ae3aa31782c37e2fd52 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:15.034206 15306 raft_consensus.cc:359] T 46ebd2bd84cc46e08c82a7b893e54578 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:15.038321 15306 raft_consensus.cc:385] T 46ebd2bd84cc46e08c82a7b893e54578 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:15.038905 15306 raft_consensus.cc:740] T 46ebd2bd84cc46e08c82a7b893e54578 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbc2c92e49e346b5b3bd7705a229afc6, State: Initialized, Role: FOLLOWER
I20260709 14:54:15.039378 15113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263098160f604ae3aa31782c37e2fd52" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605" is_pre_election: true
I20260709 14:54:15.040468 15113 raft_consensus.cc:2468] T 263098160f604ae3aa31782c37e2fd52 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa34beb1b274443b1c46839afd0a484 in term 0.
I20260709 14:54:15.039474 15186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2cd7c8159d43c080fd8302180ecfca" candidate_uuid: "7519e608fbb44d9db8ad30b9f10ae605" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484" is_pre_election: true
I20260709 14:54:15.043198 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263098160f604ae3aa31782c37e2fd52" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" is_pre_election: true
I20260709 14:54:15.044037 15037 raft_consensus.cc:2468] T 263098160f604ae3aa31782c37e2fd52 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa34beb1b274443b1c46839afd0a484 in term 0.
I20260709 14:54:15.045094 15150 leader_election.cc:304] T 263098160f604ae3aa31782c37e2fd52 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7519e608fbb44d9db8ad30b9f10ae605, eaa34beb1b274443b1c46839afd0a484; no voters: 
I20260709 14:54:15.046337 15376 raft_consensus.cc:2804] T 263098160f604ae3aa31782c37e2fd52 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:54:15.046770 15376 raft_consensus.cc:493] T 263098160f604ae3aa31782c37e2fd52 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:54:15.047153 15376 raft_consensus.cc:3060] T 263098160f604ae3aa31782c37e2fd52 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:15.047622 15079 leader_election.cc:304] T 7f2cd7c8159d43c080fd8302180ecfca P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7519e608fbb44d9db8ad30b9f10ae605; no voters: dbc2c92e49e346b5b3bd7705a229afc6, eaa34beb1b274443b1c46839afd0a484
I20260709 14:54:15.042917 15306 consensus_queue.cc:260] T 46ebd2bd84cc46e08c82a7b893e54578 P dbc2c92e49e346b5b3bd7705a229afc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:15.051486 15306 ts_tablet_manager.cc:1434] T 46ebd2bd84cc46e08c82a7b893e54578 P dbc2c92e49e346b5b3bd7705a229afc6: Time spent starting tablet: real 0.021s	user 0.009s	sys 0.000s
I20260709 14:54:15.052708 15306 tablet_bootstrap.cc:492] T 054739df584d4b9db840777c2ae17555 P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap starting.
I20260709 14:54:15.052531 15352 leader_election.cc:290] T 263098160f604ae3aa31782c37e2fd52 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477), 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177)
I20260709 14:54:15.048084 15346 raft_consensus.cc:493] T d6bcaee371174feaa06943f949efda49 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:15.054821 15346 raft_consensus.cc:515] T d6bcaee371174feaa06943f949efda49 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:15.060463 15383 raft_consensus.cc:493] T c61864fa2cd249d683f8fb90d8542480 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:15.060657 15186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6bcaee371174feaa06943f949efda49" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484" is_pre_election: true
I20260709 14:54:15.061190 15383 raft_consensus.cc:515] T c61864fa2cd249d683f8fb90d8542480 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:15.063781 15383 leader_election.cc:290] T c61864fa2cd249d683f8fb90d8542480 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805), 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493)
I20260709 14:54:15.064852 15186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61864fa2cd249d683f8fb90d8542480" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484" is_pre_election: true
W20260709 14:54:15.067046 15004 leader_election.cc:343] T c61864fa2cd249d683f8fb90d8542480 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805): Illegal state: must be running to vote when last-logged opid is not known
W20260709 14:54:15.068379 14984 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 14:54:15.069568 15307 tablet_bootstrap.cc:492] T f706543d4d3e4e7291624a785ca4e747 P 9cb8de0701f2482b99e51d5ac080aa13: No bootstrap required, opened a new log
I20260709 14:54:15.071919 15307 ts_tablet_manager.cc:1403] T f706543d4d3e4e7291624a785ca4e747 P 9cb8de0701f2482b99e51d5ac080aa13: Time spent bootstrapping tablet: real 0.169s	user 0.038s	sys 0.008s
I20260709 14:54:15.070744 15260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61864fa2cd249d683f8fb90d8542480" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13" is_pre_election: true
I20260709 14:54:15.073758 15260 raft_consensus.cc:2468] T c61864fa2cd249d683f8fb90d8542480 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbc2c92e49e346b5b3bd7705a229afc6 in term 0.
I20260709 14:54:15.076047 15309 tablet_bootstrap.cc:492] T 798d0882b1ea4b26b598c236de8f18c9 P 7519e608fbb44d9db8ad30b9f10ae605: No bootstrap required, opened a new log
I20260709 14:54:15.075603 15376 raft_consensus.cc:515] T 263098160f604ae3aa31782c37e2fd52 P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:15.076841 15309 ts_tablet_manager.cc:1403] T 798d0882b1ea4b26b598c236de8f18c9 P 7519e608fbb44d9db8ad30b9f10ae605: Time spent bootstrapping tablet: real 0.166s	user 0.012s	sys 0.007s
I20260709 14:54:15.077977 15311 tablet_bootstrap.cc:492] T a018e41c89854091a15a6a8e4deffbdd P eaa34beb1b274443b1c46839afd0a484: No bootstrap required, opened a new log
I20260709 14:54:15.077710 15307 raft_consensus.cc:359] T f706543d4d3e4e7291624a785ca4e747 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:15.078543 15307 raft_consensus.cc:385] T f706543d4d3e4e7291624a785ca4e747 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:15.078892 15307 raft_consensus.cc:740] T f706543d4d3e4e7291624a785ca4e747 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9cb8de0701f2482b99e51d5ac080aa13, State: Initialized, Role: FOLLOWER
I20260709 14:54:15.080052 15001 leader_election.cc:304] T c61864fa2cd249d683f8fb90d8542480 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9cb8de0701f2482b99e51d5ac080aa13, dbc2c92e49e346b5b3bd7705a229afc6; no voters: eaa34beb1b274443b1c46839afd0a484
I20260709 14:54:15.081765 15383 raft_consensus.cc:2804] T c61864fa2cd249d683f8fb90d8542480 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:54:15.082217 15383 raft_consensus.cc:493] T c61864fa2cd249d683f8fb90d8542480 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:54:15.082389 15351 raft_consensus.cc:2749] T 7f2cd7c8159d43c080fd8302180ecfca P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:54:15.084337 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263098160f604ae3aa31782c37e2fd52" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc2c92e49e346b5b3bd7705a229afc6"
I20260709 14:54:15.085150 15037 raft_consensus.cc:3060] T 263098160f604ae3aa31782c37e2fd52 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:15.086329 15113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263098160f604ae3aa31782c37e2fd52" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605"
I20260709 14:54:15.087324 15113 raft_consensus.cc:3060] T 263098160f604ae3aa31782c37e2fd52 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:15.090899 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6bcaee371174feaa06943f949efda49" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" is_pre_election: true
I20260709 14:54:15.078552 15311 ts_tablet_manager.cc:1403] T a018e41c89854091a15a6a8e4deffbdd P eaa34beb1b274443b1c46839afd0a484: Time spent bootstrapping tablet: real 0.141s	user 0.011s	sys 0.016s
I20260709 14:54:15.092912 15383 raft_consensus.cc:3060] T c61864fa2cd249d683f8fb90d8542480 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:15.098489 15311 raft_consensus.cc:359] T a018e41c89854091a15a6a8e4deffbdd P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:15.103166 15227 leader_election.cc:304] T d6bcaee371174feaa06943f949efda49 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cb8de0701f2482b99e51d5ac080aa13; no voters: dbc2c92e49e346b5b3bd7705a229afc6, eaa34beb1b274443b1c46839afd0a484
I20260709 14:54:15.103988 15374 raft_consensus.cc:493] T f8b33962eab84819b17953e44eae71a1 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:15.104902 15423 raft_consensus.cc:2749] T d6bcaee371174feaa06943f949efda49 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:54:15.107817 15357 consensus_queue.cc:1048] T 7f2cd7c8159d43c080fd8302180ecfca P dbc2c92e49e346b5b3bd7705a229afc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:54:15.100754 15311 raft_consensus.cc:385] T a018e41c89854091a15a6a8e4deffbdd P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:15.109578 15311 raft_consensus.cc:740] T a018e41c89854091a15a6a8e4deffbdd P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eaa34beb1b274443b1c46839afd0a484, State: Initialized, Role: FOLLOWER
I20260709 14:54:15.109930 15307 consensus_queue.cc:260] T f706543d4d3e4e7291624a785ca4e747 P 9cb8de0701f2482b99e51d5ac080aa13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:15.110562 15311 consensus_queue.cc:260] T a018e41c89854091a15a6a8e4deffbdd P eaa34beb1b274443b1c46839afd0a484 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:15.093057 15346 leader_election.cc:290] T d6bcaee371174feaa06943f949efda49 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805), dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477)
I20260709 14:54:15.117499 15260 raft_consensus.cc:3060] T d6bcaee371174feaa06943f949efda49 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:15.104622 15374 raft_consensus.cc:515] T f8b33962eab84819b17953e44eae71a1 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:15.119611 15306 tablet_bootstrap.cc:654] T 054739df584d4b9db840777c2ae17555 P dbc2c92e49e346b5b3bd7705a229afc6: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:15.121147 15309 raft_consensus.cc:359] T 798d0882b1ea4b26b598c236de8f18c9 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:15.127562 15309 raft_consensus.cc:385] T 798d0882b1ea4b26b598c236de8f18c9 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:15.128068 15309 raft_consensus.cc:740] T 798d0882b1ea4b26b598c236de8f18c9 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7519e608fbb44d9db8ad30b9f10ae605, State: Initialized, Role: FOLLOWER
I20260709 14:54:15.109479 15376 leader_election.cc:290] T 263098160f604ae3aa31782c37e2fd52 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 election: Requested vote from peers dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477), 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177)
I20260709 14:54:15.135907 15374 leader_election.cc:290] T f8b33962eab84819b17953e44eae71a1 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177), 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493)
I20260709 14:54:15.147452 15309 consensus_queue.cc:260] T 798d0882b1ea4b26b598c236de8f18c9 P 7519e608fbb44d9db8ad30b9f10ae605 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:15.151536 15307 ts_tablet_manager.cc:1434] T f706543d4d3e4e7291624a785ca4e747 P 9cb8de0701f2482b99e51d5ac080aa13: Time spent starting tablet: real 0.079s	user 0.009s	sys 0.000s
I20260709 14:54:15.152851 15307 tablet_bootstrap.cc:492] T 67409326aa124c52a5e9a650d7570a68 P 9cb8de0701f2482b99e51d5ac080aa13: Bootstrap starting.
I20260709 14:54:15.160662 15307 tablet_bootstrap.cc:654] T 67409326aa124c52a5e9a650d7570a68 P 9cb8de0701f2482b99e51d5ac080aa13: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:15.160301 15110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b33962eab84819b17953e44eae71a1" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605" is_pre_election: true
I20260709 14:54:15.151185 15259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b33962eab84819b17953e44eae71a1" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13" is_pre_election: true
I20260709 14:54:15.150233 15037 raft_consensus.cc:2468] T 263098160f604ae3aa31782c37e2fd52 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa34beb1b274443b1c46839afd0a484 in term 1.
W20260709 14:54:15.163910 15150 leader_election.cc:343] T f8b33962eab84819b17953e44eae71a1 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493): Illegal state: must be running to vote when last-logged opid is not known
W20260709 14:54:15.164995 15150 leader_election.cc:343] T f8b33962eab84819b17953e44eae71a1 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:15.165745 15150 leader_election.cc:304] T f8b33962eab84819b17953e44eae71a1 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa34beb1b274443b1c46839afd0a484; no voters: 7519e608fbb44d9db8ad30b9f10ae605, 9cb8de0701f2482b99e51d5ac080aa13
I20260709 14:54:15.167220 14935 catalog_manager.cc:5697] T 7699ad132e12472180b6a9527951c397 P 9cb8de0701f2482b99e51d5ac080aa13 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68). New cstate: current_term: 1 leader_uuid: "9cb8de0701f2482b99e51d5ac080aa13" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } health_report { overall_health: UNKNOWN } } }
I20260709 14:54:15.168045 15352 raft_consensus.cc:2749] T f8b33962eab84819b17953e44eae71a1 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:54:15.183634 15432 consensus_queue.cc:1048] T f706543d4d3e4e7291624a785ca4e747 P 7519e608fbb44d9db8ad30b9f10ae605 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 14:54:15.183768 15351 raft_consensus.cc:493] T 798d0882b1ea4b26b598c236de8f18c9 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:15.185210 15351 raft_consensus.cc:515] T 798d0882b1ea4b26b598c236de8f18c9 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:15.189568 15383 raft_consensus.cc:515] T c61864fa2cd249d683f8fb90d8542480 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:15.192204 15383 leader_election.cc:290] T c61864fa2cd249d683f8fb90d8542480 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 election: Requested vote from peers eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805), 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493)
I20260709 14:54:15.192653 15110 raft_consensus.cc:3060] T 798d0882b1ea4b26b598c236de8f18c9 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:15.193184 15186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61864fa2cd249d683f8fb90d8542480" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484"
I20260709 14:54:15.189056 15351 leader_election.cc:290] T 798d0882b1ea4b26b598c236de8f18c9 P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477), eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805)
W20260709 14:54:15.198397 15004 leader_election.cc:343] T c61864fa2cd249d683f8fb90d8542480 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:15.194301 15187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "798d0882b1ea4b26b598c236de8f18c9" candidate_uuid: "7519e608fbb44d9db8ad30b9f10ae605" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484" is_pre_election: true
I20260709 14:54:15.194885 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "798d0882b1ea4b26b598c236de8f18c9" candidate_uuid: "7519e608fbb44d9db8ad30b9f10ae605" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" is_pre_election: true
I20260709 14:54:15.195755 15259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61864fa2cd249d683f8fb90d8542480" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13"
I20260709 14:54:15.200345 15259 raft_consensus.cc:3060] T c61864fa2cd249d683f8fb90d8542480 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:15.206679 15309 ts_tablet_manager.cc:1434] T 798d0882b1ea4b26b598c236de8f18c9 P 7519e608fbb44d9db8ad30b9f10ae605: Time spent starting tablet: real 0.129s	user 0.007s	sys 0.004s
I20260709 14:54:15.208357 15309 tablet_bootstrap.cc:492] T 67409326aa124c52a5e9a650d7570a68 P 7519e608fbb44d9db8ad30b9f10ae605: Bootstrap starting.
I20260709 14:54:15.209704 15079 leader_election.cc:304] T 798d0882b1ea4b26b598c236de8f18c9 P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7519e608fbb44d9db8ad30b9f10ae605; no voters: dbc2c92e49e346b5b3bd7705a229afc6, eaa34beb1b274443b1c46839afd0a484
I20260709 14:54:15.222234 15311 ts_tablet_manager.cc:1434] T a018e41c89854091a15a6a8e4deffbdd P eaa34beb1b274443b1c46839afd0a484: Time spent starting tablet: real 0.130s	user 0.019s	sys 0.003s
I20260709 14:54:15.224198 15311 tablet_bootstrap.cc:492] T 46ebd2bd84cc46e08c82a7b893e54578 P eaa34beb1b274443b1c46839afd0a484: Bootstrap starting.
I20260709 14:54:15.231621 15259 raft_consensus.cc:2468] T c61864fa2cd249d683f8fb90d8542480 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbc2c92e49e346b5b3bd7705a229afc6 in term 1.
I20260709 14:54:15.232682 15433 raft_consensus.cc:493] T 67409326aa124c52a5e9a650d7570a68 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:15.238958 15433 raft_consensus.cc:515] T 67409326aa124c52a5e9a650d7570a68 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:15.241439 15433 leader_election.cc:290] T 67409326aa124c52a5e9a650d7570a68 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177), 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493)
I20260709 14:54:15.234778 15306 tablet_bootstrap.cc:492] T 054739df584d4b9db840777c2ae17555 P dbc2c92e49e346b5b3bd7705a229afc6: No bootstrap required, opened a new log
I20260709 14:54:15.242947 15111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67409326aa124c52a5e9a650d7570a68" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605" is_pre_election: true
I20260709 14:54:15.243654 15261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67409326aa124c52a5e9a650d7570a68" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13" is_pre_election: true
I20260709 14:54:15.242458 15306 ts_tablet_manager.cc:1403] T 054739df584d4b9db840777c2ae17555 P dbc2c92e49e346b5b3bd7705a229afc6: Time spent bootstrapping tablet: real 0.190s	user 0.021s	sys 0.004s
W20260709 14:54:15.245903 15150 leader_election.cc:343] T 67409326aa124c52a5e9a650d7570a68 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493): Illegal state: must be running to vote when last-logged opid is not known
W20260709 14:54:15.246667 15150 leader_election.cc:343] T 67409326aa124c52a5e9a650d7570a68 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:15.247100 15150 leader_election.cc:304] T 67409326aa124c52a5e9a650d7570a68 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa34beb1b274443b1c46839afd0a484; no voters: 7519e608fbb44d9db8ad30b9f10ae605, 9cb8de0701f2482b99e51d5ac080aa13
I20260709 14:54:15.248873 15430 raft_consensus.cc:2749] T 67409326aa124c52a5e9a650d7570a68 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:54:15.248620 15306 raft_consensus.cc:359] T 054739df584d4b9db840777c2ae17555 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:15.249359 15153 leader_election.cc:304] T 263098160f604ae3aa31782c37e2fd52 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dbc2c92e49e346b5b3bd7705a229afc6, eaa34beb1b274443b1c46839afd0a484; no voters: 
I20260709 14:54:15.250553 15430 raft_consensus.cc:2804] T 263098160f604ae3aa31782c37e2fd52 P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:54:15.251112 15430 raft_consensus.cc:697] T 263098160f604ae3aa31782c37e2fd52 P eaa34beb1b274443b1c46839afd0a484 [term 1 LEADER]: Becoming Leader. State: Replica: eaa34beb1b274443b1c46839afd0a484, State: Running, Role: LEADER
I20260709 14:54:15.252923 15309 tablet_bootstrap.cc:654] T 67409326aa124c52a5e9a650d7570a68 P 7519e608fbb44d9db8ad30b9f10ae605: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:15.249457 15306 raft_consensus.cc:385] T 054739df584d4b9db840777c2ae17555 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:15.255681 15306 raft_consensus.cc:740] T 054739df584d4b9db840777c2ae17555 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbc2c92e49e346b5b3bd7705a229afc6, State: Initialized, Role: FOLLOWER
I20260709 14:54:15.256788 15306 consensus_queue.cc:260] T 054739df584d4b9db840777c2ae17555 P dbc2c92e49e346b5b3bd7705a229afc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:15.262317 15001 leader_election.cc:304] T c61864fa2cd249d683f8fb90d8542480 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9cb8de0701f2482b99e51d5ac080aa13, dbc2c92e49e346b5b3bd7705a229afc6; no voters: eaa34beb1b274443b1c46839afd0a484
I20260709 14:54:15.264446 15357 raft_consensus.cc:2804] T c61864fa2cd249d683f8fb90d8542480 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:54:15.265081 15357 raft_consensus.cc:697] T c61864fa2cd249d683f8fb90d8542480 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 LEADER]: Becoming Leader. State: Replica: dbc2c92e49e346b5b3bd7705a229afc6, State: Running, Role: LEADER
I20260709 14:54:15.266038 15357 consensus_queue.cc:237] T c61864fa2cd249d683f8fb90d8542480 P dbc2c92e49e346b5b3bd7705a229afc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:15.268852 15111 raft_consensus.cc:3060] T 6cd07fbeb9f149a08fdbac2e0247eca4 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:15.274128 15113 raft_consensus.cc:2468] T 263098160f604ae3aa31782c37e2fd52 P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa34beb1b274443b1c46839afd0a484 in term 1.
I20260709 14:54:15.275580 15434 raft_consensus.cc:493] T f706543d4d3e4e7291624a785ca4e747 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:15.257975 15430 consensus_queue.cc:237] T 263098160f604ae3aa31782c37e2fd52 P eaa34beb1b274443b1c46839afd0a484 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:15.279873 15307 tablet_bootstrap.cc:492] T 67409326aa124c52a5e9a650d7570a68 P 9cb8de0701f2482b99e51d5ac080aa13: No bootstrap required, opened a new log
I20260709 14:54:15.276468 15434 raft_consensus.cc:515] T f706543d4d3e4e7291624a785ca4e747 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:15.280948 15307 ts_tablet_manager.cc:1403] T 67409326aa124c52a5e9a650d7570a68 P 9cb8de0701f2482b99e51d5ac080aa13: Time spent bootstrapping tablet: real 0.128s	user 0.019s	sys 0.011s
I20260709 14:54:15.288874 15434 leader_election.cc:290] T f706543d4d3e4e7291624a785ca4e747 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477), 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177)
I20260709 14:54:15.290371 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f706543d4d3e4e7291624a785ca4e747" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" is_pre_election: true
I20260709 14:54:15.296357 15306 ts_tablet_manager.cc:1434] T 054739df584d4b9db840777c2ae17555 P dbc2c92e49e346b5b3bd7705a229afc6: Time spent starting tablet: real 0.051s	user 0.009s	sys 0.000s
I20260709 14:54:15.300940 15306 tablet_bootstrap.cc:492] T 5f5dbc86fc8f4ae5b77e0f23adfcd593 P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap starting.
I20260709 14:54:15.305269 15113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f706543d4d3e4e7291624a785ca4e747" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605" is_pre_election: true
I20260709 14:54:15.315060 15224 leader_election.cc:304] T f706543d4d3e4e7291624a785ca4e747 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cb8de0701f2482b99e51d5ac080aa13; no voters: 7519e608fbb44d9db8ad30b9f10ae605, dbc2c92e49e346b5b3bd7705a229afc6
I20260709 14:54:15.317052 15434 raft_consensus.cc:2749] T f706543d4d3e4e7291624a785ca4e747 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:54:15.323655 15306 tablet_bootstrap.cc:654] T 5f5dbc86fc8f4ae5b77e0f23adfcd593 P dbc2c92e49e346b5b3bd7705a229afc6: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:15.310353 15307 raft_consensus.cc:359] T 67409326aa124c52a5e9a650d7570a68 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:15.324282 15307 raft_consensus.cc:385] T 67409326aa124c52a5e9a650d7570a68 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:15.324914 15307 raft_consensus.cc:740] T 67409326aa124c52a5e9a650d7570a68 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9cb8de0701f2482b99e51d5ac080aa13, State: Initialized, Role: FOLLOWER
I20260709 14:54:15.325914 15351 raft_consensus.cc:2749] T 798d0882b1ea4b26b598c236de8f18c9 P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:54:15.326402 15307 consensus_queue.cc:260] T 67409326aa124c52a5e9a650d7570a68 P 9cb8de0701f2482b99e51d5ac080aa13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:15.330197 15307 ts_tablet_manager.cc:1434] T 67409326aa124c52a5e9a650d7570a68 P 9cb8de0701f2482b99e51d5ac080aa13: Time spent starting tablet: real 0.049s	user 0.006s	sys 0.002s
I20260709 14:54:15.331832 15307 tablet_bootstrap.cc:492] T d2c4ea1c33c64cd09ba04611fdbdc59d P 9cb8de0701f2482b99e51d5ac080aa13: Bootstrap starting.
I20260709 14:54:15.333827 14935 catalog_manager.cc:5697] T c61864fa2cd249d683f8fb90d8542480 P dbc2c92e49e346b5b3bd7705a229afc6 reported cstate change: term changed from 0 to 1, leader changed from <none> to dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65). New cstate: current_term: 1 leader_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } health_report { overall_health: HEALTHY } } }
I20260709 14:54:15.337210 15311 tablet_bootstrap.cc:654] T 46ebd2bd84cc46e08c82a7b893e54578 P eaa34beb1b274443b1c46839afd0a484: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:15.374820 15311 tablet_bootstrap.cc:492] T 46ebd2bd84cc46e08c82a7b893e54578 P eaa34beb1b274443b1c46839afd0a484: No bootstrap required, opened a new log
I20260709 14:54:15.375566 15311 ts_tablet_manager.cc:1403] T 46ebd2bd84cc46e08c82a7b893e54578 P eaa34beb1b274443b1c46839afd0a484: Time spent bootstrapping tablet: real 0.152s	user 0.016s	sys 0.001s
I20260709 14:54:15.378046 15307 tablet_bootstrap.cc:654] T d2c4ea1c33c64cd09ba04611fdbdc59d P 9cb8de0701f2482b99e51d5ac080aa13: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:15.374868 15309 tablet_bootstrap.cc:492] T 67409326aa124c52a5e9a650d7570a68 P 7519e608fbb44d9db8ad30b9f10ae605: No bootstrap required, opened a new log
I20260709 14:54:15.384586 15309 ts_tablet_manager.cc:1403] T 67409326aa124c52a5e9a650d7570a68 P 7519e608fbb44d9db8ad30b9f10ae605: Time spent bootstrapping tablet: real 0.176s	user 0.024s	sys 0.019s
I20260709 14:54:15.388142 15309 raft_consensus.cc:359] T 67409326aa124c52a5e9a650d7570a68 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:15.388994 15309 raft_consensus.cc:385] T 67409326aa124c52a5e9a650d7570a68 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:15.390357 15311 raft_consensus.cc:359] T 46ebd2bd84cc46e08c82a7b893e54578 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:15.395939 15311 raft_consensus.cc:385] T 46ebd2bd84cc46e08c82a7b893e54578 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:15.396355 15311 raft_consensus.cc:740] T 46ebd2bd84cc46e08c82a7b893e54578 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eaa34beb1b274443b1c46839afd0a484, State: Initialized, Role: FOLLOWER
W20260709 14:54:15.368834 15437 log.cc:927] Time spent T f706543d4d3e4e7291624a785ca4e747 P dbc2c92e49e346b5b3bd7705a229afc6: Append to log took a long time: real 0.072s	user 0.002s	sys 0.025s
I20260709 14:54:15.396719 14934 catalog_manager.cc:5697] T 263098160f604ae3aa31782c37e2fd52 P eaa34beb1b274443b1c46839afd0a484 reported cstate change: term changed from 0 to 1, leader changed from <none> to eaa34beb1b274443b1c46839afd0a484 (127.6.101.67). New cstate: current_term: 1 leader_uuid: "eaa34beb1b274443b1c46839afd0a484" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } health_report { overall_health: HEALTHY } } }
I20260709 14:54:15.399259 15311 consensus_queue.cc:260] T 46ebd2bd84cc46e08c82a7b893e54578 P eaa34beb1b274443b1c46839afd0a484 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:15.406602 15309 raft_consensus.cc:740] T 67409326aa124c52a5e9a650d7570a68 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7519e608fbb44d9db8ad30b9f10ae605, State: Initialized, Role: FOLLOWER
I20260709 14:54:15.407923 15309 consensus_queue.cc:260] T 67409326aa124c52a5e9a650d7570a68 P 7519e608fbb44d9db8ad30b9f10ae605 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:15.409945 15311 ts_tablet_manager.cc:1434] T 46ebd2bd84cc46e08c82a7b893e54578 P eaa34beb1b274443b1c46839afd0a484: Time spent starting tablet: real 0.034s	user 0.009s	sys 0.000s
I20260709 14:54:15.411785 15311 tablet_bootstrap.cc:492] T c61864fa2cd249d683f8fb90d8542480 P eaa34beb1b274443b1c46839afd0a484: Bootstrap starting.
I20260709 14:54:15.414295 15306 tablet_bootstrap.cc:492] T 5f5dbc86fc8f4ae5b77e0f23adfcd593 P dbc2c92e49e346b5b3bd7705a229afc6: No bootstrap required, opened a new log
I20260709 14:54:15.423543 15306 ts_tablet_manager.cc:1403] T 5f5dbc86fc8f4ae5b77e0f23adfcd593 P dbc2c92e49e346b5b3bd7705a229afc6: Time spent bootstrapping tablet: real 0.123s	user 0.023s	sys 0.002s
I20260709 14:54:15.428124 15309 ts_tablet_manager.cc:1434] T 67409326aa124c52a5e9a650d7570a68 P 7519e608fbb44d9db8ad30b9f10ae605: Time spent starting tablet: real 0.043s	user 0.000s	sys 0.010s
I20260709 14:54:15.436512 15309 tablet_bootstrap.cc:492] T 054739df584d4b9db840777c2ae17555 P 7519e608fbb44d9db8ad30b9f10ae605: Bootstrap starting.
I20260709 14:54:15.453524 15260 raft_consensus.cc:3060] T f706543d4d3e4e7291624a785ca4e747 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:15.453593 15357 raft_consensus.cc:493] T 46ebd2bd84cc46e08c82a7b893e54578 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:15.455626 15357 raft_consensus.cc:515] T 46ebd2bd84cc46e08c82a7b893e54578 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:15.457667 15306 raft_consensus.cc:359] T 5f5dbc86fc8f4ae5b77e0f23adfcd593 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:15.458689 15306 raft_consensus.cc:385] T 5f5dbc86fc8f4ae5b77e0f23adfcd593 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:15.459120 15306 raft_consensus.cc:740] T 5f5dbc86fc8f4ae5b77e0f23adfcd593 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbc2c92e49e346b5b3bd7705a229afc6, State: Initialized, Role: FOLLOWER
I20260709 14:54:15.459649 15187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46ebd2bd84cc46e08c82a7b893e54578" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484" is_pre_election: true
I20260709 14:54:15.460196 15306 consensus_queue.cc:260] T 5f5dbc86fc8f4ae5b77e0f23adfcd593 P dbc2c92e49e346b5b3bd7705a229afc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:15.463315 15187 raft_consensus.cc:2468] T 46ebd2bd84cc46e08c82a7b893e54578 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbc2c92e49e346b5b3bd7705a229afc6 in term 0.
I20260709 14:54:15.469676 15357 leader_election.cc:290] T 46ebd2bd84cc46e08c82a7b893e54578 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805), 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493)
I20260709 14:54:15.469986 15004 leader_election.cc:304] T 46ebd2bd84cc46e08c82a7b893e54578 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dbc2c92e49e346b5b3bd7705a229afc6, eaa34beb1b274443b1c46839afd0a484; no voters: 
I20260709 14:54:15.471145 15261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46ebd2bd84cc46e08c82a7b893e54578" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13" is_pre_election: true
I20260709 14:54:15.468561 15306 ts_tablet_manager.cc:1434] T 5f5dbc86fc8f4ae5b77e0f23adfcd593 P dbc2c92e49e346b5b3bd7705a229afc6: Time spent starting tablet: real 0.044s	user 0.006s	sys 0.005s
I20260709 14:54:15.471248 15401 raft_consensus.cc:2804] T 46ebd2bd84cc46e08c82a7b893e54578 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 14:54:15.473361 15001 leader_election.cc:343] T 46ebd2bd84cc46e08c82a7b893e54578 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:15.480739 15401 raft_consensus.cc:493] T 46ebd2bd84cc46e08c82a7b893e54578 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:54:15.481043 15309 tablet_bootstrap.cc:654] T 054739df584d4b9db840777c2ae17555 P 7519e608fbb44d9db8ad30b9f10ae605: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:15.481292 15401 raft_consensus.cc:3060] T 46ebd2bd84cc46e08c82a7b893e54578 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:15.482440 15306 tablet_bootstrap.cc:492] T d2c4ea1c33c64cd09ba04611fdbdc59d P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap starting.
I20260709 14:54:15.485968 15311 tablet_bootstrap.cc:654] T c61864fa2cd249d683f8fb90d8542480 P eaa34beb1b274443b1c46839afd0a484: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:15.487861 15307 tablet_bootstrap.cc:492] T d2c4ea1c33c64cd09ba04611fdbdc59d P 9cb8de0701f2482b99e51d5ac080aa13: No bootstrap required, opened a new log
I20260709 14:54:15.499420 15307 ts_tablet_manager.cc:1403] T d2c4ea1c33c64cd09ba04611fdbdc59d P 9cb8de0701f2482b99e51d5ac080aa13: Time spent bootstrapping tablet: real 0.168s	user 0.026s	sys 0.032s
I20260709 14:54:15.496323 15306 tablet_bootstrap.cc:654] T d2c4ea1c33c64cd09ba04611fdbdc59d P dbc2c92e49e346b5b3bd7705a229afc6: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:15.516399 15307 raft_consensus.cc:359] T d2c4ea1c33c64cd09ba04611fdbdc59d P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:15.517863 15307 raft_consensus.cc:385] T d2c4ea1c33c64cd09ba04611fdbdc59d P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:15.518241 15307 raft_consensus.cc:740] T d2c4ea1c33c64cd09ba04611fdbdc59d P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9cb8de0701f2482b99e51d5ac080aa13, State: Initialized, Role: FOLLOWER
I20260709 14:54:15.519747 15307 consensus_queue.cc:260] T d2c4ea1c33c64cd09ba04611fdbdc59d P 9cb8de0701f2482b99e51d5ac080aa13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:15.521905 15311 tablet_bootstrap.cc:492] T c61864fa2cd249d683f8fb90d8542480 P eaa34beb1b274443b1c46839afd0a484: No bootstrap required, opened a new log
I20260709 14:54:15.522845 15311 ts_tablet_manager.cc:1403] T c61864fa2cd249d683f8fb90d8542480 P eaa34beb1b274443b1c46839afd0a484: Time spent bootstrapping tablet: real 0.111s	user 0.027s	sys 0.001s
I20260709 14:54:15.528976 15307 ts_tablet_manager.cc:1434] T d2c4ea1c33c64cd09ba04611fdbdc59d P 9cb8de0701f2482b99e51d5ac080aa13: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.002s
I20260709 14:54:15.530360 15307 tablet_bootstrap.cc:492] T a018e41c89854091a15a6a8e4deffbdd P 9cb8de0701f2482b99e51d5ac080aa13: Bootstrap starting.
I20260709 14:54:15.531251 15430 raft_consensus.cc:493] T a018e41c89854091a15a6a8e4deffbdd P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:15.532387 15430 raft_consensus.cc:515] T a018e41c89854091a15a6a8e4deffbdd P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:15.532886 15311 raft_consensus.cc:359] T c61864fa2cd249d683f8fb90d8542480 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:15.533854 15311 raft_consensus.cc:385] T c61864fa2cd249d683f8fb90d8542480 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:15.534272 15311 raft_consensus.cc:740] T c61864fa2cd249d683f8fb90d8542480 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eaa34beb1b274443b1c46839afd0a484, State: Initialized, Role: FOLLOWER
I20260709 14:54:15.534749 15434 consensus_queue.cc:1048] T 7699ad132e12472180b6a9527951c397 P 9cb8de0701f2482b99e51d5ac080aa13 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:54:15.535439 15311 consensus_queue.cc:260] T c61864fa2cd249d683f8fb90d8542480 P eaa34beb1b274443b1c46839afd0a484 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:15.539558 15111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a018e41c89854091a15a6a8e4deffbdd" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605" is_pre_election: true
I20260709 14:54:15.544806 15307 tablet_bootstrap.cc:654] T a018e41c89854091a15a6a8e4deffbdd P 9cb8de0701f2482b99e51d5ac080aa13: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:15.545135 15311 ts_tablet_manager.cc:1434] T c61864fa2cd249d683f8fb90d8542480 P eaa34beb1b274443b1c46839afd0a484: Time spent starting tablet: real 0.021s	user 0.011s	sys 0.001s
W20260709 14:54:15.545333 15150 leader_election.cc:343] T a018e41c89854091a15a6a8e4deffbdd P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:15.546631 15311 tablet_bootstrap.cc:492] T 966a06ab56a6479283ab2818c9439d4f P eaa34beb1b274443b1c46839afd0a484: Bootstrap starting.
I20260709 14:54:15.535521 15430 leader_election.cc:290] T a018e41c89854091a15a6a8e4deffbdd P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177), 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493)
I20260709 14:54:15.553419 15423 raft_consensus.cc:493] T d2c4ea1c33c64cd09ba04611fdbdc59d P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:15.553949 15434 raft_consensus.cc:493] T 67409326aa124c52a5e9a650d7570a68 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:15.554170 15423 raft_consensus.cc:515] T d2c4ea1c33c64cd09ba04611fdbdc59d P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:15.547904 15260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a018e41c89854091a15a6a8e4deffbdd" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13" is_pre_election: true
I20260709 14:54:15.560164 15309 tablet_bootstrap.cc:492] T 054739df584d4b9db840777c2ae17555 P 7519e608fbb44d9db8ad30b9f10ae605: No bootstrap required, opened a new log
I20260709 14:54:15.556697 15423 leader_election.cc:290] T d2c4ea1c33c64cd09ba04611fdbdc59d P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805), dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477)
I20260709 14:54:15.560833 15309 ts_tablet_manager.cc:1403] T 054739df584d4b9db840777c2ae17555 P 7519e608fbb44d9db8ad30b9f10ae605: Time spent bootstrapping tablet: real 0.125s	user 0.014s	sys 0.005s
I20260709 14:54:15.556638 15434 raft_consensus.cc:515] T 67409326aa124c52a5e9a650d7570a68 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
W20260709 14:54:15.568493 15150 leader_election.cc:343] T a018e41c89854091a15a6a8e4deffbdd P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:15.574005 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2c4ea1c33c64cd09ba04611fdbdc59d" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" is_pre_election: true
W20260709 14:54:15.577224 15227 leader_election.cc:343] T d2c4ea1c33c64cd09ba04611fdbdc59d P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:15.578227 15309 raft_consensus.cc:359] T 054739df584d4b9db840777c2ae17555 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:15.579699 15309 raft_consensus.cc:385] T 054739df584d4b9db840777c2ae17555 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:15.580004 15309 raft_consensus.cc:740] T 054739df584d4b9db840777c2ae17555 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7519e608fbb44d9db8ad30b9f10ae605, State: Initialized, Role: FOLLOWER
I20260709 14:54:15.581107 15309 consensus_queue.cc:260] T 054739df584d4b9db840777c2ae17555 P 7519e608fbb44d9db8ad30b9f10ae605 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:15.582322 15110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67409326aa124c52a5e9a650d7570a68" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605" is_pre_election: true
I20260709 14:54:15.583429 15110 raft_consensus.cc:2468] T 67409326aa124c52a5e9a650d7570a68 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cb8de0701f2482b99e51d5ac080aa13 in term 0.
I20260709 14:54:15.584030 15309 ts_tablet_manager.cc:1434] T 054739df584d4b9db840777c2ae17555 P 7519e608fbb44d9db8ad30b9f10ae605: Time spent starting tablet: real 0.020s	user 0.009s	sys 0.000s
I20260709 14:54:15.586179 15150 leader_election.cc:304] T a018e41c89854091a15a6a8e4deffbdd P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa34beb1b274443b1c46839afd0a484; no voters: 7519e608fbb44d9db8ad30b9f10ae605, 9cb8de0701f2482b99e51d5ac080aa13
I20260709 14:54:15.587203 15376 raft_consensus.cc:2749] T a018e41c89854091a15a6a8e4deffbdd P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:54:15.588641 15187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2c4ea1c33c64cd09ba04611fdbdc59d" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484" is_pre_election: true
I20260709 14:54:15.589488 15187 raft_consensus.cc:2468] T d2c4ea1c33c64cd09ba04611fdbdc59d P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cb8de0701f2482b99e51d5ac080aa13 in term 0.
I20260709 14:54:15.590698 15186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67409326aa124c52a5e9a650d7570a68" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484" is_pre_election: true
I20260709 14:54:15.591313 15224 leader_election.cc:304] T 67409326aa124c52a5e9a650d7570a68 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7519e608fbb44d9db8ad30b9f10ae605, 9cb8de0701f2482b99e51d5ac080aa13; no voters: 
I20260709 14:54:15.592000 15186 raft_consensus.cc:2468] T 67409326aa124c52a5e9a650d7570a68 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cb8de0701f2482b99e51d5ac080aa13 in term 0.
I20260709 14:54:15.580031 15434 leader_election.cc:290] T 67409326aa124c52a5e9a650d7570a68 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177), eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805)
I20260709 14:54:15.593063 15423 raft_consensus.cc:2804] T 67409326aa124c52a5e9a650d7570a68 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:54:15.594099 15227 leader_election.cc:304] T d2c4ea1c33c64cd09ba04611fdbdc59d P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9cb8de0701f2482b99e51d5ac080aa13, eaa34beb1b274443b1c46839afd0a484; no voters: dbc2c92e49e346b5b3bd7705a229afc6
I20260709 14:54:15.595703 15309 tablet_bootstrap.cc:492] T a018e41c89854091a15a6a8e4deffbdd P 7519e608fbb44d9db8ad30b9f10ae605: Bootstrap starting.
I20260709 14:54:15.597544 15434 raft_consensus.cc:2804] T d2c4ea1c33c64cd09ba04611fdbdc59d P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:54:15.599507 15434 raft_consensus.cc:493] T d2c4ea1c33c64cd09ba04611fdbdc59d P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:54:15.599836 15306 tablet_bootstrap.cc:492] T d2c4ea1c33c64cd09ba04611fdbdc59d P dbc2c92e49e346b5b3bd7705a229afc6: No bootstrap required, opened a new log
I20260709 14:54:15.598625 15401 raft_consensus.cc:515] T 46ebd2bd84cc46e08c82a7b893e54578 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:15.600085 15434 raft_consensus.cc:3060] T d2c4ea1c33c64cd09ba04611fdbdc59d P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:15.600512 15306 ts_tablet_manager.cc:1403] T d2c4ea1c33c64cd09ba04611fdbdc59d P dbc2c92e49e346b5b3bd7705a229afc6: Time spent bootstrapping tablet: real 0.119s	user 0.019s	sys 0.001s
I20260709 14:54:15.604784 15186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46ebd2bd84cc46e08c82a7b893e54578" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484"
I20260709 14:54:15.594485 15423 raft_consensus.cc:493] T 67409326aa124c52a5e9a650d7570a68 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:54:15.605831 15401 leader_election.cc:290] T 46ebd2bd84cc46e08c82a7b893e54578 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 election: Requested vote from peers eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805), 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493)
I20260709 14:54:15.606333 15423 raft_consensus.cc:3060] T 67409326aa124c52a5e9a650d7570a68 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:15.607187 15306 raft_consensus.cc:359] T d2c4ea1c33c64cd09ba04611fdbdc59d P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:15.608083 15306 raft_consensus.cc:385] T d2c4ea1c33c64cd09ba04611fdbdc59d P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:15.608407 15306 raft_consensus.cc:740] T d2c4ea1c33c64cd09ba04611fdbdc59d P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbc2c92e49e346b5b3bd7705a229afc6, State: Initialized, Role: FOLLOWER
I20260709 14:54:15.605685 15186 raft_consensus.cc:3060] T 46ebd2bd84cc46e08c82a7b893e54578 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:15.609608 15306 consensus_queue.cc:260] T d2c4ea1c33c64cd09ba04611fdbdc59d P dbc2c92e49e346b5b3bd7705a229afc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:15.612578 15306 ts_tablet_manager.cc:1434] T d2c4ea1c33c64cd09ba04611fdbdc59d P dbc2c92e49e346b5b3bd7705a229afc6: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 14:54:15.605713 15260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46ebd2bd84cc46e08c82a7b893e54578" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13"
W20260709 14:54:15.619853 15001 leader_election.cc:343] T 46ebd2bd84cc46e08c82a7b893e54578 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:15.630168 15448 raft_consensus.cc:493] T 054739df584d4b9db840777c2ae17555 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:15.631271 15448 raft_consensus.cc:515] T 054739df584d4b9db840777c2ae17555 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:15.633327 15311 tablet_bootstrap.cc:654] T 966a06ab56a6479283ab2818c9439d4f P eaa34beb1b274443b1c46839afd0a484: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:15.636539 15369 consensus_queue.cc:1048] T 7699ad132e12472180b6a9527951c397 P 9cb8de0701f2482b99e51d5ac080aa13 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:54:15.637975 15306 tablet_bootstrap.cc:492] T d61f9ecebc3c4a028f5327bc9debf432 P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap starting.
I20260709 14:54:15.638353 15260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "054739df584d4b9db840777c2ae17555" candidate_uuid: "7519e608fbb44d9db8ad30b9f10ae605" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13" is_pre_election: true
I20260709 14:54:15.639268 15260 raft_consensus.cc:2468] T 054739df584d4b9db840777c2ae17555 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7519e608fbb44d9db8ad30b9f10ae605 in term 0.
I20260709 14:54:15.640880 15076 leader_election.cc:304] T 054739df584d4b9db840777c2ae17555 P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7519e608fbb44d9db8ad30b9f10ae605, 9cb8de0701f2482b99e51d5ac080aa13; no voters: 
I20260709 14:54:15.643852 15351 raft_consensus.cc:2804] T 054739df584d4b9db840777c2ae17555 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:54:15.647233 15351 raft_consensus.cc:493] T 054739df584d4b9db840777c2ae17555 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:54:15.648459 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "054739df584d4b9db840777c2ae17555" candidate_uuid: "7519e608fbb44d9db8ad30b9f10ae605" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" is_pre_election: true
I20260709 14:54:15.648820 15351 raft_consensus.cc:3060] T 054739df584d4b9db840777c2ae17555 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:15.649233 15037 raft_consensus.cc:2468] T 054739df584d4b9db840777c2ae17555 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7519e608fbb44d9db8ad30b9f10ae605 in term 0.
I20260709 14:54:15.643898 15448 leader_election.cc:290] T 054739df584d4b9db840777c2ae17555 P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493), dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477)
I20260709 14:54:15.688838 15311 tablet_bootstrap.cc:492] T 966a06ab56a6479283ab2818c9439d4f P eaa34beb1b274443b1c46839afd0a484: No bootstrap required, opened a new log
I20260709 14:54:15.691309 15311 ts_tablet_manager.cc:1403] T 966a06ab56a6479283ab2818c9439d4f P eaa34beb1b274443b1c46839afd0a484: Time spent bootstrapping tablet: real 0.145s	user 0.026s	sys 0.006s
I20260709 14:54:15.693192 15434 raft_consensus.cc:515] T d2c4ea1c33c64cd09ba04611fdbdc59d P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:15.695561 15306 tablet_bootstrap.cc:654] T d61f9ecebc3c4a028f5327bc9debf432 P dbc2c92e49e346b5b3bd7705a229afc6: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:15.697860 15187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2c4ea1c33c64cd09ba04611fdbdc59d" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484"
I20260709 14:54:15.698779 15187 raft_consensus.cc:3060] T d2c4ea1c33c64cd09ba04611fdbdc59d P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:15.699855 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2c4ea1c33c64cd09ba04611fdbdc59d" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc2c92e49e346b5b3bd7705a229afc6"
I20260709 14:54:15.700672 15037 raft_consensus.cc:3060] T d2c4ea1c33c64cd09ba04611fdbdc59d P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:15.702881 15376 raft_consensus.cc:493] T c61864fa2cd249d683f8fb90d8542480 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:15.703526 15376 raft_consensus.cc:515] T c61864fa2cd249d683f8fb90d8542480 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:15.705593 15309 tablet_bootstrap.cc:654] T a018e41c89854091a15a6a8e4deffbdd P 7519e608fbb44d9db8ad30b9f10ae605: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:15.706612 15307 tablet_bootstrap.cc:492] T a018e41c89854091a15a6a8e4deffbdd P 9cb8de0701f2482b99e51d5ac080aa13: No bootstrap required, opened a new log
I20260709 14:54:15.707173 15307 ts_tablet_manager.cc:1403] T a018e41c89854091a15a6a8e4deffbdd P 9cb8de0701f2482b99e51d5ac080aa13: Time spent bootstrapping tablet: real 0.177s	user 0.016s	sys 0.013s
I20260709 14:54:15.709872 15433 consensus_queue.cc:1048] T 263098160f604ae3aa31782c37e2fd52 P eaa34beb1b274443b1c46839afd0a484 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:54:15.711629 15376 leader_election.cc:290] T c61864fa2cd249d683f8fb90d8542480 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493), dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477)
I20260709 14:54:15.712039 15307 raft_consensus.cc:359] T a018e41c89854091a15a6a8e4deffbdd P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:15.713485 15307 raft_consensus.cc:385] T a018e41c89854091a15a6a8e4deffbdd P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:15.714654 15307 raft_consensus.cc:740] T a018e41c89854091a15a6a8e4deffbdd P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9cb8de0701f2482b99e51d5ac080aa13, State: Initialized, Role: FOLLOWER
I20260709 14:54:15.716554 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61864fa2cd249d683f8fb90d8542480" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" is_pre_election: true
I20260709 14:54:15.717024 15307 consensus_queue.cc:260] T a018e41c89854091a15a6a8e4deffbdd P 9cb8de0701f2482b99e51d5ac080aa13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:15.719100 15260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61864fa2cd249d683f8fb90d8542480" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13" is_pre_election: true
I20260709 14:54:15.720350 15307 ts_tablet_manager.cc:1434] T a018e41c89854091a15a6a8e4deffbdd P 9cb8de0701f2482b99e51d5ac080aa13: Time spent starting tablet: real 0.013s	user 0.012s	sys 0.000s
I20260709 14:54:15.720620 15260 raft_consensus.cc:2393] T c61864fa2cd249d683f8fb90d8542480 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eaa34beb1b274443b1c46839afd0a484 in current term 1: Already voted for candidate dbc2c92e49e346b5b3bd7705a229afc6 in this term.
I20260709 14:54:15.721345 15434 leader_election.cc:290] T d2c4ea1c33c64cd09ba04611fdbdc59d P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 election: Requested vote from peers eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805), dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477)
I20260709 14:54:15.721838 15307 tablet_bootstrap.cc:492] T d61f9ecebc3c4a028f5327bc9debf432 P 9cb8de0701f2482b99e51d5ac080aa13: Bootstrap starting.
I20260709 14:54:15.678727 15186 raft_consensus.cc:2468] T 46ebd2bd84cc46e08c82a7b893e54578 P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbc2c92e49e346b5b3bd7705a229afc6 in term 1.
I20260709 14:54:15.723330 15004 leader_election.cc:304] T 46ebd2bd84cc46e08c82a7b893e54578 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dbc2c92e49e346b5b3bd7705a229afc6, eaa34beb1b274443b1c46839afd0a484; no voters: 9cb8de0701f2482b99e51d5ac080aa13
I20260709 14:54:15.724653 15357 raft_consensus.cc:2804] T 46ebd2bd84cc46e08c82a7b893e54578 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:54:15.706166 15423 raft_consensus.cc:515] T 67409326aa124c52a5e9a650d7570a68 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:15.738289 15351 raft_consensus.cc:515] T 054739df584d4b9db840777c2ae17555 P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:15.744087 15260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "054739df584d4b9db840777c2ae17555" candidate_uuid: "7519e608fbb44d9db8ad30b9f10ae605" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13"
I20260709 14:54:15.745021 15260 raft_consensus.cc:3060] T 054739df584d4b9db840777c2ae17555 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:15.745601 15153 leader_election.cc:304] T c61864fa2cd249d683f8fb90d8542480 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa34beb1b274443b1c46839afd0a484; no voters: 9cb8de0701f2482b99e51d5ac080aa13, dbc2c92e49e346b5b3bd7705a229afc6
I20260709 14:54:15.746660 15376 raft_consensus.cc:3060] T c61864fa2cd249d683f8fb90d8542480 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:15.749423 15307 tablet_bootstrap.cc:654] T d61f9ecebc3c4a028f5327bc9debf432 P 9cb8de0701f2482b99e51d5ac080aa13: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:15.732551 15357 raft_consensus.cc:697] T 46ebd2bd84cc46e08c82a7b893e54578 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 LEADER]: Becoming Leader. State: Replica: dbc2c92e49e346b5b3bd7705a229afc6, State: Running, Role: LEADER
I20260709 14:54:15.762283 15357 consensus_queue.cc:237] T 46ebd2bd84cc46e08c82a7b893e54578 P dbc2c92e49e346b5b3bd7705a229afc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:15.769093 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "054739df584d4b9db840777c2ae17555" candidate_uuid: "7519e608fbb44d9db8ad30b9f10ae605" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc2c92e49e346b5b3bd7705a229afc6"
I20260709 14:54:15.770118 15038 raft_consensus.cc:3060] T 054739df584d4b9db840777c2ae17555 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:15.770397 15260 raft_consensus.cc:2468] T 054739df584d4b9db840777c2ae17555 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7519e608fbb44d9db8ad30b9f10ae605 in term 1.
I20260709 14:54:15.761488 15311 raft_consensus.cc:359] T 966a06ab56a6479283ab2818c9439d4f P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:15.772312 15311 raft_consensus.cc:385] T 966a06ab56a6479283ab2818c9439d4f P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:15.772565 15311 raft_consensus.cc:740] T 966a06ab56a6479283ab2818c9439d4f P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eaa34beb1b274443b1c46839afd0a484, State: Initialized, Role: FOLLOWER
I20260709 14:54:15.773393 15311 consensus_queue.cc:260] T 966a06ab56a6479283ab2818c9439d4f P eaa34beb1b274443b1c46839afd0a484 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:15.773967 15110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67409326aa124c52a5e9a650d7570a68" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605"
I20260709 14:54:15.774971 15110 raft_consensus.cc:3060] T 67409326aa124c52a5e9a650d7570a68 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:15.776158 15423 leader_election.cc:290] T 67409326aa124c52a5e9a650d7570a68 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 election: Requested vote from peers 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177), eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805)
I20260709 14:54:15.778663 15037 raft_consensus.cc:2468] T d2c4ea1c33c64cd09ba04611fdbdc59d P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cb8de0701f2482b99e51d5ac080aa13 in term 1.
I20260709 14:54:15.787014 15076 leader_election.cc:304] T 054739df584d4b9db840777c2ae17555 P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7519e608fbb44d9db8ad30b9f10ae605, 9cb8de0701f2482b99e51d5ac080aa13; no voters: 
I20260709 14:54:15.788795 15448 raft_consensus.cc:2804] T 054739df584d4b9db840777c2ae17555 P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:54:15.792465 15448 raft_consensus.cc:697] T 054739df584d4b9db840777c2ae17555 P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 LEADER]: Becoming Leader. State: Replica: 7519e608fbb44d9db8ad30b9f10ae605, State: Running, Role: LEADER
I20260709 14:54:15.792907 15352 consensus_queue.cc:1048] T 263098160f604ae3aa31782c37e2fd52 P eaa34beb1b274443b1c46839afd0a484 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:54:15.799228 15434 raft_consensus.cc:493] T a018e41c89854091a15a6a8e4deffbdd P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:15.799918 15434 raft_consensus.cc:515] T a018e41c89854091a15a6a8e4deffbdd P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:15.802436 15434 leader_election.cc:290] T a018e41c89854091a15a6a8e4deffbdd P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177), eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805)
I20260709 14:54:15.806085 15311 ts_tablet_manager.cc:1434] T 966a06ab56a6479283ab2818c9439d4f P eaa34beb1b274443b1c46839afd0a484: Time spent starting tablet: real 0.114s	user 0.009s	sys 0.001s
I20260709 14:54:15.807456 15311 tablet_bootstrap.cc:492] T 70bc59fabcdc4359a84d584f36d18d01 P eaa34beb1b274443b1c46839afd0a484: Bootstrap starting.
I20260709 14:54:15.813323 15227 leader_election.cc:304] T d2c4ea1c33c64cd09ba04611fdbdc59d P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cb8de0701f2482b99e51d5ac080aa13, dbc2c92e49e346b5b3bd7705a229afc6; no voters: 
I20260709 14:54:15.814769 15423 raft_consensus.cc:2804] T d2c4ea1c33c64cd09ba04611fdbdc59d P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:54:15.815459 15423 raft_consensus.cc:697] T d2c4ea1c33c64cd09ba04611fdbdc59d P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 LEADER]: Becoming Leader. State: Replica: 9cb8de0701f2482b99e51d5ac080aa13, State: Running, Role: LEADER
I20260709 14:54:15.816377 15423 consensus_queue.cc:237] T d2c4ea1c33c64cd09ba04611fdbdc59d P 9cb8de0701f2482b99e51d5ac080aa13 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:15.819000 15185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a018e41c89854091a15a6a8e4deffbdd" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484" is_pre_election: true
I20260709 14:54:15.819900 15185 raft_consensus.cc:2468] T a018e41c89854091a15a6a8e4deffbdd P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cb8de0701f2482b99e51d5ac080aa13 in term 0.
I20260709 14:54:15.754791 15351 leader_election.cc:290] T 054739df584d4b9db840777c2ae17555 P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 1 election: Requested vote from peers 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493), dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477)
I20260709 14:54:15.824505 15311 tablet_bootstrap.cc:654] T 70bc59fabcdc4359a84d584f36d18d01 P eaa34beb1b274443b1c46839afd0a484: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:15.836108 15111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a018e41c89854091a15a6a8e4deffbdd" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605" is_pre_election: true
I20260709 14:54:15.839792 15186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67409326aa124c52a5e9a650d7570a68" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484"
I20260709 14:54:15.793776 15448 consensus_queue.cc:237] T 054739df584d4b9db840777c2ae17555 P 7519e608fbb44d9db8ad30b9f10ae605 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:15.889688 15306 tablet_bootstrap.cc:492] T d61f9ecebc3c4a028f5327bc9debf432 P dbc2c92e49e346b5b3bd7705a229afc6: No bootstrap required, opened a new log
I20260709 14:54:15.890636 15306 ts_tablet_manager.cc:1403] T d61f9ecebc3c4a028f5327bc9debf432 P dbc2c92e49e346b5b3bd7705a229afc6: Time spent bootstrapping tablet: real 0.253s	user 0.023s	sys 0.025s
I20260709 14:54:15.871886 15227 leader_election.cc:304] T a018e41c89854091a15a6a8e4deffbdd P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cb8de0701f2482b99e51d5ac080aa13, eaa34beb1b274443b1c46839afd0a484; no voters: 
I20260709 14:54:15.888564 15186 raft_consensus.cc:3060] T 67409326aa124c52a5e9a650d7570a68 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:15.904088 15434 raft_consensus.cc:2804] T a018e41c89854091a15a6a8e4deffbdd P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:54:15.905109 15434 raft_consensus.cc:493] T a018e41c89854091a15a6a8e4deffbdd P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:54:15.905525 15434 raft_consensus.cc:3060] T a018e41c89854091a15a6a8e4deffbdd P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Advancing to term 1
W20260709 14:54:15.902472 15224 leader_election.cc:343] T a018e41c89854091a15a6a8e4deffbdd P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:15.927809 15187 raft_consensus.cc:2468] T d2c4ea1c33c64cd09ba04611fdbdc59d P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cb8de0701f2482b99e51d5ac080aa13 in term 1.
W20260709 14:54:15.902727 15227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:33805, user_credentials={real_user=slave}} blocked reactor thread for 61208.8us
I20260709 14:54:15.921732 15376 raft_consensus.cc:2749] T c61864fa2cd249d683f8fb90d8542480 P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:54:15.942828 15307 tablet_bootstrap.cc:492] T d61f9ecebc3c4a028f5327bc9debf432 P 9cb8de0701f2482b99e51d5ac080aa13: No bootstrap required, opened a new log
I20260709 14:54:15.943455 15307 ts_tablet_manager.cc:1403] T d61f9ecebc3c4a028f5327bc9debf432 P 9cb8de0701f2482b99e51d5ac080aa13: Time spent bootstrapping tablet: real 0.222s	user 0.019s	sys 0.026s
I20260709 14:54:15.936684 15383 raft_consensus.cc:493] T 5f5dbc86fc8f4ae5b77e0f23adfcd593 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:15.949885 15459 consensus_queue.cc:1048] T c61864fa2cd249d683f8fb90d8542480 P dbc2c92e49e346b5b3bd7705a229afc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 14:54:15.949702 15383 raft_consensus.cc:515] T 5f5dbc86fc8f4ae5b77e0f23adfcd593 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:15.956343 15306 raft_consensus.cc:359] T d61f9ecebc3c4a028f5327bc9debf432 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:15.958948 15309 tablet_bootstrap.cc:492] T a018e41c89854091a15a6a8e4deffbdd P 7519e608fbb44d9db8ad30b9f10ae605: No bootstrap required, opened a new log
I20260709 14:54:15.960181 15187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5dbc86fc8f4ae5b77e0f23adfcd593" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484" is_pre_election: true
I20260709 14:54:15.959573 15113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5dbc86fc8f4ae5b77e0f23adfcd593" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605" is_pre_election: true
I20260709 14:54:15.961386 15459 consensus_queue.cc:1048] T c61864fa2cd249d683f8fb90d8542480 P dbc2c92e49e346b5b3bd7705a229afc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:54:15.964299 15383 leader_election.cc:290] T 5f5dbc86fc8f4ae5b77e0f23adfcd593 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177), eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805)
I20260709 14:54:15.966718 15309 ts_tablet_manager.cc:1403] T a018e41c89854091a15a6a8e4deffbdd P 7519e608fbb44d9db8ad30b9f10ae605: Time spent bootstrapping tablet: real 0.380s	user 0.012s	sys 0.017s
I20260709 14:54:15.967056 15306 raft_consensus.cc:385] T d61f9ecebc3c4a028f5327bc9debf432 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:15.987294 15306 raft_consensus.cc:740] T d61f9ecebc3c4a028f5327bc9debf432 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbc2c92e49e346b5b3bd7705a229afc6, State: Initialized, Role: FOLLOWER
I20260709 14:54:15.963958 15307 raft_consensus.cc:359] T d61f9ecebc3c4a028f5327bc9debf432 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:15.988562 15307 raft_consensus.cc:385] T d61f9ecebc3c4a028f5327bc9debf432 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:15.989183 15307 raft_consensus.cc:740] T d61f9ecebc3c4a028f5327bc9debf432 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9cb8de0701f2482b99e51d5ac080aa13, State: Initialized, Role: FOLLOWER
I20260709 14:54:15.990937 15307 consensus_queue.cc:260] T d61f9ecebc3c4a028f5327bc9debf432 P 9cb8de0701f2482b99e51d5ac080aa13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:15.970191 15311 tablet_bootstrap.cc:492] T 70bc59fabcdc4359a84d584f36d18d01 P eaa34beb1b274443b1c46839afd0a484: No bootstrap required, opened a new log
I20260709 14:54:15.971179 15038 raft_consensus.cc:2468] T 054739df584d4b9db840777c2ae17555 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7519e608fbb44d9db8ad30b9f10ae605 in term 1.
I20260709 14:54:15.971587 14934 catalog_manager.cc:5697] T d2c4ea1c33c64cd09ba04611fdbdc59d P 9cb8de0701f2482b99e51d5ac080aa13 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68). New cstate: current_term: 1 leader_uuid: "9cb8de0701f2482b99e51d5ac080aa13" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } health_report { overall_health: UNKNOWN } } }
I20260709 14:54:15.992837 15306 consensus_queue.cc:260] T d61f9ecebc3c4a028f5327bc9debf432 P dbc2c92e49e346b5b3bd7705a229afc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:15.974503 15186 raft_consensus.cc:2468] T 67409326aa124c52a5e9a650d7570a68 P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cb8de0701f2482b99e51d5ac080aa13 in term 1.
I20260709 14:54:15.977532 15110 raft_consensus.cc:2468] T 67409326aa124c52a5e9a650d7570a68 P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cb8de0701f2482b99e51d5ac080aa13 in term 1.
I20260709 14:54:15.982297 14933 catalog_manager.cc:5697] T 46ebd2bd84cc46e08c82a7b893e54578 P dbc2c92e49e346b5b3bd7705a229afc6 reported cstate change: term changed from 0 to 1, leader changed from <none> to dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65). New cstate: current_term: 1 leader_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } health_report { overall_health: HEALTHY } } }
I20260709 14:54:15.995962 15311 ts_tablet_manager.cc:1403] T 70bc59fabcdc4359a84d584f36d18d01 P eaa34beb1b274443b1c46839afd0a484: Time spent bootstrapping tablet: real 0.189s	user 0.020s	sys 0.014s
I20260709 14:54:15.994236 15309 raft_consensus.cc:359] T a018e41c89854091a15a6a8e4deffbdd P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:16.011574 15309 raft_consensus.cc:385] T a018e41c89854091a15a6a8e4deffbdd P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 14:54:16.007894 15001 leader_election.cc:343] T 5f5dbc86fc8f4ae5b77e0f23adfcd593 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:16.012763 15309 raft_consensus.cc:740] T a018e41c89854091a15a6a8e4deffbdd P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7519e608fbb44d9db8ad30b9f10ae605, State: Initialized, Role: FOLLOWER
I20260709 14:54:16.009490 15306 ts_tablet_manager.cc:1434] T d61f9ecebc3c4a028f5327bc9debf432 P dbc2c92e49e346b5b3bd7705a229afc6: Time spent starting tablet: real 0.118s	user 0.012s	sys 0.000s
I20260709 14:54:16.004684 15307 ts_tablet_manager.cc:1434] T d61f9ecebc3c4a028f5327bc9debf432 P 9cb8de0701f2482b99e51d5ac080aa13: Time spent starting tablet: real 0.061s	user 0.006s	sys 0.005s
I20260709 14:54:16.015026 15309 consensus_queue.cc:260] T a018e41c89854091a15a6a8e4deffbdd P 7519e608fbb44d9db8ad30b9f10ae605 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:16.018157 15309 ts_tablet_manager.cc:1434] T a018e41c89854091a15a6a8e4deffbdd P 7519e608fbb44d9db8ad30b9f10ae605: Time spent starting tablet: real 0.031s	user 0.007s	sys 0.002s
I20260709 14:54:16.020139 15309 tablet_bootstrap.cc:492] T f8b33962eab84819b17953e44eae71a1 P 7519e608fbb44d9db8ad30b9f10ae605: Bootstrap starting.
W20260709 14:54:16.033478 15004 leader_election.cc:343] T 5f5dbc86fc8f4ae5b77e0f23adfcd593 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:16.034206 15004 leader_election.cc:304] T 5f5dbc86fc8f4ae5b77e0f23adfcd593 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbc2c92e49e346b5b3bd7705a229afc6; no voters: 7519e608fbb44d9db8ad30b9f10ae605, eaa34beb1b274443b1c46839afd0a484
I20260709 14:54:16.034616 15306 tablet_bootstrap.cc:492] T a1075567fc91458ca7cc9977cf02b170 P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap starting.
I20260709 14:54:16.039263 15307 tablet_bootstrap.cc:492] T f8b33962eab84819b17953e44eae71a1 P 9cb8de0701f2482b99e51d5ac080aa13: Bootstrap starting.
I20260709 14:54:16.037001 15383 raft_consensus.cc:2749] T 5f5dbc86fc8f4ae5b77e0f23adfcd593 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:54:16.047684 15224 leader_election.cc:304] T 67409326aa124c52a5e9a650d7570a68 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7519e608fbb44d9db8ad30b9f10ae605, 9cb8de0701f2482b99e51d5ac080aa13; no voters: 
I20260709 14:54:16.038506 15311 raft_consensus.cc:359] T 70bc59fabcdc4359a84d584f36d18d01 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:16.050642 15311 raft_consensus.cc:385] T 70bc59fabcdc4359a84d584f36d18d01 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:16.051007 15311 raft_consensus.cc:740] T 70bc59fabcdc4359a84d584f36d18d01 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eaa34beb1b274443b1c46839afd0a484, State: Initialized, Role: FOLLOWER
I20260709 14:54:16.051713 15311 consensus_queue.cc:260] T 70bc59fabcdc4359a84d584f36d18d01 P eaa34beb1b274443b1c46839afd0a484 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
W20260709 14:54:16.055833 15462 log.cc:927] Time spent T 46ebd2bd84cc46e08c82a7b893e54578 P dbc2c92e49e346b5b3bd7705a229afc6: Append to log took a long time: real 0.072s	user 0.005s	sys 0.000s
I20260709 14:54:16.057898 15423 raft_consensus.cc:2804] T 67409326aa124c52a5e9a650d7570a68 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:54:16.058674 15423 raft_consensus.cc:697] T 67409326aa124c52a5e9a650d7570a68 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 LEADER]: Becoming Leader. State: Replica: 9cb8de0701f2482b99e51d5ac080aa13, State: Running, Role: LEADER
I20260709 14:54:16.059664 15423 consensus_queue.cc:237] T 67409326aa124c52a5e9a650d7570a68 P 9cb8de0701f2482b99e51d5ac080aa13 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:16.061856 14935 catalog_manager.cc:5697] T 054739df584d4b9db840777c2ae17555 P 7519e608fbb44d9db8ad30b9f10ae605 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66). New cstate: current_term: 1 leader_uuid: "7519e608fbb44d9db8ad30b9f10ae605" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } health_report { overall_health: HEALTHY } } }
I20260709 14:54:16.063025 15434 raft_consensus.cc:515] T a018e41c89854091a15a6a8e4deffbdd P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:16.087379 15434 leader_election.cc:290] T a018e41c89854091a15a6a8e4deffbdd P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 election: Requested vote from peers 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177), eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805)
I20260709 14:54:16.100172 15311 ts_tablet_manager.cc:1434] T 70bc59fabcdc4359a84d584f36d18d01 P eaa34beb1b274443b1c46839afd0a484: Time spent starting tablet: real 0.089s	user 0.005s	sys 0.003s
I20260709 14:54:16.091226 15185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a018e41c89854091a15a6a8e4deffbdd" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484"
I20260709 14:54:16.108817 15311 tablet_bootstrap.cc:492] T cc6f522768894933b21bc94b41605166 P eaa34beb1b274443b1c46839afd0a484: Bootstrap starting.
I20260709 14:54:16.108917 15185 raft_consensus.cc:3060] T a018e41c89854091a15a6a8e4deffbdd P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:16.089469 15110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a018e41c89854091a15a6a8e4deffbdd" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605"
I20260709 14:54:16.114928 15110 raft_consensus.cc:3060] T a018e41c89854091a15a6a8e4deffbdd P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:16.121759 15306 tablet_bootstrap.cc:654] T a1075567fc91458ca7cc9977cf02b170 P dbc2c92e49e346b5b3bd7705a229afc6: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:16.133041 15466 raft_consensus.cc:493] T 70bc59fabcdc4359a84d584f36d18d01 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:16.133857 15466 raft_consensus.cc:515] T 70bc59fabcdc4359a84d584f36d18d01 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
W20260709 14:54:16.138660 14984 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 14:54:16.147832 15307 tablet_bootstrap.cc:654] T f8b33962eab84819b17953e44eae71a1 P 9cb8de0701f2482b99e51d5ac080aa13: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:16.152856 15185 raft_consensus.cc:2468] T a018e41c89854091a15a6a8e4deffbdd P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cb8de0701f2482b99e51d5ac080aa13 in term 1.
I20260709 14:54:16.154115 15466 leader_election.cc:290] T 70bc59fabcdc4359a84d584f36d18d01 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477), 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177)
I20260709 14:54:16.158562 15311 tablet_bootstrap.cc:654] T cc6f522768894933b21bc94b41605166 P eaa34beb1b274443b1c46839afd0a484: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:16.160377 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70bc59fabcdc4359a84d584f36d18d01" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" is_pre_election: true
I20260709 14:54:16.161140 15113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70bc59fabcdc4359a84d584f36d18d01" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605" is_pre_election: true
W20260709 14:54:16.162215 15153 leader_election.cc:343] T 70bc59fabcdc4359a84d584f36d18d01 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Illegal state: must be running to vote when last-logged opid is not known
W20260709 14:54:16.163568 15150 leader_election.cc:343] T 70bc59fabcdc4359a84d584f36d18d01 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:16.164429 15150 leader_election.cc:304] T 70bc59fabcdc4359a84d584f36d18d01 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa34beb1b274443b1c46839afd0a484; no voters: 7519e608fbb44d9db8ad30b9f10ae605, dbc2c92e49e346b5b3bd7705a229afc6
W20260709 14:54:16.165235 15469 log.cc:927] Time spent T 054739df584d4b9db840777c2ae17555 P 7519e608fbb44d9db8ad30b9f10ae605: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260709 14:54:16.167409 15227 leader_election.cc:304] T a018e41c89854091a15a6a8e4deffbdd P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cb8de0701f2482b99e51d5ac080aa13, eaa34beb1b274443b1c46839afd0a484; no voters: 
I20260709 14:54:16.168525 15466 raft_consensus.cc:2749] T 70bc59fabcdc4359a84d584f36d18d01 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:54:16.171097 15423 raft_consensus.cc:2804] T a018e41c89854091a15a6a8e4deffbdd P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:54:16.171770 15423 raft_consensus.cc:697] T a018e41c89854091a15a6a8e4deffbdd P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 LEADER]: Becoming Leader. State: Replica: 9cb8de0701f2482b99e51d5ac080aa13, State: Running, Role: LEADER
I20260709 14:54:16.173002 15423 consensus_queue.cc:237] T a018e41c89854091a15a6a8e4deffbdd P 9cb8de0701f2482b99e51d5ac080aa13 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
W20260709 14:54:16.183343 15001 consensus_peers.cc:597] T 46ebd2bd84cc46e08c82a7b893e54578 P dbc2c92e49e346b5b3bd7705a229afc6 -> Peer 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493): Couldn't send request to peer 9cb8de0701f2482b99e51d5ac080aa13. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:54:16.198213 15309 tablet_bootstrap.cc:654] T f8b33962eab84819b17953e44eae71a1 P 7519e608fbb44d9db8ad30b9f10ae605: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:16.188072 15110 raft_consensus.cc:2468] T a018e41c89854091a15a6a8e4deffbdd P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cb8de0701f2482b99e51d5ac080aa13 in term 1.
I20260709 14:54:16.208033 15307 tablet_bootstrap.cc:492] T f8b33962eab84819b17953e44eae71a1 P 9cb8de0701f2482b99e51d5ac080aa13: No bootstrap required, opened a new log
I20260709 14:54:16.212119 15307 ts_tablet_manager.cc:1403] T f8b33962eab84819b17953e44eae71a1 P 9cb8de0701f2482b99e51d5ac080aa13: Time spent bootstrapping tablet: real 0.180s	user 0.027s	sys 0.013s
I20260709 14:54:16.215173 15430 raft_consensus.cc:493] T 966a06ab56a6479283ab2818c9439d4f P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:16.215907 15430 raft_consensus.cc:515] T 966a06ab56a6479283ab2818c9439d4f P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:16.219910 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "966a06ab56a6479283ab2818c9439d4f" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" is_pre_election: true
W20260709 14:54:16.221868 15153 leader_election.cc:343] T 966a06ab56a6479283ab2818c9439d4f P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:16.233001 15306 tablet_bootstrap.cc:492] T a1075567fc91458ca7cc9977cf02b170 P dbc2c92e49e346b5b3bd7705a229afc6: No bootstrap required, opened a new log
I20260709 14:54:16.234766 15306 ts_tablet_manager.cc:1403] T a1075567fc91458ca7cc9977cf02b170 P dbc2c92e49e346b5b3bd7705a229afc6: Time spent bootstrapping tablet: real 0.200s	user 0.018s	sys 0.005s
I20260709 14:54:16.232931 15311 tablet_bootstrap.cc:492] T cc6f522768894933b21bc94b41605166 P eaa34beb1b274443b1c46839afd0a484: No bootstrap required, opened a new log
I20260709 14:54:16.239233 15311 ts_tablet_manager.cc:1403] T cc6f522768894933b21bc94b41605166 P eaa34beb1b274443b1c46839afd0a484: Time spent bootstrapping tablet: real 0.131s	user 0.013s	sys 0.012s
I20260709 14:54:16.242676 15430 leader_election.cc:290] T 966a06ab56a6479283ab2818c9439d4f P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477), 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177)
I20260709 14:54:16.241847 15306 raft_consensus.cc:359] T a1075567fc91458ca7cc9977cf02b170 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:16.245746 15113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "966a06ab56a6479283ab2818c9439d4f" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605" is_pre_election: true
I20260709 14:54:16.253835 15423 consensus_queue.cc:1048] T d2c4ea1c33c64cd09ba04611fdbdc59d P 9cb8de0701f2482b99e51d5ac080aa13 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 14:54:16.256922 15150 leader_election.cc:343] T 966a06ab56a6479283ab2818c9439d4f P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:16.257961 15150 leader_election.cc:304] T 966a06ab56a6479283ab2818c9439d4f P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa34beb1b274443b1c46839afd0a484; no voters: 7519e608fbb44d9db8ad30b9f10ae605, dbc2c92e49e346b5b3bd7705a229afc6
I20260709 14:54:16.259764 15430 raft_consensus.cc:2749] T 966a06ab56a6479283ab2818c9439d4f P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:54:16.250859 15311 raft_consensus.cc:359] T cc6f522768894933b21bc94b41605166 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:16.249737 15309 tablet_bootstrap.cc:492] T f8b33962eab84819b17953e44eae71a1 P 7519e608fbb44d9db8ad30b9f10ae605: No bootstrap required, opened a new log
I20260709 14:54:16.244691 15306 raft_consensus.cc:385] T a1075567fc91458ca7cc9977cf02b170 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:16.261343 15311 raft_consensus.cc:385] T cc6f522768894933b21bc94b41605166 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:16.263013 15306 raft_consensus.cc:740] T a1075567fc91458ca7cc9977cf02b170 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbc2c92e49e346b5b3bd7705a229afc6, State: Initialized, Role: FOLLOWER
I20260709 14:54:16.262741 15309 ts_tablet_manager.cc:1403] T f8b33962eab84819b17953e44eae71a1 P 7519e608fbb44d9db8ad30b9f10ae605: Time spent bootstrapping tablet: real 0.243s	user 0.026s	sys 0.006s
I20260709 14:54:16.264489 15306 consensus_queue.cc:260] T a1075567fc91458ca7cc9977cf02b170 P dbc2c92e49e346b5b3bd7705a229afc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:16.247004 15307 raft_consensus.cc:359] T f8b33962eab84819b17953e44eae71a1 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:16.266242 15307 raft_consensus.cc:385] T f8b33962eab84819b17953e44eae71a1 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:16.266615 15307 raft_consensus.cc:740] T f8b33962eab84819b17953e44eae71a1 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9cb8de0701f2482b99e51d5ac080aa13, State: Initialized, Role: FOLLOWER
I20260709 14:54:16.267577 15307 consensus_queue.cc:260] T f8b33962eab84819b17953e44eae71a1 P 9cb8de0701f2482b99e51d5ac080aa13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:16.267897 15309 raft_consensus.cc:359] T f8b33962eab84819b17953e44eae71a1 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:16.269599 15383 raft_consensus.cc:493] T d61f9ecebc3c4a028f5327bc9debf432 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:16.270299 15383 raft_consensus.cc:515] T d61f9ecebc3c4a028f5327bc9debf432 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:16.273113 15383 leader_election.cc:290] T d61f9ecebc3c4a028f5327bc9debf432 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493), 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177)
I20260709 14:54:16.273767 15307 ts_tablet_manager.cc:1434] T f8b33962eab84819b17953e44eae71a1 P 9cb8de0701f2482b99e51d5ac080aa13: Time spent starting tablet: real 0.061s	user 0.009s	sys 0.000s
I20260709 14:54:16.273119 15306 ts_tablet_manager.cc:1434] T a1075567fc91458ca7cc9977cf02b170 P dbc2c92e49e346b5b3bd7705a229afc6: Time spent starting tablet: real 0.038s	user 0.009s	sys 0.000s
I20260709 14:54:16.276257 15307 tablet_bootstrap.cc:492] T 46ebd2bd84cc46e08c82a7b893e54578 P 9cb8de0701f2482b99e51d5ac080aa13: Bootstrap starting.
I20260709 14:54:16.278067 15306 tablet_bootstrap.cc:492] T cc6f522768894933b21bc94b41605166 P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap starting.
I20260709 14:54:16.279178 15423 raft_consensus.cc:493] T d61f9ecebc3c4a028f5327bc9debf432 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:16.280157 15423 raft_consensus.cc:515] T d61f9ecebc3c4a028f5327bc9debf432 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:16.274403 15260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d61f9ecebc3c4a028f5327bc9debf432" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13" is_pre_election: true
I20260709 14:54:16.283512 15260 raft_consensus.cc:2468] T d61f9ecebc3c4a028f5327bc9debf432 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbc2c92e49e346b5b3bd7705a229afc6 in term 0.
I20260709 14:54:16.268999 15309 raft_consensus.cc:385] T f8b33962eab84819b17953e44eae71a1 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:16.286592 15309 raft_consensus.cc:740] T f8b33962eab84819b17953e44eae71a1 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7519e608fbb44d9db8ad30b9f10ae605, State: Initialized, Role: FOLLOWER
I20260709 14:54:16.287425 15309 consensus_queue.cc:260] T f8b33962eab84819b17953e44eae71a1 P 7519e608fbb44d9db8ad30b9f10ae605 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:16.285734 15001 leader_election.cc:304] T d61f9ecebc3c4a028f5327bc9debf432 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cb8de0701f2482b99e51d5ac080aa13, dbc2c92e49e346b5b3bd7705a229afc6; no voters: 
I20260709 14:54:16.287923 15423 leader_election.cc:290] T d61f9ecebc3c4a028f5327bc9debf432 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477), 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177)
I20260709 14:54:16.289175 15383 raft_consensus.cc:2804] T d61f9ecebc3c4a028f5327bc9debf432 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:54:16.263600 15311 raft_consensus.cc:740] T cc6f522768894933b21bc94b41605166 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eaa34beb1b274443b1c46839afd0a484, State: Initialized, Role: FOLLOWER
I20260709 14:54:16.291047 15383 raft_consensus.cc:493] T d61f9ecebc3c4a028f5327bc9debf432 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:54:16.291527 15383 raft_consensus.cc:3060] T d61f9ecebc3c4a028f5327bc9debf432 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:16.276850 15113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d61f9ecebc3c4a028f5327bc9debf432" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605" is_pre_election: true
I20260709 14:54:16.289932 15309 ts_tablet_manager.cc:1434] T f8b33962eab84819b17953e44eae71a1 P 7519e608fbb44d9db8ad30b9f10ae605: Time spent starting tablet: real 0.026s	user 0.008s	sys 0.000s
I20260709 14:54:16.296669 15309 tablet_bootstrap.cc:492] T 966a06ab56a6479283ab2818c9439d4f P 7519e608fbb44d9db8ad30b9f10ae605: Bootstrap starting.
I20260709 14:54:16.297587 15458 consensus_queue.cc:1048] T 46ebd2bd84cc46e08c82a7b893e54578 P dbc2c92e49e346b5b3bd7705a229afc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:54:16.290004 15306 tablet_bootstrap.cc:654] T cc6f522768894933b21bc94b41605166 P dbc2c92e49e346b5b3bd7705a229afc6: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:16.290187 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d61f9ecebc3c4a028f5327bc9debf432" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" is_pre_election: true
I20260709 14:54:16.305047 15311 consensus_queue.cc:260] T cc6f522768894933b21bc94b41605166 P eaa34beb1b274443b1c46839afd0a484 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:16.310691 15311 ts_tablet_manager.cc:1434] T cc6f522768894933b21bc94b41605166 P eaa34beb1b274443b1c46839afd0a484: Time spent starting tablet: real 0.071s	user 0.007s	sys 0.002s
I20260709 14:54:16.302759 15110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d61f9ecebc3c4a028f5327bc9debf432" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605" is_pre_election: true
W20260709 14:54:16.314007 15001 leader_election.cc:343] T d61f9ecebc3c4a028f5327bc9debf432 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177): Illegal state: must be running to vote when last-logged opid is not known
W20260709 14:54:16.319191 15224 leader_election.cc:343] T d61f9ecebc3c4a028f5327bc9debf432 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:16.312855 15369 consensus_queue.cc:1048] T d2c4ea1c33c64cd09ba04611fdbdc59d P 9cb8de0701f2482b99e51d5ac080aa13 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 14:54:16.328439 15311 tablet_bootstrap.cc:492] T 6b5bb32eee204f2b90b1f1f14875c579 P eaa34beb1b274443b1c46839afd0a484: Bootstrap starting.
I20260709 14:54:16.335038 15309 tablet_bootstrap.cc:654] T 966a06ab56a6479283ab2818c9439d4f P 7519e608fbb44d9db8ad30b9f10ae605: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:16.347723 15307 tablet_bootstrap.cc:654] T 46ebd2bd84cc46e08c82a7b893e54578 P 9cb8de0701f2482b99e51d5ac080aa13: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:16.341426 15383 raft_consensus.cc:515] T d61f9ecebc3c4a028f5327bc9debf432 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:16.360183 15038 raft_consensus.cc:2393] T d61f9ecebc3c4a028f5327bc9debf432 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9cb8de0701f2482b99e51d5ac080aa13 in current term 1: Already voted for candidate dbc2c92e49e346b5b3bd7705a229afc6 in this term.
I20260709 14:54:16.354046 15458 raft_consensus.cc:493] T a1075567fc91458ca7cc9977cf02b170 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:16.361528 15458 raft_consensus.cc:515] T a1075567fc91458ca7cc9977cf02b170 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:16.367674 15311 tablet_bootstrap.cc:654] T 6b5bb32eee204f2b90b1f1f14875c579 P eaa34beb1b274443b1c46839afd0a484: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:16.369799 15260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1075567fc91458ca7cc9977cf02b170" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13" is_pre_election: true
I20260709 14:54:16.374847 15458 leader_election.cc:290] T a1075567fc91458ca7cc9977cf02b170 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493), 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177)
W20260709 14:54:16.378561 15001 leader_election.cc:343] T a1075567fc91458ca7cc9977cf02b170 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:16.382643 15110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1075567fc91458ca7cc9977cf02b170" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605" is_pre_election: true
W20260709 14:54:16.384392 15001 leader_election.cc:343] T a1075567fc91458ca7cc9977cf02b170 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:16.384965 15001 leader_election.cc:304] T a1075567fc91458ca7cc9977cf02b170 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbc2c92e49e346b5b3bd7705a229afc6; no voters: 7519e608fbb44d9db8ad30b9f10ae605, 9cb8de0701f2482b99e51d5ac080aa13
I20260709 14:54:16.384545 15383 leader_election.cc:290] T d61f9ecebc3c4a028f5327bc9debf432 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 election: Requested vote from peers 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493), 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177)
I20260709 14:54:16.391253 15369 raft_consensus.cc:493] T f8b33962eab84819b17953e44eae71a1 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:16.395787 15260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d61f9ecebc3c4a028f5327bc9debf432" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13"
I20260709 14:54:16.396082 15369 raft_consensus.cc:515] T f8b33962eab84819b17953e44eae71a1 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:16.396754 15260 raft_consensus.cc:3060] T d61f9ecebc3c4a028f5327bc9debf432 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:16.387342 15459 raft_consensus.cc:2749] T a1075567fc91458ca7cc9977cf02b170 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:54:16.401124 15227 leader_election.cc:304] T d61f9ecebc3c4a028f5327bc9debf432 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cb8de0701f2482b99e51d5ac080aa13; no voters: 7519e608fbb44d9db8ad30b9f10ae605, dbc2c92e49e346b5b3bd7705a229afc6
I20260709 14:54:16.402244 14934 catalog_manager.cc:5697] T 67409326aa124c52a5e9a650d7570a68 P 9cb8de0701f2482b99e51d5ac080aa13 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68). New cstate: current_term: 1 leader_uuid: "9cb8de0701f2482b99e51d5ac080aa13" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } health_report { overall_health: HEALTHY } } }
I20260709 14:54:16.407433 14934 catalog_manager.cc:5697] T a018e41c89854091a15a6a8e4deffbdd P 9cb8de0701f2482b99e51d5ac080aa13 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68). New cstate: current_term: 1 leader_uuid: "9cb8de0701f2482b99e51d5ac080aa13" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } health_report { overall_health: HEALTHY } } }
I20260709 14:54:16.419698 15306 tablet_bootstrap.cc:492] T cc6f522768894933b21bc94b41605166 P dbc2c92e49e346b5b3bd7705a229afc6: No bootstrap required, opened a new log
I20260709 14:54:16.420424 15306 ts_tablet_manager.cc:1403] T cc6f522768894933b21bc94b41605166 P dbc2c92e49e346b5b3bd7705a229afc6: Time spent bootstrapping tablet: real 0.143s	user 0.014s	sys 0.012s
I20260709 14:54:16.405296 15430 raft_consensus.cc:493] T cc6f522768894933b21bc94b41605166 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:16.429957 15309 tablet_bootstrap.cc:492] T 966a06ab56a6479283ab2818c9439d4f P 7519e608fbb44d9db8ad30b9f10ae605: No bootstrap required, opened a new log
I20260709 14:54:16.431275 15309 ts_tablet_manager.cc:1403] T 966a06ab56a6479283ab2818c9439d4f P 7519e608fbb44d9db8ad30b9f10ae605: Time spent bootstrapping tablet: real 0.135s	user 0.029s	sys 0.027s
I20260709 14:54:16.420898 15110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d61f9ecebc3c4a028f5327bc9debf432" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605"
I20260709 14:54:16.432811 15430 raft_consensus.cc:515] T cc6f522768894933b21bc94b41605166 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:16.437793 15369 leader_election.cc:290] T f8b33962eab84819b17953e44eae71a1 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177), eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805)
I20260709 14:54:16.421605 15432 raft_consensus.cc:493] T f8b33962eab84819b17953e44eae71a1 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:16.438961 15430 leader_election.cc:290] T cc6f522768894933b21bc94b41605166 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493), dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477)
I20260709 14:54:16.440620 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc6f522768894933b21bc94b41605166" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" is_pre_election: true
I20260709 14:54:16.441466 15261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc6f522768894933b21bc94b41605166" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13" is_pre_election: true
W20260709 14:54:16.443539 15150 leader_election.cc:343] T cc6f522768894933b21bc94b41605166 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:16.438759 15432 raft_consensus.cc:515] T f8b33962eab84819b17953e44eae71a1 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:16.446000 15307 tablet_bootstrap.cc:492] T 46ebd2bd84cc46e08c82a7b893e54578 P 9cb8de0701f2482b99e51d5ac080aa13: No bootstrap required, opened a new log
I20260709 14:54:16.446904 15307 ts_tablet_manager.cc:1403] T 46ebd2bd84cc46e08c82a7b893e54578 P 9cb8de0701f2482b99e51d5ac080aa13: Time spent bootstrapping tablet: real 0.171s	user 0.025s	sys 0.009s
W20260709 14:54:16.448210 15001 leader_election.cc:343] T d61f9ecebc3c4a028f5327bc9debf432 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:16.445492 15184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b33962eab84819b17953e44eae71a1" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484" is_pre_election: true
I20260709 14:54:16.449608 15184 raft_consensus.cc:2468] T f8b33962eab84819b17953e44eae71a1 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cb8de0701f2482b99e51d5ac080aa13 in term 0.
I20260709 14:54:16.451820 15309 raft_consensus.cc:359] T 966a06ab56a6479283ab2818c9439d4f P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:16.452816 15309 raft_consensus.cc:385] T 966a06ab56a6479283ab2818c9439d4f P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:16.452661 15184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b33962eab84819b17953e44eae71a1" candidate_uuid: "7519e608fbb44d9db8ad30b9f10ae605" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484" is_pre_election: true
I20260709 14:54:16.453361 15309 raft_consensus.cc:740] T 966a06ab56a6479283ab2818c9439d4f P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7519e608fbb44d9db8ad30b9f10ae605, State: Initialized, Role: FOLLOWER
I20260709 14:54:16.453925 15184 raft_consensus.cc:2468] T f8b33962eab84819b17953e44eae71a1 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7519e608fbb44d9db8ad30b9f10ae605 in term 0.
I20260709 14:54:16.454483 15309 consensus_queue.cc:260] T 966a06ab56a6479283ab2818c9439d4f P 7519e608fbb44d9db8ad30b9f10ae605 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
W20260709 14:54:16.452203 15153 leader_election.cc:343] T cc6f522768894933b21bc94b41605166 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:16.457145 15079 leader_election.cc:304] T f8b33962eab84819b17953e44eae71a1 P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7519e608fbb44d9db8ad30b9f10ae605, eaa34beb1b274443b1c46839afd0a484; no voters: 
I20260709 14:54:16.457571 15153 leader_election.cc:304] T cc6f522768894933b21bc94b41605166 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa34beb1b274443b1c46839afd0a484; no voters: 9cb8de0701f2482b99e51d5ac080aa13, dbc2c92e49e346b5b3bd7705a229afc6
I20260709 14:54:16.458369 15351 raft_consensus.cc:2804] T f8b33962eab84819b17953e44eae71a1 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:54:16.458830 15351 raft_consensus.cc:493] T f8b33962eab84819b17953e44eae71a1 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:54:16.459178 15351 raft_consensus.cc:3060] T f8b33962eab84819b17953e44eae71a1 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:16.459761 15309 ts_tablet_manager.cc:1434] T 966a06ab56a6479283ab2818c9439d4f P 7519e608fbb44d9db8ad30b9f10ae605: Time spent starting tablet: real 0.027s	user 0.010s	sys 0.000s
I20260709 14:54:16.460500 15306 raft_consensus.cc:359] T cc6f522768894933b21bc94b41605166 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:16.453650 15261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b33962eab84819b17953e44eae71a1" candidate_uuid: "7519e608fbb44d9db8ad30b9f10ae605" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13" is_pre_election: true
I20260709 14:54:16.461606 15306 raft_consensus.cc:385] T cc6f522768894933b21bc94b41605166 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:16.461935 15306 raft_consensus.cc:740] T cc6f522768894933b21bc94b41605166 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbc2c92e49e346b5b3bd7705a229afc6, State: Initialized, Role: FOLLOWER
I20260709 14:54:16.461818 15261 raft_consensus.cc:2468] T f8b33962eab84819b17953e44eae71a1 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7519e608fbb44d9db8ad30b9f10ae605 in term 0.
I20260709 14:54:16.463066 15306 consensus_queue.cc:260] T cc6f522768894933b21bc94b41605166 P dbc2c92e49e346b5b3bd7705a229afc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:16.465343 15110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b33962eab84819b17953e44eae71a1" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605" is_pre_election: true
I20260709 14:54:16.466341 15306 ts_tablet_manager.cc:1434] T cc6f522768894933b21bc94b41605166 P dbc2c92e49e346b5b3bd7705a229afc6: Time spent starting tablet: real 0.046s	user 0.010s	sys 0.000s
I20260709 14:54:16.467010 15227 leader_election.cc:304] T f8b33962eab84819b17953e44eae71a1 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cb8de0701f2482b99e51d5ac080aa13, eaa34beb1b274443b1c46839afd0a484; no voters: 
I20260709 14:54:16.467590 15306 tablet_bootstrap.cc:492] T 966a06ab56a6479283ab2818c9439d4f P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap starting.
I20260709 14:54:16.468205 15448 raft_consensus.cc:493] T 966a06ab56a6479283ab2818c9439d4f P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:16.468760 15448 raft_consensus.cc:515] T 966a06ab56a6479283ab2818c9439d4f P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:16.474583 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "966a06ab56a6479283ab2818c9439d4f" candidate_uuid: "7519e608fbb44d9db8ad30b9f10ae605" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" is_pre_election: true
I20260709 14:54:16.481588 15369 raft_consensus.cc:2804] T f8b33962eab84819b17953e44eae71a1 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:54:16.483856 15369 raft_consensus.cc:493] T f8b33962eab84819b17953e44eae71a1 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:54:16.484421 15369 raft_consensus.cc:3060] T f8b33962eab84819b17953e44eae71a1 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:16.486359 15307 raft_consensus.cc:359] T 46ebd2bd84cc46e08c82a7b893e54578 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:16.483258 15448 leader_election.cc:290] T 966a06ab56a6479283ab2818c9439d4f P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477), eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805)
I20260709 14:54:16.487579 15307 raft_consensus.cc:385] T 46ebd2bd84cc46e08c82a7b893e54578 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:16.488672 15307 raft_consensus.cc:740] T 46ebd2bd84cc46e08c82a7b893e54578 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9cb8de0701f2482b99e51d5ac080aa13, State: Initialized, Role: FOLLOWER
I20260709 14:54:16.478626 15430 raft_consensus.cc:2749] T cc6f522768894933b21bc94b41605166 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:54:16.491112 15306 tablet_bootstrap.cc:654] T 966a06ab56a6479283ab2818c9439d4f P dbc2c92e49e346b5b3bd7705a229afc6: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:16.461192 15432 leader_election.cc:290] T f8b33962eab84819b17953e44eae71a1 P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805), 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493)
I20260709 14:54:16.484311 15260 raft_consensus.cc:2468] T d61f9ecebc3c4a028f5327bc9debf432 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbc2c92e49e346b5b3bd7705a229afc6 in term 1.
I20260709 14:54:16.502092 15434 raft_consensus.cc:2749] T d61f9ecebc3c4a028f5327bc9debf432 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:54:16.503880 15311 tablet_bootstrap.cc:492] T 6b5bb32eee204f2b90b1f1f14875c579 P eaa34beb1b274443b1c46839afd0a484: No bootstrap required, opened a new log
I20260709 14:54:16.504225 15001 leader_election.cc:304] T d61f9ecebc3c4a028f5327bc9debf432 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9cb8de0701f2482b99e51d5ac080aa13, dbc2c92e49e346b5b3bd7705a229afc6; no voters: 7519e608fbb44d9db8ad30b9f10ae605
I20260709 14:54:16.504561 15311 ts_tablet_manager.cc:1403] T 6b5bb32eee204f2b90b1f1f14875c579 P eaa34beb1b274443b1c46839afd0a484: Time spent bootstrapping tablet: real 0.176s	user 0.015s	sys 0.007s
I20260709 14:54:16.501679 15307 consensus_queue.cc:260] T 46ebd2bd84cc46e08c82a7b893e54578 P 9cb8de0701f2482b99e51d5ac080aa13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:16.505740 15459 raft_consensus.cc:2804] T d61f9ecebc3c4a028f5327bc9debf432 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:54:16.506321 15459 raft_consensus.cc:697] T d61f9ecebc3c4a028f5327bc9debf432 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 LEADER]: Becoming Leader. State: Replica: dbc2c92e49e346b5b3bd7705a229afc6, State: Running, Role: LEADER
I20260709 14:54:16.507326 15309 tablet_bootstrap.cc:492] T f389b12c6b304243905f28267dfaeed0 P 7519e608fbb44d9db8ad30b9f10ae605: Bootstrap starting.
I20260709 14:54:16.510030 15459 consensus_queue.cc:237] T d61f9ecebc3c4a028f5327bc9debf432 P dbc2c92e49e346b5b3bd7705a229afc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:16.520244 15307 ts_tablet_manager.cc:1434] T 46ebd2bd84cc46e08c82a7b893e54578 P 9cb8de0701f2482b99e51d5ac080aa13: Time spent starting tablet: real 0.073s	user 0.004s	sys 0.008s
W20260709 14:54:16.527956 15079 leader_election.cc:343] T 966a06ab56a6479283ab2818c9439d4f P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:16.531831 15183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "966a06ab56a6479283ab2818c9439d4f" candidate_uuid: "7519e608fbb44d9db8ad30b9f10ae605" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484" is_pre_election: true
I20260709 14:54:16.532454 15311 raft_consensus.cc:359] T 6b5bb32eee204f2b90b1f1f14875c579 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:16.532769 15183 raft_consensus.cc:2468] T 966a06ab56a6479283ab2818c9439d4f P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7519e608fbb44d9db8ad30b9f10ae605 in term 0.
I20260709 14:54:16.540282 15311 raft_consensus.cc:385] T 6b5bb32eee204f2b90b1f1f14875c579 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:16.540716 15311 raft_consensus.cc:740] T 6b5bb32eee204f2b90b1f1f14875c579 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eaa34beb1b274443b1c46839afd0a484, State: Initialized, Role: FOLLOWER
I20260709 14:54:16.541594 15311 consensus_queue.cc:260] T 6b5bb32eee204f2b90b1f1f14875c579 P eaa34beb1b274443b1c46839afd0a484 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:16.543967 15311 ts_tablet_manager.cc:1434] T 6b5bb32eee204f2b90b1f1f14875c579 P eaa34beb1b274443b1c46839afd0a484: Time spent starting tablet: real 0.037s	user 0.002s	sys 0.003s
I20260709 14:54:16.545902 15079 leader_election.cc:304] T 966a06ab56a6479283ab2818c9439d4f P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7519e608fbb44d9db8ad30b9f10ae605, eaa34beb1b274443b1c46839afd0a484; no voters: dbc2c92e49e346b5b3bd7705a229afc6
I20260709 14:54:16.546838 15306 tablet_bootstrap.cc:492] T 966a06ab56a6479283ab2818c9439d4f P dbc2c92e49e346b5b3bd7705a229afc6: No bootstrap required, opened a new log
I20260709 14:54:16.547500 15306 ts_tablet_manager.cc:1403] T 966a06ab56a6479283ab2818c9439d4f P dbc2c92e49e346b5b3bd7705a229afc6: Time spent bootstrapping tablet: real 0.080s	user 0.011s	sys 0.004s
I20260709 14:54:16.524219 15351 raft_consensus.cc:515] T f8b33962eab84819b17953e44eae71a1 P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:16.547384 15492 raft_consensus.cc:2804] T 966a06ab56a6479283ab2818c9439d4f P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:54:16.550823 15492 raft_consensus.cc:493] T 966a06ab56a6479283ab2818c9439d4f P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:54:16.551286 15492 raft_consensus.cc:3060] T 966a06ab56a6479283ab2818c9439d4f P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:16.553793 15432 consensus_queue.cc:1048] T 054739df584d4b9db840777c2ae17555 P 7519e608fbb44d9db8ad30b9f10ae605 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:54:16.554643 15306 raft_consensus.cc:359] T 966a06ab56a6479283ab2818c9439d4f P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:16.555608 15306 raft_consensus.cc:385] T 966a06ab56a6479283ab2818c9439d4f P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:16.555994 15306 raft_consensus.cc:740] T 966a06ab56a6479283ab2818c9439d4f P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbc2c92e49e346b5b3bd7705a229afc6, State: Initialized, Role: FOLLOWER
I20260709 14:54:16.547495 15309 tablet_bootstrap.cc:654] T f389b12c6b304243905f28267dfaeed0 P 7519e608fbb44d9db8ad30b9f10ae605: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:16.529387 15369 raft_consensus.cc:515] T f8b33962eab84819b17953e44eae71a1 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:16.561862 15110 raft_consensus.cc:2393] T f8b33962eab84819b17953e44eae71a1 P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9cb8de0701f2482b99e51d5ac080aa13 in current term 1: Already voted for candidate 7519e608fbb44d9db8ad30b9f10ae605 in this term.
I20260709 14:54:16.562101 15113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b33962eab84819b17953e44eae71a1" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605"
I20260709 14:54:16.564528 15261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b33962eab84819b17953e44eae71a1" candidate_uuid: "7519e608fbb44d9db8ad30b9f10ae605" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13"
I20260709 14:54:16.565557 15261 raft_consensus.cc:2393] T f8b33962eab84819b17953e44eae71a1 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7519e608fbb44d9db8ad30b9f10ae605 in current term 1: Already voted for candidate 9cb8de0701f2482b99e51d5ac080aa13 in this term.
I20260709 14:54:16.566744 15423 consensus_queue.cc:1048] T a018e41c89854091a15a6a8e4deffbdd P 9cb8de0701f2482b99e51d5ac080aa13 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:54:16.568102 15351 leader_election.cc:290] T f8b33962eab84819b17953e44eae71a1 P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 1 election: Requested vote from peers eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805), 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493)
I20260709 14:54:16.568168 15183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b33962eab84819b17953e44eae71a1" candidate_uuid: "7519e608fbb44d9db8ad30b9f10ae605" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484"
I20260709 14:54:16.568806 15492 raft_consensus.cc:515] T 966a06ab56a6479283ab2818c9439d4f P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:16.569279 15183 raft_consensus.cc:3060] T f8b33962eab84819b17953e44eae71a1 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:16.571962 15369 leader_election.cc:290] T f8b33962eab84819b17953e44eae71a1 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 election: Requested vote from peers 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177), eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805)
I20260709 14:54:16.573276 15307 tablet_bootstrap.cc:492] T ca2aa2e1a8c646069cb8b23b0ebdb0c7 P 9cb8de0701f2482b99e51d5ac080aa13: Bootstrap starting.
I20260709 14:54:16.575629 15311 tablet_bootstrap.cc:492] T 5f5dbc86fc8f4ae5b77e0f23adfcd593 P eaa34beb1b274443b1c46839afd0a484: Bootstrap starting.
I20260709 14:54:16.576916 15184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b33962eab84819b17953e44eae71a1" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484"
I20260709 14:54:16.580504 15227 leader_election.cc:304] T f8b33962eab84819b17953e44eae71a1 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cb8de0701f2482b99e51d5ac080aa13; no voters: 7519e608fbb44d9db8ad30b9f10ae605, eaa34beb1b274443b1c46839afd0a484
I20260709 14:54:16.575107 15466 raft_consensus.cc:493] T d86dfc13b2834d7e8b2ad5f975f08154 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:16.582441 15466 raft_consensus.cc:515] T d86dfc13b2834d7e8b2ad5f975f08154 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:16.585705 15466 leader_election.cc:290] T d86dfc13b2834d7e8b2ad5f975f08154 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493), dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477)
I20260709 14:54:16.588315 15306 consensus_queue.cc:260] T 966a06ab56a6479283ab2818c9439d4f P dbc2c92e49e346b5b3bd7705a229afc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:16.591002 15261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86dfc13b2834d7e8b2ad5f975f08154" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13" is_pre_election: true
I20260709 14:54:16.592929 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86dfc13b2834d7e8b2ad5f975f08154" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" is_pre_election: true
I20260709 14:54:16.593668 15423 raft_consensus.cc:2749] T f8b33962eab84819b17953e44eae71a1 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 14:54:16.592609 15351 consensus_queue.cc:1048] T 054739df584d4b9db840777c2ae17555 P 7519e608fbb44d9db8ad30b9f10ae605 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 14:54:16.595113 15153 leader_election.cc:343] T d86dfc13b2834d7e8b2ad5f975f08154 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Illegal state: must be running to vote when last-logged opid is not known
W20260709 14:54:16.597734 15150 leader_election.cc:343] T d86dfc13b2834d7e8b2ad5f975f08154 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:16.598380 15150 leader_election.cc:304] T d86dfc13b2834d7e8b2ad5f975f08154 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa34beb1b274443b1c46839afd0a484; no voters: 9cb8de0701f2482b99e51d5ac080aa13, dbc2c92e49e346b5b3bd7705a229afc6
I20260709 14:54:16.595956 14934 catalog_manager.cc:5697] T d61f9ecebc3c4a028f5327bc9debf432 P dbc2c92e49e346b5b3bd7705a229afc6 reported cstate change: term changed from 0 to 1, leader changed from <none> to dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65). New cstate: current_term: 1 leader_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } health_report { overall_health: UNKNOWN } } }
I20260709 14:54:16.612236 15183 raft_consensus.cc:2468] T f8b33962eab84819b17953e44eae71a1 P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7519e608fbb44d9db8ad30b9f10ae605 in term 1.
I20260709 14:54:16.614615 15079 leader_election.cc:304] T f8b33962eab84819b17953e44eae71a1 P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7519e608fbb44d9db8ad30b9f10ae605, eaa34beb1b274443b1c46839afd0a484; no voters: 9cb8de0701f2482b99e51d5ac080aa13
I20260709 14:54:16.616053 15351 raft_consensus.cc:2804] T f8b33962eab84819b17953e44eae71a1 P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:54:16.616305 15306 ts_tablet_manager.cc:1434] T 966a06ab56a6479283ab2818c9439d4f P dbc2c92e49e346b5b3bd7705a229afc6: Time spent starting tablet: real 0.068s	user 0.008s	sys 0.000s
I20260709 14:54:16.616699 15351 raft_consensus.cc:697] T f8b33962eab84819b17953e44eae71a1 P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 LEADER]: Becoming Leader. State: Replica: 7519e608fbb44d9db8ad30b9f10ae605, State: Running, Role: LEADER
I20260709 14:54:16.603434 15466 raft_consensus.cc:2749] T d86dfc13b2834d7e8b2ad5f975f08154 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:54:16.618400 15351 consensus_queue.cc:237] T f8b33962eab84819b17953e44eae71a1 P 7519e608fbb44d9db8ad30b9f10ae605 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:16.622066 15306 tablet_bootstrap.cc:492] T d86dfc13b2834d7e8b2ad5f975f08154 P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap starting.
I20260709 14:54:16.627070 15492 leader_election.cc:290] T 966a06ab56a6479283ab2818c9439d4f P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 1 election: Requested vote from peers dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477), eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805)
I20260709 14:54:16.629806 15369 consensus_queue.cc:1048] T 67409326aa124c52a5e9a650d7570a68 P 9cb8de0701f2482b99e51d5ac080aa13 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:54:16.637192 15383 raft_consensus.cc:493] T cc6f522768894933b21bc94b41605166 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:16.657927 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "966a06ab56a6479283ab2818c9439d4f" candidate_uuid: "7519e608fbb44d9db8ad30b9f10ae605" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc2c92e49e346b5b3bd7705a229afc6"
I20260709 14:54:16.663153 15035 raft_consensus.cc:3060] T 966a06ab56a6479283ab2818c9439d4f P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:16.682358 15183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "966a06ab56a6479283ab2818c9439d4f" candidate_uuid: "7519e608fbb44d9db8ad30b9f10ae605" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484"
I20260709 14:54:16.683233 15183 raft_consensus.cc:3060] T 966a06ab56a6479283ab2818c9439d4f P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:16.661537 15383 raft_consensus.cc:515] T cc6f522768894933b21bc94b41605166 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:16.686285 15369 consensus_queue.cc:1048] T 67409326aa124c52a5e9a650d7570a68 P 9cb8de0701f2482b99e51d5ac080aa13 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:54:16.697218 15383 leader_election.cc:290] T cc6f522768894933b21bc94b41605166 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805), 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493)
I20260709 14:54:16.710515 15261 raft_consensus.cc:3060] T 46ebd2bd84cc46e08c82a7b893e54578 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:16.714932 15259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc6f522768894933b21bc94b41605166" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13" is_pre_election: true
I20260709 14:54:16.715132 15307 tablet_bootstrap.cc:654] T ca2aa2e1a8c646069cb8b23b0ebdb0c7 P 9cb8de0701f2482b99e51d5ac080aa13: Neither blocks nor log segments found. Creating new log.
W20260709 14:54:16.731702 15001 leader_election.cc:343] T cc6f522768894933b21bc94b41605166 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:16.738104 15306 tablet_bootstrap.cc:654] T d86dfc13b2834d7e8b2ad5f975f08154 P dbc2c92e49e346b5b3bd7705a229afc6: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:16.748101 15311 tablet_bootstrap.cc:654] T 5f5dbc86fc8f4ae5b77e0f23adfcd593 P eaa34beb1b274443b1c46839afd0a484: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:16.810945 15309 tablet_bootstrap.cc:492] T f389b12c6b304243905f28267dfaeed0 P 7519e608fbb44d9db8ad30b9f10ae605: No bootstrap required, opened a new log
I20260709 14:54:16.811777 15309 ts_tablet_manager.cc:1403] T f389b12c6b304243905f28267dfaeed0 P 7519e608fbb44d9db8ad30b9f10ae605: Time spent bootstrapping tablet: real 0.331s	user 0.033s	sys 0.022s
I20260709 14:54:16.897223 15430 raft_consensus.cc:493] T 6b5bb32eee204f2b90b1f1f14875c579 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:16.897990 15430 raft_consensus.cc:515] T 6b5bb32eee204f2b90b1f1f14875c579 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:16.900581 15430 leader_election.cc:290] T 6b5bb32eee204f2b90b1f1f14875c579 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177), 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493)
I20260709 14:54:16.905859 15309 raft_consensus.cc:359] T f389b12c6b304243905f28267dfaeed0 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:16.909947 15309 raft_consensus.cc:385] T f389b12c6b304243905f28267dfaeed0 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:16.910444 15309 raft_consensus.cc:740] T f389b12c6b304243905f28267dfaeed0 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7519e608fbb44d9db8ad30b9f10ae605, State: Initialized, Role: FOLLOWER
I20260709 14:54:16.909016 15035 raft_consensus.cc:2468] T 966a06ab56a6479283ab2818c9439d4f P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7519e608fbb44d9db8ad30b9f10ae605 in term 1.
I20260709 14:54:16.911844 15309 consensus_queue.cc:260] T f389b12c6b304243905f28267dfaeed0 P 7519e608fbb44d9db8ad30b9f10ae605 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:16.867592 15186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc6f522768894933b21bc94b41605166" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484" is_pre_election: true
I20260709 14:54:16.927867 15186 raft_consensus.cc:2468] T cc6f522768894933b21bc94b41605166 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbc2c92e49e346b5b3bd7705a229afc6 in term 0.
I20260709 14:54:16.938254 15306 tablet_bootstrap.cc:492] T d86dfc13b2834d7e8b2ad5f975f08154 P dbc2c92e49e346b5b3bd7705a229afc6: No bootstrap required, opened a new log
I20260709 14:54:16.939309 15306 ts_tablet_manager.cc:1403] T d86dfc13b2834d7e8b2ad5f975f08154 P dbc2c92e49e346b5b3bd7705a229afc6: Time spent bootstrapping tablet: real 0.318s	user 0.027s	sys 0.006s
I20260709 14:54:16.944265 15079 leader_election.cc:304] T 966a06ab56a6479283ab2818c9439d4f P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7519e608fbb44d9db8ad30b9f10ae605, dbc2c92e49e346b5b3bd7705a229afc6; no voters: 
I20260709 14:54:16.947695 15492 raft_consensus.cc:2804] T 966a06ab56a6479283ab2818c9439d4f P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:54:16.948300 15492 raft_consensus.cc:697] T 966a06ab56a6479283ab2818c9439d4f P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 LEADER]: Becoming Leader. State: Replica: 7519e608fbb44d9db8ad30b9f10ae605, State: Running, Role: LEADER
I20260709 14:54:16.950836 15309 ts_tablet_manager.cc:1434] T f389b12c6b304243905f28267dfaeed0 P 7519e608fbb44d9db8ad30b9f10ae605: Time spent starting tablet: real 0.139s	user 0.012s	sys 0.000s
I20260709 14:54:16.952899 15492 consensus_queue.cc:237] T 966a06ab56a6479283ab2818c9439d4f P 7519e608fbb44d9db8ad30b9f10ae605 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:16.953570 15004 leader_election.cc:304] T cc6f522768894933b21bc94b41605166 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dbc2c92e49e346b5b3bd7705a229afc6, eaa34beb1b274443b1c46839afd0a484; no voters: 9cb8de0701f2482b99e51d5ac080aa13
I20260709 14:54:16.954515 15459 raft_consensus.cc:2804] T cc6f522768894933b21bc94b41605166 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:54:16.954927 15459 raft_consensus.cc:493] T cc6f522768894933b21bc94b41605166 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:54:16.955276 15459 raft_consensus.cc:3060] T cc6f522768894933b21bc94b41605166 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:16.975102 15307 tablet_bootstrap.cc:492] T ca2aa2e1a8c646069cb8b23b0ebdb0c7 P 9cb8de0701f2482b99e51d5ac080aa13: No bootstrap required, opened a new log
I20260709 14:54:16.975872 15307 ts_tablet_manager.cc:1403] T ca2aa2e1a8c646069cb8b23b0ebdb0c7 P 9cb8de0701f2482b99e51d5ac080aa13: Time spent bootstrapping tablet: real 0.447s	user 0.036s	sys 0.042s
I20260709 14:54:16.985148 15309 tablet_bootstrap.cc:492] T ca2aa2e1a8c646069cb8b23b0ebdb0c7 P 7519e608fbb44d9db8ad30b9f10ae605: Bootstrap starting.
I20260709 14:54:16.981889 15346 consensus_queue.cc:1048] T a018e41c89854091a15a6a8e4deffbdd P 9cb8de0701f2482b99e51d5ac080aa13 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 14:54:16.986969 15307 raft_consensus.cc:359] T ca2aa2e1a8c646069cb8b23b0ebdb0c7 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:16.988343 15307 raft_consensus.cc:385] T ca2aa2e1a8c646069cb8b23b0ebdb0c7 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:16.988760 15307 raft_consensus.cc:740] T ca2aa2e1a8c646069cb8b23b0ebdb0c7 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9cb8de0701f2482b99e51d5ac080aa13, State: Initialized, Role: FOLLOWER
I20260709 14:54:16.992476 15259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b5bb32eee204f2b90b1f1f14875c579" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13" is_pre_election: true
I20260709 14:54:17.000656 15183 raft_consensus.cc:2468] T 966a06ab56a6479283ab2818c9439d4f P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7519e608fbb44d9db8ad30b9f10ae605 in term 1.
I20260709 14:54:17.002585 15306 raft_consensus.cc:359] T d86dfc13b2834d7e8b2ad5f975f08154 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:17.003480 15306 raft_consensus.cc:385] T d86dfc13b2834d7e8b2ad5f975f08154 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:17.003876 15306 raft_consensus.cc:740] T d86dfc13b2834d7e8b2ad5f975f08154 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbc2c92e49e346b5b3bd7705a229afc6, State: Initialized, Role: FOLLOWER
I20260709 14:54:17.003711 15459 raft_consensus.cc:515] T cc6f522768894933b21bc94b41605166 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:17.003525 15499 consensus_queue.cc:1048] T d61f9ecebc3c4a028f5327bc9debf432 P dbc2c92e49e346b5b3bd7705a229afc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 14:54:17.005766 15306 consensus_queue.cc:260] T d86dfc13b2834d7e8b2ad5f975f08154 P dbc2c92e49e346b5b3bd7705a229afc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:17.006093 15307 consensus_queue.cc:260] T ca2aa2e1a8c646069cb8b23b0ebdb0c7 P 9cb8de0701f2482b99e51d5ac080aa13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:17.008644 15306 ts_tablet_manager.cc:1434] T d86dfc13b2834d7e8b2ad5f975f08154 P dbc2c92e49e346b5b3bd7705a229afc6: Time spent starting tablet: real 0.069s	user 0.007s	sys 0.001s
I20260709 14:54:17.010365 15306 tablet_bootstrap.cc:492] T 1159198eabeb409996ccbec0cac057f8 P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap starting.
I20260709 14:54:17.010826 15459 leader_election.cc:290] T cc6f522768894933b21bc94b41605166 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 election: Requested vote from peers eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805), 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493)
I20260709 14:54:17.012512 15311 tablet_bootstrap.cc:492] T 5f5dbc86fc8f4ae5b77e0f23adfcd593 P eaa34beb1b274443b1c46839afd0a484: No bootstrap required, opened a new log
I20260709 14:54:17.014478 15186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc6f522768894933b21bc94b41605166" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484"
I20260709 14:54:17.015441 15186 raft_consensus.cc:3060] T cc6f522768894933b21bc94b41605166 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:17.008644 15307 ts_tablet_manager.cc:1434] T ca2aa2e1a8c646069cb8b23b0ebdb0c7 P 9cb8de0701f2482b99e51d5ac080aa13: Time spent starting tablet: real 0.032s	user 0.008s	sys 0.000s
I20260709 14:54:17.017357 15307 tablet_bootstrap.cc:492] T a1075567fc91458ca7cc9977cf02b170 P 9cb8de0701f2482b99e51d5ac080aa13: Bootstrap starting.
W20260709 14:54:17.020115 15150 leader_election.cc:343] T 6b5bb32eee204f2b90b1f1f14875c579 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:17.025123 15307 tablet_bootstrap.cc:654] T a1075567fc91458ca7cc9977cf02b170 P 9cb8de0701f2482b99e51d5ac080aa13: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:17.028142 15260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc6f522768894933b21bc94b41605166" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13"
I20260709 14:54:17.027318 15306 tablet_bootstrap.cc:654] T 1159198eabeb409996ccbec0cac057f8 P dbc2c92e49e346b5b3bd7705a229afc6: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:17.032099 14935 catalog_manager.cc:5697] T f8b33962eab84819b17953e44eae71a1 P 7519e608fbb44d9db8ad30b9f10ae605 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66). New cstate: current_term: 1 leader_uuid: "7519e608fbb44d9db8ad30b9f10ae605" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } health_report { overall_health: UNKNOWN } } }
I20260709 14:54:17.014463 15311 ts_tablet_manager.cc:1403] T 5f5dbc86fc8f4ae5b77e0f23adfcd593 P eaa34beb1b274443b1c46839afd0a484: Time spent bootstrapping tablet: real 0.469s	user 0.010s	sys 0.023s
I20260709 14:54:17.039923 15110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b5bb32eee204f2b90b1f1f14875c579" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605" is_pre_election: true
I20260709 14:54:17.040588 15311 raft_consensus.cc:359] T 5f5dbc86fc8f4ae5b77e0f23adfcd593 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:17.043272 15311 raft_consensus.cc:385] T 5f5dbc86fc8f4ae5b77e0f23adfcd593 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:17.043638 15311 raft_consensus.cc:740] T 5f5dbc86fc8f4ae5b77e0f23adfcd593 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eaa34beb1b274443b1c46839afd0a484, State: Initialized, Role: FOLLOWER
I20260709 14:54:17.047371 15311 consensus_queue.cc:260] T 5f5dbc86fc8f4ae5b77e0f23adfcd593 P eaa34beb1b274443b1c46839afd0a484 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:17.049599 15432 raft_consensus.cc:493] T f389b12c6b304243905f28267dfaeed0 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:17.050379 15432 raft_consensus.cc:515] T f389b12c6b304243905f28267dfaeed0 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:17.052124 15306 tablet_bootstrap.cc:492] T 1159198eabeb409996ccbec0cac057f8 P dbc2c92e49e346b5b3bd7705a229afc6: No bootstrap required, opened a new log
I20260709 14:54:17.052809 15432 leader_election.cc:290] T f389b12c6b304243905f28267dfaeed0 P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477), eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805)
W20260709 14:54:17.048283 15001 leader_election.cc:343] T cc6f522768894933b21bc94b41605166 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:17.052824 15306 ts_tablet_manager.cc:1403] T 1159198eabeb409996ccbec0cac057f8 P dbc2c92e49e346b5b3bd7705a229afc6: Time spent bootstrapping tablet: real 0.043s	user 0.013s	sys 0.004s
I20260709 14:54:17.059305 15183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f389b12c6b304243905f28267dfaeed0" candidate_uuid: "7519e608fbb44d9db8ad30b9f10ae605" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484" is_pre_election: true
I20260709 14:54:17.060995 15499 raft_consensus.cc:493] T d86dfc13b2834d7e8b2ad5f975f08154 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:17.066149 15499 raft_consensus.cc:515] T d86dfc13b2834d7e8b2ad5f975f08154 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:17.067556 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f389b12c6b304243905f28267dfaeed0" candidate_uuid: "7519e608fbb44d9db8ad30b9f10ae605" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" is_pre_election: true
I20260709 14:54:17.071552 15183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86dfc13b2834d7e8b2ad5f975f08154" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484" is_pre_election: true
I20260709 14:54:17.084645 15183 raft_consensus.cc:2468] T d86dfc13b2834d7e8b2ad5f975f08154 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbc2c92e49e346b5b3bd7705a229afc6 in term 0.
I20260709 14:54:17.086489 15311 ts_tablet_manager.cc:1434] T 5f5dbc86fc8f4ae5b77e0f23adfcd593 P eaa34beb1b274443b1c46839afd0a484: Time spent starting tablet: real 0.049s	user 0.008s	sys 0.001s
I20260709 14:54:17.111218 15186 raft_consensus.cc:2468] T cc6f522768894933b21bc94b41605166 P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbc2c92e49e346b5b3bd7705a229afc6 in term 1.
I20260709 14:54:17.113837 15004 leader_election.cc:304] T d86dfc13b2834d7e8b2ad5f975f08154 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dbc2c92e49e346b5b3bd7705a229afc6, eaa34beb1b274443b1c46839afd0a484; no voters: 
I20260709 14:54:17.115638 15004 leader_election.cc:304] T cc6f522768894933b21bc94b41605166 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dbc2c92e49e346b5b3bd7705a229afc6, eaa34beb1b274443b1c46839afd0a484; no voters: 9cb8de0701f2482b99e51d5ac080aa13
I20260709 14:54:17.113862 15311 tablet_bootstrap.cc:492] T f389b12c6b304243905f28267dfaeed0 P eaa34beb1b274443b1c46839afd0a484: Bootstrap starting.
I20260709 14:54:17.117038 15458 raft_consensus.cc:2804] T d86dfc13b2834d7e8b2ad5f975f08154 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:54:17.121649 15458 raft_consensus.cc:493] T d86dfc13b2834d7e8b2ad5f975f08154 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:54:17.125768 15458 raft_consensus.cc:3060] T d86dfc13b2834d7e8b2ad5f975f08154 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Advancing to term 1
W20260709 14:54:17.130462 15150 leader_election.cc:343] T 6b5bb32eee204f2b90b1f1f14875c579 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:17.131247 15150 leader_election.cc:304] T 6b5bb32eee204f2b90b1f1f14875c579 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa34beb1b274443b1c46839afd0a484; no voters: 7519e608fbb44d9db8ad30b9f10ae605, 9cb8de0701f2482b99e51d5ac080aa13
I20260709 14:54:17.105837 15499 leader_election.cc:290] T d86dfc13b2834d7e8b2ad5f975f08154 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805), 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493)
I20260709 14:54:17.133996 15466 raft_consensus.cc:2749] T 6b5bb32eee204f2b90b1f1f14875c579 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:54:17.149026 15259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86dfc13b2834d7e8b2ad5f975f08154" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13" is_pre_election: true
W20260709 14:54:17.102727 15079 leader_election.cc:343] T f389b12c6b304243905f28267dfaeed0 P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805): Illegal state: must be running to vote when last-logged opid is not known
W20260709 14:54:17.150336 15079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:33805, user_credentials={real_user=slave}} blocked reactor thread for 49625.7us
I20260709 14:54:17.164220 15311 tablet_bootstrap.cc:654] T f389b12c6b304243905f28267dfaeed0 P eaa34beb1b274443b1c46839afd0a484: Neither blocks nor log segments found. Creating new log.
W20260709 14:54:17.166584 15079 leader_election.cc:343] T f389b12c6b304243905f28267dfaeed0 P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:17.167379 15079 leader_election.cc:304] T f389b12c6b304243905f28267dfaeed0 P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7519e608fbb44d9db8ad30b9f10ae605; no voters: dbc2c92e49e346b5b3bd7705a229afc6, eaa34beb1b274443b1c46839afd0a484
I20260709 14:54:17.168578 15307 tablet_bootstrap.cc:492] T a1075567fc91458ca7cc9977cf02b170 P 9cb8de0701f2482b99e51d5ac080aa13: No bootstrap required, opened a new log
I20260709 14:54:17.170109 15307 ts_tablet_manager.cc:1403] T a1075567fc91458ca7cc9977cf02b170 P 9cb8de0701f2482b99e51d5ac080aa13: Time spent bootstrapping tablet: real 0.153s	user 0.025s	sys 0.040s
I20260709 14:54:17.173920 15432 raft_consensus.cc:2749] T f389b12c6b304243905f28267dfaeed0 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:54:17.174659 15351 consensus_queue.cc:1048] T f8b33962eab84819b17953e44eae71a1 P 7519e608fbb44d9db8ad30b9f10ae605 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:54:17.183524 15351 consensus_queue.cc:1048] T f8b33962eab84819b17953e44eae71a1 P 7519e608fbb44d9db8ad30b9f10ae605 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:54:17.151805 15459 raft_consensus.cc:2804] T cc6f522768894933b21bc94b41605166 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:54:17.192196 15309 tablet_bootstrap.cc:654] T ca2aa2e1a8c646069cb8b23b0ebdb0c7 P 7519e608fbb44d9db8ad30b9f10ae605: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:17.219808 15307 raft_consensus.cc:359] T a1075567fc91458ca7cc9977cf02b170 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:17.221101 15307 raft_consensus.cc:385] T a1075567fc91458ca7cc9977cf02b170 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:17.221726 15307 raft_consensus.cc:740] T a1075567fc91458ca7cc9977cf02b170 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9cb8de0701f2482b99e51d5ac080aa13, State: Initialized, Role: FOLLOWER
I20260709 14:54:17.231402 15306 raft_consensus.cc:359] T 1159198eabeb409996ccbec0cac057f8 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:17.235805 15306 raft_consensus.cc:385] T 1159198eabeb409996ccbec0cac057f8 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:17.235337 15307 consensus_queue.cc:260] T a1075567fc91458ca7cc9977cf02b170 P 9cb8de0701f2482b99e51d5ac080aa13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:17.236399 15306 raft_consensus.cc:740] T 1159198eabeb409996ccbec0cac057f8 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbc2c92e49e346b5b3bd7705a229afc6, State: Initialized, Role: FOLLOWER
I20260709 14:54:17.237289 15306 consensus_queue.cc:260] T 1159198eabeb409996ccbec0cac057f8 P dbc2c92e49e346b5b3bd7705a229afc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:17.211836 15459 raft_consensus.cc:697] T cc6f522768894933b21bc94b41605166 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 LEADER]: Becoming Leader. State: Replica: dbc2c92e49e346b5b3bd7705a229afc6, State: Running, Role: LEADER
I20260709 14:54:17.210968 15430 raft_consensus.cc:493] T 5f5dbc86fc8f4ae5b77e0f23adfcd593 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:54:17.232324 15001 leader_election.cc:343] T d86dfc13b2834d7e8b2ad5f975f08154 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:17.257671 15430 raft_consensus.cc:515] T 5f5dbc86fc8f4ae5b77e0f23adfcd593 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:17.260730 15430 leader_election.cc:290] T 5f5dbc86fc8f4ae5b77e0f23adfcd593 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477), 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177)
I20260709 14:54:17.262142 15459 consensus_queue.cc:237] T cc6f522768894933b21bc94b41605166 P dbc2c92e49e346b5b3bd7705a229afc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:17.268447 15306 ts_tablet_manager.cc:1434] T 1159198eabeb409996ccbec0cac057f8 P dbc2c92e49e346b5b3bd7705a229afc6: Time spent starting tablet: real 0.205s	user 0.010s	sys 0.001s
I20260709 14:54:17.273931 15307 ts_tablet_manager.cc:1434] T a1075567fc91458ca7cc9977cf02b170 P 9cb8de0701f2482b99e51d5ac080aa13: Time spent starting tablet: real 0.103s	user 0.010s	sys 0.002s
I20260709 14:54:17.274580 15113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5dbc86fc8f4ae5b77e0f23adfcd593" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605" is_pre_election: true
W20260709 14:54:17.276844 15150 leader_election.cc:343] T 5f5dbc86fc8f4ae5b77e0f23adfcd593 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:17.280382 15307 tablet_bootstrap.cc:492] T cc6f522768894933b21bc94b41605166 P 9cb8de0701f2482b99e51d5ac080aa13: Bootstrap starting.
I20260709 14:54:17.304410 15306 tablet_bootstrap.cc:492] T 42d6909533d14edbbfdad30a9972658d P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap starting.
I20260709 14:54:17.304610 15458 raft_consensus.cc:515] T d86dfc13b2834d7e8b2ad5f975f08154 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
W20260709 14:54:17.318421 15001 consensus_peers.cc:597] T d61f9ecebc3c4a028f5327bc9debf432 P dbc2c92e49e346b5b3bd7705a229afc6 -> Peer 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177): Couldn't send request to peer 7519e608fbb44d9db8ad30b9f10ae605. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:54:17.350394 15309 tablet_bootstrap.cc:492] T ca2aa2e1a8c646069cb8b23b0ebdb0c7 P 7519e608fbb44d9db8ad30b9f10ae605: No bootstrap required, opened a new log
I20260709 14:54:17.351919 15309 ts_tablet_manager.cc:1403] T ca2aa2e1a8c646069cb8b23b0ebdb0c7 P 7519e608fbb44d9db8ad30b9f10ae605: Time spent bootstrapping tablet: real 0.380s	user 0.015s	sys 0.008s
I20260709 14:54:17.353935 15306 tablet_bootstrap.cc:654] T 42d6909533d14edbbfdad30a9972658d P dbc2c92e49e346b5b3bd7705a229afc6: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:17.356379 15309 raft_consensus.cc:359] T ca2aa2e1a8c646069cb8b23b0ebdb0c7 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:17.357420 15309 raft_consensus.cc:385] T ca2aa2e1a8c646069cb8b23b0ebdb0c7 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:17.357836 15309 raft_consensus.cc:740] T ca2aa2e1a8c646069cb8b23b0ebdb0c7 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7519e608fbb44d9db8ad30b9f10ae605, State: Initialized, Role: FOLLOWER
I20260709 14:54:17.358826 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5dbc86fc8f4ae5b77e0f23adfcd593" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" is_pre_election: true
I20260709 14:54:17.358824 15309 consensus_queue.cc:260] T ca2aa2e1a8c646069cb8b23b0ebdb0c7 P 7519e608fbb44d9db8ad30b9f10ae605 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:17.360425 15307 tablet_bootstrap.cc:654] T cc6f522768894933b21bc94b41605166 P 9cb8de0701f2482b99e51d5ac080aa13: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:17.362661 15309 ts_tablet_manager.cc:1434] T ca2aa2e1a8c646069cb8b23b0ebdb0c7 P 7519e608fbb44d9db8ad30b9f10ae605: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.004s
I20260709 14:54:17.359787 15037 raft_consensus.cc:2468] T 5f5dbc86fc8f4ae5b77e0f23adfcd593 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa34beb1b274443b1c46839afd0a484 in term 0.
I20260709 14:54:17.371078 15184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86dfc13b2834d7e8b2ad5f975f08154" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484"
I20260709 14:54:17.380560 15311 tablet_bootstrap.cc:492] T f389b12c6b304243905f28267dfaeed0 P eaa34beb1b274443b1c46839afd0a484: No bootstrap required, opened a new log
I20260709 14:54:17.381762 15261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86dfc13b2834d7e8b2ad5f975f08154" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13"
I20260709 14:54:17.381763 15153 leader_election.cc:304] T 5f5dbc86fc8f4ae5b77e0f23adfcd593 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dbc2c92e49e346b5b3bd7705a229afc6, eaa34beb1b274443b1c46839afd0a484; no voters: 7519e608fbb44d9db8ad30b9f10ae605
I20260709 14:54:17.384935 15516 raft_consensus.cc:2804] T 5f5dbc86fc8f4ae5b77e0f23adfcd593 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:54:17.385792 15516 raft_consensus.cc:493] T 5f5dbc86fc8f4ae5b77e0f23adfcd593 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:54:17.386155 15516 raft_consensus.cc:3060] T 5f5dbc86fc8f4ae5b77e0f23adfcd593 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:17.388147 15458 leader_election.cc:290] T d86dfc13b2834d7e8b2ad5f975f08154 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 election: Requested vote from peers eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805), 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493)
W20260709 14:54:17.389595 15001 leader_election.cc:343] T d86dfc13b2834d7e8b2ad5f975f08154 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:17.392333 15492 consensus_queue.cc:1048] T 966a06ab56a6479283ab2818c9439d4f P 7519e608fbb44d9db8ad30b9f10ae605 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:54:17.393060 15499 raft_consensus.cc:493] T 1159198eabeb409996ccbec0cac057f8 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:17.394539 15499 raft_consensus.cc:515] T 1159198eabeb409996ccbec0cac057f8 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:17.379995 15184 raft_consensus.cc:3060] T d86dfc13b2834d7e8b2ad5f975f08154 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Advancing to term 1
W20260709 14:54:17.401178 14984 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 14:54:17.402237 15261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1159198eabeb409996ccbec0cac057f8" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13" is_pre_election: true
I20260709 14:54:17.407397 15306 tablet_bootstrap.cc:492] T 42d6909533d14edbbfdad30a9972658d P dbc2c92e49e346b5b3bd7705a229afc6: No bootstrap required, opened a new log
I20260709 14:54:17.408244 15306 ts_tablet_manager.cc:1403] T 42d6909533d14edbbfdad30a9972658d P dbc2c92e49e346b5b3bd7705a229afc6: Time spent bootstrapping tablet: real 0.122s	user 0.014s	sys 0.018s
W20260709 14:54:17.410857 15001 leader_election.cc:343] T 1159198eabeb409996ccbec0cac057f8 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:17.381424 15311 ts_tablet_manager.cc:1403] T f389b12c6b304243905f28267dfaeed0 P eaa34beb1b274443b1c46839afd0a484: Time spent bootstrapping tablet: real 0.268s	user 0.029s	sys 0.029s
I20260709 14:54:17.415659 15309 tablet_bootstrap.cc:492] T 5f5dbc86fc8f4ae5b77e0f23adfcd593 P 7519e608fbb44d9db8ad30b9f10ae605: Bootstrap starting.
I20260709 14:54:17.416949 15306 raft_consensus.cc:359] T 42d6909533d14edbbfdad30a9972658d P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:17.418025 15306 raft_consensus.cc:385] T 42d6909533d14edbbfdad30a9972658d P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:17.419308 15110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1159198eabeb409996ccbec0cac057f8" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605" is_pre_election: true
I20260709 14:54:17.420826 14932 catalog_manager.cc:5697] T 966a06ab56a6479283ab2818c9439d4f P 7519e608fbb44d9db8ad30b9f10ae605 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66). New cstate: current_term: 1 leader_uuid: "7519e608fbb44d9db8ad30b9f10ae605" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } health_report { overall_health: UNKNOWN } } }
W20260709 14:54:17.422427 15001 leader_election.cc:343] T 1159198eabeb409996ccbec0cac057f8 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:17.423151 15001 leader_election.cc:304] T 1159198eabeb409996ccbec0cac057f8 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbc2c92e49e346b5b3bd7705a229afc6; no voters: 7519e608fbb44d9db8ad30b9f10ae605, 9cb8de0701f2482b99e51d5ac080aa13
I20260709 14:54:17.424064 15458 raft_consensus.cc:2749] T 1159198eabeb409996ccbec0cac057f8 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:54:17.427527 15499 leader_election.cc:290] T 1159198eabeb409996ccbec0cac057f8 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493), 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177)
I20260709 14:54:17.435936 15309 tablet_bootstrap.cc:654] T 5f5dbc86fc8f4ae5b77e0f23adfcd593 P 7519e608fbb44d9db8ad30b9f10ae605: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:17.443703 15346 raft_consensus.cc:493] T ca2aa2e1a8c646069cb8b23b0ebdb0c7 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:17.444734 15346 raft_consensus.cc:515] T ca2aa2e1a8c646069cb8b23b0ebdb0c7 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:17.448354 15113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2aa2e1a8c646069cb8b23b0ebdb0c7" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605" is_pre_election: true
I20260709 14:54:17.449568 15113 raft_consensus.cc:2468] T ca2aa2e1a8c646069cb8b23b0ebdb0c7 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cb8de0701f2482b99e51d5ac080aa13 in term 0.
I20260709 14:54:17.451392 15224 leader_election.cc:304] T ca2aa2e1a8c646069cb8b23b0ebdb0c7 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7519e608fbb44d9db8ad30b9f10ae605, 9cb8de0701f2482b99e51d5ac080aa13; no voters: 
I20260709 14:54:17.453161 15346 leader_election.cc:290] T ca2aa2e1a8c646069cb8b23b0ebdb0c7 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177), eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805)
I20260709 14:54:17.452888 15369 raft_consensus.cc:2804] T ca2aa2e1a8c646069cb8b23b0ebdb0c7 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:54:17.454140 15369 raft_consensus.cc:493] T ca2aa2e1a8c646069cb8b23b0ebdb0c7 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:54:17.454702 15369 raft_consensus.cc:3060] T ca2aa2e1a8c646069cb8b23b0ebdb0c7 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:17.459262 14934 catalog_manager.cc:5697] T cc6f522768894933b21bc94b41605166 P dbc2c92e49e346b5b3bd7705a229afc6 reported cstate change: term changed from 0 to 1, leader changed from <none> to dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65). New cstate: current_term: 1 leader_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } health_report { overall_health: HEALTHY } } }
I20260709 14:54:17.461131 15183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2aa2e1a8c646069cb8b23b0ebdb0c7" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484" is_pre_election: true
I20260709 14:54:17.462276 15516 raft_consensus.cc:515] T 5f5dbc86fc8f4ae5b77e0f23adfcd593 P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
W20260709 14:54:17.463297 15227 leader_election.cc:343] T ca2aa2e1a8c646069cb8b23b0ebdb0c7 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:17.418421 15306 raft_consensus.cc:740] T 42d6909533d14edbbfdad30a9972658d P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbc2c92e49e346b5b3bd7705a229afc6, State: Initialized, Role: FOLLOWER
I20260709 14:54:17.467837 15306 consensus_queue.cc:260] T 42d6909533d14edbbfdad30a9972658d P dbc2c92e49e346b5b3bd7705a229afc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:17.470557 15306 ts_tablet_manager.cc:1434] T 42d6909533d14edbbfdad30a9972658d P dbc2c92e49e346b5b3bd7705a229afc6: Time spent starting tablet: real 0.062s	user 0.007s	sys 0.000s
I20260709 14:54:17.471872 15306 tablet_bootstrap.cc:492] T 9275d24f141d455cb200b9784c470d33 P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap starting.
I20260709 14:54:17.472043 15307 tablet_bootstrap.cc:492] T cc6f522768894933b21bc94b41605166 P 9cb8de0701f2482b99e51d5ac080aa13: No bootstrap required, opened a new log
I20260709 14:54:17.474298 15307 ts_tablet_manager.cc:1403] T cc6f522768894933b21bc94b41605166 P 9cb8de0701f2482b99e51d5ac080aa13: Time spent bootstrapping tablet: real 0.198s	user 0.018s	sys 0.000s
I20260709 14:54:17.502432 15306 tablet_bootstrap.cc:654] T 9275d24f141d455cb200b9784c470d33 P dbc2c92e49e346b5b3bd7705a229afc6: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:17.484758 15311 raft_consensus.cc:359] T f389b12c6b304243905f28267dfaeed0 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:17.505560 15311 raft_consensus.cc:385] T f389b12c6b304243905f28267dfaeed0 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:17.506023 15311 raft_consensus.cc:740] T f389b12c6b304243905f28267dfaeed0 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eaa34beb1b274443b1c46839afd0a484, State: Initialized, Role: FOLLOWER
I20260709 14:54:17.519345 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5dbc86fc8f4ae5b77e0f23adfcd593" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc2c92e49e346b5b3bd7705a229afc6"
I20260709 14:54:17.519630 15307 raft_consensus.cc:359] T cc6f522768894933b21bc94b41605166 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:17.494608 15432 consensus_queue.cc:1048] T 966a06ab56a6479283ab2818c9439d4f P 7519e608fbb44d9db8ad30b9f10ae605 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.026s
I20260709 14:54:17.520377 15037 raft_consensus.cc:3060] T 5f5dbc86fc8f4ae5b77e0f23adfcd593 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:17.521921 15184 raft_consensus.cc:2468] T d86dfc13b2834d7e8b2ad5f975f08154 P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbc2c92e49e346b5b3bd7705a229afc6 in term 1.
I20260709 14:54:17.523754 15004 leader_election.cc:304] T d86dfc13b2834d7e8b2ad5f975f08154 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dbc2c92e49e346b5b3bd7705a229afc6, eaa34beb1b274443b1c46839afd0a484; no voters: 9cb8de0701f2482b99e51d5ac080aa13
I20260709 14:54:17.525141 15458 raft_consensus.cc:493] T 42d6909533d14edbbfdad30a9972658d P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:17.525840 15458 raft_consensus.cc:515] T 42d6909533d14edbbfdad30a9972658d P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:17.519997 15311 consensus_queue.cc:260] T f389b12c6b304243905f28267dfaeed0 P eaa34beb1b274443b1c46839afd0a484 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:17.529812 15307 raft_consensus.cc:385] T cc6f522768894933b21bc94b41605166 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:17.530233 15307 raft_consensus.cc:740] T cc6f522768894933b21bc94b41605166 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9cb8de0701f2482b99e51d5ac080aa13, State: Initialized, Role: FOLLOWER
I20260709 14:54:17.536360 15311 ts_tablet_manager.cc:1434] T f389b12c6b304243905f28267dfaeed0 P eaa34beb1b274443b1c46839afd0a484: Time spent starting tablet: real 0.124s	user 0.009s	sys 0.001s
I20260709 14:54:17.527823 15499 raft_consensus.cc:2804] T d86dfc13b2834d7e8b2ad5f975f08154 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:54:17.538348 15499 raft_consensus.cc:697] T d86dfc13b2834d7e8b2ad5f975f08154 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 LEADER]: Becoming Leader. State: Replica: dbc2c92e49e346b5b3bd7705a229afc6, State: Running, Role: LEADER
I20260709 14:54:17.538611 15311 tablet_bootstrap.cc:492] T ca2aa2e1a8c646069cb8b23b0ebdb0c7 P eaa34beb1b274443b1c46839afd0a484: Bootstrap starting.
I20260709 14:54:17.539422 15499 consensus_queue.cc:237] T d86dfc13b2834d7e8b2ad5f975f08154 P dbc2c92e49e346b5b3bd7705a229afc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:17.548519 15307 consensus_queue.cc:260] T cc6f522768894933b21bc94b41605166 P 9cb8de0701f2482b99e51d5ac080aa13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:17.556612 15309 tablet_bootstrap.cc:492] T 5f5dbc86fc8f4ae5b77e0f23adfcd593 P 7519e608fbb44d9db8ad30b9f10ae605: No bootstrap required, opened a new log
I20260709 14:54:17.487340 15369 raft_consensus.cc:515] T ca2aa2e1a8c646069cb8b23b0ebdb0c7 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:17.557173 15309 ts_tablet_manager.cc:1403] T 5f5dbc86fc8f4ae5b77e0f23adfcd593 P 7519e608fbb44d9db8ad30b9f10ae605: Time spent bootstrapping tablet: real 0.142s	user 0.051s	sys 0.060s
I20260709 14:54:17.558487 15307 ts_tablet_manager.cc:1434] T cc6f522768894933b21bc94b41605166 P 9cb8de0701f2482b99e51d5ac080aa13: Time spent starting tablet: real 0.059s	user 0.011s	sys 0.001s
I20260709 14:54:17.566138 15307 tablet_bootstrap.cc:492] T d86dfc13b2834d7e8b2ad5f975f08154 P 9cb8de0701f2482b99e51d5ac080aa13: Bootstrap starting.
I20260709 14:54:17.564474 15434 raft_consensus.cc:493] T a1075567fc91458ca7cc9977cf02b170 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:17.571710 15434 raft_consensus.cc:515] T a1075567fc91458ca7cc9977cf02b170 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:17.572311 15369 leader_election.cc:290] T ca2aa2e1a8c646069cb8b23b0ebdb0c7 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 election: Requested vote from peers 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177), eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805)
I20260709 14:54:17.574872 15113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2aa2e1a8c646069cb8b23b0ebdb0c7" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605"
I20260709 14:54:17.575621 15113 raft_consensus.cc:3060] T ca2aa2e1a8c646069cb8b23b0ebdb0c7 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:17.576246 15458 leader_election.cc:290] T 42d6909533d14edbbfdad30a9972658d P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805), 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493)
I20260709 14:54:17.577113 15516 leader_election.cc:290] T 5f5dbc86fc8f4ae5b77e0f23adfcd593 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 election: Requested vote from peers dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477), 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177)
I20260709 14:54:17.589337 15306 tablet_bootstrap.cc:492] T 9275d24f141d455cb200b9784c470d33 P dbc2c92e49e346b5b3bd7705a229afc6: No bootstrap required, opened a new log
I20260709 14:54:17.590385 15306 ts_tablet_manager.cc:1403] T 9275d24f141d455cb200b9784c470d33 P dbc2c92e49e346b5b3bd7705a229afc6: Time spent bootstrapping tablet: real 0.119s	user 0.036s	sys 0.003s
I20260709 14:54:17.574149 15434 leader_election.cc:290] T a1075567fc91458ca7cc9977cf02b170 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477), 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177)
I20260709 14:54:17.582278 15184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d6909533d14edbbfdad30a9972658d" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484" is_pre_election: true
W20260709 14:54:17.604218 15004 leader_election.cc:343] T 42d6909533d14edbbfdad30a9972658d P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:17.605436 15110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1075567fc91458ca7cc9977cf02b170" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605" is_pre_election: true
I20260709 14:54:17.610199 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1075567fc91458ca7cc9977cf02b170" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" is_pre_election: true
I20260709 14:54:17.611678 15035 raft_consensus.cc:2468] T a1075567fc91458ca7cc9977cf02b170 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cb8de0701f2482b99e51d5ac080aa13 in term 0.
I20260709 14:54:17.611788 15260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d6909533d14edbbfdad30a9972658d" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13" is_pre_election: true
I20260709 14:54:17.612244 15185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2aa2e1a8c646069cb8b23b0ebdb0c7" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484"
W20260709 14:54:17.611830 15224 leader_election.cc:343] T a1075567fc91458ca7cc9977cf02b170 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177): Illegal state: must be running to vote when last-logged opid is not known
W20260709 14:54:17.614209 15001 leader_election.cc:343] T 42d6909533d14edbbfdad30a9972658d P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:17.614768 15001 leader_election.cc:304] T 42d6909533d14edbbfdad30a9972658d P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbc2c92e49e346b5b3bd7705a229afc6; no voters: 9cb8de0701f2482b99e51d5ac080aa13, eaa34beb1b274443b1c46839afd0a484
W20260709 14:54:17.614143 15227 leader_election.cc:343] T ca2aa2e1a8c646069cb8b23b0ebdb0c7 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:17.616514 15459 raft_consensus.cc:2749] T 42d6909533d14edbbfdad30a9972658d P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:54:17.616895 15110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5dbc86fc8f4ae5b77e0f23adfcd593" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605"
I20260709 14:54:17.622895 15307 tablet_bootstrap.cc:654] T d86dfc13b2834d7e8b2ad5f975f08154 P 9cb8de0701f2482b99e51d5ac080aa13: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:17.620527 15309 raft_consensus.cc:359] T 5f5dbc86fc8f4ae5b77e0f23adfcd593 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:17.623584 15309 raft_consensus.cc:385] T 5f5dbc86fc8f4ae5b77e0f23adfcd593 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:17.623916 15309 raft_consensus.cc:740] T 5f5dbc86fc8f4ae5b77e0f23adfcd593 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7519e608fbb44d9db8ad30b9f10ae605, State: Initialized, Role: FOLLOWER
I20260709 14:54:17.624809 15309 consensus_queue.cc:260] T 5f5dbc86fc8f4ae5b77e0f23adfcd593 P 7519e608fbb44d9db8ad30b9f10ae605 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:17.630558 15110 raft_consensus.cc:3060] T 5f5dbc86fc8f4ae5b77e0f23adfcd593 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:17.641812 15311 tablet_bootstrap.cc:654] T ca2aa2e1a8c646069cb8b23b0ebdb0c7 P eaa34beb1b274443b1c46839afd0a484: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:17.644340 15227 leader_election.cc:304] T a1075567fc91458ca7cc9977cf02b170 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9cb8de0701f2482b99e51d5ac080aa13, dbc2c92e49e346b5b3bd7705a229afc6; no voters: 7519e608fbb44d9db8ad30b9f10ae605
I20260709 14:54:17.646011 15346 raft_consensus.cc:2804] T a1075567fc91458ca7cc9977cf02b170 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:54:17.646435 15346 raft_consensus.cc:493] T a1075567fc91458ca7cc9977cf02b170 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:54:17.646773 15346 raft_consensus.cc:3060] T a1075567fc91458ca7cc9977cf02b170 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:17.649041 15037 raft_consensus.cc:2468] T 5f5dbc86fc8f4ae5b77e0f23adfcd593 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa34beb1b274443b1c46839afd0a484 in term 1.
I20260709 14:54:17.651953 15153 leader_election.cc:304] T 5f5dbc86fc8f4ae5b77e0f23adfcd593 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dbc2c92e49e346b5b3bd7705a229afc6, eaa34beb1b274443b1c46839afd0a484; no voters: 
I20260709 14:54:17.653769 15516 raft_consensus.cc:2804] T 5f5dbc86fc8f4ae5b77e0f23adfcd593 P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:54:17.654953 15516 raft_consensus.cc:697] T 5f5dbc86fc8f4ae5b77e0f23adfcd593 P eaa34beb1b274443b1c46839afd0a484 [term 1 LEADER]: Becoming Leader. State: Replica: eaa34beb1b274443b1c46839afd0a484, State: Running, Role: LEADER
I20260709 14:54:17.656296 15516 consensus_queue.cc:237] T 5f5dbc86fc8f4ae5b77e0f23adfcd593 P eaa34beb1b274443b1c46839afd0a484 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:17.661340 15306 raft_consensus.cc:359] T 9275d24f141d455cb200b9784c470d33 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:17.664660 15306 raft_consensus.cc:385] T 9275d24f141d455cb200b9784c470d33 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:17.663546 14934 catalog_manager.cc:5697] T d86dfc13b2834d7e8b2ad5f975f08154 P dbc2c92e49e346b5b3bd7705a229afc6 reported cstate change: term changed from 0 to 1, leader changed from <none> to dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65). New cstate: current_term: 1 leader_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } health_report { overall_health: HEALTHY } } }
I20260709 14:54:17.674407 15499 consensus_queue.cc:1048] T cc6f522768894933b21bc94b41605166 P dbc2c92e49e346b5b3bd7705a229afc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:54:17.665316 15306 raft_consensus.cc:740] T 9275d24f141d455cb200b9784c470d33 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbc2c92e49e346b5b3bd7705a229afc6, State: Initialized, Role: FOLLOWER
I20260709 14:54:17.684581 15306 consensus_queue.cc:260] T 9275d24f141d455cb200b9784c470d33 P dbc2c92e49e346b5b3bd7705a229afc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:17.659452 15113 raft_consensus.cc:2468] T ca2aa2e1a8c646069cb8b23b0ebdb0c7 P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cb8de0701f2482b99e51d5ac080aa13 in term 1.
I20260709 14:54:17.693173 15521 raft_consensus.cc:493] T f389b12c6b304243905f28267dfaeed0 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:17.693671 15224 leader_election.cc:304] T ca2aa2e1a8c646069cb8b23b0ebdb0c7 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7519e608fbb44d9db8ad30b9f10ae605, 9cb8de0701f2482b99e51d5ac080aa13; no voters: eaa34beb1b274443b1c46839afd0a484
I20260709 14:54:17.692785 15346 raft_consensus.cc:515] T a1075567fc91458ca7cc9977cf02b170 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:17.698856 15434 raft_consensus.cc:2804] T ca2aa2e1a8c646069cb8b23b0ebdb0c7 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:54:17.699525 15434 raft_consensus.cc:697] T ca2aa2e1a8c646069cb8b23b0ebdb0c7 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 LEADER]: Becoming Leader. State: Replica: 9cb8de0701f2482b99e51d5ac080aa13, State: Running, Role: LEADER
I20260709 14:54:17.701303 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1075567fc91458ca7cc9977cf02b170" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc2c92e49e346b5b3bd7705a229afc6"
I20260709 14:54:17.696041 15521 raft_consensus.cc:515] T f389b12c6b304243905f28267dfaeed0 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:17.715270 15521 leader_election.cc:290] T f389b12c6b304243905f28267dfaeed0 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477), 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177)
I20260709 14:54:17.716048 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f389b12c6b304243905f28267dfaeed0" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" is_pre_election: true
I20260709 14:54:17.700510 15434 consensus_queue.cc:237] T ca2aa2e1a8c646069cb8b23b0ebdb0c7 P 9cb8de0701f2482b99e51d5ac080aa13 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:17.697423 15306 ts_tablet_manager.cc:1434] T 9275d24f141d455cb200b9784c470d33 P dbc2c92e49e346b5b3bd7705a229afc6: Time spent starting tablet: real 0.107s	user 0.011s	sys 0.000s
I20260709 14:54:17.716315 14935 catalog_manager.cc:5697] T 5f5dbc86fc8f4ae5b77e0f23adfcd593 P eaa34beb1b274443b1c46839afd0a484 reported cstate change: term changed from 0 to 1, leader changed from <none> to eaa34beb1b274443b1c46839afd0a484 (127.6.101.67). New cstate: current_term: 1 leader_uuid: "eaa34beb1b274443b1c46839afd0a484" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } health_report { overall_health: HEALTHY } } }
I20260709 14:54:17.727859 15306 tablet_bootstrap.cc:492] T f389b12c6b304243905f28267dfaeed0 P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap starting.
I20260709 14:54:17.721393 15037 raft_consensus.cc:3060] T a1075567fc91458ca7cc9977cf02b170 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:17.717526 15113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f389b12c6b304243905f28267dfaeed0" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605" is_pre_election: true
I20260709 14:54:17.691144 15110 raft_consensus.cc:2468] T 5f5dbc86fc8f4ae5b77e0f23adfcd593 P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa34beb1b274443b1c46839afd0a484 in term 1.
I20260709 14:54:17.734879 15113 raft_consensus.cc:2468] T f389b12c6b304243905f28267dfaeed0 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa34beb1b274443b1c46839afd0a484 in term 0.
I20260709 14:54:17.737357 15150 leader_election.cc:304] T f389b12c6b304243905f28267dfaeed0 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7519e608fbb44d9db8ad30b9f10ae605, eaa34beb1b274443b1c46839afd0a484; no voters: 
I20260709 14:54:17.738885 15521 raft_consensus.cc:2804] T f389b12c6b304243905f28267dfaeed0 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:54:17.739408 15521 raft_consensus.cc:493] T f389b12c6b304243905f28267dfaeed0 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:54:17.739780 15521 raft_consensus.cc:3060] T f389b12c6b304243905f28267dfaeed0 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:17.741652 15309 ts_tablet_manager.cc:1434] T 5f5dbc86fc8f4ae5b77e0f23adfcd593 P 7519e608fbb44d9db8ad30b9f10ae605: Time spent starting tablet: real 0.183s	user 0.012s	sys 0.000s
I20260709 14:54:17.742936 15309 tablet_bootstrap.cc:492] T 9275d24f141d455cb200b9784c470d33 P 7519e608fbb44d9db8ad30b9f10ae605: Bootstrap starting.
I20260709 14:54:17.726307 15346 leader_election.cc:290] T a1075567fc91458ca7cc9977cf02b170 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 election: Requested vote from peers dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477), 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177)
I20260709 14:54:17.771965 15260 raft_consensus.cc:3060] T cc6f522768894933b21bc94b41605166 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:17.777531 15110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1075567fc91458ca7cc9977cf02b170" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605"
I20260709 14:54:17.779115 15311 tablet_bootstrap.cc:492] T ca2aa2e1a8c646069cb8b23b0ebdb0c7 P eaa34beb1b274443b1c46839afd0a484: No bootstrap required, opened a new log
I20260709 14:54:17.779783 15311 ts_tablet_manager.cc:1403] T ca2aa2e1a8c646069cb8b23b0ebdb0c7 P eaa34beb1b274443b1c46839afd0a484: Time spent bootstrapping tablet: real 0.242s	user 0.016s	sys 0.003s
W20260709 14:54:17.780918 15153 leader_election.cc:343] T f389b12c6b304243905f28267dfaeed0 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:17.783034 15311 raft_consensus.cc:359] T ca2aa2e1a8c646069cb8b23b0ebdb0c7 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:17.784288 15311 raft_consensus.cc:385] T ca2aa2e1a8c646069cb8b23b0ebdb0c7 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:17.784713 15311 raft_consensus.cc:740] T ca2aa2e1a8c646069cb8b23b0ebdb0c7 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eaa34beb1b274443b1c46839afd0a484, State: Initialized, Role: FOLLOWER
W20260709 14:54:17.787982 15224 leader_election.cc:343] T a1075567fc91458ca7cc9977cf02b170 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:17.792429 15309 tablet_bootstrap.cc:654] T 9275d24f141d455cb200b9784c470d33 P 7519e608fbb44d9db8ad30b9f10ae605: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:17.797294 15307 tablet_bootstrap.cc:492] T d86dfc13b2834d7e8b2ad5f975f08154 P 9cb8de0701f2482b99e51d5ac080aa13: No bootstrap required, opened a new log
I20260709 14:54:17.800236 15307 ts_tablet_manager.cc:1403] T d86dfc13b2834d7e8b2ad5f975f08154 P 9cb8de0701f2482b99e51d5ac080aa13: Time spent bootstrapping tablet: real 0.234s	user 0.026s	sys 0.021s
I20260709 14:54:17.801613 15311 consensus_queue.cc:260] T ca2aa2e1a8c646069cb8b23b0ebdb0c7 P eaa34beb1b274443b1c46839afd0a484 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:17.816016 15307 raft_consensus.cc:359] T d86dfc13b2834d7e8b2ad5f975f08154 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:17.817437 15307 raft_consensus.cc:385] T d86dfc13b2834d7e8b2ad5f975f08154 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:17.817893 15307 raft_consensus.cc:740] T d86dfc13b2834d7e8b2ad5f975f08154 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9cb8de0701f2482b99e51d5ac080aa13, State: Initialized, Role: FOLLOWER
I20260709 14:54:17.819139 15307 consensus_queue.cc:260] T d86dfc13b2834d7e8b2ad5f975f08154 P 9cb8de0701f2482b99e51d5ac080aa13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:17.825508 15521 raft_consensus.cc:515] T f389b12c6b304243905f28267dfaeed0 P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:17.827353 15307 ts_tablet_manager.cc:1434] T d86dfc13b2834d7e8b2ad5f975f08154 P 9cb8de0701f2482b99e51d5ac080aa13: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.001s
I20260709 14:54:17.819880 15306 tablet_bootstrap.cc:654] T f389b12c6b304243905f28267dfaeed0 P dbc2c92e49e346b5b3bd7705a229afc6: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:17.827593 15311 ts_tablet_manager.cc:1434] T ca2aa2e1a8c646069cb8b23b0ebdb0c7 P eaa34beb1b274443b1c46839afd0a484: Time spent starting tablet: real 0.047s	user 0.009s	sys 0.001s
I20260709 14:54:17.830682 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f389b12c6b304243905f28267dfaeed0" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc2c92e49e346b5b3bd7705a229afc6"
I20260709 14:54:17.832051 15458 consensus_queue.cc:1048] T cc6f522768894933b21bc94b41605166 P dbc2c92e49e346b5b3bd7705a229afc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 14:54:17.833434 15153 leader_election.cc:343] T f389b12c6b304243905f28267dfaeed0 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:17.834157 15309 tablet_bootstrap.cc:492] T 9275d24f141d455cb200b9784c470d33 P 7519e608fbb44d9db8ad30b9f10ae605: No bootstrap required, opened a new log
I20260709 14:54:17.835055 15309 ts_tablet_manager.cc:1403] T 9275d24f141d455cb200b9784c470d33 P 7519e608fbb44d9db8ad30b9f10ae605: Time spent bootstrapping tablet: real 0.092s	user 0.019s	sys 0.004s
I20260709 14:54:17.832772 15307 tablet_bootstrap.cc:492] T 6b5bb32eee204f2b90b1f1f14875c579 P 9cb8de0701f2482b99e51d5ac080aa13: Bootstrap starting.
I20260709 14:54:17.837771 15037 raft_consensus.cc:2468] T a1075567fc91458ca7cc9977cf02b170 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cb8de0701f2482b99e51d5ac080aa13 in term 1.
I20260709 14:54:17.840081 15227 leader_election.cc:304] T a1075567fc91458ca7cc9977cf02b170 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9cb8de0701f2482b99e51d5ac080aa13, dbc2c92e49e346b5b3bd7705a229afc6; no voters: 7519e608fbb44d9db8ad30b9f10ae605
I20260709 14:54:17.840905 15309 raft_consensus.cc:359] T 9275d24f141d455cb200b9784c470d33 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:17.841801 15309 raft_consensus.cc:385] T 9275d24f141d455cb200b9784c470d33 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:17.842065 15309 raft_consensus.cc:740] T 9275d24f141d455cb200b9784c470d33 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7519e608fbb44d9db8ad30b9f10ae605, State: Initialized, Role: FOLLOWER
I20260709 14:54:17.842849 15309 consensus_queue.cc:260] T 9275d24f141d455cb200b9784c470d33 P 7519e608fbb44d9db8ad30b9f10ae605 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:17.847016 14933 catalog_manager.cc:5697] T ca2aa2e1a8c646069cb8b23b0ebdb0c7 P 9cb8de0701f2482b99e51d5ac080aa13 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68). New cstate: current_term: 1 leader_uuid: "9cb8de0701f2482b99e51d5ac080aa13" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } health_report { overall_health: HEALTHY } } }
I20260709 14:54:17.848635 15434 raft_consensus.cc:2804] T a1075567fc91458ca7cc9977cf02b170 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:54:17.850122 15434 raft_consensus.cc:697] T a1075567fc91458ca7cc9977cf02b170 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 LEADER]: Becoming Leader. State: Replica: 9cb8de0701f2482b99e51d5ac080aa13, State: Running, Role: LEADER
I20260709 14:54:17.851846 15307 tablet_bootstrap.cc:654] T 6b5bb32eee204f2b90b1f1f14875c579 P 9cb8de0701f2482b99e51d5ac080aa13: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:17.845315 15311 tablet_bootstrap.cc:492] T 42d6909533d14edbbfdad30a9972658d P eaa34beb1b274443b1c46839afd0a484: Bootstrap starting.
I20260709 14:54:17.855396 15110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f389b12c6b304243905f28267dfaeed0" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605"
I20260709 14:54:17.856314 15110 raft_consensus.cc:3060] T f389b12c6b304243905f28267dfaeed0 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:17.868307 15346 raft_consensus.cc:493] T cc6f522768894933b21bc94b41605166 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dbc2c92e49e346b5b3bd7705a229afc6)
I20260709 14:54:17.869184 15346 raft_consensus.cc:515] T cc6f522768894933b21bc94b41605166 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:17.876629 15346 leader_election.cc:290] T cc6f522768894933b21bc94b41605166 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805), dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477)
I20260709 14:54:17.878229 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc6f522768894933b21bc94b41605166" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" is_pre_election: true
I20260709 14:54:17.880555 15309 ts_tablet_manager.cc:1434] T 9275d24f141d455cb200b9784c470d33 P 7519e608fbb44d9db8ad30b9f10ae605: Time spent starting tablet: real 0.045s	user 0.008s	sys 0.002s
I20260709 14:54:17.851334 15434 consensus_queue.cc:237] T a1075567fc91458ca7cc9977cf02b170 P 9cb8de0701f2482b99e51d5ac080aa13 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:17.878978 15521 leader_election.cc:290] T f389b12c6b304243905f28267dfaeed0 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 election: Requested vote from peers dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477), 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177)
I20260709 14:54:17.879531 15185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc6f522768894933b21bc94b41605166" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484" is_pre_election: true
I20260709 14:54:17.881824 15516 raft_consensus.cc:493] T 70bc59fabcdc4359a84d584f36d18d01 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:17.892858 15430 raft_consensus.cc:493] T ca2aa2e1a8c646069cb8b23b0ebdb0c7 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:17.893676 15430 raft_consensus.cc:515] T ca2aa2e1a8c646069cb8b23b0ebdb0c7 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:17.895169 15309 tablet_bootstrap.cc:492] T 70bc59fabcdc4359a84d584f36d18d01 P 7519e608fbb44d9db8ad30b9f10ae605: Bootstrap starting.
I20260709 14:54:17.896422 15430 leader_election.cc:290] T ca2aa2e1a8c646069cb8b23b0ebdb0c7 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177), 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493)
I20260709 14:54:17.900214 15111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2aa2e1a8c646069cb8b23b0ebdb0c7" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605" is_pre_election: true
I20260709 14:54:17.901563 15111 raft_consensus.cc:2393] T ca2aa2e1a8c646069cb8b23b0ebdb0c7 P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eaa34beb1b274443b1c46839afd0a484 in current term 1: Already voted for candidate 9cb8de0701f2482b99e51d5ac080aa13 in this term.
I20260709 14:54:17.901528 15260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2aa2e1a8c646069cb8b23b0ebdb0c7" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13" is_pre_election: true
I20260709 14:54:17.908774 15150 leader_election.cc:304] T ca2aa2e1a8c646069cb8b23b0ebdb0c7 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa34beb1b274443b1c46839afd0a484; no voters: 7519e608fbb44d9db8ad30b9f10ae605, 9cb8de0701f2482b99e51d5ac080aa13
I20260709 14:54:17.910385 15516 raft_consensus.cc:515] T 70bc59fabcdc4359a84d584f36d18d01 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:17.917587 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70bc59fabcdc4359a84d584f36d18d01" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" is_pre_election: true
W20260709 14:54:17.919790 15153 leader_election.cc:343] T 70bc59fabcdc4359a84d584f36d18d01 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:17.923971 15516 leader_election.cc:290] T 70bc59fabcdc4359a84d584f36d18d01 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477), 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177)
I20260709 14:54:17.927224 15516 raft_consensus.cc:3060] T ca2aa2e1a8c646069cb8b23b0ebdb0c7 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:17.884984 15311 tablet_bootstrap.cc:654] T 42d6909533d14edbbfdad30a9972658d P eaa34beb1b274443b1c46839afd0a484: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:17.937224 15110 raft_consensus.cc:2468] T f389b12c6b304243905f28267dfaeed0 P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa34beb1b274443b1c46839afd0a484 in term 1.
I20260709 14:54:17.940451 15111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70bc59fabcdc4359a84d584f36d18d01" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605" is_pre_election: true
I20260709 14:54:17.950342 15306 tablet_bootstrap.cc:492] T f389b12c6b304243905f28267dfaeed0 P dbc2c92e49e346b5b3bd7705a229afc6: No bootstrap required, opened a new log
I20260709 14:54:17.951128 15306 ts_tablet_manager.cc:1403] T f389b12c6b304243905f28267dfaeed0 P dbc2c92e49e346b5b3bd7705a229afc6: Time spent bootstrapping tablet: real 0.223s	user 0.032s	sys 0.009s
I20260709 14:54:17.954758 15516 raft_consensus.cc:2749] T ca2aa2e1a8c646069cb8b23b0ebdb0c7 P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:54:17.955081 15306 raft_consensus.cc:359] T f389b12c6b304243905f28267dfaeed0 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:17.956125 15306 raft_consensus.cc:385] T f389b12c6b304243905f28267dfaeed0 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:17.956432 15306 raft_consensus.cc:740] T f389b12c6b304243905f28267dfaeed0 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbc2c92e49e346b5b3bd7705a229afc6, State: Initialized, Role: FOLLOWER
I20260709 14:54:17.957690 15150 leader_election.cc:304] T f389b12c6b304243905f28267dfaeed0 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7519e608fbb44d9db8ad30b9f10ae605, eaa34beb1b274443b1c46839afd0a484; no voters: dbc2c92e49e346b5b3bd7705a229afc6
I20260709 14:54:17.959183 15307 tablet_bootstrap.cc:492] T 6b5bb32eee204f2b90b1f1f14875c579 P 9cb8de0701f2482b99e51d5ac080aa13: No bootstrap required, opened a new log
I20260709 14:54:17.960150 15309 tablet_bootstrap.cc:654] T 70bc59fabcdc4359a84d584f36d18d01 P 7519e608fbb44d9db8ad30b9f10ae605: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:17.960932 15227 leader_election.cc:304] T cc6f522768894933b21bc94b41605166 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cb8de0701f2482b99e51d5ac080aa13; no voters: dbc2c92e49e346b5b3bd7705a229afc6, eaa34beb1b274443b1c46839afd0a484
I20260709 14:54:17.962224 15545 raft_consensus.cc:2749] T cc6f522768894933b21bc94b41605166 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 14:54:17.963896 15516 raft_consensus.cc:2804] T f389b12c6b304243905f28267dfaeed0 P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:54:17.960039 15307 ts_tablet_manager.cc:1403] T 6b5bb32eee204f2b90b1f1f14875c579 P 9cb8de0701f2482b99e51d5ac080aa13: Time spent bootstrapping tablet: real 0.128s	user 0.020s	sys 0.009s
I20260709 14:54:17.964562 15516 raft_consensus.cc:697] T f389b12c6b304243905f28267dfaeed0 P eaa34beb1b274443b1c46839afd0a484 [term 1 LEADER]: Becoming Leader. State: Replica: eaa34beb1b274443b1c46839afd0a484, State: Running, Role: LEADER
I20260709 14:54:17.965631 15516 consensus_queue.cc:237] T f389b12c6b304243905f28267dfaeed0 P eaa34beb1b274443b1c46839afd0a484 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:17.967438 15306 consensus_queue.cc:260] T f389b12c6b304243905f28267dfaeed0 P dbc2c92e49e346b5b3bd7705a229afc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
W20260709 14:54:17.959334 15150 leader_election.cc:343] T 70bc59fabcdc4359a84d584f36d18d01 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:17.969751 15150 leader_election.cc:304] T 70bc59fabcdc4359a84d584f36d18d01 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa34beb1b274443b1c46839afd0a484; no voters: 7519e608fbb44d9db8ad30b9f10ae605, dbc2c92e49e346b5b3bd7705a229afc6
I20260709 14:54:17.979993 15499 raft_consensus.cc:493] T 9275d24f141d455cb200b9784c470d33 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:17.981489 15521 raft_consensus.cc:2749] T 70bc59fabcdc4359a84d584f36d18d01 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:54:17.980907 15499 raft_consensus.cc:515] T 9275d24f141d455cb200b9784c470d33 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:17.991753 15499 leader_election.cc:290] T 9275d24f141d455cb200b9784c470d33 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493), 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177)
I20260709 14:54:17.992658 15111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275d24f141d455cb200b9784c470d33" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605" is_pre_election: true
I20260709 14:54:17.993608 15111 raft_consensus.cc:2468] T 9275d24f141d455cb200b9784c470d33 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbc2c92e49e346b5b3bd7705a229afc6 in term 0.
I20260709 14:54:17.995398 15001 leader_election.cc:304] T 9275d24f141d455cb200b9784c470d33 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7519e608fbb44d9db8ad30b9f10ae605, dbc2c92e49e346b5b3bd7705a229afc6; no voters: 
I20260709 14:54:17.997788 15458 raft_consensus.cc:2804] T 9275d24f141d455cb200b9784c470d33 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:54:17.997313 15260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275d24f141d455cb200b9784c470d33" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13" is_pre_election: true
I20260709 14:54:17.998313 15458 raft_consensus.cc:493] T 9275d24f141d455cb200b9784c470d33 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:54:17.998721 15458 raft_consensus.cc:3060] T 9275d24f141d455cb200b9784c470d33 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:17.970567 15307 raft_consensus.cc:359] T 6b5bb32eee204f2b90b1f1f14875c579 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:17.999320 15307 raft_consensus.cc:385] T 6b5bb32eee204f2b90b1f1f14875c579 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:17.999668 15307 raft_consensus.cc:740] T 6b5bb32eee204f2b90b1f1f14875c579 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9cb8de0701f2482b99e51d5ac080aa13, State: Initialized, Role: FOLLOWER
I20260709 14:54:18.000332 15309 tablet_bootstrap.cc:492] T 70bc59fabcdc4359a84d584f36d18d01 P 7519e608fbb44d9db8ad30b9f10ae605: No bootstrap required, opened a new log
W20260709 14:54:18.001986 15001 leader_election.cc:343] T 9275d24f141d455cb200b9784c470d33 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:18.001087 15309 ts_tablet_manager.cc:1403] T 70bc59fabcdc4359a84d584f36d18d01 P 7519e608fbb44d9db8ad30b9f10ae605: Time spent bootstrapping tablet: real 0.107s	user 0.008s	sys 0.006s
I20260709 14:54:18.006016 15306 ts_tablet_manager.cc:1434] T f389b12c6b304243905f28267dfaeed0 P dbc2c92e49e346b5b3bd7705a229afc6: Time spent starting tablet: real 0.055s	user 0.009s	sys 0.001s
I20260709 14:54:18.000825 15307 consensus_queue.cc:260] T 6b5bb32eee204f2b90b1f1f14875c579 P 9cb8de0701f2482b99e51d5ac080aa13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:18.007423 15545 raft_consensus.cc:493] T 6b5bb32eee204f2b90b1f1f14875c579 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:18.008020 15545 raft_consensus.cc:515] T 6b5bb32eee204f2b90b1f1f14875c579 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:18.011034 15545 leader_election.cc:290] T 6b5bb32eee204f2b90b1f1f14875c579 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177), eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805)
I20260709 14:54:18.017017 15111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b5bb32eee204f2b90b1f1f14875c579" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605" is_pre_election: true
W20260709 14:54:18.019237 15224 leader_election.cc:343] T 6b5bb32eee204f2b90b1f1f14875c579 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:18.010985 15309 raft_consensus.cc:359] T 70bc59fabcdc4359a84d584f36d18d01 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:18.021145 15309 raft_consensus.cc:385] T 70bc59fabcdc4359a84d584f36d18d01 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:18.021499 15309 raft_consensus.cc:740] T 70bc59fabcdc4359a84d584f36d18d01 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7519e608fbb44d9db8ad30b9f10ae605, State: Initialized, Role: FOLLOWER
I20260709 14:54:17.971452 14935 catalog_manager.cc:5697] T a1075567fc91458ca7cc9977cf02b170 P 9cb8de0701f2482b99e51d5ac080aa13 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68). New cstate: current_term: 1 leader_uuid: "9cb8de0701f2482b99e51d5ac080aa13" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } health_report { overall_health: UNKNOWN } } }
I20260709 14:54:18.024636 15307 ts_tablet_manager.cc:1434] T 6b5bb32eee204f2b90b1f1f14875c579 P 9cb8de0701f2482b99e51d5ac080aa13: Time spent starting tablet: real 0.060s	user 0.007s	sys 0.003s
I20260709 14:54:18.025074 15309 consensus_queue.cc:260] T 70bc59fabcdc4359a84d584f36d18d01 P 7519e608fbb44d9db8ad30b9f10ae605 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:18.025665 15458 raft_consensus.cc:515] T 9275d24f141d455cb200b9784c470d33 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:18.034633 15185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b5bb32eee204f2b90b1f1f14875c579" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484" is_pre_election: true
I20260709 14:54:18.050283 15306 tablet_bootstrap.cc:492] T 70bc59fabcdc4359a84d584f36d18d01 P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap starting.
I20260709 14:54:18.052394 15307 tablet_bootstrap.cc:492] T 1159198eabeb409996ccbec0cac057f8 P 9cb8de0701f2482b99e51d5ac080aa13: Bootstrap starting.
I20260709 14:54:18.052589 15309 ts_tablet_manager.cc:1434] T 70bc59fabcdc4359a84d584f36d18d01 P 7519e608fbb44d9db8ad30b9f10ae605: Time spent starting tablet: real 0.046s	user 0.009s	sys 0.000s
I20260709 14:54:18.061595 15185 raft_consensus.cc:2468] T 6b5bb32eee204f2b90b1f1f14875c579 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cb8de0701f2482b99e51d5ac080aa13 in term 0.
I20260709 14:54:18.071832 15227 leader_election.cc:304] T 6b5bb32eee204f2b90b1f1f14875c579 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9cb8de0701f2482b99e51d5ac080aa13, eaa34beb1b274443b1c46839afd0a484; no voters: 7519e608fbb44d9db8ad30b9f10ae605
I20260709 14:54:18.072258 15458 leader_election.cc:290] T 9275d24f141d455cb200b9784c470d33 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 election: Requested vote from peers 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493), 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177)
I20260709 14:54:18.073486 15545 raft_consensus.cc:2804] T 6b5bb32eee204f2b90b1f1f14875c579 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:54:18.074043 15545 raft_consensus.cc:493] T 6b5bb32eee204f2b90b1f1f14875c579 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:54:18.074440 15545 raft_consensus.cc:3060] T 6b5bb32eee204f2b90b1f1f14875c579 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:18.076103 15458 consensus_queue.cc:1048] T d86dfc13b2834d7e8b2ad5f975f08154 P dbc2c92e49e346b5b3bd7705a229afc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:54:18.085325 15260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275d24f141d455cb200b9784c470d33" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13"
I20260709 14:54:18.093732 15432 raft_consensus.cc:493] T 70bc59fabcdc4359a84d584f36d18d01 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:18.094332 15544 consensus_queue.cc:1048] T 5f5dbc86fc8f4ae5b77e0f23adfcd593 P eaa34beb1b274443b1c46839afd0a484 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:54:18.098305 15521 consensus_queue.cc:1048] T 5f5dbc86fc8f4ae5b77e0f23adfcd593 P eaa34beb1b274443b1c46839afd0a484 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:54:18.099184 15309 tablet_bootstrap.cc:492] T 1159198eabeb409996ccbec0cac057f8 P 7519e608fbb44d9db8ad30b9f10ae605: Bootstrap starting.
I20260709 14:54:18.096607 15432 raft_consensus.cc:515] T 70bc59fabcdc4359a84d584f36d18d01 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:18.108709 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70bc59fabcdc4359a84d584f36d18d01" candidate_uuid: "7519e608fbb44d9db8ad30b9f10ae605" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" is_pre_election: true
W20260709 14:54:18.111204 15079 leader_election.cc:343] T 70bc59fabcdc4359a84d584f36d18d01 P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:18.111979 15432 leader_election.cc:290] T 70bc59fabcdc4359a84d584f36d18d01 P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477), eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805)
W20260709 14:54:18.112495 15001 leader_election.cc:343] T 9275d24f141d455cb200b9784c470d33 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:18.112759 15111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275d24f141d455cb200b9784c470d33" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605"
I20260709 14:54:18.116917 15111 raft_consensus.cc:3060] T 9275d24f141d455cb200b9784c470d33 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:18.114226 15307 tablet_bootstrap.cc:654] T 1159198eabeb409996ccbec0cac057f8 P 9cb8de0701f2482b99e51d5ac080aa13: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:18.114518 15183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70bc59fabcdc4359a84d584f36d18d01" candidate_uuid: "7519e608fbb44d9db8ad30b9f10ae605" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484" is_pre_election: true
I20260709 14:54:18.124825 15183 raft_consensus.cc:2468] T 70bc59fabcdc4359a84d584f36d18d01 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7519e608fbb44d9db8ad30b9f10ae605 in term 0.
I20260709 14:54:18.126830 15079 leader_election.cc:304] T 70bc59fabcdc4359a84d584f36d18d01 P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7519e608fbb44d9db8ad30b9f10ae605, eaa34beb1b274443b1c46839afd0a484; no voters: dbc2c92e49e346b5b3bd7705a229afc6
I20260709 14:54:18.127975 15351 raft_consensus.cc:2804] T 70bc59fabcdc4359a84d584f36d18d01 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:54:18.128440 15351 raft_consensus.cc:493] T 70bc59fabcdc4359a84d584f36d18d01 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:54:18.128770 15351 raft_consensus.cc:3060] T 70bc59fabcdc4359a84d584f36d18d01 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:18.154466 15306 tablet_bootstrap.cc:654] T 70bc59fabcdc4359a84d584f36d18d01 P dbc2c92e49e346b5b3bd7705a229afc6: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:18.158571 15311 tablet_bootstrap.cc:492] T 42d6909533d14edbbfdad30a9972658d P eaa34beb1b274443b1c46839afd0a484: No bootstrap required, opened a new log
I20260709 14:54:18.166416 15434 raft_consensus.cc:493] T d86dfc13b2834d7e8b2ad5f975f08154 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:18.190788 15311 ts_tablet_manager.cc:1403] T 42d6909533d14edbbfdad30a9972658d P eaa34beb1b274443b1c46839afd0a484: Time spent bootstrapping tablet: real 0.346s	user 0.055s	sys 0.060s
I20260709 14:54:18.190943 15434 raft_consensus.cc:515] T d86dfc13b2834d7e8b2ad5f975f08154 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:18.194599 15434 leader_election.cc:290] T d86dfc13b2834d7e8b2ad5f975f08154 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805), dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477)
I20260709 14:54:18.194854 15311 raft_consensus.cc:359] T 42d6909533d14edbbfdad30a9972658d P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:18.195942 15311 raft_consensus.cc:385] T 42d6909533d14edbbfdad30a9972658d P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:18.196331 15311 raft_consensus.cc:740] T 42d6909533d14edbbfdad30a9972658d P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eaa34beb1b274443b1c46839afd0a484, State: Initialized, Role: FOLLOWER
I20260709 14:54:18.197515 15184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86dfc13b2834d7e8b2ad5f975f08154" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484" is_pre_election: true
I20260709 14:54:18.197997 15311 consensus_queue.cc:260] T 42d6909533d14edbbfdad30a9972658d P eaa34beb1b274443b1c46839afd0a484 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:18.170961 15545 raft_consensus.cc:515] T 6b5bb32eee204f2b90b1f1f14875c579 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:18.201314 15260 raft_consensus.cc:3060] T d86dfc13b2834d7e8b2ad5f975f08154 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:18.202600 15110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b5bb32eee204f2b90b1f1f14875c579" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605"
W20260709 14:54:18.204553 15224 leader_election.cc:343] T 6b5bb32eee204f2b90b1f1f14875c579 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:18.176101 15307 tablet_bootstrap.cc:492] T 1159198eabeb409996ccbec0cac057f8 P 9cb8de0701f2482b99e51d5ac080aa13: No bootstrap required, opened a new log
I20260709 14:54:18.201076 15311 ts_tablet_manager.cc:1434] T 42d6909533d14edbbfdad30a9972658d P eaa34beb1b274443b1c46839afd0a484: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 14:54:18.205576 15307 ts_tablet_manager.cc:1403] T 1159198eabeb409996ccbec0cac057f8 P 9cb8de0701f2482b99e51d5ac080aa13: Time spent bootstrapping tablet: real 0.153s	user 0.013s	sys 0.005s
I20260709 14:54:18.169170 15111 raft_consensus.cc:2468] T 9275d24f141d455cb200b9784c470d33 P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbc2c92e49e346b5b3bd7705a229afc6 in term 1.
I20260709 14:54:18.197666 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86dfc13b2834d7e8b2ad5f975f08154" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" is_pre_election: true
I20260709 14:54:18.206681 15311 tablet_bootstrap.cc:492] T 8bae8108fe2a4ce0ba3e35746c7ec9d1 P eaa34beb1b274443b1c46839afd0a484: Bootstrap starting.
I20260709 14:54:18.212615 15545 leader_election.cc:290] T 6b5bb32eee204f2b90b1f1f14875c579 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 election: Requested vote from peers 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177), eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805)
I20260709 14:54:18.212893 15434 consensus_queue.cc:1048] T ca2aa2e1a8c646069cb8b23b0ebdb0c7 P 9cb8de0701f2482b99e51d5ac080aa13 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:54:18.207921 15001 leader_election.cc:304] T 9275d24f141d455cb200b9784c470d33 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7519e608fbb44d9db8ad30b9f10ae605, dbc2c92e49e346b5b3bd7705a229afc6; no voters: 9cb8de0701f2482b99e51d5ac080aa13
I20260709 14:54:18.212397 15227 leader_election.cc:304] T d86dfc13b2834d7e8b2ad5f975f08154 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cb8de0701f2482b99e51d5ac080aa13; no voters: dbc2c92e49e346b5b3bd7705a229afc6, eaa34beb1b274443b1c46839afd0a484
I20260709 14:54:18.215531 15458 raft_consensus.cc:2804] T 9275d24f141d455cb200b9784c470d33 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:54:18.216192 15458 raft_consensus.cc:697] T 9275d24f141d455cb200b9784c470d33 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 LEADER]: Becoming Leader. State: Replica: dbc2c92e49e346b5b3bd7705a229afc6, State: Running, Role: LEADER
I20260709 14:54:18.217353 15458 consensus_queue.cc:237] T 9275d24f141d455cb200b9784c470d33 P dbc2c92e49e346b5b3bd7705a229afc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:18.212244 15309 tablet_bootstrap.cc:654] T 1159198eabeb409996ccbec0cac057f8 P 7519e608fbb44d9db8ad30b9f10ae605: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:18.176651 14932 catalog_manager.cc:5697] T f389b12c6b304243905f28267dfaeed0 P eaa34beb1b274443b1c46839afd0a484 reported cstate change: term changed from 0 to 1, leader changed from <none> to eaa34beb1b274443b1c46839afd0a484 (127.6.101.67). New cstate: current_term: 1 leader_uuid: "eaa34beb1b274443b1c46839afd0a484" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } health_report { overall_health: HEALTHY } } }
I20260709 14:54:18.213598 15307 raft_consensus.cc:359] T 1159198eabeb409996ccbec0cac057f8 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:18.226588 15307 raft_consensus.cc:385] T 1159198eabeb409996ccbec0cac057f8 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:18.227156 15307 raft_consensus.cc:740] T 1159198eabeb409996ccbec0cac057f8 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9cb8de0701f2482b99e51d5ac080aa13, State: Initialized, Role: FOLLOWER
I20260709 14:54:18.235265 15183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b5bb32eee204f2b90b1f1f14875c579" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484"
I20260709 14:54:18.236048 15183 raft_consensus.cc:3060] T 6b5bb32eee204f2b90b1f1f14875c579 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:18.237197 14933 catalog_manager.cc:5697] T 9275d24f141d455cb200b9784c470d33 P dbc2c92e49e346b5b3bd7705a229afc6 reported cstate change: term changed from 0 to 1, leader changed from <none> to dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65). New cstate: current_term: 1 leader_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } health_report { overall_health: UNKNOWN } } }
I20260709 14:54:18.241387 15434 raft_consensus.cc:2749] T d86dfc13b2834d7e8b2ad5f975f08154 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:54:18.249138 15351 raft_consensus.cc:515] T 70bc59fabcdc4359a84d584f36d18d01 P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:18.253533 15307 consensus_queue.cc:260] T 1159198eabeb409996ccbec0cac057f8 P 9cb8de0701f2482b99e51d5ac080aa13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:18.253860 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70bc59fabcdc4359a84d584f36d18d01" candidate_uuid: "7519e608fbb44d9db8ad30b9f10ae605" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc2c92e49e346b5b3bd7705a229afc6"
I20260709 14:54:18.255687 15185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70bc59fabcdc4359a84d584f36d18d01" candidate_uuid: "7519e608fbb44d9db8ad30b9f10ae605" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484"
I20260709 14:54:18.256459 15185 raft_consensus.cc:3060] T 70bc59fabcdc4359a84d584f36d18d01 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:18.256899 15311 tablet_bootstrap.cc:654] T 8bae8108fe2a4ce0ba3e35746c7ec9d1 P eaa34beb1b274443b1c46839afd0a484: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:18.257005 15351 leader_election.cc:290] T 70bc59fabcdc4359a84d584f36d18d01 P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 1 election: Requested vote from peers dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477), eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805)
I20260709 14:54:18.263080 15307 ts_tablet_manager.cc:1434] T 1159198eabeb409996ccbec0cac057f8 P 9cb8de0701f2482b99e51d5ac080aa13: Time spent starting tablet: real 0.057s	user 0.009s	sys 0.001s
W20260709 14:54:18.263747 15079 leader_election.cc:343] T 70bc59fabcdc4359a84d584f36d18d01 P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:18.272840 15307 tablet_bootstrap.cc:492] T 42d6909533d14edbbfdad30a9972658d P 9cb8de0701f2482b99e51d5ac080aa13: Bootstrap starting.
I20260709 14:54:18.277150 15306 tablet_bootstrap.cc:492] T 70bc59fabcdc4359a84d584f36d18d01 P dbc2c92e49e346b5b3bd7705a229afc6: No bootstrap required, opened a new log
I20260709 14:54:18.277997 15306 ts_tablet_manager.cc:1403] T 70bc59fabcdc4359a84d584f36d18d01 P dbc2c92e49e346b5b3bd7705a229afc6: Time spent bootstrapping tablet: real 0.228s	user 0.014s	sys 0.006s
I20260709 14:54:18.281625 15459 consensus_queue.cc:1048] T d86dfc13b2834d7e8b2ad5f975f08154 P dbc2c92e49e346b5b3bd7705a229afc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:54:18.281906 15306 raft_consensus.cc:359] T 70bc59fabcdc4359a84d584f36d18d01 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:18.282899 15306 raft_consensus.cc:385] T 70bc59fabcdc4359a84d584f36d18d01 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:18.283248 15306 raft_consensus.cc:740] T 70bc59fabcdc4359a84d584f36d18d01 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbc2c92e49e346b5b3bd7705a229afc6, State: Initialized, Role: FOLLOWER
I20260709 14:54:18.284072 15306 consensus_queue.cc:260] T 70bc59fabcdc4359a84d584f36d18d01 P dbc2c92e49e346b5b3bd7705a229afc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:18.283326 15430 raft_consensus.cc:493] T 42d6909533d14edbbfdad30a9972658d P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:18.285370 15430 raft_consensus.cc:515] T 42d6909533d14edbbfdad30a9972658d P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:18.286844 15306 ts_tablet_manager.cc:1434] T 70bc59fabcdc4359a84d584f36d18d01 P dbc2c92e49e346b5b3bd7705a229afc6: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 14:54:18.288275 15306 tablet_bootstrap.cc:492] T 8bae8108fe2a4ce0ba3e35746c7ec9d1 P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap starting.
I20260709 14:54:18.268009 15434 consensus_queue.cc:1048] T ca2aa2e1a8c646069cb8b23b0ebdb0c7 P 9cb8de0701f2482b99e51d5ac080aa13 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 14:54:18.302668 15183 raft_consensus.cc:2468] T 6b5bb32eee204f2b90b1f1f14875c579 P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cb8de0701f2482b99e51d5ac080aa13 in term 1.
I20260709 14:54:18.304677 15309 tablet_bootstrap.cc:492] T 1159198eabeb409996ccbec0cac057f8 P 7519e608fbb44d9db8ad30b9f10ae605: No bootstrap required, opened a new log
I20260709 14:54:18.306236 15309 ts_tablet_manager.cc:1403] T 1159198eabeb409996ccbec0cac057f8 P 7519e608fbb44d9db8ad30b9f10ae605: Time spent bootstrapping tablet: real 0.207s	user 0.019s	sys 0.006s
I20260709 14:54:18.308647 15227 leader_election.cc:304] T 6b5bb32eee204f2b90b1f1f14875c579 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9cb8de0701f2482b99e51d5ac080aa13, eaa34beb1b274443b1c46839afd0a484; no voters: 7519e608fbb44d9db8ad30b9f10ae605
I20260709 14:54:18.320107 15309 raft_consensus.cc:359] T 1159198eabeb409996ccbec0cac057f8 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:18.321280 15309 raft_consensus.cc:385] T 1159198eabeb409996ccbec0cac057f8 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:18.321595 15309 raft_consensus.cc:740] T 1159198eabeb409996ccbec0cac057f8 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7519e608fbb44d9db8ad30b9f10ae605, State: Initialized, Role: FOLLOWER
I20260709 14:54:18.328722 15306 tablet_bootstrap.cc:654] T 8bae8108fe2a4ce0ba3e35746c7ec9d1 P dbc2c92e49e346b5b3bd7705a229afc6: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:18.328915 15309 consensus_queue.cc:260] T 1159198eabeb409996ccbec0cac057f8 P 7519e608fbb44d9db8ad30b9f10ae605 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:18.330953 15545 raft_consensus.cc:2804] T 6b5bb32eee204f2b90b1f1f14875c579 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:54:18.331629 15545 raft_consensus.cc:697] T 6b5bb32eee204f2b90b1f1f14875c579 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 LEADER]: Becoming Leader. State: Replica: 9cb8de0701f2482b99e51d5ac080aa13, State: Running, Role: LEADER
I20260709 14:54:18.332316 15309 ts_tablet_manager.cc:1434] T 1159198eabeb409996ccbec0cac057f8 P 7519e608fbb44d9db8ad30b9f10ae605: Time spent starting tablet: real 0.026s	user 0.009s	sys 0.001s
I20260709 14:54:18.336462 15307 tablet_bootstrap.cc:654] T 42d6909533d14edbbfdad30a9972658d P 9cb8de0701f2482b99e51d5ac080aa13: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:18.339617 15309 tablet_bootstrap.cc:492] T 6b5bb32eee204f2b90b1f1f14875c579 P 7519e608fbb44d9db8ad30b9f10ae605: Bootstrap starting.
I20260709 14:54:18.324570 15185 raft_consensus.cc:2468] T 70bc59fabcdc4359a84d584f36d18d01 P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7519e608fbb44d9db8ad30b9f10ae605 in term 1.
I20260709 14:54:18.352080 15309 tablet_bootstrap.cc:654] T 6b5bb32eee204f2b90b1f1f14875c579 P 7519e608fbb44d9db8ad30b9f10ae605: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:18.356576 15311 tablet_bootstrap.cc:492] T 8bae8108fe2a4ce0ba3e35746c7ec9d1 P eaa34beb1b274443b1c46839afd0a484: No bootstrap required, opened a new log
I20260709 14:54:18.357561 15311 ts_tablet_manager.cc:1403] T 8bae8108fe2a4ce0ba3e35746c7ec9d1 P eaa34beb1b274443b1c46839afd0a484: Time spent bootstrapping tablet: real 0.151s	user 0.020s	sys 0.007s
W20260709 14:54:18.361321 15558 log.cc:927] Time spent T 9275d24f141d455cb200b9784c470d33 P dbc2c92e49e346b5b3bd7705a229afc6: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 14:54:18.366495 15261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d6909533d14edbbfdad30a9972658d" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13" is_pre_election: true
W20260709 14:54:18.354568 15559 log.cc:927] Time spent T ca2aa2e1a8c646069cb8b23b0ebdb0c7 P eaa34beb1b274443b1c46839afd0a484: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 14:54:18.332581 15545 consensus_queue.cc:237] T 6b5bb32eee204f2b90b1f1f14875c579 P 9cb8de0701f2482b99e51d5ac080aa13 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:18.372192 15430 leader_election.cc:290] T 42d6909533d14edbbfdad30a9972658d P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493), dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477)
W20260709 14:54:18.383490 15150 leader_election.cc:343] T 42d6909533d14edbbfdad30a9972658d P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:18.391803 15458 raft_consensus.cc:493] T f389b12c6b304243905f28267dfaeed0 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:18.393325 15079 leader_election.cc:304] T 70bc59fabcdc4359a84d584f36d18d01 P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7519e608fbb44d9db8ad30b9f10ae605, eaa34beb1b274443b1c46839afd0a484; no voters: dbc2c92e49e346b5b3bd7705a229afc6
I20260709 14:54:18.392601 15458 raft_consensus.cc:515] T f389b12c6b304243905f28267dfaeed0 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:18.398679 15183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f389b12c6b304243905f28267dfaeed0" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484" is_pre_election: true
I20260709 14:54:18.399804 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d6909533d14edbbfdad30a9972658d" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" is_pre_election: true
I20260709 14:54:18.400671 15035 raft_consensus.cc:2468] T 42d6909533d14edbbfdad30a9972658d P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa34beb1b274443b1c46839afd0a484 in term 0.
I20260709 14:54:18.398553 15351 raft_consensus.cc:2804] T 70bc59fabcdc4359a84d584f36d18d01 P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:54:18.404605 15351 raft_consensus.cc:697] T 70bc59fabcdc4359a84d584f36d18d01 P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 LEADER]: Becoming Leader. State: Replica: 7519e608fbb44d9db8ad30b9f10ae605, State: Running, Role: LEADER
I20260709 14:54:18.405702 15351 consensus_queue.cc:237] T 70bc59fabcdc4359a84d584f36d18d01 P 7519e608fbb44d9db8ad30b9f10ae605 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:18.411657 15458 leader_election.cc:290] T f389b12c6b304243905f28267dfaeed0 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177), eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805)
I20260709 14:54:18.386530 15311 raft_consensus.cc:359] T 8bae8108fe2a4ce0ba3e35746c7ec9d1 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:18.417865 15311 raft_consensus.cc:385] T 8bae8108fe2a4ce0ba3e35746c7ec9d1 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:18.418311 15311 raft_consensus.cc:740] T 8bae8108fe2a4ce0ba3e35746c7ec9d1 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eaa34beb1b274443b1c46839afd0a484, State: Initialized, Role: FOLLOWER
I20260709 14:54:18.418955 15311 consensus_queue.cc:260] T 8bae8108fe2a4ce0ba3e35746c7ec9d1 P eaa34beb1b274443b1c46839afd0a484 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:18.421772 15311 ts_tablet_manager.cc:1434] T 8bae8108fe2a4ce0ba3e35746c7ec9d1 P eaa34beb1b274443b1c46839afd0a484: Time spent starting tablet: real 0.064s	user 0.007s	sys 0.003s
I20260709 14:54:18.423056 15311 tablet_bootstrap.cc:492] T 0b12879f49fa4d52a477be2e490f2b38 P eaa34beb1b274443b1c46839afd0a484: Bootstrap starting.
I20260709 14:54:18.431689 15110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f389b12c6b304243905f28267dfaeed0" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605" is_pre_election: true
W20260709 14:54:18.432574 15150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.68:45493, user_credentials={real_user=slave}} blocked reactor thread for 53862.8us
I20260709 14:54:18.432871 15110 raft_consensus.cc:2393] T f389b12c6b304243905f28267dfaeed0 P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbc2c92e49e346b5b3bd7705a229afc6 in current term 1: Already voted for candidate eaa34beb1b274443b1c46839afd0a484 in this term.
I20260709 14:54:18.442281 15001 leader_election.cc:304] T f389b12c6b304243905f28267dfaeed0 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbc2c92e49e346b5b3bd7705a229afc6; no voters: 7519e608fbb44d9db8ad30b9f10ae605, eaa34beb1b274443b1c46839afd0a484
I20260709 14:54:18.448644 15458 raft_consensus.cc:3060] T f389b12c6b304243905f28267dfaeed0 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:18.431934 15311 tablet_bootstrap.cc:654] T 0b12879f49fa4d52a477be2e490f2b38 P eaa34beb1b274443b1c46839afd0a484: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:18.454217 15307 tablet_bootstrap.cc:492] T 42d6909533d14edbbfdad30a9972658d P 9cb8de0701f2482b99e51d5ac080aa13: No bootstrap required, opened a new log
W20260709 14:54:18.454770 15224 consensus_peers.cc:597] T a1075567fc91458ca7cc9977cf02b170 P 9cb8de0701f2482b99e51d5ac080aa13 -> Peer 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177): Couldn't send request to peer 7519e608fbb44d9db8ad30b9f10ae605. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:54:18.457381 15307 ts_tablet_manager.cc:1403] T 42d6909533d14edbbfdad30a9972658d P 9cb8de0701f2482b99e51d5ac080aa13: Time spent bootstrapping tablet: real 0.187s	user 0.041s	sys 0.019s
I20260709 14:54:18.478667 15153 leader_election.cc:304] T 42d6909533d14edbbfdad30a9972658d P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dbc2c92e49e346b5b3bd7705a229afc6, eaa34beb1b274443b1c46839afd0a484; no voters: 9cb8de0701f2482b99e51d5ac080aa13
W20260709 14:54:18.489814 15153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:45477, user_credentials={real_user=slave}} blocked reactor thread for 57566.3us
I20260709 14:54:18.490672 15521 raft_consensus.cc:2804] T 42d6909533d14edbbfdad30a9972658d P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:54:18.491362 15521 raft_consensus.cc:493] T 42d6909533d14edbbfdad30a9972658d P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:54:18.491734 15521 raft_consensus.cc:3060] T 42d6909533d14edbbfdad30a9972658d P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:18.505686 15555 raft_consensus.cc:493] T 8bae8108fe2a4ce0ba3e35746c7ec9d1 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:18.506398 15555 raft_consensus.cc:515] T 8bae8108fe2a4ce0ba3e35746c7ec9d1 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:18.518630 15309 tablet_bootstrap.cc:492] T 6b5bb32eee204f2b90b1f1f14875c579 P 7519e608fbb44d9db8ad30b9f10ae605: No bootstrap required, opened a new log
I20260709 14:54:18.519538 15309 ts_tablet_manager.cc:1403] T 6b5bb32eee204f2b90b1f1f14875c579 P 7519e608fbb44d9db8ad30b9f10ae605: Time spent bootstrapping tablet: real 0.181s	user 0.009s	sys 0.009s
I20260709 14:54:18.522949 15307 raft_consensus.cc:359] T 42d6909533d14edbbfdad30a9972658d P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:18.523947 15307 raft_consensus.cc:385] T 42d6909533d14edbbfdad30a9972658d P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:18.524247 15307 raft_consensus.cc:740] T 42d6909533d14edbbfdad30a9972658d P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9cb8de0701f2482b99e51d5ac080aa13, State: Initialized, Role: FOLLOWER
I20260709 14:54:18.526062 15459 raft_consensus.cc:493] T 70bc59fabcdc4359a84d584f36d18d01 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:18.526808 15459 raft_consensus.cc:515] T 70bc59fabcdc4359a84d584f36d18d01 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:18.556075 15306 tablet_bootstrap.cc:492] T 8bae8108fe2a4ce0ba3e35746c7ec9d1 P dbc2c92e49e346b5b3bd7705a229afc6: No bootstrap required, opened a new log
I20260709 14:54:18.556888 15306 ts_tablet_manager.cc:1403] T 8bae8108fe2a4ce0ba3e35746c7ec9d1 P dbc2c92e49e346b5b3bd7705a229afc6: Time spent bootstrapping tablet: real 0.269s	user 0.028s	sys 0.032s
I20260709 14:54:18.563910 15307 consensus_queue.cc:260] T 42d6909533d14edbbfdad30a9972658d P 9cb8de0701f2482b99e51d5ac080aa13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:18.566704 15307 ts_tablet_manager.cc:1434] T 42d6909533d14edbbfdad30a9972658d P 9cb8de0701f2482b99e51d5ac080aa13: Time spent starting tablet: real 0.101s	user 0.003s	sys 0.005s
I20260709 14:54:18.569545 15555 leader_election.cc:290] T 8bae8108fe2a4ce0ba3e35746c7ec9d1 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477), 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177)
I20260709 14:54:18.569873 15459 leader_election.cc:290] T 70bc59fabcdc4359a84d584f36d18d01 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177), eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805)
I20260709 14:54:18.574747 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bae8108fe2a4ce0ba3e35746c7ec9d1" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" is_pre_election: true
I20260709 14:54:18.576532 15113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bae8108fe2a4ce0ba3e35746c7ec9d1" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605" is_pre_election: true
I20260709 14:54:18.584411 15458 raft_consensus.cc:2749] T f389b12c6b304243905f28267dfaeed0 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:54:18.584084 15556 consensus_queue.cc:1048] T f389b12c6b304243905f28267dfaeed0 P eaa34beb1b274443b1c46839afd0a484 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 14:54:18.585481 15150 leader_election.cc:343] T 8bae8108fe2a4ce0ba3e35746c7ec9d1 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:18.584873 15307 tablet_bootstrap.cc:492] T 9275d24f141d455cb200b9784c470d33 P 9cb8de0701f2482b99e51d5ac080aa13: Bootstrap starting.
I20260709 14:54:18.590934 15369 consensus_queue.cc:1048] T a1075567fc91458ca7cc9977cf02b170 P 9cb8de0701f2482b99e51d5ac080aa13 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:54:18.580862 15309 raft_consensus.cc:359] T 6b5bb32eee204f2b90b1f1f14875c579 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:18.594307 15309 raft_consensus.cc:385] T 6b5bb32eee204f2b90b1f1f14875c579 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:18.591895 15306 raft_consensus.cc:359] T 8bae8108fe2a4ce0ba3e35746c7ec9d1 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:18.598555 15306 raft_consensus.cc:385] T 8bae8108fe2a4ce0ba3e35746c7ec9d1 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:18.598968 15306 raft_consensus.cc:740] T 8bae8108fe2a4ce0ba3e35746c7ec9d1 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbc2c92e49e346b5b3bd7705a229afc6, State: Initialized, Role: FOLLOWER
I20260709 14:54:18.600550 15111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70bc59fabcdc4359a84d584f36d18d01" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605" is_pre_election: true
I20260709 14:54:18.620097 14935 catalog_manager.cc:5697] T 70bc59fabcdc4359a84d584f36d18d01 P 7519e608fbb44d9db8ad30b9f10ae605 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66). New cstate: current_term: 1 leader_uuid: "7519e608fbb44d9db8ad30b9f10ae605" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } health_report { overall_health: UNKNOWN } } }
I20260709 14:54:18.594693 15309 raft_consensus.cc:740] T 6b5bb32eee204f2b90b1f1f14875c579 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7519e608fbb44d9db8ad30b9f10ae605, State: Initialized, Role: FOLLOWER
I20260709 14:54:18.599924 15306 consensus_queue.cc:260] T 8bae8108fe2a4ce0ba3e35746c7ec9d1 P dbc2c92e49e346b5b3bd7705a229afc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:18.631764 15309 consensus_queue.cc:260] T 6b5bb32eee204f2b90b1f1f14875c579 P 7519e608fbb44d9db8ad30b9f10ae605 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:18.634058 15306 ts_tablet_manager.cc:1434] T 8bae8108fe2a4ce0ba3e35746c7ec9d1 P dbc2c92e49e346b5b3bd7705a229afc6: Time spent starting tablet: real 0.077s	user 0.010s	sys 0.001s
I20260709 14:54:18.635324 15306 tablet_bootstrap.cc:492] T b7c363a305d3434092ef6016b7064eb3 P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap starting.
I20260709 14:54:18.639860 15183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70bc59fabcdc4359a84d584f36d18d01" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484" is_pre_election: true
I20260709 14:54:18.641064 15183 raft_consensus.cc:2393] T 70bc59fabcdc4359a84d584f36d18d01 P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbc2c92e49e346b5b3bd7705a229afc6 in current term 1: Already voted for candidate 7519e608fbb44d9db8ad30b9f10ae605 in this term.
W20260709 14:54:18.620949 15153 leader_election.cc:343] T 8bae8108fe2a4ce0ba3e35746c7ec9d1 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:18.643392 15153 leader_election.cc:304] T 8bae8108fe2a4ce0ba3e35746c7ec9d1 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa34beb1b274443b1c46839afd0a484; no voters: 7519e608fbb44d9db8ad30b9f10ae605, dbc2c92e49e346b5b3bd7705a229afc6
I20260709 14:54:18.646757 15556 raft_consensus.cc:2749] T 8bae8108fe2a4ce0ba3e35746c7ec9d1 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:54:18.647691 15556 consensus_queue.cc:1048] T f389b12c6b304243905f28267dfaeed0 P eaa34beb1b274443b1c46839afd0a484 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 14:54:18.646646 15309 ts_tablet_manager.cc:1434] T 6b5bb32eee204f2b90b1f1f14875c579 P 7519e608fbb44d9db8ad30b9f10ae605: Time spent starting tablet: real 0.127s	user 0.007s	sys 0.002s
I20260709 14:54:18.660224 15434 raft_consensus.cc:493] T 1159198eabeb409996ccbec0cac057f8 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:18.660557 15004 leader_election.cc:304] T 70bc59fabcdc4359a84d584f36d18d01 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbc2c92e49e346b5b3bd7705a229afc6; no voters: 7519e608fbb44d9db8ad30b9f10ae605, eaa34beb1b274443b1c46839afd0a484
I20260709 14:54:18.660943 15432 raft_consensus.cc:493] T 1159198eabeb409996ccbec0cac057f8 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:18.668444 15574 raft_consensus.cc:3060] T 70bc59fabcdc4359a84d584f36d18d01 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:18.660804 15434 raft_consensus.cc:515] T 1159198eabeb409996ccbec0cac057f8 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:18.666841 15432 raft_consensus.cc:515] T 1159198eabeb409996ccbec0cac057f8 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:18.675531 15432 leader_election.cc:290] T 1159198eabeb409996ccbec0cac057f8 P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493), dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477)
I20260709 14:54:18.676636 15260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1159198eabeb409996ccbec0cac057f8" candidate_uuid: "7519e608fbb44d9db8ad30b9f10ae605" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13" is_pre_election: true
I20260709 14:54:18.666469 15309 tablet_bootstrap.cc:492] T 0b12879f49fa4d52a477be2e490f2b38 P 7519e608fbb44d9db8ad30b9f10ae605: Bootstrap starting.
I20260709 14:54:18.677888 15260 raft_consensus.cc:2468] T 1159198eabeb409996ccbec0cac057f8 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7519e608fbb44d9db8ad30b9f10ae605 in term 0.
I20260709 14:54:18.662143 15311 tablet_bootstrap.cc:492] T 0b12879f49fa4d52a477be2e490f2b38 P eaa34beb1b274443b1c46839afd0a484: No bootstrap required, opened a new log
I20260709 14:54:18.683552 15311 ts_tablet_manager.cc:1403] T 0b12879f49fa4d52a477be2e490f2b38 P eaa34beb1b274443b1c46839afd0a484: Time spent bootstrapping tablet: real 0.261s	user 0.011s	sys 0.008s
I20260709 14:54:18.676795 15434 leader_election.cc:290] T 1159198eabeb409996ccbec0cac057f8 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477), 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177)
I20260709 14:54:18.694887 15076 leader_election.cc:304] T 1159198eabeb409996ccbec0cac057f8 P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7519e608fbb44d9db8ad30b9f10ae605, 9cb8de0701f2482b99e51d5ac080aa13; no voters: 
I20260709 14:54:18.696200 15574 raft_consensus.cc:2749] T 70bc59fabcdc4359a84d584f36d18d01 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:54:18.696796 15432 raft_consensus.cc:2804] T 1159198eabeb409996ccbec0cac057f8 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:54:18.708204 15432 raft_consensus.cc:493] T 1159198eabeb409996ccbec0cac057f8 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:54:18.708779 15432 raft_consensus.cc:3060] T 1159198eabeb409996ccbec0cac057f8 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:18.710116 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1159198eabeb409996ccbec0cac057f8" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" is_pre_election: true
I20260709 14:54:18.711707 15036 raft_consensus.cc:2468] T 1159198eabeb409996ccbec0cac057f8 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cb8de0701f2482b99e51d5ac080aa13 in term 0.
I20260709 14:54:18.717957 15227 leader_election.cc:304] T 1159198eabeb409996ccbec0cac057f8 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cb8de0701f2482b99e51d5ac080aa13, dbc2c92e49e346b5b3bd7705a229afc6; no voters: 
I20260709 14:54:18.720175 15034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1159198eabeb409996ccbec0cac057f8" candidate_uuid: "7519e608fbb44d9db8ad30b9f10ae605" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" is_pre_election: true
I20260709 14:54:18.705431 14932 catalog_manager.cc:5697] T 6b5bb32eee204f2b90b1f1f14875c579 P 9cb8de0701f2482b99e51d5ac080aa13 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68). New cstate: current_term: 1 leader_uuid: "9cb8de0701f2482b99e51d5ac080aa13" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } health_report { overall_health: HEALTHY } } }
I20260709 14:54:18.722134 15434 raft_consensus.cc:2804] T 1159198eabeb409996ccbec0cac057f8 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:54:18.723976 15434 raft_consensus.cc:493] T 1159198eabeb409996ccbec0cac057f8 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:54:18.699090 15110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1159198eabeb409996ccbec0cac057f8" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605" is_pre_election: true
I20260709 14:54:18.724351 15434 raft_consensus.cc:3060] T 1159198eabeb409996ccbec0cac057f8 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:18.724762 15311 raft_consensus.cc:359] T 0b12879f49fa4d52a477be2e490f2b38 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:18.731765 15311 raft_consensus.cc:385] T 0b12879f49fa4d52a477be2e490f2b38 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:18.726702 15307 tablet_bootstrap.cc:654] T 9275d24f141d455cb200b9784c470d33 P 9cb8de0701f2482b99e51d5ac080aa13: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:18.732226 15311 raft_consensus.cc:740] T 0b12879f49fa4d52a477be2e490f2b38 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eaa34beb1b274443b1c46839afd0a484, State: Initialized, Role: FOLLOWER
I20260709 14:54:18.722069 15034 raft_consensus.cc:2468] T 1159198eabeb409996ccbec0cac057f8 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7519e608fbb44d9db8ad30b9f10ae605 in term 0.
W20260709 14:54:18.744148 15001 consensus_peers.cc:597] T 9275d24f141d455cb200b9784c470d33 P dbc2c92e49e346b5b3bd7705a229afc6 -> Peer 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493): Couldn't send request to peer 9cb8de0701f2482b99e51d5ac080aa13. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:54:18.756577 15458 raft_consensus.cc:493] T 8bae8108fe2a4ce0ba3e35746c7ec9d1 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:18.756958 15309 tablet_bootstrap.cc:654] T 0b12879f49fa4d52a477be2e490f2b38 P 7519e608fbb44d9db8ad30b9f10ae605: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:18.763983 15311 consensus_queue.cc:260] T 0b12879f49fa4d52a477be2e490f2b38 P eaa34beb1b274443b1c46839afd0a484 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:18.757164 15458 raft_consensus.cc:515] T 8bae8108fe2a4ce0ba3e35746c7ec9d1 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:18.770480 15521 raft_consensus.cc:515] T 42d6909533d14edbbfdad30a9972658d P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:18.781384 15521 leader_election.cc:290] T 42d6909533d14edbbfdad30a9972658d P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 election: Requested vote from peers 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493), dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477)
I20260709 14:54:18.784994 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d6909533d14edbbfdad30a9972658d" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc2c92e49e346b5b3bd7705a229afc6"
I20260709 14:54:18.787456 15035 raft_consensus.cc:3060] T 42d6909533d14edbbfdad30a9972658d P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:18.777807 15306 tablet_bootstrap.cc:654] T b7c363a305d3434092ef6016b7064eb3 P dbc2c92e49e346b5b3bd7705a229afc6: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:18.789616 15311 ts_tablet_manager.cc:1434] T 0b12879f49fa4d52a477be2e490f2b38 P eaa34beb1b274443b1c46839afd0a484: Time spent starting tablet: real 0.106s	user 0.014s	sys 0.000s
I20260709 14:54:18.791512 15311 tablet_bootstrap.cc:492] T 3b4c50fac37a43c0988d5ea911d09f43 P eaa34beb1b274443b1c46839afd0a484: Bootstrap starting.
I20260709 14:54:18.793474 15458 leader_election.cc:290] T 8bae8108fe2a4ce0ba3e35746c7ec9d1 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177), eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805)
I20260709 14:54:18.786569 15260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d6909533d14edbbfdad30a9972658d" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13"
I20260709 14:54:18.794443 15434 raft_consensus.cc:515] T 1159198eabeb409996ccbec0cac057f8 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:18.796453 15260 raft_consensus.cc:3060] T 42d6909533d14edbbfdad30a9972658d P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:18.803524 15434 leader_election.cc:290] T 1159198eabeb409996ccbec0cac057f8 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 election: Requested vote from peers dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477), 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177)
I20260709 14:54:18.809161 15183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bae8108fe2a4ce0ba3e35746c7ec9d1" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484" is_pre_election: true
I20260709 14:54:18.810141 15183 raft_consensus.cc:2468] T 8bae8108fe2a4ce0ba3e35746c7ec9d1 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbc2c92e49e346b5b3bd7705a229afc6 in term 0.
I20260709 14:54:18.811848 15004 leader_election.cc:304] T 8bae8108fe2a4ce0ba3e35746c7ec9d1 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dbc2c92e49e346b5b3bd7705a229afc6, eaa34beb1b274443b1c46839afd0a484; no voters: 
I20260709 14:54:18.802937 15311 tablet_bootstrap.cc:654] T 3b4c50fac37a43c0988d5ea911d09f43 P eaa34beb1b274443b1c46839afd0a484: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:18.828073 15113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bae8108fe2a4ce0ba3e35746c7ec9d1" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605" is_pre_election: true
I20260709 14:54:18.834560 15307 tablet_bootstrap.cc:492] T 9275d24f141d455cb200b9784c470d33 P 9cb8de0701f2482b99e51d5ac080aa13: No bootstrap required, opened a new log
I20260709 14:54:18.835165 15307 ts_tablet_manager.cc:1403] T 9275d24f141d455cb200b9784c470d33 P 9cb8de0701f2482b99e51d5ac080aa13: Time spent bootstrapping tablet: real 0.267s	user 0.016s	sys 0.008s
I20260709 14:54:18.823580 15111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1159198eabeb409996ccbec0cac057f8" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605"
I20260709 14:54:18.844363 15573 raft_consensus.cc:2804] T 8bae8108fe2a4ce0ba3e35746c7ec9d1 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:54:18.845319 15573 raft_consensus.cc:493] T 8bae8108fe2a4ce0ba3e35746c7ec9d1 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:54:18.845886 15573 raft_consensus.cc:3060] T 8bae8108fe2a4ce0ba3e35746c7ec9d1 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Advancing to term 1
W20260709 14:54:18.861994 15001 leader_election.cc:343] T 8bae8108fe2a4ce0ba3e35746c7ec9d1 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:18.863301 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1159198eabeb409996ccbec0cac057f8" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc2c92e49e346b5b3bd7705a229afc6"
I20260709 14:54:18.864115 15038 raft_consensus.cc:3060] T 1159198eabeb409996ccbec0cac057f8 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:18.867911 15432 raft_consensus.cc:515] T 1159198eabeb409996ccbec0cac057f8 P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:18.869562 15110 raft_consensus.cc:2393] T 1159198eabeb409996ccbec0cac057f8 P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9cb8de0701f2482b99e51d5ac080aa13 in current term 1: Already voted for candidate 7519e608fbb44d9db8ad30b9f10ae605 in this term.
I20260709 14:54:18.881451 15261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1159198eabeb409996ccbec0cac057f8" candidate_uuid: "7519e608fbb44d9db8ad30b9f10ae605" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13"
I20260709 14:54:18.882573 15261 raft_consensus.cc:2393] T 1159198eabeb409996ccbec0cac057f8 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7519e608fbb44d9db8ad30b9f10ae605 in current term 1: Already voted for candidate 9cb8de0701f2482b99e51d5ac080aa13 in this term.
I20260709 14:54:18.884289 15309 tablet_bootstrap.cc:492] T 0b12879f49fa4d52a477be2e490f2b38 P 7519e608fbb44d9db8ad30b9f10ae605: No bootstrap required, opened a new log
I20260709 14:54:18.885001 15309 ts_tablet_manager.cc:1403] T 0b12879f49fa4d52a477be2e490f2b38 P 7519e608fbb44d9db8ad30b9f10ae605: Time spent bootstrapping tablet: real 0.222s	user 0.018s	sys 0.004s
I20260709 14:54:18.886690 15572 consensus_queue.cc:1048] T 70bc59fabcdc4359a84d584f36d18d01 P 7519e608fbb44d9db8ad30b9f10ae605 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:54:18.892432 15260 raft_consensus.cc:2468] T 42d6909533d14edbbfdad30a9972658d P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa34beb1b274443b1c46839afd0a484 in term 1.
I20260709 14:54:18.896055 15035 raft_consensus.cc:2468] T 42d6909533d14edbbfdad30a9972658d P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa34beb1b274443b1c46839afd0a484 in term 1.
I20260709 14:54:18.897024 15309 raft_consensus.cc:359] T 0b12879f49fa4d52a477be2e490f2b38 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:18.884379 15307 raft_consensus.cc:359] T 9275d24f141d455cb200b9784c470d33 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:18.901957 15309 raft_consensus.cc:385] T 0b12879f49fa4d52a477be2e490f2b38 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:18.902316 15307 raft_consensus.cc:385] T 9275d24f141d455cb200b9784c470d33 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:18.902772 15307 raft_consensus.cc:740] T 9275d24f141d455cb200b9784c470d33 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9cb8de0701f2482b99e51d5ac080aa13, State: Initialized, Role: FOLLOWER
I20260709 14:54:18.902352 15309 raft_consensus.cc:740] T 0b12879f49fa4d52a477be2e490f2b38 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7519e608fbb44d9db8ad30b9f10ae605, State: Initialized, Role: FOLLOWER
I20260709 14:54:18.905164 15153 leader_election.cc:304] T 42d6909533d14edbbfdad30a9972658d P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dbc2c92e49e346b5b3bd7705a229afc6, eaa34beb1b274443b1c46839afd0a484; no voters: 
I20260709 14:54:18.906767 15521 raft_consensus.cc:2804] T 42d6909533d14edbbfdad30a9972658d P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:54:18.907912 15309 consensus_queue.cc:260] T 0b12879f49fa4d52a477be2e490f2b38 P 7519e608fbb44d9db8ad30b9f10ae605 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:18.910738 15306 tablet_bootstrap.cc:492] T b7c363a305d3434092ef6016b7064eb3 P dbc2c92e49e346b5b3bd7705a229afc6: No bootstrap required, opened a new log
I20260709 14:54:18.911482 15306 ts_tablet_manager.cc:1403] T b7c363a305d3434092ef6016b7064eb3 P dbc2c92e49e346b5b3bd7705a229afc6: Time spent bootstrapping tablet: real 0.276s	user 0.015s	sys 0.011s
I20260709 14:54:18.915550 15307 consensus_queue.cc:260] T 9275d24f141d455cb200b9784c470d33 P 9cb8de0701f2482b99e51d5ac080aa13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:18.907671 15521 raft_consensus.cc:697] T 42d6909533d14edbbfdad30a9972658d P eaa34beb1b274443b1c46839afd0a484 [term 1 LEADER]: Becoming Leader. State: Replica: eaa34beb1b274443b1c46839afd0a484, State: Running, Role: LEADER
I20260709 14:54:18.920850 15521 consensus_queue.cc:237] T 42d6909533d14edbbfdad30a9972658d P eaa34beb1b274443b1c46839afd0a484 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:18.928114 15574 consensus_queue.cc:1048] T 9275d24f141d455cb200b9784c470d33 P dbc2c92e49e346b5b3bd7705a229afc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:54:18.932718 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1159198eabeb409996ccbec0cac057f8" candidate_uuid: "7519e608fbb44d9db8ad30b9f10ae605" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc2c92e49e346b5b3bd7705a229afc6"
I20260709 14:54:18.933116 15306 raft_consensus.cc:359] T b7c363a305d3434092ef6016b7064eb3 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:18.935776 15432 leader_election.cc:290] T 1159198eabeb409996ccbec0cac057f8 P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 1 election: Requested vote from peers 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493), dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477)
I20260709 14:54:18.940845 15306 raft_consensus.cc:385] T b7c363a305d3434092ef6016b7064eb3 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:18.900120 15573 raft_consensus.cc:515] T 8bae8108fe2a4ce0ba3e35746c7ec9d1 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:18.945094 15311 tablet_bootstrap.cc:492] T 3b4c50fac37a43c0988d5ea911d09f43 P eaa34beb1b274443b1c46839afd0a484: No bootstrap required, opened a new log
I20260709 14:54:18.945724 15311 ts_tablet_manager.cc:1403] T 3b4c50fac37a43c0988d5ea911d09f43 P eaa34beb1b274443b1c46839afd0a484: Time spent bootstrapping tablet: real 0.154s	user 0.020s	sys 0.017s
I20260709 14:54:18.944495 15309 ts_tablet_manager.cc:1434] T 0b12879f49fa4d52a477be2e490f2b38 P 7519e608fbb44d9db8ad30b9f10ae605: Time spent starting tablet: real 0.051s	user 0.008s	sys 0.001s
I20260709 14:54:18.947870 15573 leader_election.cc:290] T 8bae8108fe2a4ce0ba3e35746c7ec9d1 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 election: Requested vote from peers 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177), eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805)
I20260709 14:54:18.948499 15309 tablet_bootstrap.cc:492] T d61f9ecebc3c4a028f5327bc9debf432 P 7519e608fbb44d9db8ad30b9f10ae605: Bootstrap starting.
I20260709 14:54:18.945117 15306 raft_consensus.cc:740] T b7c363a305d3434092ef6016b7064eb3 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbc2c92e49e346b5b3bd7705a229afc6, State: Initialized, Role: FOLLOWER
I20260709 14:54:18.950810 15311 raft_consensus.cc:359] T 3b4c50fac37a43c0988d5ea911d09f43 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:18.951784 15311 raft_consensus.cc:385] T 3b4c50fac37a43c0988d5ea911d09f43 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:18.952132 15311 raft_consensus.cc:740] T 3b4c50fac37a43c0988d5ea911d09f43 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eaa34beb1b274443b1c46839afd0a484, State: Initialized, Role: FOLLOWER
I20260709 14:54:18.952160 15306 consensus_queue.cc:260] T b7c363a305d3434092ef6016b7064eb3 P dbc2c92e49e346b5b3bd7705a229afc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:18.957950 15311 consensus_queue.cc:260] T 3b4c50fac37a43c0988d5ea911d09f43 P eaa34beb1b274443b1c46839afd0a484 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:18.960460 15307 ts_tablet_manager.cc:1434] T 9275d24f141d455cb200b9784c470d33 P 9cb8de0701f2482b99e51d5ac080aa13: Time spent starting tablet: real 0.125s	user 0.002s	sys 0.008s
I20260709 14:54:18.961961 15307 tablet_bootstrap.cc:492] T b7c363a305d3434092ef6016b7064eb3 P 9cb8de0701f2482b99e51d5ac080aa13: Bootstrap starting.
I20260709 14:54:18.963999 15184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bae8108fe2a4ce0ba3e35746c7ec9d1" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484"
I20260709 14:54:18.964824 15184 raft_consensus.cc:3060] T 8bae8108fe2a4ce0ba3e35746c7ec9d1 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:18.965911 15346 raft_consensus.cc:493] T 9275d24f141d455cb200b9784c470d33 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:18.966737 15346 raft_consensus.cc:515] T 9275d24f141d455cb200b9784c470d33 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:18.970716 15309 tablet_bootstrap.cc:654] T d61f9ecebc3c4a028f5327bc9debf432 P 7519e608fbb44d9db8ad30b9f10ae605: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:18.971925 15346 leader_election.cc:290] T 9275d24f141d455cb200b9784c470d33 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477), 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177)
I20260709 14:54:18.970757 15307 tablet_bootstrap.cc:654] T b7c363a305d3434092ef6016b7064eb3 P 9cb8de0701f2482b99e51d5ac080aa13: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:18.974280 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275d24f141d455cb200b9784c470d33" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" is_pre_election: true
I20260709 14:54:18.987371 15306 ts_tablet_manager.cc:1434] T b7c363a305d3434092ef6016b7064eb3 P dbc2c92e49e346b5b3bd7705a229afc6: Time spent starting tablet: real 0.074s	user 0.008s	sys 0.004s
I20260709 14:54:18.989300 15306 tablet_bootstrap.cc:492] T 3b4c50fac37a43c0988d5ea911d09f43 P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap starting.
I20260709 14:54:18.990628 15311 ts_tablet_manager.cc:1434] T 3b4c50fac37a43c0988d5ea911d09f43 P eaa34beb1b274443b1c46839afd0a484: Time spent starting tablet: real 0.044s	user 0.008s	sys 0.001s
I20260709 14:54:19.009807 15038 raft_consensus.cc:2468] T 1159198eabeb409996ccbec0cac057f8 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cb8de0701f2482b99e51d5ac080aa13 in term 1.
I20260709 14:54:19.019907 15110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275d24f141d455cb200b9784c470d33" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605" is_pre_election: true
I20260709 14:54:19.021041 15110 raft_consensus.cc:2393] T 9275d24f141d455cb200b9784c470d33 P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9cb8de0701f2482b99e51d5ac080aa13 in current term 1: Already voted for candidate dbc2c92e49e346b5b3bd7705a229afc6 in this term.
I20260709 14:54:19.022928 15545 consensus_queue.cc:1048] T 6b5bb32eee204f2b90b1f1f14875c579 P 9cb8de0701f2482b99e51d5ac080aa13 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:54:19.027477 15306 tablet_bootstrap.cc:654] T 3b4c50fac37a43c0988d5ea911d09f43 P dbc2c92e49e346b5b3bd7705a229afc6: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:19.037061 15311 tablet_bootstrap.cc:492] T c7d360d2b84b4f0aa38f5c325f4521c1 P eaa34beb1b274443b1c46839afd0a484: Bootstrap starting.
I20260709 14:54:19.057955 15184 raft_consensus.cc:2468] T 8bae8108fe2a4ce0ba3e35746c7ec9d1 P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbc2c92e49e346b5b3bd7705a229afc6 in term 1.
I20260709 14:54:19.060036 15004 leader_election.cc:304] T 8bae8108fe2a4ce0ba3e35746c7ec9d1 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dbc2c92e49e346b5b3bd7705a229afc6, eaa34beb1b274443b1c46839afd0a484; no voters: 
I20260709 14:54:19.059356 15113 raft_consensus.cc:3060] T 6b5bb32eee204f2b90b1f1f14875c579 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:19.061101 15459 raft_consensus.cc:2804] T 8bae8108fe2a4ce0ba3e35746c7ec9d1 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:54:19.061698 15459 raft_consensus.cc:697] T 8bae8108fe2a4ce0ba3e35746c7ec9d1 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 LEADER]: Becoming Leader. State: Replica: dbc2c92e49e346b5b3bd7705a229afc6, State: Running, Role: LEADER
I20260709 14:54:19.062661 15459 consensus_queue.cc:237] T 8bae8108fe2a4ce0ba3e35746c7ec9d1 P dbc2c92e49e346b5b3bd7705a229afc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:19.082160 15307 tablet_bootstrap.cc:492] T b7c363a305d3434092ef6016b7064eb3 P 9cb8de0701f2482b99e51d5ac080aa13: No bootstrap required, opened a new log
I20260709 14:54:19.083494 15307 ts_tablet_manager.cc:1403] T b7c363a305d3434092ef6016b7064eb3 P 9cb8de0701f2482b99e51d5ac080aa13: Time spent bootstrapping tablet: real 0.122s	user 0.017s	sys 0.021s
W20260709 14:54:19.087234 14984 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 14:54:19.093858 15111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bae8108fe2a4ce0ba3e35746c7ec9d1" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605"
I20260709 14:54:19.099167 15079 leader_election.cc:304] T 1159198eabeb409996ccbec0cac057f8 P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7519e608fbb44d9db8ad30b9f10ae605; no voters: 9cb8de0701f2482b99e51d5ac080aa13, dbc2c92e49e346b5b3bd7705a229afc6
I20260709 14:54:19.103166 15572 raft_consensus.cc:2749] T 1159198eabeb409996ccbec0cac057f8 P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 14:54:19.104789 15572 consensus_queue.cc:1048] T 70bc59fabcdc4359a84d584f36d18d01 P 7519e608fbb44d9db8ad30b9f10ae605 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 14:54:19.109956 14933 catalog_manager.cc:5697] T 42d6909533d14edbbfdad30a9972658d P eaa34beb1b274443b1c46839afd0a484 reported cstate change: term changed from 0 to 1, leader changed from <none> to eaa34beb1b274443b1c46839afd0a484 (127.6.101.67). New cstate: current_term: 1 leader_uuid: "eaa34beb1b274443b1c46839afd0a484" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } health_report { overall_health: UNKNOWN } } }
W20260709 14:54:19.102818 15001 leader_election.cc:343] T 8bae8108fe2a4ce0ba3e35746c7ec9d1 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:19.113705 15227 leader_election.cc:304] T 9275d24f141d455cb200b9784c470d33 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cb8de0701f2482b99e51d5ac080aa13; no voters: 7519e608fbb44d9db8ad30b9f10ae605, dbc2c92e49e346b5b3bd7705a229afc6
W20260709 14:54:19.124430 15588 log.cc:927] Time spent T 6b5bb32eee204f2b90b1f1f14875c579 P eaa34beb1b274443b1c46839afd0a484: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 14:54:19.124615 15346 raft_consensus.cc:3060] T 9275d24f141d455cb200b9784c470d33 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:19.127215 15227 leader_election.cc:304] T 1159198eabeb409996ccbec0cac057f8 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9cb8de0701f2482b99e51d5ac080aa13, dbc2c92e49e346b5b3bd7705a229afc6; no voters: 7519e608fbb44d9db8ad30b9f10ae605
I20260709 14:54:19.116298 15307 raft_consensus.cc:359] T b7c363a305d3434092ef6016b7064eb3 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:19.148098 15307 raft_consensus.cc:385] T b7c363a305d3434092ef6016b7064eb3 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:19.149542 15307 raft_consensus.cc:740] T b7c363a305d3434092ef6016b7064eb3 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9cb8de0701f2482b99e51d5ac080aa13, State: Initialized, Role: FOLLOWER
I20260709 14:54:19.148978 15545 raft_consensus.cc:2804] T 1159198eabeb409996ccbec0cac057f8 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:54:19.154438 15309 tablet_bootstrap.cc:492] T d61f9ecebc3c4a028f5327bc9debf432 P 7519e608fbb44d9db8ad30b9f10ae605: No bootstrap required, opened a new log
I20260709 14:54:19.155297 15309 ts_tablet_manager.cc:1403] T d61f9ecebc3c4a028f5327bc9debf432 P 7519e608fbb44d9db8ad30b9f10ae605: Time spent bootstrapping tablet: real 0.207s	user 0.034s	sys 0.025s
I20260709 14:54:19.159523 15309 raft_consensus.cc:359] T d61f9ecebc3c4a028f5327bc9debf432 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:19.160255 15309 raft_consensus.cc:385] T d61f9ecebc3c4a028f5327bc9debf432 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:19.159504 15306 tablet_bootstrap.cc:492] T 3b4c50fac37a43c0988d5ea911d09f43 P dbc2c92e49e346b5b3bd7705a229afc6: No bootstrap required, opened a new log
I20260709 14:54:19.150969 15307 consensus_queue.cc:260] T b7c363a305d3434092ef6016b7064eb3 P 9cb8de0701f2482b99e51d5ac080aa13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:19.174531 15311 tablet_bootstrap.cc:654] T c7d360d2b84b4f0aa38f5c325f4521c1 P eaa34beb1b274443b1c46839afd0a484: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:19.167264 15306 ts_tablet_manager.cc:1403] T 3b4c50fac37a43c0988d5ea911d09f43 P dbc2c92e49e346b5b3bd7705a229afc6: Time spent bootstrapping tablet: real 0.173s	user 0.018s	sys 0.005s
I20260709 14:54:19.162022 15430 raft_consensus.cc:493] T 0b12879f49fa4d52a477be2e490f2b38 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:19.160554 15309 raft_consensus.cc:740] T d61f9ecebc3c4a028f5327bc9debf432 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7519e608fbb44d9db8ad30b9f10ae605, State: Initialized, Role: FOLLOWER
I20260709 14:54:19.182785 15307 ts_tablet_manager.cc:1434] T b7c363a305d3434092ef6016b7064eb3 P 9cb8de0701f2482b99e51d5ac080aa13: Time spent starting tablet: real 0.099s	user 0.014s	sys 0.001s
I20260709 14:54:19.184162 15307 tablet_bootstrap.cc:492] T 0b12879f49fa4d52a477be2e490f2b38 P 9cb8de0701f2482b99e51d5ac080aa13: Bootstrap starting.
I20260709 14:54:19.188382 15309 consensus_queue.cc:260] T d61f9ecebc3c4a028f5327bc9debf432 P 7519e608fbb44d9db8ad30b9f10ae605 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
W20260709 14:54:19.173213 15584 log.cc:927] Time spent T 70bc59fabcdc4359a84d584f36d18d01 P eaa34beb1b274443b1c46839afd0a484: Append to log took a long time: real 0.121s	user 0.008s	sys 0.000s
I20260709 14:54:19.164090 15545 raft_consensus.cc:697] T 1159198eabeb409996ccbec0cac057f8 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 LEADER]: Becoming Leader. State: Replica: 9cb8de0701f2482b99e51d5ac080aa13, State: Running, Role: LEADER
I20260709 14:54:19.203735 15309 ts_tablet_manager.cc:1434] T d61f9ecebc3c4a028f5327bc9debf432 P 7519e608fbb44d9db8ad30b9f10ae605: Time spent starting tablet: real 0.048s	user 0.009s	sys 0.000s
I20260709 14:54:19.203154 15545 consensus_queue.cc:237] T 1159198eabeb409996ccbec0cac057f8 P 9cb8de0701f2482b99e51d5ac080aa13 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:19.215636 15572 raft_consensus.cc:493] T 0b12879f49fa4d52a477be2e490f2b38 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:19.185676 15430 raft_consensus.cc:515] T 0b12879f49fa4d52a477be2e490f2b38 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:19.217849 15572 raft_consensus.cc:515] T 0b12879f49fa4d52a477be2e490f2b38 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:19.222162 15261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b12879f49fa4d52a477be2e490f2b38" candidate_uuid: "7519e608fbb44d9db8ad30b9f10ae605" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13" is_pre_election: true
I20260709 14:54:19.223923 15183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b12879f49fa4d52a477be2e490f2b38" candidate_uuid: "7519e608fbb44d9db8ad30b9f10ae605" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484" is_pre_election: true
W20260709 14:54:19.224637 15076 leader_election.cc:343] T 0b12879f49fa4d52a477be2e490f2b38 P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:19.225874 15572 leader_election.cc:290] T 0b12879f49fa4d52a477be2e490f2b38 P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805), 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493)
I20260709 14:54:19.226032 15111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b12879f49fa4d52a477be2e490f2b38" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605" is_pre_election: true
I20260709 14:54:19.226759 15111 raft_consensus.cc:2468] T 0b12879f49fa4d52a477be2e490f2b38 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa34beb1b274443b1c46839afd0a484 in term 0.
I20260709 14:54:19.211038 15309 tablet_bootstrap.cc:492] T a1075567fc91458ca7cc9977cf02b170 P 7519e608fbb44d9db8ad30b9f10ae605: Bootstrap starting.
I20260709 14:54:19.230285 15150 leader_election.cc:304] T 0b12879f49fa4d52a477be2e490f2b38 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7519e608fbb44d9db8ad30b9f10ae605, eaa34beb1b274443b1c46839afd0a484; no voters: 
I20260709 14:54:19.235435 15430 leader_election.cc:290] T 0b12879f49fa4d52a477be2e490f2b38 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177), 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493)
I20260709 14:54:19.224717 15183 raft_consensus.cc:2468] T 0b12879f49fa4d52a477be2e490f2b38 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7519e608fbb44d9db8ad30b9f10ae605 in term 0.
I20260709 14:54:19.257921 15555 raft_consensus.cc:2804] T 0b12879f49fa4d52a477be2e490f2b38 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:54:19.259995 15346 raft_consensus.cc:2749] T 9275d24f141d455cb200b9784c470d33 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:54:19.260497 15555 raft_consensus.cc:493] T 0b12879f49fa4d52a477be2e490f2b38 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:54:19.260960 15555 raft_consensus.cc:3060] T 0b12879f49fa4d52a477be2e490f2b38 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:19.269039 15261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b12879f49fa4d52a477be2e490f2b38" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13" is_pre_election: true
I20260709 14:54:19.274176 15432 raft_consensus.cc:493] T 6b5bb32eee204f2b90b1f1f14875c579 P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:19.281618 15112 raft_consensus.cc:3060] T d61f9ecebc3c4a028f5327bc9debf432 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:19.289494 15432 raft_consensus.cc:515] T 6b5bb32eee204f2b90b1f1f14875c579 P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:19.275425 15369 consensus_queue.cc:1048] T 6b5bb32eee204f2b90b1f1f14875c579 P 9cb8de0701f2482b99e51d5ac080aa13 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:54:19.311358 15430 raft_consensus.cc:493] T 3b4c50fac37a43c0988d5ea911d09f43 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:19.314357 15306 raft_consensus.cc:359] T 3b4c50fac37a43c0988d5ea911d09f43 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:19.315160 15306 raft_consensus.cc:385] T 3b4c50fac37a43c0988d5ea911d09f43 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:19.315449 15306 raft_consensus.cc:740] T 3b4c50fac37a43c0988d5ea911d09f43 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbc2c92e49e346b5b3bd7705a229afc6, State: Initialized, Role: FOLLOWER
W20260709 14:54:19.304944 15150 leader_election.cc:343] T 0b12879f49fa4d52a477be2e490f2b38 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:19.276990 15307 tablet_bootstrap.cc:654] T 0b12879f49fa4d52a477be2e490f2b38 P 9cb8de0701f2482b99e51d5ac080aa13: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:19.334784 15555 raft_consensus.cc:515] T 0b12879f49fa4d52a477be2e490f2b38 P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:19.340097 15555 leader_election.cc:290] T 0b12879f49fa4d52a477be2e490f2b38 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 election: Requested vote from peers 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177), 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493)
I20260709 14:54:19.324082 14934 catalog_manager.cc:5697] T 8bae8108fe2a4ce0ba3e35746c7ec9d1 P dbc2c92e49e346b5b3bd7705a229afc6 reported cstate change: term changed from 0 to 1, leader changed from <none> to dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65). New cstate: current_term: 1 leader_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } health_report { overall_health: UNKNOWN } } }
I20260709 14:54:19.329474 15079 leader_election.cc:304] T 0b12879f49fa4d52a477be2e490f2b38 P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7519e608fbb44d9db8ad30b9f10ae605, eaa34beb1b274443b1c46839afd0a484; no voters: 9cb8de0701f2482b99e51d5ac080aa13
I20260709 14:54:19.323479 15306 consensus_queue.cc:260] T 3b4c50fac37a43c0988d5ea911d09f43 P dbc2c92e49e346b5b3bd7705a229afc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:19.354506 15306 ts_tablet_manager.cc:1434] T 3b4c50fac37a43c0988d5ea911d09f43 P dbc2c92e49e346b5b3bd7705a229afc6: Time spent starting tablet: real 0.178s	user 0.008s	sys 0.000s
I20260709 14:54:19.355760 15306 tablet_bootstrap.cc:492] T 91c9f89fcb8b45ff9be43f535cafffde P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap starting.
I20260709 14:54:19.343273 15309 tablet_bootstrap.cc:654] T a1075567fc91458ca7cc9977cf02b170 P 7519e608fbb44d9db8ad30b9f10ae605: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:19.312256 15430 raft_consensus.cc:515] T 3b4c50fac37a43c0988d5ea911d09f43 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:19.369776 15432 leader_election.cc:290] T 6b5bb32eee204f2b90b1f1f14875c579 P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805), 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493)
I20260709 14:54:19.370540 15259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b5bb32eee204f2b90b1f1f14875c579" candidate_uuid: "7519e608fbb44d9db8ad30b9f10ae605" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13" is_pre_election: true
I20260709 14:54:19.372949 15311 tablet_bootstrap.cc:492] T c7d360d2b84b4f0aa38f5c325f4521c1 P eaa34beb1b274443b1c46839afd0a484: No bootstrap required, opened a new log
I20260709 14:54:19.376680 15311 ts_tablet_manager.cc:1403] T c7d360d2b84b4f0aa38f5c325f4521c1 P eaa34beb1b274443b1c46839afd0a484: Time spent bootstrapping tablet: real 0.385s	user 0.013s	sys 0.009s
I20260709 14:54:19.379536 15432 raft_consensus.cc:2804] T 0b12879f49fa4d52a477be2e490f2b38 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:54:19.380465 15432 raft_consensus.cc:493] T 0b12879f49fa4d52a477be2e490f2b38 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:54:19.380980 15311 raft_consensus.cc:359] T c7d360d2b84b4f0aa38f5c325f4521c1 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:19.381038 15432 raft_consensus.cc:3060] T 0b12879f49fa4d52a477be2e490f2b38 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:19.381959 15311 raft_consensus.cc:385] T c7d360d2b84b4f0aa38f5c325f4521c1 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:19.382297 15311 raft_consensus.cc:740] T c7d360d2b84b4f0aa38f5c325f4521c1 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eaa34beb1b274443b1c46839afd0a484, State: Initialized, Role: FOLLOWER
I20260709 14:54:19.384920 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4c50fac37a43c0988d5ea911d09f43" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" is_pre_election: true
W20260709 14:54:19.389763 15079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:33805, user_credentials={real_user=slave}} blocked reactor thread for 65118.9us
I20260709 14:54:19.396864 15037 raft_consensus.cc:2468] T 3b4c50fac37a43c0988d5ea911d09f43 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa34beb1b274443b1c46839afd0a484 in term 0.
I20260709 14:54:19.405362 15187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b5bb32eee204f2b90b1f1f14875c579" candidate_uuid: "7519e608fbb44d9db8ad30b9f10ae605" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484" is_pre_election: true
I20260709 14:54:19.393033 15311 consensus_queue.cc:260] T c7d360d2b84b4f0aa38f5c325f4521c1 P eaa34beb1b274443b1c46839afd0a484 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:19.400383 15430 leader_election.cc:290] T 3b4c50fac37a43c0988d5ea911d09f43 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493), dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477)
I20260709 14:54:19.404309 15261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b12879f49fa4d52a477be2e490f2b38" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13"
I20260709 14:54:19.405364 15259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4c50fac37a43c0988d5ea911d09f43" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13" is_pre_election: true
I20260709 14:54:19.435572 15306 tablet_bootstrap.cc:654] T 91c9f89fcb8b45ff9be43f535cafffde P dbc2c92e49e346b5b3bd7705a229afc6: Neither blocks nor log segments found. Creating new log.
W20260709 14:54:19.407330 15224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:43177, user_credentials={real_user=slave}} blocked reactor thread for 133086us
I20260709 14:54:19.446662 15311 ts_tablet_manager.cc:1434] T c7d360d2b84b4f0aa38f5c325f4521c1 P eaa34beb1b274443b1c46839afd0a484: Time spent starting tablet: real 0.070s	user 0.011s	sys 0.000s
I20260709 14:54:19.448668 15499 raft_consensus.cc:493] T b7c363a305d3434092ef6016b7064eb3 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:54:19.452029 15150 leader_election.cc:343] T 0b12879f49fa4d52a477be2e490f2b38 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493): Illegal state: must be running to vote when last-logged opid is not known
W20260709 14:54:19.461968 15600 log.cc:927] Time spent T 9275d24f141d455cb200b9784c470d33 P 9cb8de0701f2482b99e51d5ac080aa13: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 14:54:19.467599 15598 raft_consensus.cc:493] T b7c363a305d3434092ef6016b7064eb3 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:19.431818 15153 leader_election.cc:304] T 3b4c50fac37a43c0988d5ea911d09f43 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dbc2c92e49e346b5b3bd7705a229afc6, eaa34beb1b274443b1c46839afd0a484; no voters: 
I20260709 14:54:19.472076 15311 tablet_bootstrap.cc:492] T 91c9f89fcb8b45ff9be43f535cafffde P eaa34beb1b274443b1c46839afd0a484: Bootstrap starting.
I20260709 14:54:19.453583 15499 raft_consensus.cc:515] T b7c363a305d3434092ef6016b7064eb3 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:19.482748 15307 tablet_bootstrap.cc:492] T 0b12879f49fa4d52a477be2e490f2b38 P 9cb8de0701f2482b99e51d5ac080aa13: No bootstrap required, opened a new log
I20260709 14:54:19.483771 15307 ts_tablet_manager.cc:1403] T 0b12879f49fa4d52a477be2e490f2b38 P 9cb8de0701f2482b99e51d5ac080aa13: Time spent bootstrapping tablet: real 0.300s	user 0.013s	sys 0.019s
I20260709 14:54:19.491271 15109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b12879f49fa4d52a477be2e490f2b38" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605"
W20260709 14:54:19.486949 15153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:45477, user_credentials={real_user=slave}} blocked reactor thread for 75549.8us
I20260709 14:54:19.479611 15499 leader_election.cc:290] T b7c363a305d3434092ef6016b7064eb3 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493), 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177)
I20260709 14:54:19.509865 15555 consensus_queue.cc:1048] T 42d6909533d14edbbfdad30a9972658d P eaa34beb1b274443b1c46839afd0a484 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 14:54:19.514905 15150 leader_election.cc:343] T 3b4c50fac37a43c0988d5ea911d09f43 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:19.518417 15432 raft_consensus.cc:515] T 0b12879f49fa4d52a477be2e490f2b38 P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:19.489554 15556 raft_consensus.cc:2804] T 3b4c50fac37a43c0988d5ea911d09f43 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:54:19.481562 15598 raft_consensus.cc:515] T b7c363a305d3434092ef6016b7064eb3 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
W20260709 14:54:19.535823 15001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.68:45493, user_credentials={real_user=slave}} blocked reactor thread for 65282.5us
I20260709 14:54:19.543561 15079 leader_election.cc:304] T 6b5bb32eee204f2b90b1f1f14875c579 P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7519e608fbb44d9db8ad30b9f10ae605; no voters: 9cb8de0701f2482b99e51d5ac080aa13, eaa34beb1b274443b1c46839afd0a484
I20260709 14:54:19.540968 15260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b12879f49fa4d52a477be2e490f2b38" candidate_uuid: "7519e608fbb44d9db8ad30b9f10ae605" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13"
I20260709 14:54:19.528712 15556 raft_consensus.cc:493] T 3b4c50fac37a43c0988d5ea911d09f43 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:54:19.555064 15111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7c363a305d3434092ef6016b7064eb3" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605" is_pre_election: true
I20260709 14:54:19.569128 15556 raft_consensus.cc:3060] T 3b4c50fac37a43c0988d5ea911d09f43 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:19.552673 15598 leader_election.cc:290] T b7c363a305d3434092ef6016b7064eb3 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477), 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177)
I20260709 14:54:19.573216 15309 tablet_bootstrap.cc:492] T a1075567fc91458ca7cc9977cf02b170 P 7519e608fbb44d9db8ad30b9f10ae605: No bootstrap required, opened a new log
I20260709 14:54:19.578178 15309 ts_tablet_manager.cc:1403] T a1075567fc91458ca7cc9977cf02b170 P 7519e608fbb44d9db8ad30b9f10ae605: Time spent bootstrapping tablet: real 0.367s	user 0.024s	sys 0.013s
I20260709 14:54:19.555953 15311 tablet_bootstrap.cc:654] T 91c9f89fcb8b45ff9be43f535cafffde P eaa34beb1b274443b1c46839afd0a484: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:19.560125 15594 raft_consensus.cc:2749] T 6b5bb32eee204f2b90b1f1f14875c579 P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 14:54:19.556684 15109 raft_consensus.cc:2393] T 0b12879f49fa4d52a477be2e490f2b38 P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate eaa34beb1b274443b1c46839afd0a484 in current term 1: Already voted for candidate 7519e608fbb44d9db8ad30b9f10ae605 in this term.
I20260709 14:54:19.581226 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7c363a305d3434092ef6016b7064eb3" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" is_pre_election: true
I20260709 14:54:19.530776 15432 leader_election.cc:290] T 0b12879f49fa4d52a477be2e490f2b38 P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 1 election: Requested vote from peers eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805), 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493)
I20260709 14:54:19.581507 15521 consensus_queue.cc:1048] T 42d6909533d14edbbfdad30a9972658d P eaa34beb1b274443b1c46839afd0a484 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 14:54:19.587239 15037 raft_consensus.cc:2468] T b7c363a305d3434092ef6016b7064eb3 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cb8de0701f2482b99e51d5ac080aa13 in term 0.
I20260709 14:54:19.591626 15185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b12879f49fa4d52a477be2e490f2b38" candidate_uuid: "7519e608fbb44d9db8ad30b9f10ae605" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484"
I20260709 14:54:19.592785 15185 raft_consensus.cc:2393] T 0b12879f49fa4d52a477be2e490f2b38 P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7519e608fbb44d9db8ad30b9f10ae605 in current term 1: Already voted for candidate eaa34beb1b274443b1c46839afd0a484 in this term.
I20260709 14:54:19.564668 15459 consensus_queue.cc:1048] T 8bae8108fe2a4ce0ba3e35746c7ec9d1 P dbc2c92e49e346b5b3bd7705a229afc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.032s
I20260709 14:54:19.605693 15309 raft_consensus.cc:359] T a1075567fc91458ca7cc9977cf02b170 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:19.616798 15309 raft_consensus.cc:385] T a1075567fc91458ca7cc9977cf02b170 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:19.617233 15309 raft_consensus.cc:740] T a1075567fc91458ca7cc9977cf02b170 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7519e608fbb44d9db8ad30b9f10ae605, State: Initialized, Role: FOLLOWER
I20260709 14:54:19.618207 15309 consensus_queue.cc:260] T a1075567fc91458ca7cc9977cf02b170 P 7519e608fbb44d9db8ad30b9f10ae605 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:19.620687 15309 ts_tablet_manager.cc:1434] T a1075567fc91458ca7cc9977cf02b170 P 7519e608fbb44d9db8ad30b9f10ae605: Time spent starting tablet: real 0.042s	user 0.006s	sys 0.001s
I20260709 14:54:19.621748 15307 raft_consensus.cc:359] T 0b12879f49fa4d52a477be2e490f2b38 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
W20260709 14:54:19.607220 15001 leader_election.cc:343] T b7c363a305d3434092ef6016b7064eb3 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:19.610314 15258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7c363a305d3434092ef6016b7064eb3" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13" is_pre_election: true
I20260709 14:54:19.605877 15227 leader_election.cc:304] T b7c363a305d3434092ef6016b7064eb3 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cb8de0701f2482b99e51d5ac080aa13, dbc2c92e49e346b5b3bd7705a229afc6; no voters: 
I20260709 14:54:19.629603 15309 tablet_bootstrap.cc:492] T 8bae8108fe2a4ce0ba3e35746c7ec9d1 P 7519e608fbb44d9db8ad30b9f10ae605: Bootstrap starting.
I20260709 14:54:19.630429 15307 raft_consensus.cc:385] T 0b12879f49fa4d52a477be2e490f2b38 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:19.641103 15307 raft_consensus.cc:740] T 0b12879f49fa4d52a477be2e490f2b38 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9cb8de0701f2482b99e51d5ac080aa13, State: Initialized, Role: FOLLOWER
I20260709 14:54:19.642503 15307 consensus_queue.cc:260] T 0b12879f49fa4d52a477be2e490f2b38 P 9cb8de0701f2482b99e51d5ac080aa13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:19.644568 15430 raft_consensus.cc:493] T c7d360d2b84b4f0aa38f5c325f4521c1 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:19.653813 15430 raft_consensus.cc:515] T c7d360d2b84b4f0aa38f5c325f4521c1 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:19.656432 15430 leader_election.cc:290] T c7d360d2b84b4f0aa38f5c325f4521c1 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177), 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493)
I20260709 14:54:19.635262 15258 raft_consensus.cc:2468] T b7c363a305d3434092ef6016b7064eb3 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbc2c92e49e346b5b3bd7705a229afc6 in term 0.
I20260709 14:54:19.662653 15545 raft_consensus.cc:2804] T b7c363a305d3434092ef6016b7064eb3 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:54:19.668448 15113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d360d2b84b4f0aa38f5c325f4521c1" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605" is_pre_election: true
I20260709 14:54:19.671948 15306 tablet_bootstrap.cc:492] T 91c9f89fcb8b45ff9be43f535cafffde P dbc2c92e49e346b5b3bd7705a229afc6: No bootstrap required, opened a new log
I20260709 14:54:19.672554 15306 ts_tablet_manager.cc:1403] T 91c9f89fcb8b45ff9be43f535cafffde P dbc2c92e49e346b5b3bd7705a229afc6: Time spent bootstrapping tablet: real 0.317s	user 0.024s	sys 0.008s
I20260709 14:54:19.673293 15260 raft_consensus.cc:3060] T 0b12879f49fa4d52a477be2e490f2b38 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:19.666487 15545 raft_consensus.cc:493] T b7c363a305d3434092ef6016b7064eb3 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:54:19.674609 15545 raft_consensus.cc:3060] T b7c363a305d3434092ef6016b7064eb3 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:19.674281 15556 raft_consensus.cc:515] T 3b4c50fac37a43c0988d5ea911d09f43 P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:19.678782 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4c50fac37a43c0988d5ea911d09f43" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc2c92e49e346b5b3bd7705a229afc6"
I20260709 14:54:19.679531 15038 raft_consensus.cc:3060] T 3b4c50fac37a43c0988d5ea911d09f43 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:19.679349 14934 catalog_manager.cc:5697] T 1159198eabeb409996ccbec0cac057f8 P 9cb8de0701f2482b99e51d5ac080aa13 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68). New cstate: current_term: 1 leader_uuid: "9cb8de0701f2482b99e51d5ac080aa13" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } health_report { overall_health: UNKNOWN } } }
W20260709 14:54:19.683542 15150 leader_election.cc:343] T c7d360d2b84b4f0aa38f5c325f4521c1 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:19.681118 15306 raft_consensus.cc:359] T 91c9f89fcb8b45ff9be43f535cafffde P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:19.686858 15306 raft_consensus.cc:385] T 91c9f89fcb8b45ff9be43f535cafffde P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:19.687391 15306 raft_consensus.cc:740] T 91c9f89fcb8b45ff9be43f535cafffde P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbc2c92e49e346b5b3bd7705a229afc6, State: Initialized, Role: FOLLOWER
I20260709 14:54:19.690152 15306 consensus_queue.cc:260] T 91c9f89fcb8b45ff9be43f535cafffde P dbc2c92e49e346b5b3bd7705a229afc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:19.693115 15307 ts_tablet_manager.cc:1434] T 0b12879f49fa4d52a477be2e490f2b38 P 9cb8de0701f2482b99e51d5ac080aa13: Time spent starting tablet: real 0.209s	user 0.011s	sys 0.001s
I20260709 14:54:19.694702 15307 tablet_bootstrap.cc:492] T 3b4c50fac37a43c0988d5ea911d09f43 P 9cb8de0701f2482b99e51d5ac080aa13: Bootstrap starting.
I20260709 14:54:19.696883 15001 leader_election.cc:304] T b7c363a305d3434092ef6016b7064eb3 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9cb8de0701f2482b99e51d5ac080aa13, dbc2c92e49e346b5b3bd7705a229afc6; no voters: 7519e608fbb44d9db8ad30b9f10ae605
I20260709 14:54:19.701844 15260 raft_consensus.cc:2468] T 0b12879f49fa4d52a477be2e490f2b38 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7519e608fbb44d9db8ad30b9f10ae605 in term 1.
I20260709 14:54:19.702210 15306 ts_tablet_manager.cc:1434] T 91c9f89fcb8b45ff9be43f535cafffde P dbc2c92e49e346b5b3bd7705a229afc6: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.003s
I20260709 14:54:19.705514 15306 tablet_bootstrap.cc:492] T dd44b332dc744f94a5f7cfffc06f3956 P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap starting.
I20260709 14:54:19.710826 15254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4c50fac37a43c0988d5ea911d09f43" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13"
I20260709 14:54:19.711663 15150 leader_election.cc:304] T 0b12879f49fa4d52a477be2e490f2b38 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa34beb1b274443b1c46839afd0a484; no voters: 7519e608fbb44d9db8ad30b9f10ae605, 9cb8de0701f2482b99e51d5ac080aa13
I20260709 14:54:19.712572 15521 raft_consensus.cc:2749] T 0b12879f49fa4d52a477be2e490f2b38 P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 14:54:19.713881 15434 consensus_queue.cc:1048] T 1159198eabeb409996ccbec0cac057f8 P 9cb8de0701f2482b99e51d5ac080aa13 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:54:19.719847 15605 raft_consensus.cc:2804] T b7c363a305d3434092ef6016b7064eb3 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:54:19.720683 15605 raft_consensus.cc:493] T b7c363a305d3434092ef6016b7064eb3 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:54:19.721144 15311 tablet_bootstrap.cc:492] T 91c9f89fcb8b45ff9be43f535cafffde P eaa34beb1b274443b1c46839afd0a484: No bootstrap required, opened a new log
I20260709 14:54:19.721931 15311 ts_tablet_manager.cc:1403] T 91c9f89fcb8b45ff9be43f535cafffde P eaa34beb1b274443b1c46839afd0a484: Time spent bootstrapping tablet: real 0.250s	user 0.023s	sys 0.018s
I20260709 14:54:19.712657 15255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d360d2b84b4f0aa38f5c325f4521c1" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13" is_pre_election: true
I20260709 14:54:19.725888 15311 raft_consensus.cc:359] T 91c9f89fcb8b45ff9be43f535cafffde P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:19.726835 15311 raft_consensus.cc:385] T 91c9f89fcb8b45ff9be43f535cafffde P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:19.727190 15311 raft_consensus.cc:740] T 91c9f89fcb8b45ff9be43f535cafffde P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eaa34beb1b274443b1c46839afd0a484, State: Initialized, Role: FOLLOWER
I20260709 14:54:19.727892 15113 raft_consensus.cc:3060] T a1075567fc91458ca7cc9977cf02b170 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:19.731302 15306 tablet_bootstrap.cc:654] T dd44b332dc744f94a5f7cfffc06f3956 P dbc2c92e49e346b5b3bd7705a229afc6: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:19.732089 15311 consensus_queue.cc:260] T 91c9f89fcb8b45ff9be43f535cafffde P eaa34beb1b274443b1c46839afd0a484 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:19.721489 15076 leader_election.cc:304] T 0b12879f49fa4d52a477be2e490f2b38 P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7519e608fbb44d9db8ad30b9f10ae605, 9cb8de0701f2482b99e51d5ac080aa13; no voters: eaa34beb1b274443b1c46839afd0a484
I20260709 14:54:19.738384 15311 ts_tablet_manager.cc:1434] T 91c9f89fcb8b45ff9be43f535cafffde P eaa34beb1b274443b1c46839afd0a484: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.001s
W20260709 14:54:19.738704 15150 leader_election.cc:343] T 3b4c50fac37a43c0988d5ea911d09f43 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493): Illegal state: must be running to vote when last-logged opid is not known
W20260709 14:54:19.740737 15150 leader_election.cc:343] T c7d360d2b84b4f0aa38f5c325f4521c1 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:19.721128 15605 raft_consensus.cc:3060] T b7c363a305d3434092ef6016b7064eb3 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:19.742244 15594 raft_consensus.cc:2804] T 0b12879f49fa4d52a477be2e490f2b38 P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:54:19.753989 15594 raft_consensus.cc:697] T 0b12879f49fa4d52a477be2e490f2b38 P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 LEADER]: Becoming Leader. State: Replica: 7519e608fbb44d9db8ad30b9f10ae605, State: Running, Role: LEADER
I20260709 14:54:19.755021 15594 consensus_queue.cc:237] T 0b12879f49fa4d52a477be2e490f2b38 P 7519e608fbb44d9db8ad30b9f10ae605 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:19.758519 15109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7c363a305d3434092ef6016b7064eb3" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605" is_pre_election: true
I20260709 14:54:19.761551 15573 raft_consensus.cc:493] T 91c9f89fcb8b45ff9be43f535cafffde P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:19.762421 15573 raft_consensus.cc:515] T 91c9f89fcb8b45ff9be43f535cafffde P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:19.766443 15311 tablet_bootstrap.cc:492] T 9f90ac0a3b004f6ca430ff2fc5198678 P eaa34beb1b274443b1c46839afd0a484: Bootstrap starting.
I20260709 14:54:19.741708 15150 leader_election.cc:304] T c7d360d2b84b4f0aa38f5c325f4521c1 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa34beb1b274443b1c46839afd0a484; no voters: 7519e608fbb44d9db8ad30b9f10ae605, 9cb8de0701f2482b99e51d5ac080aa13
I20260709 14:54:19.695232 15556 leader_election.cc:290] T 3b4c50fac37a43c0988d5ea911d09f43 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 election: Requested vote from peers 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493), dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477)
I20260709 14:54:19.788589 15573 leader_election.cc:290] T 91c9f89fcb8b45ff9be43f535cafffde P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177), eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805)
I20260709 14:54:19.778353 15521 raft_consensus.cc:2749] T c7d360d2b84b4f0aa38f5c325f4521c1 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:54:19.810806 15185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c9f89fcb8b45ff9be43f535cafffde" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484" is_pre_election: true
W20260709 14:54:19.811623 15224 leader_election.cc:343] T b7c363a305d3434092ef6016b7064eb3 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:19.811872 15185 raft_consensus.cc:2468] T 91c9f89fcb8b45ff9be43f535cafffde P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbc2c92e49e346b5b3bd7705a229afc6 in term 0.
I20260709 14:54:19.814509 15110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c9f89fcb8b45ff9be43f535cafffde" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605" is_pre_election: true
I20260709 14:54:19.818538 15309 tablet_bootstrap.cc:654] T 8bae8108fe2a4ce0ba3e35746c7ec9d1 P 7519e608fbb44d9db8ad30b9f10ae605: Neither blocks nor log segments found. Creating new log.
W20260709 14:54:19.820891 15001 leader_election.cc:343] T 91c9f89fcb8b45ff9be43f535cafffde P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:19.821674 15004 leader_election.cc:304] T 91c9f89fcb8b45ff9be43f535cafffde P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dbc2c92e49e346b5b3bd7705a229afc6, eaa34beb1b274443b1c46839afd0a484; no voters: 7519e608fbb44d9db8ad30b9f10ae605
I20260709 14:54:19.824627 15346 consensus_queue.cc:1048] T 1159198eabeb409996ccbec0cac057f8 P 9cb8de0701f2482b99e51d5ac080aa13 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:54:19.829403 15311 tablet_bootstrap.cc:654] T 9f90ac0a3b004f6ca430ff2fc5198678 P eaa34beb1b274443b1c46839afd0a484: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:19.831856 15307 tablet_bootstrap.cc:654] T 3b4c50fac37a43c0988d5ea911d09f43 P 9cb8de0701f2482b99e51d5ac080aa13: Neither blocks nor log segments found. Creating new log.
W20260709 14:54:19.821908 15001 consensus_peers.cc:597] T 8bae8108fe2a4ce0ba3e35746c7ec9d1 P dbc2c92e49e346b5b3bd7705a229afc6 -> Peer 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177): Couldn't send request to peer 7519e608fbb44d9db8ad30b9f10ae605. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:54:19.828404 15545 raft_consensus.cc:515] T b7c363a305d3434092ef6016b7064eb3 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:19.849910 15038 raft_consensus.cc:2468] T 3b4c50fac37a43c0988d5ea911d09f43 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa34beb1b274443b1c46839afd0a484 in term 1.
W20260709 14:54:19.850201 15153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:45477, user_credentials={real_user=slave}} blocked reactor thread for 111991us
I20260709 14:54:19.880636 15306 tablet_bootstrap.cc:492] T dd44b332dc744f94a5f7cfffc06f3956 P dbc2c92e49e346b5b3bd7705a229afc6: No bootstrap required, opened a new log
I20260709 14:54:19.882148 15306 ts_tablet_manager.cc:1403] T dd44b332dc744f94a5f7cfffc06f3956 P dbc2c92e49e346b5b3bd7705a229afc6: Time spent bootstrapping tablet: real 0.177s	user 0.042s	sys 0.007s
I20260709 14:54:19.883463 15606 raft_consensus.cc:2804] T 91c9f89fcb8b45ff9be43f535cafffde P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:54:19.884184 15606 raft_consensus.cc:493] T 91c9f89fcb8b45ff9be43f535cafffde P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:54:19.884701 15606 raft_consensus.cc:3060] T 91c9f89fcb8b45ff9be43f535cafffde P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:19.885823 15545 leader_election.cc:290] T b7c363a305d3434092ef6016b7064eb3 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 election: Requested vote from peers dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477), 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177)
I20260709 14:54:19.891412 15106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7c363a305d3434092ef6016b7064eb3" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605"
W20260709 14:54:19.893726 15224 leader_election.cc:343] T b7c363a305d3434092ef6016b7064eb3 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:19.904810 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7c363a305d3434092ef6016b7064eb3" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc2c92e49e346b5b3bd7705a229afc6"
I20260709 14:54:19.946352 15311 tablet_bootstrap.cc:492] T 9f90ac0a3b004f6ca430ff2fc5198678 P eaa34beb1b274443b1c46839afd0a484: No bootstrap required, opened a new log
I20260709 14:54:19.949671 15306 raft_consensus.cc:359] T dd44b332dc744f94a5f7cfffc06f3956 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:19.953459 15311 ts_tablet_manager.cc:1403] T 9f90ac0a3b004f6ca430ff2fc5198678 P eaa34beb1b274443b1c46839afd0a484: Time spent bootstrapping tablet: real 0.187s	user 0.027s	sys 0.029s
I20260709 14:54:19.955711 15306 raft_consensus.cc:385] T dd44b332dc744f94a5f7cfffc06f3956 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:19.956115 15306 raft_consensus.cc:740] T dd44b332dc744f94a5f7cfffc06f3956 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbc2c92e49e346b5b3bd7705a229afc6, State: Initialized, Role: FOLLOWER
I20260709 14:54:19.959441 15306 consensus_queue.cc:260] T dd44b332dc744f94a5f7cfffc06f3956 P dbc2c92e49e346b5b3bd7705a229afc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
W20260709 14:54:19.984078 15617 log.cc:927] Time spent T 1159198eabeb409996ccbec0cac057f8 P dbc2c92e49e346b5b3bd7705a229afc6: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 14:54:19.969017 15311 raft_consensus.cc:359] T 9f90ac0a3b004f6ca430ff2fc5198678 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:19.992607 15311 raft_consensus.cc:385] T 9f90ac0a3b004f6ca430ff2fc5198678 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:19.993046 15311 raft_consensus.cc:740] T 9f90ac0a3b004f6ca430ff2fc5198678 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eaa34beb1b274443b1c46839afd0a484, State: Initialized, Role: FOLLOWER
I20260709 14:54:20.000536 15311 consensus_queue.cc:260] T 9f90ac0a3b004f6ca430ff2fc5198678 P eaa34beb1b274443b1c46839afd0a484 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:20.015208 15306 ts_tablet_manager.cc:1434] T dd44b332dc744f94a5f7cfffc06f3956 P dbc2c92e49e346b5b3bd7705a229afc6: Time spent starting tablet: real 0.133s	user 0.008s	sys 0.003s
I20260709 14:54:20.022403 15306 tablet_bootstrap.cc:492] T 5585b0f6bbf04c10865d2463767621dc P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap starting.
I20260709 14:54:20.027845 15309 tablet_bootstrap.cc:492] T 8bae8108fe2a4ce0ba3e35746c7ec9d1 P 7519e608fbb44d9db8ad30b9f10ae605: No bootstrap required, opened a new log
I20260709 14:54:20.028987 15309 ts_tablet_manager.cc:1403] T 8bae8108fe2a4ce0ba3e35746c7ec9d1 P 7519e608fbb44d9db8ad30b9f10ae605: Time spent bootstrapping tablet: real 0.400s	user 0.021s	sys 0.012s
I20260709 14:54:19.916182 15605 raft_consensus.cc:515] T b7c363a305d3434092ef6016b7064eb3 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:20.043371 15035 raft_consensus.cc:2393] T b7c363a305d3434092ef6016b7064eb3 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9cb8de0701f2482b99e51d5ac080aa13 in current term 1: Already voted for candidate dbc2c92e49e346b5b3bd7705a229afc6 in this term.
I20260709 14:54:20.043668 15605 leader_election.cc:290] T b7c363a305d3434092ef6016b7064eb3 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 election: Requested vote from peers 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493), 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177)
I20260709 14:54:20.012233 15153 leader_election.cc:304] T 3b4c50fac37a43c0988d5ea911d09f43 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dbc2c92e49e346b5b3bd7705a229afc6, eaa34beb1b274443b1c46839afd0a484; no voters: 9cb8de0701f2482b99e51d5ac080aa13
I20260709 14:54:20.049741 15106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7c363a305d3434092ef6016b7064eb3" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605"
I20260709 14:54:20.052016 15309 raft_consensus.cc:359] T 8bae8108fe2a4ce0ba3e35746c7ec9d1 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
W20260709 14:54:20.056066 15001 leader_election.cc:343] T b7c363a305d3434092ef6016b7064eb3 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:20.059769 15307 tablet_bootstrap.cc:492] T 3b4c50fac37a43c0988d5ea911d09f43 P 9cb8de0701f2482b99e51d5ac080aa13: No bootstrap required, opened a new log
I20260709 14:54:20.070823 15311 ts_tablet_manager.cc:1434] T 9f90ac0a3b004f6ca430ff2fc5198678 P eaa34beb1b274443b1c46839afd0a484: Time spent starting tablet: real 0.115s	user 0.011s	sys 0.000s
I20260709 14:54:20.075974 15307 ts_tablet_manager.cc:1403] T 3b4c50fac37a43c0988d5ea911d09f43 P 9cb8de0701f2482b99e51d5ac080aa13: Time spent bootstrapping tablet: real 0.382s	user 0.024s	sys 0.014s
I20260709 14:54:20.081339 15307 raft_consensus.cc:359] T 3b4c50fac37a43c0988d5ea911d09f43 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:20.082918 15307 raft_consensus.cc:385] T 3b4c50fac37a43c0988d5ea911d09f43 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:20.083526 15307 raft_consensus.cc:740] T 3b4c50fac37a43c0988d5ea911d09f43 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9cb8de0701f2482b99e51d5ac080aa13, State: Initialized, Role: FOLLOWER
I20260709 14:54:20.083658 15606 raft_consensus.cc:515] T 91c9f89fcb8b45ff9be43f535cafffde P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:20.055866 15227 leader_election.cc:304] T b7c363a305d3434092ef6016b7064eb3 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cb8de0701f2482b99e51d5ac080aa13; no voters: 7519e608fbb44d9db8ad30b9f10ae605, dbc2c92e49e346b5b3bd7705a229afc6
I20260709 14:54:20.081521 15311 tablet_bootstrap.cc:492] T 342798bf4325470fa3991757eadb0764 P eaa34beb1b274443b1c46839afd0a484: Bootstrap starting.
W20260709 14:54:20.089488 15153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:45477, user_credentials={real_user=slave}} blocked reactor thread for 129680us
I20260709 14:54:20.084630 15307 consensus_queue.cc:260] T 3b4c50fac37a43c0988d5ea911d09f43 P 9cb8de0701f2482b99e51d5ac080aa13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:20.092546 15434 raft_consensus.cc:2749] T b7c363a305d3434092ef6016b7064eb3 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 14:54:20.100011 15623 raft_consensus.cc:2804] T 3b4c50fac37a43c0988d5ea911d09f43 P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:54:20.101107 15623 raft_consensus.cc:697] T 3b4c50fac37a43c0988d5ea911d09f43 P eaa34beb1b274443b1c46839afd0a484 [term 1 LEADER]: Becoming Leader. State: Replica: eaa34beb1b274443b1c46839afd0a484, State: Running, Role: LEADER
I20260709 14:54:20.102280 15623 consensus_queue.cc:237] T 3b4c50fac37a43c0988d5ea911d09f43 P eaa34beb1b274443b1c46839afd0a484 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:20.086949 15254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7c363a305d3434092ef6016b7064eb3" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13"
I20260709 14:54:20.087404 15306 tablet_bootstrap.cc:654] T 5585b0f6bbf04c10865d2463767621dc P dbc2c92e49e346b5b3bd7705a229afc6: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:20.112360 15254 raft_consensus.cc:2393] T b7c363a305d3434092ef6016b7064eb3 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate dbc2c92e49e346b5b3bd7705a229afc6 in current term 1: Already voted for candidate 9cb8de0701f2482b99e51d5ac080aa13 in this term.
I20260709 14:54:20.117379 15183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c9f89fcb8b45ff9be43f535cafffde" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484"
I20260709 14:54:20.118206 15183 raft_consensus.cc:3060] T 91c9f89fcb8b45ff9be43f535cafffde P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:20.138270 15306 tablet_bootstrap.cc:492] T 5585b0f6bbf04c10865d2463767621dc P dbc2c92e49e346b5b3bd7705a229afc6: No bootstrap required, opened a new log
I20260709 14:54:20.139029 15306 ts_tablet_manager.cc:1403] T 5585b0f6bbf04c10865d2463767621dc P dbc2c92e49e346b5b3bd7705a229afc6: Time spent bootstrapping tablet: real 0.123s	user 0.017s	sys 0.001s
I20260709 14:54:20.139586 15307 ts_tablet_manager.cc:1434] T 3b4c50fac37a43c0988d5ea911d09f43 P 9cb8de0701f2482b99e51d5ac080aa13: Time spent starting tablet: real 0.063s	user 0.006s	sys 0.005s
I20260709 14:54:20.144335 15306 raft_consensus.cc:359] T 5585b0f6bbf04c10865d2463767621dc P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:20.145340 15306 raft_consensus.cc:385] T 5585b0f6bbf04c10865d2463767621dc P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:20.145664 15306 raft_consensus.cc:740] T 5585b0f6bbf04c10865d2463767621dc P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbc2c92e49e346b5b3bd7705a229afc6, State: Initialized, Role: FOLLOWER
I20260709 14:54:20.149093 15311 tablet_bootstrap.cc:654] T 342798bf4325470fa3991757eadb0764 P eaa34beb1b274443b1c46839afd0a484: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:20.146534 15306 consensus_queue.cc:260] T 5585b0f6bbf04c10865d2463767621dc P dbc2c92e49e346b5b3bd7705a229afc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:20.150559 15606 leader_election.cc:290] T 91c9f89fcb8b45ff9be43f535cafffde P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 election: Requested vote from peers 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177), eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805)
I20260709 14:54:20.152597 15306 ts_tablet_manager.cc:1434] T 5585b0f6bbf04c10865d2463767621dc P dbc2c92e49e346b5b3bd7705a229afc6: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.000s
I20260709 14:54:20.154408 15306 tablet_bootstrap.cc:492] T d178b88fdab54a29b05fb98e05ffe8c5 P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap starting.
I20260709 14:54:20.164108 15307 tablet_bootstrap.cc:492] T c7d360d2b84b4f0aa38f5c325f4521c1 P 9cb8de0701f2482b99e51d5ac080aa13: Bootstrap starting.
I20260709 14:54:20.174832 15599 consensus_queue.cc:1048] T 0b12879f49fa4d52a477be2e490f2b38 P 7519e608fbb44d9db8ad30b9f10ae605 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:54:20.179744 15306 tablet_bootstrap.cc:654] T d178b88fdab54a29b05fb98e05ffe8c5 P dbc2c92e49e346b5b3bd7705a229afc6: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:20.183411 15106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c9f89fcb8b45ff9be43f535cafffde" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605"
I20260709 14:54:20.197471 15311 tablet_bootstrap.cc:492] T 342798bf4325470fa3991757eadb0764 P eaa34beb1b274443b1c46839afd0a484: No bootstrap required, opened a new log
W20260709 14:54:20.198000 14984 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 14:54:20.198443 15311 ts_tablet_manager.cc:1403] T 342798bf4325470fa3991757eadb0764 P eaa34beb1b274443b1c46839afd0a484: Time spent bootstrapping tablet: real 0.122s	user 0.017s	sys 0.000s
I20260709 14:54:20.212065 15311 raft_consensus.cc:359] T 342798bf4325470fa3991757eadb0764 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:20.212746 15311 raft_consensus.cc:385] T 342798bf4325470fa3991757eadb0764 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:20.213577 15311 raft_consensus.cc:740] T 342798bf4325470fa3991757eadb0764 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eaa34beb1b274443b1c46839afd0a484, State: Initialized, Role: FOLLOWER
I20260709 14:54:20.200107 15307 tablet_bootstrap.cc:654] T c7d360d2b84b4f0aa38f5c325f4521c1 P 9cb8de0701f2482b99e51d5ac080aa13: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:20.204782 15306 tablet_bootstrap.cc:492] T d178b88fdab54a29b05fb98e05ffe8c5 P dbc2c92e49e346b5b3bd7705a229afc6: No bootstrap required, opened a new log
I20260709 14:54:20.217141 15309 raft_consensus.cc:385] T 8bae8108fe2a4ce0ba3e35746c7ec9d1 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:20.217343 15306 ts_tablet_manager.cc:1403] T d178b88fdab54a29b05fb98e05ffe8c5 P dbc2c92e49e346b5b3bd7705a229afc6: Time spent bootstrapping tablet: real 0.064s	user 0.016s	sys 0.017s
I20260709 14:54:20.219616 15309 raft_consensus.cc:740] T 8bae8108fe2a4ce0ba3e35746c7ec9d1 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7519e608fbb44d9db8ad30b9f10ae605, State: Initialized, Role: FOLLOWER
I20260709 14:54:20.221120 15309 consensus_queue.cc:260] T 8bae8108fe2a4ce0ba3e35746c7ec9d1 P 7519e608fbb44d9db8ad30b9f10ae605 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:20.214443 15311 consensus_queue.cc:260] T 342798bf4325470fa3991757eadb0764 P eaa34beb1b274443b1c46839afd0a484 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:20.227036 15311 ts_tablet_manager.cc:1434] T 342798bf4325470fa3991757eadb0764 P eaa34beb1b274443b1c46839afd0a484: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 14:54:20.216796 15183 raft_consensus.cc:2468] T 91c9f89fcb8b45ff9be43f535cafffde P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbc2c92e49e346b5b3bd7705a229afc6 in term 1.
I20260709 14:54:20.224097 15001 leader_election.cc:304] T b7c363a305d3434092ef6016b7064eb3 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbc2c92e49e346b5b3bd7705a229afc6; no voters: 7519e608fbb44d9db8ad30b9f10ae605, 9cb8de0701f2482b99e51d5ac080aa13
I20260709 14:54:20.230286 14934 catalog_manager.cc:5697] T 0b12879f49fa4d52a477be2e490f2b38 P 7519e608fbb44d9db8ad30b9f10ae605 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66). New cstate: current_term: 1 leader_uuid: "7519e608fbb44d9db8ad30b9f10ae605" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } health_report { overall_health: UNKNOWN } } }
I20260709 14:54:20.241021 15311 tablet_bootstrap.cc:492] T d178b88fdab54a29b05fb98e05ffe8c5 P eaa34beb1b274443b1c46839afd0a484: Bootstrap starting.
I20260709 14:54:20.244481 15309 ts_tablet_manager.cc:1434] T 8bae8108fe2a4ce0ba3e35746c7ec9d1 P 7519e608fbb44d9db8ad30b9f10ae605: Time spent starting tablet: real 0.214s	user 0.012s	sys 0.000s
W20260709 14:54:20.244606 15001 leader_election.cc:343] T 91c9f89fcb8b45ff9be43f535cafffde P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:20.233827 15606 raft_consensus.cc:2749] T b7c363a305d3434092ef6016b7064eb3 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 14:54:20.264485 15309 tablet_bootstrap.cc:492] T b7c363a305d3434092ef6016b7064eb3 P 7519e608fbb44d9db8ad30b9f10ae605: Bootstrap starting.
I20260709 14:54:20.249318 15574 raft_consensus.cc:493] T 5585b0f6bbf04c10865d2463767621dc P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:20.282384 15004 leader_election.cc:304] T 91c9f89fcb8b45ff9be43f535cafffde P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dbc2c92e49e346b5b3bd7705a229afc6, eaa34beb1b274443b1c46839afd0a484; no voters: 7519e608fbb44d9db8ad30b9f10ae605
I20260709 14:54:20.289091 15307 tablet_bootstrap.cc:492] T c7d360d2b84b4f0aa38f5c325f4521c1 P 9cb8de0701f2482b99e51d5ac080aa13: No bootstrap required, opened a new log
I20260709 14:54:20.289841 15307 ts_tablet_manager.cc:1403] T c7d360d2b84b4f0aa38f5c325f4521c1 P 9cb8de0701f2482b99e51d5ac080aa13: Time spent bootstrapping tablet: real 0.130s	user 0.010s	sys 0.020s
I20260709 14:54:20.277160 15574 raft_consensus.cc:515] T 5585b0f6bbf04c10865d2463767621dc P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:20.294039 15307 raft_consensus.cc:359] T c7d360d2b84b4f0aa38f5c325f4521c1 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:20.295367 15307 raft_consensus.cc:385] T c7d360d2b84b4f0aa38f5c325f4521c1 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:20.296707 15307 raft_consensus.cc:740] T c7d360d2b84b4f0aa38f5c325f4521c1 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9cb8de0701f2482b99e51d5ac080aa13, State: Initialized, Role: FOLLOWER
I20260709 14:54:20.297708 15307 consensus_queue.cc:260] T c7d360d2b84b4f0aa38f5c325f4521c1 P 9cb8de0701f2482b99e51d5ac080aa13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:20.296099 15616 raft_consensus.cc:493] T 9f90ac0a3b004f6ca430ff2fc5198678 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:20.306460 15616 raft_consensus.cc:515] T 9f90ac0a3b004f6ca430ff2fc5198678 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:20.302592 14933 catalog_manager.cc:5697] T 3b4c50fac37a43c0988d5ea911d09f43 P eaa34beb1b274443b1c46839afd0a484 reported cstate change: term changed from 0 to 1, leader changed from <none> to eaa34beb1b274443b1c46839afd0a484 (127.6.101.67). New cstate: current_term: 1 leader_uuid: "eaa34beb1b274443b1c46839afd0a484" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } health_report { overall_health: UNKNOWN } } }
I20260709 14:54:20.305900 15306 raft_consensus.cc:359] T d178b88fdab54a29b05fb98e05ffe8c5 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:20.313787 15306 raft_consensus.cc:385] T d178b88fdab54a29b05fb98e05ffe8c5 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:20.314174 15306 raft_consensus.cc:740] T d178b88fdab54a29b05fb98e05ffe8c5 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbc2c92e49e346b5b3bd7705a229afc6, State: Initialized, Role: FOLLOWER
I20260709 14:54:20.308984 15574 leader_election.cc:290] T 5585b0f6bbf04c10865d2463767621dc P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493), 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177)
I20260709 14:54:20.315027 15306 consensus_queue.cc:260] T d178b88fdab54a29b05fb98e05ffe8c5 P dbc2c92e49e346b5b3bd7705a229afc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:20.317445 15034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f90ac0a3b004f6ca430ff2fc5198678" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" is_pre_election: true
I20260709 14:54:20.308729 15613 raft_consensus.cc:2804] T 91c9f89fcb8b45ff9be43f535cafffde P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:54:20.320243 15613 raft_consensus.cc:697] T 91c9f89fcb8b45ff9be43f535cafffde P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 LEADER]: Becoming Leader. State: Replica: dbc2c92e49e346b5b3bd7705a229afc6, State: Running, Role: LEADER
I20260709 14:54:20.322706 15613 consensus_queue.cc:237] T 91c9f89fcb8b45ff9be43f535cafffde P dbc2c92e49e346b5b3bd7705a229afc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:20.329643 15306 ts_tablet_manager.cc:1434] T d178b88fdab54a29b05fb98e05ffe8c5 P dbc2c92e49e346b5b3bd7705a229afc6: Time spent starting tablet: real 0.110s	user 0.007s	sys 0.002s
W20260709 14:54:20.330495 15153 leader_election.cc:343] T 9f90ac0a3b004f6ca430ff2fc5198678 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:20.331266 15306 tablet_bootstrap.cc:492] T 9f90ac0a3b004f6ca430ff2fc5198678 P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap starting.
I20260709 14:54:20.332582 15309 tablet_bootstrap.cc:654] T b7c363a305d3434092ef6016b7064eb3 P 7519e608fbb44d9db8ad30b9f10ae605: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:20.338094 15307 ts_tablet_manager.cc:1434] T c7d360d2b84b4f0aa38f5c325f4521c1 P 9cb8de0701f2482b99e51d5ac080aa13: Time spent starting tablet: real 0.048s	user 0.008s	sys 0.000s
I20260709 14:54:20.338753 15616 leader_election.cc:290] T 9f90ac0a3b004f6ca430ff2fc5198678 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477), 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177)
I20260709 14:54:20.345898 15113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f90ac0a3b004f6ca430ff2fc5198678" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605" is_pre_election: true
W20260709 14:54:20.348547 15150 leader_election.cc:343] T 9f90ac0a3b004f6ca430ff2fc5198678 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:20.349360 15150 leader_election.cc:304] T 9f90ac0a3b004f6ca430ff2fc5198678 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa34beb1b274443b1c46839afd0a484; no voters: 7519e608fbb44d9db8ad30b9f10ae605, dbc2c92e49e346b5b3bd7705a229afc6
I20260709 14:54:20.374577 15307 tablet_bootstrap.cc:492] T dd44b332dc744f94a5f7cfffc06f3956 P 9cb8de0701f2482b99e51d5ac080aa13: Bootstrap starting.
I20260709 14:54:20.376837 15311 tablet_bootstrap.cc:654] T d178b88fdab54a29b05fb98e05ffe8c5 P eaa34beb1b274443b1c46839afd0a484: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:20.375016 15254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5585b0f6bbf04c10865d2463767621dc" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13" is_pre_election: true
I20260709 14:54:20.377817 15555 raft_consensus.cc:2749] T 9f90ac0a3b004f6ca430ff2fc5198678 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:54:20.378032 15109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5585b0f6bbf04c10865d2463767621dc" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605" is_pre_election: true
I20260709 14:54:20.395107 15432 consensus_queue.cc:1048] T 0b12879f49fa4d52a477be2e490f2b38 P 7519e608fbb44d9db8ad30b9f10ae605 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:54:20.397915 15306 tablet_bootstrap.cc:654] T 9f90ac0a3b004f6ca430ff2fc5198678 P dbc2c92e49e346b5b3bd7705a229afc6: Neither blocks nor log segments found. Creating new log.
W20260709 14:54:20.400415 15001 leader_election.cc:343] T 5585b0f6bbf04c10865d2463767621dc P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177): Illegal state: must be running to vote when last-logged opid is not known
W20260709 14:54:20.403748 15001 leader_election.cc:343] T 5585b0f6bbf04c10865d2463767621dc P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:20.404529 15001 leader_election.cc:304] T 5585b0f6bbf04c10865d2463767621dc P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbc2c92e49e346b5b3bd7705a229afc6; no voters: 7519e608fbb44d9db8ad30b9f10ae605, 9cb8de0701f2482b99e51d5ac080aa13
I20260709 14:54:20.409186 15307 tablet_bootstrap.cc:654] T dd44b332dc744f94a5f7cfffc06f3956 P 9cb8de0701f2482b99e51d5ac080aa13: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:20.411927 15573 raft_consensus.cc:2749] T 5585b0f6bbf04c10865d2463767621dc P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:54:20.451573 15573 raft_consensus.cc:493] T dd44b332dc744f94a5f7cfffc06f3956 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:20.452168 15573 raft_consensus.cc:515] T dd44b332dc744f94a5f7cfffc06f3956 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:20.460031 15555 raft_consensus.cc:493] T 342798bf4325470fa3991757eadb0764 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:20.461372 15555 raft_consensus.cc:515] T 342798bf4325470fa3991757eadb0764 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:20.472039 15309 tablet_bootstrap.cc:492] T b7c363a305d3434092ef6016b7064eb3 P 7519e608fbb44d9db8ad30b9f10ae605: No bootstrap required, opened a new log
I20260709 14:54:20.472580 15309 ts_tablet_manager.cc:1403] T b7c363a305d3434092ef6016b7064eb3 P 7519e608fbb44d9db8ad30b9f10ae605: Time spent bootstrapping tablet: real 0.209s	user 0.025s	sys 0.014s
I20260709 14:54:20.480419 15311 tablet_bootstrap.cc:492] T d178b88fdab54a29b05fb98e05ffe8c5 P eaa34beb1b274443b1c46839afd0a484: No bootstrap required, opened a new log
I20260709 14:54:20.481132 15311 ts_tablet_manager.cc:1403] T d178b88fdab54a29b05fb98e05ffe8c5 P eaa34beb1b274443b1c46839afd0a484: Time spent bootstrapping tablet: real 0.252s	user 0.015s	sys 0.006s
I20260709 14:54:20.482550 15596 raft_consensus.cc:493] T 3b4c50fac37a43c0988d5ea911d09f43 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:20.484732 15254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd44b332dc744f94a5f7cfffc06f3956" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13" is_pre_election: true
I20260709 14:54:20.487748 15311 raft_consensus.cc:359] T d178b88fdab54a29b05fb98e05ffe8c5 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:20.488809 15311 raft_consensus.cc:385] T d178b88fdab54a29b05fb98e05ffe8c5 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:20.489128 15311 raft_consensus.cc:740] T d178b88fdab54a29b05fb98e05ffe8c5 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eaa34beb1b274443b1c46839afd0a484, State: Initialized, Role: FOLLOWER
I20260709 14:54:20.485090 15596 raft_consensus.cc:515] T 3b4c50fac37a43c0988d5ea911d09f43 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:20.489897 15311 consensus_queue.cc:260] T d178b88fdab54a29b05fb98e05ffe8c5 P eaa34beb1b274443b1c46839afd0a484 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:20.491894 15596 leader_election.cc:290] T 3b4c50fac37a43c0988d5ea911d09f43 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805), dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477)
I20260709 14:54:20.493038 15311 ts_tablet_manager.cc:1434] T d178b88fdab54a29b05fb98e05ffe8c5 P eaa34beb1b274443b1c46839afd0a484: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 14:54:20.494280 15109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342798bf4325470fa3991757eadb0764" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605" is_pre_election: true
I20260709 14:54:20.494771 15311 tablet_bootstrap.cc:492] T 594083b10772433f90560d387bbbeabe P eaa34beb1b274443b1c46839afd0a484: Bootstrap starting.
I20260709 14:54:20.492074 15555 leader_election.cc:290] T 342798bf4325470fa3991757eadb0764 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177), 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493)
W20260709 14:54:20.504737 15150 leader_election.cc:343] T 342798bf4325470fa3991757eadb0764 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:20.502241 15184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4c50fac37a43c0988d5ea911d09f43" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484" is_pre_election: true
I20260709 14:54:20.495200 15573 leader_election.cc:290] T dd44b332dc744f94a5f7cfffc06f3956 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493), 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177)
I20260709 14:54:20.509449 15492 raft_consensus.cc:493] T 8bae8108fe2a4ce0ba3e35746c7ec9d1 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:20.510080 15113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd44b332dc744f94a5f7cfffc06f3956" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605" is_pre_election: true
I20260709 14:54:20.510145 15492 raft_consensus.cc:515] T 8bae8108fe2a4ce0ba3e35746c7ec9d1 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:20.511629 15309 raft_consensus.cc:359] T b7c363a305d3434092ef6016b7064eb3 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:20.512306 15309 raft_consensus.cc:385] T b7c363a305d3434092ef6016b7064eb3 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:20.512584 15309 raft_consensus.cc:740] T b7c363a305d3434092ef6016b7064eb3 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7519e608fbb44d9db8ad30b9f10ae605, State: Initialized, Role: FOLLOWER
I20260709 14:54:20.515028 15492 leader_election.cc:290] T 8bae8108fe2a4ce0ba3e35746c7ec9d1 P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477), eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805)
I20260709 14:54:20.516253 15034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4c50fac37a43c0988d5ea911d09f43" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" is_pre_election: true
I20260709 14:54:20.516914 15185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bae8108fe2a4ce0ba3e35746c7ec9d1" candidate_uuid: "7519e608fbb44d9db8ad30b9f10ae605" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484" is_pre_election: true
I20260709 14:54:20.517675 15034 raft_consensus.cc:2393] T 3b4c50fac37a43c0988d5ea911d09f43 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9cb8de0701f2482b99e51d5ac080aa13 in current term 1: Already voted for candidate eaa34beb1b274443b1c46839afd0a484 in this term.
I20260709 14:54:20.517699 15109 raft_consensus.cc:3060] T 8bae8108fe2a4ce0ba3e35746c7ec9d1 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:20.502126 15254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342798bf4325470fa3991757eadb0764" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13" is_pre_election: true
I20260709 14:54:20.528371 15309 consensus_queue.cc:260] T b7c363a305d3434092ef6016b7064eb3 P 7519e608fbb44d9db8ad30b9f10ae605 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
W20260709 14:54:20.503346 15001 leader_election.cc:343] T dd44b332dc744f94a5f7cfffc06f3956 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493): Illegal state: must be running to vote when last-logged opid is not known
W20260709 14:54:20.530974 15150 leader_election.cc:343] T 342798bf4325470fa3991757eadb0764 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493): Illegal state: must be running to vote when last-logged opid is not known
W20260709 14:54:20.531901 15001 leader_election.cc:343] T dd44b332dc744f94a5f7cfffc06f3956 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:20.532752 15001 leader_election.cc:304] T dd44b332dc744f94a5f7cfffc06f3956 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbc2c92e49e346b5b3bd7705a229afc6; no voters: 7519e608fbb44d9db8ad30b9f10ae605, 9cb8de0701f2482b99e51d5ac080aa13
I20260709 14:54:20.532857 15150 leader_election.cc:304] T 342798bf4325470fa3991757eadb0764 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa34beb1b274443b1c46839afd0a484; no voters: 7519e608fbb44d9db8ad30b9f10ae605, 9cb8de0701f2482b99e51d5ac080aa13
I20260709 14:54:20.532877 15227 leader_election.cc:304] T 3b4c50fac37a43c0988d5ea911d09f43 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cb8de0701f2482b99e51d5ac080aa13; no voters: dbc2c92e49e346b5b3bd7705a229afc6, eaa34beb1b274443b1c46839afd0a484
I20260709 14:54:20.539834 15034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bae8108fe2a4ce0ba3e35746c7ec9d1" candidate_uuid: "7519e608fbb44d9db8ad30b9f10ae605" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" is_pre_election: true
I20260709 14:54:20.541143 15545 raft_consensus.cc:3060] T 3b4c50fac37a43c0988d5ea911d09f43 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:20.541764 15311 tablet_bootstrap.cc:654] T 594083b10772433f90560d387bbbeabe P eaa34beb1b274443b1c46839afd0a484: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:20.545683 15079 leader_election.cc:304] T 8bae8108fe2a4ce0ba3e35746c7ec9d1 P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7519e608fbb44d9db8ad30b9f10ae605; no voters: dbc2c92e49e346b5b3bd7705a229afc6, eaa34beb1b274443b1c46839afd0a484
I20260709 14:54:20.546186 15573 raft_consensus.cc:2749] T dd44b332dc744f94a5f7cfffc06f3956 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:54:20.555136 15309 ts_tablet_manager.cc:1434] T b7c363a305d3434092ef6016b7064eb3 P 7519e608fbb44d9db8ad30b9f10ae605: Time spent starting tablet: real 0.082s	user 0.011s	sys 0.000s
I20260709 14:54:20.556619 15309 tablet_bootstrap.cc:492] T c7d360d2b84b4f0aa38f5c325f4521c1 P 7519e608fbb44d9db8ad30b9f10ae605: Bootstrap starting.
I20260709 14:54:20.558831 15306 tablet_bootstrap.cc:492] T 9f90ac0a3b004f6ca430ff2fc5198678 P dbc2c92e49e346b5b3bd7705a229afc6: No bootstrap required, opened a new log
I20260709 14:54:20.559748 15306 ts_tablet_manager.cc:1403] T 9f90ac0a3b004f6ca430ff2fc5198678 P dbc2c92e49e346b5b3bd7705a229afc6: Time spent bootstrapping tablet: real 0.229s	user 0.025s	sys 0.012s
I20260709 14:54:20.563515 15306 raft_consensus.cc:359] T 9f90ac0a3b004f6ca430ff2fc5198678 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:20.564421 15306 raft_consensus.cc:385] T 9f90ac0a3b004f6ca430ff2fc5198678 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:20.564730 15306 raft_consensus.cc:740] T 9f90ac0a3b004f6ca430ff2fc5198678 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbc2c92e49e346b5b3bd7705a229afc6, State: Initialized, Role: FOLLOWER
I20260709 14:54:20.546516 15555 raft_consensus.cc:2749] T 342798bf4325470fa3991757eadb0764 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:54:20.563687 15307 tablet_bootstrap.cc:492] T dd44b332dc744f94a5f7cfffc06f3956 P 9cb8de0701f2482b99e51d5ac080aa13: No bootstrap required, opened a new log
I20260709 14:54:20.569283 15307 ts_tablet_manager.cc:1403] T dd44b332dc744f94a5f7cfffc06f3956 P 9cb8de0701f2482b99e51d5ac080aa13: Time spent bootstrapping tablet: real 0.195s	user 0.022s	sys 0.008s
I20260709 14:54:20.582240 15545 raft_consensus.cc:2749] T 3b4c50fac37a43c0988d5ea911d09f43 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:54:20.592280 14932 catalog_manager.cc:5697] T 91c9f89fcb8b45ff9be43f535cafffde P dbc2c92e49e346b5b3bd7705a229afc6 reported cstate change: term changed from 0 to 1, leader changed from <none> to dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65). New cstate: current_term: 1 leader_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } health_report { overall_health: UNKNOWN } } }
I20260709 14:54:20.597548 15623 consensus_queue.cc:1048] T 3b4c50fac37a43c0988d5ea911d09f43 P eaa34beb1b274443b1c46839afd0a484 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:54:20.585168 15309 tablet_bootstrap.cc:654] T c7d360d2b84b4f0aa38f5c325f4521c1 P 7519e608fbb44d9db8ad30b9f10ae605: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:20.585520 15430 raft_consensus.cc:493] T d178b88fdab54a29b05fb98e05ffe8c5 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:20.601646 15430 raft_consensus.cc:515] T d178b88fdab54a29b05fb98e05ffe8c5 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:20.604910 15430 leader_election.cc:290] T d178b88fdab54a29b05fb98e05ffe8c5 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493), dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477)
I20260709 14:54:20.612789 15311 tablet_bootstrap.cc:492] T 594083b10772433f90560d387bbbeabe P eaa34beb1b274443b1c46839afd0a484: No bootstrap required, opened a new log
I20260709 14:54:20.614529 15311 ts_tablet_manager.cc:1403] T 594083b10772433f90560d387bbbeabe P eaa34beb1b274443b1c46839afd0a484: Time spent bootstrapping tablet: real 0.120s	user 0.015s	sys 0.002s
I20260709 14:54:20.615347 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d178b88fdab54a29b05fb98e05ffe8c5" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" is_pre_election: true
I20260709 14:54:20.617295 15254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d178b88fdab54a29b05fb98e05ffe8c5" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13" is_pre_election: true
I20260709 14:54:20.618100 15311 raft_consensus.cc:359] T 594083b10772433f90560d387bbbeabe P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
W20260709 14:54:20.619235 15150 leader_election.cc:343] T d178b88fdab54a29b05fb98e05ffe8c5 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:20.546955 15613 raft_consensus.cc:493] T d178b88fdab54a29b05fb98e05ffe8c5 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:20.624073 15613 raft_consensus.cc:515] T d178b88fdab54a29b05fb98e05ffe8c5 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:20.625528 15307 raft_consensus.cc:359] T dd44b332dc744f94a5f7cfffc06f3956 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:20.626655 15307 raft_consensus.cc:385] T dd44b332dc744f94a5f7cfffc06f3956 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:20.627044 15307 raft_consensus.cc:740] T dd44b332dc744f94a5f7cfffc06f3956 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9cb8de0701f2482b99e51d5ac080aa13, State: Initialized, Role: FOLLOWER
I20260709 14:54:20.619099 15311 raft_consensus.cc:385] T 594083b10772433f90560d387bbbeabe P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:20.630491 15311 raft_consensus.cc:740] T 594083b10772433f90560d387bbbeabe P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eaa34beb1b274443b1c46839afd0a484, State: Initialized, Role: FOLLOWER
I20260709 14:54:20.630797 15035 raft_consensus.cc:2468] T d178b88fdab54a29b05fb98e05ffe8c5 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa34beb1b274443b1c46839afd0a484 in term 0.
I20260709 14:54:20.635088 15599 raft_consensus.cc:2749] T 8bae8108fe2a4ce0ba3e35746c7ec9d1 P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:54:20.638655 15307 consensus_queue.cc:260] T dd44b332dc744f94a5f7cfffc06f3956 P 9cb8de0701f2482b99e51d5ac080aa13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:20.639925 15153 leader_election.cc:304] T d178b88fdab54a29b05fb98e05ffe8c5 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dbc2c92e49e346b5b3bd7705a229afc6, eaa34beb1b274443b1c46839afd0a484; no voters: 9cb8de0701f2482b99e51d5ac080aa13
I20260709 14:54:20.641857 15183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d178b88fdab54a29b05fb98e05ffe8c5" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484" is_pre_election: true
I20260709 14:54:20.642105 15254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d178b88fdab54a29b05fb98e05ffe8c5" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13" is_pre_election: true
I20260709 14:54:20.642691 15183 raft_consensus.cc:2468] T d178b88fdab54a29b05fb98e05ffe8c5 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbc2c92e49e346b5b3bd7705a229afc6 in term 0.
W20260709 14:54:20.645092 15001 leader_election.cc:343] T d178b88fdab54a29b05fb98e05ffe8c5 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:20.646981 15004 leader_election.cc:304] T d178b88fdab54a29b05fb98e05ffe8c5 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dbc2c92e49e346b5b3bd7705a229afc6, eaa34beb1b274443b1c46839afd0a484; no voters: 9cb8de0701f2482b99e51d5ac080aa13
I20260709 14:54:20.648140 15499 raft_consensus.cc:2804] T d178b88fdab54a29b05fb98e05ffe8c5 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:54:20.648325 15555 raft_consensus.cc:2804] T d178b88fdab54a29b05fb98e05ffe8c5 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:54:20.648929 15499 raft_consensus.cc:493] T d178b88fdab54a29b05fb98e05ffe8c5 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:54:20.649762 15499 raft_consensus.cc:3060] T d178b88fdab54a29b05fb98e05ffe8c5 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:20.650293 15555 raft_consensus.cc:493] T d178b88fdab54a29b05fb98e05ffe8c5 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:54:20.655035 15555 raft_consensus.cc:3060] T d178b88fdab54a29b05fb98e05ffe8c5 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:20.650866 15306 consensus_queue.cc:260] T 9f90ac0a3b004f6ca430ff2fc5198678 P dbc2c92e49e346b5b3bd7705a229afc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:20.641587 15307 ts_tablet_manager.cc:1434] T dd44b332dc744f94a5f7cfffc06f3956 P 9cb8de0701f2482b99e51d5ac080aa13: Time spent starting tablet: real 0.072s	user 0.008s	sys 0.000s
I20260709 14:54:20.660919 15306 ts_tablet_manager.cc:1434] T 9f90ac0a3b004f6ca430ff2fc5198678 P dbc2c92e49e346b5b3bd7705a229afc6: Time spent starting tablet: real 0.101s	user 0.007s	sys 0.001s
I20260709 14:54:20.670033 15309 tablet_bootstrap.cc:492] T c7d360d2b84b4f0aa38f5c325f4521c1 P 7519e608fbb44d9db8ad30b9f10ae605: No bootstrap required, opened a new log
I20260709 14:54:20.661187 15640 consensus_queue.cc:1048] T 3b4c50fac37a43c0988d5ea911d09f43 P eaa34beb1b274443b1c46839afd0a484 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:54:20.670709 15309 ts_tablet_manager.cc:1403] T c7d360d2b84b4f0aa38f5c325f4521c1 P 7519e608fbb44d9db8ad30b9f10ae605: Time spent bootstrapping tablet: real 0.114s	user 0.017s	sys 0.000s
I20260709 14:54:20.648612 15613 leader_election.cc:290] T d178b88fdab54a29b05fb98e05ffe8c5 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805), 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493)
I20260709 14:54:20.672402 15307 tablet_bootstrap.cc:492] T 5585b0f6bbf04c10865d2463767621dc P 9cb8de0701f2482b99e51d5ac080aa13: Bootstrap starting.
I20260709 14:54:20.631409 15311 consensus_queue.cc:260] T 594083b10772433f90560d387bbbeabe P eaa34beb1b274443b1c46839afd0a484 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:20.679463 15309 raft_consensus.cc:359] T c7d360d2b84b4f0aa38f5c325f4521c1 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:20.680317 15309 raft_consensus.cc:385] T c7d360d2b84b4f0aa38f5c325f4521c1 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:20.680867 15309 raft_consensus.cc:740] T c7d360d2b84b4f0aa38f5c325f4521c1 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7519e608fbb44d9db8ad30b9f10ae605, State: Initialized, Role: FOLLOWER
I20260709 14:54:20.684473 15309 consensus_queue.cc:260] T c7d360d2b84b4f0aa38f5c325f4521c1 P 7519e608fbb44d9db8ad30b9f10ae605 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:20.686686 15306 tablet_bootstrap.cc:492] T 594083b10772433f90560d387bbbeabe P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap starting.
I20260709 14:54:20.691908 15311 ts_tablet_manager.cc:1434] T 594083b10772433f90560d387bbbeabe P eaa34beb1b274443b1c46839afd0a484: Time spent starting tablet: real 0.077s	user 0.008s	sys 0.000s
I20260709 14:54:20.692931 15311 tablet_bootstrap.cc:492] T e43bf64543ef494790c2f7a4a063fdd1 P eaa34beb1b274443b1c46839afd0a484: Bootstrap starting.
I20260709 14:54:20.694561 15309 ts_tablet_manager.cc:1434] T c7d360d2b84b4f0aa38f5c325f4521c1 P 7519e608fbb44d9db8ad30b9f10ae605: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.000s
I20260709 14:54:20.704522 15492 raft_consensus.cc:493] T b7c363a305d3434092ef6016b7064eb3 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:20.708853 15492 raft_consensus.cc:515] T b7c363a305d3434092ef6016b7064eb3 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:20.713265 15034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7c363a305d3434092ef6016b7064eb3" candidate_uuid: "7519e608fbb44d9db8ad30b9f10ae605" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" is_pre_election: true
I20260709 14:54:20.714342 15034 raft_consensus.cc:2393] T b7c363a305d3434092ef6016b7064eb3 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7519e608fbb44d9db8ad30b9f10ae605 in current term 1: Already voted for candidate dbc2c92e49e346b5b3bd7705a229afc6 in this term.
I20260709 14:54:20.713203 15307 tablet_bootstrap.cc:654] T 5585b0f6bbf04c10865d2463767621dc P 9cb8de0701f2482b99e51d5ac080aa13: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:20.722146 15309 tablet_bootstrap.cc:492] T 91c9f89fcb8b45ff9be43f535cafffde P 7519e608fbb44d9db8ad30b9f10ae605: Bootstrap starting.
I20260709 14:54:20.725536 15259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7c363a305d3434092ef6016b7064eb3" candidate_uuid: "7519e608fbb44d9db8ad30b9f10ae605" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13" is_pre_election: true
I20260709 14:54:20.726677 15259 raft_consensus.cc:2393] T b7c363a305d3434092ef6016b7064eb3 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7519e608fbb44d9db8ad30b9f10ae605 in current term 1: Already voted for candidate 9cb8de0701f2482b99e51d5ac080aa13 in this term.
I20260709 14:54:20.728854 15076 leader_election.cc:304] T b7c363a305d3434092ef6016b7064eb3 P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7519e608fbb44d9db8ad30b9f10ae605; no voters: 9cb8de0701f2482b99e51d5ac080aa13, dbc2c92e49e346b5b3bd7705a229afc6
I20260709 14:54:20.735440 15432 raft_consensus.cc:3060] T b7c363a305d3434092ef6016b7064eb3 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:20.721860 15492 leader_election.cc:290] T b7c363a305d3434092ef6016b7064eb3 P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493), dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477)
I20260709 14:54:20.745955 15499 raft_consensus.cc:515] T d178b88fdab54a29b05fb98e05ffe8c5 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:20.748932 15499 leader_election.cc:290] T d178b88fdab54a29b05fb98e05ffe8c5 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 election: Requested vote from peers eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805), 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493)
I20260709 14:54:20.751261 15183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d178b88fdab54a29b05fb98e05ffe8c5" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484"
I20260709 14:54:20.752554 15596 raft_consensus.cc:493] T c7d360d2b84b4f0aa38f5c325f4521c1 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:20.753868 15596 raft_consensus.cc:515] T c7d360d2b84b4f0aa38f5c325f4521c1 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:20.756289 15596 leader_election.cc:290] T c7d360d2b84b4f0aa38f5c325f4521c1 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177), eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805)
I20260709 14:54:20.762245 15106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d360d2b84b4f0aa38f5c325f4521c1" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605" is_pre_election: true
I20260709 14:54:20.762874 15185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d360d2b84b4f0aa38f5c325f4521c1" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484" is_pre_election: true
I20260709 14:54:20.763274 15106 raft_consensus.cc:2468] T c7d360d2b84b4f0aa38f5c325f4521c1 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cb8de0701f2482b99e51d5ac080aa13 in term 0.
I20260709 14:54:20.763567 15185 raft_consensus.cc:2468] T c7d360d2b84b4f0aa38f5c325f4521c1 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cb8de0701f2482b99e51d5ac080aa13 in term 0.
I20260709 14:54:20.765327 15224 leader_election.cc:304] T c7d360d2b84b4f0aa38f5c325f4521c1 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7519e608fbb44d9db8ad30b9f10ae605, 9cb8de0701f2482b99e51d5ac080aa13; no voters: 
I20260709 14:54:20.765542 15254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d178b88fdab54a29b05fb98e05ffe8c5" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13"
I20260709 14:54:20.775404 15346 raft_consensus.cc:2804] T c7d360d2b84b4f0aa38f5c325f4521c1 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:54:20.778678 15346 raft_consensus.cc:493] T c7d360d2b84b4f0aa38f5c325f4521c1 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:54:20.783794 15346 raft_consensus.cc:3060] T c7d360d2b84b4f0aa38f5c325f4521c1 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Advancing to term 1
W20260709 14:54:20.784857 15001 leader_election.cc:343] T d178b88fdab54a29b05fb98e05ffe8c5 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:20.791695 15311 tablet_bootstrap.cc:654] T e43bf64543ef494790c2f7a4a063fdd1 P eaa34beb1b274443b1c46839afd0a484: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:20.794672 15306 tablet_bootstrap.cc:654] T 594083b10772433f90560d387bbbeabe P dbc2c92e49e346b5b3bd7705a229afc6: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:20.797364 15432 raft_consensus.cc:2749] T b7c363a305d3434092ef6016b7064eb3 P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:54:20.813452 15596 raft_consensus.cc:493] T dd44b332dc744f94a5f7cfffc06f3956 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:20.814216 15596 raft_consensus.cc:515] T dd44b332dc744f94a5f7cfffc06f3956 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:20.814993 15555 raft_consensus.cc:515] T d178b88fdab54a29b05fb98e05ffe8c5 P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:20.822073 15183 raft_consensus.cc:2393] T d178b88fdab54a29b05fb98e05ffe8c5 P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate dbc2c92e49e346b5b3bd7705a229afc6 in current term 1: Already voted for candidate eaa34beb1b274443b1c46839afd0a484 in this term.
I20260709 14:54:20.823463 15034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd44b332dc744f94a5f7cfffc06f3956" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" is_pre_election: true
I20260709 14:54:20.824375 15034 raft_consensus.cc:2468] T dd44b332dc744f94a5f7cfffc06f3956 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cb8de0701f2482b99e51d5ac080aa13 in term 0.
I20260709 14:54:20.826104 15254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d178b88fdab54a29b05fb98e05ffe8c5" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13"
I20260709 14:54:20.827458 15346 raft_consensus.cc:515] T c7d360d2b84b4f0aa38f5c325f4521c1 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:20.819136 15109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd44b332dc744f94a5f7cfffc06f3956" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605" is_pre_election: true
I20260709 14:54:20.816784 15596 leader_election.cc:290] T dd44b332dc744f94a5f7cfffc06f3956 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477), 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177)
W20260709 14:54:20.829962 15224 leader_election.cc:343] T dd44b332dc744f94a5f7cfffc06f3956 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:20.830623 15555 leader_election.cc:290] T d178b88fdab54a29b05fb98e05ffe8c5 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 election: Requested vote from peers 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493), dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477)
I20260709 14:54:20.827643 15004 leader_election.cc:304] T d178b88fdab54a29b05fb98e05ffe8c5 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbc2c92e49e346b5b3bd7705a229afc6; no voters: 9cb8de0701f2482b99e51d5ac080aa13, eaa34beb1b274443b1c46839afd0a484
I20260709 14:54:20.821007 15309 tablet_bootstrap.cc:654] T 91c9f89fcb8b45ff9be43f535cafffde P 7519e608fbb44d9db8ad30b9f10ae605: Neither blocks nor log segments found. Creating new log.
W20260709 14:54:20.836024 15150 leader_election.cc:343] T d178b88fdab54a29b05fb98e05ffe8c5 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:20.837548 15227 leader_election.cc:304] T dd44b332dc744f94a5f7cfffc06f3956 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9cb8de0701f2482b99e51d5ac080aa13, dbc2c92e49e346b5b3bd7705a229afc6; no voters: 7519e608fbb44d9db8ad30b9f10ae605
I20260709 14:54:20.834546 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d178b88fdab54a29b05fb98e05ffe8c5" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc2c92e49e346b5b3bd7705a229afc6"
I20260709 14:54:20.838397 15499 raft_consensus.cc:2749] T d178b88fdab54a29b05fb98e05ffe8c5 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 14:54:20.839725 15035 raft_consensus.cc:2393] T d178b88fdab54a29b05fb98e05ffe8c5 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate eaa34beb1b274443b1c46839afd0a484 in current term 1: Already voted for candidate dbc2c92e49e346b5b3bd7705a229afc6 in this term.
I20260709 14:54:20.839418 15596 raft_consensus.cc:2804] T dd44b332dc744f94a5f7cfffc06f3956 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:54:20.840406 15596 raft_consensus.cc:493] T dd44b332dc744f94a5f7cfffc06f3956 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:54:20.841722 15153 leader_election.cc:304] T d178b88fdab54a29b05fb98e05ffe8c5 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa34beb1b274443b1c46839afd0a484; no voters: 9cb8de0701f2482b99e51d5ac080aa13, dbc2c92e49e346b5b3bd7705a229afc6
I20260709 14:54:20.844861 15596 raft_consensus.cc:3060] T dd44b332dc744f94a5f7cfffc06f3956 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:20.861680 15555 raft_consensus.cc:2749] T d178b88fdab54a29b05fb98e05ffe8c5 P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 14:54:20.890638 15109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d360d2b84b4f0aa38f5c325f4521c1" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605"
I20260709 14:54:20.892247 15109 raft_consensus.cc:3060] T c7d360d2b84b4f0aa38f5c325f4521c1 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:20.891224 15596 raft_consensus.cc:515] T dd44b332dc744f94a5f7cfffc06f3956 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:20.899406 15346 leader_election.cc:290] T c7d360d2b84b4f0aa38f5c325f4521c1 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 election: Requested vote from peers 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177), eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805)
I20260709 14:54:20.903266 15311 tablet_bootstrap.cc:492] T e43bf64543ef494790c2f7a4a063fdd1 P eaa34beb1b274443b1c46839afd0a484: No bootstrap required, opened a new log
I20260709 14:54:20.904116 15307 tablet_bootstrap.cc:492] T 5585b0f6bbf04c10865d2463767621dc P 9cb8de0701f2482b99e51d5ac080aa13: No bootstrap required, opened a new log
I20260709 14:54:20.913190 15307 ts_tablet_manager.cc:1403] T 5585b0f6bbf04c10865d2463767621dc P 9cb8de0701f2482b99e51d5ac080aa13: Time spent bootstrapping tablet: real 0.241s	user 0.015s	sys 0.010s
I20260709 14:54:20.914460 15311 ts_tablet_manager.cc:1403] T e43bf64543ef494790c2f7a4a063fdd1 P eaa34beb1b274443b1c46839afd0a484: Time spent bootstrapping tablet: real 0.222s	user 0.023s	sys 0.012s
I20260709 14:54:20.915313 15183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d360d2b84b4f0aa38f5c325f4521c1" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484"
I20260709 14:54:20.916213 15183 raft_consensus.cc:3060] T c7d360d2b84b4f0aa38f5c325f4521c1 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:20.924811 15307 raft_consensus.cc:359] T 5585b0f6bbf04c10865d2463767621dc P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:20.927299 15307 raft_consensus.cc:385] T 5585b0f6bbf04c10865d2463767621dc P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:20.927598 15307 raft_consensus.cc:740] T 5585b0f6bbf04c10865d2463767621dc P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9cb8de0701f2482b99e51d5ac080aa13, State: Initialized, Role: FOLLOWER
I20260709 14:54:20.929605 15309 tablet_bootstrap.cc:492] T 91c9f89fcb8b45ff9be43f535cafffde P 7519e608fbb44d9db8ad30b9f10ae605: No bootstrap required, opened a new log
I20260709 14:54:20.930313 15309 ts_tablet_manager.cc:1403] T 91c9f89fcb8b45ff9be43f535cafffde P 7519e608fbb44d9db8ad30b9f10ae605: Time spent bootstrapping tablet: real 0.223s	user 0.020s	sys 0.007s
I20260709 14:54:20.926283 15034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd44b332dc744f94a5f7cfffc06f3956" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc2c92e49e346b5b3bd7705a229afc6"
I20260709 14:54:20.932353 15034 raft_consensus.cc:3060] T dd44b332dc744f94a5f7cfffc06f3956 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:20.941840 15309 raft_consensus.cc:359] T 91c9f89fcb8b45ff9be43f535cafffde P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:20.942780 15309 raft_consensus.cc:385] T 91c9f89fcb8b45ff9be43f535cafffde P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:20.943112 15309 raft_consensus.cc:740] T 91c9f89fcb8b45ff9be43f535cafffde P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7519e608fbb44d9db8ad30b9f10ae605, State: Initialized, Role: FOLLOWER
I20260709 14:54:20.943994 15309 consensus_queue.cc:260] T 91c9f89fcb8b45ff9be43f535cafffde P 7519e608fbb44d9db8ad30b9f10ae605 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:20.945353 15106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd44b332dc744f94a5f7cfffc06f3956" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605"
I20260709 14:54:20.947688 15309 ts_tablet_manager.cc:1434] T 91c9f89fcb8b45ff9be43f535cafffde P 7519e608fbb44d9db8ad30b9f10ae605: Time spent starting tablet: real 0.017s	user 0.010s	sys 0.000s
W20260709 14:54:20.948704 15224 leader_election.cc:343] T dd44b332dc744f94a5f7cfffc06f3956 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:20.951851 15309 tablet_bootstrap.cc:492] T 5585b0f6bbf04c10865d2463767621dc P 7519e608fbb44d9db8ad30b9f10ae605: Bootstrap starting.
I20260709 14:54:20.948132 15311 raft_consensus.cc:359] T e43bf64543ef494790c2f7a4a063fdd1 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:20.950819 15596 leader_election.cc:290] T dd44b332dc744f94a5f7cfffc06f3956 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 election: Requested vote from peers dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477), 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177)
I20260709 14:54:20.954217 15106 raft_consensus.cc:3060] T 91c9f89fcb8b45ff9be43f535cafffde P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:20.938251 15109 raft_consensus.cc:2468] T c7d360d2b84b4f0aa38f5c325f4521c1 P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cb8de0701f2482b99e51d5ac080aa13 in term 1.
I20260709 14:54:20.955859 15311 raft_consensus.cc:385] T e43bf64543ef494790c2f7a4a063fdd1 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:20.949602 15307 consensus_queue.cc:260] T 5585b0f6bbf04c10865d2463767621dc P 9cb8de0701f2482b99e51d5ac080aa13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:20.962389 15311 raft_consensus.cc:740] T e43bf64543ef494790c2f7a4a063fdd1 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eaa34beb1b274443b1c46839afd0a484, State: Initialized, Role: FOLLOWER
I20260709 14:54:20.964720 15311 consensus_queue.cc:260] T e43bf64543ef494790c2f7a4a063fdd1 P eaa34beb1b274443b1c46839afd0a484 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:20.967344 15311 ts_tablet_manager.cc:1434] T e43bf64543ef494790c2f7a4a063fdd1 P eaa34beb1b274443b1c46839afd0a484: Time spent starting tablet: real 0.052s	user 0.011s	sys 0.000s
I20260709 14:54:20.968744 15311 tablet_bootstrap.cc:492] T 4abdbdda3ce149a9904e919be18e7a3f P eaa34beb1b274443b1c46839afd0a484: Bootstrap starting.
I20260709 14:54:20.973562 15573 consensus_queue.cc:1048] T 91c9f89fcb8b45ff9be43f535cafffde P dbc2c92e49e346b5b3bd7705a229afc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:54:20.978462 15311 tablet_bootstrap.cc:654] T 4abdbdda3ce149a9904e919be18e7a3f P eaa34beb1b274443b1c46839afd0a484: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:20.973488 15224 leader_election.cc:304] T c7d360d2b84b4f0aa38f5c325f4521c1 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7519e608fbb44d9db8ad30b9f10ae605, 9cb8de0701f2482b99e51d5ac080aa13; no voters: 
I20260709 14:54:20.953018 15183 raft_consensus.cc:2468] T c7d360d2b84b4f0aa38f5c325f4521c1 P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cb8de0701f2482b99e51d5ac080aa13 in term 1.
I20260709 14:54:20.989527 15309 tablet_bootstrap.cc:654] T 5585b0f6bbf04c10865d2463767621dc P 7519e608fbb44d9db8ad30b9f10ae605: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:20.981488 15307 ts_tablet_manager.cc:1434] T 5585b0f6bbf04c10865d2463767621dc P 9cb8de0701f2482b99e51d5ac080aa13: Time spent starting tablet: real 0.068s	user 0.006s	sys 0.007s
I20260709 14:54:20.983425 15346 raft_consensus.cc:2804] T c7d360d2b84b4f0aa38f5c325f4521c1 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:54:20.995870 15346 raft_consensus.cc:697] T c7d360d2b84b4f0aa38f5c325f4521c1 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 LEADER]: Becoming Leader. State: Replica: 9cb8de0701f2482b99e51d5ac080aa13, State: Running, Role: LEADER
I20260709 14:54:21.000912 15307 tablet_bootstrap.cc:492] T 342798bf4325470fa3991757eadb0764 P 9cb8de0701f2482b99e51d5ac080aa13: Bootstrap starting.
I20260709 14:54:20.997144 15346 consensus_queue.cc:237] T c7d360d2b84b4f0aa38f5c325f4521c1 P 9cb8de0701f2482b99e51d5ac080aa13 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:21.003232 15306 tablet_bootstrap.cc:492] T 594083b10772433f90560d387bbbeabe P dbc2c92e49e346b5b3bd7705a229afc6: No bootstrap required, opened a new log
I20260709 14:54:21.005887 15306 ts_tablet_manager.cc:1403] T 594083b10772433f90560d387bbbeabe P dbc2c92e49e346b5b3bd7705a229afc6: Time spent bootstrapping tablet: real 0.319s	user 0.010s	sys 0.028s
I20260709 14:54:21.025331 15034 raft_consensus.cc:2468] T dd44b332dc744f94a5f7cfffc06f3956 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cb8de0701f2482b99e51d5ac080aa13 in term 1.
I20260709 14:54:21.026026 15306 raft_consensus.cc:359] T 594083b10772433f90560d387bbbeabe P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:21.030110 15306 raft_consensus.cc:385] T 594083b10772433f90560d387bbbeabe P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:21.030587 15306 raft_consensus.cc:740] T 594083b10772433f90560d387bbbeabe P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbc2c92e49e346b5b3bd7705a229afc6, State: Initialized, Role: FOLLOWER
I20260709 14:54:21.034116 15306 consensus_queue.cc:260] T 594083b10772433f90560d387bbbeabe P dbc2c92e49e346b5b3bd7705a229afc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:21.055809 15307 tablet_bootstrap.cc:654] T 342798bf4325470fa3991757eadb0764 P 9cb8de0701f2482b99e51d5ac080aa13: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:21.056342 15499 consensus_queue.cc:1048] T 91c9f89fcb8b45ff9be43f535cafffde P dbc2c92e49e346b5b3bd7705a229afc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:54:21.057644 15309 tablet_bootstrap.cc:492] T 5585b0f6bbf04c10865d2463767621dc P 7519e608fbb44d9db8ad30b9f10ae605: No bootstrap required, opened a new log
I20260709 14:54:21.058511 15309 ts_tablet_manager.cc:1403] T 5585b0f6bbf04c10865d2463767621dc P 7519e608fbb44d9db8ad30b9f10ae605: Time spent bootstrapping tablet: real 0.107s	user 0.014s	sys 0.008s
I20260709 14:54:21.069882 15499 raft_consensus.cc:493] T 9f90ac0a3b004f6ca430ff2fc5198678 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:21.070451 15309 raft_consensus.cc:359] T 5585b0f6bbf04c10865d2463767621dc P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:21.068928 15306 ts_tablet_manager.cc:1434] T 594083b10772433f90560d387bbbeabe P dbc2c92e49e346b5b3bd7705a229afc6: Time spent starting tablet: real 0.063s	user 0.008s	sys 0.002s
I20260709 14:54:21.071410 15309 raft_consensus.cc:385] T 5585b0f6bbf04c10865d2463767621dc P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:21.072687 15309 raft_consensus.cc:740] T 5585b0f6bbf04c10865d2463767621dc P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7519e608fbb44d9db8ad30b9f10ae605, State: Initialized, Role: FOLLOWER
I20260709 14:54:21.073230 15306 tablet_bootstrap.cc:492] T 5e8a01e27eab492bb73df3359e500627 P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap starting.
I20260709 14:54:21.073561 15227 leader_election.cc:304] T dd44b332dc744f94a5f7cfffc06f3956 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9cb8de0701f2482b99e51d5ac080aa13, dbc2c92e49e346b5b3bd7705a229afc6; no voters: 7519e608fbb44d9db8ad30b9f10ae605
I20260709 14:54:21.074108 15309 consensus_queue.cc:260] T 5585b0f6bbf04c10865d2463767621dc P 7519e608fbb44d9db8ad30b9f10ae605 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:21.070677 15499 raft_consensus.cc:515] T 9f90ac0a3b004f6ca430ff2fc5198678 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:21.076493 15596 raft_consensus.cc:2804] T dd44b332dc744f94a5f7cfffc06f3956 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:54:21.096000 15499 leader_election.cc:290] T 9f90ac0a3b004f6ca430ff2fc5198678 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177), eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805)
I20260709 14:54:21.077500 15555 raft_consensus.cc:493] T 594083b10772433f90560d387bbbeabe P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:21.097694 15555 raft_consensus.cc:515] T 594083b10772433f90560d387bbbeabe P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:21.100219 15555 leader_election.cc:290] T 594083b10772433f90560d387bbbeabe P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493), dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477)
I20260709 14:54:21.105599 15185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f90ac0a3b004f6ca430ff2fc5198678" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484" is_pre_election: true
I20260709 14:54:21.106653 15185 raft_consensus.cc:2468] T 9f90ac0a3b004f6ca430ff2fc5198678 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbc2c92e49e346b5b3bd7705a229afc6 in term 0.
I20260709 14:54:21.108177 15109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f90ac0a3b004f6ca430ff2fc5198678" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605" is_pre_election: true
I20260709 14:54:21.109421 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594083b10772433f90560d387bbbeabe" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" is_pre_election: true
I20260709 14:54:21.105639 15596 raft_consensus.cc:697] T dd44b332dc744f94a5f7cfffc06f3956 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 LEADER]: Becoming Leader. State: Replica: 9cb8de0701f2482b99e51d5ac080aa13, State: Running, Role: LEADER
I20260709 14:54:21.110172 15037 raft_consensus.cc:2468] T 594083b10772433f90560d387bbbeabe P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa34beb1b274443b1c46839afd0a484 in term 0.
I20260709 14:54:21.110705 15596 consensus_queue.cc:237] T dd44b332dc744f94a5f7cfffc06f3956 P 9cb8de0701f2482b99e51d5ac080aa13 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:21.112721 15257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594083b10772433f90560d387bbbeabe" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13" is_pre_election: true
W20260709 14:54:21.115180 15001 leader_election.cc:343] T 9f90ac0a3b004f6ca430ff2fc5198678 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177): Illegal state: must be running to vote when last-logged opid is not known
W20260709 14:54:21.124293 15150 leader_election.cc:343] T 594083b10772433f90560d387bbbeabe P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:21.126210 15004 leader_election.cc:304] T 9f90ac0a3b004f6ca430ff2fc5198678 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dbc2c92e49e346b5b3bd7705a229afc6, eaa34beb1b274443b1c46839afd0a484; no voters: 7519e608fbb44d9db8ad30b9f10ae605
I20260709 14:54:21.135196 15309 ts_tablet_manager.cc:1434] T 5585b0f6bbf04c10865d2463767621dc P 7519e608fbb44d9db8ad30b9f10ae605: Time spent starting tablet: real 0.076s	user 0.010s	sys 0.001s
I20260709 14:54:21.136667 15309 tablet_bootstrap.cc:492] T 342798bf4325470fa3991757eadb0764 P 7519e608fbb44d9db8ad30b9f10ae605: Bootstrap starting.
I20260709 14:54:21.135521 15499 raft_consensus.cc:2804] T 9f90ac0a3b004f6ca430ff2fc5198678 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:54:21.151291 14932 catalog_manager.cc:5697] T c7d360d2b84b4f0aa38f5c325f4521c1 P 9cb8de0701f2482b99e51d5ac080aa13 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68). New cstate: current_term: 1 leader_uuid: "9cb8de0701f2482b99e51d5ac080aa13" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } health_report { overall_health: HEALTHY } } }
I20260709 14:54:21.169384 15153 leader_election.cc:304] T 594083b10772433f90560d387bbbeabe P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dbc2c92e49e346b5b3bd7705a229afc6, eaa34beb1b274443b1c46839afd0a484; no voters: 9cb8de0701f2482b99e51d5ac080aa13
I20260709 14:54:21.173199 15307 tablet_bootstrap.cc:492] T 342798bf4325470fa3991757eadb0764 P 9cb8de0701f2482b99e51d5ac080aa13: No bootstrap required, opened a new log
I20260709 14:54:21.173852 15307 ts_tablet_manager.cc:1403] T 342798bf4325470fa3991757eadb0764 P 9cb8de0701f2482b99e51d5ac080aa13: Time spent bootstrapping tablet: real 0.173s	user 0.034s	sys 0.029s
I20260709 14:54:21.156159 15499 raft_consensus.cc:493] T 9f90ac0a3b004f6ca430ff2fc5198678 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:54:21.174954 15640 raft_consensus.cc:2804] T 594083b10772433f90560d387bbbeabe P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:54:21.175806 15640 raft_consensus.cc:493] T 594083b10772433f90560d387bbbeabe P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:54:21.176319 15640 raft_consensus.cc:3060] T 594083b10772433f90560d387bbbeabe P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:21.180486 15346 raft_consensus.cc:493] T 5585b0f6bbf04c10865d2463767621dc P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:21.180864 15311 tablet_bootstrap.cc:492] T 4abdbdda3ce149a9904e919be18e7a3f P eaa34beb1b274443b1c46839afd0a484: No bootstrap required, opened a new log
I20260709 14:54:21.181496 15311 ts_tablet_manager.cc:1403] T 4abdbdda3ce149a9904e919be18e7a3f P eaa34beb1b274443b1c46839afd0a484: Time spent bootstrapping tablet: real 0.213s	user 0.023s	sys 0.004s
I20260709 14:54:21.181350 15346 raft_consensus.cc:515] T 5585b0f6bbf04c10865d2463767621dc P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:21.183065 15307 raft_consensus.cc:359] T 342798bf4325470fa3991757eadb0764 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:21.184031 15307 raft_consensus.cc:385] T 342798bf4325470fa3991757eadb0764 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:21.187930 15346 leader_election.cc:290] T 5585b0f6bbf04c10865d2463767621dc P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477), 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177)
I20260709 14:54:21.175510 15499 raft_consensus.cc:3060] T 9f90ac0a3b004f6ca430ff2fc5198678 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:21.184314 15307 raft_consensus.cc:740] T 342798bf4325470fa3991757eadb0764 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9cb8de0701f2482b99e51d5ac080aa13, State: Initialized, Role: FOLLOWER
I20260709 14:54:21.193207 15034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5585b0f6bbf04c10865d2463767621dc" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" is_pre_election: true
I20260709 14:54:21.194268 15034 raft_consensus.cc:2468] T 5585b0f6bbf04c10865d2463767621dc P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cb8de0701f2482b99e51d5ac080aa13 in term 0.
I20260709 14:54:21.201920 15113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5585b0f6bbf04c10865d2463767621dc" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605" is_pre_election: true
I20260709 14:54:21.202646 15113 raft_consensus.cc:2468] T 5585b0f6bbf04c10865d2463767621dc P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cb8de0701f2482b99e51d5ac080aa13 in term 0.
I20260709 14:54:21.205358 15227 leader_election.cc:304] T 5585b0f6bbf04c10865d2463767621dc P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cb8de0701f2482b99e51d5ac080aa13, dbc2c92e49e346b5b3bd7705a229afc6; no voters: 
I20260709 14:54:21.206554 15346 raft_consensus.cc:2804] T 5585b0f6bbf04c10865d2463767621dc P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:54:21.206961 15346 raft_consensus.cc:493] T 5585b0f6bbf04c10865d2463767621dc P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:54:21.207269 15346 raft_consensus.cc:3060] T 5585b0f6bbf04c10865d2463767621dc P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:21.232652 15307 consensus_queue.cc:260] T 342798bf4325470fa3991757eadb0764 P 9cb8de0701f2482b99e51d5ac080aa13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:21.243764 15311 raft_consensus.cc:359] T 4abdbdda3ce149a9904e919be18e7a3f P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:21.244815 15311 raft_consensus.cc:385] T 4abdbdda3ce149a9904e919be18e7a3f P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:21.245137 15311 raft_consensus.cc:740] T 4abdbdda3ce149a9904e919be18e7a3f P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eaa34beb1b274443b1c46839afd0a484, State: Initialized, Role: FOLLOWER
I20260709 14:54:21.246042 15311 consensus_queue.cc:260] T 4abdbdda3ce149a9904e919be18e7a3f P eaa34beb1b274443b1c46839afd0a484 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:21.245822 15346 raft_consensus.cc:515] T 5585b0f6bbf04c10865d2463767621dc P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:21.250870 15346 leader_election.cc:290] T 5585b0f6bbf04c10865d2463767621dc P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 election: Requested vote from peers dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477), 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177)
I20260709 14:54:21.252498 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5585b0f6bbf04c10865d2463767621dc" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc2c92e49e346b5b3bd7705a229afc6"
I20260709 14:54:21.264909 15037 raft_consensus.cc:3060] T 5585b0f6bbf04c10865d2463767621dc P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:21.251605 15662 raft_consensus.cc:493] T e43bf64543ef494790c2f7a4a063fdd1 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:21.272724 15306 tablet_bootstrap.cc:654] T 5e8a01e27eab492bb73df3359e500627 P dbc2c92e49e346b5b3bd7705a229afc6: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:21.295773 15307 ts_tablet_manager.cc:1434] T 342798bf4325470fa3991757eadb0764 P 9cb8de0701f2482b99e51d5ac080aa13: Time spent starting tablet: real 0.122s	user 0.009s	sys 0.002s
I20260709 14:54:21.285786 15662 raft_consensus.cc:515] T e43bf64543ef494790c2f7a4a063fdd1 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:21.300586 15662 leader_election.cc:290] T e43bf64543ef494790c2f7a4a063fdd1 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177), 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493)
I20260709 14:54:21.303702 15499 raft_consensus.cc:515] T 9f90ac0a3b004f6ca430ff2fc5198678 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:21.306360 15307 tablet_bootstrap.cc:492] T d178b88fdab54a29b05fb98e05ffe8c5 P 9cb8de0701f2482b99e51d5ac080aa13: Bootstrap starting.
I20260709 14:54:21.308126 15309 tablet_bootstrap.cc:654] T 342798bf4325470fa3991757eadb0764 P 7519e608fbb44d9db8ad30b9f10ae605: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:21.339461 15499 leader_election.cc:290] T 9f90ac0a3b004f6ca430ff2fc5198678 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 election: Requested vote from peers 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177), eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805)
I20260709 14:54:21.341805 15106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43bf64543ef494790c2f7a4a063fdd1" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605" is_pre_election: true
W20260709 14:54:21.341827 14984 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 14:54:21.348749 15254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43bf64543ef494790c2f7a4a063fdd1" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13" is_pre_election: true
I20260709 14:54:21.357656 15307 tablet_bootstrap.cc:654] T d178b88fdab54a29b05fb98e05ffe8c5 P 9cb8de0701f2482b99e51d5ac080aa13: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:21.360150 15109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5585b0f6bbf04c10865d2463767621dc" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605"
I20260709 14:54:21.360985 15109 raft_consensus.cc:3060] T 5585b0f6bbf04c10865d2463767621dc P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:21.361748 15183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f90ac0a3b004f6ca430ff2fc5198678" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484"
I20260709 14:54:21.362462 15183 raft_consensus.cc:3060] T 9f90ac0a3b004f6ca430ff2fc5198678 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:21.365056 15111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f90ac0a3b004f6ca430ff2fc5198678" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605"
I20260709 14:54:21.375800 15640 raft_consensus.cc:515] T 594083b10772433f90560d387bbbeabe P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:21.376226 15037 raft_consensus.cc:2468] T 5585b0f6bbf04c10865d2463767621dc P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cb8de0701f2482b99e51d5ac080aa13 in term 1.
W20260709 14:54:21.369014 15001 leader_election.cc:343] T 9f90ac0a3b004f6ca430ff2fc5198678 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177): Illegal state: must be running to vote when last-logged opid is not known
W20260709 14:54:21.357496 15150 leader_election.cc:343] T e43bf64543ef494790c2f7a4a063fdd1 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493): Illegal state: must be running to vote when last-logged opid is not known
W20260709 14:54:21.382688 15150 leader_election.cc:343] T e43bf64543ef494790c2f7a4a063fdd1 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:21.383502 15150 leader_election.cc:304] T e43bf64543ef494790c2f7a4a063fdd1 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa34beb1b274443b1c46839afd0a484; no voters: 7519e608fbb44d9db8ad30b9f10ae605, 9cb8de0701f2482b99e51d5ac080aa13
I20260709 14:54:21.384737 15663 raft_consensus.cc:2749] T e43bf64543ef494790c2f7a4a063fdd1 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:54:21.383543 15227 leader_election.cc:304] T 5585b0f6bbf04c10865d2463767621dc P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cb8de0701f2482b99e51d5ac080aa13, dbc2c92e49e346b5b3bd7705a229afc6; no voters: 
I20260709 14:54:21.389647 15183 raft_consensus.cc:2468] T 9f90ac0a3b004f6ca430ff2fc5198678 P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbc2c92e49e346b5b3bd7705a229afc6 in term 1.
I20260709 14:54:21.392168 15545 raft_consensus.cc:2804] T 5585b0f6bbf04c10865d2463767621dc P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:54:21.392874 15545 raft_consensus.cc:697] T 5585b0f6bbf04c10865d2463767621dc P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 LEADER]: Becoming Leader. State: Replica: 9cb8de0701f2482b99e51d5ac080aa13, State: Running, Role: LEADER
I20260709 14:54:21.416370 15311 ts_tablet_manager.cc:1434] T 4abdbdda3ce149a9904e919be18e7a3f P eaa34beb1b274443b1c46839afd0a484: Time spent starting tablet: real 0.234s	user 0.027s	sys 0.036s
I20260709 14:54:21.426328 15311 tablet_bootstrap.cc:492] T db39b7ffe995451885f4074ddf16028d P eaa34beb1b274443b1c46839afd0a484: Bootstrap starting.
I20260709 14:54:21.433676 15004 leader_election.cc:304] T 9f90ac0a3b004f6ca430ff2fc5198678 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dbc2c92e49e346b5b3bd7705a229afc6, eaa34beb1b274443b1c46839afd0a484; no voters: 7519e608fbb44d9db8ad30b9f10ae605
W20260709 14:54:21.471997 15004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:33805, user_credentials={real_user=slave}} blocked reactor thread for 45772.4us
I20260709 14:54:21.474152 15573 raft_consensus.cc:2804] T 9f90ac0a3b004f6ca430ff2fc5198678 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:54:21.463804 15545 consensus_queue.cc:237] T 5585b0f6bbf04c10865d2463767621dc P 9cb8de0701f2482b99e51d5ac080aa13 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:21.474828 15573 raft_consensus.cc:697] T 9f90ac0a3b004f6ca430ff2fc5198678 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 LEADER]: Becoming Leader. State: Replica: dbc2c92e49e346b5b3bd7705a229afc6, State: Running, Role: LEADER
I20260709 14:54:21.476058 15573 consensus_queue.cc:237] T 9f90ac0a3b004f6ca430ff2fc5198678 P dbc2c92e49e346b5b3bd7705a229afc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:21.482497 15309 tablet_bootstrap.cc:492] T 342798bf4325470fa3991757eadb0764 P 7519e608fbb44d9db8ad30b9f10ae605: No bootstrap required, opened a new log
I20260709 14:54:21.483489 15309 ts_tablet_manager.cc:1403] T 342798bf4325470fa3991757eadb0764 P 7519e608fbb44d9db8ad30b9f10ae605: Time spent bootstrapping tablet: real 0.347s	user 0.024s	sys 0.029s
I20260709 14:54:21.487267 15309 raft_consensus.cc:359] T 342798bf4325470fa3991757eadb0764 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:21.488106 15309 raft_consensus.cc:385] T 342798bf4325470fa3991757eadb0764 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:21.488397 15309 raft_consensus.cc:740] T 342798bf4325470fa3991757eadb0764 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7519e608fbb44d9db8ad30b9f10ae605, State: Initialized, Role: FOLLOWER
I20260709 14:54:21.489187 15309 consensus_queue.cc:260] T 342798bf4325470fa3991757eadb0764 P 7519e608fbb44d9db8ad30b9f10ae605 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:21.472133 15109 raft_consensus.cc:2468] T 5585b0f6bbf04c10865d2463767621dc P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cb8de0701f2482b99e51d5ac080aa13 in term 1.
I20260709 14:54:21.537101 15640 leader_election.cc:290] T 594083b10772433f90560d387bbbeabe P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 election: Requested vote from peers 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493), dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477)
I20260709 14:54:21.539708 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594083b10772433f90560d387bbbeabe" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc2c92e49e346b5b3bd7705a229afc6"
I20260709 14:54:21.540946 15037 raft_consensus.cc:3060] T 594083b10772433f90560d387bbbeabe P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:21.542243 15259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594083b10772433f90560d387bbbeabe" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13"
W20260709 14:54:21.551472 15150 leader_election.cc:343] T 594083b10772433f90560d387bbbeabe P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:21.554831 15311 tablet_bootstrap.cc:654] T db39b7ffe995451885f4074ddf16028d P eaa34beb1b274443b1c46839afd0a484: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:21.546075 15307 tablet_bootstrap.cc:492] T d178b88fdab54a29b05fb98e05ffe8c5 P 9cb8de0701f2482b99e51d5ac080aa13: No bootstrap required, opened a new log
I20260709 14:54:21.546052 15346 consensus_queue.cc:1048] T c7d360d2b84b4f0aa38f5c325f4521c1 P 9cb8de0701f2482b99e51d5ac080aa13 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:54:21.555658 15307 ts_tablet_manager.cc:1403] T d178b88fdab54a29b05fb98e05ffe8c5 P 9cb8de0701f2482b99e51d5ac080aa13: Time spent bootstrapping tablet: real 0.250s	user 0.034s	sys 0.042s
I20260709 14:54:21.540946 15309 ts_tablet_manager.cc:1434] T 342798bf4325470fa3991757eadb0764 P 7519e608fbb44d9db8ad30b9f10ae605: Time spent starting tablet: real 0.057s	user 0.010s	sys 0.000s
I20260709 14:54:21.557886 15309 tablet_bootstrap.cc:492] T dd44b332dc744f94a5f7cfffc06f3956 P 7519e608fbb44d9db8ad30b9f10ae605: Bootstrap starting.
W20260709 14:54:21.548928 15001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:43177, user_credentials={real_user=slave}} blocked reactor thread for 72288.8us
I20260709 14:54:21.554605 15037 raft_consensus.cc:2468] T 594083b10772433f90560d387bbbeabe P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa34beb1b274443b1c46839afd0a484 in term 1.
I20260709 14:54:21.563277 15153 leader_election.cc:304] T 594083b10772433f90560d387bbbeabe P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dbc2c92e49e346b5b3bd7705a229afc6, eaa34beb1b274443b1c46839afd0a484; no voters: 9cb8de0701f2482b99e51d5ac080aa13
I20260709 14:54:21.565492 15594 raft_consensus.cc:493] T 342798bf4325470fa3991757eadb0764 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:21.566134 15594 raft_consensus.cc:515] T 342798bf4325470fa3991757eadb0764 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:21.560549 15307 raft_consensus.cc:359] T d178b88fdab54a29b05fb98e05ffe8c5 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:21.569772 15307 raft_consensus.cc:385] T d178b88fdab54a29b05fb98e05ffe8c5 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:21.570247 15307 raft_consensus.cc:740] T d178b88fdab54a29b05fb98e05ffe8c5 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9cb8de0701f2482b99e51d5ac080aa13, State: Initialized, Role: FOLLOWER
I20260709 14:54:21.543270 15306 tablet_bootstrap.cc:492] T 5e8a01e27eab492bb73df3359e500627 P dbc2c92e49e346b5b3bd7705a229afc6: No bootstrap required, opened a new log
I20260709 14:54:21.572546 15306 ts_tablet_manager.cc:1403] T 5e8a01e27eab492bb73df3359e500627 P dbc2c92e49e346b5b3bd7705a229afc6: Time spent bootstrapping tablet: real 0.500s	user 0.026s	sys 0.035s
I20260709 14:54:21.575562 15640 raft_consensus.cc:2804] T 594083b10772433f90560d387bbbeabe P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:54:21.577363 15183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342798bf4325470fa3991757eadb0764" candidate_uuid: "7519e608fbb44d9db8ad30b9f10ae605" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484" is_pre_election: true
I20260709 14:54:21.578431 15183 raft_consensus.cc:2468] T 342798bf4325470fa3991757eadb0764 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7519e608fbb44d9db8ad30b9f10ae605 in term 0.
I20260709 14:54:21.579192 15259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342798bf4325470fa3991757eadb0764" candidate_uuid: "7519e608fbb44d9db8ad30b9f10ae605" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13" is_pre_election: true
I20260709 14:54:21.564231 14934 catalog_manager.cc:5697] T dd44b332dc744f94a5f7cfffc06f3956 P 9cb8de0701f2482b99e51d5ac080aa13 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68). New cstate: current_term: 1 leader_uuid: "9cb8de0701f2482b99e51d5ac080aa13" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } health_report { overall_health: UNKNOWN } } }
I20260709 14:54:21.580224 15259 raft_consensus.cc:2468] T 342798bf4325470fa3991757eadb0764 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7519e608fbb44d9db8ad30b9f10ae605 in term 0.
I20260709 14:54:21.580871 15079 leader_election.cc:304] T 342798bf4325470fa3991757eadb0764 P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7519e608fbb44d9db8ad30b9f10ae605, eaa34beb1b274443b1c46839afd0a484; no voters: 
I20260709 14:54:21.582190 15599 raft_consensus.cc:2804] T 342798bf4325470fa3991757eadb0764 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:54:21.577282 15594 leader_election.cc:290] T 342798bf4325470fa3991757eadb0764 P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805), 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493)
I20260709 14:54:21.582777 15596 consensus_queue.cc:1048] T c7d360d2b84b4f0aa38f5c325f4521c1 P 9cb8de0701f2482b99e51d5ac080aa13 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:54:21.582701 15599 raft_consensus.cc:493] T 342798bf4325470fa3991757eadb0764 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:54:21.585901 15599 raft_consensus.cc:3060] T 342798bf4325470fa3991757eadb0764 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:21.593612 15309 tablet_bootstrap.cc:654] T dd44b332dc744f94a5f7cfffc06f3956 P 7519e608fbb44d9db8ad30b9f10ae605: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:21.587548 14932 catalog_manager.cc:5697] T 9f90ac0a3b004f6ca430ff2fc5198678 P dbc2c92e49e346b5b3bd7705a229afc6 reported cstate change: term changed from 0 to 1, leader changed from <none> to dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65). New cstate: current_term: 1 leader_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } health_report { overall_health: UNKNOWN } } }
I20260709 14:54:21.581569 14934 catalog_manager.cc:5697] T 5585b0f6bbf04c10865d2463767621dc P 9cb8de0701f2482b99e51d5ac080aa13 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68). New cstate: current_term: 1 leader_uuid: "9cb8de0701f2482b99e51d5ac080aa13" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } health_report { overall_health: UNKNOWN } } }
I20260709 14:54:21.610620 15306 raft_consensus.cc:359] T 5e8a01e27eab492bb73df3359e500627 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:21.603416 15640 raft_consensus.cc:697] T 594083b10772433f90560d387bbbeabe P eaa34beb1b274443b1c46839afd0a484 [term 1 LEADER]: Becoming Leader. State: Replica: eaa34beb1b274443b1c46839afd0a484, State: Running, Role: LEADER
I20260709 14:54:21.613353 15306 raft_consensus.cc:385] T 5e8a01e27eab492bb73df3359e500627 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:21.613777 15306 raft_consensus.cc:740] T 5e8a01e27eab492bb73df3359e500627 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbc2c92e49e346b5b3bd7705a229afc6, State: Initialized, Role: FOLLOWER
I20260709 14:54:21.598026 15599 raft_consensus.cc:515] T 342798bf4325470fa3991757eadb0764 P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:21.628537 15661 raft_consensus.cc:493] T 4abdbdda3ce149a9904e919be18e7a3f P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:21.629510 15661 raft_consensus.cc:515] T 4abdbdda3ce149a9904e919be18e7a3f P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:21.630594 15306 consensus_queue.cc:260] T 5e8a01e27eab492bb73df3359e500627 P dbc2c92e49e346b5b3bd7705a229afc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:21.636656 15184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342798bf4325470fa3991757eadb0764" candidate_uuid: "7519e608fbb44d9db8ad30b9f10ae605" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484"
I20260709 14:54:21.638803 15184 raft_consensus.cc:3060] T 342798bf4325470fa3991757eadb0764 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:21.605880 15307 consensus_queue.cc:260] T d178b88fdab54a29b05fb98e05ffe8c5 P 9cb8de0701f2482b99e51d5ac080aa13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:21.641775 15346 raft_consensus.cc:493] T d178b88fdab54a29b05fb98e05ffe8c5 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:21.642479 15346 raft_consensus.cc:515] T d178b88fdab54a29b05fb98e05ffe8c5 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:21.644279 15259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342798bf4325470fa3991757eadb0764" candidate_uuid: "7519e608fbb44d9db8ad30b9f10ae605" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13"
I20260709 14:54:21.642642 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abdbdda3ce149a9904e919be18e7a3f" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" is_pre_election: true
I20260709 14:54:21.614323 15640 consensus_queue.cc:237] T 594083b10772433f90560d387bbbeabe P eaa34beb1b274443b1c46839afd0a484 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:21.632359 15311 tablet_bootstrap.cc:492] T db39b7ffe995451885f4074ddf16028d P eaa34beb1b274443b1c46839afd0a484: No bootstrap required, opened a new log
W20260709 14:54:21.649888 15153 leader_election.cc:343] T 4abdbdda3ce149a9904e919be18e7a3f P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:21.650081 15661 leader_election.cc:290] T 4abdbdda3ce149a9904e919be18e7a3f P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493), dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477)
I20260709 14:54:21.656322 15311 ts_tablet_manager.cc:1403] T db39b7ffe995451885f4074ddf16028d P eaa34beb1b274443b1c46839afd0a484: Time spent bootstrapping tablet: real 0.234s	user 0.019s	sys 0.000s
I20260709 14:54:21.651222 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d178b88fdab54a29b05fb98e05ffe8c5" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" is_pre_election: true
I20260709 14:54:21.660451 15037 raft_consensus.cc:2393] T d178b88fdab54a29b05fb98e05ffe8c5 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9cb8de0701f2482b99e51d5ac080aa13 in current term 1: Already voted for candidate dbc2c92e49e346b5b3bd7705a229afc6 in this term.
I20260709 14:54:21.647500 15259 raft_consensus.cc:3060] T 342798bf4325470fa3991757eadb0764 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:21.648918 15346 leader_election.cc:290] T d178b88fdab54a29b05fb98e05ffe8c5 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805), dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477)
I20260709 14:54:21.674516 15599 leader_election.cc:290] T 342798bf4325470fa3991757eadb0764 P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 1 election: Requested vote from peers eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805), 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493)
I20260709 14:54:21.674780 15185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d178b88fdab54a29b05fb98e05ffe8c5" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484" is_pre_election: true
I20260709 14:54:21.675614 15185 raft_consensus.cc:2393] T d178b88fdab54a29b05fb98e05ffe8c5 P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9cb8de0701f2482b99e51d5ac080aa13 in current term 1: Already voted for candidate eaa34beb1b274443b1c46839afd0a484 in this term.
I20260709 14:54:21.681475 15306 ts_tablet_manager.cc:1434] T 5e8a01e27eab492bb73df3359e500627 P dbc2c92e49e346b5b3bd7705a229afc6: Time spent starting tablet: real 0.108s	user 0.012s	sys 0.000s
I20260709 14:54:21.686169 15306 tablet_bootstrap.cc:492] T bdf08eed05854470954a5e9dd17dfb27 P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap starting.
I20260709 14:54:21.687855 15227 leader_election.cc:304] T d178b88fdab54a29b05fb98e05ffe8c5 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cb8de0701f2482b99e51d5ac080aa13; no voters: dbc2c92e49e346b5b3bd7705a229afc6, eaa34beb1b274443b1c46839afd0a484
I20260709 14:54:21.701886 15307 ts_tablet_manager.cc:1434] T d178b88fdab54a29b05fb98e05ffe8c5 P 9cb8de0701f2482b99e51d5ac080aa13: Time spent starting tablet: real 0.146s	user 0.011s	sys 0.000s
I20260709 14:54:21.703336 15307 tablet_bootstrap.cc:492] T e43bf64543ef494790c2f7a4a063fdd1 P 9cb8de0701f2482b99e51d5ac080aa13: Bootstrap starting.
I20260709 14:54:21.706331 15184 raft_consensus.cc:2468] T 342798bf4325470fa3991757eadb0764 P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7519e608fbb44d9db8ad30b9f10ae605 in term 1.
I20260709 14:54:21.711071 15596 raft_consensus.cc:3060] T d178b88fdab54a29b05fb98e05ffe8c5 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:21.721132 15079 leader_election.cc:304] T 342798bf4325470fa3991757eadb0764 P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7519e608fbb44d9db8ad30b9f10ae605, eaa34beb1b274443b1c46839afd0a484; no voters: 
I20260709 14:54:21.724048 15599 raft_consensus.cc:2804] T 342798bf4325470fa3991757eadb0764 P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:54:21.727154 15311 raft_consensus.cc:359] T db39b7ffe995451885f4074ddf16028d P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:21.727784 14932 catalog_manager.cc:5697] T 594083b10772433f90560d387bbbeabe P eaa34beb1b274443b1c46839afd0a484 reported cstate change: term changed from 0 to 1, leader changed from <none> to eaa34beb1b274443b1c46839afd0a484 (127.6.101.67). New cstate: current_term: 1 leader_uuid: "eaa34beb1b274443b1c46839afd0a484" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } health_report { overall_health: UNKNOWN } } }
I20260709 14:54:21.750216 15311 raft_consensus.cc:385] T db39b7ffe995451885f4074ddf16028d P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:21.750602 15311 raft_consensus.cc:740] T db39b7ffe995451885f4074ddf16028d P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eaa34beb1b274443b1c46839afd0a484, State: Initialized, Role: FOLLOWER
I20260709 14:54:21.751555 15311 consensus_queue.cc:260] T db39b7ffe995451885f4074ddf16028d P eaa34beb1b274443b1c46839afd0a484 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:21.742775 15257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abdbdda3ce149a9904e919be18e7a3f" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13" is_pre_election: true
I20260709 14:54:21.748473 15259 raft_consensus.cc:2468] T 342798bf4325470fa3991757eadb0764 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7519e608fbb44d9db8ad30b9f10ae605 in term 1.
I20260709 14:54:21.795251 15311 ts_tablet_manager.cc:1434] T db39b7ffe995451885f4074ddf16028d P eaa34beb1b274443b1c46839afd0a484: Time spent starting tablet: real 0.136s	user 0.009s	sys 0.000s
I20260709 14:54:21.796998 15311 tablet_bootstrap.cc:492] T 5e8a01e27eab492bb73df3359e500627 P eaa34beb1b274443b1c46839afd0a484: Bootstrap starting.
I20260709 14:54:21.802228 15307 tablet_bootstrap.cc:654] T e43bf64543ef494790c2f7a4a063fdd1 P 9cb8de0701f2482b99e51d5ac080aa13: Neither blocks nor log segments found. Creating new log.
W20260709 14:54:21.809424 15227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:45477, user_credentials={real_user=slave}} blocked reactor thread for 59904.6us
I20260709 14:54:21.810045 15309 tablet_bootstrap.cc:492] T dd44b332dc744f94a5f7cfffc06f3956 P 7519e608fbb44d9db8ad30b9f10ae605: No bootstrap required, opened a new log
I20260709 14:54:21.787871 15599 raft_consensus.cc:697] T 342798bf4325470fa3991757eadb0764 P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 LEADER]: Becoming Leader. State: Replica: 7519e608fbb44d9db8ad30b9f10ae605, State: Running, Role: LEADER
I20260709 14:54:21.811842 15309 ts_tablet_manager.cc:1403] T dd44b332dc744f94a5f7cfffc06f3956 P 7519e608fbb44d9db8ad30b9f10ae605: Time spent bootstrapping tablet: real 0.253s	user 0.047s	sys 0.059s
I20260709 14:54:21.800323 15613 raft_consensus.cc:493] T 5e8a01e27eab492bb73df3359e500627 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:54:21.816222 15150 leader_election.cc:343] T 4abdbdda3ce149a9904e919be18e7a3f P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:21.817624 15150 leader_election.cc:304] T 4abdbdda3ce149a9904e919be18e7a3f P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa34beb1b274443b1c46839afd0a484; no voters: 9cb8de0701f2482b99e51d5ac080aa13, dbc2c92e49e346b5b3bd7705a229afc6
I20260709 14:54:21.819110 15640 raft_consensus.cc:2749] T 4abdbdda3ce149a9904e919be18e7a3f P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:54:21.821954 15346 consensus_queue.cc:1048] T dd44b332dc744f94a5f7cfffc06f3956 P 9cb8de0701f2482b99e51d5ac080aa13 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:54:21.823194 15599 consensus_queue.cc:237] T 342798bf4325470fa3991757eadb0764 P 7519e608fbb44d9db8ad30b9f10ae605 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:21.828528 15306 tablet_bootstrap.cc:654] T bdf08eed05854470954a5e9dd17dfb27 P dbc2c92e49e346b5b3bd7705a229afc6: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:21.924506 15311 tablet_bootstrap.cc:654] T 5e8a01e27eab492bb73df3359e500627 P eaa34beb1b274443b1c46839afd0a484: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:21.829906 15613 raft_consensus.cc:515] T 5e8a01e27eab492bb73df3359e500627 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:21.932018 15613 leader_election.cc:290] T 5e8a01e27eab492bb73df3359e500627 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177), eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805)
I20260709 14:54:21.934114 15183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e8a01e27eab492bb73df3359e500627" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484" is_pre_election: true
W20260709 14:54:21.942482 15004 leader_election.cc:343] T 5e8a01e27eab492bb73df3359e500627 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805): Illegal state: must be running to vote when last-logged opid is not known
W20260709 14:54:21.899735 15076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.68:45493, user_credentials={real_user=slave}} blocked reactor thread for 84798.4us
I20260709 14:54:21.943627 15111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e8a01e27eab492bb73df3359e500627" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605" is_pre_election: true
W20260709 14:54:21.951870 15001 leader_election.cc:343] T 5e8a01e27eab492bb73df3359e500627 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:21.952544 15001 leader_election.cc:304] T 5e8a01e27eab492bb73df3359e500627 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbc2c92e49e346b5b3bd7705a229afc6; no voters: 7519e608fbb44d9db8ad30b9f10ae605, eaa34beb1b274443b1c46839afd0a484
I20260709 14:54:21.968703 15596 raft_consensus.cc:2749] T d178b88fdab54a29b05fb98e05ffe8c5 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:54:21.986454 15306 tablet_bootstrap.cc:492] T bdf08eed05854470954a5e9dd17dfb27 P dbc2c92e49e346b5b3bd7705a229afc6: No bootstrap required, opened a new log
I20260709 14:54:21.988368 15306 ts_tablet_manager.cc:1403] T bdf08eed05854470954a5e9dd17dfb27 P dbc2c92e49e346b5b3bd7705a229afc6: Time spent bootstrapping tablet: real 0.303s	user 0.037s	sys 0.001s
I20260709 14:54:22.003300 15309 raft_consensus.cc:359] T dd44b332dc744f94a5f7cfffc06f3956 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:22.004628 15309 raft_consensus.cc:385] T dd44b332dc744f94a5f7cfffc06f3956 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:21.962929 15613 raft_consensus.cc:2749] T 5e8a01e27eab492bb73df3359e500627 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:54:22.004994 15309 raft_consensus.cc:740] T dd44b332dc744f94a5f7cfffc06f3956 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7519e608fbb44d9db8ad30b9f10ae605, State: Initialized, Role: FOLLOWER
I20260709 14:54:22.035205 15306 raft_consensus.cc:359] T bdf08eed05854470954a5e9dd17dfb27 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:22.036464 15306 raft_consensus.cc:385] T bdf08eed05854470954a5e9dd17dfb27 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:22.036950 15306 raft_consensus.cc:740] T bdf08eed05854470954a5e9dd17dfb27 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbc2c92e49e346b5b3bd7705a229afc6, State: Initialized, Role: FOLLOWER
W20260709 14:54:22.036998 15079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:45477, user_credentials={real_user=slave}} blocked reactor thread for 227513us
I20260709 14:54:22.037894 15306 consensus_queue.cc:260] T bdf08eed05854470954a5e9dd17dfb27 P dbc2c92e49e346b5b3bd7705a229afc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:22.012224 15309 consensus_queue.cc:260] T dd44b332dc744f94a5f7cfffc06f3956 P 7519e608fbb44d9db8ad30b9f10ae605 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:22.054355 15306 ts_tablet_manager.cc:1434] T bdf08eed05854470954a5e9dd17dfb27 P dbc2c92e49e346b5b3bd7705a229afc6: Time spent starting tablet: real 0.065s	user 0.011s	sys 0.000s
I20260709 14:54:22.056653 15309 ts_tablet_manager.cc:1434] T dd44b332dc744f94a5f7cfffc06f3956 P 7519e608fbb44d9db8ad30b9f10ae605: Time spent starting tablet: real 0.244s	user 0.006s	sys 0.005s
I20260709 14:54:22.074613 15311 tablet_bootstrap.cc:492] T 5e8a01e27eab492bb73df3359e500627 P eaa34beb1b274443b1c46839afd0a484: No bootstrap required, opened a new log
I20260709 14:54:22.075397 15311 ts_tablet_manager.cc:1403] T 5e8a01e27eab492bb73df3359e500627 P eaa34beb1b274443b1c46839afd0a484: Time spent bootstrapping tablet: real 0.279s	user 0.029s	sys 0.019s
I20260709 14:54:22.060539 15309 tablet_bootstrap.cc:492] T 9f90ac0a3b004f6ca430ff2fc5198678 P 7519e608fbb44d9db8ad30b9f10ae605: Bootstrap starting.
I20260709 14:54:22.103709 15685 consensus_queue.cc:1048] T 5585b0f6bbf04c10865d2463767621dc P 9cb8de0701f2482b99e51d5ac080aa13 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 14:54:22.105873 15224 consensus_peers.cc:597] T dd44b332dc744f94a5f7cfffc06f3956 P 9cb8de0701f2482b99e51d5ac080aa13 -> Peer 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177): Couldn't send request to peer 7519e608fbb44d9db8ad30b9f10ae605. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:54:22.113570 15311 raft_consensus.cc:359] T 5e8a01e27eab492bb73df3359e500627 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:22.114681 15311 raft_consensus.cc:385] T 5e8a01e27eab492bb73df3359e500627 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:22.115049 15311 raft_consensus.cc:740] T 5e8a01e27eab492bb73df3359e500627 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eaa34beb1b274443b1c46839afd0a484, State: Initialized, Role: FOLLOWER
I20260709 14:54:22.121466 15307 tablet_bootstrap.cc:492] T e43bf64543ef494790c2f7a4a063fdd1 P 9cb8de0701f2482b99e51d5ac080aa13: No bootstrap required, opened a new log
I20260709 14:54:22.122588 15307 ts_tablet_manager.cc:1403] T e43bf64543ef494790c2f7a4a063fdd1 P 9cb8de0701f2482b99e51d5ac080aa13: Time spent bootstrapping tablet: real 0.419s	user 0.021s	sys 0.004s
I20260709 14:54:22.130172 15311 consensus_queue.cc:260] T 5e8a01e27eab492bb73df3359e500627 P eaa34beb1b274443b1c46839afd0a484 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:22.136755 15306 tablet_bootstrap.cc:492] T 4abdbdda3ce149a9904e919be18e7a3f P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap starting.
I20260709 14:54:22.130661 15677 raft_consensus.cc:493] T b7c363a305d3434092ef6016b7064eb3 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:22.125900 15574 raft_consensus.cc:493] T bdf08eed05854470954a5e9dd17dfb27 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:22.144340 15574 raft_consensus.cc:515] T bdf08eed05854470954a5e9dd17dfb27 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:22.146831 15574 leader_election.cc:290] T bdf08eed05854470954a5e9dd17dfb27 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493), 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177)
I20260709 14:54:22.143059 15677 raft_consensus.cc:515] T b7c363a305d3434092ef6016b7064eb3 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:22.151693 15677 leader_election.cc:290] T b7c363a305d3434092ef6016b7064eb3 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477), 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177)
I20260709 14:54:22.155797 15111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7c363a305d3434092ef6016b7064eb3" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605" is_pre_election: true
W20260709 14:54:22.147717 15690 log.cc:927] Time spent T dd44b332dc744f94a5f7cfffc06f3956 P dbc2c92e49e346b5b3bd7705a229afc6: Append to log took a long time: real 0.168s	user 0.000s	sys 0.002s
I20260709 14:54:22.165459 14935 catalog_manager.cc:5697] T 342798bf4325470fa3991757eadb0764 P 7519e608fbb44d9db8ad30b9f10ae605 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66). New cstate: current_term: 1 leader_uuid: "7519e608fbb44d9db8ad30b9f10ae605" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } health_report { overall_health: UNKNOWN } } }
I20260709 14:54:22.156790 15111 raft_consensus.cc:2468] T b7c363a305d3434092ef6016b7064eb3 P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cb8de0701f2482b99e51d5ac080aa13 in term 1.
I20260709 14:54:22.175287 15311 ts_tablet_manager.cc:1434] T 5e8a01e27eab492bb73df3359e500627 P eaa34beb1b274443b1c46839afd0a484: Time spent starting tablet: real 0.100s	user 0.006s	sys 0.004s
I20260709 14:54:22.176669 15311 tablet_bootstrap.cc:492] T b97c761f72c14075b65e501c4b3ae0fb P eaa34beb1b274443b1c46839afd0a484: Bootstrap starting.
I20260709 14:54:22.156906 15545 consensus_queue.cc:1048] T 5585b0f6bbf04c10865d2463767621dc P 9cb8de0701f2482b99e51d5ac080aa13 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.023s
I20260709 14:54:22.197132 15224 leader_election.cc:304] T b7c363a305d3434092ef6016b7064eb3 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7519e608fbb44d9db8ad30b9f10ae605, 9cb8de0701f2482b99e51d5ac080aa13; no voters: 
I20260709 14:54:22.197518 15661 raft_consensus.cc:493] T db39b7ffe995451885f4074ddf16028d P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:22.201686 15661 raft_consensus.cc:515] T db39b7ffe995451885f4074ddf16028d P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:22.207700 15661 leader_election.cc:290] T db39b7ffe995451885f4074ddf16028d P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477), 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177)
I20260709 14:54:22.208333 15111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db39b7ffe995451885f4074ddf16028d" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605" is_pre_election: true
W20260709 14:54:22.215798 15150 consensus_peers.cc:597] T 594083b10772433f90560d387bbbeabe P eaa34beb1b274443b1c46839afd0a484 -> Peer 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493): Couldn't send request to peer 9cb8de0701f2482b99e51d5ac080aa13. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 14:54:22.218256 15150 leader_election.cc:343] T db39b7ffe995451885f4074ddf16028d P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:22.219862 15545 raft_consensus.cc:2804] T b7c363a305d3434092ef6016b7064eb3 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 14:54:22.220408 15545 raft_consensus.cc:493] T b7c363a305d3434092ef6016b7064eb3 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:54:22.220846 15545 raft_consensus.cc:3060] T b7c363a305d3434092ef6016b7064eb3 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:54:22.179425 15307 raft_consensus.cc:359] T e43bf64543ef494790c2f7a4a063fdd1 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:22.225581 15307 raft_consensus.cc:385] T e43bf64543ef494790c2f7a4a063fdd1 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:22.226132 15307 raft_consensus.cc:740] T e43bf64543ef494790c2f7a4a063fdd1 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9cb8de0701f2482b99e51d5ac080aa13, State: Initialized, Role: FOLLOWER
I20260709 14:54:22.226971 15307 consensus_queue.cc:260] T e43bf64543ef494790c2f7a4a063fdd1 P 9cb8de0701f2482b99e51d5ac080aa13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:22.233621 15545 raft_consensus.cc:515] T b7c363a305d3434092ef6016b7064eb3 P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:22.235999 15307 ts_tablet_manager.cc:1434] T e43bf64543ef494790c2f7a4a063fdd1 P 9cb8de0701f2482b99e51d5ac080aa13: Time spent starting tablet: real 0.113s	user 0.009s	sys 0.000s
I20260709 14:54:22.244333 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db39b7ffe995451885f4074ddf16028d" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" is_pre_election: true
I20260709 14:54:22.263303 15307 tablet_bootstrap.cc:492] T 594083b10772433f90560d387bbbeabe P 9cb8de0701f2482b99e51d5ac080aa13: Bootstrap starting.
I20260709 14:54:22.265205 15661 consensus_queue.cc:1048] T 594083b10772433f90560d387bbbeabe P eaa34beb1b274443b1c46839afd0a484 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 14:54:22.269884 15309 tablet_bootstrap.cc:654] T 9f90ac0a3b004f6ca430ff2fc5198678 P 7519e608fbb44d9db8ad30b9f10ae605: Neither blocks nor log segments found. Creating new log.
W20260709 14:54:22.276510 15001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.68:45493, user_credentials={real_user=slave}} blocked reactor thread for 118304us
I20260709 14:54:22.282249 15573 raft_consensus.cc:493] T b7c363a305d3434092ef6016b7064eb3 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:22.283176 15573 raft_consensus.cc:515] T b7c363a305d3434092ef6016b7064eb3 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:22.286839 15573 leader_election.cc:290] T b7c363a305d3434092ef6016b7064eb3 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493), 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177)
W20260709 14:54:22.287818 15153 leader_election.cc:343] T db39b7ffe995451885f4074ddf16028d P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:22.288537 15153 leader_election.cc:304] T db39b7ffe995451885f4074ddf16028d P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa34beb1b274443b1c46839afd0a484; no voters: 7519e608fbb44d9db8ad30b9f10ae605, dbc2c92e49e346b5b3bd7705a229afc6
I20260709 14:54:22.289947 15640 raft_consensus.cc:2749] T db39b7ffe995451885f4074ddf16028d P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:54:22.301116 15545 leader_election.cc:290] T b7c363a305d3434092ef6016b7064eb3 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 2 election: Requested vote from peers dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477), 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177)
I20260709 14:54:22.301549 15111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7c363a305d3434092ef6016b7064eb3" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605"
I20260709 14:54:22.306183 15111 raft_consensus.cc:3060] T b7c363a305d3434092ef6016b7064eb3 P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:54:22.305905 15692 consensus_queue.cc:1048] T 9f90ac0a3b004f6ca430ff2fc5198678 P dbc2c92e49e346b5b3bd7705a229afc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:54:22.312620 15106 raft_consensus.cc:3060] T dd44b332dc744f94a5f7cfffc06f3956 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:22.318137 15113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf08eed05854470954a5e9dd17dfb27" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605" is_pre_election: true
I20260709 14:54:22.326508 15111 raft_consensus.cc:2468] T b7c363a305d3434092ef6016b7064eb3 P 7519e608fbb44d9db8ad30b9f10ae605 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cb8de0701f2482b99e51d5ac080aa13 in term 2.
I20260709 14:54:22.324432 15255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf08eed05854470954a5e9dd17dfb27" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13" is_pre_election: true
I20260709 14:54:22.334445 15110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7c363a305d3434092ef6016b7064eb3" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605" is_pre_election: true
I20260709 14:54:22.335507 15110 raft_consensus.cc:2393] T b7c363a305d3434092ef6016b7064eb3 P 7519e608fbb44d9db8ad30b9f10ae605 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbc2c92e49e346b5b3bd7705a229afc6 in current term 2: Already voted for candidate 9cb8de0701f2482b99e51d5ac080aa13 in this term.
I20260709 14:54:22.338248 15224 leader_election.cc:304] T b7c363a305d3434092ef6016b7064eb3 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7519e608fbb44d9db8ad30b9f10ae605, 9cb8de0701f2482b99e51d5ac080aa13; no voters: 
I20260709 14:54:22.306525 15311 tablet_bootstrap.cc:654] T b97c761f72c14075b65e501c4b3ae0fb P eaa34beb1b274443b1c46839afd0a484: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:22.371392 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7c363a305d3434092ef6016b7064eb3" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" is_pre_election: true
I20260709 14:54:22.372287 15037 raft_consensus.cc:2468] T b7c363a305d3434092ef6016b7064eb3 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cb8de0701f2482b99e51d5ac080aa13 in term 1.
I20260709 14:54:22.378211 15640 raft_consensus.cc:493] T 5e8a01e27eab492bb73df3359e500627 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:22.379359 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7c363a305d3434092ef6016b7064eb3" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc2c92e49e346b5b3bd7705a229afc6"
I20260709 14:54:22.380183 15035 raft_consensus.cc:3060] T b7c363a305d3434092ef6016b7064eb3 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:54:22.368671 15682 raft_consensus.cc:2804] T b7c363a305d3434092ef6016b7064eb3 P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 14:54:22.392918 15001 leader_election.cc:343] T bdf08eed05854470954a5e9dd17dfb27 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493): Illegal state: must be running to vote when last-logged opid is not known
W20260709 14:54:22.398918 15001 leader_election.cc:343] T bdf08eed05854470954a5e9dd17dfb27 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:22.399506 15001 leader_election.cc:304] T bdf08eed05854470954a5e9dd17dfb27 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbc2c92e49e346b5b3bd7705a229afc6; no voters: 7519e608fbb44d9db8ad30b9f10ae605, 9cb8de0701f2482b99e51d5ac080aa13
I20260709 14:54:22.400399 15574 raft_consensus.cc:2749] T bdf08eed05854470954a5e9dd17dfb27 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 14:54:22.400595 14984 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 14:54:22.366025 15599 consensus_queue.cc:1048] T 342798bf4325470fa3991757eadb0764 P 7519e608fbb44d9db8ad30b9f10ae605 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.027s
I20260709 14:54:22.392428 15261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7c363a305d3434092ef6016b7064eb3" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13" is_pre_election: true
I20260709 14:54:22.402123 15682 raft_consensus.cc:697] T b7c363a305d3434092ef6016b7064eb3 P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 LEADER]: Becoming Leader. State: Replica: 9cb8de0701f2482b99e51d5ac080aa13, State: Running, Role: LEADER
I20260709 14:54:22.384680 15640 raft_consensus.cc:515] T 5e8a01e27eab492bb73df3359e500627 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
W20260709 14:54:22.469446 15001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:43177, user_credentials={real_user=slave}} blocked reactor thread for 63181.7us
I20260709 14:54:22.482973 15682 consensus_queue.cc:237] T b7c363a305d3434092ef6016b7064eb3 P 9cb8de0701f2482b99e51d5ac080aa13 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:22.486554 15306 tablet_bootstrap.cc:654] T 4abdbdda3ce149a9904e919be18e7a3f P dbc2c92e49e346b5b3bd7705a229afc6: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:22.499960 15307 tablet_bootstrap.cc:654] T 594083b10772433f90560d387bbbeabe P 9cb8de0701f2482b99e51d5ac080aa13: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:22.533121 15035 raft_consensus.cc:2468] T b7c363a305d3434092ef6016b7064eb3 P dbc2c92e49e346b5b3bd7705a229afc6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cb8de0701f2482b99e51d5ac080aa13 in term 2.
I20260709 14:54:22.558908 15309 tablet_bootstrap.cc:492] T 9f90ac0a3b004f6ca430ff2fc5198678 P 7519e608fbb44d9db8ad30b9f10ae605: No bootstrap required, opened a new log
I20260709 14:54:22.559799 15309 ts_tablet_manager.cc:1403] T 9f90ac0a3b004f6ca430ff2fc5198678 P 7519e608fbb44d9db8ad30b9f10ae605: Time spent bootstrapping tablet: real 0.500s	user 0.014s	sys 0.012s
I20260709 14:54:22.656358 15311 tablet_bootstrap.cc:492] T b97c761f72c14075b65e501c4b3ae0fb P eaa34beb1b274443b1c46839afd0a484: No bootstrap required, opened a new log
I20260709 14:54:22.657310 15311 ts_tablet_manager.cc:1403] T b97c761f72c14075b65e501c4b3ae0fb P eaa34beb1b274443b1c46839afd0a484: Time spent bootstrapping tablet: real 0.481s	user 0.031s	sys 0.014s
I20260709 14:54:22.628123 15640 leader_election.cc:290] T 5e8a01e27eab492bb73df3359e500627 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477), 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177)
I20260709 14:54:22.672343 15032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e8a01e27eab492bb73df3359e500627" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" is_pre_election: true
W20260709 14:54:22.673100 15703 log.cc:927] Time spent T dd44b332dc744f94a5f7cfffc06f3956 P 9cb8de0701f2482b99e51d5ac080aa13: Append to log took a long time: real 0.107s	user 0.003s	sys 0.000s
I20260709 14:54:22.658489 15594 raft_consensus.cc:493] T dd44b332dc744f94a5f7cfffc06f3956 P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9cb8de0701f2482b99e51d5ac080aa13)
I20260709 14:54:22.706496 15677 raft_consensus.cc:493] T e43bf64543ef494790c2f7a4a063fdd1 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:22.707197 15677 raft_consensus.cc:515] T e43bf64543ef494790c2f7a4a063fdd1 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:22.697032 15032 raft_consensus.cc:2468] T 5e8a01e27eab492bb73df3359e500627 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa34beb1b274443b1c46839afd0a484 in term 0.
I20260709 14:54:22.724493 15311 raft_consensus.cc:359] T b97c761f72c14075b65e501c4b3ae0fb P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:22.726469 15311 raft_consensus.cc:385] T b97c761f72c14075b65e501c4b3ae0fb P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:22.728847 15311 raft_consensus.cc:740] T b97c761f72c14075b65e501c4b3ae0fb P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eaa34beb1b274443b1c46839afd0a484, State: Initialized, Role: FOLLOWER
I20260709 14:54:22.730769 15311 consensus_queue.cc:260] T b97c761f72c14075b65e501c4b3ae0fb P eaa34beb1b274443b1c46839afd0a484 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:22.734087 15311 ts_tablet_manager.cc:1434] T b97c761f72c14075b65e501c4b3ae0fb P eaa34beb1b274443b1c46839afd0a484: Time spent starting tablet: real 0.076s	user 0.011s	sys 0.000s
I20260709 14:54:22.687844 15432 consensus_queue.cc:1048] T 342798bf4325470fa3991757eadb0764 P 7519e608fbb44d9db8ad30b9f10ae605 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.038s
I20260709 14:54:22.738193 15311 tablet_bootstrap.cc:492] T 5b9f8063585c4e5faddebd56fbe1aa01 P eaa34beb1b274443b1c46839afd0a484: Bootstrap starting.
I20260709 14:54:22.720889 15594 raft_consensus.cc:515] T dd44b332dc744f94a5f7cfffc06f3956 P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:22.764743 15309 raft_consensus.cc:359] T 9f90ac0a3b004f6ca430ff2fc5198678 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:22.765473 15309 raft_consensus.cc:385] T 9f90ac0a3b004f6ca430ff2fc5198678 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:22.765769 15309 raft_consensus.cc:740] T 9f90ac0a3b004f6ca430ff2fc5198678 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7519e608fbb44d9db8ad30b9f10ae605, State: Initialized, Role: FOLLOWER
I20260709 14:54:22.766812 15309 consensus_queue.cc:260] T 9f90ac0a3b004f6ca430ff2fc5198678 P 7519e608fbb44d9db8ad30b9f10ae605 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:22.768323 15677 leader_election.cc:290] T e43bf64543ef494790c2f7a4a063fdd1 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177), eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805)
I20260709 14:54:22.769622 15309 ts_tablet_manager.cc:1434] T 9f90ac0a3b004f6ca430ff2fc5198678 P 7519e608fbb44d9db8ad30b9f10ae605: Time spent starting tablet: real 0.210s	user 0.007s	sys 0.003s
W20260709 14:54:22.834380 15079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:33805, user_credentials={real_user=slave}} blocked reactor thread for 192204us
I20260709 14:54:22.846313 15112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43bf64543ef494790c2f7a4a063fdd1" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605" is_pre_election: true
I20260709 14:54:22.851115 15306 tablet_bootstrap.cc:492] T 4abdbdda3ce149a9904e919be18e7a3f P dbc2c92e49e346b5b3bd7705a229afc6: No bootstrap required, opened a new log
I20260709 14:54:22.853027 15306 ts_tablet_manager.cc:1403] T 4abdbdda3ce149a9904e919be18e7a3f P dbc2c92e49e346b5b3bd7705a229afc6: Time spent bootstrapping tablet: real 0.717s	user 0.014s	sys 0.014s
I20260709 14:54:22.896134 15183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43bf64543ef494790c2f7a4a063fdd1" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484" is_pre_election: true
W20260709 14:54:22.904665 15079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:33805, user_credentials={real_user=slave}} blocked reactor thread for 63152us
I20260709 14:54:22.884879 15107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e8a01e27eab492bb73df3359e500627" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605" is_pre_election: true
I20260709 14:54:22.954342 15183 raft_consensus.cc:2468] T e43bf64543ef494790c2f7a4a063fdd1 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cb8de0701f2482b99e51d5ac080aa13 in term 0.
W20260709 14:54:22.957664 15224 leader_election.cc:343] T e43bf64543ef494790c2f7a4a063fdd1 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:22.964336 15311 tablet_bootstrap.cc:654] T 5b9f8063585c4e5faddebd56fbe1aa01 P eaa34beb1b274443b1c46839afd0a484: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:22.971753 15307 tablet_bootstrap.cc:492] T 594083b10772433f90560d387bbbeabe P 9cb8de0701f2482b99e51d5ac080aa13: No bootstrap required, opened a new log
I20260709 14:54:22.989106 15309 tablet_bootstrap.cc:492] T bdf08eed05854470954a5e9dd17dfb27 P 7519e608fbb44d9db8ad30b9f10ae605: Bootstrap starting.
I20260709 14:54:23.008834 15623 raft_consensus.cc:493] T b97c761f72c14075b65e501c4b3ae0fb P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:23.010773 15623 raft_consensus.cc:515] T b97c761f72c14075b65e501c4b3ae0fb P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:23.024677 15227 leader_election.cc:304] T e43bf64543ef494790c2f7a4a063fdd1 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9cb8de0701f2482b99e51d5ac080aa13, eaa34beb1b274443b1c46839afd0a484; no voters: 7519e608fbb44d9db8ad30b9f10ae605
I20260709 14:54:23.030913 15647 raft_consensus.cc:2804] T e43bf64543ef494790c2f7a4a063fdd1 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:54:23.031550 15647 raft_consensus.cc:493] T e43bf64543ef494790c2f7a4a063fdd1 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:54:23.032007 15647 raft_consensus.cc:3060] T e43bf64543ef494790c2f7a4a063fdd1 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:23.032869 15307 ts_tablet_manager.cc:1403] T 594083b10772433f90560d387bbbeabe P 9cb8de0701f2482b99e51d5ac080aa13: Time spent bootstrapping tablet: real 0.770s	user 0.014s	sys 0.015s
I20260709 14:54:23.035048 15311 tablet_bootstrap.cc:492] T 5b9f8063585c4e5faddebd56fbe1aa01 P eaa34beb1b274443b1c46839afd0a484: No bootstrap required, opened a new log
I20260709 14:54:23.036607 15311 ts_tablet_manager.cc:1403] T 5b9f8063585c4e5faddebd56fbe1aa01 P eaa34beb1b274443b1c46839afd0a484: Time spent bootstrapping tablet: real 0.299s	user 0.012s	sys 0.008s
W20260709 14:54:23.041559 15227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:33805, user_credentials={real_user=slave}} blocked reactor thread for 44927.9us
W20260709 14:54:23.047230 15150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.68:45493, user_credentials={real_user=slave}} blocked reactor thread for 47260.9us
I20260709 14:54:23.024780 15306 raft_consensus.cc:359] T 4abdbdda3ce149a9904e919be18e7a3f P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:23.079361 15594 leader_election.cc:290] T dd44b332dc744f94a5f7cfffc06f3956 P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493), dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477)
I20260709 14:54:23.070132 15306 raft_consensus.cc:385] T 4abdbdda3ce149a9904e919be18e7a3f P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:23.093978 14932 catalog_manager.cc:5697] T b7c363a305d3434092ef6016b7064eb3 P 9cb8de0701f2482b99e51d5ac080aa13 reported cstate change: term changed from 0 to 2, leader changed from <none> to 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68). New cstate: current_term: 2 leader_uuid: "9cb8de0701f2482b99e51d5ac080aa13" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } health_report { overall_health: UNKNOWN } } }
I20260709 14:54:23.108232 15616 raft_consensus.cc:493] T d178b88fdab54a29b05fb98e05ffe8c5 P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:23.110908 15311 raft_consensus.cc:359] T 5b9f8063585c4e5faddebd56fbe1aa01 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:23.111912 15616 raft_consensus.cc:515] T d178b88fdab54a29b05fb98e05ffe8c5 P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:23.118424 15616 leader_election.cc:290] T d178b88fdab54a29b05fb98e05ffe8c5 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493), dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477)
I20260709 14:54:23.126309 15311 raft_consensus.cc:385] T 5b9f8063585c4e5faddebd56fbe1aa01 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:23.082677 15306 raft_consensus.cc:740] T 4abdbdda3ce149a9904e919be18e7a3f P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbc2c92e49e346b5b3bd7705a229afc6, State: Initialized, Role: FOLLOWER
I20260709 14:54:23.126734 15311 raft_consensus.cc:740] T 5b9f8063585c4e5faddebd56fbe1aa01 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eaa34beb1b274443b1c46839afd0a484, State: Initialized, Role: FOLLOWER
I20260709 14:54:23.097491 15623 leader_election.cc:290] T b97c761f72c14075b65e501c4b3ae0fb P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177), 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493)
I20260709 14:54:23.132020 15110 raft_consensus.cc:3060] T 9f90ac0a3b004f6ca430ff2fc5198678 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:23.108753 15307 raft_consensus.cc:359] T 594083b10772433f90560d387bbbeabe P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:23.132853 15307 raft_consensus.cc:385] T 594083b10772433f90560d387bbbeabe P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:23.133205 15307 raft_consensus.cc:740] T 594083b10772433f90560d387bbbeabe P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9cb8de0701f2482b99e51d5ac080aa13, State: Initialized, Role: FOLLOWER
I20260709 14:54:23.134325 15254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd44b332dc744f94a5f7cfffc06f3956" candidate_uuid: "7519e608fbb44d9db8ad30b9f10ae605" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13" is_pre_election: true
I20260709 14:54:23.134162 15307 consensus_queue.cc:260] T 594083b10772433f90560d387bbbeabe P 9cb8de0701f2482b99e51d5ac080aa13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
W20260709 14:54:23.167392 15001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:43177, user_credentials={real_user=slave}} blocked reactor thread for 529155us
I20260709 14:54:23.168599 15307 ts_tablet_manager.cc:1434] T 594083b10772433f90560d387bbbeabe P 9cb8de0701f2482b99e51d5ac080aa13: Time spent starting tablet: real 0.135s	user 0.012s	sys 0.000s
W20260709 14:54:23.155373 15004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:33805, user_credentials={real_user=slave}} blocked reactor thread for 541991us
W20260709 14:54:23.172508 15150 leader_election.cc:343] T 5e8a01e27eab492bb73df3359e500627 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:23.162753 15306 consensus_queue.cc:260] T 4abdbdda3ce149a9904e919be18e7a3f P dbc2c92e49e346b5b3bd7705a229afc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:23.183043 15306 ts_tablet_manager.cc:1434] T 4abdbdda3ce149a9904e919be18e7a3f P dbc2c92e49e346b5b3bd7705a229afc6: Time spent starting tablet: real 0.329s	user 0.011s	sys 0.003s
I20260709 14:54:23.167404 15309 tablet_bootstrap.cc:654] T bdf08eed05854470954a5e9dd17dfb27 P 7519e608fbb44d9db8ad30b9f10ae605: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:23.162607 15311 consensus_queue.cc:260] T 5b9f8063585c4e5faddebd56fbe1aa01 P eaa34beb1b274443b1c46839afd0a484 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:23.189733 15306 tablet_bootstrap.cc:492] T a9dab1878c4b4550880f5680c6d48c67 P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap starting.
I20260709 14:54:23.210546 15108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97c761f72c14075b65e501c4b3ae0fb" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605" is_pre_election: true
I20260709 14:54:23.217823 15254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97c761f72c14075b65e501c4b3ae0fb" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13" is_pre_election: true
W20260709 14:54:23.230208 15150 leader_election.cc:343] T b97c761f72c14075b65e501c4b3ae0fb P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:23.230576 15311 ts_tablet_manager.cc:1434] T 5b9f8063585c4e5faddebd56fbe1aa01 P eaa34beb1b274443b1c46839afd0a484: Time spent starting tablet: real 0.190s	user 0.008s	sys 0.006s
I20260709 14:54:23.238974 15311 tablet_bootstrap.cc:492] T d2463fd792b240e9911c6b38bcb453b8 P eaa34beb1b274443b1c46839afd0a484: Bootstrap starting.
I20260709 14:54:23.243736 15254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d178b88fdab54a29b05fb98e05ffe8c5" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13" is_pre_election: true
I20260709 14:54:23.244897 15254 raft_consensus.cc:2468] T d178b88fdab54a29b05fb98e05ffe8c5 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa34beb1b274443b1c46839afd0a484 in term 1.
I20260709 14:54:23.247634 15726 raft_consensus.cc:493] T d178b88fdab54a29b05fb98e05ffe8c5 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:23.248939 15726 raft_consensus.cc:515] T d178b88fdab54a29b05fb98e05ffe8c5 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
W20260709 14:54:23.255905 15150 leader_election.cc:343] T b97c761f72c14075b65e501c4b3ae0fb P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:23.256377 15726 leader_election.cc:290] T d178b88fdab54a29b05fb98e05ffe8c5 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805), 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493)
I20260709 14:54:23.272161 15001 leader_election.cc:304] T b7c363a305d3434092ef6016b7064eb3 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbc2c92e49e346b5b3bd7705a229afc6; no voters: 7519e608fbb44d9db8ad30b9f10ae605, 9cb8de0701f2482b99e51d5ac080aa13
I20260709 14:54:23.275169 15032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd44b332dc744f94a5f7cfffc06f3956" candidate_uuid: "7519e608fbb44d9db8ad30b9f10ae605" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" is_pre_election: true
I20260709 14:54:23.279760 15109 raft_consensus.cc:1275] T b7c363a305d3434092ef6016b7064eb3 P 7519e608fbb44d9db8ad30b9f10ae605 [term 2 FOLLOWER]: Refusing update from remote peer 9cb8de0701f2482b99e51d5ac080aa13: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 14:54:23.282544 15647 raft_consensus.cc:515] T e43bf64543ef494790c2f7a4a063fdd1 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:23.284017 15432 raft_consensus.cc:493] T 9f90ac0a3b004f6ca430ff2fc5198678 P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:23.284731 15432 raft_consensus.cc:515] T 9f90ac0a3b004f6ca430ff2fc5198678 P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:23.286188 15647 leader_election.cc:290] T e43bf64543ef494790c2f7a4a063fdd1 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 election: Requested vote from peers 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177), eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805)
I20260709 14:54:23.291244 15186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f90ac0a3b004f6ca430ff2fc5198678" candidate_uuid: "7519e608fbb44d9db8ad30b9f10ae605" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484" is_pre_election: true
I20260709 14:54:23.294938 15432 leader_election.cc:290] T 9f90ac0a3b004f6ca430ff2fc5198678 P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477), eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805)
I20260709 14:54:23.263437 15150 leader_election.cc:304] T b97c761f72c14075b65e501c4b3ae0fb P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa34beb1b274443b1c46839afd0a484; no voters: 7519e608fbb44d9db8ad30b9f10ae605, 9cb8de0701f2482b99e51d5ac080aa13
W20260709 14:54:23.303102 15150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.68:45493, user_credentials={real_user=slave}} blocked reactor thread for 47244.5us
I20260709 14:54:23.304652 15623 raft_consensus.cc:2749] T b97c761f72c14075b65e501c4b3ae0fb P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:54:23.317898 15306 tablet_bootstrap.cc:654] T a9dab1878c4b4550880f5680c6d48c67 P dbc2c92e49e346b5b3bd7705a229afc6: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:23.324568 15181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43bf64543ef494790c2f7a4a063fdd1" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484"
I20260709 14:54:23.325518 15181 raft_consensus.cc:3060] T e43bf64543ef494790c2f7a4a063fdd1 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:23.317674 15613 raft_consensus.cc:2749] T b7c363a305d3434092ef6016b7064eb3 P dbc2c92e49e346b5b3bd7705a229afc6 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 14:54:23.322146 15184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d178b88fdab54a29b05fb98e05ffe8c5" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484" is_pre_election: true
I20260709 14:54:23.330610 15184 raft_consensus.cc:2468] T d178b88fdab54a29b05fb98e05ffe8c5 P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbc2c92e49e346b5b3bd7705a229afc6 in term 1.
I20260709 14:54:23.337667 15004 leader_election.cc:304] T d178b88fdab54a29b05fb98e05ffe8c5 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dbc2c92e49e346b5b3bd7705a229afc6, eaa34beb1b274443b1c46839afd0a484; no voters: 
I20260709 14:54:23.339052 15613 raft_consensus.cc:2804] T d178b88fdab54a29b05fb98e05ffe8c5 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 14:54:23.339834 15613 raft_consensus.cc:493] T d178b88fdab54a29b05fb98e05ffe8c5 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:54:23.340296 15613 raft_consensus.cc:3060] T d178b88fdab54a29b05fb98e05ffe8c5 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:54:23.340319 15677 raft_consensus.cc:493] T 594083b10772433f90560d387bbbeabe P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:23.341202 15677 raft_consensus.cc:515] T 594083b10772433f90560d387bbbeabe P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:23.355160 15150 leader_election.cc:304] T d178b88fdab54a29b05fb98e05ffe8c5 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cb8de0701f2482b99e51d5ac080aa13, eaa34beb1b274443b1c46839afd0a484; no voters: 
I20260709 14:54:23.359314 15623 raft_consensus.cc:2804] T d178b88fdab54a29b05fb98e05ffe8c5 P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 14:54:23.359897 15623 raft_consensus.cc:493] T d178b88fdab54a29b05fb98e05ffe8c5 P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:54:23.360245 15623 raft_consensus.cc:3060] T d178b88fdab54a29b05fb98e05ffe8c5 P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:54:23.365100 15307 tablet_bootstrap.cc:492] T bdf08eed05854470954a5e9dd17dfb27 P 9cb8de0701f2482b99e51d5ac080aa13: Bootstrap starting.
I20260709 14:54:23.372498 15661 raft_consensus.cc:493] T 5b9f8063585c4e5faddebd56fbe1aa01 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:54:23.374156 15001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.68:45493, user_credentials={real_user=slave}} blocked reactor thread for 102249us
I20260709 14:54:23.373870 15661 raft_consensus.cc:515] T 5b9f8063585c4e5faddebd56fbe1aa01 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:23.378490 15255 raft_consensus.cc:3060] T 594083b10772433f90560d387bbbeabe P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:23.379141 15677 leader_election.cc:290] T 594083b10772433f90560d387bbbeabe P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805), dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477)
I20260709 14:54:23.372725 15185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594083b10772433f90560d387bbbeabe" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484" is_pre_election: true
I20260709 14:54:23.387645 15257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b9f8063585c4e5faddebd56fbe1aa01" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13" is_pre_election: true
I20260709 14:54:23.435357 15307 tablet_bootstrap.cc:654] T bdf08eed05854470954a5e9dd17dfb27 P 9cb8de0701f2482b99e51d5ac080aa13: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:23.407124 15661 leader_election.cc:290] T 5b9f8063585c4e5faddebd56fbe1aa01 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493), dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477)
I20260709 14:54:23.407239 15647 consensus_queue.cc:1048] T b7c363a305d3434092ef6016b7064eb3 P 9cb8de0701f2482b99e51d5ac080aa13 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.029s
I20260709 14:54:23.441088 15309 tablet_bootstrap.cc:492] T bdf08eed05854470954a5e9dd17dfb27 P 7519e608fbb44d9db8ad30b9f10ae605: No bootstrap required, opened a new log
I20260709 14:54:23.456193 15309 ts_tablet_manager.cc:1403] T bdf08eed05854470954a5e9dd17dfb27 P 7519e608fbb44d9db8ad30b9f10ae605: Time spent bootstrapping tablet: real 0.468s	user 0.025s	sys 0.036s
I20260709 14:54:23.445981 15311 tablet_bootstrap.cc:654] T d2463fd792b240e9911c6b38bcb453b8 P eaa34beb1b274443b1c46839afd0a484: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:23.469587 15723 consensus_queue.cc:1048] T 9f90ac0a3b004f6ca430ff2fc5198678 P dbc2c92e49e346b5b3bd7705a229afc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
I20260709 14:54:23.470660 15257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d178b88fdab54a29b05fb98e05ffe8c5" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13" is_pre_election: true
I20260709 14:54:23.471542 15257 raft_consensus.cc:2468] T d178b88fdab54a29b05fb98e05ffe8c5 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbc2c92e49e346b5b3bd7705a229afc6 in term 1.
I20260709 14:54:23.474910 15079 leader_election.cc:304] T dd44b332dc744f94a5f7cfffc06f3956 P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7519e608fbb44d9db8ad30b9f10ae605; no voters: 9cb8de0701f2482b99e51d5ac080aa13, dbc2c92e49e346b5b3bd7705a229afc6
I20260709 14:54:23.447398 15153 leader_election.cc:304] T 5e8a01e27eab492bb73df3359e500627 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dbc2c92e49e346b5b3bd7705a229afc6, eaa34beb1b274443b1c46839afd0a484; no voters: 7519e608fbb44d9db8ad30b9f10ae605
I20260709 14:54:23.477200 15721 raft_consensus.cc:2749] T dd44b332dc744f94a5f7cfffc06f3956 P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 14:54:23.449733 15034 raft_consensus.cc:1275] T b7c363a305d3434092ef6016b7064eb3 P dbc2c92e49e346b5b3bd7705a229afc6 [term 2 FOLLOWER]: Refusing update from remote peer 9cb8de0701f2482b99e51d5ac080aa13: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 14:54:23.485664 15661 raft_consensus.cc:2804] T 5e8a01e27eab492bb73df3359e500627 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:54:23.486263 15661 raft_consensus.cc:493] T 5e8a01e27eab492bb73df3359e500627 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:54:23.486662 15661 raft_consensus.cc:3060] T 5e8a01e27eab492bb73df3359e500627 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:23.480471 15033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594083b10772433f90560d387bbbeabe" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" is_pre_election: true
I20260709 14:54:23.443614 15110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43bf64543ef494790c2f7a4a063fdd1" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605"
I20260709 14:54:23.498129 15034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d178b88fdab54a29b05fb98e05ffe8c5" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" is_pre_election: true
I20260709 14:54:23.483570 15623 raft_consensus.cc:515] T d178b88fdab54a29b05fb98e05ffe8c5 P eaa34beb1b274443b1c46839afd0a484 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
W20260709 14:54:23.520694 15224 leader_election.cc:343] T e43bf64543ef494790c2f7a4a063fdd1 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:23.567518 15647 consensus_queue.cc:1048] T b7c363a305d3434092ef6016b7064eb3 P 9cb8de0701f2482b99e51d5ac080aa13 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 14:54:23.572494 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b9f8063585c4e5faddebd56fbe1aa01" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" is_pre_election: true
I20260709 14:54:23.580420 15306 tablet_bootstrap.cc:492] T a9dab1878c4b4550880f5680c6d48c67 P dbc2c92e49e346b5b3bd7705a229afc6: No bootstrap required, opened a new log
I20260709 14:54:23.581525 15306 ts_tablet_manager.cc:1403] T a9dab1878c4b4550880f5680c6d48c67 P dbc2c92e49e346b5b3bd7705a229afc6: Time spent bootstrapping tablet: real 0.397s	user 0.033s	sys 0.025s
I20260709 14:54:23.555444 15033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f90ac0a3b004f6ca430ff2fc5198678" candidate_uuid: "7519e608fbb44d9db8ad30b9f10ae605" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" is_pre_election: true
W20260709 14:54:23.583102 15150 leader_election.cc:343] T 5b9f8063585c4e5faddebd56fbe1aa01 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493): Illegal state: must be running to vote when last-logged opid is not known
W20260709 14:54:23.590720 15153 leader_election.cc:343] T 5b9f8063585c4e5faddebd56fbe1aa01 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:23.591398 15153 leader_election.cc:304] T 5b9f8063585c4e5faddebd56fbe1aa01 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa34beb1b274443b1c46839afd0a484; no voters: 9cb8de0701f2482b99e51d5ac080aa13, dbc2c92e49e346b5b3bd7705a229afc6
I20260709 14:54:23.630028 15079 leader_election.cc:304] T 9f90ac0a3b004f6ca430ff2fc5198678 P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7519e608fbb44d9db8ad30b9f10ae605; no voters: dbc2c92e49e346b5b3bd7705a229afc6, eaa34beb1b274443b1c46839afd0a484
I20260709 14:54:23.651540 15724 raft_consensus.cc:493] T 4abdbdda3ce149a9904e919be18e7a3f P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:23.652331 15724 raft_consensus.cc:515] T 4abdbdda3ce149a9904e919be18e7a3f P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:23.669416 15309 raft_consensus.cc:359] T bdf08eed05854470954a5e9dd17dfb27 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:23.679339 15309 raft_consensus.cc:385] T bdf08eed05854470954a5e9dd17dfb27 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:23.679778 15309 raft_consensus.cc:740] T bdf08eed05854470954a5e9dd17dfb27 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7519e608fbb44d9db8ad30b9f10ae605, State: Initialized, Role: FOLLOWER
I20260709 14:54:23.657074 15623 leader_election.cc:290] T d178b88fdab54a29b05fb98e05ffe8c5 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 2 election: Requested vote from peers 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493), dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477)
I20260709 14:54:23.685858 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d178b88fdab54a29b05fb98e05ffe8c5" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc2c92e49e346b5b3bd7705a229afc6"
I20260709 14:54:23.695751 15613 raft_consensus.cc:515] T d178b88fdab54a29b05fb98e05ffe8c5 P dbc2c92e49e346b5b3bd7705a229afc6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:23.700186 15663 raft_consensus.cc:2749] T 5b9f8063585c4e5faddebd56fbe1aa01 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:54:23.702302 15034 raft_consensus.cc:2393] T d178b88fdab54a29b05fb98e05ffe8c5 P dbc2c92e49e346b5b3bd7705a229afc6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eaa34beb1b274443b1c46839afd0a484 in current term 2: Already voted for candidate dbc2c92e49e346b5b3bd7705a229afc6 in this term.
I20260709 14:54:23.709142 15184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abdbdda3ce149a9904e919be18e7a3f" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484" is_pre_election: true
I20260709 14:54:23.710394 15184 raft_consensus.cc:2468] T 4abdbdda3ce149a9904e919be18e7a3f P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbc2c92e49e346b5b3bd7705a229afc6 in term 0.
I20260709 14:54:23.712846 15257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d178b88fdab54a29b05fb98e05ffe8c5" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13"
I20260709 14:54:23.713682 15004 leader_election.cc:304] T 4abdbdda3ce149a9904e919be18e7a3f P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dbc2c92e49e346b5b3bd7705a229afc6, eaa34beb1b274443b1c46839afd0a484; no voters: 
I20260709 14:54:23.713770 15257 raft_consensus.cc:3060] T d178b88fdab54a29b05fb98e05ffe8c5 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:54:23.700429 15724 leader_election.cc:290] T 4abdbdda3ce149a9904e919be18e7a3f P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805), 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493)
I20260709 14:54:23.715274 15723 raft_consensus.cc:2804] T 4abdbdda3ce149a9904e919be18e7a3f P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:54:23.721837 15723 raft_consensus.cc:493] T 4abdbdda3ce149a9904e919be18e7a3f P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:54:23.723582 15227 leader_election.cc:304] T 594083b10772433f90560d387bbbeabe P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cb8de0701f2482b99e51d5ac080aa13; no voters: dbc2c92e49e346b5b3bd7705a229afc6, eaa34beb1b274443b1c46839afd0a484
I20260709 14:54:23.726711 15647 raft_consensus.cc:2749] T 594083b10772433f90560d387bbbeabe P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:54:23.728040 15613 leader_election.cc:290] T d178b88fdab54a29b05fb98e05ffe8c5 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 2 election: Requested vote from peers eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805), 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493)
I20260709 14:54:23.722308 15309 consensus_queue.cc:260] T bdf08eed05854470954a5e9dd17dfb27 P 7519e608fbb44d9db8ad30b9f10ae605 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:23.729672 15306 raft_consensus.cc:359] T a9dab1878c4b4550880f5680c6d48c67 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:23.731454 15306 raft_consensus.cc:385] T a9dab1878c4b4550880f5680c6d48c67 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:23.732138 15306 raft_consensus.cc:740] T a9dab1878c4b4550880f5680c6d48c67 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbc2c92e49e346b5b3bd7705a229afc6, State: Initialized, Role: FOLLOWER
I20260709 14:54:23.738956 15259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abdbdda3ce149a9904e919be18e7a3f" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13" is_pre_election: true
I20260709 14:54:23.747903 15309 ts_tablet_manager.cc:1434] T bdf08eed05854470954a5e9dd17dfb27 P 7519e608fbb44d9db8ad30b9f10ae605: Time spent starting tablet: real 0.291s	user 0.009s	sys 0.001s
I20260709 14:54:23.749717 15309 tablet_bootstrap.cc:492] T e43bf64543ef494790c2f7a4a063fdd1 P 7519e608fbb44d9db8ad30b9f10ae605: Bootstrap starting.
I20260709 14:54:23.734774 15306 consensus_queue.cc:260] T a9dab1878c4b4550880f5680c6d48c67 P dbc2c92e49e346b5b3bd7705a229afc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:23.753409 15184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d178b88fdab54a29b05fb98e05ffe8c5" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484"
I20260709 14:54:23.754674 15184 raft_consensus.cc:2393] T d178b88fdab54a29b05fb98e05ffe8c5 P eaa34beb1b274443b1c46839afd0a484 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate dbc2c92e49e346b5b3bd7705a229afc6 in current term 2: Already voted for candidate eaa34beb1b274443b1c46839afd0a484 in this term.
I20260709 14:54:23.722268 15723 raft_consensus.cc:3060] T 4abdbdda3ce149a9904e919be18e7a3f P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:23.769060 15306 ts_tablet_manager.cc:1434] T a9dab1878c4b4550880f5680c6d48c67 P dbc2c92e49e346b5b3bd7705a229afc6: Time spent starting tablet: real 0.185s	user 0.003s	sys 0.008s
W20260709 14:54:23.789301 15001 leader_election.cc:343] T 4abdbdda3ce149a9904e919be18e7a3f P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:23.677031 15661 raft_consensus.cc:515] T 5e8a01e27eab492bb73df3359e500627 P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:23.799855 15254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d178b88fdab54a29b05fb98e05ffe8c5" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13"
I20260709 14:54:23.821667 15306 tablet_bootstrap.cc:492] T db39b7ffe995451885f4074ddf16028d P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap starting.
I20260709 14:54:23.871106 15001 leader_election.cc:304] T d178b88fdab54a29b05fb98e05ffe8c5 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbc2c92e49e346b5b3bd7705a229afc6; no voters: 9cb8de0701f2482b99e51d5ac080aa13, eaa34beb1b274443b1c46839afd0a484
W20260709 14:54:23.872373 15001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.68:45493, user_credentials={real_user=slave}} blocked reactor thread for 53919.6us
I20260709 14:54:23.874096 15726 raft_consensus.cc:2749] T d178b88fdab54a29b05fb98e05ffe8c5 P dbc2c92e49e346b5b3bd7705a229afc6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 14:54:23.875527 15307 tablet_bootstrap.cc:492] T bdf08eed05854470954a5e9dd17dfb27 P 9cb8de0701f2482b99e51d5ac080aa13: No bootstrap required, opened a new log
I20260709 14:54:23.876262 15307 ts_tablet_manager.cc:1403] T bdf08eed05854470954a5e9dd17dfb27 P 9cb8de0701f2482b99e51d5ac080aa13: Time spent bootstrapping tablet: real 0.512s	user 0.019s	sys 0.008s
I20260709 14:54:23.895653 15307 raft_consensus.cc:359] T bdf08eed05854470954a5e9dd17dfb27 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:23.896577 15307 raft_consensus.cc:385] T bdf08eed05854470954a5e9dd17dfb27 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:23.896885 15307 raft_consensus.cc:740] T bdf08eed05854470954a5e9dd17dfb27 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9cb8de0701f2482b99e51d5ac080aa13, State: Initialized, Role: FOLLOWER
I20260709 14:54:23.909070 15307 consensus_queue.cc:260] T bdf08eed05854470954a5e9dd17dfb27 P 9cb8de0701f2482b99e51d5ac080aa13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:23.907593 15432 raft_consensus.cc:2749] T 9f90ac0a3b004f6ca430ff2fc5198678 P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 14:54:23.917376 15661 leader_election.cc:290] T 5e8a01e27eab492bb73df3359e500627 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 election: Requested vote from peers dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477), 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177)
I20260709 14:54:23.918311 15109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e8a01e27eab492bb73df3359e500627" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605"
W20260709 14:54:23.920583 15150 leader_election.cc:343] T 5e8a01e27eab492bb73df3359e500627 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:23.860848 15723 raft_consensus.cc:515] T 4abdbdda3ce149a9904e919be18e7a3f P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:23.935281 15723 leader_election.cc:290] T 4abdbdda3ce149a9904e919be18e7a3f P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 election: Requested vote from peers eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805), 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493)
I20260709 14:54:23.938081 15257 raft_consensus.cc:2468] T d178b88fdab54a29b05fb98e05ffe8c5 P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa34beb1b274443b1c46839afd0a484 in term 2.
I20260709 14:54:23.939365 15183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abdbdda3ce149a9904e919be18e7a3f" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484"
I20260709 14:54:23.940285 15183 raft_consensus.cc:3060] T 4abdbdda3ce149a9904e919be18e7a3f P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Advancing to term 1
W20260709 14:54:23.914355 15181 consensus_meta.cc:287] T e43bf64543ef494790c2f7a4a063fdd1 P eaa34beb1b274443b1c46839afd0a484: Time spent flushing consensus metadata: real 0.588s	user 0.012s	sys 0.005s
I20260709 14:54:23.941515 15181 raft_consensus.cc:2468] T e43bf64543ef494790c2f7a4a063fdd1 P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cb8de0701f2482b99e51d5ac080aa13 in term 1.
I20260709 14:54:23.945499 15309 tablet_bootstrap.cc:654] T e43bf64543ef494790c2f7a4a063fdd1 P 7519e608fbb44d9db8ad30b9f10ae605: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:23.956807 15311 tablet_bootstrap.cc:492] T d2463fd792b240e9911c6b38bcb453b8 P eaa34beb1b274443b1c46839afd0a484: No bootstrap required, opened a new log
I20260709 14:54:23.957909 15311 ts_tablet_manager.cc:1403] T d2463fd792b240e9911c6b38bcb453b8 P eaa34beb1b274443b1c46839afd0a484: Time spent bootstrapping tablet: real 0.719s	user 0.023s	sys 0.022s
I20260709 14:54:23.966178 15150 leader_election.cc:304] T d178b88fdab54a29b05fb98e05ffe8c5 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9cb8de0701f2482b99e51d5ac080aa13, eaa34beb1b274443b1c46839afd0a484; no voters: dbc2c92e49e346b5b3bd7705a229afc6
I20260709 14:54:23.967463 15694 raft_consensus.cc:493] T a9dab1878c4b4550880f5680c6d48c67 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:23.967891 15739 raft_consensus.cc:2804] T d178b88fdab54a29b05fb98e05ffe8c5 P eaa34beb1b274443b1c46839afd0a484 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:54:23.968611 15739 raft_consensus.cc:697] T d178b88fdab54a29b05fb98e05ffe8c5 P eaa34beb1b274443b1c46839afd0a484 [term 2 LEADER]: Becoming Leader. State: Replica: eaa34beb1b274443b1c46839afd0a484, State: Running, Role: LEADER
I20260709 14:54:23.970070 15739 consensus_queue.cc:237] T d178b88fdab54a29b05fb98e05ffe8c5 P eaa34beb1b274443b1c46839afd0a484 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:23.970631 15677 raft_consensus.cc:493] T bdf08eed05854470954a5e9dd17dfb27 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:23.971187 15677 raft_consensus.cc:515] T bdf08eed05854470954a5e9dd17dfb27 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:23.974532 15677 leader_election.cc:290] T bdf08eed05854470954a5e9dd17dfb27 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477), 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177)
I20260709 14:54:23.968896 15306 tablet_bootstrap.cc:654] T db39b7ffe995451885f4074ddf16028d P dbc2c92e49e346b5b3bd7705a229afc6: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:23.977592 15227 leader_election.cc:304] T e43bf64543ef494790c2f7a4a063fdd1 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9cb8de0701f2482b99e51d5ac080aa13, eaa34beb1b274443b1c46839afd0a484; no voters: 7519e608fbb44d9db8ad30b9f10ae605
I20260709 14:54:23.950937 15034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e8a01e27eab492bb73df3359e500627" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc2c92e49e346b5b3bd7705a229afc6"
I20260709 14:54:23.995211 15307 ts_tablet_manager.cc:1434] T bdf08eed05854470954a5e9dd17dfb27 P 9cb8de0701f2482b99e51d5ac080aa13: Time spent starting tablet: real 0.119s	user 0.014s	sys 0.001s
I20260709 14:54:23.968197 15694 raft_consensus.cc:515] T a9dab1878c4b4550880f5680c6d48c67 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:24.000449 15694 leader_election.cc:290] T a9dab1878c4b4550880f5680c6d48c67 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177), eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805)
I20260709 14:54:24.001690 15685 raft_consensus.cc:2804] T e43bf64543ef494790c2f7a4a063fdd1 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 14:54:24.017712 15224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:43177, user_credentials={real_user=slave}} blocked reactor thread for 61615.4us
I20260709 14:54:24.002849 15685 raft_consensus.cc:697] T e43bf64543ef494790c2f7a4a063fdd1 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 LEADER]: Becoming Leader. State: Replica: 9cb8de0701f2482b99e51d5ac080aa13, State: Running, Role: LEADER
I20260709 14:54:24.020432 15034 raft_consensus.cc:3060] T 5e8a01e27eab492bb73df3359e500627 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:24.032348 15257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abdbdda3ce149a9904e919be18e7a3f" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13"
I20260709 14:54:24.033936 15307 tablet_bootstrap.cc:492] T b97c761f72c14075b65e501c4b3ae0fb P 9cb8de0701f2482b99e51d5ac080aa13: Bootstrap starting.
I20260709 14:54:24.038151 15105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf08eed05854470954a5e9dd17dfb27" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605" is_pre_election: true
I20260709 14:54:24.032213 15311 raft_consensus.cc:359] T d2463fd792b240e9911c6b38bcb453b8 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:24.046175 15311 raft_consensus.cc:385] T d2463fd792b240e9911c6b38bcb453b8 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:24.046535 15311 raft_consensus.cc:740] T d2463fd792b240e9911c6b38bcb453b8 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eaa34beb1b274443b1c46839afd0a484, State: Initialized, Role: FOLLOWER
I20260709 14:54:24.041220 15032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf08eed05854470954a5e9dd17dfb27" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" is_pre_election: true
I20260709 14:54:24.052214 15032 raft_consensus.cc:2468] T bdf08eed05854470954a5e9dd17dfb27 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cb8de0701f2482b99e51d5ac080aa13 in term 0.
I20260709 14:54:24.058881 15227 leader_election.cc:304] T bdf08eed05854470954a5e9dd17dfb27 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cb8de0701f2482b99e51d5ac080aa13, dbc2c92e49e346b5b3bd7705a229afc6; no voters: 
I20260709 14:54:24.042865 15108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dab1878c4b4550880f5680c6d48c67" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605" is_pre_election: true
I20260709 14:54:24.059459 15105 raft_consensus.cc:2468] T bdf08eed05854470954a5e9dd17dfb27 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cb8de0701f2482b99e51d5ac080aa13 in term 0.
I20260709 14:54:24.081835 14932 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54022 (request call id 67) took 1254 ms. Trace:
I20260709 14:54:24.061915 15181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dab1878c4b4550880f5680c6d48c67" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484" is_pre_election: true
I20260709 14:54:24.085594 15545 raft_consensus.cc:2804] T bdf08eed05854470954a5e9dd17dfb27 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:54:24.089385 15183 raft_consensus.cc:2468] T 4abdbdda3ce149a9904e919be18e7a3f P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbc2c92e49e346b5b3bd7705a229afc6 in term 1.
I20260709 14:54:24.094141 15545 raft_consensus.cc:493] T bdf08eed05854470954a5e9dd17dfb27 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:54:24.102437 15545 raft_consensus.cc:3060] T bdf08eed05854470954a5e9dd17dfb27 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:24.094331 15311 consensus_queue.cc:260] T d2463fd792b240e9911c6b38bcb453b8 P eaa34beb1b274443b1c46839afd0a484 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:24.117837 15309 tablet_bootstrap.cc:492] T e43bf64543ef494790c2f7a4a063fdd1 P 7519e608fbb44d9db8ad30b9f10ae605: No bootstrap required, opened a new log
I20260709 14:54:24.118456 15309 ts_tablet_manager.cc:1403] T e43bf64543ef494790c2f7a4a063fdd1 P 7519e608fbb44d9db8ad30b9f10ae605: Time spent bootstrapping tablet: real 0.369s	user 0.011s	sys 0.012s
I20260709 14:54:24.121745 15685 consensus_queue.cc:237] T e43bf64543ef494790c2f7a4a063fdd1 P 9cb8de0701f2482b99e51d5ac080aa13 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:24.126293 15004 leader_election.cc:304] T 4abdbdda3ce149a9904e919be18e7a3f P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dbc2c92e49e346b5b3bd7705a229afc6, eaa34beb1b274443b1c46839afd0a484; no voters: 
W20260709 14:54:24.133235 15004 leader_election.cc:343] T a9dab1878c4b4550880f5680c6d48c67 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:24.134974 15695 raft_consensus.cc:2804] T 4abdbdda3ce149a9904e919be18e7a3f P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:54:24.135638 15695 raft_consensus.cc:697] T 4abdbdda3ce149a9904e919be18e7a3f P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 LEADER]: Becoming Leader. State: Replica: dbc2c92e49e346b5b3bd7705a229afc6, State: Running, Role: LEADER
I20260709 14:54:24.136565 15695 consensus_queue.cc:237] T 4abdbdda3ce149a9904e919be18e7a3f P dbc2c92e49e346b5b3bd7705a229afc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:24.091743 14932 rpcz_store.cc:276] 0709 14:54:22.828098 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:54:22.828833 (+   735us) service_pool.cc:224] Handling call
0709 14:54:24.081722 (+1252889us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 14:54:23.316724 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 14:54:23.330869 (+ 14145us) write_op.cc:432] Acquiring schema lock in shared mode
0709 14:54:23.330932 (+    63us) write_op.cc:435] Acquired schema lock
0709 14:54:23.330973 (+    41us) tablet.cc:662] Decoding operations
0709 14:54:23.331685 (+   712us) write_op.cc:620] Acquiring the partition lock for write op
0709 14:54:23.331880 (+   195us) write_op.cc:641] Partition lock acquired for write op
0709 14:54:23.331918 (+    38us) tablet.cc:685] Acquiring locks for 1 operations
0709 14:54:23.332301 (+   383us) tablet.cc:701] Row locks acquired
0709 14:54:23.332335 (+    34us) write_op.cc:260] PREPARE: finished
0709 14:54:23.332566 (+   231us) write_op.cc:270] Start()
0709 14:54:23.332738 (+   172us) write_op.cc:276] Timestamp: P: 1783608863332489 usec, L: 0
0709 14:54:23.332787 (+    49us) op_driver.cc:348] REPLICATION: starting
0709 14:54:23.395753 (+ 62966us) log.cc:844] Serialized 537 byte log entry
0709 14:54:23.857609 (+461856us) op_driver.cc:464] REPLICATION: finished
0709 14:54:24.042251 (+184642us) write_op.cc:301] APPLY: starting
0709 14:54:24.042357 (+   106us) tablet.cc:1367] starting BulkCheckPresence
0709 14:54:24.042497 (+   140us) tablet.cc:1370] finished BulkCheckPresence
0709 14:54:24.042638 (+   141us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 14:54:24.051805 (+  9167us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 14:54:24.052118 (+   313us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 14:54:24.052179 (+    61us) write_op.cc:312] APPLY: finished
0709 14:54:24.052586 (+   407us) log.cc:844] Serialized 22 byte log entry
0709 14:54:24.052818 (+   232us) write_op.cc:489] Releasing partition, row and schema locks
0709 14:54:24.052943 (+   125us) write_op.cc:454] Released schema lock
0709 14:54:24.053012 (+    69us) write_op.cc:341] FINISH: Updating metrics
0709 14:54:24.053684 (+   672us) write_op.cc:489] Releasing partition, row and schema locks
0709 14:54:24.053715 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":59540,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":158767,"apply.run_cpu_time_us":2937,"apply.run_wall_time_us":11438,"num_ops":1,"prepare.queue_time_us":143951,"prepare.run_cpu_time_us":67922,"prepare.run_wall_time_us":214321,"raft.queue_time_us":173045,"raft.run_cpu_time_us":29779,"raft.run_wall_time_us":156655,"replication_time_us":513252,"thread_start_us":462603,"threads_started":4,"wal-append.queue_time_us":186077}]]}
I20260709 14:54:24.180547 15311 ts_tablet_manager.cc:1434] T d2463fd792b240e9911c6b38bcb453b8 P eaa34beb1b274443b1c46839afd0a484: Time spent starting tablet: real 0.221s	user 0.010s	sys 0.003s
I20260709 14:54:24.182610 15311 tablet_bootstrap.cc:492] T a9dab1878c4b4550880f5680c6d48c67 P eaa34beb1b274443b1c46839afd0a484: Bootstrap starting.
I20260709 14:54:24.152820 15307 tablet_bootstrap.cc:654] T b97c761f72c14075b65e501c4b3ae0fb P 9cb8de0701f2482b99e51d5ac080aa13: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:24.167277 15309 raft_consensus.cc:359] T e43bf64543ef494790c2f7a4a063fdd1 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:24.186764 15309 raft_consensus.cc:385] T e43bf64543ef494790c2f7a4a063fdd1 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:24.187144 15309 raft_consensus.cc:740] T e43bf64543ef494790c2f7a4a063fdd1 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7519e608fbb44d9db8ad30b9f10ae605, State: Initialized, Role: FOLLOWER
I20260709 14:54:24.188015 15309 consensus_queue.cc:260] T e43bf64543ef494790c2f7a4a063fdd1 P 7519e608fbb44d9db8ad30b9f10ae605 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:24.190975 15309 ts_tablet_manager.cc:1434] T e43bf64543ef494790c2f7a4a063fdd1 P 7519e608fbb44d9db8ad30b9f10ae605: Time spent starting tablet: real 0.072s	user 0.008s	sys 0.000s
I20260709 14:54:24.195689 15034 raft_consensus.cc:2468] T 5e8a01e27eab492bb73df3359e500627 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa34beb1b274443b1c46839afd0a484 in term 1.
I20260709 14:54:24.199724 15153 leader_election.cc:304] T 5e8a01e27eab492bb73df3359e500627 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dbc2c92e49e346b5b3bd7705a229afc6, eaa34beb1b274443b1c46839afd0a484; no voters: 7519e608fbb44d9db8ad30b9f10ae605
I20260709 14:54:24.191713 15545 raft_consensus.cc:515] T bdf08eed05854470954a5e9dd17dfb27 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
W20260709 14:54:24.202004 15001 leader_election.cc:343] T 4abdbdda3ce149a9904e919be18e7a3f P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:24.206941 14932 catalog_manager.cc:5697] T d178b88fdab54a29b05fb98e05ffe8c5 P eaa34beb1b274443b1c46839afd0a484 reported cstate change: term changed from 0 to 2, leader changed from <none> to eaa34beb1b274443b1c46839afd0a484 (127.6.101.67). New cstate: current_term: 2 leader_uuid: "eaa34beb1b274443b1c46839afd0a484" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } health_report { overall_health: UNKNOWN } } }
W20260709 14:54:24.211621 15001 leader_election.cc:343] T a9dab1878c4b4550880f5680c6d48c67 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:24.212855 15001 leader_election.cc:304] T a9dab1878c4b4550880f5680c6d48c67 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbc2c92e49e346b5b3bd7705a229afc6; no voters: 7519e608fbb44d9db8ad30b9f10ae605, eaa34beb1b274443b1c46839afd0a484
I20260709 14:54:24.218063 15309 tablet_bootstrap.cc:492] T db39b7ffe995451885f4074ddf16028d P 7519e608fbb44d9db8ad30b9f10ae605: Bootstrap starting.
I20260709 14:54:24.222682 15032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf08eed05854470954a5e9dd17dfb27" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc2c92e49e346b5b3bd7705a229afc6"
I20260709 14:54:24.223409 15032 raft_consensus.cc:3060] T bdf08eed05854470954a5e9dd17dfb27 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:24.209775 15616 raft_consensus.cc:2804] T 5e8a01e27eab492bb73df3359e500627 P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:54:24.231109 15616 raft_consensus.cc:697] T 5e8a01e27eab492bb73df3359e500627 P eaa34beb1b274443b1c46839afd0a484 [term 1 LEADER]: Becoming Leader. State: Replica: eaa34beb1b274443b1c46839afd0a484, State: Running, Role: LEADER
I20260709 14:54:24.234392 15616 consensus_queue.cc:237] T 5e8a01e27eab492bb73df3359e500627 P eaa34beb1b274443b1c46839afd0a484 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:24.232895 15545 leader_election.cc:290] T bdf08eed05854470954a5e9dd17dfb27 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 election: Requested vote from peers dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477), 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177)
I20260709 14:54:24.244331 15105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf08eed05854470954a5e9dd17dfb27" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605"
I20260709 14:54:24.245443 15105 raft_consensus.cc:3060] T bdf08eed05854470954a5e9dd17dfb27 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:24.217990 15695 raft_consensus.cc:2749] T a9dab1878c4b4550880f5680c6d48c67 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:54:24.257153 15311 tablet_bootstrap.cc:654] T a9dab1878c4b4550880f5680c6d48c67 P eaa34beb1b274443b1c46839afd0a484: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:24.309577 15306 tablet_bootstrap.cc:492] T db39b7ffe995451885f4074ddf16028d P dbc2c92e49e346b5b3bd7705a229afc6: No bootstrap required, opened a new log
I20260709 14:54:24.313759 15306 ts_tablet_manager.cc:1403] T db39b7ffe995451885f4074ddf16028d P dbc2c92e49e346b5b3bd7705a229afc6: Time spent bootstrapping tablet: real 0.510s	user 0.019s	sys 0.013s
I20260709 14:54:24.316717 15032 raft_consensus.cc:2468] T bdf08eed05854470954a5e9dd17dfb27 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cb8de0701f2482b99e51d5ac080aa13 in term 1.
I20260709 14:54:24.323019 15306 raft_consensus.cc:359] T db39b7ffe995451885f4074ddf16028d P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:24.328719 14933 catalog_manager.cc:5697] T 4abdbdda3ce149a9904e919be18e7a3f P dbc2c92e49e346b5b3bd7705a229afc6 reported cstate change: term changed from 0 to 1, leader changed from <none> to dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65). New cstate: current_term: 1 leader_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } health_report { overall_health: HEALTHY } } }
I20260709 14:54:24.325960 15306 raft_consensus.cc:385] T db39b7ffe995451885f4074ddf16028d P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:24.314347 15309 tablet_bootstrap.cc:654] T db39b7ffe995451885f4074ddf16028d P 7519e608fbb44d9db8ad30b9f10ae605: Neither blocks nor log segments found. Creating new log.
W20260709 14:54:24.335140 14984 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 14:54:24.339586 14932 catalog_manager.cc:5697] T 5e8a01e27eab492bb73df3359e500627 P eaa34beb1b274443b1c46839afd0a484 reported cstate change: term changed from 0 to 1, leader changed from <none> to eaa34beb1b274443b1c46839afd0a484 (127.6.101.67). New cstate: current_term: 1 leader_uuid: "eaa34beb1b274443b1c46839afd0a484" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } health_report { overall_health: HEALTHY } } }
I20260709 14:54:24.332644 15306 raft_consensus.cc:740] T db39b7ffe995451885f4074ddf16028d P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbc2c92e49e346b5b3bd7705a229afc6, State: Initialized, Role: FOLLOWER
I20260709 14:54:24.345049 15306 consensus_queue.cc:260] T db39b7ffe995451885f4074ddf16028d P dbc2c92e49e346b5b3bd7705a229afc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:24.354380 15227 leader_election.cc:304] T bdf08eed05854470954a5e9dd17dfb27 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cb8de0701f2482b99e51d5ac080aa13, dbc2c92e49e346b5b3bd7705a229afc6; no voters: 
I20260709 14:54:24.372503 15545 raft_consensus.cc:2804] T bdf08eed05854470954a5e9dd17dfb27 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:54:24.373096 15545 raft_consensus.cc:697] T bdf08eed05854470954a5e9dd17dfb27 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 LEADER]: Becoming Leader. State: Replica: 9cb8de0701f2482b99e51d5ac080aa13, State: Running, Role: LEADER
I20260709 14:54:24.373864 15545 consensus_queue.cc:237] T bdf08eed05854470954a5e9dd17dfb27 P 9cb8de0701f2482b99e51d5ac080aa13 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:24.384927 14934 catalog_manager.cc:5697] T e43bf64543ef494790c2f7a4a063fdd1 P 9cb8de0701f2482b99e51d5ac080aa13 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68). New cstate: current_term: 1 leader_uuid: "9cb8de0701f2482b99e51d5ac080aa13" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } health_report { overall_health: HEALTHY } } }
I20260709 14:54:24.386935 15307 tablet_bootstrap.cc:492] T b97c761f72c14075b65e501c4b3ae0fb P 9cb8de0701f2482b99e51d5ac080aa13: No bootstrap required, opened a new log
I20260709 14:54:24.387697 15307 ts_tablet_manager.cc:1403] T b97c761f72c14075b65e501c4b3ae0fb P 9cb8de0701f2482b99e51d5ac080aa13: Time spent bootstrapping tablet: real 0.355s	user 0.022s	sys 0.005s
I20260709 14:54:24.378226 15105 raft_consensus.cc:2468] T bdf08eed05854470954a5e9dd17dfb27 P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cb8de0701f2482b99e51d5ac080aa13 in term 1.
I20260709 14:54:24.425731 15306 ts_tablet_manager.cc:1434] T db39b7ffe995451885f4074ddf16028d P dbc2c92e49e346b5b3bd7705a229afc6: Time spent starting tablet: real 0.112s	user 0.011s	sys 0.005s
I20260709 14:54:24.427794 15307 raft_consensus.cc:359] T b97c761f72c14075b65e501c4b3ae0fb P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:24.434036 15307 raft_consensus.cc:385] T b97c761f72c14075b65e501c4b3ae0fb P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:24.434494 15307 raft_consensus.cc:740] T b97c761f72c14075b65e501c4b3ae0fb P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9cb8de0701f2482b99e51d5ac080aa13, State: Initialized, Role: FOLLOWER
I20260709 14:54:24.434607 15613 raft_consensus.cc:493] T db39b7ffe995451885f4074ddf16028d P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:24.434779 15716 raft_consensus.cc:493] T e43bf64543ef494790c2f7a4a063fdd1 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:24.435401 15613 raft_consensus.cc:515] T db39b7ffe995451885f4074ddf16028d P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:24.435491 15716 raft_consensus.cc:515] T e43bf64543ef494790c2f7a4a063fdd1 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:24.425086 15311 tablet_bootstrap.cc:492] T a9dab1878c4b4550880f5680c6d48c67 P eaa34beb1b274443b1c46839afd0a484: No bootstrap required, opened a new log
I20260709 14:54:24.439999 15311 ts_tablet_manager.cc:1403] T a9dab1878c4b4550880f5680c6d48c67 P eaa34beb1b274443b1c46839afd0a484: Time spent bootstrapping tablet: real 0.258s	user 0.016s	sys 0.018s
I20260709 14:54:24.440217 15613 leader_election.cc:290] T db39b7ffe995451885f4074ddf16028d P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177), eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805)
I20260709 14:54:24.440455 15184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43bf64543ef494790c2f7a4a063fdd1" candidate_uuid: "7519e608fbb44d9db8ad30b9f10ae605" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484" is_pre_election: true
I20260709 14:54:24.435884 15307 consensus_queue.cc:260] T b97c761f72c14075b65e501c4b3ae0fb P 9cb8de0701f2482b99e51d5ac080aa13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:24.434659 15306 tablet_bootstrap.cc:492] T 5b9f8063585c4e5faddebd56fbe1aa01 P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap starting.
I20260709 14:54:24.445711 15183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db39b7ffe995451885f4074ddf16028d" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484" is_pre_election: true
I20260709 14:54:24.453914 15183 raft_consensus.cc:2468] T db39b7ffe995451885f4074ddf16028d P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbc2c92e49e346b5b3bd7705a229afc6 in term 0.
I20260709 14:54:24.456040 15716 leader_election.cc:290] T e43bf64543ef494790c2f7a4a063fdd1 P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805), 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493)
I20260709 14:54:24.457588 15257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43bf64543ef494790c2f7a4a063fdd1" candidate_uuid: "7519e608fbb44d9db8ad30b9f10ae605" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13" is_pre_election: true
I20260709 14:54:24.461419 15259 raft_consensus.cc:1275] T d178b88fdab54a29b05fb98e05ffe8c5 P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 FOLLOWER]: Refusing update from remote peer eaa34beb1b274443b1c46839afd0a484: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 14:54:24.462883 15741 raft_consensus.cc:493] T db39b7ffe995451885f4074ddf16028d P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:24.463712 15741 raft_consensus.cc:515] T db39b7ffe995451885f4074ddf16028d P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:24.465482 15004 leader_election.cc:304] T db39b7ffe995451885f4074ddf16028d P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dbc2c92e49e346b5b3bd7705a229afc6, eaa34beb1b274443b1c46839afd0a484; no voters: 
I20260709 14:54:24.467000 15616 raft_consensus.cc:493] T d2463fd792b240e9911c6b38bcb453b8 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:24.467626 15616 raft_consensus.cc:515] T d2463fd792b240e9911c6b38bcb453b8 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:24.467878 15694 raft_consensus.cc:2804] T db39b7ffe995451885f4074ddf16028d P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:54:24.468518 15694 raft_consensus.cc:493] T db39b7ffe995451885f4074ddf16028d P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:54:24.468883 15694 raft_consensus.cc:3060] T db39b7ffe995451885f4074ddf16028d P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:24.469400 15740 consensus_queue.cc:1048] T d178b88fdab54a29b05fb98e05ffe8c5 P eaa34beb1b274443b1c46839afd0a484 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:54:24.469935 15616 leader_election.cc:290] T d2463fd792b240e9911c6b38bcb453b8 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493), dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477)
I20260709 14:54:24.454861 15184 raft_consensus.cc:2393] T e43bf64543ef494790c2f7a4a063fdd1 P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7519e608fbb44d9db8ad30b9f10ae605 in current term 1: Already voted for candidate 9cb8de0701f2482b99e51d5ac080aa13 in this term.
I20260709 14:54:24.473031 15032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db39b7ffe995451885f4074ddf16028d" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" is_pre_election: true
I20260709 14:54:24.472587 15109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db39b7ffe995451885f4074ddf16028d" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605" is_pre_election: true
I20260709 14:54:24.491660 15259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2463fd792b240e9911c6b38bcb453b8" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13" is_pre_election: true
I20260709 14:54:24.503280 15311 raft_consensus.cc:359] T a9dab1878c4b4550880f5680c6d48c67 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:24.504084 15311 raft_consensus.cc:385] T a9dab1878c4b4550880f5680c6d48c67 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:24.504952 15311 raft_consensus.cc:740] T a9dab1878c4b4550880f5680c6d48c67 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eaa34beb1b274443b1c46839afd0a484, State: Initialized, Role: FOLLOWER
I20260709 14:54:24.505833 15311 consensus_queue.cc:260] T a9dab1878c4b4550880f5680c6d48c67 P eaa34beb1b274443b1c46839afd0a484 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
W20260709 14:54:24.507157 15001 leader_election.cc:343] T db39b7ffe995451885f4074ddf16028d P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:24.503017 15108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db39b7ffe995451885f4074ddf16028d" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605" is_pre_election: true
I20260709 14:54:24.498464 15741 leader_election.cc:290] T db39b7ffe995451885f4074ddf16028d P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477), 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177)
I20260709 14:54:24.494410 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2463fd792b240e9911c6b38bcb453b8" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" is_pre_election: true
I20260709 14:54:24.520133 15311 ts_tablet_manager.cc:1434] T a9dab1878c4b4550880f5680c6d48c67 P eaa34beb1b274443b1c46839afd0a484: Time spent starting tablet: real 0.080s	user 0.008s	sys 0.000s
W20260709 14:54:24.522074 15150 leader_election.cc:343] T d2463fd792b240e9911c6b38bcb453b8 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493): Illegal state: must be running to vote when last-logged opid is not known
W20260709 14:54:24.522780 15150 leader_election.cc:343] T db39b7ffe995451885f4074ddf16028d P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177): Illegal state: must be running to vote when last-logged opid is not known
W20260709 14:54:24.522876 15153 leader_election.cc:343] T d2463fd792b240e9911c6b38bcb453b8 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:24.524507 15153 leader_election.cc:304] T d2463fd792b240e9911c6b38bcb453b8 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa34beb1b274443b1c46839afd0a484; no voters: 9cb8de0701f2482b99e51d5ac080aa13, dbc2c92e49e346b5b3bd7705a229afc6
I20260709 14:54:24.525952 15306 tablet_bootstrap.cc:654] T 5b9f8063585c4e5faddebd56fbe1aa01 P dbc2c92e49e346b5b3bd7705a229afc6: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:24.526533 15740 raft_consensus.cc:2749] T d2463fd792b240e9911c6b38bcb453b8 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:54:24.531654 15079 leader_election.cc:304] T e43bf64543ef494790c2f7a4a063fdd1 P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7519e608fbb44d9db8ad30b9f10ae605; no voters: 9cb8de0701f2482b99e51d5ac080aa13, eaa34beb1b274443b1c46839afd0a484
I20260709 14:54:24.532893 15432 raft_consensus.cc:3060] T e43bf64543ef494790c2f7a4a063fdd1 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:24.536195 15694 raft_consensus.cc:515] T db39b7ffe995451885f4074ddf16028d P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:24.537818 15032 raft_consensus.cc:2393] T db39b7ffe995451885f4074ddf16028d P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eaa34beb1b274443b1c46839afd0a484 in current term 1: Already voted for candidate dbc2c92e49e346b5b3bd7705a229afc6 in this term.
I20260709 14:54:24.539012 15694 leader_election.cc:290] T db39b7ffe995451885f4074ddf16028d P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 election: Requested vote from peers 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177), eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805)
I20260709 14:54:24.549612 15307 ts_tablet_manager.cc:1434] T b97c761f72c14075b65e501c4b3ae0fb P 9cb8de0701f2482b99e51d5ac080aa13: Time spent starting tablet: real 0.162s	user 0.014s	sys 0.000s
I20260709 14:54:24.553721 15184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db39b7ffe995451885f4074ddf16028d" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484"
I20260709 14:54:24.562659 15153 leader_election.cc:304] T db39b7ffe995451885f4074ddf16028d P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa34beb1b274443b1c46839afd0a484; no voters: 7519e608fbb44d9db8ad30b9f10ae605, dbc2c92e49e346b5b3bd7705a229afc6
I20260709 14:54:24.580693 15309 tablet_bootstrap.cc:492] T db39b7ffe995451885f4074ddf16028d P 7519e608fbb44d9db8ad30b9f10ae605: No bootstrap required, opened a new log
I20260709 14:54:24.582665 15723 consensus_queue.cc:1048] T 4abdbdda3ce149a9904e919be18e7a3f P dbc2c92e49e346b5b3bd7705a229afc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:54:24.570621 15184 raft_consensus.cc:3060] T db39b7ffe995451885f4074ddf16028d P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:24.598176 15105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db39b7ffe995451885f4074ddf16028d" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605"
W20260709 14:54:24.600915 15001 leader_election.cc:343] T db39b7ffe995451885f4074ddf16028d P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:24.609314 15309 ts_tablet_manager.cc:1403] T db39b7ffe995451885f4074ddf16028d P 7519e608fbb44d9db8ad30b9f10ae605: Time spent bootstrapping tablet: real 0.395s	user 0.021s	sys 0.012s
W20260709 14:54:24.610539 15079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:33805, user_credentials={real_user=slave}} blocked reactor thread for 67308.7us
I20260709 14:54:24.619004 15311 tablet_bootstrap.cc:492] T 46a35b81512c4e8c8ec6b83d4c768e1f P eaa34beb1b274443b1c46839afd0a484: Bootstrap starting.
I20260709 14:54:24.620904 14934 catalog_manager.cc:5697] T bdf08eed05854470954a5e9dd17dfb27 P 9cb8de0701f2482b99e51d5ac080aa13 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68). New cstate: current_term: 1 leader_uuid: "9cb8de0701f2482b99e51d5ac080aa13" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } health_report { overall_health: UNKNOWN } } }
I20260709 14:54:24.631409 15307 tablet_bootstrap.cc:492] T ff73c3d51e5e480c920d1aca00b9b40d P 9cb8de0701f2482b99e51d5ac080aa13: Bootstrap starting.
I20260709 14:54:24.645210 15034 raft_consensus.cc:1275] T d178b88fdab54a29b05fb98e05ffe8c5 P dbc2c92e49e346b5b3bd7705a229afc6 [term 2 FOLLOWER]: Refusing update from remote peer eaa34beb1b274443b1c46839afd0a484: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 14:54:24.662623 15754 consensus_queue.cc:1048] T e43bf64543ef494790c2f7a4a063fdd1 P 9cb8de0701f2482b99e51d5ac080aa13 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:54:24.686674 15309 raft_consensus.cc:359] T db39b7ffe995451885f4074ddf16028d P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:24.687569 15309 raft_consensus.cc:385] T db39b7ffe995451885f4074ddf16028d P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:24.687876 15309 raft_consensus.cc:740] T db39b7ffe995451885f4074ddf16028d P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7519e608fbb44d9db8ad30b9f10ae605, State: Initialized, Role: FOLLOWER
I20260709 14:54:24.688689 15309 consensus_queue.cc:260] T db39b7ffe995451885f4074ddf16028d P 7519e608fbb44d9db8ad30b9f10ae605 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:24.691483 15311 tablet_bootstrap.cc:654] T 46a35b81512c4e8c8ec6b83d4c768e1f P eaa34beb1b274443b1c46839afd0a484: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:24.702706 15306 tablet_bootstrap.cc:492] T 5b9f8063585c4e5faddebd56fbe1aa01 P dbc2c92e49e346b5b3bd7705a229afc6: No bootstrap required, opened a new log
I20260709 14:54:24.703348 15306 ts_tablet_manager.cc:1403] T 5b9f8063585c4e5faddebd56fbe1aa01 P dbc2c92e49e346b5b3bd7705a229afc6: Time spent bootstrapping tablet: real 0.270s	user 0.024s	sys 0.020s
I20260709 14:54:24.714103 15307 tablet_bootstrap.cc:654] T ff73c3d51e5e480c920d1aca00b9b40d P 9cb8de0701f2482b99e51d5ac080aa13: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:24.708894 15616 consensus_queue.cc:1048] T d178b88fdab54a29b05fb98e05ffe8c5 P eaa34beb1b274443b1c46839afd0a484 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
W20260709 14:54:24.729835 15150 consensus_peers.cc:597] T 5e8a01e27eab492bb73df3359e500627 P eaa34beb1b274443b1c46839afd0a484 -> Peer 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177): Couldn't send request to peer 7519e608fbb44d9db8ad30b9f10ae605. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 14:54:24.750590 15001 consensus_peers.cc:597] T 4abdbdda3ce149a9904e919be18e7a3f P dbc2c92e49e346b5b3bd7705a229afc6 -> Peer 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493): Couldn't send request to peer 9cb8de0701f2482b99e51d5ac080aa13. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:54:24.760787 15432 raft_consensus.cc:2749] T e43bf64543ef494790c2f7a4a063fdd1 P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:54:24.767692 15309 ts_tablet_manager.cc:1434] T db39b7ffe995451885f4074ddf16028d P 7519e608fbb44d9db8ad30b9f10ae605: Time spent starting tablet: real 0.157s	user 0.009s	sys 0.001s
I20260709 14:54:24.791555 15311 tablet_bootstrap.cc:492] T 46a35b81512c4e8c8ec6b83d4c768e1f P eaa34beb1b274443b1c46839afd0a484: No bootstrap required, opened a new log
I20260709 14:54:24.792239 15311 ts_tablet_manager.cc:1403] T 46a35b81512c4e8c8ec6b83d4c768e1f P eaa34beb1b274443b1c46839afd0a484: Time spent bootstrapping tablet: real 0.185s	user 0.024s	sys 0.035s
I20260709 14:54:24.793533 15309 tablet_bootstrap.cc:492] T b97c761f72c14075b65e501c4b3ae0fb P 7519e608fbb44d9db8ad30b9f10ae605: Bootstrap starting.
W20260709 14:54:24.792907 15153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:45477, user_credentials={real_user=slave}} blocked reactor thread for 87843.8us
I20260709 14:54:24.797709 15184 raft_consensus.cc:2468] T db39b7ffe995451885f4074ddf16028d P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbc2c92e49e346b5b3bd7705a229afc6 in term 1.
I20260709 14:54:24.802284 15311 raft_consensus.cc:359] T 46a35b81512c4e8c8ec6b83d4c768e1f P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:24.808511 15311 raft_consensus.cc:385] T 46a35b81512c4e8c8ec6b83d4c768e1f P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:24.808918 15311 raft_consensus.cc:740] T 46a35b81512c4e8c8ec6b83d4c768e1f P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eaa34beb1b274443b1c46839afd0a484, State: Initialized, Role: FOLLOWER
I20260709 14:54:24.794394 15306 raft_consensus.cc:359] T 5b9f8063585c4e5faddebd56fbe1aa01 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:24.809641 15306 raft_consensus.cc:385] T 5b9f8063585c4e5faddebd56fbe1aa01 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:24.810045 15306 raft_consensus.cc:740] T 5b9f8063585c4e5faddebd56fbe1aa01 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbc2c92e49e346b5b3bd7705a229afc6, State: Initialized, Role: FOLLOWER
I20260709 14:54:24.812886 15311 consensus_queue.cc:260] T 46a35b81512c4e8c8ec6b83d4c768e1f P eaa34beb1b274443b1c46839afd0a484 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:24.815160 15754 consensus_queue.cc:1048] T e43bf64543ef494790c2f7a4a063fdd1 P 9cb8de0701f2482b99e51d5ac080aa13 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:54:24.816009 15311 ts_tablet_manager.cc:1434] T 46a35b81512c4e8c8ec6b83d4c768e1f P eaa34beb1b274443b1c46839afd0a484: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.001s
I20260709 14:54:24.821017 15306 consensus_queue.cc:260] T 5b9f8063585c4e5faddebd56fbe1aa01 P dbc2c92e49e346b5b3bd7705a229afc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:24.809373 15741 raft_consensus.cc:2749] T db39b7ffe995451885f4074ddf16028d P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:54:24.823814 15004 leader_election.cc:304] T db39b7ffe995451885f4074ddf16028d P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dbc2c92e49e346b5b3bd7705a229afc6, eaa34beb1b274443b1c46839afd0a484; no voters: 7519e608fbb44d9db8ad30b9f10ae605
I20260709 14:54:24.824182 15306 ts_tablet_manager.cc:1434] T 5b9f8063585c4e5faddebd56fbe1aa01 P dbc2c92e49e346b5b3bd7705a229afc6: Time spent starting tablet: real 0.121s	user 0.008s	sys 0.002s
I20260709 14:54:24.825799 15306 tablet_bootstrap.cc:492] T 4f709a060be148029cf72f1af6f79714 P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap starting.
I20260709 14:54:24.826699 15723 raft_consensus.cc:2804] T db39b7ffe995451885f4074ddf16028d P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:54:24.827383 15723 raft_consensus.cc:697] T db39b7ffe995451885f4074ddf16028d P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 LEADER]: Becoming Leader. State: Replica: dbc2c92e49e346b5b3bd7705a229afc6, State: Running, Role: LEADER
I20260709 14:54:24.828365 15723 consensus_queue.cc:237] T db39b7ffe995451885f4074ddf16028d P dbc2c92e49e346b5b3bd7705a229afc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:24.829357 15311 tablet_bootstrap.cc:492] T ff73c3d51e5e480c920d1aca00b9b40d P eaa34beb1b274443b1c46839afd0a484: Bootstrap starting.
I20260709 14:54:24.841295 15311 tablet_bootstrap.cc:654] T ff73c3d51e5e480c920d1aca00b9b40d P eaa34beb1b274443b1c46839afd0a484: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:24.843428 15309 tablet_bootstrap.cc:654] T b97c761f72c14075b65e501c4b3ae0fb P 7519e608fbb44d9db8ad30b9f10ae605: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:24.857228 15545 raft_consensus.cc:493] T b97c761f72c14075b65e501c4b3ae0fb P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:24.859134 15545 raft_consensus.cc:515] T b97c761f72c14075b65e501c4b3ae0fb P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:24.890913 15545 leader_election.cc:290] T b97c761f72c14075b65e501c4b3ae0fb P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177), eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805)
I20260709 14:54:24.918962 15181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97c761f72c14075b65e501c4b3ae0fb" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484" is_pre_election: true
I20260709 14:54:24.920188 15181 raft_consensus.cc:2468] T b97c761f72c14075b65e501c4b3ae0fb P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cb8de0701f2482b99e51d5ac080aa13 in term 0.
I20260709 14:54:24.895370 15105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97c761f72c14075b65e501c4b3ae0fb" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605" is_pre_election: true
I20260709 14:54:24.895925 15776 consensus_queue.cc:1048] T 5e8a01e27eab492bb73df3359e500627 P eaa34beb1b274443b1c46839afd0a484 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.055s
I20260709 14:54:24.952883 15740 raft_consensus.cc:493] T a9dab1878c4b4550880f5680c6d48c67 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:24.953500 15740 raft_consensus.cc:515] T a9dab1878c4b4550880f5680c6d48c67 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:24.955109 15661 raft_consensus.cc:493] T 46a35b81512c4e8c8ec6b83d4c768e1f P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:24.955816 15661 raft_consensus.cc:515] T 46a35b81512c4e8c8ec6b83d4c768e1f P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:24.958921 15307 tablet_bootstrap.cc:492] T ff73c3d51e5e480c920d1aca00b9b40d P 9cb8de0701f2482b99e51d5ac080aa13: No bootstrap required, opened a new log
I20260709 14:54:24.961295 15307 ts_tablet_manager.cc:1403] T ff73c3d51e5e480c920d1aca00b9b40d P 9cb8de0701f2482b99e51d5ac080aa13: Time spent bootstrapping tablet: real 0.351s	user 0.011s	sys 0.012s
I20260709 14:54:24.964021 15661 leader_election.cc:290] T 46a35b81512c4e8c8ec6b83d4c768e1f P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493), dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477)
I20260709 14:54:24.965673 15740 leader_election.cc:290] T a9dab1878c4b4550880f5680c6d48c67 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477), 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177)
I20260709 14:54:24.961079 15306 tablet_bootstrap.cc:654] T 4f709a060be148029cf72f1af6f79714 P dbc2c92e49e346b5b3bd7705a229afc6: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:24.989056 15307 raft_consensus.cc:359] T ff73c3d51e5e480c920d1aca00b9b40d P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:24.990006 15307 raft_consensus.cc:385] T ff73c3d51e5e480c920d1aca00b9b40d P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:24.990048 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a35b81512c4e8c8ec6b83d4c768e1f" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" is_pre_election: true
I20260709 14:54:24.990891 15307 raft_consensus.cc:740] T ff73c3d51e5e480c920d1aca00b9b40d P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9cb8de0701f2482b99e51d5ac080aa13, State: Initialized, Role: FOLLOWER
W20260709 14:54:24.992422 15153 leader_election.cc:343] T 46a35b81512c4e8c8ec6b83d4c768e1f P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:24.996470 15032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dab1878c4b4550880f5680c6d48c67" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" is_pre_election: true
I20260709 14:54:24.997308 15032 raft_consensus.cc:2468] T a9dab1878c4b4550880f5680c6d48c67 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa34beb1b274443b1c46839afd0a484 in term 0.
I20260709 14:54:25.017017 15432 raft_consensus.cc:493] T db39b7ffe995451885f4074ddf16028d P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:54:25.017771 15150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.68:45493, user_credentials={real_user=slave}} blocked reactor thread for 87699us
I20260709 14:54:25.018268 15432 raft_consensus.cc:515] T db39b7ffe995451885f4074ddf16028d P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:25.022122 15227 leader_election.cc:304] T b97c761f72c14075b65e501c4b3ae0fb P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cb8de0701f2482b99e51d5ac080aa13, eaa34beb1b274443b1c46839afd0a484; no voters: 
I20260709 14:54:25.023965 15647 raft_consensus.cc:2804] T b97c761f72c14075b65e501c4b3ae0fb P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:54:25.024518 15647 raft_consensus.cc:493] T b97c761f72c14075b65e501c4b3ae0fb P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:54:25.024878 15647 raft_consensus.cc:3060] T b97c761f72c14075b65e501c4b3ae0fb P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:25.025936 15153 leader_election.cc:304] T a9dab1878c4b4550880f5680c6d48c67 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dbc2c92e49e346b5b3bd7705a229afc6, eaa34beb1b274443b1c46839afd0a484; no voters: 
I20260709 14:54:25.027896 15104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dab1878c4b4550880f5680c6d48c67" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605" is_pre_election: true
I20260709 14:54:24.992501 15307 consensus_queue.cc:260] T ff73c3d51e5e480c920d1aca00b9b40d P 9cb8de0701f2482b99e51d5ac080aa13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:25.052119 15432 leader_election.cc:290] T db39b7ffe995451885f4074ddf16028d P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477), eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805)
I20260709 14:54:25.057061 15032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db39b7ffe995451885f4074ddf16028d" candidate_uuid: "7519e608fbb44d9db8ad30b9f10ae605" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" is_pre_election: true
I20260709 14:54:25.057548 15740 raft_consensus.cc:2804] T a9dab1878c4b4550880f5680c6d48c67 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:54:25.058727 15740 raft_consensus.cc:493] T a9dab1878c4b4550880f5680c6d48c67 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:54:25.059466 15740 raft_consensus.cc:3060] T a9dab1878c4b4550880f5680c6d48c67 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Advancing to term 1
W20260709 14:54:25.091642 15150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.68:45493, user_credentials={real_user=slave}} blocked reactor thread for 61107.5us
W20260709 14:54:25.100925 15224 leader_election.cc:343] T b97c761f72c14075b65e501c4b3ae0fb P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:25.176648 15307 ts_tablet_manager.cc:1434] T ff73c3d51e5e480c920d1aca00b9b40d P 9cb8de0701f2482b99e51d5ac080aa13: Time spent starting tablet: real 0.215s	user 0.011s	sys 0.000s
W20260709 14:54:25.177533 15001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.68:45493, user_credentials={real_user=slave}} blocked reactor thread for 63921.1us
I20260709 14:54:25.103227 15259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a35b81512c4e8c8ec6b83d4c768e1f" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13" is_pre_election: true
I20260709 14:54:25.203517 15307 tablet_bootstrap.cc:492] T 4abdbdda3ce149a9904e919be18e7a3f P 9cb8de0701f2482b99e51d5ac080aa13: Bootstrap starting.
I20260709 14:54:25.204000 15755 consensus_queue.cc:1048] T bdf08eed05854470954a5e9dd17dfb27 P 9cb8de0701f2482b99e51d5ac080aa13 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.115s
I20260709 14:54:25.212836 15306 tablet_bootstrap.cc:492] T 4f709a060be148029cf72f1af6f79714 P dbc2c92e49e346b5b3bd7705a229afc6: No bootstrap required, opened a new log
I20260709 14:54:25.238613 15306 ts_tablet_manager.cc:1403] T 4f709a060be148029cf72f1af6f79714 P dbc2c92e49e346b5b3bd7705a229afc6: Time spent bootstrapping tablet: real 0.413s	user 0.011s	sys 0.017s
I20260709 14:54:25.215039 15311 tablet_bootstrap.cc:492] T ff73c3d51e5e480c920d1aca00b9b40d P eaa34beb1b274443b1c46839afd0a484: No bootstrap required, opened a new log
I20260709 14:54:25.221146 15185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db39b7ffe995451885f4074ddf16028d" candidate_uuid: "7519e608fbb44d9db8ad30b9f10ae605" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484" is_pre_election: true
I20260709 14:54:25.239903 15311 ts_tablet_manager.cc:1403] T ff73c3d51e5e480c920d1aca00b9b40d P eaa34beb1b274443b1c46839afd0a484: Time spent bootstrapping tablet: real 0.423s	user 0.019s	sys 0.006s
I20260709 14:54:25.240079 15185 raft_consensus.cc:2393] T db39b7ffe995451885f4074ddf16028d P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7519e608fbb44d9db8ad30b9f10ae605 in current term 1: Already voted for candidate dbc2c92e49e346b5b3bd7705a229afc6 in this term.
I20260709 14:54:25.249022 15309 tablet_bootstrap.cc:492] T b97c761f72c14075b65e501c4b3ae0fb P 7519e608fbb44d9db8ad30b9f10ae605: No bootstrap required, opened a new log
I20260709 14:54:25.249827 15309 ts_tablet_manager.cc:1403] T b97c761f72c14075b65e501c4b3ae0fb P 7519e608fbb44d9db8ad30b9f10ae605: Time spent bootstrapping tablet: real 0.463s	user 0.014s	sys 0.014s
I20260709 14:54:25.254405 15647 raft_consensus.cc:515] T b97c761f72c14075b65e501c4b3ae0fb P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:25.263056 14932 catalog_manager.cc:5697] T db39b7ffe995451885f4074ddf16028d P dbc2c92e49e346b5b3bd7705a229afc6 reported cstate change: term changed from 0 to 1, leader changed from <none> to dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65). New cstate: current_term: 1 leader_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } health_report { overall_health: UNKNOWN } } }
W20260709 14:54:25.290153 15789 log.cc:927] Time spent T 5e8a01e27eab492bb73df3359e500627 P dbc2c92e49e346b5b3bd7705a229afc6: Append to log took a long time: real 0.194s	user 0.003s	sys 0.002s
W20260709 14:54:25.309484 15150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:43177, user_credentials={real_user=slave}} blocked reactor thread for 199237us
W20260709 14:54:25.310560 15150 leader_election.cc:343] T a9dab1878c4b4550880f5680c6d48c67 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:25.315634 15311 raft_consensus.cc:359] T ff73c3d51e5e480c920d1aca00b9b40d P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:25.316849 15311 raft_consensus.cc:385] T ff73c3d51e5e480c920d1aca00b9b40d P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:25.317425 15311 raft_consensus.cc:740] T ff73c3d51e5e480c920d1aca00b9b40d P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eaa34beb1b274443b1c46839afd0a484, State: Initialized, Role: FOLLOWER
I20260709 14:54:25.326123 15311 consensus_queue.cc:260] T ff73c3d51e5e480c920d1aca00b9b40d P eaa34beb1b274443b1c46839afd0a484 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
W20260709 14:54:25.333559 15150 leader_election.cc:343] T 46a35b81512c4e8c8ec6b83d4c768e1f P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:25.334254 15150 leader_election.cc:304] T 46a35b81512c4e8c8ec6b83d4c768e1f P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa34beb1b274443b1c46839afd0a484; no voters: 9cb8de0701f2482b99e51d5ac080aa13, dbc2c92e49e346b5b3bd7705a229afc6
W20260709 14:54:25.343356 15001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:43177, user_credentials={real_user=slave}} blocked reactor thread for 134657us
I20260709 14:54:25.294970 15754 consensus_queue.cc:1048] T bdf08eed05854470954a5e9dd17dfb27 P 9cb8de0701f2482b99e51d5ac080aa13 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.025s
W20260709 14:54:25.403327 15224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:43177, user_credentials={real_user=slave}} blocked reactor thread for 68836.9us
W20260709 14:54:25.402761 15150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.68:45493, user_credentials={real_user=slave}} blocked reactor thread for 69251.3us
W20260709 14:54:25.433329 15153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:45477, user_credentials={real_user=slave}} blocked reactor thread for 114081us
I20260709 14:54:25.434283 15795 raft_consensus.cc:493] T 5b9f8063585c4e5faddebd56fbe1aa01 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:25.462333 15647 leader_election.cc:290] T b97c761f72c14075b65e501c4b3ae0fb P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 election: Requested vote from peers 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177), eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805)
W20260709 14:54:25.491869 14984 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 14:54:25.492654 15803 raft_consensus.cc:2749] T 46a35b81512c4e8c8ec6b83d4c768e1f P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:54:25.493974 15306 raft_consensus.cc:359] T 4f709a060be148029cf72f1af6f79714 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:25.495103 15306 raft_consensus.cc:385] T 4f709a060be148029cf72f1af6f79714 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:25.495602 15306 raft_consensus.cc:740] T 4f709a060be148029cf72f1af6f79714 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbc2c92e49e346b5b3bd7705a229afc6, State: Initialized, Role: FOLLOWER
I20260709 14:54:25.494903 15309 raft_consensus.cc:359] T b97c761f72c14075b65e501c4b3ae0fb P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:25.497605 15309 raft_consensus.cc:385] T b97c761f72c14075b65e501c4b3ae0fb P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:25.497916 15309 raft_consensus.cc:740] T b97c761f72c14075b65e501c4b3ae0fb P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7519e608fbb44d9db8ad30b9f10ae605, State: Initialized, Role: FOLLOWER
I20260709 14:54:25.494257 15079 leader_election.cc:304] T db39b7ffe995451885f4074ddf16028d P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7519e608fbb44d9db8ad30b9f10ae605; no voters: dbc2c92e49e346b5b3bd7705a229afc6, eaa34beb1b274443b1c46839afd0a484
I20260709 14:54:25.511369 15306 consensus_queue.cc:260] T 4f709a060be148029cf72f1af6f79714 P dbc2c92e49e346b5b3bd7705a229afc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
W20260709 14:54:25.513088 15001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.68:45493, user_credentials={real_user=slave}} blocked reactor thread for 149478us
I20260709 14:54:25.522085 15309 consensus_queue.cc:260] T b97c761f72c14075b65e501c4b3ae0fb P 7519e608fbb44d9db8ad30b9f10ae605 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:25.524463 15309 ts_tablet_manager.cc:1434] T b97c761f72c14075b65e501c4b3ae0fb P 7519e608fbb44d9db8ad30b9f10ae605: Time spent starting tablet: real 0.274s	user 0.009s	sys 0.000s
I20260709 14:54:25.527073 15307 tablet_bootstrap.cc:654] T 4abdbdda3ce149a9904e919be18e7a3f P 9cb8de0701f2482b99e51d5ac080aa13: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:25.531450 15306 ts_tablet_manager.cc:1434] T 4f709a060be148029cf72f1af6f79714 P dbc2c92e49e346b5b3bd7705a229afc6: Time spent starting tablet: real 0.292s	user 0.006s	sys 0.014s
I20260709 14:54:25.538160 15769 raft_consensus.cc:3060] T db39b7ffe995451885f4074ddf16028d P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:25.540491 15306 tablet_bootstrap.cc:492] T 8974e5ab032b4fba92bfc577280778bf P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap starting.
I20260709 14:54:25.467382 15795 raft_consensus.cc:515] T 5b9f8063585c4e5faddebd56fbe1aa01 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
W20260709 14:54:25.543825 15079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:33805, user_credentials={real_user=slave}} blocked reactor thread for 49686.9us
I20260709 14:54:25.558521 15311 ts_tablet_manager.cc:1434] T ff73c3d51e5e480c920d1aca00b9b40d P eaa34beb1b274443b1c46839afd0a484: Time spent starting tablet: real 0.318s	user 0.009s	sys 0.008s
W20260709 14:54:25.558588 15004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:33805, user_credentials={real_user=slave}} blocked reactor thread for 195112us
I20260709 14:54:25.571125 15795 leader_election.cc:290] T 5b9f8063585c4e5faddebd56fbe1aa01 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805), 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493)
I20260709 14:54:25.613088 15311 tablet_bootstrap.cc:492] T d326f264e68d41d69b5007023083ed9e P eaa34beb1b274443b1c46839afd0a484: Bootstrap starting.
W20260709 14:54:25.615420 15227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:45477, user_credentials={real_user=slave}} blocked reactor thread for 57916.3us
I20260709 14:54:25.606429 15254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b9f8063585c4e5faddebd56fbe1aa01" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13" is_pre_election: true
I20260709 14:54:25.633283 15788 raft_consensus.cc:493] T ff73c3d51e5e480c920d1aca00b9b40d P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:25.634053 15788 raft_consensus.cc:515] T ff73c3d51e5e480c920d1aca00b9b40d P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:25.636634 15788 leader_election.cc:290] T ff73c3d51e5e480c920d1aca00b9b40d P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177), eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805)
I20260709 14:54:25.641536 15812 raft_consensus.cc:493] T ff73c3d51e5e480c920d1aca00b9b40d P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:25.642277 15812 raft_consensus.cc:515] T ff73c3d51e5e480c920d1aca00b9b40d P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:25.666666 15181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97c761f72c14075b65e501c4b3ae0fb" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484"
I20260709 14:54:25.667582 15181 raft_consensus.cc:3060] T b97c761f72c14075b65e501c4b3ae0fb P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:25.676997 15180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b9f8063585c4e5faddebd56fbe1aa01" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484" is_pre_election: true
I20260709 14:54:25.678038 15180 raft_consensus.cc:2468] T 5b9f8063585c4e5faddebd56fbe1aa01 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbc2c92e49e346b5b3bd7705a229afc6 in term 0.
I20260709 14:54:25.645080 15812 leader_election.cc:290] T ff73c3d51e5e480c920d1aca00b9b40d P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177), 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493)
I20260709 14:54:25.683933 15311 tablet_bootstrap.cc:654] T d326f264e68d41d69b5007023083ed9e P eaa34beb1b274443b1c46839afd0a484: Neither blocks nor log segments found. Creating new log.
W20260709 14:54:25.697680 15227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:45477, user_credentials={real_user=slave}} blocked reactor thread for 76703.4us
W20260709 14:54:25.701893 15079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:45477, user_credentials={real_user=slave}} blocked reactor thread for 108064us
I20260709 14:54:25.710906 15769 raft_consensus.cc:2749] T db39b7ffe995451885f4074ddf16028d P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:54:25.716468 15004 leader_election.cc:304] T 5b9f8063585c4e5faddebd56fbe1aa01 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dbc2c92e49e346b5b3bd7705a229afc6, eaa34beb1b274443b1c46839afd0a484; no voters: 
I20260709 14:54:25.720872 15726 raft_consensus.cc:2804] T 5b9f8063585c4e5faddebd56fbe1aa01 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:54:25.721891 15726 raft_consensus.cc:493] T 5b9f8063585c4e5faddebd56fbe1aa01 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:54:25.722314 15726 raft_consensus.cc:3060] T 5b9f8063585c4e5faddebd56fbe1aa01 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:25.726002 15306 tablet_bootstrap.cc:654] T 8974e5ab032b4fba92bfc577280778bf P dbc2c92e49e346b5b3bd7705a229afc6: Neither blocks nor log segments found. Creating new log.
W20260709 14:54:25.729686 15740 consensus_meta.cc:287] T a9dab1878c4b4550880f5680c6d48c67 P eaa34beb1b274443b1c46839afd0a484: Time spent flushing consensus metadata: real 0.670s	user 0.018s	sys 0.000s
I20260709 14:54:25.730232 15740 raft_consensus.cc:515] T a9dab1878c4b4550880f5680c6d48c67 P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:25.736670 15307 tablet_bootstrap.cc:492] T 4abdbdda3ce149a9904e919be18e7a3f P 9cb8de0701f2482b99e51d5ac080aa13: No bootstrap required, opened a new log
I20260709 14:54:25.739056 15033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dab1878c4b4550880f5680c6d48c67" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc2c92e49e346b5b3bd7705a229afc6"
I20260709 14:54:25.740047 15309 tablet_bootstrap.cc:492] T 5e8a01e27eab492bb73df3359e500627 P 7519e608fbb44d9db8ad30b9f10ae605: Bootstrap starting.
I20260709 14:54:25.745651 15307 ts_tablet_manager.cc:1403] T 4abdbdda3ce149a9904e919be18e7a3f P 9cb8de0701f2482b99e51d5ac080aa13: Time spent bootstrapping tablet: real 0.546s	user 0.015s	sys 0.008s
I20260709 14:54:25.769090 15311 tablet_bootstrap.cc:492] T d326f264e68d41d69b5007023083ed9e P eaa34beb1b274443b1c46839afd0a484: No bootstrap required, opened a new log
I20260709 14:54:25.770036 15311 ts_tablet_manager.cc:1403] T d326f264e68d41d69b5007023083ed9e P eaa34beb1b274443b1c46839afd0a484: Time spent bootstrapping tablet: real 0.166s	user 0.015s	sys 0.004s
I20260709 14:54:25.732847 15740 leader_election.cc:290] T a9dab1878c4b4550880f5680c6d48c67 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 election: Requested vote from peers dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477), 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177)
I20260709 14:54:25.815547 15186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff73c3d51e5e480c920d1aca00b9b40d" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484" is_pre_election: true
I20260709 14:54:25.815761 15307 raft_consensus.cc:359] T 4abdbdda3ce149a9904e919be18e7a3f P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:25.816632 15186 raft_consensus.cc:2468] T ff73c3d51e5e480c920d1aca00b9b40d P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cb8de0701f2482b99e51d5ac080aa13 in term 0.
I20260709 14:54:25.817349 15254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff73c3d51e5e480c920d1aca00b9b40d" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13" is_pre_election: true
I20260709 14:54:25.741719 15108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff73c3d51e5e480c920d1aca00b9b40d" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605" is_pre_election: true
I20260709 14:54:25.740149 15033 raft_consensus.cc:3060] T a9dab1878c4b4550880f5680c6d48c67 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:25.816736 15307 raft_consensus.cc:385] T 4abdbdda3ce149a9904e919be18e7a3f P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:25.818113 15254 raft_consensus.cc:2468] T ff73c3d51e5e480c920d1aca00b9b40d P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa34beb1b274443b1c46839afd0a484 in term 0.
I20260709 14:54:25.823908 15307 raft_consensus.cc:740] T 4abdbdda3ce149a9904e919be18e7a3f P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9cb8de0701f2482b99e51d5ac080aa13, State: Initialized, Role: FOLLOWER
W20260709 14:54:25.825856 15001 leader_election.cc:343] T 5b9f8063585c4e5faddebd56fbe1aa01 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:25.834232 15799 consensus_queue.cc:1048] T db39b7ffe995451885f4074ddf16028d P dbc2c92e49e346b5b3bd7705a229afc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 14:54:25.847007 15311 raft_consensus.cc:359] T d326f264e68d41d69b5007023083ed9e P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:25.848145 15311 raft_consensus.cc:385] T d326f264e68d41d69b5007023083ed9e P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:25.840523 15181 raft_consensus.cc:2468] T b97c761f72c14075b65e501c4b3ae0fb P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cb8de0701f2482b99e51d5ac080aa13 in term 1.
W20260709 14:54:25.854332 15150 leader_election.cc:343] T ff73c3d51e5e480c920d1aca00b9b40d P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:25.856140 15311 raft_consensus.cc:740] T d326f264e68d41d69b5007023083ed9e P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eaa34beb1b274443b1c46839afd0a484, State: Initialized, Role: FOLLOWER
I20260709 14:54:25.862968 15311 consensus_queue.cc:260] T d326f264e68d41d69b5007023083ed9e P eaa34beb1b274443b1c46839afd0a484 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:25.870847 15307 consensus_queue.cc:260] T 4abdbdda3ce149a9904e919be18e7a3f P 9cb8de0701f2482b99e51d5ac080aa13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:25.873103 15112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97c761f72c14075b65e501c4b3ae0fb" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605"
I20260709 14:54:25.874140 15112 raft_consensus.cc:3060] T b97c761f72c14075b65e501c4b3ae0fb P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Advancing to term 1
W20260709 14:54:25.887931 15001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:43177, user_credentials={real_user=slave}} blocked reactor thread for 56007.6us
I20260709 14:54:25.894333 15695 raft_consensus.cc:493] T 4f709a060be148029cf72f1af6f79714 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:25.895120 15695 raft_consensus.cc:515] T 4f709a060be148029cf72f1af6f79714 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:25.895841 15311 ts_tablet_manager.cc:1434] T d326f264e68d41d69b5007023083ed9e P eaa34beb1b274443b1c46839afd0a484: Time spent starting tablet: real 0.125s	user 0.010s	sys 0.000s
I20260709 14:54:25.898355 15309 tablet_bootstrap.cc:654] T 5e8a01e27eab492bb73df3359e500627 P 7519e608fbb44d9db8ad30b9f10ae605: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:25.898943 15311 tablet_bootstrap.cc:492] T 1193461bc272409e8a1e719ecdb38e7f P eaa34beb1b274443b1c46839afd0a484: Bootstrap starting.
I20260709 14:54:25.900782 15695 leader_election.cc:290] T 4f709a060be148029cf72f1af6f79714 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493), 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177)
I20260709 14:54:25.931102 15227 leader_election.cc:304] T ff73c3d51e5e480c920d1aca00b9b40d P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cb8de0701f2482b99e51d5ac080aa13, eaa34beb1b274443b1c46839afd0a484; no voters: 
I20260709 14:54:25.934849 15307 ts_tablet_manager.cc:1434] T 4abdbdda3ce149a9904e919be18e7a3f P 9cb8de0701f2482b99e51d5ac080aa13: Time spent starting tablet: real 0.189s	user 0.005s	sys 0.005s
I20260709 14:54:25.935879 15227 leader_election.cc:304] T b97c761f72c14075b65e501c4b3ae0fb P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cb8de0701f2482b99e51d5ac080aa13, eaa34beb1b274443b1c46839afd0a484; no voters: 
I20260709 14:54:25.947847 15346 raft_consensus.cc:2804] T b97c761f72c14075b65e501c4b3ae0fb P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:54:25.955389 15346 raft_consensus.cc:697] T b97c761f72c14075b65e501c4b3ae0fb P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 LEADER]: Becoming Leader. State: Replica: 9cb8de0701f2482b99e51d5ac080aa13, State: Running, Role: LEADER
I20260709 14:54:25.956548 15346 consensus_queue.cc:237] T b97c761f72c14075b65e501c4b3ae0fb P 9cb8de0701f2482b99e51d5ac080aa13 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:25.942078 15754 raft_consensus.cc:2804] T ff73c3d51e5e480c920d1aca00b9b40d P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:54:25.933828 15112 raft_consensus.cc:2468] T b97c761f72c14075b65e501c4b3ae0fb P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cb8de0701f2482b99e51d5ac080aa13 in term 1.
I20260709 14:54:25.968262 15754 raft_consensus.cc:493] T ff73c3d51e5e480c920d1aca00b9b40d P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:54:25.975524 15307 tablet_bootstrap.cc:492] T 8974e5ab032b4fba92bfc577280778bf P 9cb8de0701f2482b99e51d5ac080aa13: Bootstrap starting.
I20260709 14:54:25.971844 15150 leader_election.cc:304] T ff73c3d51e5e480c920d1aca00b9b40d P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9cb8de0701f2482b99e51d5ac080aa13, eaa34beb1b274443b1c46839afd0a484; no voters: 7519e608fbb44d9db8ad30b9f10ae605
I20260709 14:54:25.924857 15726 raft_consensus.cc:515] T 5b9f8063585c4e5faddebd56fbe1aa01 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:25.973423 15112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff73c3d51e5e480c920d1aca00b9b40d" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605" is_pre_election: true
I20260709 14:54:25.992725 15804 raft_consensus.cc:2804] T ff73c3d51e5e480c920d1aca00b9b40d P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:54:25.993283 15804 raft_consensus.cc:493] T ff73c3d51e5e480c920d1aca00b9b40d P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:54:25.993669 15804 raft_consensus.cc:3060] T ff73c3d51e5e480c920d1aca00b9b40d P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:26.004209 15726 leader_election.cc:290] T 5b9f8063585c4e5faddebd56fbe1aa01 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 election: Requested vote from peers eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805), 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493)
I20260709 14:54:26.007835 15311 tablet_bootstrap.cc:654] T 1193461bc272409e8a1e719ecdb38e7f P eaa34beb1b274443b1c46839afd0a484: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:25.975445 15754 raft_consensus.cc:3060] T ff73c3d51e5e480c920d1aca00b9b40d P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:26.009063 15186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b9f8063585c4e5faddebd56fbe1aa01" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484"
I20260709 14:54:26.010183 15186 raft_consensus.cc:3060] T 5b9f8063585c4e5faddebd56fbe1aa01 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:25.943784 15033 raft_consensus.cc:2468] T a9dab1878c4b4550880f5680c6d48c67 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa34beb1b274443b1c46839afd0a484 in term 1.
I20260709 14:54:26.012928 15153 leader_election.cc:304] T a9dab1878c4b4550880f5680c6d48c67 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dbc2c92e49e346b5b3bd7705a229afc6, eaa34beb1b274443b1c46839afd0a484; no voters: 
I20260709 14:54:26.014357 15787 raft_consensus.cc:2804] T a9dab1878c4b4550880f5680c6d48c67 P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:54:26.015879 15787 raft_consensus.cc:697] T a9dab1878c4b4550880f5680c6d48c67 P eaa34beb1b274443b1c46839afd0a484 [term 1 LEADER]: Becoming Leader. State: Replica: eaa34beb1b274443b1c46839afd0a484, State: Running, Role: LEADER
I20260709 14:54:26.016976 15787 consensus_queue.cc:237] T a9dab1878c4b4550880f5680c6d48c67 P eaa34beb1b274443b1c46839afd0a484 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:26.051496 15107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f709a060be148029cf72f1af6f79714" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605" is_pre_election: true
W20260709 14:54:26.059499 15001 leader_election.cc:343] T 4f709a060be148029cf72f1af6f79714 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:26.066705 15186 raft_consensus.cc:2468] T 5b9f8063585c4e5faddebd56fbe1aa01 P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbc2c92e49e346b5b3bd7705a229afc6 in term 1.
W20260709 14:54:26.077913 15224 leader_election.cc:343] T ff73c3d51e5e480c920d1aca00b9b40d P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:26.094460 15307 tablet_bootstrap.cc:654] T 8974e5ab032b4fba92bfc577280778bf P 9cb8de0701f2482b99e51d5ac080aa13: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:26.097404 15812 raft_consensus.cc:493] T d2463fd792b240e9911c6b38bcb453b8 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:26.103933 15812 raft_consensus.cc:515] T d2463fd792b240e9911c6b38bcb453b8 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:26.106513 15812 leader_election.cc:290] T d2463fd792b240e9911c6b38bcb453b8 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493), dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477)
I20260709 14:54:26.121080 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2463fd792b240e9911c6b38bcb453b8" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" is_pre_election: true
I20260709 14:54:26.130239 15110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dab1878c4b4550880f5680c6d48c67" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605"
W20260709 14:54:26.131047 15153 leader_election.cc:343] T d2463fd792b240e9911c6b38bcb453b8 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:26.159808 15309 tablet_bootstrap.cc:492] T 5e8a01e27eab492bb73df3359e500627 P 7519e608fbb44d9db8ad30b9f10ae605: No bootstrap required, opened a new log
I20260709 14:54:26.160652 15309 ts_tablet_manager.cc:1403] T 5e8a01e27eab492bb73df3359e500627 P 7519e608fbb44d9db8ad30b9f10ae605: Time spent bootstrapping tablet: real 0.421s	user 0.015s	sys 0.015s
I20260709 14:54:26.164424 15309 raft_consensus.cc:359] T 5e8a01e27eab492bb73df3359e500627 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:26.165561 15309 raft_consensus.cc:385] T 5e8a01e27eab492bb73df3359e500627 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:26.166292 15309 raft_consensus.cc:740] T 5e8a01e27eab492bb73df3359e500627 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7519e608fbb44d9db8ad30b9f10ae605, State: Initialized, Role: FOLLOWER
I20260709 14:54:26.168022 15309 consensus_queue.cc:260] T 5e8a01e27eab492bb73df3359e500627 P 7519e608fbb44d9db8ad30b9f10ae605 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:26.178191 15309 ts_tablet_manager.cc:1434] T 5e8a01e27eab492bb73df3359e500627 P 7519e608fbb44d9db8ad30b9f10ae605: Time spent starting tablet: real 0.017s	user 0.009s	sys 0.001s
I20260709 14:54:26.152845 15254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f709a060be148029cf72f1af6f79714" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13" is_pre_election: true
I20260709 14:54:26.189189 15802 raft_consensus.cc:493] T d326f264e68d41d69b5007023083ed9e P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:26.190095 15802 raft_consensus.cc:515] T d326f264e68d41d69b5007023083ed9e P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:26.208509 15254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b9f8063585c4e5faddebd56fbe1aa01" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13"
I20260709 14:54:26.211302 15309 tablet_bootstrap.cc:492] T 1193461bc272409e8a1e719ecdb38e7f P 7519e608fbb44d9db8ad30b9f10ae605: Bootstrap starting.
I20260709 14:54:26.216753 14932 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53982 (request call id 67) took 1008 ms. Trace:
W20260709 14:54:26.154697 15150 leader_election.cc:343] T a9dab1878c4b4550880f5680c6d48c67 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177): Illegal state: must be running to vote when last-logged opid is not known
W20260709 14:54:26.232604 15150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:43177, user_credentials={real_user=slave}} blocked reactor thread for 77958.5us
I20260709 14:54:26.253360 15306 tablet_bootstrap.cc:492] T 8974e5ab032b4fba92bfc577280778bf P dbc2c92e49e346b5b3bd7705a229afc6: No bootstrap required, opened a new log
I20260709 14:54:26.254367 15306 ts_tablet_manager.cc:1403] T 8974e5ab032b4fba92bfc577280778bf P dbc2c92e49e346b5b3bd7705a229afc6: Time spent bootstrapping tablet: real 0.714s	user 0.027s	sys 0.033s
I20260709 14:54:26.228559 14932 rpcz_store.cc:276] 0709 14:54:25.208316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:54:25.208511 (+   195us) service_pool.cc:224] Handling call
0709 14:54:26.216624 (+1008113us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 14:54:25.471278 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 14:54:25.521674 (+ 50396us) write_op.cc:432] Acquiring schema lock in shared mode
0709 14:54:25.521711 (+    37us) write_op.cc:435] Acquired schema lock
0709 14:54:25.521734 (+    23us) tablet.cc:662] Decoding operations
0709 14:54:25.522084 (+   350us) write_op.cc:620] Acquiring the partition lock for write op
0709 14:54:25.522143 (+    59us) write_op.cc:641] Partition lock acquired for write op
0709 14:54:25.522169 (+    26us) tablet.cc:685] Acquiring locks for 1 operations
0709 14:54:25.522349 (+   180us) tablet.cc:701] Row locks acquired
0709 14:54:25.522363 (+    14us) write_op.cc:260] PREPARE: finished
0709 14:54:25.522508 (+   145us) write_op.cc:270] Start()
0709 14:54:25.522616 (+   108us) write_op.cc:276] Timestamp: P: 1783608865522461 usec, L: 0
0709 14:54:25.522634 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 14:54:25.523486 (+   852us) log.cc:844] Serialized 537 byte log entry
0709 14:54:25.718877 (+195391us) op_driver.cc:464] REPLICATION: finished
0709 14:54:25.865949 (+147072us) write_op.cc:301] APPLY: starting
0709 14:54:25.869671 (+  3722us) tablet.cc:1367] starting BulkCheckPresence
0709 14:54:25.873215 (+  3544us) tablet.cc:1370] finished BulkCheckPresence
0709 14:54:25.873388 (+   173us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 14:54:25.873722 (+   334us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 14:54:25.873893 (+   171us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 14:54:25.873941 (+    48us) write_op.cc:312] APPLY: finished
0709 14:54:25.874278 (+   337us) log.cc:844] Serialized 22 byte log entry
0709 14:54:25.874481 (+   203us) write_op.cc:489] Releasing partition, row and schema locks
0709 14:54:25.874578 (+    97us) write_op.cc:454] Released schema lock
0709 14:54:25.874620 (+    42us) write_op.cc:341] FINISH: Updating metrics
0709 14:54:25.875227 (+   607us) write_op.cc:489] Releasing partition, row and schema locks
0709 14:54:25.875369 (+   142us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":285264,"reported_tablets":7,"child_traces":[["op",{"apply.queue_time_us":125960,"apply.run_cpu_time_us":2287,"apply.run_wall_time_us":17176,"num_ops":1,"prepare.queue_time_us":148518,"prepare.run_cpu_time_us":3455,"prepare.run_wall_time_us":63375,"replication_time_us":180205,"thread_start_us":130092,"threads_started":2}]]}
W20260709 14:54:26.264621 15001 leader_election.cc:343] T 4f709a060be148029cf72f1af6f79714 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:26.265399 15001 leader_election.cc:304] T 4f709a060be148029cf72f1af6f79714 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbc2c92e49e346b5b3bd7705a229afc6; no voters: 7519e608fbb44d9db8ad30b9f10ae605, 9cb8de0701f2482b99e51d5ac080aa13
I20260709 14:54:26.208932 15802 leader_election.cc:290] T d326f264e68d41d69b5007023083ed9e P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477), 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177)
I20260709 14:54:26.224341 15259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2463fd792b240e9911c6b38bcb453b8" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13" is_pre_election: true
I20260709 14:54:26.280061 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d326f264e68d41d69b5007023083ed9e" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" is_pre_election: true
W20260709 14:54:26.290495 15153 leader_election.cc:343] T d326f264e68d41d69b5007023083ed9e P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Illegal state: must be running to vote when last-logged opid is not known
W20260709 14:54:26.299326 15001 leader_election.cc:343] T 5b9f8063585c4e5faddebd56fbe1aa01 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:26.280681 15811 raft_consensus.cc:2749] T 4f709a060be148029cf72f1af6f79714 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:54:26.300128 15754 raft_consensus.cc:515] T ff73c3d51e5e480c920d1aca00b9b40d P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:26.304003 15813 consensus_queue.cc:1048] T db39b7ffe995451885f4074ddf16028d P dbc2c92e49e346b5b3bd7705a229afc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
W20260709 14:54:26.323259 15150 leader_election.cc:343] T d2463fd792b240e9911c6b38bcb453b8 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:26.323876 15150 leader_election.cc:304] T d2463fd792b240e9911c6b38bcb453b8 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa34beb1b274443b1c46839afd0a484; no voters: 9cb8de0701f2482b99e51d5ac080aa13, dbc2c92e49e346b5b3bd7705a229afc6
I20260709 14:54:26.324906 15786 raft_consensus.cc:2749] T d2463fd792b240e9911c6b38bcb453b8 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:54:26.330942 15307 tablet_bootstrap.cc:492] T 8974e5ab032b4fba92bfc577280778bf P 9cb8de0701f2482b99e51d5ac080aa13: No bootstrap required, opened a new log
I20260709 14:54:26.331540 15307 ts_tablet_manager.cc:1403] T 8974e5ab032b4fba92bfc577280778bf P 9cb8de0701f2482b99e51d5ac080aa13: Time spent bootstrapping tablet: real 0.368s	user 0.060s	sys 0.063s
I20260709 14:54:26.307240 15804 raft_consensus.cc:515] T ff73c3d51e5e480c920d1aca00b9b40d P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:26.334515 15107 raft_consensus.cc:3060] T 5e8a01e27eab492bb73df3359e500627 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:26.336067 15804 leader_election.cc:290] T ff73c3d51e5e480c920d1aca00b9b40d P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 election: Requested vote from peers 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177), 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493)
I20260709 14:54:26.337360 15754 leader_election.cc:290] T ff73c3d51e5e480c920d1aca00b9b40d P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 election: Requested vote from peers 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177), eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805)
I20260709 14:54:26.320859 15306 raft_consensus.cc:359] T 8974e5ab032b4fba92bfc577280778bf P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:26.350411 15306 raft_consensus.cc:385] T 8974e5ab032b4fba92bfc577280778bf P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:26.351239 15306 raft_consensus.cc:740] T 8974e5ab032b4fba92bfc577280778bf P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbc2c92e49e346b5b3bd7705a229afc6, State: Initialized, Role: FOLLOWER
I20260709 14:54:26.362887 15306 consensus_queue.cc:260] T 8974e5ab032b4fba92bfc577280778bf P dbc2c92e49e346b5b3bd7705a229afc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:26.379179 15186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff73c3d51e5e480c920d1aca00b9b40d" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484"
I20260709 14:54:26.386442 15186 raft_consensus.cc:2393] T ff73c3d51e5e480c920d1aca00b9b40d P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9cb8de0701f2482b99e51d5ac080aa13 in current term 1: Already voted for candidate eaa34beb1b274443b1c46839afd0a484 in this term.
I20260709 14:54:26.397872 14934 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54008 (request call id 74) took 1140 ms. Trace:
I20260709 14:54:26.398437 14934 rpcz_store.cc:276] 0709 14:54:25.257694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:54:25.286119 (+ 28425us) service_pool.cc:224] Handling call
0709 14:54:26.397781 (+1111662us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13254,"reported_tablets":7}
I20260709 14:54:26.380477 15713 raft_consensus.cc:493] T 4abdbdda3ce149a9904e919be18e7a3f P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:26.415122 15307 raft_consensus.cc:359] T 8974e5ab032b4fba92bfc577280778bf P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:26.416740 15307 raft_consensus.cc:385] T 8974e5ab032b4fba92bfc577280778bf P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:26.390455 15105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff73c3d51e5e480c920d1aca00b9b40d" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605"
I20260709 14:54:26.417198 15307 raft_consensus.cc:740] T 8974e5ab032b4fba92bfc577280778bf P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9cb8de0701f2482b99e51d5ac080aa13, State: Initialized, Role: FOLLOWER
I20260709 14:54:26.431699 15309 tablet_bootstrap.cc:654] T 1193461bc272409e8a1e719ecdb38e7f P 7519e608fbb44d9db8ad30b9f10ae605: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:26.444991 15113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d326f264e68d41d69b5007023083ed9e" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605" is_pre_election: true
I20260709 14:54:26.445381 15545 raft_consensus.cc:493] T 3b4c50fac37a43c0988d5ea911d09f43 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader eaa34beb1b274443b1c46839afd0a484)
I20260709 14:54:26.446244 15545 raft_consensus.cc:515] T 3b4c50fac37a43c0988d5ea911d09f43 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:26.454295 15306 ts_tablet_manager.cc:1434] T 8974e5ab032b4fba92bfc577280778bf P dbc2c92e49e346b5b3bd7705a229afc6: Time spent starting tablet: real 0.200s	user 0.009s	sys 0.002s
I20260709 14:54:26.432920 15713 raft_consensus.cc:515] T 4abdbdda3ce149a9904e919be18e7a3f P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:26.457453 15307 consensus_queue.cc:260] T 8974e5ab032b4fba92bfc577280778bf P 9cb8de0701f2482b99e51d5ac080aa13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:26.464370 15545 leader_election.cc:290] T 3b4c50fac37a43c0988d5ea911d09f43 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805), dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477)
I20260709 14:54:26.467998 15260 raft_consensus.cc:3060] T 4abdbdda3ce149a9904e919be18e7a3f P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:26.469023 15713 leader_election.cc:290] T 4abdbdda3ce149a9904e919be18e7a3f P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805), dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477)
I20260709 14:54:26.477206 15306 tablet_bootstrap.cc:492] T d2463fd792b240e9911c6b38bcb453b8 P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap starting.
W20260709 14:54:26.480243 15834 log.cc:927] Time spent T a9dab1878c4b4550880f5680c6d48c67 P eaa34beb1b274443b1c46839afd0a484: Append to log took a long time: real 0.186s	user 0.005s	sys 0.000s
I20260709 14:54:26.490571 15112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff73c3d51e5e480c920d1aca00b9b40d" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605"
I20260709 14:54:26.494638 15181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4c50fac37a43c0988d5ea911d09f43" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484" is_pre_election: true
I20260709 14:54:26.495359 15180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abdbdda3ce149a9904e919be18e7a3f" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484" is_pre_election: true
I20260709 14:54:26.512717 15311 tablet_bootstrap.cc:492] T 1193461bc272409e8a1e719ecdb38e7f P eaa34beb1b274443b1c46839afd0a484: No bootstrap required, opened a new log
I20260709 14:54:26.513808 15311 ts_tablet_manager.cc:1403] T 1193461bc272409e8a1e719ecdb38e7f P eaa34beb1b274443b1c46839afd0a484: Time spent bootstrapping tablet: real 0.617s	user 0.034s	sys 0.036s
W20260709 14:54:26.528256 15001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.68:45493, user_credentials={real_user=slave}} blocked reactor thread for 123393us
I20260709 14:54:26.540412 15805 consensus_queue.cc:1048] T b97c761f72c14075b65e501c4b3ae0fb P 9cb8de0701f2482b99e51d5ac080aa13 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:54:26.557421 15004 leader_election.cc:304] T 5b9f8063585c4e5faddebd56fbe1aa01 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dbc2c92e49e346b5b3bd7705a229afc6, eaa34beb1b274443b1c46839afd0a484; no voters: 9cb8de0701f2482b99e51d5ac080aa13
I20260709 14:54:26.560415 15813 raft_consensus.cc:2804] T 5b9f8063585c4e5faddebd56fbe1aa01 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:54:26.562731 15813 raft_consensus.cc:697] T 5b9f8063585c4e5faddebd56fbe1aa01 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 LEADER]: Becoming Leader. State: Replica: dbc2c92e49e346b5b3bd7705a229afc6, State: Running, Role: LEADER
I20260709 14:54:26.563946 15813 consensus_queue.cc:237] T 5b9f8063585c4e5faddebd56fbe1aa01 P dbc2c92e49e346b5b3bd7705a229afc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:26.576820 15307 ts_tablet_manager.cc:1434] T 8974e5ab032b4fba92bfc577280778bf P 9cb8de0701f2482b99e51d5ac080aa13: Time spent starting tablet: real 0.245s	user 0.017s	sys 0.008s
W20260709 14:54:26.603241 15150 leader_election.cc:343] T ff73c3d51e5e480c920d1aca00b9b40d P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177): Illegal state: must be running to vote when last-logged opid is not known
W20260709 14:54:26.604259 15150 leader_election.cc:343] T d326f264e68d41d69b5007023083ed9e P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:26.612978 15150 leader_election.cc:304] T d326f264e68d41d69b5007023083ed9e P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa34beb1b274443b1c46839afd0a484; no voters: 7519e608fbb44d9db8ad30b9f10ae605, dbc2c92e49e346b5b3bd7705a229afc6
I20260709 14:54:26.626549 15307 tablet_bootstrap.cc:492] T 4f709a060be148029cf72f1af6f79714 P 9cb8de0701f2482b99e51d5ac080aa13: Bootstrap starting.
I20260709 14:54:26.642956 15034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4c50fac37a43c0988d5ea911d09f43" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" is_pre_election: true
I20260709 14:54:26.650619 15311 raft_consensus.cc:359] T 1193461bc272409e8a1e719ecdb38e7f P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:26.657603 15311 raft_consensus.cc:385] T 1193461bc272409e8a1e719ecdb38e7f P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:26.619167 15804 raft_consensus.cc:2749] T d326f264e68d41d69b5007023083ed9e P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:54:26.658722 15311 raft_consensus.cc:740] T 1193461bc272409e8a1e719ecdb38e7f P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eaa34beb1b274443b1c46839afd0a484, State: Initialized, Role: FOLLOWER
I20260709 14:54:26.670883 15311 consensus_queue.cc:260] T 1193461bc272409e8a1e719ecdb38e7f P eaa34beb1b274443b1c46839afd0a484 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:26.683203 15034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abdbdda3ce149a9904e919be18e7a3f" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" is_pre_election: true
W20260709 14:54:26.686878 15150 consensus_peers.cc:597] T a9dab1878c4b4550880f5680c6d48c67 P eaa34beb1b274443b1c46839afd0a484 -> Peer 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177): Couldn't send request to peer 7519e608fbb44d9db8ad30b9f10ae605. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 14:54:26.695801 15224 leader_election.cc:343] T ff73c3d51e5e480c920d1aca00b9b40d P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:26.696533 15224 leader_election.cc:304] T ff73c3d51e5e480c920d1aca00b9b40d P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cb8de0701f2482b99e51d5ac080aa13; no voters: 7519e608fbb44d9db8ad30b9f10ae605, eaa34beb1b274443b1c46839afd0a484
I20260709 14:54:26.701092 15311 ts_tablet_manager.cc:1434] T 1193461bc272409e8a1e719ecdb38e7f P eaa34beb1b274443b1c46839afd0a484: Time spent starting tablet: real 0.187s	user 0.012s	sys 0.018s
I20260709 14:54:26.705737 15227 leader_election.cc:304] T 3b4c50fac37a43c0988d5ea911d09f43 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cb8de0701f2482b99e51d5ac080aa13; no voters: dbc2c92e49e346b5b3bd7705a229afc6, eaa34beb1b274443b1c46839afd0a484
I20260709 14:54:26.708772 15806 raft_consensus.cc:2749] T ff73c3d51e5e480c920d1aca00b9b40d P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 14:54:26.745265 15255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff73c3d51e5e480c920d1aca00b9b40d" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13"
W20260709 14:54:26.948879 15227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:45477, user_credentials={real_user=slave}} blocked reactor thread for 236876us
I20260709 14:54:26.929087 15808 raft_consensus.cc:493] T 5e8a01e27eab492bb73df3359e500627 P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader eaa34beb1b274443b1c46839afd0a484)
I20260709 14:54:26.973749 15306 tablet_bootstrap.cc:654] T d2463fd792b240e9911c6b38bcb453b8 P dbc2c92e49e346b5b3bd7705a229afc6: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:26.976649 15307 tablet_bootstrap.cc:654] T 4f709a060be148029cf72f1af6f79714 P 9cb8de0701f2482b99e51d5ac080aa13: Neither blocks nor log segments found. Creating new log.
W20260709 14:54:26.977451 15224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:43177, user_credentials={real_user=slave}} blocked reactor thread for 281693us
I20260709 14:54:26.747833 15822 raft_consensus.cc:2749] T 3b4c50fac37a43c0988d5ea911d09f43 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 14:54:27.011984 15309 tablet_bootstrap.cc:492] T 1193461bc272409e8a1e719ecdb38e7f P 7519e608fbb44d9db8ad30b9f10ae605: No bootstrap required, opened a new log
I20260709 14:54:27.012673 15309 ts_tablet_manager.cc:1403] T 1193461bc272409e8a1e719ecdb38e7f P 7519e608fbb44d9db8ad30b9f10ae605: Time spent bootstrapping tablet: real 0.802s	user 0.032s	sys 0.063s
I20260709 14:54:26.997628 15808 raft_consensus.cc:515] T 5e8a01e27eab492bb73df3359e500627 P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:27.021482 15694 raft_consensus.cc:493] T 8974e5ab032b4fba92bfc577280778bf P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:27.022195 15694 raft_consensus.cc:515] T 8974e5ab032b4fba92bfc577280778bf P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:27.024865 15694 leader_election.cc:290] T 8974e5ab032b4fba92bfc577280778bf P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493), 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177)
I20260709 14:54:27.049605 15255 raft_consensus.cc:2393] T ff73c3d51e5e480c920d1aca00b9b40d P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate eaa34beb1b274443b1c46839afd0a484 in current term 1: Already voted for candidate 9cb8de0701f2482b99e51d5ac080aa13 in this term.
I20260709 14:54:27.061357 15227 leader_election.cc:304] T 4abdbdda3ce149a9904e919be18e7a3f P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cb8de0701f2482b99e51d5ac080aa13; no voters: dbc2c92e49e346b5b3bd7705a229afc6, eaa34beb1b274443b1c46839afd0a484
W20260709 14:54:27.074224 15845 log.cc:927] Time spent T db39b7ffe995451885f4074ddf16028d P 7519e608fbb44d9db8ad30b9f10ae605: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
W20260709 14:54:27.081399 15850 log.cc:927] Time spent T 5b9f8063585c4e5faddebd56fbe1aa01 P dbc2c92e49e346b5b3bd7705a229afc6: Append to log took a long time: real 0.051s	user 0.002s	sys 0.000s
I20260709 14:54:27.059836 15786 raft_consensus.cc:493] T 0b12879f49fa4d52a477be2e490f2b38 P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7519e608fbb44d9db8ad30b9f10ae605)
I20260709 14:54:27.129988 15150 leader_election.cc:304] T ff73c3d51e5e480c920d1aca00b9b40d P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa34beb1b274443b1c46839afd0a484; no voters: 7519e608fbb44d9db8ad30b9f10ae605, 9cb8de0701f2482b99e51d5ac080aa13
I20260709 14:54:27.133061 15739 raft_consensus.cc:2749] T ff73c3d51e5e480c920d1aca00b9b40d P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 14:54:27.114300 15806 raft_consensus.cc:2749] T 4abdbdda3ce149a9904e919be18e7a3f P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:54:27.110313 15802 consensus_queue.cc:1048] T a9dab1878c4b4550880f5680c6d48c67 P eaa34beb1b274443b1c46839afd0a484 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.030s
I20260709 14:54:27.145155 15309 raft_consensus.cc:359] T 1193461bc272409e8a1e719ecdb38e7f P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:27.146332 15309 raft_consensus.cc:385] T 1193461bc272409e8a1e719ecdb38e7f P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:27.146651 15309 raft_consensus.cc:740] T 1193461bc272409e8a1e719ecdb38e7f P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7519e608fbb44d9db8ad30b9f10ae605, State: Initialized, Role: FOLLOWER
I20260709 14:54:27.152276 15309 consensus_queue.cc:260] T 1193461bc272409e8a1e719ecdb38e7f P 7519e608fbb44d9db8ad30b9f10ae605 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:27.111181 15786 raft_consensus.cc:515] T 0b12879f49fa4d52a477be2e490f2b38 P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:27.148070 15805 raft_consensus.cc:493] T 8974e5ab032b4fba92bfc577280778bf P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:27.160322 15309 ts_tablet_manager.cc:1434] T 1193461bc272409e8a1e719ecdb38e7f P 7519e608fbb44d9db8ad30b9f10ae605: Time spent starting tablet: real 0.147s	user 0.009s	sys 0.000s
W20260709 14:54:27.161477 15851 log.cc:927] Time spent T 5e8a01e27eab492bb73df3359e500627 P 7519e608fbb44d9db8ad30b9f10ae605: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 14:54:27.155217 15849 consensus_queue.cc:1048] T b97c761f72c14075b65e501c4b3ae0fb P 9cb8de0701f2482b99e51d5ac080aa13 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 14:54:27.163483 15786 leader_election.cc:290] T 0b12879f49fa4d52a477be2e490f2b38 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177), 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493)
I20260709 14:54:27.172082 15309 tablet_bootstrap.cc:492] T 8974e5ab032b4fba92bfc577280778bf P 7519e608fbb44d9db8ad30b9f10ae605: Bootstrap starting.
I20260709 14:54:27.174660 15110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8974e5ab032b4fba92bfc577280778bf" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605" is_pre_election: true
I20260709 14:54:27.184413 15306 tablet_bootstrap.cc:492] T d2463fd792b240e9911c6b38bcb453b8 P dbc2c92e49e346b5b3bd7705a229afc6: No bootstrap required, opened a new log
I20260709 14:54:27.186969 15307 tablet_bootstrap.cc:492] T 4f709a060be148029cf72f1af6f79714 P 9cb8de0701f2482b99e51d5ac080aa13: No bootstrap required, opened a new log
I20260709 14:54:27.190446 15307 ts_tablet_manager.cc:1403] T 4f709a060be148029cf72f1af6f79714 P 9cb8de0701f2482b99e51d5ac080aa13: Time spent bootstrapping tablet: real 0.571s	user 0.013s	sys 0.040s
I20260709 14:54:27.168128 15805 raft_consensus.cc:515] T 8974e5ab032b4fba92bfc577280778bf P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:27.194478 15307 raft_consensus.cc:359] T 4f709a060be148029cf72f1af6f79714 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:27.195516 15307 raft_consensus.cc:385] T 4f709a060be148029cf72f1af6f79714 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:27.195926 15307 raft_consensus.cc:740] T 4f709a060be148029cf72f1af6f79714 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9cb8de0701f2482b99e51d5ac080aa13, State: Initialized, Role: FOLLOWER
W20260709 14:54:27.197425 15001 leader_election.cc:343] T 8974e5ab032b4fba92bfc577280778bf P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:27.198202 15307 consensus_queue.cc:260] T 4f709a060be148029cf72f1af6f79714 P 9cb8de0701f2482b99e51d5ac080aa13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:27.200647 15307 ts_tablet_manager.cc:1434] T 4f709a060be148029cf72f1af6f79714 P 9cb8de0701f2482b99e51d5ac080aa13: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 14:54:27.202167 15307 tablet_bootstrap.cc:492] T 1193461bc272409e8a1e719ecdb38e7f P 9cb8de0701f2482b99e51d5ac080aa13: Bootstrap starting.
I20260709 14:54:27.204475 14936 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54022 (request call id 71) took 1034 ms. Trace:
W20260709 14:54:27.206413 14984 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 14:54:27.210479 15805 leader_election.cc:290] T 8974e5ab032b4fba92bfc577280778bf P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477), 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177)
I20260709 14:54:27.185130 15306 ts_tablet_manager.cc:1403] T d2463fd792b240e9911c6b38bcb453b8 P dbc2c92e49e346b5b3bd7705a229afc6: Time spent bootstrapping tablet: real 0.711s	user 0.024s	sys 0.016s
I20260709 14:54:27.219707 15261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8974e5ab032b4fba92bfc577280778bf" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13" is_pre_election: true
I20260709 14:54:27.216583 14936 rpcz_store.cc:276] 0709 14:54:26.169678 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 14:54:26.169824 (+   146us) service_pool.cc:224] Handling call
0709 14:54:27.204253 (+1034429us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":269233,"reported_tablets":7}
I20260709 14:54:27.220796 15105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8974e5ab032b4fba92bfc577280778bf" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605" is_pre_election: true
I20260709 14:54:27.230820 14933 catalog_manager.cc:5697] T a9dab1878c4b4550880f5680c6d48c67 P eaa34beb1b274443b1c46839afd0a484 reported cstate change: term changed from 0 to 1, leader changed from <none> to eaa34beb1b274443b1c46839afd0a484 (127.6.101.67). New cstate: current_term: 1 leader_uuid: "eaa34beb1b274443b1c46839afd0a484" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } health_report { overall_health: HEALTHY } } }
I20260709 14:54:27.210510 15786 raft_consensus.cc:493] T 1193461bc272409e8a1e719ecdb38e7f P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:54:27.243234 15224 leader_election.cc:343] T 8974e5ab032b4fba92bfc577280778bf P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:27.243562 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8974e5ab032b4fba92bfc577280778bf" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" is_pre_election: true
I20260709 14:54:27.257864 15035 raft_consensus.cc:2468] T 8974e5ab032b4fba92bfc577280778bf P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cb8de0701f2482b99e51d5ac080aa13 in term 0.
I20260709 14:54:27.258862 15256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b12879f49fa4d52a477be2e490f2b38" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13" is_pre_election: true
I20260709 14:54:27.239218 15261 raft_consensus.cc:2468] T 8974e5ab032b4fba92bfc577280778bf P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbc2c92e49e346b5b3bd7705a229afc6 in term 0.
W20260709 14:54:27.261132 15001 consensus_peers.cc:597] T 5b9f8063585c4e5faddebd56fbe1aa01 P dbc2c92e49e346b5b3bd7705a229afc6 -> Peer 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493): Couldn't send request to peer 9cb8de0701f2482b99e51d5ac080aa13. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:54:27.247816 15786 raft_consensus.cc:515] T 1193461bc272409e8a1e719ecdb38e7f P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:27.262526 15001 leader_election.cc:304] T 8974e5ab032b4fba92bfc577280778bf P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9cb8de0701f2482b99e51d5ac080aa13, dbc2c92e49e346b5b3bd7705a229afc6; no voters: 7519e608fbb44d9db8ad30b9f10ae605
I20260709 14:54:27.264731 15839 raft_consensus.cc:2804] T 8974e5ab032b4fba92bfc577280778bf P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:54:27.265265 15839 raft_consensus.cc:493] T 8974e5ab032b4fba92bfc577280778bf P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:54:27.265604 15839 raft_consensus.cc:3060] T 8974e5ab032b4fba92bfc577280778bf P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:27.264758 15786 leader_election.cc:290] T 1193461bc272409e8a1e719ecdb38e7f P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177), 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493)
I20260709 14:54:27.270637 15808 leader_election.cc:290] T 5e8a01e27eab492bb73df3359e500627 P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477), eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805)
I20260709 14:54:27.266947 15227 leader_election.cc:304] T 8974e5ab032b4fba92bfc577280778bf P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9cb8de0701f2482b99e51d5ac080aa13, dbc2c92e49e346b5b3bd7705a229afc6; no voters: 7519e608fbb44d9db8ad30b9f10ae605
I20260709 14:54:27.275938 15713 raft_consensus.cc:2804] T 8974e5ab032b4fba92bfc577280778bf P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:54:27.276440 15713 raft_consensus.cc:493] T 8974e5ab032b4fba92bfc577280778bf P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:54:27.276762 15713 raft_consensus.cc:3060] T 8974e5ab032b4fba92bfc577280778bf P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:27.278167 15256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1193461bc272409e8a1e719ecdb38e7f" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13" is_pre_election: true
I20260709 14:54:27.278834 15306 raft_consensus.cc:359] T d2463fd792b240e9911c6b38bcb453b8 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:27.279645 15306 raft_consensus.cc:385] T d2463fd792b240e9911c6b38bcb453b8 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:27.279898 15306 raft_consensus.cc:740] T d2463fd792b240e9911c6b38bcb453b8 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbc2c92e49e346b5b3bd7705a229afc6, State: Initialized, Role: FOLLOWER
I20260709 14:54:27.281203 15309 tablet_bootstrap.cc:654] T 8974e5ab032b4fba92bfc577280778bf P 7519e608fbb44d9db8ad30b9f10ae605: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:27.283596 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e8a01e27eab492bb73df3359e500627" candidate_uuid: "7519e608fbb44d9db8ad30b9f10ae605" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" is_pre_election: true
W20260709 14:54:27.288407 15150 leader_election.cc:343] T 1193461bc272409e8a1e719ecdb38e7f P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:27.289511 15184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e8a01e27eab492bb73df3359e500627" candidate_uuid: "7519e608fbb44d9db8ad30b9f10ae605" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484" is_pre_election: true
I20260709 14:54:27.288100 15106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b12879f49fa4d52a477be2e490f2b38" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605" is_pre_election: true
I20260709 14:54:27.292763 15307 tablet_bootstrap.cc:654] T 1193461bc272409e8a1e719ecdb38e7f P 9cb8de0701f2482b99e51d5ac080aa13: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:27.280710 15306 consensus_queue.cc:260] T d2463fd792b240e9911c6b38bcb453b8 P dbc2c92e49e346b5b3bd7705a229afc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:27.301442 15805 raft_consensus.cc:493] T 4f709a060be148029cf72f1af6f79714 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:27.302035 15805 raft_consensus.cc:515] T 4f709a060be148029cf72f1af6f79714 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:27.304055 15805 leader_election.cc:290] T 4f709a060be148029cf72f1af6f79714 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477), 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177)
I20260709 14:54:27.304944 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f709a060be148029cf72f1af6f79714" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" is_pre_election: true
I20260709 14:54:27.305661 15035 raft_consensus.cc:2468] T 4f709a060be148029cf72f1af6f79714 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cb8de0701f2482b99e51d5ac080aa13 in term 0.
I20260709 14:54:27.306195 15107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1193461bc272409e8a1e719ecdb38e7f" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605" is_pre_election: true
I20260709 14:54:27.291834 15839 raft_consensus.cc:515] T 8974e5ab032b4fba92bfc577280778bf P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:27.305516 15105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f709a060be148029cf72f1af6f79714" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605" is_pre_election: true
I20260709 14:54:27.306823 15107 raft_consensus.cc:2468] T 1193461bc272409e8a1e719ecdb38e7f P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa34beb1b274443b1c46839afd0a484 in term 0.
W20260709 14:54:27.309355 15224 leader_election.cc:343] T 4f709a060be148029cf72f1af6f79714 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:27.312134 15256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8974e5ab032b4fba92bfc577280778bf" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13"
I20260709 14:54:27.313011 15227 leader_election.cc:304] T 4f709a060be148029cf72f1af6f79714 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9cb8de0701f2482b99e51d5ac080aa13, dbc2c92e49e346b5b3bd7705a229afc6; no voters: 7519e608fbb44d9db8ad30b9f10ae605
I20260709 14:54:27.314582 15848 raft_consensus.cc:2804] T 4f709a060be148029cf72f1af6f79714 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:54:27.315692 15848 raft_consensus.cc:493] T 4f709a060be148029cf72f1af6f79714 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:54:27.316088 15848 raft_consensus.cc:3060] T 4f709a060be148029cf72f1af6f79714 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:27.320137 15150 leader_election.cc:304] T 0b12879f49fa4d52a477be2e490f2b38 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa34beb1b274443b1c46839afd0a484; no voters: 7519e608fbb44d9db8ad30b9f10ae605, 9cb8de0701f2482b99e51d5ac080aa13
I20260709 14:54:27.320822 15079 leader_election.cc:304] T 5e8a01e27eab492bb73df3359e500627 P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7519e608fbb44d9db8ad30b9f10ae605; no voters: dbc2c92e49e346b5b3bd7705a229afc6, eaa34beb1b274443b1c46839afd0a484
I20260709 14:54:27.322340 15432 raft_consensus.cc:2749] T 5e8a01e27eab492bb73df3359e500627 P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 14:54:27.312125 15107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8974e5ab032b4fba92bfc577280778bf" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605"
I20260709 14:54:27.323084 15150 leader_election.cc:304] T 1193461bc272409e8a1e719ecdb38e7f P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7519e608fbb44d9db8ad30b9f10ae605, eaa34beb1b274443b1c46839afd0a484; no voters: 9cb8de0701f2482b99e51d5ac080aa13
I20260709 14:54:27.324424 15804 raft_consensus.cc:2749] T 0b12879f49fa4d52a477be2e490f2b38 P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 14:54:27.326761 15793 raft_consensus.cc:2804] T 1193461bc272409e8a1e719ecdb38e7f P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:54:27.330420 15793 raft_consensus.cc:493] T 1193461bc272409e8a1e719ecdb38e7f P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:54:27.315069 15839 leader_election.cc:290] T 8974e5ab032b4fba92bfc577280778bf P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 election: Requested vote from peers 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493), 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177)
I20260709 14:54:27.330834 15793 raft_consensus.cc:3060] T 1193461bc272409e8a1e719ecdb38e7f P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:27.329511 15713 raft_consensus.cc:515] T 8974e5ab032b4fba92bfc577280778bf P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:27.336659 15306 ts_tablet_manager.cc:1434] T d2463fd792b240e9911c6b38bcb453b8 P dbc2c92e49e346b5b3bd7705a229afc6: Time spent starting tablet: real 0.109s	user 0.009s	sys 0.000s
W20260709 14:54:27.344061 15001 leader_election.cc:343] T 8974e5ab032b4fba92bfc577280778bf P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:27.345777 15256 raft_consensus.cc:2393] T 8974e5ab032b4fba92bfc577280778bf P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate dbc2c92e49e346b5b3bd7705a229afc6 in current term 1: Already voted for candidate 9cb8de0701f2482b99e51d5ac080aa13 in this term.
I20260709 14:54:27.349715 15001 leader_election.cc:304] T 8974e5ab032b4fba92bfc577280778bf P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbc2c92e49e346b5b3bd7705a229afc6; no voters: 7519e608fbb44d9db8ad30b9f10ae605, 9cb8de0701f2482b99e51d5ac080aa13
I20260709 14:54:27.350837 15724 raft_consensus.cc:2749] T 8974e5ab032b4fba92bfc577280778bf P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 14:54:27.353125 15713 leader_election.cc:290] T 8974e5ab032b4fba92bfc577280778bf P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 election: Requested vote from peers dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477), 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177)
I20260709 14:54:27.355079 15111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8974e5ab032b4fba92bfc577280778bf" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605"
I20260709 14:54:27.360628 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8974e5ab032b4fba92bfc577280778bf" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc2c92e49e346b5b3bd7705a229afc6"
I20260709 14:54:27.362057 15035 raft_consensus.cc:2393] T 8974e5ab032b4fba92bfc577280778bf P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9cb8de0701f2482b99e51d5ac080aa13 in current term 1: Already voted for candidate dbc2c92e49e346b5b3bd7705a229afc6 in this term.
W20260709 14:54:27.367911 15224 leader_election.cc:343] T 8974e5ab032b4fba92bfc577280778bf P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:27.368948 15306 tablet_bootstrap.cc:492] T d326f264e68d41d69b5007023083ed9e P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap starting.
I20260709 14:54:27.369525 15227 leader_election.cc:304] T 8974e5ab032b4fba92bfc577280778bf P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cb8de0701f2482b99e51d5ac080aa13; no voters: 7519e608fbb44d9db8ad30b9f10ae605, dbc2c92e49e346b5b3bd7705a229afc6
I20260709 14:54:27.339458 15839 consensus_queue.cc:1048] T 5b9f8063585c4e5faddebd56fbe1aa01 P dbc2c92e49e346b5b3bd7705a229afc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.029s
I20260709 14:54:27.377413 15713 raft_consensus.cc:2749] T 8974e5ab032b4fba92bfc577280778bf P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 14:54:27.367955 15793 raft_consensus.cc:515] T 1193461bc272409e8a1e719ecdb38e7f P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:27.386656 15111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1193461bc272409e8a1e719ecdb38e7f" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605"
I20260709 14:54:27.387458 15111 raft_consensus.cc:3060] T 1193461bc272409e8a1e719ecdb38e7f P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:27.391973 15309 tablet_bootstrap.cc:492] T 8974e5ab032b4fba92bfc577280778bf P 7519e608fbb44d9db8ad30b9f10ae605: No bootstrap required, opened a new log
I20260709 14:54:27.392692 15309 ts_tablet_manager.cc:1403] T 8974e5ab032b4fba92bfc577280778bf P 7519e608fbb44d9db8ad30b9f10ae605: Time spent bootstrapping tablet: real 0.221s	user 0.015s	sys 0.004s
I20260709 14:54:27.393601 15848 raft_consensus.cc:515] T 4f709a060be148029cf72f1af6f79714 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:27.395803 15306 tablet_bootstrap.cc:654] T d326f264e68d41d69b5007023083ed9e P dbc2c92e49e346b5b3bd7705a229afc6: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:27.404394 15309 raft_consensus.cc:359] T 8974e5ab032b4fba92bfc577280778bf P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:27.405315 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f709a060be148029cf72f1af6f79714" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc2c92e49e346b5b3bd7705a229afc6"
I20260709 14:54:27.405838 15309 raft_consensus.cc:385] T 8974e5ab032b4fba92bfc577280778bf P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:27.406427 15309 raft_consensus.cc:740] T 8974e5ab032b4fba92bfc577280778bf P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7519e608fbb44d9db8ad30b9f10ae605, State: Initialized, Role: FOLLOWER
I20260709 14:54:27.409133 15307 tablet_bootstrap.cc:492] T 1193461bc272409e8a1e719ecdb38e7f P 9cb8de0701f2482b99e51d5ac080aa13: No bootstrap required, opened a new log
I20260709 14:54:27.405315 15107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f709a060be148029cf72f1af6f79714" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605"
I20260709 14:54:27.409760 15307 ts_tablet_manager.cc:1403] T 1193461bc272409e8a1e719ecdb38e7f P 9cb8de0701f2482b99e51d5ac080aa13: Time spent bootstrapping tablet: real 0.208s	user 0.016s	sys 0.009s
I20260709 14:54:27.408309 15309 consensus_queue.cc:260] T 8974e5ab032b4fba92bfc577280778bf P 7519e608fbb44d9db8ad30b9f10ae605 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
W20260709 14:54:27.410701 15224 leader_election.cc:343] T 4f709a060be148029cf72f1af6f79714 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:27.412551 15309 ts_tablet_manager.cc:1434] T 8974e5ab032b4fba92bfc577280778bf P 7519e608fbb44d9db8ad30b9f10ae605: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.002s
I20260709 14:54:27.412735 15111 raft_consensus.cc:2468] T 1193461bc272409e8a1e719ecdb38e7f P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa34beb1b274443b1c46839afd0a484 in term 1.
I20260709 14:54:27.406198 15035 raft_consensus.cc:3060] T 4f709a060be148029cf72f1af6f79714 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:27.414465 15309 tablet_bootstrap.cc:492] T a9dab1878c4b4550880f5680c6d48c67 P 7519e608fbb44d9db8ad30b9f10ae605: Bootstrap starting.
I20260709 14:54:27.414752 15150 leader_election.cc:304] T 1193461bc272409e8a1e719ecdb38e7f P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7519e608fbb44d9db8ad30b9f10ae605, eaa34beb1b274443b1c46839afd0a484; no voters: 
I20260709 14:54:27.415927 15786 raft_consensus.cc:2804] T 1193461bc272409e8a1e719ecdb38e7f P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:54:27.416429 15786 raft_consensus.cc:697] T 1193461bc272409e8a1e719ecdb38e7f P eaa34beb1b274443b1c46839afd0a484 [term 1 LEADER]: Becoming Leader. State: Replica: eaa34beb1b274443b1c46839afd0a484, State: Running, Role: LEADER
I20260709 14:54:27.417681 15786 consensus_queue.cc:237] T 1193461bc272409e8a1e719ecdb38e7f P eaa34beb1b274443b1c46839afd0a484 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:27.412994 15307 raft_consensus.cc:359] T 1193461bc272409e8a1e719ecdb38e7f P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:27.421685 15307 raft_consensus.cc:385] T 1193461bc272409e8a1e719ecdb38e7f P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:27.404471 15848 leader_election.cc:290] T 4f709a060be148029cf72f1af6f79714 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 election: Requested vote from peers dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477), 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177)
I20260709 14:54:27.423745 15793 leader_election.cc:290] T 1193461bc272409e8a1e719ecdb38e7f P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 election: Requested vote from peers 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177), 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493)
I20260709 14:54:27.422178 15307 raft_consensus.cc:740] T 1193461bc272409e8a1e719ecdb38e7f P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9cb8de0701f2482b99e51d5ac080aa13, State: Initialized, Role: FOLLOWER
I20260709 14:54:27.427479 15256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1193461bc272409e8a1e719ecdb38e7f" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13"
I20260709 14:54:27.432309 15307 consensus_queue.cc:260] T 1193461bc272409e8a1e719ecdb38e7f P 9cb8de0701f2482b99e51d5ac080aa13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:27.433084 15309 tablet_bootstrap.cc:654] T a9dab1878c4b4550880f5680c6d48c67 P 7519e608fbb44d9db8ad30b9f10ae605: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:27.436247 15256 raft_consensus.cc:3060] T 1193461bc272409e8a1e719ecdb38e7f P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:27.448508 15035 raft_consensus.cc:2468] T 4f709a060be148029cf72f1af6f79714 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cb8de0701f2482b99e51d5ac080aa13 in term 1.
I20260709 14:54:27.450335 15227 leader_election.cc:304] T 4f709a060be148029cf72f1af6f79714 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9cb8de0701f2482b99e51d5ac080aa13, dbc2c92e49e346b5b3bd7705a229afc6; no voters: 7519e608fbb44d9db8ad30b9f10ae605
I20260709 14:54:27.451323 15307 ts_tablet_manager.cc:1434] T 1193461bc272409e8a1e719ecdb38e7f P 9cb8de0701f2482b99e51d5ac080aa13: Time spent starting tablet: real 0.041s	user 0.009s	sys 0.000s
I20260709 14:54:27.451609 15848 raft_consensus.cc:2804] T 4f709a060be148029cf72f1af6f79714 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:54:27.452594 15307 tablet_bootstrap.cc:492] T 5b9f8063585c4e5faddebd56fbe1aa01 P 9cb8de0701f2482b99e51d5ac080aa13: Bootstrap starting.
I20260709 14:54:27.452006 15256 raft_consensus.cc:2468] T 1193461bc272409e8a1e719ecdb38e7f P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa34beb1b274443b1c46839afd0a484 in term 1.
I20260709 14:54:27.452123 15848 raft_consensus.cc:697] T 4f709a060be148029cf72f1af6f79714 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 LEADER]: Becoming Leader. State: Replica: 9cb8de0701f2482b99e51d5ac080aa13, State: Running, Role: LEADER
I20260709 14:54:27.456000 15848 consensus_queue.cc:237] T 4f709a060be148029cf72f1af6f79714 P 9cb8de0701f2482b99e51d5ac080aa13 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:27.460270 15307 tablet_bootstrap.cc:654] T 5b9f8063585c4e5faddebd56fbe1aa01 P 9cb8de0701f2482b99e51d5ac080aa13: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:27.477790 15309 tablet_bootstrap.cc:492] T a9dab1878c4b4550880f5680c6d48c67 P 7519e608fbb44d9db8ad30b9f10ae605: No bootstrap required, opened a new log
I20260709 14:54:27.478632 15309 ts_tablet_manager.cc:1403] T a9dab1878c4b4550880f5680c6d48c67 P 7519e608fbb44d9db8ad30b9f10ae605: Time spent bootstrapping tablet: real 0.065s	user 0.014s	sys 0.006s
I20260709 14:54:27.487362 15309 raft_consensus.cc:359] T a9dab1878c4b4550880f5680c6d48c67 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:27.504560 15309 raft_consensus.cc:385] T a9dab1878c4b4550880f5680c6d48c67 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:27.506597 15306 tablet_bootstrap.cc:492] T d326f264e68d41d69b5007023083ed9e P dbc2c92e49e346b5b3bd7705a229afc6: No bootstrap required, opened a new log
I20260709 14:54:27.505056 15309 raft_consensus.cc:740] T a9dab1878c4b4550880f5680c6d48c67 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7519e608fbb44d9db8ad30b9f10ae605, State: Initialized, Role: FOLLOWER
I20260709 14:54:27.507320 15306 ts_tablet_manager.cc:1403] T d326f264e68d41d69b5007023083ed9e P dbc2c92e49e346b5b3bd7705a229afc6: Time spent bootstrapping tablet: real 0.139s	user 0.008s	sys 0.010s
I20260709 14:54:27.509773 15307 tablet_bootstrap.cc:492] T 5b9f8063585c4e5faddebd56fbe1aa01 P 9cb8de0701f2482b99e51d5ac080aa13: No bootstrap required, opened a new log
I20260709 14:54:27.510376 15307 ts_tablet_manager.cc:1403] T 5b9f8063585c4e5faddebd56fbe1aa01 P 9cb8de0701f2482b99e51d5ac080aa13: Time spent bootstrapping tablet: real 0.058s	user 0.020s	sys 0.023s
I20260709 14:54:27.511230 15306 raft_consensus.cc:359] T d326f264e68d41d69b5007023083ed9e P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:27.515015 15306 raft_consensus.cc:385] T d326f264e68d41d69b5007023083ed9e P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:27.515364 15306 raft_consensus.cc:740] T d326f264e68d41d69b5007023083ed9e P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbc2c92e49e346b5b3bd7705a229afc6, State: Initialized, Role: FOLLOWER
I20260709 14:54:27.512559 14932 catalog_manager.cc:5697] T b97c761f72c14075b65e501c4b3ae0fb P 9cb8de0701f2482b99e51d5ac080aa13 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68). New cstate: current_term: 1 leader_uuid: "9cb8de0701f2482b99e51d5ac080aa13" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } health_report { overall_health: HEALTHY } } }
I20260709 14:54:27.516047 15306 consensus_queue.cc:260] T d326f264e68d41d69b5007023083ed9e P dbc2c92e49e346b5b3bd7705a229afc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:27.518718 15306 ts_tablet_manager.cc:1434] T d326f264e68d41d69b5007023083ed9e P dbc2c92e49e346b5b3bd7705a229afc6: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.004s
I20260709 14:54:27.514736 15309 consensus_queue.cc:260] T a9dab1878c4b4550880f5680c6d48c67 P 7519e608fbb44d9db8ad30b9f10ae605 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:27.519938 15306 tablet_bootstrap.cc:492] T d2273a1ad13e4c54ae2101a15a7e56e1 P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap starting.
I20260709 14:54:27.521741 15309 ts_tablet_manager.cc:1434] T a9dab1878c4b4550880f5680c6d48c67 P 7519e608fbb44d9db8ad30b9f10ae605: Time spent starting tablet: real 0.043s	user 0.009s	sys 0.001s
I20260709 14:54:27.523242 15309 tablet_bootstrap.cc:492] T 4f709a060be148029cf72f1af6f79714 P 7519e608fbb44d9db8ad30b9f10ae605: Bootstrap starting.
I20260709 14:54:27.524171 15307 raft_consensus.cc:359] T 5b9f8063585c4e5faddebd56fbe1aa01 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:27.527843 15307 raft_consensus.cc:385] T 5b9f8063585c4e5faddebd56fbe1aa01 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:27.528214 15307 raft_consensus.cc:740] T 5b9f8063585c4e5faddebd56fbe1aa01 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9cb8de0701f2482b99e51d5ac080aa13, State: Initialized, Role: FOLLOWER
I20260709 14:54:27.531991 15307 consensus_queue.cc:260] T 5b9f8063585c4e5faddebd56fbe1aa01 P 9cb8de0701f2482b99e51d5ac080aa13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:27.533768 15307 ts_tablet_manager.cc:1434] T 5b9f8063585c4e5faddebd56fbe1aa01 P 9cb8de0701f2482b99e51d5ac080aa13: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.001s
I20260709 14:54:27.534861 15307 tablet_bootstrap.cc:492] T d2463fd792b240e9911c6b38bcb453b8 P 9cb8de0701f2482b99e51d5ac080aa13: Bootstrap starting.
I20260709 14:54:27.537765 15306 tablet_bootstrap.cc:654] T d2273a1ad13e4c54ae2101a15a7e56e1 P dbc2c92e49e346b5b3bd7705a229afc6: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:27.539110 15309 tablet_bootstrap.cc:654] T 4f709a060be148029cf72f1af6f79714 P 7519e608fbb44d9db8ad30b9f10ae605: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:27.542164 15432 raft_consensus.cc:493] T a9dab1878c4b4550880f5680c6d48c67 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:27.544185 15432 raft_consensus.cc:515] T a9dab1878c4b4550880f5680c6d48c67 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:27.546856 15432 leader_election.cc:290] T a9dab1878c4b4550880f5680c6d48c67 P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477), eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805)
I20260709 14:54:27.549444 15307 tablet_bootstrap.cc:654] T d2463fd792b240e9911c6b38bcb453b8 P 9cb8de0701f2482b99e51d5ac080aa13: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:27.563668 15857 raft_consensus.cc:493] T d2463fd792b240e9911c6b38bcb453b8 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:27.564391 15857 raft_consensus.cc:515] T d2463fd792b240e9911c6b38bcb453b8 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:27.565843 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dab1878c4b4550880f5680c6d48c67" candidate_uuid: "7519e608fbb44d9db8ad30b9f10ae605" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" is_pre_election: true
I20260709 14:54:27.567745 15180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dab1878c4b4550880f5680c6d48c67" candidate_uuid: "7519e608fbb44d9db8ad30b9f10ae605" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484" is_pre_election: true
I20260709 14:54:27.571039 15079 leader_election.cc:304] T a9dab1878c4b4550880f5680c6d48c67 P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7519e608fbb44d9db8ad30b9f10ae605; no voters: dbc2c92e49e346b5b3bd7705a229afc6, eaa34beb1b274443b1c46839afd0a484
I20260709 14:54:27.575229 15432 raft_consensus.cc:2749] T a9dab1878c4b4550880f5680c6d48c67 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:54:27.597507 15857 leader_election.cc:290] T d2463fd792b240e9911c6b38bcb453b8 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805), 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493)
I20260709 14:54:27.608543 15260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2463fd792b240e9911c6b38bcb453b8" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13" is_pre_election: true
I20260709 14:54:27.601543 15256 raft_consensus.cc:3060] T 5b9f8063585c4e5faddebd56fbe1aa01 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:27.603760 14934 catalog_manager.cc:5697] T 5b9f8063585c4e5faddebd56fbe1aa01 P dbc2c92e49e346b5b3bd7705a229afc6 reported cstate change: term changed from 0 to 1, leader changed from <none> to dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65). New cstate: current_term: 1 leader_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } health_report { overall_health: HEALTHY } } }
W20260709 14:54:27.624918 15001 leader_election.cc:343] T d2463fd792b240e9911c6b38bcb453b8 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:27.627934 15111 raft_consensus.cc:3060] T a9dab1878c4b4550880f5680c6d48c67 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:27.631269 15306 tablet_bootstrap.cc:492] T d2273a1ad13e4c54ae2101a15a7e56e1 P dbc2c92e49e346b5b3bd7705a229afc6: No bootstrap required, opened a new log
I20260709 14:54:27.631927 15306 ts_tablet_manager.cc:1403] T d2273a1ad13e4c54ae2101a15a7e56e1 P dbc2c92e49e346b5b3bd7705a229afc6: Time spent bootstrapping tablet: real 0.112s	user 0.020s	sys 0.010s
I20260709 14:54:27.641722 15186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2463fd792b240e9911c6b38bcb453b8" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484" is_pre_election: true
I20260709 14:54:27.642848 15186 raft_consensus.cc:2468] T d2463fd792b240e9911c6b38bcb453b8 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbc2c92e49e346b5b3bd7705a229afc6 in term 0.
I20260709 14:54:27.646910 15309 tablet_bootstrap.cc:492] T 4f709a060be148029cf72f1af6f79714 P 7519e608fbb44d9db8ad30b9f10ae605: No bootstrap required, opened a new log
I20260709 14:54:27.684615 15858 raft_consensus.cc:493] T 46a35b81512c4e8c8ec6b83d4c768e1f P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:27.646678 15817 raft_consensus.cc:493] T 8974e5ab032b4fba92bfc577280778bf P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:27.693488 15309 ts_tablet_manager.cc:1403] T 4f709a060be148029cf72f1af6f79714 P 7519e608fbb44d9db8ad30b9f10ae605: Time spent bootstrapping tablet: real 0.171s	user 0.031s	sys 0.021s
I20260709 14:54:27.708580 15004 leader_election.cc:304] T d2463fd792b240e9911c6b38bcb453b8 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dbc2c92e49e346b5b3bd7705a229afc6, eaa34beb1b274443b1c46839afd0a484; no voters: 9cb8de0701f2482b99e51d5ac080aa13
I20260709 14:54:27.718780 15306 raft_consensus.cc:359] T d2273a1ad13e4c54ae2101a15a7e56e1 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:27.719892 15306 raft_consensus.cc:385] T d2273a1ad13e4c54ae2101a15a7e56e1 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:27.720288 15306 raft_consensus.cc:740] T d2273a1ad13e4c54ae2101a15a7e56e1 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbc2c92e49e346b5b3bd7705a229afc6, State: Initialized, Role: FOLLOWER
I20260709 14:54:27.721271 15306 consensus_queue.cc:260] T d2273a1ad13e4c54ae2101a15a7e56e1 P dbc2c92e49e346b5b3bd7705a229afc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:27.737010 15306 ts_tablet_manager.cc:1434] T d2273a1ad13e4c54ae2101a15a7e56e1 P dbc2c92e49e346b5b3bd7705a229afc6: Time spent starting tablet: real 0.105s	user 0.009s	sys 0.001s
I20260709 14:54:27.735505 15857 raft_consensus.cc:493] T d326f264e68d41d69b5007023083ed9e P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:27.739312 15857 raft_consensus.cc:515] T d326f264e68d41d69b5007023083ed9e P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:27.709493 15817 raft_consensus.cc:515] T 8974e5ab032b4fba92bfc577280778bf P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:27.747298 15307 tablet_bootstrap.cc:492] T d2463fd792b240e9911c6b38bcb453b8 P 9cb8de0701f2482b99e51d5ac080aa13: No bootstrap required, opened a new log
I20260709 14:54:27.748051 15307 ts_tablet_manager.cc:1403] T d2463fd792b240e9911c6b38bcb453b8 P 9cb8de0701f2482b99e51d5ac080aa13: Time spent bootstrapping tablet: real 0.213s	user 0.007s	sys 0.018s
I20260709 14:54:27.707681 15858 raft_consensus.cc:515] T 46a35b81512c4e8c8ec6b83d4c768e1f P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:27.749482 14936 catalog_manager.cc:5697] T 1193461bc272409e8a1e719ecdb38e7f P eaa34beb1b274443b1c46839afd0a484 reported cstate change: term changed from 0 to 1, leader changed from <none> to eaa34beb1b274443b1c46839afd0a484 (127.6.101.67). New cstate: current_term: 1 leader_uuid: "eaa34beb1b274443b1c46839afd0a484" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } health_report { overall_health: UNKNOWN } } }
I20260709 14:54:27.728761 15853 raft_consensus.cc:2804] T d2463fd792b240e9911c6b38bcb453b8 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:54:27.751965 15853 raft_consensus.cc:493] T d2463fd792b240e9911c6b38bcb453b8 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:54:27.752332 15853 raft_consensus.cc:3060] T d2463fd792b240e9911c6b38bcb453b8 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:27.754760 15033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8974e5ab032b4fba92bfc577280778bf" candidate_uuid: "7519e608fbb44d9db8ad30b9f10ae605" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" is_pre_election: true
I20260709 14:54:27.756359 15033 raft_consensus.cc:2393] T 8974e5ab032b4fba92bfc577280778bf P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7519e608fbb44d9db8ad30b9f10ae605 in current term 1: Already voted for candidate dbc2c92e49e346b5b3bd7705a229afc6 in this term.
I20260709 14:54:27.755494 15817 leader_election.cc:290] T 8974e5ab032b4fba92bfc577280778bf P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493), dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477)
I20260709 14:54:27.762950 15110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d326f264e68d41d69b5007023083ed9e" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605" is_pre_election: true
I20260709 14:54:27.767203 15857 leader_election.cc:290] T d326f264e68d41d69b5007023083ed9e P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177), eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805)
W20260709 14:54:27.771503 15001 leader_election.cc:343] T d326f264e68d41d69b5007023083ed9e P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:27.776188 15309 raft_consensus.cc:359] T 4f709a060be148029cf72f1af6f79714 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:27.777212 15309 raft_consensus.cc:385] T 4f709a060be148029cf72f1af6f79714 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:27.777572 15309 raft_consensus.cc:740] T 4f709a060be148029cf72f1af6f79714 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7519e608fbb44d9db8ad30b9f10ae605, State: Initialized, Role: FOLLOWER
I20260709 14:54:27.778533 15186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d326f264e68d41d69b5007023083ed9e" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484" is_pre_election: true
I20260709 14:54:27.779381 15186 raft_consensus.cc:2468] T d326f264e68d41d69b5007023083ed9e P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbc2c92e49e346b5b3bd7705a229afc6 in term 0.
I20260709 14:54:27.785059 15306 tablet_bootstrap.cc:492] T 46a35b81512c4e8c8ec6b83d4c768e1f P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap starting.
I20260709 14:54:27.785305 15004 leader_election.cc:304] T d326f264e68d41d69b5007023083ed9e P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dbc2c92e49e346b5b3bd7705a229afc6, eaa34beb1b274443b1c46839afd0a484; no voters: 7519e608fbb44d9db8ad30b9f10ae605
I20260709 14:54:27.786194 15857 raft_consensus.cc:2804] T d326f264e68d41d69b5007023083ed9e P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:54:27.786711 15857 raft_consensus.cc:493] T d326f264e68d41d69b5007023083ed9e P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:54:27.787057 15857 raft_consensus.cc:3060] T d326f264e68d41d69b5007023083ed9e P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:27.787635 15307 raft_consensus.cc:359] T d2463fd792b240e9911c6b38bcb453b8 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:27.788798 15307 raft_consensus.cc:385] T d2463fd792b240e9911c6b38bcb453b8 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:27.791337 15307 raft_consensus.cc:740] T d2463fd792b240e9911c6b38bcb453b8 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9cb8de0701f2482b99e51d5ac080aa13, State: Initialized, Role: FOLLOWER
I20260709 14:54:27.792532 15307 consensus_queue.cc:260] T d2463fd792b240e9911c6b38bcb453b8 P 9cb8de0701f2482b99e51d5ac080aa13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:27.809480 15309 consensus_queue.cc:260] T 4f709a060be148029cf72f1af6f79714 P 7519e608fbb44d9db8ad30b9f10ae605 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
W20260709 14:54:27.819446 15877 log.cc:927] Time spent T 4f709a060be148029cf72f1af6f79714 P 9cb8de0701f2482b99e51d5ac080aa13: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 14:54:27.821660 15257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a35b81512c4e8c8ec6b83d4c768e1f" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13" is_pre_election: true
I20260709 14:54:27.822324 15307 ts_tablet_manager.cc:1434] T d2463fd792b240e9911c6b38bcb453b8 P 9cb8de0701f2482b99e51d5ac080aa13: Time spent starting tablet: real 0.074s	user 0.010s	sys 0.000s
I20260709 14:54:27.825232 15858 leader_election.cc:290] T 46a35b81512c4e8c8ec6b83d4c768e1f P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493), dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477)
I20260709 14:54:27.826458 15307 tablet_bootstrap.cc:492] T d2273a1ad13e4c54ae2101a15a7e56e1 P 9cb8de0701f2482b99e51d5ac080aa13: Bootstrap starting.
W20260709 14:54:27.833765 15150 leader_election.cc:343] T 46a35b81512c4e8c8ec6b83d4c768e1f P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:27.834987 15786 consensus_queue.cc:1048] T 1193461bc272409e8a1e719ecdb38e7f P eaa34beb1b274443b1c46839afd0a484 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:54:27.835618 15857 raft_consensus.cc:515] T d326f264e68d41d69b5007023083ed9e P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:27.845767 15105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d326f264e68d41d69b5007023083ed9e" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605"
I20260709 14:54:27.846076 15306 tablet_bootstrap.cc:654] T 46a35b81512c4e8c8ec6b83d4c768e1f P dbc2c92e49e346b5b3bd7705a229afc6: Neither blocks nor log segments found. Creating new log.
W20260709 14:54:27.847559 15001 leader_election.cc:343] T d326f264e68d41d69b5007023083ed9e P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:27.855417 15853 raft_consensus.cc:515] T d2463fd792b240e9911c6b38bcb453b8 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:27.859995 15186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d326f264e68d41d69b5007023083ed9e" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484"
I20260709 14:54:27.860894 15186 raft_consensus.cc:3060] T d326f264e68d41d69b5007023083ed9e P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:27.855834 15034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a35b81512c4e8c8ec6b83d4c768e1f" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" is_pre_election: true
I20260709 14:54:27.870263 15309 ts_tablet_manager.cc:1434] T 4f709a060be148029cf72f1af6f79714 P 7519e608fbb44d9db8ad30b9f10ae605: Time spent starting tablet: real 0.164s	user 0.005s	sys 0.004s
I20260709 14:54:27.872013 15309 tablet_bootstrap.cc:492] T ff73c3d51e5e480c920d1aca00b9b40d P 7519e608fbb44d9db8ad30b9f10ae605: Bootstrap starting.
W20260709 14:54:27.872941 15153 leader_election.cc:343] T 46a35b81512c4e8c8ec6b83d4c768e1f P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:27.873593 15153 leader_election.cc:304] T 46a35b81512c4e8c8ec6b83d4c768e1f P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa34beb1b274443b1c46839afd0a484; no voters: 9cb8de0701f2482b99e51d5ac080aa13, dbc2c92e49e346b5b3bd7705a229afc6
I20260709 14:54:27.874975 15793 raft_consensus.cc:2749] T 46a35b81512c4e8c8ec6b83d4c768e1f P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:54:27.913630 15186 raft_consensus.cc:2468] T d326f264e68d41d69b5007023083ed9e P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbc2c92e49e346b5b3bd7705a229afc6 in term 1.
I20260709 14:54:27.880831 15857 leader_election.cc:290] T d326f264e68d41d69b5007023083ed9e P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 election: Requested vote from peers 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177), eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805)
I20260709 14:54:27.919720 15261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8974e5ab032b4fba92bfc577280778bf" candidate_uuid: "7519e608fbb44d9db8ad30b9f10ae605" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13" is_pre_election: true
I20260709 14:54:27.919917 15004 leader_election.cc:304] T d326f264e68d41d69b5007023083ed9e P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dbc2c92e49e346b5b3bd7705a229afc6, eaa34beb1b274443b1c46839afd0a484; no voters: 7519e608fbb44d9db8ad30b9f10ae605
I20260709 14:54:27.920852 15261 raft_consensus.cc:2393] T 8974e5ab032b4fba92bfc577280778bf P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7519e608fbb44d9db8ad30b9f10ae605 in current term 1: Already voted for candidate 9cb8de0701f2482b99e51d5ac080aa13 in this term.
I20260709 14:54:27.922931 15856 raft_consensus.cc:2804] T d326f264e68d41d69b5007023083ed9e P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:54:27.923740 15856 raft_consensus.cc:697] T d326f264e68d41d69b5007023083ed9e P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 LEADER]: Becoming Leader. State: Replica: dbc2c92e49e346b5b3bd7705a229afc6, State: Running, Role: LEADER
I20260709 14:54:27.948876 15076 leader_election.cc:304] T 8974e5ab032b4fba92bfc577280778bf P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7519e608fbb44d9db8ad30b9f10ae605; no voters: 9cb8de0701f2482b99e51d5ac080aa13, dbc2c92e49e346b5b3bd7705a229afc6
I20260709 14:54:27.951896 15843 raft_consensus.cc:3060] T 8974e5ab032b4fba92bfc577280778bf P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:27.954509 15307 tablet_bootstrap.cc:654] T d2273a1ad13e4c54ae2101a15a7e56e1 P 9cb8de0701f2482b99e51d5ac080aa13: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:27.959389 15856 consensus_queue.cc:237] T d326f264e68d41d69b5007023083ed9e P dbc2c92e49e346b5b3bd7705a229afc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:27.960333 15883 raft_consensus.cc:493] T 4f709a060be148029cf72f1af6f79714 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:27.961082 15883 raft_consensus.cc:515] T 4f709a060be148029cf72f1af6f79714 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:27.964313 15883 leader_election.cc:290] T 4f709a060be148029cf72f1af6f79714 P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493), dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477)
I20260709 14:54:27.966694 15257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f709a060be148029cf72f1af6f79714" candidate_uuid: "7519e608fbb44d9db8ad30b9f10ae605" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13" is_pre_election: true
I20260709 14:54:27.969384 15034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f709a060be148029cf72f1af6f79714" candidate_uuid: "7519e608fbb44d9db8ad30b9f10ae605" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" is_pre_election: true
I20260709 14:54:27.970599 15034 raft_consensus.cc:2393] T 4f709a060be148029cf72f1af6f79714 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7519e608fbb44d9db8ad30b9f10ae605 in current term 1: Already voted for candidate 9cb8de0701f2482b99e51d5ac080aa13 in this term.
I20260709 14:54:27.973821 14936 catalog_manager.cc:5697] T 4f709a060be148029cf72f1af6f79714 P 9cb8de0701f2482b99e51d5ac080aa13 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68). New cstate: current_term: 1 leader_uuid: "9cb8de0701f2482b99e51d5ac080aa13" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } health_report { overall_health: UNKNOWN } } }
I20260709 14:54:27.982390 15306 tablet_bootstrap.cc:492] T 46a35b81512c4e8c8ec6b83d4c768e1f P dbc2c92e49e346b5b3bd7705a229afc6: No bootstrap required, opened a new log
I20260709 14:54:27.983029 15306 ts_tablet_manager.cc:1403] T 46a35b81512c4e8c8ec6b83d4c768e1f P dbc2c92e49e346b5b3bd7705a229afc6: Time spent bootstrapping tablet: real 0.198s	user 0.028s	sys 0.017s
I20260709 14:54:27.987782 15257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2463fd792b240e9911c6b38bcb453b8" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13"
I20260709 14:54:27.988548 15257 raft_consensus.cc:3060] T d2463fd792b240e9911c6b38bcb453b8 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:27.967242 15853 leader_election.cc:290] T d2463fd792b240e9911c6b38bcb453b8 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 election: Requested vote from peers eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805), 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493)
I20260709 14:54:27.989938 15079 leader_election.cc:304] T 4f709a060be148029cf72f1af6f79714 P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7519e608fbb44d9db8ad30b9f10ae605; no voters: 9cb8de0701f2482b99e51d5ac080aa13, dbc2c92e49e346b5b3bd7705a229afc6
I20260709 14:54:28.000969 15817 raft_consensus.cc:3060] T 4f709a060be148029cf72f1af6f79714 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:28.006664 15306 raft_consensus.cc:359] T 46a35b81512c4e8c8ec6b83d4c768e1f P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:28.018326 15306 raft_consensus.cc:385] T 46a35b81512c4e8c8ec6b83d4c768e1f P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:28.018787 15306 raft_consensus.cc:740] T 46a35b81512c4e8c8ec6b83d4c768e1f P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbc2c92e49e346b5b3bd7705a229afc6, State: Initialized, Role: FOLLOWER
I20260709 14:54:28.022547 15306 consensus_queue.cc:260] T 46a35b81512c4e8c8ec6b83d4c768e1f P dbc2c92e49e346b5b3bd7705a229afc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:28.018810 15786 consensus_queue.cc:1048] T 1193461bc272409e8a1e719ecdb38e7f P eaa34beb1b274443b1c46839afd0a484 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 14:54:28.024026 15186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2463fd792b240e9911c6b38bcb453b8" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484"
I20260709 14:54:28.057021 15186 raft_consensus.cc:3060] T d2463fd792b240e9911c6b38bcb453b8 P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:28.065680 15306 ts_tablet_manager.cc:1434] T 46a35b81512c4e8c8ec6b83d4c768e1f P dbc2c92e49e346b5b3bd7705a229afc6: Time spent starting tablet: real 0.082s	user 0.010s	sys 0.000s
I20260709 14:54:28.071990 15843 raft_consensus.cc:2749] T 8974e5ab032b4fba92bfc577280778bf P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:54:28.089576 15840 raft_consensus.cc:493] T d2273a1ad13e4c54ae2101a15a7e56e1 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:28.090193 15840 raft_consensus.cc:515] T d2273a1ad13e4c54ae2101a15a7e56e1 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
W20260709 14:54:28.090263 15150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:43177, user_credentials={real_user=slave}} blocked reactor thread for 54381.5us
I20260709 14:54:28.108886 15111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2273a1ad13e4c54ae2101a15a7e56e1" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605" is_pre_election: true
I20260709 14:54:28.082134 15647 consensus_queue.cc:1048] T 4f709a060be148029cf72f1af6f79714 P 9cb8de0701f2482b99e51d5ac080aa13 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20260709 14:54:28.113687 15261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2273a1ad13e4c54ae2101a15a7e56e1" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13" is_pre_election: true
I20260709 14:54:28.115875 15257 raft_consensus.cc:2468] T d2463fd792b240e9911c6b38bcb453b8 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbc2c92e49e346b5b3bd7705a229afc6 in term 1.
I20260709 14:54:28.093150 15840 leader_election.cc:290] T d2273a1ad13e4c54ae2101a15a7e56e1 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493), 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177)
W20260709 14:54:28.125289 15001 leader_election.cc:343] T d2273a1ad13e4c54ae2101a15a7e56e1 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:28.135577 15307 tablet_bootstrap.cc:492] T d2273a1ad13e4c54ae2101a15a7e56e1 P 9cb8de0701f2482b99e51d5ac080aa13: No bootstrap required, opened a new log
I20260709 14:54:28.136562 15307 ts_tablet_manager.cc:1403] T d2273a1ad13e4c54ae2101a15a7e56e1 P 9cb8de0701f2482b99e51d5ac080aa13: Time spent bootstrapping tablet: real 0.310s	user 0.016s	sys 0.008s
W20260709 14:54:28.153739 15001 leader_election.cc:343] T d2273a1ad13e4c54ae2101a15a7e56e1 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:28.154575 15001 leader_election.cc:304] T d2273a1ad13e4c54ae2101a15a7e56e1 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbc2c92e49e346b5b3bd7705a229afc6; no voters: 7519e608fbb44d9db8ad30b9f10ae605, 9cb8de0701f2482b99e51d5ac080aa13
I20260709 14:54:28.160020 15001 leader_election.cc:304] T d2463fd792b240e9911c6b38bcb453b8 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cb8de0701f2482b99e51d5ac080aa13, dbc2c92e49e346b5b3bd7705a229afc6; no voters: 
I20260709 14:54:28.166211 15724 raft_consensus.cc:2749] T d2273a1ad13e4c54ae2101a15a7e56e1 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:54:28.175026 15186 raft_consensus.cc:2468] T d2463fd792b240e9911c6b38bcb453b8 P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbc2c92e49e346b5b3bd7705a229afc6 in term 1.
I20260709 14:54:28.176872 15856 raft_consensus.cc:2804] T d2463fd792b240e9911c6b38bcb453b8 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:54:28.177680 15856 raft_consensus.cc:697] T d2463fd792b240e9911c6b38bcb453b8 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 LEADER]: Becoming Leader. State: Replica: dbc2c92e49e346b5b3bd7705a229afc6, State: Running, Role: LEADER
I20260709 14:54:28.178771 15856 consensus_queue.cc:237] T d2463fd792b240e9911c6b38bcb453b8 P dbc2c92e49e346b5b3bd7705a229afc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:28.190387 15817 raft_consensus.cc:2749] T 4f709a060be148029cf72f1af6f79714 P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:54:28.167292 14934 catalog_manager.cc:5697] T d326f264e68d41d69b5007023083ed9e P dbc2c92e49e346b5b3bd7705a229afc6 reported cstate change: term changed from 0 to 1, leader changed from <none> to dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65). New cstate: current_term: 1 leader_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } health_report { overall_health: UNKNOWN } } }
I20260709 14:54:28.201573 15309 tablet_bootstrap.cc:654] T ff73c3d51e5e480c920d1aca00b9b40d P 7519e608fbb44d9db8ad30b9f10ae605: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:28.203401 15806 consensus_queue.cc:1048] T 4f709a060be148029cf72f1af6f79714 P 9cb8de0701f2482b99e51d5ac080aa13 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 14:54:28.192505 15307 raft_consensus.cc:359] T d2273a1ad13e4c54ae2101a15a7e56e1 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:28.208042 15307 raft_consensus.cc:385] T d2273a1ad13e4c54ae2101a15a7e56e1 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:28.208410 15307 raft_consensus.cc:740] T d2273a1ad13e4c54ae2101a15a7e56e1 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9cb8de0701f2482b99e51d5ac080aa13, State: Initialized, Role: FOLLOWER
I20260709 14:54:28.209234 15307 consensus_queue.cc:260] T d2273a1ad13e4c54ae2101a15a7e56e1 P 9cb8de0701f2482b99e51d5ac080aa13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:28.250385 15307 ts_tablet_manager.cc:1434] T d2273a1ad13e4c54ae2101a15a7e56e1 P 9cb8de0701f2482b99e51d5ac080aa13: Time spent starting tablet: real 0.113s	user 0.008s	sys 0.001s
I20260709 14:54:28.252355 15307 tablet_bootstrap.cc:492] T 46a35b81512c4e8c8ec6b83d4c768e1f P 9cb8de0701f2482b99e51d5ac080aa13: Bootstrap starting.
I20260709 14:54:28.272502 14934 catalog_manager.cc:5697] T d2463fd792b240e9911c6b38bcb453b8 P dbc2c92e49e346b5b3bd7705a229afc6 reported cstate change: term changed from 0 to 1, leader changed from <none> to dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65). New cstate: current_term: 1 leader_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } health_report { overall_health: HEALTHY } } }
I20260709 14:54:28.310833 15309 tablet_bootstrap.cc:492] T ff73c3d51e5e480c920d1aca00b9b40d P 7519e608fbb44d9db8ad30b9f10ae605: No bootstrap required, opened a new log
I20260709 14:54:28.320582 15309 ts_tablet_manager.cc:1403] T ff73c3d51e5e480c920d1aca00b9b40d P 7519e608fbb44d9db8ad30b9f10ae605: Time spent bootstrapping tablet: real 0.449s	user 0.003s	sys 0.014s
I20260709 14:54:28.302887 15754 raft_consensus.cc:493] T ff73c3d51e5e480c920d1aca00b9b40d P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:28.322606 15754 raft_consensus.cc:515] T ff73c3d51e5e480c920d1aca00b9b40d P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:28.325289 15309 raft_consensus.cc:359] T ff73c3d51e5e480c920d1aca00b9b40d P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:28.326097 15309 raft_consensus.cc:385] T ff73c3d51e5e480c920d1aca00b9b40d P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:28.326398 15309 raft_consensus.cc:740] T ff73c3d51e5e480c920d1aca00b9b40d P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7519e608fbb44d9db8ad30b9f10ae605, State: Initialized, Role: FOLLOWER
I20260709 14:54:28.337119 15754 leader_election.cc:290] T ff73c3d51e5e480c920d1aca00b9b40d P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177), eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805)
I20260709 14:54:28.344347 15309 consensus_queue.cc:260] T ff73c3d51e5e480c920d1aca00b9b40d P 7519e608fbb44d9db8ad30b9f10ae605 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:28.349958 15307 tablet_bootstrap.cc:654] T 46a35b81512c4e8c8ec6b83d4c768e1f P 9cb8de0701f2482b99e51d5ac080aa13: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:28.355573 15180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff73c3d51e5e480c920d1aca00b9b40d" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484" is_pre_election: true
I20260709 14:54:28.356266 15113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff73c3d51e5e480c920d1aca00b9b40d" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605" is_pre_election: true
I20260709 14:54:28.356532 15180 raft_consensus.cc:2468] T ff73c3d51e5e480c920d1aca00b9b40d P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cb8de0701f2482b99e51d5ac080aa13 in term 1.
I20260709 14:54:28.356927 15113 raft_consensus.cc:2468] T ff73c3d51e5e480c920d1aca00b9b40d P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cb8de0701f2482b99e51d5ac080aa13 in term 0.
I20260709 14:54:28.361140 15224 leader_election.cc:304] T ff73c3d51e5e480c920d1aca00b9b40d P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7519e608fbb44d9db8ad30b9f10ae605, 9cb8de0701f2482b99e51d5ac080aa13; no voters: 
I20260709 14:54:28.362365 15848 raft_consensus.cc:2804] T ff73c3d51e5e480c920d1aca00b9b40d P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 14:54:28.362819 15848 raft_consensus.cc:493] T ff73c3d51e5e480c920d1aca00b9b40d P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:54:28.363190 15848 raft_consensus.cc:3060] T ff73c3d51e5e480c920d1aca00b9b40d P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:54:28.377600 15856 consensus_queue.cc:1048] T d326f264e68d41d69b5007023083ed9e P dbc2c92e49e346b5b3bd7705a229afc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:54:28.391254 15856 raft_consensus.cc:493] T 46a35b81512c4e8c8ec6b83d4c768e1f P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:28.392213 15856 raft_consensus.cc:515] T 46a35b81512c4e8c8ec6b83d4c768e1f P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:28.401911 15856 leader_election.cc:290] T 46a35b81512c4e8c8ec6b83d4c768e1f P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805), 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493)
I20260709 14:54:28.348834 15309 ts_tablet_manager.cc:1434] T ff73c3d51e5e480c920d1aca00b9b40d P 7519e608fbb44d9db8ad30b9f10ae605: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.000s
I20260709 14:54:28.426167 15309 tablet_bootstrap.cc:492] T d326f264e68d41d69b5007023083ed9e P 7519e608fbb44d9db8ad30b9f10ae605: Bootstrap starting.
I20260709 14:54:28.434342 15181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a35b81512c4e8c8ec6b83d4c768e1f" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484" is_pre_election: true
I20260709 14:54:28.435866 15181 raft_consensus.cc:2468] T 46a35b81512c4e8c8ec6b83d4c768e1f P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbc2c92e49e346b5b3bd7705a229afc6 in term 0.
I20260709 14:54:28.442905 15004 leader_election.cc:304] T 46a35b81512c4e8c8ec6b83d4c768e1f P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dbc2c92e49e346b5b3bd7705a229afc6, eaa34beb1b274443b1c46839afd0a484; no voters: 
I20260709 14:54:28.446108 15724 raft_consensus.cc:2804] T 46a35b81512c4e8c8ec6b83d4c768e1f P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:54:28.446637 15724 raft_consensus.cc:493] T 46a35b81512c4e8c8ec6b83d4c768e1f P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:54:28.449849 15724 raft_consensus.cc:3060] T 46a35b81512c4e8c8ec6b83d4c768e1f P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Advancing to term 1
W20260709 14:54:28.469795 15224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:43177, user_credentials={real_user=slave}} blocked reactor thread for 52501.8us
I20260709 14:54:28.480475 15309 tablet_bootstrap.cc:654] T d326f264e68d41d69b5007023083ed9e P 7519e608fbb44d9db8ad30b9f10ae605: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:28.490411 15309 tablet_bootstrap.cc:492] T d326f264e68d41d69b5007023083ed9e P 7519e608fbb44d9db8ad30b9f10ae605: No bootstrap required, opened a new log
I20260709 14:54:28.491031 15309 ts_tablet_manager.cc:1403] T d326f264e68d41d69b5007023083ed9e P 7519e608fbb44d9db8ad30b9f10ae605: Time spent bootstrapping tablet: real 0.076s	user 0.016s	sys 0.001s
I20260709 14:54:28.494536 15309 raft_consensus.cc:359] T d326f264e68d41d69b5007023083ed9e P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:28.502442 15261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a35b81512c4e8c8ec6b83d4c768e1f" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13" is_pre_election: true
I20260709 14:54:28.495555 15309 raft_consensus.cc:385] T d326f264e68d41d69b5007023083ed9e P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 14:54:28.513821 15001 leader_election.cc:343] T 46a35b81512c4e8c8ec6b83d4c768e1f P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:28.512449 15309 raft_consensus.cc:740] T d326f264e68d41d69b5007023083ed9e P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7519e608fbb44d9db8ad30b9f10ae605, State: Initialized, Role: FOLLOWER
I20260709 14:54:28.484838 15848 raft_consensus.cc:515] T ff73c3d51e5e480c920d1aca00b9b40d P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:28.528158 15307 tablet_bootstrap.cc:492] T 46a35b81512c4e8c8ec6b83d4c768e1f P 9cb8de0701f2482b99e51d5ac080aa13: No bootstrap required, opened a new log
I20260709 14:54:28.528860 15307 ts_tablet_manager.cc:1403] T 46a35b81512c4e8c8ec6b83d4c768e1f P 9cb8de0701f2482b99e51d5ac080aa13: Time spent bootstrapping tablet: real 0.277s	user 0.028s	sys 0.036s
I20260709 14:54:28.529819 15848 leader_election.cc:290] T ff73c3d51e5e480c920d1aca00b9b40d P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 2 election: Requested vote from peers 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177), eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805)
I20260709 14:54:28.538604 15105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff73c3d51e5e480c920d1aca00b9b40d" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605"
I20260709 14:54:28.539723 15105 raft_consensus.cc:3060] T ff73c3d51e5e480c920d1aca00b9b40d P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Advancing to term 2
I20260709 14:54:28.546244 15180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff73c3d51e5e480c920d1aca00b9b40d" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484"
I20260709 14:54:28.547056 15307 raft_consensus.cc:359] T 46a35b81512c4e8c8ec6b83d4c768e1f P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:28.553141 15307 raft_consensus.cc:385] T 46a35b81512c4e8c8ec6b83d4c768e1f P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:28.547120 15180 raft_consensus.cc:3060] T ff73c3d51e5e480c920d1aca00b9b40d P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:54:28.554044 15309 consensus_queue.cc:260] T d326f264e68d41d69b5007023083ed9e P 7519e608fbb44d9db8ad30b9f10ae605 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:28.553568 15307 raft_consensus.cc:740] T 46a35b81512c4e8c8ec6b83d4c768e1f P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9cb8de0701f2482b99e51d5ac080aa13, State: Initialized, Role: FOLLOWER
I20260709 14:54:28.563848 15307 consensus_queue.cc:260] T 46a35b81512c4e8c8ec6b83d4c768e1f P 9cb8de0701f2482b99e51d5ac080aa13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
W20260709 14:54:28.572551 14984 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 14:54:28.585423 15309 ts_tablet_manager.cc:1434] T d326f264e68d41d69b5007023083ed9e P 7519e608fbb44d9db8ad30b9f10ae605: Time spent starting tablet: real 0.094s	user 0.005s	sys 0.004s
I20260709 14:54:28.591320 15309 tablet_bootstrap.cc:492] T d2273a1ad13e4c54ae2101a15a7e56e1 P 7519e608fbb44d9db8ad30b9f10ae605: Bootstrap starting.
I20260709 14:54:28.589190 15724 raft_consensus.cc:515] T 46a35b81512c4e8c8ec6b83d4c768e1f P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:28.626847 15111 raft_consensus.cc:3060] T d326f264e68d41d69b5007023083ed9e P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:28.629629 15724 leader_election.cc:290] T 46a35b81512c4e8c8ec6b83d4c768e1f P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 election: Requested vote from peers eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805), 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493)
I20260709 14:54:28.650599 15848 raft_consensus.cc:493] T d2273a1ad13e4c54ae2101a15a7e56e1 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:28.651489 15848 raft_consensus.cc:515] T d2273a1ad13e4c54ae2101a15a7e56e1 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:28.650575 15857 consensus_queue.cc:1048] T d326f264e68d41d69b5007023083ed9e P dbc2c92e49e346b5b3bd7705a229afc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 14:54:28.654564 15848 leader_election.cc:290] T d2273a1ad13e4c54ae2101a15a7e56e1 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477), 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177)
I20260709 14:54:28.662061 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2273a1ad13e4c54ae2101a15a7e56e1" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" is_pre_election: true
I20260709 14:54:28.663055 15035 raft_consensus.cc:2468] T d2273a1ad13e4c54ae2101a15a7e56e1 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cb8de0701f2482b99e51d5ac080aa13 in term 0.
I20260709 14:54:28.641165 15840 consensus_queue.cc:1048] T d2463fd792b240e9911c6b38bcb453b8 P dbc2c92e49e346b5b3bd7705a229afc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.026s
I20260709 14:54:28.669692 15180 raft_consensus.cc:2468] T ff73c3d51e5e480c920d1aca00b9b40d P eaa34beb1b274443b1c46839afd0a484 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cb8de0701f2482b99e51d5ac080aa13 in term 2.
I20260709 14:54:28.672187 15105 raft_consensus.cc:2468] T ff73c3d51e5e480c920d1aca00b9b40d P 7519e608fbb44d9db8ad30b9f10ae605 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cb8de0701f2482b99e51d5ac080aa13 in term 2.
I20260709 14:54:28.678318 15307 ts_tablet_manager.cc:1434] T 46a35b81512c4e8c8ec6b83d4c768e1f P 9cb8de0701f2482b99e51d5ac080aa13: Time spent starting tablet: real 0.149s	user 0.009s	sys 0.003s
I20260709 14:54:28.686848 15227 leader_election.cc:304] T ff73c3d51e5e480c920d1aca00b9b40d P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cb8de0701f2482b99e51d5ac080aa13, eaa34beb1b274443b1c46839afd0a484; no voters: 
I20260709 14:54:28.655416 15848 raft_consensus.cc:493] T 46a35b81512c4e8c8ec6b83d4c768e1f P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:28.666977 15185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a35b81512c4e8c8ec6b83d4c768e1f" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484"
I20260709 14:54:28.697140 15185 raft_consensus.cc:3060] T 46a35b81512c4e8c8ec6b83d4c768e1f P eaa34beb1b274443b1c46839afd0a484 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:28.697453 15647 raft_consensus.cc:2804] T ff73c3d51e5e480c920d1aca00b9b40d P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:54:28.698257 15647 raft_consensus.cc:697] T ff73c3d51e5e480c920d1aca00b9b40d P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 LEADER]: Becoming Leader. State: Replica: 9cb8de0701f2482b99e51d5ac080aa13, State: Running, Role: LEADER
I20260709 14:54:28.699707 15647 consensus_queue.cc:237] T ff73c3d51e5e480c920d1aca00b9b40d P 9cb8de0701f2482b99e51d5ac080aa13 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:28.707425 15848 raft_consensus.cc:515] T 46a35b81512c4e8c8ec6b83d4c768e1f P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:28.720492 15848 leader_election.cc:290] T 46a35b81512c4e8c8ec6b83d4c768e1f P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805), dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477)
I20260709 14:54:28.717536 15227 leader_election.cc:304] T d2273a1ad13e4c54ae2101a15a7e56e1 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cb8de0701f2482b99e51d5ac080aa13, dbc2c92e49e346b5b3bd7705a229afc6; no voters: 
I20260709 14:54:28.721350 15257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a35b81512c4e8c8ec6b83d4c768e1f" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13"
I20260709 14:54:28.728010 15257 raft_consensus.cc:3060] T 46a35b81512c4e8c8ec6b83d4c768e1f P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:28.733501 15809 raft_consensus.cc:2804] T d2273a1ad13e4c54ae2101a15a7e56e1 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:54:28.734264 15809 raft_consensus.cc:493] T d2273a1ad13e4c54ae2101a15a7e56e1 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:54:28.736205 15106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2273a1ad13e4c54ae2101a15a7e56e1" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605" is_pre_election: true
I20260709 14:54:28.710026 15309 tablet_bootstrap.cc:654] T d2273a1ad13e4c54ae2101a15a7e56e1 P 7519e608fbb44d9db8ad30b9f10ae605: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:28.739667 15809 raft_consensus.cc:3060] T d2273a1ad13e4c54ae2101a15a7e56e1 P 9cb8de0701f2482b99e51d5ac080aa13 [term 0 FOLLOWER]: Advancing to term 1
W20260709 14:54:28.786001 15076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.68:45493, user_credentials={real_user=slave}} blocked reactor thread for 56630.4us
I20260709 14:54:28.792737 15187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a35b81512c4e8c8ec6b83d4c768e1f" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484" is_pre_election: true
I20260709 14:54:28.807400 15257 raft_consensus.cc:2468] T 46a35b81512c4e8c8ec6b83d4c768e1f P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbc2c92e49e346b5b3bd7705a229afc6 in term 1.
I20260709 14:54:28.726073 15185 raft_consensus.cc:2468] T 46a35b81512c4e8c8ec6b83d4c768e1f P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbc2c92e49e346b5b3bd7705a229afc6 in term 1.
I20260709 14:54:28.834583 15004 leader_election.cc:304] T 46a35b81512c4e8c8ec6b83d4c768e1f P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dbc2c92e49e346b5b3bd7705a229afc6, eaa34beb1b274443b1c46839afd0a484; no voters: 
I20260709 14:54:28.836405 15840 raft_consensus.cc:2804] T 46a35b81512c4e8c8ec6b83d4c768e1f P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:54:28.841504 15840 raft_consensus.cc:697] T 46a35b81512c4e8c8ec6b83d4c768e1f P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 LEADER]: Becoming Leader. State: Replica: dbc2c92e49e346b5b3bd7705a229afc6, State: Running, Role: LEADER
I20260709 14:54:28.842635 15840 consensus_queue.cc:237] T 46a35b81512c4e8c8ec6b83d4c768e1f P dbc2c92e49e346b5b3bd7705a229afc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:28.849839 15809 raft_consensus.cc:515] T d2273a1ad13e4c54ae2101a15a7e56e1 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:28.872605 15809 leader_election.cc:290] T d2273a1ad13e4c54ae2101a15a7e56e1 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 election: Requested vote from peers dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477), 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177)
I20260709 14:54:28.876576 15033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a35b81512c4e8c8ec6b83d4c768e1f" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" is_pre_election: true
I20260709 14:54:28.888232 15032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2273a1ad13e4c54ae2101a15a7e56e1" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc2c92e49e346b5b3bd7705a229afc6"
I20260709 14:54:28.889073 15032 raft_consensus.cc:3060] T d2273a1ad13e4c54ae2101a15a7e56e1 P dbc2c92e49e346b5b3bd7705a229afc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:28.891381 15227 leader_election.cc:304] T 46a35b81512c4e8c8ec6b83d4c768e1f P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cb8de0701f2482b99e51d5ac080aa13; no voters: dbc2c92e49e346b5b3bd7705a229afc6, eaa34beb1b274443b1c46839afd0a484
I20260709 14:54:28.892433 15809 raft_consensus.cc:2749] T 46a35b81512c4e8c8ec6b83d4c768e1f P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:54:28.898960 15032 raft_consensus.cc:2468] T d2273a1ad13e4c54ae2101a15a7e56e1 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cb8de0701f2482b99e51d5ac080aa13 in term 1.
I20260709 14:54:28.901566 15227 leader_election.cc:304] T d2273a1ad13e4c54ae2101a15a7e56e1 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cb8de0701f2482b99e51d5ac080aa13, dbc2c92e49e346b5b3bd7705a229afc6; no voters: 
I20260709 14:54:28.904258 15647 raft_consensus.cc:2804] T d2273a1ad13e4c54ae2101a15a7e56e1 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:54:28.932338 15309 tablet_bootstrap.cc:492] T d2273a1ad13e4c54ae2101a15a7e56e1 P 7519e608fbb44d9db8ad30b9f10ae605: No bootstrap required, opened a new log
I20260709 14:54:28.932974 15309 ts_tablet_manager.cc:1403] T d2273a1ad13e4c54ae2101a15a7e56e1 P 7519e608fbb44d9db8ad30b9f10ae605: Time spent bootstrapping tablet: real 0.342s	user 0.014s	sys 0.004s
I20260709 14:54:28.904881 15647 raft_consensus.cc:697] T d2273a1ad13e4c54ae2101a15a7e56e1 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 LEADER]: Becoming Leader. State: Replica: 9cb8de0701f2482b99e51d5ac080aa13, State: Running, Role: LEADER
W20260709 14:54:28.855420 15224 leader_election.cc:343] T d2273a1ad13e4c54ae2101a15a7e56e1 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:28.858039 14936 catalog_manager.cc:5697] T ff73c3d51e5e480c920d1aca00b9b40d P 9cb8de0701f2482b99e51d5ac080aa13 reported cstate change: term changed from 0 to 2, leader changed from <none> to 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68). New cstate: current_term: 2 leader_uuid: "9cb8de0701f2482b99e51d5ac080aa13" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } health_report { overall_health: HEALTHY } } }
W20260709 14:54:28.939250 15224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:43177, user_credentials={real_user=slave}} blocked reactor thread for 84032.2us
I20260709 14:54:28.941282 15840 consensus_queue.cc:1048] T d2463fd792b240e9911c6b38bcb453b8 P dbc2c92e49e346b5b3bd7705a229afc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:54:28.937714 15309 raft_consensus.cc:359] T d2273a1ad13e4c54ae2101a15a7e56e1 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:28.945098 15309 raft_consensus.cc:385] T d2273a1ad13e4c54ae2101a15a7e56e1 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:28.945600 15309 raft_consensus.cc:740] T d2273a1ad13e4c54ae2101a15a7e56e1 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7519e608fbb44d9db8ad30b9f10ae605, State: Initialized, Role: FOLLOWER
I20260709 14:54:28.946686 15110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2273a1ad13e4c54ae2101a15a7e56e1" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605"
I20260709 14:54:28.949856 15647 consensus_queue.cc:237] T d2273a1ad13e4c54ae2101a15a7e56e1 P 9cb8de0701f2482b99e51d5ac080aa13 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:28.957825 15309 consensus_queue.cc:260] T d2273a1ad13e4c54ae2101a15a7e56e1 P 7519e608fbb44d9db8ad30b9f10ae605 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:28.959185 15110 raft_consensus.cc:3060] T d2273a1ad13e4c54ae2101a15a7e56e1 P 7519e608fbb44d9db8ad30b9f10ae605 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:28.960244 15309 ts_tablet_manager.cc:1434] T d2273a1ad13e4c54ae2101a15a7e56e1 P 7519e608fbb44d9db8ad30b9f10ae605: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.000s
I20260709 14:54:28.970814 15110 raft_consensus.cc:2468] T d2273a1ad13e4c54ae2101a15a7e56e1 P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cb8de0701f2482b99e51d5ac080aa13 in term 1.
W20260709 14:54:29.067843 15917 log.cc:927] Time spent T d2463fd792b240e9911c6b38bcb453b8 P 9cb8de0701f2482b99e51d5ac080aa13: Append to log took a long time: real 0.061s	user 0.002s	sys 0.000s
I20260709 14:54:29.106475 14933 catalog_manager.cc:5697] T 46a35b81512c4e8c8ec6b83d4c768e1f P dbc2c92e49e346b5b3bd7705a229afc6 reported cstate change: term changed from 0 to 1, leader changed from <none> to dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65). New cstate: current_term: 1 leader_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } health_report { overall_health: HEALTHY } } }
W20260709 14:54:29.114311 15227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:33805, user_credentials={real_user=slave}} blocked reactor thread for 99946.2us
I20260709 14:54:29.166723 14936 catalog_manager.cc:5697] T d2273a1ad13e4c54ae2101a15a7e56e1 P 9cb8de0701f2482b99e51d5ac080aa13 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68). New cstate: current_term: 1 leader_uuid: "9cb8de0701f2482b99e51d5ac080aa13" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } health_report { overall_health: UNKNOWN } } }
I20260709 14:54:29.217455 15111 raft_consensus.cc:1275] T ff73c3d51e5e480c920d1aca00b9b40d P 7519e608fbb44d9db8ad30b9f10ae605 [term 2 FOLLOWER]: Refusing update from remote peer 9cb8de0701f2482b99e51d5ac080aa13: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 14:54:29.220171 15901 consensus_queue.cc:1048] T ff73c3d51e5e480c920d1aca00b9b40d P 9cb8de0701f2482b99e51d5ac080aa13 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 14:54:29.243116 15187 raft_consensus.cc:1275] T ff73c3d51e5e480c920d1aca00b9b40d P eaa34beb1b274443b1c46839afd0a484 [term 2 FOLLOWER]: Refusing update from remote peer 9cb8de0701f2482b99e51d5ac080aa13: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 14:54:29.249656 15901 consensus_queue.cc:1048] T ff73c3d51e5e480c920d1aca00b9b40d P 9cb8de0701f2482b99e51d5ac080aa13 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:54:29.259605 15806 raft_consensus.cc:493] T 8974e5ab032b4fba92bfc577280778bf P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:29.260320 15806 raft_consensus.cc:515] T 8974e5ab032b4fba92bfc577280778bf P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:29.262830 15806 leader_election.cc:290] T 8974e5ab032b4fba92bfc577280778bf P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477), 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177)
I20260709 14:54:29.265206 15106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8974e5ab032b4fba92bfc577280778bf" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605" is_pre_election: true
I20260709 14:54:29.266161 15106 raft_consensus.cc:2468] T 8974e5ab032b4fba92bfc577280778bf P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cb8de0701f2482b99e51d5ac080aa13 in term 1.
I20260709 14:54:29.281141 15224 leader_election.cc:304] T 8974e5ab032b4fba92bfc577280778bf P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7519e608fbb44d9db8ad30b9f10ae605, 9cb8de0701f2482b99e51d5ac080aa13; no voters: 
I20260709 14:54:29.284524 15754 raft_consensus.cc:2804] T 8974e5ab032b4fba92bfc577280778bf P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 14:54:29.285182 15754 raft_consensus.cc:493] T 8974e5ab032b4fba92bfc577280778bf P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:54:29.285625 15754 raft_consensus.cc:3060] T 8974e5ab032b4fba92bfc577280778bf P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:54:29.298584 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8974e5ab032b4fba92bfc577280778bf" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" is_pre_election: true
I20260709 14:54:29.299695 15035 raft_consensus.cc:2468] T 8974e5ab032b4fba92bfc577280778bf P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cb8de0701f2482b99e51d5ac080aa13 in term 1.
I20260709 14:54:29.310113 15840 consensus_queue.cc:1048] T 46a35b81512c4e8c8ec6b83d4c768e1f P dbc2c92e49e346b5b3bd7705a229afc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 14:54:29.338728 15754 raft_consensus.cc:515] T 8974e5ab032b4fba92bfc577280778bf P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:29.405552 15110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8974e5ab032b4fba92bfc577280778bf" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605"
I20260709 14:54:29.406344 15110 raft_consensus.cc:3060] T 8974e5ab032b4fba92bfc577280778bf P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:54:29.405723 15754 leader_election.cc:290] T 8974e5ab032b4fba92bfc577280778bf P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 2 election: Requested vote from peers dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477), 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177)
I20260709 14:54:29.408514 15840 consensus_queue.cc:1048] T 46a35b81512c4e8c8ec6b83d4c768e1f P dbc2c92e49e346b5b3bd7705a229afc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:54:29.409171 15754 consensus_queue.cc:1048] T d2273a1ad13e4c54ae2101a15a7e56e1 P 9cb8de0701f2482b99e51d5ac080aa13 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:54:29.420555 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8974e5ab032b4fba92bfc577280778bf" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc2c92e49e346b5b3bd7705a229afc6"
I20260709 14:54:29.421365 15035 raft_consensus.cc:3060] T 8974e5ab032b4fba92bfc577280778bf P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:54:29.427218 15110 raft_consensus.cc:2468] T 8974e5ab032b4fba92bfc577280778bf P 7519e608fbb44d9db8ad30b9f10ae605 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cb8de0701f2482b99e51d5ac080aa13 in term 2.
I20260709 14:54:29.453786 15224 leader_election.cc:304] T 8974e5ab032b4fba92bfc577280778bf P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7519e608fbb44d9db8ad30b9f10ae605, 9cb8de0701f2482b99e51d5ac080aa13; no voters: 
I20260709 14:54:29.455641 15809 raft_consensus.cc:2804] T 8974e5ab032b4fba92bfc577280778bf P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:54:29.456311 15809 raft_consensus.cc:697] T 8974e5ab032b4fba92bfc577280778bf P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 LEADER]: Becoming Leader. State: Replica: 9cb8de0701f2482b99e51d5ac080aa13, State: Running, Role: LEADER
I20260709 14:54:29.457520 15809 consensus_queue.cc:237] T 8974e5ab032b4fba92bfc577280778bf P 9cb8de0701f2482b99e51d5ac080aa13 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:29.478047 15035 raft_consensus.cc:2468] T 8974e5ab032b4fba92bfc577280778bf P dbc2c92e49e346b5b3bd7705a229afc6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cb8de0701f2482b99e51d5ac080aa13 in term 2.
I20260709 14:54:29.510007 15754 consensus_queue.cc:1048] T d2273a1ad13e4c54ae2101a15a7e56e1 P 9cb8de0701f2482b99e51d5ac080aa13 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:54:29.514086 14933 catalog_manager.cc:5697] T 8974e5ab032b4fba92bfc577280778bf P 9cb8de0701f2482b99e51d5ac080aa13 reported cstate change: term changed from 0 to 2, leader changed from <none> to 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68). New cstate: current_term: 2 leader_uuid: "9cb8de0701f2482b99e51d5ac080aa13" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } health_report { overall_health: UNKNOWN } } }
I20260709 14:54:30.025557 15035 raft_consensus.cc:1275] T 8974e5ab032b4fba92bfc577280778bf P dbc2c92e49e346b5b3bd7705a229afc6 [term 2 FOLLOWER]: Refusing update from remote peer 9cb8de0701f2482b99e51d5ac080aa13: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 14:54:30.030869 15806 consensus_queue.cc:1048] T 8974e5ab032b4fba92bfc577280778bf P 9cb8de0701f2482b99e51d5ac080aa13 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 14:54:30.079824 15224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:43177, user_credentials={real_user=slave}} blocked reactor thread for 45895.2us
I20260709 14:54:30.115223 15111 raft_consensus.cc:1275] T 8974e5ab032b4fba92bfc577280778bf P 7519e608fbb44d9db8ad30b9f10ae605 [term 2 FOLLOWER]: Refusing update from remote peer 9cb8de0701f2482b99e51d5ac080aa13: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 14:54:30.120007 15754 consensus_queue.cc:1048] T 8974e5ab032b4fba92bfc577280778bf P 9cb8de0701f2482b99e51d5ac080aa13 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:54:30.232410  6549 tablet_server.cc:179] TabletServer@127.6.101.65:0 shutting down...
W20260709 14:54:30.271757 15153 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 210 similar messages]
W20260709 14:54:30.281188 15227 consensus_peers.cc:597] T 7699ad132e12472180b6a9527951c397 P 9cb8de0701f2482b99e51d5ac080aa13 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 14:54:30.283475 15153 consensus_peers.cc:597] T 5e8a01e27eab492bb73df3359e500627 P eaa34beb1b274443b1c46839afd0a484 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 14:54:30.309377 15153 consensus_peers.cc:597] T 98280a706ec54413830f342b48666f6e P eaa34beb1b274443b1c46839afd0a484 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 14:54:30.312306 15153 consensus_peers.cc:597] T 5f5dbc86fc8f4ae5b77e0f23adfcd593 P eaa34beb1b274443b1c46839afd0a484 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 14:54:30.341136 15227 consensus_peers.cc:597] T 5585b0f6bbf04c10865d2463767621dc P 9cb8de0701f2482b99e51d5ac080aa13 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:54:30.369549  6549 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 14:54:30.371894  6549 tablet_replica.cc:333] T d2273a1ad13e4c54ae2101a15a7e56e1 P dbc2c92e49e346b5b3bd7705a229afc6: stopping tablet replica
I20260709 14:54:30.381865  6549 raft_consensus.cc:2243] T d2273a1ad13e4c54ae2101a15a7e56e1 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:30.384291  6549 raft_consensus.cc:2272] T d2273a1ad13e4c54ae2101a15a7e56e1 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 14:54:30.392351 15153 consensus_peers.cc:597] T a9dab1878c4b4550880f5680c6d48c67 P eaa34beb1b274443b1c46839afd0a484 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:54:30.393206  6549 tablet_replica.cc:333] T 8974e5ab032b4fba92bfc577280778bf P dbc2c92e49e346b5b3bd7705a229afc6: stopping tablet replica
W20260709 14:54:30.404394 15079 consensus_peers.cc:597] T 054739df584d4b9db840777c2ae17555 P 7519e608fbb44d9db8ad30b9f10ae605 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:54:30.405628  6549 raft_consensus.cc:2243] T 8974e5ab032b4fba92bfc577280778bf P dbc2c92e49e346b5b3bd7705a229afc6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:30.406607  6549 raft_consensus.cc:2272] T 8974e5ab032b4fba92bfc577280778bf P dbc2c92e49e346b5b3bd7705a229afc6 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 14:54:30.409180 15079 consensus_peers.cc:597] T 966a06ab56a6479283ab2818c9439d4f P 7519e608fbb44d9db8ad30b9f10ae605 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:54:30.410394  6549 tablet_replica.cc:333] T 5b9f8063585c4e5faddebd56fbe1aa01 P dbc2c92e49e346b5b3bd7705a229afc6: stopping tablet replica
I20260709 14:54:30.411580  6549 raft_consensus.cc:2243] T 5b9f8063585c4e5faddebd56fbe1aa01 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 14:54:30.413179  6549 raft_consensus.cc:2272] T 5b9f8063585c4e5faddebd56fbe1aa01 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:30.416807  6549 tablet_replica.cc:333] T db39b7ffe995451885f4074ddf16028d P dbc2c92e49e346b5b3bd7705a229afc6: stopping tablet replica
W20260709 14:54:30.420316 15153 consensus_peers.cc:597] T 594083b10772433f90560d387bbbeabe P eaa34beb1b274443b1c46839afd0a484 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:54:30.420701  6549 raft_consensus.cc:2243] T db39b7ffe995451885f4074ddf16028d P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 LEADER]: Raft consensus shutting down.
W20260709 14:54:30.433153 15079 consensus_peers.cc:597] T 70bc59fabcdc4359a84d584f36d18d01 P 7519e608fbb44d9db8ad30b9f10ae605 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 14:54:30.436183 15153 consensus_peers.cc:597] T 798d0882b1ea4b26b598c236de8f18c9 P eaa34beb1b274443b1c46839afd0a484 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:54:30.438391  6549 raft_consensus.cc:2272] T db39b7ffe995451885f4074ddf16028d P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:30.443423  6549 tablet_replica.cc:333] T 4abdbdda3ce149a9904e919be18e7a3f P dbc2c92e49e346b5b3bd7705a229afc6: stopping tablet replica
I20260709 14:54:30.444715  6549 raft_consensus.cc:2243] T 4abdbdda3ce149a9904e919be18e7a3f P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 LEADER]: Raft consensus shutting down.
W20260709 14:54:30.447829 15153 consensus_peers.cc:597] T 42d6909533d14edbbfdad30a9972658d P eaa34beb1b274443b1c46839afd0a484 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 14:54:30.452663 15227 consensus_peers.cc:597] T dd44b332dc744f94a5f7cfffc06f3956 P 9cb8de0701f2482b99e51d5ac080aa13 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:54:30.454391  6549 raft_consensus.cc:2272] T 4abdbdda3ce149a9904e919be18e7a3f P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 14:54:30.454675 15227 consensus_peers.cc:597] T 1159198eabeb409996ccbec0cac057f8 P 9cb8de0701f2482b99e51d5ac080aa13 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 14:54:30.455400 15227 consensus_peers.cc:597] T a1075567fc91458ca7cc9977cf02b170 P 9cb8de0701f2482b99e51d5ac080aa13 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:54:30.456717  6549 tablet_replica.cc:333] T bdf08eed05854470954a5e9dd17dfb27 P dbc2c92e49e346b5b3bd7705a229afc6: stopping tablet replica
I20260709 14:54:30.457607  6549 raft_consensus.cc:2243] T bdf08eed05854470954a5e9dd17dfb27 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 14:54:30.459192 15227 consensus_peers.cc:597] T d2c4ea1c33c64cd09ba04611fdbdc59d P 9cb8de0701f2482b99e51d5ac080aa13 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:54:30.459466  6549 raft_consensus.cc:2272] T bdf08eed05854470954a5e9dd17dfb27 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:30.463737  6549 tablet_replica.cc:333] T d2463fd792b240e9911c6b38bcb453b8 P dbc2c92e49e346b5b3bd7705a229afc6: stopping tablet replica
I20260709 14:54:30.464496  6549 raft_consensus.cc:2243] T d2463fd792b240e9911c6b38bcb453b8 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 14:54:30.465485  6549 raft_consensus.cc:2272] T d2463fd792b240e9911c6b38bcb453b8 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:30.467864  6549 tablet_replica.cc:333] T 9f90ac0a3b004f6ca430ff2fc5198678 P dbc2c92e49e346b5b3bd7705a229afc6: stopping tablet replica
I20260709 14:54:30.468863  6549 raft_consensus.cc:2243] T 9f90ac0a3b004f6ca430ff2fc5198678 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 14:54:30.470933  6549 raft_consensus.cc:2272] T 9f90ac0a3b004f6ca430ff2fc5198678 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:30.473708  6549 tablet_replica.cc:333] T d178b88fdab54a29b05fb98e05ffe8c5 P dbc2c92e49e346b5b3bd7705a229afc6: stopping tablet replica
I20260709 14:54:30.474459  6549 raft_consensus.cc:2243] T d178b88fdab54a29b05fb98e05ffe8c5 P dbc2c92e49e346b5b3bd7705a229afc6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:30.475045  6549 raft_consensus.cc:2272] T d178b88fdab54a29b05fb98e05ffe8c5 P dbc2c92e49e346b5b3bd7705a229afc6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:30.478144  6549 tablet_replica.cc:333] T 5585b0f6bbf04c10865d2463767621dc P dbc2c92e49e346b5b3bd7705a229afc6: stopping tablet replica
I20260709 14:54:30.479198  6549 raft_consensus.cc:2243] T 5585b0f6bbf04c10865d2463767621dc P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:30.479861  6549 raft_consensus.cc:2272] T 5585b0f6bbf04c10865d2463767621dc P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:30.483016  6549 tablet_replica.cc:333] T dd44b332dc744f94a5f7cfffc06f3956 P dbc2c92e49e346b5b3bd7705a229afc6: stopping tablet replica
I20260709 14:54:30.483772  6549 raft_consensus.cc:2243] T dd44b332dc744f94a5f7cfffc06f3956 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:30.484375  6549 raft_consensus.cc:2272] T dd44b332dc744f94a5f7cfffc06f3956 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:30.488580  6549 tablet_replica.cc:333] T 3b4c50fac37a43c0988d5ea911d09f43 P dbc2c92e49e346b5b3bd7705a229afc6: stopping tablet replica
I20260709 14:54:30.489627  6549 raft_consensus.cc:2243] T 3b4c50fac37a43c0988d5ea911d09f43 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:30.490258  6549 raft_consensus.cc:2272] T 3b4c50fac37a43c0988d5ea911d09f43 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:30.492640  6549 tablet_replica.cc:333] T b7c363a305d3434092ef6016b7064eb3 P dbc2c92e49e346b5b3bd7705a229afc6: stopping tablet replica
I20260709 14:54:30.493388  6549 raft_consensus.cc:2243] T b7c363a305d3434092ef6016b7064eb3 P dbc2c92e49e346b5b3bd7705a229afc6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:30.493858  6549 raft_consensus.cc:2272] T b7c363a305d3434092ef6016b7064eb3 P dbc2c92e49e346b5b3bd7705a229afc6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:30.496292  6549 tablet_replica.cc:333] T d326f264e68d41d69b5007023083ed9e P dbc2c92e49e346b5b3bd7705a229afc6: stopping tablet replica
I20260709 14:54:30.496901  6549 raft_consensus.cc:2243] T d326f264e68d41d69b5007023083ed9e P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 14:54:30.497823  6549 raft_consensus.cc:2272] T d326f264e68d41d69b5007023083ed9e P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:30.500907  6549 tablet_replica.cc:333] T 70bc59fabcdc4359a84d584f36d18d01 P dbc2c92e49e346b5b3bd7705a229afc6: stopping tablet replica
I20260709 14:54:30.502324  6549 raft_consensus.cc:2243] T 70bc59fabcdc4359a84d584f36d18d01 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:30.503604  6549 raft_consensus.cc:2272] T 70bc59fabcdc4359a84d584f36d18d01 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:30.506542  6549 tablet_replica.cc:333] T 9275d24f141d455cb200b9784c470d33 P dbc2c92e49e346b5b3bd7705a229afc6: stopping tablet replica
I20260709 14:54:30.507472  6549 raft_consensus.cc:2243] T 9275d24f141d455cb200b9784c470d33 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 14:54:30.508759  6549 raft_consensus.cc:2272] T 9275d24f141d455cb200b9784c470d33 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 14:54:30.512436 15153 consensus_peers.cc:597] T d6bcaee371174feaa06943f949efda49 P eaa34beb1b274443b1c46839afd0a484 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:54:30.512751  6549 tablet_replica.cc:333] T a9dab1878c4b4550880f5680c6d48c67 P dbc2c92e49e346b5b3bd7705a229afc6: stopping tablet replica
I20260709 14:54:30.513836  6549 raft_consensus.cc:2243] T a9dab1878c4b4550880f5680c6d48c67 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:30.514425  6549 raft_consensus.cc:2272] T a9dab1878c4b4550880f5680c6d48c67 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:30.518362  6549 tablet_replica.cc:333] T 966a06ab56a6479283ab2818c9439d4f P dbc2c92e49e346b5b3bd7705a229afc6: stopping tablet replica
I20260709 14:54:30.519371  6549 raft_consensus.cc:2243] T 966a06ab56a6479283ab2818c9439d4f P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:30.520049  6549 raft_consensus.cc:2272] T 966a06ab56a6479283ab2818c9439d4f P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:30.523260  6549 tablet_replica.cc:333] T cc6f522768894933b21bc94b41605166 P dbc2c92e49e346b5b3bd7705a229afc6: stopping tablet replica
I20260709 14:54:30.524184  6549 raft_consensus.cc:2243] T cc6f522768894933b21bc94b41605166 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 14:54:30.525405  6549 raft_consensus.cc:2272] T cc6f522768894933b21bc94b41605166 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:30.528654  6549 tablet_replica.cc:333] T 42d6909533d14edbbfdad30a9972658d P dbc2c92e49e346b5b3bd7705a229afc6: stopping tablet replica
I20260709 14:54:30.529917  6549 raft_consensus.cc:2243] T 42d6909533d14edbbfdad30a9972658d P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:30.530747  6549 raft_consensus.cc:2272] T 42d6909533d14edbbfdad30a9972658d P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:30.534339  6549 tablet_replica.cc:333] T a1075567fc91458ca7cc9977cf02b170 P dbc2c92e49e346b5b3bd7705a229afc6: stopping tablet replica
I20260709 14:54:30.535221  6549 raft_consensus.cc:2243] T a1075567fc91458ca7cc9977cf02b170 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:30.535801  6549 raft_consensus.cc:2272] T a1075567fc91458ca7cc9977cf02b170 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:30.539247  6549 tablet_replica.cc:333] T f389b12c6b304243905f28267dfaeed0 P dbc2c92e49e346b5b3bd7705a229afc6: stopping tablet replica
I20260709 14:54:30.540235  6549 raft_consensus.cc:2243] T f389b12c6b304243905f28267dfaeed0 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:30.540861  6549 raft_consensus.cc:2272] T f389b12c6b304243905f28267dfaeed0 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:30.544559  6549 tablet_replica.cc:333] T 594083b10772433f90560d387bbbeabe P dbc2c92e49e346b5b3bd7705a229afc6: stopping tablet replica
I20260709 14:54:30.545513  6549 raft_consensus.cc:2243] T 594083b10772433f90560d387bbbeabe P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:30.546159  6549 raft_consensus.cc:2272] T 594083b10772433f90560d387bbbeabe P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:30.548962  6549 tablet_replica.cc:333] T d86dfc13b2834d7e8b2ad5f975f08154 P dbc2c92e49e346b5b3bd7705a229afc6: stopping tablet replica
I20260709 14:54:30.549850  6549 raft_consensus.cc:2243] T d86dfc13b2834d7e8b2ad5f975f08154 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 14:54:30.551115  6549 raft_consensus.cc:2272] T d86dfc13b2834d7e8b2ad5f975f08154 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:30.554350  6549 tablet_replica.cc:333] T d2c4ea1c33c64cd09ba04611fdbdc59d P dbc2c92e49e346b5b3bd7705a229afc6: stopping tablet replica
I20260709 14:54:30.555220  6549 raft_consensus.cc:2243] T d2c4ea1c33c64cd09ba04611fdbdc59d P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:30.555831  6549 raft_consensus.cc:2272] T d2c4ea1c33c64cd09ba04611fdbdc59d P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:30.558615  6549 tablet_replica.cc:333] T 4f709a060be148029cf72f1af6f79714 P dbc2c92e49e346b5b3bd7705a229afc6: stopping tablet replica
I20260709 14:54:30.559454  6549 raft_consensus.cc:2243] T 4f709a060be148029cf72f1af6f79714 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:30.560024  6549 raft_consensus.cc:2272] T 4f709a060be148029cf72f1af6f79714 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:30.563879  6549 tablet_replica.cc:333] T d6bcaee371174feaa06943f949efda49 P dbc2c92e49e346b5b3bd7705a229afc6: stopping tablet replica
I20260709 14:54:30.565369  6549 raft_consensus.cc:2243] T d6bcaee371174feaa06943f949efda49 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:30.566145  6549 raft_consensus.cc:2272] T d6bcaee371174feaa06943f949efda49 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:30.569111  6549 tablet_replica.cc:333] T 98280a706ec54413830f342b48666f6e P dbc2c92e49e346b5b3bd7705a229afc6: stopping tablet replica
I20260709 14:54:30.570039  6549 raft_consensus.cc:2243] T 98280a706ec54413830f342b48666f6e P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:30.570672  6549 raft_consensus.cc:2272] T 98280a706ec54413830f342b48666f6e P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:30.573565  6549 tablet_replica.cc:333] T 5f5dbc86fc8f4ae5b77e0f23adfcd593 P dbc2c92e49e346b5b3bd7705a229afc6: stopping tablet replica
I20260709 14:54:30.574420  6549 raft_consensus.cc:2243] T 5f5dbc86fc8f4ae5b77e0f23adfcd593 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:30.575016  6549 raft_consensus.cc:2272] T 5f5dbc86fc8f4ae5b77e0f23adfcd593 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:30.578966  6549 tablet_replica.cc:333] T 054739df584d4b9db840777c2ae17555 P dbc2c92e49e346b5b3bd7705a229afc6: stopping tablet replica
I20260709 14:54:30.580082  6549 raft_consensus.cc:2243] T 054739df584d4b9db840777c2ae17555 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:30.580804  6549 raft_consensus.cc:2272] T 054739df584d4b9db840777c2ae17555 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:30.583849  6549 tablet_replica.cc:333] T 7699ad132e12472180b6a9527951c397 P dbc2c92e49e346b5b3bd7705a229afc6: stopping tablet replica
I20260709 14:54:30.584738  6549 raft_consensus.cc:2243] T 7699ad132e12472180b6a9527951c397 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:30.585389  6549 raft_consensus.cc:2272] T 7699ad132e12472180b6a9527951c397 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:30.588583  6549 tablet_replica.cc:333] T c61864fa2cd249d683f8fb90d8542480 P dbc2c92e49e346b5b3bd7705a229afc6: stopping tablet replica
I20260709 14:54:30.589493  6549 raft_consensus.cc:2243] T c61864fa2cd249d683f8fb90d8542480 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 14:54:30.590987  6549 raft_consensus.cc:2272] T c61864fa2cd249d683f8fb90d8542480 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:30.594321  6549 tablet_replica.cc:333] T 5e8a01e27eab492bb73df3359e500627 P dbc2c92e49e346b5b3bd7705a229afc6: stopping tablet replica
I20260709 14:54:30.595229  6549 raft_consensus.cc:2243] T 5e8a01e27eab492bb73df3359e500627 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:30.595914  6549 raft_consensus.cc:2272] T 5e8a01e27eab492bb73df3359e500627 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:30.599313  6549 tablet_replica.cc:333] T 8bae8108fe2a4ce0ba3e35746c7ec9d1 P dbc2c92e49e346b5b3bd7705a229afc6: stopping tablet replica
I20260709 14:54:30.600181  6549 raft_consensus.cc:2243] T 8bae8108fe2a4ce0ba3e35746c7ec9d1 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 14:54:30.601359  6549 raft_consensus.cc:2272] T 8bae8108fe2a4ce0ba3e35746c7ec9d1 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:30.604359  6549 tablet_replica.cc:333] T 46ebd2bd84cc46e08c82a7b893e54578 P dbc2c92e49e346b5b3bd7705a229afc6: stopping tablet replica
I20260709 14:54:30.605173  6549 raft_consensus.cc:2243] T 46ebd2bd84cc46e08c82a7b893e54578 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 14:54:30.606343  6549 raft_consensus.cc:2272] T 46ebd2bd84cc46e08c82a7b893e54578 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:30.609920  6549 tablet_replica.cc:333] T 0284d9835221427ab285015d48a8040d P dbc2c92e49e346b5b3bd7705a229afc6: stopping tablet replica
I20260709 14:54:30.610771  6549 raft_consensus.cc:2243] T 0284d9835221427ab285015d48a8040d P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 14:54:30.612094  6549 raft_consensus.cc:2272] T 0284d9835221427ab285015d48a8040d P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:30.615116  6549 tablet_replica.cc:333] T 1159198eabeb409996ccbec0cac057f8 P dbc2c92e49e346b5b3bd7705a229afc6: stopping tablet replica
I20260709 14:54:30.615901  6549 raft_consensus.cc:2243] T 1159198eabeb409996ccbec0cac057f8 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 14:54:30.616449 15153 consensus_peers.cc:597] T 263098160f604ae3aa31782c37e2fd52 P eaa34beb1b274443b1c46839afd0a484 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 14:54:30.618095 15153 consensus_peers.cc:597] T f389b12c6b304243905f28267dfaeed0 P eaa34beb1b274443b1c46839afd0a484 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:54:30.616515  6549 raft_consensus.cc:2272] T 1159198eabeb409996ccbec0cac057f8 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:30.625020  6549 tablet_replica.cc:333] T 7f2cd7c8159d43c080fd8302180ecfca P dbc2c92e49e346b5b3bd7705a229afc6: stopping tablet replica
I20260709 14:54:30.626181  6549 raft_consensus.cc:2243] T 7f2cd7c8159d43c080fd8302180ecfca P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 LEADER]: Raft consensus shutting down.
W20260709 14:54:30.627267 15079 consensus_peers.cc:597] T f706543d4d3e4e7291624a785ca4e747 P 7519e608fbb44d9db8ad30b9f10ae605 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:54:30.628270  6549 raft_consensus.cc:2272] T 7f2cd7c8159d43c080fd8302180ecfca P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:30.632047  6549 tablet_replica.cc:333] T f706543d4d3e4e7291624a785ca4e747 P dbc2c92e49e346b5b3bd7705a229afc6: stopping tablet replica
I20260709 14:54:30.633143  6549 raft_consensus.cc:2243] T f706543d4d3e4e7291624a785ca4e747 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:30.633832  6549 raft_consensus.cc:2272] T f706543d4d3e4e7291624a785ca4e747 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:30.636785  6549 tablet_replica.cc:333] T d354c94548fc411ab62b4281ed947944 P dbc2c92e49e346b5b3bd7705a229afc6: stopping tablet replica
I20260709 14:54:30.637633  6549 raft_consensus.cc:2243] T d354c94548fc411ab62b4281ed947944 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 14:54:30.638852  6549 raft_consensus.cc:2272] T d354c94548fc411ab62b4281ed947944 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:30.642004  6549 tablet_replica.cc:333] T 263098160f604ae3aa31782c37e2fd52 P dbc2c92e49e346b5b3bd7705a229afc6: stopping tablet replica
I20260709 14:54:30.642819  6549 raft_consensus.cc:2243] T 263098160f604ae3aa31782c37e2fd52 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:30.643522  6549 raft_consensus.cc:2272] T 263098160f604ae3aa31782c37e2fd52 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:30.646696  6549 tablet_replica.cc:333] T 46a35b81512c4e8c8ec6b83d4c768e1f P dbc2c92e49e346b5b3bd7705a229afc6: stopping tablet replica
I20260709 14:54:30.647549  6549 raft_consensus.cc:2243] T 46a35b81512c4e8c8ec6b83d4c768e1f P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 14:54:30.648798  6549 raft_consensus.cc:2272] T 46a35b81512c4e8c8ec6b83d4c768e1f P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:30.652174  6549 tablet_replica.cc:333] T 91c9f89fcb8b45ff9be43f535cafffde P dbc2c92e49e346b5b3bd7705a229afc6: stopping tablet replica
I20260709 14:54:30.653119  6549 raft_consensus.cc:2243] T 91c9f89fcb8b45ff9be43f535cafffde P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 14:54:30.654739  6549 raft_consensus.cc:2272] T 91c9f89fcb8b45ff9be43f535cafffde P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:30.658746  6549 tablet_replica.cc:333] T d61f9ecebc3c4a028f5327bc9debf432 P dbc2c92e49e346b5b3bd7705a229afc6: stopping tablet replica
I20260709 14:54:30.659689  6549 raft_consensus.cc:2243] T d61f9ecebc3c4a028f5327bc9debf432 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 LEADER]: Raft consensus shutting down.
W20260709 14:54:30.660355 15153 consensus_peers.cc:597] T 3b4c50fac37a43c0988d5ea911d09f43 P eaa34beb1b274443b1c46839afd0a484 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:54:30.661206  6549 raft_consensus.cc:2272] T d61f9ecebc3c4a028f5327bc9debf432 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:30.664386  6549 tablet_replica.cc:333] T 798d0882b1ea4b26b598c236de8f18c9 P dbc2c92e49e346b5b3bd7705a229afc6: stopping tablet replica
I20260709 14:54:30.665035  6549 raft_consensus.cc:2243] T 798d0882b1ea4b26b598c236de8f18c9 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:30.665598  6549 raft_consensus.cc:2272] T 798d0882b1ea4b26b598c236de8f18c9 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 14:54:30.693082 15227 consensus_peers.cc:597] T 4f709a060be148029cf72f1af6f79714 P 9cb8de0701f2482b99e51d5ac080aa13 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 14:54:30.693846 15227 consensus_peers.cc:597] T bdf08eed05854470954a5e9dd17dfb27 P 9cb8de0701f2482b99e51d5ac080aa13 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 14:54:30.700513 15227 consensus_peers.cc:597] T 8974e5ab032b4fba92bfc577280778bf P 9cb8de0701f2482b99e51d5ac080aa13 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 14:54:30.701225 15227 consensus_peers.cc:597] T b7c363a305d3434092ef6016b7064eb3 P 9cb8de0701f2482b99e51d5ac080aa13 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 14:54:30.712136 15227 consensus_peers.cc:597] T d2273a1ad13e4c54ae2101a15a7e56e1 P 9cb8de0701f2482b99e51d5ac080aa13 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:54:30.869880  6549 tablet_server.cc:196] TabletServer@127.6.101.65:0 shutdown complete.
W20260709 14:54:30.901374 15153 consensus_peers.cc:597] T d178b88fdab54a29b05fb98e05ffe8c5 P eaa34beb1b274443b1c46839afd0a484 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 14:54:31.037788  6549 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 14:54:31.073210 15946 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 14:54:31.073927 15947 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 14:54:31.077510  6549 server_base.cc:1061] running on GCE node
W20260709 14:54:31.078058 15950 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 14:54:31.085843  6549 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 14:54:31.086279  6549 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 14:54:31.086575  6549 hybrid_clock.cc:648] HybridClock initialized: now 1783608871086545 us; error 0 us; skew 500 ppm
I20260709 14:54:31.087270  6549 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 14:54:31.091706  6549 webserver.cc:533] Webserver started at http://127.6.101.65:42577/ using document root <none> and password file <none>
I20260709 14:54:31.092352  6549 fs_manager.cc:362] Metadata directory not provided
I20260709 14:54:31.093019  6549 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 14:54:31.100435  6549 fs_manager.cc:714] Time spent opening directory manager: real 0.006s	user 0.006s	sys 0.000s
I20260709 14:54:31.183449 15954 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 14:54:31.185004  6549 fs_manager.cc:730] Time spent opening block manager: real 0.077s	user 0.039s	sys 0.038s
I20260709 14:54:31.185545  6549 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783608571892863-6549-0/minicluster-data/ts-0-root
uuid: "dbc2c92e49e346b5b3bd7705a229afc6"
format_stamp: "Formatted at 2026-07-09 14:54:09 on dist-test-slave-lv34"
I20260709 14:54:31.186157  6549 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783608571892863-6549-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783608571892863-6549-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783608571892863-6549-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 14:54:31.220966  6549 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 14:54:31.223268  6549 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 14:54:31.318292  6549 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 14:54:31.348611 15964 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
I20260709 14:54:31.603566 15942 raft_consensus.cc:493] T d61f9ecebc3c4a028f5327bc9debf432 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dbc2c92e49e346b5b3bd7705a229afc6)
I20260709 14:54:31.604389 15942 raft_consensus.cc:515] T d61f9ecebc3c4a028f5327bc9debf432 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:31.607021 15942 leader_election.cc:290] T d61f9ecebc3c4a028f5327bc9debf432 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477), 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177)
I20260709 14:54:31.608202 15942 raft_consensus.cc:493] T 5b9f8063585c4e5faddebd56fbe1aa01 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dbc2c92e49e346b5b3bd7705a229afc6)
I20260709 14:54:31.608922 15942 raft_consensus.cc:515] T 5b9f8063585c4e5faddebd56fbe1aa01 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:31.609805 15111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d61f9ecebc3c4a028f5327bc9debf432" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605" is_pre_election: true
I20260709 14:54:31.613575 15942 leader_election.cc:290] T 5b9f8063585c4e5faddebd56fbe1aa01 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805), dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477)
I20260709 14:54:31.619704 15187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b9f8063585c4e5faddebd56fbe1aa01" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484" is_pre_election: true
I20260709 14:54:31.623618 15754 raft_consensus.cc:493] T 46ebd2bd84cc46e08c82a7b893e54578 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dbc2c92e49e346b5b3bd7705a229afc6)
I20260709 14:54:31.624378 15754 raft_consensus.cc:515] T 46ebd2bd84cc46e08c82a7b893e54578 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:31.627951 15754 leader_election.cc:290] T 46ebd2bd84cc46e08c82a7b893e54578 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805), dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477)
I20260709 14:54:31.635941 15187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46ebd2bd84cc46e08c82a7b893e54578" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484" is_pre_election: true
W20260709 14:54:31.640375 15227 leader_election.cc:336] T d61f9ecebc3c4a028f5327bc9debf432 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111)
I20260709 14:54:31.640813 15930 raft_consensus.cc:493] T 4abdbdda3ce149a9904e919be18e7a3f P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dbc2c92e49e346b5b3bd7705a229afc6)
I20260709 14:54:31.641216 15227 leader_election.cc:304] T d61f9ecebc3c4a028f5327bc9debf432 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cb8de0701f2482b99e51d5ac080aa13; no voters: 7519e608fbb44d9db8ad30b9f10ae605, dbc2c92e49e346b5b3bd7705a229afc6
I20260709 14:54:31.641851 15930 raft_consensus.cc:515] T 4abdbdda3ce149a9904e919be18e7a3f P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:31.645200 15930 leader_election.cc:290] T 4abdbdda3ce149a9904e919be18e7a3f P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805), dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477)
I20260709 14:54:31.642520 15754 raft_consensus.cc:2749] T d61f9ecebc3c4a028f5327bc9debf432 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 14:54:31.642455 15227 leader_election.cc:336] T 5b9f8063585c4e5faddebd56fbe1aa01 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111)
I20260709 14:54:31.646410 15227 leader_election.cc:304] T 5b9f8063585c4e5faddebd56fbe1aa01 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cb8de0701f2482b99e51d5ac080aa13; no voters: dbc2c92e49e346b5b3bd7705a229afc6, eaa34beb1b274443b1c46839afd0a484
I20260709 14:54:31.650297 15754 raft_consensus.cc:2749] T 5b9f8063585c4e5faddebd56fbe1aa01 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 14:54:31.650332 15187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abdbdda3ce149a9904e919be18e7a3f" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484" is_pre_election: true
I20260709 14:54:31.651244 15754 raft_consensus.cc:493] T d86dfc13b2834d7e8b2ad5f975f08154 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dbc2c92e49e346b5b3bd7705a229afc6)
I20260709 14:54:31.651772 15754 raft_consensus.cc:515] T d86dfc13b2834d7e8b2ad5f975f08154 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:31.653961 15754 leader_election.cc:290] T d86dfc13b2834d7e8b2ad5f975f08154 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805), dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477)
I20260709 14:54:31.659289 15881 raft_consensus.cc:493] T d326f264e68d41d69b5007023083ed9e P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dbc2c92e49e346b5b3bd7705a229afc6)
I20260709 14:54:31.659994 15892 raft_consensus.cc:493] T c61864fa2cd249d683f8fb90d8542480 P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dbc2c92e49e346b5b3bd7705a229afc6)
I20260709 14:54:31.659955 15881 raft_consensus.cc:515] T d326f264e68d41d69b5007023083ed9e P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:31.660672 15892 raft_consensus.cc:515] T c61864fa2cd249d683f8fb90d8542480 P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:31.661582 15187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86dfc13b2834d7e8b2ad5f975f08154" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484" is_pre_election: true
I20260709 14:54:31.663405 15892 leader_election.cc:290] T c61864fa2cd249d683f8fb90d8542480 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493), dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477)
I20260709 14:54:31.667351 15881 leader_election.cc:290] T d326f264e68d41d69b5007023083ed9e P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477), 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177)
W20260709 14:54:31.670806 15227 leader_election.cc:336] T 46ebd2bd84cc46e08c82a7b893e54578 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111)
I20260709 14:54:31.674194 15881 raft_consensus.cc:493] T db39b7ffe995451885f4074ddf16028d P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dbc2c92e49e346b5b3bd7705a229afc6)
I20260709 14:54:31.674959 15881 raft_consensus.cc:515] T db39b7ffe995451885f4074ddf16028d P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:31.676057 15892 raft_consensus.cc:493] T 5b9f8063585c4e5faddebd56fbe1aa01 P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dbc2c92e49e346b5b3bd7705a229afc6)
I20260709 14:54:31.679711 15892 raft_consensus.cc:515] T 5b9f8063585c4e5faddebd56fbe1aa01 P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:31.680811 15881 leader_election.cc:290] T db39b7ffe995451885f4074ddf16028d P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477), 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177)
I20260709 14:54:31.677644 15111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d326f264e68d41d69b5007023083ed9e" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605" is_pre_election: true
I20260709 14:54:31.682511 15892 leader_election.cc:290] T 5b9f8063585c4e5faddebd56fbe1aa01 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493), dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477)
I20260709 14:54:31.683763 15892 raft_consensus.cc:493] T d354c94548fc411ab62b4281ed947944 P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dbc2c92e49e346b5b3bd7705a229afc6)
I20260709 14:54:31.684365 15892 raft_consensus.cc:515] T d354c94548fc411ab62b4281ed947944 P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:31.687193 15892 leader_election.cc:290] T d354c94548fc411ab62b4281ed947944 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477), 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177)
I20260709 14:54:31.687276 15106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db39b7ffe995451885f4074ddf16028d" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605" is_pre_election: true
I20260709 14:54:31.689657 15111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d354c94548fc411ab62b4281ed947944" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605" is_pre_election: true
I20260709 14:54:31.673072 15227 leader_election.cc:304] T 46ebd2bd84cc46e08c82a7b893e54578 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cb8de0701f2482b99e51d5ac080aa13; no voters: dbc2c92e49e346b5b3bd7705a229afc6, eaa34beb1b274443b1c46839afd0a484
I20260709 14:54:31.691531 15930 raft_consensus.cc:2749] T 46ebd2bd84cc46e08c82a7b893e54578 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 14:54:31.694784 15261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61864fa2cd249d683f8fb90d8542480" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13" is_pre_election: true
I20260709 14:54:31.697981 15257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b9f8063585c4e5faddebd56fbe1aa01" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13" is_pre_election: true
I20260709 14:54:31.698824 15257 raft_consensus.cc:2468] T 5b9f8063585c4e5faddebd56fbe1aa01 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa34beb1b274443b1c46839afd0a484 in term 1.
W20260709 14:54:31.700917 15153 leader_election.cc:336] T c61864fa2cd249d683f8fb90d8542480 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111)
W20260709 14:54:31.701781 15153 leader_election.cc:336] T d326f264e68d41d69b5007023083ed9e P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111)
I20260709 14:54:31.708689 15754 raft_consensus.cc:493] T 9275d24f141d455cb200b9784c470d33 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dbc2c92e49e346b5b3bd7705a229afc6)
I20260709 14:54:31.722515 15754 raft_consensus.cc:515] T 9275d24f141d455cb200b9784c470d33 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:31.724871 15754 leader_election.cc:290] T 9275d24f141d455cb200b9784c470d33 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477), 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177)
I20260709 14:54:31.716593 15956 raft_consensus.cc:493] T 9275d24f141d455cb200b9784c470d33 P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dbc2c92e49e346b5b3bd7705a229afc6)
I20260709 14:54:31.728945 15956 raft_consensus.cc:515] T 9275d24f141d455cb200b9784c470d33 P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:31.727957 15111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275d24f141d455cb200b9784c470d33" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605" is_pre_election: true
I20260709 14:54:31.731221 15111 raft_consensus.cc:2468] T 9275d24f141d455cb200b9784c470d33 P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cb8de0701f2482b99e51d5ac080aa13 in term 1.
I20260709 14:54:31.733279 15224 leader_election.cc:304] T 9275d24f141d455cb200b9784c470d33 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7519e608fbb44d9db8ad30b9f10ae605, 9cb8de0701f2482b99e51d5ac080aa13; no voters: 
I20260709 14:54:31.737394 15754 raft_consensus.cc:2804] T 9275d24f141d455cb200b9784c470d33 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 14:54:31.739513 15754 raft_consensus.cc:493] T 9275d24f141d455cb200b9784c470d33 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Starting leader election (detected failure of leader dbc2c92e49e346b5b3bd7705a229afc6)
I20260709 14:54:31.740139 15754 raft_consensus.cc:3060] T 9275d24f141d455cb200b9784c470d33 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:54:31.738862 15956 leader_election.cc:290] T 9275d24f141d455cb200b9784c470d33 P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493), dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477)
I20260709 14:54:31.743853 15257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275d24f141d455cb200b9784c470d33" candidate_uuid: "7519e608fbb44d9db8ad30b9f10ae605" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13" is_pre_election: true
I20260709 14:54:31.744946 15153 leader_election.cc:304] T d326f264e68d41d69b5007023083ed9e P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa34beb1b274443b1c46839afd0a484; no voters: 7519e608fbb44d9db8ad30b9f10ae605, dbc2c92e49e346b5b3bd7705a229afc6
W20260709 14:54:31.745888 15079 leader_election.cc:336] T 9275d24f141d455cb200b9784c470d33 P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111)
I20260709 14:54:31.746049 15150 leader_election.cc:304] T c61864fa2cd249d683f8fb90d8542480 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa34beb1b274443b1c46839afd0a484; no voters: 9cb8de0701f2482b99e51d5ac080aa13, dbc2c92e49e346b5b3bd7705a229afc6
I20260709 14:54:31.748556 15962 raft_consensus.cc:2749] T d326f264e68d41d69b5007023083ed9e P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 14:54:31.748986 15892 raft_consensus.cc:2749] T c61864fa2cd249d683f8fb90d8542480 P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 14:54:31.749619 15153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:45477, user_credentials={real_user=slave}} blocked reactor thread for 47874.3us
I20260709 14:54:31.751040 15150 leader_election.cc:304] T 5b9f8063585c4e5faddebd56fbe1aa01 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cb8de0701f2482b99e51d5ac080aa13, eaa34beb1b274443b1c46839afd0a484; no voters: 
I20260709 14:54:31.752079 15892 raft_consensus.cc:2804] T 5b9f8063585c4e5faddebd56fbe1aa01 P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 14:54:31.747530 15227 leader_election.cc:336] T 4abdbdda3ce149a9904e919be18e7a3f P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111)
I20260709 14:54:31.752490 15892 raft_consensus.cc:493] T 5b9f8063585c4e5faddebd56fbe1aa01 P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Starting leader election (detected failure of leader dbc2c92e49e346b5b3bd7705a229afc6)
I20260709 14:54:31.752871 15892 raft_consensus.cc:3060] T 5b9f8063585c4e5faddebd56fbe1aa01 P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:54:31.763652 15892 raft_consensus.cc:515] T 5b9f8063585c4e5faddebd56fbe1aa01 P eaa34beb1b274443b1c46839afd0a484 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:31.766676 15892 leader_election.cc:290] T 5b9f8063585c4e5faddebd56fbe1aa01 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 2 election: Requested vote from peers 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493), dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477)
I20260709 14:54:31.772643 15227 leader_election.cc:304] T 4abdbdda3ce149a9904e919be18e7a3f P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cb8de0701f2482b99e51d5ac080aa13; no voters: dbc2c92e49e346b5b3bd7705a229afc6, eaa34beb1b274443b1c46839afd0a484
W20260709 14:54:31.774121 15227 leader_election.cc:336] T d86dfc13b2834d7e8b2ad5f975f08154 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111)
I20260709 14:54:31.774781 15227 leader_election.cc:304] T d86dfc13b2834d7e8b2ad5f975f08154 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cb8de0701f2482b99e51d5ac080aa13; no voters: dbc2c92e49e346b5b3bd7705a229afc6, eaa34beb1b274443b1c46839afd0a484
I20260709 14:54:31.775110 15942 raft_consensus.cc:2749] T 4abdbdda3ce149a9904e919be18e7a3f P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 14:54:31.775460 15962 raft_consensus.cc:493] T cc6f522768894933b21bc94b41605166 P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dbc2c92e49e346b5b3bd7705a229afc6)
I20260709 14:54:31.776026 15962 raft_consensus.cc:515] T cc6f522768894933b21bc94b41605166 P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:31.778501 15962 leader_election.cc:290] T cc6f522768894933b21bc94b41605166 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493), dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477)
W20260709 14:54:31.780644 15153 leader_election.cc:336] T db39b7ffe995451885f4074ddf16028d P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111)
I20260709 14:54:31.781930 15153 leader_election.cc:304] T db39b7ffe995451885f4074ddf16028d P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa34beb1b274443b1c46839afd0a484; no voters: 7519e608fbb44d9db8ad30b9f10ae605, dbc2c92e49e346b5b3bd7705a229afc6
I20260709 14:54:31.780884 15962 raft_consensus.cc:493] T d2463fd792b240e9911c6b38bcb453b8 P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dbc2c92e49e346b5b3bd7705a229afc6)
I20260709 14:54:31.782963 15881 raft_consensus.cc:2749] T db39b7ffe995451885f4074ddf16028d P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 14:54:31.783218 15962 raft_consensus.cc:515] T d2463fd792b240e9911c6b38bcb453b8 P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
W20260709 14:54:31.784174 15153 leader_election.cc:336] T 5b9f8063585c4e5faddebd56fbe1aa01 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111)
I20260709 14:54:31.787199 15942 raft_consensus.cc:2749] T d86dfc13b2834d7e8b2ad5f975f08154 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 14:54:31.791589  6549 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 14:54:31.791908 15962 leader_election.cc:290] T d2463fd792b240e9911c6b38bcb453b8 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493), dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477)
I20260709 14:54:31.792061  6549 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.446s	user 0.012s	sys 0.000s
W20260709 14:54:31.792781 15153 leader_election.cc:336] T d354c94548fc411ab62b4281ed947944 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111)
I20260709 14:54:31.792892  6549 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 14:54:31.785905 15754 raft_consensus.cc:515] T 9275d24f141d455cb200b9784c470d33 P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:31.798207 15257 raft_consensus.cc:2393] T 9275d24f141d455cb200b9784c470d33 P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7519e608fbb44d9db8ad30b9f10ae605 in current term 2: Already voted for candidate 9cb8de0701f2482b99e51d5ac080aa13 in this term.
I20260709 14:54:31.799463 15754 leader_election.cc:290] T 9275d24f141d455cb200b9784c470d33 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 2 election: Requested vote from peers dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477), 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177)
I20260709 14:54:31.800401 15153 leader_election.cc:304] T d354c94548fc411ab62b4281ed947944 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa34beb1b274443b1c46839afd0a484; no voters: 7519e608fbb44d9db8ad30b9f10ae605, dbc2c92e49e346b5b3bd7705a229afc6
I20260709 14:54:31.801668 15076 leader_election.cc:304] T 9275d24f141d455cb200b9784c470d33 P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7519e608fbb44d9db8ad30b9f10ae605; no voters: 9cb8de0701f2482b99e51d5ac080aa13, dbc2c92e49e346b5b3bd7705a229afc6
I20260709 14:54:31.804636 15956 raft_consensus.cc:3060] T 9275d24f141d455cb200b9784c470d33 P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:54:31.806100 15929 raft_consensus.cc:2749] T d354c94548fc411ab62b4281ed947944 P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 14:54:31.807179 15817 raft_consensus.cc:493] T 9f90ac0a3b004f6ca430ff2fc5198678 P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dbc2c92e49e346b5b3bd7705a229afc6)
I20260709 14:54:31.807842 15817 raft_consensus.cc:515] T 9f90ac0a3b004f6ca430ff2fc5198678 P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:31.809556 15111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275d24f141d455cb200b9784c470d33" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605"
I20260709 14:54:31.810325 15817 leader_election.cc:290] T 9f90ac0a3b004f6ca430ff2fc5198678 P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477), eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805)
I20260709 14:54:31.814440 15892 raft_consensus.cc:493] T 8bae8108fe2a4ce0ba3e35746c7ec9d1 P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dbc2c92e49e346b5b3bd7705a229afc6)
I20260709 14:54:31.815178 15892 raft_consensus.cc:515] T 8bae8108fe2a4ce0ba3e35746c7ec9d1 P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:31.816035 15817 raft_consensus.cc:493] T db39b7ffe995451885f4074ddf16028d P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dbc2c92e49e346b5b3bd7705a229afc6)
I20260709 14:54:31.817193 15817 raft_consensus.cc:515] T db39b7ffe995451885f4074ddf16028d P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:31.818161 15185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f90ac0a3b004f6ca430ff2fc5198678" candidate_uuid: "7519e608fbb44d9db8ad30b9f10ae605" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484" is_pre_election: true
I20260709 14:54:31.818231 15257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b9f8063585c4e5faddebd56fbe1aa01" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13"
I20260709 14:54:31.826195 15257 raft_consensus.cc:3060] T 5b9f8063585c4e5faddebd56fbe1aa01 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:54:31.819658 15261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc6f522768894933b21bc94b41605166" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13" is_pre_election: true
I20260709 14:54:31.820364 15256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2463fd792b240e9911c6b38bcb453b8" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13" is_pre_election: true
W20260709 14:54:31.833942 15079 leader_election.cc:336] T 9f90ac0a3b004f6ca430ff2fc5198678 P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111)
I20260709 14:54:31.834599 15079 leader_election.cc:304] T 9f90ac0a3b004f6ca430ff2fc5198678 P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7519e608fbb44d9db8ad30b9f10ae605; no voters: dbc2c92e49e346b5b3bd7705a229afc6, eaa34beb1b274443b1c46839afd0a484
I20260709 14:54:31.836283 15892 leader_election.cc:290] T 8bae8108fe2a4ce0ba3e35746c7ec9d1 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477), 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177)
I20260709 14:54:31.839099 15257 raft_consensus.cc:2468] T 5b9f8063585c4e5faddebd56fbe1aa01 P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa34beb1b274443b1c46839afd0a484 in term 2.
I20260709 14:54:31.842398 15817 leader_election.cc:290] T db39b7ffe995451885f4074ddf16028d P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477), eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805)
I20260709 14:54:31.854491 15817 raft_consensus.cc:493] T 0284d9835221427ab285015d48a8040d P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dbc2c92e49e346b5b3bd7705a229afc6)
I20260709 14:54:31.855093 15817 raft_consensus.cc:515] T 0284d9835221427ab285015d48a8040d P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:31.857491 15817 leader_election.cc:290] T 0284d9835221427ab285015d48a8040d P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477), 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493)
W20260709 14:54:31.843829 15153 leader_election.cc:336] T 5b9f8063585c4e5faddebd56fbe1aa01 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111)
I20260709 14:54:31.844229 15964 tablet_bootstrap.cc:492] T f389b12c6b304243905f28267dfaeed0 P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap starting.
W20260709 14:54:31.858255 15153 leader_election.cc:336] T cc6f522768894933b21bc94b41605166 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111)
W20260709 14:54:31.858878 15153 leader_election.cc:336] T d2463fd792b240e9911c6b38bcb453b8 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111)
W20260709 14:54:31.826222 15227 leader_election.cc:336] T 9275d24f141d455cb200b9784c470d33 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111)
I20260709 14:54:31.858878 15256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0284d9835221427ab285015d48a8040d" candidate_uuid: "7519e608fbb44d9db8ad30b9f10ae605" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13" is_pre_election: true
I20260709 14:54:31.850322 15956 raft_consensus.cc:2749] T 9275d24f141d455cb200b9784c470d33 P 7519e608fbb44d9db8ad30b9f10ae605 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 14:54:31.846300 15965 raft_consensus.cc:2749] T 9f90ac0a3b004f6ca430ff2fc5198678 P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 14:54:31.863300 15965 raft_consensus.cc:493] T 91c9f89fcb8b45ff9be43f535cafffde P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dbc2c92e49e346b5b3bd7705a229afc6)
I20260709 14:54:31.864008 15965 raft_consensus.cc:515] T 91c9f89fcb8b45ff9be43f535cafffde P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:31.866580 15965 leader_election.cc:290] T 91c9f89fcb8b45ff9be43f535cafffde P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477), eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805)
I20260709 14:54:31.870564 15150 leader_election.cc:304] T cc6f522768894933b21bc94b41605166 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa34beb1b274443b1c46839afd0a484; no voters: 9cb8de0701f2482b99e51d5ac080aa13, dbc2c92e49e346b5b3bd7705a229afc6
I20260709 14:54:31.872263 15150 leader_election.cc:304] T d2463fd792b240e9911c6b38bcb453b8 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa34beb1b274443b1c46839afd0a484; no voters: 9cb8de0701f2482b99e51d5ac080aa13, dbc2c92e49e346b5b3bd7705a229afc6
I20260709 14:54:31.873631 15881 raft_consensus.cc:2749] T cc6f522768894933b21bc94b41605166 P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 14:54:31.874415 15881 raft_consensus.cc:2749] T d2463fd792b240e9911c6b38bcb453b8 P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 14:54:31.879135 15227 leader_election.cc:336] T 9275d24f141d455cb200b9784c470d33 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111)
I20260709 14:54:31.880231 15185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db39b7ffe995451885f4074ddf16028d" candidate_uuid: "7519e608fbb44d9db8ad30b9f10ae605" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484" is_pre_election: true
I20260709 14:54:31.880993 15185 raft_consensus.cc:2468] T db39b7ffe995451885f4074ddf16028d P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7519e608fbb44d9db8ad30b9f10ae605 in term 1.
I20260709 14:54:31.882661 15150 leader_election.cc:304] T 5b9f8063585c4e5faddebd56fbe1aa01 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9cb8de0701f2482b99e51d5ac080aa13, eaa34beb1b274443b1c46839afd0a484; no voters: dbc2c92e49e346b5b3bd7705a229afc6
I20260709 14:54:31.883692 15929 raft_consensus.cc:493] T 4abdbdda3ce149a9904e919be18e7a3f P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dbc2c92e49e346b5b3bd7705a229afc6)
I20260709 14:54:31.884271 15929 raft_consensus.cc:515] T 4abdbdda3ce149a9904e919be18e7a3f P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:31.886632 15962 raft_consensus.cc:2804] T 5b9f8063585c4e5faddebd56fbe1aa01 P eaa34beb1b274443b1c46839afd0a484 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:54:31.887223 15929 leader_election.cc:290] T 4abdbdda3ce149a9904e919be18e7a3f P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493), dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477)
I20260709 14:54:31.888042 15929 raft_consensus.cc:493] T 91c9f89fcb8b45ff9be43f535cafffde P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dbc2c92e49e346b5b3bd7705a229afc6)
I20260709 14:54:31.888696 15929 raft_consensus.cc:515] T 91c9f89fcb8b45ff9be43f535cafffde P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:31.891748 15929 leader_election.cc:290] T 91c9f89fcb8b45ff9be43f535cafffde P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477), 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177)
I20260709 14:54:31.892691 15962 raft_consensus.cc:697] T 5b9f8063585c4e5faddebd56fbe1aa01 P eaa34beb1b274443b1c46839afd0a484 [term 2 LEADER]: Becoming Leader. State: Replica: eaa34beb1b274443b1c46839afd0a484, State: Running, Role: LEADER
I20260709 14:54:31.894232 15962 consensus_queue.cc:237] T 5b9f8063585c4e5faddebd56fbe1aa01 P eaa34beb1b274443b1c46839afd0a484 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:31.897394 15111 raft_consensus.cc:2468] T 9275d24f141d455cb200b9784c470d33 P 7519e608fbb44d9db8ad30b9f10ae605 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cb8de0701f2482b99e51d5ac080aa13 in term 2.
W20260709 14:54:31.886308 15153 leader_election.cc:336] T 8bae8108fe2a4ce0ba3e35746c7ec9d1 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111)
I20260709 14:54:31.918958 15185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c9f89fcb8b45ff9be43f535cafffde" candidate_uuid: "7519e608fbb44d9db8ad30b9f10ae605" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484" is_pre_election: true
I20260709 14:54:31.920010 15185 raft_consensus.cc:2468] T 91c9f89fcb8b45ff9be43f535cafffde P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7519e608fbb44d9db8ad30b9f10ae605 in term 1.
I20260709 14:54:31.930751 15111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bae8108fe2a4ce0ba3e35746c7ec9d1" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605" is_pre_election: true
I20260709 14:54:31.939592 15224 leader_election.cc:304] T 9275d24f141d455cb200b9784c470d33 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7519e608fbb44d9db8ad30b9f10ae605, 9cb8de0701f2482b99e51d5ac080aa13; no voters: dbc2c92e49e346b5b3bd7705a229afc6
I20260709 14:54:31.940948 15754 raft_consensus.cc:2804] T 9275d24f141d455cb200b9784c470d33 P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:54:31.942143 15817 raft_consensus.cc:493] T d61f9ecebc3c4a028f5327bc9debf432 P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dbc2c92e49e346b5b3bd7705a229afc6)
I20260709 14:54:31.942297 15754 raft_consensus.cc:697] T 9275d24f141d455cb200b9784c470d33 P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 LEADER]: Becoming Leader. State: Replica: 9cb8de0701f2482b99e51d5ac080aa13, State: Running, Role: LEADER
I20260709 14:54:31.942844 15817 raft_consensus.cc:515] T d61f9ecebc3c4a028f5327bc9debf432 P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:31.943361 15942 raft_consensus.cc:493] T cc6f522768894933b21bc94b41605166 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dbc2c92e49e346b5b3bd7705a229afc6)
I20260709 14:54:31.943876 15942 raft_consensus.cc:515] T cc6f522768894933b21bc94b41605166 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:31.945393 15965 raft_consensus.cc:493] T d326f264e68d41d69b5007023083ed9e P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dbc2c92e49e346b5b3bd7705a229afc6)
I20260709 14:54:31.945415 14935 catalog_manager.cc:5697] T 5b9f8063585c4e5faddebd56fbe1aa01 P eaa34beb1b274443b1c46839afd0a484 reported cstate change: term changed from 1 to 2, leader changed from dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65) to eaa34beb1b274443b1c46839afd0a484 (127.6.101.67). New cstate: current_term: 2 leader_uuid: "eaa34beb1b274443b1c46839afd0a484" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } health_report { overall_health: UNKNOWN } } }
I20260709 14:54:31.946373 15965 raft_consensus.cc:515] T d326f264e68d41d69b5007023083ed9e P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:31.947356 15257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d61f9ecebc3c4a028f5327bc9debf432" candidate_uuid: "7519e608fbb44d9db8ad30b9f10ae605" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13" is_pre_election: true
I20260709 14:54:31.947966 15817 leader_election.cc:290] T d61f9ecebc3c4a028f5327bc9debf432 P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493), dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477)
I20260709 14:54:31.948225 15257 raft_consensus.cc:2468] T d61f9ecebc3c4a028f5327bc9debf432 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7519e608fbb44d9db8ad30b9f10ae605 in term 1.
I20260709 14:54:31.948745 15965 leader_election.cc:290] T d326f264e68d41d69b5007023083ed9e P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477), eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805)
I20260709 14:54:31.949625 15076 leader_election.cc:304] T d61f9ecebc3c4a028f5327bc9debf432 P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7519e608fbb44d9db8ad30b9f10ae605, 9cb8de0701f2482b99e51d5ac080aa13; no voters: 
I20260709 14:54:31.950481 15965 raft_consensus.cc:2804] T d61f9ecebc3c4a028f5327bc9debf432 P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 14:54:31.950989 15965 raft_consensus.cc:493] T d61f9ecebc3c4a028f5327bc9debf432 P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Starting leader election (detected failure of leader dbc2c92e49e346b5b3bd7705a229afc6)
I20260709 14:54:31.951277 15956 raft_consensus.cc:493] T 8bae8108fe2a4ce0ba3e35746c7ec9d1 P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dbc2c92e49e346b5b3bd7705a229afc6)
I20260709 14:54:31.951409 15965 raft_consensus.cc:3060] T d61f9ecebc3c4a028f5327bc9debf432 P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:54:31.949069 15817 raft_consensus.cc:493] T 7f2cd7c8159d43c080fd8302180ecfca P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dbc2c92e49e346b5b3bd7705a229afc6)
I20260709 14:54:31.947351 15942 leader_election.cc:290] T cc6f522768894933b21bc94b41605166 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805), dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477)
I20260709 14:54:31.952195 15817 raft_consensus.cc:515] T 7f2cd7c8159d43c080fd8302180ecfca P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:31.956660 15817 leader_election.cc:290] T 7f2cd7c8159d43c080fd8302180ecfca P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805), dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477)
I20260709 14:54:31.952831 15956 raft_consensus.cc:515] T 8bae8108fe2a4ce0ba3e35746c7ec9d1 P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:31.959265 15956 leader_election.cc:290] T 8bae8108fe2a4ce0ba3e35746c7ec9d1 P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477), eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805)
I20260709 14:54:31.960678 15754 consensus_queue.cc:237] T 9275d24f141d455cb200b9784c470d33 P 9cb8de0701f2482b99e51d5ac080aa13 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:31.962945 15881 raft_consensus.cc:493] T 46ebd2bd84cc46e08c82a7b893e54578 P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dbc2c92e49e346b5b3bd7705a229afc6)
I20260709 14:54:31.963692 15881 raft_consensus.cc:515] T 46ebd2bd84cc46e08c82a7b893e54578 P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:31.966768 15881 leader_election.cc:290] T 46ebd2bd84cc46e08c82a7b893e54578 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493), dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477)
I20260709 14:54:31.966970 15110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c9f89fcb8b45ff9be43f535cafffde" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605" is_pre_election: true
I20260709 14:54:31.968111 15110 raft_consensus.cc:2468] T 91c9f89fcb8b45ff9be43f535cafffde P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa34beb1b274443b1c46839afd0a484 in term 1.
I20260709 14:54:31.969782 15929 raft_consensus.cc:493] T 9f90ac0a3b004f6ca430ff2fc5198678 P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dbc2c92e49e346b5b3bd7705a229afc6)
I20260709 14:54:31.970635 15929 raft_consensus.cc:515] T 9f90ac0a3b004f6ca430ff2fc5198678 P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:31.974130 15150 leader_election.cc:304] T 8bae8108fe2a4ce0ba3e35746c7ec9d1 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa34beb1b274443b1c46839afd0a484; no voters: 7519e608fbb44d9db8ad30b9f10ae605, dbc2c92e49e346b5b3bd7705a229afc6
I20260709 14:54:31.975575 15881 raft_consensus.cc:2749] T 8bae8108fe2a4ce0ba3e35746c7ec9d1 P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 14:54:31.984217 15964 tablet_bootstrap.cc:492] T f389b12c6b304243905f28267dfaeed0 P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 14:54:31.985880 15929 leader_election.cc:290] T 9f90ac0a3b004f6ca430ff2fc5198678 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477), 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177)
I20260709 14:54:31.990691 15965 raft_consensus.cc:515] T d61f9ecebc3c4a028f5327bc9debf432 P 7519e608fbb44d9db8ad30b9f10ae605 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:31.994843 15257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abdbdda3ce149a9904e919be18e7a3f" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13" is_pre_election: true
I20260709 14:54:31.995872 15257 raft_consensus.cc:2468] T 4abdbdda3ce149a9904e919be18e7a3f P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa34beb1b274443b1c46839afd0a484 in term 1.
I20260709 14:54:31.996819 15929 raft_consensus.cc:493] T 46a35b81512c4e8c8ec6b83d4c768e1f P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dbc2c92e49e346b5b3bd7705a229afc6)
W20260709 14:54:31.997502 15153 leader_election.cc:336] T 4abdbdda3ce149a9904e919be18e7a3f P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111)
I20260709 14:54:31.997673 15929 raft_consensus.cc:515] T 46a35b81512c4e8c8ec6b83d4c768e1f P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:32.001605 15964 tablet_bootstrap.cc:492] T f389b12c6b304243905f28267dfaeed0 P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap complete.
I20260709 14:54:32.002723 15964 ts_tablet_manager.cc:1403] T f389b12c6b304243905f28267dfaeed0 P dbc2c92e49e346b5b3bd7705a229afc6: Time spent bootstrapping tablet: real 0.159s	user 0.016s	sys 0.008s
I20260709 14:54:32.006042 15929 leader_election.cc:290] T 46a35b81512c4e8c8ec6b83d4c768e1f P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493), dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477)
I20260709 14:54:32.009876 15257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46ebd2bd84cc46e08c82a7b893e54578" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13" is_pre_election: true
I20260709 14:54:32.010795 15257 raft_consensus.cc:2468] T 46ebd2bd84cc46e08c82a7b893e54578 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa34beb1b274443b1c46839afd0a484 in term 1.
I20260709 14:54:32.013172 15806 raft_consensus.cc:493] T 46a35b81512c4e8c8ec6b83d4c768e1f P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dbc2c92e49e346b5b3bd7705a229afc6)
I20260709 14:54:32.013885 15806 raft_consensus.cc:515] T 46a35b81512c4e8c8ec6b83d4c768e1f P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:32.015461 15965 leader_election.cc:290] T d61f9ecebc3c4a028f5327bc9debf432 P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 2 election: Requested vote from peers 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493), dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477)
I20260709 14:54:32.016194 15806 leader_election.cc:290] T 46a35b81512c4e8c8ec6b83d4c768e1f P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805), dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477)
I20260709 14:54:32.016625 15257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d61f9ecebc3c4a028f5327bc9debf432" candidate_uuid: "7519e608fbb44d9db8ad30b9f10ae605" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13"
I20260709 14:54:32.017401 15257 raft_consensus.cc:3060] T d61f9ecebc3c4a028f5327bc9debf432 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:54:32.019901 15962 raft_consensus.cc:493] T d86dfc13b2834d7e8b2ad5f975f08154 P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dbc2c92e49e346b5b3bd7705a229afc6)
I20260709 14:54:32.020553 15962 raft_consensus.cc:515] T d86dfc13b2834d7e8b2ad5f975f08154 P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
W20260709 14:54:32.021435 15153 leader_election.cc:336] T 91c9f89fcb8b45ff9be43f535cafffde P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111)
I20260709 14:54:32.024405 15962 leader_election.cc:290] T d86dfc13b2834d7e8b2ad5f975f08154 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493), dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477)
I20260709 14:54:32.025976 15964 raft_consensus.cc:359] T f389b12c6b304243905f28267dfaeed0 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:32.026917 15964 raft_consensus.cc:740] T f389b12c6b304243905f28267dfaeed0 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbc2c92e49e346b5b3bd7705a229afc6, State: Initialized, Role: FOLLOWER
I20260709 14:54:32.027858 15964 consensus_queue.cc:260] T f389b12c6b304243905f28267dfaeed0 P dbc2c92e49e346b5b3bd7705a229afc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:32.030697 15256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86dfc13b2834d7e8b2ad5f975f08154" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13" is_pre_election: true
I20260709 14:54:32.031556 15256 raft_consensus.cc:2468] T d86dfc13b2834d7e8b2ad5f975f08154 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa34beb1b274443b1c46839afd0a484 in term 1.
I20260709 14:54:32.032009 15187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc6f522768894933b21bc94b41605166" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484" is_pre_election: true
I20260709 14:54:32.032372 15261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a35b81512c4e8c8ec6b83d4c768e1f" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13" is_pre_election: true
I20260709 14:54:32.032899 15187 raft_consensus.cc:2468] T cc6f522768894933b21bc94b41605166 P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cb8de0701f2482b99e51d5ac080aa13 in term 1.
I20260709 14:54:32.033130 15261 raft_consensus.cc:2468] T 46a35b81512c4e8c8ec6b83d4c768e1f P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa34beb1b274443b1c46839afd0a484 in term 1.
I20260709 14:54:32.042892 15150 leader_election.cc:304] T 4abdbdda3ce149a9904e919be18e7a3f P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9cb8de0701f2482b99e51d5ac080aa13, eaa34beb1b274443b1c46839afd0a484; no voters: dbc2c92e49e346b5b3bd7705a229afc6
I20260709 14:54:32.044925 15962 raft_consensus.cc:2804] T 4abdbdda3ce149a9904e919be18e7a3f P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 14:54:32.045446 15962 raft_consensus.cc:493] T 4abdbdda3ce149a9904e919be18e7a3f P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Starting leader election (detected failure of leader dbc2c92e49e346b5b3bd7705a229afc6)
I20260709 14:54:32.045830 15962 raft_consensus.cc:3060] T 4abdbdda3ce149a9904e919be18e7a3f P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:54:32.046072 15187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d326f264e68d41d69b5007023083ed9e" candidate_uuid: "7519e608fbb44d9db8ad30b9f10ae605" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484" is_pre_election: true
I20260709 14:54:32.046844 15187 raft_consensus.cc:2468] T d326f264e68d41d69b5007023083ed9e P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7519e608fbb44d9db8ad30b9f10ae605 in term 1.
I20260709 14:54:32.048046 15964 ts_tablet_manager.cc:1434] T f389b12c6b304243905f28267dfaeed0 P dbc2c92e49e346b5b3bd7705a229afc6: Time spent starting tablet: real 0.045s	user 0.010s	sys 0.000s
I20260709 14:54:32.049232 15187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2cd7c8159d43c080fd8302180ecfca" candidate_uuid: "7519e608fbb44d9db8ad30b9f10ae605" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484" is_pre_election: true
I20260709 14:54:32.055778 15187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bae8108fe2a4ce0ba3e35746c7ec9d1" candidate_uuid: "7519e608fbb44d9db8ad30b9f10ae605" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484" is_pre_election: true
I20260709 14:54:32.056674 15187 raft_consensus.cc:2468] T 8bae8108fe2a4ce0ba3e35746c7ec9d1 P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7519e608fbb44d9db8ad30b9f10ae605 in term 1.
I20260709 14:54:32.040884 15257 raft_consensus.cc:2468] T d61f9ecebc3c4a028f5327bc9debf432 P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7519e608fbb44d9db8ad30b9f10ae605 in term 2.
I20260709 14:54:32.058847 15076 leader_election.cc:304] T d61f9ecebc3c4a028f5327bc9debf432 P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7519e608fbb44d9db8ad30b9f10ae605, 9cb8de0701f2482b99e51d5ac080aa13; no voters: 
I20260709 14:54:32.060117 15967 raft_consensus.cc:2804] T d61f9ecebc3c4a028f5327bc9debf432 P 7519e608fbb44d9db8ad30b9f10ae605 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:54:32.060761 15967 raft_consensus.cc:697] T d61f9ecebc3c4a028f5327bc9debf432 P 7519e608fbb44d9db8ad30b9f10ae605 [term 2 LEADER]: Becoming Leader. State: Replica: 7519e608fbb44d9db8ad30b9f10ae605, State: Running, Role: LEADER
I20260709 14:54:32.061724 15967 consensus_queue.cc:237] T d61f9ecebc3c4a028f5327bc9debf432 P 7519e608fbb44d9db8ad30b9f10ae605 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:32.049376 15964 tablet_bootstrap.cc:492] T db39b7ffe995451885f4074ddf16028d P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap starting.
I20260709 14:54:32.071368 15150 leader_election.cc:304] T 91c9f89fcb8b45ff9be43f535cafffde P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7519e608fbb44d9db8ad30b9f10ae605, eaa34beb1b274443b1c46839afd0a484; no voters: dbc2c92e49e346b5b3bd7705a229afc6
W20260709 14:54:32.055912 15153 leader_election.cc:336] T 46ebd2bd84cc46e08c82a7b893e54578 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111)
W20260709 14:54:32.075544 15153 leader_election.cc:336] T 9f90ac0a3b004f6ca430ff2fc5198678 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111)
I20260709 14:54:32.084961 15942 raft_consensus.cc:493] T 0284d9835221427ab285015d48a8040d P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dbc2c92e49e346b5b3bd7705a229afc6)
I20260709 14:54:32.085839 15187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a35b81512c4e8c8ec6b83d4c768e1f" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484" is_pre_election: true
I20260709 14:54:32.086130 15079 leader_election.cc:304] T db39b7ffe995451885f4074ddf16028d P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7519e608fbb44d9db8ad30b9f10ae605, eaa34beb1b274443b1c46839afd0a484; no voters: 
I20260709 14:54:32.086725 15187 raft_consensus.cc:2468] T 46a35b81512c4e8c8ec6b83d4c768e1f P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cb8de0701f2482b99e51d5ac080aa13 in term 1.
I20260709 14:54:32.087262 15079 leader_election.cc:304] T 91c9f89fcb8b45ff9be43f535cafffde P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7519e608fbb44d9db8ad30b9f10ae605, eaa34beb1b274443b1c46839afd0a484; no voters: 
I20260709 14:54:32.087987 15965 raft_consensus.cc:493] T d354c94548fc411ab62b4281ed947944 P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dbc2c92e49e346b5b3bd7705a229afc6)
I20260709 14:54:32.086666 15881 raft_consensus.cc:2804] T 91c9f89fcb8b45ff9be43f535cafffde P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 14:54:32.101145 14933 catalog_manager.cc:5697] T 9275d24f141d455cb200b9784c470d33 P 9cb8de0701f2482b99e51d5ac080aa13 reported cstate change: term changed from 1 to 2, leader changed from dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65) to 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68). New cstate: current_term: 2 leader_uuid: "9cb8de0701f2482b99e51d5ac080aa13" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } health_report { overall_health: UNKNOWN } } }
I20260709 14:54:32.076437 15930 raft_consensus.cc:493] T c61864fa2cd249d683f8fb90d8542480 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dbc2c92e49e346b5b3bd7705a229afc6)
I20260709 14:54:32.059917 15962 raft_consensus.cc:515] T 4abdbdda3ce149a9904e919be18e7a3f P eaa34beb1b274443b1c46839afd0a484 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
W20260709 14:54:32.144449 15079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:33805, user_credentials={real_user=slave}} blocked reactor thread for 56217.8us
I20260709 14:54:32.145896 15079 leader_election.cc:304] T d326f264e68d41d69b5007023083ed9e P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7519e608fbb44d9db8ad30b9f10ae605, eaa34beb1b274443b1c46839afd0a484; no voters: 
W20260709 14:54:32.139505 15150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.68:45493, user_credentials={real_user=slave}} blocked reactor thread for 66201.3us
W20260709 14:54:32.141290 15076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.68:45493, user_credentials={real_user=slave}} blocked reactor thread for 47741.6us
I20260709 14:54:32.091846 15817 raft_consensus.cc:2804] T db39b7ffe995451885f4074ddf16028d P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 14:54:32.091518 15956 raft_consensus.cc:2804] T 91c9f89fcb8b45ff9be43f535cafffde P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 14:54:32.149856 15150 leader_election.cc:304] T 46ebd2bd84cc46e08c82a7b893e54578 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9cb8de0701f2482b99e51d5ac080aa13, eaa34beb1b274443b1c46839afd0a484; no voters: dbc2c92e49e346b5b3bd7705a229afc6
I20260709 14:54:32.152299 15978 raft_consensus.cc:2804] T d326f264e68d41d69b5007023083ed9e P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 14:54:32.152747 15754 raft_consensus.cc:493] T d2463fd792b240e9911c6b38bcb453b8 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dbc2c92e49e346b5b3bd7705a229afc6)
I20260709 14:54:32.085839 15942 raft_consensus.cc:515] T 0284d9835221427ab285015d48a8040d P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:32.139405 15881 raft_consensus.cc:493] T 91c9f89fcb8b45ff9be43f535cafffde P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Starting leader election (detected failure of leader dbc2c92e49e346b5b3bd7705a229afc6)
I20260709 14:54:32.092119 15965 raft_consensus.cc:515] T d354c94548fc411ab62b4281ed947944 P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:32.155936 15754 raft_consensus.cc:515] T d2463fd792b240e9911c6b38bcb453b8 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:32.149806 15817 raft_consensus.cc:493] T db39b7ffe995451885f4074ddf16028d P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Starting leader election (detected failure of leader dbc2c92e49e346b5b3bd7705a229afc6)
I20260709 14:54:32.143352 15930 raft_consensus.cc:515] T c61864fa2cd249d683f8fb90d8542480 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:32.153854 15956 raft_consensus.cc:493] T 91c9f89fcb8b45ff9be43f535cafffde P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Starting leader election (detected failure of leader dbc2c92e49e346b5b3bd7705a229afc6)
I20260709 14:54:32.166247 15956 raft_consensus.cc:3060] T 91c9f89fcb8b45ff9be43f535cafffde P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:54:32.166824 15942 leader_election.cc:290] T 0284d9835221427ab285015d48a8040d P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477), 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177)
I20260709 14:54:32.157539 15892 raft_consensus.cc:2804] T 46ebd2bd84cc46e08c82a7b893e54578 P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 14:54:32.159361 15881 raft_consensus.cc:3060] T 91c9f89fcb8b45ff9be43f535cafffde P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:54:32.171058 15817 raft_consensus.cc:3060] T db39b7ffe995451885f4074ddf16028d P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:54:32.171123 15754 leader_election.cc:290] T d2463fd792b240e9911c6b38bcb453b8 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805), dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477)
I20260709 14:54:32.172328 15962 leader_election.cc:290] T 4abdbdda3ce149a9904e919be18e7a3f P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 2 election: Requested vote from peers 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493), dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477)
I20260709 14:54:32.173061 15930 leader_election.cc:290] T c61864fa2cd249d683f8fb90d8542480 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805), dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477)
I20260709 14:54:32.173436 15892 raft_consensus.cc:493] T 46ebd2bd84cc46e08c82a7b893e54578 P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Starting leader election (detected failure of leader dbc2c92e49e346b5b3bd7705a229afc6)
I20260709 14:54:32.180789 15892 raft_consensus.cc:3060] T 46ebd2bd84cc46e08c82a7b893e54578 P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:54:32.173979 15110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0284d9835221427ab285015d48a8040d" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605" is_pre_election: true
I20260709 14:54:32.186574 15110 raft_consensus.cc:2468] T 0284d9835221427ab285015d48a8040d P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cb8de0701f2482b99e51d5ac080aa13 in term 1.
I20260709 14:54:32.164913 15965 leader_election.cc:290] T d354c94548fc411ab62b4281ed947944 P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477), eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805)
I20260709 14:54:32.189393 15224 leader_election.cc:304] T 0284d9835221427ab285015d48a8040d P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7519e608fbb44d9db8ad30b9f10ae605, 9cb8de0701f2482b99e51d5ac080aa13; no voters: 
I20260709 14:54:32.155727 15978 raft_consensus.cc:493] T d326f264e68d41d69b5007023083ed9e P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Starting leader election (detected failure of leader dbc2c92e49e346b5b3bd7705a229afc6)
I20260709 14:54:32.193279 15978 raft_consensus.cc:3060] T d326f264e68d41d69b5007023083ed9e P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:54:32.192886 15977 raft_consensus.cc:2804] T 0284d9835221427ab285015d48a8040d P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 14:54:32.198272 15977 raft_consensus.cc:493] T 0284d9835221427ab285015d48a8040d P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Starting leader election (detected failure of leader dbc2c92e49e346b5b3bd7705a229afc6)
I20260709 14:54:32.198921 15977 raft_consensus.cc:3060] T 0284d9835221427ab285015d48a8040d P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:54:32.199327 14936 catalog_manager.cc:5697] T d61f9ecebc3c4a028f5327bc9debf432 P 7519e608fbb44d9db8ad30b9f10ae605 reported cstate change: term changed from 1 to 2, leader changed from dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65) to 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66). New cstate: current_term: 2 leader_uuid: "7519e608fbb44d9db8ad30b9f10ae605" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } health_report { overall_health: HEALTHY } } }
I20260709 14:54:32.247051 15976 raft_consensus.cc:493] T 7f2cd7c8159d43c080fd8302180ecfca P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dbc2c92e49e346b5b3bd7705a229afc6)
I20260709 14:54:32.251185 15976 raft_consensus.cc:515] T 7f2cd7c8159d43c080fd8302180ecfca P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:32.241166 15956 raft_consensus.cc:515] T 91c9f89fcb8b45ff9be43f535cafffde P 7519e608fbb44d9db8ad30b9f10ae605 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:32.254130 15976 leader_election.cc:290] T 7f2cd7c8159d43c080fd8302180ecfca P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477), 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177)
W20260709 14:54:32.262682 15079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:33805, user_credentials={real_user=slave}} blocked reactor thread for 117183us
I20260709 14:54:32.264192 15079 leader_election.cc:304] T 8bae8108fe2a4ce0ba3e35746c7ec9d1 P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7519e608fbb44d9db8ad30b9f10ae605, eaa34beb1b274443b1c46839afd0a484; no voters: 
I20260709 14:54:32.266223 15964 tablet_bootstrap.cc:492] T db39b7ffe995451885f4074ddf16028d P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 14:54:32.262729 15892 raft_consensus.cc:515] T 46ebd2bd84cc46e08c82a7b893e54578 P eaa34beb1b274443b1c46839afd0a484 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:32.267686 15964 tablet_bootstrap.cc:492] T db39b7ffe995451885f4074ddf16028d P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap complete.
I20260709 14:54:32.268607 15956 leader_election.cc:290] T 91c9f89fcb8b45ff9be43f535cafffde P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 2 election: Requested vote from peers dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477), eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805)
I20260709 14:54:32.247912 15881 raft_consensus.cc:515] T 91c9f89fcb8b45ff9be43f535cafffde P eaa34beb1b274443b1c46839afd0a484 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:32.250085 15817 raft_consensus.cc:515] T db39b7ffe995451885f4074ddf16028d P 7519e608fbb44d9db8ad30b9f10ae605 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:32.270857 15892 leader_election.cc:290] T 46ebd2bd84cc46e08c82a7b893e54578 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 2 election: Requested vote from peers 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493), dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477)
I20260709 14:54:32.271860 15956 raft_consensus.cc:2804] T 8bae8108fe2a4ce0ba3e35746c7ec9d1 P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 14:54:32.273983 15956 raft_consensus.cc:493] T 8bae8108fe2a4ce0ba3e35746c7ec9d1 P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Starting leader election (detected failure of leader dbc2c92e49e346b5b3bd7705a229afc6)
I20260709 14:54:32.276057 15817 leader_election.cc:290] T db39b7ffe995451885f4074ddf16028d P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 2 election: Requested vote from peers dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477), eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805)
I20260709 14:54:32.274657 15956 raft_consensus.cc:3060] T 8bae8108fe2a4ce0ba3e35746c7ec9d1 P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Advancing to term 2
W20260709 14:54:32.278883 15153 leader_election.cc:336] T 46a35b81512c4e8c8ec6b83d4c768e1f P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111)
W20260709 14:54:32.280558 15153 leader_election.cc:336] T d86dfc13b2834d7e8b2ad5f975f08154 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111)
I20260709 14:54:32.287153 15187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2463fd792b240e9911c6b38bcb453b8" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484" is_pre_election: true
I20260709 14:54:32.288319 15187 raft_consensus.cc:2468] T d2463fd792b240e9911c6b38bcb453b8 P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cb8de0701f2482b99e51d5ac080aa13 in term 1.
I20260709 14:54:32.269125 15964 ts_tablet_manager.cc:1403] T db39b7ffe995451885f4074ddf16028d P dbc2c92e49e346b5b3bd7705a229afc6: Time spent bootstrapping tablet: real 0.220s	user 0.018s	sys 0.006s
I20260709 14:54:32.290184 15187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61864fa2cd249d683f8fb90d8542480" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484" is_pre_election: true
I20260709 14:54:32.291141 15187 raft_consensus.cc:2468] T c61864fa2cd249d683f8fb90d8542480 P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cb8de0701f2482b99e51d5ac080aa13 in term 1.
I20260709 14:54:32.291312 15257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abdbdda3ce149a9904e919be18e7a3f" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13"
I20260709 14:54:32.292136 15257 raft_consensus.cc:3060] T 4abdbdda3ce149a9904e919be18e7a3f P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Advancing to term 2
W20260709 14:54:32.270227 15079 leader_election.cc:336] T db39b7ffe995451885f4074ddf16028d P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111)
I20260709 14:54:32.283675 15881 leader_election.cc:290] T 91c9f89fcb8b45ff9be43f535cafffde P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 2 election: Requested vote from peers dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477), 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177)
W20260709 14:54:32.293548 15079 leader_election.cc:336] T 0284d9835221427ab285015d48a8040d P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111)
I20260709 14:54:32.294036 15079 leader_election.cc:304] T 0284d9835221427ab285015d48a8040d P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7519e608fbb44d9db8ad30b9f10ae605; no voters: 9cb8de0701f2482b99e51d5ac080aa13, dbc2c92e49e346b5b3bd7705a229afc6
I20260709 14:54:32.295135 15985 raft_consensus.cc:2749] T 0284d9835221427ab285015d48a8040d P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 14:54:32.297735 15964 raft_consensus.cc:359] T db39b7ffe995451885f4074ddf16028d P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:32.299086 15964 raft_consensus.cc:740] T db39b7ffe995451885f4074ddf16028d P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbc2c92e49e346b5b3bd7705a229afc6, State: Initialized, Role: FOLLOWER
W20260709 14:54:32.301738 15153 leader_election.cc:336] T 4abdbdda3ce149a9904e919be18e7a3f P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111)
I20260709 14:54:32.305449 15150 leader_election.cc:304] T d86dfc13b2834d7e8b2ad5f975f08154 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9cb8de0701f2482b99e51d5ac080aa13, eaa34beb1b274443b1c46839afd0a484; no voters: dbc2c92e49e346b5b3bd7705a229afc6
I20260709 14:54:32.307125 15150 leader_election.cc:304] T 46a35b81512c4e8c8ec6b83d4c768e1f P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9cb8de0701f2482b99e51d5ac080aa13, eaa34beb1b274443b1c46839afd0a484; no voters: dbc2c92e49e346b5b3bd7705a229afc6
I20260709 14:54:32.308485 15892 raft_consensus.cc:2804] T d86dfc13b2834d7e8b2ad5f975f08154 P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 14:54:32.309603 15079 leader_election.cc:336] T 91c9f89fcb8b45ff9be43f535cafffde P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111)
I20260709 14:54:32.310273 15892 raft_consensus.cc:493] T d86dfc13b2834d7e8b2ad5f975f08154 P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Starting leader election (detected failure of leader dbc2c92e49e346b5b3bd7705a229afc6)
I20260709 14:54:32.311298 15892 raft_consensus.cc:3060] T d86dfc13b2834d7e8b2ad5f975f08154 P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:54:32.316286 15977 raft_consensus.cc:515] T 0284d9835221427ab285015d48a8040d P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:32.319036 15977 leader_election.cc:290] T 0284d9835221427ab285015d48a8040d P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 2 election: Requested vote from peers dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477), 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177)
I20260709 14:54:32.320122 15978 raft_consensus.cc:515] T d326f264e68d41d69b5007023083ed9e P 7519e608fbb44d9db8ad30b9f10ae605 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:32.321425 15110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0284d9835221427ab285015d48a8040d" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605"
I20260709 14:54:32.322103 15110 raft_consensus.cc:3060] T 0284d9835221427ab285015d48a8040d P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:54:32.322149 15881 raft_consensus.cc:2804] T 46a35b81512c4e8c8ec6b83d4c768e1f P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 14:54:32.322983 15881 raft_consensus.cc:493] T 46a35b81512c4e8c8ec6b83d4c768e1f P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Starting leader election (detected failure of leader dbc2c92e49e346b5b3bd7705a229afc6)
I20260709 14:54:32.323378 15881 raft_consensus.cc:3060] T 46a35b81512c4e8c8ec6b83d4c768e1f P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:54:32.335561 15187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d354c94548fc411ab62b4281ed947944" candidate_uuid: "7519e608fbb44d9db8ad30b9f10ae605" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484" is_pre_election: true
I20260709 14:54:32.336668 15187 raft_consensus.cc:2468] T d354c94548fc411ab62b4281ed947944 P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7519e608fbb44d9db8ad30b9f10ae605 in term 1.
I20260709 14:54:32.338425 15964 consensus_queue.cc:260] T db39b7ffe995451885f4074ddf16028d P dbc2c92e49e346b5b3bd7705a229afc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:32.341954 15978 leader_election.cc:290] T d326f264e68d41d69b5007023083ed9e P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 2 election: Requested vote from peers dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477), eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805)
I20260709 14:54:32.344738 15187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c9f89fcb8b45ff9be43f535cafffde" candidate_uuid: "7519e608fbb44d9db8ad30b9f10ae605" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484"
I20260709 14:54:32.346101 15187 raft_consensus.cc:2393] T 91c9f89fcb8b45ff9be43f535cafffde P eaa34beb1b274443b1c46839afd0a484 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 7519e608fbb44d9db8ad30b9f10ae605 in current term 2: Already voted for candidate eaa34beb1b274443b1c46839afd0a484 in this term.
I20260709 14:54:32.346269 15956 raft_consensus.cc:515] T 8bae8108fe2a4ce0ba3e35746c7ec9d1 P 7519e608fbb44d9db8ad30b9f10ae605 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
W20260709 14:54:32.353667 15153 leader_election.cc:336] T 7f2cd7c8159d43c080fd8302180ecfca P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111)
I20260709 14:54:32.353706 15111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f90ac0a3b004f6ca430ff2fc5198678" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605" is_pre_election: true
I20260709 14:54:32.354786 15111 raft_consensus.cc:2468] T 9f90ac0a3b004f6ca430ff2fc5198678 P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa34beb1b274443b1c46839afd0a484 in term 1.
I20260709 14:54:32.356438 15964 ts_tablet_manager.cc:1434] T db39b7ffe995451885f4074ddf16028d P dbc2c92e49e346b5b3bd7705a229afc6: Time spent starting tablet: real 0.066s	user 0.009s	sys 0.000s
I20260709 14:54:32.356299 15261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46ebd2bd84cc46e08c82a7b893e54578" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13"
I20260709 14:54:32.357215 15261 raft_consensus.cc:3060] T 46ebd2bd84cc46e08c82a7b893e54578 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:54:32.358712 15964 tablet_bootstrap.cc:492] T d326f264e68d41d69b5007023083ed9e P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap starting.
I20260709 14:54:32.366463 15956 leader_election.cc:290] T 8bae8108fe2a4ce0ba3e35746c7ec9d1 P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 2 election: Requested vote from peers dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477), eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805)
I20260709 14:54:32.350284 15892 raft_consensus.cc:515] T d86dfc13b2834d7e8b2ad5f975f08154 P eaa34beb1b274443b1c46839afd0a484 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:32.369369 15227 leader_election.cc:304] T cc6f522768894933b21bc94b41605166 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cb8de0701f2482b99e51d5ac080aa13, eaa34beb1b274443b1c46839afd0a484; no voters: 
I20260709 14:54:32.369704 15892 leader_election.cc:290] T d86dfc13b2834d7e8b2ad5f975f08154 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 2 election: Requested vote from peers 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493), dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477)
I20260709 14:54:32.380689 15105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c9f89fcb8b45ff9be43f535cafffde" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605"
I20260709 14:54:32.370748 15227 leader_election.cc:304] T 46a35b81512c4e8c8ec6b83d4c768e1f P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cb8de0701f2482b99e51d5ac080aa13, eaa34beb1b274443b1c46839afd0a484; no voters: 
I20260709 14:54:32.368620 15881 raft_consensus.cc:515] T 46a35b81512c4e8c8ec6b83d4c768e1f P eaa34beb1b274443b1c46839afd0a484 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
W20260709 14:54:32.371574 15153 leader_election.cc:336] T 46ebd2bd84cc46e08c82a7b893e54578 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111)
I20260709 14:54:32.372552 15111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2cd7c8159d43c080fd8302180ecfca" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605" is_pre_election: true
I20260709 14:54:32.371538 15982 raft_consensus.cc:2804] T cc6f522768894933b21bc94b41605166 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 14:54:32.384064 15982 raft_consensus.cc:493] T cc6f522768894933b21bc94b41605166 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Starting leader election (detected failure of leader dbc2c92e49e346b5b3bd7705a229afc6)
I20260709 14:54:32.383567 15111 raft_consensus.cc:2468] T 7f2cd7c8159d43c080fd8302180ecfca P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa34beb1b274443b1c46839afd0a484 in term 1.
I20260709 14:54:32.384478 15982 raft_consensus.cc:3060] T cc6f522768894933b21bc94b41605166 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Advancing to term 2
W20260709 14:54:32.382961 15153 leader_election.cc:336] T 91c9f89fcb8b45ff9be43f535cafffde P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111)
I20260709 14:54:32.381801 15257 raft_consensus.cc:2468] T 4abdbdda3ce149a9904e919be18e7a3f P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa34beb1b274443b1c46839afd0a484 in term 2.
I20260709 14:54:32.375594 15110 raft_consensus.cc:2468] T 0284d9835221427ab285015d48a8040d P 7519e608fbb44d9db8ad30b9f10ae605 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cb8de0701f2482b99e51d5ac080aa13 in term 2.
I20260709 14:54:32.381878 15105 raft_consensus.cc:2393] T 91c9f89fcb8b45ff9be43f535cafffde P 7519e608fbb44d9db8ad30b9f10ae605 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate eaa34beb1b274443b1c46839afd0a484 in current term 2: Already voted for candidate 7519e608fbb44d9db8ad30b9f10ae605 in this term.
I20260709 14:54:32.383457 15930 raft_consensus.cc:2804] T 46a35b81512c4e8c8ec6b83d4c768e1f P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 14:54:32.392621 15930 raft_consensus.cc:493] T 46a35b81512c4e8c8ec6b83d4c768e1f P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Starting leader election (detected failure of leader dbc2c92e49e346b5b3bd7705a229afc6)
I20260709 14:54:32.393118 15930 raft_consensus.cc:3060] T 46a35b81512c4e8c8ec6b83d4c768e1f P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:54:32.393417 15224 leader_election.cc:304] T 0284d9835221427ab285015d48a8040d P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7519e608fbb44d9db8ad30b9f10ae605, 9cb8de0701f2482b99e51d5ac080aa13; no voters: 
I20260709 14:54:32.394510 15984 raft_consensus.cc:2804] T 0284d9835221427ab285015d48a8040d P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:54:32.395093 15984 raft_consensus.cc:697] T 0284d9835221427ab285015d48a8040d P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 LEADER]: Becoming Leader. State: Replica: 9cb8de0701f2482b99e51d5ac080aa13, State: Running, Role: LEADER
I20260709 14:54:32.396986 15984 consensus_queue.cc:237] T 0284d9835221427ab285015d48a8040d P 9cb8de0701f2482b99e51d5ac080aa13 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:32.399871 15187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db39b7ffe995451885f4074ddf16028d" candidate_uuid: "7519e608fbb44d9db8ad30b9f10ae605" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484"
I20260709 14:54:32.400755 15187 raft_consensus.cc:3060] T db39b7ffe995451885f4074ddf16028d P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Advancing to term 2
W20260709 14:54:32.408236 15153 leader_election.cc:336] T d86dfc13b2834d7e8b2ad5f975f08154 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111)
W20260709 14:54:32.408994 15153 leader_election.cc:336] T 46a35b81512c4e8c8ec6b83d4c768e1f P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111)
I20260709 14:54:32.410252 15261 raft_consensus.cc:2468] T 46ebd2bd84cc46e08c82a7b893e54578 P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa34beb1b274443b1c46839afd0a484 in term 2.
I20260709 14:54:32.384194 15881 leader_election.cc:290] T 46a35b81512c4e8c8ec6b83d4c768e1f P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 2 election: Requested vote from peers 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493), dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477)
I20260709 14:54:32.382966 15227 leader_election.cc:304] T d2463fd792b240e9911c6b38bcb453b8 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cb8de0701f2482b99e51d5ac080aa13, eaa34beb1b274443b1c46839afd0a484; no voters: 
I20260709 14:54:32.416440 15982 raft_consensus.cc:515] T cc6f522768894933b21bc94b41605166 P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:32.420112 15984 raft_consensus.cc:2804] T d2463fd792b240e9911c6b38bcb453b8 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 14:54:32.420842 15079 leader_election.cc:336] T d61f9ecebc3c4a028f5327bc9debf432 P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111)
I20260709 14:54:32.422845 14936 catalog_manager.cc:5697] T 0284d9835221427ab285015d48a8040d P 9cb8de0701f2482b99e51d5ac080aa13 reported cstate change: term changed from 1 to 2, leader changed from dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65) to 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68). New cstate: current_term: 2 leader_uuid: "9cb8de0701f2482b99e51d5ac080aa13" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } health_report { overall_health: UNKNOWN } } }
I20260709 14:54:32.425755 15227 leader_election.cc:304] T c61864fa2cd249d683f8fb90d8542480 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cb8de0701f2482b99e51d5ac080aa13, eaa34beb1b274443b1c46839afd0a484; no voters: 
I20260709 14:54:32.426172 15984 raft_consensus.cc:493] T d2463fd792b240e9911c6b38bcb453b8 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Starting leader election (detected failure of leader dbc2c92e49e346b5b3bd7705a229afc6)
I20260709 14:54:32.434959 15984 raft_consensus.cc:3060] T d2463fd792b240e9911c6b38bcb453b8 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Advancing to term 2
W20260709 14:54:32.430394 15079 leader_election.cc:336] T d326f264e68d41d69b5007023083ed9e P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111)
I20260709 14:54:32.432487 15110 raft_consensus.cc:1275] T 9275d24f141d455cb200b9784c470d33 P 7519e608fbb44d9db8ad30b9f10ae605 [term 2 FOLLOWER]: Refusing update from remote peer 9cb8de0701f2482b99e51d5ac080aa13: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 14:54:32.432844 15153 consensus_peers.cc:597] T 5b9f8063585c4e5faddebd56fbe1aa01 P eaa34beb1b274443b1c46839afd0a484 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 14:54:32.437742 15079 leader_election.cc:336] T 7f2cd7c8159d43c080fd8302180ecfca P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111)
I20260709 14:54:32.438310 15079 leader_election.cc:304] T 7f2cd7c8159d43c080fd8302180ecfca P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7519e608fbb44d9db8ad30b9f10ae605; no voters: dbc2c92e49e346b5b3bd7705a229afc6, eaa34beb1b274443b1c46839afd0a484
I20260709 14:54:32.433617 15930 raft_consensus.cc:515] T 46a35b81512c4e8c8ec6b83d4c768e1f P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:32.438993 15977 consensus_queue.cc:1048] T 9275d24f141d455cb200b9784c470d33 P 9cb8de0701f2482b99e51d5ac080aa13 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 14:54:32.440296 15978 raft_consensus.cc:2749] T 7f2cd7c8159d43c080fd8302180ecfca P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 14:54:32.443759 15754 raft_consensus.cc:2804] T c61864fa2cd249d683f8fb90d8542480 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 14:54:32.444506 15754 raft_consensus.cc:493] T c61864fa2cd249d683f8fb90d8542480 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Starting leader election (detected failure of leader dbc2c92e49e346b5b3bd7705a229afc6)
I20260709 14:54:32.445006 15754 raft_consensus.cc:3060] T c61864fa2cd249d683f8fb90d8542480 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:54:32.427662 15982 leader_election.cc:290] T cc6f522768894933b21bc94b41605166 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 2 election: Requested vote from peers eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805), dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477)
I20260709 14:54:32.450604 15930 leader_election.cc:290] T 46a35b81512c4e8c8ec6b83d4c768e1f P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 2 election: Requested vote from peers eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805), dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477)
W20260709 14:54:32.460014 15079 leader_election.cc:336] T 8bae8108fe2a4ce0ba3e35746c7ec9d1 P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111)
I20260709 14:54:32.457794 15187 raft_consensus.cc:2468] T db39b7ffe995451885f4074ddf16028d P eaa34beb1b274443b1c46839afd0a484 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7519e608fbb44d9db8ad30b9f10ae605 in term 2.
W20260709 14:54:32.470461 15227 leader_election.cc:336] T cc6f522768894933b21bc94b41605166 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111)
W20260709 14:54:32.472077 15227 leader_election.cc:336] T 46a35b81512c4e8c8ec6b83d4c768e1f P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111)
I20260709 14:54:32.485409 15261 raft_consensus.cc:1275] T d61f9ecebc3c4a028f5327bc9debf432 P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 FOLLOWER]: Refusing update from remote peer 7519e608fbb44d9db8ad30b9f10ae605: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:54:32.491824 15984 raft_consensus.cc:515] T d2463fd792b240e9911c6b38bcb453b8 P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:32.500244 15978 consensus_queue.cc:1048] T d61f9ecebc3c4a028f5327bc9debf432 P 7519e608fbb44d9db8ad30b9f10ae605 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 14:54:32.485095 15754 raft_consensus.cc:515] T c61864fa2cd249d683f8fb90d8542480 P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:32.502740 15984 leader_election.cc:290] T d2463fd792b240e9911c6b38bcb453b8 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 2 election: Requested vote from peers eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805), dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477)
I20260709 14:54:32.506914 15187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d326f264e68d41d69b5007023083ed9e" candidate_uuid: "7519e608fbb44d9db8ad30b9f10ae605" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484"
I20260709 14:54:32.508332 15187 raft_consensus.cc:3060] T d326f264e68d41d69b5007023083ed9e P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:54:32.510542 15150 leader_election.cc:304] T 9f90ac0a3b004f6ca430ff2fc5198678 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7519e608fbb44d9db8ad30b9f10ae605, eaa34beb1b274443b1c46839afd0a484; no voters: dbc2c92e49e346b5b3bd7705a229afc6
I20260709 14:54:32.511217 15964 tablet_bootstrap.cc:492] T d326f264e68d41d69b5007023083ed9e P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 14:54:32.512779 15964 tablet_bootstrap.cc:492] T d326f264e68d41d69b5007023083ed9e P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap complete.
I20260709 14:54:32.507153 15185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bae8108fe2a4ce0ba3e35746c7ec9d1" candidate_uuid: "7519e608fbb44d9db8ad30b9f10ae605" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484"
I20260709 14:54:32.515641 15185 raft_consensus.cc:3060] T 8bae8108fe2a4ce0ba3e35746c7ec9d1 P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:54:32.518301 15754 leader_election.cc:290] T c61864fa2cd249d683f8fb90d8542480 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 2 election: Requested vote from peers eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805), dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477)
I20260709 14:54:32.519831 15892 raft_consensus.cc:2804] T 9f90ac0a3b004f6ca430ff2fc5198678 P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 14:54:32.520433 15892 raft_consensus.cc:493] T 9f90ac0a3b004f6ca430ff2fc5198678 P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Starting leader election (detected failure of leader dbc2c92e49e346b5b3bd7705a229afc6)
I20260709 14:54:32.520787 15892 raft_consensus.cc:3060] T 9f90ac0a3b004f6ca430ff2fc5198678 P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:54:32.525897 15185 raft_consensus.cc:2468] T 8bae8108fe2a4ce0ba3e35746c7ec9d1 P eaa34beb1b274443b1c46839afd0a484 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7519e608fbb44d9db8ad30b9f10ae605 in term 2.
I20260709 14:54:32.515302 15964 ts_tablet_manager.cc:1403] T d326f264e68d41d69b5007023083ed9e P dbc2c92e49e346b5b3bd7705a229afc6: Time spent bootstrapping tablet: real 0.157s	user 0.019s	sys 0.008s
I20260709 14:54:32.526871 15079 leader_election.cc:304] T d354c94548fc411ab62b4281ed947944 P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7519e608fbb44d9db8ad30b9f10ae605, eaa34beb1b274443b1c46839afd0a484; no voters: 
I20260709 14:54:32.532413 15956 raft_consensus.cc:2804] T d354c94548fc411ab62b4281ed947944 P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 14:54:32.533066 15956 raft_consensus.cc:493] T d354c94548fc411ab62b4281ed947944 P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Starting leader election (detected failure of leader dbc2c92e49e346b5b3bd7705a229afc6)
I20260709 14:54:32.533528 15956 raft_consensus.cc:3060] T d354c94548fc411ab62b4281ed947944 P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:54:32.533752 15079 leader_election.cc:304] T db39b7ffe995451885f4074ddf16028d P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7519e608fbb44d9db8ad30b9f10ae605, eaa34beb1b274443b1c46839afd0a484; no voters: 
I20260709 14:54:32.534835 15985 raft_consensus.cc:2804] T db39b7ffe995451885f4074ddf16028d P 7519e608fbb44d9db8ad30b9f10ae605 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:54:32.535553 15985 raft_consensus.cc:697] T db39b7ffe995451885f4074ddf16028d P 7519e608fbb44d9db8ad30b9f10ae605 [term 2 LEADER]: Becoming Leader. State: Replica: 7519e608fbb44d9db8ad30b9f10ae605, State: Running, Role: LEADER
I20260709 14:54:32.536684 15985 consensus_queue.cc:237] T db39b7ffe995451885f4074ddf16028d P 7519e608fbb44d9db8ad30b9f10ae605 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:32.538239 15964 raft_consensus.cc:359] T d326f264e68d41d69b5007023083ed9e P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:32.539515 15964 raft_consensus.cc:740] T d326f264e68d41d69b5007023083ed9e P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbc2c92e49e346b5b3bd7705a229afc6, State: Initialized, Role: FOLLOWER
I20260709 14:54:32.540436 15964 consensus_queue.cc:260] T d326f264e68d41d69b5007023083ed9e P dbc2c92e49e346b5b3bd7705a229afc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:32.543426 15964 ts_tablet_manager.cc:1434] T d326f264e68d41d69b5007023083ed9e P dbc2c92e49e346b5b3bd7705a229afc6: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.003s
I20260709 14:54:32.544529 15964 tablet_bootstrap.cc:492] T bdf08eed05854470954a5e9dd17dfb27 P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap starting.
I20260709 14:54:32.546193 15256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a35b81512c4e8c8ec6b83d4c768e1f" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13"
I20260709 14:54:32.547179 15256 raft_consensus.cc:2393] T 46a35b81512c4e8c8ec6b83d4c768e1f P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate eaa34beb1b274443b1c46839afd0a484 in current term 2: Already voted for candidate 9cb8de0701f2482b99e51d5ac080aa13 in this term.
I20260709 14:54:32.546934 15257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86dfc13b2834d7e8b2ad5f975f08154" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13"
I20260709 14:54:32.548614 15257 raft_consensus.cc:3060] T d86dfc13b2834d7e8b2ad5f975f08154 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:54:32.556527 15257 raft_consensus.cc:2468] T d86dfc13b2834d7e8b2ad5f975f08154 P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa34beb1b274443b1c46839afd0a484 in term 2.
I20260709 14:54:32.535661 15079 leader_election.cc:304] T 8bae8108fe2a4ce0ba3e35746c7ec9d1 P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7519e608fbb44d9db8ad30b9f10ae605, eaa34beb1b274443b1c46839afd0a484; no voters: 
I20260709 14:54:32.558561 15965 raft_consensus.cc:2804] T 8bae8108fe2a4ce0ba3e35746c7ec9d1 P 7519e608fbb44d9db8ad30b9f10ae605 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:54:32.559098 15965 raft_consensus.cc:697] T 8bae8108fe2a4ce0ba3e35746c7ec9d1 P 7519e608fbb44d9db8ad30b9f10ae605 [term 2 LEADER]: Becoming Leader. State: Replica: 7519e608fbb44d9db8ad30b9f10ae605, State: Running, Role: LEADER
I20260709 14:54:32.560245 15965 consensus_queue.cc:237] T 8bae8108fe2a4ce0ba3e35746c7ec9d1 P 7519e608fbb44d9db8ad30b9f10ae605 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:32.561388 15956 raft_consensus.cc:515] T d354c94548fc411ab62b4281ed947944 P 7519e608fbb44d9db8ad30b9f10ae605 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:32.563174 15150 leader_election.cc:304] T 91c9f89fcb8b45ff9be43f535cafffde P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa34beb1b274443b1c46839afd0a484; no voters: 7519e608fbb44d9db8ad30b9f10ae605, dbc2c92e49e346b5b3bd7705a229afc6
I20260709 14:54:32.563891 15956 leader_election.cc:290] T d354c94548fc411ab62b4281ed947944 P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 2 election: Requested vote from peers dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477), eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805)
I20260709 14:54:32.564213 15962 raft_consensus.cc:2749] T 91c9f89fcb8b45ff9be43f535cafffde P eaa34beb1b274443b1c46839afd0a484 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 14:54:32.566226 15150 leader_election.cc:304] T 7f2cd7c8159d43c080fd8302180ecfca P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7519e608fbb44d9db8ad30b9f10ae605, eaa34beb1b274443b1c46839afd0a484; no voters: dbc2c92e49e346b5b3bd7705a229afc6
I20260709 14:54:32.567180 15962 raft_consensus.cc:2804] T 7f2cd7c8159d43c080fd8302180ecfca P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 14:54:32.567596 15962 raft_consensus.cc:493] T 7f2cd7c8159d43c080fd8302180ecfca P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Starting leader election (detected failure of leader dbc2c92e49e346b5b3bd7705a229afc6)
I20260709 14:54:32.567977 15962 raft_consensus.cc:3060] T 7f2cd7c8159d43c080fd8302180ecfca P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Advancing to term 2
W20260709 14:54:32.571015 15079 leader_election.cc:336] T d61f9ecebc3c4a028f5327bc9debf432 P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111)
I20260709 14:54:32.572540 15187 raft_consensus.cc:2468] T d326f264e68d41d69b5007023083ed9e P eaa34beb1b274443b1c46839afd0a484 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7519e608fbb44d9db8ad30b9f10ae605 in term 2.
W20260709 14:54:32.577584 15079 leader_election.cc:336] T d354c94548fc411ab62b4281ed947944 P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111)
I20260709 14:54:32.582206 15256 raft_consensus.cc:1275] T 5b9f8063585c4e5faddebd56fbe1aa01 P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 FOLLOWER]: Refusing update from remote peer eaa34beb1b274443b1c46839afd0a484: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 14:54:32.585911 15079 leader_election.cc:336] T 91c9f89fcb8b45ff9be43f535cafffde P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111)
I20260709 14:54:32.590318 15079 leader_election.cc:304] T 91c9f89fcb8b45ff9be43f535cafffde P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7519e608fbb44d9db8ad30b9f10ae605; no voters: dbc2c92e49e346b5b3bd7705a229afc6, eaa34beb1b274443b1c46839afd0a484
I20260709 14:54:32.587569 15892 raft_consensus.cc:515] T 9f90ac0a3b004f6ca430ff2fc5198678 P eaa34beb1b274443b1c46839afd0a484 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:32.594676 15892 leader_election.cc:290] T 9f90ac0a3b004f6ca430ff2fc5198678 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 2 election: Requested vote from peers dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477), 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177)
W20260709 14:54:32.602813 15153 leader_election.cc:336] T 9f90ac0a3b004f6ca430ff2fc5198678 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111)
I20260709 14:54:32.601848 14936 catalog_manager.cc:5697] T db39b7ffe995451885f4074ddf16028d P 7519e608fbb44d9db8ad30b9f10ae605 reported cstate change: term changed from 1 to 2, leader changed from dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65) to 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66). New cstate: current_term: 2 leader_uuid: "7519e608fbb44d9db8ad30b9f10ae605" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } health_report { overall_health: UNKNOWN } } }
I20260709 14:54:32.602841 15965 raft_consensus.cc:2749] T 91c9f89fcb8b45ff9be43f535cafffde P 7519e608fbb44d9db8ad30b9f10ae605 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 14:54:32.615269 15964 tablet_bootstrap.cc:492] T bdf08eed05854470954a5e9dd17dfb27 P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 14:54:32.616034 15227 leader_election.cc:336] T 0284d9835221427ab285015d48a8040d P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111)
I20260709 14:54:32.616946 15964 tablet_bootstrap.cc:492] T bdf08eed05854470954a5e9dd17dfb27 P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap complete.
W20260709 14:54:32.617585 15227 leader_election.cc:336] T d2463fd792b240e9911c6b38bcb453b8 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111)
I20260709 14:54:32.618086 15964 ts_tablet_manager.cc:1403] T bdf08eed05854470954a5e9dd17dfb27 P dbc2c92e49e346b5b3bd7705a229afc6: Time spent bootstrapping tablet: real 0.074s	user 0.020s	sys 0.004s
W20260709 14:54:32.618659 15227 leader_election.cc:336] T c61864fa2cd249d683f8fb90d8542480 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111)
I20260709 14:54:32.621093 15964 raft_consensus.cc:359] T bdf08eed05854470954a5e9dd17dfb27 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:32.621950 15964 raft_consensus.cc:740] T bdf08eed05854470954a5e9dd17dfb27 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbc2c92e49e346b5b3bd7705a229afc6, State: Initialized, Role: FOLLOWER
W20260709 14:54:32.603334 15079 leader_election.cc:336] T db39b7ffe995451885f4074ddf16028d P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111)
I20260709 14:54:32.629289 15964 consensus_queue.cc:260] T bdf08eed05854470954a5e9dd17dfb27 P dbc2c92e49e346b5b3bd7705a229afc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:32.633524 15964 ts_tablet_manager.cc:1434] T bdf08eed05854470954a5e9dd17dfb27 P dbc2c92e49e346b5b3bd7705a229afc6: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 14:54:32.634694 15964 tablet_bootstrap.cc:492] T d354c94548fc411ab62b4281ed947944 P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap starting.
I20260709 14:54:32.635634 15150 leader_election.cc:304] T 4abdbdda3ce149a9904e919be18e7a3f P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9cb8de0701f2482b99e51d5ac080aa13, eaa34beb1b274443b1c46839afd0a484; no voters: dbc2c92e49e346b5b3bd7705a229afc6
I20260709 14:54:32.634186 14933 catalog_manager.cc:5697] T 8bae8108fe2a4ce0ba3e35746c7ec9d1 P 7519e608fbb44d9db8ad30b9f10ae605 reported cstate change: term changed from 1 to 2, leader changed from dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65) to 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66). New cstate: current_term: 2 leader_uuid: "7519e608fbb44d9db8ad30b9f10ae605" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } health_report { overall_health: UNKNOWN } } }
I20260709 14:54:32.638017 15150 leader_election.cc:304] T 46ebd2bd84cc46e08c82a7b893e54578 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9cb8de0701f2482b99e51d5ac080aa13, eaa34beb1b274443b1c46839afd0a484; no voters: dbc2c92e49e346b5b3bd7705a229afc6
I20260709 14:54:32.637033 15983 raft_consensus.cc:2804] T 4abdbdda3ce149a9904e919be18e7a3f P eaa34beb1b274443b1c46839afd0a484 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:54:32.644232 15983 raft_consensus.cc:697] T 4abdbdda3ce149a9904e919be18e7a3f P eaa34beb1b274443b1c46839afd0a484 [term 2 LEADER]: Becoming Leader. State: Replica: eaa34beb1b274443b1c46839afd0a484, State: Running, Role: LEADER
I20260709 14:54:32.646039 15983 consensus_queue.cc:237] T 4abdbdda3ce149a9904e919be18e7a3f P eaa34beb1b274443b1c46839afd0a484 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:32.648337 15892 raft_consensus.cc:2804] T 46ebd2bd84cc46e08c82a7b893e54578 P eaa34beb1b274443b1c46839afd0a484 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:54:32.650105 15892 raft_consensus.cc:697] T 46ebd2bd84cc46e08c82a7b893e54578 P eaa34beb1b274443b1c46839afd0a484 [term 2 LEADER]: Becoming Leader. State: Replica: eaa34beb1b274443b1c46839afd0a484, State: Running, Role: LEADER
I20260709 14:54:32.649493 15150 leader_election.cc:304] T 46a35b81512c4e8c8ec6b83d4c768e1f P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa34beb1b274443b1c46839afd0a484; no voters: 9cb8de0701f2482b99e51d5ac080aa13, dbc2c92e49e346b5b3bd7705a229afc6
I20260709 14:54:32.651515 15976 raft_consensus.cc:2749] T 46a35b81512c4e8c8ec6b83d4c768e1f P eaa34beb1b274443b1c46839afd0a484 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 14:54:32.652076 15150 leader_election.cc:304] T d86dfc13b2834d7e8b2ad5f975f08154 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9cb8de0701f2482b99e51d5ac080aa13, eaa34beb1b274443b1c46839afd0a484; no voters: dbc2c92e49e346b5b3bd7705a229afc6
I20260709 14:54:32.653178 15976 raft_consensus.cc:2804] T d86dfc13b2834d7e8b2ad5f975f08154 P eaa34beb1b274443b1c46839afd0a484 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:54:32.651136 15892 consensus_queue.cc:237] T 46ebd2bd84cc46e08c82a7b893e54578 P eaa34beb1b274443b1c46839afd0a484 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:32.661505 15974 consensus_queue.cc:1048] T 5b9f8063585c4e5faddebd56fbe1aa01 P eaa34beb1b274443b1c46839afd0a484 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 14:54:32.682307 15976 raft_consensus.cc:697] T d86dfc13b2834d7e8b2ad5f975f08154 P eaa34beb1b274443b1c46839afd0a484 [term 2 LEADER]: Becoming Leader. State: Replica: eaa34beb1b274443b1c46839afd0a484, State: Running, Role: LEADER
I20260709 14:54:32.683482 15976 consensus_queue.cc:237] T d86dfc13b2834d7e8b2ad5f975f08154 P eaa34beb1b274443b1c46839afd0a484 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:32.686429 15187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d354c94548fc411ab62b4281ed947944" candidate_uuid: "7519e608fbb44d9db8ad30b9f10ae605" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484"
I20260709 14:54:32.687280 15187 raft_consensus.cc:3060] T d354c94548fc411ab62b4281ed947944 P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Advancing to term 2
W20260709 14:54:32.693943 15224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:43177, user_credentials={real_user=slave}} blocked reactor thread for 63209.6us
I20260709 14:54:32.650715 15962 raft_consensus.cc:515] T 7f2cd7c8159d43c080fd8302180ecfca P eaa34beb1b274443b1c46839afd0a484 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:32.715637 15962 leader_election.cc:290] T 7f2cd7c8159d43c080fd8302180ecfca P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 2 election: Requested vote from peers dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477), 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177)
W20260709 14:54:32.736686 15153 leader_election.cc:336] T 7f2cd7c8159d43c080fd8302180ecfca P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111)
I20260709 14:54:32.742897 14936 catalog_manager.cc:5697] T 4abdbdda3ce149a9904e919be18e7a3f P eaa34beb1b274443b1c46839afd0a484 reported cstate change: term changed from 1 to 2, leader changed from dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65) to eaa34beb1b274443b1c46839afd0a484 (127.6.101.67). New cstate: current_term: 2 leader_uuid: "eaa34beb1b274443b1c46839afd0a484" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } health_report { overall_health: UNKNOWN } } }
W20260709 14:54:32.744429 15993 log.cc:927] Time spent T d61f9ecebc3c4a028f5327bc9debf432 P 9cb8de0701f2482b99e51d5ac080aa13: Append to log took a long time: real 0.064s	user 0.002s	sys 0.004s
I20260709 14:54:32.736819 15964 tablet_bootstrap.cc:492] T d354c94548fc411ab62b4281ed947944 P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 14:54:32.746268 15964 tablet_bootstrap.cc:492] T d354c94548fc411ab62b4281ed947944 P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap complete.
W20260709 14:54:32.686674 15079 leader_election.cc:336] T d326f264e68d41d69b5007023083ed9e P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111)
I20260709 14:54:32.747058 15964 ts_tablet_manager.cc:1403] T d354c94548fc411ab62b4281ed947944 P dbc2c92e49e346b5b3bd7705a229afc6: Time spent bootstrapping tablet: real 0.113s	user 0.025s	sys 0.005s
W20260709 14:54:32.747557 15079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:45477, user_credentials={real_user=slave}} blocked reactor thread for 60933.7us
W20260709 14:54:32.748418 15079 leader_election.cc:336] T 8bae8108fe2a4ce0ba3e35746c7ec9d1 P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111)
W20260709 14:54:32.749068 15150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.68:45493, user_credentials={real_user=slave}} blocked reactor thread for 94198.1us
I20260709 14:54:32.750535 15964 raft_consensus.cc:359] T d354c94548fc411ab62b4281ed947944 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:32.751380 15964 raft_consensus.cc:740] T d354c94548fc411ab62b4281ed947944 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbc2c92e49e346b5b3bd7705a229afc6, State: Initialized, Role: FOLLOWER
I20260709 14:54:32.752471 15964 consensus_queue.cc:260] T d354c94548fc411ab62b4281ed947944 P dbc2c92e49e346b5b3bd7705a229afc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
W20260709 14:54:32.761345 15153 consensus_peers.cc:597] T a9dab1878c4b4550880f5680c6d48c67 P eaa34beb1b274443b1c46839afd0a484 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 14:54:32.762825 15964 ts_tablet_manager.cc:1434] T d354c94548fc411ab62b4281ed947944 P dbc2c92e49e346b5b3bd7705a229afc6: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 14:54:32.764052 15964 tablet_bootstrap.cc:492] T 1159198eabeb409996ccbec0cac057f8 P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap starting.
I20260709 14:54:32.769889 15187 raft_consensus.cc:2468] T d354c94548fc411ab62b4281ed947944 P eaa34beb1b274443b1c46839afd0a484 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7519e608fbb44d9db8ad30b9f10ae605 in term 2.
I20260709 14:54:32.772987 15180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc6f522768894933b21bc94b41605166" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484"
I20260709 14:54:32.773985 15180 raft_consensus.cc:3060] T cc6f522768894933b21bc94b41605166 P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Advancing to term 2
W20260709 14:54:32.781636 15227 leader_election.cc:336] T 0284d9835221427ab285015d48a8040d P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111)
I20260709 14:54:32.782786 15182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2463fd792b240e9911c6b38bcb453b8" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484"
I20260709 14:54:32.783466 15182 raft_consensus.cc:3060] T d2463fd792b240e9911c6b38bcb453b8 P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:54:32.783804 15184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61864fa2cd249d683f8fb90d8542480" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484"
I20260709 14:54:32.784621 15184 raft_consensus.cc:3060] T c61864fa2cd249d683f8fb90d8542480 P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:54:32.794159 15187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a35b81512c4e8c8ec6b83d4c768e1f" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484"
I20260709 14:54:32.795240 15187 raft_consensus.cc:2393] T 46a35b81512c4e8c8ec6b83d4c768e1f P eaa34beb1b274443b1c46839afd0a484 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 9cb8de0701f2482b99e51d5ac080aa13 in current term 2: Already voted for candidate eaa34beb1b274443b1c46839afd0a484 in this term.
I20260709 14:54:32.797653 14936 catalog_manager.cc:5697] T 46ebd2bd84cc46e08c82a7b893e54578 P eaa34beb1b274443b1c46839afd0a484 reported cstate change: term changed from 1 to 2, leader changed from dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65) to eaa34beb1b274443b1c46839afd0a484 (127.6.101.67). New cstate: current_term: 2 leader_uuid: "eaa34beb1b274443b1c46839afd0a484" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } health_report { overall_health: UNKNOWN } } }
I20260709 14:54:32.799063 15180 raft_consensus.cc:2468] T cc6f522768894933b21bc94b41605166 P eaa34beb1b274443b1c46839afd0a484 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cb8de0701f2482b99e51d5ac080aa13 in term 2.
W20260709 14:54:32.795178 15227 leader_election.cc:336] T cc6f522768894933b21bc94b41605166 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111)
W20260709 14:54:32.801867 15227 consensus_peers.cc:597] T 9275d24f141d455cb200b9784c470d33 P 9cb8de0701f2482b99e51d5ac080aa13 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 14:54:32.802608 15227 leader_election.cc:336] T 46a35b81512c4e8c8ec6b83d4c768e1f P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111)
W20260709 14:54:32.802995 15153 consensus_peers.cc:597] T 98280a706ec54413830f342b48666f6e P eaa34beb1b274443b1c46839afd0a484 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 14:54:32.799614  6549 ts_tablet_manager.cc:600] Registering tablets (34/45 complete)
I20260709 14:54:32.795244 15079 leader_election.cc:304] T d326f264e68d41d69b5007023083ed9e P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7519e608fbb44d9db8ad30b9f10ae605, eaa34beb1b274443b1c46839afd0a484; no voters: dbc2c92e49e346b5b3bd7705a229afc6
W20260709 14:54:32.808902 15227 leader_election.cc:336] T d2463fd792b240e9911c6b38bcb453b8 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111)
I20260709 14:54:32.809233 15965 raft_consensus.cc:2804] T d326f264e68d41d69b5007023083ed9e P 7519e608fbb44d9db8ad30b9f10ae605 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:54:32.811506 15965 raft_consensus.cc:697] T d326f264e68d41d69b5007023083ed9e P 7519e608fbb44d9db8ad30b9f10ae605 [term 2 LEADER]: Becoming Leader. State: Replica: 7519e608fbb44d9db8ad30b9f10ae605, State: Running, Role: LEADER
I20260709 14:54:32.811605 15182 raft_consensus.cc:2468] T d2463fd792b240e9911c6b38bcb453b8 P eaa34beb1b274443b1c46839afd0a484 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cb8de0701f2482b99e51d5ac080aa13 in term 2.
I20260709 14:54:32.812660 15965 consensus_queue.cc:237] T d326f264e68d41d69b5007023083ed9e P 7519e608fbb44d9db8ad30b9f10ae605 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:32.828223 15964 tablet_bootstrap.cc:492] T 1159198eabeb409996ccbec0cac057f8 P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 14:54:32.829874 15964 tablet_bootstrap.cc:492] T 1159198eabeb409996ccbec0cac057f8 P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap complete.
I20260709 14:54:32.831333 15964 ts_tablet_manager.cc:1403] T 1159198eabeb409996ccbec0cac057f8 P dbc2c92e49e346b5b3bd7705a229afc6: Time spent bootstrapping tablet: real 0.068s	user 0.020s	sys 0.007s
W20260709 14:54:32.810791 15227 leader_election.cc:336] T c61864fa2cd249d683f8fb90d8542480 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111)
I20260709 14:54:32.834784 15964 raft_consensus.cc:359] T 1159198eabeb409996ccbec0cac057f8 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:32.835667 15964 raft_consensus.cc:740] T 1159198eabeb409996ccbec0cac057f8 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbc2c92e49e346b5b3bd7705a229afc6, State: Initialized, Role: FOLLOWER
I20260709 14:54:32.836596 15964 consensus_queue.cc:260] T 1159198eabeb409996ccbec0cac057f8 P dbc2c92e49e346b5b3bd7705a229afc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:32.806628 15184 raft_consensus.cc:2468] T c61864fa2cd249d683f8fb90d8542480 P eaa34beb1b274443b1c46839afd0a484 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cb8de0701f2482b99e51d5ac080aa13 in term 2.
W20260709 14:54:32.838966 15227 consensus_peers.cc:597] T 5585b0f6bbf04c10865d2463767621dc P 9cb8de0701f2482b99e51d5ac080aa13 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 14:54:32.839600 15079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:33805, user_credentials={real_user=slave}} blocked reactor thread for 44493.7us
I20260709 14:54:32.844161 15079 leader_election.cc:304] T d354c94548fc411ab62b4281ed947944 P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7519e608fbb44d9db8ad30b9f10ae605, eaa34beb1b274443b1c46839afd0a484; no voters: 
I20260709 14:54:32.799786 14936 catalog_manager.cc:5697] T d86dfc13b2834d7e8b2ad5f975f08154 P eaa34beb1b274443b1c46839afd0a484 reported cstate change: term changed from 1 to 2, leader changed from dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65) to eaa34beb1b274443b1c46839afd0a484 (127.6.101.67). New cstate: current_term: 2 leader_uuid: "eaa34beb1b274443b1c46839afd0a484" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } health_report { overall_health: UNKNOWN } } }
I20260709 14:54:32.841493 15964 ts_tablet_manager.cc:1434] T 1159198eabeb409996ccbec0cac057f8 P dbc2c92e49e346b5b3bd7705a229afc6: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 14:54:32.851272 15964 tablet_bootstrap.cc:492] T 4abdbdda3ce149a9904e919be18e7a3f P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap starting.
I20260709 14:54:32.852054 15965 raft_consensus.cc:2804] T d354c94548fc411ab62b4281ed947944 P 7519e608fbb44d9db8ad30b9f10ae605 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:54:32.857923 15965 raft_consensus.cc:697] T d354c94548fc411ab62b4281ed947944 P 7519e608fbb44d9db8ad30b9f10ae605 [term 2 LEADER]: Becoming Leader. State: Replica: 7519e608fbb44d9db8ad30b9f10ae605, State: Running, Role: LEADER
I20260709 14:54:32.855804 14933 catalog_manager.cc:5697] T d326f264e68d41d69b5007023083ed9e P 7519e608fbb44d9db8ad30b9f10ae605 reported cstate change: term changed from 1 to 2, leader changed from dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65) to 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66). New cstate: current_term: 2 leader_uuid: "7519e608fbb44d9db8ad30b9f10ae605" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } health_report { overall_health: UNKNOWN } } }
I20260709 14:54:32.859131 15965 consensus_queue.cc:237] T d354c94548fc411ab62b4281ed947944 P 7519e608fbb44d9db8ad30b9f10ae605 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
W20260709 14:54:32.868211 15079 leader_election.cc:336] T d354c94548fc411ab62b4281ed947944 P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111)
I20260709 14:54:32.882148 15110 raft_consensus.cc:1275] T 0284d9835221427ab285015d48a8040d P 7519e608fbb44d9db8ad30b9f10ae605 [term 2 FOLLOWER]: Refusing update from remote peer 9cb8de0701f2482b99e51d5ac080aa13: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:54:32.884454 15982 consensus_queue.cc:1048] T 0284d9835221427ab285015d48a8040d P 9cb8de0701f2482b99e51d5ac080aa13 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 14:54:32.890722 15106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f90ac0a3b004f6ca430ff2fc5198678" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605"
I20260709 14:54:32.891575 15106 raft_consensus.cc:3060] T 9f90ac0a3b004f6ca430ff2fc5198678 P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:54:32.901150 15227 leader_election.cc:304] T cc6f522768894933b21bc94b41605166 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9cb8de0701f2482b99e51d5ac080aa13, eaa34beb1b274443b1c46839afd0a484; no voters: dbc2c92e49e346b5b3bd7705a229afc6
I20260709 14:54:32.903095 15111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2cd7c8159d43c080fd8302180ecfca" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605"
I20260709 14:54:32.903808 15111 raft_consensus.cc:3060] T 7f2cd7c8159d43c080fd8302180ecfca P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:54:32.905140 15106 raft_consensus.cc:2468] T 9f90ac0a3b004f6ca430ff2fc5198678 P 7519e608fbb44d9db8ad30b9f10ae605 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa34beb1b274443b1c46839afd0a484 in term 2.
I20260709 14:54:32.912109 14936 catalog_manager.cc:5697] T d354c94548fc411ab62b4281ed947944 P 7519e608fbb44d9db8ad30b9f10ae605 reported cstate change: term changed from 1 to 2, leader changed from dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65) to 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66). New cstate: current_term: 2 leader_uuid: "7519e608fbb44d9db8ad30b9f10ae605" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } health_report { overall_health: UNKNOWN } } }
I20260709 14:54:32.915257 15982 raft_consensus.cc:2804] T cc6f522768894933b21bc94b41605166 P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 14:54:32.917143 15079 consensus_peers.cc:597] T d61f9ecebc3c4a028f5327bc9debf432 P 7519e608fbb44d9db8ad30b9f10ae605 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 14:54:32.917850 15227 leader_election.cc:304] T 46a35b81512c4e8c8ec6b83d4c768e1f P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cb8de0701f2482b99e51d5ac080aa13; no voters: dbc2c92e49e346b5b3bd7705a229afc6, eaa34beb1b274443b1c46839afd0a484
I20260709 14:54:32.919162 15754 raft_consensus.cc:2749] T 46a35b81512c4e8c8ec6b83d4c768e1f P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 14:54:32.912283 15111 raft_consensus.cc:2468] T 7f2cd7c8159d43c080fd8302180ecfca P 7519e608fbb44d9db8ad30b9f10ae605 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa34beb1b274443b1c46839afd0a484 in term 2.
I20260709 14:54:32.922767 15982 raft_consensus.cc:697] T cc6f522768894933b21bc94b41605166 P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 LEADER]: Becoming Leader. State: Replica: 9cb8de0701f2482b99e51d5ac080aa13, State: Running, Role: LEADER
I20260709 14:54:32.924140 15982 consensus_queue.cc:237] T cc6f522768894933b21bc94b41605166 P 9cb8de0701f2482b99e51d5ac080aa13 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:32.930341 15150 leader_election.cc:304] T 9f90ac0a3b004f6ca430ff2fc5198678 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7519e608fbb44d9db8ad30b9f10ae605, eaa34beb1b274443b1c46839afd0a484; no voters: dbc2c92e49e346b5b3bd7705a229afc6
I20260709 14:54:32.931689 15962 raft_consensus.cc:2804] T 9f90ac0a3b004f6ca430ff2fc5198678 P eaa34beb1b274443b1c46839afd0a484 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:54:32.932235 15962 raft_consensus.cc:697] T 9f90ac0a3b004f6ca430ff2fc5198678 P eaa34beb1b274443b1c46839afd0a484 [term 2 LEADER]: Becoming Leader. State: Replica: eaa34beb1b274443b1c46839afd0a484, State: Running, Role: LEADER
I20260709 14:54:32.933142 15962 consensus_queue.cc:237] T 9f90ac0a3b004f6ca430ff2fc5198678 P eaa34beb1b274443b1c46839afd0a484 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:32.920692 15227 leader_election.cc:304] T d2463fd792b240e9911c6b38bcb453b8 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9cb8de0701f2482b99e51d5ac080aa13, eaa34beb1b274443b1c46839afd0a484; no voters: dbc2c92e49e346b5b3bd7705a229afc6
I20260709 14:54:32.939090 15754 raft_consensus.cc:2804] T d2463fd792b240e9911c6b38bcb453b8 P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:54:32.939778 15754 raft_consensus.cc:697] T d2463fd792b240e9911c6b38bcb453b8 P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 LEADER]: Becoming Leader. State: Replica: 9cb8de0701f2482b99e51d5ac080aa13, State: Running, Role: LEADER
I20260709 14:54:32.941525 15754 consensus_queue.cc:237] T d2463fd792b240e9911c6b38bcb453b8 P 9cb8de0701f2482b99e51d5ac080aa13 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
W20260709 14:54:32.930385 15153 consensus_peers.cc:597] T 5f5dbc86fc8f4ae5b77e0f23adfcd593 P eaa34beb1b274443b1c46839afd0a484 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 14:54:32.948465 15153 consensus_peers.cc:597] T d6bcaee371174feaa06943f949efda49 P eaa34beb1b274443b1c46839afd0a484 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 14:54:32.950207 15227 leader_election.cc:304] T c61864fa2cd249d683f8fb90d8542480 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9cb8de0701f2482b99e51d5ac080aa13, eaa34beb1b274443b1c46839afd0a484; no voters: dbc2c92e49e346b5b3bd7705a229afc6
I20260709 14:54:32.953586 15942 raft_consensus.cc:2804] T c61864fa2cd249d683f8fb90d8542480 P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:54:32.954190 15942 raft_consensus.cc:697] T c61864fa2cd249d683f8fb90d8542480 P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 LEADER]: Becoming Leader. State: Replica: 9cb8de0701f2482b99e51d5ac080aa13, State: Running, Role: LEADER
I20260709 14:54:32.955178 15942 consensus_queue.cc:237] T c61864fa2cd249d683f8fb90d8542480 P 9cb8de0701f2482b99e51d5ac080aa13 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:32.967041 14933 catalog_manager.cc:5697] T 9f90ac0a3b004f6ca430ff2fc5198678 P eaa34beb1b274443b1c46839afd0a484 reported cstate change: term changed from 1 to 2, leader changed from dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65) to eaa34beb1b274443b1c46839afd0a484 (127.6.101.67). New cstate: current_term: 2 leader_uuid: "eaa34beb1b274443b1c46839afd0a484" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } health_report { overall_health: HEALTHY } } }
W20260709 14:54:32.971993 15153 consensus_peers.cc:597] T 42d6909533d14edbbfdad30a9972658d P eaa34beb1b274443b1c46839afd0a484 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 14:54:32.978440 15150 leader_election.cc:304] T 7f2cd7c8159d43c080fd8302180ecfca P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7519e608fbb44d9db8ad30b9f10ae605, eaa34beb1b274443b1c46839afd0a484; no voters: dbc2c92e49e346b5b3bd7705a229afc6
I20260709 14:54:32.990504 15964 tablet_bootstrap.cc:492] T 4abdbdda3ce149a9904e919be18e7a3f P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 14:54:32.980191 15079 consensus_peers.cc:597] T 966a06ab56a6479283ab2818c9439d4f P 7519e608fbb44d9db8ad30b9f10ae605 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 14:54:32.991086 15962 raft_consensus.cc:2804] T 7f2cd7c8159d43c080fd8302180ecfca P eaa34beb1b274443b1c46839afd0a484 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:54:33.000092 15962 raft_consensus.cc:697] T 7f2cd7c8159d43c080fd8302180ecfca P eaa34beb1b274443b1c46839afd0a484 [term 2 LEADER]: Becoming Leader. State: Replica: eaa34beb1b274443b1c46839afd0a484, State: Running, Role: LEADER
I20260709 14:54:33.001431 15962 consensus_queue.cc:237] T 7f2cd7c8159d43c080fd8302180ecfca P eaa34beb1b274443b1c46839afd0a484 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:33.006929 14933 catalog_manager.cc:5697] T cc6f522768894933b21bc94b41605166 P 9cb8de0701f2482b99e51d5ac080aa13 reported cstate change: term changed from 1 to 2, leader changed from dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65) to 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68). New cstate: current_term: 2 leader_uuid: "9cb8de0701f2482b99e51d5ac080aa13" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } health_report { overall_health: UNKNOWN } } }
I20260709 14:54:32.995957 15964 tablet_bootstrap.cc:492] T 4abdbdda3ce149a9904e919be18e7a3f P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap complete.
W20260709 14:54:33.011929 15153 consensus_peers.cc:597] T 5e8a01e27eab492bb73df3359e500627 P eaa34beb1b274443b1c46839afd0a484 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 14:54:33.012691 15964 ts_tablet_manager.cc:1403] T 4abdbdda3ce149a9904e919be18e7a3f P dbc2c92e49e346b5b3bd7705a229afc6: Time spent bootstrapping tablet: real 0.162s	user 0.016s	sys 0.004s
W20260709 14:54:33.011929 15079 consensus_peers.cc:597] T 70bc59fabcdc4359a84d584f36d18d01 P 7519e608fbb44d9db8ad30b9f10ae605 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 14:54:33.027398 15964 raft_consensus.cc:359] T 4abdbdda3ce149a9904e919be18e7a3f P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:33.028239 15964 raft_consensus.cc:740] T 4abdbdda3ce149a9904e919be18e7a3f P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbc2c92e49e346b5b3bd7705a229afc6, State: Initialized, Role: FOLLOWER
I20260709 14:54:33.038369 15964 consensus_queue.cc:260] T 4abdbdda3ce149a9904e919be18e7a3f P dbc2c92e49e346b5b3bd7705a229afc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:33.044742 15964 ts_tablet_manager.cc:1434] T 4abdbdda3ce149a9904e919be18e7a3f P dbc2c92e49e346b5b3bd7705a229afc6: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.000s
I20260709 14:54:33.045903 15964 tablet_bootstrap.cc:492] T 5b9f8063585c4e5faddebd56fbe1aa01 P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap starting.
I20260709 14:54:33.102945  6549 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 14:54:33.103968  6549 ts_tablet_manager.cc:595] Time spent register tablets: real 1.311s	user 0.394s	sys 0.020s
W20260709 14:54:33.104081 15227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:45477, user_credentials={real_user=slave}} blocked reactor thread for 56301.2us
I20260709 14:54:33.151589 15182 raft_consensus.cc:1275] T 8bae8108fe2a4ce0ba3e35746c7ec9d1 P eaa34beb1b274443b1c46839afd0a484 [term 2 FOLLOWER]: Refusing update from remote peer 7519e608fbb44d9db8ad30b9f10ae605: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 14:54:33.160128 15153 consensus_peers.cc:597] T 798d0882b1ea4b26b598c236de8f18c9 P eaa34beb1b274443b1c46839afd0a484 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 14:54:33.172452 15184 raft_consensus.cc:1275] T db39b7ffe995451885f4074ddf16028d P eaa34beb1b274443b1c46839afd0a484 [term 2 FOLLOWER]: Refusing update from remote peer 7519e608fbb44d9db8ad30b9f10ae605: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:54:33.135666 14935 catalog_manager.cc:5697] T 7f2cd7c8159d43c080fd8302180ecfca P eaa34beb1b274443b1c46839afd0a484 reported cstate change: term changed from 1 to 2, leader changed from dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65) to eaa34beb1b274443b1c46839afd0a484 (127.6.101.67). New cstate: current_term: 2 leader_uuid: "eaa34beb1b274443b1c46839afd0a484" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } health_report { overall_health: UNKNOWN } } }
W20260709 14:54:33.180140 15153 consensus_peers.cc:597] T d86dfc13b2834d7e8b2ad5f975f08154 P eaa34beb1b274443b1c46839afd0a484 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 14:54:33.187670 15153 consensus_peers.cc:597] T 4abdbdda3ce149a9904e919be18e7a3f P eaa34beb1b274443b1c46839afd0a484 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 14:54:33.176386 15227 consensus_peers.cc:597] T 7699ad132e12472180b6a9527951c397 P 9cb8de0701f2482b99e51d5ac080aa13 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 14:54:33.193545 15227 consensus_peers.cc:597] T 0284d9835221427ab285015d48a8040d P 9cb8de0701f2482b99e51d5ac080aa13 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 14:54:33.194659 15817 consensus_queue.cc:1048] T db39b7ffe995451885f4074ddf16028d P 7519e608fbb44d9db8ad30b9f10ae605 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 14:54:33.209669 16021 consensus_queue.cc:1048] T 8bae8108fe2a4ce0ba3e35746c7ec9d1 P 7519e608fbb44d9db8ad30b9f10ae605 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
W20260709 14:54:33.217805 15079 consensus_peers.cc:597] T db39b7ffe995451885f4074ddf16028d P 7519e608fbb44d9db8ad30b9f10ae605 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 14:54:33.218603 15079 consensus_peers.cc:597] T 054739df584d4b9db840777c2ae17555 P 7519e608fbb44d9db8ad30b9f10ae605 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 14:54:33.240451 15153 consensus_peers.cc:597] T d178b88fdab54a29b05fb98e05ffe8c5 P eaa34beb1b274443b1c46839afd0a484 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 14:54:33.244004 14936 catalog_manager.cc:5697] T c61864fa2cd249d683f8fb90d8542480 P 9cb8de0701f2482b99e51d5ac080aa13 reported cstate change: term changed from 1 to 2, leader changed from dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65) to 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68). New cstate: current_term: 2 leader_uuid: "9cb8de0701f2482b99e51d5ac080aa13" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } health_report { overall_health: UNKNOWN } } }
I20260709 14:54:33.247789 15261 raft_consensus.cc:1275] T 4abdbdda3ce149a9904e919be18e7a3f P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 FOLLOWER]: Refusing update from remote peer eaa34beb1b274443b1c46839afd0a484: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:54:33.247509 14936 catalog_manager.cc:5697] T d2463fd792b240e9911c6b38bcb453b8 P 9cb8de0701f2482b99e51d5ac080aa13 reported cstate change: term changed from 1 to 2, leader changed from dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65) to 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68). New cstate: current_term: 2 leader_uuid: "9cb8de0701f2482b99e51d5ac080aa13" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } health_report { overall_health: UNKNOWN } } }
W20260709 14:54:33.304298 15079 consensus_peers.cc:597] T 8bae8108fe2a4ce0ba3e35746c7ec9d1 P 7519e608fbb44d9db8ad30b9f10ae605 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 14:54:33.308636 15964 tablet_bootstrap.cc:492] T 5b9f8063585c4e5faddebd56fbe1aa01 P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 14:54:33.309350 15079 consensus_peers.cc:597] T d354c94548fc411ab62b4281ed947944 P 7519e608fbb44d9db8ad30b9f10ae605 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 14:54:33.310034 15079 consensus_peers.cc:597] T d326f264e68d41d69b5007023083ed9e P 7519e608fbb44d9db8ad30b9f10ae605 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 14:54:33.311535 15964 tablet_bootstrap.cc:492] T 5b9f8063585c4e5faddebd56fbe1aa01 P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap complete.
I20260709 14:54:33.312880 15964 ts_tablet_manager.cc:1403] T 5b9f8063585c4e5faddebd56fbe1aa01 P dbc2c92e49e346b5b3bd7705a229afc6: Time spent bootstrapping tablet: real 0.267s	user 0.046s	sys 0.019s
I20260709 14:54:33.316233 15256 raft_consensus.cc:1275] T d86dfc13b2834d7e8b2ad5f975f08154 P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 FOLLOWER]: Refusing update from remote peer eaa34beb1b274443b1c46839afd0a484: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 14:54:33.317981 15153 consensus_peers.cc:597] T 263098160f604ae3aa31782c37e2fd52 P eaa34beb1b274443b1c46839afd0a484 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 14:54:33.319240 15153 consensus_peers.cc:597] T 3b4c50fac37a43c0988d5ea911d09f43 P eaa34beb1b274443b1c46839afd0a484 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 14:54:33.327234 15973 raft_consensus.cc:493] T f389b12c6b304243905f28267dfaeed0 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:33.328513 15973 raft_consensus.cc:515] T f389b12c6b304243905f28267dfaeed0 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
W20260709 14:54:33.338172 15153 consensus_peers.cc:597] T 594083b10772433f90560d387bbbeabe P eaa34beb1b274443b1c46839afd0a484 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 14:54:33.352131 15256 raft_consensus.cc:1275] T 46ebd2bd84cc46e08c82a7b893e54578 P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 FOLLOWER]: Refusing update from remote peer eaa34beb1b274443b1c46839afd0a484: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:54:33.339143 15973 leader_election.cc:290] T f389b12c6b304243905f28267dfaeed0 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177), eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805)
I20260709 14:54:33.327311 15964 raft_consensus.cc:359] T 5b9f8063585c4e5faddebd56fbe1aa01 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:33.360800 15964 raft_consensus.cc:740] T 5b9f8063585c4e5faddebd56fbe1aa01 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbc2c92e49e346b5b3bd7705a229afc6, State: Initialized, Role: FOLLOWER
I20260709 14:54:33.398979 15182 raft_consensus.cc:1275] T d354c94548fc411ab62b4281ed947944 P eaa34beb1b274443b1c46839afd0a484 [term 2 FOLLOWER]: Refusing update from remote peer 7519e608fbb44d9db8ad30b9f10ae605: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 14:54:33.421815 15227 consensus_peers.cc:597] T dd44b332dc744f94a5f7cfffc06f3956 P 9cb8de0701f2482b99e51d5ac080aa13 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 14:54:33.427274 15150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:43177, user_credentials={real_user=slave}} blocked reactor thread for 74005.1us
I20260709 14:54:33.394796 15964 consensus_queue.cc:260] T 5b9f8063585c4e5faddebd56fbe1aa01 P dbc2c92e49e346b5b3bd7705a229afc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:33.451591 15817 consensus_queue.cc:1048] T d354c94548fc411ab62b4281ed947944 P 7519e608fbb44d9db8ad30b9f10ae605 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 14:54:33.470220 15106 raft_consensus.cc:1275] T 9f90ac0a3b004f6ca430ff2fc5198678 P 7519e608fbb44d9db8ad30b9f10ae605 [term 2 FOLLOWER]: Refusing update from remote peer eaa34beb1b274443b1c46839afd0a484: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 14:54:33.485625 15153 consensus_peers.cc:597] T 9f90ac0a3b004f6ca430ff2fc5198678 P eaa34beb1b274443b1c46839afd0a484 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 14:54:33.495687 15153 consensus_peers.cc:597] T 46ebd2bd84cc46e08c82a7b893e54578 P eaa34beb1b274443b1c46839afd0a484 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 14:54:33.497856 15187 raft_consensus.cc:1275] T c61864fa2cd249d683f8fb90d8542480 P eaa34beb1b274443b1c46839afd0a484 [term 2 FOLLOWER]: Refusing update from remote peer 9cb8de0701f2482b99e51d5ac080aa13: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 14:54:33.496464 15153 consensus_peers.cc:597] T f389b12c6b304243905f28267dfaeed0 P eaa34beb1b274443b1c46839afd0a484 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 14:54:33.515591 15180 raft_consensus.cc:1275] T cc6f522768894933b21bc94b41605166 P eaa34beb1b274443b1c46839afd0a484 [term 2 FOLLOWER]: Refusing update from remote peer 9cb8de0701f2482b99e51d5ac080aa13: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 14:54:33.518556 15227 consensus_peers.cc:597] T 8974e5ab032b4fba92bfc577280778bf P 9cb8de0701f2482b99e51d5ac080aa13 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 14:54:33.519265 15227 consensus_peers.cc:597] T a1075567fc91458ca7cc9977cf02b170 P 9cb8de0701f2482b99e51d5ac080aa13 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 14:54:33.519732 15227 consensus_peers.cc:597] T 1159198eabeb409996ccbec0cac057f8 P 9cb8de0701f2482b99e51d5ac080aa13 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 14:54:33.520256 15227 consensus_peers.cc:597] T 4f709a060be148029cf72f1af6f79714 P 9cb8de0701f2482b99e51d5ac080aa13 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 14:54:33.520795 15227 consensus_peers.cc:597] T bdf08eed05854470954a5e9dd17dfb27 P 9cb8de0701f2482b99e51d5ac080aa13 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 14:54:33.518159 15964 ts_tablet_manager.cc:1434] T 5b9f8063585c4e5faddebd56fbe1aa01 P dbc2c92e49e346b5b3bd7705a229afc6: Time spent starting tablet: real 0.204s	user 0.006s	sys 0.010s
W20260709 14:54:33.525873 15153 consensus_peers.cc:597] T 7f2cd7c8159d43c080fd8302180ecfca P eaa34beb1b274443b1c46839afd0a484 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 14:54:33.529052 15227 consensus_peers.cc:597] T c61864fa2cd249d683f8fb90d8542480 P 9cb8de0701f2482b99e51d5ac080aa13 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 14:54:33.544448 15964 tablet_bootstrap.cc:492] T 594083b10772433f90560d387bbbeabe P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap starting.
I20260709 14:54:33.551498 15997 consensus_queue.cc:1048] T 4abdbdda3ce149a9904e919be18e7a3f P eaa34beb1b274443b1c46839afd0a484 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 14:54:33.542600 15227 consensus_peers.cc:597] T cc6f522768894933b21bc94b41605166 P 9cb8de0701f2482b99e51d5ac080aa13 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 14:54:33.569492 15184 raft_consensus.cc:1275] T d326f264e68d41d69b5007023083ed9e P eaa34beb1b274443b1c46839afd0a484 [term 2 FOLLOWER]: Refusing update from remote peer 7519e608fbb44d9db8ad30b9f10ae605: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:54:33.572553 15974 consensus_queue.cc:1048] T d86dfc13b2834d7e8b2ad5f975f08154 P eaa34beb1b274443b1c46839afd0a484 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 14:54:33.572755 15962 consensus_queue.cc:1048] T 46ebd2bd84cc46e08c82a7b893e54578 P eaa34beb1b274443b1c46839afd0a484 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 14:54:33.567142 15227 consensus_peers.cc:597] T d2c4ea1c33c64cd09ba04611fdbdc59d P 9cb8de0701f2482b99e51d5ac080aa13 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 14:54:33.581321 15985 consensus_queue.cc:1048] T d326f264e68d41d69b5007023083ed9e P 7519e608fbb44d9db8ad30b9f10ae605 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 14:54:33.584196 15106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f389b12c6b304243905f28267dfaeed0" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605" is_pre_election: true
W20260709 14:54:33.589612 15227 consensus_peers.cc:597] T d2463fd792b240e9911c6b38bcb453b8 P 9cb8de0701f2482b99e51d5ac080aa13 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 14:54:33.622364 15182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f389b12c6b304243905f28267dfaeed0" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484" is_pre_election: true
I20260709 14:54:33.626993 15960 leader_election.cc:304] T f389b12c6b304243905f28267dfaeed0 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbc2c92e49e346b5b3bd7705a229afc6; no voters: 7519e608fbb44d9db8ad30b9f10ae605, eaa34beb1b274443b1c46839afd0a484
I20260709 14:54:33.630687 15982 consensus_queue.cc:1048] T c61864fa2cd249d683f8fb90d8542480 P 9cb8de0701f2482b99e51d5ac080aa13 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 14:54:33.635057 15973 raft_consensus.cc:2749] T f389b12c6b304243905f28267dfaeed0 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 14:54:33.651185 15982 consensus_queue.cc:1048] T cc6f522768894933b21bc94b41605166 P 9cb8de0701f2482b99e51d5ac080aa13 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 14:54:33.645087 15974 consensus_queue.cc:1048] T 9f90ac0a3b004f6ca430ff2fc5198678 P eaa34beb1b274443b1c46839afd0a484 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
W20260709 14:54:33.687069 15079 consensus_peers.cc:597] T f706543d4d3e4e7291624a785ca4e747 P 7519e608fbb44d9db8ad30b9f10ae605 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 14:54:33.694511 15227 consensus_peers.cc:597] T b7c363a305d3434092ef6016b7064eb3 P 9cb8de0701f2482b99e51d5ac080aa13 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 14:54:33.715076 15184 raft_consensus.cc:1275] T d2463fd792b240e9911c6b38bcb453b8 P eaa34beb1b274443b1c46839afd0a484 [term 2 FOLLOWER]: Refusing update from remote peer 9cb8de0701f2482b99e51d5ac080aa13: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:54:33.723213 15964 tablet_bootstrap.cc:492] T 594083b10772433f90560d387bbbeabe P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 14:54:33.724426 15964 tablet_bootstrap.cc:492] T 594083b10772433f90560d387bbbeabe P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap complete.
I20260709 14:54:33.727276 15964 ts_tablet_manager.cc:1403] T 594083b10772433f90560d387bbbeabe P dbc2c92e49e346b5b3bd7705a229afc6: Time spent bootstrapping tablet: real 0.195s	user 0.028s	sys 0.023s
I20260709 14:54:33.766623 15942 consensus_queue.cc:1048] T d2463fd792b240e9911c6b38bcb453b8 P 9cb8de0701f2482b99e51d5ac080aa13 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 14:54:33.831032 15964 raft_consensus.cc:359] T 594083b10772433f90560d387bbbeabe P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:33.832552 15964 raft_consensus.cc:740] T 594083b10772433f90560d387bbbeabe P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbc2c92e49e346b5b3bd7705a229afc6, State: Initialized, Role: FOLLOWER
I20260709 14:54:33.850216 15964 consensus_queue.cc:260] T 594083b10772433f90560d387bbbeabe P dbc2c92e49e346b5b3bd7705a229afc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:33.926331 15964 ts_tablet_manager.cc:1434] T 594083b10772433f90560d387bbbeabe P dbc2c92e49e346b5b3bd7705a229afc6: Time spent starting tablet: real 0.199s	user 0.011s	sys 0.000s
I20260709 14:54:33.927151 15106 raft_consensus.cc:1275] T 7f2cd7c8159d43c080fd8302180ecfca P 7519e608fbb44d9db8ad30b9f10ae605 [term 2 FOLLOWER]: Refusing update from remote peer eaa34beb1b274443b1c46839afd0a484: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:54:33.927656 15964 tablet_bootstrap.cc:492] T 8bae8108fe2a4ce0ba3e35746c7ec9d1 P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap starting.
W20260709 14:54:33.980871 15227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:33805, user_credentials={real_user=slave}} blocked reactor thread for 49597.3us
I20260709 14:54:34.045620 15973 raft_consensus.cc:493] T db39b7ffe995451885f4074ddf16028d P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:34.051034 15973 raft_consensus.cc:515] T db39b7ffe995451885f4074ddf16028d P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
W20260709 14:54:34.065021 15153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:45477, user_credentials={real_user=slave}} blocked reactor thread for 97003.7us
I20260709 14:54:34.066308 15973 leader_election.cc:290] T db39b7ffe995451885f4074ddf16028d P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177), eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805)
I20260709 14:54:34.097399 15973 raft_consensus.cc:493] T bdf08eed05854470954a5e9dd17dfb27 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:54:34.120012 15227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:33805, user_credentials={real_user=slave}} blocked reactor thread for 92199us
I20260709 14:54:34.125315 15105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db39b7ffe995451885f4074ddf16028d" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605" is_pre_election: true
I20260709 14:54:34.132830 15973 raft_consensus.cc:515] T bdf08eed05854470954a5e9dd17dfb27 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:34.155190 16070 raft_consensus.cc:493] T d354c94548fc411ab62b4281ed947944 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:34.156224 16070 raft_consensus.cc:515] T d354c94548fc411ab62b4281ed947944 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:34.159842 16071 raft_consensus.cc:493] T d326f264e68d41d69b5007023083ed9e P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:34.160621 16071 raft_consensus.cc:515] T d326f264e68d41d69b5007023083ed9e P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:34.163164 16071 leader_election.cc:290] T d326f264e68d41d69b5007023083ed9e P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177), eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805)
I20260709 14:54:34.168800 15105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d354c94548fc411ab62b4281ed947944" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605" is_pre_election: true
I20260709 14:54:34.171324 16070 leader_election.cc:290] T d354c94548fc411ab62b4281ed947944 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177), eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805)
W20260709 14:54:34.212649 15153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:45477, user_credentials={real_user=slave}} blocked reactor thread for 48517.9us
I20260709 14:54:34.236733 15105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d326f264e68d41d69b5007023083ed9e" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605" is_pre_election: true
W20260709 14:54:34.249750 16076 log.cc:927] Time spent T d2463fd792b240e9911c6b38bcb453b8 P eaa34beb1b274443b1c46839afd0a484: Append to log took a long time: real 0.086s	user 0.002s	sys 0.000s
I20260709 14:54:34.257601 15973 leader_election.cc:290] T bdf08eed05854470954a5e9dd17dfb27 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493), 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177)
I20260709 14:54:34.297744 16073 consensus_queue.cc:1048] T 7f2cd7c8159d43c080fd8302180ecfca P eaa34beb1b274443b1c46839afd0a484 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 14:54:34.309185 15187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db39b7ffe995451885f4074ddf16028d" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484" is_pre_election: true
I20260709 14:54:34.309836 15184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d326f264e68d41d69b5007023083ed9e" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484" is_pre_election: true
I20260709 14:54:34.340653 15111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf08eed05854470954a5e9dd17dfb27" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605" is_pre_election: true
I20260709 14:54:34.323969 15180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d354c94548fc411ab62b4281ed947944" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484" is_pre_election: true
W20260709 14:54:34.402056 15153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:45477, user_credentials={real_user=slave}} blocked reactor thread for 51264.7us
I20260709 14:54:34.416988 15960 leader_election.cc:304] T db39b7ffe995451885f4074ddf16028d P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbc2c92e49e346b5b3bd7705a229afc6; no voters: 7519e608fbb44d9db8ad30b9f10ae605, eaa34beb1b274443b1c46839afd0a484
I20260709 14:54:34.433465 16070 raft_consensus.cc:2749] T db39b7ffe995451885f4074ddf16028d P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 14:54:34.401993 15973 raft_consensus.cc:493] T 4abdbdda3ce149a9904e919be18e7a3f P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:34.435307 15973 raft_consensus.cc:515] T 4abdbdda3ce149a9904e919be18e7a3f P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:34.438418 15973 leader_election.cc:290] T 4abdbdda3ce149a9904e919be18e7a3f P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805), 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493)
I20260709 14:54:34.442313 15964 tablet_bootstrap.cc:492] T 8bae8108fe2a4ce0ba3e35746c7ec9d1 P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 14:54:34.473765 15964 tablet_bootstrap.cc:492] T 8bae8108fe2a4ce0ba3e35746c7ec9d1 P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap complete.
I20260709 14:54:34.475304 15964 ts_tablet_manager.cc:1403] T 8bae8108fe2a4ce0ba3e35746c7ec9d1 P dbc2c92e49e346b5b3bd7705a229afc6: Time spent bootstrapping tablet: real 0.548s	user 0.035s	sys 0.035s
W20260709 14:54:34.461716 15960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:33805, user_credentials={real_user=slave}} blocked reactor thread for 54075.4us
I20260709 14:54:34.518311 15960 leader_election.cc:304] T d326f264e68d41d69b5007023083ed9e P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbc2c92e49e346b5b3bd7705a229afc6; no voters: 7519e608fbb44d9db8ad30b9f10ae605, eaa34beb1b274443b1c46839afd0a484
I20260709 14:54:34.519472 15973 raft_consensus.cc:2749] T d326f264e68d41d69b5007023083ed9e P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 14:54:34.519935 15960 leader_election.cc:304] T d354c94548fc411ab62b4281ed947944 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbc2c92e49e346b5b3bd7705a229afc6; no voters: 7519e608fbb44d9db8ad30b9f10ae605, eaa34beb1b274443b1c46839afd0a484
W20260709 14:54:34.530956 15957 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:43177, user_credentials={real_user=slave}} blocked reactor thread for 50124.4us
I20260709 14:54:34.533278 15973 raft_consensus.cc:2749] T d354c94548fc411ab62b4281ed947944 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 14:54:34.588239 15187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abdbdda3ce149a9904e919be18e7a3f" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484" is_pre_election: true
W20260709 14:54:34.613991 15227 consensus_peers.cc:597] T d2273a1ad13e4c54ae2101a15a7e56e1 P 9cb8de0701f2482b99e51d5ac080aa13 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 14:54:34.626190 16063 raft_consensus.cc:493] T 91c9f89fcb8b45ff9be43f535cafffde P eaa34beb1b274443b1c46839afd0a484 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:34.627054 16063 raft_consensus.cc:515] T 91c9f89fcb8b45ff9be43f535cafffde P eaa34beb1b274443b1c46839afd0a484 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:34.631276 15973 raft_consensus.cc:493] T 5b9f8063585c4e5faddebd56fbe1aa01 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:34.632007 15973 raft_consensus.cc:515] T 5b9f8063585c4e5faddebd56fbe1aa01 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:34.635739 16070 raft_consensus.cc:493] T 1159198eabeb409996ccbec0cac057f8 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:34.641007 15973 leader_election.cc:290] T 5b9f8063585c4e5faddebd56fbe1aa01 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805), 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493)
I20260709 14:54:34.636608 16070 raft_consensus.cc:515] T 1159198eabeb409996ccbec0cac057f8 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:34.636574 15964 raft_consensus.cc:359] T 8bae8108fe2a4ce0ba3e35746c7ec9d1 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:34.644178 15964 raft_consensus.cc:740] T 8bae8108fe2a4ce0ba3e35746c7ec9d1 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbc2c92e49e346b5b3bd7705a229afc6, State: Initialized, Role: FOLLOWER
I20260709 14:54:34.661972 15964 consensus_queue.cc:260] T 8bae8108fe2a4ce0ba3e35746c7ec9d1 P dbc2c92e49e346b5b3bd7705a229afc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:34.666100 15182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b9f8063585c4e5faddebd56fbe1aa01" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484" is_pre_election: true
I20260709 14:54:34.667307 15964 ts_tablet_manager.cc:1434] T 8bae8108fe2a4ce0ba3e35746c7ec9d1 P dbc2c92e49e346b5b3bd7705a229afc6: Time spent starting tablet: real 0.191s	user 0.007s	sys 0.001s
I20260709 14:54:34.669219 15964 tablet_bootstrap.cc:492] T d2c4ea1c33c64cd09ba04611fdbdc59d P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap starting.
I20260709 14:54:34.678282 16063 leader_election.cc:290] T 91c9f89fcb8b45ff9be43f535cafffde P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477), 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177)
W20260709 14:54:34.689563 15153 leader_election.cc:336] T 91c9f89fcb8b45ff9be43f535cafffde P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111)
I20260709 14:54:34.693477 16090 raft_consensus.cc:493] T 91c9f89fcb8b45ff9be43f535cafffde P 7519e608fbb44d9db8ad30b9f10ae605 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:34.699973 16090 raft_consensus.cc:515] T 91c9f89fcb8b45ff9be43f535cafffde P 7519e608fbb44d9db8ad30b9f10ae605 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:34.701099 16070 leader_election.cc:290] T 1159198eabeb409996ccbec0cac057f8 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493), 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177)
I20260709 14:54:34.707515 16090 leader_election.cc:290] T 91c9f89fcb8b45ff9be43f535cafffde P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477), eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805)
W20260709 14:54:34.732256 15079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:33805, user_credentials={real_user=slave}} blocked reactor thread for 283684us
I20260709 14:54:34.743803 15106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1159198eabeb409996ccbec0cac057f8" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605" is_pre_election: true
I20260709 14:54:34.808998 15261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b9f8063585c4e5faddebd56fbe1aa01" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13" is_pre_election: true
I20260709 14:54:34.810652 15260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abdbdda3ce149a9904e919be18e7a3f" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13" is_pre_election: true
I20260709 14:54:34.811007 15257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf08eed05854470954a5e9dd17dfb27" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13" is_pre_election: true
I20260709 14:54:34.817658 15257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1159198eabeb409996ccbec0cac057f8" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13" is_pre_election: true
I20260709 14:54:34.821098 15957 leader_election.cc:304] T 5b9f8063585c4e5faddebd56fbe1aa01 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbc2c92e49e346b5b3bd7705a229afc6; no voters: 9cb8de0701f2482b99e51d5ac080aa13, eaa34beb1b274443b1c46839afd0a484
I20260709 14:54:34.823158 15957 leader_election.cc:304] T 4abdbdda3ce149a9904e919be18e7a3f P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbc2c92e49e346b5b3bd7705a229afc6; no voters: 9cb8de0701f2482b99e51d5ac080aa13, eaa34beb1b274443b1c46839afd0a484
I20260709 14:54:34.824287 15973 raft_consensus.cc:2749] T 5b9f8063585c4e5faddebd56fbe1aa01 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 14:54:34.827068 16070 raft_consensus.cc:2749] T 4abdbdda3ce149a9904e919be18e7a3f P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 14:54:34.831218 15079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:45477, user_credentials={real_user=slave}} blocked reactor thread for 97558.9us
I20260709 14:54:34.835072 15957 leader_election.cc:304] T bdf08eed05854470954a5e9dd17dfb27 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbc2c92e49e346b5b3bd7705a229afc6; no voters: 7519e608fbb44d9db8ad30b9f10ae605, 9cb8de0701f2482b99e51d5ac080aa13
I20260709 14:54:34.848421 16070 raft_consensus.cc:2749] T bdf08eed05854470954a5e9dd17dfb27 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 14:54:34.849085 15957 leader_election.cc:304] T 1159198eabeb409996ccbec0cac057f8 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbc2c92e49e346b5b3bd7705a229afc6; no voters: 7519e608fbb44d9db8ad30b9f10ae605, 9cb8de0701f2482b99e51d5ac080aa13
I20260709 14:54:34.870471 16070 raft_consensus.cc:2749] T 1159198eabeb409996ccbec0cac057f8 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 14:54:34.876143 15754 raft_consensus.cc:493] T 46a35b81512c4e8c8ec6b83d4c768e1f P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:34.878930 15754 raft_consensus.cc:515] T 46a35b81512c4e8c8ec6b83d4c768e1f P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:34.880643 16067 raft_consensus.cc:493] T 46a35b81512c4e8c8ec6b83d4c768e1f P eaa34beb1b274443b1c46839afd0a484 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:34.881608 15754 leader_election.cc:290] T 46a35b81512c4e8c8ec6b83d4c768e1f P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805), dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477)
I20260709 14:54:34.881405 16067 raft_consensus.cc:515] T 46a35b81512c4e8c8ec6b83d4c768e1f P eaa34beb1b274443b1c46839afd0a484 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:34.883176 15187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a35b81512c4e8c8ec6b83d4c768e1f" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484" is_pre_election: true
I20260709 14:54:34.883910 15187 raft_consensus.cc:2468] T 46a35b81512c4e8c8ec6b83d4c768e1f P eaa34beb1b274443b1c46839afd0a484 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cb8de0701f2482b99e51d5ac080aa13 in term 2.
I20260709 14:54:34.885110 16067 leader_election.cc:290] T 46a35b81512c4e8c8ec6b83d4c768e1f P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493), dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477)
W20260709 14:54:34.890283 15153 leader_election.cc:336] T 46a35b81512c4e8c8ec6b83d4c768e1f P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111)
I20260709 14:54:34.894994 15227 leader_election.cc:304] T 46a35b81512c4e8c8ec6b83d4c768e1f P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cb8de0701f2482b99e51d5ac080aa13, eaa34beb1b274443b1c46839afd0a484; no voters: 
I20260709 14:54:34.896749 15257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a35b81512c4e8c8ec6b83d4c768e1f" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13" is_pre_election: true
I20260709 14:54:34.896106 15942 raft_consensus.cc:2804] T 46a35b81512c4e8c8ec6b83d4c768e1f P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 14:54:34.901641 15187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c9f89fcb8b45ff9be43f535cafffde" candidate_uuid: "7519e608fbb44d9db8ad30b9f10ae605" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484" is_pre_election: true
I20260709 14:54:34.902465 15187 raft_consensus.cc:2468] T 91c9f89fcb8b45ff9be43f535cafffde P eaa34beb1b274443b1c46839afd0a484 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7519e608fbb44d9db8ad30b9f10ae605 in term 2.
I20260709 14:54:34.901285 15942 raft_consensus.cc:493] T 46a35b81512c4e8c8ec6b83d4c768e1f P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:54:34.909514 15942 raft_consensus.cc:3060] T 46a35b81512c4e8c8ec6b83d4c768e1f P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:54:34.933115 15106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c9f89fcb8b45ff9be43f535cafffde" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605" is_pre_election: true
I20260709 14:54:34.934094 15106 raft_consensus.cc:2468] T 91c9f89fcb8b45ff9be43f535cafffde P 7519e608fbb44d9db8ad30b9f10ae605 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa34beb1b274443b1c46839afd0a484 in term 2.
W20260709 14:54:34.949877 15227 leader_election.cc:336] T 46a35b81512c4e8c8ec6b83d4c768e1f P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111)
I20260709 14:54:34.965315 15942 raft_consensus.cc:515] T 46a35b81512c4e8c8ec6b83d4c768e1f P 9cb8de0701f2482b99e51d5ac080aa13 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:34.983148 15257 raft_consensus.cc:2393] T 46a35b81512c4e8c8ec6b83d4c768e1f P 9cb8de0701f2482b99e51d5ac080aa13 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eaa34beb1b274443b1c46839afd0a484 in current term 3: Already voted for candidate 9cb8de0701f2482b99e51d5ac080aa13 in this term.
I20260709 14:54:34.991799 15079 leader_election.cc:304] T 91c9f89fcb8b45ff9be43f535cafffde P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7519e608fbb44d9db8ad30b9f10ae605, eaa34beb1b274443b1c46839afd0a484; no voters: 
I20260709 14:54:34.993016 15817 raft_consensus.cc:2804] T 91c9f89fcb8b45ff9be43f535cafffde P 7519e608fbb44d9db8ad30b9f10ae605 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 14:54:34.993481 15817 raft_consensus.cc:493] T 91c9f89fcb8b45ff9be43f535cafffde P 7519e608fbb44d9db8ad30b9f10ae605 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:54:34.993891 15817 raft_consensus.cc:3060] T 91c9f89fcb8b45ff9be43f535cafffde P 7519e608fbb44d9db8ad30b9f10ae605 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:54:34.994846 15964 tablet_bootstrap.cc:492] T d2c4ea1c33c64cd09ba04611fdbdc59d P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 14:54:35.039729 15150 leader_election.cc:304] T 46a35b81512c4e8c8ec6b83d4c768e1f P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa34beb1b274443b1c46839afd0a484; no voters: 9cb8de0701f2482b99e51d5ac080aa13, dbc2c92e49e346b5b3bd7705a229afc6
I20260709 14:54:35.046764 16073 raft_consensus.cc:3060] T 46a35b81512c4e8c8ec6b83d4c768e1f P eaa34beb1b274443b1c46839afd0a484 [term 2 FOLLOWER]: Advancing to term 3
W20260709 14:54:35.061767 15079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:33805, user_credentials={real_user=slave}} blocked reactor thread for 66020.2us
I20260709 14:54:35.063709 15150 leader_election.cc:304] T 91c9f89fcb8b45ff9be43f535cafffde P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7519e608fbb44d9db8ad30b9f10ae605, eaa34beb1b274443b1c46839afd0a484; no voters: dbc2c92e49e346b5b3bd7705a229afc6
I20260709 14:54:35.071734 16074 raft_consensus.cc:2804] T 91c9f89fcb8b45ff9be43f535cafffde P eaa34beb1b274443b1c46839afd0a484 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 14:54:35.072305 15942 leader_election.cc:290] T 46a35b81512c4e8c8ec6b83d4c768e1f P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 3 election: Requested vote from peers eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805), dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477)
I20260709 14:54:35.072300 16074 raft_consensus.cc:493] T 91c9f89fcb8b45ff9be43f535cafffde P eaa34beb1b274443b1c46839afd0a484 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:54:35.073582 16074 raft_consensus.cc:3060] T 91c9f89fcb8b45ff9be43f535cafffde P eaa34beb1b274443b1c46839afd0a484 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:54:35.078042 15964 tablet_bootstrap.cc:492] T d2c4ea1c33c64cd09ba04611fdbdc59d P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap complete.
I20260709 14:54:35.079159 15964 ts_tablet_manager.cc:1403] T d2c4ea1c33c64cd09ba04611fdbdc59d P dbc2c92e49e346b5b3bd7705a229afc6: Time spent bootstrapping tablet: real 0.410s	user 0.038s	sys 0.020s
W20260709 14:54:35.091591 15153 consensus_peers.cc:597] T 5b9f8063585c4e5faddebd56fbe1aa01 P eaa34beb1b274443b1c46839afd0a484 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 14:54:35.092301 15182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a35b81512c4e8c8ec6b83d4c768e1f" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484"
I20260709 14:54:35.107115 15817 raft_consensus.cc:515] T 91c9f89fcb8b45ff9be43f535cafffde P 7519e608fbb44d9db8ad30b9f10ae605 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
W20260709 14:54:35.116688 15079 leader_election.cc:336] T 91c9f89fcb8b45ff9be43f535cafffde P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111)
W20260709 14:54:35.120723 15227 consensus_peers.cc:597] T 9275d24f141d455cb200b9784c470d33 P 9cb8de0701f2482b99e51d5ac080aa13 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 14:54:35.123571 16073 raft_consensus.cc:2749] T 46a35b81512c4e8c8ec6b83d4c768e1f P eaa34beb1b274443b1c46839afd0a484 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 14:54:35.111187 15964 raft_consensus.cc:359] T d2c4ea1c33c64cd09ba04611fdbdc59d P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:35.129514 15964 raft_consensus.cc:740] T d2c4ea1c33c64cd09ba04611fdbdc59d P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbc2c92e49e346b5b3bd7705a229afc6, State: Initialized, Role: FOLLOWER
W20260709 14:54:35.121572 15227 leader_election.cc:336] T 46a35b81512c4e8c8ec6b83d4c768e1f P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111)
I20260709 14:54:35.140470 15964 consensus_queue.cc:260] T d2c4ea1c33c64cd09ba04611fdbdc59d P dbc2c92e49e346b5b3bd7705a229afc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:35.146341 15964 ts_tablet_manager.cc:1434] T d2c4ea1c33c64cd09ba04611fdbdc59d P dbc2c92e49e346b5b3bd7705a229afc6: Time spent starting tablet: real 0.067s	user 0.009s	sys 0.000s
I20260709 14:54:35.147284 15964 tablet_bootstrap.cc:492] T 3b4c50fac37a43c0988d5ea911d09f43 P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap starting.
I20260709 14:54:35.148334 16070 raft_consensus.cc:493] T 594083b10772433f90560d387bbbeabe P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:35.148512 16074 raft_consensus.cc:515] T 91c9f89fcb8b45ff9be43f535cafffde P eaa34beb1b274443b1c46839afd0a484 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:35.149435 16070 raft_consensus.cc:515] T 594083b10772433f90560d387bbbeabe P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:35.154148 16074 leader_election.cc:290] T 91c9f89fcb8b45ff9be43f535cafffde P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 3 election: Requested vote from peers dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477), 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177)
I20260709 14:54:35.153999 15182 raft_consensus.cc:2468] T 46a35b81512c4e8c8ec6b83d4c768e1f P eaa34beb1b274443b1c46839afd0a484 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cb8de0701f2482b99e51d5ac080aa13 in term 3.
I20260709 14:54:35.159301 16070 leader_election.cc:290] T 594083b10772433f90560d387bbbeabe P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805), 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493)
I20260709 14:54:35.157742 15185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594083b10772433f90560d387bbbeabe" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484" is_pre_election: true
W20260709 14:54:35.167416 15153 leader_election.cc:336] T 91c9f89fcb8b45ff9be43f535cafffde P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111)
I20260709 14:54:35.164115 15105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c9f89fcb8b45ff9be43f535cafffde" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605"
I20260709 14:54:35.169533 15105 raft_consensus.cc:2393] T 91c9f89fcb8b45ff9be43f535cafffde P 7519e608fbb44d9db8ad30b9f10ae605 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate eaa34beb1b274443b1c46839afd0a484 in current term 3: Already voted for candidate 7519e608fbb44d9db8ad30b9f10ae605 in this term.
I20260709 14:54:35.171592 15150 leader_election.cc:304] T 91c9f89fcb8b45ff9be43f535cafffde P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa34beb1b274443b1c46839afd0a484; no voters: 7519e608fbb44d9db8ad30b9f10ae605, dbc2c92e49e346b5b3bd7705a229afc6
I20260709 14:54:35.169181 15185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c9f89fcb8b45ff9be43f535cafffde" candidate_uuid: "7519e608fbb44d9db8ad30b9f10ae605" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484"
I20260709 14:54:35.173225 15185 raft_consensus.cc:2393] T 91c9f89fcb8b45ff9be43f535cafffde P eaa34beb1b274443b1c46839afd0a484 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7519e608fbb44d9db8ad30b9f10ae605 in current term 3: Already voted for candidate eaa34beb1b274443b1c46839afd0a484 in this term.
I20260709 14:54:35.174494 16074 raft_consensus.cc:2749] T 91c9f89fcb8b45ff9be43f535cafffde P eaa34beb1b274443b1c46839afd0a484 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 14:54:35.177145 15079 leader_election.cc:336] T 91c9f89fcb8b45ff9be43f535cafffde P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111)
I20260709 14:54:35.177868 15079 leader_election.cc:304] T 91c9f89fcb8b45ff9be43f535cafffde P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7519e608fbb44d9db8ad30b9f10ae605; no voters: dbc2c92e49e346b5b3bd7705a229afc6, eaa34beb1b274443b1c46839afd0a484
I20260709 14:54:35.179802 16090 raft_consensus.cc:2749] T 91c9f89fcb8b45ff9be43f535cafffde P 7519e608fbb44d9db8ad30b9f10ae605 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 14:54:35.163057 15817 leader_election.cc:290] T 91c9f89fcb8b45ff9be43f535cafffde P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 3 election: Requested vote from peers dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477), eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805)
I20260709 14:54:35.237453 15227 leader_election.cc:304] T 46a35b81512c4e8c8ec6b83d4c768e1f P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9cb8de0701f2482b99e51d5ac080aa13, eaa34beb1b274443b1c46839afd0a484; no voters: dbc2c92e49e346b5b3bd7705a229afc6
I20260709 14:54:35.241518 16042 raft_consensus.cc:2804] T 46a35b81512c4e8c8ec6b83d4c768e1f P 9cb8de0701f2482b99e51d5ac080aa13 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 14:54:35.245113 15260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594083b10772433f90560d387bbbeabe" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13" is_pre_election: true
I20260709 14:54:35.248014 16042 raft_consensus.cc:697] T 46a35b81512c4e8c8ec6b83d4c768e1f P 9cb8de0701f2482b99e51d5ac080aa13 [term 3 LEADER]: Becoming Leader. State: Replica: 9cb8de0701f2482b99e51d5ac080aa13, State: Running, Role: LEADER
I20260709 14:54:35.258126 16042 consensus_queue.cc:237] T 46a35b81512c4e8c8ec6b83d4c768e1f P 9cb8de0701f2482b99e51d5ac080aa13 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
W20260709 14:54:35.272809 15227 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111) [suppressed 367 similar messages]
I20260709 14:54:35.288412 15957 leader_election.cc:304] T 594083b10772433f90560d387bbbeabe P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbc2c92e49e346b5b3bd7705a229afc6; no voters: 9cb8de0701f2482b99e51d5ac080aa13, eaa34beb1b274443b1c46839afd0a484
I20260709 14:54:35.289692 16070 raft_consensus.cc:2749] T 594083b10772433f90560d387bbbeabe P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 14:54:35.300135 15964 tablet_bootstrap.cc:492] T 3b4c50fac37a43c0988d5ea911d09f43 P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 14:54:35.301426 15964 tablet_bootstrap.cc:492] T 3b4c50fac37a43c0988d5ea911d09f43 P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap complete.
I20260709 14:54:35.303368 15964 ts_tablet_manager.cc:1403] T 3b4c50fac37a43c0988d5ea911d09f43 P dbc2c92e49e346b5b3bd7705a229afc6: Time spent bootstrapping tablet: real 0.156s	user 0.022s	sys 0.011s
I20260709 14:54:35.303812 14933 catalog_manager.cc:5697] T 46a35b81512c4e8c8ec6b83d4c768e1f P 9cb8de0701f2482b99e51d5ac080aa13 reported cstate change: term changed from 1 to 3, leader changed from dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65) to 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68). New cstate: current_term: 3 leader_uuid: "9cb8de0701f2482b99e51d5ac080aa13" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } health_report { overall_health: UNKNOWN } } }
I20260709 14:54:35.306802 15964 raft_consensus.cc:359] T 3b4c50fac37a43c0988d5ea911d09f43 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:35.307641 15964 raft_consensus.cc:740] T 3b4c50fac37a43c0988d5ea911d09f43 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbc2c92e49e346b5b3bd7705a229afc6, State: Initialized, Role: FOLLOWER
W20260709 14:54:35.322818 15153 consensus_peers.cc:597] T a9dab1878c4b4550880f5680c6d48c67 P eaa34beb1b274443b1c46839afd0a484 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 14:54:35.323176 15964 consensus_queue.cc:260] T 3b4c50fac37a43c0988d5ea911d09f43 P dbc2c92e49e346b5b3bd7705a229afc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:35.327732 15964 ts_tablet_manager.cc:1434] T 3b4c50fac37a43c0988d5ea911d09f43 P dbc2c92e49e346b5b3bd7705a229afc6: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.001s
I20260709 14:54:35.337698 15964 tablet_bootstrap.cc:492] T 91c9f89fcb8b45ff9be43f535cafffde P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap starting.
I20260709 14:54:35.395102 15964 tablet_bootstrap.cc:492] T 91c9f89fcb8b45ff9be43f535cafffde P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 14:54:35.396556 15964 tablet_bootstrap.cc:492] T 91c9f89fcb8b45ff9be43f535cafffde P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap complete.
W20260709 14:54:35.400311 15153 consensus_peers.cc:597] T 98280a706ec54413830f342b48666f6e P eaa34beb1b274443b1c46839afd0a484 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 14:54:35.401114 15964 ts_tablet_manager.cc:1403] T 91c9f89fcb8b45ff9be43f535cafffde P dbc2c92e49e346b5b3bd7705a229afc6: Time spent bootstrapping tablet: real 0.064s	user 0.015s	sys 0.012s
I20260709 14:54:35.416745 15964 raft_consensus.cc:359] T 91c9f89fcb8b45ff9be43f535cafffde P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:35.417922 15964 raft_consensus.cc:740] T 91c9f89fcb8b45ff9be43f535cafffde P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbc2c92e49e346b5b3bd7705a229afc6, State: Initialized, Role: FOLLOWER
I20260709 14:54:35.420200 15964 consensus_queue.cc:260] T 91c9f89fcb8b45ff9be43f535cafffde P dbc2c92e49e346b5b3bd7705a229afc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:35.427166 15964 ts_tablet_manager.cc:1434] T 91c9f89fcb8b45ff9be43f535cafffde P dbc2c92e49e346b5b3bd7705a229afc6: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.003s
I20260709 14:54:35.450484 15964 tablet_bootstrap.cc:492] T d86dfc13b2834d7e8b2ad5f975f08154 P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap starting.
W20260709 14:54:35.457348 15153 consensus_peers.cc:597] T d6bcaee371174feaa06943f949efda49 P eaa34beb1b274443b1c46839afd0a484 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 14:54:35.476946 15153 consensus_peers.cc:597] T 5f5dbc86fc8f4ae5b77e0f23adfcd593 P eaa34beb1b274443b1c46839afd0a484 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 14:54:35.513175 15153 consensus_peers.cc:597] T 4abdbdda3ce149a9904e919be18e7a3f P eaa34beb1b274443b1c46839afd0a484 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 14:54:35.559566 15153 consensus_peers.cc:597] T 5e8a01e27eab492bb73df3359e500627 P eaa34beb1b274443b1c46839afd0a484 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 14:54:35.575356 15964 tablet_bootstrap.cc:492] T d86dfc13b2834d7e8b2ad5f975f08154 P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 14:54:35.576815 15964 tablet_bootstrap.cc:492] T d86dfc13b2834d7e8b2ad5f975f08154 P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap complete.
I20260709 14:54:35.579778 15964 ts_tablet_manager.cc:1403] T d86dfc13b2834d7e8b2ad5f975f08154 P dbc2c92e49e346b5b3bd7705a229afc6: Time spent bootstrapping tablet: real 0.152s	user 0.032s	sys 0.009s
I20260709 14:54:35.603792 15964 raft_consensus.cc:359] T d86dfc13b2834d7e8b2ad5f975f08154 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:35.615532 15964 raft_consensus.cc:740] T d86dfc13b2834d7e8b2ad5f975f08154 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbc2c92e49e346b5b3bd7705a229afc6, State: Initialized, Role: FOLLOWER
I20260709 14:54:35.616554 15964 consensus_queue.cc:260] T d86dfc13b2834d7e8b2ad5f975f08154 P dbc2c92e49e346b5b3bd7705a229afc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:35.626538 15964 ts_tablet_manager.cc:1434] T d86dfc13b2834d7e8b2ad5f975f08154 P dbc2c92e49e346b5b3bd7705a229afc6: Time spent starting tablet: real 0.046s	user 0.010s	sys 0.000s
I20260709 14:54:35.629179 15964 tablet_bootstrap.cc:492] T c61864fa2cd249d683f8fb90d8542480 P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap starting.
I20260709 14:54:35.658993  6549 rpc_server.cc:307] RPC server started. Bound to: 127.6.101.65:45477
I20260709 14:54:35.671373 16140 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.101.65:45477 every 8 connection(s)
I20260709 14:54:35.695842 15964 tablet_bootstrap.cc:492] T c61864fa2cd249d683f8fb90d8542480 P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 14:54:35.724267 15964 tablet_bootstrap.cc:492] T c61864fa2cd249d683f8fb90d8542480 P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap complete.
I20260709 14:54:35.726377 15964 ts_tablet_manager.cc:1403] T c61864fa2cd249d683f8fb90d8542480 P dbc2c92e49e346b5b3bd7705a229afc6: Time spent bootstrapping tablet: real 0.098s	user 0.024s	sys 0.008s
I20260709 14:54:35.750792 15964 raft_consensus.cc:359] T c61864fa2cd249d683f8fb90d8542480 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:35.751673 15964 raft_consensus.cc:740] T c61864fa2cd249d683f8fb90d8542480 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbc2c92e49e346b5b3bd7705a229afc6, State: Initialized, Role: FOLLOWER
I20260709 14:54:35.753135 15964 consensus_queue.cc:260] T c61864fa2cd249d683f8fb90d8542480 P dbc2c92e49e346b5b3bd7705a229afc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:35.765656 16108 raft_consensus.cc:3060] T c61864fa2cd249d683f8fb90d8542480 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Advancing to term 2
W20260709 14:54:35.787667 15227 consensus_peers.cc:597] T 0284d9835221427ab285015d48a8040d P 9cb8de0701f2482b99e51d5ac080aa13 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 14:54:35.788796 15227 consensus_peers.cc:597] T 5585b0f6bbf04c10865d2463767621dc P 9cb8de0701f2482b99e51d5ac080aa13 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
W20260709 14:54:35.790196 15227 consensus_peers.cc:597] T 8974e5ab032b4fba92bfc577280778bf P 9cb8de0701f2482b99e51d5ac080aa13 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 14:54:35.793552 15964 ts_tablet_manager.cc:1434] T c61864fa2cd249d683f8fb90d8542480 P dbc2c92e49e346b5b3bd7705a229afc6: Time spent starting tablet: real 0.054s	user 0.007s	sys 0.000s
W20260709 14:54:35.794243 15227 consensus_peers.cc:597] T 4f709a060be148029cf72f1af6f79714 P 9cb8de0701f2482b99e51d5ac080aa13 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 14:54:35.795015 15964 tablet_bootstrap.cc:492] T 70bc59fabcdc4359a84d584f36d18d01 P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap starting.
I20260709 14:54:35.814452 16070 raft_consensus.cc:493] T f389b12c6b304243905f28267dfaeed0 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:35.822032 15185 raft_consensus.cc:1275] T 46a35b81512c4e8c8ec6b83d4c768e1f P eaa34beb1b274443b1c46839afd0a484 [term 3 FOLLOWER]: Refusing update from remote peer 9cb8de0701f2482b99e51d5ac080aa13: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 14:54:35.824680 16062 consensus_queue.cc:1048] T 46a35b81512c4e8c8ec6b83d4c768e1f P 9cb8de0701f2482b99e51d5ac080aa13 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 14:54:35.858629 16103 raft_consensus.cc:3060] T 8bae8108fe2a4ce0ba3e35746c7ec9d1 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:54:35.815951 16070 raft_consensus.cc:515] T f389b12c6b304243905f28267dfaeed0 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
W20260709 14:54:35.871748 15227 consensus_peers.cc:597] T 46a35b81512c4e8c8ec6b83d4c768e1f P 9cb8de0701f2482b99e51d5ac080aa13 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:54:35.874161 16070 leader_election.cc:290] T f389b12c6b304243905f28267dfaeed0 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177), eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805)
I20260709 14:54:35.875682 15182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f389b12c6b304243905f28267dfaeed0" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484" is_pre_election: true
I20260709 14:54:35.890017 16099 raft_consensus.cc:3060] T db39b7ffe995451885f4074ddf16028d P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Advancing to term 2
W20260709 14:54:35.893182 15079 consensus_peers.cc:597] T 966a06ab56a6479283ab2818c9439d4f P 7519e608fbb44d9db8ad30b9f10ae605 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 14:54:35.896507 15106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f389b12c6b304243905f28267dfaeed0" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605" is_pre_election: true
I20260709 14:54:35.907523 15957 leader_election.cc:304] T f389b12c6b304243905f28267dfaeed0 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbc2c92e49e346b5b3bd7705a229afc6; no voters: 7519e608fbb44d9db8ad30b9f10ae605, eaa34beb1b274443b1c46839afd0a484
I20260709 14:54:35.908927 16149 raft_consensus.cc:2749] T f389b12c6b304243905f28267dfaeed0 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 14:54:35.923044 15150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:43177, user_credentials={real_user=slave}} blocked reactor thread for 87095.5us
W20260709 14:54:35.951254 15227 consensus_peers.cc:597] T 7699ad132e12472180b6a9527951c397 P 9cb8de0701f2482b99e51d5ac080aa13 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 14:54:35.962491 16105 raft_consensus.cc:3060] T 4abdbdda3ce149a9904e919be18e7a3f P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Advancing to term 2
W20260709 14:54:36.060408 15153 consensus_peers.cc:597] T 42d6909533d14edbbfdad30a9972658d P eaa34beb1b274443b1c46839afd0a484 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
W20260709 14:54:36.064756 15153 consensus_peers.cc:597] T 798d0882b1ea4b26b598c236de8f18c9 P eaa34beb1b274443b1c46839afd0a484 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
W20260709 14:54:36.065680 15153 consensus_peers.cc:597] T d178b88fdab54a29b05fb98e05ffe8c5 P eaa34beb1b274443b1c46839afd0a484 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
W20260709 14:54:36.128958 16153 log.cc:927] Time spent T db39b7ffe995451885f4074ddf16028d P dbc2c92e49e346b5b3bd7705a229afc6: Append to log took a long time: real 0.101s	user 0.002s	sys 0.000s
W20260709 14:54:36.136682 15227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:33805, user_credentials={real_user=slave}} blocked reactor thread for 105572us
W20260709 14:54:36.181965 15153 consensus_peers.cc:597] T 263098160f604ae3aa31782c37e2fd52 P eaa34beb1b274443b1c46839afd0a484 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
W20260709 14:54:36.200196 15227 consensus_peers.cc:597] T dd44b332dc744f94a5f7cfffc06f3956 P 9cb8de0701f2482b99e51d5ac080aa13 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
W20260709 14:54:36.230468 15150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.68:45493, user_credentials={real_user=slave}} blocked reactor thread for 161650us
W20260709 14:54:36.292091 15079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:33805, user_credentials={real_user=slave}} blocked reactor thread for 112512us
I20260709 14:54:36.256269 16108 raft_consensus.cc:3060] T d354c94548fc411ab62b4281ed947944 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:54:36.415948 16099 raft_consensus.cc:3060] T d86dfc13b2834d7e8b2ad5f975f08154 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:54:36.423513 16103 raft_consensus.cc:3060] T 5b9f8063585c4e5faddebd56fbe1aa01 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Advancing to term 2
W20260709 14:54:36.426659 15079 consensus_peers.cc:597] T d61f9ecebc3c4a028f5327bc9debf432 P 7519e608fbb44d9db8ad30b9f10ae605 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 14:54:36.443168 16102 raft_consensus.cc:3060] T d326f264e68d41d69b5007023083ed9e P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:54:36.447599 15964 tablet_bootstrap.cc:492] T 70bc59fabcdc4359a84d584f36d18d01 P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 14:54:36.455180 15153 consensus_peers.cc:597] T 9f90ac0a3b004f6ca430ff2fc5198678 P eaa34beb1b274443b1c46839afd0a484 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 14:54:36.466990 15227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:33805, user_credentials={real_user=slave}} blocked reactor thread for 158797us
I20260709 14:54:36.468930 15964 tablet_bootstrap.cc:492] T 70bc59fabcdc4359a84d584f36d18d01 P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap complete.
I20260709 14:54:36.469944 15964 ts_tablet_manager.cc:1403] T 70bc59fabcdc4359a84d584f36d18d01 P dbc2c92e49e346b5b3bd7705a229afc6: Time spent bootstrapping tablet: real 0.675s	user 0.025s	sys 0.009s
W20260709 14:54:36.475181 15079 consensus_peers.cc:597] T 70bc59fabcdc4359a84d584f36d18d01 P 7519e608fbb44d9db8ad30b9f10ae605 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 11: this message will repeat every 5th retry.
I20260709 14:54:36.493781 15964 raft_consensus.cc:359] T 70bc59fabcdc4359a84d584f36d18d01 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:36.494946 15964 raft_consensus.cc:740] T 70bc59fabcdc4359a84d584f36d18d01 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbc2c92e49e346b5b3bd7705a229afc6, State: Initialized, Role: FOLLOWER
I20260709 14:54:36.502457 15964 consensus_queue.cc:260] T 70bc59fabcdc4359a84d584f36d18d01 P dbc2c92e49e346b5b3bd7705a229afc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:36.527757 15964 ts_tablet_manager.cc:1434] T 70bc59fabcdc4359a84d584f36d18d01 P dbc2c92e49e346b5b3bd7705a229afc6: Time spent starting tablet: real 0.057s	user 0.010s	sys 0.008s
I20260709 14:54:36.557337 15964 tablet_bootstrap.cc:492] T 42d6909533d14edbbfdad30a9972658d P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap starting.
I20260709 14:54:36.606127 16142 heartbeater.cc:344] Connected to a master server at 127.6.101.126:35373
I20260709 14:54:36.639492 16142 heartbeater.cc:461] Registering TS with master...
I20260709 14:54:36.640640 16142 heartbeater.cc:507] Master 127.6.101.126:35373 requested a full tablet report, sending...
W20260709 14:54:36.643867 15227 consensus_peers.cc:597] T a1075567fc91458ca7cc9977cf02b170 P 9cb8de0701f2482b99e51d5ac080aa13 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
W20260709 14:54:36.644809 15227 consensus_peers.cc:597] T cc6f522768894933b21bc94b41605166 P 9cb8de0701f2482b99e51d5ac080aa13 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 14:54:36.633384 16070 raft_consensus.cc:493] T d354c94548fc411ab62b4281ed947944 P dbc2c92e49e346b5b3bd7705a229afc6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7519e608fbb44d9db8ad30b9f10ae605)
I20260709 14:54:36.646037 16070 raft_consensus.cc:515] T d354c94548fc411ab62b4281ed947944 P dbc2c92e49e346b5b3bd7705a229afc6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
W20260709 14:54:36.615340 15153 consensus_peers.cc:597] T 46ebd2bd84cc46e08c82a7b893e54578 P eaa34beb1b274443b1c46839afd0a484 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 14:54:36.651230 15153 consensus_peers.cc:597] T 7f2cd7c8159d43c080fd8302180ecfca P eaa34beb1b274443b1c46839afd0a484 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 14:54:36.658128 16179 raft_consensus.cc:493] T d326f264e68d41d69b5007023083ed9e P dbc2c92e49e346b5b3bd7705a229afc6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7519e608fbb44d9db8ad30b9f10ae605)
I20260709 14:54:36.659032 16179 raft_consensus.cc:515] T d326f264e68d41d69b5007023083ed9e P dbc2c92e49e346b5b3bd7705a229afc6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:36.660954 16070 leader_election.cc:290] T d354c94548fc411ab62b4281ed947944 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177), eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805)
I20260709 14:54:36.663033 15106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d354c94548fc411ab62b4281ed947944" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605" is_pre_election: true
I20260709 14:54:36.666528 15182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d354c94548fc411ab62b4281ed947944" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484" is_pre_election: true
I20260709 14:54:36.668286 15960 leader_election.cc:304] T d354c94548fc411ab62b4281ed947944 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbc2c92e49e346b5b3bd7705a229afc6; no voters: 7519e608fbb44d9db8ad30b9f10ae605, eaa34beb1b274443b1c46839afd0a484
W20260709 14:54:36.618196 15224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:43177, user_credentials={real_user=slave}} blocked reactor thread for 147334us
I20260709 14:54:36.685385 16179 leader_election.cc:290] T d326f264e68d41d69b5007023083ed9e P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177), eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805)
I20260709 14:54:36.688772 15187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d326f264e68d41d69b5007023083ed9e" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484" is_pre_election: true
I20260709 14:54:36.689893 16070 raft_consensus.cc:2749] T d354c94548fc411ab62b4281ed947944 P dbc2c92e49e346b5b3bd7705a229afc6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 14:54:36.752236 16070 raft_consensus.cc:493] T 91c9f89fcb8b45ff9be43f535cafffde P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:36.753047 16070 raft_consensus.cc:515] T 91c9f89fcb8b45ff9be43f535cafffde P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:36.766201 16070 leader_election.cc:290] T 91c9f89fcb8b45ff9be43f535cafffde P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177), eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805)
I20260709 14:54:36.768002 15185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c9f89fcb8b45ff9be43f535cafffde" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484" is_pre_election: true
I20260709 14:54:36.769081 15185 raft_consensus.cc:2368] T 91c9f89fcb8b45ff9be43f535cafffde P eaa34beb1b274443b1c46839afd0a484 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbc2c92e49e346b5b3bd7705a229afc6 for earlier term 2. Current term is 3.
I20260709 14:54:36.773518 15960 leader_election.cc:400] T 91c9f89fcb8b45ff9be43f535cafffde P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 2 pre-election: Vote denied by peer eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805) with higher term. Message: Invalid argument: T 91c9f89fcb8b45ff9be43f535cafffde P eaa34beb1b274443b1c46839afd0a484 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbc2c92e49e346b5b3bd7705a229afc6 for earlier term 2. Current term is 3.
I20260709 14:54:36.774164 15960 leader_election.cc:403] T 91c9f89fcb8b45ff9be43f535cafffde P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 14:54:36.777029 15106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d326f264e68d41d69b5007023083ed9e" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605" is_pre_election: true
I20260709 14:54:36.775079 16070 raft_consensus.cc:3060] T 91c9f89fcb8b45ff9be43f535cafffde P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Advancing to term 3
W20260709 14:54:36.784274 15227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:33805, user_credentials={real_user=slave}} blocked reactor thread for 48884us
I20260709 14:54:36.800477 15964 tablet_bootstrap.cc:492] T 42d6909533d14edbbfdad30a9972658d P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 14:54:36.801767 15964 tablet_bootstrap.cc:492] T 42d6909533d14edbbfdad30a9972658d P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap complete.
I20260709 14:54:36.802611 15964 ts_tablet_manager.cc:1403] T 42d6909533d14edbbfdad30a9972658d P dbc2c92e49e346b5b3bd7705a229afc6: Time spent bootstrapping tablet: real 0.247s	user 0.027s	sys 0.010s
I20260709 14:54:36.804525 16070 raft_consensus.cc:2749] T 91c9f89fcb8b45ff9be43f535cafffde P dbc2c92e49e346b5b3bd7705a229afc6 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805) with higher term. Message: Invalid argument: T 91c9f89fcb8b45ff9be43f535cafffde P eaa34beb1b274443b1c46839afd0a484 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbc2c92e49e346b5b3bd7705a229afc6 for earlier term 2. Current term is 3.
I20260709 14:54:36.805619 15964 raft_consensus.cc:359] T 42d6909533d14edbbfdad30a9972658d P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:36.806499 15964 raft_consensus.cc:740] T 42d6909533d14edbbfdad30a9972658d P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbc2c92e49e346b5b3bd7705a229afc6, State: Initialized, Role: FOLLOWER
I20260709 14:54:36.807454 15964 consensus_queue.cc:260] T 42d6909533d14edbbfdad30a9972658d P dbc2c92e49e346b5b3bd7705a229afc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:36.810258 15964 ts_tablet_manager.cc:1434] T 42d6909533d14edbbfdad30a9972658d P dbc2c92e49e346b5b3bd7705a229afc6: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 14:54:36.811455 15964 tablet_bootstrap.cc:492] T d61f9ecebc3c4a028f5327bc9debf432 P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap starting.
I20260709 14:54:36.813470 15106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c9f89fcb8b45ff9be43f535cafffde" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605" is_pre_election: true
I20260709 14:54:36.814459 15106 raft_consensus.cc:2368] T 91c9f89fcb8b45ff9be43f535cafffde P 7519e608fbb44d9db8ad30b9f10ae605 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbc2c92e49e346b5b3bd7705a229afc6 for earlier term 2. Current term is 3.
I20260709 14:54:36.818181 15957 leader_election.cc:304] T d326f264e68d41d69b5007023083ed9e P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbc2c92e49e346b5b3bd7705a229afc6; no voters: 7519e608fbb44d9db8ad30b9f10ae605, eaa34beb1b274443b1c46839afd0a484
I20260709 14:54:36.833384 15957 leader_election.cc:400] T 91c9f89fcb8b45ff9be43f535cafffde P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177) with higher term. Message: Invalid argument: T 91c9f89fcb8b45ff9be43f535cafffde P 7519e608fbb44d9db8ad30b9f10ae605 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbc2c92e49e346b5b3bd7705a229afc6 for earlier term 2. Current term is 3.
I20260709 14:54:36.833971 16179 raft_consensus.cc:2749] T d326f264e68d41d69b5007023083ed9e P dbc2c92e49e346b5b3bd7705a229afc6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 14:54:36.831938 15227 consensus_peers.cc:597] T d2463fd792b240e9911c6b38bcb453b8 P 9cb8de0701f2482b99e51d5ac080aa13 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 14:54:36.837477 15079 consensus_peers.cc:597] T 054739df584d4b9db840777c2ae17555 P 7519e608fbb44d9db8ad30b9f10ae605 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 14:54:36.842185 15964 tablet_bootstrap.cc:492] T d61f9ecebc3c4a028f5327bc9debf432 P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 14:54:36.846625 14933 ts_manager.cc:194] Re-registered known tserver with Master: dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477)
I20260709 14:54:36.848804 15964 tablet_bootstrap.cc:492] T d61f9ecebc3c4a028f5327bc9debf432 P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap complete.
I20260709 14:54:36.849821 15964 ts_tablet_manager.cc:1403] T d61f9ecebc3c4a028f5327bc9debf432 P dbc2c92e49e346b5b3bd7705a229afc6: Time spent bootstrapping tablet: real 0.039s	user 0.027s	sys 0.000s
I20260709 14:54:36.853863 15964 raft_consensus.cc:359] T d61f9ecebc3c4a028f5327bc9debf432 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:36.854728 15964 raft_consensus.cc:740] T d61f9ecebc3c4a028f5327bc9debf432 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbc2c92e49e346b5b3bd7705a229afc6, State: Initialized, Role: FOLLOWER
I20260709 14:54:36.855545 15964 consensus_queue.cc:260] T d61f9ecebc3c4a028f5327bc9debf432 P dbc2c92e49e346b5b3bd7705a229afc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:36.858088 15964 ts_tablet_manager.cc:1434] T d61f9ecebc3c4a028f5327bc9debf432 P dbc2c92e49e346b5b3bd7705a229afc6: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 14:54:36.859309 15964 tablet_bootstrap.cc:492] T 8974e5ab032b4fba92bfc577280778bf P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap starting.
I20260709 14:54:36.887269 15964 tablet_bootstrap.cc:492] T 8974e5ab032b4fba92bfc577280778bf P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 14:54:36.888468 15964 tablet_bootstrap.cc:492] T 8974e5ab032b4fba92bfc577280778bf P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap complete.
I20260709 14:54:36.889313 15964 ts_tablet_manager.cc:1403] T 8974e5ab032b4fba92bfc577280778bf P dbc2c92e49e346b5b3bd7705a229afc6: Time spent bootstrapping tablet: real 0.030s	user 0.020s	sys 0.006s
I20260709 14:54:36.893869 15964 raft_consensus.cc:359] T 8974e5ab032b4fba92bfc577280778bf P dbc2c92e49e346b5b3bd7705a229afc6 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:36.894891 15964 raft_consensus.cc:740] T 8974e5ab032b4fba92bfc577280778bf P dbc2c92e49e346b5b3bd7705a229afc6 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbc2c92e49e346b5b3bd7705a229afc6, State: Initialized, Role: FOLLOWER
I20260709 14:54:36.895789 15964 consensus_queue.cc:260] T 8974e5ab032b4fba92bfc577280778bf P dbc2c92e49e346b5b3bd7705a229afc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:36.897672 15964 ts_tablet_manager.cc:1434] T 8974e5ab032b4fba92bfc577280778bf P dbc2c92e49e346b5b3bd7705a229afc6: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 14:54:36.898802 15964 tablet_bootstrap.cc:492] T f706543d4d3e4e7291624a785ca4e747 P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap starting.
I20260709 14:54:36.935745 15964 tablet_bootstrap.cc:492] T f706543d4d3e4e7291624a785ca4e747 P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 14:54:36.936967 15964 tablet_bootstrap.cc:492] T f706543d4d3e4e7291624a785ca4e747 P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap complete.
I20260709 14:54:36.937870 15964 ts_tablet_manager.cc:1403] T f706543d4d3e4e7291624a785ca4e747 P dbc2c92e49e346b5b3bd7705a229afc6: Time spent bootstrapping tablet: real 0.039s	user 0.023s	sys 0.004s
I20260709 14:54:36.945717 15964 raft_consensus.cc:359] T f706543d4d3e4e7291624a785ca4e747 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:36.953529 15964 raft_consensus.cc:740] T f706543d4d3e4e7291624a785ca4e747 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbc2c92e49e346b5b3bd7705a229afc6, State: Initialized, Role: FOLLOWER
I20260709 14:54:36.954669 15964 consensus_queue.cc:260] T f706543d4d3e4e7291624a785ca4e747 P dbc2c92e49e346b5b3bd7705a229afc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:36.963603 15964 ts_tablet_manager.cc:1434] T f706543d4d3e4e7291624a785ca4e747 P dbc2c92e49e346b5b3bd7705a229afc6: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.000s
W20260709 14:54:36.975605 15079 consensus_peers.cc:597] T f706543d4d3e4e7291624a785ca4e747 P 7519e608fbb44d9db8ad30b9f10ae605 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 11: this message will repeat every 5th retry.
I20260709 14:54:36.975898 15964 tablet_bootstrap.cc:492] T 7f2cd7c8159d43c080fd8302180ecfca P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap starting.
I20260709 14:54:37.040455 15964 tablet_bootstrap.cc:492] T 7f2cd7c8159d43c080fd8302180ecfca P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 14:54:37.041749 15964 tablet_bootstrap.cc:492] T 7f2cd7c8159d43c080fd8302180ecfca P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap complete.
I20260709 14:54:37.054006 15964 ts_tablet_manager.cc:1403] T 7f2cd7c8159d43c080fd8302180ecfca P dbc2c92e49e346b5b3bd7705a229afc6: Time spent bootstrapping tablet: real 0.078s	user 0.018s	sys 0.008s
I20260709 14:54:37.055696 16103 raft_consensus.cc:3060] T d61f9ecebc3c4a028f5327bc9debf432 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:54:37.057821 15964 raft_consensus.cc:359] T 7f2cd7c8159d43c080fd8302180ecfca P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:37.058796 15964 raft_consensus.cc:740] T 7f2cd7c8159d43c080fd8302180ecfca P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbc2c92e49e346b5b3bd7705a229afc6, State: Initialized, Role: FOLLOWER
I20260709 14:54:37.059949 15964 consensus_queue.cc:260] T 7f2cd7c8159d43c080fd8302180ecfca P dbc2c92e49e346b5b3bd7705a229afc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:37.062736 15964 ts_tablet_manager.cc:1434] T 7f2cd7c8159d43c080fd8302180ecfca P dbc2c92e49e346b5b3bd7705a229afc6: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 14:54:37.063797 15964 tablet_bootstrap.cc:492] T d2273a1ad13e4c54ae2101a15a7e56e1 P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap starting.
W20260709 14:54:37.288487 15227 consensus_peers.cc:597] T d2273a1ad13e4c54ae2101a15a7e56e1 P 9cb8de0701f2482b99e51d5ac080aa13 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 11: this message will repeat every 5th retry.
W20260709 14:54:37.289316 15227 consensus_peers.cc:597] T b7c363a305d3434092ef6016b7064eb3 P 9cb8de0701f2482b99e51d5ac080aa13 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
W20260709 14:54:37.345636 15153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:45477, user_credentials={real_user=slave}} blocked reactor thread for 48527.2us
W20260709 14:54:37.360328 15292 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.GetTabletLocations -> {remote=127.6.101.126:35373, user_credentials={real_user=slave}} blocked reactor thread for 259647us
I20260709 14:54:37.375514 15964 tablet_bootstrap.cc:492] T d2273a1ad13e4c54ae2101a15a7e56e1 P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 14:54:37.393784 16108 raft_consensus.cc:3060] T 7f2cd7c8159d43c080fd8302180ecfca P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:54:37.437356 15964 tablet_bootstrap.cc:492] T d2273a1ad13e4c54ae2101a15a7e56e1 P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap complete.
I20260709 14:54:37.453871 15964 ts_tablet_manager.cc:1403] T d2273a1ad13e4c54ae2101a15a7e56e1 P dbc2c92e49e346b5b3bd7705a229afc6: Time spent bootstrapping tablet: real 0.390s	user 0.019s	sys 0.013s
I20260709 14:54:37.475236 15964 raft_consensus.cc:359] T d2273a1ad13e4c54ae2101a15a7e56e1 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:37.492010 15964 raft_consensus.cc:740] T d2273a1ad13e4c54ae2101a15a7e56e1 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbc2c92e49e346b5b3bd7705a229afc6, State: Initialized, Role: FOLLOWER
I20260709 14:54:37.496006 15964 consensus_queue.cc:260] T d2273a1ad13e4c54ae2101a15a7e56e1 P dbc2c92e49e346b5b3bd7705a229afc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:37.499696 15964 ts_tablet_manager.cc:1434] T d2273a1ad13e4c54ae2101a15a7e56e1 P dbc2c92e49e346b5b3bd7705a229afc6: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.001s
I20260709 14:54:37.502161 15964 tablet_bootstrap.cc:492] T d2463fd792b240e9911c6b38bcb453b8 P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap starting.
I20260709 14:54:37.570027 14933 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59828
I20260709 14:54:37.580502 16142 heartbeater.cc:499] Master 127.6.101.126:35373 was elected leader, sending a full tablet report...
I20260709 14:54:37.641880 15964 tablet_bootstrap.cc:492] T d2463fd792b240e9911c6b38bcb453b8 P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 14:54:37.643784 15964 tablet_bootstrap.cc:492] T d2463fd792b240e9911c6b38bcb453b8 P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap complete.
I20260709 14:54:37.644833 15964 ts_tablet_manager.cc:1403] T d2463fd792b240e9911c6b38bcb453b8 P dbc2c92e49e346b5b3bd7705a229afc6: Time spent bootstrapping tablet: real 0.143s	user 0.022s	sys 0.019s
I20260709 14:54:37.657859 15964 raft_consensus.cc:359] T d2463fd792b240e9911c6b38bcb453b8 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:37.659883 15964 raft_consensus.cc:740] T d2463fd792b240e9911c6b38bcb453b8 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbc2c92e49e346b5b3bd7705a229afc6, State: Initialized, Role: FOLLOWER
I20260709 14:54:37.667047 15964 consensus_queue.cc:260] T d2463fd792b240e9911c6b38bcb453b8 P dbc2c92e49e346b5b3bd7705a229afc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:37.673051 15964 ts_tablet_manager.cc:1434] T d2463fd792b240e9911c6b38bcb453b8 P dbc2c92e49e346b5b3bd7705a229afc6: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.001s
W20260709 14:54:37.673561 15153 consensus_peers.cc:597] T a9dab1878c4b4550880f5680c6d48c67 P eaa34beb1b274443b1c46839afd0a484 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 16: this message will repeat every 5th retry.
I20260709 14:54:37.674391 15964 tablet_bootstrap.cc:492] T 5f5dbc86fc8f4ae5b77e0f23adfcd593 P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap starting.
I20260709 14:54:37.727514 15964 tablet_bootstrap.cc:492] T 5f5dbc86fc8f4ae5b77e0f23adfcd593 P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 14:54:37.728717 15964 tablet_bootstrap.cc:492] T 5f5dbc86fc8f4ae5b77e0f23adfcd593 P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap complete.
I20260709 14:54:37.729574 15964 ts_tablet_manager.cc:1403] T 5f5dbc86fc8f4ae5b77e0f23adfcd593 P dbc2c92e49e346b5b3bd7705a229afc6: Time spent bootstrapping tablet: real 0.055s	user 0.027s	sys 0.000s
I20260709 14:54:37.736861 15964 raft_consensus.cc:359] T 5f5dbc86fc8f4ae5b77e0f23adfcd593 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:37.739156 15964 raft_consensus.cc:740] T 5f5dbc86fc8f4ae5b77e0f23adfcd593 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbc2c92e49e346b5b3bd7705a229afc6, State: Initialized, Role: FOLLOWER
I20260709 14:54:37.740156 15964 consensus_queue.cc:260] T 5f5dbc86fc8f4ae5b77e0f23adfcd593 P dbc2c92e49e346b5b3bd7705a229afc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:37.743031 15964 ts_tablet_manager.cc:1434] T 5f5dbc86fc8f4ae5b77e0f23adfcd593 P dbc2c92e49e346b5b3bd7705a229afc6: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 14:54:37.744155 15964 tablet_bootstrap.cc:492] T b7c363a305d3434092ef6016b7064eb3 P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap starting.
W20260709 14:54:37.765736 15153 consensus_peers.cc:597] T 98280a706ec54413830f342b48666f6e P eaa34beb1b274443b1c46839afd0a484 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 16: this message will repeat every 5th retry.
I20260709 14:54:37.795135 15964 tablet_bootstrap.cc:492] T b7c363a305d3434092ef6016b7064eb3 P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 14:54:37.797230 15964 tablet_bootstrap.cc:492] T b7c363a305d3434092ef6016b7064eb3 P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap complete.
I20260709 14:54:37.805418 16169 raft_consensus.cc:493] T 91c9f89fcb8b45ff9be43f535cafffde P 7519e608fbb44d9db8ad30b9f10ae605 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:37.806231 15964 ts_tablet_manager.cc:1403] T b7c363a305d3434092ef6016b7064eb3 P dbc2c92e49e346b5b3bd7705a229afc6: Time spent bootstrapping tablet: real 0.062s	user 0.016s	sys 0.009s
I20260709 14:54:37.806181 16169 raft_consensus.cc:515] T 91c9f89fcb8b45ff9be43f535cafffde P 7519e608fbb44d9db8ad30b9f10ae605 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:37.824362 15964 raft_consensus.cc:359] T b7c363a305d3434092ef6016b7064eb3 P dbc2c92e49e346b5b3bd7705a229afc6 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:37.826596 16099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c9f89fcb8b45ff9be43f535cafffde" candidate_uuid: "7519e608fbb44d9db8ad30b9f10ae605" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" is_pre_election: true
I20260709 14:54:37.825989 15964 raft_consensus.cc:740] T b7c363a305d3434092ef6016b7064eb3 P dbc2c92e49e346b5b3bd7705a229afc6 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbc2c92e49e346b5b3bd7705a229afc6, State: Initialized, Role: FOLLOWER
I20260709 14:54:37.827479 16099 raft_consensus.cc:2468] T 91c9f89fcb8b45ff9be43f535cafffde P dbc2c92e49e346b5b3bd7705a229afc6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7519e608fbb44d9db8ad30b9f10ae605 in term 3.
I20260709 14:54:37.829993 15079 leader_election.cc:304] T 91c9f89fcb8b45ff9be43f535cafffde P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7519e608fbb44d9db8ad30b9f10ae605, dbc2c92e49e346b5b3bd7705a229afc6; no voters: 
I20260709 14:54:37.829741 15964 consensus_queue.cc:260] T b7c363a305d3434092ef6016b7064eb3 P dbc2c92e49e346b5b3bd7705a229afc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:37.830960 16196 raft_consensus.cc:2804] T 91c9f89fcb8b45ff9be43f535cafffde P 7519e608fbb44d9db8ad30b9f10ae605 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 14:54:37.831418 16196 raft_consensus.cc:493] T 91c9f89fcb8b45ff9be43f535cafffde P 7519e608fbb44d9db8ad30b9f10ae605 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:54:37.831753 16196 raft_consensus.cc:3060] T 91c9f89fcb8b45ff9be43f535cafffde P 7519e608fbb44d9db8ad30b9f10ae605 [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:54:37.825693 16169 leader_election.cc:290] T 91c9f89fcb8b45ff9be43f535cafffde P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477), eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805)
I20260709 14:54:37.832118 15964 ts_tablet_manager.cc:1434] T b7c363a305d3434092ef6016b7064eb3 P dbc2c92e49e346b5b3bd7705a229afc6: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.000s
I20260709 14:54:37.832669 15185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c9f89fcb8b45ff9be43f535cafffde" candidate_uuid: "7519e608fbb44d9db8ad30b9f10ae605" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484" is_pre_election: true
I20260709 14:54:37.837090 15964 tablet_bootstrap.cc:492] T 46a35b81512c4e8c8ec6b83d4c768e1f P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap starting.
I20260709 14:54:37.847811 16099 raft_consensus.cc:3060] T d2463fd792b240e9911c6b38bcb453b8 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:54:37.856277 15185 raft_consensus.cc:2468] T 91c9f89fcb8b45ff9be43f535cafffde P eaa34beb1b274443b1c46839afd0a484 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7519e608fbb44d9db8ad30b9f10ae605 in term 3.
I20260709 14:54:37.870946 16196 raft_consensus.cc:515] T 91c9f89fcb8b45ff9be43f535cafffde P 7519e608fbb44d9db8ad30b9f10ae605 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:37.882807 16196 leader_election.cc:290] T 91c9f89fcb8b45ff9be43f535cafffde P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 4 election: Requested vote from peers dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477), eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805)
I20260709 14:54:37.884441 15182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c9f89fcb8b45ff9be43f535cafffde" candidate_uuid: "7519e608fbb44d9db8ad30b9f10ae605" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484"
I20260709 14:54:37.885336 15182 raft_consensus.cc:3060] T 91c9f89fcb8b45ff9be43f535cafffde P eaa34beb1b274443b1c46839afd0a484 [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:54:37.886889 16108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c9f89fcb8b45ff9be43f535cafffde" candidate_uuid: "7519e608fbb44d9db8ad30b9f10ae605" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbc2c92e49e346b5b3bd7705a229afc6"
I20260709 14:54:37.887988 16108 raft_consensus.cc:3060] T 91c9f89fcb8b45ff9be43f535cafffde P dbc2c92e49e346b5b3bd7705a229afc6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:54:37.922729 16108 raft_consensus.cc:2468] T 91c9f89fcb8b45ff9be43f535cafffde P dbc2c92e49e346b5b3bd7705a229afc6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7519e608fbb44d9db8ad30b9f10ae605 in term 4.
I20260709 14:54:37.956634 15079 leader_election.cc:304] T 91c9f89fcb8b45ff9be43f535cafffde P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7519e608fbb44d9db8ad30b9f10ae605, dbc2c92e49e346b5b3bd7705a229afc6; no voters: 
I20260709 14:54:37.958462 15817 raft_consensus.cc:2804] T 91c9f89fcb8b45ff9be43f535cafffde P 7519e608fbb44d9db8ad30b9f10ae605 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 14:54:37.958976 15817 raft_consensus.cc:697] T 91c9f89fcb8b45ff9be43f535cafffde P 7519e608fbb44d9db8ad30b9f10ae605 [term 4 LEADER]: Becoming Leader. State: Replica: 7519e608fbb44d9db8ad30b9f10ae605, State: Running, Role: LEADER
I20260709 14:54:37.959942 15817 consensus_queue.cc:237] T 91c9f89fcb8b45ff9be43f535cafffde P 7519e608fbb44d9db8ad30b9f10ae605 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:37.970151 15964 tablet_bootstrap.cc:492] T 46a35b81512c4e8c8ec6b83d4c768e1f P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 14:54:37.971900 15964 tablet_bootstrap.cc:492] T 46a35b81512c4e8c8ec6b83d4c768e1f P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap complete.
I20260709 14:54:37.995640 15964 ts_tablet_manager.cc:1403] T 46a35b81512c4e8c8ec6b83d4c768e1f P dbc2c92e49e346b5b3bd7705a229afc6: Time spent bootstrapping tablet: real 0.159s	user 0.022s	sys 0.017s
I20260709 14:54:38.000725 15964 raft_consensus.cc:359] T 46a35b81512c4e8c8ec6b83d4c768e1f P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:38.016533 15964 raft_consensus.cc:740] T 46a35b81512c4e8c8ec6b83d4c768e1f P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbc2c92e49e346b5b3bd7705a229afc6, State: Initialized, Role: FOLLOWER
I20260709 14:54:38.017488 15964 consensus_queue.cc:260] T 46a35b81512c4e8c8ec6b83d4c768e1f P dbc2c92e49e346b5b3bd7705a229afc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:38.021870 15964 ts_tablet_manager.cc:1434] T 46a35b81512c4e8c8ec6b83d4c768e1f P dbc2c92e49e346b5b3bd7705a229afc6: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.004s
I20260709 14:54:38.029673 15964 tablet_bootstrap.cc:492] T a9dab1878c4b4550880f5680c6d48c67 P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap starting.
I20260709 14:54:38.039455 15182 raft_consensus.cc:2468] T 91c9f89fcb8b45ff9be43f535cafffde P eaa34beb1b274443b1c46839afd0a484 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7519e608fbb44d9db8ad30b9f10ae605 in term 4.
I20260709 14:54:38.045892 14933 catalog_manager.cc:5697] T 91c9f89fcb8b45ff9be43f535cafffde P 7519e608fbb44d9db8ad30b9f10ae605 reported cstate change: term changed from 1 to 4, leader changed from dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65) to 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66). New cstate: current_term: 4 leader_uuid: "7519e608fbb44d9db8ad30b9f10ae605" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } health_report { overall_health: UNKNOWN } } }
W20260709 14:54:38.061084 15227 consensus_peers.cc:597] T 9275d24f141d455cb200b9784c470d33 P 9cb8de0701f2482b99e51d5ac080aa13 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
W20260709 14:54:38.091126 15153 consensus_peers.cc:597] T d6bcaee371174feaa06943f949efda49 P eaa34beb1b274443b1c46839afd0a484 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 16: this message will repeat every 5th retry.
I20260709 14:54:38.112538 15964 tablet_bootstrap.cc:492] T a9dab1878c4b4550880f5680c6d48c67 P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 14:54:38.114110 15964 tablet_bootstrap.cc:492] T a9dab1878c4b4550880f5680c6d48c67 P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap complete.
I20260709 14:54:38.115152 15964 ts_tablet_manager.cc:1403] T a9dab1878c4b4550880f5680c6d48c67 P dbc2c92e49e346b5b3bd7705a229afc6: Time spent bootstrapping tablet: real 0.086s	user 0.007s	sys 0.021s
I20260709 14:54:38.114089 16099 raft_consensus.cc:3060] T 46a35b81512c4e8c8ec6b83d4c768e1f P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Advancing to term 3
I20260709 14:54:38.118957 15964 raft_consensus.cc:359] T a9dab1878c4b4550880f5680c6d48c67 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:38.119853 15964 raft_consensus.cc:740] T a9dab1878c4b4550880f5680c6d48c67 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbc2c92e49e346b5b3bd7705a229afc6, State: Initialized, Role: FOLLOWER
I20260709 14:54:38.120679 15964 consensus_queue.cc:260] T a9dab1878c4b4550880f5680c6d48c67 P dbc2c92e49e346b5b3bd7705a229afc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:38.131160 15964 ts_tablet_manager.cc:1434] T a9dab1878c4b4550880f5680c6d48c67 P dbc2c92e49e346b5b3bd7705a229afc6: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.002s
I20260709 14:54:38.132282 15964 tablet_bootstrap.cc:492] T d6bcaee371174feaa06943f949efda49 P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap starting.
I20260709 14:54:38.192166 15964 tablet_bootstrap.cc:492] T d6bcaee371174feaa06943f949efda49 P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 14:54:38.193361 15964 tablet_bootstrap.cc:492] T d6bcaee371174feaa06943f949efda49 P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap complete.
I20260709 14:54:38.194074 15964 ts_tablet_manager.cc:1403] T d6bcaee371174feaa06943f949efda49 P dbc2c92e49e346b5b3bd7705a229afc6: Time spent bootstrapping tablet: real 0.062s	user 0.013s	sys 0.009s
I20260709 14:54:38.198372 15964 raft_consensus.cc:359] T d6bcaee371174feaa06943f949efda49 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:38.199119 15964 raft_consensus.cc:740] T d6bcaee371174feaa06943f949efda49 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbc2c92e49e346b5b3bd7705a229afc6, State: Initialized, Role: FOLLOWER
I20260709 14:54:38.200275 15964 consensus_queue.cc:260] T d6bcaee371174feaa06943f949efda49 P dbc2c92e49e346b5b3bd7705a229afc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
W20260709 14:54:38.211653 15227 consensus_peers.cc:597] T 5585b0f6bbf04c10865d2463767621dc P 9cb8de0701f2482b99e51d5ac080aa13 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 16: this message will repeat every 5th retry.
I20260709 14:54:38.212663 15964 ts_tablet_manager.cc:1434] T d6bcaee371174feaa06943f949efda49 P dbc2c92e49e346b5b3bd7705a229afc6: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 14:54:38.213912 15964 tablet_bootstrap.cc:492] T 9f90ac0a3b004f6ca430ff2fc5198678 P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap starting.
I20260709 14:54:38.249202 15964 tablet_bootstrap.cc:492] T 9f90ac0a3b004f6ca430ff2fc5198678 P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 14:54:38.250471 15964 tablet_bootstrap.cc:492] T 9f90ac0a3b004f6ca430ff2fc5198678 P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap complete.
I20260709 14:54:38.252804 15964 ts_tablet_manager.cc:1403] T 9f90ac0a3b004f6ca430ff2fc5198678 P dbc2c92e49e346b5b3bd7705a229afc6: Time spent bootstrapping tablet: real 0.039s	user 0.020s	sys 0.007s
W20260709 14:54:38.259665 15153 consensus_peers.cc:597] T 5e8a01e27eab492bb73df3359e500627 P eaa34beb1b274443b1c46839afd0a484 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 16: this message will repeat every 5th retry.
W20260709 14:54:38.267247 15153 consensus_peers.cc:597] T d178b88fdab54a29b05fb98e05ffe8c5 P eaa34beb1b274443b1c46839afd0a484 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 16: this message will repeat every 5th retry.
I20260709 14:54:38.278805 15964 raft_consensus.cc:359] T 9f90ac0a3b004f6ca430ff2fc5198678 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:38.281703 15964 raft_consensus.cc:740] T 9f90ac0a3b004f6ca430ff2fc5198678 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbc2c92e49e346b5b3bd7705a229afc6, State: Initialized, Role: FOLLOWER
I20260709 14:54:38.282819 15964 consensus_queue.cc:260] T 9f90ac0a3b004f6ca430ff2fc5198678 P dbc2c92e49e346b5b3bd7705a229afc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:38.284746 15964 ts_tablet_manager.cc:1434] T 9f90ac0a3b004f6ca430ff2fc5198678 P dbc2c92e49e346b5b3bd7705a229afc6: Time spent starting tablet: real 0.032s	user 0.005s	sys 0.001s
I20260709 14:54:38.285735 15964 tablet_bootstrap.cc:492] T 7699ad132e12472180b6a9527951c397 P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap starting.
W20260709 14:54:38.312544 15227 consensus_peers.cc:597] T 0284d9835221427ab285015d48a8040d P 9cb8de0701f2482b99e51d5ac080aa13 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 14:54:38.328982 15964 tablet_bootstrap.cc:492] T 7699ad132e12472180b6a9527951c397 P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 14:54:38.330571 15964 tablet_bootstrap.cc:492] T 7699ad132e12472180b6a9527951c397 P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap complete.
I20260709 14:54:38.331387 15964 ts_tablet_manager.cc:1403] T 7699ad132e12472180b6a9527951c397 P dbc2c92e49e346b5b3bd7705a229afc6: Time spent bootstrapping tablet: real 0.046s	user 0.016s	sys 0.020s
I20260709 14:54:38.339699 15964 raft_consensus.cc:359] T 7699ad132e12472180b6a9527951c397 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:38.343819 15964 raft_consensus.cc:740] T 7699ad132e12472180b6a9527951c397 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbc2c92e49e346b5b3bd7705a229afc6, State: Initialized, Role: FOLLOWER
I20260709 14:54:38.344947 15964 consensus_queue.cc:260] T 7699ad132e12472180b6a9527951c397 P dbc2c92e49e346b5b3bd7705a229afc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:38.347537 15964 ts_tablet_manager.cc:1434] T 7699ad132e12472180b6a9527951c397 P dbc2c92e49e346b5b3bd7705a229afc6: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 14:54:38.349054 15964 tablet_bootstrap.cc:492] T cc6f522768894933b21bc94b41605166 P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap starting.
I20260709 14:54:38.378927 15964 tablet_bootstrap.cc:492] T cc6f522768894933b21bc94b41605166 P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 14:54:38.380110 15964 tablet_bootstrap.cc:492] T cc6f522768894933b21bc94b41605166 P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap complete.
I20260709 14:54:38.384039 15964 ts_tablet_manager.cc:1403] T cc6f522768894933b21bc94b41605166 P dbc2c92e49e346b5b3bd7705a229afc6: Time spent bootstrapping tablet: real 0.035s	user 0.018s	sys 0.004s
I20260709 14:54:38.385787 15182 raft_consensus.cc:1275] T 91c9f89fcb8b45ff9be43f535cafffde P eaa34beb1b274443b1c46839afd0a484 [term 4 FOLLOWER]: Refusing update from remote peer 7519e608fbb44d9db8ad30b9f10ae605: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 14:54:38.390908 16106 consensus_queue.cc:1048] T 91c9f89fcb8b45ff9be43f535cafffde P 7519e608fbb44d9db8ad30b9f10ae605 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 14:54:38.394492 15964 raft_consensus.cc:359] T cc6f522768894933b21bc94b41605166 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:38.395448 15964 raft_consensus.cc:740] T cc6f522768894933b21bc94b41605166 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbc2c92e49e346b5b3bd7705a229afc6, State: Initialized, Role: FOLLOWER
I20260709 14:54:38.398152 15964 consensus_queue.cc:260] T cc6f522768894933b21bc94b41605166 P dbc2c92e49e346b5b3bd7705a229afc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:38.403122 15964 ts_tablet_manager.cc:1434] T cc6f522768894933b21bc94b41605166 P dbc2c92e49e346b5b3bd7705a229afc6: Time spent starting tablet: real 0.019s	user 0.009s	sys 0.000s
I20260709 14:54:38.404701 15964 tablet_bootstrap.cc:492] T 9275d24f141d455cb200b9784c470d33 P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap starting.
I20260709 14:54:38.438571 15964 tablet_bootstrap.cc:492] T 9275d24f141d455cb200b9784c470d33 P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 14:54:38.439621 16103 raft_consensus.cc:3060] T 9f90ac0a3b004f6ca430ff2fc5198678 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:54:38.440960 15964 tablet_bootstrap.cc:492] T 9275d24f141d455cb200b9784c470d33 P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap complete.
I20260709 14:54:38.442107 15964 ts_tablet_manager.cc:1403] T 9275d24f141d455cb200b9784c470d33 P dbc2c92e49e346b5b3bd7705a229afc6: Time spent bootstrapping tablet: real 0.038s	user 0.017s	sys 0.015s
I20260709 14:54:38.446156 15964 raft_consensus.cc:359] T 9275d24f141d455cb200b9784c470d33 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:38.447352 15964 raft_consensus.cc:740] T 9275d24f141d455cb200b9784c470d33 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbc2c92e49e346b5b3bd7705a229afc6, State: Initialized, Role: FOLLOWER
I20260709 14:54:38.448969 15964 consensus_queue.cc:260] T 9275d24f141d455cb200b9784c470d33 P dbc2c92e49e346b5b3bd7705a229afc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:38.451421 15964 ts_tablet_manager.cc:1434] T 9275d24f141d455cb200b9784c470d33 P dbc2c92e49e346b5b3bd7705a229afc6: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 14:54:38.453011 15964 tablet_bootstrap.cc:492] T 4f709a060be148029cf72f1af6f79714 P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap starting.
I20260709 14:54:38.476387 16099 raft_consensus.cc:1275] T 91c9f89fcb8b45ff9be43f535cafffde P dbc2c92e49e346b5b3bd7705a229afc6 [term 4 FOLLOWER]: Refusing update from remote peer 7519e608fbb44d9db8ad30b9f10ae605: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 14:54:38.483114 16196 consensus_queue.cc:1048] T 91c9f89fcb8b45ff9be43f535cafffde P 7519e608fbb44d9db8ad30b9f10ae605 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 14:54:38.494966 16108 raft_consensus.cc:3060] T cc6f522768894933b21bc94b41605166 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:54:38.532970 16102 raft_consensus.cc:3060] T 9275d24f141d455cb200b9784c470d33 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Advancing to term 2
W20260709 14:54:38.552379 15227 consensus_peers.cc:597] T dd44b332dc744f94a5f7cfffc06f3956 P 9cb8de0701f2482b99e51d5ac080aa13 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 16: this message will repeat every 5th retry.
W20260709 14:54:38.565128 15153 consensus_peers.cc:597] T 798d0882b1ea4b26b598c236de8f18c9 P eaa34beb1b274443b1c46839afd0a484 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 16: this message will repeat every 5th retry.
I20260709 14:54:38.607105 15964 tablet_bootstrap.cc:492] T 4f709a060be148029cf72f1af6f79714 P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 14:54:38.608531 15964 tablet_bootstrap.cc:492] T 4f709a060be148029cf72f1af6f79714 P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap complete.
I20260709 14:54:38.609432 15964 ts_tablet_manager.cc:1403] T 4f709a060be148029cf72f1af6f79714 P dbc2c92e49e346b5b3bd7705a229afc6: Time spent bootstrapping tablet: real 0.157s	user 0.059s	sys 0.049s
W20260709 14:54:38.615854 15153 consensus_peers.cc:597] T 263098160f604ae3aa31782c37e2fd52 P eaa34beb1b274443b1c46839afd0a484 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 16: this message will repeat every 5th retry.
I20260709 14:54:38.621409 15964 raft_consensus.cc:359] T 4f709a060be148029cf72f1af6f79714 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:38.622363 15964 raft_consensus.cc:740] T 4f709a060be148029cf72f1af6f79714 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbc2c92e49e346b5b3bd7705a229afc6, State: Initialized, Role: FOLLOWER
I20260709 14:54:38.624989 15964 consensus_queue.cc:260] T 4f709a060be148029cf72f1af6f79714 P dbc2c92e49e346b5b3bd7705a229afc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
W20260709 14:54:38.633008 15079 consensus_peers.cc:597] T 966a06ab56a6479283ab2818c9439d4f P 7519e608fbb44d9db8ad30b9f10ae605 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 16: this message will repeat every 5th retry.
I20260709 14:54:38.638615 15964 ts_tablet_manager.cc:1434] T 4f709a060be148029cf72f1af6f79714 P dbc2c92e49e346b5b3bd7705a229afc6: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.000s
I20260709 14:54:38.648118 15964 tablet_bootstrap.cc:492] T 0284d9835221427ab285015d48a8040d P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap starting.
W20260709 14:54:38.698901 15227 consensus_peers.cc:597] T a1075567fc91458ca7cc9977cf02b170 P 9cb8de0701f2482b99e51d5ac080aa13 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 16: this message will repeat every 5th retry.
I20260709 14:54:38.700229 15964 tablet_bootstrap.cc:492] T 0284d9835221427ab285015d48a8040d P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 14:54:38.701997 15964 tablet_bootstrap.cc:492] T 0284d9835221427ab285015d48a8040d P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap complete.
I20260709 14:54:38.703073 15964 ts_tablet_manager.cc:1403] T 0284d9835221427ab285015d48a8040d P dbc2c92e49e346b5b3bd7705a229afc6: Time spent bootstrapping tablet: real 0.055s	user 0.016s	sys 0.010s
I20260709 14:54:38.712277 15964 raft_consensus.cc:359] T 0284d9835221427ab285015d48a8040d P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:38.713562 15964 raft_consensus.cc:740] T 0284d9835221427ab285015d48a8040d P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbc2c92e49e346b5b3bd7705a229afc6, State: Initialized, Role: FOLLOWER
I20260709 14:54:38.714440 15964 consensus_queue.cc:260] T 0284d9835221427ab285015d48a8040d P dbc2c92e49e346b5b3bd7705a229afc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:38.717053 15964 ts_tablet_manager.cc:1434] T 0284d9835221427ab285015d48a8040d P dbc2c92e49e346b5b3bd7705a229afc6: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 14:54:38.718149 15964 tablet_bootstrap.cc:492] T a1075567fc91458ca7cc9977cf02b170 P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap starting.
I20260709 14:54:38.750422 15964 tablet_bootstrap.cc:492] T a1075567fc91458ca7cc9977cf02b170 P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 14:54:38.752383 15964 tablet_bootstrap.cc:492] T a1075567fc91458ca7cc9977cf02b170 P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap complete.
I20260709 14:54:38.753549 15964 ts_tablet_manager.cc:1403] T a1075567fc91458ca7cc9977cf02b170 P dbc2c92e49e346b5b3bd7705a229afc6: Time spent bootstrapping tablet: real 0.036s	user 0.024s	sys 0.002s
I20260709 14:54:38.756999 15964 raft_consensus.cc:359] T a1075567fc91458ca7cc9977cf02b170 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:38.757922 15964 raft_consensus.cc:740] T a1075567fc91458ca7cc9977cf02b170 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbc2c92e49e346b5b3bd7705a229afc6, State: Initialized, Role: FOLLOWER
I20260709 14:54:38.758879 15964 consensus_queue.cc:260] T a1075567fc91458ca7cc9977cf02b170 P dbc2c92e49e346b5b3bd7705a229afc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:38.762756 15964 ts_tablet_manager.cc:1434] T a1075567fc91458ca7cc9977cf02b170 P dbc2c92e49e346b5b3bd7705a229afc6: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 14:54:38.763929 15964 tablet_bootstrap.cc:492] T 054739df584d4b9db840777c2ae17555 P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap starting.
I20260709 14:54:38.789314 15964 tablet_bootstrap.cc:492] T 054739df584d4b9db840777c2ae17555 P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 14:54:38.790818 15964 tablet_bootstrap.cc:492] T 054739df584d4b9db840777c2ae17555 P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap complete.
I20260709 14:54:38.791834 15964 ts_tablet_manager.cc:1403] T 054739df584d4b9db840777c2ae17555 P dbc2c92e49e346b5b3bd7705a229afc6: Time spent bootstrapping tablet: real 0.028s	user 0.025s	sys 0.000s
I20260709 14:54:38.796123 15964 raft_consensus.cc:359] T 054739df584d4b9db840777c2ae17555 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:38.797152 15964 raft_consensus.cc:740] T 054739df584d4b9db840777c2ae17555 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbc2c92e49e346b5b3bd7705a229afc6, State: Initialized, Role: FOLLOWER
I20260709 14:54:38.798076 15964 consensus_queue.cc:260] T 054739df584d4b9db840777c2ae17555 P dbc2c92e49e346b5b3bd7705a229afc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:38.817792 15964 ts_tablet_manager.cc:1434] T 054739df584d4b9db840777c2ae17555 P dbc2c92e49e346b5b3bd7705a229afc6: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.000s
I20260709 14:54:38.819094 15964 tablet_bootstrap.cc:492] T dd44b332dc744f94a5f7cfffc06f3956 P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap starting.
I20260709 14:54:38.849722 15964 tablet_bootstrap.cc:492] T dd44b332dc744f94a5f7cfffc06f3956 P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 14:54:38.851187 15964 tablet_bootstrap.cc:492] T dd44b332dc744f94a5f7cfffc06f3956 P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap complete.
I20260709 14:54:38.852198 15964 ts_tablet_manager.cc:1403] T dd44b332dc744f94a5f7cfffc06f3956 P dbc2c92e49e346b5b3bd7705a229afc6: Time spent bootstrapping tablet: real 0.033s	user 0.020s	sys 0.000s
I20260709 14:54:38.855640 15964 raft_consensus.cc:359] T dd44b332dc744f94a5f7cfffc06f3956 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:38.856546 15964 raft_consensus.cc:740] T dd44b332dc744f94a5f7cfffc06f3956 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbc2c92e49e346b5b3bd7705a229afc6, State: Initialized, Role: FOLLOWER
I20260709 14:54:38.857465 15964 consensus_queue.cc:260] T dd44b332dc744f94a5f7cfffc06f3956 P dbc2c92e49e346b5b3bd7705a229afc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:38.860203 15964 ts_tablet_manager.cc:1434] T dd44b332dc744f94a5f7cfffc06f3956 P dbc2c92e49e346b5b3bd7705a229afc6: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 14:54:38.862004 15964 tablet_bootstrap.cc:492] T d178b88fdab54a29b05fb98e05ffe8c5 P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap starting.
W20260709 14:54:38.874255 15153 consensus_peers.cc:597] T 46ebd2bd84cc46e08c82a7b893e54578 P eaa34beb1b274443b1c46839afd0a484 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 14:54:38.906342 16108 raft_consensus.cc:3060] T 0284d9835221427ab285015d48a8040d P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Advancing to term 2
W20260709 14:54:38.976558 15150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:43177, user_credentials={real_user=slave}} blocked reactor thread for 94966.2us
I20260709 14:54:39.046715 15964 tablet_bootstrap.cc:492] T d178b88fdab54a29b05fb98e05ffe8c5 P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 14:54:39.048166 15964 tablet_bootstrap.cc:492] T d178b88fdab54a29b05fb98e05ffe8c5 P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap complete.
I20260709 14:54:39.049021 15964 ts_tablet_manager.cc:1403] T d178b88fdab54a29b05fb98e05ffe8c5 P dbc2c92e49e346b5b3bd7705a229afc6: Time spent bootstrapping tablet: real 0.187s	user 0.047s	sys 0.077s
I20260709 14:54:39.059037 15964 raft_consensus.cc:359] T d178b88fdab54a29b05fb98e05ffe8c5 P dbc2c92e49e346b5b3bd7705a229afc6 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:39.063053 15964 raft_consensus.cc:740] T d178b88fdab54a29b05fb98e05ffe8c5 P dbc2c92e49e346b5b3bd7705a229afc6 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbc2c92e49e346b5b3bd7705a229afc6, State: Initialized, Role: FOLLOWER
I20260709 14:54:39.069921 15964 consensus_queue.cc:260] T d178b88fdab54a29b05fb98e05ffe8c5 P dbc2c92e49e346b5b3bd7705a229afc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:39.072414 15964 ts_tablet_manager.cc:1434] T d178b88fdab54a29b05fb98e05ffe8c5 P dbc2c92e49e346b5b3bd7705a229afc6: Time spent starting tablet: real 0.023s	user 0.005s	sys 0.000s
I20260709 14:54:39.073683 15964 tablet_bootstrap.cc:492] T 98280a706ec54413830f342b48666f6e P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap starting.
I20260709 14:54:39.094717 15964 tablet_bootstrap.cc:492] T 98280a706ec54413830f342b48666f6e P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 14:54:39.095983 15964 tablet_bootstrap.cc:492] T 98280a706ec54413830f342b48666f6e P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap complete.
I20260709 14:54:39.096849 15964 ts_tablet_manager.cc:1403] T 98280a706ec54413830f342b48666f6e P dbc2c92e49e346b5b3bd7705a229afc6: Time spent bootstrapping tablet: real 0.023s	user 0.019s	sys 0.000s
I20260709 14:54:39.100914 15964 raft_consensus.cc:359] T 98280a706ec54413830f342b48666f6e P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:39.101712 15964 raft_consensus.cc:740] T 98280a706ec54413830f342b48666f6e P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbc2c92e49e346b5b3bd7705a229afc6, State: Initialized, Role: FOLLOWER
I20260709 14:54:39.104358 15964 consensus_queue.cc:260] T 98280a706ec54413830f342b48666f6e P dbc2c92e49e346b5b3bd7705a229afc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:39.111732 15964 ts_tablet_manager.cc:1434] T 98280a706ec54413830f342b48666f6e P dbc2c92e49e346b5b3bd7705a229afc6: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 14:54:39.112928 15964 tablet_bootstrap.cc:492] T 966a06ab56a6479283ab2818c9439d4f P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap starting.
I20260709 14:54:39.143076 15964 tablet_bootstrap.cc:492] T 966a06ab56a6479283ab2818c9439d4f P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 14:54:39.144562 15964 tablet_bootstrap.cc:492] T 966a06ab56a6479283ab2818c9439d4f P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap complete.
I20260709 14:54:39.146114 15964 ts_tablet_manager.cc:1403] T 966a06ab56a6479283ab2818c9439d4f P dbc2c92e49e346b5b3bd7705a229afc6: Time spent bootstrapping tablet: real 0.033s	user 0.018s	sys 0.008s
I20260709 14:54:39.150339 15964 raft_consensus.cc:359] T 966a06ab56a6479283ab2818c9439d4f P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:39.151108 15964 raft_consensus.cc:740] T 966a06ab56a6479283ab2818c9439d4f P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbc2c92e49e346b5b3bd7705a229afc6, State: Initialized, Role: FOLLOWER
I20260709 14:54:39.151787 15964 consensus_queue.cc:260] T 966a06ab56a6479283ab2818c9439d4f P dbc2c92e49e346b5b3bd7705a229afc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:39.158031 15964 ts_tablet_manager.cc:1434] T 966a06ab56a6479283ab2818c9439d4f P dbc2c92e49e346b5b3bd7705a229afc6: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 14:54:39.160674 15964 tablet_bootstrap.cc:492] T 798d0882b1ea4b26b598c236de8f18c9 P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap starting.
I20260709 14:54:39.192029 15964 tablet_bootstrap.cc:492] T 798d0882b1ea4b26b598c236de8f18c9 P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 14:54:39.193465 15964 tablet_bootstrap.cc:492] T 798d0882b1ea4b26b598c236de8f18c9 P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap complete.
I20260709 14:54:39.194307 15964 ts_tablet_manager.cc:1403] T 798d0882b1ea4b26b598c236de8f18c9 P dbc2c92e49e346b5b3bd7705a229afc6: Time spent bootstrapping tablet: real 0.034s	user 0.018s	sys 0.010s
I20260709 14:54:39.197577 15964 raft_consensus.cc:359] T 798d0882b1ea4b26b598c236de8f18c9 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:39.198679 15964 raft_consensus.cc:740] T 798d0882b1ea4b26b598c236de8f18c9 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbc2c92e49e346b5b3bd7705a229afc6, State: Initialized, Role: FOLLOWER
I20260709 14:54:39.199563 15964 consensus_queue.cc:260] T 798d0882b1ea4b26b598c236de8f18c9 P dbc2c92e49e346b5b3bd7705a229afc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:39.249876 15964 ts_tablet_manager.cc:1434] T 798d0882b1ea4b26b598c236de8f18c9 P dbc2c92e49e346b5b3bd7705a229afc6: Time spent starting tablet: real 0.055s	user 0.008s	sys 0.001s
I20260709 14:54:39.259050 15964 tablet_bootstrap.cc:492] T 5e8a01e27eab492bb73df3359e500627 P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap starting.
I20260709 14:54:39.320607 15964 tablet_bootstrap.cc:492] T 5e8a01e27eab492bb73df3359e500627 P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 14:54:39.321710 15964 tablet_bootstrap.cc:492] T 5e8a01e27eab492bb73df3359e500627 P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap complete.
I20260709 14:54:39.322423 15964 ts_tablet_manager.cc:1403] T 5e8a01e27eab492bb73df3359e500627 P dbc2c92e49e346b5b3bd7705a229afc6: Time spent bootstrapping tablet: real 0.064s	user 0.014s	sys 0.003s
I20260709 14:54:39.324550 15964 raft_consensus.cc:359] T 5e8a01e27eab492bb73df3359e500627 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:39.325469 15964 raft_consensus.cc:740] T 5e8a01e27eab492bb73df3359e500627 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbc2c92e49e346b5b3bd7705a229afc6, State: Initialized, Role: FOLLOWER
I20260709 14:54:39.326464 15964 consensus_queue.cc:260] T 5e8a01e27eab492bb73df3359e500627 P dbc2c92e49e346b5b3bd7705a229afc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:39.329720 15964 ts_tablet_manager.cc:1434] T 5e8a01e27eab492bb73df3359e500627 P dbc2c92e49e346b5b3bd7705a229afc6: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 14:54:39.331391 15964 tablet_bootstrap.cc:492] T 5585b0f6bbf04c10865d2463767621dc P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap starting.
I20260709 14:54:39.361008 15964 tablet_bootstrap.cc:492] T 5585b0f6bbf04c10865d2463767621dc P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 14:54:39.361960 15964 tablet_bootstrap.cc:492] T 5585b0f6bbf04c10865d2463767621dc P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap complete.
I20260709 14:54:39.362591 15964 ts_tablet_manager.cc:1403] T 5585b0f6bbf04c10865d2463767621dc P dbc2c92e49e346b5b3bd7705a229afc6: Time spent bootstrapping tablet: real 0.031s	user 0.020s	sys 0.005s
I20260709 14:54:39.364869 15964 raft_consensus.cc:359] T 5585b0f6bbf04c10865d2463767621dc P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:39.365638 15964 raft_consensus.cc:740] T 5585b0f6bbf04c10865d2463767621dc P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbc2c92e49e346b5b3bd7705a229afc6, State: Initialized, Role: FOLLOWER
I20260709 14:54:39.366542 15964 consensus_queue.cc:260] T 5585b0f6bbf04c10865d2463767621dc P dbc2c92e49e346b5b3bd7705a229afc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:39.368808 15964 ts_tablet_manager.cc:1434] T 5585b0f6bbf04c10865d2463767621dc P dbc2c92e49e346b5b3bd7705a229afc6: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 14:54:39.374060 15964 tablet_bootstrap.cc:492] T 263098160f604ae3aa31782c37e2fd52 P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap starting.
I20260709 14:54:39.400113 15964 tablet_bootstrap.cc:492] T 263098160f604ae3aa31782c37e2fd52 P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 14:54:39.402580 15964 tablet_bootstrap.cc:492] T 263098160f604ae3aa31782c37e2fd52 P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap complete.
I20260709 14:54:39.403765 15964 ts_tablet_manager.cc:1403] T 263098160f604ae3aa31782c37e2fd52 P dbc2c92e49e346b5b3bd7705a229afc6: Time spent bootstrapping tablet: real 0.030s	user 0.016s	sys 0.009s
I20260709 14:54:39.406499 15964 raft_consensus.cc:359] T 263098160f604ae3aa31782c37e2fd52 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:39.407151 15964 raft_consensus.cc:740] T 263098160f604ae3aa31782c37e2fd52 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbc2c92e49e346b5b3bd7705a229afc6, State: Initialized, Role: FOLLOWER
I20260709 14:54:39.407795 15964 consensus_queue.cc:260] T 263098160f604ae3aa31782c37e2fd52 P dbc2c92e49e346b5b3bd7705a229afc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:39.409849 15964 ts_tablet_manager.cc:1434] T 263098160f604ae3aa31782c37e2fd52 P dbc2c92e49e346b5b3bd7705a229afc6: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.004s
I20260709 14:54:39.410790 15964 tablet_bootstrap.cc:492] T 46ebd2bd84cc46e08c82a7b893e54578 P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap starting.
I20260709 14:54:39.533306 15964 tablet_bootstrap.cc:492] T 46ebd2bd84cc46e08c82a7b893e54578 P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 14:54:39.534391 15964 tablet_bootstrap.cc:492] T 46ebd2bd84cc46e08c82a7b893e54578 P dbc2c92e49e346b5b3bd7705a229afc6: Bootstrap complete.
I20260709 14:54:39.535231 15964 ts_tablet_manager.cc:1403] T 46ebd2bd84cc46e08c82a7b893e54578 P dbc2c92e49e346b5b3bd7705a229afc6: Time spent bootstrapping tablet: real 0.125s	user 0.053s	sys 0.059s
I20260709 14:54:39.538657 15964 raft_consensus.cc:359] T 46ebd2bd84cc46e08c82a7b893e54578 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:39.540104 15964 raft_consensus.cc:740] T 46ebd2bd84cc46e08c82a7b893e54578 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbc2c92e49e346b5b3bd7705a229afc6, State: Initialized, Role: FOLLOWER
I20260709 14:54:39.540999 15964 consensus_queue.cc:260] T 46ebd2bd84cc46e08c82a7b893e54578 P dbc2c92e49e346b5b3bd7705a229afc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:39.544745 15964 ts_tablet_manager.cc:1434] T 46ebd2bd84cc46e08c82a7b893e54578 P dbc2c92e49e346b5b3bd7705a229afc6: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 14:54:39.883138 16103 raft_consensus.cc:3060] T 46ebd2bd84cc46e08c82a7b893e54578 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Advancing to term 2
W20260709 14:54:42.625626 15153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:45477, user_credentials={real_user=slave}} blocked reactor thread for 45520.9us
I20260709 14:54:42.917599  6549 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 14:54:43.102751 16255 raft_consensus.cc:493] T 966a06ab56a6479283ab2818c9439d4f P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7519e608fbb44d9db8ad30b9f10ae605)
I20260709 14:54:43.103605 16255 raft_consensus.cc:515] T 966a06ab56a6479283ab2818c9439d4f P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:43.115937 15105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "966a06ab56a6479283ab2818c9439d4f" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605" is_pre_election: true
I20260709 14:54:43.130419 16255 leader_election.cc:290] T 966a06ab56a6479283ab2818c9439d4f P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477), 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177)
I20260709 14:54:43.139113 16256 raft_consensus.cc:493] T d354c94548fc411ab62b4281ed947944 P eaa34beb1b274443b1c46839afd0a484 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7519e608fbb44d9db8ad30b9f10ae605)
I20260709 14:54:43.173437 16256 raft_consensus.cc:515] T d354c94548fc411ab62b4281ed947944 P eaa34beb1b274443b1c46839afd0a484 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:43.175696 16256 leader_election.cc:290] T d354c94548fc411ab62b4281ed947944 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477), 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177)
I20260709 14:54:43.188982 15111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d354c94548fc411ab62b4281ed947944" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605" is_pre_election: true
I20260709 14:54:43.195981 16264 raft_consensus.cc:493] T d61f9ecebc3c4a028f5327bc9debf432 P dbc2c92e49e346b5b3bd7705a229afc6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7519e608fbb44d9db8ad30b9f10ae605)
I20260709 14:54:43.197103 16264 raft_consensus.cc:515] T d61f9ecebc3c4a028f5327bc9debf432 P dbc2c92e49e346b5b3bd7705a229afc6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:43.201359 16264 leader_election.cc:290] T d61f9ecebc3c4a028f5327bc9debf432 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493), 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177)
I20260709 14:54:43.202798 15111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d61f9ecebc3c4a028f5327bc9debf432" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605" is_pre_election: true
I20260709 14:54:43.344801 16250 raft_consensus.cc:493] T 3b4c50fac37a43c0988d5ea911d09f43 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader eaa34beb1b274443b1c46839afd0a484)
I20260709 14:54:43.346917 16250 raft_consensus.cc:515] T 3b4c50fac37a43c0988d5ea911d09f43 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:43.352579 16264 raft_consensus.cc:493] T 263098160f604ae3aa31782c37e2fd52 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader eaa34beb1b274443b1c46839afd0a484)
I20260709 14:54:43.353932 16264 raft_consensus.cc:515] T 263098160f604ae3aa31782c37e2fd52 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:43.375293 16264 leader_election.cc:290] T 263098160f604ae3aa31782c37e2fd52 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177), eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805)
I20260709 14:54:43.376180 16264 raft_consensus.cc:493] T d354c94548fc411ab62b4281ed947944 P dbc2c92e49e346b5b3bd7705a229afc6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7519e608fbb44d9db8ad30b9f10ae605)
I20260709 14:54:43.377172 16264 raft_consensus.cc:515] T d354c94548fc411ab62b4281ed947944 P dbc2c92e49e346b5b3bd7705a229afc6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:43.377696 15111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263098160f604ae3aa31782c37e2fd52" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605" is_pre_election: true
I20260709 14:54:43.387877 16264 leader_election.cc:290] T d354c94548fc411ab62b4281ed947944 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177), eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805)
I20260709 14:54:43.388779 16250 leader_election.cc:290] T 3b4c50fac37a43c0988d5ea911d09f43 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805), dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477)
I20260709 14:54:43.389475 15111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d354c94548fc411ab62b4281ed947944" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605" is_pre_election: true
I20260709 14:54:43.443092 16264 raft_consensus.cc:493] T 3b4c50fac37a43c0988d5ea911d09f43 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader eaa34beb1b274443b1c46839afd0a484)
I20260709 14:54:43.470124 16264 raft_consensus.cc:515] T 3b4c50fac37a43c0988d5ea911d09f43 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:43.474618 16264 leader_election.cc:290] T 3b4c50fac37a43c0988d5ea911d09f43 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805), 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493)
W20260709 14:54:43.491891 15227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:45477, user_credentials={real_user=slave}} blocked reactor thread for 83917.9us
I20260709 14:54:43.496438 16258 raft_consensus.cc:493] T 798d0882b1ea4b26b598c236de8f18c9 P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader eaa34beb1b274443b1c46839afd0a484)
I20260709 14:54:43.500885 16258 raft_consensus.cc:515] T 798d0882b1ea4b26b598c236de8f18c9 P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:43.507005 16258 leader_election.cc:290] T 798d0882b1ea4b26b598c236de8f18c9 P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477), eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805)
I20260709 14:54:43.453111 16268 raft_consensus.cc:493] T f706543d4d3e4e7291624a785ca4e747 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7519e608fbb44d9db8ad30b9f10ae605)
I20260709 14:54:43.532037 16268 raft_consensus.cc:515] T f706543d4d3e4e7291624a785ca4e747 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:43.546757 16264 raft_consensus.cc:493] T 5585b0f6bbf04c10865d2463767621dc P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9cb8de0701f2482b99e51d5ac080aa13)
I20260709 14:54:43.547866 16264 raft_consensus.cc:515] T 5585b0f6bbf04c10865d2463767621dc P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:43.553375 15186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "798d0882b1ea4b26b598c236de8f18c9" candidate_uuid: "7519e608fbb44d9db8ad30b9f10ae605" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484" is_pre_election: true
I20260709 14:54:43.554232 16269 raft_consensus.cc:493] T 0284d9835221427ab285015d48a8040d P dbc2c92e49e346b5b3bd7705a229afc6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9cb8de0701f2482b99e51d5ac080aa13)
I20260709 14:54:43.555229 16269 raft_consensus.cc:515] T 0284d9835221427ab285015d48a8040d P dbc2c92e49e346b5b3bd7705a229afc6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:43.558401 16268 leader_election.cc:290] T f706543d4d3e4e7291624a785ca4e747 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477), 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177)
I20260709 14:54:43.577347 15105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5585b0f6bbf04c10865d2463767621dc" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605" is_pre_election: true
W20260709 14:54:43.581573 15227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:45477, user_credentials={real_user=slave}} blocked reactor thread for 63844.9us
I20260709 14:54:43.584637 16269 leader_election.cc:290] T 0284d9835221427ab285015d48a8040d P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493), 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177)
I20260709 14:54:43.586489 16102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d354c94548fc411ab62b4281ed947944" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" is_pre_election: true
I20260709 14:54:43.588150 15105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0284d9835221427ab285015d48a8040d" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605" is_pre_election: true
I20260709 14:54:43.589808 16194 raft_consensus.cc:493] T ca2aa2e1a8c646069cb8b23b0ebdb0c7 P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9cb8de0701f2482b99e51d5ac080aa13)
I20260709 14:54:43.590562 16194 raft_consensus.cc:515] T ca2aa2e1a8c646069cb8b23b0ebdb0c7 P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:43.592846 16269 raft_consensus.cc:493] T 798d0882b1ea4b26b598c236de8f18c9 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader eaa34beb1b274443b1c46839afd0a484)
I20260709 14:54:43.594014 16269 raft_consensus.cc:515] T 798d0882b1ea4b26b598c236de8f18c9 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:43.595574 15105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2aa2e1a8c646069cb8b23b0ebdb0c7" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605" is_pre_election: true
I20260709 14:54:43.596621 16194 leader_election.cc:290] T ca2aa2e1a8c646069cb8b23b0ebdb0c7 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177), 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493)
I20260709 14:54:43.575476 16264 leader_election.cc:290] T 5585b0f6bbf04c10865d2463767621dc P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493), 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177)
I20260709 14:54:43.598810 15111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "798d0882b1ea4b26b598c236de8f18c9" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605" is_pre_election: true
I20260709 14:54:43.594730 16107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "966a06ab56a6479283ab2818c9439d4f" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" is_pre_election: true
I20260709 14:54:43.602926 15185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263098160f604ae3aa31782c37e2fd52" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484" is_pre_election: true
I20260709 14:54:43.608244 15185 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "46ebd2bd84cc46e08c82a7b893e54578"
dest_uuid: "eaa34beb1b274443b1c46839afd0a484"
mode: GRACEFUL
new_leader_uuid: "dbc2c92e49e346b5b3bd7705a229afc6"
 from {username='slave'} at 127.0.0.1:44288
I20260709 14:54:43.609652 15185 raft_consensus.cc:606] T 46ebd2bd84cc46e08c82a7b893e54578 P eaa34beb1b274443b1c46839afd0a484 [term 2 LEADER]: Received request to transfer leadership to TS dbc2c92e49e346b5b3bd7705a229afc6
I20260709 14:54:43.612314 15185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d354c94548fc411ab62b4281ed947944" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484" is_pre_election: true
I20260709 14:54:43.620043 16269 leader_election.cc:290] T 798d0882b1ea4b26b598c236de8f18c9 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177), eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805)
I20260709 14:54:43.626797 15185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4c50fac37a43c0988d5ea911d09f43" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484" is_pre_election: true
I20260709 14:54:43.633899 15185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "798d0882b1ea4b26b598c236de8f18c9" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484" is_pre_election: true
I20260709 14:54:43.634903 16107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "798d0882b1ea4b26b598c236de8f18c9" candidate_uuid: "7519e608fbb44d9db8ad30b9f10ae605" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" is_pre_election: true
I20260709 14:54:43.635984 16107 raft_consensus.cc:2468] T 798d0882b1ea4b26b598c236de8f18c9 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7519e608fbb44d9db8ad30b9f10ae605 in term 1.
I20260709 14:54:43.645750 16107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4c50fac37a43c0988d5ea911d09f43" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" is_pre_election: true
I20260709 14:54:43.648880 16107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f706543d4d3e4e7291624a785ca4e747" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" is_pre_election: true
I20260709 14:54:43.649127 15186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4c50fac37a43c0988d5ea911d09f43" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484" is_pre_election: true
I20260709 14:54:43.659511 15079 leader_election.cc:304] T 798d0882b1ea4b26b598c236de8f18c9 P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7519e608fbb44d9db8ad30b9f10ae605, dbc2c92e49e346b5b3bd7705a229afc6; no voters: eaa34beb1b274443b1c46839afd0a484
I20260709 14:54:43.660746 16258 raft_consensus.cc:2804] T 798d0882b1ea4b26b598c236de8f18c9 P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 14:54:43.661804 16258 raft_consensus.cc:493] T 798d0882b1ea4b26b598c236de8f18c9 P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Starting leader election (detected failure of leader eaa34beb1b274443b1c46839afd0a484)
I20260709 14:54:43.663688 16258 raft_consensus.cc:3060] T 798d0882b1ea4b26b598c236de8f18c9 P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:54:43.666275 16230 raft_consensus.cc:993] T 46ebd2bd84cc46e08c82a7b893e54578 P eaa34beb1b274443b1c46839afd0a484: : Instructing follower dbc2c92e49e346b5b3bd7705a229afc6 to start an election
I20260709 14:54:43.667098 16230 raft_consensus.cc:1081] T 46ebd2bd84cc46e08c82a7b893e54578 P eaa34beb1b274443b1c46839afd0a484 [term 2 LEADER]: Signalling peer dbc2c92e49e346b5b3bd7705a229afc6 to start an election
I20260709 14:54:43.667412 15111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f706543d4d3e4e7291624a785ca4e747" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605" is_pre_election: true
I20260709 14:54:43.663637 16269 raft_consensus.cc:493] T 42d6909533d14edbbfdad30a9972658d P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader eaa34beb1b274443b1c46839afd0a484)
I20260709 14:54:43.672365 16269 raft_consensus.cc:515] T 42d6909533d14edbbfdad30a9972658d P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:43.680423 16258 raft_consensus.cc:515] T 798d0882b1ea4b26b598c236de8f18c9 P 7519e608fbb44d9db8ad30b9f10ae605 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:43.683620 16258 leader_election.cc:290] T 798d0882b1ea4b26b598c236de8f18c9 P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 2 election: Requested vote from peers dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477), eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805)
I20260709 14:54:43.685410 15153 leader_election.cc:304] T d354c94548fc411ab62b4281ed947944 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa34beb1b274443b1c46839afd0a484; no voters: 7519e608fbb44d9db8ad30b9f10ae605, dbc2c92e49e346b5b3bd7705a229afc6
I20260709 14:54:43.686293 16269 leader_election.cc:290] T 42d6909533d14edbbfdad30a9972658d P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805), 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493)
I20260709 14:54:43.687925 16256 raft_consensus.cc:2749] T d354c94548fc411ab62b4281ed947944 P eaa34beb1b274443b1c46839afd0a484 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 14:54:43.690191 16099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "798d0882b1ea4b26b598c236de8f18c9" candidate_uuid: "7519e608fbb44d9db8ad30b9f10ae605" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbc2c92e49e346b5b3bd7705a229afc6"
I20260709 14:54:43.691051 16099 raft_consensus.cc:3060] T 798d0882b1ea4b26b598c236de8f18c9 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:54:43.691284 15153 leader_election.cc:304] T 966a06ab56a6479283ab2818c9439d4f P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa34beb1b274443b1c46839afd0a484; no voters: 7519e608fbb44d9db8ad30b9f10ae605, dbc2c92e49e346b5b3bd7705a229afc6
I20260709 14:54:43.692474 16254 raft_consensus.cc:2749] T 966a06ab56a6479283ab2818c9439d4f P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 14:54:43.694337 15185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "798d0882b1ea4b26b598c236de8f18c9" candidate_uuid: "7519e608fbb44d9db8ad30b9f10ae605" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484"
I20260709 14:54:43.694865 15960 leader_election.cc:304] T 263098160f604ae3aa31782c37e2fd52 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbc2c92e49e346b5b3bd7705a229afc6; no voters: 7519e608fbb44d9db8ad30b9f10ae605, eaa34beb1b274443b1c46839afd0a484
I20260709 14:54:43.695955 16269 raft_consensus.cc:2749] T 263098160f604ae3aa31782c37e2fd52 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 14:54:43.697039 15960 leader_election.cc:304] T d354c94548fc411ab62b4281ed947944 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbc2c92e49e346b5b3bd7705a229afc6; no voters: 7519e608fbb44d9db8ad30b9f10ae605, eaa34beb1b274443b1c46839afd0a484
I20260709 14:54:43.698391 16269 raft_consensus.cc:2749] T d354c94548fc411ab62b4281ed947944 P dbc2c92e49e346b5b3bd7705a229afc6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 14:54:43.699018 15960 leader_election.cc:304] T 798d0882b1ea4b26b598c236de8f18c9 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbc2c92e49e346b5b3bd7705a229afc6; no voters: 7519e608fbb44d9db8ad30b9f10ae605, eaa34beb1b274443b1c46839afd0a484
I20260709 14:54:43.700138 15185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d6909533d14edbbfdad30a9972658d" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484" is_pre_election: true
I20260709 14:54:43.703992 16099 raft_consensus.cc:2468] T 798d0882b1ea4b26b598c236de8f18c9 P dbc2c92e49e346b5b3bd7705a229afc6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7519e608fbb44d9db8ad30b9f10ae605 in term 2.
I20260709 14:54:43.704551 16269 raft_consensus.cc:2749] T 798d0882b1ea4b26b598c236de8f18c9 P dbc2c92e49e346b5b3bd7705a229afc6 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 14:54:43.706566 16107 raft_consensus.cc:1240] T 798d0882b1ea4b26b598c236de8f18c9 P dbc2c92e49e346b5b3bd7705a229afc6 [term 2 FOLLOWER]: Rejecting Update request from peer eaa34beb1b274443b1c46839afd0a484 for earlier term 1. Current term is 2. Ops: []
I20260709 14:54:43.708752 15079 leader_election.cc:304] T 798d0882b1ea4b26b598c236de8f18c9 P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7519e608fbb44d9db8ad30b9f10ae605, dbc2c92e49e346b5b3bd7705a229afc6; no voters: eaa34beb1b274443b1c46839afd0a484
I20260709 14:54:43.709962 16261 raft_consensus.cc:2804] T 798d0882b1ea4b26b598c236de8f18c9 P 7519e608fbb44d9db8ad30b9f10ae605 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:54:43.710609 16261 raft_consensus.cc:697] T 798d0882b1ea4b26b598c236de8f18c9 P 7519e608fbb44d9db8ad30b9f10ae605 [term 2 LEADER]: Becoming Leader. State: Replica: 7519e608fbb44d9db8ad30b9f10ae605, State: Running, Role: LEADER
I20260709 14:54:43.712481 16261 consensus_queue.cc:237] T 798d0882b1ea4b26b598c236de8f18c9 P 7519e608fbb44d9db8ad30b9f10ae605 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:43.716557 16256 consensus_queue.cc:1059] T 798d0882b1ea4b26b598c236de8f18c9 P eaa34beb1b274443b1c46839afd0a484 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 14:54:43.717636 16099 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "46ebd2bd84cc46e08c82a7b893e54578"
dest_uuid: "dbc2c92e49e346b5b3bd7705a229afc6"
 from {username='slave'} at 127.0.0.1:39038
I20260709 14:54:43.718168 16256 raft_consensus.cc:3055] T 798d0882b1ea4b26b598c236de8f18c9 P eaa34beb1b274443b1c46839afd0a484 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 14:54:43.718519 16099 raft_consensus.cc:493] T 46ebd2bd84cc46e08c82a7b893e54578 P dbc2c92e49e346b5b3bd7705a229afc6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:54:43.719285 16099 raft_consensus.cc:3060] T 46ebd2bd84cc46e08c82a7b893e54578 P dbc2c92e49e346b5b3bd7705a229afc6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:54:43.719101 16256 raft_consensus.cc:740] T 798d0882b1ea4b26b598c236de8f18c9 P eaa34beb1b274443b1c46839afd0a484 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: eaa34beb1b274443b1c46839afd0a484, State: Running, Role: LEADER
I20260709 14:54:43.720952 16256 consensus_queue.cc:260] T 798d0882b1ea4b26b598c236de8f18c9 P eaa34beb1b274443b1c46839afd0a484 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:43.723287 16256 raft_consensus.cc:3060] T 798d0882b1ea4b26b598c236de8f18c9 P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:54:43.731962 16099 raft_consensus.cc:515] T 46ebd2bd84cc46e08c82a7b893e54578 P dbc2c92e49e346b5b3bd7705a229afc6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:43.735603 16099 leader_election.cc:290] T 46ebd2bd84cc46e08c82a7b893e54578 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 3 election: Requested vote from peers eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805), 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493)
I20260709 14:54:43.736440 15185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46ebd2bd84cc46e08c82a7b893e54578" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "eaa34beb1b274443b1c46839afd0a484"
I20260709 14:54:43.737317 15185 raft_consensus.cc:3055] T 46ebd2bd84cc46e08c82a7b893e54578 P eaa34beb1b274443b1c46839afd0a484 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 14:54:43.737679 15185 raft_consensus.cc:740] T 46ebd2bd84cc46e08c82a7b893e54578 P eaa34beb1b274443b1c46839afd0a484 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: eaa34beb1b274443b1c46839afd0a484, State: Running, Role: LEADER
I20260709 14:54:43.738657 15185 consensus_queue.cc:260] T 46ebd2bd84cc46e08c82a7b893e54578 P eaa34beb1b274443b1c46839afd0a484 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:43.740041 15185 raft_consensus.cc:3060] T 46ebd2bd84cc46e08c82a7b893e54578 P eaa34beb1b274443b1c46839afd0a484 [term 2 FOLLOWER]: Advancing to term 3
W20260709 14:54:43.746932 15134 debug-util.cc:398] Leaking SignalData structure 0x7b08001608e0 after lost signal to thread 6552
W20260709 14:54:43.748891 15134 debug-util.cc:398] Leaking SignalData structure 0x7b0800192fe0 after lost signal to thread 14970
W20260709 14:54:43.756553 15134 debug-util.cc:398] Leaking SignalData structure 0x7b0800247c80 after lost signal to thread 15137
I20260709 14:54:43.759387 15257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d61f9ecebc3c4a028f5327bc9debf432" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13" is_pre_election: true
I20260709 14:54:43.766151 15256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4c50fac37a43c0988d5ea911d09f43" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13" is_pre_election: true
I20260709 14:54:43.766261 15260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0284d9835221427ab285015d48a8040d" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13" is_pre_election: true
I20260709 14:54:43.767271 14935 catalog_manager.cc:5697] T 798d0882b1ea4b26b598c236de8f18c9 P 7519e608fbb44d9db8ad30b9f10ae605 reported cstate change: term changed from 1 to 2, leader changed from eaa34beb1b274443b1c46839afd0a484 (127.6.101.67) to 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66). New cstate: current_term: 2 leader_uuid: "7519e608fbb44d9db8ad30b9f10ae605" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } health_report { overall_health: UNKNOWN } } }
I20260709 14:54:43.769833 15260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5585b0f6bbf04c10865d2463767621dc" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13" is_pre_election: true
W20260709 14:54:43.772110 15134 debug-util.cc:398] Leaking SignalData structure 0x7b08002559a0 after lost signal to thread 16140
I20260709 14:54:43.780495 15260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d6909533d14edbbfdad30a9972658d" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13" is_pre_election: true
I20260709 14:54:43.785794 15260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46ebd2bd84cc46e08c82a7b893e54578" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13"
I20260709 14:54:43.786577 15260 raft_consensus.cc:3060] T 46ebd2bd84cc46e08c82a7b893e54578 P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:54:43.786736 15185 raft_consensus.cc:2468] T 46ebd2bd84cc46e08c82a7b893e54578 P eaa34beb1b274443b1c46839afd0a484 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbc2c92e49e346b5b3bd7705a229afc6 in term 3.
I20260709 14:54:43.799402 15256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2aa2e1a8c646069cb8b23b0ebdb0c7" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13" is_pre_election: true
I20260709 14:54:43.807509 15960 leader_election.cc:304] T 46ebd2bd84cc46e08c82a7b893e54578 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dbc2c92e49e346b5b3bd7705a229afc6, eaa34beb1b274443b1c46839afd0a484; no voters: 
I20260709 14:54:43.807554 15260 raft_consensus.cc:2468] T 46ebd2bd84cc46e08c82a7b893e54578 P 9cb8de0701f2482b99e51d5ac080aa13 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbc2c92e49e346b5b3bd7705a229afc6 in term 3.
I20260709 14:54:43.809124 16269 raft_consensus.cc:2804] T 46ebd2bd84cc46e08c82a7b893e54578 P dbc2c92e49e346b5b3bd7705a229afc6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 14:54:43.810245 16269 raft_consensus.cc:697] T 46ebd2bd84cc46e08c82a7b893e54578 P dbc2c92e49e346b5b3bd7705a229afc6 [term 3 LEADER]: Becoming Leader. State: Replica: dbc2c92e49e346b5b3bd7705a229afc6, State: Running, Role: LEADER
I20260709 14:54:43.811558 16269 consensus_queue.cc:237] T 46ebd2bd84cc46e08c82a7b893e54578 P dbc2c92e49e346b5b3bd7705a229afc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:43.822010 15150 leader_election.cc:304] T ca2aa2e1a8c646069cb8b23b0ebdb0c7 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa34beb1b274443b1c46839afd0a484; no voters: 7519e608fbb44d9db8ad30b9f10ae605, 9cb8de0701f2482b99e51d5ac080aa13
I20260709 14:54:43.821884 15227 leader_election.cc:304] T 3b4c50fac37a43c0988d5ea911d09f43 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cb8de0701f2482b99e51d5ac080aa13; no voters: dbc2c92e49e346b5b3bd7705a229afc6, eaa34beb1b274443b1c46839afd0a484
I20260709 14:54:43.823552 16251 raft_consensus.cc:2749] T 3b4c50fac37a43c0988d5ea911d09f43 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 14:54:43.823899 15227 leader_election.cc:304] T f706543d4d3e4e7291624a785ca4e747 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cb8de0701f2482b99e51d5ac080aa13; no voters: 7519e608fbb44d9db8ad30b9f10ae605, dbc2c92e49e346b5b3bd7705a229afc6
I20260709 14:54:43.824939 16275 raft_consensus.cc:2749] T f706543d4d3e4e7291624a785ca4e747 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 14:54:43.829892 16230 raft_consensus.cc:2749] T ca2aa2e1a8c646069cb8b23b0ebdb0c7 P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 14:54:43.830713 15957 leader_election.cc:304] T d61f9ecebc3c4a028f5327bc9debf432 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbc2c92e49e346b5b3bd7705a229afc6; no voters: 7519e608fbb44d9db8ad30b9f10ae605, 9cb8de0701f2482b99e51d5ac080aa13
I20260709 14:54:43.832470 15957 leader_election.cc:304] T 3b4c50fac37a43c0988d5ea911d09f43 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbc2c92e49e346b5b3bd7705a229afc6; no voters: 9cb8de0701f2482b99e51d5ac080aa13, eaa34beb1b274443b1c46839afd0a484
I20260709 14:54:43.838380 16264 raft_consensus.cc:2749] T d61f9ecebc3c4a028f5327bc9debf432 P dbc2c92e49e346b5b3bd7705a229afc6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 14:54:43.857699 16269 raft_consensus.cc:2749] T 3b4c50fac37a43c0988d5ea911d09f43 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 14:54:43.855957 14933 catalog_manager.cc:5697] T 46ebd2bd84cc46e08c82a7b893e54578 P dbc2c92e49e346b5b3bd7705a229afc6 reported cstate change: term changed from 2 to 3, leader changed from eaa34beb1b274443b1c46839afd0a484 (127.6.101.67) to dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65). New cstate: current_term: 3 leader_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } health_report { overall_health: HEALTHY } } }
I20260709 14:54:43.861438 15260 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8974e5ab032b4fba92bfc577280778bf"
dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13"
mode: GRACEFUL
new_leader_uuid: "dbc2c92e49e346b5b3bd7705a229afc6"
 from {username='slave'} at 127.0.0.1:34412
I20260709 14:54:43.862246 15260 raft_consensus.cc:606] T 8974e5ab032b4fba92bfc577280778bf P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 LEADER]: Received request to transfer leadership to TS dbc2c92e49e346b5b3bd7705a229afc6
I20260709 14:54:43.865485 15957 leader_election.cc:304] T 0284d9835221427ab285015d48a8040d P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbc2c92e49e346b5b3bd7705a229afc6; no voters: 7519e608fbb44d9db8ad30b9f10ae605, 9cb8de0701f2482b99e51d5ac080aa13
I20260709 14:54:43.866761 15260 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b7c363a305d3434092ef6016b7064eb3"
dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13"
mode: GRACEFUL
new_leader_uuid: "dbc2c92e49e346b5b3bd7705a229afc6"
 from {username='slave'} at 127.0.0.1:34412
I20260709 14:54:43.867072 15957 leader_election.cc:304] T 5585b0f6bbf04c10865d2463767621dc P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbc2c92e49e346b5b3bd7705a229afc6; no voters: 7519e608fbb44d9db8ad30b9f10ae605, 9cb8de0701f2482b99e51d5ac080aa13
I20260709 14:54:43.870510 15260 raft_consensus.cc:606] T b7c363a305d3434092ef6016b7064eb3 P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 LEADER]: Received request to transfer leadership to TS dbc2c92e49e346b5b3bd7705a229afc6
I20260709 14:54:43.872022 16269 raft_consensus.cc:2749] T 0284d9835221427ab285015d48a8040d P dbc2c92e49e346b5b3bd7705a229afc6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 14:54:43.873404 16269 raft_consensus.cc:2749] T 5585b0f6bbf04c10865d2463767621dc P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 14:54:43.878069 15957 leader_election.cc:304] T 42d6909533d14edbbfdad30a9972658d P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbc2c92e49e346b5b3bd7705a229afc6; no voters: 9cb8de0701f2482b99e51d5ac080aa13, eaa34beb1b274443b1c46839afd0a484
I20260709 14:54:43.878842 15260 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bdf08eed05854470954a5e9dd17dfb27"
dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13"
mode: GRACEFUL
new_leader_uuid: "dbc2c92e49e346b5b3bd7705a229afc6"
 from {username='slave'} at 127.0.0.1:34412
I20260709 14:54:43.879628 15260 raft_consensus.cc:606] T bdf08eed05854470954a5e9dd17dfb27 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 LEADER]: Received request to transfer leadership to TS dbc2c92e49e346b5b3bd7705a229afc6
I20260709 14:54:43.879879 16281 raft_consensus.cc:2749] T 42d6909533d14edbbfdad30a9972658d P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 14:54:43.882967 15260 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cc6f522768894933b21bc94b41605166"
dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13"
mode: GRACEFUL
new_leader_uuid: "dbc2c92e49e346b5b3bd7705a229afc6"
 from {username='slave'} at 127.0.0.1:34412
I20260709 14:54:43.890758 15260 raft_consensus.cc:606] T cc6f522768894933b21bc94b41605166 P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 LEADER]: Received request to transfer leadership to TS dbc2c92e49e346b5b3bd7705a229afc6
I20260709 14:54:43.902585 15260 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ff73c3d51e5e480c920d1aca00b9b40d"
dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13"
mode: GRACEFUL
new_leader_uuid: "7519e608fbb44d9db8ad30b9f10ae605"
 from {username='slave'} at 127.0.0.1:34412
I20260709 14:54:43.903404 15260 raft_consensus.cc:606] T ff73c3d51e5e480c920d1aca00b9b40d P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 LEADER]: Received request to transfer leadership to TS 7519e608fbb44d9db8ad30b9f10ae605
I20260709 14:54:43.907199  6549 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 14:54:43.913692 16272 raft_consensus.cc:993] T b7c363a305d3434092ef6016b7064eb3 P 9cb8de0701f2482b99e51d5ac080aa13: : Instructing follower dbc2c92e49e346b5b3bd7705a229afc6 to start an election
I20260709 14:54:43.914408 16272 raft_consensus.cc:993] T cc6f522768894933b21bc94b41605166 P 9cb8de0701f2482b99e51d5ac080aa13: : Instructing follower dbc2c92e49e346b5b3bd7705a229afc6 to start an election
I20260709 14:54:43.915794 16271 raft_consensus.cc:993] T 8974e5ab032b4fba92bfc577280778bf P 9cb8de0701f2482b99e51d5ac080aa13: : Instructing follower dbc2c92e49e346b5b3bd7705a229afc6 to start an election
I20260709 14:54:43.916275 16271 raft_consensus.cc:1081] T b7c363a305d3434092ef6016b7064eb3 P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 LEADER]: Signalling peer dbc2c92e49e346b5b3bd7705a229afc6 to start an election
I20260709 14:54:43.916908 16273 raft_consensus.cc:1081] T cc6f522768894933b21bc94b41605166 P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 LEADER]: Signalling peer dbc2c92e49e346b5b3bd7705a229afc6 to start an election
I20260709 14:54:43.917411 16271 raft_consensus.cc:1081] T 8974e5ab032b4fba92bfc577280778bf P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 LEADER]: Signalling peer dbc2c92e49e346b5b3bd7705a229afc6 to start an election
I20260709 14:54:43.920322  6549 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 14:54:43.928987 16271 raft_consensus.cc:993] T bdf08eed05854470954a5e9dd17dfb27 P 9cb8de0701f2482b99e51d5ac080aa13: : Instructing follower dbc2c92e49e346b5b3bd7705a229afc6 to start an election
I20260709 14:54:43.930219 16275 raft_consensus.cc:1081] T bdf08eed05854470954a5e9dd17dfb27 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 LEADER]: Signalling peer dbc2c92e49e346b5b3bd7705a229afc6 to start an election
I20260709 14:54:43.959523 16107 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b7c363a305d3434092ef6016b7064eb3"
dest_uuid: "dbc2c92e49e346b5b3bd7705a229afc6"
 from {username='slave'} at 127.0.0.1:39014
I20260709 14:54:43.960440 16107 raft_consensus.cc:493] T b7c363a305d3434092ef6016b7064eb3 P dbc2c92e49e346b5b3bd7705a229afc6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:54:43.960964 16107 raft_consensus.cc:3060] T b7c363a305d3434092ef6016b7064eb3 P dbc2c92e49e346b5b3bd7705a229afc6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:54:43.965579 16103 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8974e5ab032b4fba92bfc577280778bf"
dest_uuid: "dbc2c92e49e346b5b3bd7705a229afc6"
 from {username='slave'} at 127.0.0.1:39014
I20260709 14:54:43.966451 16103 raft_consensus.cc:493] T 8974e5ab032b4fba92bfc577280778bf P dbc2c92e49e346b5b3bd7705a229afc6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:54:43.966948 16103 raft_consensus.cc:3060] T 8974e5ab032b4fba92bfc577280778bf P dbc2c92e49e346b5b3bd7705a229afc6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:54:43.966476 16099 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cc6f522768894933b21bc94b41605166"
dest_uuid: "dbc2c92e49e346b5b3bd7705a229afc6"
 from {username='slave'} at 127.0.0.1:39014
I20260709 14:54:43.967597 16099 raft_consensus.cc:493] T cc6f522768894933b21bc94b41605166 P dbc2c92e49e346b5b3bd7705a229afc6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:54:43.968029 16099 raft_consensus.cc:3060] T cc6f522768894933b21bc94b41605166 P dbc2c92e49e346b5b3bd7705a229afc6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:54:43.969494 16102 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bdf08eed05854470954a5e9dd17dfb27"
dest_uuid: "dbc2c92e49e346b5b3bd7705a229afc6"
 from {username='slave'} at 127.0.0.1:39014
I20260709 14:54:43.970446 16102 raft_consensus.cc:493] T bdf08eed05854470954a5e9dd17dfb27 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:54:43.970947 16102 raft_consensus.cc:3060] T bdf08eed05854470954a5e9dd17dfb27 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:54:43.994059 16107 raft_consensus.cc:515] T b7c363a305d3434092ef6016b7064eb3 P dbc2c92e49e346b5b3bd7705a229afc6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:43.997939 16099 raft_consensus.cc:515] T cc6f522768894933b21bc94b41605166 P dbc2c92e49e346b5b3bd7705a229afc6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:44.000320 16102 raft_consensus.cc:515] T bdf08eed05854470954a5e9dd17dfb27 P dbc2c92e49e346b5b3bd7705a229afc6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:44.003872 16103 raft_consensus.cc:515] T 8974e5ab032b4fba92bfc577280778bf P dbc2c92e49e346b5b3bd7705a229afc6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:44.008253 15186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc6f522768894933b21bc94b41605166" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "eaa34beb1b274443b1c46839afd0a484"
I20260709 14:54:44.009102 15186 raft_consensus.cc:3060] T cc6f522768894933b21bc94b41605166 P eaa34beb1b274443b1c46839afd0a484 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:54:44.009475 16107 leader_election.cc:290] T b7c363a305d3434092ef6016b7064eb3 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 3 election: Requested vote from peers 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493), 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177)
I20260709 14:54:44.007939 16099 leader_election.cc:290] T cc6f522768894933b21bc94b41605166 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 3 election: Requested vote from peers eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805), 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493)
I20260709 14:54:44.010718 15111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7c363a305d3434092ef6016b7064eb3" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605"
I20260709 14:54:44.011485 15111 raft_consensus.cc:3060] T b7c363a305d3434092ef6016b7064eb3 P 7519e608fbb44d9db8ad30b9f10ae605 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:54:44.013340 15105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf08eed05854470954a5e9dd17dfb27" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605"
I20260709 14:54:44.014127 15105 raft_consensus.cc:3060] T bdf08eed05854470954a5e9dd17dfb27 P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:54:44.019984 15261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc6f522768894933b21bc94b41605166" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13"
I20260709 14:54:44.020190 15257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf08eed05854470954a5e9dd17dfb27" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13"
I20260709 14:54:44.021140 15257 raft_consensus.cc:3055] T bdf08eed05854470954a5e9dd17dfb27 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 14:54:44.020907 15261 raft_consensus.cc:3055] T cc6f522768894933b21bc94b41605166 P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 14:54:44.020308 15260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7c363a305d3434092ef6016b7064eb3" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13"
I20260709 14:54:44.021937 15257 raft_consensus.cc:740] T bdf08eed05854470954a5e9dd17dfb27 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9cb8de0701f2482b99e51d5ac080aa13, State: Running, Role: LEADER
I20260709 14:54:44.022209 15261 raft_consensus.cc:740] T cc6f522768894933b21bc94b41605166 P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9cb8de0701f2482b99e51d5ac080aa13, State: Running, Role: LEADER
I20260709 14:54:44.021023 15255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8974e5ab032b4fba92bfc577280778bf" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13"
I20260709 14:54:44.022941 15111 raft_consensus.cc:2468] T b7c363a305d3434092ef6016b7064eb3 P 7519e608fbb44d9db8ad30b9f10ae605 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbc2c92e49e346b5b3bd7705a229afc6 in term 3.
I20260709 14:54:44.023219 15257 consensus_queue.cc:260] T bdf08eed05854470954a5e9dd17dfb27 P 9cb8de0701f2482b99e51d5ac080aa13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:44.023567 15261 consensus_queue.cc:260] T cc6f522768894933b21bc94b41605166 P 9cb8de0701f2482b99e51d5ac080aa13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:44.032070 15261 raft_consensus.cc:3060] T cc6f522768894933b21bc94b41605166 P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:54:44.023499 15255 raft_consensus.cc:3055] T 8974e5ab032b4fba92bfc577280778bf P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 14:54:44.032281 15257 raft_consensus.cc:3060] T bdf08eed05854470954a5e9dd17dfb27 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:54:44.032760 15255 raft_consensus.cc:740] T 8974e5ab032b4fba92bfc577280778bf P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9cb8de0701f2482b99e51d5ac080aa13, State: Running, Role: LEADER
I20260709 14:54:44.024765 15957 leader_election.cc:304] T b7c363a305d3434092ef6016b7064eb3 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7519e608fbb44d9db8ad30b9f10ae605, dbc2c92e49e346b5b3bd7705a229afc6; no voters: 
I20260709 14:54:44.034368 15255 consensus_queue.cc:260] T 8974e5ab032b4fba92bfc577280778bf P 9cb8de0701f2482b99e51d5ac080aa13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:44.036357 15255 raft_consensus.cc:3060] T 8974e5ab032b4fba92bfc577280778bf P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:54:44.030864 16281 raft_consensus.cc:493] T c61864fa2cd249d683f8fb90d8542480 P dbc2c92e49e346b5b3bd7705a229afc6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9cb8de0701f2482b99e51d5ac080aa13)
I20260709 14:54:44.038240 16281 raft_consensus.cc:515] T c61864fa2cd249d683f8fb90d8542480 P dbc2c92e49e346b5b3bd7705a229afc6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:44.042876 16269 raft_consensus.cc:2804] T b7c363a305d3434092ef6016b7064eb3 P dbc2c92e49e346b5b3bd7705a229afc6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 14:54:44.043674 16269 raft_consensus.cc:697] T b7c363a305d3434092ef6016b7064eb3 P dbc2c92e49e346b5b3bd7705a229afc6 [term 3 LEADER]: Becoming Leader. State: Replica: dbc2c92e49e346b5b3bd7705a229afc6, State: Running, Role: LEADER
I20260709 14:54:44.044837 16269 consensus_queue.cc:237] T b7c363a305d3434092ef6016b7064eb3 P dbc2c92e49e346b5b3bd7705a229afc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:44.028517 16102 leader_election.cc:290] T bdf08eed05854470954a5e9dd17dfb27 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 2 election: Requested vote from peers 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493), 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177)
I20260709 14:54:44.022617 15260 raft_consensus.cc:3055] T b7c363a305d3434092ef6016b7064eb3 P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 14:54:44.049479 15260 raft_consensus.cc:740] T b7c363a305d3434092ef6016b7064eb3 P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9cb8de0701f2482b99e51d5ac080aa13, State: Running, Role: LEADER
I20260709 14:54:44.050650 15260 consensus_queue.cc:260] T b7c363a305d3434092ef6016b7064eb3 P 9cb8de0701f2482b99e51d5ac080aa13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:44.065115 16103 leader_election.cc:290] T 8974e5ab032b4fba92bfc577280778bf P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 3 election: Requested vote from peers 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493), 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177)
I20260709 14:54:44.068446 15260 raft_consensus.cc:3060] T b7c363a305d3434092ef6016b7064eb3 P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:54:44.073231 15107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8974e5ab032b4fba92bfc577280778bf" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605"
I20260709 14:54:44.074198 15107 raft_consensus.cc:3060] T 8974e5ab032b4fba92bfc577280778bf P 7519e608fbb44d9db8ad30b9f10ae605 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:54:44.081722 15257 raft_consensus.cc:2468] T bdf08eed05854470954a5e9dd17dfb27 P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbc2c92e49e346b5b3bd7705a229afc6 in term 2.
I20260709 14:54:44.084280 15181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61864fa2cd249d683f8fb90d8542480" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484" is_pre_election: true
I20260709 14:54:44.086148 15105 raft_consensus.cc:2468] T bdf08eed05854470954a5e9dd17dfb27 P 7519e608fbb44d9db8ad30b9f10ae605 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbc2c92e49e346b5b3bd7705a229afc6 in term 2.
I20260709 14:54:44.088445 15186 raft_consensus.cc:2468] T cc6f522768894933b21bc94b41605166 P eaa34beb1b274443b1c46839afd0a484 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbc2c92e49e346b5b3bd7705a229afc6 in term 3.
I20260709 14:54:44.087337 16281 leader_election.cc:290] T c61864fa2cd249d683f8fb90d8542480 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805), 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493)
I20260709 14:54:44.089951 15957 leader_election.cc:304] T bdf08eed05854470954a5e9dd17dfb27 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7519e608fbb44d9db8ad30b9f10ae605, dbc2c92e49e346b5b3bd7705a229afc6; no voters: 
I20260709 14:54:44.091290 16281 raft_consensus.cc:2804] T bdf08eed05854470954a5e9dd17dfb27 P dbc2c92e49e346b5b3bd7705a229afc6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:54:44.091495 15260 raft_consensus.cc:2468] T b7c363a305d3434092ef6016b7064eb3 P 9cb8de0701f2482b99e51d5ac080aa13 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbc2c92e49e346b5b3bd7705a229afc6 in term 3.
I20260709 14:54:44.093472 15960 leader_election.cc:304] T cc6f522768894933b21bc94b41605166 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dbc2c92e49e346b5b3bd7705a229afc6, eaa34beb1b274443b1c46839afd0a484; no voters: 
I20260709 14:54:44.094769 16264 raft_consensus.cc:2804] T cc6f522768894933b21bc94b41605166 P dbc2c92e49e346b5b3bd7705a229afc6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 14:54:44.097136 15260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61864fa2cd249d683f8fb90d8542480" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13" is_pre_election: true
I20260709 14:54:44.104341 15261 raft_consensus.cc:2468] T cc6f522768894933b21bc94b41605166 P 9cb8de0701f2482b99e51d5ac080aa13 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbc2c92e49e346b5b3bd7705a229afc6 in term 3.
I20260709 14:54:44.092504 16281 raft_consensus.cc:697] T bdf08eed05854470954a5e9dd17dfb27 P dbc2c92e49e346b5b3bd7705a229afc6 [term 2 LEADER]: Becoming Leader. State: Replica: dbc2c92e49e346b5b3bd7705a229afc6, State: Running, Role: LEADER
I20260709 14:54:44.122457 15957 leader_election.cc:304] T c61864fa2cd249d683f8fb90d8542480 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbc2c92e49e346b5b3bd7705a229afc6; no voters: 9cb8de0701f2482b99e51d5ac080aa13, eaa34beb1b274443b1c46839afd0a484
I20260709 14:54:44.122253 15255 raft_consensus.cc:2468] T 8974e5ab032b4fba92bfc577280778bf P 9cb8de0701f2482b99e51d5ac080aa13 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbc2c92e49e346b5b3bd7705a229afc6 in term 3.
I20260709 14:54:44.120869 16264 raft_consensus.cc:697] T cc6f522768894933b21bc94b41605166 P dbc2c92e49e346b5b3bd7705a229afc6 [term 3 LEADER]: Becoming Leader. State: Replica: dbc2c92e49e346b5b3bd7705a229afc6, State: Running, Role: LEADER
I20260709 14:54:44.129678 16264 consensus_queue.cc:237] T cc6f522768894933b21bc94b41605166 P dbc2c92e49e346b5b3bd7705a229afc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:44.130412 16269 raft_consensus.cc:2749] T c61864fa2cd249d683f8fb90d8542480 P dbc2c92e49e346b5b3bd7705a229afc6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 14:54:44.133216 16269 raft_consensus.cc:493] T 7f2cd7c8159d43c080fd8302180ecfca P dbc2c92e49e346b5b3bd7705a229afc6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eaa34beb1b274443b1c46839afd0a484)
I20260709 14:54:44.134402 16269 raft_consensus.cc:515] T 7f2cd7c8159d43c080fd8302180ecfca P dbc2c92e49e346b5b3bd7705a229afc6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:44.138615 16269 leader_election.cc:290] T 7f2cd7c8159d43c080fd8302180ecfca P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805), 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177)
I20260709 14:54:44.140552 15186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2cd7c8159d43c080fd8302180ecfca" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484" is_pre_election: true
I20260709 14:54:44.141220 16281 consensus_queue.cc:237] T bdf08eed05854470954a5e9dd17dfb27 P dbc2c92e49e346b5b3bd7705a229afc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:44.146624 15107 raft_consensus.cc:2468] T 8974e5ab032b4fba92bfc577280778bf P 7519e608fbb44d9db8ad30b9f10ae605 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbc2c92e49e346b5b3bd7705a229afc6 in term 3.
I20260709 14:54:44.152364 14933 catalog_manager.cc:5697] T b7c363a305d3434092ef6016b7064eb3 P dbc2c92e49e346b5b3bd7705a229afc6 reported cstate change: term changed from 2 to 3, leader changed from 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68) to dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65). New cstate: current_term: 3 leader_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } health_report { overall_health: UNKNOWN } } }
I20260709 14:54:44.163605 15186 raft_consensus.cc:1275] T 798d0882b1ea4b26b598c236de8f18c9 P eaa34beb1b274443b1c46839afd0a484 [term 2 FOLLOWER]: Refusing update from remote peer 7519e608fbb44d9db8ad30b9f10ae605: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:54:44.176360 16258 consensus_queue.cc:1048] T 798d0882b1ea4b26b598c236de8f18c9 P 7519e608fbb44d9db8ad30b9f10ae605 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 14:54:44.192894 16283 raft_consensus.cc:993] T ff73c3d51e5e480c920d1aca00b9b40d P 9cb8de0701f2482b99e51d5ac080aa13: : Instructing follower 7519e608fbb44d9db8ad30b9f10ae605 to start an election
I20260709 14:54:44.193886 16270 raft_consensus.cc:1081] T ff73c3d51e5e480c920d1aca00b9b40d P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 LEADER]: Signalling peer 7519e608fbb44d9db8ad30b9f10ae605 to start an election
I20260709 14:54:44.196930 15111 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ff73c3d51e5e480c920d1aca00b9b40d"
dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605"
 from {username='slave'} at 127.0.0.1:51820
I20260709 14:54:44.197636 15111 raft_consensus.cc:493] T ff73c3d51e5e480c920d1aca00b9b40d P 7519e608fbb44d9db8ad30b9f10ae605 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:54:44.198000 15111 raft_consensus.cc:3060] T ff73c3d51e5e480c920d1aca00b9b40d P 7519e608fbb44d9db8ad30b9f10ae605 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:54:44.220438 16254 raft_consensus.cc:493] T c7d360d2b84b4f0aa38f5c325f4521c1 P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9cb8de0701f2482b99e51d5ac080aa13)
I20260709 14:54:44.221843 16254 raft_consensus.cc:515] T c7d360d2b84b4f0aa38f5c325f4521c1 P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:44.225395 16254 leader_election.cc:290] T c7d360d2b84b4f0aa38f5c325f4521c1 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177), 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493)
I20260709 14:54:44.224779 15111 raft_consensus.cc:515] T ff73c3d51e5e480c920d1aca00b9b40d P 7519e608fbb44d9db8ad30b9f10ae605 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:44.231860 15261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d360d2b84b4f0aa38f5c325f4521c1" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13" is_pre_election: true
I20260709 14:54:44.235394 15261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff73c3d51e5e480c920d1aca00b9b40d" candidate_uuid: "7519e608fbb44d9db8ad30b9f10ae605" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13"
I20260709 14:54:44.236083 15261 raft_consensus.cc:3055] T ff73c3d51e5e480c920d1aca00b9b40d P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 14:54:44.236413 15261 raft_consensus.cc:740] T ff73c3d51e5e480c920d1aca00b9b40d P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9cb8de0701f2482b99e51d5ac080aa13, State: Running, Role: LEADER
I20260709 14:54:44.238147 15261 consensus_queue.cc:260] T ff73c3d51e5e480c920d1aca00b9b40d P 9cb8de0701f2482b99e51d5ac080aa13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:44.240780 15261 raft_consensus.cc:3060] T ff73c3d51e5e480c920d1aca00b9b40d P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:54:44.255620 16103 raft_consensus.cc:1275] T 798d0882b1ea4b26b598c236de8f18c9 P dbc2c92e49e346b5b3bd7705a229afc6 [term 2 FOLLOWER]: Refusing update from remote peer 7519e608fbb44d9db8ad30b9f10ae605: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:54:44.257498 15105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d360d2b84b4f0aa38f5c325f4521c1" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605" is_pre_election: true
I20260709 14:54:44.259711 15181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff73c3d51e5e480c920d1aca00b9b40d" candidate_uuid: "7519e608fbb44d9db8ad30b9f10ae605" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "eaa34beb1b274443b1c46839afd0a484"
I20260709 14:54:44.260715 15181 raft_consensus.cc:3060] T ff73c3d51e5e480c920d1aca00b9b40d P eaa34beb1b274443b1c46839afd0a484 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:54:44.266417 15261 raft_consensus.cc:2468] T ff73c3d51e5e480c920d1aca00b9b40d P 9cb8de0701f2482b99e51d5ac080aa13 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7519e608fbb44d9db8ad30b9f10ae605 in term 3.
I20260709 14:54:44.268894 15076 leader_election.cc:304] T ff73c3d51e5e480c920d1aca00b9b40d P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7519e608fbb44d9db8ad30b9f10ae605, 9cb8de0701f2482b99e51d5ac080aa13; no voters: 
W20260709 14:54:44.270879 16287 log.cc:927] Time spent T b7c363a305d3434092ef6016b7064eb3 P dbc2c92e49e346b5b3bd7705a229afc6: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260709 14:54:44.271732 16261 raft_consensus.cc:2804] T ff73c3d51e5e480c920d1aca00b9b40d P 7519e608fbb44d9db8ad30b9f10ae605 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 14:54:44.277345 16261 raft_consensus.cc:697] T ff73c3d51e5e480c920d1aca00b9b40d P 7519e608fbb44d9db8ad30b9f10ae605 [term 3 LEADER]: Becoming Leader. State: Replica: 7519e608fbb44d9db8ad30b9f10ae605, State: Running, Role: LEADER
I20260709 14:54:44.279791 16261 consensus_queue.cc:237] T ff73c3d51e5e480c920d1aca00b9b40d P 7519e608fbb44d9db8ad30b9f10ae605 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
W20260709 14:54:44.290519 15957 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.68:45493, user_credentials={real_user=slave}} blocked reactor thread for 168161us
I20260709 14:54:44.297465 15150 leader_election.cc:304] T c7d360d2b84b4f0aa38f5c325f4521c1 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa34beb1b274443b1c46839afd0a484; no voters: 7519e608fbb44d9db8ad30b9f10ae605, 9cb8de0701f2482b99e51d5ac080aa13
I20260709 14:54:44.310742 16267 consensus_queue.cc:1048] T 798d0882b1ea4b26b598c236de8f18c9 P 7519e608fbb44d9db8ad30b9f10ae605 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 14:54:44.315341 15107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2cd7c8159d43c080fd8302180ecfca" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605" is_pre_election: true
I20260709 14:54:44.317875 15111 leader_election.cc:290] T ff73c3d51e5e480c920d1aca00b9b40d P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 3 election: Requested vote from peers eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805), 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493)
I20260709 14:54:44.335798 16230 raft_consensus.cc:2749] T c7d360d2b84b4f0aa38f5c325f4521c1 P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 14:54:44.342036 14935 catalog_manager.cc:5697] T ff73c3d51e5e480c920d1aca00b9b40d P 7519e608fbb44d9db8ad30b9f10ae605 reported cstate change: term changed from 2 to 3, leader changed from 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68) to 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66). New cstate: current_term: 3 leader_uuid: "7519e608fbb44d9db8ad30b9f10ae605" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } health_report { overall_health: UNKNOWN } } }
I20260709 14:54:44.347462 15957 leader_election.cc:304] T 8974e5ab032b4fba92bfc577280778bf P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7519e608fbb44d9db8ad30b9f10ae605, dbc2c92e49e346b5b3bd7705a229afc6; no voters: 
I20260709 14:54:44.349802 16289 raft_consensus.cc:2804] T 8974e5ab032b4fba92bfc577280778bf P dbc2c92e49e346b5b3bd7705a229afc6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 14:54:44.350808 16289 raft_consensus.cc:697] T 8974e5ab032b4fba92bfc577280778bf P dbc2c92e49e346b5b3bd7705a229afc6 [term 3 LEADER]: Becoming Leader. State: Replica: dbc2c92e49e346b5b3bd7705a229afc6, State: Running, Role: LEADER
I20260709 14:54:44.353204 15957 leader_election.cc:304] T 7f2cd7c8159d43c080fd8302180ecfca P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbc2c92e49e346b5b3bd7705a229afc6; no voters: 7519e608fbb44d9db8ad30b9f10ae605, eaa34beb1b274443b1c46839afd0a484
I20260709 14:54:44.361178 16281 raft_consensus.cc:2749] T 7f2cd7c8159d43c080fd8302180ecfca P dbc2c92e49e346b5b3bd7705a229afc6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 14:54:44.378921 15079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:33805, user_credentials={real_user=slave}} blocked reactor thread for 66073.3us
I20260709 14:54:44.352046 16289 consensus_queue.cc:237] T 8974e5ab032b4fba92bfc577280778bf P dbc2c92e49e346b5b3bd7705a229afc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:44.452786 15255 raft_consensus.cc:1275] T 46ebd2bd84cc46e08c82a7b893e54578 P 9cb8de0701f2482b99e51d5ac080aa13 [term 3 FOLLOWER]: Refusing update from remote peer dbc2c92e49e346b5b3bd7705a229afc6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 14:54:44.454640 16289 consensus_queue.cc:1048] T 46ebd2bd84cc46e08c82a7b893e54578 P dbc2c92e49e346b5b3bd7705a229afc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 14:54:44.455998 14935 catalog_manager.cc:5697] T bdf08eed05854470954a5e9dd17dfb27 P dbc2c92e49e346b5b3bd7705a229afc6 reported cstate change: term changed from 1 to 2, leader changed from 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68) to dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65). New cstate: current_term: 2 leader_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } health_report { overall_health: UNKNOWN } } }
I20260709 14:54:44.428934 15181 raft_consensus.cc:2468] T ff73c3d51e5e480c920d1aca00b9b40d P eaa34beb1b274443b1c46839afd0a484 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7519e608fbb44d9db8ad30b9f10ae605 in term 3.
I20260709 14:54:44.458252 14935 catalog_manager.cc:5697] T cc6f522768894933b21bc94b41605166 P dbc2c92e49e346b5b3bd7705a229afc6 reported cstate change: term changed from 2 to 3, leader changed from 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68) to dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65). New cstate: current_term: 3 leader_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } health_report { overall_health: HEALTHY } } }
I20260709 14:54:44.559187 15261 raft_consensus.cc:1275] T b7c363a305d3434092ef6016b7064eb3 P 9cb8de0701f2482b99e51d5ac080aa13 [term 3 FOLLOWER]: Refusing update from remote peer dbc2c92e49e346b5b3bd7705a229afc6: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 14:54:44.561208 16264 consensus_queue.cc:1048] T b7c363a305d3434092ef6016b7064eb3 P dbc2c92e49e346b5b3bd7705a229afc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 14:54:44.565830 15079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:45477, user_credentials={real_user=slave}} blocked reactor thread for 106368us
I20260709 14:54:44.588491 15105 raft_consensus.cc:1275] T bdf08eed05854470954a5e9dd17dfb27 P 7519e608fbb44d9db8ad30b9f10ae605 [term 2 FOLLOWER]: Refusing update from remote peer dbc2c92e49e346b5b3bd7705a229afc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:54:44.645936 16264 consensus_queue.cc:1048] T bdf08eed05854470954a5e9dd17dfb27 P dbc2c92e49e346b5b3bd7705a229afc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 14:54:44.688989 15111 raft_consensus.cc:1275] T b7c363a305d3434092ef6016b7064eb3 P 7519e608fbb44d9db8ad30b9f10ae605 [term 3 FOLLOWER]: Refusing update from remote peer dbc2c92e49e346b5b3bd7705a229afc6: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 14:54:44.691908 14935 catalog_manager.cc:5697] T 8974e5ab032b4fba92bfc577280778bf P dbc2c92e49e346b5b3bd7705a229afc6 reported cstate change: term changed from 2 to 3, leader changed from 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68) to dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65). New cstate: current_term: 3 leader_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } health_report { overall_health: UNKNOWN } } }
I20260709 14:54:44.741678 16289 consensus_queue.cc:1048] T b7c363a305d3434092ef6016b7064eb3 P dbc2c92e49e346b5b3bd7705a229afc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 14:54:44.752557 15181 raft_consensus.cc:1275] T 46ebd2bd84cc46e08c82a7b893e54578 P eaa34beb1b274443b1c46839afd0a484 [term 3 FOLLOWER]: Refusing update from remote peer dbc2c92e49e346b5b3bd7705a229afc6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 14:54:44.765796 15260 raft_consensus.cc:1275] T ff73c3d51e5e480c920d1aca00b9b40d P 9cb8de0701f2482b99e51d5ac080aa13 [term 3 FOLLOWER]: Refusing update from remote peer 7519e608fbb44d9db8ad30b9f10ae605: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 14:54:44.791538 15153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:45477, user_credentials={real_user=slave}} blocked reactor thread for 55915us
I20260709 14:54:44.789353 16252 consensus_queue.cc:1048] T ff73c3d51e5e480c920d1aca00b9b40d P 7519e608fbb44d9db8ad30b9f10ae605 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 14:54:44.809808 16264 consensus_queue.cc:1048] T 46ebd2bd84cc46e08c82a7b893e54578 P dbc2c92e49e346b5b3bd7705a229afc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 14:54:44.847119 15183 raft_consensus.cc:1275] T ff73c3d51e5e480c920d1aca00b9b40d P eaa34beb1b274443b1c46839afd0a484 [term 3 FOLLOWER]: Refusing update from remote peer 7519e608fbb44d9db8ad30b9f10ae605: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 14:54:44.863040 15957 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.66:43177, user_credentials={real_user=slave}} blocked reactor thread for 169888us
I20260709 14:54:44.870595 16295 consensus_queue.cc:1048] T ff73c3d51e5e480c920d1aca00b9b40d P 7519e608fbb44d9db8ad30b9f10ae605 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 14:54:44.946158  6549 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 14:54:44.980594 15153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:45477, user_credentials={real_user=slave}} blocked reactor thread for 87568.1us
I20260709 14:54:45.048209 15182 raft_consensus.cc:1275] T cc6f522768894933b21bc94b41605166 P eaa34beb1b274443b1c46839afd0a484 [term 3 FOLLOWER]: Refusing update from remote peer dbc2c92e49e346b5b3bd7705a229afc6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 14:54:45.053987 16281 consensus_queue.cc:1048] T cc6f522768894933b21bc94b41605166 P dbc2c92e49e346b5b3bd7705a229afc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 14:54:45.065843 15111 raft_consensus.cc:1275] T 8974e5ab032b4fba92bfc577280778bf P 7519e608fbb44d9db8ad30b9f10ae605 [term 3 FOLLOWER]: Refusing update from remote peer dbc2c92e49e346b5b3bd7705a229afc6: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 14:54:45.098927 16289 consensus_queue.cc:1048] T 8974e5ab032b4fba92bfc577280778bf P dbc2c92e49e346b5b3bd7705a229afc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
W20260709 14:54:45.186968 16320 log.cc:927] Time spent T bdf08eed05854470954a5e9dd17dfb27 P 7519e608fbb44d9db8ad30b9f10ae605: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 14:54:45.217931 15261 raft_consensus.cc:1275] T cc6f522768894933b21bc94b41605166 P 9cb8de0701f2482b99e51d5ac080aa13 [term 3 FOLLOWER]: Refusing update from remote peer dbc2c92e49e346b5b3bd7705a229afc6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 14:54:45.220137 15261 raft_consensus.cc:1275] T bdf08eed05854470954a5e9dd17dfb27 P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 FOLLOWER]: Refusing update from remote peer dbc2c92e49e346b5b3bd7705a229afc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:54:45.242368 15261 raft_consensus.cc:1275] T 8974e5ab032b4fba92bfc577280778bf P 9cb8de0701f2482b99e51d5ac080aa13 [term 3 FOLLOWER]: Refusing update from remote peer dbc2c92e49e346b5b3bd7705a229afc6: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 14:54:45.302982 16313 consensus_queue.cc:1048] T cc6f522768894933b21bc94b41605166 P dbc2c92e49e346b5b3bd7705a229afc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 14:54:45.309620 16326 consensus_queue.cc:1048] T bdf08eed05854470954a5e9dd17dfb27 P dbc2c92e49e346b5b3bd7705a229afc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 14:54:45.318684 16289 consensus_queue.cc:1048] T 8974e5ab032b4fba92bfc577280778bf P dbc2c92e49e346b5b3bd7705a229afc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 14:54:45.547101  6549 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 14:54:45.635771 15255 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1159198eabeb409996ccbec0cac057f8"
dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13"
mode: GRACEFUL
new_leader_uuid: "dbc2c92e49e346b5b3bd7705a229afc6"
 from {username='slave'} at 127.0.0.1:34412
I20260709 14:54:45.637115 15255 raft_consensus.cc:606] T 1159198eabeb409996ccbec0cac057f8 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 LEADER]: Received request to transfer leadership to TS dbc2c92e49e346b5b3bd7705a229afc6
I20260709 14:54:45.644187 15182 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1193461bc272409e8a1e719ecdb38e7f"
dest_uuid: "eaa34beb1b274443b1c46839afd0a484"
mode: GRACEFUL
new_leader_uuid: "9cb8de0701f2482b99e51d5ac080aa13"
 from {username='slave'} at 127.0.0.1:44288
I20260709 14:54:45.645308 15182 raft_consensus.cc:606] T 1193461bc272409e8a1e719ecdb38e7f P eaa34beb1b274443b1c46839afd0a484 [term 1 LEADER]: Received request to transfer leadership to TS 9cb8de0701f2482b99e51d5ac080aa13
I20260709 14:54:45.656183 15260 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5585b0f6bbf04c10865d2463767621dc"
dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13"
mode: GRACEFUL
new_leader_uuid: "dbc2c92e49e346b5b3bd7705a229afc6"
 from {username='slave'} at 127.0.0.1:34412
I20260709 14:54:45.657009 15260 raft_consensus.cc:606] T 5585b0f6bbf04c10865d2463767621dc P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 LEADER]: Received request to transfer leadership to TS dbc2c92e49e346b5b3bd7705a229afc6
I20260709 14:54:45.660810 15260 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ca2aa2e1a8c646069cb8b23b0ebdb0c7"
dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13"
mode: GRACEFUL
new_leader_uuid: "7519e608fbb44d9db8ad30b9f10ae605"
 from {username='slave'} at 127.0.0.1:34412
I20260709 14:54:45.661474 15260 raft_consensus.cc:606] T ca2aa2e1a8c646069cb8b23b0ebdb0c7 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 LEADER]: Received request to transfer leadership to TS 7519e608fbb44d9db8ad30b9f10ae605
I20260709 14:54:45.672159 15260 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dd44b332dc744f94a5f7cfffc06f3956"
dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13"
mode: GRACEFUL
new_leader_uuid: "dbc2c92e49e346b5b3bd7705a229afc6"
 from {username='slave'} at 127.0.0.1:34412
I20260709 14:54:45.673105 15260 raft_consensus.cc:606] T dd44b332dc744f94a5f7cfffc06f3956 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 LEADER]: Received request to transfer leadership to TS dbc2c92e49e346b5b3bd7705a229afc6
I20260709 14:54:45.690536 15260 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e43bf64543ef494790c2f7a4a063fdd1"
dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13"
mode: GRACEFUL
new_leader_uuid: "7519e608fbb44d9db8ad30b9f10ae605"
 from {username='slave'} at 127.0.0.1:34412
I20260709 14:54:45.691524 15260 raft_consensus.cc:606] T e43bf64543ef494790c2f7a4a063fdd1 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 LEADER]: Received request to transfer leadership to TS 7519e608fbb44d9db8ad30b9f10ae605
I20260709 14:54:45.706264  6549 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 14:54:45.708959  6549 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 14:54:45.750223 16255 raft_consensus.cc:993] T 1193461bc272409e8a1e719ecdb38e7f P eaa34beb1b274443b1c46839afd0a484: : Instructing follower 9cb8de0701f2482b99e51d5ac080aa13 to start an election
I20260709 14:54:45.750823 16255 raft_consensus.cc:1081] T 1193461bc272409e8a1e719ecdb38e7f P eaa34beb1b274443b1c46839afd0a484 [term 1 LEADER]: Signalling peer 9cb8de0701f2482b99e51d5ac080aa13 to start an election
I20260709 14:54:45.758172 15260 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1193461bc272409e8a1e719ecdb38e7f"
dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13"
 from {username='slave'} at 127.0.0.1:51436
I20260709 14:54:45.758924 15260 raft_consensus.cc:493] T 1193461bc272409e8a1e719ecdb38e7f P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:54:45.759568 15260 raft_consensus.cc:3060] T 1193461bc272409e8a1e719ecdb38e7f P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:54:45.816000 15260 raft_consensus.cc:515] T 1193461bc272409e8a1e719ecdb38e7f P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:45.841504 15260 leader_election.cc:290] T 1193461bc272409e8a1e719ecdb38e7f P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 2 election: Requested vote from peers 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177), eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805)
I20260709 14:54:45.849787 15113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1193461bc272409e8a1e719ecdb38e7f" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605"
I20260709 14:54:45.857760 15113 raft_consensus.cc:3060] T 1193461bc272409e8a1e719ecdb38e7f P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:54:45.859666 15185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1193461bc272409e8a1e719ecdb38e7f" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eaa34beb1b274443b1c46839afd0a484"
I20260709 14:54:45.860399 15185 raft_consensus.cc:3055] T 1193461bc272409e8a1e719ecdb38e7f P eaa34beb1b274443b1c46839afd0a484 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 14:54:45.860695 15185 raft_consensus.cc:740] T 1193461bc272409e8a1e719ecdb38e7f P eaa34beb1b274443b1c46839afd0a484 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: eaa34beb1b274443b1c46839afd0a484, State: Running, Role: LEADER
I20260709 14:54:45.868013 15113 raft_consensus.cc:2468] T 1193461bc272409e8a1e719ecdb38e7f P 7519e608fbb44d9db8ad30b9f10ae605 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cb8de0701f2482b99e51d5ac080aa13 in term 2.
I20260709 14:54:45.873440 15224 leader_election.cc:304] T 1193461bc272409e8a1e719ecdb38e7f P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7519e608fbb44d9db8ad30b9f10ae605, 9cb8de0701f2482b99e51d5ac080aa13; no voters: 
I20260709 14:54:45.874734 16272 raft_consensus.cc:2804] T 1193461bc272409e8a1e719ecdb38e7f P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:54:45.875403 16272 raft_consensus.cc:697] T 1193461bc272409e8a1e719ecdb38e7f P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 LEADER]: Becoming Leader. State: Replica: 9cb8de0701f2482b99e51d5ac080aa13, State: Running, Role: LEADER
I20260709 14:54:45.877043 16272 consensus_queue.cc:237] T 1193461bc272409e8a1e719ecdb38e7f P 9cb8de0701f2482b99e51d5ac080aa13 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:45.898336 15185 consensus_queue.cc:260] T 1193461bc272409e8a1e719ecdb38e7f P eaa34beb1b274443b1c46839afd0a484 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:45.900274 15185 raft_consensus.cc:3060] T 1193461bc272409e8a1e719ecdb38e7f P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:54:45.908608 14932 catalog_manager.cc:5697] T 1193461bc272409e8a1e719ecdb38e7f P 9cb8de0701f2482b99e51d5ac080aa13 reported cstate change: term changed from 1 to 2, leader changed from eaa34beb1b274443b1c46839afd0a484 (127.6.101.67) to 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68). New cstate: current_term: 2 leader_uuid: "9cb8de0701f2482b99e51d5ac080aa13" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } health_report { overall_health: HEALTHY } } }
I20260709 14:54:45.915997 15185 raft_consensus.cc:2468] T 1193461bc272409e8a1e719ecdb38e7f P eaa34beb1b274443b1c46839afd0a484 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cb8de0701f2482b99e51d5ac080aa13 in term 2.
I20260709 14:54:45.946624 16272 raft_consensus.cc:993] T 1159198eabeb409996ccbec0cac057f8 P 9cb8de0701f2482b99e51d5ac080aa13: : Instructing follower dbc2c92e49e346b5b3bd7705a229afc6 to start an election
I20260709 14:54:45.947191 16272 raft_consensus.cc:1081] T 1159198eabeb409996ccbec0cac057f8 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 LEADER]: Signalling peer dbc2c92e49e346b5b3bd7705a229afc6 to start an election
I20260709 14:54:45.950405 16096 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1159198eabeb409996ccbec0cac057f8"
dest_uuid: "dbc2c92e49e346b5b3bd7705a229afc6"
 from {username='slave'} at 127.0.0.1:39014
I20260709 14:54:45.951071 16096 raft_consensus.cc:493] T 1159198eabeb409996ccbec0cac057f8 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:54:45.951436 16096 raft_consensus.cc:3060] T 1159198eabeb409996ccbec0cac057f8 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:54:45.961977 16096 raft_consensus.cc:515] T 1159198eabeb409996ccbec0cac057f8 P dbc2c92e49e346b5b3bd7705a229afc6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:45.964524 16096 leader_election.cc:290] T 1159198eabeb409996ccbec0cac057f8 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 2 election: Requested vote from peers 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493), 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177)
I20260709 14:54:45.973198 15113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1159198eabeb409996ccbec0cac057f8" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605"
I20260709 14:54:45.973866 15113 raft_consensus.cc:3060] T 1159198eabeb409996ccbec0cac057f8 P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:54:45.988147 16270 raft_consensus.cc:993] T ca2aa2e1a8c646069cb8b23b0ebdb0c7 P 9cb8de0701f2482b99e51d5ac080aa13: : Instructing follower 7519e608fbb44d9db8ad30b9f10ae605 to start an election
I20260709 14:54:45.988849 16273 raft_consensus.cc:1081] T ca2aa2e1a8c646069cb8b23b0ebdb0c7 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 LEADER]: Signalling peer 7519e608fbb44d9db8ad30b9f10ae605 to start an election
I20260709 14:54:45.990983 15105 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ca2aa2e1a8c646069cb8b23b0ebdb0c7"
dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605"
 from {username='slave'} at 127.0.0.1:51820
I20260709 14:54:45.991797 15105 raft_consensus.cc:493] T ca2aa2e1a8c646069cb8b23b0ebdb0c7 P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:54:45.992259 15105 raft_consensus.cc:3060] T ca2aa2e1a8c646069cb8b23b0ebdb0c7 P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:54:46.008877 15105 raft_consensus.cc:515] T ca2aa2e1a8c646069cb8b23b0ebdb0c7 P 7519e608fbb44d9db8ad30b9f10ae605 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:46.014606 15185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2aa2e1a8c646069cb8b23b0ebdb0c7" candidate_uuid: "7519e608fbb44d9db8ad30b9f10ae605" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eaa34beb1b274443b1c46839afd0a484"
I20260709 14:54:46.015375 15185 raft_consensus.cc:3060] T ca2aa2e1a8c646069cb8b23b0ebdb0c7 P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:54:46.014954 15255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2aa2e1a8c646069cb8b23b0ebdb0c7" candidate_uuid: "7519e608fbb44d9db8ad30b9f10ae605" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13"
I20260709 14:54:46.016182 15255 raft_consensus.cc:3055] T ca2aa2e1a8c646069cb8b23b0ebdb0c7 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 14:54:46.016577 15255 raft_consensus.cc:740] T ca2aa2e1a8c646069cb8b23b0ebdb0c7 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9cb8de0701f2482b99e51d5ac080aa13, State: Running, Role: LEADER
I20260709 14:54:46.017829 15255 consensus_queue.cc:260] T ca2aa2e1a8c646069cb8b23b0ebdb0c7 P 9cb8de0701f2482b99e51d5ac080aa13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:46.020618 15255 raft_consensus.cc:3060] T ca2aa2e1a8c646069cb8b23b0ebdb0c7 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:54:46.020833 15105 leader_election.cc:290] T ca2aa2e1a8c646069cb8b23b0ebdb0c7 P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 2 election: Requested vote from peers eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805), 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493)
I20260709 14:54:46.022344 15113 raft_consensus.cc:2468] T 1159198eabeb409996ccbec0cac057f8 P 7519e608fbb44d9db8ad30b9f10ae605 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbc2c92e49e346b5b3bd7705a229afc6 in term 2.
I20260709 14:54:46.024037 15957 leader_election.cc:304] T 1159198eabeb409996ccbec0cac057f8 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7519e608fbb44d9db8ad30b9f10ae605, dbc2c92e49e346b5b3bd7705a229afc6; no voters: 
I20260709 14:54:46.024977 15185 raft_consensus.cc:2468] T ca2aa2e1a8c646069cb8b23b0ebdb0c7 P eaa34beb1b274443b1c46839afd0a484 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7519e608fbb44d9db8ad30b9f10ae605 in term 2.
I20260709 14:54:46.025553 16313 raft_consensus.cc:2804] T 1159198eabeb409996ccbec0cac057f8 P dbc2c92e49e346b5b3bd7705a229afc6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:54:46.026533 15079 leader_election.cc:304] T ca2aa2e1a8c646069cb8b23b0ebdb0c7 P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7519e608fbb44d9db8ad30b9f10ae605, eaa34beb1b274443b1c46839afd0a484; no voters: 
I20260709 14:54:46.026825 16313 raft_consensus.cc:697] T 1159198eabeb409996ccbec0cac057f8 P dbc2c92e49e346b5b3bd7705a229afc6 [term 2 LEADER]: Becoming Leader. State: Replica: dbc2c92e49e346b5b3bd7705a229afc6, State: Running, Role: LEADER
I20260709 14:54:46.028030 16313 consensus_queue.cc:237] T 1159198eabeb409996ccbec0cac057f8 P dbc2c92e49e346b5b3bd7705a229afc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:46.031481 15260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1159198eabeb409996ccbec0cac057f8" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13"
I20260709 14:54:46.032991 16296 raft_consensus.cc:2804] T ca2aa2e1a8c646069cb8b23b0ebdb0c7 P 7519e608fbb44d9db8ad30b9f10ae605 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:54:46.037731 16296 raft_consensus.cc:697] T ca2aa2e1a8c646069cb8b23b0ebdb0c7 P 7519e608fbb44d9db8ad30b9f10ae605 [term 2 LEADER]: Becoming Leader. State: Replica: 7519e608fbb44d9db8ad30b9f10ae605, State: Running, Role: LEADER
I20260709 14:54:46.038115 15260 raft_consensus.cc:3055] T 1159198eabeb409996ccbec0cac057f8 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 14:54:46.038625 15260 raft_consensus.cc:740] T 1159198eabeb409996ccbec0cac057f8 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9cb8de0701f2482b99e51d5ac080aa13, State: Running, Role: LEADER
I20260709 14:54:46.039038 16296 consensus_queue.cc:237] T ca2aa2e1a8c646069cb8b23b0ebdb0c7 P 7519e608fbb44d9db8ad30b9f10ae605 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:46.039737 15260 consensus_queue.cc:260] T 1159198eabeb409996ccbec0cac057f8 P 9cb8de0701f2482b99e51d5ac080aa13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:46.041805 15260 raft_consensus.cc:3060] T 1159198eabeb409996ccbec0cac057f8 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:54:46.071799 16328 raft_consensus.cc:993] T 5585b0f6bbf04c10865d2463767621dc P 9cb8de0701f2482b99e51d5ac080aa13: : Instructing follower dbc2c92e49e346b5b3bd7705a229afc6 to start an election
I20260709 14:54:46.072726 16328 raft_consensus.cc:1081] T 5585b0f6bbf04c10865d2463767621dc P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 LEADER]: Signalling peer dbc2c92e49e346b5b3bd7705a229afc6 to start an election
I20260709 14:54:46.073748 15260 raft_consensus.cc:2468] T 1159198eabeb409996ccbec0cac057f8 P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbc2c92e49e346b5b3bd7705a229afc6 in term 2.
I20260709 14:54:46.076380 16107 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5585b0f6bbf04c10865d2463767621dc"
dest_uuid: "dbc2c92e49e346b5b3bd7705a229afc6"
 from {username='slave'} at 127.0.0.1:39014
I20260709 14:54:46.077170 16107 raft_consensus.cc:493] T 5585b0f6bbf04c10865d2463767621dc P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:54:46.077651 16107 raft_consensus.cc:3060] T 5585b0f6bbf04c10865d2463767621dc P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:54:46.107304 16107 raft_consensus.cc:515] T 5585b0f6bbf04c10865d2463767621dc P dbc2c92e49e346b5b3bd7705a229afc6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:46.109395 16272 raft_consensus.cc:993] T dd44b332dc744f94a5f7cfffc06f3956 P 9cb8de0701f2482b99e51d5ac080aa13: : Instructing follower dbc2c92e49e346b5b3bd7705a229afc6 to start an election
I20260709 14:54:46.109674 16107 leader_election.cc:290] T 5585b0f6bbf04c10865d2463767621dc P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 2 election: Requested vote from peers 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493), 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177)
I20260709 14:54:46.110296 16272 raft_consensus.cc:1081] T dd44b332dc744f94a5f7cfffc06f3956 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 LEADER]: Signalling peer dbc2c92e49e346b5b3bd7705a229afc6 to start an election
I20260709 14:54:46.116397 15260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5585b0f6bbf04c10865d2463767621dc" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13"
I20260709 14:54:46.117349 15260 raft_consensus.cc:3055] T 5585b0f6bbf04c10865d2463767621dc P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 14:54:46.117811 15260 raft_consensus.cc:740] T 5585b0f6bbf04c10865d2463767621dc P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9cb8de0701f2482b99e51d5ac080aa13, State: Running, Role: LEADER
I20260709 14:54:46.118701 15260 consensus_queue.cc:260] T 5585b0f6bbf04c10865d2463767621dc P 9cb8de0701f2482b99e51d5ac080aa13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:46.120457 15260 raft_consensus.cc:3060] T 5585b0f6bbf04c10865d2463767621dc P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:54:46.116690 15113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5585b0f6bbf04c10865d2463767621dc" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605"
I20260709 14:54:46.122545 15113 raft_consensus.cc:3060] T 5585b0f6bbf04c10865d2463767621dc P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:54:46.131103 15255 raft_consensus.cc:2468] T ca2aa2e1a8c646069cb8b23b0ebdb0c7 P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7519e608fbb44d9db8ad30b9f10ae605 in term 2.
I20260709 14:54:46.136853 15260 raft_consensus.cc:2468] T 5585b0f6bbf04c10865d2463767621dc P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbc2c92e49e346b5b3bd7705a229afc6 in term 2.
I20260709 14:54:46.116730 16107 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dd44b332dc744f94a5f7cfffc06f3956"
dest_uuid: "dbc2c92e49e346b5b3bd7705a229afc6"
 from {username='slave'} at 127.0.0.1:39014
I20260709 14:54:46.139398 16272 raft_consensus.cc:993] T e43bf64543ef494790c2f7a4a063fdd1 P 9cb8de0701f2482b99e51d5ac080aa13: : Instructing follower 7519e608fbb44d9db8ad30b9f10ae605 to start an election
I20260709 14:54:46.145854 14933 catalog_manager.cc:5697] T ca2aa2e1a8c646069cb8b23b0ebdb0c7 P 7519e608fbb44d9db8ad30b9f10ae605 reported cstate change: term changed from 1 to 2, leader changed from 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68) to 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66). New cstate: current_term: 2 leader_uuid: "7519e608fbb44d9db8ad30b9f10ae605" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } health_report { overall_health: UNKNOWN } } }
I20260709 14:54:46.137099 14932 catalog_manager.cc:5697] T 1159198eabeb409996ccbec0cac057f8 P dbc2c92e49e346b5b3bd7705a229afc6 reported cstate change: term changed from 1 to 2, leader changed from 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68) to dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65). New cstate: current_term: 2 leader_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } health_report { overall_health: UNKNOWN } } }
I20260709 14:54:46.152101 16272 raft_consensus.cc:1081] T e43bf64543ef494790c2f7a4a063fdd1 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 LEADER]: Signalling peer 7519e608fbb44d9db8ad30b9f10ae605 to start an election
I20260709 14:54:46.154006 16107 raft_consensus.cc:493] T dd44b332dc744f94a5f7cfffc06f3956 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:54:46.154547 16107 raft_consensus.cc:3060] T dd44b332dc744f94a5f7cfffc06f3956 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:54:46.151005 15957 leader_election.cc:304] T 5585b0f6bbf04c10865d2463767621dc P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cb8de0701f2482b99e51d5ac080aa13, dbc2c92e49e346b5b3bd7705a229afc6; no voters: 
I20260709 14:54:46.159878 15105 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e43bf64543ef494790c2f7a4a063fdd1"
dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605"
 from {username='slave'} at 127.0.0.1:51820
I20260709 14:54:46.160777 15105 raft_consensus.cc:493] T e43bf64543ef494790c2f7a4a063fdd1 P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:54:46.160866 16313 raft_consensus.cc:2804] T 5585b0f6bbf04c10865d2463767621dc P dbc2c92e49e346b5b3bd7705a229afc6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:54:46.161746 16313 raft_consensus.cc:697] T 5585b0f6bbf04c10865d2463767621dc P dbc2c92e49e346b5b3bd7705a229afc6 [term 2 LEADER]: Becoming Leader. State: Replica: dbc2c92e49e346b5b3bd7705a229afc6, State: Running, Role: LEADER
I20260709 14:54:46.162966 16313 consensus_queue.cc:237] T 5585b0f6bbf04c10865d2463767621dc P dbc2c92e49e346b5b3bd7705a229afc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:46.161204 15105 raft_consensus.cc:3060] T e43bf64543ef494790c2f7a4a063fdd1 P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:54:46.170127 15113 raft_consensus.cc:2468] T 5585b0f6bbf04c10865d2463767621dc P 7519e608fbb44d9db8ad30b9f10ae605 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbc2c92e49e346b5b3bd7705a229afc6 in term 2.
I20260709 14:54:46.172765 16107 raft_consensus.cc:515] T dd44b332dc744f94a5f7cfffc06f3956 P dbc2c92e49e346b5b3bd7705a229afc6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:46.177982 16107 leader_election.cc:290] T dd44b332dc744f94a5f7cfffc06f3956 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 2 election: Requested vote from peers 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493), 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177)
I20260709 14:54:46.179781 15113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd44b332dc744f94a5f7cfffc06f3956" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605"
I20260709 14:54:46.180502 15113 raft_consensus.cc:3060] T dd44b332dc744f94a5f7cfffc06f3956 P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:54:46.189190 15105 raft_consensus.cc:515] T e43bf64543ef494790c2f7a4a063fdd1 P 7519e608fbb44d9db8ad30b9f10ae605 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:46.181164 15255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd44b332dc744f94a5f7cfffc06f3956" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13"
I20260709 14:54:46.191897 15255 raft_consensus.cc:3055] T dd44b332dc744f94a5f7cfffc06f3956 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 14:54:46.198377 15255 raft_consensus.cc:740] T dd44b332dc744f94a5f7cfffc06f3956 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9cb8de0701f2482b99e51d5ac080aa13, State: Running, Role: LEADER
I20260709 14:54:46.193327 15105 leader_election.cc:290] T e43bf64543ef494790c2f7a4a063fdd1 P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 2 election: Requested vote from peers eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805), 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493)
I20260709 14:54:46.194542 15260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43bf64543ef494790c2f7a4a063fdd1" candidate_uuid: "7519e608fbb44d9db8ad30b9f10ae605" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13"
I20260709 14:54:46.201999 15260 raft_consensus.cc:3055] T e43bf64543ef494790c2f7a4a063fdd1 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 14:54:46.201623 15255 consensus_queue.cc:260] T dd44b332dc744f94a5f7cfffc06f3956 P 9cb8de0701f2482b99e51d5ac080aa13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:46.202407 15260 raft_consensus.cc:740] T e43bf64543ef494790c2f7a4a063fdd1 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9cb8de0701f2482b99e51d5ac080aa13, State: Running, Role: LEADER
I20260709 14:54:46.203370 15255 raft_consensus.cc:3060] T dd44b332dc744f94a5f7cfffc06f3956 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:54:46.195811 15113 raft_consensus.cc:2468] T dd44b332dc744f94a5f7cfffc06f3956 P 7519e608fbb44d9db8ad30b9f10ae605 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbc2c92e49e346b5b3bd7705a229afc6 in term 2.
I20260709 14:54:46.196911 15185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43bf64543ef494790c2f7a4a063fdd1" candidate_uuid: "7519e608fbb44d9db8ad30b9f10ae605" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eaa34beb1b274443b1c46839afd0a484"
I20260709 14:54:46.204483 15185 raft_consensus.cc:3060] T e43bf64543ef494790c2f7a4a063fdd1 P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:54:46.205132 15957 leader_election.cc:304] T dd44b332dc744f94a5f7cfffc06f3956 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7519e608fbb44d9db8ad30b9f10ae605, dbc2c92e49e346b5b3bd7705a229afc6; no voters: 
I20260709 14:54:46.206385 16313 raft_consensus.cc:2804] T dd44b332dc744f94a5f7cfffc06f3956 P dbc2c92e49e346b5b3bd7705a229afc6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:54:46.206960 16313 raft_consensus.cc:697] T dd44b332dc744f94a5f7cfffc06f3956 P dbc2c92e49e346b5b3bd7705a229afc6 [term 2 LEADER]: Becoming Leader. State: Replica: dbc2c92e49e346b5b3bd7705a229afc6, State: Running, Role: LEADER
I20260709 14:54:46.208009 16313 consensus_queue.cc:237] T dd44b332dc744f94a5f7cfffc06f3956 P dbc2c92e49e346b5b3bd7705a229afc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:46.203372 15260 consensus_queue.cc:260] T e43bf64543ef494790c2f7a4a063fdd1 P 9cb8de0701f2482b99e51d5ac080aa13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:46.212013 15260 raft_consensus.cc:3060] T e43bf64543ef494790c2f7a4a063fdd1 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:54:46.223001 15260 raft_consensus.cc:2468] T e43bf64543ef494790c2f7a4a063fdd1 P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7519e608fbb44d9db8ad30b9f10ae605 in term 2.
I20260709 14:54:46.224545 15076 leader_election.cc:304] T e43bf64543ef494790c2f7a4a063fdd1 P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7519e608fbb44d9db8ad30b9f10ae605, 9cb8de0701f2482b99e51d5ac080aa13; no voters: 
I20260709 14:54:46.226480 16261 raft_consensus.cc:2804] T e43bf64543ef494790c2f7a4a063fdd1 P 7519e608fbb44d9db8ad30b9f10ae605 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:54:46.227160 16261 raft_consensus.cc:697] T e43bf64543ef494790c2f7a4a063fdd1 P 7519e608fbb44d9db8ad30b9f10ae605 [term 2 LEADER]: Becoming Leader. State: Replica: 7519e608fbb44d9db8ad30b9f10ae605, State: Running, Role: LEADER
I20260709 14:54:46.228155 16261 consensus_queue.cc:237] T e43bf64543ef494790c2f7a4a063fdd1 P 7519e608fbb44d9db8ad30b9f10ae605 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:46.252699 14932 catalog_manager.cc:5697] T e43bf64543ef494790c2f7a4a063fdd1 P 7519e608fbb44d9db8ad30b9f10ae605 reported cstate change: term changed from 1 to 2, leader changed from 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68) to 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66). New cstate: current_term: 2 leader_uuid: "7519e608fbb44d9db8ad30b9f10ae605" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } health_report { overall_health: UNKNOWN } } }
I20260709 14:54:46.234941 15255 raft_consensus.cc:2468] T dd44b332dc744f94a5f7cfffc06f3956 P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbc2c92e49e346b5b3bd7705a229afc6 in term 2.
I20260709 14:54:46.262667 15185 raft_consensus.cc:2468] T e43bf64543ef494790c2f7a4a063fdd1 P eaa34beb1b274443b1c46839afd0a484 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7519e608fbb44d9db8ad30b9f10ae605 in term 2.
I20260709 14:54:46.268239 14933 catalog_manager.cc:5697] T 5585b0f6bbf04c10865d2463767621dc P dbc2c92e49e346b5b3bd7705a229afc6 reported cstate change: term changed from 1 to 2, leader changed from 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68) to dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65). New cstate: current_term: 2 leader_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } health_report { overall_health: UNKNOWN } } }
I20260709 14:54:46.270984 14933 catalog_manager.cc:5697] T dd44b332dc744f94a5f7cfffc06f3956 P dbc2c92e49e346b5b3bd7705a229afc6 reported cstate change: term changed from 1 to 2, leader changed from 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68) to dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65). New cstate: current_term: 2 leader_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } health_report { overall_health: UNKNOWN } } }
I20260709 14:54:46.300398 15113 raft_consensus.cc:1275] T 1193461bc272409e8a1e719ecdb38e7f P 7519e608fbb44d9db8ad30b9f10ae605 [term 2 FOLLOWER]: Refusing update from remote peer 9cb8de0701f2482b99e51d5ac080aa13: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:54:46.303247 16273 consensus_queue.cc:1048] T 1193461bc272409e8a1e719ecdb38e7f P 9cb8de0701f2482b99e51d5ac080aa13 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 14:54:46.385396 15185 raft_consensus.cc:1275] T 1193461bc272409e8a1e719ecdb38e7f P eaa34beb1b274443b1c46839afd0a484 [term 2 FOLLOWER]: Refusing update from remote peer 9cb8de0701f2482b99e51d5ac080aa13: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:54:46.408674 16272 consensus_queue.cc:1048] T 1193461bc272409e8a1e719ecdb38e7f P 9cb8de0701f2482b99e51d5ac080aa13 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 14:54:46.459164 15105 raft_consensus.cc:1275] T 1159198eabeb409996ccbec0cac057f8 P 7519e608fbb44d9db8ad30b9f10ae605 [term 2 FOLLOWER]: Refusing update from remote peer dbc2c92e49e346b5b3bd7705a229afc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:54:46.461812 16281 consensus_queue.cc:1048] T 1159198eabeb409996ccbec0cac057f8 P dbc2c92e49e346b5b3bd7705a229afc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 14:54:46.494225 15255 raft_consensus.cc:1275] T 1159198eabeb409996ccbec0cac057f8 P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 FOLLOWER]: Refusing update from remote peer dbc2c92e49e346b5b3bd7705a229afc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:54:46.495882 16313 consensus_queue.cc:1048] T 1159198eabeb409996ccbec0cac057f8 P dbc2c92e49e346b5b3bd7705a229afc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 14:54:46.563606 15105 raft_consensus.cc:1275] T 5585b0f6bbf04c10865d2463767621dc P 7519e608fbb44d9db8ad30b9f10ae605 [term 2 FOLLOWER]: Refusing update from remote peer dbc2c92e49e346b5b3bd7705a229afc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:54:46.565407 16281 consensus_queue.cc:1048] T 5585b0f6bbf04c10865d2463767621dc P dbc2c92e49e346b5b3bd7705a229afc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 14:54:46.593844 15255 raft_consensus.cc:1275] T 5585b0f6bbf04c10865d2463767621dc P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 FOLLOWER]: Refusing update from remote peer dbc2c92e49e346b5b3bd7705a229afc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:54:46.599267 16316 consensus_queue.cc:1048] T 5585b0f6bbf04c10865d2463767621dc P dbc2c92e49e346b5b3bd7705a229afc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 14:54:46.619127 15185 raft_consensus.cc:1275] T ca2aa2e1a8c646069cb8b23b0ebdb0c7 P eaa34beb1b274443b1c46839afd0a484 [term 2 FOLLOWER]: Refusing update from remote peer 7519e608fbb44d9db8ad30b9f10ae605: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:54:46.628043 16349 consensus_queue.cc:1048] T ca2aa2e1a8c646069cb8b23b0ebdb0c7 P 7519e608fbb44d9db8ad30b9f10ae605 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 14:54:46.660691 15255 raft_consensus.cc:1275] T dd44b332dc744f94a5f7cfffc06f3956 P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 FOLLOWER]: Refusing update from remote peer dbc2c92e49e346b5b3bd7705a229afc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:54:46.664391 16316 consensus_queue.cc:1048] T dd44b332dc744f94a5f7cfffc06f3956 P dbc2c92e49e346b5b3bd7705a229afc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 14:54:46.671267 15255 raft_consensus.cc:1275] T ca2aa2e1a8c646069cb8b23b0ebdb0c7 P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 FOLLOWER]: Refusing update from remote peer 7519e608fbb44d9db8ad30b9f10ae605: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:54:46.676847 16349 consensus_queue.cc:1048] T ca2aa2e1a8c646069cb8b23b0ebdb0c7 P 7519e608fbb44d9db8ad30b9f10ae605 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 14:54:46.717674  6549 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 14:54:46.747551 15257 raft_consensus.cc:1275] T e43bf64543ef494790c2f7a4a063fdd1 P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 FOLLOWER]: Refusing update from remote peer 7519e608fbb44d9db8ad30b9f10ae605: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:54:46.765383 16349 consensus_queue.cc:1048] T e43bf64543ef494790c2f7a4a063fdd1 P 7519e608fbb44d9db8ad30b9f10ae605 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 14:54:46.817584 15182 raft_consensus.cc:1275] T e43bf64543ef494790c2f7a4a063fdd1 P eaa34beb1b274443b1c46839afd0a484 [term 2 FOLLOWER]: Refusing update from remote peer 7519e608fbb44d9db8ad30b9f10ae605: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:54:46.818398  6549 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 14:54:46.831986 16296 consensus_queue.cc:1048] T e43bf64543ef494790c2f7a4a063fdd1 P 7519e608fbb44d9db8ad30b9f10ae605 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 14:54:46.820787 15113 raft_consensus.cc:1275] T dd44b332dc744f94a5f7cfffc06f3956 P 7519e608fbb44d9db8ad30b9f10ae605 [term 2 FOLLOWER]: Refusing update from remote peer dbc2c92e49e346b5b3bd7705a229afc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:54:46.856387 16313 consensus_queue.cc:1048] T dd44b332dc744f94a5f7cfffc06f3956 P dbc2c92e49e346b5b3bd7705a229afc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 14:54:47.067289 15113 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "91c9f89fcb8b45ff9be43f535cafffde"
dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605"
mode: GRACEFUL
new_leader_uuid: "dbc2c92e49e346b5b3bd7705a229afc6"
 from {username='slave'} at 127.0.0.1:50244
I20260709 14:54:47.067960 15113 raft_consensus.cc:606] T 91c9f89fcb8b45ff9be43f535cafffde P 7519e608fbb44d9db8ad30b9f10ae605 [term 4 LEADER]: Received request to transfer leadership to TS dbc2c92e49e346b5b3bd7705a229afc6
I20260709 14:54:47.071237 15260 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a1075567fc91458ca7cc9977cf02b170"
dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13"
mode: GRACEFUL
new_leader_uuid: "dbc2c92e49e346b5b3bd7705a229afc6"
 from {username='slave'} at 127.0.0.1:34412
I20260709 14:54:47.071911 15260 raft_consensus.cc:606] T a1075567fc91458ca7cc9977cf02b170 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 LEADER]: Received request to transfer leadership to TS dbc2c92e49e346b5b3bd7705a229afc6
I20260709 14:54:47.075500 15260 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b8d6b9cf24a24444b2a69fd526cd4b09"
dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13"
mode: GRACEFUL
new_leader_uuid: "7519e608fbb44d9db8ad30b9f10ae605"
 from {username='slave'} at 127.0.0.1:34412
I20260709 14:54:47.076545 15260 raft_consensus.cc:606] T b8d6b9cf24a24444b2a69fd526cd4b09 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 LEADER]: Received request to transfer leadership to TS 7519e608fbb44d9db8ad30b9f10ae605
I20260709 14:54:47.081081 15113 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d354c94548fc411ab62b4281ed947944"
dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605"
mode: GRACEFUL
new_leader_uuid: "dbc2c92e49e346b5b3bd7705a229afc6"
 from {username='slave'} at 127.0.0.1:50244
I20260709 14:54:47.081982 15113 raft_consensus.cc:606] T d354c94548fc411ab62b4281ed947944 P 7519e608fbb44d9db8ad30b9f10ae605 [term 2 LEADER]: Received request to transfer leadership to TS dbc2c92e49e346b5b3bd7705a229afc6
I20260709 14:54:47.087611 15182 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d86dfc13b2834d7e8b2ad5f975f08154"
dest_uuid: "eaa34beb1b274443b1c46839afd0a484"
mode: GRACEFUL
new_leader_uuid: "dbc2c92e49e346b5b3bd7705a229afc6"
 from {username='slave'} at 127.0.0.1:44288
I20260709 14:54:47.088313 15182 raft_consensus.cc:606] T d86dfc13b2834d7e8b2ad5f975f08154 P eaa34beb1b274443b1c46839afd0a484 [term 2 LEADER]: Received request to transfer leadership to TS dbc2c92e49e346b5b3bd7705a229afc6
I20260709 14:54:47.090372  6549 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 14:54:47.092289  6549 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 14:54:47.116667 16349 raft_consensus.cc:993] T 91c9f89fcb8b45ff9be43f535cafffde P 7519e608fbb44d9db8ad30b9f10ae605: : Instructing follower dbc2c92e49e346b5b3bd7705a229afc6 to start an election
I20260709 14:54:47.117362 16296 raft_consensus.cc:1081] T 91c9f89fcb8b45ff9be43f535cafffde P 7519e608fbb44d9db8ad30b9f10ae605 [term 4 LEADER]: Signalling peer dbc2c92e49e346b5b3bd7705a229afc6 to start an election
I20260709 14:54:47.121006 16103 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "91c9f89fcb8b45ff9be43f535cafffde"
dest_uuid: "dbc2c92e49e346b5b3bd7705a229afc6"
 from {username='slave'} at 127.0.0.1:39024
I20260709 14:54:47.121639 16103 raft_consensus.cc:493] T 91c9f89fcb8b45ff9be43f535cafffde P dbc2c92e49e346b5b3bd7705a229afc6 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:54:47.122004 16103 raft_consensus.cc:3060] T 91c9f89fcb8b45ff9be43f535cafffde P dbc2c92e49e346b5b3bd7705a229afc6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:54:47.125182 16273 raft_consensus.cc:993] T b8d6b9cf24a24444b2a69fd526cd4b09 P 9cb8de0701f2482b99e51d5ac080aa13: : Instructing follower 7519e608fbb44d9db8ad30b9f10ae605 to start an election
I20260709 14:54:47.125864 16273 raft_consensus.cc:1081] T b8d6b9cf24a24444b2a69fd526cd4b09 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 LEADER]: Signalling peer 7519e608fbb44d9db8ad30b9f10ae605 to start an election
I20260709 14:54:47.129808 15113 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b8d6b9cf24a24444b2a69fd526cd4b09"
dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605"
 from {username='slave'} at 127.0.0.1:51820
I20260709 14:54:47.130867 15113 raft_consensus.cc:493] T b8d6b9cf24a24444b2a69fd526cd4b09 P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:54:47.131316 15113 raft_consensus.cc:3060] T b8d6b9cf24a24444b2a69fd526cd4b09 P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:54:47.134019 16103 raft_consensus.cc:515] T 91c9f89fcb8b45ff9be43f535cafffde P dbc2c92e49e346b5b3bd7705a229afc6 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:47.136809 16103 leader_election.cc:290] T 91c9f89fcb8b45ff9be43f535cafffde P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 5 election: Requested vote from peers 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177), eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805)
I20260709 14:54:47.138795 15185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c9f89fcb8b45ff9be43f535cafffde" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: true dest_uuid: "eaa34beb1b274443b1c46839afd0a484"
I20260709 14:54:47.139622 15185 raft_consensus.cc:3060] T 91c9f89fcb8b45ff9be43f535cafffde P eaa34beb1b274443b1c46839afd0a484 [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:54:47.138783 15111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c9f89fcb8b45ff9be43f535cafffde" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: true dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605"
I20260709 14:54:47.141220 15111 raft_consensus.cc:3055] T 91c9f89fcb8b45ff9be43f535cafffde P 7519e608fbb44d9db8ad30b9f10ae605 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 14:54:47.141656 15111 raft_consensus.cc:740] T 91c9f89fcb8b45ff9be43f535cafffde P 7519e608fbb44d9db8ad30b9f10ae605 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7519e608fbb44d9db8ad30b9f10ae605, State: Running, Role: LEADER
I20260709 14:54:47.142467 15111 consensus_queue.cc:260] T 91c9f89fcb8b45ff9be43f535cafffde P 7519e608fbb44d9db8ad30b9f10ae605 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:47.144208 15111 raft_consensus.cc:3060] T 91c9f89fcb8b45ff9be43f535cafffde P 7519e608fbb44d9db8ad30b9f10ae605 [term 4 FOLLOWER]: Advancing to term 5
I20260709 14:54:47.165702 15113 raft_consensus.cc:515] T b8d6b9cf24a24444b2a69fd526cd4b09 P 7519e608fbb44d9db8ad30b9f10ae605 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:47.170295 15182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8d6b9cf24a24444b2a69fd526cd4b09" candidate_uuid: "7519e608fbb44d9db8ad30b9f10ae605" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eaa34beb1b274443b1c46839afd0a484"
I20260709 14:54:47.170339 15260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8d6b9cf24a24444b2a69fd526cd4b09" candidate_uuid: "7519e608fbb44d9db8ad30b9f10ae605" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13"
I20260709 14:54:47.171336 15260 raft_consensus.cc:3055] T b8d6b9cf24a24444b2a69fd526cd4b09 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 14:54:47.171614 15182 raft_consensus.cc:3060] T b8d6b9cf24a24444b2a69fd526cd4b09 P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:54:47.171722 15260 raft_consensus.cc:740] T b8d6b9cf24a24444b2a69fd526cd4b09 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9cb8de0701f2482b99e51d5ac080aa13, State: Running, Role: LEADER
I20260709 14:54:47.173347 15260 consensus_queue.cc:260] T b8d6b9cf24a24444b2a69fd526cd4b09 P 9cb8de0701f2482b99e51d5ac080aa13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:47.174918 15260 raft_consensus.cc:3060] T b8d6b9cf24a24444b2a69fd526cd4b09 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:54:47.179544 15113 leader_election.cc:290] T b8d6b9cf24a24444b2a69fd526cd4b09 P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 2 election: Requested vote from peers eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805), 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493)
I20260709 14:54:47.190658 15260 raft_consensus.cc:2468] T b8d6b9cf24a24444b2a69fd526cd4b09 P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7519e608fbb44d9db8ad30b9f10ae605 in term 2.
I20260709 14:54:47.193425 15076 leader_election.cc:304] T b8d6b9cf24a24444b2a69fd526cd4b09 P 7519e608fbb44d9db8ad30b9f10ae605 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7519e608fbb44d9db8ad30b9f10ae605, 9cb8de0701f2482b99e51d5ac080aa13; no voters: 
I20260709 14:54:47.194909 16296 raft_consensus.cc:2804] T b8d6b9cf24a24444b2a69fd526cd4b09 P 7519e608fbb44d9db8ad30b9f10ae605 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:54:47.195509 16296 raft_consensus.cc:697] T b8d6b9cf24a24444b2a69fd526cd4b09 P 7519e608fbb44d9db8ad30b9f10ae605 [term 2 LEADER]: Becoming Leader. State: Replica: 7519e608fbb44d9db8ad30b9f10ae605, State: Running, Role: LEADER
I20260709 14:54:47.196460 16296 consensus_queue.cc:237] T b8d6b9cf24a24444b2a69fd526cd4b09 P 7519e608fbb44d9db8ad30b9f10ae605 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:47.207304 15182 raft_consensus.cc:2468] T b8d6b9cf24a24444b2a69fd526cd4b09 P eaa34beb1b274443b1c46839afd0a484 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7519e608fbb44d9db8ad30b9f10ae605 in term 2.
I20260709 14:54:47.215675 15185 raft_consensus.cc:2468] T 91c9f89fcb8b45ff9be43f535cafffde P eaa34beb1b274443b1c46839afd0a484 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbc2c92e49e346b5b3bd7705a229afc6 in term 5.
I20260709 14:54:47.221150 14933 catalog_manager.cc:5697] T b8d6b9cf24a24444b2a69fd526cd4b09 P 7519e608fbb44d9db8ad30b9f10ae605 reported cstate change: term changed from 1 to 2, leader changed from 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68) to 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66). New cstate: current_term: 2 leader_uuid: "7519e608fbb44d9db8ad30b9f10ae605" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } health_report { overall_health: UNKNOWN } } }
I20260709 14:54:47.245210 15111 raft_consensus.cc:2468] T 91c9f89fcb8b45ff9be43f535cafffde P 7519e608fbb44d9db8ad30b9f10ae605 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbc2c92e49e346b5b3bd7705a229afc6 in term 5.
I20260709 14:54:47.248457 15960 leader_election.cc:304] T 91c9f89fcb8b45ff9be43f535cafffde P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dbc2c92e49e346b5b3bd7705a229afc6, eaa34beb1b274443b1c46839afd0a484; no voters: 
I20260709 14:54:47.264441 16313 raft_consensus.cc:2804] T 91c9f89fcb8b45ff9be43f535cafffde P dbc2c92e49e346b5b3bd7705a229afc6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 14:54:47.265069 16313 raft_consensus.cc:697] T 91c9f89fcb8b45ff9be43f535cafffde P dbc2c92e49e346b5b3bd7705a229afc6 [term 5 LEADER]: Becoming Leader. State: Replica: dbc2c92e49e346b5b3bd7705a229afc6, State: Running, Role: LEADER
I20260709 14:54:47.266202 16313 consensus_queue.cc:237] T 91c9f89fcb8b45ff9be43f535cafffde P dbc2c92e49e346b5b3bd7705a229afc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:47.310662 14935 catalog_manager.cc:5697] T 91c9f89fcb8b45ff9be43f535cafffde P dbc2c92e49e346b5b3bd7705a229afc6 reported cstate change: term changed from 4 to 5, leader changed from 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66) to dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65). New cstate: current_term: 5 leader_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } health_report { overall_health: UNKNOWN } } }
I20260709 14:54:47.433965 16254 raft_consensus.cc:993] T d86dfc13b2834d7e8b2ad5f975f08154 P eaa34beb1b274443b1c46839afd0a484: : Instructing follower dbc2c92e49e346b5b3bd7705a229afc6 to start an election
I20260709 14:54:47.434931 16254 raft_consensus.cc:1081] T d86dfc13b2834d7e8b2ad5f975f08154 P eaa34beb1b274443b1c46839afd0a484 [term 2 LEADER]: Signalling peer dbc2c92e49e346b5b3bd7705a229afc6 to start an election
I20260709 14:54:47.438578 16103 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d86dfc13b2834d7e8b2ad5f975f08154"
dest_uuid: "dbc2c92e49e346b5b3bd7705a229afc6"
 from {username='slave'} at 127.0.0.1:39038
I20260709 14:54:47.439208 16103 raft_consensus.cc:493] T d86dfc13b2834d7e8b2ad5f975f08154 P dbc2c92e49e346b5b3bd7705a229afc6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:54:47.439857 16103 raft_consensus.cc:3060] T d86dfc13b2834d7e8b2ad5f975f08154 P dbc2c92e49e346b5b3bd7705a229afc6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:54:47.451561 16103 raft_consensus.cc:515] T d86dfc13b2834d7e8b2ad5f975f08154 P dbc2c92e49e346b5b3bd7705a229afc6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:47.455818 15260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86dfc13b2834d7e8b2ad5f975f08154" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13"
I20260709 14:54:47.456573 15260 raft_consensus.cc:3060] T d86dfc13b2834d7e8b2ad5f975f08154 P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:54:47.456171 15183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86dfc13b2834d7e8b2ad5f975f08154" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "eaa34beb1b274443b1c46839afd0a484"
I20260709 14:54:47.457839 16103 leader_election.cc:290] T d86dfc13b2834d7e8b2ad5f975f08154 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 3 election: Requested vote from peers eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805), 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493)
I20260709 14:54:47.458197 15183 raft_consensus.cc:3055] T d86dfc13b2834d7e8b2ad5f975f08154 P eaa34beb1b274443b1c46839afd0a484 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 14:54:47.458770 15183 raft_consensus.cc:740] T d86dfc13b2834d7e8b2ad5f975f08154 P eaa34beb1b274443b1c46839afd0a484 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: eaa34beb1b274443b1c46839afd0a484, State: Running, Role: LEADER
I20260709 14:54:47.460538 15183 consensus_queue.cc:260] T d86dfc13b2834d7e8b2ad5f975f08154 P eaa34beb1b274443b1c46839afd0a484 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:47.462822 15183 raft_consensus.cc:3060] T d86dfc13b2834d7e8b2ad5f975f08154 P eaa34beb1b274443b1c46839afd0a484 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:54:47.465541 15260 raft_consensus.cc:2468] T d86dfc13b2834d7e8b2ad5f975f08154 P 9cb8de0701f2482b99e51d5ac080aa13 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbc2c92e49e346b5b3bd7705a229afc6 in term 3.
I20260709 14:54:47.466846 15957 leader_election.cc:304] T d86dfc13b2834d7e8b2ad5f975f08154 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cb8de0701f2482b99e51d5ac080aa13, dbc2c92e49e346b5b3bd7705a229afc6; no voters: 
I20260709 14:54:47.467684 16281 raft_consensus.cc:2804] T d86dfc13b2834d7e8b2ad5f975f08154 P dbc2c92e49e346b5b3bd7705a229afc6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 14:54:47.468506 16281 raft_consensus.cc:697] T d86dfc13b2834d7e8b2ad5f975f08154 P dbc2c92e49e346b5b3bd7705a229afc6 [term 3 LEADER]: Becoming Leader. State: Replica: dbc2c92e49e346b5b3bd7705a229afc6, State: Running, Role: LEADER
I20260709 14:54:47.469537 16281 consensus_queue.cc:237] T d86dfc13b2834d7e8b2ad5f975f08154 P dbc2c92e49e346b5b3bd7705a229afc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:47.472263 15183 raft_consensus.cc:2468] T d86dfc13b2834d7e8b2ad5f975f08154 P eaa34beb1b274443b1c46839afd0a484 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbc2c92e49e346b5b3bd7705a229afc6 in term 3.
I20260709 14:54:47.484217 14933 catalog_manager.cc:5697] T d86dfc13b2834d7e8b2ad5f975f08154 P dbc2c92e49e346b5b3bd7705a229afc6 reported cstate change: term changed from 2 to 3, leader changed from eaa34beb1b274443b1c46839afd0a484 (127.6.101.67) to dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65). New cstate: current_term: 3 leader_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } health_report { overall_health: HEALTHY } } }
I20260709 14:54:47.572306 16270 raft_consensus.cc:993] T a1075567fc91458ca7cc9977cf02b170 P 9cb8de0701f2482b99e51d5ac080aa13: : Instructing follower dbc2c92e49e346b5b3bd7705a229afc6 to start an election
I20260709 14:54:47.572943 16283 raft_consensus.cc:1081] T a1075567fc91458ca7cc9977cf02b170 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 LEADER]: Signalling peer dbc2c92e49e346b5b3bd7705a229afc6 to start an election
I20260709 14:54:47.575322 16103 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a1075567fc91458ca7cc9977cf02b170"
dest_uuid: "dbc2c92e49e346b5b3bd7705a229afc6"
 from {username='slave'} at 127.0.0.1:39014
I20260709 14:54:47.575858 16103 raft_consensus.cc:493] T a1075567fc91458ca7cc9977cf02b170 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:54:47.576627 16103 raft_consensus.cc:3060] T a1075567fc91458ca7cc9977cf02b170 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:54:47.585723 16103 raft_consensus.cc:515] T a1075567fc91458ca7cc9977cf02b170 P dbc2c92e49e346b5b3bd7705a229afc6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:47.588250 16103 leader_election.cc:290] T a1075567fc91458ca7cc9977cf02b170 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 2 election: Requested vote from peers 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493), 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177)
I20260709 14:54:47.589323 15105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1075567fc91458ca7cc9977cf02b170" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605"
I20260709 14:54:47.590013 15105 raft_consensus.cc:3060] T a1075567fc91458ca7cc9977cf02b170 P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:54:47.590284 15260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1075567fc91458ca7cc9977cf02b170" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13"
I20260709 14:54:47.591070 15260 raft_consensus.cc:3055] T a1075567fc91458ca7cc9977cf02b170 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 14:54:47.591341 16261 raft_consensus.cc:993] T d354c94548fc411ab62b4281ed947944 P 7519e608fbb44d9db8ad30b9f10ae605: : Instructing follower dbc2c92e49e346b5b3bd7705a229afc6 to start an election
I20260709 14:54:47.591435 15260 raft_consensus.cc:740] T a1075567fc91458ca7cc9977cf02b170 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9cb8de0701f2482b99e51d5ac080aa13, State: Running, Role: LEADER
I20260709 14:54:47.592046 16349 raft_consensus.cc:1081] T d354c94548fc411ab62b4281ed947944 P 7519e608fbb44d9db8ad30b9f10ae605 [term 2 LEADER]: Signalling peer dbc2c92e49e346b5b3bd7705a229afc6 to start an election
I20260709 14:54:47.592386 15260 consensus_queue.cc:260] T a1075567fc91458ca7cc9977cf02b170 P 9cb8de0701f2482b99e51d5ac080aa13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:47.593829 15260 raft_consensus.cc:3060] T a1075567fc91458ca7cc9977cf02b170 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:54:47.594578 16103 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d354c94548fc411ab62b4281ed947944"
dest_uuid: "dbc2c92e49e346b5b3bd7705a229afc6"
 from {username='slave'} at 127.0.0.1:39024
I20260709 14:54:47.595278 16103 raft_consensus.cc:493] T d354c94548fc411ab62b4281ed947944 P dbc2c92e49e346b5b3bd7705a229afc6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:54:47.595625 16103 raft_consensus.cc:3060] T d354c94548fc411ab62b4281ed947944 P dbc2c92e49e346b5b3bd7705a229afc6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:54:47.598024 15183 raft_consensus.cc:1275] T b8d6b9cf24a24444b2a69fd526cd4b09 P eaa34beb1b274443b1c46839afd0a484 [term 2 FOLLOWER]: Refusing update from remote peer 7519e608fbb44d9db8ad30b9f10ae605: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:54:47.600180 16349 consensus_queue.cc:1048] T b8d6b9cf24a24444b2a69fd526cd4b09 P 7519e608fbb44d9db8ad30b9f10ae605 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 14:54:47.601523 15105 raft_consensus.cc:2468] T a1075567fc91458ca7cc9977cf02b170 P 7519e608fbb44d9db8ad30b9f10ae605 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbc2c92e49e346b5b3bd7705a229afc6 in term 2.
I20260709 14:54:47.603119 15260 raft_consensus.cc:2468] T a1075567fc91458ca7cc9977cf02b170 P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbc2c92e49e346b5b3bd7705a229afc6 in term 2.
I20260709 14:54:47.603310 15957 leader_election.cc:304] T a1075567fc91458ca7cc9977cf02b170 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7519e608fbb44d9db8ad30b9f10ae605, dbc2c92e49e346b5b3bd7705a229afc6; no voters: 
I20260709 14:54:47.604489 16313 raft_consensus.cc:2804] T a1075567fc91458ca7cc9977cf02b170 P dbc2c92e49e346b5b3bd7705a229afc6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:54:47.605084 16313 raft_consensus.cc:697] T a1075567fc91458ca7cc9977cf02b170 P dbc2c92e49e346b5b3bd7705a229afc6 [term 2 LEADER]: Becoming Leader. State: Replica: dbc2c92e49e346b5b3bd7705a229afc6, State: Running, Role: LEADER
I20260709 14:54:47.605053 16103 raft_consensus.cc:515] T d354c94548fc411ab62b4281ed947944 P dbc2c92e49e346b5b3bd7705a229afc6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:47.606127 16313 consensus_queue.cc:237] T a1075567fc91458ca7cc9977cf02b170 P dbc2c92e49e346b5b3bd7705a229afc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:47.608888 16103 leader_election.cc:290] T d354c94548fc411ab62b4281ed947944 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 3 election: Requested vote from peers 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177), eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805)
I20260709 14:54:47.609612 15182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d354c94548fc411ab62b4281ed947944" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "eaa34beb1b274443b1c46839afd0a484"
I20260709 14:54:47.610406 15182 raft_consensus.cc:3060] T d354c94548fc411ab62b4281ed947944 P eaa34beb1b274443b1c46839afd0a484 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:54:47.611805 15105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d354c94548fc411ab62b4281ed947944" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605"
I20260709 14:54:47.612406 15105 raft_consensus.cc:3055] T d354c94548fc411ab62b4281ed947944 P 7519e608fbb44d9db8ad30b9f10ae605 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 14:54:47.612604 15105 raft_consensus.cc:740] T d354c94548fc411ab62b4281ed947944 P 7519e608fbb44d9db8ad30b9f10ae605 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7519e608fbb44d9db8ad30b9f10ae605, State: Running, Role: LEADER
I20260709 14:54:47.613466 15105 consensus_queue.cc:260] T d354c94548fc411ab62b4281ed947944 P 7519e608fbb44d9db8ad30b9f10ae605 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:47.614933 15105 raft_consensus.cc:3060] T d354c94548fc411ab62b4281ed947944 P 7519e608fbb44d9db8ad30b9f10ae605 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:54:47.624639 15105 raft_consensus.cc:2468] T d354c94548fc411ab62b4281ed947944 P 7519e608fbb44d9db8ad30b9f10ae605 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbc2c92e49e346b5b3bd7705a229afc6 in term 3.
I20260709 14:54:47.625768 15182 raft_consensus.cc:2468] T d354c94548fc411ab62b4281ed947944 P eaa34beb1b274443b1c46839afd0a484 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbc2c92e49e346b5b3bd7705a229afc6 in term 3.
I20260709 14:54:47.626430 15957 leader_election.cc:304] T d354c94548fc411ab62b4281ed947944 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7519e608fbb44d9db8ad30b9f10ae605, dbc2c92e49e346b5b3bd7705a229afc6; no voters: 
I20260709 14:54:47.627802 16313 raft_consensus.cc:2804] T d354c94548fc411ab62b4281ed947944 P dbc2c92e49e346b5b3bd7705a229afc6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 14:54:47.631922 16313 raft_consensus.cc:697] T d354c94548fc411ab62b4281ed947944 P dbc2c92e49e346b5b3bd7705a229afc6 [term 3 LEADER]: Becoming Leader. State: Replica: dbc2c92e49e346b5b3bd7705a229afc6, State: Running, Role: LEADER
I20260709 14:54:47.633049 16313 consensus_queue.cc:237] T d354c94548fc411ab62b4281ed947944 P dbc2c92e49e346b5b3bd7705a229afc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:47.635175 15255 raft_consensus.cc:1275] T b8d6b9cf24a24444b2a69fd526cd4b09 P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 FOLLOWER]: Refusing update from remote peer 7519e608fbb44d9db8ad30b9f10ae605: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:54:47.626991 14935 catalog_manager.cc:5697] T a1075567fc91458ca7cc9977cf02b170 P dbc2c92e49e346b5b3bd7705a229afc6 reported cstate change: term changed from 1 to 2, leader changed from 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68) to dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65). New cstate: current_term: 2 leader_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } health_report { overall_health: UNKNOWN } } }
I20260709 14:54:47.638686 16296 consensus_queue.cc:1048] T b8d6b9cf24a24444b2a69fd526cd4b09 P 7519e608fbb44d9db8ad30b9f10ae605 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 14:54:47.683164 14935 catalog_manager.cc:5697] T d354c94548fc411ab62b4281ed947944 P dbc2c92e49e346b5b3bd7705a229afc6 reported cstate change: term changed from 2 to 3, leader changed from 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66) to dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65). New cstate: current_term: 3 leader_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } health_report { overall_health: UNKNOWN } } }
I20260709 14:54:47.694283 15182 raft_consensus.cc:1275] T 91c9f89fcb8b45ff9be43f535cafffde P eaa34beb1b274443b1c46839afd0a484 [term 5 FOLLOWER]: Refusing update from remote peer dbc2c92e49e346b5b3bd7705a229afc6: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 14:54:47.697319 16281 consensus_queue.cc:1048] T 91c9f89fcb8b45ff9be43f535cafffde P dbc2c92e49e346b5b3bd7705a229afc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 14:54:47.726172 15111 raft_consensus.cc:1275] T 91c9f89fcb8b45ff9be43f535cafffde P 7519e608fbb44d9db8ad30b9f10ae605 [term 5 FOLLOWER]: Refusing update from remote peer dbc2c92e49e346b5b3bd7705a229afc6: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 14:54:47.727880 16316 consensus_queue.cc:1048] T 91c9f89fcb8b45ff9be43f535cafffde P dbc2c92e49e346b5b3bd7705a229afc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 14:54:47.907596 15183 raft_consensus.cc:1275] T d86dfc13b2834d7e8b2ad5f975f08154 P eaa34beb1b274443b1c46839afd0a484 [term 3 FOLLOWER]: Refusing update from remote peer dbc2c92e49e346b5b3bd7705a229afc6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 14:54:47.910251 16313 consensus_queue.cc:1048] T d86dfc13b2834d7e8b2ad5f975f08154 P dbc2c92e49e346b5b3bd7705a229afc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 14:54:47.938980 15255 raft_consensus.cc:1275] T d86dfc13b2834d7e8b2ad5f975f08154 P 9cb8de0701f2482b99e51d5ac080aa13 [term 3 FOLLOWER]: Refusing update from remote peer dbc2c92e49e346b5b3bd7705a229afc6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 14:54:47.941123 16313 consensus_queue.cc:1048] T d86dfc13b2834d7e8b2ad5f975f08154 P dbc2c92e49e346b5b3bd7705a229afc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 14:54:48.049782 15107 raft_consensus.cc:1275] T a1075567fc91458ca7cc9977cf02b170 P 7519e608fbb44d9db8ad30b9f10ae605 [term 2 FOLLOWER]: Refusing update from remote peer dbc2c92e49e346b5b3bd7705a229afc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:54:48.051919 16313 consensus_queue.cc:1048] T a1075567fc91458ca7cc9977cf02b170 P dbc2c92e49e346b5b3bd7705a229afc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 14:54:48.066040 15255 raft_consensus.cc:1275] T a1075567fc91458ca7cc9977cf02b170 P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 FOLLOWER]: Refusing update from remote peer dbc2c92e49e346b5b3bd7705a229afc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:54:48.068768 16316 consensus_queue.cc:1048] T a1075567fc91458ca7cc9977cf02b170 P dbc2c92e49e346b5b3bd7705a229afc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 14:54:48.094509  6549 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 14:54:48.108383 15107 raft_consensus.cc:1275] T d354c94548fc411ab62b4281ed947944 P 7519e608fbb44d9db8ad30b9f10ae605 [term 3 FOLLOWER]: Refusing update from remote peer dbc2c92e49e346b5b3bd7705a229afc6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 14:54:48.110944 16316 consensus_queue.cc:1048] T d354c94548fc411ab62b4281ed947944 P dbc2c92e49e346b5b3bd7705a229afc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 14:54:48.141367 15183 raft_consensus.cc:1275] T d354c94548fc411ab62b4281ed947944 P eaa34beb1b274443b1c46839afd0a484 [term 3 FOLLOWER]: Refusing update from remote peer dbc2c92e49e346b5b3bd7705a229afc6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 14:54:48.143024 16281 consensus_queue.cc:1048] T d354c94548fc411ab62b4281ed947944 P dbc2c92e49e346b5b3bd7705a229afc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 14:54:48.176015  6549 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 14:54:48.237623 15183 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3b4c50fac37a43c0988d5ea911d09f43"
dest_uuid: "eaa34beb1b274443b1c46839afd0a484"
mode: GRACEFUL
new_leader_uuid: "dbc2c92e49e346b5b3bd7705a229afc6"
 from {username='slave'} at 127.0.0.1:44288
I20260709 14:54:48.238561 15183 raft_consensus.cc:606] T 3b4c50fac37a43c0988d5ea911d09f43 P eaa34beb1b274443b1c46839afd0a484 [term 1 LEADER]: Received request to transfer leadership to TS dbc2c92e49e346b5b3bd7705a229afc6
I20260709 14:54:48.243461 15105 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "db39b7ffe995451885f4074ddf16028d"
dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605"
mode: GRACEFUL
new_leader_uuid: "dbc2c92e49e346b5b3bd7705a229afc6"
 from {username='slave'} at 127.0.0.1:50244
I20260709 14:54:48.244067 15105 raft_consensus.cc:606] T db39b7ffe995451885f4074ddf16028d P 7519e608fbb44d9db8ad30b9f10ae605 [term 2 LEADER]: Received request to transfer leadership to TS dbc2c92e49e346b5b3bd7705a229afc6
I20260709 14:54:48.245667  6549 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 14:54:48.248051  6549 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 14:54:48.307874 16305 raft_consensus.cc:993] T 3b4c50fac37a43c0988d5ea911d09f43 P eaa34beb1b274443b1c46839afd0a484: : Instructing follower dbc2c92e49e346b5b3bd7705a229afc6 to start an election
I20260709 14:54:48.308647 16308 raft_consensus.cc:1081] T 3b4c50fac37a43c0988d5ea911d09f43 P eaa34beb1b274443b1c46839afd0a484 [term 1 LEADER]: Signalling peer dbc2c92e49e346b5b3bd7705a229afc6 to start an election
I20260709 14:54:48.310801 16099 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3b4c50fac37a43c0988d5ea911d09f43"
dest_uuid: "dbc2c92e49e346b5b3bd7705a229afc6"
 from {username='slave'} at 127.0.0.1:39038
I20260709 14:54:48.311425 16099 raft_consensus.cc:493] T 3b4c50fac37a43c0988d5ea911d09f43 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:54:48.311987 16099 raft_consensus.cc:3060] T 3b4c50fac37a43c0988d5ea911d09f43 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:54:48.319865 16099 raft_consensus.cc:515] T 3b4c50fac37a43c0988d5ea911d09f43 P dbc2c92e49e346b5b3bd7705a229afc6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:48.322630 15183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4c50fac37a43c0988d5ea911d09f43" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eaa34beb1b274443b1c46839afd0a484"
I20260709 14:54:48.323519 15183 raft_consensus.cc:3055] T 3b4c50fac37a43c0988d5ea911d09f43 P eaa34beb1b274443b1c46839afd0a484 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 14:54:48.323689 15260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4c50fac37a43c0988d5ea911d09f43" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13"
I20260709 14:54:48.323704 16099 leader_election.cc:290] T 3b4c50fac37a43c0988d5ea911d09f43 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 2 election: Requested vote from peers eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805), 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493)
I20260709 14:54:48.323899 15183 raft_consensus.cc:740] T 3b4c50fac37a43c0988d5ea911d09f43 P eaa34beb1b274443b1c46839afd0a484 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: eaa34beb1b274443b1c46839afd0a484, State: Running, Role: LEADER
I20260709 14:54:48.324496 15260 raft_consensus.cc:3060] T 3b4c50fac37a43c0988d5ea911d09f43 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:54:48.325289 15183 consensus_queue.cc:260] T 3b4c50fac37a43c0988d5ea911d09f43 P eaa34beb1b274443b1c46839afd0a484 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:48.327163 15183 raft_consensus.cc:3060] T 3b4c50fac37a43c0988d5ea911d09f43 P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:54:48.333671 15260 raft_consensus.cc:2468] T 3b4c50fac37a43c0988d5ea911d09f43 P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbc2c92e49e346b5b3bd7705a229afc6 in term 2.
I20260709 14:54:48.335819 15183 raft_consensus.cc:2468] T 3b4c50fac37a43c0988d5ea911d09f43 P eaa34beb1b274443b1c46839afd0a484 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbc2c92e49e346b5b3bd7705a229afc6 in term 2.
I20260709 14:54:48.335785 15957 leader_election.cc:304] T 3b4c50fac37a43c0988d5ea911d09f43 P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cb8de0701f2482b99e51d5ac080aa13, dbc2c92e49e346b5b3bd7705a229afc6; no voters: 
I20260709 14:54:48.337497 16316 raft_consensus.cc:2804] T 3b4c50fac37a43c0988d5ea911d09f43 P dbc2c92e49e346b5b3bd7705a229afc6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:54:48.338055 16316 raft_consensus.cc:697] T 3b4c50fac37a43c0988d5ea911d09f43 P dbc2c92e49e346b5b3bd7705a229afc6 [term 2 LEADER]: Becoming Leader. State: Replica: dbc2c92e49e346b5b3bd7705a229afc6, State: Running, Role: LEADER
I20260709 14:54:48.339035 16316 consensus_queue.cc:237] T 3b4c50fac37a43c0988d5ea911d09f43 P dbc2c92e49e346b5b3bd7705a229afc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:48.352610 14935 catalog_manager.cc:5697] T 3b4c50fac37a43c0988d5ea911d09f43 P dbc2c92e49e346b5b3bd7705a229afc6 reported cstate change: term changed from 1 to 2, leader changed from eaa34beb1b274443b1c46839afd0a484 (127.6.101.67) to dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65). New cstate: current_term: 2 leader_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } health_report { overall_health: HEALTHY } } }
I20260709 14:54:48.474633 16296 raft_consensus.cc:993] T db39b7ffe995451885f4074ddf16028d P 7519e608fbb44d9db8ad30b9f10ae605: : Instructing follower dbc2c92e49e346b5b3bd7705a229afc6 to start an election
I20260709 14:54:48.475512 16349 raft_consensus.cc:1081] T db39b7ffe995451885f4074ddf16028d P 7519e608fbb44d9db8ad30b9f10ae605 [term 2 LEADER]: Signalling peer dbc2c92e49e346b5b3bd7705a229afc6 to start an election
I20260709 14:54:48.477610 16103 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "db39b7ffe995451885f4074ddf16028d"
dest_uuid: "dbc2c92e49e346b5b3bd7705a229afc6"
 from {username='slave'} at 127.0.0.1:39024
I20260709 14:54:48.478276 16103 raft_consensus.cc:493] T db39b7ffe995451885f4074ddf16028d P dbc2c92e49e346b5b3bd7705a229afc6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:54:48.479031 16103 raft_consensus.cc:3060] T db39b7ffe995451885f4074ddf16028d P dbc2c92e49e346b5b3bd7705a229afc6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:54:48.487689 16103 raft_consensus.cc:515] T db39b7ffe995451885f4074ddf16028d P dbc2c92e49e346b5b3bd7705a229afc6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:48.492592 16103 leader_election.cc:290] T db39b7ffe995451885f4074ddf16028d P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 3 election: Requested vote from peers 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177), eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805)
I20260709 14:54:48.492874 15107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db39b7ffe995451885f4074ddf16028d" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7519e608fbb44d9db8ad30b9f10ae605"
I20260709 14:54:48.493646 15107 raft_consensus.cc:3055] T db39b7ffe995451885f4074ddf16028d P 7519e608fbb44d9db8ad30b9f10ae605 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 14:54:48.493990 15107 raft_consensus.cc:740] T db39b7ffe995451885f4074ddf16028d P 7519e608fbb44d9db8ad30b9f10ae605 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7519e608fbb44d9db8ad30b9f10ae605, State: Running, Role: LEADER
I20260709 14:54:48.494781 15107 consensus_queue.cc:260] T db39b7ffe995451885f4074ddf16028d P 7519e608fbb44d9db8ad30b9f10ae605 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:48.495929 15107 raft_consensus.cc:3060] T db39b7ffe995451885f4074ddf16028d P 7519e608fbb44d9db8ad30b9f10ae605 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:54:48.497871 15183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db39b7ffe995451885f4074ddf16028d" candidate_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "eaa34beb1b274443b1c46839afd0a484"
I20260709 14:54:48.498623 15183 raft_consensus.cc:3060] T db39b7ffe995451885f4074ddf16028d P eaa34beb1b274443b1c46839afd0a484 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:54:48.504797 15107 raft_consensus.cc:2468] T db39b7ffe995451885f4074ddf16028d P 7519e608fbb44d9db8ad30b9f10ae605 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbc2c92e49e346b5b3bd7705a229afc6 in term 3.
I20260709 14:54:48.506800 15957 leader_election.cc:304] T db39b7ffe995451885f4074ddf16028d P dbc2c92e49e346b5b3bd7705a229afc6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7519e608fbb44d9db8ad30b9f10ae605, dbc2c92e49e346b5b3bd7705a229afc6; no voters: 
I20260709 14:54:48.507897 16281 raft_consensus.cc:2804] T db39b7ffe995451885f4074ddf16028d P dbc2c92e49e346b5b3bd7705a229afc6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 14:54:48.508567 16281 raft_consensus.cc:697] T db39b7ffe995451885f4074ddf16028d P dbc2c92e49e346b5b3bd7705a229afc6 [term 3 LEADER]: Becoming Leader. State: Replica: dbc2c92e49e346b5b3bd7705a229afc6, State: Running, Role: LEADER
I20260709 14:54:48.509460 15183 raft_consensus.cc:2468] T db39b7ffe995451885f4074ddf16028d P eaa34beb1b274443b1c46839afd0a484 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbc2c92e49e346b5b3bd7705a229afc6 in term 3.
I20260709 14:54:48.509987 16281 consensus_queue.cc:237] T db39b7ffe995451885f4074ddf16028d P dbc2c92e49e346b5b3bd7705a229afc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
I20260709 14:54:48.522970 14935 catalog_manager.cc:5697] T db39b7ffe995451885f4074ddf16028d P dbc2c92e49e346b5b3bd7705a229afc6 reported cstate change: term changed from 2 to 3, leader changed from 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66) to dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65). New cstate: current_term: 3 leader_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } health_report { overall_health: UNKNOWN } } }
I20260709 14:54:48.783862 15183 raft_consensus.cc:1275] T 3b4c50fac37a43c0988d5ea911d09f43 P eaa34beb1b274443b1c46839afd0a484 [term 2 FOLLOWER]: Refusing update from remote peer dbc2c92e49e346b5b3bd7705a229afc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:54:48.785609 16281 consensus_queue.cc:1048] T 3b4c50fac37a43c0988d5ea911d09f43 P dbc2c92e49e346b5b3bd7705a229afc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 14:54:48.804690 15260 raft_consensus.cc:1275] T 3b4c50fac37a43c0988d5ea911d09f43 P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 FOLLOWER]: Refusing update from remote peer dbc2c92e49e346b5b3bd7705a229afc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:54:48.806875 16281 consensus_queue.cc:1048] T 3b4c50fac37a43c0988d5ea911d09f43 P dbc2c92e49e346b5b3bd7705a229afc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 14:54:48.989380 15182 raft_consensus.cc:1275] T db39b7ffe995451885f4074ddf16028d P eaa34beb1b274443b1c46839afd0a484 [term 3 FOLLOWER]: Refusing update from remote peer dbc2c92e49e346b5b3bd7705a229afc6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 14:54:48.992440 16281 consensus_queue.cc:1048] T db39b7ffe995451885f4074ddf16028d P dbc2c92e49e346b5b3bd7705a229afc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 14:54:49.007351 15105 raft_consensus.cc:1275] T db39b7ffe995451885f4074ddf16028d P 7519e608fbb44d9db8ad30b9f10ae605 [term 3 FOLLOWER]: Refusing update from remote peer dbc2c92e49e346b5b3bd7705a229afc6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 14:54:49.010000 16396 consensus_queue.cc:1048] T db39b7ffe995451885f4074ddf16028d P dbc2c92e49e346b5b3bd7705a229afc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 14:54:49.249215  6549 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 14:54:49.306316  6549 tablet_server.cc:179] TabletServer@127.6.101.65:45477 shutting down...
W20260709 14:54:49.322849 15227 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 36 similar messages]
W20260709 14:54:49.332571 15227 consensus_peers.cc:597] T c61864fa2cd249d683f8fb90d8542480 P 9cb8de0701f2482b99e51d5ac080aa13 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 14:54:49.334544 15227 consensus_peers.cc:597] T d2273a1ad13e4c54ae2101a15a7e56e1 P 9cb8de0701f2482b99e51d5ac080aa13 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 14:54:49.353543 15153 consensus_peers.cc:597] T 98280a706ec54413830f342b48666f6e P eaa34beb1b274443b1c46839afd0a484 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 14:54:49.368953 15153 consensus_peers.cc:597] T d178b88fdab54a29b05fb98e05ffe8c5 P eaa34beb1b274443b1c46839afd0a484 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:54:49.383375  6549 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 14:54:49.385104  6549 tablet_replica.cc:333] stopping tablet replica
I20260709 14:54:49.387048  6549 raft_consensus.cc:2243] T 263098160f604ae3aa31782c37e2fd52 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:49.387769  6549 raft_consensus.cc:2272] T 263098160f604ae3aa31782c37e2fd52 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:49.392596  6549 tablet_replica.cc:333] stopping tablet replica
I20260709 14:54:49.393887  6549 raft_consensus.cc:2243] T 5585b0f6bbf04c10865d2463767621dc P dbc2c92e49e346b5b3bd7705a229afc6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 14:54:49.395071  6549 raft_consensus.cc:2272] T 5585b0f6bbf04c10865d2463767621dc P dbc2c92e49e346b5b3bd7705a229afc6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:49.401049  6549 tablet_replica.cc:333] stopping tablet replica
I20260709 14:54:49.402196  6549 raft_consensus.cc:2243] T 798d0882b1ea4b26b598c236de8f18c9 P dbc2c92e49e346b5b3bd7705a229afc6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:49.402873  6549 raft_consensus.cc:2272] T 798d0882b1ea4b26b598c236de8f18c9 P dbc2c92e49e346b5b3bd7705a229afc6 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 14:54:49.404891 15227 consensus_peers.cc:597] T 4f709a060be148029cf72f1af6f79714 P 9cb8de0701f2482b99e51d5ac080aa13 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:54:49.407351  6549 tablet_replica.cc:333] stopping tablet replica
I20260709 14:54:49.408236  6549 raft_consensus.cc:2243] T d178b88fdab54a29b05fb98e05ffe8c5 P dbc2c92e49e346b5b3bd7705a229afc6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:49.408716  6549 raft_consensus.cc:2272] T d178b88fdab54a29b05fb98e05ffe8c5 P dbc2c92e49e346b5b3bd7705a229afc6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:49.411299  6549 tablet_replica.cc:333] stopping tablet replica
I20260709 14:54:49.412361  6549 raft_consensus.cc:2243] T dd44b332dc744f94a5f7cfffc06f3956 P dbc2c92e49e346b5b3bd7705a229afc6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 14:54:49.413698  6549 raft_consensus.cc:2272] T dd44b332dc744f94a5f7cfffc06f3956 P dbc2c92e49e346b5b3bd7705a229afc6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:49.416038  6549 tablet_replica.cc:333] stopping tablet replica
I20260709 14:54:49.417564  6549 raft_consensus.cc:2243] T 054739df584d4b9db840777c2ae17555 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:49.418118  6549 raft_consensus.cc:2272] T 054739df584d4b9db840777c2ae17555 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:49.423326  6549 tablet_replica.cc:333] stopping tablet replica
I20260709 14:54:49.424324  6549 raft_consensus.cc:2243] T a1075567fc91458ca7cc9977cf02b170 P dbc2c92e49e346b5b3bd7705a229afc6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 14:54:49.425441  6549 raft_consensus.cc:2272] T a1075567fc91458ca7cc9977cf02b170 P dbc2c92e49e346b5b3bd7705a229afc6 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 14:54:49.426476 15153 consensus_peers.cc:597] T 5b9f8063585c4e5faddebd56fbe1aa01 P eaa34beb1b274443b1c46839afd0a484 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:54:49.428432  6549 tablet_replica.cc:333] stopping tablet replica
I20260709 14:54:49.429203  6549 raft_consensus.cc:2243] T 9275d24f141d455cb200b9784c470d33 P dbc2c92e49e346b5b3bd7705a229afc6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:49.429750  6549 raft_consensus.cc:2272] T 9275d24f141d455cb200b9784c470d33 P dbc2c92e49e346b5b3bd7705a229afc6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:49.431965  6549 tablet_replica.cc:333] stopping tablet replica
I20260709 14:54:49.432826  6549 raft_consensus.cc:2243] T b7c363a305d3434092ef6016b7064eb3 P dbc2c92e49e346b5b3bd7705a229afc6 [term 3 LEADER]: Raft consensus shutting down.
I20260709 14:54:49.434110  6549 raft_consensus.cc:2272] T b7c363a305d3434092ef6016b7064eb3 P dbc2c92e49e346b5b3bd7705a229afc6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:49.436513  6549 tablet_replica.cc:333] stopping tablet replica
I20260709 14:54:49.437340  6549 raft_consensus.cc:2243] T 98280a706ec54413830f342b48666f6e P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:49.437830  6549 raft_consensus.cc:2272] T 98280a706ec54413830f342b48666f6e P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:49.440382  6549 tablet_replica.cc:333] stopping tablet replica
I20260709 14:54:49.441711  6549 raft_consensus.cc:2243] T 4f709a060be148029cf72f1af6f79714 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:49.442406  6549 raft_consensus.cc:2272] T 4f709a060be148029cf72f1af6f79714 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:49.445461  6549 tablet_replica.cc:333] stopping tablet replica
I20260709 14:54:49.446632  6549 raft_consensus.cc:2243] T d6bcaee371174feaa06943f949efda49 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:49.447867  6549 raft_consensus.cc:2272] T d6bcaee371174feaa06943f949efda49 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:49.452376  6549 tablet_replica.cc:333] stopping tablet replica
I20260709 14:54:49.453426  6549 raft_consensus.cc:2243] T 5f5dbc86fc8f4ae5b77e0f23adfcd593 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:49.453894  6549 raft_consensus.cc:2272] T 5f5dbc86fc8f4ae5b77e0f23adfcd593 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 14:54:49.455873 15153 consensus_peers.cc:597] T 594083b10772433f90560d387bbbeabe P eaa34beb1b274443b1c46839afd0a484 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:54:49.456717  6549 tablet_replica.cc:333] stopping tablet replica
I20260709 14:54:49.457698  6549 raft_consensus.cc:2243] T f706543d4d3e4e7291624a785ca4e747 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:49.458480  6549 raft_consensus.cc:2272] T f706543d4d3e4e7291624a785ca4e747 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:49.462375  6549 tablet_replica.cc:333] stopping tablet replica
I20260709 14:54:49.463362  6549 raft_consensus.cc:2243] T d2273a1ad13e4c54ae2101a15a7e56e1 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:49.464164  6549 raft_consensus.cc:2272] T d2273a1ad13e4c54ae2101a15a7e56e1 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 14:54:49.465104 15153 consensus_peers.cc:597] T 9f90ac0a3b004f6ca430ff2fc5198678 P eaa34beb1b274443b1c46839afd0a484 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:54:49.467612  6549 tablet_replica.cc:333] stopping tablet replica
I20260709 14:54:49.468444  6549 raft_consensus.cc:2243] T 46a35b81512c4e8c8ec6b83d4c768e1f P dbc2c92e49e346b5b3bd7705a229afc6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:49.469002  6549 raft_consensus.cc:2272] T 46a35b81512c4e8c8ec6b83d4c768e1f P dbc2c92e49e346b5b3bd7705a229afc6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:49.471517  6549 tablet_replica.cc:333] stopping tablet replica
I20260709 14:54:49.472167  6549 raft_consensus.cc:2243] T 91c9f89fcb8b45ff9be43f535cafffde P dbc2c92e49e346b5b3bd7705a229afc6 [term 5 LEADER]: Raft consensus shutting down.
I20260709 14:54:49.473021  6549 raft_consensus.cc:2272] T 91c9f89fcb8b45ff9be43f535cafffde P dbc2c92e49e346b5b3bd7705a229afc6 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:49.476882  6549 tablet_replica.cc:333] stopping tablet replica
I20260709 14:54:49.477766  6549 raft_consensus.cc:2243] T d61f9ecebc3c4a028f5327bc9debf432 P dbc2c92e49e346b5b3bd7705a229afc6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:49.478492  6549 raft_consensus.cc:2272] T d61f9ecebc3c4a028f5327bc9debf432 P dbc2c92e49e346b5b3bd7705a229afc6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:49.482718  6549 tablet_replica.cc:333] stopping tablet replica
I20260709 14:54:49.483700  6549 raft_consensus.cc:2243] T 966a06ab56a6479283ab2818c9439d4f P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:49.484315  6549 raft_consensus.cc:2272] T 966a06ab56a6479283ab2818c9439d4f P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 14:54:49.484735 15227 consensus_peers.cc:597] T 46a35b81512c4e8c8ec6b83d4c768e1f P 9cb8de0701f2482b99e51d5ac080aa13 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:54:49.487462  6549 tablet_replica.cc:333] stopping tablet replica
I20260709 14:54:49.488283  6549 raft_consensus.cc:2243] T cc6f522768894933b21bc94b41605166 P dbc2c92e49e346b5b3bd7705a229afc6 [term 3 LEADER]: Raft consensus shutting down.
I20260709 14:54:49.489192  6549 raft_consensus.cc:2272] T cc6f522768894933b21bc94b41605166 P dbc2c92e49e346b5b3bd7705a229afc6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:49.491971  6549 tablet_replica.cc:333] stopping tablet replica
I20260709 14:54:49.492817  6549 raft_consensus.cc:2243] T a9dab1878c4b4550880f5680c6d48c67 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:49.493474  6549 raft_consensus.cc:2272] T a9dab1878c4b4550880f5680c6d48c67 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:49.496196  6549 tablet_replica.cc:333] stopping tablet replica
I20260709 14:54:49.496903  6549 raft_consensus.cc:2243] T 42d6909533d14edbbfdad30a9972658d P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:49.497552  6549 raft_consensus.cc:2272] T 42d6909533d14edbbfdad30a9972658d P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:49.500650  6549 tablet_replica.cc:333] stopping tablet replica
I20260709 14:54:49.501922  6549 raft_consensus.cc:2243] T d326f264e68d41d69b5007023083ed9e P dbc2c92e49e346b5b3bd7705a229afc6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:49.503050  6549 raft_consensus.cc:2272] T d326f264e68d41d69b5007023083ed9e P dbc2c92e49e346b5b3bd7705a229afc6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:49.510444  6549 tablet_replica.cc:333] stopping tablet replica
I20260709 14:54:49.511400  6549 raft_consensus.cc:2243] T 70bc59fabcdc4359a84d584f36d18d01 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:49.511994  6549 raft_consensus.cc:2272] T 70bc59fabcdc4359a84d584f36d18d01 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:49.515415  6549 tablet_replica.cc:333] stopping tablet replica
I20260709 14:54:49.516384  6549 raft_consensus.cc:2243] T d2c4ea1c33c64cd09ba04611fdbdc59d P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:49.516916  6549 raft_consensus.cc:2272] T d2c4ea1c33c64cd09ba04611fdbdc59d P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:49.519523  6549 tablet_replica.cc:333] stopping tablet replica
I20260709 14:54:49.520390  6549 raft_consensus.cc:2243] T 594083b10772433f90560d387bbbeabe P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:49.520884  6549 raft_consensus.cc:2272] T 594083b10772433f90560d387bbbeabe P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:49.527220  6549 tablet_replica.cc:333] stopping tablet replica
I20260709 14:54:49.528151  6549 raft_consensus.cc:2243] T d86dfc13b2834d7e8b2ad5f975f08154 P dbc2c92e49e346b5b3bd7705a229afc6 [term 3 LEADER]: Raft consensus shutting down.
I20260709 14:54:49.529615  6549 raft_consensus.cc:2272] T d86dfc13b2834d7e8b2ad5f975f08154 P dbc2c92e49e346b5b3bd7705a229afc6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:49.534538  6549 tablet_replica.cc:333] stopping tablet replica
W20260709 14:54:49.534511 15079 consensus_peers.cc:597] T d326f264e68d41d69b5007023083ed9e P 7519e608fbb44d9db8ad30b9f10ae605 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:54:49.541165  6549 raft_consensus.cc:2243] T 8974e5ab032b4fba92bfc577280778bf P dbc2c92e49e346b5b3bd7705a229afc6 [term 3 LEADER]: Raft consensus shutting down.
I20260709 14:54:49.542629  6549 raft_consensus.cc:2272] T 8974e5ab032b4fba92bfc577280778bf P dbc2c92e49e346b5b3bd7705a229afc6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:49.547422  6549 tablet_replica.cc:333] stopping tablet replica
I20260709 14:54:49.548681  6549 raft_consensus.cc:2243] T 46ebd2bd84cc46e08c82a7b893e54578 P dbc2c92e49e346b5b3bd7705a229afc6 [term 3 LEADER]: Raft consensus shutting down.
I20260709 14:54:49.550088  6549 raft_consensus.cc:2272] T 46ebd2bd84cc46e08c82a7b893e54578 P dbc2c92e49e346b5b3bd7705a229afc6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:49.556519  6549 tablet_replica.cc:333] stopping tablet replica
W20260709 14:54:49.557570 15227 consensus_peers.cc:597] T 0284d9835221427ab285015d48a8040d P 9cb8de0701f2482b99e51d5ac080aa13 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:54:49.557662  6549 raft_consensus.cc:2243] T 5e8a01e27eab492bb73df3359e500627 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:49.560946  6549 raft_consensus.cc:2272] T 5e8a01e27eab492bb73df3359e500627 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:49.566864  6549 tablet_replica.cc:333] stopping tablet replica
W20260709 14:54:49.567775 15227 consensus_peers.cc:597] T d2c4ea1c33c64cd09ba04611fdbdc59d P 9cb8de0701f2482b99e51d5ac080aa13 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:54:49.568107  6549 raft_consensus.cc:2243] T 8bae8108fe2a4ce0ba3e35746c7ec9d1 P dbc2c92e49e346b5b3bd7705a229afc6 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 14:54:49.568187 15079 consensus_peers.cc:597] T 966a06ab56a6479283ab2818c9439d4f P 7519e608fbb44d9db8ad30b9f10ae605 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:54:49.569635  6549 raft_consensus.cc:2272] T 8bae8108fe2a4ce0ba3e35746c7ec9d1 P dbc2c92e49e346b5b3bd7705a229afc6 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 14:54:49.572578 15079 consensus_peers.cc:597] T 70bc59fabcdc4359a84d584f36d18d01 P 7519e608fbb44d9db8ad30b9f10ae605 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:54:49.573123  6549 tablet_replica.cc:333] stopping tablet replica
I20260709 14:54:49.574105  6549 raft_consensus.cc:2243] T 0284d9835221427ab285015d48a8040d P dbc2c92e49e346b5b3bd7705a229afc6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:49.574831  6549 raft_consensus.cc:2272] T 0284d9835221427ab285015d48a8040d P dbc2c92e49e346b5b3bd7705a229afc6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:49.578850  6549 tablet_replica.cc:333] stopping tablet replica
I20260709 14:54:49.579818  6549 raft_consensus.cc:2243] T 1159198eabeb409996ccbec0cac057f8 P dbc2c92e49e346b5b3bd7705a229afc6 [term 2 LEADER]: Raft consensus shutting down.
W20260709 14:54:49.579869 15079 consensus_peers.cc:597] T 8bae8108fe2a4ce0ba3e35746c7ec9d1 P 7519e608fbb44d9db8ad30b9f10ae605 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:54:49.581107  6549 raft_consensus.cc:2272] T 1159198eabeb409996ccbec0cac057f8 P dbc2c92e49e346b5b3bd7705a229afc6 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 14:54:49.585855 15153 consensus_peers.cc:597] T 7f2cd7c8159d43c080fd8302180ecfca P eaa34beb1b274443b1c46839afd0a484 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:54:49.586236  6549 tablet_replica.cc:333] stopping tablet replica
I20260709 14:54:49.587530  6549 raft_consensus.cc:2243] T 7699ad132e12472180b6a9527951c397 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:49.588238  6549 raft_consensus.cc:2272] T 7699ad132e12472180b6a9527951c397 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:49.592154  6549 tablet_replica.cc:333] stopping tablet replica
I20260709 14:54:49.593313  6549 raft_consensus.cc:2243] T c61864fa2cd249d683f8fb90d8542480 P dbc2c92e49e346b5b3bd7705a229afc6 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 14:54:49.593964 15227 consensus_peers.cc:597] T 7699ad132e12472180b6a9527951c397 P 9cb8de0701f2482b99e51d5ac080aa13 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:54:49.593986  6549 raft_consensus.cc:2272] T c61864fa2cd249d683f8fb90d8542480 P dbc2c92e49e346b5b3bd7705a229afc6 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 14:54:49.596935 15153 consensus_peers.cc:597] T 4abdbdda3ce149a9904e919be18e7a3f P eaa34beb1b274443b1c46839afd0a484 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:54:49.598430  6549 tablet_replica.cc:333] stopping tablet replica
I20260709 14:54:49.599470  6549 raft_consensus.cc:2243] T bdf08eed05854470954a5e9dd17dfb27 P dbc2c92e49e346b5b3bd7705a229afc6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 14:54:49.600634  6549 raft_consensus.cc:2272] T bdf08eed05854470954a5e9dd17dfb27 P dbc2c92e49e346b5b3bd7705a229afc6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:49.604346  6549 tablet_replica.cc:333] stopping tablet replica
I20260709 14:54:49.605114  6549 raft_consensus.cc:2243] T 9f90ac0a3b004f6ca430ff2fc5198678 P dbc2c92e49e346b5b3bd7705a229afc6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:49.605649  6549 raft_consensus.cc:2272] T 9f90ac0a3b004f6ca430ff2fc5198678 P dbc2c92e49e346b5b3bd7705a229afc6 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 14:54:49.607456 15153 consensus_peers.cc:597] T 263098160f604ae3aa31782c37e2fd52 P eaa34beb1b274443b1c46839afd0a484 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:54:49.609761  6549 tablet_replica.cc:333] stopping tablet replica
I20260709 14:54:49.610771  6549 raft_consensus.cc:2243] T d2463fd792b240e9911c6b38bcb453b8 P dbc2c92e49e346b5b3bd7705a229afc6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:49.611362  6549 raft_consensus.cc:2272] T d2463fd792b240e9911c6b38bcb453b8 P dbc2c92e49e346b5b3bd7705a229afc6 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 14:54:49.612337 15153 consensus_peers.cc:597] T 5f5dbc86fc8f4ae5b77e0f23adfcd593 P eaa34beb1b274443b1c46839afd0a484 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:54:49.614135  6549 tablet_replica.cc:333] stopping tablet replica
I20260709 14:54:49.614897  6549 raft_consensus.cc:2243] T db39b7ffe995451885f4074ddf16028d P dbc2c92e49e346b5b3bd7705a229afc6 [term 3 LEADER]: Raft consensus shutting down.
I20260709 14:54:49.615849  6549 raft_consensus.cc:2272] T db39b7ffe995451885f4074ddf16028d P dbc2c92e49e346b5b3bd7705a229afc6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:49.619185  6549 tablet_replica.cc:333] stopping tablet replica
I20260709 14:54:49.619920  6549 raft_consensus.cc:2243] T d354c94548fc411ab62b4281ed947944 P dbc2c92e49e346b5b3bd7705a229afc6 [term 3 LEADER]: Raft consensus shutting down.
I20260709 14:54:49.621078  6549 raft_consensus.cc:2272] T d354c94548fc411ab62b4281ed947944 P dbc2c92e49e346b5b3bd7705a229afc6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:49.624536  6549 tablet_replica.cc:333] stopping tablet replica
I20260709 14:54:49.625531  6549 raft_consensus.cc:2243] T 3b4c50fac37a43c0988d5ea911d09f43 P dbc2c92e49e346b5b3bd7705a229afc6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 14:54:49.626791  6549 raft_consensus.cc:2272] T 3b4c50fac37a43c0988d5ea911d09f43 P dbc2c92e49e346b5b3bd7705a229afc6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:49.630460  6549 tablet_replica.cc:333] stopping tablet replica
I20260709 14:54:49.631358  6549 raft_consensus.cc:2243] T f389b12c6b304243905f28267dfaeed0 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:49.631930  6549 raft_consensus.cc:2272] T f389b12c6b304243905f28267dfaeed0 P dbc2c92e49e346b5b3bd7705a229afc6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:49.634989  6549 tablet_replica.cc:333] stopping tablet replica
I20260709 14:54:49.635589  6549 raft_consensus.cc:2243] T 7f2cd7c8159d43c080fd8302180ecfca P dbc2c92e49e346b5b3bd7705a229afc6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:49.636106  6549 raft_consensus.cc:2272] T 7f2cd7c8159d43c080fd8302180ecfca P dbc2c92e49e346b5b3bd7705a229afc6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:49.639089  6549 tablet_replica.cc:333] stopping tablet replica
I20260709 14:54:49.639765  6549 raft_consensus.cc:2243] T 5b9f8063585c4e5faddebd56fbe1aa01 P dbc2c92e49e346b5b3bd7705a229afc6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:49.640399  6549 raft_consensus.cc:2272] T 5b9f8063585c4e5faddebd56fbe1aa01 P dbc2c92e49e346b5b3bd7705a229afc6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:49.643263  6549 tablet_replica.cc:333] stopping tablet replica
I20260709 14:54:49.644016  6549 raft_consensus.cc:2243] T 4abdbdda3ce149a9904e919be18e7a3f P dbc2c92e49e346b5b3bd7705a229afc6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:49.644665  6549 raft_consensus.cc:2272] T 4abdbdda3ce149a9904e919be18e7a3f P dbc2c92e49e346b5b3bd7705a229afc6 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 14:54:49.668288 15079 consensus_peers.cc:597] T f706543d4d3e4e7291624a785ca4e747 P 7519e608fbb44d9db8ad30b9f10ae605 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 14:54:49.676086 15079 consensus_peers.cc:597] T d61f9ecebc3c4a028f5327bc9debf432 P 7519e608fbb44d9db8ad30b9f10ae605 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 14:54:49.701119 15227 consensus_peers.cc:597] T d2463fd792b240e9911c6b38bcb453b8 P 9cb8de0701f2482b99e51d5ac080aa13 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 14:54:49.709184 15153 consensus_peers.cc:597] T 42d6909533d14edbbfdad30a9972658d P eaa34beb1b274443b1c46839afd0a484 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 14:54:49.713907 15153 consensus_peers.cc:597] T a9dab1878c4b4550880f5680c6d48c67 P eaa34beb1b274443b1c46839afd0a484 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 14:54:49.719148 15079 consensus_peers.cc:597] T 798d0882b1ea4b26b598c236de8f18c9 P 7519e608fbb44d9db8ad30b9f10ae605 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 14:54:49.735587 15079 consensus_peers.cc:597] T 054739df584d4b9db840777c2ae17555 P 7519e608fbb44d9db8ad30b9f10ae605 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:54:49.756222  6549 tablet_server.cc:196] TabletServer@127.6.101.65:45477 shutdown complete.
W20260709 14:54:49.810040 15153 consensus_peers.cc:597] T 5e8a01e27eab492bb73df3359e500627 P eaa34beb1b274443b1c46839afd0a484 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 14:54:49.810825 15153 consensus_peers.cc:597] T d6bcaee371174feaa06943f949efda49 P eaa34beb1b274443b1c46839afd0a484 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 14:54:49.812933 15227 consensus_peers.cc:597] T 9275d24f141d455cb200b9784c470d33 P 9cb8de0701f2482b99e51d5ac080aa13 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 14:54:49.817384 15153 consensus_peers.cc:597] T f389b12c6b304243905f28267dfaeed0 P eaa34beb1b274443b1c46839afd0a484 -> Peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Couldn't send request to peer dbc2c92e49e346b5b3bd7705a229afc6. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 14:54:49.917810  6549 tablet_server.cc:179] TabletServer@127.6.101.66:0 shutting down...
W20260709 14:54:49.930841 15224 consensus_peers.cc:597] T 7699ad132e12472180b6a9527951c397 P 9cb8de0701f2482b99e51d5ac080aa13 -> Peer 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177): Couldn't send request to peer 7519e608fbb44d9db8ad30b9f10ae605. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 14:54:50.067176 15224 consensus_peers.cc:597] T 9275d24f141d455cb200b9784c470d33 P 9cb8de0701f2482b99e51d5ac080aa13 -> Peer 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177): Couldn't send request to peer 7519e608fbb44d9db8ad30b9f10ae605. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 14:54:50.084952 15224 consensus_peers.cc:597] T d2273a1ad13e4c54ae2101a15a7e56e1 P 9cb8de0701f2482b99e51d5ac080aa13 -> Peer 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177): Couldn't send request to peer 7519e608fbb44d9db8ad30b9f10ae605. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 14:54:50.104761 15224 consensus_peers.cc:597] T 6b5bb32eee204f2b90b1f1f14875c579 P 9cb8de0701f2482b99e51d5ac080aa13 -> Peer 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177): Couldn't send request to peer 7519e608fbb44d9db8ad30b9f10ae605. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 14:54:50.120805 15150 consensus_peers.cc:597] T 6cd07fbeb9f149a08fdbac2e0247eca4 P eaa34beb1b274443b1c46839afd0a484 -> Peer 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177): Couldn't send request to peer 7519e608fbb44d9db8ad30b9f10ae605. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:54:50.120960  6549 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 14:54:50.125015  6549 tablet_replica.cc:333] T d2273a1ad13e4c54ae2101a15a7e56e1 P 7519e608fbb44d9db8ad30b9f10ae605: stopping tablet replica
I20260709 14:54:50.125993  6549 raft_consensus.cc:2243] T d2273a1ad13e4c54ae2101a15a7e56e1 P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:50.126822  6549 raft_consensus.cc:2272] T d2273a1ad13e4c54ae2101a15a7e56e1 P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:50.130323  6549 tablet_replica.cc:333] T 1193461bc272409e8a1e719ecdb38e7f P 7519e608fbb44d9db8ad30b9f10ae605: stopping tablet replica
I20260709 14:54:50.131101  6549 raft_consensus.cc:2243] T 1193461bc272409e8a1e719ecdb38e7f P 7519e608fbb44d9db8ad30b9f10ae605 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:50.131639  6549 raft_consensus.cc:2272] T 1193461bc272409e8a1e719ecdb38e7f P 7519e608fbb44d9db8ad30b9f10ae605 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:50.134675  6549 tablet_replica.cc:333] T db39b7ffe995451885f4074ddf16028d P 7519e608fbb44d9db8ad30b9f10ae605: stopping tablet replica
I20260709 14:54:50.135504  6549 raft_consensus.cc:2243] T db39b7ffe995451885f4074ddf16028d P 7519e608fbb44d9db8ad30b9f10ae605 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:50.136080  6549 raft_consensus.cc:2272] T db39b7ffe995451885f4074ddf16028d P 7519e608fbb44d9db8ad30b9f10ae605 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:50.138511  6549 tablet_replica.cc:333] T e43bf64543ef494790c2f7a4a063fdd1 P 7519e608fbb44d9db8ad30b9f10ae605: stopping tablet replica
I20260709 14:54:50.139189  6549 raft_consensus.cc:2243] T e43bf64543ef494790c2f7a4a063fdd1 P 7519e608fbb44d9db8ad30b9f10ae605 [term 2 LEADER]: Raft consensus shutting down.
I20260709 14:54:50.140221  6549 raft_consensus.cc:2272] T e43bf64543ef494790c2f7a4a063fdd1 P 7519e608fbb44d9db8ad30b9f10ae605 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:50.143638  6549 tablet_replica.cc:333] T bdf08eed05854470954a5e9dd17dfb27 P 7519e608fbb44d9db8ad30b9f10ae605: stopping tablet replica
I20260709 14:54:50.144872  6549 raft_consensus.cc:2243] T bdf08eed05854470954a5e9dd17dfb27 P 7519e608fbb44d9db8ad30b9f10ae605 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:50.145557  6549 raft_consensus.cc:2272] T bdf08eed05854470954a5e9dd17dfb27 P 7519e608fbb44d9db8ad30b9f10ae605 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:50.150158  6549 tablet_replica.cc:333] T 9f90ac0a3b004f6ca430ff2fc5198678 P 7519e608fbb44d9db8ad30b9f10ae605: stopping tablet replica
W20260709 14:54:50.151357 15224 consensus_peers.cc:597] T b97c761f72c14075b65e501c4b3ae0fb P 9cb8de0701f2482b99e51d5ac080aa13 -> Peer 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177): Couldn't send request to peer 7519e608fbb44d9db8ad30b9f10ae605. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:54:50.151932  6549 raft_consensus.cc:2243] T 9f90ac0a3b004f6ca430ff2fc5198678 P 7519e608fbb44d9db8ad30b9f10ae605 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:50.152875  6549 raft_consensus.cc:2272] T 9f90ac0a3b004f6ca430ff2fc5198678 P 7519e608fbb44d9db8ad30b9f10ae605 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 14:54:50.154284 15150 consensus_peers.cc:597] T 5f5dbc86fc8f4ae5b77e0f23adfcd593 P eaa34beb1b274443b1c46839afd0a484 -> Peer 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177): Couldn't send request to peer 7519e608fbb44d9db8ad30b9f10ae605. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:54:50.158762  6549 tablet_replica.cc:333] T dd44b332dc744f94a5f7cfffc06f3956 P 7519e608fbb44d9db8ad30b9f10ae605: stopping tablet replica
I20260709 14:54:50.160777  6549 raft_consensus.cc:2243] T dd44b332dc744f94a5f7cfffc06f3956 P 7519e608fbb44d9db8ad30b9f10ae605 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:50.161926  6549 raft_consensus.cc:2272] T dd44b332dc744f94a5f7cfffc06f3956 P 7519e608fbb44d9db8ad30b9f10ae605 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:50.166550  6549 tablet_replica.cc:333] T ff73c3d51e5e480c920d1aca00b9b40d P 7519e608fbb44d9db8ad30b9f10ae605: stopping tablet replica
I20260709 14:54:50.168026  6549 raft_consensus.cc:2243] T ff73c3d51e5e480c920d1aca00b9b40d P 7519e608fbb44d9db8ad30b9f10ae605 [term 3 LEADER]: Raft consensus shutting down.
I20260709 14:54:50.169597  6549 raft_consensus.cc:2272] T ff73c3d51e5e480c920d1aca00b9b40d P 7519e608fbb44d9db8ad30b9f10ae605 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:50.174100  6549 tablet_replica.cc:333] T 5585b0f6bbf04c10865d2463767621dc P 7519e608fbb44d9db8ad30b9f10ae605: stopping tablet replica
I20260709 14:54:50.175323  6549 raft_consensus.cc:2243] T 5585b0f6bbf04c10865d2463767621dc P 7519e608fbb44d9db8ad30b9f10ae605 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:50.176262  6549 raft_consensus.cc:2272] T 5585b0f6bbf04c10865d2463767621dc P 7519e608fbb44d9db8ad30b9f10ae605 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:50.182309  6549 tablet_replica.cc:333] T 5e8a01e27eab492bb73df3359e500627 P 7519e608fbb44d9db8ad30b9f10ae605: stopping tablet replica
I20260709 14:54:50.184069  6549 raft_consensus.cc:2243] T 5e8a01e27eab492bb73df3359e500627 P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:50.185580  6549 raft_consensus.cc:2272] T 5e8a01e27eab492bb73df3359e500627 P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 14:54:50.188108 15224 consensus_peers.cc:597] T 1193461bc272409e8a1e719ecdb38e7f P 9cb8de0701f2482b99e51d5ac080aa13 -> Peer 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177): Couldn't send request to peer 7519e608fbb44d9db8ad30b9f10ae605. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:54:50.192939  6549 tablet_replica.cc:333] T 8bae8108fe2a4ce0ba3e35746c7ec9d1 P 7519e608fbb44d9db8ad30b9f10ae605: stopping tablet replica
I20260709 14:54:50.194546  6549 raft_consensus.cc:2243] T 8bae8108fe2a4ce0ba3e35746c7ec9d1 P 7519e608fbb44d9db8ad30b9f10ae605 [term 2 LEADER]: Raft consensus shutting down.
I20260709 14:54:50.196113  6549 raft_consensus.cc:2272] T 8bae8108fe2a4ce0ba3e35746c7ec9d1 P 7519e608fbb44d9db8ad30b9f10ae605 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:50.201170  6549 tablet_replica.cc:333] T a1075567fc91458ca7cc9977cf02b170 P 7519e608fbb44d9db8ad30b9f10ae605: stopping tablet replica
I20260709 14:54:50.202381  6549 raft_consensus.cc:2243] T a1075567fc91458ca7cc9977cf02b170 P 7519e608fbb44d9db8ad30b9f10ae605 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:50.203266  6549 raft_consensus.cc:2272] T a1075567fc91458ca7cc9977cf02b170 P 7519e608fbb44d9db8ad30b9f10ae605 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 14:54:50.204116 15224 consensus_peers.cc:597] T a018e41c89854091a15a6a8e4deffbdd P 9cb8de0701f2482b99e51d5ac080aa13 -> Peer 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177): Couldn't send request to peer 7519e608fbb44d9db8ad30b9f10ae605. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:54:50.211143  6549 tablet_replica.cc:333] T 0b12879f49fa4d52a477be2e490f2b38 P 7519e608fbb44d9db8ad30b9f10ae605: stopping tablet replica
I20260709 14:54:50.212819  6549 raft_consensus.cc:2243] T 0b12879f49fa4d52a477be2e490f2b38 P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 LEADER]: Raft consensus shutting down.
I20260709 14:54:50.214375  6549 raft_consensus.cc:2272] T 0b12879f49fa4d52a477be2e490f2b38 P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:50.218418  6549 tablet_replica.cc:333] T 8974e5ab032b4fba92bfc577280778bf P 7519e608fbb44d9db8ad30b9f10ae605: stopping tablet replica
I20260709 14:54:50.219548  6549 raft_consensus.cc:2243] T 8974e5ab032b4fba92bfc577280778bf P 7519e608fbb44d9db8ad30b9f10ae605 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:50.220340  6549 raft_consensus.cc:2272] T 8974e5ab032b4fba92bfc577280778bf P 7519e608fbb44d9db8ad30b9f10ae605 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 14:54:50.221537 15150 consensus_peers.cc:597] T 5e8a01e27eab492bb73df3359e500627 P eaa34beb1b274443b1c46839afd0a484 -> Peer 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177): Couldn't send request to peer 7519e608fbb44d9db8ad30b9f10ae605. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:54:50.227833  6549 tablet_replica.cc:333] T 6b5bb32eee204f2b90b1f1f14875c579 P 7519e608fbb44d9db8ad30b9f10ae605: stopping tablet replica
I20260709 14:54:50.229130  6549 raft_consensus.cc:2243] T 6b5bb32eee204f2b90b1f1f14875c579 P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:50.229830  6549 raft_consensus.cc:2272] T 6b5bb32eee204f2b90b1f1f14875c579 P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:50.233358  6549 tablet_replica.cc:333] T d326f264e68d41d69b5007023083ed9e P 7519e608fbb44d9db8ad30b9f10ae605: stopping tablet replica
I20260709 14:54:50.234239  6549 raft_consensus.cc:2243] T d326f264e68d41d69b5007023083ed9e P 7519e608fbb44d9db8ad30b9f10ae605 [term 2 LEADER]: Raft consensus shutting down.
I20260709 14:54:50.235776  6549 raft_consensus.cc:2272] T d326f264e68d41d69b5007023083ed9e P 7519e608fbb44d9db8ad30b9f10ae605 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:50.240530  6549 tablet_replica.cc:333] T 70bc59fabcdc4359a84d584f36d18d01 P 7519e608fbb44d9db8ad30b9f10ae605: stopping tablet replica
I20260709 14:54:50.241452  6549 raft_consensus.cc:2243] T 70bc59fabcdc4359a84d584f36d18d01 P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 LEADER]: Raft consensus shutting down.
I20260709 14:54:50.242983  6549 raft_consensus.cc:2272] T 70bc59fabcdc4359a84d584f36d18d01 P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 14:54:50.246209 15150 consensus_peers.cc:597] T f389b12c6b304243905f28267dfaeed0 P eaa34beb1b274443b1c46839afd0a484 -> Peer 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177): Couldn't send request to peer 7519e608fbb44d9db8ad30b9f10ae605. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:54:50.247958  6549 tablet_replica.cc:333] T 9275d24f141d455cb200b9784c470d33 P 7519e608fbb44d9db8ad30b9f10ae605: stopping tablet replica
I20260709 14:54:50.248906  6549 raft_consensus.cc:2243] T 9275d24f141d455cb200b9784c470d33 P 7519e608fbb44d9db8ad30b9f10ae605 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:50.249531  6549 raft_consensus.cc:2272] T 9275d24f141d455cb200b9784c470d33 P 7519e608fbb44d9db8ad30b9f10ae605 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:50.252199  6549 tablet_replica.cc:333] T 4f709a060be148029cf72f1af6f79714 P 7519e608fbb44d9db8ad30b9f10ae605: stopping tablet replica
I20260709 14:54:50.252909  6549 raft_consensus.cc:2243] T 4f709a060be148029cf72f1af6f79714 P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:50.253470  6549 raft_consensus.cc:2272] T 4f709a060be148029cf72f1af6f79714 P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:50.255986  6549 tablet_replica.cc:333] T 5f5dbc86fc8f4ae5b77e0f23adfcd593 P 7519e608fbb44d9db8ad30b9f10ae605: stopping tablet replica
I20260709 14:54:50.256717  6549 raft_consensus.cc:2243] T 5f5dbc86fc8f4ae5b77e0f23adfcd593 P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:50.257409  6549 raft_consensus.cc:2272] T 5f5dbc86fc8f4ae5b77e0f23adfcd593 P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:50.261111  6549 tablet_replica.cc:333] T c7d360d2b84b4f0aa38f5c325f4521c1 P 7519e608fbb44d9db8ad30b9f10ae605: stopping tablet replica
I20260709 14:54:50.262202  6549 raft_consensus.cc:2243] T c7d360d2b84b4f0aa38f5c325f4521c1 P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:50.262923  6549 raft_consensus.cc:2272] T c7d360d2b84b4f0aa38f5c325f4521c1 P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:50.267047  6549 tablet_replica.cc:333] T ca2aa2e1a8c646069cb8b23b0ebdb0c7 P 7519e608fbb44d9db8ad30b9f10ae605: stopping tablet replica
I20260709 14:54:50.268034  6549 raft_consensus.cc:2243] T ca2aa2e1a8c646069cb8b23b0ebdb0c7 P 7519e608fbb44d9db8ad30b9f10ae605 [term 2 LEADER]: Raft consensus shutting down.
I20260709 14:54:50.269392  6549 raft_consensus.cc:2272] T ca2aa2e1a8c646069cb8b23b0ebdb0c7 P 7519e608fbb44d9db8ad30b9f10ae605 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:50.272653  6549 tablet_replica.cc:333] T f389b12c6b304243905f28267dfaeed0 P 7519e608fbb44d9db8ad30b9f10ae605: stopping tablet replica
I20260709 14:54:50.274010  6549 raft_consensus.cc:2243] T f389b12c6b304243905f28267dfaeed0 P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:50.274768  6549 raft_consensus.cc:2272] T f389b12c6b304243905f28267dfaeed0 P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:50.277992  6549 tablet_replica.cc:333] T 054739df584d4b9db840777c2ae17555 P 7519e608fbb44d9db8ad30b9f10ae605: stopping tablet replica
I20260709 14:54:50.278935  6549 raft_consensus.cc:2243] T 054739df584d4b9db840777c2ae17555 P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 LEADER]: Raft consensus shutting down.
I20260709 14:54:50.280179  6549 raft_consensus.cc:2272] T 054739df584d4b9db840777c2ae17555 P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:50.283996  6549 tablet_replica.cc:333] T a018e41c89854091a15a6a8e4deffbdd P 7519e608fbb44d9db8ad30b9f10ae605: stopping tablet replica
I20260709 14:54:50.284969  6549 raft_consensus.cc:2243] T a018e41c89854091a15a6a8e4deffbdd P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:50.285707  6549 raft_consensus.cc:2272] T a018e41c89854091a15a6a8e4deffbdd P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:50.288782  6549 tablet_replica.cc:333] T 67409326aa124c52a5e9a650d7570a68 P 7519e608fbb44d9db8ad30b9f10ae605: stopping tablet replica
I20260709 14:54:50.289712  6549 raft_consensus.cc:2243] T 67409326aa124c52a5e9a650d7570a68 P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:50.290308  6549 raft_consensus.cc:2272] T 67409326aa124c52a5e9a650d7570a68 P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:50.294304  6549 tablet_replica.cc:333] T 91c9f89fcb8b45ff9be43f535cafffde P 7519e608fbb44d9db8ad30b9f10ae605: stopping tablet replica
I20260709 14:54:50.295393  6549 raft_consensus.cc:2243] T 91c9f89fcb8b45ff9be43f535cafffde P 7519e608fbb44d9db8ad30b9f10ae605 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:50.296257  6549 raft_consensus.cc:2272] T 91c9f89fcb8b45ff9be43f535cafffde P 7519e608fbb44d9db8ad30b9f10ae605 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:50.300472  6549 tablet_replica.cc:333] T d61f9ecebc3c4a028f5327bc9debf432 P 7519e608fbb44d9db8ad30b9f10ae605: stopping tablet replica
I20260709 14:54:50.301548  6549 raft_consensus.cc:2243] T d61f9ecebc3c4a028f5327bc9debf432 P 7519e608fbb44d9db8ad30b9f10ae605 [term 2 LEADER]: Raft consensus shutting down.
I20260709 14:54:50.302850  6549 raft_consensus.cc:2272] T d61f9ecebc3c4a028f5327bc9debf432 P 7519e608fbb44d9db8ad30b9f10ae605 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:50.307082  6549 tablet_replica.cc:333] T 798d0882b1ea4b26b598c236de8f18c9 P 7519e608fbb44d9db8ad30b9f10ae605: stopping tablet replica
I20260709 14:54:50.308044  6549 raft_consensus.cc:2243] T 798d0882b1ea4b26b598c236de8f18c9 P 7519e608fbb44d9db8ad30b9f10ae605 [term 2 LEADER]: Raft consensus shutting down.
I20260709 14:54:50.309342  6549 raft_consensus.cc:2272] T 798d0882b1ea4b26b598c236de8f18c9 P 7519e608fbb44d9db8ad30b9f10ae605 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 14:54:50.306721 15224 consensus_peers.cc:597] T 0284d9835221427ab285015d48a8040d P 9cb8de0701f2482b99e51d5ac080aa13 -> Peer 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177): Couldn't send request to peer 7519e608fbb44d9db8ad30b9f10ae605. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:54:50.313566  6549 tablet_replica.cc:333] T a9dab1878c4b4550880f5680c6d48c67 P 7519e608fbb44d9db8ad30b9f10ae605: stopping tablet replica
I20260709 14:54:50.314654  6549 raft_consensus.cc:2243] T a9dab1878c4b4550880f5680c6d48c67 P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:50.315346  6549 raft_consensus.cc:2272] T a9dab1878c4b4550880f5680c6d48c67 P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:50.319729  6549 tablet_replica.cc:333] T 966a06ab56a6479283ab2818c9439d4f P 7519e608fbb44d9db8ad30b9f10ae605: stopping tablet replica
I20260709 14:54:50.320679  6549 raft_consensus.cc:2243] T 966a06ab56a6479283ab2818c9439d4f P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 LEADER]: Raft consensus shutting down.
W20260709 14:54:50.321497 15150 consensus_peers.cc:597] T a9dab1878c4b4550880f5680c6d48c67 P eaa34beb1b274443b1c46839afd0a484 -> Peer 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177): Couldn't send request to peer 7519e608fbb44d9db8ad30b9f10ae605. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:54:50.321943  6549 raft_consensus.cc:2272] T 966a06ab56a6479283ab2818c9439d4f P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 14:54:50.322383 15150 consensus_peers.cc:597] T 7f2cd7c8159d43c080fd8302180ecfca P eaa34beb1b274443b1c46839afd0a484 -> Peer 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177): Couldn't send request to peer 7519e608fbb44d9db8ad30b9f10ae605. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:54:50.324867  6549 tablet_replica.cc:333] T 263098160f604ae3aa31782c37e2fd52 P 7519e608fbb44d9db8ad30b9f10ae605: stopping tablet replica
I20260709 14:54:50.325941  6549 raft_consensus.cc:2243] T 263098160f604ae3aa31782c37e2fd52 P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:50.326573  6549 raft_consensus.cc:2272] T 263098160f604ae3aa31782c37e2fd52 P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:50.329761  6549 tablet_replica.cc:333] T 6cd07fbeb9f149a08fdbac2e0247eca4 P 7519e608fbb44d9db8ad30b9f10ae605: stopping tablet replica
I20260709 14:54:50.330485  6549 raft_consensus.cc:2243] T 6cd07fbeb9f149a08fdbac2e0247eca4 P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:50.330991  6549 raft_consensus.cc:2272] T 6cd07fbeb9f149a08fdbac2e0247eca4 P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:50.334980  6549 tablet_replica.cc:333] T 7f2cd7c8159d43c080fd8302180ecfca P 7519e608fbb44d9db8ad30b9f10ae605: stopping tablet replica
I20260709 14:54:50.336033  6549 raft_consensus.cc:2243] T 7f2cd7c8159d43c080fd8302180ecfca P 7519e608fbb44d9db8ad30b9f10ae605 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:50.336742  6549 raft_consensus.cc:2272] T 7f2cd7c8159d43c080fd8302180ecfca P 7519e608fbb44d9db8ad30b9f10ae605 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 14:54:50.340489 15150 consensus_peers.cc:597] T 9f90ac0a3b004f6ca430ff2fc5198678 P eaa34beb1b274443b1c46839afd0a484 -> Peer 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177): Couldn't send request to peer 7519e608fbb44d9db8ad30b9f10ae605. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:54:50.340780  6549 tablet_replica.cc:333] T f706543d4d3e4e7291624a785ca4e747 P 7519e608fbb44d9db8ad30b9f10ae605: stopping tablet replica
I20260709 14:54:50.341676  6549 raft_consensus.cc:2243] T f706543d4d3e4e7291624a785ca4e747 P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 LEADER]: Raft consensus shutting down.
I20260709 14:54:50.342669  6549 raft_consensus.cc:2272] T f706543d4d3e4e7291624a785ca4e747 P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:50.345739  6549 tablet_replica.cc:333] T d354c94548fc411ab62b4281ed947944 P 7519e608fbb44d9db8ad30b9f10ae605: stopping tablet replica
I20260709 14:54:50.346381  6549 raft_consensus.cc:2243] T d354c94548fc411ab62b4281ed947944 P 7519e608fbb44d9db8ad30b9f10ae605 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:50.346840  6549 raft_consensus.cc:2272] T d354c94548fc411ab62b4281ed947944 P 7519e608fbb44d9db8ad30b9f10ae605 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:50.349505  6549 tablet_replica.cc:333] T 0284d9835221427ab285015d48a8040d P 7519e608fbb44d9db8ad30b9f10ae605: stopping tablet replica
I20260709 14:54:50.350452  6549 raft_consensus.cc:2243] T 0284d9835221427ab285015d48a8040d P 7519e608fbb44d9db8ad30b9f10ae605 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:50.351269  6549 raft_consensus.cc:2272] T 0284d9835221427ab285015d48a8040d P 7519e608fbb44d9db8ad30b9f10ae605 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:50.354933  6549 tablet_replica.cc:333] T 1159198eabeb409996ccbec0cac057f8 P 7519e608fbb44d9db8ad30b9f10ae605: stopping tablet replica
I20260709 14:54:50.356129  6549 raft_consensus.cc:2243] T 1159198eabeb409996ccbec0cac057f8 P 7519e608fbb44d9db8ad30b9f10ae605 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:50.356956  6549 raft_consensus.cc:2272] T 1159198eabeb409996ccbec0cac057f8 P 7519e608fbb44d9db8ad30b9f10ae605 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:50.361219  6549 tablet_replica.cc:333] T 7699ad132e12472180b6a9527951c397 P 7519e608fbb44d9db8ad30b9f10ae605: stopping tablet replica
I20260709 14:54:50.362108  6549 raft_consensus.cc:2243] T 7699ad132e12472180b6a9527951c397 P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:50.362792  6549 raft_consensus.cc:2272] T 7699ad132e12472180b6a9527951c397 P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 14:54:50.362615 15150 consensus_peers.cc:597] T 263098160f604ae3aa31782c37e2fd52 P eaa34beb1b274443b1c46839afd0a484 -> Peer 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177): Couldn't send request to peer 7519e608fbb44d9db8ad30b9f10ae605. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:54:50.366971  6549 tablet_replica.cc:333] T b97c761f72c14075b65e501c4b3ae0fb P 7519e608fbb44d9db8ad30b9f10ae605: stopping tablet replica
I20260709 14:54:50.368152  6549 raft_consensus.cc:2243] T b97c761f72c14075b65e501c4b3ae0fb P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:50.368866  6549 raft_consensus.cc:2272] T b97c761f72c14075b65e501c4b3ae0fb P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:50.372442  6549 tablet_replica.cc:333] T f8b33962eab84819b17953e44eae71a1 P 7519e608fbb44d9db8ad30b9f10ae605: stopping tablet replica
I20260709 14:54:50.373749  6549 raft_consensus.cc:2243] T f8b33962eab84819b17953e44eae71a1 P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 LEADER]: Raft consensus shutting down.
W20260709 14:54:50.375059 15224 consensus_peers.cc:597] T 67409326aa124c52a5e9a650d7570a68 P 9cb8de0701f2482b99e51d5ac080aa13 -> Peer 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177): Couldn't send request to peer 7519e608fbb44d9db8ad30b9f10ae605. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:54:50.375473  6549 raft_consensus.cc:2272] T f8b33962eab84819b17953e44eae71a1 P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:50.378779  6549 tablet_replica.cc:333] T 342798bf4325470fa3991757eadb0764 P 7519e608fbb44d9db8ad30b9f10ae605: stopping tablet replica
I20260709 14:54:50.379616  6549 raft_consensus.cc:2243] T 342798bf4325470fa3991757eadb0764 P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 LEADER]: Raft consensus shutting down.
I20260709 14:54:50.380755  6549 raft_consensus.cc:2272] T 342798bf4325470fa3991757eadb0764 P 7519e608fbb44d9db8ad30b9f10ae605 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:50.384184  6549 tablet_replica.cc:333] T b7c363a305d3434092ef6016b7064eb3 P 7519e608fbb44d9db8ad30b9f10ae605: stopping tablet replica
I20260709 14:54:50.384864  6549 raft_consensus.cc:2243] T b7c363a305d3434092ef6016b7064eb3 P 7519e608fbb44d9db8ad30b9f10ae605 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:50.385505  6549 raft_consensus.cc:2272] T b7c363a305d3434092ef6016b7064eb3 P 7519e608fbb44d9db8ad30b9f10ae605 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:50.387871  6549 tablet_replica.cc:333] T b8d6b9cf24a24444b2a69fd526cd4b09 P 7519e608fbb44d9db8ad30b9f10ae605: stopping tablet replica
I20260709 14:54:50.388582  6549 raft_consensus.cc:2243] T b8d6b9cf24a24444b2a69fd526cd4b09 P 7519e608fbb44d9db8ad30b9f10ae605 [term 2 LEADER]: Raft consensus shutting down.
I20260709 14:54:50.390142  6549 raft_consensus.cc:2272] T b8d6b9cf24a24444b2a69fd526cd4b09 P 7519e608fbb44d9db8ad30b9f10ae605 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 14:54:50.426096 15224 consensus_peers.cc:597] T c7d360d2b84b4f0aa38f5c325f4521c1 P 9cb8de0701f2482b99e51d5ac080aa13 -> Peer 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177): Couldn't send request to peer 7519e608fbb44d9db8ad30b9f10ae605. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 14:54:50.462400 15224 consensus_peers.cc:597] T 4f709a060be148029cf72f1af6f79714 P 9cb8de0701f2482b99e51d5ac080aa13 -> Peer 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177): Couldn't send request to peer 7519e608fbb44d9db8ad30b9f10ae605. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.66:43177: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 14:54:50.504840 16273 raft_consensus.cc:493] T d86dfc13b2834d7e8b2ad5f975f08154 P 9cb8de0701f2482b99e51d5ac080aa13 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader dbc2c92e49e346b5b3bd7705a229afc6)
I20260709 14:54:50.505458 16273 raft_consensus.cc:515] T d86dfc13b2834d7e8b2ad5f975f08154 P 9cb8de0701f2482b99e51d5ac080aa13 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:50.507426 16273 leader_election.cc:290] T d86dfc13b2834d7e8b2ad5f975f08154 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805), dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477)
I20260709 14:54:50.510092 15183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86dfc13b2834d7e8b2ad5f975f08154" candidate_uuid: "9cb8de0701f2482b99e51d5ac080aa13" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eaa34beb1b274443b1c46839afd0a484" is_pre_election: true
W20260709 14:54:50.513442 15227 leader_election.cc:336] T d86dfc13b2834d7e8b2ad5f975f08154 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111)
I20260709 14:54:50.513976 15227 leader_election.cc:304] T d86dfc13b2834d7e8b2ad5f975f08154 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cb8de0701f2482b99e51d5ac080aa13; no voters: dbc2c92e49e346b5b3bd7705a229afc6, eaa34beb1b274443b1c46839afd0a484
I20260709 14:54:50.514776 16273 raft_consensus.cc:2749] T d86dfc13b2834d7e8b2ad5f975f08154 P 9cb8de0701f2482b99e51d5ac080aa13 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 14:54:50.519243 16273 raft_consensus.cc:493] T 5585b0f6bbf04c10865d2463767621dc P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader dbc2c92e49e346b5b3bd7705a229afc6)
I20260709 14:54:50.519771 16273 raft_consensus.cc:515] T 5585b0f6bbf04c10865d2463767621dc P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:50.521962 16273 leader_election.cc:290] T 5585b0f6bbf04c10865d2463767621dc P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477), 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177)
W20260709 14:54:50.527212 15227 leader_election.cc:336] T 5585b0f6bbf04c10865d2463767621dc P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111)
W20260709 14:54:50.528833 15224 leader_election.cc:336] T 5585b0f6bbf04c10865d2463767621dc P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177): Network error: Client connection negotiation failed: client connection to 127.6.101.66:43177: connect: Connection refused (error 111)
I20260709 14:54:50.529335 15224 leader_election.cc:304] T 5585b0f6bbf04c10865d2463767621dc P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cb8de0701f2482b99e51d5ac080aa13; no voters: 7519e608fbb44d9db8ad30b9f10ae605, dbc2c92e49e346b5b3bd7705a229afc6
I20260709 14:54:50.529959 16273 raft_consensus.cc:2749] T 5585b0f6bbf04c10865d2463767621dc P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 14:54:50.541476  6549 tablet_server.cc:196] TabletServer@127.6.101.66:0 shutdown complete.
I20260709 14:54:50.583637 16273 raft_consensus.cc:493] T a1075567fc91458ca7cc9977cf02b170 P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader dbc2c92e49e346b5b3bd7705a229afc6)
I20260709 14:54:50.584497 16273 raft_consensus.cc:515] T a1075567fc91458ca7cc9977cf02b170 P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:50.588668 16273 leader_election.cc:290] T a1075567fc91458ca7cc9977cf02b170 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477), 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177)
W20260709 14:54:50.597122 15227 leader_election.cc:336] T a1075567fc91458ca7cc9977cf02b170 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111)
W20260709 14:54:50.597817 15224 leader_election.cc:336] T a1075567fc91458ca7cc9977cf02b170 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177): Network error: Client connection negotiation failed: client connection to 127.6.101.66:43177: connect: Connection refused (error 111)
I20260709 14:54:50.598385 15224 leader_election.cc:304] T a1075567fc91458ca7cc9977cf02b170 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cb8de0701f2482b99e51d5ac080aa13; no voters: 7519e608fbb44d9db8ad30b9f10ae605, dbc2c92e49e346b5b3bd7705a229afc6
I20260709 14:54:50.599272 16273 raft_consensus.cc:2749] T a1075567fc91458ca7cc9977cf02b170 P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 14:54:50.615514 16411 raft_consensus.cc:493] T cc6f522768894933b21bc94b41605166 P eaa34beb1b274443b1c46839afd0a484 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader dbc2c92e49e346b5b3bd7705a229afc6)
I20260709 14:54:50.616357 16411 raft_consensus.cc:515] T cc6f522768894933b21bc94b41605166 P eaa34beb1b274443b1c46839afd0a484 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:50.619196 16411 leader_election.cc:290] T cc6f522768894933b21bc94b41605166 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493), dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477)
W20260709 14:54:50.627197 15153 leader_election.cc:336] T cc6f522768894933b21bc94b41605166 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111)
I20260709 14:54:50.628297 16409 raft_consensus.cc:493] T dd44b332dc744f94a5f7cfffc06f3956 P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader dbc2c92e49e346b5b3bd7705a229afc6)
I20260709 14:54:50.629040 16409 raft_consensus.cc:515] T dd44b332dc744f94a5f7cfffc06f3956 P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:50.631832 16409 leader_election.cc:290] T dd44b332dc744f94a5f7cfffc06f3956 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477), 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177)
I20260709 14:54:50.639539 15260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc6f522768894933b21bc94b41605166" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13" is_pre_election: true
I20260709 14:54:50.643997 15150 leader_election.cc:304] T cc6f522768894933b21bc94b41605166 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa34beb1b274443b1c46839afd0a484; no voters: 9cb8de0701f2482b99e51d5ac080aa13, dbc2c92e49e346b5b3bd7705a229afc6
I20260709 14:54:50.645480 16411 raft_consensus.cc:2749] T cc6f522768894933b21bc94b41605166 P eaa34beb1b274443b1c46839afd0a484 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 14:54:50.645788 15224 leader_election.cc:336] T dd44b332dc744f94a5f7cfffc06f3956 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177): Network error: Client connection negotiation failed: client connection to 127.6.101.66:43177: connect: Connection refused (error 111)
W20260709 14:54:50.647156 15227 leader_election.cc:336] T dd44b332dc744f94a5f7cfffc06f3956 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111)
I20260709 14:54:50.647802 15227 leader_election.cc:304] T dd44b332dc744f94a5f7cfffc06f3956 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cb8de0701f2482b99e51d5ac080aa13; no voters: 7519e608fbb44d9db8ad30b9f10ae605, dbc2c92e49e346b5b3bd7705a229afc6
I20260709 14:54:50.648754 16283 raft_consensus.cc:2749] T dd44b332dc744f94a5f7cfffc06f3956 P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 14:54:50.667393  6549 tablet_server.cc:179] TabletServer@127.6.101.67:0 shutting down...
W20260709 14:54:50.681110 15227 consensus_peers.cc:597] T 46a35b81512c4e8c8ec6b83d4c768e1f P 9cb8de0701f2482b99e51d5ac080aa13 -> Peer eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805): Couldn't send request to peer eaa34beb1b274443b1c46839afd0a484. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:54:50.713892 16308 raft_consensus.cc:493] T 91c9f89fcb8b45ff9be43f535cafffde P eaa34beb1b274443b1c46839afd0a484 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader dbc2c92e49e346b5b3bd7705a229afc6)
I20260709 14:54:50.715498 16308 raft_consensus.cc:515] T 91c9f89fcb8b45ff9be43f535cafffde P eaa34beb1b274443b1c46839afd0a484 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } }
W20260709 14:54:50.723878 15227 consensus_peers.cc:597] T d2c4ea1c33c64cd09ba04611fdbdc59d P 9cb8de0701f2482b99e51d5ac080aa13 -> Peer eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805): Couldn't send request to peer eaa34beb1b274443b1c46839afd0a484. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:54:50.732767 16308 leader_election.cc:290] T 91c9f89fcb8b45ff9be43f535cafffde P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477), 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177)
W20260709 14:54:50.734933 15153 leader_election.cc:336] T 91c9f89fcb8b45ff9be43f535cafffde P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111)
W20260709 14:54:50.743171 15227 consensus_peers.cc:597] T a018e41c89854091a15a6a8e4deffbdd P 9cb8de0701f2482b99e51d5ac080aa13 -> Peer eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805): Couldn't send request to peer eaa34beb1b274443b1c46839afd0a484. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 14:54:50.751073 15150 leader_election.cc:336] T 91c9f89fcb8b45ff9be43f535cafffde P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177): Network error: Client connection negotiation failed: client connection to 127.6.101.66:43177: connect: Connection refused (error 111)
I20260709 14:54:50.751763 15150 leader_election.cc:304] T 91c9f89fcb8b45ff9be43f535cafffde P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa34beb1b274443b1c46839afd0a484; no voters: 7519e608fbb44d9db8ad30b9f10ae605, dbc2c92e49e346b5b3bd7705a229afc6
I20260709 14:54:50.753100 16305 raft_consensus.cc:2749] T 91c9f89fcb8b45ff9be43f535cafffde P eaa34beb1b274443b1c46839afd0a484 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 14:54:50.786665 16283 raft_consensus.cc:493] T 8974e5ab032b4fba92bfc577280778bf P 9cb8de0701f2482b99e51d5ac080aa13 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader dbc2c92e49e346b5b3bd7705a229afc6)
I20260709 14:54:50.787338 16283 raft_consensus.cc:515] T 8974e5ab032b4fba92bfc577280778bf P 9cb8de0701f2482b99e51d5ac080aa13 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:50.789745 16283 leader_election.cc:290] T 8974e5ab032b4fba92bfc577280778bf P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477), 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177)
W20260709 14:54:50.796752 15224 leader_election.cc:336] T 8974e5ab032b4fba92bfc577280778bf P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177): Network error: Client connection negotiation failed: client connection to 127.6.101.66:43177: connect: Connection refused (error 111)
W20260709 14:54:50.801350 15227 leader_election.cc:336] T 8974e5ab032b4fba92bfc577280778bf P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111)
I20260709 14:54:50.802543 15227 leader_election.cc:304] T 8974e5ab032b4fba92bfc577280778bf P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cb8de0701f2482b99e51d5ac080aa13; no voters: 7519e608fbb44d9db8ad30b9f10ae605, dbc2c92e49e346b5b3bd7705a229afc6
I20260709 14:54:50.815608 16409 raft_consensus.cc:493] T 3b4c50fac37a43c0988d5ea911d09f43 P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader dbc2c92e49e346b5b3bd7705a229afc6)
I20260709 14:54:50.816521 16409 raft_consensus.cc:515] T 3b4c50fac37a43c0988d5ea911d09f43 P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:50.820426 16409 leader_election.cc:290] T 3b4c50fac37a43c0988d5ea911d09f43 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805), dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477)
I20260709 14:54:50.821715 16283 raft_consensus.cc:2749] T 8974e5ab032b4fba92bfc577280778bf P 9cb8de0701f2482b99e51d5ac080aa13 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 14:54:50.829433 15227 leader_election.cc:336] T 3b4c50fac37a43c0988d5ea911d09f43 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111)
W20260709 14:54:50.830433 15227 consensus_peers.cc:597] T 1193461bc272409e8a1e719ecdb38e7f P 9cb8de0701f2482b99e51d5ac080aa13 -> Peer eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805): Couldn't send request to peer eaa34beb1b274443b1c46839afd0a484. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 14:54:50.830981 15227 leader_election.cc:336] T 3b4c50fac37a43c0988d5ea911d09f43 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 14:54:50.830994  6549 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 14:54:50.831346 15227 leader_election.cc:304] T 3b4c50fac37a43c0988d5ea911d09f43 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cb8de0701f2482b99e51d5ac080aa13; no voters: dbc2c92e49e346b5b3bd7705a229afc6, eaa34beb1b274443b1c46839afd0a484
I20260709 14:54:50.832286  6549 tablet_replica.cc:333] T 1193461bc272409e8a1e719ecdb38e7f P eaa34beb1b274443b1c46839afd0a484: stopping tablet replica
I20260709 14:54:50.832721 16409 raft_consensus.cc:2749] T 3b4c50fac37a43c0988d5ea911d09f43 P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 14:54:50.833461  6549 raft_consensus.cc:2243] T 1193461bc272409e8a1e719ecdb38e7f P eaa34beb1b274443b1c46839afd0a484 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:50.834221  6549 raft_consensus.cc:2272] T 1193461bc272409e8a1e719ecdb38e7f P eaa34beb1b274443b1c46839afd0a484 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:50.837747  6549 tablet_replica.cc:333] T ff73c3d51e5e480c920d1aca00b9b40d P eaa34beb1b274443b1c46839afd0a484: stopping tablet replica
I20260709 14:54:50.838750  6549 raft_consensus.cc:2243] T ff73c3d51e5e480c920d1aca00b9b40d P eaa34beb1b274443b1c46839afd0a484 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:50.839359  6549 raft_consensus.cc:2272] T ff73c3d51e5e480c920d1aca00b9b40d P eaa34beb1b274443b1c46839afd0a484 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:50.841899  6549 tablet_replica.cc:333] T 5b9f8063585c4e5faddebd56fbe1aa01 P eaa34beb1b274443b1c46839afd0a484: stopping tablet replica
I20260709 14:54:50.842813  6549 raft_consensus.cc:2243] T 5b9f8063585c4e5faddebd56fbe1aa01 P eaa34beb1b274443b1c46839afd0a484 [term 2 LEADER]: Raft consensus shutting down.
I20260709 14:54:50.843940  6549 raft_consensus.cc:2272] T 5b9f8063585c4e5faddebd56fbe1aa01 P eaa34beb1b274443b1c46839afd0a484 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:50.846415  6549 tablet_replica.cc:333] T db39b7ffe995451885f4074ddf16028d P eaa34beb1b274443b1c46839afd0a484: stopping tablet replica
I20260709 14:54:50.847352  6549 raft_consensus.cc:2243] T db39b7ffe995451885f4074ddf16028d P eaa34beb1b274443b1c46839afd0a484 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:50.847951  6549 raft_consensus.cc:2272] T db39b7ffe995451885f4074ddf16028d P eaa34beb1b274443b1c46839afd0a484 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:50.850404  6549 tablet_replica.cc:333] T 4abdbdda3ce149a9904e919be18e7a3f P eaa34beb1b274443b1c46839afd0a484: stopping tablet replica
I20260709 14:54:50.851112  6549 raft_consensus.cc:2243] T 4abdbdda3ce149a9904e919be18e7a3f P eaa34beb1b274443b1c46839afd0a484 [term 2 LEADER]: Raft consensus shutting down.
I20260709 14:54:50.852085  6549 raft_consensus.cc:2272] T 4abdbdda3ce149a9904e919be18e7a3f P eaa34beb1b274443b1c46839afd0a484 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:50.854624  6549 tablet_replica.cc:333] T e43bf64543ef494790c2f7a4a063fdd1 P eaa34beb1b274443b1c46839afd0a484: stopping tablet replica
I20260709 14:54:50.855294  6549 raft_consensus.cc:2243] T e43bf64543ef494790c2f7a4a063fdd1 P eaa34beb1b274443b1c46839afd0a484 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:50.855794  6549 raft_consensus.cc:2272] T e43bf64543ef494790c2f7a4a063fdd1 P eaa34beb1b274443b1c46839afd0a484 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:50.856140 16409 raft_consensus.cc:493] T bdf08eed05854470954a5e9dd17dfb27 P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader dbc2c92e49e346b5b3bd7705a229afc6)
I20260709 14:54:50.856747 16409 raft_consensus.cc:515] T bdf08eed05854470954a5e9dd17dfb27 P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:50.858745  6549 tablet_replica.cc:333] T d178b88fdab54a29b05fb98e05ffe8c5 P eaa34beb1b274443b1c46839afd0a484: stopping tablet replica
I20260709 14:54:50.859843  6549 raft_consensus.cc:2243] T d178b88fdab54a29b05fb98e05ffe8c5 P eaa34beb1b274443b1c46839afd0a484 [term 2 LEADER]: Raft consensus shutting down.
I20260709 14:54:50.859792 16409 leader_election.cc:290] T bdf08eed05854470954a5e9dd17dfb27 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477), 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177)
I20260709 14:54:50.861371  6549 raft_consensus.cc:2272] T d178b88fdab54a29b05fb98e05ffe8c5 P eaa34beb1b274443b1c46839afd0a484 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 14:54:50.865198 15224 leader_election.cc:336] T bdf08eed05854470954a5e9dd17dfb27 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177): Network error: Client connection negotiation failed: client connection to 127.6.101.66:43177: connect: Connection refused (error 111)
I20260709 14:54:50.865840  6549 tablet_replica.cc:333] T d2463fd792b240e9911c6b38bcb453b8 P eaa34beb1b274443b1c46839afd0a484: stopping tablet replica
I20260709 14:54:50.866854  6549 raft_consensus.cc:2243] T d2463fd792b240e9911c6b38bcb453b8 P eaa34beb1b274443b1c46839afd0a484 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 14:54:50.867175 15227 leader_election.cc:336] T bdf08eed05854470954a5e9dd17dfb27 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111)
I20260709 14:54:50.867519  6549 raft_consensus.cc:2272] T d2463fd792b240e9911c6b38bcb453b8 P eaa34beb1b274443b1c46839afd0a484 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:50.867865 15227 leader_election.cc:304] T bdf08eed05854470954a5e9dd17dfb27 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cb8de0701f2482b99e51d5ac080aa13; no voters: 7519e608fbb44d9db8ad30b9f10ae605, dbc2c92e49e346b5b3bd7705a229afc6
I20260709 14:54:50.869009 16409 raft_consensus.cc:2749] T bdf08eed05854470954a5e9dd17dfb27 P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 14:54:50.869941 16283 raft_consensus.cc:493] T 1159198eabeb409996ccbec0cac057f8 P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader dbc2c92e49e346b5b3bd7705a229afc6)
I20260709 14:54:50.870767 16283 raft_consensus.cc:515] T 1159198eabeb409996ccbec0cac057f8 P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:50.871513  6549 tablet_replica.cc:333] T 9f90ac0a3b004f6ca430ff2fc5198678 P eaa34beb1b274443b1c46839afd0a484: stopping tablet replica
I20260709 14:54:50.872560  6549 raft_consensus.cc:2243] T 9f90ac0a3b004f6ca430ff2fc5198678 P eaa34beb1b274443b1c46839afd0a484 [term 2 LEADER]: Raft consensus shutting down.
I20260709 14:54:50.873684 16283 leader_election.cc:290] T 1159198eabeb409996ccbec0cac057f8 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477), 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177)
I20260709 14:54:50.874037  6549 raft_consensus.cc:2272] T 9f90ac0a3b004f6ca430ff2fc5198678 P eaa34beb1b274443b1c46839afd0a484 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:50.878386  6549 tablet_replica.cc:333] T 46a35b81512c4e8c8ec6b83d4c768e1f P eaa34beb1b274443b1c46839afd0a484: stopping tablet replica
I20260709 14:54:50.879480  6549 raft_consensus.cc:2243] T 46a35b81512c4e8c8ec6b83d4c768e1f P eaa34beb1b274443b1c46839afd0a484 [term 3 FOLLOWER]: Raft consensus shutting down.
W20260709 14:54:50.880147 15227 leader_election.cc:336] T 1159198eabeb409996ccbec0cac057f8 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111)
I20260709 14:54:50.880511  6549 raft_consensus.cc:2272] T 46a35b81512c4e8c8ec6b83d4c768e1f P eaa34beb1b274443b1c46839afd0a484 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 14:54:50.882011 15224 leader_election.cc:336] T 1159198eabeb409996ccbec0cac057f8 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177): Network error: Client connection negotiation failed: client connection to 127.6.101.66:43177: connect: Connection refused (error 111)
I20260709 14:54:50.882547 15224 leader_election.cc:304] T 1159198eabeb409996ccbec0cac057f8 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cb8de0701f2482b99e51d5ac080aa13; no voters: 7519e608fbb44d9db8ad30b9f10ae605, dbc2c92e49e346b5b3bd7705a229afc6
I20260709 14:54:50.880556 16305 raft_consensus.cc:493] T 3b4c50fac37a43c0988d5ea911d09f43 P eaa34beb1b274443b1c46839afd0a484 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader dbc2c92e49e346b5b3bd7705a229afc6)
I20260709 14:54:50.883991 16305 raft_consensus.cc:515] T 3b4c50fac37a43c0988d5ea911d09f43 P eaa34beb1b274443b1c46839afd0a484 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:50.885146  6549 tablet_replica.cc:333] T 91c9f89fcb8b45ff9be43f535cafffde P eaa34beb1b274443b1c46839afd0a484: stopping tablet replica
I20260709 14:54:50.885762 16283 raft_consensus.cc:2749] T 1159198eabeb409996ccbec0cac057f8 P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 14:54:50.886178  6549 raft_consensus.cc:2243] T 91c9f89fcb8b45ff9be43f535cafffde P eaa34beb1b274443b1c46839afd0a484 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:50.886818 16305 leader_election.cc:290] T 3b4c50fac37a43c0988d5ea911d09f43 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493), dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477)
I20260709 14:54:50.886905  6549 raft_consensus.cc:2272] T 91c9f89fcb8b45ff9be43f535cafffde P eaa34beb1b274443b1c46839afd0a484 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:50.889492 15260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4c50fac37a43c0988d5ea911d09f43" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13" is_pre_election: true
I20260709 14:54:50.890401 15260 raft_consensus.cc:2468] T 3b4c50fac37a43c0988d5ea911d09f43 P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa34beb1b274443b1c46839afd0a484 in term 2.
I20260709 14:54:50.890995  6549 tablet_replica.cc:333] T 0b12879f49fa4d52a477be2e490f2b38 P eaa34beb1b274443b1c46839afd0a484: stopping tablet replica
I20260709 14:54:50.892074  6549 raft_consensus.cc:2243] T 0b12879f49fa4d52a477be2e490f2b38 P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:50.891820 15150 leader_election.cc:304] T 3b4c50fac37a43c0988d5ea911d09f43 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cb8de0701f2482b99e51d5ac080aa13, eaa34beb1b274443b1c46839afd0a484; no voters: 
I20260709 14:54:50.892964  6549 raft_consensus.cc:2272] T 0b12879f49fa4d52a477be2e490f2b38 P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:50.893487 16305 raft_consensus.cc:2804] T 3b4c50fac37a43c0988d5ea911d09f43 P eaa34beb1b274443b1c46839afd0a484 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 14:54:50.893618 15153 leader_election.cc:336] T 3b4c50fac37a43c0988d5ea911d09f43 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111)
I20260709 14:54:50.894517 16305 raft_consensus.cc:493] T 3b4c50fac37a43c0988d5ea911d09f43 P eaa34beb1b274443b1c46839afd0a484 [term 2 FOLLOWER]: Starting leader election (detected failure of leader dbc2c92e49e346b5b3bd7705a229afc6)
I20260709 14:54:50.894984 16305 raft_consensus.cc:3060] T 3b4c50fac37a43c0988d5ea911d09f43 P eaa34beb1b274443b1c46839afd0a484 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:54:50.895424 16417 raft_consensus.cc:493] T 46ebd2bd84cc46e08c82a7b893e54578 P eaa34beb1b274443b1c46839afd0a484 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader dbc2c92e49e346b5b3bd7705a229afc6)
I20260709 14:54:50.896166 16417 raft_consensus.cc:515] T 46ebd2bd84cc46e08c82a7b893e54578 P eaa34beb1b274443b1c46839afd0a484 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:50.896848  6549 tablet_replica.cc:333] T a9dab1878c4b4550880f5680c6d48c67 P eaa34beb1b274443b1c46839afd0a484: stopping tablet replica
I20260709 14:54:50.898113  6549 raft_consensus.cc:2243] T a9dab1878c4b4550880f5680c6d48c67 P eaa34beb1b274443b1c46839afd0a484 [term 1 LEADER]: Raft consensus shutting down.
I20260709 14:54:50.898888 16417 leader_election.cc:290] T 46ebd2bd84cc46e08c82a7b893e54578 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493), dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477)
I20260709 14:54:50.899503  6549 raft_consensus.cc:2272] T a9dab1878c4b4550880f5680c6d48c67 P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:50.901017 15260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46ebd2bd84cc46e08c82a7b893e54578" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13" is_pre_election: true
I20260709 14:54:50.901818 16283 raft_consensus.cc:493] T b7c363a305d3434092ef6016b7064eb3 P 9cb8de0701f2482b99e51d5ac080aa13 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader dbc2c92e49e346b5b3bd7705a229afc6)
I20260709 14:54:50.902505 16283 raft_consensus.cc:515] T b7c363a305d3434092ef6016b7064eb3 P 9cb8de0701f2482b99e51d5ac080aa13 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:50.903429  6549 tablet_replica.cc:333] T cc6f522768894933b21bc94b41605166 P eaa34beb1b274443b1c46839afd0a484: stopping tablet replica
I20260709 14:54:50.903654 16305 raft_consensus.cc:515] T 3b4c50fac37a43c0988d5ea911d09f43 P eaa34beb1b274443b1c46839afd0a484 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:50.904404  6549 raft_consensus.cc:2243] T cc6f522768894933b21bc94b41605166 P eaa34beb1b274443b1c46839afd0a484 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:50.904757 16283 leader_election.cc:290] T b7c363a305d3434092ef6016b7064eb3 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477), 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177)
I20260709 14:54:50.905015  6549 raft_consensus.cc:2272] T cc6f522768894933b21bc94b41605166 P eaa34beb1b274443b1c46839afd0a484 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:50.909029  6549 tablet_replica.cc:333] T 966a06ab56a6479283ab2818c9439d4f P eaa34beb1b274443b1c46839afd0a484: stopping tablet replica
I20260709 14:54:50.908761 16305 leader_election.cc:290] T 3b4c50fac37a43c0988d5ea911d09f43 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 3 election: Requested vote from peers 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493), dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477)
I20260709 14:54:50.910351  6549 raft_consensus.cc:2243] T 966a06ab56a6479283ab2818c9439d4f P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:50.910867 15260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4c50fac37a43c0988d5ea911d09f43" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13"
I20260709 14:54:50.911572  6549 raft_consensus.cc:2272] T 966a06ab56a6479283ab2818c9439d4f P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:50.911612 15260 raft_consensus.cc:3060] T 3b4c50fac37a43c0988d5ea911d09f43 P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 FOLLOWER]: Advancing to term 3
W20260709 14:54:50.912271 15224 leader_election.cc:336] T b7c363a305d3434092ef6016b7064eb3 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177): Network error: Client connection negotiation failed: client connection to 127.6.101.66:43177: connect: Connection refused (error 111)
I20260709 14:54:50.917150  6549 tablet_replica.cc:333] T 42d6909533d14edbbfdad30a9972658d P eaa34beb1b274443b1c46839afd0a484: stopping tablet replica
I20260709 14:54:50.918416  6549 raft_consensus.cc:2243] T 42d6909533d14edbbfdad30a9972658d P eaa34beb1b274443b1c46839afd0a484 [term 1 LEADER]: Raft consensus shutting down.
I20260709 14:54:50.919883  6549 raft_consensus.cc:2272] T 42d6909533d14edbbfdad30a9972658d P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:50.922658 16409 raft_consensus.cc:493] T 46ebd2bd84cc46e08c82a7b893e54578 P 9cb8de0701f2482b99e51d5ac080aa13 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader dbc2c92e49e346b5b3bd7705a229afc6)
I20260709 14:54:50.924091  6549 tablet_replica.cc:333] T 98280a706ec54413830f342b48666f6e P eaa34beb1b274443b1c46839afd0a484: stopping tablet replica
I20260709 14:54:50.923697 16409 raft_consensus.cc:515] T 46ebd2bd84cc46e08c82a7b893e54578 P 9cb8de0701f2482b99e51d5ac080aa13 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:50.923913 15260 raft_consensus.cc:2468] T 3b4c50fac37a43c0988d5ea911d09f43 P 9cb8de0701f2482b99e51d5ac080aa13 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa34beb1b274443b1c46839afd0a484 in term 3.
I20260709 14:54:50.925369  6549 raft_consensus.cc:2243] T 98280a706ec54413830f342b48666f6e P eaa34beb1b274443b1c46839afd0a484 [term 1 LEADER]: Raft consensus shutting down.
I20260709 14:54:50.926626 16409 leader_election.cc:290] T 46ebd2bd84cc46e08c82a7b893e54578 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805), dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477)
W20260709 14:54:50.926771 15227 leader_election.cc:336] T b7c363a305d3434092ef6016b7064eb3 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111)
W20260709 14:54:50.927312 15153 leader_election.cc:336] T 46ebd2bd84cc46e08c82a7b893e54578 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111)
I20260709 14:54:50.927659 15227 leader_election.cc:304] T b7c363a305d3434092ef6016b7064eb3 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cb8de0701f2482b99e51d5ac080aa13; no voters: 7519e608fbb44d9db8ad30b9f10ae605, dbc2c92e49e346b5b3bd7705a229afc6
I20260709 14:54:50.927874 15153 leader_election.cc:304] T 46ebd2bd84cc46e08c82a7b893e54578 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eaa34beb1b274443b1c46839afd0a484; no voters: 9cb8de0701f2482b99e51d5ac080aa13, dbc2c92e49e346b5b3bd7705a229afc6
I20260709 14:54:50.928510 16409 raft_consensus.cc:2749] T b7c363a305d3434092ef6016b7064eb3 P 9cb8de0701f2482b99e51d5ac080aa13 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 14:54:50.928799 16305 raft_consensus.cc:2749] T 46ebd2bd84cc46e08c82a7b893e54578 P eaa34beb1b274443b1c46839afd0a484 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 14:54:50.929033 15153 leader_election.cc:336] T 3b4c50fac37a43c0988d5ea911d09f43 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111)
I20260709 14:54:50.929777 15150 leader_election.cc:304] T 3b4c50fac37a43c0988d5ea911d09f43 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9cb8de0701f2482b99e51d5ac080aa13, eaa34beb1b274443b1c46839afd0a484; no voters: dbc2c92e49e346b5b3bd7705a229afc6
I20260709 14:54:50.926707  6549 raft_consensus.cc:2272] T 98280a706ec54413830f342b48666f6e P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:50.930598 16305 raft_consensus.cc:2804] T 3b4c50fac37a43c0988d5ea911d09f43 P eaa34beb1b274443b1c46839afd0a484 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 14:54:50.931409 16305 raft_consensus.cc:697] T 3b4c50fac37a43c0988d5ea911d09f43 P eaa34beb1b274443b1c46839afd0a484 [term 3 LEADER]: Becoming Leader. State: Replica: eaa34beb1b274443b1c46839afd0a484, State: Running, Role: LEADER
I20260709 14:54:50.932385 16305 consensus_queue.cc:237] T 3b4c50fac37a43c0988d5ea911d09f43 P eaa34beb1b274443b1c46839afd0a484 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:50.933547  6549 tablet_replica.cc:333] T d6bcaee371174feaa06943f949efda49 P eaa34beb1b274443b1c46839afd0a484: stopping tablet replica
I20260709 14:54:50.934628  6549 raft_consensus.cc:2243] T d6bcaee371174feaa06943f949efda49 P eaa34beb1b274443b1c46839afd0a484 [term 1 LEADER]: Raft consensus shutting down.
I20260709 14:54:50.935822  6549 raft_consensus.cc:2272] T d6bcaee371174feaa06943f949efda49 P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:50.938889  6549 tablet_replica.cc:333] T 5f5dbc86fc8f4ae5b77e0f23adfcd593 P eaa34beb1b274443b1c46839afd0a484: stopping tablet replica
I20260709 14:54:50.939775  6549 raft_consensus.cc:2243] T 5f5dbc86fc8f4ae5b77e0f23adfcd593 P eaa34beb1b274443b1c46839afd0a484 [term 1 LEADER]: Raft consensus shutting down.
W20260709 14:54:50.940640 15227 leader_election.cc:336] T 46ebd2bd84cc46e08c82a7b893e54578 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111)
I20260709 14:54:50.940972  6549 raft_consensus.cc:2272] T 5f5dbc86fc8f4ae5b77e0f23adfcd593 P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 14:54:50.943490 15227 leader_election.cc:336] T 46ebd2bd84cc46e08c82a7b893e54578 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 14:54:50.944057 15227 leader_election.cc:304] T 46ebd2bd84cc46e08c82a7b893e54578 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cb8de0701f2482b99e51d5ac080aa13; no voters: dbc2c92e49e346b5b3bd7705a229afc6, eaa34beb1b274443b1c46839afd0a484
I20260709 14:54:50.944916  6549 tablet_replica.cc:333] T 6b5bb32eee204f2b90b1f1f14875c579 P eaa34beb1b274443b1c46839afd0a484: stopping tablet replica
I20260709 14:54:50.944931 16409 raft_consensus.cc:2749] T 46ebd2bd84cc46e08c82a7b893e54578 P 9cb8de0701f2482b99e51d5ac080aa13 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 14:54:50.946362  6549 raft_consensus.cc:2243] T 6b5bb32eee204f2b90b1f1f14875c579 P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:50.946954  6549 raft_consensus.cc:2272] T 6b5bb32eee204f2b90b1f1f14875c579 P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 14:54:50.948293 15227 consensus_peers.cc:597] T 67409326aa124c52a5e9a650d7570a68 P 9cb8de0701f2482b99e51d5ac080aa13 -> Peer eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805): Couldn't send request to peer eaa34beb1b274443b1c46839afd0a484. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:54:50.949867  6549 tablet_replica.cc:333] T d326f264e68d41d69b5007023083ed9e P eaa34beb1b274443b1c46839afd0a484: stopping tablet replica
I20260709 14:54:50.951697  6549 raft_consensus.cc:2243] T d326f264e68d41d69b5007023083ed9e P eaa34beb1b274443b1c46839afd0a484 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:50.952471  6549 raft_consensus.cc:2272] T d326f264e68d41d69b5007023083ed9e P eaa34beb1b274443b1c46839afd0a484 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:50.955803  6549 tablet_replica.cc:333] T 70bc59fabcdc4359a84d584f36d18d01 P eaa34beb1b274443b1c46839afd0a484: stopping tablet replica
I20260709 14:54:50.956753  6549 raft_consensus.cc:2243] T 70bc59fabcdc4359a84d584f36d18d01 P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:50.957358  6549 raft_consensus.cc:2272] T 70bc59fabcdc4359a84d584f36d18d01 P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:50.957835 16305 raft_consensus.cc:493] T d86dfc13b2834d7e8b2ad5f975f08154 P eaa34beb1b274443b1c46839afd0a484 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader dbc2c92e49e346b5b3bd7705a229afc6)
I20260709 14:54:50.958334 16305 raft_consensus.cc:515] T d86dfc13b2834d7e8b2ad5f975f08154 P eaa34beb1b274443b1c46839afd0a484 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:50.960660  6549 tablet_replica.cc:333] T 67409326aa124c52a5e9a650d7570a68 P eaa34beb1b274443b1c46839afd0a484: stopping tablet replica
I20260709 14:54:50.960805 16305 leader_election.cc:290] T d86dfc13b2834d7e8b2ad5f975f08154 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493), dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477)
I20260709 14:54:50.961941  6549 raft_consensus.cc:2243] T 67409326aa124c52a5e9a650d7570a68 P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:50.962224 15260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86dfc13b2834d7e8b2ad5f975f08154" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13" is_pre_election: true
I20260709 14:54:50.962695  6549 raft_consensus.cc:2272] T 67409326aa124c52a5e9a650d7570a68 P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:50.962993 15260 raft_consensus.cc:2468] T d86dfc13b2834d7e8b2ad5f975f08154 P 9cb8de0701f2482b99e51d5ac080aa13 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa34beb1b274443b1c46839afd0a484 in term 3.
I20260709 14:54:50.964310 15150 leader_election.cc:304] T d86dfc13b2834d7e8b2ad5f975f08154 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cb8de0701f2482b99e51d5ac080aa13, eaa34beb1b274443b1c46839afd0a484; no voters: 
I20260709 14:54:50.965324 16305 raft_consensus.cc:2804] T d86dfc13b2834d7e8b2ad5f975f08154 P eaa34beb1b274443b1c46839afd0a484 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 14:54:50.965647 16305 raft_consensus.cc:493] T d86dfc13b2834d7e8b2ad5f975f08154 P eaa34beb1b274443b1c46839afd0a484 [term 3 FOLLOWER]: Starting leader election (detected failure of leader dbc2c92e49e346b5b3bd7705a229afc6)
I20260709 14:54:50.965965 16305 raft_consensus.cc:3060] T d86dfc13b2834d7e8b2ad5f975f08154 P eaa34beb1b274443b1c46839afd0a484 [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:54:50.966058  6549 tablet_replica.cc:333] T a018e41c89854091a15a6a8e4deffbdd P eaa34beb1b274443b1c46839afd0a484: stopping tablet replica
W20260709 14:54:50.965993 15153 leader_election.cc:336] T d86dfc13b2834d7e8b2ad5f975f08154 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111)
I20260709 14:54:50.967269  6549 raft_consensus.cc:2243] T a018e41c89854091a15a6a8e4deffbdd P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:50.968025  6549 raft_consensus.cc:2272] T a018e41c89854091a15a6a8e4deffbdd P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:50.971338  6549 tablet_replica.cc:333] T 594083b10772433f90560d387bbbeabe P eaa34beb1b274443b1c46839afd0a484: stopping tablet replica
I20260709 14:54:50.972050  6549 raft_consensus.cc:2243] T 594083b10772433f90560d387bbbeabe P eaa34beb1b274443b1c46839afd0a484 [term 1 LEADER]: Raft consensus shutting down.
I20260709 14:54:50.972872 16305 raft_consensus.cc:515] T d86dfc13b2834d7e8b2ad5f975f08154 P eaa34beb1b274443b1c46839afd0a484 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:50.973232  6549 raft_consensus.cc:2272] T 594083b10772433f90560d387bbbeabe P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:50.974946 16305 leader_election.cc:290] T d86dfc13b2834d7e8b2ad5f975f08154 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 4 election: Requested vote from peers 9cb8de0701f2482b99e51d5ac080aa13 (127.6.101.68:45493), dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477)
I20260709 14:54:50.976007 15260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86dfc13b2834d7e8b2ad5f975f08154" candidate_uuid: "eaa34beb1b274443b1c46839afd0a484" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9cb8de0701f2482b99e51d5ac080aa13"
I20260709 14:54:50.976976 15260 raft_consensus.cc:3060] T d86dfc13b2834d7e8b2ad5f975f08154 P 9cb8de0701f2482b99e51d5ac080aa13 [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:54:50.977864  6549 tablet_replica.cc:333] T d2c4ea1c33c64cd09ba04611fdbdc59d P eaa34beb1b274443b1c46839afd0a484: stopping tablet replica
I20260709 14:54:50.978906  6549 raft_consensus.cc:2243] T d2c4ea1c33c64cd09ba04611fdbdc59d P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:50.979604  6549 raft_consensus.cc:2272] T d2c4ea1c33c64cd09ba04611fdbdc59d P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 14:54:50.981608 15153 leader_election.cc:336] T d86dfc13b2834d7e8b2ad5f975f08154 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111)
I20260709 14:54:50.982290 16409 raft_consensus.cc:493] T cc6f522768894933b21bc94b41605166 P 9cb8de0701f2482b99e51d5ac080aa13 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader dbc2c92e49e346b5b3bd7705a229afc6)
I20260709 14:54:50.982690  6549 tablet_replica.cc:333] T d86dfc13b2834d7e8b2ad5f975f08154 P eaa34beb1b274443b1c46839afd0a484: stopping tablet replica
I20260709 14:54:50.983114 16409 raft_consensus.cc:515] T cc6f522768894933b21bc94b41605166 P 9cb8de0701f2482b99e51d5ac080aa13 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } }
I20260709 14:54:50.983597  6549 raft_consensus.cc:2243] T d86dfc13b2834d7e8b2ad5f975f08154 P eaa34beb1b274443b1c46839afd0a484 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:50.984423  6549 raft_consensus.cc:2272] T d86dfc13b2834d7e8b2ad5f975f08154 P eaa34beb1b274443b1c46839afd0a484 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:50.985772 16409 leader_election.cc:290] T cc6f522768894933b21bc94b41605166 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805), dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477)
I20260709 14:54:50.986323 15260 raft_consensus.cc:2468] T d86dfc13b2834d7e8b2ad5f975f08154 P 9cb8de0701f2482b99e51d5ac080aa13 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa34beb1b274443b1c46839afd0a484 in term 4.
I20260709 14:54:50.988071  6549 tablet_replica.cc:333] T b97c761f72c14075b65e501c4b3ae0fb P eaa34beb1b274443b1c46839afd0a484: stopping tablet replica
I20260709 14:54:50.988735 15150 leader_election.cc:304] T d86dfc13b2834d7e8b2ad5f975f08154 P eaa34beb1b274443b1c46839afd0a484 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9cb8de0701f2482b99e51d5ac080aa13, eaa34beb1b274443b1c46839afd0a484; no voters: dbc2c92e49e346b5b3bd7705a229afc6
I20260709 14:54:50.989070  6549 raft_consensus.cc:2243] T b97c761f72c14075b65e501c4b3ae0fb P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 14:54:50.989507 15150 raft_consensus.cc:2686] T d86dfc13b2834d7e8b2ad5f975f08154 P eaa34beb1b274443b1c46839afd0a484: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 14:54:50.989975  6549 raft_consensus.cc:2272] T b97c761f72c14075b65e501c4b3ae0fb P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 14:54:50.992179 15227 leader_election.cc:336] T cc6f522768894933b21bc94b41605166 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 14:54:50.993014 15227 leader_election.cc:336] T cc6f522768894933b21bc94b41605166 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111)
I20260709 14:54:50.993541  6549 tablet_replica.cc:333] T f8b33962eab84819b17953e44eae71a1 P eaa34beb1b274443b1c46839afd0a484: stopping tablet replica
I20260709 14:54:50.993621 15227 leader_election.cc:304] T cc6f522768894933b21bc94b41605166 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cb8de0701f2482b99e51d5ac080aa13; no voters: dbc2c92e49e346b5b3bd7705a229afc6, eaa34beb1b274443b1c46839afd0a484
I20260709 14:54:50.994359  6549 raft_consensus.cc:2243] T f8b33962eab84819b17953e44eae71a1 P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:50.994674 16409 raft_consensus.cc:2749] T cc6f522768894933b21bc94b41605166 P 9cb8de0701f2482b99e51d5ac080aa13 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 14:54:50.994989  6549 raft_consensus.cc:2272] T f8b33962eab84819b17953e44eae71a1 P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:50.998656  6549 tablet_replica.cc:333] T 342798bf4325470fa3991757eadb0764 P eaa34beb1b274443b1c46839afd0a484: stopping tablet replica
I20260709 14:54:50.999572  6549 raft_consensus.cc:2243] T 342798bf4325470fa3991757eadb0764 P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:51.000224  6549 raft_consensus.cc:2272] T 342798bf4325470fa3991757eadb0764 P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:51.003279  6549 tablet_replica.cc:333] T b8d6b9cf24a24444b2a69fd526cd4b09 P eaa34beb1b274443b1c46839afd0a484: stopping tablet replica
I20260709 14:54:51.004617  6549 raft_consensus.cc:2243] T b8d6b9cf24a24444b2a69fd526cd4b09 P eaa34beb1b274443b1c46839afd0a484 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:51.005296  6549 raft_consensus.cc:2272] T b8d6b9cf24a24444b2a69fd526cd4b09 P eaa34beb1b274443b1c46839afd0a484 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:51.007596  6549 tablet_replica.cc:333] T f389b12c6b304243905f28267dfaeed0 P eaa34beb1b274443b1c46839afd0a484: stopping tablet replica
I20260709 14:54:51.009001  6549 raft_consensus.cc:2243] T f389b12c6b304243905f28267dfaeed0 P eaa34beb1b274443b1c46839afd0a484 [term 1 LEADER]: Raft consensus shutting down.
I20260709 14:54:51.010864  6549 raft_consensus.cc:2272] T f389b12c6b304243905f28267dfaeed0 P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:51.014611  6549 tablet_replica.cc:333] T d354c94548fc411ab62b4281ed947944 P eaa34beb1b274443b1c46839afd0a484: stopping tablet replica
I20260709 14:54:51.015606  6549 raft_consensus.cc:2243] T d354c94548fc411ab62b4281ed947944 P eaa34beb1b274443b1c46839afd0a484 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:51.016547  6549 raft_consensus.cc:2272] T d354c94548fc411ab62b4281ed947944 P eaa34beb1b274443b1c46839afd0a484 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:51.019083  6549 tablet_replica.cc:333] T 7f2cd7c8159d43c080fd8302180ecfca P eaa34beb1b274443b1c46839afd0a484: stopping tablet replica
I20260709 14:54:51.019871  6549 raft_consensus.cc:2243] T 7f2cd7c8159d43c080fd8302180ecfca P eaa34beb1b274443b1c46839afd0a484 [term 2 LEADER]: Raft consensus shutting down.
I20260709 14:54:51.020776  6549 raft_consensus.cc:2272] T 7f2cd7c8159d43c080fd8302180ecfca P eaa34beb1b274443b1c46839afd0a484 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:51.023129  6549 tablet_replica.cc:333] T 263098160f604ae3aa31782c37e2fd52 P eaa34beb1b274443b1c46839afd0a484: stopping tablet replica
I20260709 14:54:51.023748  6549 raft_consensus.cc:2243] T 263098160f604ae3aa31782c37e2fd52 P eaa34beb1b274443b1c46839afd0a484 [term 1 LEADER]: Raft consensus shutting down.
I20260709 14:54:51.024662  6549 raft_consensus.cc:2272] T 263098160f604ae3aa31782c37e2fd52 P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:51.027354  6549 tablet_replica.cc:333] T 798d0882b1ea4b26b598c236de8f18c9 P eaa34beb1b274443b1c46839afd0a484: stopping tablet replica
I20260709 14:54:51.028057  6549 raft_consensus.cc:2243] T 798d0882b1ea4b26b598c236de8f18c9 P eaa34beb1b274443b1c46839afd0a484 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:51.028570  6549 raft_consensus.cc:2272] T 798d0882b1ea4b26b598c236de8f18c9 P eaa34beb1b274443b1c46839afd0a484 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:51.033521  6549 tablet_replica.cc:333] T c61864fa2cd249d683f8fb90d8542480 P eaa34beb1b274443b1c46839afd0a484: stopping tablet replica
I20260709 14:54:51.034694  6549 raft_consensus.cc:2243] T c61864fa2cd249d683f8fb90d8542480 P eaa34beb1b274443b1c46839afd0a484 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:51.035249  6549 raft_consensus.cc:2272] T c61864fa2cd249d683f8fb90d8542480 P eaa34beb1b274443b1c46839afd0a484 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:51.038225  6549 tablet_replica.cc:333] T 5e8a01e27eab492bb73df3359e500627 P eaa34beb1b274443b1c46839afd0a484: stopping tablet replica
I20260709 14:54:51.038884  6549 raft_consensus.cc:2243] T 5e8a01e27eab492bb73df3359e500627 P eaa34beb1b274443b1c46839afd0a484 [term 1 LEADER]: Raft consensus shutting down.
I20260709 14:54:51.039774  6549 raft_consensus.cc:2272] T 5e8a01e27eab492bb73df3359e500627 P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:51.042043  6549 tablet_replica.cc:333] T 8bae8108fe2a4ce0ba3e35746c7ec9d1 P eaa34beb1b274443b1c46839afd0a484: stopping tablet replica
I20260709 14:54:51.042629  6549 raft_consensus.cc:2243] T 8bae8108fe2a4ce0ba3e35746c7ec9d1 P eaa34beb1b274443b1c46839afd0a484 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:51.043112  6549 raft_consensus.cc:2272] T 8bae8108fe2a4ce0ba3e35746c7ec9d1 P eaa34beb1b274443b1c46839afd0a484 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:51.045892  6549 tablet_replica.cc:333] T 46ebd2bd84cc46e08c82a7b893e54578 P eaa34beb1b274443b1c46839afd0a484: stopping tablet replica
I20260709 14:54:51.046572  6549 raft_consensus.cc:2243] T 46ebd2bd84cc46e08c82a7b893e54578 P eaa34beb1b274443b1c46839afd0a484 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:51.047137  6549 raft_consensus.cc:2272] T 46ebd2bd84cc46e08c82a7b893e54578 P eaa34beb1b274443b1c46839afd0a484 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 14:54:51.048310 15227 consensus_peers.cc:597] T b97c761f72c14075b65e501c4b3ae0fb P 9cb8de0701f2482b99e51d5ac080aa13 -> Peer eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805): Couldn't send request to peer eaa34beb1b274443b1c46839afd0a484. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 14:54:51.049844 15227 consensus_peers.cc:597] T c7d360d2b84b4f0aa38f5c325f4521c1 P 9cb8de0701f2482b99e51d5ac080aa13 -> Peer eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805): Couldn't send request to peer eaa34beb1b274443b1c46839afd0a484. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:54:51.049932  6549 tablet_replica.cc:333] T c7d360d2b84b4f0aa38f5c325f4521c1 P eaa34beb1b274443b1c46839afd0a484: stopping tablet replica
I20260709 14:54:51.050817  6549 raft_consensus.cc:2243] T c7d360d2b84b4f0aa38f5c325f4521c1 P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:51.051505  6549 raft_consensus.cc:2272] T c7d360d2b84b4f0aa38f5c325f4521c1 P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:51.055332  6549 tablet_replica.cc:333] T ca2aa2e1a8c646069cb8b23b0ebdb0c7 P eaa34beb1b274443b1c46839afd0a484: stopping tablet replica
I20260709 14:54:51.056128  6549 raft_consensus.cc:2243] T ca2aa2e1a8c646069cb8b23b0ebdb0c7 P eaa34beb1b274443b1c46839afd0a484 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:51.056783  6549 raft_consensus.cc:2272] T ca2aa2e1a8c646069cb8b23b0ebdb0c7 P eaa34beb1b274443b1c46839afd0a484 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 14:54:51.059505 15227 consensus_peers.cc:597] T d2463fd792b240e9911c6b38bcb453b8 P 9cb8de0701f2482b99e51d5ac080aa13 -> Peer eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805): Couldn't send request to peer eaa34beb1b274443b1c46839afd0a484. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:54:51.060935  6549 tablet_replica.cc:333] T 3b4c50fac37a43c0988d5ea911d09f43 P eaa34beb1b274443b1c46839afd0a484: stopping tablet replica
I20260709 14:54:51.061903  6549 raft_consensus.cc:2243] T 3b4c50fac37a43c0988d5ea911d09f43 P eaa34beb1b274443b1c46839afd0a484 [term 3 LEADER]: Raft consensus shutting down.
I20260709 14:54:51.063032  6549 pending_rounds.cc:70] T 3b4c50fac37a43c0988d5ea911d09f43 P eaa34beb1b274443b1c46839afd0a484: Trying to abort 1 pending ops.
I20260709 14:54:51.063318  6549 pending_rounds.cc:77] T 3b4c50fac37a43c0988d5ea911d09f43 P eaa34beb1b274443b1c46839afd0a484: Aborting op as it isn't in flight: id { term: 3 index: 3 } timestamp: 7305662017327624192 op_type: NO_OP noop_request { }
I20260709 14:54:51.063632  6549 raft_consensus.cc:2889] T 3b4c50fac37a43c0988d5ea911d09f43 P eaa34beb1b274443b1c46839afd0a484 [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 14:54:51.063910  6549 raft_consensus.cc:2272] T 3b4c50fac37a43c0988d5ea911d09f43 P eaa34beb1b274443b1c46839afd0a484 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:51.067365  6549 tablet_replica.cc:333] T 6cd07fbeb9f149a08fdbac2e0247eca4 P eaa34beb1b274443b1c46839afd0a484: stopping tablet replica
I20260709 14:54:51.067994  6549 raft_consensus.cc:2243] T 6cd07fbeb9f149a08fdbac2e0247eca4 P eaa34beb1b274443b1c46839afd0a484 [term 1 LEADER]: Raft consensus shutting down.
I20260709 14:54:51.069056  6549 raft_consensus.cc:2272] T 6cd07fbeb9f149a08fdbac2e0247eca4 P eaa34beb1b274443b1c46839afd0a484 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 14:54:51.115443 15227 consensus_peers.cc:597] T c61864fa2cd249d683f8fb90d8542480 P 9cb8de0701f2482b99e51d5ac080aa13 -> Peer eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805): Couldn't send request to peer eaa34beb1b274443b1c46839afd0a484. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 14:54:51.156962 15227 consensus_peers.cc:597] T 6b5bb32eee204f2b90b1f1f14875c579 P 9cb8de0701f2482b99e51d5ac080aa13 -> Peer eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805): Couldn't send request to peer eaa34beb1b274443b1c46839afd0a484. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.67:33805: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 14:54:51.159667  6549 tablet_server.cc:196] TabletServer@127.6.101.67:0 shutdown complete.
I20260709 14:54:51.260807  6549 tablet_server.cc:179] TabletServer@127.6.101.68:0 shutting down...
I20260709 14:54:51.295572 16409 raft_consensus.cc:493] T d61f9ecebc3c4a028f5327bc9debf432 P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7519e608fbb44d9db8ad30b9f10ae605)
I20260709 14:54:51.298337 16409 raft_consensus.cc:515] T d61f9ecebc3c4a028f5327bc9debf432 P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } } peers { permanent_uuid: "dbc2c92e49e346b5b3bd7705a229afc6" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 45477 } } peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } }
I20260709 14:54:51.300623 16409 leader_election.cc:290] T d61f9ecebc3c4a028f5327bc9debf432 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477), 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177)
W20260709 14:54:51.308969 15227 leader_election.cc:336] T d61f9ecebc3c4a028f5327bc9debf432 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer dbc2c92e49e346b5b3bd7705a229afc6 (127.6.101.65:45477): Network error: Client connection negotiation failed: client connection to 127.6.101.65:45477: connect: Connection refused (error 111)
W20260709 14:54:51.310422 15224 leader_election.cc:336] T d61f9ecebc3c4a028f5327bc9debf432 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177): Network error: Client connection negotiation failed: client connection to 127.6.101.66:43177: connect: Connection refused (error 111)
I20260709 14:54:51.310881 15224 leader_election.cc:304] T d61f9ecebc3c4a028f5327bc9debf432 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cb8de0701f2482b99e51d5ac080aa13; no voters: 7519e608fbb44d9db8ad30b9f10ae605, dbc2c92e49e346b5b3bd7705a229afc6
I20260709 14:54:51.311604 16409 raft_consensus.cc:2749] T d61f9ecebc3c4a028f5327bc9debf432 P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 14:54:51.336949  6549 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 14:54:51.338177  6549 tablet_replica.cc:333] T d2463fd792b240e9911c6b38bcb453b8 P 9cb8de0701f2482b99e51d5ac080aa13: stopping tablet replica
I20260709 14:54:51.339023  6549 raft_consensus.cc:2243] T d2463fd792b240e9911c6b38bcb453b8 P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 LEADER]: Raft consensus shutting down.
I20260709 14:54:51.339991  6549 raft_consensus.cc:2272] T d2463fd792b240e9911c6b38bcb453b8 P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:51.343798  6549 tablet_replica.cc:333] T 5b9f8063585c4e5faddebd56fbe1aa01 P 9cb8de0701f2482b99e51d5ac080aa13: stopping tablet replica
I20260709 14:54:51.345062  6549 raft_consensus.cc:2243] T 5b9f8063585c4e5faddebd56fbe1aa01 P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:51.346140  6549 raft_consensus.cc:2272] T 5b9f8063585c4e5faddebd56fbe1aa01 P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:51.349380  6549 tablet_replica.cc:333] T d2273a1ad13e4c54ae2101a15a7e56e1 P 9cb8de0701f2482b99e51d5ac080aa13: stopping tablet replica
I20260709 14:54:51.350020  6549 raft_consensus.cc:2243] T d2273a1ad13e4c54ae2101a15a7e56e1 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 LEADER]: Raft consensus shutting down.
I20260709 14:54:51.350878  6549 raft_consensus.cc:2272] T d2273a1ad13e4c54ae2101a15a7e56e1 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:51.353475  6549 tablet_replica.cc:333] T 1193461bc272409e8a1e719ecdb38e7f P 9cb8de0701f2482b99e51d5ac080aa13: stopping tablet replica
I20260709 14:54:51.354202  6549 raft_consensus.cc:2243] T 1193461bc272409e8a1e719ecdb38e7f P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 LEADER]: Raft consensus shutting down.
I20260709 14:54:51.355036  6549 raft_consensus.cc:2272] T 1193461bc272409e8a1e719ecdb38e7f P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:51.356562 16409 raft_consensus.cc:493] T ca2aa2e1a8c646069cb8b23b0ebdb0c7 P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7519e608fbb44d9db8ad30b9f10ae605)
I20260709 14:54:51.357182 16409 raft_consensus.cc:515] T ca2aa2e1a8c646069cb8b23b0ebdb0c7 P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:51.358479  6549 tablet_replica.cc:333] T 4abdbdda3ce149a9904e919be18e7a3f P 9cb8de0701f2482b99e51d5ac080aa13: stopping tablet replica
I20260709 14:54:51.359405  6549 raft_consensus.cc:2243] T 4abdbdda3ce149a9904e919be18e7a3f P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:51.359728 16409 leader_election.cc:290] T ca2aa2e1a8c646069cb8b23b0ebdb0c7 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177), eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805)
I20260709 14:54:51.360538  6549 raft_consensus.cc:2272] T 4abdbdda3ce149a9904e919be18e7a3f P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:51.365449  6549 tablet_replica.cc:333] T bdf08eed05854470954a5e9dd17dfb27 P 9cb8de0701f2482b99e51d5ac080aa13: stopping tablet replica
W20260709 14:54:51.365963 15224 leader_election.cc:336] T ca2aa2e1a8c646069cb8b23b0ebdb0c7 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177): Network error: Client connection negotiation failed: client connection to 127.6.101.66:43177: connect: Connection refused (error 111)
W20260709 14:54:51.366865 15227 leader_election.cc:336] T ca2aa2e1a8c646069cb8b23b0ebdb0c7 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805): Network error: Client connection negotiation failed: client connection to 127.6.101.67:33805: connect: Connection refused (error 111)
I20260709 14:54:51.367017  6549 raft_consensus.cc:2243] T bdf08eed05854470954a5e9dd17dfb27 P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:51.367615 15227 leader_election.cc:304] T ca2aa2e1a8c646069cb8b23b0ebdb0c7 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cb8de0701f2482b99e51d5ac080aa13; no voters: 7519e608fbb44d9db8ad30b9f10ae605, eaa34beb1b274443b1c46839afd0a484
I20260709 14:54:51.368167  6549 raft_consensus.cc:2272] T bdf08eed05854470954a5e9dd17dfb27 P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:51.369397 16409 raft_consensus.cc:2749] T ca2aa2e1a8c646069cb8b23b0ebdb0c7 P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 14:54:51.371677  6549 tablet_replica.cc:333] T e43bf64543ef494790c2f7a4a063fdd1 P 9cb8de0701f2482b99e51d5ac080aa13: stopping tablet replica
I20260709 14:54:51.374158  6549 raft_consensus.cc:2243] T e43bf64543ef494790c2f7a4a063fdd1 P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:51.374842  6549 raft_consensus.cc:2272] T e43bf64543ef494790c2f7a4a063fdd1 P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:51.377291  6549 tablet_replica.cc:333] T d178b88fdab54a29b05fb98e05ffe8c5 P 9cb8de0701f2482b99e51d5ac080aa13: stopping tablet replica
I20260709 14:54:51.378257  6549 raft_consensus.cc:2243] T d178b88fdab54a29b05fb98e05ffe8c5 P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:51.378834  6549 raft_consensus.cc:2272] T d178b88fdab54a29b05fb98e05ffe8c5 P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:51.381716  6549 tablet_replica.cc:333] T ff73c3d51e5e480c920d1aca00b9b40d P 9cb8de0701f2482b99e51d5ac080aa13: stopping tablet replica
I20260709 14:54:51.382725  6549 raft_consensus.cc:2243] T ff73c3d51e5e480c920d1aca00b9b40d P 9cb8de0701f2482b99e51d5ac080aa13 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:51.383471  6549 raft_consensus.cc:2272] T ff73c3d51e5e480c920d1aca00b9b40d P 9cb8de0701f2482b99e51d5ac080aa13 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:51.386711  6549 tablet_replica.cc:333] T 5585b0f6bbf04c10865d2463767621dc P 9cb8de0701f2482b99e51d5ac080aa13: stopping tablet replica
I20260709 14:54:51.387643  6549 raft_consensus.cc:2243] T 5585b0f6bbf04c10865d2463767621dc P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:51.388259  6549 raft_consensus.cc:2272] T 5585b0f6bbf04c10865d2463767621dc P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:51.391497  6549 tablet_replica.cc:333] T dd44b332dc744f94a5f7cfffc06f3956 P 9cb8de0701f2482b99e51d5ac080aa13: stopping tablet replica
I20260709 14:54:51.392751  6549 raft_consensus.cc:2243] T dd44b332dc744f94a5f7cfffc06f3956 P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:51.393544  6549 raft_consensus.cc:2272] T dd44b332dc744f94a5f7cfffc06f3956 P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:51.395087 16409 raft_consensus.cc:493] T 0b12879f49fa4d52a477be2e490f2b38 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7519e608fbb44d9db8ad30b9f10ae605)
I20260709 14:54:51.395704 16409 raft_consensus.cc:515] T 0b12879f49fa4d52a477be2e490f2b38 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:51.396426  6549 tablet_replica.cc:333] T 0b12879f49fa4d52a477be2e490f2b38 P 9cb8de0701f2482b99e51d5ac080aa13: stopping tablet replica
I20260709 14:54:51.397406  6549 raft_consensus.cc:2243] T 0b12879f49fa4d52a477be2e490f2b38 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:51.398037  6549 raft_consensus.cc:2272] T 0b12879f49fa4d52a477be2e490f2b38 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:51.398144 16409 leader_election.cc:290] T 0b12879f49fa4d52a477be2e490f2b38 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177), eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805)
I20260709 14:54:51.402446  6549 tablet_replica.cc:333] T 9275d24f141d455cb200b9784c470d33 P 9cb8de0701f2482b99e51d5ac080aa13: stopping tablet replica
W20260709 14:54:51.403442 15224 leader_election.cc:336] T 0b12879f49fa4d52a477be2e490f2b38 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177): Network error: Client connection negotiation failed: client connection to 127.6.101.66:43177: connect: Connection refused (error 111)
I20260709 14:54:51.403513  6549 raft_consensus.cc:2243] T 9275d24f141d455cb200b9784c470d33 P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 LEADER]: Raft consensus shutting down.
W20260709 14:54:51.404983 15227 leader_election.cc:336] T 0b12879f49fa4d52a477be2e490f2b38 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805): Network error: Client connection negotiation failed: client connection to 127.6.101.67:33805: connect: Connection refused (error 111)
I20260709 14:54:51.405521  6549 raft_consensus.cc:2272] T 9275d24f141d455cb200b9784c470d33 P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:51.405612 15227 leader_election.cc:304] T 0b12879f49fa4d52a477be2e490f2b38 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cb8de0701f2482b99e51d5ac080aa13; no voters: 7519e608fbb44d9db8ad30b9f10ae605, eaa34beb1b274443b1c46839afd0a484
W20260709 14:54:51.406615 15227 raft_consensus.cc:2686] T 0b12879f49fa4d52a477be2e490f2b38 P 9cb8de0701f2482b99e51d5ac080aa13: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 14:54:51.408871  6549 tablet_replica.cc:333] T 8974e5ab032b4fba92bfc577280778bf P 9cb8de0701f2482b99e51d5ac080aa13: stopping tablet replica
I20260709 14:54:51.409809  6549 raft_consensus.cc:2243] T 8974e5ab032b4fba92bfc577280778bf P 9cb8de0701f2482b99e51d5ac080aa13 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:51.410322  6549 raft_consensus.cc:2272] T 8974e5ab032b4fba92bfc577280778bf P 9cb8de0701f2482b99e51d5ac080aa13 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:51.414597  6549 tablet_replica.cc:333] T 6b5bb32eee204f2b90b1f1f14875c579 P 9cb8de0701f2482b99e51d5ac080aa13: stopping tablet replica
I20260709 14:54:51.415308  6549 raft_consensus.cc:2243] T 6b5bb32eee204f2b90b1f1f14875c579 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 LEADER]: Raft consensus shutting down.
I20260709 14:54:51.416734  6549 raft_consensus.cc:2272] T 6b5bb32eee204f2b90b1f1f14875c579 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:51.419216  6549 tablet_replica.cc:333] T cc6f522768894933b21bc94b41605166 P 9cb8de0701f2482b99e51d5ac080aa13: stopping tablet replica
I20260709 14:54:51.419945  6549 raft_consensus.cc:2243] T cc6f522768894933b21bc94b41605166 P 9cb8de0701f2482b99e51d5ac080aa13 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:51.420432  6549 raft_consensus.cc:2272] T cc6f522768894933b21bc94b41605166 P 9cb8de0701f2482b99e51d5ac080aa13 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:51.422730  6549 tablet_replica.cc:333] T 42d6909533d14edbbfdad30a9972658d P 9cb8de0701f2482b99e51d5ac080aa13: stopping tablet replica
I20260709 14:54:51.423532  6549 raft_consensus.cc:2243] T 42d6909533d14edbbfdad30a9972658d P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:51.424014  6549 raft_consensus.cc:2272] T 42d6909533d14edbbfdad30a9972658d P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:51.427223  6549 tablet_replica.cc:333] T a1075567fc91458ca7cc9977cf02b170 P 9cb8de0701f2482b99e51d5ac080aa13: stopping tablet replica
I20260709 14:54:51.428013  6549 raft_consensus.cc:2243] T a1075567fc91458ca7cc9977cf02b170 P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:51.428490  6549 raft_consensus.cc:2272] T a1075567fc91458ca7cc9977cf02b170 P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:51.432219  6549 tablet_replica.cc:333] T 46a35b81512c4e8c8ec6b83d4c768e1f P 9cb8de0701f2482b99e51d5ac080aa13: stopping tablet replica
I20260709 14:54:51.432981  6549 raft_consensus.cc:2243] T 46a35b81512c4e8c8ec6b83d4c768e1f P 9cb8de0701f2482b99e51d5ac080aa13 [term 3 LEADER]: Raft consensus shutting down.
I20260709 14:54:51.434202  6549 raft_consensus.cc:2272] T 46a35b81512c4e8c8ec6b83d4c768e1f P 9cb8de0701f2482b99e51d5ac080aa13 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:51.436977  6549 tablet_replica.cc:333] T d61f9ecebc3c4a028f5327bc9debf432 P 9cb8de0701f2482b99e51d5ac080aa13: stopping tablet replica
I20260709 14:54:51.437732  6549 raft_consensus.cc:2243] T d61f9ecebc3c4a028f5327bc9debf432 P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:51.438261  6549 raft_consensus.cc:2272] T d61f9ecebc3c4a028f5327bc9debf432 P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:51.441758  6549 tablet_replica.cc:333] T 594083b10772433f90560d387bbbeabe P 9cb8de0701f2482b99e51d5ac080aa13: stopping tablet replica
I20260709 14:54:51.442456  6549 raft_consensus.cc:2243] T 594083b10772433f90560d387bbbeabe P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:51.443064  6549 raft_consensus.cc:2272] T 594083b10772433f90560d387bbbeabe P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:51.445222  6549 tablet_replica.cc:333] T d86dfc13b2834d7e8b2ad5f975f08154 P 9cb8de0701f2482b99e51d5ac080aa13: stopping tablet replica
I20260709 14:54:51.446216  6549 raft_consensus.cc:2243] T d86dfc13b2834d7e8b2ad5f975f08154 P 9cb8de0701f2482b99e51d5ac080aa13 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:51.446784  6549 raft_consensus.cc:2272] T d86dfc13b2834d7e8b2ad5f975f08154 P 9cb8de0701f2482b99e51d5ac080aa13 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:51.449492  6549 tablet_replica.cc:333] T d2c4ea1c33c64cd09ba04611fdbdc59d P 9cb8de0701f2482b99e51d5ac080aa13: stopping tablet replica
I20260709 14:54:51.450212  6549 raft_consensus.cc:2243] T d2c4ea1c33c64cd09ba04611fdbdc59d P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 LEADER]: Raft consensus shutting down.
I20260709 14:54:51.451709  6549 raft_consensus.cc:2272] T d2c4ea1c33c64cd09ba04611fdbdc59d P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:51.454479  6549 tablet_replica.cc:333] T 46ebd2bd84cc46e08c82a7b893e54578 P 9cb8de0701f2482b99e51d5ac080aa13: stopping tablet replica
I20260709 14:54:51.455181  6549 raft_consensus.cc:2243] T 46ebd2bd84cc46e08c82a7b893e54578 P 9cb8de0701f2482b99e51d5ac080aa13 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:51.455678  6549 raft_consensus.cc:2272] T 46ebd2bd84cc46e08c82a7b893e54578 P 9cb8de0701f2482b99e51d5ac080aa13 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:51.458429  6549 tablet_replica.cc:333] T 7699ad132e12472180b6a9527951c397 P 9cb8de0701f2482b99e51d5ac080aa13: stopping tablet replica
I20260709 14:54:51.459089  6549 raft_consensus.cc:2243] T 7699ad132e12472180b6a9527951c397 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 LEADER]: Raft consensus shutting down.
I20260709 14:54:51.459924  6549 raft_consensus.cc:2272] T 7699ad132e12472180b6a9527951c397 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:51.463570  6549 tablet_replica.cc:333] T c61864fa2cd249d683f8fb90d8542480 P 9cb8de0701f2482b99e51d5ac080aa13: stopping tablet replica
I20260709 14:54:51.464339  6549 raft_consensus.cc:2243] T c61864fa2cd249d683f8fb90d8542480 P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 LEADER]: Raft consensus shutting down.
I20260709 14:54:51.465454  6549 raft_consensus.cc:2272] T c61864fa2cd249d683f8fb90d8542480 P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:51.468271  6549 tablet_replica.cc:333] T a018e41c89854091a15a6a8e4deffbdd P 9cb8de0701f2482b99e51d5ac080aa13: stopping tablet replica
I20260709 14:54:51.469008  6549 raft_consensus.cc:2243] T a018e41c89854091a15a6a8e4deffbdd P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 LEADER]: Raft consensus shutting down.
I20260709 14:54:51.470571  6549 raft_consensus.cc:2272] T a018e41c89854091a15a6a8e4deffbdd P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:51.473053  6549 tablet_replica.cc:333] T 67409326aa124c52a5e9a650d7570a68 P 9cb8de0701f2482b99e51d5ac080aa13: stopping tablet replica
I20260709 14:54:51.473721  6549 raft_consensus.cc:2243] T 67409326aa124c52a5e9a650d7570a68 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 LEADER]: Raft consensus shutting down.
I20260709 14:54:51.474596  6549 raft_consensus.cc:2272] T 67409326aa124c52a5e9a650d7570a68 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:51.476814  6549 tablet_replica.cc:333] T f706543d4d3e4e7291624a785ca4e747 P 9cb8de0701f2482b99e51d5ac080aa13: stopping tablet replica
I20260709 14:54:51.477515  6549 raft_consensus.cc:2243] T f706543d4d3e4e7291624a785ca4e747 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:51.478011  6549 raft_consensus.cc:2272] T f706543d4d3e4e7291624a785ca4e747 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:51.480959  6549 tablet_replica.cc:333] T c7d360d2b84b4f0aa38f5c325f4521c1 P 9cb8de0701f2482b99e51d5ac080aa13: stopping tablet replica
I20260709 14:54:51.482052  6549 raft_consensus.cc:2243] T c7d360d2b84b4f0aa38f5c325f4521c1 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 LEADER]: Raft consensus shutting down.
I20260709 14:54:51.483587  6549 raft_consensus.cc:2272] T c7d360d2b84b4f0aa38f5c325f4521c1 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:51.486639  6549 tablet_replica.cc:333] T ca2aa2e1a8c646069cb8b23b0ebdb0c7 P 9cb8de0701f2482b99e51d5ac080aa13: stopping tablet replica
I20260709 14:54:51.487349  6549 raft_consensus.cc:2243] T ca2aa2e1a8c646069cb8b23b0ebdb0c7 P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:51.487824  6549 raft_consensus.cc:2272] T ca2aa2e1a8c646069cb8b23b0ebdb0c7 P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:51.490185  6549 tablet_replica.cc:333] T 4f709a060be148029cf72f1af6f79714 P 9cb8de0701f2482b99e51d5ac080aa13: stopping tablet replica
I20260709 14:54:51.490861  6549 raft_consensus.cc:2243] T 4f709a060be148029cf72f1af6f79714 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 LEADER]: Raft consensus shutting down.
I20260709 14:54:51.491935  6549 raft_consensus.cc:2272] T 4f709a060be148029cf72f1af6f79714 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:51.494462  6549 tablet_replica.cc:333] T 98280a706ec54413830f342b48666f6e P 9cb8de0701f2482b99e51d5ac080aa13: stopping tablet replica
I20260709 14:54:51.495154  6549 raft_consensus.cc:2243] T 98280a706ec54413830f342b48666f6e P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:51.495649  6549 raft_consensus.cc:2272] T 98280a706ec54413830f342b48666f6e P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:51.497824  6549 tablet_replica.cc:333] T d6bcaee371174feaa06943f949efda49 P 9cb8de0701f2482b99e51d5ac080aa13: stopping tablet replica
I20260709 14:54:51.498422  6549 raft_consensus.cc:2243] T d6bcaee371174feaa06943f949efda49 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:51.498876  6549 raft_consensus.cc:2272] T d6bcaee371174feaa06943f949efda49 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:51.501621  6549 tablet_replica.cc:333] T 0284d9835221427ab285015d48a8040d P 9cb8de0701f2482b99e51d5ac080aa13: stopping tablet replica
I20260709 14:54:51.502264  6549 raft_consensus.cc:2243] T 0284d9835221427ab285015d48a8040d P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 LEADER]: Raft consensus shutting down.
I20260709 14:54:51.503530  6549 raft_consensus.cc:2272] T 0284d9835221427ab285015d48a8040d P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:51.505842  6549 tablet_replica.cc:333] T 1159198eabeb409996ccbec0cac057f8 P 9cb8de0701f2482b99e51d5ac080aa13: stopping tablet replica
I20260709 14:54:51.506448  6549 raft_consensus.cc:2243] T 1159198eabeb409996ccbec0cac057f8 P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:51.507215  6549 raft_consensus.cc:2272] T 1159198eabeb409996ccbec0cac057f8 P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:51.509797  6549 tablet_replica.cc:333] T 054739df584d4b9db840777c2ae17555 P 9cb8de0701f2482b99e51d5ac080aa13: stopping tablet replica
I20260709 14:54:51.511015 16409 raft_consensus.cc:493] T f8b33962eab84819b17953e44eae71a1 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7519e608fbb44d9db8ad30b9f10ae605)
I20260709 14:54:51.511204  6549 raft_consensus.cc:2243] T 054739df584d4b9db840777c2ae17555 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:51.511714 16409 raft_consensus.cc:515] T f8b33962eab84819b17953e44eae71a1 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7519e608fbb44d9db8ad30b9f10ae605" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 43177 } } peers { permanent_uuid: "eaa34beb1b274443b1c46839afd0a484" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33805 } } peers { permanent_uuid: "9cb8de0701f2482b99e51d5ac080aa13" member_type: VOTER last_known_addr { host: "127.6.101.68" port: 45493 } }
I20260709 14:54:51.512238  6549 raft_consensus.cc:2272] T 054739df584d4b9db840777c2ae17555 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:51.514104 16409 leader_election.cc:290] T f8b33962eab84819b17953e44eae71a1 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177), eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805)
I20260709 14:54:51.516283  6549 tablet_replica.cc:333] T b97c761f72c14075b65e501c4b3ae0fb P 9cb8de0701f2482b99e51d5ac080aa13: stopping tablet replica
I20260709 14:54:51.517184  6549 raft_consensus.cc:2243] T b97c761f72c14075b65e501c4b3ae0fb P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 LEADER]: Raft consensus shutting down.
I20260709 14:54:51.518358  6549 raft_consensus.cc:2272] T b97c761f72c14075b65e501c4b3ae0fb P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 14:54:51.518911 15224 leader_election.cc:336] T f8b33962eab84819b17953e44eae71a1 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7519e608fbb44d9db8ad30b9f10ae605 (127.6.101.66:43177): Network error: Client connection negotiation failed: client connection to 127.6.101.66:43177: connect: Connection refused (error 111)
W20260709 14:54:51.519572 15227 leader_election.cc:336] T f8b33962eab84819b17953e44eae71a1 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer eaa34beb1b274443b1c46839afd0a484 (127.6.101.67:33805): Network error: Client connection negotiation failed: client connection to 127.6.101.67:33805: connect: Connection refused (error 111)
I20260709 14:54:51.520000 15227 leader_election.cc:304] T f8b33962eab84819b17953e44eae71a1 P 9cb8de0701f2482b99e51d5ac080aa13 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cb8de0701f2482b99e51d5ac080aa13; no voters: 7519e608fbb44d9db8ad30b9f10ae605, eaa34beb1b274443b1c46839afd0a484
I20260709 14:54:51.520665 16409 raft_consensus.cc:2749] T f8b33962eab84819b17953e44eae71a1 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 14:54:51.520903  6549 tablet_replica.cc:333] T f8b33962eab84819b17953e44eae71a1 P 9cb8de0701f2482b99e51d5ac080aa13: stopping tablet replica
I20260709 14:54:51.521653  6549 raft_consensus.cc:2243] T f8b33962eab84819b17953e44eae71a1 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:51.522161  6549 raft_consensus.cc:2272] T f8b33962eab84819b17953e44eae71a1 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:51.524631  6549 tablet_replica.cc:333] T 342798bf4325470fa3991757eadb0764 P 9cb8de0701f2482b99e51d5ac080aa13: stopping tablet replica
I20260709 14:54:51.525301  6549 raft_consensus.cc:2243] T 342798bf4325470fa3991757eadb0764 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:51.525765  6549 raft_consensus.cc:2272] T 342798bf4325470fa3991757eadb0764 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:51.527838  6549 tablet_replica.cc:333] T b7c363a305d3434092ef6016b7064eb3 P 9cb8de0701f2482b99e51d5ac080aa13: stopping tablet replica
I20260709 14:54:51.528386  6549 raft_consensus.cc:2243] T b7c363a305d3434092ef6016b7064eb3 P 9cb8de0701f2482b99e51d5ac080aa13 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:51.528817  6549 raft_consensus.cc:2272] T b7c363a305d3434092ef6016b7064eb3 P 9cb8de0701f2482b99e51d5ac080aa13 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:51.530906  6549 tablet_replica.cc:333] T b8d6b9cf24a24444b2a69fd526cd4b09 P 9cb8de0701f2482b99e51d5ac080aa13: stopping tablet replica
I20260709 14:54:51.531438  6549 raft_consensus.cc:2243] T b8d6b9cf24a24444b2a69fd526cd4b09 P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:51.531885  6549 raft_consensus.cc:2272] T b8d6b9cf24a24444b2a69fd526cd4b09 P 9cb8de0701f2482b99e51d5ac080aa13 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:51.533916  6549 tablet_replica.cc:333] T 3b4c50fac37a43c0988d5ea911d09f43 P 9cb8de0701f2482b99e51d5ac080aa13: stopping tablet replica
I20260709 14:54:51.534427  6549 raft_consensus.cc:2243] T 3b4c50fac37a43c0988d5ea911d09f43 P 9cb8de0701f2482b99e51d5ac080aa13 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:51.534840  6549 raft_consensus.cc:2272] T 3b4c50fac37a43c0988d5ea911d09f43 P 9cb8de0701f2482b99e51d5ac080aa13 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:51.536712  6549 tablet_replica.cc:333] T 6cd07fbeb9f149a08fdbac2e0247eca4 P 9cb8de0701f2482b99e51d5ac080aa13: stopping tablet replica
I20260709 14:54:51.537200  6549 raft_consensus.cc:2243] T 6cd07fbeb9f149a08fdbac2e0247eca4 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:51.537710  6549 raft_consensus.cc:2272] T 6cd07fbeb9f149a08fdbac2e0247eca4 P 9cb8de0701f2482b99e51d5ac080aa13 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:51.617575  6549 tablet_server.cc:196] TabletServer@127.6.101.68:0 shutdown complete.
I20260709 14:54:51.691325  6549 master.cc:562] Master@127.6.101.126:35373 shutting down...
I20260709 14:54:51.732262  6549 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 1087f77b67cc4cb1a841d6c146b1af47 [term 1 LEADER]: Raft consensus shutting down.
I20260709 14:54:51.733021  6549 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 1087f77b67cc4cb1a841d6c146b1af47 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:51.733471  6549 tablet_replica.cc:333] T 00000000000000000000000000000000 P 1087f77b67cc4cb1a841d6c146b1af47: stopping tablet replica
I20260709 14:54:51.758628  6549 master.cc:584] Master@127.6.101.126:35373 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (43125 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 14:54:51.866714  6549 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.6.101.126:42521
I20260709 14:54:51.868170  6549 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 14:54:51.876735 16419 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 14:54:51.878379 16420 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 14:54:51.879151 16422 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 14:54:51.881460  6549 server_base.cc:1061] running on GCE node
I20260709 14:54:51.883527  6549 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 14:54:51.883849  6549 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 14:54:51.884163  6549 hybrid_clock.cc:648] HybridClock initialized: now 1783608891884104 us; error 0 us; skew 500 ppm
I20260709 14:54:51.885172  6549 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 14:54:51.888494  6549 webserver.cc:533] Webserver started at http://127.6.101.126:35115/ using document root <none> and password file <none>
I20260709 14:54:51.889074  6549 fs_manager.cc:362] Metadata directory not provided
I20260709 14:54:51.889307  6549 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 14:54:51.889634  6549 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 14:54:51.890843  6549 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783608571892863-6549-0/minicluster-data/master-0-root/instance:
uuid: "589d8c6bb5194c5abbf34b2b5b715fa2"
format_stamp: "Formatted at 2026-07-09 14:54:51 on dist-test-slave-lv34"
I20260709 14:54:51.896356  6549 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.002s
I20260709 14:54:51.902390 16427 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 14:54:51.903558  6549 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 14:54:51.903964  6549 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783608571892863-6549-0/minicluster-data/master-0-root
uuid: "589d8c6bb5194c5abbf34b2b5b715fa2"
format_stamp: "Formatted at 2026-07-09 14:54:51 on dist-test-slave-lv34"
I20260709 14:54:51.904529  6549 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783608571892863-6549-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783608571892863-6549-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783608571892863-6549-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 14:54:51.928589  6549 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 14:54:51.930953  6549 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 14:54:51.989732  6549 rpc_server.cc:307] RPC server started. Bound to: 127.6.101.126:42521
I20260709 14:54:51.989866 16478 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.101.126:42521 every 8 connection(s)
I20260709 14:54:51.996724 16479 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:52.016546 16479 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 589d8c6bb5194c5abbf34b2b5b715fa2: Bootstrap starting.
I20260709 14:54:52.023521 16479 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 589d8c6bb5194c5abbf34b2b5b715fa2: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:52.029357 16479 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 589d8c6bb5194c5abbf34b2b5b715fa2: No bootstrap required, opened a new log
I20260709 14:54:52.032078 16479 raft_consensus.cc:359] T 00000000000000000000000000000000 P 589d8c6bb5194c5abbf34b2b5b715fa2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "589d8c6bb5194c5abbf34b2b5b715fa2" member_type: VOTER }
I20260709 14:54:52.032605 16479 raft_consensus.cc:385] T 00000000000000000000000000000000 P 589d8c6bb5194c5abbf34b2b5b715fa2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:52.032882 16479 raft_consensus.cc:740] T 00000000000000000000000000000000 P 589d8c6bb5194c5abbf34b2b5b715fa2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 589d8c6bb5194c5abbf34b2b5b715fa2, State: Initialized, Role: FOLLOWER
I20260709 14:54:52.033901 16479 consensus_queue.cc:260] T 00000000000000000000000000000000 P 589d8c6bb5194c5abbf34b2b5b715fa2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "589d8c6bb5194c5abbf34b2b5b715fa2" member_type: VOTER }
I20260709 14:54:52.034534 16479 raft_consensus.cc:399] T 00000000000000000000000000000000 P 589d8c6bb5194c5abbf34b2b5b715fa2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 14:54:52.034786 16479 raft_consensus.cc:493] T 00000000000000000000000000000000 P 589d8c6bb5194c5abbf34b2b5b715fa2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 14:54:52.035087 16479 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 589d8c6bb5194c5abbf34b2b5b715fa2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:52.042900 16479 raft_consensus.cc:515] T 00000000000000000000000000000000 P 589d8c6bb5194c5abbf34b2b5b715fa2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "589d8c6bb5194c5abbf34b2b5b715fa2" member_type: VOTER }
I20260709 14:54:52.043630 16479 leader_election.cc:304] T 00000000000000000000000000000000 P 589d8c6bb5194c5abbf34b2b5b715fa2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 589d8c6bb5194c5abbf34b2b5b715fa2; no voters: 
I20260709 14:54:52.045490 16479 leader_election.cc:290] T 00000000000000000000000000000000 P 589d8c6bb5194c5abbf34b2b5b715fa2 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 14:54:52.046290 16482 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 589d8c6bb5194c5abbf34b2b5b715fa2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:54:52.047996 16482 raft_consensus.cc:697] T 00000000000000000000000000000000 P 589d8c6bb5194c5abbf34b2b5b715fa2 [term 1 LEADER]: Becoming Leader. State: Replica: 589d8c6bb5194c5abbf34b2b5b715fa2, State: Running, Role: LEADER
I20260709 14:54:52.048887 16482 consensus_queue.cc:237] T 00000000000000000000000000000000 P 589d8c6bb5194c5abbf34b2b5b715fa2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "589d8c6bb5194c5abbf34b2b5b715fa2" member_type: VOTER }
I20260709 14:54:52.049124 16479 sys_catalog.cc:565] T 00000000000000000000000000000000 P 589d8c6bb5194c5abbf34b2b5b715fa2 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 14:54:52.055838 16483 sys_catalog.cc:455] T 00000000000000000000000000000000 P 589d8c6bb5194c5abbf34b2b5b715fa2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "589d8c6bb5194c5abbf34b2b5b715fa2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "589d8c6bb5194c5abbf34b2b5b715fa2" member_type: VOTER } }
I20260709 14:54:52.056679 16483 sys_catalog.cc:458] T 00000000000000000000000000000000 P 589d8c6bb5194c5abbf34b2b5b715fa2 [sys.catalog]: This master's current role is: LEADER
I20260709 14:54:52.056478 16484 sys_catalog.cc:455] T 00000000000000000000000000000000 P 589d8c6bb5194c5abbf34b2b5b715fa2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 589d8c6bb5194c5abbf34b2b5b715fa2. Latest consensus state: current_term: 1 leader_uuid: "589d8c6bb5194c5abbf34b2b5b715fa2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "589d8c6bb5194c5abbf34b2b5b715fa2" member_type: VOTER } }
I20260709 14:54:52.057713 16484 sys_catalog.cc:458] T 00000000000000000000000000000000 P 589d8c6bb5194c5abbf34b2b5b715fa2 [sys.catalog]: This master's current role is: LEADER
I20260709 14:54:52.061462 16489 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 14:54:52.070344 16489 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 14:54:52.072899  6549 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 14:54:52.083106 16489 catalog_manager.cc:1383] Generated new cluster ID: 4c4b8f67567148928402ddf8668de52a
I20260709 14:54:52.083493 16489 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 14:54:52.105504 16489 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 14:54:52.108803 16489 catalog_manager.cc:1540] Loading token signing keys...
I20260709 14:54:52.127538 16489 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 589d8c6bb5194c5abbf34b2b5b715fa2: Generated new TSK 0
I20260709 14:54:52.128337 16489 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 14:54:52.143790  6549 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 14:54:52.153393 16500 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 14:54:52.155670 16501 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 14:54:52.158480  6549 server_base.cc:1061] running on GCE node
W20260709 14:54:52.158583 16503 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 14:54:52.160456  6549 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 14:54:52.160742  6549 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 14:54:52.160879  6549 hybrid_clock.cc:648] HybridClock initialized: now 1783608892160867 us; error 0 us; skew 500 ppm
I20260709 14:54:52.161743  6549 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 14:54:52.165310  6549 webserver.cc:533] Webserver started at http://127.6.101.65:33525/ using document root <none> and password file <none>
I20260709 14:54:52.166183  6549 fs_manager.cc:362] Metadata directory not provided
I20260709 14:54:52.166532  6549 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 14:54:52.166873  6549 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 14:54:52.168108  6549 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783608571892863-6549-0/minicluster-data/ts-0-root/instance:
uuid: "1cb7a022bda844bfb69fec38131c8e31"
format_stamp: "Formatted at 2026-07-09 14:54:52 on dist-test-slave-lv34"
I20260709 14:54:52.173831  6549 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.002s
I20260709 14:54:52.178610 16508 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 14:54:52.179958  6549 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 14:54:52.180413  6549 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783608571892863-6549-0/minicluster-data/ts-0-root
uuid: "1cb7a022bda844bfb69fec38131c8e31"
format_stamp: "Formatted at 2026-07-09 14:54:52 on dist-test-slave-lv34"
I20260709 14:54:52.180734  6549 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783608571892863-6549-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783608571892863-6549-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783608571892863-6549-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 14:54:52.202802  6549 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 14:54:52.204840  6549 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 14:54:52.207633  6549 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 14:54:52.211278  6549 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 14:54:52.211583  6549 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 14:54:52.211894  6549 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 14:54:52.212128  6549 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 14:54:52.276080  6549 rpc_server.cc:307] RPC server started. Bound to: 127.6.101.65:41617
I20260709 14:54:52.276160 16570 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.101.65:41617 every 8 connection(s)
I20260709 14:54:52.281740  6549 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 14:54:52.291033 16575 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 14:54:52.293152 16576 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 14:54:52.298497  6549 server_base.cc:1061] running on GCE node
W20260709 14:54:52.298480 16578 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 14:54:52.299440 16571 heartbeater.cc:344] Connected to a master server at 127.6.101.126:42521
I20260709 14:54:52.299907 16571 heartbeater.cc:461] Registering TS with master...
I20260709 14:54:52.300843 16571 heartbeater.cc:507] Master 127.6.101.126:42521 requested a full tablet report, sending...
I20260709 14:54:52.301805  6549 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 14:54:52.302240  6549 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 14:54:52.302451  6549 hybrid_clock.cc:648] HybridClock initialized: now 1783608892302427 us; error 0 us; skew 500 ppm
I20260709 14:54:52.303160  6549 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 14:54:52.303824 16444 ts_manager.cc:194] Registered new tserver with Master: 1cb7a022bda844bfb69fec38131c8e31 (127.6.101.65:41617)
I20260709 14:54:52.306741  6549 webserver.cc:533] Webserver started at http://127.6.101.66:33295/ using document root <none> and password file <none>
I20260709 14:54:52.306811 16444 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36286
I20260709 14:54:52.307494  6549 fs_manager.cc:362] Metadata directory not provided
I20260709 14:54:52.307832  6549 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 14:54:52.308145  6549 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 14:54:52.310444  6549 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783608571892863-6549-0/minicluster-data/ts-1-root/instance:
uuid: "f3160b8200a64810983bda11c4af8fff"
format_stamp: "Formatted at 2026-07-09 14:54:52 on dist-test-slave-lv34"
I20260709 14:54:52.316890  6549 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.007s	sys 0.000s
I20260709 14:54:52.321760 16583 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 14:54:52.322687  6549 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 14:54:52.323184  6549 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783608571892863-6549-0/minicluster-data/ts-1-root
uuid: "f3160b8200a64810983bda11c4af8fff"
format_stamp: "Formatted at 2026-07-09 14:54:52 on dist-test-slave-lv34"
I20260709 14:54:52.323527  6549 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783608571892863-6549-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783608571892863-6549-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783608571892863-6549-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 14:54:52.343479  6549 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 14:54:52.345778  6549 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 14:54:52.347802  6549 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 14:54:52.350584  6549 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 14:54:52.350806  6549 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 14:54:52.351014  6549 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 14:54:52.351186  6549 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 14:54:52.413755  6549 rpc_server.cc:307] RPC server started. Bound to: 127.6.101.66:35977
I20260709 14:54:52.413954 16645 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.101.66:35977 every 8 connection(s)
I20260709 14:54:52.423138  6549 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 14:54:52.432438 16650 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 14:54:52.432384 16649 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 14:54:52.438877 16646 heartbeater.cc:344] Connected to a master server at 127.6.101.126:42521
W20260709 14:54:52.439046 16653 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 14:54:52.439524 16646 heartbeater.cc:461] Registering TS with master...
I20260709 14:54:52.440712 16646 heartbeater.cc:507] Master 127.6.101.126:42521 requested a full tablet report, sending...
I20260709 14:54:52.442760  6549 server_base.cc:1061] running on GCE node
I20260709 14:54:52.443737 16444 ts_manager.cc:194] Registered new tserver with Master: f3160b8200a64810983bda11c4af8fff (127.6.101.66:35977)
I20260709 14:54:52.444113  6549 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 14:54:52.444384  6549 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 14:54:52.444579  6549 hybrid_clock.cc:648] HybridClock initialized: now 1783608892444560 us; error 0 us; skew 500 ppm
I20260709 14:54:52.445232  6549 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 14:54:52.445612 16444 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36298
I20260709 14:54:52.448824  6549 webserver.cc:533] Webserver started at http://127.6.101.67:34209/ using document root <none> and password file <none>
I20260709 14:54:52.449687  6549 fs_manager.cc:362] Metadata directory not provided
I20260709 14:54:52.449892  6549 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 14:54:52.450193  6549 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 14:54:52.451506  6549 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783608571892863-6549-0/minicluster-data/ts-2-root/instance:
uuid: "93374462fb7d40ac80f3d526d4547642"
format_stamp: "Formatted at 2026-07-09 14:54:52 on dist-test-slave-lv34"
I20260709 14:54:52.456815  6549 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 14:54:52.461118 16657 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 14:54:52.462623  6549 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 14:54:52.462996  6549 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783608571892863-6549-0/minicluster-data/ts-2-root
uuid: "93374462fb7d40ac80f3d526d4547642"
format_stamp: "Formatted at 2026-07-09 14:54:52 on dist-test-slave-lv34"
I20260709 14:54:52.463306  6549 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783608571892863-6549-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783608571892863-6549-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783608571892863-6549-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 14:54:52.495223  6549 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 14:54:52.496630  6549 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 14:54:52.498492  6549 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 14:54:52.501195  6549 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 14:54:52.501514  6549 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.001s	sys 0.000s
I20260709 14:54:52.501803  6549 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 14:54:52.501973  6549 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 14:54:52.570086  6549 rpc_server.cc:307] RPC server started. Bound to: 127.6.101.67:41835
I20260709 14:54:52.570281 16719 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.101.67:41835 every 8 connection(s)
I20260709 14:54:52.594898 16720 heartbeater.cc:344] Connected to a master server at 127.6.101.126:42521
I20260709 14:54:52.595436 16720 heartbeater.cc:461] Registering TS with master...
I20260709 14:54:52.596294 16720 heartbeater.cc:507] Master 127.6.101.126:42521 requested a full tablet report, sending...
I20260709 14:54:52.599538 16444 ts_manager.cc:194] Registered new tserver with Master: 93374462fb7d40ac80f3d526d4547642 (127.6.101.67:41835)
I20260709 14:54:52.600767  6549 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.026063162s
I20260709 14:54:52.601495 16444 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36314
I20260709 14:54:52.641638 16444 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36330:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 14:54:52.645210 16444 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 14:54:52.744302 16534 tablet_service.cc:1511] Processing CreateTablet for tablet 48f69b6ba5bd492b8470cb9edfa3fc49 (DEFAULT_TABLE table=test-workload [id=3bba08b579a14fb6ab6c447cc17c72f7]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 14:54:52.744721 16535 tablet_service.cc:1511] Processing CreateTablet for tablet 43486d5085024ad4ab238eb24756ce7b (DEFAULT_TABLE table=test-workload [id=3bba08b579a14fb6ab6c447cc17c72f7]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 14:54:52.749296 16534 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48f69b6ba5bd492b8470cb9edfa3fc49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:52.749056 16533 tablet_service.cc:1511] Processing CreateTablet for tablet 27e19d91f3664b33a47fc21010adb06d (DEFAULT_TABLE table=test-workload [id=3bba08b579a14fb6ab6c447cc17c72f7]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 14:54:52.749841 16536 tablet_service.cc:1511] Processing CreateTablet for tablet 9a69054eca44462f8f9d0ecadd574a2a (DEFAULT_TABLE table=test-workload [id=3bba08b579a14fb6ab6c447cc17c72f7]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 14:54:52.753881 16536 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a69054eca44462f8f9d0ecadd574a2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:52.756883 16611 tablet_service.cc:1511] Processing CreateTablet for tablet 9a69054eca44462f8f9d0ecadd574a2a (DEFAULT_TABLE table=test-workload [id=3bba08b579a14fb6ab6c447cc17c72f7]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 14:54:52.757817 16609 tablet_service.cc:1511] Processing CreateTablet for tablet 48f69b6ba5bd492b8470cb9edfa3fc49 (DEFAULT_TABLE table=test-workload [id=3bba08b579a14fb6ab6c447cc17c72f7]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 14:54:52.758819 16611 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a69054eca44462f8f9d0ecadd574a2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:52.759686 16609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48f69b6ba5bd492b8470cb9edfa3fc49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:52.761451 16610 tablet_service.cc:1511] Processing CreateTablet for tablet 43486d5085024ad4ab238eb24756ce7b (DEFAULT_TABLE table=test-workload [id=3bba08b579a14fb6ab6c447cc17c72f7]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 14:54:52.763296 16610 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43486d5085024ad4ab238eb24756ce7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:52.763031 16608 tablet_service.cc:1511] Processing CreateTablet for tablet 27e19d91f3664b33a47fc21010adb06d (DEFAULT_TABLE table=test-workload [id=3bba08b579a14fb6ab6c447cc17c72f7]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 14:54:52.765066 16608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27e19d91f3664b33a47fc21010adb06d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:52.777199 16535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43486d5085024ad4ab238eb24756ce7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:52.781796 16533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27e19d91f3664b33a47fc21010adb06d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:52.791077 16532 tablet_service.cc:1511] Processing CreateTablet for tablet 6492b42adab04eceb2ad67a6f9dca9ed (DEFAULT_TABLE table=test-workload [id=3bba08b579a14fb6ab6c447cc17c72f7]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 14:54:52.792985 16532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6492b42adab04eceb2ad67a6f9dca9ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:52.795032 16607 tablet_service.cc:1511] Processing CreateTablet for tablet 6492b42adab04eceb2ad67a6f9dca9ed (DEFAULT_TABLE table=test-workload [id=3bba08b579a14fb6ab6c447cc17c72f7]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 14:54:52.799777 16607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6492b42adab04eceb2ad67a6f9dca9ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:52.798841 16738 tablet_bootstrap.cc:492] T 48f69b6ba5bd492b8470cb9edfa3fc49 P 1cb7a022bda844bfb69fec38131c8e31: Bootstrap starting.
I20260709 14:54:52.814215 16682 tablet_service.cc:1511] Processing CreateTablet for tablet 27e19d91f3664b33a47fc21010adb06d (DEFAULT_TABLE table=test-workload [id=3bba08b579a14fb6ab6c447cc17c72f7]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 14:54:52.815997 16682 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27e19d91f3664b33a47fc21010adb06d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:52.816298 16684 tablet_service.cc:1511] Processing CreateTablet for tablet 43486d5085024ad4ab238eb24756ce7b (DEFAULT_TABLE table=test-workload [id=3bba08b579a14fb6ab6c447cc17c72f7]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 14:54:52.818013 16684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43486d5085024ad4ab238eb24756ce7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:52.823945 16681 tablet_service.cc:1511] Processing CreateTablet for tablet 6492b42adab04eceb2ad67a6f9dca9ed (DEFAULT_TABLE table=test-workload [id=3bba08b579a14fb6ab6c447cc17c72f7]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 14:54:52.824755 16534 tablet_service.cc:1511] Processing CreateTablet for tablet 93526d1276e74b9382a2fe40d2694853 (DEFAULT_TABLE table=test-workload [id=3bba08b579a14fb6ab6c447cc17c72f7]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 14:54:52.826144 16534 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93526d1276e74b9382a2fe40d2694853. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:52.827020 16683 tablet_service.cc:1511] Processing CreateTablet for tablet 48f69b6ba5bd492b8470cb9edfa3fc49 (DEFAULT_TABLE table=test-workload [id=3bba08b579a14fb6ab6c447cc17c72f7]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 14:54:52.825554 16681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6492b42adab04eceb2ad67a6f9dca9ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:52.831750 16738 tablet_bootstrap.cc:654] T 48f69b6ba5bd492b8470cb9edfa3fc49 P 1cb7a022bda844bfb69fec38131c8e31: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:52.814915 16685 tablet_service.cc:1511] Processing CreateTablet for tablet 9a69054eca44462f8f9d0ecadd574a2a (DEFAULT_TABLE table=test-workload [id=3bba08b579a14fb6ab6c447cc17c72f7]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 14:54:52.833779 16683 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48f69b6ba5bd492b8470cb9edfa3fc49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:52.835377 16606 tablet_service.cc:1511] Processing CreateTablet for tablet 93526d1276e74b9382a2fe40d2694853 (DEFAULT_TABLE table=test-workload [id=3bba08b579a14fb6ab6c447cc17c72f7]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 14:54:52.845942 16606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93526d1276e74b9382a2fe40d2694853. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:52.840637 16680 tablet_service.cc:1511] Processing CreateTablet for tablet 93526d1276e74b9382a2fe40d2694853 (DEFAULT_TABLE table=test-workload [id=3bba08b579a14fb6ab6c447cc17c72f7]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 14:54:52.854957 16685 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a69054eca44462f8f9d0ecadd574a2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:52.856230 16679 tablet_service.cc:1511] Processing CreateTablet for tablet e197eb61cbe44c1e99a7a9cc182b7268 (DEFAULT_TABLE table=test-workload [id=3bba08b579a14fb6ab6c447cc17c72f7]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 14:54:52.857676 16680 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93526d1276e74b9382a2fe40d2694853. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:52.858662 16679 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e197eb61cbe44c1e99a7a9cc182b7268. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:52.843276 16533 tablet_service.cc:1511] Processing CreateTablet for tablet e197eb61cbe44c1e99a7a9cc182b7268 (DEFAULT_TABLE table=test-workload [id=3bba08b579a14fb6ab6c447cc17c72f7]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 14:54:52.863758 16533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e197eb61cbe44c1e99a7a9cc182b7268. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:52.869069 16741 tablet_bootstrap.cc:492] T 27e19d91f3664b33a47fc21010adb06d P 93374462fb7d40ac80f3d526d4547642: Bootstrap starting.
I20260709 14:54:52.886643 16531 tablet_service.cc:1511] Processing CreateTablet for tablet c727468585cc4bff8f000e922b7a7d95 (DEFAULT_TABLE table=test-workload [id=3bba08b579a14fb6ab6c447cc17c72f7]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 14:54:52.889452 16531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c727468585cc4bff8f000e922b7a7d95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:52.890064 16609 tablet_service.cc:1511] Processing CreateTablet for tablet c727468585cc4bff8f000e922b7a7d95 (DEFAULT_TABLE table=test-workload [id=3bba08b579a14fb6ab6c447cc17c72f7]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 14:54:52.892032 16609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c727468585cc4bff8f000e922b7a7d95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:52.887001 16739 tablet_bootstrap.cc:492] T 48f69b6ba5bd492b8470cb9edfa3fc49 P f3160b8200a64810983bda11c4af8fff: Bootstrap starting.
I20260709 14:54:52.900699 16610 tablet_service.cc:1511] Processing CreateTablet for tablet e197eb61cbe44c1e99a7a9cc182b7268 (DEFAULT_TABLE table=test-workload [id=3bba08b579a14fb6ab6c447cc17c72f7]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 14:54:52.902387 16610 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e197eb61cbe44c1e99a7a9cc182b7268. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:52.926008 16738 tablet_bootstrap.cc:492] T 48f69b6ba5bd492b8470cb9edfa3fc49 P 1cb7a022bda844bfb69fec38131c8e31: No bootstrap required, opened a new log
I20260709 14:54:52.926724 16682 tablet_service.cc:1511] Processing CreateTablet for tablet c727468585cc4bff8f000e922b7a7d95 (DEFAULT_TABLE table=test-workload [id=3bba08b579a14fb6ab6c447cc17c72f7]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 14:54:52.941905 16738 ts_tablet_manager.cc:1403] T 48f69b6ba5bd492b8470cb9edfa3fc49 P 1cb7a022bda844bfb69fec38131c8e31: Time spent bootstrapping tablet: real 0.150s	user 0.011s	sys 0.012s
I20260709 14:54:52.942453 16682 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c727468585cc4bff8f000e922b7a7d95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:52.945513 16536 tablet_service.cc:1511] Processing CreateTablet for tablet 544aaafd8b6b427191e89277cb281bd1 (DEFAULT_TABLE table=test-workload [id=3bba08b579a14fb6ab6c447cc17c72f7]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 14:54:52.947237 16536 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 544aaafd8b6b427191e89277cb281bd1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:52.886934 16741 tablet_bootstrap.cc:654] T 27e19d91f3664b33a47fc21010adb06d P 93374462fb7d40ac80f3d526d4547642: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:52.953389 16609 tablet_service.cc:1511] Processing CreateTablet for tablet 544aaafd8b6b427191e89277cb281bd1 (DEFAULT_TABLE table=test-workload [id=3bba08b579a14fb6ab6c447cc17c72f7]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 14:54:52.955252 16609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 544aaafd8b6b427191e89277cb281bd1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:52.958863 16738 raft_consensus.cc:359] T 48f69b6ba5bd492b8470cb9edfa3fc49 P 1cb7a022bda844bfb69fec38131c8e31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:54:52.967170 16678 tablet_service.cc:1511] Processing CreateTablet for tablet 544aaafd8b6b427191e89277cb281bd1 (DEFAULT_TABLE table=test-workload [id=3bba08b579a14fb6ab6c447cc17c72f7]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 14:54:52.969183 16678 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 544aaafd8b6b427191e89277cb281bd1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:52.974058 16535 tablet_service.cc:1511] Processing CreateTablet for tablet 213053d1a14c4365a4bccd2d11a2764a (DEFAULT_TABLE table=test-workload [id=3bba08b579a14fb6ab6c447cc17c72f7]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 14:54:52.976140 16535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 213053d1a14c4365a4bccd2d11a2764a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:52.979810 16739 tablet_bootstrap.cc:654] T 48f69b6ba5bd492b8470cb9edfa3fc49 P f3160b8200a64810983bda11c4af8fff: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:52.962049 16738 raft_consensus.cc:385] T 48f69b6ba5bd492b8470cb9edfa3fc49 P 1cb7a022bda844bfb69fec38131c8e31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:52.981830 16738 raft_consensus.cc:740] T 48f69b6ba5bd492b8470cb9edfa3fc49 P 1cb7a022bda844bfb69fec38131c8e31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cb7a022bda844bfb69fec38131c8e31, State: Initialized, Role: FOLLOWER
I20260709 14:54:52.986250 16738 consensus_queue.cc:260] T 48f69b6ba5bd492b8470cb9edfa3fc49 P 1cb7a022bda844bfb69fec38131c8e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:54:52.990865 16607 tablet_service.cc:1511] Processing CreateTablet for tablet 213053d1a14c4365a4bccd2d11a2764a (DEFAULT_TABLE table=test-workload [id=3bba08b579a14fb6ab6c447cc17c72f7]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 14:54:53.001996 16607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 213053d1a14c4365a4bccd2d11a2764a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:53.023449 16682 tablet_service.cc:1511] Processing CreateTablet for tablet 213053d1a14c4365a4bccd2d11a2764a (DEFAULT_TABLE table=test-workload [id=3bba08b579a14fb6ab6c447cc17c72f7]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 14:54:53.025223 16682 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 213053d1a14c4365a4bccd2d11a2764a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:54:53.026930 16739 tablet_bootstrap.cc:492] T 48f69b6ba5bd492b8470cb9edfa3fc49 P f3160b8200a64810983bda11c4af8fff: No bootstrap required, opened a new log
I20260709 14:54:53.027555 16739 ts_tablet_manager.cc:1403] T 48f69b6ba5bd492b8470cb9edfa3fc49 P f3160b8200a64810983bda11c4af8fff: Time spent bootstrapping tablet: real 0.141s	user 0.013s	sys 0.006s
I20260709 14:54:53.039824 16741 tablet_bootstrap.cc:492] T 27e19d91f3664b33a47fc21010adb06d P 93374462fb7d40ac80f3d526d4547642: No bootstrap required, opened a new log
I20260709 14:54:53.040656 16741 ts_tablet_manager.cc:1403] T 27e19d91f3664b33a47fc21010adb06d P 93374462fb7d40ac80f3d526d4547642: Time spent bootstrapping tablet: real 0.175s	user 0.022s	sys 0.033s
I20260709 14:54:53.050976 16739 raft_consensus.cc:359] T 48f69b6ba5bd492b8470cb9edfa3fc49 P f3160b8200a64810983bda11c4af8fff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:54:53.051872 16739 raft_consensus.cc:385] T 48f69b6ba5bd492b8470cb9edfa3fc49 P f3160b8200a64810983bda11c4af8fff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:53.052192 16739 raft_consensus.cc:740] T 48f69b6ba5bd492b8470cb9edfa3fc49 P f3160b8200a64810983bda11c4af8fff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3160b8200a64810983bda11c4af8fff, State: Initialized, Role: FOLLOWER
I20260709 14:54:53.052942 16739 consensus_queue.cc:260] T 48f69b6ba5bd492b8470cb9edfa3fc49 P f3160b8200a64810983bda11c4af8fff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:54:53.053963 16741 raft_consensus.cc:359] T 27e19d91f3664b33a47fc21010adb06d P 93374462fb7d40ac80f3d526d4547642 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:54:53.057307 16741 raft_consensus.cc:385] T 27e19d91f3664b33a47fc21010adb06d P 93374462fb7d40ac80f3d526d4547642 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:53.057706 16741 raft_consensus.cc:740] T 27e19d91f3664b33a47fc21010adb06d P 93374462fb7d40ac80f3d526d4547642 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93374462fb7d40ac80f3d526d4547642, State: Initialized, Role: FOLLOWER
I20260709 14:54:53.058562 16738 ts_tablet_manager.cc:1434] T 48f69b6ba5bd492b8470cb9edfa3fc49 P 1cb7a022bda844bfb69fec38131c8e31: Time spent starting tablet: real 0.113s	user 0.009s	sys 0.016s
I20260709 14:54:53.059691 16571 heartbeater.cc:499] Master 127.6.101.126:42521 was elected leader, sending a full tablet report...
I20260709 14:54:53.062012 16741 consensus_queue.cc:260] T 27e19d91f3664b33a47fc21010adb06d P 93374462fb7d40ac80f3d526d4547642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:54:53.065169 16738 tablet_bootstrap.cc:492] T 27e19d91f3664b33a47fc21010adb06d P 1cb7a022bda844bfb69fec38131c8e31: Bootstrap starting.
W20260709 14:54:53.066885 16492 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 14:54:53.074719 16720 heartbeater.cc:499] Master 127.6.101.126:42521 was elected leader, sending a full tablet report...
I20260709 14:54:53.075747 16741 ts_tablet_manager.cc:1434] T 27e19d91f3664b33a47fc21010adb06d P 93374462fb7d40ac80f3d526d4547642: Time spent starting tablet: real 0.035s	user 0.013s	sys 0.006s
W20260709 14:54:53.076368 16721 tablet.cc:2406] T 27e19d91f3664b33a47fc21010adb06d P 93374462fb7d40ac80f3d526d4547642: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 14:54:53.077386 16741 tablet_bootstrap.cc:492] T 43486d5085024ad4ab238eb24756ce7b P 93374462fb7d40ac80f3d526d4547642: Bootstrap starting.
I20260709 14:54:53.078673 16738 tablet_bootstrap.cc:654] T 27e19d91f3664b33a47fc21010adb06d P 1cb7a022bda844bfb69fec38131c8e31: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:53.087415 16741 tablet_bootstrap.cc:654] T 43486d5085024ad4ab238eb24756ce7b P 93374462fb7d40ac80f3d526d4547642: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:53.090945 16739 ts_tablet_manager.cc:1434] T 48f69b6ba5bd492b8470cb9edfa3fc49 P f3160b8200a64810983bda11c4af8fff: Time spent starting tablet: real 0.063s	user 0.002s	sys 0.009s
I20260709 14:54:53.091979 16646 heartbeater.cc:499] Master 127.6.101.126:42521 was elected leader, sending a full tablet report...
I20260709 14:54:53.101992 16739 tablet_bootstrap.cc:492] T 43486d5085024ad4ab238eb24756ce7b P f3160b8200a64810983bda11c4af8fff: Bootstrap starting.
I20260709 14:54:53.102100 16741 tablet_bootstrap.cc:492] T 43486d5085024ad4ab238eb24756ce7b P 93374462fb7d40ac80f3d526d4547642: No bootstrap required, opened a new log
I20260709 14:54:53.103039 16741 ts_tablet_manager.cc:1403] T 43486d5085024ad4ab238eb24756ce7b P 93374462fb7d40ac80f3d526d4547642: Time spent bootstrapping tablet: real 0.026s	user 0.013s	sys 0.011s
I20260709 14:54:53.106828 16741 raft_consensus.cc:359] T 43486d5085024ad4ab238eb24756ce7b P 93374462fb7d40ac80f3d526d4547642 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:54:53.107753 16741 raft_consensus.cc:385] T 43486d5085024ad4ab238eb24756ce7b P 93374462fb7d40ac80f3d526d4547642 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:53.108103 16741 raft_consensus.cc:740] T 43486d5085024ad4ab238eb24756ce7b P 93374462fb7d40ac80f3d526d4547642 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93374462fb7d40ac80f3d526d4547642, State: Initialized, Role: FOLLOWER
I20260709 14:54:53.109407 16741 consensus_queue.cc:260] T 43486d5085024ad4ab238eb24756ce7b P 93374462fb7d40ac80f3d526d4547642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:54:53.110992 16739 tablet_bootstrap.cc:654] T 43486d5085024ad4ab238eb24756ce7b P f3160b8200a64810983bda11c4af8fff: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:53.112605 16741 ts_tablet_manager.cc:1434] T 43486d5085024ad4ab238eb24756ce7b P 93374462fb7d40ac80f3d526d4547642: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 14:54:53.114333 16741 tablet_bootstrap.cc:492] T 48f69b6ba5bd492b8470cb9edfa3fc49 P 93374462fb7d40ac80f3d526d4547642: Bootstrap starting.
I20260709 14:54:53.123757 16741 tablet_bootstrap.cc:654] T 48f69b6ba5bd492b8470cb9edfa3fc49 P 93374462fb7d40ac80f3d526d4547642: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:53.131944 16739 tablet_bootstrap.cc:492] T 43486d5085024ad4ab238eb24756ce7b P f3160b8200a64810983bda11c4af8fff: No bootstrap required, opened a new log
I20260709 14:54:53.132547 16739 ts_tablet_manager.cc:1403] T 43486d5085024ad4ab238eb24756ce7b P f3160b8200a64810983bda11c4af8fff: Time spent bootstrapping tablet: real 0.031s	user 0.017s	sys 0.010s
I20260709 14:54:53.142623 16738 tablet_bootstrap.cc:492] T 27e19d91f3664b33a47fc21010adb06d P 1cb7a022bda844bfb69fec38131c8e31: No bootstrap required, opened a new log
I20260709 14:54:53.143136 16739 raft_consensus.cc:359] T 43486d5085024ad4ab238eb24756ce7b P f3160b8200a64810983bda11c4af8fff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:54:53.143836 16738 ts_tablet_manager.cc:1403] T 27e19d91f3664b33a47fc21010adb06d P 1cb7a022bda844bfb69fec38131c8e31: Time spent bootstrapping tablet: real 0.079s	user 0.032s	sys 0.040s
I20260709 14:54:53.144117 16739 raft_consensus.cc:385] T 43486d5085024ad4ab238eb24756ce7b P f3160b8200a64810983bda11c4af8fff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:53.144536 16739 raft_consensus.cc:740] T 43486d5085024ad4ab238eb24756ce7b P f3160b8200a64810983bda11c4af8fff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3160b8200a64810983bda11c4af8fff, State: Initialized, Role: FOLLOWER
I20260709 14:54:53.149729 16738 raft_consensus.cc:359] T 27e19d91f3664b33a47fc21010adb06d P 1cb7a022bda844bfb69fec38131c8e31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:54:53.151644 16738 raft_consensus.cc:385] T 27e19d91f3664b33a47fc21010adb06d P 1cb7a022bda844bfb69fec38131c8e31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:53.152315 16738 raft_consensus.cc:740] T 27e19d91f3664b33a47fc21010adb06d P 1cb7a022bda844bfb69fec38131c8e31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cb7a022bda844bfb69fec38131c8e31, State: Initialized, Role: FOLLOWER
I20260709 14:54:53.150866 16739 consensus_queue.cc:260] T 43486d5085024ad4ab238eb24756ce7b P f3160b8200a64810983bda11c4af8fff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:54:53.153957 16738 consensus_queue.cc:260] T 27e19d91f3664b33a47fc21010adb06d P 1cb7a022bda844bfb69fec38131c8e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:54:53.156369 16739 ts_tablet_manager.cc:1434] T 43486d5085024ad4ab238eb24756ce7b P f3160b8200a64810983bda11c4af8fff: Time spent starting tablet: real 0.023s	user 0.011s	sys 0.001s
I20260709 14:54:53.157663 16739 tablet_bootstrap.cc:492] T 9a69054eca44462f8f9d0ecadd574a2a P f3160b8200a64810983bda11c4af8fff: Bootstrap starting.
I20260709 14:54:53.161630 16738 ts_tablet_manager.cc:1434] T 27e19d91f3664b33a47fc21010adb06d P 1cb7a022bda844bfb69fec38131c8e31: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.006s
I20260709 14:54:53.163759 16738 tablet_bootstrap.cc:492] T 9a69054eca44462f8f9d0ecadd574a2a P 1cb7a022bda844bfb69fec38131c8e31: Bootstrap starting.
I20260709 14:54:53.164489 16739 tablet_bootstrap.cc:654] T 9a69054eca44462f8f9d0ecadd574a2a P f3160b8200a64810983bda11c4af8fff: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:53.173499 16738 tablet_bootstrap.cc:654] T 9a69054eca44462f8f9d0ecadd574a2a P 1cb7a022bda844bfb69fec38131c8e31: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:53.181797 16741 tablet_bootstrap.cc:492] T 48f69b6ba5bd492b8470cb9edfa3fc49 P 93374462fb7d40ac80f3d526d4547642: No bootstrap required, opened a new log
I20260709 14:54:53.182569 16741 ts_tablet_manager.cc:1403] T 48f69b6ba5bd492b8470cb9edfa3fc49 P 93374462fb7d40ac80f3d526d4547642: Time spent bootstrapping tablet: real 0.069s	user 0.035s	sys 0.028s
I20260709 14:54:53.184243 16739 tablet_bootstrap.cc:492] T 9a69054eca44462f8f9d0ecadd574a2a P f3160b8200a64810983bda11c4af8fff: No bootstrap required, opened a new log
I20260709 14:54:53.184875 16739 ts_tablet_manager.cc:1403] T 9a69054eca44462f8f9d0ecadd574a2a P f3160b8200a64810983bda11c4af8fff: Time spent bootstrapping tablet: real 0.027s	user 0.002s	sys 0.009s
I20260709 14:54:53.186120 16741 raft_consensus.cc:359] T 48f69b6ba5bd492b8470cb9edfa3fc49 P 93374462fb7d40ac80f3d526d4547642 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:54:53.187011 16741 raft_consensus.cc:385] T 48f69b6ba5bd492b8470cb9edfa3fc49 P 93374462fb7d40ac80f3d526d4547642 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:53.187317 16741 raft_consensus.cc:740] T 48f69b6ba5bd492b8470cb9edfa3fc49 P 93374462fb7d40ac80f3d526d4547642 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93374462fb7d40ac80f3d526d4547642, State: Initialized, Role: FOLLOWER
I20260709 14:54:53.188031 16738 tablet_bootstrap.cc:492] T 9a69054eca44462f8f9d0ecadd574a2a P 1cb7a022bda844bfb69fec38131c8e31: No bootstrap required, opened a new log
I20260709 14:54:53.188742 16738 ts_tablet_manager.cc:1403] T 9a69054eca44462f8f9d0ecadd574a2a P 1cb7a022bda844bfb69fec38131c8e31: Time spent bootstrapping tablet: real 0.025s	user 0.009s	sys 0.014s
I20260709 14:54:53.188082 16739 raft_consensus.cc:359] T 9a69054eca44462f8f9d0ecadd574a2a P f3160b8200a64810983bda11c4af8fff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:54:53.188375 16741 consensus_queue.cc:260] T 48f69b6ba5bd492b8470cb9edfa3fc49 P 93374462fb7d40ac80f3d526d4547642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:54:53.189622 16739 raft_consensus.cc:385] T 9a69054eca44462f8f9d0ecadd574a2a P f3160b8200a64810983bda11c4af8fff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:53.190018 16739 raft_consensus.cc:740] T 9a69054eca44462f8f9d0ecadd574a2a P f3160b8200a64810983bda11c4af8fff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3160b8200a64810983bda11c4af8fff, State: Initialized, Role: FOLLOWER
I20260709 14:54:53.190914 16739 consensus_queue.cc:260] T 9a69054eca44462f8f9d0ecadd574a2a P f3160b8200a64810983bda11c4af8fff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:54:53.192029 16741 ts_tablet_manager.cc:1434] T 48f69b6ba5bd492b8470cb9edfa3fc49 P 93374462fb7d40ac80f3d526d4547642: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 14:54:53.193531 16741 tablet_bootstrap.cc:492] T 6492b42adab04eceb2ad67a6f9dca9ed P 93374462fb7d40ac80f3d526d4547642: Bootstrap starting.
I20260709 14:54:53.193207 16738 raft_consensus.cc:359] T 9a69054eca44462f8f9d0ecadd574a2a P 1cb7a022bda844bfb69fec38131c8e31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:54:53.194216 16738 raft_consensus.cc:385] T 9a69054eca44462f8f9d0ecadd574a2a P 1cb7a022bda844bfb69fec38131c8e31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:53.194541 16738 raft_consensus.cc:740] T 9a69054eca44462f8f9d0ecadd574a2a P 1cb7a022bda844bfb69fec38131c8e31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cb7a022bda844bfb69fec38131c8e31, State: Initialized, Role: FOLLOWER
I20260709 14:54:53.195565 16738 consensus_queue.cc:260] T 9a69054eca44462f8f9d0ecadd574a2a P 1cb7a022bda844bfb69fec38131c8e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:54:53.197121 16739 ts_tablet_manager.cc:1434] T 9a69054eca44462f8f9d0ecadd574a2a P f3160b8200a64810983bda11c4af8fff: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 14:54:53.198414 16739 tablet_bootstrap.cc:492] T 27e19d91f3664b33a47fc21010adb06d P f3160b8200a64810983bda11c4af8fff: Bootstrap starting.
I20260709 14:54:53.198678 16746 raft_consensus.cc:493] T 43486d5085024ad4ab238eb24756ce7b P 93374462fb7d40ac80f3d526d4547642 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:53.199288 16746 raft_consensus.cc:515] T 43486d5085024ad4ab238eb24756ce7b P 93374462fb7d40ac80f3d526d4547642 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:54:53.200834 16738 ts_tablet_manager.cc:1434] T 9a69054eca44462f8f9d0ecadd574a2a P 1cb7a022bda844bfb69fec38131c8e31: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 14:54:53.202152 16738 tablet_bootstrap.cc:492] T 6492b42adab04eceb2ad67a6f9dca9ed P 1cb7a022bda844bfb69fec38131c8e31: Bootstrap starting.
I20260709 14:54:53.209715 16741 tablet_bootstrap.cc:654] T 6492b42adab04eceb2ad67a6f9dca9ed P 93374462fb7d40ac80f3d526d4547642: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:53.210129 16738 tablet_bootstrap.cc:654] T 6492b42adab04eceb2ad67a6f9dca9ed P 1cb7a022bda844bfb69fec38131c8e31: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:53.205073 16739 tablet_bootstrap.cc:654] T 27e19d91f3664b33a47fc21010adb06d P f3160b8200a64810983bda11c4af8fff: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:53.212894 16746 leader_election.cc:290] T 43486d5085024ad4ab238eb24756ce7b P 93374462fb7d40ac80f3d526d4547642 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1cb7a022bda844bfb69fec38131c8e31 (127.6.101.65:41617), f3160b8200a64810983bda11c4af8fff (127.6.101.66:35977)
I20260709 14:54:53.233592 16744 raft_consensus.cc:493] T 27e19d91f3664b33a47fc21010adb06d P 1cb7a022bda844bfb69fec38131c8e31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:53.234402 16744 raft_consensus.cc:515] T 27e19d91f3664b33a47fc21010adb06d P 1cb7a022bda844bfb69fec38131c8e31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:54:53.242085 16745 raft_consensus.cc:493] T 48f69b6ba5bd492b8470cb9edfa3fc49 P f3160b8200a64810983bda11c4af8fff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:53.243000 16745 raft_consensus.cc:515] T 48f69b6ba5bd492b8470cb9edfa3fc49 P f3160b8200a64810983bda11c4af8fff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:54:53.244444 16744 leader_election.cc:290] T 27e19d91f3664b33a47fc21010adb06d P 1cb7a022bda844bfb69fec38131c8e31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3160b8200a64810983bda11c4af8fff (127.6.101.66:35977), 93374462fb7d40ac80f3d526d4547642 (127.6.101.67:41835)
I20260709 14:54:53.249577 16745 leader_election.cc:290] T 48f69b6ba5bd492b8470cb9edfa3fc49 P f3160b8200a64810983bda11c4af8fff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1cb7a022bda844bfb69fec38131c8e31 (127.6.101.65:41617), 93374462fb7d40ac80f3d526d4547642 (127.6.101.67:41835)
I20260709 14:54:53.278088 16746 raft_consensus.cc:493] T 27e19d91f3664b33a47fc21010adb06d P 93374462fb7d40ac80f3d526d4547642 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:53.279078 16746 raft_consensus.cc:515] T 27e19d91f3664b33a47fc21010adb06d P 93374462fb7d40ac80f3d526d4547642 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:54:53.281810 16744 raft_consensus.cc:493] T 48f69b6ba5bd492b8470cb9edfa3fc49 P 1cb7a022bda844bfb69fec38131c8e31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:53.282507 16744 raft_consensus.cc:515] T 48f69b6ba5bd492b8470cb9edfa3fc49 P 1cb7a022bda844bfb69fec38131c8e31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:54:53.284798 16746 leader_election.cc:290] T 27e19d91f3664b33a47fc21010adb06d P 93374462fb7d40ac80f3d526d4547642 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1cb7a022bda844bfb69fec38131c8e31 (127.6.101.65:41617), f3160b8200a64810983bda11c4af8fff (127.6.101.66:35977)
I20260709 14:54:53.285521 16744 leader_election.cc:290] T 48f69b6ba5bd492b8470cb9edfa3fc49 P 1cb7a022bda844bfb69fec38131c8e31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3160b8200a64810983bda11c4af8fff (127.6.101.66:35977), 93374462fb7d40ac80f3d526d4547642 (127.6.101.67:41835)
I20260709 14:54:53.320326 16739 tablet_bootstrap.cc:492] T 27e19d91f3664b33a47fc21010adb06d P f3160b8200a64810983bda11c4af8fff: No bootstrap required, opened a new log
I20260709 14:54:53.321462 16739 ts_tablet_manager.cc:1403] T 27e19d91f3664b33a47fc21010adb06d P f3160b8200a64810983bda11c4af8fff: Time spent bootstrapping tablet: real 0.123s	user 0.026s	sys 0.035s
I20260709 14:54:53.332196 16738 tablet_bootstrap.cc:492] T 6492b42adab04eceb2ad67a6f9dca9ed P 1cb7a022bda844bfb69fec38131c8e31: No bootstrap required, opened a new log
I20260709 14:54:53.333081 16738 ts_tablet_manager.cc:1403] T 6492b42adab04eceb2ad67a6f9dca9ed P 1cb7a022bda844bfb69fec38131c8e31: Time spent bootstrapping tablet: real 0.131s	user 0.025s	sys 0.036s
I20260709 14:54:53.345125 16741 tablet_bootstrap.cc:492] T 6492b42adab04eceb2ad67a6f9dca9ed P 93374462fb7d40ac80f3d526d4547642: No bootstrap required, opened a new log
I20260709 14:54:53.346076 16741 ts_tablet_manager.cc:1403] T 6492b42adab04eceb2ad67a6f9dca9ed P 93374462fb7d40ac80f3d526d4547642: Time spent bootstrapping tablet: real 0.153s	user 0.030s	sys 0.050s
I20260709 14:54:53.347097 16695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e19d91f3664b33a47fc21010adb06d" candidate_uuid: "1cb7a022bda844bfb69fec38131c8e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93374462fb7d40ac80f3d526d4547642" is_pre_election: true
I20260709 14:54:53.348002 16695 raft_consensus.cc:2468] T 27e19d91f3664b33a47fc21010adb06d P 93374462fb7d40ac80f3d526d4547642 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1cb7a022bda844bfb69fec38131c8e31 in term 0.
I20260709 14:54:53.349282 16694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f69b6ba5bd492b8470cb9edfa3fc49" candidate_uuid: "1cb7a022bda844bfb69fec38131c8e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93374462fb7d40ac80f3d526d4547642" is_pre_election: true
I20260709 14:54:53.350301 16694 raft_consensus.cc:2468] T 48f69b6ba5bd492b8470cb9edfa3fc49 P 93374462fb7d40ac80f3d526d4547642 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1cb7a022bda844bfb69fec38131c8e31 in term 0.
I20260709 14:54:53.341279 16738 raft_consensus.cc:359] T 6492b42adab04eceb2ad67a6f9dca9ed P 1cb7a022bda844bfb69fec38131c8e31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:54:53.352246 16738 raft_consensus.cc:385] T 6492b42adab04eceb2ad67a6f9dca9ed P 1cb7a022bda844bfb69fec38131c8e31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:53.356700 16738 raft_consensus.cc:740] T 6492b42adab04eceb2ad67a6f9dca9ed P 1cb7a022bda844bfb69fec38131c8e31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cb7a022bda844bfb69fec38131c8e31, State: Initialized, Role: FOLLOWER
I20260709 14:54:53.352474 16510 leader_election.cc:304] T 27e19d91f3664b33a47fc21010adb06d P 1cb7a022bda844bfb69fec38131c8e31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1cb7a022bda844bfb69fec38131c8e31, 93374462fb7d40ac80f3d526d4547642; no voters: 
I20260709 14:54:53.358191 16744 raft_consensus.cc:2804] T 27e19d91f3664b33a47fc21010adb06d P 1cb7a022bda844bfb69fec38131c8e31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:54:53.358017 16738 consensus_queue.cc:260] T 6492b42adab04eceb2ad67a6f9dca9ed P 1cb7a022bda844bfb69fec38131c8e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:54:53.358147 16621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43486d5085024ad4ab238eb24756ce7b" candidate_uuid: "93374462fb7d40ac80f3d526d4547642" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3160b8200a64810983bda11c4af8fff" is_pre_election: true
I20260709 14:54:53.358443 16510 leader_election.cc:304] T 48f69b6ba5bd492b8470cb9edfa3fc49 P 1cb7a022bda844bfb69fec38131c8e31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1cb7a022bda844bfb69fec38131c8e31, 93374462fb7d40ac80f3d526d4547642; no voters: 
I20260709 14:54:53.359683 16621 raft_consensus.cc:2468] T 43486d5085024ad4ab238eb24756ce7b P f3160b8200a64810983bda11c4af8fff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93374462fb7d40ac80f3d526d4547642 in term 0.
I20260709 14:54:53.358877 16620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e19d91f3664b33a47fc21010adb06d" candidate_uuid: "93374462fb7d40ac80f3d526d4547642" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3160b8200a64810983bda11c4af8fff" is_pre_election: true
I20260709 14:54:53.360725 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e19d91f3664b33a47fc21010adb06d" candidate_uuid: "1cb7a022bda844bfb69fec38131c8e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3160b8200a64810983bda11c4af8fff" is_pre_election: true
I20260709 14:54:53.355263 16741 raft_consensus.cc:359] T 6492b42adab04eceb2ad67a6f9dca9ed P 93374462fb7d40ac80f3d526d4547642 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:54:53.364948 16741 raft_consensus.cc:385] T 6492b42adab04eceb2ad67a6f9dca9ed P 93374462fb7d40ac80f3d526d4547642 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:53.365995 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f69b6ba5bd492b8470cb9edfa3fc49" candidate_uuid: "1cb7a022bda844bfb69fec38131c8e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3160b8200a64810983bda11c4af8fff" is_pre_election: true
I20260709 14:54:53.367866 16618 raft_consensus.cc:2468] T 48f69b6ba5bd492b8470cb9edfa3fc49 P f3160b8200a64810983bda11c4af8fff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1cb7a022bda844bfb69fec38131c8e31 in term 0.
I20260709 14:54:53.368425 16546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43486d5085024ad4ab238eb24756ce7b" candidate_uuid: "93374462fb7d40ac80f3d526d4547642" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cb7a022bda844bfb69fec38131c8e31" is_pre_election: true
I20260709 14:54:53.358919 16744 raft_consensus.cc:493] T 27e19d91f3664b33a47fc21010adb06d P 1cb7a022bda844bfb69fec38131c8e31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:54:53.369918 16744 raft_consensus.cc:3060] T 27e19d91f3664b33a47fc21010adb06d P 1cb7a022bda844bfb69fec38131c8e31 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:53.370615 16546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e19d91f3664b33a47fc21010adb06d" candidate_uuid: "93374462fb7d40ac80f3d526d4547642" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cb7a022bda844bfb69fec38131c8e31" is_pre_election: true
W20260709 14:54:53.371999 16660 leader_election.cc:343] T 43486d5085024ad4ab238eb24756ce7b P 93374462fb7d40ac80f3d526d4547642 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1cb7a022bda844bfb69fec38131c8e31 (127.6.101.65:41617): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:53.366483 16741 raft_consensus.cc:740] T 6492b42adab04eceb2ad67a6f9dca9ed P 93374462fb7d40ac80f3d526d4547642 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93374462fb7d40ac80f3d526d4547642, State: Initialized, Role: FOLLOWER
I20260709 14:54:53.373660 16741 consensus_queue.cc:260] T 6492b42adab04eceb2ad67a6f9dca9ed P 93374462fb7d40ac80f3d526d4547642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:54:53.373900 16661 leader_election.cc:304] T 43486d5085024ad4ab238eb24756ce7b P 93374462fb7d40ac80f3d526d4547642 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 93374462fb7d40ac80f3d526d4547642, f3160b8200a64810983bda11c4af8fff; no voters: 1cb7a022bda844bfb69fec38131c8e31
I20260709 14:54:53.380033 16766 raft_consensus.cc:2804] T 48f69b6ba5bd492b8470cb9edfa3fc49 P 1cb7a022bda844bfb69fec38131c8e31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:54:53.380656 16766 raft_consensus.cc:493] T 48f69b6ba5bd492b8470cb9edfa3fc49 P 1cb7a022bda844bfb69fec38131c8e31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:54:53.352438 16739 raft_consensus.cc:359] T 27e19d91f3664b33a47fc21010adb06d P f3160b8200a64810983bda11c4af8fff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:54:53.380373 16741 ts_tablet_manager.cc:1434] T 6492b42adab04eceb2ad67a6f9dca9ed P 93374462fb7d40ac80f3d526d4547642: Time spent starting tablet: real 0.034s	user 0.008s	sys 0.000s
I20260709 14:54:53.384851 16739 raft_consensus.cc:385] T 27e19d91f3664b33a47fc21010adb06d P f3160b8200a64810983bda11c4af8fff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:53.390913 16746 raft_consensus.cc:2804] T 43486d5085024ad4ab238eb24756ce7b P 93374462fb7d40ac80f3d526d4547642 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:54:53.392131 16746 raft_consensus.cc:493] T 43486d5085024ad4ab238eb24756ce7b P 93374462fb7d40ac80f3d526d4547642 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:54:53.392577 16746 raft_consensus.cc:3060] T 43486d5085024ad4ab238eb24756ce7b P 93374462fb7d40ac80f3d526d4547642 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:53.381084 16766 raft_consensus.cc:3060] T 48f69b6ba5bd492b8470cb9edfa3fc49 P 1cb7a022bda844bfb69fec38131c8e31 [term 0 FOLLOWER]: Advancing to term 1
W20260709 14:54:53.409970 16510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.67:41835, user_credentials={real_user=slave}} blocked reactor thread for 51687.2us
I20260709 14:54:53.421890 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f69b6ba5bd492b8470cb9edfa3fc49" candidate_uuid: "f3160b8200a64810983bda11c4af8fff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cb7a022bda844bfb69fec38131c8e31" is_pre_election: true
I20260709 14:54:53.427426 16766 raft_consensus.cc:515] T 48f69b6ba5bd492b8470cb9edfa3fc49 P 1cb7a022bda844bfb69fec38131c8e31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:54:53.429602 16545 raft_consensus.cc:2393] T 48f69b6ba5bd492b8470cb9edfa3fc49 P 1cb7a022bda844bfb69fec38131c8e31 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3160b8200a64810983bda11c4af8fff in current term 1: Already voted for candidate 1cb7a022bda844bfb69fec38131c8e31 in this term.
I20260709 14:54:53.438387 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f69b6ba5bd492b8470cb9edfa3fc49" candidate_uuid: "1cb7a022bda844bfb69fec38131c8e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3160b8200a64810983bda11c4af8fff"
I20260709 14:54:53.439179 16618 raft_consensus.cc:3060] T 48f69b6ba5bd492b8470cb9edfa3fc49 P f3160b8200a64810983bda11c4af8fff [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:53.440124 16741 tablet_bootstrap.cc:492] T e197eb61cbe44c1e99a7a9cc182b7268 P 93374462fb7d40ac80f3d526d4547642: Bootstrap starting.
I20260709 14:54:53.442451 16694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f69b6ba5bd492b8470cb9edfa3fc49" candidate_uuid: "f3160b8200a64810983bda11c4af8fff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93374462fb7d40ac80f3d526d4547642" is_pre_election: true
I20260709 14:54:53.443780 16694 raft_consensus.cc:2468] T 48f69b6ba5bd492b8470cb9edfa3fc49 P 93374462fb7d40ac80f3d526d4547642 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3160b8200a64810983bda11c4af8fff in term 0.
I20260709 14:54:53.445456 16585 leader_election.cc:304] T 48f69b6ba5bd492b8470cb9edfa3fc49 P f3160b8200a64810983bda11c4af8fff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 93374462fb7d40ac80f3d526d4547642, f3160b8200a64810983bda11c4af8fff; no voters: 1cb7a022bda844bfb69fec38131c8e31
I20260709 14:54:53.390434 16739 raft_consensus.cc:740] T 27e19d91f3664b33a47fc21010adb06d P f3160b8200a64810983bda11c4af8fff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3160b8200a64810983bda11c4af8fff, State: Initialized, Role: FOLLOWER
I20260709 14:54:53.450224 16694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f69b6ba5bd492b8470cb9edfa3fc49" candidate_uuid: "1cb7a022bda844bfb69fec38131c8e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93374462fb7d40ac80f3d526d4547642"
I20260709 14:54:53.451493 16694 raft_consensus.cc:3060] T 48f69b6ba5bd492b8470cb9edfa3fc49 P 93374462fb7d40ac80f3d526d4547642 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:53.438778 16744 raft_consensus.cc:515] T 27e19d91f3664b33a47fc21010adb06d P 1cb7a022bda844bfb69fec38131c8e31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
W20260709 14:54:53.448669 16661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:35977, user_credentials={real_user=slave}} blocked reactor thread for 74869.4us
I20260709 14:54:53.454480 16739 consensus_queue.cc:260] T 27e19d91f3664b33a47fc21010adb06d P f3160b8200a64810983bda11c4af8fff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:54:53.455140 16546 raft_consensus.cc:2393] T 27e19d91f3664b33a47fc21010adb06d P 1cb7a022bda844bfb69fec38131c8e31 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 93374462fb7d40ac80f3d526d4547642 in current term 1: Already voted for candidate 1cb7a022bda844bfb69fec38131c8e31 in this term.
I20260709 14:54:53.455313 16746 raft_consensus.cc:515] T 43486d5085024ad4ab238eb24756ce7b P 93374462fb7d40ac80f3d526d4547642 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:54:53.458278 16746 leader_election.cc:290] T 43486d5085024ad4ab238eb24756ce7b P 93374462fb7d40ac80f3d526d4547642 [CANDIDATE]: Term 1 election: Requested vote from peers 1cb7a022bda844bfb69fec38131c8e31 (127.6.101.65:41617), f3160b8200a64810983bda11c4af8fff (127.6.101.66:35977)
I20260709 14:54:53.459722 16546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43486d5085024ad4ab238eb24756ce7b" candidate_uuid: "93374462fb7d40ac80f3d526d4547642" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cb7a022bda844bfb69fec38131c8e31"
I20260709 14:54:53.460201 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43486d5085024ad4ab238eb24756ce7b" candidate_uuid: "93374462fb7d40ac80f3d526d4547642" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3160b8200a64810983bda11c4af8fff"
I20260709 14:54:53.460292 16621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e19d91f3664b33a47fc21010adb06d" candidate_uuid: "1cb7a022bda844bfb69fec38131c8e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3160b8200a64810983bda11c4af8fff"
I20260709 14:54:53.461148 16619 raft_consensus.cc:3060] T 43486d5085024ad4ab238eb24756ce7b P f3160b8200a64810983bda11c4af8fff [term 0 FOLLOWER]: Advancing to term 1
W20260709 14:54:53.462265 16660 leader_election.cc:343] T 43486d5085024ad4ab238eb24756ce7b P 93374462fb7d40ac80f3d526d4547642 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1cb7a022bda844bfb69fec38131c8e31 (127.6.101.65:41617): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:53.462482 16620 raft_consensus.cc:2468] T 27e19d91f3664b33a47fc21010adb06d P f3160b8200a64810983bda11c4af8fff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93374462fb7d40ac80f3d526d4547642 in term 0.
I20260709 14:54:53.465781 16744 leader_election.cc:290] T 27e19d91f3664b33a47fc21010adb06d P 1cb7a022bda844bfb69fec38131c8e31 [CANDIDATE]: Term 1 election: Requested vote from peers f3160b8200a64810983bda11c4af8fff (127.6.101.66:35977), 93374462fb7d40ac80f3d526d4547642 (127.6.101.67:41835)
I20260709 14:54:53.465494 16661 leader_election.cc:304] T 27e19d91f3664b33a47fc21010adb06d P 93374462fb7d40ac80f3d526d4547642 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 93374462fb7d40ac80f3d526d4547642, f3160b8200a64810983bda11c4af8fff; no voters: 1cb7a022bda844bfb69fec38131c8e31
I20260709 14:54:53.467409 16695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e19d91f3664b33a47fc21010adb06d" candidate_uuid: "1cb7a022bda844bfb69fec38131c8e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93374462fb7d40ac80f3d526d4547642"
I20260709 14:54:53.467808 16746 raft_consensus.cc:2804] T 27e19d91f3664b33a47fc21010adb06d P 93374462fb7d40ac80f3d526d4547642 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:54:53.468597 16746 raft_consensus.cc:493] T 27e19d91f3664b33a47fc21010adb06d P 93374462fb7d40ac80f3d526d4547642 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:54:53.469027 16746 raft_consensus.cc:3060] T 27e19d91f3664b33a47fc21010adb06d P 93374462fb7d40ac80f3d526d4547642 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:53.470616 16738 ts_tablet_manager.cc:1434] T 6492b42adab04eceb2ad67a6f9dca9ed P 1cb7a022bda844bfb69fec38131c8e31: Time spent starting tablet: real 0.137s	user 0.015s	sys 0.015s
I20260709 14:54:53.446740 16766 leader_election.cc:290] T 48f69b6ba5bd492b8470cb9edfa3fc49 P 1cb7a022bda844bfb69fec38131c8e31 [CANDIDATE]: Term 1 election: Requested vote from peers f3160b8200a64810983bda11c4af8fff (127.6.101.66:35977), 93374462fb7d40ac80f3d526d4547642 (127.6.101.67:41835)
I20260709 14:54:53.456920 16618 raft_consensus.cc:2468] T 48f69b6ba5bd492b8470cb9edfa3fc49 P f3160b8200a64810983bda11c4af8fff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1cb7a022bda844bfb69fec38131c8e31 in term 1.
I20260709 14:54:53.477588 16694 raft_consensus.cc:2468] T 48f69b6ba5bd492b8470cb9edfa3fc49 P 93374462fb7d40ac80f3d526d4547642 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1cb7a022bda844bfb69fec38131c8e31 in term 1.
I20260709 14:54:53.475847 16738 tablet_bootstrap.cc:492] T 43486d5085024ad4ab238eb24756ce7b P 1cb7a022bda844bfb69fec38131c8e31: Bootstrap starting.
I20260709 14:54:53.550114 16512 leader_election.cc:304] T 48f69b6ba5bd492b8470cb9edfa3fc49 P 1cb7a022bda844bfb69fec38131c8e31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1cb7a022bda844bfb69fec38131c8e31, f3160b8200a64810983bda11c4af8fff; no voters: 
I20260709 14:54:53.480116 16739 ts_tablet_manager.cc:1434] T 27e19d91f3664b33a47fc21010adb06d P f3160b8200a64810983bda11c4af8fff: Time spent starting tablet: real 0.158s	user 0.010s	sys 0.000s
I20260709 14:54:53.484267 16746 raft_consensus.cc:515] T 27e19d91f3664b33a47fc21010adb06d P 93374462fb7d40ac80f3d526d4547642 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:54:53.556906 16739 tablet_bootstrap.cc:492] T c727468585cc4bff8f000e922b7a7d95 P f3160b8200a64810983bda11c4af8fff: Bootstrap starting.
I20260709 14:54:53.557372 16695 raft_consensus.cc:2393] T 27e19d91f3664b33a47fc21010adb06d P 93374462fb7d40ac80f3d526d4547642 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1cb7a022bda844bfb69fec38131c8e31 in current term 1: Already voted for candidate 93374462fb7d40ac80f3d526d4547642 in this term.
I20260709 14:54:53.477747 16619 raft_consensus.cc:2468] T 43486d5085024ad4ab238eb24756ce7b P f3160b8200a64810983bda11c4af8fff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93374462fb7d40ac80f3d526d4547642 in term 1.
I20260709 14:54:53.560669 16746 leader_election.cc:290] T 27e19d91f3664b33a47fc21010adb06d P 93374462fb7d40ac80f3d526d4547642 [CANDIDATE]: Term 1 election: Requested vote from peers 1cb7a022bda844bfb69fec38131c8e31 (127.6.101.65:41617), f3160b8200a64810983bda11c4af8fff (127.6.101.66:35977)
I20260709 14:54:53.480681 16741 tablet_bootstrap.cc:654] T e197eb61cbe44c1e99a7a9cc182b7268 P 93374462fb7d40ac80f3d526d4547642: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:53.562111 16546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e19d91f3664b33a47fc21010adb06d" candidate_uuid: "93374462fb7d40ac80f3d526d4547642" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cb7a022bda844bfb69fec38131c8e31"
I20260709 14:54:53.563261 16766 raft_consensus.cc:2804] T 48f69b6ba5bd492b8470cb9edfa3fc49 P 1cb7a022bda844bfb69fec38131c8e31 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:54:53.564126 16546 raft_consensus.cc:2393] T 27e19d91f3664b33a47fc21010adb06d P 1cb7a022bda844bfb69fec38131c8e31 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 93374462fb7d40ac80f3d526d4547642 in current term 1: Already voted for candidate 1cb7a022bda844bfb69fec38131c8e31 in this term.
I20260709 14:54:53.564029 16661 leader_election.cc:304] T 43486d5085024ad4ab238eb24756ce7b P 93374462fb7d40ac80f3d526d4547642 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 93374462fb7d40ac80f3d526d4547642, f3160b8200a64810983bda11c4af8fff; no voters: 1cb7a022bda844bfb69fec38131c8e31
I20260709 14:54:53.564124 16766 raft_consensus.cc:697] T 48f69b6ba5bd492b8470cb9edfa3fc49 P 1cb7a022bda844bfb69fec38131c8e31 [term 1 LEADER]: Becoming Leader. State: Replica: 1cb7a022bda844bfb69fec38131c8e31, State: Running, Role: LEADER
I20260709 14:54:53.562127 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e19d91f3664b33a47fc21010adb06d" candidate_uuid: "93374462fb7d40ac80f3d526d4547642" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3160b8200a64810983bda11c4af8fff"
I20260709 14:54:53.568420 16618 raft_consensus.cc:3060] T 27e19d91f3664b33a47fc21010adb06d P f3160b8200a64810983bda11c4af8fff [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:53.565950 16769 raft_consensus.cc:493] T 9a69054eca44462f8f9d0ecadd574a2a P f3160b8200a64810983bda11c4af8fff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:53.569687 16766 consensus_queue.cc:237] T 48f69b6ba5bd492b8470cb9edfa3fc49 P 1cb7a022bda844bfb69fec38131c8e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:54:53.571277 16769 raft_consensus.cc:515] T 9a69054eca44462f8f9d0ecadd574a2a P f3160b8200a64810983bda11c4af8fff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:54:53.573905 16768 raft_consensus.cc:2804] T 43486d5085024ad4ab238eb24756ce7b P 93374462fb7d40ac80f3d526d4547642 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:54:53.574786 16769 leader_election.cc:290] T 9a69054eca44462f8f9d0ecadd574a2a P f3160b8200a64810983bda11c4af8fff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1cb7a022bda844bfb69fec38131c8e31 (127.6.101.65:41617), 93374462fb7d40ac80f3d526d4547642 (127.6.101.67:41835)
I20260709 14:54:53.561923 16746 raft_consensus.cc:493] T 6492b42adab04eceb2ad67a6f9dca9ed P 93374462fb7d40ac80f3d526d4547642 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:53.561725 16745 raft_consensus.cc:2764] T 48f69b6ba5bd492b8470cb9edfa3fc49 P f3160b8200a64810983bda11c4af8fff [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 14:54:53.578471 16694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a69054eca44462f8f9d0ecadd574a2a" candidate_uuid: "f3160b8200a64810983bda11c4af8fff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93374462fb7d40ac80f3d526d4547642" is_pre_election: true
I20260709 14:54:53.583050 16746 raft_consensus.cc:515] T 6492b42adab04eceb2ad67a6f9dca9ed P 93374462fb7d40ac80f3d526d4547642 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
W20260709 14:54:53.584249 16585 leader_election.cc:343] T 9a69054eca44462f8f9d0ecadd574a2a P f3160b8200a64810983bda11c4af8fff [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 93374462fb7d40ac80f3d526d4547642 (127.6.101.67:41835): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:53.586371 16746 leader_election.cc:290] T 6492b42adab04eceb2ad67a6f9dca9ed P 93374462fb7d40ac80f3d526d4547642 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1cb7a022bda844bfb69fec38131c8e31 (127.6.101.65:41617), f3160b8200a64810983bda11c4af8fff (127.6.101.66:35977)
I20260709 14:54:53.587414 16546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6492b42adab04eceb2ad67a6f9dca9ed" candidate_uuid: "93374462fb7d40ac80f3d526d4547642" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cb7a022bda844bfb69fec38131c8e31" is_pre_election: true
I20260709 14:54:53.587872 16768 raft_consensus.cc:697] T 43486d5085024ad4ab238eb24756ce7b P 93374462fb7d40ac80f3d526d4547642 [term 1 LEADER]: Becoming Leader. State: Replica: 93374462fb7d40ac80f3d526d4547642, State: Running, Role: LEADER
I20260709 14:54:53.588406 16739 tablet_bootstrap.cc:654] T c727468585cc4bff8f000e922b7a7d95 P f3160b8200a64810983bda11c4af8fff: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:53.588512 16546 raft_consensus.cc:2468] T 6492b42adab04eceb2ad67a6f9dca9ed P 1cb7a022bda844bfb69fec38131c8e31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93374462fb7d40ac80f3d526d4547642 in term 0.
I20260709 14:54:53.589743 16768 consensus_queue.cc:237] T 43486d5085024ad4ab238eb24756ce7b P 93374462fb7d40ac80f3d526d4547642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:54:53.590768 16660 leader_election.cc:304] T 6492b42adab04eceb2ad67a6f9dca9ed P 93374462fb7d40ac80f3d526d4547642 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1cb7a022bda844bfb69fec38131c8e31, 93374462fb7d40ac80f3d526d4547642; no voters: 
I20260709 14:54:53.591403 16738 tablet_bootstrap.cc:654] T 43486d5085024ad4ab238eb24756ce7b P 1cb7a022bda844bfb69fec38131c8e31: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:53.592633 16771 raft_consensus.cc:2804] T 6492b42adab04eceb2ad67a6f9dca9ed P 93374462fb7d40ac80f3d526d4547642 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:54:53.596565 16510 leader_election.cc:304] T 27e19d91f3664b33a47fc21010adb06d P 1cb7a022bda844bfb69fec38131c8e31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1cb7a022bda844bfb69fec38131c8e31; no voters: 93374462fb7d40ac80f3d526d4547642, f3160b8200a64810983bda11c4af8fff
I20260709 14:54:53.599736 16546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a69054eca44462f8f9d0ecadd574a2a" candidate_uuid: "f3160b8200a64810983bda11c4af8fff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cb7a022bda844bfb69fec38131c8e31" is_pre_election: true
I20260709 14:54:53.601389 16771 raft_consensus.cc:493] T 6492b42adab04eceb2ad67a6f9dca9ed P 93374462fb7d40ac80f3d526d4547642 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:54:53.602993 16771 raft_consensus.cc:3060] T 6492b42adab04eceb2ad67a6f9dca9ed P 93374462fb7d40ac80f3d526d4547642 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:53.605113 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6492b42adab04eceb2ad67a6f9dca9ed" candidate_uuid: "93374462fb7d40ac80f3d526d4547642" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3160b8200a64810983bda11c4af8fff" is_pre_election: true
I20260709 14:54:53.605703 16546 raft_consensus.cc:2468] T 9a69054eca44462f8f9d0ecadd574a2a P 1cb7a022bda844bfb69fec38131c8e31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3160b8200a64810983bda11c4af8fff in term 0.
I20260709 14:54:53.608518 16766 raft_consensus.cc:2749] T 27e19d91f3664b33a47fc21010adb06d P 1cb7a022bda844bfb69fec38131c8e31 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 14:54:53.610824 16618 raft_consensus.cc:2468] T 27e19d91f3664b33a47fc21010adb06d P f3160b8200a64810983bda11c4af8fff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93374462fb7d40ac80f3d526d4547642 in term 1.
W20260709 14:54:53.609174 16661 leader_election.cc:343] T 6492b42adab04eceb2ad67a6f9dca9ed P 93374462fb7d40ac80f3d526d4547642 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f3160b8200a64810983bda11c4af8fff (127.6.101.66:35977): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:53.614409 16741 tablet_bootstrap.cc:492] T e197eb61cbe44c1e99a7a9cc182b7268 P 93374462fb7d40ac80f3d526d4547642: No bootstrap required, opened a new log
I20260709 14:54:53.614542 16661 leader_election.cc:304] T 27e19d91f3664b33a47fc21010adb06d P 93374462fb7d40ac80f3d526d4547642 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 93374462fb7d40ac80f3d526d4547642, f3160b8200a64810983bda11c4af8fff; no voters: 1cb7a022bda844bfb69fec38131c8e31
I20260709 14:54:53.615623 16741 ts_tablet_manager.cc:1403] T e197eb61cbe44c1e99a7a9cc182b7268 P 93374462fb7d40ac80f3d526d4547642: Time spent bootstrapping tablet: real 0.176s	user 0.017s	sys 0.007s
I20260709 14:54:53.616030 16768 raft_consensus.cc:2804] T 27e19d91f3664b33a47fc21010adb06d P 93374462fb7d40ac80f3d526d4547642 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:54:53.617352 16768 raft_consensus.cc:697] T 27e19d91f3664b33a47fc21010adb06d P 93374462fb7d40ac80f3d526d4547642 [term 1 LEADER]: Becoming Leader. State: Replica: 93374462fb7d40ac80f3d526d4547642, State: Running, Role: LEADER
I20260709 14:54:53.618189 16586 leader_election.cc:304] T 9a69054eca44462f8f9d0ecadd574a2a P f3160b8200a64810983bda11c4af8fff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1cb7a022bda844bfb69fec38131c8e31, f3160b8200a64810983bda11c4af8fff; no voters: 93374462fb7d40ac80f3d526d4547642
I20260709 14:54:53.618870 16768 consensus_queue.cc:237] T 27e19d91f3664b33a47fc21010adb06d P 93374462fb7d40ac80f3d526d4547642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:54:53.619820 16745 raft_consensus.cc:2804] T 9a69054eca44462f8f9d0ecadd574a2a P f3160b8200a64810983bda11c4af8fff [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:54:53.620251 16745 raft_consensus.cc:493] T 9a69054eca44462f8f9d0ecadd574a2a P f3160b8200a64810983bda11c4af8fff [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:54:53.620609 16745 raft_consensus.cc:3060] T 9a69054eca44462f8f9d0ecadd574a2a P f3160b8200a64810983bda11c4af8fff [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:53.628185 16771 raft_consensus.cc:515] T 6492b42adab04eceb2ad67a6f9dca9ed P 93374462fb7d40ac80f3d526d4547642 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:54:53.631238 16771 leader_election.cc:290] T 6492b42adab04eceb2ad67a6f9dca9ed P 93374462fb7d40ac80f3d526d4547642 [CANDIDATE]: Term 1 election: Requested vote from peers 1cb7a022bda844bfb69fec38131c8e31 (127.6.101.65:41617), f3160b8200a64810983bda11c4af8fff (127.6.101.66:35977)
I20260709 14:54:53.632302 16546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6492b42adab04eceb2ad67a6f9dca9ed" candidate_uuid: "93374462fb7d40ac80f3d526d4547642" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cb7a022bda844bfb69fec38131c8e31"
I20260709 14:54:53.632635 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6492b42adab04eceb2ad67a6f9dca9ed" candidate_uuid: "93374462fb7d40ac80f3d526d4547642" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3160b8200a64810983bda11c4af8fff"
I20260709 14:54:53.633224 16546 raft_consensus.cc:3060] T 6492b42adab04eceb2ad67a6f9dca9ed P 1cb7a022bda844bfb69fec38131c8e31 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:53.635699 16741 raft_consensus.cc:359] T e197eb61cbe44c1e99a7a9cc182b7268 P 93374462fb7d40ac80f3d526d4547642 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:54:53.642135 16443 catalog_manager.cc:5697] T 43486d5085024ad4ab238eb24756ce7b P 93374462fb7d40ac80f3d526d4547642 reported cstate change: term changed from 0 to 1, leader changed from <none> to 93374462fb7d40ac80f3d526d4547642 (127.6.101.67). New cstate: current_term: 1 leader_uuid: "93374462fb7d40ac80f3d526d4547642" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } health_report { overall_health: HEALTHY } } }
I20260709 14:54:53.646996 16745 raft_consensus.cc:515] T 9a69054eca44462f8f9d0ecadd574a2a P f3160b8200a64810983bda11c4af8fff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:54:53.647603 16739 tablet_bootstrap.cc:492] T c727468585cc4bff8f000e922b7a7d95 P f3160b8200a64810983bda11c4af8fff: No bootstrap required, opened a new log
I20260709 14:54:53.637041 16741 raft_consensus.cc:385] T e197eb61cbe44c1e99a7a9cc182b7268 P 93374462fb7d40ac80f3d526d4547642 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:53.649989 16741 raft_consensus.cc:740] T e197eb61cbe44c1e99a7a9cc182b7268 P 93374462fb7d40ac80f3d526d4547642 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93374462fb7d40ac80f3d526d4547642, State: Initialized, Role: FOLLOWER
I20260709 14:54:53.651836 16741 consensus_queue.cc:260] T e197eb61cbe44c1e99a7a9cc182b7268 P 93374462fb7d40ac80f3d526d4547642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
W20260709 14:54:53.654433 16661 leader_election.cc:343] T 6492b42adab04eceb2ad67a6f9dca9ed P 93374462fb7d40ac80f3d526d4547642 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f3160b8200a64810983bda11c4af8fff (127.6.101.66:35977): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:53.648274 16739 ts_tablet_manager.cc:1403] T c727468585cc4bff8f000e922b7a7d95 P f3160b8200a64810983bda11c4af8fff: Time spent bootstrapping tablet: real 0.093s	user 0.032s	sys 0.000s
I20260709 14:54:53.657734 16444 catalog_manager.cc:5697] T 48f69b6ba5bd492b8470cb9edfa3fc49 P 1cb7a022bda844bfb69fec38131c8e31 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1cb7a022bda844bfb69fec38131c8e31 (127.6.101.65). New cstate: current_term: 1 leader_uuid: "1cb7a022bda844bfb69fec38131c8e31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } health_report { overall_health: UNKNOWN } } }
I20260709 14:54:53.665105 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a69054eca44462f8f9d0ecadd574a2a" candidate_uuid: "f3160b8200a64810983bda11c4af8fff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cb7a022bda844bfb69fec38131c8e31"
I20260709 14:54:53.666208 16545 raft_consensus.cc:3060] T 9a69054eca44462f8f9d0ecadd574a2a P 1cb7a022bda844bfb69fec38131c8e31 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:53.667039 16739 raft_consensus.cc:359] T c727468585cc4bff8f000e922b7a7d95 P f3160b8200a64810983bda11c4af8fff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:54:53.668150 16739 raft_consensus.cc:385] T c727468585cc4bff8f000e922b7a7d95 P f3160b8200a64810983bda11c4af8fff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:53.668725 16739 raft_consensus.cc:740] T c727468585cc4bff8f000e922b7a7d95 P f3160b8200a64810983bda11c4af8fff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3160b8200a64810983bda11c4af8fff, State: Initialized, Role: FOLLOWER
I20260709 14:54:53.669919 16739 consensus_queue.cc:260] T c727468585cc4bff8f000e922b7a7d95 P f3160b8200a64810983bda11c4af8fff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:54:53.670470 16695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a69054eca44462f8f9d0ecadd574a2a" candidate_uuid: "f3160b8200a64810983bda11c4af8fff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93374462fb7d40ac80f3d526d4547642"
I20260709 14:54:53.672801 16546 raft_consensus.cc:2468] T 6492b42adab04eceb2ad67a6f9dca9ed P 1cb7a022bda844bfb69fec38131c8e31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93374462fb7d40ac80f3d526d4547642 in term 1.
W20260709 14:54:53.673400 16585 leader_election.cc:343] T 9a69054eca44462f8f9d0ecadd574a2a P f3160b8200a64810983bda11c4af8fff [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 93374462fb7d40ac80f3d526d4547642 (127.6.101.67:41835): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:53.676498 16741 ts_tablet_manager.cc:1434] T e197eb61cbe44c1e99a7a9cc182b7268 P 93374462fb7d40ac80f3d526d4547642: Time spent starting tablet: real 0.060s	user 0.009s	sys 0.007s
I20260709 14:54:53.676599 16739 ts_tablet_manager.cc:1434] T c727468585cc4bff8f000e922b7a7d95 P f3160b8200a64810983bda11c4af8fff: Time spent starting tablet: real 0.017s	user 0.011s	sys 0.000s
I20260709 14:54:53.673612 16745 leader_election.cc:290] T 9a69054eca44462f8f9d0ecadd574a2a P f3160b8200a64810983bda11c4af8fff [CANDIDATE]: Term 1 election: Requested vote from peers 1cb7a022bda844bfb69fec38131c8e31 (127.6.101.65:41617), 93374462fb7d40ac80f3d526d4547642 (127.6.101.67:41835)
I20260709 14:54:53.678611 16741 tablet_bootstrap.cc:492] T c727468585cc4bff8f000e922b7a7d95 P 93374462fb7d40ac80f3d526d4547642: Bootstrap starting.
I20260709 14:54:53.679478 16738 tablet_bootstrap.cc:492] T 43486d5085024ad4ab238eb24756ce7b P 1cb7a022bda844bfb69fec38131c8e31: No bootstrap required, opened a new log
I20260709 14:54:53.682032 16738 ts_tablet_manager.cc:1403] T 43486d5085024ad4ab238eb24756ce7b P 1cb7a022bda844bfb69fec38131c8e31: Time spent bootstrapping tablet: real 0.207s	user 0.016s	sys 0.017s
I20260709 14:54:53.682168 16660 leader_election.cc:304] T 6492b42adab04eceb2ad67a6f9dca9ed P 93374462fb7d40ac80f3d526d4547642 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1cb7a022bda844bfb69fec38131c8e31, 93374462fb7d40ac80f3d526d4547642; no voters: f3160b8200a64810983bda11c4af8fff
I20260709 14:54:53.685930 16739 tablet_bootstrap.cc:492] T 6492b42adab04eceb2ad67a6f9dca9ed P f3160b8200a64810983bda11c4af8fff: Bootstrap starting.
I20260709 14:54:53.686408 16768 raft_consensus.cc:2804] T 6492b42adab04eceb2ad67a6f9dca9ed P 93374462fb7d40ac80f3d526d4547642 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:54:53.688716 16768 raft_consensus.cc:697] T 6492b42adab04eceb2ad67a6f9dca9ed P 93374462fb7d40ac80f3d526d4547642 [term 1 LEADER]: Becoming Leader. State: Replica: 93374462fb7d40ac80f3d526d4547642, State: Running, Role: LEADER
I20260709 14:54:53.690085 16768 consensus_queue.cc:237] T 6492b42adab04eceb2ad67a6f9dca9ed P 93374462fb7d40ac80f3d526d4547642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:54:53.693045 16738 raft_consensus.cc:359] T 43486d5085024ad4ab238eb24756ce7b P 1cb7a022bda844bfb69fec38131c8e31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:54:53.694537 16738 raft_consensus.cc:385] T 43486d5085024ad4ab238eb24756ce7b P 1cb7a022bda844bfb69fec38131c8e31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:53.694965 16738 raft_consensus.cc:740] T 43486d5085024ad4ab238eb24756ce7b P 1cb7a022bda844bfb69fec38131c8e31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cb7a022bda844bfb69fec38131c8e31, State: Initialized, Role: FOLLOWER
I20260709 14:54:53.696457 16738 consensus_queue.cc:260] T 43486d5085024ad4ab238eb24756ce7b P 1cb7a022bda844bfb69fec38131c8e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:54:53.700706 16738 ts_tablet_manager.cc:1434] T 43486d5085024ad4ab238eb24756ce7b P 1cb7a022bda844bfb69fec38131c8e31: Time spent starting tablet: real 0.016s	user 0.010s	sys 0.000s
I20260709 14:54:53.702997 16738 tablet_bootstrap.cc:492] T e197eb61cbe44c1e99a7a9cc182b7268 P 1cb7a022bda844bfb69fec38131c8e31: Bootstrap starting.
I20260709 14:54:53.705999 16739 tablet_bootstrap.cc:654] T 6492b42adab04eceb2ad67a6f9dca9ed P f3160b8200a64810983bda11c4af8fff: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:53.708492 16545 raft_consensus.cc:2468] T 9a69054eca44462f8f9d0ecadd574a2a P 1cb7a022bda844bfb69fec38131c8e31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3160b8200a64810983bda11c4af8fff in term 1.
I20260709 14:54:53.713030 16738 tablet_bootstrap.cc:654] T e197eb61cbe44c1e99a7a9cc182b7268 P 1cb7a022bda844bfb69fec38131c8e31: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:53.714268 16741 tablet_bootstrap.cc:654] T c727468585cc4bff8f000e922b7a7d95 P 93374462fb7d40ac80f3d526d4547642: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:53.715497 16586 leader_election.cc:304] T 9a69054eca44462f8f9d0ecadd574a2a P f3160b8200a64810983bda11c4af8fff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1cb7a022bda844bfb69fec38131c8e31, f3160b8200a64810983bda11c4af8fff; no voters: 93374462fb7d40ac80f3d526d4547642
I20260709 14:54:53.717175 16745 raft_consensus.cc:2804] T 9a69054eca44462f8f9d0ecadd574a2a P f3160b8200a64810983bda11c4af8fff [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:54:53.717911 16745 raft_consensus.cc:697] T 9a69054eca44462f8f9d0ecadd574a2a P f3160b8200a64810983bda11c4af8fff [term 1 LEADER]: Becoming Leader. State: Replica: f3160b8200a64810983bda11c4af8fff, State: Running, Role: LEADER
I20260709 14:54:53.720626 16745 consensus_queue.cc:237] T 9a69054eca44462f8f9d0ecadd574a2a P f3160b8200a64810983bda11c4af8fff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:54:53.730588 16738 tablet_bootstrap.cc:492] T e197eb61cbe44c1e99a7a9cc182b7268 P 1cb7a022bda844bfb69fec38131c8e31: No bootstrap required, opened a new log
I20260709 14:54:53.731298 16738 ts_tablet_manager.cc:1403] T e197eb61cbe44c1e99a7a9cc182b7268 P 1cb7a022bda844bfb69fec38131c8e31: Time spent bootstrapping tablet: real 0.029s	user 0.019s	sys 0.004s
I20260709 14:54:53.733093 16741 tablet_bootstrap.cc:492] T c727468585cc4bff8f000e922b7a7d95 P 93374462fb7d40ac80f3d526d4547642: No bootstrap required, opened a new log
I20260709 14:54:53.734306 16741 ts_tablet_manager.cc:1403] T c727468585cc4bff8f000e922b7a7d95 P 93374462fb7d40ac80f3d526d4547642: Time spent bootstrapping tablet: real 0.056s	user 0.015s	sys 0.013s
I20260709 14:54:53.735733 16738 raft_consensus.cc:359] T e197eb61cbe44c1e99a7a9cc182b7268 P 1cb7a022bda844bfb69fec38131c8e31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:54:53.736814 16738 raft_consensus.cc:385] T e197eb61cbe44c1e99a7a9cc182b7268 P 1cb7a022bda844bfb69fec38131c8e31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:53.737190 16738 raft_consensus.cc:740] T e197eb61cbe44c1e99a7a9cc182b7268 P 1cb7a022bda844bfb69fec38131c8e31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cb7a022bda844bfb69fec38131c8e31, State: Initialized, Role: FOLLOWER
I20260709 14:54:53.738679 16738 consensus_queue.cc:260] T e197eb61cbe44c1e99a7a9cc182b7268 P 1cb7a022bda844bfb69fec38131c8e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:54:53.741554 16739 tablet_bootstrap.cc:492] T 6492b42adab04eceb2ad67a6f9dca9ed P f3160b8200a64810983bda11c4af8fff: No bootstrap required, opened a new log
I20260709 14:54:53.741950 16738 ts_tablet_manager.cc:1434] T e197eb61cbe44c1e99a7a9cc182b7268 P 1cb7a022bda844bfb69fec38131c8e31: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.004s
I20260709 14:54:53.743777 16739 ts_tablet_manager.cc:1403] T 6492b42adab04eceb2ad67a6f9dca9ed P f3160b8200a64810983bda11c4af8fff: Time spent bootstrapping tablet: real 0.059s	user 0.013s	sys 0.018s
I20260709 14:54:53.741869 16741 raft_consensus.cc:359] T c727468585cc4bff8f000e922b7a7d95 P 93374462fb7d40ac80f3d526d4547642 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:54:53.744648 16741 raft_consensus.cc:385] T c727468585cc4bff8f000e922b7a7d95 P 93374462fb7d40ac80f3d526d4547642 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:53.745114 16741 raft_consensus.cc:740] T c727468585cc4bff8f000e922b7a7d95 P 93374462fb7d40ac80f3d526d4547642 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93374462fb7d40ac80f3d526d4547642, State: Initialized, Role: FOLLOWER
I20260709 14:54:53.745421 16738 tablet_bootstrap.cc:492] T 93526d1276e74b9382a2fe40d2694853 P 1cb7a022bda844bfb69fec38131c8e31: Bootstrap starting.
I20260709 14:54:53.750051 16739 raft_consensus.cc:359] T 6492b42adab04eceb2ad67a6f9dca9ed P f3160b8200a64810983bda11c4af8fff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:54:53.753545 16739 raft_consensus.cc:385] T 6492b42adab04eceb2ad67a6f9dca9ed P f3160b8200a64810983bda11c4af8fff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:53.753935 16739 raft_consensus.cc:740] T 6492b42adab04eceb2ad67a6f9dca9ed P f3160b8200a64810983bda11c4af8fff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3160b8200a64810983bda11c4af8fff, State: Initialized, Role: FOLLOWER
I20260709 14:54:53.749507 16741 consensus_queue.cc:260] T c727468585cc4bff8f000e922b7a7d95 P 93374462fb7d40ac80f3d526d4547642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:54:53.756688 16741 ts_tablet_manager.cc:1434] T c727468585cc4bff8f000e922b7a7d95 P 93374462fb7d40ac80f3d526d4547642: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.003s
I20260709 14:54:53.758245 16741 tablet_bootstrap.cc:492] T 93526d1276e74b9382a2fe40d2694853 P 93374462fb7d40ac80f3d526d4547642: Bootstrap starting.
I20260709 14:54:53.759402 16738 tablet_bootstrap.cc:654] T 93526d1276e74b9382a2fe40d2694853 P 1cb7a022bda844bfb69fec38131c8e31: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:53.761770 16739 consensus_queue.cc:260] T 6492b42adab04eceb2ad67a6f9dca9ed P f3160b8200a64810983bda11c4af8fff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:54:53.765300 16739 ts_tablet_manager.cc:1434] T 6492b42adab04eceb2ad67a6f9dca9ed P f3160b8200a64810983bda11c4af8fff: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.001s
I20260709 14:54:53.765976 16741 tablet_bootstrap.cc:654] T 93526d1276e74b9382a2fe40d2694853 P 93374462fb7d40ac80f3d526d4547642: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:53.767725 16739 tablet_bootstrap.cc:492] T 93526d1276e74b9382a2fe40d2694853 P f3160b8200a64810983bda11c4af8fff: Bootstrap starting.
I20260709 14:54:53.772891 16442 catalog_manager.cc:5697] T 9a69054eca44462f8f9d0ecadd574a2a P f3160b8200a64810983bda11c4af8fff reported cstate change: term changed from 0 to 1, leader changed from <none> to f3160b8200a64810983bda11c4af8fff (127.6.101.66). New cstate: current_term: 1 leader_uuid: "f3160b8200a64810983bda11c4af8fff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } health_report { overall_health: UNKNOWN } } }
I20260709 14:54:53.773154 16443 catalog_manager.cc:5697] T 27e19d91f3664b33a47fc21010adb06d P 93374462fb7d40ac80f3d526d4547642 reported cstate change: term changed from 0 to 1, leader changed from <none> to 93374462fb7d40ac80f3d526d4547642 (127.6.101.67). New cstate: current_term: 1 leader_uuid: "93374462fb7d40ac80f3d526d4547642" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } health_report { overall_health: HEALTHY } } }
I20260709 14:54:53.776399 16768 raft_consensus.cc:493] T c727468585cc4bff8f000e922b7a7d95 P 93374462fb7d40ac80f3d526d4547642 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:53.777295 16443 catalog_manager.cc:5697] T 6492b42adab04eceb2ad67a6f9dca9ed P 93374462fb7d40ac80f3d526d4547642 reported cstate change: term changed from 0 to 1, leader changed from <none> to 93374462fb7d40ac80f3d526d4547642 (127.6.101.67). New cstate: current_term: 1 leader_uuid: "93374462fb7d40ac80f3d526d4547642" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } health_report { overall_health: HEALTHY } } }
I20260709 14:54:53.777616 16768 raft_consensus.cc:515] T c727468585cc4bff8f000e922b7a7d95 P 93374462fb7d40ac80f3d526d4547642 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:54:53.782725 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c727468585cc4bff8f000e922b7a7d95" candidate_uuid: "93374462fb7d40ac80f3d526d4547642" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cb7a022bda844bfb69fec38131c8e31" is_pre_election: true
I20260709 14:54:53.784315 16739 tablet_bootstrap.cc:654] T 93526d1276e74b9382a2fe40d2694853 P f3160b8200a64810983bda11c4af8fff: Neither blocks nor log segments found. Creating new log.
W20260709 14:54:53.785468 16660 leader_election.cc:343] T c727468585cc4bff8f000e922b7a7d95 P 93374462fb7d40ac80f3d526d4547642 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1cb7a022bda844bfb69fec38131c8e31 (127.6.101.65:41617): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:53.789054 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c727468585cc4bff8f000e922b7a7d95" candidate_uuid: "93374462fb7d40ac80f3d526d4547642" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3160b8200a64810983bda11c4af8fff" is_pre_election: true
I20260709 14:54:53.790038 16618 raft_consensus.cc:2468] T c727468585cc4bff8f000e922b7a7d95 P f3160b8200a64810983bda11c4af8fff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93374462fb7d40ac80f3d526d4547642 in term 0.
I20260709 14:54:53.791875 16661 leader_election.cc:304] T c727468585cc4bff8f000e922b7a7d95 P 93374462fb7d40ac80f3d526d4547642 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 93374462fb7d40ac80f3d526d4547642, f3160b8200a64810983bda11c4af8fff; no voters: 1cb7a022bda844bfb69fec38131c8e31
I20260709 14:54:53.793187 16771 raft_consensus.cc:2804] T c727468585cc4bff8f000e922b7a7d95 P 93374462fb7d40ac80f3d526d4547642 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:54:53.793699 16771 raft_consensus.cc:493] T c727468585cc4bff8f000e922b7a7d95 P 93374462fb7d40ac80f3d526d4547642 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:54:53.794202 16771 raft_consensus.cc:3060] T c727468585cc4bff8f000e922b7a7d95 P 93374462fb7d40ac80f3d526d4547642 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:53.801465 16768 leader_election.cc:290] T c727468585cc4bff8f000e922b7a7d95 P 93374462fb7d40ac80f3d526d4547642 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1cb7a022bda844bfb69fec38131c8e31 (127.6.101.65:41617), f3160b8200a64810983bda11c4af8fff (127.6.101.66:35977)
I20260709 14:54:53.805135 16738 tablet_bootstrap.cc:492] T 93526d1276e74b9382a2fe40d2694853 P 1cb7a022bda844bfb69fec38131c8e31: No bootstrap required, opened a new log
I20260709 14:54:53.806034 16738 ts_tablet_manager.cc:1403] T 93526d1276e74b9382a2fe40d2694853 P 1cb7a022bda844bfb69fec38131c8e31: Time spent bootstrapping tablet: real 0.061s	user 0.016s	sys 0.013s
I20260709 14:54:53.815467 16738 raft_consensus.cc:359] T 93526d1276e74b9382a2fe40d2694853 P 1cb7a022bda844bfb69fec38131c8e31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:54:53.816447 16738 raft_consensus.cc:385] T 93526d1276e74b9382a2fe40d2694853 P 1cb7a022bda844bfb69fec38131c8e31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:53.816696 16741 tablet_bootstrap.cc:492] T 93526d1276e74b9382a2fe40d2694853 P 93374462fb7d40ac80f3d526d4547642: No bootstrap required, opened a new log
I20260709 14:54:53.816887 16738 raft_consensus.cc:740] T 93526d1276e74b9382a2fe40d2694853 P 1cb7a022bda844bfb69fec38131c8e31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cb7a022bda844bfb69fec38131c8e31, State: Initialized, Role: FOLLOWER
I20260709 14:54:53.817468 16741 ts_tablet_manager.cc:1403] T 93526d1276e74b9382a2fe40d2694853 P 93374462fb7d40ac80f3d526d4547642: Time spent bootstrapping tablet: real 0.060s	user 0.034s	sys 0.019s
I20260709 14:54:53.818336 16738 consensus_queue.cc:260] T 93526d1276e74b9382a2fe40d2694853 P 1cb7a022bda844bfb69fec38131c8e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:54:53.823413 16771 raft_consensus.cc:515] T c727468585cc4bff8f000e922b7a7d95 P 93374462fb7d40ac80f3d526d4547642 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:54:53.827400 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c727468585cc4bff8f000e922b7a7d95" candidate_uuid: "93374462fb7d40ac80f3d526d4547642" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cb7a022bda844bfb69fec38131c8e31"
W20260709 14:54:53.829190 16660 leader_election.cc:343] T c727468585cc4bff8f000e922b7a7d95 P 93374462fb7d40ac80f3d526d4547642 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1cb7a022bda844bfb69fec38131c8e31 (127.6.101.65:41617): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:53.831790 16741 raft_consensus.cc:359] T 93526d1276e74b9382a2fe40d2694853 P 93374462fb7d40ac80f3d526d4547642 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:54:53.832381 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c727468585cc4bff8f000e922b7a7d95" candidate_uuid: "93374462fb7d40ac80f3d526d4547642" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3160b8200a64810983bda11c4af8fff"
I20260709 14:54:53.833768 16618 raft_consensus.cc:3060] T c727468585cc4bff8f000e922b7a7d95 P f3160b8200a64810983bda11c4af8fff [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:53.834718 16738 ts_tablet_manager.cc:1434] T 93526d1276e74b9382a2fe40d2694853 P 1cb7a022bda844bfb69fec38131c8e31: Time spent starting tablet: real 0.028s	user 0.003s	sys 0.008s
I20260709 14:54:53.839826 16739 tablet_bootstrap.cc:492] T 93526d1276e74b9382a2fe40d2694853 P f3160b8200a64810983bda11c4af8fff: No bootstrap required, opened a new log
I20260709 14:54:53.840555 16739 ts_tablet_manager.cc:1403] T 93526d1276e74b9382a2fe40d2694853 P f3160b8200a64810983bda11c4af8fff: Time spent bootstrapping tablet: real 0.073s	user 0.025s	sys 0.031s
I20260709 14:54:53.841274 16738 tablet_bootstrap.cc:492] T 544aaafd8b6b427191e89277cb281bd1 P 1cb7a022bda844bfb69fec38131c8e31: Bootstrap starting.
I20260709 14:54:53.832907 16771 leader_election.cc:290] T c727468585cc4bff8f000e922b7a7d95 P 93374462fb7d40ac80f3d526d4547642 [CANDIDATE]: Term 1 election: Requested vote from peers 1cb7a022bda844bfb69fec38131c8e31 (127.6.101.65:41617), f3160b8200a64810983bda11c4af8fff (127.6.101.66:35977)
I20260709 14:54:53.844645 16739 raft_consensus.cc:359] T 93526d1276e74b9382a2fe40d2694853 P f3160b8200a64810983bda11c4af8fff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:54:53.846658 16739 raft_consensus.cc:385] T 93526d1276e74b9382a2fe40d2694853 P f3160b8200a64810983bda11c4af8fff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:53.846772 16741 raft_consensus.cc:385] T 93526d1276e74b9382a2fe40d2694853 P 93374462fb7d40ac80f3d526d4547642 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:53.846323 16618 raft_consensus.cc:2468] T c727468585cc4bff8f000e922b7a7d95 P f3160b8200a64810983bda11c4af8fff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93374462fb7d40ac80f3d526d4547642 in term 1.
I20260709 14:54:53.847338 16739 raft_consensus.cc:740] T 93526d1276e74b9382a2fe40d2694853 P f3160b8200a64810983bda11c4af8fff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3160b8200a64810983bda11c4af8fff, State: Initialized, Role: FOLLOWER
I20260709 14:54:53.847441 16741 raft_consensus.cc:740] T 93526d1276e74b9382a2fe40d2694853 P 93374462fb7d40ac80f3d526d4547642 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93374462fb7d40ac80f3d526d4547642, State: Initialized, Role: FOLLOWER
I20260709 14:54:53.849484 16661 leader_election.cc:304] T c727468585cc4bff8f000e922b7a7d95 P 93374462fb7d40ac80f3d526d4547642 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 93374462fb7d40ac80f3d526d4547642, f3160b8200a64810983bda11c4af8fff; no voters: 1cb7a022bda844bfb69fec38131c8e31
I20260709 14:54:53.850572 16739 consensus_queue.cc:260] T 93526d1276e74b9382a2fe40d2694853 P f3160b8200a64810983bda11c4af8fff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:54:53.851938 16741 consensus_queue.cc:260] T 93526d1276e74b9382a2fe40d2694853 P 93374462fb7d40ac80f3d526d4547642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:54:53.852789 16738 tablet_bootstrap.cc:654] T 544aaafd8b6b427191e89277cb281bd1 P 1cb7a022bda844bfb69fec38131c8e31: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:53.854885 16741 ts_tablet_manager.cc:1434] T 93526d1276e74b9382a2fe40d2694853 P 93374462fb7d40ac80f3d526d4547642: Time spent starting tablet: real 0.037s	user 0.010s	sys 0.001s
I20260709 14:54:53.856016 16768 raft_consensus.cc:2804] T c727468585cc4bff8f000e922b7a7d95 P 93374462fb7d40ac80f3d526d4547642 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:54:53.857113 16768 raft_consensus.cc:697] T c727468585cc4bff8f000e922b7a7d95 P 93374462fb7d40ac80f3d526d4547642 [term 1 LEADER]: Becoming Leader. State: Replica: 93374462fb7d40ac80f3d526d4547642, State: Running, Role: LEADER
I20260709 14:54:53.858665 16768 consensus_queue.cc:237] T c727468585cc4bff8f000e922b7a7d95 P 93374462fb7d40ac80f3d526d4547642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:54:53.863891 16766 raft_consensus.cc:493] T e197eb61cbe44c1e99a7a9cc182b7268 P 1cb7a022bda844bfb69fec38131c8e31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:53.865152 16766 raft_consensus.cc:515] T e197eb61cbe44c1e99a7a9cc182b7268 P 1cb7a022bda844bfb69fec38131c8e31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:54:53.868405 16739 ts_tablet_manager.cc:1434] T 93526d1276e74b9382a2fe40d2694853 P f3160b8200a64810983bda11c4af8fff: Time spent starting tablet: real 0.027s	user 0.011s	sys 0.003s
I20260709 14:54:53.870522 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e197eb61cbe44c1e99a7a9cc182b7268" candidate_uuid: "1cb7a022bda844bfb69fec38131c8e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3160b8200a64810983bda11c4af8fff" is_pre_election: true
I20260709 14:54:53.871842 16738 tablet_bootstrap.cc:492] T 544aaafd8b6b427191e89277cb281bd1 P 1cb7a022bda844bfb69fec38131c8e31: No bootstrap required, opened a new log
I20260709 14:54:53.872699 16741 tablet_bootstrap.cc:492] T 9a69054eca44462f8f9d0ecadd574a2a P 93374462fb7d40ac80f3d526d4547642: Bootstrap starting.
W20260709 14:54:53.872898 16512 leader_election.cc:343] T e197eb61cbe44c1e99a7a9cc182b7268 P 1cb7a022bda844bfb69fec38131c8e31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f3160b8200a64810983bda11c4af8fff (127.6.101.66:35977): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:53.872717 16738 ts_tablet_manager.cc:1403] T 544aaafd8b6b427191e89277cb281bd1 P 1cb7a022bda844bfb69fec38131c8e31: Time spent bootstrapping tablet: real 0.033s	user 0.016s	sys 0.008s
I20260709 14:54:53.875023 16739 tablet_bootstrap.cc:492] T e197eb61cbe44c1e99a7a9cc182b7268 P f3160b8200a64810983bda11c4af8fff: Bootstrap starting.
I20260709 14:54:53.876315 16695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e197eb61cbe44c1e99a7a9cc182b7268" candidate_uuid: "1cb7a022bda844bfb69fec38131c8e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93374462fb7d40ac80f3d526d4547642" is_pre_election: true
I20260709 14:54:53.877177 16695 raft_consensus.cc:2468] T e197eb61cbe44c1e99a7a9cc182b7268 P 93374462fb7d40ac80f3d526d4547642 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1cb7a022bda844bfb69fec38131c8e31 in term 0.
I20260709 14:54:53.878952 16510 leader_election.cc:304] T e197eb61cbe44c1e99a7a9cc182b7268 P 1cb7a022bda844bfb69fec38131c8e31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1cb7a022bda844bfb69fec38131c8e31, 93374462fb7d40ac80f3d526d4547642; no voters: f3160b8200a64810983bda11c4af8fff
I20260709 14:54:53.879076 16738 raft_consensus.cc:359] T 544aaafd8b6b427191e89277cb281bd1 P 1cb7a022bda844bfb69fec38131c8e31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:54:53.880455 16767 raft_consensus.cc:2804] T e197eb61cbe44c1e99a7a9cc182b7268 P 1cb7a022bda844bfb69fec38131c8e31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:54:53.881356 16767 raft_consensus.cc:493] T e197eb61cbe44c1e99a7a9cc182b7268 P 1cb7a022bda844bfb69fec38131c8e31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:54:53.881408 16738 raft_consensus.cc:385] T 544aaafd8b6b427191e89277cb281bd1 P 1cb7a022bda844bfb69fec38131c8e31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:53.881841 16767 raft_consensus.cc:3060] T e197eb61cbe44c1e99a7a9cc182b7268 P 1cb7a022bda844bfb69fec38131c8e31 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:53.882380 16738 raft_consensus.cc:740] T 544aaafd8b6b427191e89277cb281bd1 P 1cb7a022bda844bfb69fec38131c8e31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cb7a022bda844bfb69fec38131c8e31, State: Initialized, Role: FOLLOWER
I20260709 14:54:53.883701 16738 consensus_queue.cc:260] T 544aaafd8b6b427191e89277cb281bd1 P 1cb7a022bda844bfb69fec38131c8e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:54:53.886787 16739 tablet_bootstrap.cc:654] T e197eb61cbe44c1e99a7a9cc182b7268 P f3160b8200a64810983bda11c4af8fff: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:53.881011 16766 leader_election.cc:290] T e197eb61cbe44c1e99a7a9cc182b7268 P 1cb7a022bda844bfb69fec38131c8e31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3160b8200a64810983bda11c4af8fff (127.6.101.66:35977), 93374462fb7d40ac80f3d526d4547642 (127.6.101.67:41835)
I20260709 14:54:53.889348 16738 ts_tablet_manager.cc:1434] T 544aaafd8b6b427191e89277cb281bd1 P 1cb7a022bda844bfb69fec38131c8e31: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.001s
I20260709 14:54:53.892884 16738 tablet_bootstrap.cc:492] T c727468585cc4bff8f000e922b7a7d95 P 1cb7a022bda844bfb69fec38131c8e31: Bootstrap starting.
I20260709 14:54:53.899022 16739 tablet_bootstrap.cc:492] T e197eb61cbe44c1e99a7a9cc182b7268 P f3160b8200a64810983bda11c4af8fff: No bootstrap required, opened a new log
I20260709 14:54:53.900184 16739 ts_tablet_manager.cc:1403] T e197eb61cbe44c1e99a7a9cc182b7268 P f3160b8200a64810983bda11c4af8fff: Time spent bootstrapping tablet: real 0.026s	user 0.018s	sys 0.002s
I20260709 14:54:53.896731 16767 raft_consensus.cc:515] T e197eb61cbe44c1e99a7a9cc182b7268 P 1cb7a022bda844bfb69fec38131c8e31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:54:53.904525 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e197eb61cbe44c1e99a7a9cc182b7268" candidate_uuid: "1cb7a022bda844bfb69fec38131c8e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3160b8200a64810983bda11c4af8fff"
I20260709 14:54:53.908811 16767 leader_election.cc:290] T e197eb61cbe44c1e99a7a9cc182b7268 P 1cb7a022bda844bfb69fec38131c8e31 [CANDIDATE]: Term 1 election: Requested vote from peers f3160b8200a64810983bda11c4af8fff (127.6.101.66:35977), 93374462fb7d40ac80f3d526d4547642 (127.6.101.67:41835)
I20260709 14:54:53.908690 16695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e197eb61cbe44c1e99a7a9cc182b7268" candidate_uuid: "1cb7a022bda844bfb69fec38131c8e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93374462fb7d40ac80f3d526d4547642"
I20260709 14:54:53.912209 16739 raft_consensus.cc:359] T e197eb61cbe44c1e99a7a9cc182b7268 P f3160b8200a64810983bda11c4af8fff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:54:53.912815 16695 raft_consensus.cc:3060] T e197eb61cbe44c1e99a7a9cc182b7268 P 93374462fb7d40ac80f3d526d4547642 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:53.908658 16738 tablet_bootstrap.cc:654] T c727468585cc4bff8f000e922b7a7d95 P 1cb7a022bda844bfb69fec38131c8e31: Neither blocks nor log segments found. Creating new log.
W20260709 14:54:53.913357 16512 leader_election.cc:343] T e197eb61cbe44c1e99a7a9cc182b7268 P 1cb7a022bda844bfb69fec38131c8e31 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f3160b8200a64810983bda11c4af8fff (127.6.101.66:35977): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:53.917621 16739 raft_consensus.cc:385] T e197eb61cbe44c1e99a7a9cc182b7268 P f3160b8200a64810983bda11c4af8fff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:53.918244 16739 raft_consensus.cc:740] T e197eb61cbe44c1e99a7a9cc182b7268 P f3160b8200a64810983bda11c4af8fff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3160b8200a64810983bda11c4af8fff, State: Initialized, Role: FOLLOWER
I20260709 14:54:53.919287 16739 consensus_queue.cc:260] T e197eb61cbe44c1e99a7a9cc182b7268 P f3160b8200a64810983bda11c4af8fff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:54:53.921862 16741 tablet_bootstrap.cc:654] T 9a69054eca44462f8f9d0ecadd574a2a P 93374462fb7d40ac80f3d526d4547642: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:53.925173 16738 tablet_bootstrap.cc:492] T c727468585cc4bff8f000e922b7a7d95 P 1cb7a022bda844bfb69fec38131c8e31: No bootstrap required, opened a new log
I20260709 14:54:53.926110 16738 ts_tablet_manager.cc:1403] T c727468585cc4bff8f000e922b7a7d95 P 1cb7a022bda844bfb69fec38131c8e31: Time spent bootstrapping tablet: real 0.034s	user 0.018s	sys 0.002s
I20260709 14:54:53.927479 16739 ts_tablet_manager.cc:1434] T e197eb61cbe44c1e99a7a9cc182b7268 P f3160b8200a64810983bda11c4af8fff: Time spent starting tablet: real 0.027s	user 0.011s	sys 0.001s
I20260709 14:54:53.929103 16739 tablet_bootstrap.cc:492] T 544aaafd8b6b427191e89277cb281bd1 P f3160b8200a64810983bda11c4af8fff: Bootstrap starting.
I20260709 14:54:53.929625 16745 raft_consensus.cc:493] T 6492b42adab04eceb2ad67a6f9dca9ed P f3160b8200a64810983bda11c4af8fff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:53.929997 16738 raft_consensus.cc:359] T c727468585cc4bff8f000e922b7a7d95 P 1cb7a022bda844bfb69fec38131c8e31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:54:53.930261 16745 raft_consensus.cc:515] T 6492b42adab04eceb2ad67a6f9dca9ed P f3160b8200a64810983bda11c4af8fff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:54:53.930876 16738 raft_consensus.cc:385] T c727468585cc4bff8f000e922b7a7d95 P 1cb7a022bda844bfb69fec38131c8e31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:53.931356 16738 raft_consensus.cc:740] T c727468585cc4bff8f000e922b7a7d95 P 1cb7a022bda844bfb69fec38131c8e31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cb7a022bda844bfb69fec38131c8e31, State: Initialized, Role: FOLLOWER
I20260709 14:54:53.932245 16738 consensus_queue.cc:260] T c727468585cc4bff8f000e922b7a7d95 P 1cb7a022bda844bfb69fec38131c8e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:54:53.934337 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6492b42adab04eceb2ad67a6f9dca9ed" candidate_uuid: "f3160b8200a64810983bda11c4af8fff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cb7a022bda844bfb69fec38131c8e31" is_pre_election: true
I20260709 14:54:53.935209 16545 raft_consensus.cc:2393] T 6492b42adab04eceb2ad67a6f9dca9ed P 1cb7a022bda844bfb69fec38131c8e31 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3160b8200a64810983bda11c4af8fff in current term 1: Already voted for candidate 93374462fb7d40ac80f3d526d4547642 in this term.
I20260709 14:54:53.935415 16738 ts_tablet_manager.cc:1434] T c727468585cc4bff8f000e922b7a7d95 P 1cb7a022bda844bfb69fec38131c8e31: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 14:54:53.938519 16738 tablet_bootstrap.cc:492] T 213053d1a14c4365a4bccd2d11a2764a P 1cb7a022bda844bfb69fec38131c8e31: Bootstrap starting.
I20260709 14:54:53.940822 16739 tablet_bootstrap.cc:654] T 544aaafd8b6b427191e89277cb281bd1 P f3160b8200a64810983bda11c4af8fff: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:53.944104 16695 raft_consensus.cc:2468] T e197eb61cbe44c1e99a7a9cc182b7268 P 93374462fb7d40ac80f3d526d4547642 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1cb7a022bda844bfb69fec38131c8e31 in term 1.
I20260709 14:54:53.947182 16694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6492b42adab04eceb2ad67a6f9dca9ed" candidate_uuid: "f3160b8200a64810983bda11c4af8fff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93374462fb7d40ac80f3d526d4547642" is_pre_election: true
I20260709 14:54:53.947962 16745 leader_election.cc:290] T 6492b42adab04eceb2ad67a6f9dca9ed P f3160b8200a64810983bda11c4af8fff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1cb7a022bda844bfb69fec38131c8e31 (127.6.101.65:41617), 93374462fb7d40ac80f3d526d4547642 (127.6.101.67:41835)
I20260709 14:54:53.949612 16585 leader_election.cc:304] T 6492b42adab04eceb2ad67a6f9dca9ed P f3160b8200a64810983bda11c4af8fff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3160b8200a64810983bda11c4af8fff; no voters: 1cb7a022bda844bfb69fec38131c8e31, 93374462fb7d40ac80f3d526d4547642
I20260709 14:54:53.951802 16510 leader_election.cc:304] T e197eb61cbe44c1e99a7a9cc182b7268 P 1cb7a022bda844bfb69fec38131c8e31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1cb7a022bda844bfb69fec38131c8e31, 93374462fb7d40ac80f3d526d4547642; no voters: f3160b8200a64810983bda11c4af8fff
I20260709 14:54:53.953531 16738 tablet_bootstrap.cc:654] T 213053d1a14c4365a4bccd2d11a2764a P 1cb7a022bda844bfb69fec38131c8e31: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:53.953675 16767 raft_consensus.cc:2804] T e197eb61cbe44c1e99a7a9cc182b7268 P 1cb7a022bda844bfb69fec38131c8e31 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:54:53.954643 16767 raft_consensus.cc:697] T e197eb61cbe44c1e99a7a9cc182b7268 P 1cb7a022bda844bfb69fec38131c8e31 [term 1 LEADER]: Becoming Leader. State: Replica: 1cb7a022bda844bfb69fec38131c8e31, State: Running, Role: LEADER
I20260709 14:54:53.955726 16767 consensus_queue.cc:237] T e197eb61cbe44c1e99a7a9cc182b7268 P 1cb7a022bda844bfb69fec38131c8e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:54:53.961498 16745 raft_consensus.cc:3060] T 6492b42adab04eceb2ad67a6f9dca9ed P f3160b8200a64810983bda11c4af8fff [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:53.970343 16738 tablet_bootstrap.cc:492] T 213053d1a14c4365a4bccd2d11a2764a P 1cb7a022bda844bfb69fec38131c8e31: No bootstrap required, opened a new log
I20260709 14:54:53.969174 16442 catalog_manager.cc:5697] T c727468585cc4bff8f000e922b7a7d95 P 93374462fb7d40ac80f3d526d4547642 reported cstate change: term changed from 0 to 1, leader changed from <none> to 93374462fb7d40ac80f3d526d4547642 (127.6.101.67). New cstate: current_term: 1 leader_uuid: "93374462fb7d40ac80f3d526d4547642" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } health_report { overall_health: HEALTHY } } }
I20260709 14:54:53.971277 16738 ts_tablet_manager.cc:1403] T 213053d1a14c4365a4bccd2d11a2764a P 1cb7a022bda844bfb69fec38131c8e31: Time spent bootstrapping tablet: real 0.033s	user 0.014s	sys 0.011s
I20260709 14:54:53.976224 16738 raft_consensus.cc:359] T 213053d1a14c4365a4bccd2d11a2764a P 1cb7a022bda844bfb69fec38131c8e31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:54:53.977432 16738 raft_consensus.cc:385] T 213053d1a14c4365a4bccd2d11a2764a P 1cb7a022bda844bfb69fec38131c8e31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:53.977788 16738 raft_consensus.cc:740] T 213053d1a14c4365a4bccd2d11a2764a P 1cb7a022bda844bfb69fec38131c8e31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cb7a022bda844bfb69fec38131c8e31, State: Initialized, Role: FOLLOWER
I20260709 14:54:53.978829 16738 consensus_queue.cc:260] T 213053d1a14c4365a4bccd2d11a2764a P 1cb7a022bda844bfb69fec38131c8e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:54:53.981961 16738 ts_tablet_manager.cc:1434] T 213053d1a14c4365a4bccd2d11a2764a P 1cb7a022bda844bfb69fec38131c8e31: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.005s
I20260709 14:54:53.989600 16767 raft_consensus.cc:493] T 544aaafd8b6b427191e89277cb281bd1 P 1cb7a022bda844bfb69fec38131c8e31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:53.990453 16767 raft_consensus.cc:515] T 544aaafd8b6b427191e89277cb281bd1 P 1cb7a022bda844bfb69fec38131c8e31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:54:53.996428 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544aaafd8b6b427191e89277cb281bd1" candidate_uuid: "1cb7a022bda844bfb69fec38131c8e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3160b8200a64810983bda11c4af8fff" is_pre_election: true
I20260709 14:54:53.996687 16694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544aaafd8b6b427191e89277cb281bd1" candidate_uuid: "1cb7a022bda844bfb69fec38131c8e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93374462fb7d40ac80f3d526d4547642" is_pre_election: true
W20260709 14:54:54.001917 16512 leader_election.cc:343] T 544aaafd8b6b427191e89277cb281bd1 P 1cb7a022bda844bfb69fec38131c8e31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f3160b8200a64810983bda11c4af8fff (127.6.101.66:35977): Illegal state: must be running to vote when last-logged opid is not known
W20260709 14:54:54.004179 16510 leader_election.cc:343] T 544aaafd8b6b427191e89277cb281bd1 P 1cb7a022bda844bfb69fec38131c8e31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 93374462fb7d40ac80f3d526d4547642 (127.6.101.67:41835): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:54:54.001628 16766 raft_consensus.cc:493] T c727468585cc4bff8f000e922b7a7d95 P 1cb7a022bda844bfb69fec38131c8e31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:54.004917 16510 leader_election.cc:304] T 544aaafd8b6b427191e89277cb281bd1 P 1cb7a022bda844bfb69fec38131c8e31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1cb7a022bda844bfb69fec38131c8e31; no voters: 93374462fb7d40ac80f3d526d4547642, f3160b8200a64810983bda11c4af8fff
I20260709 14:54:54.005295 16766 raft_consensus.cc:515] T c727468585cc4bff8f000e922b7a7d95 P 1cb7a022bda844bfb69fec38131c8e31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:54:54.006223 16744 raft_consensus.cc:2749] T 544aaafd8b6b427191e89277cb281bd1 P 1cb7a022bda844bfb69fec38131c8e31 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:54:54.008512 16766 leader_election.cc:290] T c727468585cc4bff8f000e922b7a7d95 P 1cb7a022bda844bfb69fec38131c8e31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3160b8200a64810983bda11c4af8fff (127.6.101.66:35977), 93374462fb7d40ac80f3d526d4547642 (127.6.101.67:41835)
I20260709 14:54:54.010749 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c727468585cc4bff8f000e922b7a7d95" candidate_uuid: "1cb7a022bda844bfb69fec38131c8e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3160b8200a64810983bda11c4af8fff" is_pre_election: true
I20260709 14:54:54.012986 16618 raft_consensus.cc:2393] T c727468585cc4bff8f000e922b7a7d95 P f3160b8200a64810983bda11c4af8fff [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1cb7a022bda844bfb69fec38131c8e31 in current term 1: Already voted for candidate 93374462fb7d40ac80f3d526d4547642 in this term.
I20260709 14:54:54.015774 16766 raft_consensus.cc:493] T 43486d5085024ad4ab238eb24756ce7b P 1cb7a022bda844bfb69fec38131c8e31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:54.021389 16766 raft_consensus.cc:515] T 43486d5085024ad4ab238eb24756ce7b P 1cb7a022bda844bfb69fec38131c8e31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:54:54.023468 16767 leader_election.cc:290] T 544aaafd8b6b427191e89277cb281bd1 P 1cb7a022bda844bfb69fec38131c8e31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3160b8200a64810983bda11c4af8fff (127.6.101.66:35977), 93374462fb7d40ac80f3d526d4547642 (127.6.101.67:41835)
I20260709 14:54:54.026516 16694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c727468585cc4bff8f000e922b7a7d95" candidate_uuid: "1cb7a022bda844bfb69fec38131c8e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93374462fb7d40ac80f3d526d4547642" is_pre_election: true
I20260709 14:54:54.030148 16745 raft_consensus.cc:2749] T 6492b42adab04eceb2ad67a6f9dca9ed P f3160b8200a64810983bda11c4af8fff [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:54:54.031772 16510 leader_election.cc:304] T c727468585cc4bff8f000e922b7a7d95 P 1cb7a022bda844bfb69fec38131c8e31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1cb7a022bda844bfb69fec38131c8e31; no voters: 93374462fb7d40ac80f3d526d4547642, f3160b8200a64810983bda11c4af8fff
I20260709 14:54:54.032742 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43486d5085024ad4ab238eb24756ce7b" candidate_uuid: "1cb7a022bda844bfb69fec38131c8e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3160b8200a64810983bda11c4af8fff" is_pre_election: true
I20260709 14:54:54.034354 16618 raft_consensus.cc:2393] T 43486d5085024ad4ab238eb24756ce7b P f3160b8200a64810983bda11c4af8fff [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1cb7a022bda844bfb69fec38131c8e31 in current term 1: Already voted for candidate 93374462fb7d40ac80f3d526d4547642 in this term.
I20260709 14:54:54.035336 16694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43486d5085024ad4ab238eb24756ce7b" candidate_uuid: "1cb7a022bda844bfb69fec38131c8e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93374462fb7d40ac80f3d526d4547642" is_pre_election: true
I20260709 14:54:54.036767 16767 raft_consensus.cc:3060] T c727468585cc4bff8f000e922b7a7d95 P 1cb7a022bda844bfb69fec38131c8e31 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:54.037294 16510 leader_election.cc:304] T 43486d5085024ad4ab238eb24756ce7b P 1cb7a022bda844bfb69fec38131c8e31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1cb7a022bda844bfb69fec38131c8e31; no voters: 93374462fb7d40ac80f3d526d4547642, f3160b8200a64810983bda11c4af8fff
I20260709 14:54:54.038887 16744 raft_consensus.cc:3060] T 43486d5085024ad4ab238eb24756ce7b P 1cb7a022bda844bfb69fec38131c8e31 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:54.046897 16767 raft_consensus.cc:2749] T c727468585cc4bff8f000e922b7a7d95 P 1cb7a022bda844bfb69fec38131c8e31 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:54:54.031136 16766 leader_election.cc:290] T 43486d5085024ad4ab238eb24756ce7b P 1cb7a022bda844bfb69fec38131c8e31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3160b8200a64810983bda11c4af8fff (127.6.101.66:35977), 93374462fb7d40ac80f3d526d4547642 (127.6.101.67:41835)
I20260709 14:54:54.056056 16741 tablet_bootstrap.cc:492] T 9a69054eca44462f8f9d0ecadd574a2a P 93374462fb7d40ac80f3d526d4547642: No bootstrap required, opened a new log
I20260709 14:54:54.056599 16739 tablet_bootstrap.cc:492] T 544aaafd8b6b427191e89277cb281bd1 P f3160b8200a64810983bda11c4af8fff: No bootstrap required, opened a new log
I20260709 14:54:54.056620 16741 ts_tablet_manager.cc:1403] T 9a69054eca44462f8f9d0ecadd574a2a P 93374462fb7d40ac80f3d526d4547642: Time spent bootstrapping tablet: real 0.184s	user 0.043s	sys 0.047s
I20260709 14:54:54.056715 16744 raft_consensus.cc:2749] T 43486d5085024ad4ab238eb24756ce7b P 1cb7a022bda844bfb69fec38131c8e31 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:54:54.057457 16739 ts_tablet_manager.cc:1403] T 544aaafd8b6b427191e89277cb281bd1 P f3160b8200a64810983bda11c4af8fff: Time spent bootstrapping tablet: real 0.129s	user 0.066s	sys 0.054s
I20260709 14:54:54.060468 16741 raft_consensus.cc:359] T 9a69054eca44462f8f9d0ecadd574a2a P 93374462fb7d40ac80f3d526d4547642 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:54:54.061551 16741 raft_consensus.cc:385] T 9a69054eca44462f8f9d0ecadd574a2a P 93374462fb7d40ac80f3d526d4547642 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:54.061926 16739 raft_consensus.cc:359] T 544aaafd8b6b427191e89277cb281bd1 P f3160b8200a64810983bda11c4af8fff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:54:54.061954 16741 raft_consensus.cc:740] T 9a69054eca44462f8f9d0ecadd574a2a P 93374462fb7d40ac80f3d526d4547642 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93374462fb7d40ac80f3d526d4547642, State: Initialized, Role: FOLLOWER
I20260709 14:54:54.060910 16441 catalog_manager.cc:5697] T e197eb61cbe44c1e99a7a9cc182b7268 P 1cb7a022bda844bfb69fec38131c8e31 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1cb7a022bda844bfb69fec38131c8e31 (127.6.101.65). New cstate: current_term: 1 leader_uuid: "1cb7a022bda844bfb69fec38131c8e31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } health_report { overall_health: UNKNOWN } } }
I20260709 14:54:54.062873 16739 raft_consensus.cc:385] T 544aaafd8b6b427191e89277cb281bd1 P f3160b8200a64810983bda11c4af8fff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:54.063302 16739 raft_consensus.cc:740] T 544aaafd8b6b427191e89277cb281bd1 P f3160b8200a64810983bda11c4af8fff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3160b8200a64810983bda11c4af8fff, State: Initialized, Role: FOLLOWER
I20260709 14:54:54.063652 16741 consensus_queue.cc:260] T 9a69054eca44462f8f9d0ecadd574a2a P 93374462fb7d40ac80f3d526d4547642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:54:54.064563 16739 consensus_queue.cc:260] T 544aaafd8b6b427191e89277cb281bd1 P f3160b8200a64810983bda11c4af8fff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:54:54.070052 16739 ts_tablet_manager.cc:1434] T 544aaafd8b6b427191e89277cb281bd1 P f3160b8200a64810983bda11c4af8fff: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.003s
I20260709 14:54:54.072050 16739 tablet_bootstrap.cc:492] T 213053d1a14c4365a4bccd2d11a2764a P f3160b8200a64810983bda11c4af8fff: Bootstrap starting.
I20260709 14:54:54.080317 16739 tablet_bootstrap.cc:654] T 213053d1a14c4365a4bccd2d11a2764a P f3160b8200a64810983bda11c4af8fff: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:54.085099 16741 ts_tablet_manager.cc:1434] T 9a69054eca44462f8f9d0ecadd574a2a P 93374462fb7d40ac80f3d526d4547642: Time spent starting tablet: real 0.028s	user 0.008s	sys 0.002s
W20260709 14:54:54.085355 16492 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 14:54:54.087030 16741 tablet_bootstrap.cc:492] T 213053d1a14c4365a4bccd2d11a2764a P 93374462fb7d40ac80f3d526d4547642: Bootstrap starting.
I20260709 14:54:54.087332 16739 tablet_bootstrap.cc:492] T 213053d1a14c4365a4bccd2d11a2764a P f3160b8200a64810983bda11c4af8fff: No bootstrap required, opened a new log
I20260709 14:54:54.087807 16739 ts_tablet_manager.cc:1403] T 213053d1a14c4365a4bccd2d11a2764a P f3160b8200a64810983bda11c4af8fff: Time spent bootstrapping tablet: real 0.016s	user 0.014s	sys 0.000s
I20260709 14:54:54.091001 16739 raft_consensus.cc:359] T 213053d1a14c4365a4bccd2d11a2764a P f3160b8200a64810983bda11c4af8fff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:54:54.091892 16739 raft_consensus.cc:385] T 213053d1a14c4365a4bccd2d11a2764a P f3160b8200a64810983bda11c4af8fff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:54.092204 16739 raft_consensus.cc:740] T 213053d1a14c4365a4bccd2d11a2764a P f3160b8200a64810983bda11c4af8fff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3160b8200a64810983bda11c4af8fff, State: Initialized, Role: FOLLOWER
I20260709 14:54:54.093423 16741 tablet_bootstrap.cc:654] T 213053d1a14c4365a4bccd2d11a2764a P 93374462fb7d40ac80f3d526d4547642: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:54.093088 16739 consensus_queue.cc:260] T 213053d1a14c4365a4bccd2d11a2764a P f3160b8200a64810983bda11c4af8fff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:54:54.096228 16739 ts_tablet_manager.cc:1434] T 213053d1a14c4365a4bccd2d11a2764a P f3160b8200a64810983bda11c4af8fff: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 14:54:54.099272 16768 consensus_queue.cc:1048] T 43486d5085024ad4ab238eb24756ce7b P 93374462fb7d40ac80f3d526d4547642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:54:54.100468 16741 tablet_bootstrap.cc:492] T 213053d1a14c4365a4bccd2d11a2764a P 93374462fb7d40ac80f3d526d4547642: No bootstrap required, opened a new log
I20260709 14:54:54.101338 16741 ts_tablet_manager.cc:1403] T 213053d1a14c4365a4bccd2d11a2764a P 93374462fb7d40ac80f3d526d4547642: Time spent bootstrapping tablet: real 0.015s	user 0.014s	sys 0.000s
I20260709 14:54:54.105005 16741 raft_consensus.cc:359] T 213053d1a14c4365a4bccd2d11a2764a P 93374462fb7d40ac80f3d526d4547642 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:54:54.105754 16741 raft_consensus.cc:385] T 213053d1a14c4365a4bccd2d11a2764a P 93374462fb7d40ac80f3d526d4547642 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:54.106024 16741 raft_consensus.cc:740] T 213053d1a14c4365a4bccd2d11a2764a P 93374462fb7d40ac80f3d526d4547642 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93374462fb7d40ac80f3d526d4547642, State: Initialized, Role: FOLLOWER
I20260709 14:54:54.106755 16741 consensus_queue.cc:260] T 213053d1a14c4365a4bccd2d11a2764a P 93374462fb7d40ac80f3d526d4547642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:54:54.113523 16741 ts_tablet_manager.cc:1434] T 213053d1a14c4365a4bccd2d11a2764a P 93374462fb7d40ac80f3d526d4547642: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 14:54:54.113849 16744 consensus_queue.cc:1048] T 48f69b6ba5bd492b8470cb9edfa3fc49 P 1cb7a022bda844bfb69fec38131c8e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 14:54:54.114758 16741 tablet_bootstrap.cc:492] T 544aaafd8b6b427191e89277cb281bd1 P 93374462fb7d40ac80f3d526d4547642: Bootstrap starting.
I20260709 14:54:54.119095 16744 raft_consensus.cc:493] T 93526d1276e74b9382a2fe40d2694853 P 1cb7a022bda844bfb69fec38131c8e31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:54.119699 16744 raft_consensus.cc:515] T 93526d1276e74b9382a2fe40d2694853 P 1cb7a022bda844bfb69fec38131c8e31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:54:54.121790 16741 tablet_bootstrap.cc:654] T 544aaafd8b6b427191e89277cb281bd1 P 93374462fb7d40ac80f3d526d4547642: Neither blocks nor log segments found. Creating new log.
I20260709 14:54:54.124423 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93526d1276e74b9382a2fe40d2694853" candidate_uuid: "1cb7a022bda844bfb69fec38131c8e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3160b8200a64810983bda11c4af8fff" is_pre_election: true
I20260709 14:54:54.125381 16618 raft_consensus.cc:2468] T 93526d1276e74b9382a2fe40d2694853 P f3160b8200a64810983bda11c4af8fff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1cb7a022bda844bfb69fec38131c8e31 in term 0.
I20260709 14:54:54.127594 16744 leader_election.cc:290] T 93526d1276e74b9382a2fe40d2694853 P 1cb7a022bda844bfb69fec38131c8e31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3160b8200a64810983bda11c4af8fff (127.6.101.66:35977), 93374462fb7d40ac80f3d526d4547642 (127.6.101.67:41835)
I20260709 14:54:54.128643 16768 consensus_queue.cc:1048] T 27e19d91f3664b33a47fc21010adb06d P 93374462fb7d40ac80f3d526d4547642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:54:54.132287 16512 leader_election.cc:304] T 93526d1276e74b9382a2fe40d2694853 P 1cb7a022bda844bfb69fec38131c8e31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1cb7a022bda844bfb69fec38131c8e31, f3160b8200a64810983bda11c4af8fff; no voters: 
I20260709 14:54:54.132952 16694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93526d1276e74b9382a2fe40d2694853" candidate_uuid: "1cb7a022bda844bfb69fec38131c8e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93374462fb7d40ac80f3d526d4547642" is_pre_election: true
I20260709 14:54:54.136011 16741 tablet_bootstrap.cc:492] T 544aaafd8b6b427191e89277cb281bd1 P 93374462fb7d40ac80f3d526d4547642: No bootstrap required, opened a new log
I20260709 14:54:54.137483 16745 raft_consensus.cc:493] T e197eb61cbe44c1e99a7a9cc182b7268 P f3160b8200a64810983bda11c4af8fff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:54.138104 16745 raft_consensus.cc:515] T e197eb61cbe44c1e99a7a9cc182b7268 P f3160b8200a64810983bda11c4af8fff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:54:54.138857 16767 raft_consensus.cc:2804] T 93526d1276e74b9382a2fe40d2694853 P 1cb7a022bda844bfb69fec38131c8e31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:54:54.139358 16767 raft_consensus.cc:493] T 93526d1276e74b9382a2fe40d2694853 P 1cb7a022bda844bfb69fec38131c8e31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:54:54.139568 16694 raft_consensus.cc:2468] T 93526d1276e74b9382a2fe40d2694853 P 93374462fb7d40ac80f3d526d4547642 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1cb7a022bda844bfb69fec38131c8e31 in term 0.
I20260709 14:54:54.139739 16767 raft_consensus.cc:3060] T 93526d1276e74b9382a2fe40d2694853 P 1cb7a022bda844bfb69fec38131c8e31 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:54.140235 16745 leader_election.cc:290] T e197eb61cbe44c1e99a7a9cc182b7268 P f3160b8200a64810983bda11c4af8fff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1cb7a022bda844bfb69fec38131c8e31 (127.6.101.65:41617), 93374462fb7d40ac80f3d526d4547642 (127.6.101.67:41835)
I20260709 14:54:54.140861 16741 ts_tablet_manager.cc:1403] T 544aaafd8b6b427191e89277cb281bd1 P 93374462fb7d40ac80f3d526d4547642: Time spent bootstrapping tablet: real 0.026s	user 0.014s	sys 0.003s
I20260709 14:54:54.146346 16741 raft_consensus.cc:359] T 544aaafd8b6b427191e89277cb281bd1 P 93374462fb7d40ac80f3d526d4547642 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:54:54.147482 16741 raft_consensus.cc:385] T 544aaafd8b6b427191e89277cb281bd1 P 93374462fb7d40ac80f3d526d4547642 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:54:54.147831 16741 raft_consensus.cc:740] T 544aaafd8b6b427191e89277cb281bd1 P 93374462fb7d40ac80f3d526d4547642 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93374462fb7d40ac80f3d526d4547642, State: Initialized, Role: FOLLOWER
I20260709 14:54:54.148641 16741 consensus_queue.cc:260] T 544aaafd8b6b427191e89277cb281bd1 P 93374462fb7d40ac80f3d526d4547642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:54:54.150816 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e197eb61cbe44c1e99a7a9cc182b7268" candidate_uuid: "f3160b8200a64810983bda11c4af8fff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cb7a022bda844bfb69fec38131c8e31" is_pre_election: true
I20260709 14:54:54.152506 16694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e197eb61cbe44c1e99a7a9cc182b7268" candidate_uuid: "f3160b8200a64810983bda11c4af8fff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93374462fb7d40ac80f3d526d4547642" is_pre_election: true
I20260709 14:54:54.153576 16694 raft_consensus.cc:2393] T e197eb61cbe44c1e99a7a9cc182b7268 P 93374462fb7d40ac80f3d526d4547642 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3160b8200a64810983bda11c4af8fff in current term 1: Already voted for candidate 1cb7a022bda844bfb69fec38131c8e31 in this term.
I20260709 14:54:54.141826 16744 consensus_queue.cc:1048] T 48f69b6ba5bd492b8470cb9edfa3fc49 P 1cb7a022bda844bfb69fec38131c8e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 14:54:54.158125 16745 consensus_queue.cc:1048] T 9a69054eca44462f8f9d0ecadd574a2a P f3160b8200a64810983bda11c4af8fff [LEADER]: Connected to new peer: Peer: permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 14:54:54.154888 16585 leader_election.cc:304] T e197eb61cbe44c1e99a7a9cc182b7268 P f3160b8200a64810983bda11c4af8fff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3160b8200a64810983bda11c4af8fff; no voters: 1cb7a022bda844bfb69fec38131c8e31, 93374462fb7d40ac80f3d526d4547642
I20260709 14:54:54.166770 16769 raft_consensus.cc:3060] T e197eb61cbe44c1e99a7a9cc182b7268 P f3160b8200a64810983bda11c4af8fff [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:54.170500 16746 consensus_queue.cc:1048] T 43486d5085024ad4ab238eb24756ce7b P 93374462fb7d40ac80f3d526d4547642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:54:54.183720 16741 ts_tablet_manager.cc:1434] T 544aaafd8b6b427191e89277cb281bd1 P 93374462fb7d40ac80f3d526d4547642: Time spent starting tablet: real 0.042s	user 0.009s	sys 0.000s
I20260709 14:54:54.178449 16767 raft_consensus.cc:515] T 93526d1276e74b9382a2fe40d2694853 P 1cb7a022bda844bfb69fec38131c8e31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:54:54.190867 16767 leader_election.cc:290] T 93526d1276e74b9382a2fe40d2694853 P 1cb7a022bda844bfb69fec38131c8e31 [CANDIDATE]: Term 1 election: Requested vote from peers f3160b8200a64810983bda11c4af8fff (127.6.101.66:35977), 93374462fb7d40ac80f3d526d4547642 (127.6.101.67:41835)
I20260709 14:54:54.200627 16769 raft_consensus.cc:2749] T e197eb61cbe44c1e99a7a9cc182b7268 P f3160b8200a64810983bda11c4af8fff [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:54:54.192952 16694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93526d1276e74b9382a2fe40d2694853" candidate_uuid: "1cb7a022bda844bfb69fec38131c8e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93374462fb7d40ac80f3d526d4547642"
I20260709 14:54:54.192409 16620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93526d1276e74b9382a2fe40d2694853" candidate_uuid: "1cb7a022bda844bfb69fec38131c8e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3160b8200a64810983bda11c4af8fff"
I20260709 14:54:54.201788 16620 raft_consensus.cc:3060] T 93526d1276e74b9382a2fe40d2694853 P f3160b8200a64810983bda11c4af8fff [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:54.201694 16694 raft_consensus.cc:3060] T 93526d1276e74b9382a2fe40d2694853 P 93374462fb7d40ac80f3d526d4547642 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:54.206147 16745 raft_consensus.cc:493] T 213053d1a14c4365a4bccd2d11a2764a P f3160b8200a64810983bda11c4af8fff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:54.206858 16745 raft_consensus.cc:515] T 213053d1a14c4365a4bccd2d11a2764a P f3160b8200a64810983bda11c4af8fff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:54:54.232555 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213053d1a14c4365a4bccd2d11a2764a" candidate_uuid: "f3160b8200a64810983bda11c4af8fff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cb7a022bda844bfb69fec38131c8e31" is_pre_election: true
I20260709 14:54:54.233696 16544 raft_consensus.cc:2468] T 213053d1a14c4365a4bccd2d11a2764a P 1cb7a022bda844bfb69fec38131c8e31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3160b8200a64810983bda11c4af8fff in term 0.
I20260709 14:54:54.235703 16586 leader_election.cc:304] T 213053d1a14c4365a4bccd2d11a2764a P f3160b8200a64810983bda11c4af8fff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1cb7a022bda844bfb69fec38131c8e31, f3160b8200a64810983bda11c4af8fff; no voters: 
I20260709 14:54:54.236991 16769 raft_consensus.cc:2804] T 213053d1a14c4365a4bccd2d11a2764a P f3160b8200a64810983bda11c4af8fff [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:54:54.232077 16745 leader_election.cc:290] T 213053d1a14c4365a4bccd2d11a2764a P f3160b8200a64810983bda11c4af8fff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1cb7a022bda844bfb69fec38131c8e31 (127.6.101.65:41617), 93374462fb7d40ac80f3d526d4547642 (127.6.101.67:41835)
I20260709 14:54:54.237798 16769 raft_consensus.cc:493] T 213053d1a14c4365a4bccd2d11a2764a P f3160b8200a64810983bda11c4af8fff [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:54:54.238397 16769 raft_consensus.cc:3060] T 213053d1a14c4365a4bccd2d11a2764a P f3160b8200a64810983bda11c4af8fff [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:54.227793 16694 raft_consensus.cc:2468] T 93526d1276e74b9382a2fe40d2694853 P 93374462fb7d40ac80f3d526d4547642 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1cb7a022bda844bfb69fec38131c8e31 in term 1.
I20260709 14:54:54.232597 16695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213053d1a14c4365a4bccd2d11a2764a" candidate_uuid: "f3160b8200a64810983bda11c4af8fff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93374462fb7d40ac80f3d526d4547642" is_pre_election: true
I20260709 14:54:54.265076 16620 raft_consensus.cc:2468] T 93526d1276e74b9382a2fe40d2694853 P f3160b8200a64810983bda11c4af8fff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1cb7a022bda844bfb69fec38131c8e31 in term 1.
I20260709 14:54:54.266925 16693 raft_consensus.cc:3060] T 9a69054eca44462f8f9d0ecadd574a2a P 93374462fb7d40ac80f3d526d4547642 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:54.268157 16512 leader_election.cc:304] T 93526d1276e74b9382a2fe40d2694853 P 1cb7a022bda844bfb69fec38131c8e31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1cb7a022bda844bfb69fec38131c8e31, f3160b8200a64810983bda11c4af8fff; no voters: 
I20260709 14:54:54.269731 16806 raft_consensus.cc:2804] T 93526d1276e74b9382a2fe40d2694853 P 1cb7a022bda844bfb69fec38131c8e31 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:54:54.271294 16806 raft_consensus.cc:697] T 93526d1276e74b9382a2fe40d2694853 P 1cb7a022bda844bfb69fec38131c8e31 [term 1 LEADER]: Becoming Leader. State: Replica: 1cb7a022bda844bfb69fec38131c8e31, State: Running, Role: LEADER
I20260709 14:54:54.272346 16806 consensus_queue.cc:237] T 93526d1276e74b9382a2fe40d2694853 P 1cb7a022bda844bfb69fec38131c8e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:54:54.257433 16695 raft_consensus.cc:2468] T 213053d1a14c4365a4bccd2d11a2764a P 93374462fb7d40ac80f3d526d4547642 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3160b8200a64810983bda11c4af8fff in term 0.
I20260709 14:54:54.287858 16768 consensus_queue.cc:1048] T 6492b42adab04eceb2ad67a6f9dca9ed P 93374462fb7d40ac80f3d526d4547642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 14:54:54.288643 16746 consensus_queue.cc:1048] T c727468585cc4bff8f000e922b7a7d95 P 93374462fb7d40ac80f3d526d4547642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 14:54:54.295899 16771 consensus_queue.cc:1048] T 6492b42adab04eceb2ad67a6f9dca9ed P 93374462fb7d40ac80f3d526d4547642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:54:54.297361 16769 raft_consensus.cc:515] T 213053d1a14c4365a4bccd2d11a2764a P f3160b8200a64810983bda11c4af8fff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:54:54.300688 16769 leader_election.cc:290] T 213053d1a14c4365a4bccd2d11a2764a P f3160b8200a64810983bda11c4af8fff [CANDIDATE]: Term 1 election: Requested vote from peers 1cb7a022bda844bfb69fec38131c8e31 (127.6.101.65:41617), 93374462fb7d40ac80f3d526d4547642 (127.6.101.67:41835)
I20260709 14:54:54.301923 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213053d1a14c4365a4bccd2d11a2764a" candidate_uuid: "f3160b8200a64810983bda11c4af8fff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cb7a022bda844bfb69fec38131c8e31"
I20260709 14:54:54.302817 16543 raft_consensus.cc:3060] T 213053d1a14c4365a4bccd2d11a2764a P 1cb7a022bda844bfb69fec38131c8e31 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:54.304060 16771 consensus_queue.cc:1048] T 27e19d91f3664b33a47fc21010adb06d P 93374462fb7d40ac80f3d526d4547642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 14:54:54.302141 16695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213053d1a14c4365a4bccd2d11a2764a" candidate_uuid: "f3160b8200a64810983bda11c4af8fff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93374462fb7d40ac80f3d526d4547642"
I20260709 14:54:54.318161 16695 raft_consensus.cc:3060] T 213053d1a14c4365a4bccd2d11a2764a P 93374462fb7d40ac80f3d526d4547642 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:54.325124 16813 consensus_queue.cc:1048] T 9a69054eca44462f8f9d0ecadd574a2a P f3160b8200a64810983bda11c4af8fff [LEADER]: Connected to new peer: Peer: permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:54:54.328673 16543 raft_consensus.cc:2468] T 213053d1a14c4365a4bccd2d11a2764a P 1cb7a022bda844bfb69fec38131c8e31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3160b8200a64810983bda11c4af8fff in term 1.
I20260709 14:54:54.345813 16586 leader_election.cc:304] T 213053d1a14c4365a4bccd2d11a2764a P f3160b8200a64810983bda11c4af8fff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1cb7a022bda844bfb69fec38131c8e31, f3160b8200a64810983bda11c4af8fff; no voters: 
I20260709 14:54:54.346462 16771 consensus_queue.cc:1048] T c727468585cc4bff8f000e922b7a7d95 P 93374462fb7d40ac80f3d526d4547642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 14:54:54.346802 16769 raft_consensus.cc:2804] T 213053d1a14c4365a4bccd2d11a2764a P f3160b8200a64810983bda11c4af8fff [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:54:54.347936 16769 raft_consensus.cc:697] T 213053d1a14c4365a4bccd2d11a2764a P f3160b8200a64810983bda11c4af8fff [term 1 LEADER]: Becoming Leader. State: Replica: f3160b8200a64810983bda11c4af8fff, State: Running, Role: LEADER
I20260709 14:54:54.350792 16769 consensus_queue.cc:237] T 213053d1a14c4365a4bccd2d11a2764a P f3160b8200a64810983bda11c4af8fff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:54:54.356436 16695 raft_consensus.cc:2468] T 213053d1a14c4365a4bccd2d11a2764a P 93374462fb7d40ac80f3d526d4547642 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3160b8200a64810983bda11c4af8fff in term 1.
I20260709 14:54:54.367867 16745 raft_consensus.cc:493] T 544aaafd8b6b427191e89277cb281bd1 P f3160b8200a64810983bda11c4af8fff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:54.368738 16745 raft_consensus.cc:515] T 544aaafd8b6b427191e89277cb281bd1 P f3160b8200a64810983bda11c4af8fff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:54:54.373229 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544aaafd8b6b427191e89277cb281bd1" candidate_uuid: "f3160b8200a64810983bda11c4af8fff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cb7a022bda844bfb69fec38131c8e31" is_pre_election: true
I20260709 14:54:54.376470 16543 raft_consensus.cc:2468] T 544aaafd8b6b427191e89277cb281bd1 P 1cb7a022bda844bfb69fec38131c8e31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3160b8200a64810983bda11c4af8fff in term 0.
I20260709 14:54:54.378192 16745 leader_election.cc:290] T 544aaafd8b6b427191e89277cb281bd1 P f3160b8200a64810983bda11c4af8fff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1cb7a022bda844bfb69fec38131c8e31 (127.6.101.65:41617), 93374462fb7d40ac80f3d526d4547642 (127.6.101.67:41835)
I20260709 14:54:54.379329 16586 leader_election.cc:304] T 544aaafd8b6b427191e89277cb281bd1 P f3160b8200a64810983bda11c4af8fff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1cb7a022bda844bfb69fec38131c8e31, f3160b8200a64810983bda11c4af8fff; no voters: 
I20260709 14:54:54.379733 16693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544aaafd8b6b427191e89277cb281bd1" candidate_uuid: "f3160b8200a64810983bda11c4af8fff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93374462fb7d40ac80f3d526d4547642" is_pre_election: true
I20260709 14:54:54.380530 16693 raft_consensus.cc:2468] T 544aaafd8b6b427191e89277cb281bd1 P 93374462fb7d40ac80f3d526d4547642 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3160b8200a64810983bda11c4af8fff in term 0.
I20260709 14:54:54.380901 16745 raft_consensus.cc:2804] T 544aaafd8b6b427191e89277cb281bd1 P f3160b8200a64810983bda11c4af8fff [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:54:54.382014 16745 raft_consensus.cc:493] T 544aaafd8b6b427191e89277cb281bd1 P f3160b8200a64810983bda11c4af8fff [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:54:54.382465 16745 raft_consensus.cc:3060] T 544aaafd8b6b427191e89277cb281bd1 P f3160b8200a64810983bda11c4af8fff [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:54.395920 16442 catalog_manager.cc:5697] T 93526d1276e74b9382a2fe40d2694853 P 1cb7a022bda844bfb69fec38131c8e31 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1cb7a022bda844bfb69fec38131c8e31 (127.6.101.65). New cstate: current_term: 1 leader_uuid: "1cb7a022bda844bfb69fec38131c8e31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } health_report { overall_health: UNKNOWN } } }
I20260709 14:54:54.402932 16745 raft_consensus.cc:515] T 544aaafd8b6b427191e89277cb281bd1 P f3160b8200a64810983bda11c4af8fff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:54:54.405732 16745 leader_election.cc:290] T 544aaafd8b6b427191e89277cb281bd1 P f3160b8200a64810983bda11c4af8fff [CANDIDATE]: Term 1 election: Requested vote from peers 1cb7a022bda844bfb69fec38131c8e31 (127.6.101.65:41617), 93374462fb7d40ac80f3d526d4547642 (127.6.101.67:41835)
I20260709 14:54:54.406446 16546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544aaafd8b6b427191e89277cb281bd1" candidate_uuid: "f3160b8200a64810983bda11c4af8fff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cb7a022bda844bfb69fec38131c8e31"
I20260709 14:54:54.407236 16546 raft_consensus.cc:3060] T 544aaafd8b6b427191e89277cb281bd1 P 1cb7a022bda844bfb69fec38131c8e31 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:54.407585 16693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544aaafd8b6b427191e89277cb281bd1" candidate_uuid: "f3160b8200a64810983bda11c4af8fff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93374462fb7d40ac80f3d526d4547642"
I20260709 14:54:54.409152 16693 raft_consensus.cc:3060] T 544aaafd8b6b427191e89277cb281bd1 P 93374462fb7d40ac80f3d526d4547642 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:54:54.415032 16441 catalog_manager.cc:5697] T 213053d1a14c4365a4bccd2d11a2764a P f3160b8200a64810983bda11c4af8fff reported cstate change: term changed from 0 to 1, leader changed from <none> to f3160b8200a64810983bda11c4af8fff (127.6.101.66). New cstate: current_term: 1 leader_uuid: "f3160b8200a64810983bda11c4af8fff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } health_report { overall_health: UNKNOWN } } }
I20260709 14:54:54.419617 16693 raft_consensus.cc:2468] T 544aaafd8b6b427191e89277cb281bd1 P 93374462fb7d40ac80f3d526d4547642 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3160b8200a64810983bda11c4af8fff in term 1.
I20260709 14:54:54.419617 16546 raft_consensus.cc:2468] T 544aaafd8b6b427191e89277cb281bd1 P 1cb7a022bda844bfb69fec38131c8e31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3160b8200a64810983bda11c4af8fff in term 1.
I20260709 14:54:54.421232 16585 leader_election.cc:304] T 544aaafd8b6b427191e89277cb281bd1 P f3160b8200a64810983bda11c4af8fff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 93374462fb7d40ac80f3d526d4547642, f3160b8200a64810983bda11c4af8fff; no voters: 
I20260709 14:54:54.422361 16745 raft_consensus.cc:2804] T 544aaafd8b6b427191e89277cb281bd1 P f3160b8200a64810983bda11c4af8fff [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:54:54.422818 16745 raft_consensus.cc:697] T 544aaafd8b6b427191e89277cb281bd1 P f3160b8200a64810983bda11c4af8fff [term 1 LEADER]: Becoming Leader. State: Replica: f3160b8200a64810983bda11c4af8fff, State: Running, Role: LEADER
I20260709 14:54:54.423686 16745 consensus_queue.cc:237] T 544aaafd8b6b427191e89277cb281bd1 P f3160b8200a64810983bda11c4af8fff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:54:54.442324 16443 catalog_manager.cc:5697] T 544aaafd8b6b427191e89277cb281bd1 P f3160b8200a64810983bda11c4af8fff reported cstate change: term changed from 0 to 1, leader changed from <none> to f3160b8200a64810983bda11c4af8fff (127.6.101.66). New cstate: current_term: 1 leader_uuid: "f3160b8200a64810983bda11c4af8fff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } health_report { overall_health: UNKNOWN } } }
I20260709 14:54:54.525015 16806 consensus_queue.cc:1048] T e197eb61cbe44c1e99a7a9cc182b7268 P 1cb7a022bda844bfb69fec38131c8e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:54:54.539880 16766 consensus_queue.cc:1048] T e197eb61cbe44c1e99a7a9cc182b7268 P 1cb7a022bda844bfb69fec38131c8e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 14:54:54.563858  6549 ts_manager.cc:295] Set tserver state for 1cb7a022bda844bfb69fec38131c8e31 to MAINTENANCE_MODE
I20260709 14:54:54.565316  6549 tablet_server.cc:179] TabletServer@127.6.101.65:0 shutting down...
W20260709 14:54:54.579813 16660 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 202 similar messages]
W20260709 14:54:54.588126 16660 consensus_peers.cc:597] T 43486d5085024ad4ab238eb24756ce7b P 93374462fb7d40ac80f3d526d4547642 -> Peer 1cb7a022bda844bfb69fec38131c8e31 (127.6.101.65:41617): Couldn't send request to peer 1cb7a022bda844bfb69fec38131c8e31. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:54:54.609767  6549 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 14:54:54.610785  6549 tablet_replica.cc:333] T 213053d1a14c4365a4bccd2d11a2764a P 1cb7a022bda844bfb69fec38131c8e31: stopping tablet replica
I20260709 14:54:54.611558  6549 raft_consensus.cc:2243] T 213053d1a14c4365a4bccd2d11a2764a P 1cb7a022bda844bfb69fec38131c8e31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:54.612031  6549 raft_consensus.cc:2272] T 213053d1a14c4365a4bccd2d11a2764a P 1cb7a022bda844bfb69fec38131c8e31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:54.614761  6549 tablet_replica.cc:333] T c727468585cc4bff8f000e922b7a7d95 P 1cb7a022bda844bfb69fec38131c8e31: stopping tablet replica
I20260709 14:54:54.615849  6549 raft_consensus.cc:2243] T c727468585cc4bff8f000e922b7a7d95 P 1cb7a022bda844bfb69fec38131c8e31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:54.616585  6549 raft_consensus.cc:2272] T c727468585cc4bff8f000e922b7a7d95 P 1cb7a022bda844bfb69fec38131c8e31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:54.620285  6549 tablet_replica.cc:333] T 93526d1276e74b9382a2fe40d2694853 P 1cb7a022bda844bfb69fec38131c8e31: stopping tablet replica
I20260709 14:54:54.621189  6549 raft_consensus.cc:2243] T 93526d1276e74b9382a2fe40d2694853 P 1cb7a022bda844bfb69fec38131c8e31 [term 1 LEADER]: Raft consensus shutting down.
I20260709 14:54:54.621984  6549 pending_rounds.cc:70] T 93526d1276e74b9382a2fe40d2694853 P 1cb7a022bda844bfb69fec38131c8e31: Trying to abort 1 pending ops.
I20260709 14:54:54.622241  6549 pending_rounds.cc:77] T 93526d1276e74b9382a2fe40d2694853 P 1cb7a022bda844bfb69fec38131c8e31: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305662030950494208 op_type: NO_OP noop_request { }
I20260709 14:54:54.622648  6549 raft_consensus.cc:2889] T 93526d1276e74b9382a2fe40d2694853 P 1cb7a022bda844bfb69fec38131c8e31 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 14:54:54.623121  6549 raft_consensus.cc:2272] T 93526d1276e74b9382a2fe40d2694853 P 1cb7a022bda844bfb69fec38131c8e31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:54.626444  6549 tablet_replica.cc:333] T 43486d5085024ad4ab238eb24756ce7b P 1cb7a022bda844bfb69fec38131c8e31: stopping tablet replica
I20260709 14:54:54.627507  6549 raft_consensus.cc:2243] T 43486d5085024ad4ab238eb24756ce7b P 1cb7a022bda844bfb69fec38131c8e31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:54.628126  6549 raft_consensus.cc:2272] T 43486d5085024ad4ab238eb24756ce7b P 1cb7a022bda844bfb69fec38131c8e31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:54.631894  6549 tablet_replica.cc:333] T 6492b42adab04eceb2ad67a6f9dca9ed P 1cb7a022bda844bfb69fec38131c8e31: stopping tablet replica
I20260709 14:54:54.632673  6549 raft_consensus.cc:2243] T 6492b42adab04eceb2ad67a6f9dca9ed P 1cb7a022bda844bfb69fec38131c8e31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:54.633219  6549 raft_consensus.cc:2272] T 6492b42adab04eceb2ad67a6f9dca9ed P 1cb7a022bda844bfb69fec38131c8e31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:54.636348  6549 tablet_replica.cc:333] T 9a69054eca44462f8f9d0ecadd574a2a P 1cb7a022bda844bfb69fec38131c8e31: stopping tablet replica
I20260709 14:54:54.638005  6549 raft_consensus.cc:2243] T 9a69054eca44462f8f9d0ecadd574a2a P 1cb7a022bda844bfb69fec38131c8e31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:54.638537  6549 raft_consensus.cc:2272] T 9a69054eca44462f8f9d0ecadd574a2a P 1cb7a022bda844bfb69fec38131c8e31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:54.642519  6549 tablet_replica.cc:333] T e197eb61cbe44c1e99a7a9cc182b7268 P 1cb7a022bda844bfb69fec38131c8e31: stopping tablet replica
I20260709 14:54:54.643347  6549 raft_consensus.cc:2243] T e197eb61cbe44c1e99a7a9cc182b7268 P 1cb7a022bda844bfb69fec38131c8e31 [term 1 LEADER]: Raft consensus shutting down.
I20260709 14:54:54.644677  6549 raft_consensus.cc:2272] T e197eb61cbe44c1e99a7a9cc182b7268 P 1cb7a022bda844bfb69fec38131c8e31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:54.648257  6549 tablet_replica.cc:333] T 27e19d91f3664b33a47fc21010adb06d P 1cb7a022bda844bfb69fec38131c8e31: stopping tablet replica
I20260709 14:54:54.649036  6549 raft_consensus.cc:2243] T 27e19d91f3664b33a47fc21010adb06d P 1cb7a022bda844bfb69fec38131c8e31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:54.649863  6549 raft_consensus.cc:2272] T 27e19d91f3664b33a47fc21010adb06d P 1cb7a022bda844bfb69fec38131c8e31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:54.653386  6549 tablet_replica.cc:333] T 544aaafd8b6b427191e89277cb281bd1 P 1cb7a022bda844bfb69fec38131c8e31: stopping tablet replica
I20260709 14:54:54.654007  6549 raft_consensus.cc:2243] T 544aaafd8b6b427191e89277cb281bd1 P 1cb7a022bda844bfb69fec38131c8e31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 14:54:54.654429  6549 raft_consensus.cc:2272] T 544aaafd8b6b427191e89277cb281bd1 P 1cb7a022bda844bfb69fec38131c8e31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:54.656275  6549 tablet_replica.cc:333] T 48f69b6ba5bd492b8470cb9edfa3fc49 P 1cb7a022bda844bfb69fec38131c8e31: stopping tablet replica
I20260709 14:54:54.656847  6549 raft_consensus.cc:2243] T 48f69b6ba5bd492b8470cb9edfa3fc49 P 1cb7a022bda844bfb69fec38131c8e31 [term 1 LEADER]: Raft consensus shutting down.
I20260709 14:54:54.657743  6549 raft_consensus.cc:2272] T 48f69b6ba5bd492b8470cb9edfa3fc49 P 1cb7a022bda844bfb69fec38131c8e31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:54:54.696795  6549 tablet_server.cc:196] TabletServer@127.6.101.65:0 shutdown complete.
W20260709 14:54:54.700158 16586 consensus_peers.cc:597] T 9a69054eca44462f8f9d0ecadd574a2a P f3160b8200a64810983bda11c4af8fff -> Peer 1cb7a022bda844bfb69fec38131c8e31 (127.6.101.65:41617): Couldn't send request to peer 1cb7a022bda844bfb69fec38131c8e31. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:41617: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 14:54:54.757926 16745 consensus_queue.cc:1048] T 213053d1a14c4365a4bccd2d11a2764a P f3160b8200a64810983bda11c4af8fff [LEADER]: Connected to new peer: Peer: permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 14:54:54.767017 16660 consensus_peers.cc:597] T 27e19d91f3664b33a47fc21010adb06d P 93374462fb7d40ac80f3d526d4547642 -> Peer 1cb7a022bda844bfb69fec38131c8e31 (127.6.101.65:41617): Couldn't send request to peer 1cb7a022bda844bfb69fec38131c8e31. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:41617: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 14:54:54.774849 16586 consensus_peers.cc:597] T 213053d1a14c4365a4bccd2d11a2764a P f3160b8200a64810983bda11c4af8fff -> Peer 1cb7a022bda844bfb69fec38131c8e31 (127.6.101.65:41617): Couldn't send request to peer 1cb7a022bda844bfb69fec38131c8e31. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:41617: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 14:54:54.804014 16660 consensus_peers.cc:597] T c727468585cc4bff8f000e922b7a7d95 P 93374462fb7d40ac80f3d526d4547642 -> Peer 1cb7a022bda844bfb69fec38131c8e31 (127.6.101.65:41617): Couldn't send request to peer 1cb7a022bda844bfb69fec38131c8e31. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:41617: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 14:54:54.916733 16660 consensus_peers.cc:597] T 6492b42adab04eceb2ad67a6f9dca9ed P 93374462fb7d40ac80f3d526d4547642 -> Peer 1cb7a022bda844bfb69fec38131c8e31 (127.6.101.65:41617): Couldn't send request to peer 1cb7a022bda844bfb69fec38131c8e31. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:41617: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 14:54:54.928637 16813 consensus_queue.cc:1048] T 544aaafd8b6b427191e89277cb281bd1 P f3160b8200a64810983bda11c4af8fff [LEADER]: Connected to new peer: Peer: permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 14:54:54.946025 16586 consensus_peers.cc:597] T 544aaafd8b6b427191e89277cb281bd1 P f3160b8200a64810983bda11c4af8fff -> Peer 1cb7a022bda844bfb69fec38131c8e31 (127.6.101.65:41617): Couldn't send request to peer 1cb7a022bda844bfb69fec38131c8e31. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:41617: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 14:54:55.086937 16492 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 14:54:55.950098 16769 raft_consensus.cc:493] T 93526d1276e74b9382a2fe40d2694853 P f3160b8200a64810983bda11c4af8fff [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:54:55.951040 16769 raft_consensus.cc:515] T 93526d1276e74b9382a2fe40d2694853 P f3160b8200a64810983bda11c4af8fff [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:54:55.953565 16769 leader_election.cc:290] T 93526d1276e74b9382a2fe40d2694853 P f3160b8200a64810983bda11c4af8fff [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1cb7a022bda844bfb69fec38131c8e31 (127.6.101.65:41617), 93374462fb7d40ac80f3d526d4547642 (127.6.101.67:41835)
I20260709 14:54:55.955346 16693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93526d1276e74b9382a2fe40d2694853" candidate_uuid: "f3160b8200a64810983bda11c4af8fff" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93374462fb7d40ac80f3d526d4547642" is_pre_election: true
I20260709 14:54:55.956308 16693 raft_consensus.cc:2468] T 93526d1276e74b9382a2fe40d2694853 P 93374462fb7d40ac80f3d526d4547642 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3160b8200a64810983bda11c4af8fff in term 1.
I20260709 14:54:55.957569 16585 leader_election.cc:304] T 93526d1276e74b9382a2fe40d2694853 P f3160b8200a64810983bda11c4af8fff [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 93374462fb7d40ac80f3d526d4547642, f3160b8200a64810983bda11c4af8fff; no voters: 
W20260709 14:54:55.958482 16586 leader_election.cc:336] T 93526d1276e74b9382a2fe40d2694853 P f3160b8200a64810983bda11c4af8fff [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1cb7a022bda844bfb69fec38131c8e31 (127.6.101.65:41617): Network error: Client connection negotiation failed: client connection to 127.6.101.65:41617: connect: Connection refused (error 111)
I20260709 14:54:55.958578 16769 raft_consensus.cc:2804] T 93526d1276e74b9382a2fe40d2694853 P f3160b8200a64810983bda11c4af8fff [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 14:54:55.959084 16769 raft_consensus.cc:493] T 93526d1276e74b9382a2fe40d2694853 P f3160b8200a64810983bda11c4af8fff [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:54:55.959379 16769 raft_consensus.cc:3060] T 93526d1276e74b9382a2fe40d2694853 P f3160b8200a64810983bda11c4af8fff [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:54:55.966144 16769 raft_consensus.cc:515] T 93526d1276e74b9382a2fe40d2694853 P f3160b8200a64810983bda11c4af8fff [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:54:55.968142 16769 leader_election.cc:290] T 93526d1276e74b9382a2fe40d2694853 P f3160b8200a64810983bda11c4af8fff [CANDIDATE]: Term 2 election: Requested vote from peers 1cb7a022bda844bfb69fec38131c8e31 (127.6.101.65:41617), 93374462fb7d40ac80f3d526d4547642 (127.6.101.67:41835)
I20260709 14:54:55.969609 16693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93526d1276e74b9382a2fe40d2694853" candidate_uuid: "f3160b8200a64810983bda11c4af8fff" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93374462fb7d40ac80f3d526d4547642"
I20260709 14:54:55.970526 16693 raft_consensus.cc:3060] T 93526d1276e74b9382a2fe40d2694853 P 93374462fb7d40ac80f3d526d4547642 [term 1 FOLLOWER]: Advancing to term 2
W20260709 14:54:55.972977 16586 leader_election.cc:336] T 93526d1276e74b9382a2fe40d2694853 P f3160b8200a64810983bda11c4af8fff [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 1cb7a022bda844bfb69fec38131c8e31 (127.6.101.65:41617): Network error: Client connection negotiation failed: client connection to 127.6.101.65:41617: connect: Connection refused (error 111)
I20260709 14:54:55.976969 16693 raft_consensus.cc:2468] T 93526d1276e74b9382a2fe40d2694853 P 93374462fb7d40ac80f3d526d4547642 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3160b8200a64810983bda11c4af8fff in term 2.
I20260709 14:54:55.978457 16585 leader_election.cc:304] T 93526d1276e74b9382a2fe40d2694853 P f3160b8200a64810983bda11c4af8fff [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 93374462fb7d40ac80f3d526d4547642, f3160b8200a64810983bda11c4af8fff; no voters: 1cb7a022bda844bfb69fec38131c8e31
I20260709 14:54:55.979732 16769 raft_consensus.cc:2804] T 93526d1276e74b9382a2fe40d2694853 P f3160b8200a64810983bda11c4af8fff [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:54:55.981360 16769 raft_consensus.cc:697] T 93526d1276e74b9382a2fe40d2694853 P f3160b8200a64810983bda11c4af8fff [term 2 LEADER]: Becoming Leader. State: Replica: f3160b8200a64810983bda11c4af8fff, State: Running, Role: LEADER
I20260709 14:54:55.982576 16769 consensus_queue.cc:237] T 93526d1276e74b9382a2fe40d2694853 P f3160b8200a64810983bda11c4af8fff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:54:55.995668 16443 catalog_manager.cc:5697] T 93526d1276e74b9382a2fe40d2694853 P f3160b8200a64810983bda11c4af8fff reported cstate change: term changed from 1 to 2, leader changed from 1cb7a022bda844bfb69fec38131c8e31 (127.6.101.65) to f3160b8200a64810983bda11c4af8fff (127.6.101.66). New cstate: current_term: 2 leader_uuid: "f3160b8200a64810983bda11c4af8fff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } health_report { overall_health: UNKNOWN } } }
I20260709 14:54:56.037424 16771 raft_consensus.cc:493] T e197eb61cbe44c1e99a7a9cc182b7268 P 93374462fb7d40ac80f3d526d4547642 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1cb7a022bda844bfb69fec38131c8e31)
I20260709 14:54:56.038033 16771 raft_consensus.cc:515] T e197eb61cbe44c1e99a7a9cc182b7268 P 93374462fb7d40ac80f3d526d4547642 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:54:56.039822 16771 leader_election.cc:290] T e197eb61cbe44c1e99a7a9cc182b7268 P 93374462fb7d40ac80f3d526d4547642 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1cb7a022bda844bfb69fec38131c8e31 (127.6.101.65:41617), f3160b8200a64810983bda11c4af8fff (127.6.101.66:35977)
I20260709 14:54:56.041461 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e197eb61cbe44c1e99a7a9cc182b7268" candidate_uuid: "93374462fb7d40ac80f3d526d4547642" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f3160b8200a64810983bda11c4af8fff" is_pre_election: true
W20260709 14:54:56.044494 16660 leader_election.cc:336] T e197eb61cbe44c1e99a7a9cc182b7268 P 93374462fb7d40ac80f3d526d4547642 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1cb7a022bda844bfb69fec38131c8e31 (127.6.101.65:41617): Network error: Client connection negotiation failed: client connection to 127.6.101.65:41617: connect: Connection refused (error 111)
I20260709 14:54:56.044998 16660 leader_election.cc:304] T e197eb61cbe44c1e99a7a9cc182b7268 P 93374462fb7d40ac80f3d526d4547642 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 93374462fb7d40ac80f3d526d4547642; no voters: 1cb7a022bda844bfb69fec38131c8e31, f3160b8200a64810983bda11c4af8fff
I20260709 14:54:56.045090 16769 raft_consensus.cc:493] T e197eb61cbe44c1e99a7a9cc182b7268 P f3160b8200a64810983bda11c4af8fff [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1cb7a022bda844bfb69fec38131c8e31)
I20260709 14:54:56.045800 16771 raft_consensus.cc:2749] T e197eb61cbe44c1e99a7a9cc182b7268 P 93374462fb7d40ac80f3d526d4547642 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 14:54:56.045822 16769 raft_consensus.cc:515] T e197eb61cbe44c1e99a7a9cc182b7268 P f3160b8200a64810983bda11c4af8fff [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:54:56.048246 16769 leader_election.cc:290] T e197eb61cbe44c1e99a7a9cc182b7268 P f3160b8200a64810983bda11c4af8fff [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1cb7a022bda844bfb69fec38131c8e31 (127.6.101.65:41617), 93374462fb7d40ac80f3d526d4547642 (127.6.101.67:41835)
I20260709 14:54:56.049690 16693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e197eb61cbe44c1e99a7a9cc182b7268" candidate_uuid: "f3160b8200a64810983bda11c4af8fff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "93374462fb7d40ac80f3d526d4547642" is_pre_election: true
I20260709 14:54:56.050479 16693 raft_consensus.cc:2468] T e197eb61cbe44c1e99a7a9cc182b7268 P 93374462fb7d40ac80f3d526d4547642 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3160b8200a64810983bda11c4af8fff in term 1.
I20260709 14:54:56.051606 16585 leader_election.cc:304] T e197eb61cbe44c1e99a7a9cc182b7268 P f3160b8200a64810983bda11c4af8fff [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 93374462fb7d40ac80f3d526d4547642, f3160b8200a64810983bda11c4af8fff; no voters: 
W20260709 14:54:56.052291 16586 leader_election.cc:336] T e197eb61cbe44c1e99a7a9cc182b7268 P f3160b8200a64810983bda11c4af8fff [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1cb7a022bda844bfb69fec38131c8e31 (127.6.101.65:41617): Network error: Client connection negotiation failed: client connection to 127.6.101.65:41617: connect: Connection refused (error 111)
I20260709 14:54:56.052476 16769 raft_consensus.cc:2804] T e197eb61cbe44c1e99a7a9cc182b7268 P f3160b8200a64810983bda11c4af8fff [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 14:54:56.053134 16769 raft_consensus.cc:493] T e197eb61cbe44c1e99a7a9cc182b7268 P f3160b8200a64810983bda11c4af8fff [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1cb7a022bda844bfb69fec38131c8e31)
I20260709 14:54:56.053894 16769 raft_consensus.cc:3060] T e197eb61cbe44c1e99a7a9cc182b7268 P f3160b8200a64810983bda11c4af8fff [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:54:56.059751 16769 raft_consensus.cc:515] T e197eb61cbe44c1e99a7a9cc182b7268 P f3160b8200a64810983bda11c4af8fff [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:54:56.061537 16769 leader_election.cc:290] T e197eb61cbe44c1e99a7a9cc182b7268 P f3160b8200a64810983bda11c4af8fff [CANDIDATE]: Term 2 election: Requested vote from peers 1cb7a022bda844bfb69fec38131c8e31 (127.6.101.65:41617), 93374462fb7d40ac80f3d526d4547642 (127.6.101.67:41835)
I20260709 14:54:56.063092 16693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e197eb61cbe44c1e99a7a9cc182b7268" candidate_uuid: "f3160b8200a64810983bda11c4af8fff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "93374462fb7d40ac80f3d526d4547642"
I20260709 14:54:56.063723 16693 raft_consensus.cc:3060] T e197eb61cbe44c1e99a7a9cc182b7268 P 93374462fb7d40ac80f3d526d4547642 [term 1 FOLLOWER]: Advancing to term 2
W20260709 14:54:56.067157 16586 leader_election.cc:336] T e197eb61cbe44c1e99a7a9cc182b7268 P f3160b8200a64810983bda11c4af8fff [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 1cb7a022bda844bfb69fec38131c8e31 (127.6.101.65:41617): Network error: Client connection negotiation failed: client connection to 127.6.101.65:41617: connect: Connection refused (error 111)
I20260709 14:54:56.070456 16693 raft_consensus.cc:2468] T e197eb61cbe44c1e99a7a9cc182b7268 P 93374462fb7d40ac80f3d526d4547642 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3160b8200a64810983bda11c4af8fff in term 2.
I20260709 14:54:56.071664 16585 leader_election.cc:304] T e197eb61cbe44c1e99a7a9cc182b7268 P f3160b8200a64810983bda11c4af8fff [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 93374462fb7d40ac80f3d526d4547642, f3160b8200a64810983bda11c4af8fff; no voters: 1cb7a022bda844bfb69fec38131c8e31
I20260709 14:54:56.072558 16769 raft_consensus.cc:2804] T e197eb61cbe44c1e99a7a9cc182b7268 P f3160b8200a64810983bda11c4af8fff [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:54:56.073089 16769 raft_consensus.cc:697] T e197eb61cbe44c1e99a7a9cc182b7268 P f3160b8200a64810983bda11c4af8fff [term 2 LEADER]: Becoming Leader. State: Replica: f3160b8200a64810983bda11c4af8fff, State: Running, Role: LEADER
I20260709 14:54:56.073901 16769 consensus_queue.cc:237] T e197eb61cbe44c1e99a7a9cc182b7268 P f3160b8200a64810983bda11c4af8fff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:54:56.082835 16443 catalog_manager.cc:5697] T e197eb61cbe44c1e99a7a9cc182b7268 P f3160b8200a64810983bda11c4af8fff reported cstate change: term changed from 1 to 2, leader changed from 1cb7a022bda844bfb69fec38131c8e31 (127.6.101.65) to f3160b8200a64810983bda11c4af8fff (127.6.101.66). New cstate: current_term: 2 leader_uuid: "f3160b8200a64810983bda11c4af8fff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } health_report { overall_health: UNKNOWN } } }
I20260709 14:54:56.086266 16771 raft_consensus.cc:493] T 48f69b6ba5bd492b8470cb9edfa3fc49 P 93374462fb7d40ac80f3d526d4547642 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1cb7a022bda844bfb69fec38131c8e31)
I20260709 14:54:56.086988 16771 raft_consensus.cc:515] T 48f69b6ba5bd492b8470cb9edfa3fc49 P 93374462fb7d40ac80f3d526d4547642 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
W20260709 14:54:56.088301 16492 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 14:54:56.089773 16771 leader_election.cc:290] T 48f69b6ba5bd492b8470cb9edfa3fc49 P 93374462fb7d40ac80f3d526d4547642 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1cb7a022bda844bfb69fec38131c8e31 (127.6.101.65:41617), f3160b8200a64810983bda11c4af8fff (127.6.101.66:35977)
I20260709 14:54:56.091558 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f69b6ba5bd492b8470cb9edfa3fc49" candidate_uuid: "93374462fb7d40ac80f3d526d4547642" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f3160b8200a64810983bda11c4af8fff" is_pre_election: true
W20260709 14:54:56.095397 16660 leader_election.cc:336] T 48f69b6ba5bd492b8470cb9edfa3fc49 P 93374462fb7d40ac80f3d526d4547642 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1cb7a022bda844bfb69fec38131c8e31 (127.6.101.65:41617): Network error: Client connection negotiation failed: client connection to 127.6.101.65:41617: connect: Connection refused (error 111)
I20260709 14:54:56.095873 16660 leader_election.cc:304] T 48f69b6ba5bd492b8470cb9edfa3fc49 P 93374462fb7d40ac80f3d526d4547642 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 93374462fb7d40ac80f3d526d4547642; no voters: 1cb7a022bda844bfb69fec38131c8e31, f3160b8200a64810983bda11c4af8fff
I20260709 14:54:56.096696 16771 raft_consensus.cc:2749] T 48f69b6ba5bd492b8470cb9edfa3fc49 P 93374462fb7d40ac80f3d526d4547642 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 14:54:56.123198 16769 raft_consensus.cc:493] T 48f69b6ba5bd492b8470cb9edfa3fc49 P f3160b8200a64810983bda11c4af8fff [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1cb7a022bda844bfb69fec38131c8e31)
I20260709 14:54:56.124013 16769 raft_consensus.cc:515] T 48f69b6ba5bd492b8470cb9edfa3fc49 P f3160b8200a64810983bda11c4af8fff [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:54:56.126559 16769 leader_election.cc:290] T 48f69b6ba5bd492b8470cb9edfa3fc49 P f3160b8200a64810983bda11c4af8fff [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1cb7a022bda844bfb69fec38131c8e31 (127.6.101.65:41617), 93374462fb7d40ac80f3d526d4547642 (127.6.101.67:41835)
I20260709 14:54:56.128068 16693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f69b6ba5bd492b8470cb9edfa3fc49" candidate_uuid: "f3160b8200a64810983bda11c4af8fff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "93374462fb7d40ac80f3d526d4547642" is_pre_election: true
I20260709 14:54:56.128909 16693 raft_consensus.cc:2468] T 48f69b6ba5bd492b8470cb9edfa3fc49 P 93374462fb7d40ac80f3d526d4547642 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3160b8200a64810983bda11c4af8fff in term 1.
I20260709 14:54:56.130234 16585 leader_election.cc:304] T 48f69b6ba5bd492b8470cb9edfa3fc49 P f3160b8200a64810983bda11c4af8fff [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 93374462fb7d40ac80f3d526d4547642, f3160b8200a64810983bda11c4af8fff; no voters: 
I20260709 14:54:56.131119 16769 raft_consensus.cc:2804] T 48f69b6ba5bd492b8470cb9edfa3fc49 P f3160b8200a64810983bda11c4af8fff [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 14:54:56.131475 16769 raft_consensus.cc:493] T 48f69b6ba5bd492b8470cb9edfa3fc49 P f3160b8200a64810983bda11c4af8fff [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1cb7a022bda844bfb69fec38131c8e31)
W20260709 14:54:56.131508 16586 leader_election.cc:336] T 48f69b6ba5bd492b8470cb9edfa3fc49 P f3160b8200a64810983bda11c4af8fff [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1cb7a022bda844bfb69fec38131c8e31 (127.6.101.65:41617): Network error: Client connection negotiation failed: client connection to 127.6.101.65:41617: connect: Connection refused (error 111)
I20260709 14:54:56.131820 16769 raft_consensus.cc:3060] T 48f69b6ba5bd492b8470cb9edfa3fc49 P f3160b8200a64810983bda11c4af8fff [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:54:56.137933 16769 raft_consensus.cc:515] T 48f69b6ba5bd492b8470cb9edfa3fc49 P f3160b8200a64810983bda11c4af8fff [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:54:56.139828 16769 leader_election.cc:290] T 48f69b6ba5bd492b8470cb9edfa3fc49 P f3160b8200a64810983bda11c4af8fff [CANDIDATE]: Term 2 election: Requested vote from peers 1cb7a022bda844bfb69fec38131c8e31 (127.6.101.65:41617), 93374462fb7d40ac80f3d526d4547642 (127.6.101.67:41835)
I20260709 14:54:56.141516 16693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f69b6ba5bd492b8470cb9edfa3fc49" candidate_uuid: "f3160b8200a64810983bda11c4af8fff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "93374462fb7d40ac80f3d526d4547642"
I20260709 14:54:56.142596 16693 raft_consensus.cc:3060] T 48f69b6ba5bd492b8470cb9edfa3fc49 P 93374462fb7d40ac80f3d526d4547642 [term 1 FOLLOWER]: Advancing to term 2
W20260709 14:54:56.144906 16586 leader_election.cc:336] T 48f69b6ba5bd492b8470cb9edfa3fc49 P f3160b8200a64810983bda11c4af8fff [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 1cb7a022bda844bfb69fec38131c8e31 (127.6.101.65:41617): Network error: Client connection negotiation failed: client connection to 127.6.101.65:41617: connect: Connection refused (error 111)
I20260709 14:54:56.148574 16693 raft_consensus.cc:2468] T 48f69b6ba5bd492b8470cb9edfa3fc49 P 93374462fb7d40ac80f3d526d4547642 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3160b8200a64810983bda11c4af8fff in term 2.
I20260709 14:54:56.150003 16585 leader_election.cc:304] T 48f69b6ba5bd492b8470cb9edfa3fc49 P f3160b8200a64810983bda11c4af8fff [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 93374462fb7d40ac80f3d526d4547642, f3160b8200a64810983bda11c4af8fff; no voters: 1cb7a022bda844bfb69fec38131c8e31
I20260709 14:54:56.150918 16769 raft_consensus.cc:2804] T 48f69b6ba5bd492b8470cb9edfa3fc49 P f3160b8200a64810983bda11c4af8fff [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:54:56.151495 16769 raft_consensus.cc:697] T 48f69b6ba5bd492b8470cb9edfa3fc49 P f3160b8200a64810983bda11c4af8fff [term 2 LEADER]: Becoming Leader. State: Replica: f3160b8200a64810983bda11c4af8fff, State: Running, Role: LEADER
I20260709 14:54:56.152884 16769 consensus_queue.cc:237] T 48f69b6ba5bd492b8470cb9edfa3fc49 P f3160b8200a64810983bda11c4af8fff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:54:56.161870 16443 catalog_manager.cc:5697] T 48f69b6ba5bd492b8470cb9edfa3fc49 P f3160b8200a64810983bda11c4af8fff reported cstate change: term changed from 1 to 2, leader changed from 1cb7a022bda844bfb69fec38131c8e31 (127.6.101.65) to f3160b8200a64810983bda11c4af8fff (127.6.101.66). New cstate: current_term: 2 leader_uuid: "f3160b8200a64810983bda11c4af8fff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } health_report { overall_health: UNKNOWN } } }
I20260709 14:54:56.544342 16693 raft_consensus.cc:1275] T 93526d1276e74b9382a2fe40d2694853 P 93374462fb7d40ac80f3d526d4547642 [term 2 FOLLOWER]: Refusing update from remote peer f3160b8200a64810983bda11c4af8fff: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
W20260709 14:54:56.545948 16586 consensus_peers.cc:597] T 93526d1276e74b9382a2fe40d2694853 P f3160b8200a64810983bda11c4af8fff -> Peer 1cb7a022bda844bfb69fec38131c8e31 (127.6.101.65:41617): Couldn't send request to peer 1cb7a022bda844bfb69fec38131c8e31. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:41617: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 14:54:56.546682 16769 consensus_queue.cc:1048] T 93526d1276e74b9382a2fe40d2694853 P f3160b8200a64810983bda11c4af8fff [LEADER]: Connected to new peer: Peer: permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:54:56.644874 16693 raft_consensus.cc:1275] T 48f69b6ba5bd492b8470cb9edfa3fc49 P 93374462fb7d40ac80f3d526d4547642 [term 2 FOLLOWER]: Refusing update from remote peer f3160b8200a64810983bda11c4af8fff: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:54:56.646548 16769 consensus_queue.cc:1048] T 48f69b6ba5bd492b8470cb9edfa3fc49 P f3160b8200a64810983bda11c4af8fff [LEADER]: Connected to new peer: Peer: permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 14:54:56.660566 16693 raft_consensus.cc:1275] T e197eb61cbe44c1e99a7a9cc182b7268 P 93374462fb7d40ac80f3d526d4547642 [term 2 FOLLOWER]: Refusing update from remote peer f3160b8200a64810983bda11c4af8fff: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:54:56.663652 16831 consensus_queue.cc:1048] T e197eb61cbe44c1e99a7a9cc182b7268 P f3160b8200a64810983bda11c4af8fff [LEADER]: Connected to new peer: Peer: permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 14:54:56.670465 16586 consensus_peers.cc:597] T e197eb61cbe44c1e99a7a9cc182b7268 P f3160b8200a64810983bda11c4af8fff -> Peer 1cb7a022bda844bfb69fec38131c8e31 (127.6.101.65:41617): Couldn't send request to peer 1cb7a022bda844bfb69fec38131c8e31. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:41617: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 14:54:56.671051 16586 consensus_peers.cc:597] T 48f69b6ba5bd492b8470cb9edfa3fc49 P f3160b8200a64810983bda11c4af8fff -> Peer 1cb7a022bda844bfb69fec38131c8e31 (127.6.101.65:41617): Couldn't send request to peer 1cb7a022bda844bfb69fec38131c8e31. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:41617: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 14:54:57.089624 16492 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 14:54:57.103847 16660 consensus_peers.cc:597] T c727468585cc4bff8f000e922b7a7d95 P 93374462fb7d40ac80f3d526d4547642 -> Peer 1cb7a022bda844bfb69fec38131c8e31 (127.6.101.65:41617): Couldn't send request to peer 1cb7a022bda844bfb69fec38131c8e31. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:41617: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 14:54:57.117630 16586 consensus_peers.cc:597] T 213053d1a14c4365a4bccd2d11a2764a P f3160b8200a64810983bda11c4af8fff -> Peer 1cb7a022bda844bfb69fec38131c8e31 (127.6.101.65:41617): Couldn't send request to peer 1cb7a022bda844bfb69fec38131c8e31. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:41617: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 14:54:57.202001 16586 consensus_peers.cc:597] T 9a69054eca44462f8f9d0ecadd574a2a P f3160b8200a64810983bda11c4af8fff -> Peer 1cb7a022bda844bfb69fec38131c8e31 (127.6.101.65:41617): Couldn't send request to peer 1cb7a022bda844bfb69fec38131c8e31. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:41617: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 14:54:57.265875 16660 consensus_peers.cc:597] T 27e19d91f3664b33a47fc21010adb06d P 93374462fb7d40ac80f3d526d4547642 -> Peer 1cb7a022bda844bfb69fec38131c8e31 (127.6.101.65:41617): Couldn't send request to peer 1cb7a022bda844bfb69fec38131c8e31. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:41617: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 14:54:57.277215 16660 consensus_peers.cc:597] T 43486d5085024ad4ab238eb24756ce7b P 93374462fb7d40ac80f3d526d4547642 -> Peer 1cb7a022bda844bfb69fec38131c8e31 (127.6.101.65:41617): Couldn't send request to peer 1cb7a022bda844bfb69fec38131c8e31. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:41617: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 14:54:57.396970 16660 consensus_peers.cc:597] T 6492b42adab04eceb2ad67a6f9dca9ed P 93374462fb7d40ac80f3d526d4547642 -> Peer 1cb7a022bda844bfb69fec38131c8e31 (127.6.101.65:41617): Couldn't send request to peer 1cb7a022bda844bfb69fec38131c8e31. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:41617: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 14:54:57.564420 16586 consensus_peers.cc:597] T 544aaafd8b6b427191e89277cb281bd1 P f3160b8200a64810983bda11c4af8fff -> Peer 1cb7a022bda844bfb69fec38131c8e31 (127.6.101.65:41617): Couldn't send request to peer 1cb7a022bda844bfb69fec38131c8e31. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:41617: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 14:54:58.091081 16492 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 14:54:58.900729 16586 consensus_peers.cc:597] T 93526d1276e74b9382a2fe40d2694853 P f3160b8200a64810983bda11c4af8fff -> Peer 1cb7a022bda844bfb69fec38131c8e31 (127.6.101.65:41617): Couldn't send request to peer 1cb7a022bda844bfb69fec38131c8e31. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:41617: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 14:54:58.914640 16586 consensus_peers.cc:597] T 48f69b6ba5bd492b8470cb9edfa3fc49 P f3160b8200a64810983bda11c4af8fff -> Peer 1cb7a022bda844bfb69fec38131c8e31 (127.6.101.65:41617): Couldn't send request to peer 1cb7a022bda844bfb69fec38131c8e31. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:41617: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 14:54:59.034801 16586 consensus_peers.cc:597] T e197eb61cbe44c1e99a7a9cc182b7268 P f3160b8200a64810983bda11c4af8fff -> Peer 1cb7a022bda844bfb69fec38131c8e31 (127.6.101.65:41617): Couldn't send request to peer 1cb7a022bda844bfb69fec38131c8e31. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:41617: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 14:54:59.092527 16492 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 14:54:59.518566 16660 consensus_peers.cc:597] T c727468585cc4bff8f000e922b7a7d95 P 93374462fb7d40ac80f3d526d4547642 -> Peer 1cb7a022bda844bfb69fec38131c8e31 (127.6.101.65:41617): Couldn't send request to peer 1cb7a022bda844bfb69fec38131c8e31. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:41617: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 14:54:59.622074 16660 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.6.101.65:41617: connect: Connection refused (error 111) [suppressed 99 similar messages]
W20260709 14:54:59.625605 16660 consensus_peers.cc:597] T 27e19d91f3664b33a47fc21010adb06d P 93374462fb7d40ac80f3d526d4547642 -> Peer 1cb7a022bda844bfb69fec38131c8e31 (127.6.101.65:41617): Couldn't send request to peer 1cb7a022bda844bfb69fec38131c8e31. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:41617: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 14:54:59.625770 16586 consensus_peers.cc:597] T 9a69054eca44462f8f9d0ecadd574a2a P f3160b8200a64810983bda11c4af8fff -> Peer 1cb7a022bda844bfb69fec38131c8e31 (127.6.101.65:41617): Couldn't send request to peer 1cb7a022bda844bfb69fec38131c8e31. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:41617: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 14:54:59.629693 16660 consensus_peers.cc:597] T 43486d5085024ad4ab238eb24756ce7b P 93374462fb7d40ac80f3d526d4547642 -> Peer 1cb7a022bda844bfb69fec38131c8e31 (127.6.101.65:41617): Couldn't send request to peer 1cb7a022bda844bfb69fec38131c8e31. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:41617: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 14:54:59.709283 16586 consensus_peers.cc:597] T 213053d1a14c4365a4bccd2d11a2764a P f3160b8200a64810983bda11c4af8fff -> Peer 1cb7a022bda844bfb69fec38131c8e31 (127.6.101.65:41617): Couldn't send request to peer 1cb7a022bda844bfb69fec38131c8e31. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:41617: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 14:54:59.731142  6549 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 14:54:59.739255 16848 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 14:54:59.739602 16849 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 14:54:59.743034 16851 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 14:54:59.746279  6549 server_base.cc:1061] running on GCE node
I20260709 14:54:59.749825  6549 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 14:54:59.750134  6549 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 14:54:59.750346  6549 hybrid_clock.cc:648] HybridClock initialized: now 1783608899750323 us; error 0 us; skew 500 ppm
I20260709 14:54:59.750999  6549 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 14:54:59.754520  6549 webserver.cc:533] Webserver started at http://127.6.101.65:33525/ using document root <none> and password file <none>
I20260709 14:54:59.755105  6549 fs_manager.cc:362] Metadata directory not provided
I20260709 14:54:59.755300  6549 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 14:54:59.759825  6549 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.005s	sys 0.000s
I20260709 14:54:59.764712 16856 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 14:54:59.766175  6549 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 14:54:59.766571  6549 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783608571892863-6549-0/minicluster-data/ts-0-root
uuid: "1cb7a022bda844bfb69fec38131c8e31"
format_stamp: "Formatted at 2026-07-09 14:54:52 on dist-test-slave-lv34"
I20260709 14:54:59.766956  6549 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783608571892863-6549-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783608571892863-6549-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783608571892863-6549-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 14:54:59.787161  6549 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 14:54:59.788769  6549 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 14:54:59.790748  6549 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 14:54:59.796658 16863 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
W20260709 14:54:59.858793 16660 consensus_peers.cc:597] T 6492b42adab04eceb2ad67a6f9dca9ed P 93374462fb7d40ac80f3d526d4547642 -> Peer 1cb7a022bda844bfb69fec38131c8e31 (127.6.101.65:41617): Couldn't send request to peer 1cb7a022bda844bfb69fec38131c8e31. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:41617: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 14:54:59.867654  6549 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 14:54:59.868250  6549 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.073s	user 0.003s	sys 0.001s
I20260709 14:54:59.868643  6549 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
I20260709 14:54:59.876298 16863 tablet_bootstrap.cc:492] T 9a69054eca44462f8f9d0ecadd574a2a P 1cb7a022bda844bfb69fec38131c8e31: Bootstrap starting.
I20260709 14:54:59.893414 16863 tablet_bootstrap.cc:492] T 9a69054eca44462f8f9d0ecadd574a2a P 1cb7a022bda844bfb69fec38131c8e31: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 14:54:59.894260 16863 tablet_bootstrap.cc:492] T 9a69054eca44462f8f9d0ecadd574a2a P 1cb7a022bda844bfb69fec38131c8e31: Bootstrap complete.
I20260709 14:54:59.894899 16863 ts_tablet_manager.cc:1403] T 9a69054eca44462f8f9d0ecadd574a2a P 1cb7a022bda844bfb69fec38131c8e31: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.008s
I20260709 14:54:59.897150 16863 raft_consensus.cc:359] T 9a69054eca44462f8f9d0ecadd574a2a P 1cb7a022bda844bfb69fec38131c8e31 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:54:59.897778 16863 raft_consensus.cc:740] T 9a69054eca44462f8f9d0ecadd574a2a P 1cb7a022bda844bfb69fec38131c8e31 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cb7a022bda844bfb69fec38131c8e31, State: Initialized, Role: FOLLOWER
I20260709 14:54:59.898463 16863 consensus_queue.cc:260] T 9a69054eca44462f8f9d0ecadd574a2a P 1cb7a022bda844bfb69fec38131c8e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:54:59.900815 16863 ts_tablet_manager.cc:1434] T 9a69054eca44462f8f9d0ecadd574a2a P 1cb7a022bda844bfb69fec38131c8e31: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 14:54:59.901638 16863 tablet_bootstrap.cc:492] T 27e19d91f3664b33a47fc21010adb06d P 1cb7a022bda844bfb69fec38131c8e31: Bootstrap starting.
I20260709 14:54:59.919786 16863 tablet_bootstrap.cc:492] T 27e19d91f3664b33a47fc21010adb06d P 1cb7a022bda844bfb69fec38131c8e31: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 14:54:59.920742 16863 tablet_bootstrap.cc:492] T 27e19d91f3664b33a47fc21010adb06d P 1cb7a022bda844bfb69fec38131c8e31: Bootstrap complete.
I20260709 14:54:59.921744 16863 ts_tablet_manager.cc:1403] T 27e19d91f3664b33a47fc21010adb06d P 1cb7a022bda844bfb69fec38131c8e31: Time spent bootstrapping tablet: real 0.020s	user 0.015s	sys 0.004s
I20260709 14:54:59.925069 16863 raft_consensus.cc:359] T 27e19d91f3664b33a47fc21010adb06d P 1cb7a022bda844bfb69fec38131c8e31 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:54:59.925817 16863 raft_consensus.cc:740] T 27e19d91f3664b33a47fc21010adb06d P 1cb7a022bda844bfb69fec38131c8e31 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cb7a022bda844bfb69fec38131c8e31, State: Initialized, Role: FOLLOWER
I20260709 14:54:59.926553 16863 consensus_queue.cc:260] T 27e19d91f3664b33a47fc21010adb06d P 1cb7a022bda844bfb69fec38131c8e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:54:59.927230  6549 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 14:54:59.927778  6549 ts_tablet_manager.cc:595] Time spent register tablets: real 0.059s	user 0.055s	sys 0.004s
I20260709 14:54:59.928310 16863 ts_tablet_manager.cc:1434] T 27e19d91f3664b33a47fc21010adb06d P 1cb7a022bda844bfb69fec38131c8e31: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 14:54:59.929492 16863 tablet_bootstrap.cc:492] T 93526d1276e74b9382a2fe40d2694853 P 1cb7a022bda844bfb69fec38131c8e31: Bootstrap starting.
I20260709 14:54:59.945960 16863 tablet_bootstrap.cc:492] T 93526d1276e74b9382a2fe40d2694853 P 1cb7a022bda844bfb69fec38131c8e31: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 14:54:59.946882 16863 tablet_bootstrap.cc:492] T 93526d1276e74b9382a2fe40d2694853 P 1cb7a022bda844bfb69fec38131c8e31: Bootstrap complete.
I20260709 14:54:59.947541 16863 ts_tablet_manager.cc:1403] T 93526d1276e74b9382a2fe40d2694853 P 1cb7a022bda844bfb69fec38131c8e31: Time spent bootstrapping tablet: real 0.018s	user 0.008s	sys 0.007s
I20260709 14:54:59.950098 16863 raft_consensus.cc:359] T 93526d1276e74b9382a2fe40d2694853 P 1cb7a022bda844bfb69fec38131c8e31 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:54:59.951207 16863 raft_consensus.cc:740] T 93526d1276e74b9382a2fe40d2694853 P 1cb7a022bda844bfb69fec38131c8e31 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cb7a022bda844bfb69fec38131c8e31, State: Initialized, Role: FOLLOWER
I20260709 14:54:59.952437 16863 consensus_queue.cc:260] T 93526d1276e74b9382a2fe40d2694853 P 1cb7a022bda844bfb69fec38131c8e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:54:59.954445 16863 ts_tablet_manager.cc:1434] T 93526d1276e74b9382a2fe40d2694853 P 1cb7a022bda844bfb69fec38131c8e31: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 14:54:59.955399 16863 tablet_bootstrap.cc:492] T c727468585cc4bff8f000e922b7a7d95 P 1cb7a022bda844bfb69fec38131c8e31: Bootstrap starting.
I20260709 14:54:59.971890 16863 tablet_bootstrap.cc:492] T c727468585cc4bff8f000e922b7a7d95 P 1cb7a022bda844bfb69fec38131c8e31: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 14:54:59.973044 16863 tablet_bootstrap.cc:492] T c727468585cc4bff8f000e922b7a7d95 P 1cb7a022bda844bfb69fec38131c8e31: Bootstrap complete.
I20260709 14:54:59.973721 16863 ts_tablet_manager.cc:1403] T c727468585cc4bff8f000e922b7a7d95 P 1cb7a022bda844bfb69fec38131c8e31: Time spent bootstrapping tablet: real 0.019s	user 0.017s	sys 0.000s
I20260709 14:54:59.976706 16863 raft_consensus.cc:359] T c727468585cc4bff8f000e922b7a7d95 P 1cb7a022bda844bfb69fec38131c8e31 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:54:59.977641 16863 raft_consensus.cc:740] T c727468585cc4bff8f000e922b7a7d95 P 1cb7a022bda844bfb69fec38131c8e31 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cb7a022bda844bfb69fec38131c8e31, State: Initialized, Role: FOLLOWER
I20260709 14:54:59.978467 16863 consensus_queue.cc:260] T c727468585cc4bff8f000e922b7a7d95 P 1cb7a022bda844bfb69fec38131c8e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:54:59.980732 16863 ts_tablet_manager.cc:1434] T c727468585cc4bff8f000e922b7a7d95 P 1cb7a022bda844bfb69fec38131c8e31: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 14:54:59.982051 16863 tablet_bootstrap.cc:492] T 43486d5085024ad4ab238eb24756ce7b P 1cb7a022bda844bfb69fec38131c8e31: Bootstrap starting.
I20260709 14:55:00.003043 16863 tablet_bootstrap.cc:492] T 43486d5085024ad4ab238eb24756ce7b P 1cb7a022bda844bfb69fec38131c8e31: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 14:55:00.004528 16863 tablet_bootstrap.cc:492] T 43486d5085024ad4ab238eb24756ce7b P 1cb7a022bda844bfb69fec38131c8e31: Bootstrap complete.
I20260709 14:55:00.049567 16863 ts_tablet_manager.cc:1403] T 43486d5085024ad4ab238eb24756ce7b P 1cb7a022bda844bfb69fec38131c8e31: Time spent bootstrapping tablet: real 0.068s	user 0.031s	sys 0.029s
I20260709 14:55:00.052668 16863 raft_consensus.cc:359] T 43486d5085024ad4ab238eb24756ce7b P 1cb7a022bda844bfb69fec38131c8e31 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:55:00.054016 16863 raft_consensus.cc:740] T 43486d5085024ad4ab238eb24756ce7b P 1cb7a022bda844bfb69fec38131c8e31 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cb7a022bda844bfb69fec38131c8e31, State: Initialized, Role: FOLLOWER
I20260709 14:55:00.056131 16863 consensus_queue.cc:260] T 43486d5085024ad4ab238eb24756ce7b P 1cb7a022bda844bfb69fec38131c8e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:55:00.061640 16863 ts_tablet_manager.cc:1434] T 43486d5085024ad4ab238eb24756ce7b P 1cb7a022bda844bfb69fec38131c8e31: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.001s
I20260709 14:55:00.062856 16863 tablet_bootstrap.cc:492] T e197eb61cbe44c1e99a7a9cc182b7268 P 1cb7a022bda844bfb69fec38131c8e31: Bootstrap starting.
I20260709 14:55:00.082186  6549 rpc_server.cc:307] RPC server started. Bound to: 127.6.101.65:41617
I20260709 14:55:00.082374 16928 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.101.65:41617 every 8 connection(s)
I20260709 14:55:00.084468 16863 tablet_bootstrap.cc:492] T e197eb61cbe44c1e99a7a9cc182b7268 P 1cb7a022bda844bfb69fec38131c8e31: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 14:55:00.085944 16863 tablet_bootstrap.cc:492] T e197eb61cbe44c1e99a7a9cc182b7268 P 1cb7a022bda844bfb69fec38131c8e31: Bootstrap complete.
I20260709 14:55:00.086692 16863 ts_tablet_manager.cc:1403] T e197eb61cbe44c1e99a7a9cc182b7268 P 1cb7a022bda844bfb69fec38131c8e31: Time spent bootstrapping tablet: real 0.024s	user 0.013s	sys 0.007s
I20260709 14:55:00.088469  6549 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 14:55:00.093225 16863 raft_consensus.cc:359] T e197eb61cbe44c1e99a7a9cc182b7268 P 1cb7a022bda844bfb69fec38131c8e31 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
W20260709 14:55:00.093854 16492 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 14:55:00.094326 16863 raft_consensus.cc:740] T e197eb61cbe44c1e99a7a9cc182b7268 P 1cb7a022bda844bfb69fec38131c8e31 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cb7a022bda844bfb69fec38131c8e31, State: Initialized, Role: FOLLOWER
I20260709 14:55:00.095293 16863 consensus_queue.cc:260] T e197eb61cbe44c1e99a7a9cc182b7268 P 1cb7a022bda844bfb69fec38131c8e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:55:00.098440 16863 ts_tablet_manager.cc:1434] T e197eb61cbe44c1e99a7a9cc182b7268 P 1cb7a022bda844bfb69fec38131c8e31: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 14:55:00.099494 16863 tablet_bootstrap.cc:492] T 6492b42adab04eceb2ad67a6f9dca9ed P 1cb7a022bda844bfb69fec38131c8e31: Bootstrap starting.
I20260709 14:55:00.132160 16863 tablet_bootstrap.cc:492] T 6492b42adab04eceb2ad67a6f9dca9ed P 1cb7a022bda844bfb69fec38131c8e31: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 14:55:00.133910 16929 heartbeater.cc:344] Connected to a master server at 127.6.101.126:42521
I20260709 14:55:00.133914 16900 raft_consensus.cc:3060] T e197eb61cbe44c1e99a7a9cc182b7268 P 1cb7a022bda844bfb69fec38131c8e31 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:55:00.134774 16863 tablet_bootstrap.cc:492] T 6492b42adab04eceb2ad67a6f9dca9ed P 1cb7a022bda844bfb69fec38131c8e31: Bootstrap complete.
I20260709 14:55:00.134716 16929 heartbeater.cc:461] Registering TS with master...
I20260709 14:55:00.136236 16929 heartbeater.cc:507] Master 127.6.101.126:42521 requested a full tablet report, sending...
W20260709 14:55:00.139616 16586 consensus_peers.cc:597] T 544aaafd8b6b427191e89277cb281bd1 P f3160b8200a64810983bda11c4af8fff -> Peer 1cb7a022bda844bfb69fec38131c8e31 (127.6.101.65:41617): Couldn't send request to peer 1cb7a022bda844bfb69fec38131c8e31. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 14:55:00.136142 16863 ts_tablet_manager.cc:1403] T 6492b42adab04eceb2ad67a6f9dca9ed P 1cb7a022bda844bfb69fec38131c8e31: Time spent bootstrapping tablet: real 0.037s	user 0.015s	sys 0.007s
I20260709 14:55:00.143996 16863 raft_consensus.cc:359] T 6492b42adab04eceb2ad67a6f9dca9ed P 1cb7a022bda844bfb69fec38131c8e31 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:55:00.145718 16863 raft_consensus.cc:740] T 6492b42adab04eceb2ad67a6f9dca9ed P 1cb7a022bda844bfb69fec38131c8e31 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cb7a022bda844bfb69fec38131c8e31, State: Initialized, Role: FOLLOWER
I20260709 14:55:00.147187 16863 consensus_queue.cc:260] T 6492b42adab04eceb2ad67a6f9dca9ed P 1cb7a022bda844bfb69fec38131c8e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:55:00.149466 16619 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "48f69b6ba5bd492b8470cb9edfa3fc49"
dest_uuid: "f3160b8200a64810983bda11c4af8fff"
mode: GRACEFUL
new_leader_uuid: "93374462fb7d40ac80f3d526d4547642"
 from {username='slave'} at 127.0.0.1:59348
I20260709 14:55:00.150377 16863 ts_tablet_manager.cc:1434] T 6492b42adab04eceb2ad67a6f9dca9ed P 1cb7a022bda844bfb69fec38131c8e31: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 14:55:00.150516 16619 raft_consensus.cc:606] T 48f69b6ba5bd492b8470cb9edfa3fc49 P f3160b8200a64810983bda11c4af8fff [term 2 LEADER]: Received request to transfer leadership to TS 93374462fb7d40ac80f3d526d4547642
I20260709 14:55:00.151276 16863 tablet_bootstrap.cc:492] T 48f69b6ba5bd492b8470cb9edfa3fc49 P 1cb7a022bda844bfb69fec38131c8e31: Bootstrap starting.
I20260709 14:55:00.154484 16619 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e197eb61cbe44c1e99a7a9cc182b7268"
dest_uuid: "f3160b8200a64810983bda11c4af8fff"
mode: GRACEFUL
new_leader_uuid: "93374462fb7d40ac80f3d526d4547642"
 from {username='slave'} at 127.0.0.1:59348
I20260709 14:55:00.155589 16619 raft_consensus.cc:606] T e197eb61cbe44c1e99a7a9cc182b7268 P f3160b8200a64810983bda11c4af8fff [term 2 LEADER]: Received request to transfer leadership to TS 93374462fb7d40ac80f3d526d4547642
I20260709 14:55:00.157457  6549 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 14:55:00.158093  6549 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 14:55:00.158818  6549 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 14:55:00.164357 16443 ts_manager.cc:194] Re-registered known tserver with Master: 1cb7a022bda844bfb69fec38131c8e31 (127.6.101.65:41617)
I20260709 14:55:00.168816 16863 tablet_bootstrap.cc:492] T 48f69b6ba5bd492b8470cb9edfa3fc49 P 1cb7a022bda844bfb69fec38131c8e31: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 14:55:00.169803 16863 tablet_bootstrap.cc:492] T 48f69b6ba5bd492b8470cb9edfa3fc49 P 1cb7a022bda844bfb69fec38131c8e31: Bootstrap complete.
I20260709 14:55:00.170403 16863 ts_tablet_manager.cc:1403] T 48f69b6ba5bd492b8470cb9edfa3fc49 P 1cb7a022bda844bfb69fec38131c8e31: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.004s
I20260709 14:55:00.172456 16863 raft_consensus.cc:359] T 48f69b6ba5bd492b8470cb9edfa3fc49 P 1cb7a022bda844bfb69fec38131c8e31 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:55:00.173022 16863 raft_consensus.cc:740] T 48f69b6ba5bd492b8470cb9edfa3fc49 P 1cb7a022bda844bfb69fec38131c8e31 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cb7a022bda844bfb69fec38131c8e31, State: Initialized, Role: FOLLOWER
I20260709 14:55:00.173629 16863 consensus_queue.cc:260] T 48f69b6ba5bd492b8470cb9edfa3fc49 P 1cb7a022bda844bfb69fec38131c8e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:55:00.175227 16863 ts_tablet_manager.cc:1434] T 48f69b6ba5bd492b8470cb9edfa3fc49 P 1cb7a022bda844bfb69fec38131c8e31: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.001s
I20260709 14:55:00.175323 16443 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46282
I20260709 14:55:00.175999 16863 tablet_bootstrap.cc:492] T 213053d1a14c4365a4bccd2d11a2764a P 1cb7a022bda844bfb69fec38131c8e31: Bootstrap starting.
I20260709 14:55:00.181360 16929 heartbeater.cc:499] Master 127.6.101.126:42521 was elected leader, sending a full tablet report...
I20260709 14:55:00.192556 16863 tablet_bootstrap.cc:492] T 213053d1a14c4365a4bccd2d11a2764a P 1cb7a022bda844bfb69fec38131c8e31: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 14:55:00.193482 16863 tablet_bootstrap.cc:492] T 213053d1a14c4365a4bccd2d11a2764a P 1cb7a022bda844bfb69fec38131c8e31: Bootstrap complete.
I20260709 14:55:00.194170 16863 ts_tablet_manager.cc:1403] T 213053d1a14c4365a4bccd2d11a2764a P 1cb7a022bda844bfb69fec38131c8e31: Time spent bootstrapping tablet: real 0.018s	user 0.013s	sys 0.004s
I20260709 14:55:00.196269 16863 raft_consensus.cc:359] T 213053d1a14c4365a4bccd2d11a2764a P 1cb7a022bda844bfb69fec38131c8e31 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:55:00.197069 16863 raft_consensus.cc:740] T 213053d1a14c4365a4bccd2d11a2764a P 1cb7a022bda844bfb69fec38131c8e31 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cb7a022bda844bfb69fec38131c8e31, State: Initialized, Role: FOLLOWER
I20260709 14:55:00.197736 16863 consensus_queue.cc:260] T 213053d1a14c4365a4bccd2d11a2764a P 1cb7a022bda844bfb69fec38131c8e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:55:00.199636 16863 ts_tablet_manager.cc:1434] T 213053d1a14c4365a4bccd2d11a2764a P 1cb7a022bda844bfb69fec38131c8e31: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 14:55:00.200695 16863 tablet_bootstrap.cc:492] T 544aaafd8b6b427191e89277cb281bd1 P 1cb7a022bda844bfb69fec38131c8e31: Bootstrap starting.
I20260709 14:55:00.218218 16863 tablet_bootstrap.cc:492] T 544aaafd8b6b427191e89277cb281bd1 P 1cb7a022bda844bfb69fec38131c8e31: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 14:55:00.219353 16863 tablet_bootstrap.cc:492] T 544aaafd8b6b427191e89277cb281bd1 P 1cb7a022bda844bfb69fec38131c8e31: Bootstrap complete.
I20260709 14:55:00.220081 16863 ts_tablet_manager.cc:1403] T 544aaafd8b6b427191e89277cb281bd1 P 1cb7a022bda844bfb69fec38131c8e31: Time spent bootstrapping tablet: real 0.020s	user 0.016s	sys 0.000s
I20260709 14:55:00.222868 16863 raft_consensus.cc:359] T 544aaafd8b6b427191e89277cb281bd1 P 1cb7a022bda844bfb69fec38131c8e31 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:55:00.223469 16863 raft_consensus.cc:740] T 544aaafd8b6b427191e89277cb281bd1 P 1cb7a022bda844bfb69fec38131c8e31 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cb7a022bda844bfb69fec38131c8e31, State: Initialized, Role: FOLLOWER
I20260709 14:55:00.224174 16863 consensus_queue.cc:260] T 544aaafd8b6b427191e89277cb281bd1 P 1cb7a022bda844bfb69fec38131c8e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:55:00.226445 16863 ts_tablet_manager.cc:1434] T 544aaafd8b6b427191e89277cb281bd1 P 1cb7a022bda844bfb69fec38131c8e31: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 14:55:00.278457 16900 raft_consensus.cc:3060] T 93526d1276e74b9382a2fe40d2694853 P 1cb7a022bda844bfb69fec38131c8e31 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:55:00.286629 16900 pending_rounds.cc:85] T 93526d1276e74b9382a2fe40d2694853 P 1cb7a022bda844bfb69fec38131c8e31: Aborting all ops after (but not including) 0
I20260709 14:55:00.286881 16900 pending_rounds.cc:107] T 93526d1276e74b9382a2fe40d2694853 P 1cb7a022bda844bfb69fec38131c8e31: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 14:55:00.287138 16900 raft_consensus.cc:2889] T 93526d1276e74b9382a2fe40d2694853 P 1cb7a022bda844bfb69fec38131c8e31 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:55:00.410624 16900 raft_consensus.cc:3060] T 48f69b6ba5bd492b8470cb9edfa3fc49 P 1cb7a022bda844bfb69fec38131c8e31 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:55:00.556108 16843 raft_consensus.cc:993] T 48f69b6ba5bd492b8470cb9edfa3fc49 P f3160b8200a64810983bda11c4af8fff: : Instructing follower 93374462fb7d40ac80f3d526d4547642 to start an election
I20260709 14:55:00.556891 16937 raft_consensus.cc:1081] T 48f69b6ba5bd492b8470cb9edfa3fc49 P f3160b8200a64810983bda11c4af8fff [term 2 LEADER]: Signalling peer 93374462fb7d40ac80f3d526d4547642 to start an election
I20260709 14:55:00.559230 16695 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "48f69b6ba5bd492b8470cb9edfa3fc49"
dest_uuid: "93374462fb7d40ac80f3d526d4547642"
 from {username='slave'} at 127.0.0.1:53032
I20260709 14:55:00.559955 16695 raft_consensus.cc:493] T 48f69b6ba5bd492b8470cb9edfa3fc49 P 93374462fb7d40ac80f3d526d4547642 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:55:00.560356 16695 raft_consensus.cc:3060] T 48f69b6ba5bd492b8470cb9edfa3fc49 P 93374462fb7d40ac80f3d526d4547642 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:55:00.569092 16695 raft_consensus.cc:515] T 48f69b6ba5bd492b8470cb9edfa3fc49 P 93374462fb7d40ac80f3d526d4547642 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:55:00.571190 16695 leader_election.cc:290] T 48f69b6ba5bd492b8470cb9edfa3fc49 P 93374462fb7d40ac80f3d526d4547642 [CANDIDATE]: Term 3 election: Requested vote from peers 1cb7a022bda844bfb69fec38131c8e31 (127.6.101.65:41617), f3160b8200a64810983bda11c4af8fff (127.6.101.66:35977)
I20260709 14:55:00.572269 16900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f69b6ba5bd492b8470cb9edfa3fc49" candidate_uuid: "93374462fb7d40ac80f3d526d4547642" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1cb7a022bda844bfb69fec38131c8e31"
I20260709 14:55:00.572428 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f69b6ba5bd492b8470cb9edfa3fc49" candidate_uuid: "93374462fb7d40ac80f3d526d4547642" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f3160b8200a64810983bda11c4af8fff"
I20260709 14:55:00.573004 16900 raft_consensus.cc:3060] T 48f69b6ba5bd492b8470cb9edfa3fc49 P 1cb7a022bda844bfb69fec38131c8e31 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:55:00.573092 16619 raft_consensus.cc:3055] T 48f69b6ba5bd492b8470cb9edfa3fc49 P f3160b8200a64810983bda11c4af8fff [term 2 LEADER]: Stepping down as leader of term 2
I20260709 14:55:00.573588 16619 raft_consensus.cc:740] T 48f69b6ba5bd492b8470cb9edfa3fc49 P f3160b8200a64810983bda11c4af8fff [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f3160b8200a64810983bda11c4af8fff, State: Running, Role: LEADER
I20260709 14:55:00.574266 16619 consensus_queue.cc:260] T 48f69b6ba5bd492b8470cb9edfa3fc49 P f3160b8200a64810983bda11c4af8fff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:55:00.575271 16619 raft_consensus.cc:3060] T 48f69b6ba5bd492b8470cb9edfa3fc49 P f3160b8200a64810983bda11c4af8fff [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:55:00.580405 16900 raft_consensus.cc:2468] T 48f69b6ba5bd492b8470cb9edfa3fc49 P 1cb7a022bda844bfb69fec38131c8e31 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93374462fb7d40ac80f3d526d4547642 in term 3.
I20260709 14:55:00.582099 16660 leader_election.cc:304] T 48f69b6ba5bd492b8470cb9edfa3fc49 P 93374462fb7d40ac80f3d526d4547642 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1cb7a022bda844bfb69fec38131c8e31, 93374462fb7d40ac80f3d526d4547642; no voters: 
I20260709 14:55:00.582266 16619 raft_consensus.cc:2468] T 48f69b6ba5bd492b8470cb9edfa3fc49 P f3160b8200a64810983bda11c4af8fff [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93374462fb7d40ac80f3d526d4547642 in term 3.
I20260709 14:55:00.583316 16923 raft_consensus.cc:2804] T 48f69b6ba5bd492b8470cb9edfa3fc49 P 93374462fb7d40ac80f3d526d4547642 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 14:55:00.584663 16923 raft_consensus.cc:697] T 48f69b6ba5bd492b8470cb9edfa3fc49 P 93374462fb7d40ac80f3d526d4547642 [term 3 LEADER]: Becoming Leader. State: Replica: 93374462fb7d40ac80f3d526d4547642, State: Running, Role: LEADER
I20260709 14:55:00.585842 16923 consensus_queue.cc:237] T 48f69b6ba5bd492b8470cb9edfa3fc49 P 93374462fb7d40ac80f3d526d4547642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:55:00.594702 16443 catalog_manager.cc:5697] T 48f69b6ba5bd492b8470cb9edfa3fc49 P 93374462fb7d40ac80f3d526d4547642 reported cstate change: term changed from 2 to 3, leader changed from f3160b8200a64810983bda11c4af8fff (127.6.101.66) to 93374462fb7d40ac80f3d526d4547642 (127.6.101.67). New cstate: current_term: 3 leader_uuid: "93374462fb7d40ac80f3d526d4547642" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } health_report { overall_health: HEALTHY } } }
I20260709 14:55:00.642048 16937 raft_consensus.cc:993] T e197eb61cbe44c1e99a7a9cc182b7268 P f3160b8200a64810983bda11c4af8fff: : Instructing follower 93374462fb7d40ac80f3d526d4547642 to start an election
I20260709 14:55:00.642668 16843 raft_consensus.cc:1081] T e197eb61cbe44c1e99a7a9cc182b7268 P f3160b8200a64810983bda11c4af8fff [term 2 LEADER]: Signalling peer 93374462fb7d40ac80f3d526d4547642 to start an election
I20260709 14:55:00.644913 16695 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e197eb61cbe44c1e99a7a9cc182b7268"
dest_uuid: "93374462fb7d40ac80f3d526d4547642"
 from {username='slave'} at 127.0.0.1:53032
I20260709 14:55:00.645740 16695 raft_consensus.cc:493] T e197eb61cbe44c1e99a7a9cc182b7268 P 93374462fb7d40ac80f3d526d4547642 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:55:00.646071 16695 raft_consensus.cc:3060] T e197eb61cbe44c1e99a7a9cc182b7268 P 93374462fb7d40ac80f3d526d4547642 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:55:00.654340 16695 raft_consensus.cc:515] T e197eb61cbe44c1e99a7a9cc182b7268 P 93374462fb7d40ac80f3d526d4547642 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:55:00.656375 16695 leader_election.cc:290] T e197eb61cbe44c1e99a7a9cc182b7268 P 93374462fb7d40ac80f3d526d4547642 [CANDIDATE]: Term 3 election: Requested vote from peers 1cb7a022bda844bfb69fec38131c8e31 (127.6.101.65:41617), f3160b8200a64810983bda11c4af8fff (127.6.101.66:35977)
I20260709 14:55:00.657568 16900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e197eb61cbe44c1e99a7a9cc182b7268" candidate_uuid: "93374462fb7d40ac80f3d526d4547642" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1cb7a022bda844bfb69fec38131c8e31"
I20260709 14:55:00.657709 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e197eb61cbe44c1e99a7a9cc182b7268" candidate_uuid: "93374462fb7d40ac80f3d526d4547642" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f3160b8200a64810983bda11c4af8fff"
I20260709 14:55:00.658262 16900 raft_consensus.cc:3060] T e197eb61cbe44c1e99a7a9cc182b7268 P 1cb7a022bda844bfb69fec38131c8e31 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:55:00.658427 16618 raft_consensus.cc:3055] T e197eb61cbe44c1e99a7a9cc182b7268 P f3160b8200a64810983bda11c4af8fff [term 2 LEADER]: Stepping down as leader of term 2
I20260709 14:55:00.658807 16618 raft_consensus.cc:740] T e197eb61cbe44c1e99a7a9cc182b7268 P f3160b8200a64810983bda11c4af8fff [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f3160b8200a64810983bda11c4af8fff, State: Running, Role: LEADER
I20260709 14:55:00.659581 16618 consensus_queue.cc:260] T e197eb61cbe44c1e99a7a9cc182b7268 P f3160b8200a64810983bda11c4af8fff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:55:00.660733 16618 raft_consensus.cc:3060] T e197eb61cbe44c1e99a7a9cc182b7268 P f3160b8200a64810983bda11c4af8fff [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:55:00.665195 16900 raft_consensus.cc:2468] T e197eb61cbe44c1e99a7a9cc182b7268 P 1cb7a022bda844bfb69fec38131c8e31 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93374462fb7d40ac80f3d526d4547642 in term 3.
I20260709 14:55:00.666560 16660 leader_election.cc:304] T e197eb61cbe44c1e99a7a9cc182b7268 P 93374462fb7d40ac80f3d526d4547642 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1cb7a022bda844bfb69fec38131c8e31, 93374462fb7d40ac80f3d526d4547642; no voters: 
I20260709 14:55:00.667385 16923 raft_consensus.cc:2804] T e197eb61cbe44c1e99a7a9cc182b7268 P 93374462fb7d40ac80f3d526d4547642 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 14:55:00.667554 16618 raft_consensus.cc:2468] T e197eb61cbe44c1e99a7a9cc182b7268 P f3160b8200a64810983bda11c4af8fff [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93374462fb7d40ac80f3d526d4547642 in term 3.
I20260709 14:55:00.667814 16923 raft_consensus.cc:697] T e197eb61cbe44c1e99a7a9cc182b7268 P 93374462fb7d40ac80f3d526d4547642 [term 3 LEADER]: Becoming Leader. State: Replica: 93374462fb7d40ac80f3d526d4547642, State: Running, Role: LEADER
I20260709 14:55:00.668869 16923 consensus_queue.cc:237] T e197eb61cbe44c1e99a7a9cc182b7268 P 93374462fb7d40ac80f3d526d4547642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:55:00.678081 16443 catalog_manager.cc:5697] T e197eb61cbe44c1e99a7a9cc182b7268 P 93374462fb7d40ac80f3d526d4547642 reported cstate change: term changed from 2 to 3, leader changed from f3160b8200a64810983bda11c4af8fff (127.6.101.66) to 93374462fb7d40ac80f3d526d4547642 (127.6.101.67). New cstate: current_term: 3 leader_uuid: "93374462fb7d40ac80f3d526d4547642" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } health_report { overall_health: HEALTHY } } }
I20260709 14:55:00.980439 16618 raft_consensus.cc:1275] T 48f69b6ba5bd492b8470cb9edfa3fc49 P f3160b8200a64810983bda11c4af8fff [term 3 FOLLOWER]: Refusing update from remote peer 93374462fb7d40ac80f3d526d4547642: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 14:55:00.982810 16947 consensus_queue.cc:1048] T 48f69b6ba5bd492b8470cb9edfa3fc49 P 93374462fb7d40ac80f3d526d4547642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 14:55:00.999017 16900 raft_consensus.cc:1275] T 48f69b6ba5bd492b8470cb9edfa3fc49 P 1cb7a022bda844bfb69fec38131c8e31 [term 3 FOLLOWER]: Refusing update from remote peer 93374462fb7d40ac80f3d526d4547642: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 14:55:01.001503 16922 consensus_queue.cc:1048] T 48f69b6ba5bd492b8470cb9edfa3fc49 P 93374462fb7d40ac80f3d526d4547642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 14:55:01.095168 16492 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 14:55:01.171311  6549 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 14:55:01.191907 16695 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "27e19d91f3664b33a47fc21010adb06d"
dest_uuid: "93374462fb7d40ac80f3d526d4547642"
mode: GRACEFUL
new_leader_uuid: "f3160b8200a64810983bda11c4af8fff"
 from {username='slave'} at 127.0.0.1:57328
I20260709 14:55:01.192683 16695 raft_consensus.cc:606] T 27e19d91f3664b33a47fc21010adb06d P 93374462fb7d40ac80f3d526d4547642 [term 1 LEADER]: Received request to transfer leadership to TS f3160b8200a64810983bda11c4af8fff
I20260709 14:55:01.196609 16618 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "544aaafd8b6b427191e89277cb281bd1"
dest_uuid: "f3160b8200a64810983bda11c4af8fff"
mode: GRACEFUL
new_leader_uuid: "93374462fb7d40ac80f3d526d4547642"
 from {username='slave'} at 127.0.0.1:59348
I20260709 14:55:01.197381 16618 raft_consensus.cc:606] T 544aaafd8b6b427191e89277cb281bd1 P f3160b8200a64810983bda11c4af8fff [term 1 LEADER]: Received request to transfer leadership to TS 93374462fb7d40ac80f3d526d4547642
I20260709 14:55:01.201213 16695 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e197eb61cbe44c1e99a7a9cc182b7268"
dest_uuid: "93374462fb7d40ac80f3d526d4547642"
mode: GRACEFUL
new_leader_uuid: "f3160b8200a64810983bda11c4af8fff"
 from {username='slave'} at 127.0.0.1:57328
I20260709 14:55:01.202028 16695 raft_consensus.cc:606] T e197eb61cbe44c1e99a7a9cc182b7268 P 93374462fb7d40ac80f3d526d4547642 [term 3 LEADER]: Received request to transfer leadership to TS f3160b8200a64810983bda11c4af8fff
I20260709 14:55:01.203799  6549 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 14:55:01.204542  6549 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 14:55:01.205741  6549 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 14:55:01.233560 16922 raft_consensus.cc:993] T 27e19d91f3664b33a47fc21010adb06d P 93374462fb7d40ac80f3d526d4547642: : Instructing follower f3160b8200a64810983bda11c4af8fff to start an election
I20260709 14:55:01.234373 16922 raft_consensus.cc:1081] T 27e19d91f3664b33a47fc21010adb06d P 93374462fb7d40ac80f3d526d4547642 [term 1 LEADER]: Signalling peer f3160b8200a64810983bda11c4af8fff to start an election
I20260709 14:55:01.236683 16618 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "27e19d91f3664b33a47fc21010adb06d"
dest_uuid: "f3160b8200a64810983bda11c4af8fff"
 from {username='slave'} at 127.0.0.1:50290
I20260709 14:55:01.237172 16900 raft_consensus.cc:1275] T e197eb61cbe44c1e99a7a9cc182b7268 P 1cb7a022bda844bfb69fec38131c8e31 [term 3 FOLLOWER]: Refusing update from remote peer 93374462fb7d40ac80f3d526d4547642: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 14:55:01.237453 16618 raft_consensus.cc:493] T 27e19d91f3664b33a47fc21010adb06d P f3160b8200a64810983bda11c4af8fff [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:55:01.237993 16618 raft_consensus.cc:3060] T 27e19d91f3664b33a47fc21010adb06d P f3160b8200a64810983bda11c4af8fff [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:55:01.238883 16922 consensus_queue.cc:1048] T e197eb61cbe44c1e99a7a9cc182b7268 P 93374462fb7d40ac80f3d526d4547642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 14:55:01.249521 16618 raft_consensus.cc:515] T 27e19d91f3664b33a47fc21010adb06d P f3160b8200a64810983bda11c4af8fff [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:55:01.252533 16619 raft_consensus.cc:1275] T e197eb61cbe44c1e99a7a9cc182b7268 P f3160b8200a64810983bda11c4af8fff [term 3 FOLLOWER]: Refusing update from remote peer 93374462fb7d40ac80f3d526d4547642: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 14:55:01.254202 16618 leader_election.cc:290] T 27e19d91f3664b33a47fc21010adb06d P f3160b8200a64810983bda11c4af8fff [CANDIDATE]: Term 2 election: Requested vote from peers 1cb7a022bda844bfb69fec38131c8e31 (127.6.101.65:41617), 93374462fb7d40ac80f3d526d4547642 (127.6.101.67:41835)
I20260709 14:55:01.255123 16922 consensus_queue.cc:1048] T e197eb61cbe44c1e99a7a9cc182b7268 P 93374462fb7d40ac80f3d526d4547642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 14:55:01.255766 16695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e19d91f3664b33a47fc21010adb06d" candidate_uuid: "f3160b8200a64810983bda11c4af8fff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "93374462fb7d40ac80f3d526d4547642"
I20260709 14:55:01.256645 16695 raft_consensus.cc:3055] T 27e19d91f3664b33a47fc21010adb06d P 93374462fb7d40ac80f3d526d4547642 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 14:55:01.256983 16695 raft_consensus.cc:740] T 27e19d91f3664b33a47fc21010adb06d P 93374462fb7d40ac80f3d526d4547642 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 93374462fb7d40ac80f3d526d4547642, State: Running, Role: LEADER
I20260709 14:55:01.258224 16900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e19d91f3664b33a47fc21010adb06d" candidate_uuid: "f3160b8200a64810983bda11c4af8fff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1cb7a022bda844bfb69fec38131c8e31"
I20260709 14:55:01.259116 16900 raft_consensus.cc:3060] T 27e19d91f3664b33a47fc21010adb06d P 1cb7a022bda844bfb69fec38131c8e31 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:55:01.258323 16695 consensus_queue.cc:260] T 27e19d91f3664b33a47fc21010adb06d P 93374462fb7d40ac80f3d526d4547642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:55:01.262336 16695 raft_consensus.cc:3060] T 27e19d91f3664b33a47fc21010adb06d P 93374462fb7d40ac80f3d526d4547642 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:55:01.273520 16923 raft_consensus.cc:993] T e197eb61cbe44c1e99a7a9cc182b7268 P 93374462fb7d40ac80f3d526d4547642: : Instructing follower f3160b8200a64810983bda11c4af8fff to start an election
I20260709 14:55:01.273514 16695 raft_consensus.cc:2468] T 27e19d91f3664b33a47fc21010adb06d P 93374462fb7d40ac80f3d526d4547642 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3160b8200a64810983bda11c4af8fff in term 2.
I20260709 14:55:01.274471 16923 raft_consensus.cc:1081] T e197eb61cbe44c1e99a7a9cc182b7268 P 93374462fb7d40ac80f3d526d4547642 [term 3 LEADER]: Signalling peer f3160b8200a64810983bda11c4af8fff to start an election
I20260709 14:55:01.274763 16900 raft_consensus.cc:2468] T 27e19d91f3664b33a47fc21010adb06d P 1cb7a022bda844bfb69fec38131c8e31 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3160b8200a64810983bda11c4af8fff in term 2.
I20260709 14:55:01.275887 16585 leader_election.cc:304] T 27e19d91f3664b33a47fc21010adb06d P f3160b8200a64810983bda11c4af8fff [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 93374462fb7d40ac80f3d526d4547642, f3160b8200a64810983bda11c4af8fff; no voters: 
I20260709 14:55:01.276908 16937 raft_consensus.cc:2804] T 27e19d91f3664b33a47fc21010adb06d P f3160b8200a64810983bda11c4af8fff [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:55:01.277735 16937 raft_consensus.cc:697] T 27e19d91f3664b33a47fc21010adb06d P f3160b8200a64810983bda11c4af8fff [term 2 LEADER]: Becoming Leader. State: Replica: f3160b8200a64810983bda11c4af8fff, State: Running, Role: LEADER
I20260709 14:55:01.278110 16618 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e197eb61cbe44c1e99a7a9cc182b7268"
dest_uuid: "f3160b8200a64810983bda11c4af8fff"
 from {username='slave'} at 127.0.0.1:50290
I20260709 14:55:01.278869 16937 consensus_queue.cc:237] T 27e19d91f3664b33a47fc21010adb06d P f3160b8200a64810983bda11c4af8fff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:55:01.279817 16618 raft_consensus.cc:493] T e197eb61cbe44c1e99a7a9cc182b7268 P f3160b8200a64810983bda11c4af8fff [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:55:01.280484 16618 raft_consensus.cc:3060] T e197eb61cbe44c1e99a7a9cc182b7268 P f3160b8200a64810983bda11c4af8fff [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:55:01.289732 16618 raft_consensus.cc:515] T e197eb61cbe44c1e99a7a9cc182b7268 P f3160b8200a64810983bda11c4af8fff [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:55:01.292717 16618 leader_election.cc:290] T e197eb61cbe44c1e99a7a9cc182b7268 P f3160b8200a64810983bda11c4af8fff [CANDIDATE]: Term 4 election: Requested vote from peers 1cb7a022bda844bfb69fec38131c8e31 (127.6.101.65:41617), 93374462fb7d40ac80f3d526d4547642 (127.6.101.67:41835)
I20260709 14:55:01.293403 16695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e197eb61cbe44c1e99a7a9cc182b7268" candidate_uuid: "f3160b8200a64810983bda11c4af8fff" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "93374462fb7d40ac80f3d526d4547642"
I20260709 14:55:01.293407 16900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e197eb61cbe44c1e99a7a9cc182b7268" candidate_uuid: "f3160b8200a64810983bda11c4af8fff" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "1cb7a022bda844bfb69fec38131c8e31"
I20260709 14:55:01.294813 16695 raft_consensus.cc:3055] T e197eb61cbe44c1e99a7a9cc182b7268 P 93374462fb7d40ac80f3d526d4547642 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 14:55:01.294905 16900 raft_consensus.cc:3060] T e197eb61cbe44c1e99a7a9cc182b7268 P 1cb7a022bda844bfb69fec38131c8e31 [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:55:01.295302 16695 raft_consensus.cc:740] T e197eb61cbe44c1e99a7a9cc182b7268 P 93374462fb7d40ac80f3d526d4547642 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 93374462fb7d40ac80f3d526d4547642, State: Running, Role: LEADER
I20260709 14:55:01.296432 16695 consensus_queue.cc:260] T e197eb61cbe44c1e99a7a9cc182b7268 P 93374462fb7d40ac80f3d526d4547642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:55:01.298100 16695 raft_consensus.cc:3060] T e197eb61cbe44c1e99a7a9cc182b7268 P 93374462fb7d40ac80f3d526d4547642 [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:55:01.297326 16443 catalog_manager.cc:5697] T 27e19d91f3664b33a47fc21010adb06d P f3160b8200a64810983bda11c4af8fff reported cstate change: term changed from 1 to 2, leader changed from 93374462fb7d40ac80f3d526d4547642 (127.6.101.67) to f3160b8200a64810983bda11c4af8fff (127.6.101.66). New cstate: current_term: 2 leader_uuid: "f3160b8200a64810983bda11c4af8fff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } health_report { overall_health: UNKNOWN } } }
I20260709 14:55:01.301313 16955 raft_consensus.cc:993] T 544aaafd8b6b427191e89277cb281bd1 P f3160b8200a64810983bda11c4af8fff: : Instructing follower 93374462fb7d40ac80f3d526d4547642 to start an election
I20260709 14:55:01.301959 16955 raft_consensus.cc:1081] T 544aaafd8b6b427191e89277cb281bd1 P f3160b8200a64810983bda11c4af8fff [term 1 LEADER]: Signalling peer 93374462fb7d40ac80f3d526d4547642 to start an election
I20260709 14:55:01.304327 16693 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "544aaafd8b6b427191e89277cb281bd1"
dest_uuid: "93374462fb7d40ac80f3d526d4547642"
 from {username='slave'} at 127.0.0.1:53032
I20260709 14:55:01.305055 16693 raft_consensus.cc:493] T 544aaafd8b6b427191e89277cb281bd1 P 93374462fb7d40ac80f3d526d4547642 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:55:01.305519 16693 raft_consensus.cc:3060] T 544aaafd8b6b427191e89277cb281bd1 P 93374462fb7d40ac80f3d526d4547642 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:55:01.308805 16900 raft_consensus.cc:2468] T e197eb61cbe44c1e99a7a9cc182b7268 P 1cb7a022bda844bfb69fec38131c8e31 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3160b8200a64810983bda11c4af8fff in term 4.
I20260709 14:55:01.311157 16695 raft_consensus.cc:2468] T e197eb61cbe44c1e99a7a9cc182b7268 P 93374462fb7d40ac80f3d526d4547642 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3160b8200a64810983bda11c4af8fff in term 4.
I20260709 14:55:01.311381 16586 leader_election.cc:304] T e197eb61cbe44c1e99a7a9cc182b7268 P f3160b8200a64810983bda11c4af8fff [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1cb7a022bda844bfb69fec38131c8e31, f3160b8200a64810983bda11c4af8fff; no voters: 
I20260709 14:55:01.312250 16843 raft_consensus.cc:2804] T e197eb61cbe44c1e99a7a9cc182b7268 P f3160b8200a64810983bda11c4af8fff [term 4 FOLLOWER]: Leader election won for term 4
I20260709 14:55:01.312894 16843 raft_consensus.cc:697] T e197eb61cbe44c1e99a7a9cc182b7268 P f3160b8200a64810983bda11c4af8fff [term 4 LEADER]: Becoming Leader. State: Replica: f3160b8200a64810983bda11c4af8fff, State: Running, Role: LEADER
I20260709 14:55:01.313861 16843 consensus_queue.cc:237] T e197eb61cbe44c1e99a7a9cc182b7268 P f3160b8200a64810983bda11c4af8fff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:55:01.315819 16693 raft_consensus.cc:515] T 544aaafd8b6b427191e89277cb281bd1 P 93374462fb7d40ac80f3d526d4547642 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:55:01.319154 16693 leader_election.cc:290] T 544aaafd8b6b427191e89277cb281bd1 P 93374462fb7d40ac80f3d526d4547642 [CANDIDATE]: Term 2 election: Requested vote from peers 1cb7a022bda844bfb69fec38131c8e31 (127.6.101.65:41617), f3160b8200a64810983bda11c4af8fff (127.6.101.66:35977)
I20260709 14:55:01.320695 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544aaafd8b6b427191e89277cb281bd1" candidate_uuid: "93374462fb7d40ac80f3d526d4547642" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f3160b8200a64810983bda11c4af8fff"
I20260709 14:55:01.320755 16900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544aaafd8b6b427191e89277cb281bd1" candidate_uuid: "93374462fb7d40ac80f3d526d4547642" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1cb7a022bda844bfb69fec38131c8e31"
I20260709 14:55:01.321722 16618 raft_consensus.cc:3055] T 544aaafd8b6b427191e89277cb281bd1 P f3160b8200a64810983bda11c4af8fff [term 1 LEADER]: Stepping down as leader of term 1
I20260709 14:55:01.321997 16900 raft_consensus.cc:3060] T 544aaafd8b6b427191e89277cb281bd1 P 1cb7a022bda844bfb69fec38131c8e31 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:55:01.322208 16618 raft_consensus.cc:740] T 544aaafd8b6b427191e89277cb281bd1 P f3160b8200a64810983bda11c4af8fff [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f3160b8200a64810983bda11c4af8fff, State: Running, Role: LEADER
I20260709 14:55:01.323374 16618 consensus_queue.cc:260] T 544aaafd8b6b427191e89277cb281bd1 P f3160b8200a64810983bda11c4af8fff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:55:01.325021 16618 raft_consensus.cc:3060] T 544aaafd8b6b427191e89277cb281bd1 P f3160b8200a64810983bda11c4af8fff [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:55:01.331866 16900 raft_consensus.cc:2468] T 544aaafd8b6b427191e89277cb281bd1 P 1cb7a022bda844bfb69fec38131c8e31 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93374462fb7d40ac80f3d526d4547642 in term 2.
I20260709 14:55:01.333770 16660 leader_election.cc:304] T 544aaafd8b6b427191e89277cb281bd1 P 93374462fb7d40ac80f3d526d4547642 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1cb7a022bda844bfb69fec38131c8e31, 93374462fb7d40ac80f3d526d4547642; no voters: 
I20260709 14:55:01.334956 16922 raft_consensus.cc:2804] T 544aaafd8b6b427191e89277cb281bd1 P 93374462fb7d40ac80f3d526d4547642 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:55:01.335500 16922 raft_consensus.cc:697] T 544aaafd8b6b427191e89277cb281bd1 P 93374462fb7d40ac80f3d526d4547642 [term 2 LEADER]: Becoming Leader. State: Replica: 93374462fb7d40ac80f3d526d4547642, State: Running, Role: LEADER
I20260709 14:55:01.336123 16618 raft_consensus.cc:2468] T 544aaafd8b6b427191e89277cb281bd1 P f3160b8200a64810983bda11c4af8fff [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93374462fb7d40ac80f3d526d4547642 in term 2.
I20260709 14:55:01.336321 16922 consensus_queue.cc:237] T 544aaafd8b6b427191e89277cb281bd1 P 93374462fb7d40ac80f3d526d4547642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:55:01.346093 16443 catalog_manager.cc:5697] T e197eb61cbe44c1e99a7a9cc182b7268 P f3160b8200a64810983bda11c4af8fff reported cstate change: term changed from 3 to 4, leader changed from 93374462fb7d40ac80f3d526d4547642 (127.6.101.67) to f3160b8200a64810983bda11c4af8fff (127.6.101.66). New cstate: current_term: 4 leader_uuid: "f3160b8200a64810983bda11c4af8fff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } health_report { overall_health: UNKNOWN } } }
I20260709 14:55:01.359615 16441 catalog_manager.cc:5697] T 544aaafd8b6b427191e89277cb281bd1 P 93374462fb7d40ac80f3d526d4547642 reported cstate change: term changed from 1 to 2, leader changed from f3160b8200a64810983bda11c4af8fff (127.6.101.66) to 93374462fb7d40ac80f3d526d4547642 (127.6.101.67). New cstate: current_term: 2 leader_uuid: "93374462fb7d40ac80f3d526d4547642" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } health_report { overall_health: HEALTHY } } }
I20260709 14:55:01.812260 16900 raft_consensus.cc:1275] T 27e19d91f3664b33a47fc21010adb06d P 1cb7a022bda844bfb69fec38131c8e31 [term 2 FOLLOWER]: Refusing update from remote peer f3160b8200a64810983bda11c4af8fff: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:55:01.814152 16843 consensus_queue.cc:1048] T 27e19d91f3664b33a47fc21010adb06d P f3160b8200a64810983bda11c4af8fff [LEADER]: Connected to new peer: Peer: permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 14:55:01.818521 16693 raft_consensus.cc:1275] T 27e19d91f3664b33a47fc21010adb06d P 93374462fb7d40ac80f3d526d4547642 [term 2 FOLLOWER]: Refusing update from remote peer f3160b8200a64810983bda11c4af8fff: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:55:01.820518 16968 consensus_queue.cc:1048] T 27e19d91f3664b33a47fc21010adb06d P f3160b8200a64810983bda11c4af8fff [LEADER]: Connected to new peer: Peer: permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 14:55:01.842140 16695 raft_consensus.cc:1275] T e197eb61cbe44c1e99a7a9cc182b7268 P 93374462fb7d40ac80f3d526d4547642 [term 4 FOLLOWER]: Refusing update from remote peer f3160b8200a64810983bda11c4af8fff: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 14:55:01.844256 16968 consensus_queue.cc:1048] T e197eb61cbe44c1e99a7a9cc182b7268 P f3160b8200a64810983bda11c4af8fff [LEADER]: Connected to new peer: Peer: permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 14:55:01.851735 16618 raft_consensus.cc:1275] T 544aaafd8b6b427191e89277cb281bd1 P f3160b8200a64810983bda11c4af8fff [term 2 FOLLOWER]: Refusing update from remote peer 93374462fb7d40ac80f3d526d4547642: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:55:01.854084 16922 consensus_queue.cc:1048] T 544aaafd8b6b427191e89277cb281bd1 P 93374462fb7d40ac80f3d526d4547642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 14:55:01.861382 16900 raft_consensus.cc:1275] T e197eb61cbe44c1e99a7a9cc182b7268 P 1cb7a022bda844bfb69fec38131c8e31 [term 4 FOLLOWER]: Refusing update from remote peer f3160b8200a64810983bda11c4af8fff: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 14:55:01.870944 16974 consensus_queue.cc:1048] T e197eb61cbe44c1e99a7a9cc182b7268 P f3160b8200a64810983bda11c4af8fff [LEADER]: Connected to new peer: Peer: permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 14:55:01.901602 16899 raft_consensus.cc:1275] T 544aaafd8b6b427191e89277cb281bd1 P 1cb7a022bda844bfb69fec38131c8e31 [term 2 FOLLOWER]: Refusing update from remote peer 93374462fb7d40ac80f3d526d4547642: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:55:01.906908 16947 consensus_queue.cc:1048] T 544aaafd8b6b427191e89277cb281bd1 P 93374462fb7d40ac80f3d526d4547642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 14:55:02.096350 16492 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 14:55:02.214389  6549 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 14:55:02.224889 16618 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "93526d1276e74b9382a2fe40d2694853"
dest_uuid: "f3160b8200a64810983bda11c4af8fff"
mode: GRACEFUL
new_leader_uuid: "93374462fb7d40ac80f3d526d4547642"
 from {username='slave'} at 127.0.0.1:59348
I20260709 14:55:02.225845 16618 raft_consensus.cc:606] T 93526d1276e74b9382a2fe40d2694853 P f3160b8200a64810983bda11c4af8fff [term 2 LEADER]: Received request to transfer leadership to TS 93374462fb7d40ac80f3d526d4547642
I20260709 14:55:02.229657 16619 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9a69054eca44462f8f9d0ecadd574a2a"
dest_uuid: "f3160b8200a64810983bda11c4af8fff"
mode: GRACEFUL
new_leader_uuid: "93374462fb7d40ac80f3d526d4547642"
 from {username='slave'} at 127.0.0.1:59348
I20260709 14:55:02.230345 16619 raft_consensus.cc:606] T 9a69054eca44462f8f9d0ecadd574a2a P f3160b8200a64810983bda11c4af8fff [term 1 LEADER]: Received request to transfer leadership to TS 93374462fb7d40ac80f3d526d4547642
I20260709 14:55:02.234568 16693 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c727468585cc4bff8f000e922b7a7d95"
dest_uuid: "93374462fb7d40ac80f3d526d4547642"
mode: GRACEFUL
new_leader_uuid: "f3160b8200a64810983bda11c4af8fff"
 from {username='slave'} at 127.0.0.1:57328
I20260709 14:55:02.235357 16693 raft_consensus.cc:606] T c727468585cc4bff8f000e922b7a7d95 P 93374462fb7d40ac80f3d526d4547642 [term 1 LEADER]: Received request to transfer leadership to TS f3160b8200a64810983bda11c4af8fff
I20260709 14:55:02.237092  6549 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 14:55:02.237874  6549 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 14:55:02.238694  6549 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 14:55:02.385460 16974 raft_consensus.cc:993] T 93526d1276e74b9382a2fe40d2694853 P f3160b8200a64810983bda11c4af8fff: : Instructing follower 93374462fb7d40ac80f3d526d4547642 to start an election
I20260709 14:55:02.385995 16974 raft_consensus.cc:1081] T 93526d1276e74b9382a2fe40d2694853 P f3160b8200a64810983bda11c4af8fff [term 2 LEADER]: Signalling peer 93374462fb7d40ac80f3d526d4547642 to start an election
I20260709 14:55:02.388036 16693 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "93526d1276e74b9382a2fe40d2694853"
dest_uuid: "93374462fb7d40ac80f3d526d4547642"
 from {username='slave'} at 127.0.0.1:53032
I20260709 14:55:02.388634 16693 raft_consensus.cc:493] T 93526d1276e74b9382a2fe40d2694853 P 93374462fb7d40ac80f3d526d4547642 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:55:02.388991 16693 raft_consensus.cc:3060] T 93526d1276e74b9382a2fe40d2694853 P 93374462fb7d40ac80f3d526d4547642 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:55:02.397677 16693 raft_consensus.cc:515] T 93526d1276e74b9382a2fe40d2694853 P 93374462fb7d40ac80f3d526d4547642 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:55:02.399765 16693 leader_election.cc:290] T 93526d1276e74b9382a2fe40d2694853 P 93374462fb7d40ac80f3d526d4547642 [CANDIDATE]: Term 3 election: Requested vote from peers 1cb7a022bda844bfb69fec38131c8e31 (127.6.101.65:41617), f3160b8200a64810983bda11c4af8fff (127.6.101.66:35977)
I20260709 14:55:02.400857 16900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93526d1276e74b9382a2fe40d2694853" candidate_uuid: "93374462fb7d40ac80f3d526d4547642" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "1cb7a022bda844bfb69fec38131c8e31"
I20260709 14:55:02.401467 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93526d1276e74b9382a2fe40d2694853" candidate_uuid: "93374462fb7d40ac80f3d526d4547642" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "f3160b8200a64810983bda11c4af8fff"
I20260709 14:55:02.401708 16900 raft_consensus.cc:3060] T 93526d1276e74b9382a2fe40d2694853 P 1cb7a022bda844bfb69fec38131c8e31 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:55:02.402115 16619 raft_consensus.cc:3055] T 93526d1276e74b9382a2fe40d2694853 P f3160b8200a64810983bda11c4af8fff [term 2 LEADER]: Stepping down as leader of term 2
I20260709 14:55:02.402534 16619 raft_consensus.cc:740] T 93526d1276e74b9382a2fe40d2694853 P f3160b8200a64810983bda11c4af8fff [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f3160b8200a64810983bda11c4af8fff, State: Running, Role: LEADER
I20260709 14:55:02.403555 16619 consensus_queue.cc:260] T 93526d1276e74b9382a2fe40d2694853 P f3160b8200a64810983bda11c4af8fff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:55:02.404940 16619 raft_consensus.cc:3060] T 93526d1276e74b9382a2fe40d2694853 P f3160b8200a64810983bda11c4af8fff [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:55:02.411427 16900 raft_consensus.cc:2468] T 93526d1276e74b9382a2fe40d2694853 P 1cb7a022bda844bfb69fec38131c8e31 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93374462fb7d40ac80f3d526d4547642 in term 3.
I20260709 14:55:02.413383 16660 leader_election.cc:304] T 93526d1276e74b9382a2fe40d2694853 P 93374462fb7d40ac80f3d526d4547642 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1cb7a022bda844bfb69fec38131c8e31, 93374462fb7d40ac80f3d526d4547642; no voters: 
I20260709 14:55:02.414230 16947 raft_consensus.cc:2804] T 93526d1276e74b9382a2fe40d2694853 P 93374462fb7d40ac80f3d526d4547642 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 14:55:02.414417 16619 raft_consensus.cc:2468] T 93526d1276e74b9382a2fe40d2694853 P f3160b8200a64810983bda11c4af8fff [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93374462fb7d40ac80f3d526d4547642 in term 3.
I20260709 14:55:02.414754 16947 raft_consensus.cc:697] T 93526d1276e74b9382a2fe40d2694853 P 93374462fb7d40ac80f3d526d4547642 [term 3 LEADER]: Becoming Leader. State: Replica: 93374462fb7d40ac80f3d526d4547642, State: Running, Role: LEADER
I20260709 14:55:02.416235 16947 consensus_queue.cc:237] T 93526d1276e74b9382a2fe40d2694853 P 93374462fb7d40ac80f3d526d4547642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:55:02.425868 16441 catalog_manager.cc:5697] T 93526d1276e74b9382a2fe40d2694853 P 93374462fb7d40ac80f3d526d4547642 reported cstate change: term changed from 2 to 3, leader changed from f3160b8200a64810983bda11c4af8fff (127.6.101.66) to 93374462fb7d40ac80f3d526d4547642 (127.6.101.67). New cstate: current_term: 3 leader_uuid: "93374462fb7d40ac80f3d526d4547642" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } health_report { overall_health: HEALTHY } } }
I20260709 14:55:02.600306 16843 raft_consensus.cc:993] T 9a69054eca44462f8f9d0ecadd574a2a P f3160b8200a64810983bda11c4af8fff: : Instructing follower 93374462fb7d40ac80f3d526d4547642 to start an election
I20260709 14:55:02.600905 16974 raft_consensus.cc:1081] T 9a69054eca44462f8f9d0ecadd574a2a P f3160b8200a64810983bda11c4af8fff [term 1 LEADER]: Signalling peer 93374462fb7d40ac80f3d526d4547642 to start an election
I20260709 14:55:02.603396 16693 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9a69054eca44462f8f9d0ecadd574a2a"
dest_uuid: "93374462fb7d40ac80f3d526d4547642"
 from {username='slave'} at 127.0.0.1:53032
I20260709 14:55:02.604043 16693 raft_consensus.cc:493] T 9a69054eca44462f8f9d0ecadd574a2a P 93374462fb7d40ac80f3d526d4547642 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:55:02.604351 16693 raft_consensus.cc:3060] T 9a69054eca44462f8f9d0ecadd574a2a P 93374462fb7d40ac80f3d526d4547642 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:55:02.610306 16693 raft_consensus.cc:515] T 9a69054eca44462f8f9d0ecadd574a2a P 93374462fb7d40ac80f3d526d4547642 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:55:02.612282 16693 leader_election.cc:290] T 9a69054eca44462f8f9d0ecadd574a2a P 93374462fb7d40ac80f3d526d4547642 [CANDIDATE]: Term 2 election: Requested vote from peers 1cb7a022bda844bfb69fec38131c8e31 (127.6.101.65:41617), f3160b8200a64810983bda11c4af8fff (127.6.101.66:35977)
I20260709 14:55:02.613464 16900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a69054eca44462f8f9d0ecadd574a2a" candidate_uuid: "93374462fb7d40ac80f3d526d4547642" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1cb7a022bda844bfb69fec38131c8e31"
I20260709 14:55:02.613628 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a69054eca44462f8f9d0ecadd574a2a" candidate_uuid: "93374462fb7d40ac80f3d526d4547642" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f3160b8200a64810983bda11c4af8fff"
I20260709 14:55:02.614297 16900 raft_consensus.cc:3060] T 9a69054eca44462f8f9d0ecadd574a2a P 1cb7a022bda844bfb69fec38131c8e31 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:55:02.614342 16619 raft_consensus.cc:3055] T 9a69054eca44462f8f9d0ecadd574a2a P f3160b8200a64810983bda11c4af8fff [term 1 LEADER]: Stepping down as leader of term 1
I20260709 14:55:02.614903 16619 raft_consensus.cc:740] T 9a69054eca44462f8f9d0ecadd574a2a P f3160b8200a64810983bda11c4af8fff [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f3160b8200a64810983bda11c4af8fff, State: Running, Role: LEADER
I20260709 14:55:02.615845 16619 consensus_queue.cc:260] T 9a69054eca44462f8f9d0ecadd574a2a P f3160b8200a64810983bda11c4af8fff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:55:02.617791 16619 raft_consensus.cc:3060] T 9a69054eca44462f8f9d0ecadd574a2a P f3160b8200a64810983bda11c4af8fff [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:55:02.624150 16900 raft_consensus.cc:2468] T 9a69054eca44462f8f9d0ecadd574a2a P 1cb7a022bda844bfb69fec38131c8e31 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93374462fb7d40ac80f3d526d4547642 in term 2.
I20260709 14:55:02.625955 16660 leader_election.cc:304] T 9a69054eca44462f8f9d0ecadd574a2a P 93374462fb7d40ac80f3d526d4547642 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1cb7a022bda844bfb69fec38131c8e31, 93374462fb7d40ac80f3d526d4547642; no voters: 
I20260709 14:55:02.626801 16947 raft_consensus.cc:2804] T 9a69054eca44462f8f9d0ecadd574a2a P 93374462fb7d40ac80f3d526d4547642 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:55:02.627259 16947 raft_consensus.cc:697] T 9a69054eca44462f8f9d0ecadd574a2a P 93374462fb7d40ac80f3d526d4547642 [term 2 LEADER]: Becoming Leader. State: Replica: 93374462fb7d40ac80f3d526d4547642, State: Running, Role: LEADER
I20260709 14:55:02.627324 16619 raft_consensus.cc:2468] T 9a69054eca44462f8f9d0ecadd574a2a P f3160b8200a64810983bda11c4af8fff [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93374462fb7d40ac80f3d526d4547642 in term 2.
I20260709 14:55:02.628240 16947 consensus_queue.cc:237] T 9a69054eca44462f8f9d0ecadd574a2a P 93374462fb7d40ac80f3d526d4547642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:55:02.637866 16441 catalog_manager.cc:5697] T 9a69054eca44462f8f9d0ecadd574a2a P 93374462fb7d40ac80f3d526d4547642 reported cstate change: term changed from 1 to 2, leader changed from f3160b8200a64810983bda11c4af8fff (127.6.101.66) to 93374462fb7d40ac80f3d526d4547642 (127.6.101.67). New cstate: current_term: 2 leader_uuid: "93374462fb7d40ac80f3d526d4547642" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } health_report { overall_health: HEALTHY } } }
I20260709 14:55:02.681692 16923 raft_consensus.cc:993] T c727468585cc4bff8f000e922b7a7d95 P 93374462fb7d40ac80f3d526d4547642: : Instructing follower f3160b8200a64810983bda11c4af8fff to start an election
I20260709 14:55:02.682199 16947 raft_consensus.cc:1081] T c727468585cc4bff8f000e922b7a7d95 P 93374462fb7d40ac80f3d526d4547642 [term 1 LEADER]: Signalling peer f3160b8200a64810983bda11c4af8fff to start an election
I20260709 14:55:02.684078 16619 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c727468585cc4bff8f000e922b7a7d95"
dest_uuid: "f3160b8200a64810983bda11c4af8fff"
 from {username='slave'} at 127.0.0.1:50290
I20260709 14:55:02.684693 16619 raft_consensus.cc:493] T c727468585cc4bff8f000e922b7a7d95 P f3160b8200a64810983bda11c4af8fff [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:55:02.685017 16619 raft_consensus.cc:3060] T c727468585cc4bff8f000e922b7a7d95 P f3160b8200a64810983bda11c4af8fff [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:55:02.690800 16619 raft_consensus.cc:515] T c727468585cc4bff8f000e922b7a7d95 P f3160b8200a64810983bda11c4af8fff [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:55:02.692906 16619 leader_election.cc:290] T c727468585cc4bff8f000e922b7a7d95 P f3160b8200a64810983bda11c4af8fff [CANDIDATE]: Term 2 election: Requested vote from peers 1cb7a022bda844bfb69fec38131c8e31 (127.6.101.65:41617), 93374462fb7d40ac80f3d526d4547642 (127.6.101.67:41835)
I20260709 14:55:02.694279 16693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c727468585cc4bff8f000e922b7a7d95" candidate_uuid: "f3160b8200a64810983bda11c4af8fff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "93374462fb7d40ac80f3d526d4547642"
I20260709 14:55:02.694219 16899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c727468585cc4bff8f000e922b7a7d95" candidate_uuid: "f3160b8200a64810983bda11c4af8fff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1cb7a022bda844bfb69fec38131c8e31"
I20260709 14:55:02.695116 16693 raft_consensus.cc:3055] T c727468585cc4bff8f000e922b7a7d95 P 93374462fb7d40ac80f3d526d4547642 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 14:55:02.695264 16899 raft_consensus.cc:3060] T c727468585cc4bff8f000e922b7a7d95 P 1cb7a022bda844bfb69fec38131c8e31 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:55:02.695602 16693 raft_consensus.cc:740] T c727468585cc4bff8f000e922b7a7d95 P 93374462fb7d40ac80f3d526d4547642 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 93374462fb7d40ac80f3d526d4547642, State: Running, Role: LEADER
I20260709 14:55:02.696656 16693 consensus_queue.cc:260] T c727468585cc4bff8f000e922b7a7d95 P 93374462fb7d40ac80f3d526d4547642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:55:02.698028 16693 raft_consensus.cc:3060] T c727468585cc4bff8f000e922b7a7d95 P 93374462fb7d40ac80f3d526d4547642 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:55:02.703161 16899 raft_consensus.cc:2468] T c727468585cc4bff8f000e922b7a7d95 P 1cb7a022bda844bfb69fec38131c8e31 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3160b8200a64810983bda11c4af8fff in term 2.
I20260709 14:55:02.704015 16693 raft_consensus.cc:2468] T c727468585cc4bff8f000e922b7a7d95 P 93374462fb7d40ac80f3d526d4547642 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3160b8200a64810983bda11c4af8fff in term 2.
I20260709 14:55:02.704862 16586 leader_election.cc:304] T c727468585cc4bff8f000e922b7a7d95 P f3160b8200a64810983bda11c4af8fff [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1cb7a022bda844bfb69fec38131c8e31, f3160b8200a64810983bda11c4af8fff; no voters: 
I20260709 14:55:02.706259 16974 raft_consensus.cc:2804] T c727468585cc4bff8f000e922b7a7d95 P f3160b8200a64810983bda11c4af8fff [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:55:02.707957 16974 raft_consensus.cc:697] T c727468585cc4bff8f000e922b7a7d95 P f3160b8200a64810983bda11c4af8fff [term 2 LEADER]: Becoming Leader. State: Replica: f3160b8200a64810983bda11c4af8fff, State: Running, Role: LEADER
I20260709 14:55:02.708840 16974 consensus_queue.cc:237] T c727468585cc4bff8f000e922b7a7d95 P f3160b8200a64810983bda11c4af8fff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:55:02.720358 16441 catalog_manager.cc:5697] T c727468585cc4bff8f000e922b7a7d95 P f3160b8200a64810983bda11c4af8fff reported cstate change: term changed from 1 to 2, leader changed from 93374462fb7d40ac80f3d526d4547642 (127.6.101.67) to f3160b8200a64810983bda11c4af8fff (127.6.101.66). New cstate: current_term: 2 leader_uuid: "f3160b8200a64810983bda11c4af8fff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } health_report { overall_health: UNKNOWN } } }
I20260709 14:55:02.840615 16899 raft_consensus.cc:1275] T 93526d1276e74b9382a2fe40d2694853 P 1cb7a022bda844bfb69fec38131c8e31 [term 3 FOLLOWER]: Refusing update from remote peer 93374462fb7d40ac80f3d526d4547642: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 14:55:02.842367 16947 consensus_queue.cc:1048] T 93526d1276e74b9382a2fe40d2694853 P 93374462fb7d40ac80f3d526d4547642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 14:55:02.854521 16619 raft_consensus.cc:1275] T 93526d1276e74b9382a2fe40d2694853 P f3160b8200a64810983bda11c4af8fff [term 3 FOLLOWER]: Refusing update from remote peer 93374462fb7d40ac80f3d526d4547642: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 14:55:02.857133 16922 consensus_queue.cc:1048] T 93526d1276e74b9382a2fe40d2694853 P 93374462fb7d40ac80f3d526d4547642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 14:55:03.009490 16899 raft_consensus.cc:1275] T 9a69054eca44462f8f9d0ecadd574a2a P 1cb7a022bda844bfb69fec38131c8e31 [term 2 FOLLOWER]: Refusing update from remote peer 93374462fb7d40ac80f3d526d4547642: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:55:03.011075 16922 consensus_queue.cc:1048] T 9a69054eca44462f8f9d0ecadd574a2a P 93374462fb7d40ac80f3d526d4547642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 14:55:03.011580 16619 raft_consensus.cc:1275] T 9a69054eca44462f8f9d0ecadd574a2a P f3160b8200a64810983bda11c4af8fff [term 2 FOLLOWER]: Refusing update from remote peer 93374462fb7d40ac80f3d526d4547642: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:55:03.013353 16922 consensus_queue.cc:1048] T 9a69054eca44462f8f9d0ecadd574a2a P 93374462fb7d40ac80f3d526d4547642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 14:55:03.097882 16492 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 14:55:03.237982 16693 raft_consensus.cc:1275] T c727468585cc4bff8f000e922b7a7d95 P 93374462fb7d40ac80f3d526d4547642 [term 2 FOLLOWER]: Refusing update from remote peer f3160b8200a64810983bda11c4af8fff: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:55:03.239701 16974 consensus_queue.cc:1048] T c727468585cc4bff8f000e922b7a7d95 P f3160b8200a64810983bda11c4af8fff [LEADER]: Connected to new peer: Peer: permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 14:55:03.247583  6549 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 14:55:03.254077 16899 raft_consensus.cc:1275] T c727468585cc4bff8f000e922b7a7d95 P 1cb7a022bda844bfb69fec38131c8e31 [term 2 FOLLOWER]: Refusing update from remote peer f3160b8200a64810983bda11c4af8fff: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:55:03.257288 16999 consensus_queue.cc:1048] T c727468585cc4bff8f000e922b7a7d95 P f3160b8200a64810983bda11c4af8fff [LEADER]: Connected to new peer: Peer: permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 14:55:03.271287 16619 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "213053d1a14c4365a4bccd2d11a2764a"
dest_uuid: "f3160b8200a64810983bda11c4af8fff"
mode: GRACEFUL
new_leader_uuid: "93374462fb7d40ac80f3d526d4547642"
 from {username='slave'} at 127.0.0.1:59348
I20260709 14:55:03.271970 16619 raft_consensus.cc:606] T 213053d1a14c4365a4bccd2d11a2764a P f3160b8200a64810983bda11c4af8fff [term 1 LEADER]: Received request to transfer leadership to TS 93374462fb7d40ac80f3d526d4547642
I20260709 14:55:03.275104 16693 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "48f69b6ba5bd492b8470cb9edfa3fc49"
dest_uuid: "93374462fb7d40ac80f3d526d4547642"
mode: GRACEFUL
new_leader_uuid: "f3160b8200a64810983bda11c4af8fff"
 from {username='slave'} at 127.0.0.1:57328
I20260709 14:55:03.275609 16693 raft_consensus.cc:606] T 48f69b6ba5bd492b8470cb9edfa3fc49 P 93374462fb7d40ac80f3d526d4547642 [term 3 LEADER]: Received request to transfer leadership to TS f3160b8200a64810983bda11c4af8fff
I20260709 14:55:03.278621 16693 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "93526d1276e74b9382a2fe40d2694853"
dest_uuid: "93374462fb7d40ac80f3d526d4547642"
mode: GRACEFUL
new_leader_uuid: "f3160b8200a64810983bda11c4af8fff"
 from {username='slave'} at 127.0.0.1:57328
I20260709 14:55:03.279192 16693 raft_consensus.cc:606] T 93526d1276e74b9382a2fe40d2694853 P 93374462fb7d40ac80f3d526d4547642 [term 3 LEADER]: Received request to transfer leadership to TS f3160b8200a64810983bda11c4af8fff
I20260709 14:55:03.280647  6549 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 14:55:03.281368  6549 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 14:55:03.282060  6549 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 14:55:03.397626 16996 raft_consensus.cc:993] T 93526d1276e74b9382a2fe40d2694853 P 93374462fb7d40ac80f3d526d4547642: : Instructing follower f3160b8200a64810983bda11c4af8fff to start an election
I20260709 14:55:03.398319 16996 raft_consensus.cc:1081] T 93526d1276e74b9382a2fe40d2694853 P 93374462fb7d40ac80f3d526d4547642 [term 3 LEADER]: Signalling peer f3160b8200a64810983bda11c4af8fff to start an election
I20260709 14:55:03.401332 16619 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "93526d1276e74b9382a2fe40d2694853"
dest_uuid: "f3160b8200a64810983bda11c4af8fff"
 from {username='slave'} at 127.0.0.1:50290
I20260709 14:55:03.402168 16619 raft_consensus.cc:493] T 93526d1276e74b9382a2fe40d2694853 P f3160b8200a64810983bda11c4af8fff [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:55:03.402635 16619 raft_consensus.cc:3060] T 93526d1276e74b9382a2fe40d2694853 P f3160b8200a64810983bda11c4af8fff [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:55:03.409983 16619 raft_consensus.cc:515] T 93526d1276e74b9382a2fe40d2694853 P f3160b8200a64810983bda11c4af8fff [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:55:03.412108 16619 leader_election.cc:290] T 93526d1276e74b9382a2fe40d2694853 P f3160b8200a64810983bda11c4af8fff [CANDIDATE]: Term 4 election: Requested vote from peers 1cb7a022bda844bfb69fec38131c8e31 (127.6.101.65:41617), 93374462fb7d40ac80f3d526d4547642 (127.6.101.67:41835)
I20260709 14:55:03.413481 16693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93526d1276e74b9382a2fe40d2694853" candidate_uuid: "f3160b8200a64810983bda11c4af8fff" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "93374462fb7d40ac80f3d526d4547642"
I20260709 14:55:03.414145 16899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93526d1276e74b9382a2fe40d2694853" candidate_uuid: "f3160b8200a64810983bda11c4af8fff" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "1cb7a022bda844bfb69fec38131c8e31"
I20260709 14:55:03.414535 16693 raft_consensus.cc:3055] T 93526d1276e74b9382a2fe40d2694853 P 93374462fb7d40ac80f3d526d4547642 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 14:55:03.414883 16899 raft_consensus.cc:3060] T 93526d1276e74b9382a2fe40d2694853 P 1cb7a022bda844bfb69fec38131c8e31 [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:55:03.414923 16693 raft_consensus.cc:740] T 93526d1276e74b9382a2fe40d2694853 P 93374462fb7d40ac80f3d526d4547642 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 93374462fb7d40ac80f3d526d4547642, State: Running, Role: LEADER
I20260709 14:55:03.415827 16693 consensus_queue.cc:260] T 93526d1276e74b9382a2fe40d2694853 P 93374462fb7d40ac80f3d526d4547642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:55:03.416991 16693 raft_consensus.cc:3060] T 93526d1276e74b9382a2fe40d2694853 P 93374462fb7d40ac80f3d526d4547642 [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:55:03.421097 16899 raft_consensus.cc:2468] T 93526d1276e74b9382a2fe40d2694853 P 1cb7a022bda844bfb69fec38131c8e31 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3160b8200a64810983bda11c4af8fff in term 4.
I20260709 14:55:03.423080 16586 leader_election.cc:304] T 93526d1276e74b9382a2fe40d2694853 P f3160b8200a64810983bda11c4af8fff [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1cb7a022bda844bfb69fec38131c8e31, f3160b8200a64810983bda11c4af8fff; no voters: 
I20260709 14:55:03.423743 16693 raft_consensus.cc:2468] T 93526d1276e74b9382a2fe40d2694853 P 93374462fb7d40ac80f3d526d4547642 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3160b8200a64810983bda11c4af8fff in term 4.
I20260709 14:55:03.424175 16998 raft_consensus.cc:2804] T 93526d1276e74b9382a2fe40d2694853 P f3160b8200a64810983bda11c4af8fff [term 4 FOLLOWER]: Leader election won for term 4
I20260709 14:55:03.424808 16998 raft_consensus.cc:697] T 93526d1276e74b9382a2fe40d2694853 P f3160b8200a64810983bda11c4af8fff [term 4 LEADER]: Becoming Leader. State: Replica: f3160b8200a64810983bda11c4af8fff, State: Running, Role: LEADER
I20260709 14:55:03.426124 16998 consensus_queue.cc:237] T 93526d1276e74b9382a2fe40d2694853 P f3160b8200a64810983bda11c4af8fff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:55:03.434147 16443 catalog_manager.cc:5697] T 93526d1276e74b9382a2fe40d2694853 P f3160b8200a64810983bda11c4af8fff reported cstate change: term changed from 3 to 4, leader changed from 93374462fb7d40ac80f3d526d4547642 (127.6.101.67) to f3160b8200a64810983bda11c4af8fff (127.6.101.66). New cstate: current_term: 4 leader_uuid: "f3160b8200a64810983bda11c4af8fff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } health_report { overall_health: UNKNOWN } } }
I20260709 14:55:03.652837 16999 raft_consensus.cc:993] T 213053d1a14c4365a4bccd2d11a2764a P f3160b8200a64810983bda11c4af8fff: : Instructing follower 93374462fb7d40ac80f3d526d4547642 to start an election
I20260709 14:55:03.655277 16998 raft_consensus.cc:1081] T 213053d1a14c4365a4bccd2d11a2764a P f3160b8200a64810983bda11c4af8fff [term 1 LEADER]: Signalling peer 93374462fb7d40ac80f3d526d4547642 to start an election
I20260709 14:55:03.659147 16693 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "213053d1a14c4365a4bccd2d11a2764a"
dest_uuid: "93374462fb7d40ac80f3d526d4547642"
 from {username='slave'} at 127.0.0.1:53032
I20260709 14:55:03.660470 16693 raft_consensus.cc:493] T 213053d1a14c4365a4bccd2d11a2764a P 93374462fb7d40ac80f3d526d4547642 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:55:03.661468 16693 raft_consensus.cc:3060] T 213053d1a14c4365a4bccd2d11a2764a P 93374462fb7d40ac80f3d526d4547642 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:55:03.678198 16693 raft_consensus.cc:515] T 213053d1a14c4365a4bccd2d11a2764a P 93374462fb7d40ac80f3d526d4547642 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:55:03.680152 16693 leader_election.cc:290] T 213053d1a14c4365a4bccd2d11a2764a P 93374462fb7d40ac80f3d526d4547642 [CANDIDATE]: Term 2 election: Requested vote from peers 1cb7a022bda844bfb69fec38131c8e31 (127.6.101.65:41617), f3160b8200a64810983bda11c4af8fff (127.6.101.66:35977)
I20260709 14:55:03.682369 16899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213053d1a14c4365a4bccd2d11a2764a" candidate_uuid: "93374462fb7d40ac80f3d526d4547642" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1cb7a022bda844bfb69fec38131c8e31"
I20260709 14:55:03.682377 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213053d1a14c4365a4bccd2d11a2764a" candidate_uuid: "93374462fb7d40ac80f3d526d4547642" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f3160b8200a64810983bda11c4af8fff"
I20260709 14:55:03.683797 16619 raft_consensus.cc:3055] T 213053d1a14c4365a4bccd2d11a2764a P f3160b8200a64810983bda11c4af8fff [term 1 LEADER]: Stepping down as leader of term 1
I20260709 14:55:03.683805 16899 raft_consensus.cc:3060] T 213053d1a14c4365a4bccd2d11a2764a P 1cb7a022bda844bfb69fec38131c8e31 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:55:03.684463 16619 raft_consensus.cc:740] T 213053d1a14c4365a4bccd2d11a2764a P f3160b8200a64810983bda11c4af8fff [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f3160b8200a64810983bda11c4af8fff, State: Running, Role: LEADER
I20260709 14:55:03.687623 16619 consensus_queue.cc:260] T 213053d1a14c4365a4bccd2d11a2764a P f3160b8200a64810983bda11c4af8fff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:55:03.690388 16619 raft_consensus.cc:3060] T 213053d1a14c4365a4bccd2d11a2764a P f3160b8200a64810983bda11c4af8fff [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:55:03.697028 16899 raft_consensus.cc:2468] T 213053d1a14c4365a4bccd2d11a2764a P 1cb7a022bda844bfb69fec38131c8e31 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93374462fb7d40ac80f3d526d4547642 in term 2.
I20260709 14:55:03.699472 16660 leader_election.cc:304] T 213053d1a14c4365a4bccd2d11a2764a P 93374462fb7d40ac80f3d526d4547642 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1cb7a022bda844bfb69fec38131c8e31, 93374462fb7d40ac80f3d526d4547642; no voters: 
I20260709 14:55:03.700897 16922 raft_consensus.cc:2804] T 213053d1a14c4365a4bccd2d11a2764a P 93374462fb7d40ac80f3d526d4547642 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:55:03.701483 16922 raft_consensus.cc:697] T 213053d1a14c4365a4bccd2d11a2764a P 93374462fb7d40ac80f3d526d4547642 [term 2 LEADER]: Becoming Leader. State: Replica: 93374462fb7d40ac80f3d526d4547642, State: Running, Role: LEADER
I20260709 14:55:03.701732 16619 raft_consensus.cc:2468] T 213053d1a14c4365a4bccd2d11a2764a P f3160b8200a64810983bda11c4af8fff [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93374462fb7d40ac80f3d526d4547642 in term 2.
I20260709 14:55:03.703534 16922 consensus_queue.cc:237] T 213053d1a14c4365a4bccd2d11a2764a P 93374462fb7d40ac80f3d526d4547642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:55:03.717584 16443 catalog_manager.cc:5697] T 213053d1a14c4365a4bccd2d11a2764a P 93374462fb7d40ac80f3d526d4547642 reported cstate change: term changed from 1 to 2, leader changed from f3160b8200a64810983bda11c4af8fff (127.6.101.66) to 93374462fb7d40ac80f3d526d4547642 (127.6.101.67). New cstate: current_term: 2 leader_uuid: "93374462fb7d40ac80f3d526d4547642" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } health_report { overall_health: HEALTHY } } }
I20260709 14:55:03.751232 16996 raft_consensus.cc:993] T 48f69b6ba5bd492b8470cb9edfa3fc49 P 93374462fb7d40ac80f3d526d4547642: : Instructing follower f3160b8200a64810983bda11c4af8fff to start an election
I20260709 14:55:03.751748 16922 raft_consensus.cc:1081] T 48f69b6ba5bd492b8470cb9edfa3fc49 P 93374462fb7d40ac80f3d526d4547642 [term 3 LEADER]: Signalling peer f3160b8200a64810983bda11c4af8fff to start an election
I20260709 14:55:03.753639 16619 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "48f69b6ba5bd492b8470cb9edfa3fc49"
dest_uuid: "f3160b8200a64810983bda11c4af8fff"
 from {username='slave'} at 127.0.0.1:50290
I20260709 14:55:03.754299 16619 raft_consensus.cc:493] T 48f69b6ba5bd492b8470cb9edfa3fc49 P f3160b8200a64810983bda11c4af8fff [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:55:03.754776 16619 raft_consensus.cc:3060] T 48f69b6ba5bd492b8470cb9edfa3fc49 P f3160b8200a64810983bda11c4af8fff [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:55:03.762105 16619 raft_consensus.cc:515] T 48f69b6ba5bd492b8470cb9edfa3fc49 P f3160b8200a64810983bda11c4af8fff [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:55:03.764297 16619 leader_election.cc:290] T 48f69b6ba5bd492b8470cb9edfa3fc49 P f3160b8200a64810983bda11c4af8fff [CANDIDATE]: Term 4 election: Requested vote from peers 1cb7a022bda844bfb69fec38131c8e31 (127.6.101.65:41617), 93374462fb7d40ac80f3d526d4547642 (127.6.101.67:41835)
I20260709 14:55:03.765547 16899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f69b6ba5bd492b8470cb9edfa3fc49" candidate_uuid: "f3160b8200a64810983bda11c4af8fff" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "1cb7a022bda844bfb69fec38131c8e31"
I20260709 14:55:03.766281 16899 raft_consensus.cc:3060] T 48f69b6ba5bd492b8470cb9edfa3fc49 P 1cb7a022bda844bfb69fec38131c8e31 [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:55:03.766541 16693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f69b6ba5bd492b8470cb9edfa3fc49" candidate_uuid: "f3160b8200a64810983bda11c4af8fff" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "93374462fb7d40ac80f3d526d4547642"
I20260709 14:55:03.767321 16693 raft_consensus.cc:3055] T 48f69b6ba5bd492b8470cb9edfa3fc49 P 93374462fb7d40ac80f3d526d4547642 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 14:55:03.767593 16693 raft_consensus.cc:740] T 48f69b6ba5bd492b8470cb9edfa3fc49 P 93374462fb7d40ac80f3d526d4547642 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 93374462fb7d40ac80f3d526d4547642, State: Running, Role: LEADER
I20260709 14:55:03.768438 16693 consensus_queue.cc:260] T 48f69b6ba5bd492b8470cb9edfa3fc49 P 93374462fb7d40ac80f3d526d4547642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:55:03.769682 16693 raft_consensus.cc:3060] T 48f69b6ba5bd492b8470cb9edfa3fc49 P 93374462fb7d40ac80f3d526d4547642 [term 3 FOLLOWER]: Advancing to term 4
I20260709 14:55:03.776078 16899 raft_consensus.cc:2468] T 48f69b6ba5bd492b8470cb9edfa3fc49 P 1cb7a022bda844bfb69fec38131c8e31 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3160b8200a64810983bda11c4af8fff in term 4.
I20260709 14:55:03.778589 16586 leader_election.cc:304] T 48f69b6ba5bd492b8470cb9edfa3fc49 P f3160b8200a64810983bda11c4af8fff [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1cb7a022bda844bfb69fec38131c8e31, f3160b8200a64810983bda11c4af8fff; no voters: 
I20260709 14:55:03.779935 16998 raft_consensus.cc:2804] T 48f69b6ba5bd492b8470cb9edfa3fc49 P f3160b8200a64810983bda11c4af8fff [term 4 FOLLOWER]: Leader election won for term 4
I20260709 14:55:03.780658 16998 raft_consensus.cc:697] T 48f69b6ba5bd492b8470cb9edfa3fc49 P f3160b8200a64810983bda11c4af8fff [term 4 LEADER]: Becoming Leader. State: Replica: f3160b8200a64810983bda11c4af8fff, State: Running, Role: LEADER
I20260709 14:55:03.781003 16693 raft_consensus.cc:2468] T 48f69b6ba5bd492b8470cb9edfa3fc49 P 93374462fb7d40ac80f3d526d4547642 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3160b8200a64810983bda11c4af8fff in term 4.
I20260709 14:55:03.782083 16998 consensus_queue.cc:237] T 48f69b6ba5bd492b8470cb9edfa3fc49 P f3160b8200a64810983bda11c4af8fff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:55:03.793562 16443 catalog_manager.cc:5697] T 48f69b6ba5bd492b8470cb9edfa3fc49 P f3160b8200a64810983bda11c4af8fff reported cstate change: term changed from 3 to 4, leader changed from 93374462fb7d40ac80f3d526d4547642 (127.6.101.67) to f3160b8200a64810983bda11c4af8fff (127.6.101.66). New cstate: current_term: 4 leader_uuid: "f3160b8200a64810983bda11c4af8fff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } health_report { overall_health: UNKNOWN } } }
I20260709 14:55:03.847085 16899 raft_consensus.cc:1275] T 93526d1276e74b9382a2fe40d2694853 P 1cb7a022bda844bfb69fec38131c8e31 [term 4 FOLLOWER]: Refusing update from remote peer f3160b8200a64810983bda11c4af8fff: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 14:55:03.848867 16998 consensus_queue.cc:1048] T 93526d1276e74b9382a2fe40d2694853 P f3160b8200a64810983bda11c4af8fff [LEADER]: Connected to new peer: Peer: permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 14:55:03.867914 16693 raft_consensus.cc:1275] T 93526d1276e74b9382a2fe40d2694853 P 93374462fb7d40ac80f3d526d4547642 [term 4 FOLLOWER]: Refusing update from remote peer f3160b8200a64810983bda11c4af8fff: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 14:55:03.871090 16974 consensus_queue.cc:1048] T 93526d1276e74b9382a2fe40d2694853 P f3160b8200a64810983bda11c4af8fff [LEADER]: Connected to new peer: Peer: permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 14:55:04.099448 16492 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 14:55:04.149143 16899 raft_consensus.cc:1275] T 213053d1a14c4365a4bccd2d11a2764a P 1cb7a022bda844bfb69fec38131c8e31 [term 2 FOLLOWER]: Refusing update from remote peer 93374462fb7d40ac80f3d526d4547642: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:55:04.151345 16922 consensus_queue.cc:1048] T 213053d1a14c4365a4bccd2d11a2764a P 93374462fb7d40ac80f3d526d4547642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 14:55:04.164361 16619 raft_consensus.cc:1275] T 213053d1a14c4365a4bccd2d11a2764a P f3160b8200a64810983bda11c4af8fff [term 2 FOLLOWER]: Refusing update from remote peer 93374462fb7d40ac80f3d526d4547642: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:55:04.167075 17013 consensus_queue.cc:1048] T 213053d1a14c4365a4bccd2d11a2764a P 93374462fb7d40ac80f3d526d4547642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 14:55:04.261688 16899 raft_consensus.cc:1275] T 48f69b6ba5bd492b8470cb9edfa3fc49 P 1cb7a022bda844bfb69fec38131c8e31 [term 4 FOLLOWER]: Refusing update from remote peer f3160b8200a64810983bda11c4af8fff: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 14:55:04.263408 16998 consensus_queue.cc:1048] T 48f69b6ba5bd492b8470cb9edfa3fc49 P f3160b8200a64810983bda11c4af8fff [LEADER]: Connected to new peer: Peer: permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 14:55:04.277940 16693 raft_consensus.cc:1275] T 48f69b6ba5bd492b8470cb9edfa3fc49 P 93374462fb7d40ac80f3d526d4547642 [term 4 FOLLOWER]: Refusing update from remote peer f3160b8200a64810983bda11c4af8fff: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 14:55:04.280247 16998 consensus_queue.cc:1048] T 48f69b6ba5bd492b8470cb9edfa3fc49 P f3160b8200a64810983bda11c4af8fff [LEADER]: Connected to new peer: Peer: permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 14:55:04.289812  6549 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 14:55:04.313385 16619 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "27e19d91f3664b33a47fc21010adb06d"
dest_uuid: "f3160b8200a64810983bda11c4af8fff"
mode: GRACEFUL
new_leader_uuid: "93374462fb7d40ac80f3d526d4547642"
 from {username='slave'} at 127.0.0.1:59348
I20260709 14:55:04.314240 16619 raft_consensus.cc:606] T 27e19d91f3664b33a47fc21010adb06d P f3160b8200a64810983bda11c4af8fff [term 2 LEADER]: Received request to transfer leadership to TS 93374462fb7d40ac80f3d526d4547642
I20260709 14:55:04.318123 16693 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9a69054eca44462f8f9d0ecadd574a2a"
dest_uuid: "93374462fb7d40ac80f3d526d4547642"
mode: GRACEFUL
new_leader_uuid: "f3160b8200a64810983bda11c4af8fff"
 from {username='slave'} at 127.0.0.1:57328
I20260709 14:55:04.318718 16693 raft_consensus.cc:606] T 9a69054eca44462f8f9d0ecadd574a2a P 93374462fb7d40ac80f3d526d4547642 [term 2 LEADER]: Received request to transfer leadership to TS f3160b8200a64810983bda11c4af8fff
I20260709 14:55:04.322244 16619 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c727468585cc4bff8f000e922b7a7d95"
dest_uuid: "f3160b8200a64810983bda11c4af8fff"
mode: GRACEFUL
new_leader_uuid: "93374462fb7d40ac80f3d526d4547642"
 from {username='slave'} at 127.0.0.1:59348
I20260709 14:55:04.323078 16619 raft_consensus.cc:606] T c727468585cc4bff8f000e922b7a7d95 P f3160b8200a64810983bda11c4af8fff [term 2 LEADER]: Received request to transfer leadership to TS 93374462fb7d40ac80f3d526d4547642
I20260709 14:55:04.324527  6549 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 14:55:04.325084  6549 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 14:55:04.325901  6549 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 14:55:04.445209 16996 raft_consensus.cc:993] T 9a69054eca44462f8f9d0ecadd574a2a P 93374462fb7d40ac80f3d526d4547642: : Instructing follower f3160b8200a64810983bda11c4af8fff to start an election
I20260709 14:55:04.445930 16922 raft_consensus.cc:1081] T 9a69054eca44462f8f9d0ecadd574a2a P 93374462fb7d40ac80f3d526d4547642 [term 2 LEADER]: Signalling peer f3160b8200a64810983bda11c4af8fff to start an election
I20260709 14:55:04.448520 16619 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9a69054eca44462f8f9d0ecadd574a2a"
dest_uuid: "f3160b8200a64810983bda11c4af8fff"
 from {username='slave'} at 127.0.0.1:50290
I20260709 14:55:04.449170 16619 raft_consensus.cc:493] T 9a69054eca44462f8f9d0ecadd574a2a P f3160b8200a64810983bda11c4af8fff [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:55:04.449481 16619 raft_consensus.cc:3060] T 9a69054eca44462f8f9d0ecadd574a2a P f3160b8200a64810983bda11c4af8fff [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:55:04.457423 16619 raft_consensus.cc:515] T 9a69054eca44462f8f9d0ecadd574a2a P f3160b8200a64810983bda11c4af8fff [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:55:04.459115 16619 leader_election.cc:290] T 9a69054eca44462f8f9d0ecadd574a2a P f3160b8200a64810983bda11c4af8fff [CANDIDATE]: Term 3 election: Requested vote from peers 1cb7a022bda844bfb69fec38131c8e31 (127.6.101.65:41617), 93374462fb7d40ac80f3d526d4547642 (127.6.101.67:41835)
I20260709 14:55:04.460354 16693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a69054eca44462f8f9d0ecadd574a2a" candidate_uuid: "f3160b8200a64810983bda11c4af8fff" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "93374462fb7d40ac80f3d526d4547642"
I20260709 14:55:04.460354 16899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a69054eca44462f8f9d0ecadd574a2a" candidate_uuid: "f3160b8200a64810983bda11c4af8fff" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1cb7a022bda844bfb69fec38131c8e31"
I20260709 14:55:04.461434 16693 raft_consensus.cc:3055] T 9a69054eca44462f8f9d0ecadd574a2a P 93374462fb7d40ac80f3d526d4547642 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 14:55:04.461768 16899 raft_consensus.cc:3060] T 9a69054eca44462f8f9d0ecadd574a2a P 1cb7a022bda844bfb69fec38131c8e31 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:55:04.461773 16693 raft_consensus.cc:740] T 9a69054eca44462f8f9d0ecadd574a2a P 93374462fb7d40ac80f3d526d4547642 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 93374462fb7d40ac80f3d526d4547642, State: Running, Role: LEADER
I20260709 14:55:04.463229 16693 consensus_queue.cc:260] T 9a69054eca44462f8f9d0ecadd574a2a P 93374462fb7d40ac80f3d526d4547642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:55:04.464361 16693 raft_consensus.cc:3060] T 9a69054eca44462f8f9d0ecadd574a2a P 93374462fb7d40ac80f3d526d4547642 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:55:04.469429 16899 raft_consensus.cc:2468] T 9a69054eca44462f8f9d0ecadd574a2a P 1cb7a022bda844bfb69fec38131c8e31 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3160b8200a64810983bda11c4af8fff in term 3.
I20260709 14:55:04.470722 16586 leader_election.cc:304] T 9a69054eca44462f8f9d0ecadd574a2a P f3160b8200a64810983bda11c4af8fff [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1cb7a022bda844bfb69fec38131c8e31, f3160b8200a64810983bda11c4af8fff; no voters: 
I20260709 14:55:04.471161 16693 raft_consensus.cc:2468] T 9a69054eca44462f8f9d0ecadd574a2a P 93374462fb7d40ac80f3d526d4547642 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3160b8200a64810983bda11c4af8fff in term 3.
I20260709 14:55:04.471553 16998 raft_consensus.cc:2804] T 9a69054eca44462f8f9d0ecadd574a2a P f3160b8200a64810983bda11c4af8fff [term 3 FOLLOWER]: Leader election won for term 3
I20260709 14:55:04.472134 16998 raft_consensus.cc:697] T 9a69054eca44462f8f9d0ecadd574a2a P f3160b8200a64810983bda11c4af8fff [term 3 LEADER]: Becoming Leader. State: Replica: f3160b8200a64810983bda11c4af8fff, State: Running, Role: LEADER
I20260709 14:55:04.473667 16998 consensus_queue.cc:237] T 9a69054eca44462f8f9d0ecadd574a2a P f3160b8200a64810983bda11c4af8fff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:55:04.482645 16443 catalog_manager.cc:5697] T 9a69054eca44462f8f9d0ecadd574a2a P f3160b8200a64810983bda11c4af8fff reported cstate change: term changed from 2 to 3, leader changed from 93374462fb7d40ac80f3d526d4547642 (127.6.101.67) to f3160b8200a64810983bda11c4af8fff (127.6.101.66). New cstate: current_term: 3 leader_uuid: "f3160b8200a64810983bda11c4af8fff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } health_report { overall_health: UNKNOWN } } }
I20260709 14:55:04.545336 16974 raft_consensus.cc:993] T 27e19d91f3664b33a47fc21010adb06d P f3160b8200a64810983bda11c4af8fff: : Instructing follower 93374462fb7d40ac80f3d526d4547642 to start an election
I20260709 14:55:04.545879 16998 raft_consensus.cc:1081] T 27e19d91f3664b33a47fc21010adb06d P f3160b8200a64810983bda11c4af8fff [term 2 LEADER]: Signalling peer 93374462fb7d40ac80f3d526d4547642 to start an election
I20260709 14:55:04.547857 16693 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "27e19d91f3664b33a47fc21010adb06d"
dest_uuid: "93374462fb7d40ac80f3d526d4547642"
 from {username='slave'} at 127.0.0.1:53032
I20260709 14:55:04.548620 16693 raft_consensus.cc:493] T 27e19d91f3664b33a47fc21010adb06d P 93374462fb7d40ac80f3d526d4547642 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:55:04.549088 16693 raft_consensus.cc:3060] T 27e19d91f3664b33a47fc21010adb06d P 93374462fb7d40ac80f3d526d4547642 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:55:04.557962 16693 raft_consensus.cc:515] T 27e19d91f3664b33a47fc21010adb06d P 93374462fb7d40ac80f3d526d4547642 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:55:04.559861 16693 leader_election.cc:290] T 27e19d91f3664b33a47fc21010adb06d P 93374462fb7d40ac80f3d526d4547642 [CANDIDATE]: Term 3 election: Requested vote from peers 1cb7a022bda844bfb69fec38131c8e31 (127.6.101.65:41617), f3160b8200a64810983bda11c4af8fff (127.6.101.66:35977)
I20260709 14:55:04.561041 16899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e19d91f3664b33a47fc21010adb06d" candidate_uuid: "93374462fb7d40ac80f3d526d4547642" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1cb7a022bda844bfb69fec38131c8e31"
I20260709 14:55:04.561209 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e19d91f3664b33a47fc21010adb06d" candidate_uuid: "93374462fb7d40ac80f3d526d4547642" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f3160b8200a64810983bda11c4af8fff"
I20260709 14:55:04.562048 16899 raft_consensus.cc:3060] T 27e19d91f3664b33a47fc21010adb06d P 1cb7a022bda844bfb69fec38131c8e31 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:55:04.562227 16619 raft_consensus.cc:3055] T 27e19d91f3664b33a47fc21010adb06d P f3160b8200a64810983bda11c4af8fff [term 2 LEADER]: Stepping down as leader of term 2
I20260709 14:55:04.562702 16619 raft_consensus.cc:740] T 27e19d91f3664b33a47fc21010adb06d P f3160b8200a64810983bda11c4af8fff [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f3160b8200a64810983bda11c4af8fff, State: Running, Role: LEADER
I20260709 14:55:04.563617 16619 consensus_queue.cc:260] T 27e19d91f3664b33a47fc21010adb06d P f3160b8200a64810983bda11c4af8fff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:55:04.564999 16619 raft_consensus.cc:3060] T 27e19d91f3664b33a47fc21010adb06d P f3160b8200a64810983bda11c4af8fff [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:55:04.568620 16899 raft_consensus.cc:2468] T 27e19d91f3664b33a47fc21010adb06d P 1cb7a022bda844bfb69fec38131c8e31 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93374462fb7d40ac80f3d526d4547642 in term 3.
I20260709 14:55:04.570282 16660 leader_election.cc:304] T 27e19d91f3664b33a47fc21010adb06d P 93374462fb7d40ac80f3d526d4547642 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1cb7a022bda844bfb69fec38131c8e31, 93374462fb7d40ac80f3d526d4547642; no voters: 
I20260709 14:55:04.571381 16922 raft_consensus.cc:2804] T 27e19d91f3664b33a47fc21010adb06d P 93374462fb7d40ac80f3d526d4547642 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 14:55:04.571900 16922 raft_consensus.cc:697] T 27e19d91f3664b33a47fc21010adb06d P 93374462fb7d40ac80f3d526d4547642 [term 3 LEADER]: Becoming Leader. State: Replica: 93374462fb7d40ac80f3d526d4547642, State: Running, Role: LEADER
I20260709 14:55:04.571961 16619 raft_consensus.cc:2468] T 27e19d91f3664b33a47fc21010adb06d P f3160b8200a64810983bda11c4af8fff [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93374462fb7d40ac80f3d526d4547642 in term 3.
I20260709 14:55:04.573133 16922 consensus_queue.cc:237] T 27e19d91f3664b33a47fc21010adb06d P 93374462fb7d40ac80f3d526d4547642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:55:04.582379 16443 catalog_manager.cc:5697] T 27e19d91f3664b33a47fc21010adb06d P 93374462fb7d40ac80f3d526d4547642 reported cstate change: term changed from 2 to 3, leader changed from f3160b8200a64810983bda11c4af8fff (127.6.101.66) to 93374462fb7d40ac80f3d526d4547642 (127.6.101.67). New cstate: current_term: 3 leader_uuid: "93374462fb7d40ac80f3d526d4547642" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } health_report { overall_health: HEALTHY } } }
I20260709 14:55:04.690361 16974 raft_consensus.cc:993] T c727468585cc4bff8f000e922b7a7d95 P f3160b8200a64810983bda11c4af8fff: : Instructing follower 93374462fb7d40ac80f3d526d4547642 to start an election
I20260709 14:55:04.690953 16974 raft_consensus.cc:1081] T c727468585cc4bff8f000e922b7a7d95 P f3160b8200a64810983bda11c4af8fff [term 2 LEADER]: Signalling peer 93374462fb7d40ac80f3d526d4547642 to start an election
I20260709 14:55:04.692941 16693 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c727468585cc4bff8f000e922b7a7d95"
dest_uuid: "93374462fb7d40ac80f3d526d4547642"
 from {username='slave'} at 127.0.0.1:53032
I20260709 14:55:04.693512 16693 raft_consensus.cc:493] T c727468585cc4bff8f000e922b7a7d95 P 93374462fb7d40ac80f3d526d4547642 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:55:04.693809 16693 raft_consensus.cc:3060] T c727468585cc4bff8f000e922b7a7d95 P 93374462fb7d40ac80f3d526d4547642 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:55:04.700829 16693 raft_consensus.cc:515] T c727468585cc4bff8f000e922b7a7d95 P 93374462fb7d40ac80f3d526d4547642 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:55:04.702898 16693 leader_election.cc:290] T c727468585cc4bff8f000e922b7a7d95 P 93374462fb7d40ac80f3d526d4547642 [CANDIDATE]: Term 3 election: Requested vote from peers 1cb7a022bda844bfb69fec38131c8e31 (127.6.101.65:41617), f3160b8200a64810983bda11c4af8fff (127.6.101.66:35977)
I20260709 14:55:04.704005 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c727468585cc4bff8f000e922b7a7d95" candidate_uuid: "93374462fb7d40ac80f3d526d4547642" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f3160b8200a64810983bda11c4af8fff"
I20260709 14:55:04.704025 16899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c727468585cc4bff8f000e922b7a7d95" candidate_uuid: "93374462fb7d40ac80f3d526d4547642" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1cb7a022bda844bfb69fec38131c8e31"
I20260709 14:55:04.704934 16619 raft_consensus.cc:3055] T c727468585cc4bff8f000e922b7a7d95 P f3160b8200a64810983bda11c4af8fff [term 2 LEADER]: Stepping down as leader of term 2
I20260709 14:55:04.705016 16899 raft_consensus.cc:3060] T c727468585cc4bff8f000e922b7a7d95 P 1cb7a022bda844bfb69fec38131c8e31 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:55:04.705376 16619 raft_consensus.cc:740] T c727468585cc4bff8f000e922b7a7d95 P f3160b8200a64810983bda11c4af8fff [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f3160b8200a64810983bda11c4af8fff, State: Running, Role: LEADER
I20260709 14:55:04.706382 16619 consensus_queue.cc:260] T c727468585cc4bff8f000e922b7a7d95 P f3160b8200a64810983bda11c4af8fff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:55:04.707839 16619 raft_consensus.cc:3060] T c727468585cc4bff8f000e922b7a7d95 P f3160b8200a64810983bda11c4af8fff [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:55:04.715364 16899 raft_consensus.cc:2468] T c727468585cc4bff8f000e922b7a7d95 P 1cb7a022bda844bfb69fec38131c8e31 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93374462fb7d40ac80f3d526d4547642 in term 3.
I20260709 14:55:04.717326 16660 leader_election.cc:304] T c727468585cc4bff8f000e922b7a7d95 P 93374462fb7d40ac80f3d526d4547642 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1cb7a022bda844bfb69fec38131c8e31, 93374462fb7d40ac80f3d526d4547642; no voters: 
I20260709 14:55:04.718293 16619 raft_consensus.cc:2468] T c727468585cc4bff8f000e922b7a7d95 P f3160b8200a64810983bda11c4af8fff [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93374462fb7d40ac80f3d526d4547642 in term 3.
I20260709 14:55:04.718312 17013 raft_consensus.cc:2804] T c727468585cc4bff8f000e922b7a7d95 P 93374462fb7d40ac80f3d526d4547642 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 14:55:04.719069 17013 raft_consensus.cc:697] T c727468585cc4bff8f000e922b7a7d95 P 93374462fb7d40ac80f3d526d4547642 [term 3 LEADER]: Becoming Leader. State: Replica: 93374462fb7d40ac80f3d526d4547642, State: Running, Role: LEADER
I20260709 14:55:04.720202 17013 consensus_queue.cc:237] T c727468585cc4bff8f000e922b7a7d95 P 93374462fb7d40ac80f3d526d4547642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } }
I20260709 14:55:04.729003 16443 catalog_manager.cc:5697] T c727468585cc4bff8f000e922b7a7d95 P 93374462fb7d40ac80f3d526d4547642 reported cstate change: term changed from 2 to 3, leader changed from f3160b8200a64810983bda11c4af8fff (127.6.101.66) to 93374462fb7d40ac80f3d526d4547642 (127.6.101.67). New cstate: current_term: 3 leader_uuid: "93374462fb7d40ac80f3d526d4547642" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 } health_report { overall_health: HEALTHY } } }
I20260709 14:55:04.920228 16899 raft_consensus.cc:1275] T 9a69054eca44462f8f9d0ecadd574a2a P 1cb7a022bda844bfb69fec38131c8e31 [term 3 FOLLOWER]: Refusing update from remote peer f3160b8200a64810983bda11c4af8fff: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 14:55:04.921908 17023 consensus_queue.cc:1048] T 9a69054eca44462f8f9d0ecadd574a2a P f3160b8200a64810983bda11c4af8fff [LEADER]: Connected to new peer: Peer: permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 14:55:04.935114 16693 raft_consensus.cc:1275] T 9a69054eca44462f8f9d0ecadd574a2a P 93374462fb7d40ac80f3d526d4547642 [term 3 FOLLOWER]: Refusing update from remote peer f3160b8200a64810983bda11c4af8fff: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 14:55:04.937316 17023 consensus_queue.cc:1048] T 9a69054eca44462f8f9d0ecadd574a2a P f3160b8200a64810983bda11c4af8fff [LEADER]: Connected to new peer: Peer: permanent_uuid: "93374462fb7d40ac80f3d526d4547642" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 41835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 14:55:04.999892 16619 raft_consensus.cc:1275] T 27e19d91f3664b33a47fc21010adb06d P f3160b8200a64810983bda11c4af8fff [term 3 FOLLOWER]: Refusing update from remote peer 93374462fb7d40ac80f3d526d4547642: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 14:55:05.001709 17013 consensus_queue.cc:1048] T 27e19d91f3664b33a47fc21010adb06d P 93374462fb7d40ac80f3d526d4547642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 14:55:05.013792 16899 raft_consensus.cc:1275] T 27e19d91f3664b33a47fc21010adb06d P 1cb7a022bda844bfb69fec38131c8e31 [term 3 FOLLOWER]: Refusing update from remote peer 93374462fb7d40ac80f3d526d4547642: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 14:55:05.017189 16922 consensus_queue.cc:1048] T 27e19d91f3664b33a47fc21010adb06d P 93374462fb7d40ac80f3d526d4547642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 14:55:05.100785 16492 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 14:55:05.198972 16900 raft_consensus.cc:1275] T c727468585cc4bff8f000e922b7a7d95 P 1cb7a022bda844bfb69fec38131c8e31 [term 3 FOLLOWER]: Refusing update from remote peer 93374462fb7d40ac80f3d526d4547642: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 14:55:05.200675 16996 consensus_queue.cc:1048] T c727468585cc4bff8f000e922b7a7d95 P 93374462fb7d40ac80f3d526d4547642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1cb7a022bda844bfb69fec38131c8e31" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 41617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 14:55:05.216071 16619 raft_consensus.cc:1275] T c727468585cc4bff8f000e922b7a7d95 P f3160b8200a64810983bda11c4af8fff [term 3 FOLLOWER]: Refusing update from remote peer 93374462fb7d40ac80f3d526d4547642: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 14:55:05.217974 16996 consensus_queue.cc:1048] T c727468585cc4bff8f000e922b7a7d95 P 93374462fb7d40ac80f3d526d4547642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3160b8200a64810983bda11c4af8fff" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 14:55:05.333355  6549 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 14:55:05.375600  6549 tablet_server.cc:179] TabletServer@127.6.101.65:41617 shutting down...
I20260709 14:55:05.419143  6549 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 14:55:05.420639  6549 tablet_replica.cc:333] stopping tablet replica
I20260709 14:55:05.421779  6549 raft_consensus.cc:2243] T 213053d1a14c4365a4bccd2d11a2764a P 1cb7a022bda844bfb69fec38131c8e31 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 14:55:05.422736  6549 raft_consensus.cc:2272] T 213053d1a14c4365a4bccd2d11a2764a P 1cb7a022bda844bfb69fec38131c8e31 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:05.427569  6549 tablet_replica.cc:333] stopping tablet replica
I20260709 14:55:05.428423  6549 raft_consensus.cc:2243] T 544aaafd8b6b427191e89277cb281bd1 P 1cb7a022bda844bfb69fec38131c8e31 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 14:55:05.429028  6549 raft_consensus.cc:2272] T 544aaafd8b6b427191e89277cb281bd1 P 1cb7a022bda844bfb69fec38131c8e31 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:05.431618  6549 tablet_replica.cc:333] stopping tablet replica
I20260709 14:55:05.432502  6549 raft_consensus.cc:2243] T 48f69b6ba5bd492b8470cb9edfa3fc49 P 1cb7a022bda844bfb69fec38131c8e31 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 14:55:05.433298  6549 raft_consensus.cc:2272] T 48f69b6ba5bd492b8470cb9edfa3fc49 P 1cb7a022bda844bfb69fec38131c8e31 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:05.436813  6549 tablet_replica.cc:333] stopping tablet replica
I20260709 14:55:05.437634  6549 raft_consensus.cc:2243] T 6492b42adab04eceb2ad67a6f9dca9ed P 1cb7a022bda844bfb69fec38131c8e31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 14:55:05.438386  6549 raft_consensus.cc:2272] T 6492b42adab04eceb2ad67a6f9dca9ed P 1cb7a022bda844bfb69fec38131c8e31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:05.443539  6549 tablet_replica.cc:333] stopping tablet replica
I20260709 14:55:05.444295  6549 raft_consensus.cc:2243] T 43486d5085024ad4ab238eb24756ce7b P 1cb7a022bda844bfb69fec38131c8e31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 14:55:05.444800  6549 raft_consensus.cc:2272] T 43486d5085024ad4ab238eb24756ce7b P 1cb7a022bda844bfb69fec38131c8e31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:05.448652  6549 tablet_replica.cc:333] stopping tablet replica
W20260709 14:55:05.448869 16660 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 10 similar messages]
I20260709 14:55:05.449766  6549 raft_consensus.cc:2243] T c727468585cc4bff8f000e922b7a7d95 P 1cb7a022bda844bfb69fec38131c8e31 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 14:55:05.452030  6549 raft_consensus.cc:2272] T c727468585cc4bff8f000e922b7a7d95 P 1cb7a022bda844bfb69fec38131c8e31 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 14:55:05.455518 16660 consensus_peers.cc:597] T 544aaafd8b6b427191e89277cb281bd1 P 93374462fb7d40ac80f3d526d4547642 -> Peer 1cb7a022bda844bfb69fec38131c8e31 (127.6.101.65:41617): Couldn't send request to peer 1cb7a022bda844bfb69fec38131c8e31. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:55:05.456754  6549 tablet_replica.cc:333] stopping tablet replica
I20260709 14:55:05.457580  6549 raft_consensus.cc:2243] T 93526d1276e74b9382a2fe40d2694853 P 1cb7a022bda844bfb69fec38131c8e31 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 14:55:05.458151  6549 raft_consensus.cc:2272] T 93526d1276e74b9382a2fe40d2694853 P 1cb7a022bda844bfb69fec38131c8e31 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:05.460546  6549 tablet_replica.cc:333] stopping tablet replica
I20260709 14:55:05.461165  6549 raft_consensus.cc:2243] T e197eb61cbe44c1e99a7a9cc182b7268 P 1cb7a022bda844bfb69fec38131c8e31 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 14:55:05.461750  6549 raft_consensus.cc:2272] T e197eb61cbe44c1e99a7a9cc182b7268 P 1cb7a022bda844bfb69fec38131c8e31 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:05.464195  6549 tablet_replica.cc:333] stopping tablet replica
I20260709 14:55:05.464807  6549 raft_consensus.cc:2243] T 27e19d91f3664b33a47fc21010adb06d P 1cb7a022bda844bfb69fec38131c8e31 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 14:55:05.465310  6549 raft_consensus.cc:2272] T 27e19d91f3664b33a47fc21010adb06d P 1cb7a022bda844bfb69fec38131c8e31 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:05.469977  6549 tablet_replica.cc:333] stopping tablet replica
I20260709 14:55:05.470643  6549 raft_consensus.cc:2243] T 9a69054eca44462f8f9d0ecadd574a2a P 1cb7a022bda844bfb69fec38131c8e31 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 14:55:05.471170  6549 raft_consensus.cc:2272] T 9a69054eca44462f8f9d0ecadd574a2a P 1cb7a022bda844bfb69fec38131c8e31 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:05.514240  6549 tablet_server.cc:196] TabletServer@127.6.101.65:41617 shutdown complete.
W20260709 14:55:05.527223 16660 consensus_peers.cc:597] T 27e19d91f3664b33a47fc21010adb06d P 93374462fb7d40ac80f3d526d4547642 -> Peer 1cb7a022bda844bfb69fec38131c8e31 (127.6.101.65:41617): Couldn't send request to peer 1cb7a022bda844bfb69fec38131c8e31. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:41617: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 14:55:05.564069  6549 tablet_server.cc:179] TabletServer@127.6.101.66:0 shutting down...
W20260709 14:55:05.570695 16660 consensus_peers.cc:597] T 6492b42adab04eceb2ad67a6f9dca9ed P 93374462fb7d40ac80f3d526d4547642 -> Peer 1cb7a022bda844bfb69fec38131c8e31 (127.6.101.65:41617): Couldn't send request to peer 1cb7a022bda844bfb69fec38131c8e31. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:41617: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 14:55:05.610615  6549 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 14:55:05.611723  6549 tablet_replica.cc:333] T 213053d1a14c4365a4bccd2d11a2764a P f3160b8200a64810983bda11c4af8fff: stopping tablet replica
I20260709 14:55:05.612812  6549 raft_consensus.cc:2243] T 213053d1a14c4365a4bccd2d11a2764a P f3160b8200a64810983bda11c4af8fff [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 14:55:05.613410  6549 raft_consensus.cc:2272] T 213053d1a14c4365a4bccd2d11a2764a P f3160b8200a64810983bda11c4af8fff [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:05.621579  6549 tablet_replica.cc:333] T 93526d1276e74b9382a2fe40d2694853 P f3160b8200a64810983bda11c4af8fff: stopping tablet replica
I20260709 14:55:05.622743  6549 raft_consensus.cc:2243] T 93526d1276e74b9382a2fe40d2694853 P f3160b8200a64810983bda11c4af8fff [term 4 LEADER]: Raft consensus shutting down.
I20260709 14:55:05.623986  6549 raft_consensus.cc:2272] T 93526d1276e74b9382a2fe40d2694853 P f3160b8200a64810983bda11c4af8fff [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:05.628090  6549 tablet_replica.cc:333] T c727468585cc4bff8f000e922b7a7d95 P f3160b8200a64810983bda11c4af8fff: stopping tablet replica
I20260709 14:55:05.629312  6549 raft_consensus.cc:2243] T c727468585cc4bff8f000e922b7a7d95 P f3160b8200a64810983bda11c4af8fff [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 14:55:05.630273  6549 raft_consensus.cc:2272] T c727468585cc4bff8f000e922b7a7d95 P f3160b8200a64810983bda11c4af8fff [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:05.639333  6549 tablet_replica.cc:333] T e197eb61cbe44c1e99a7a9cc182b7268 P f3160b8200a64810983bda11c4af8fff: stopping tablet replica
I20260709 14:55:05.640319  6549 raft_consensus.cc:2243] T e197eb61cbe44c1e99a7a9cc182b7268 P f3160b8200a64810983bda11c4af8fff [term 4 LEADER]: Raft consensus shutting down.
I20260709 14:55:05.641601  6549 raft_consensus.cc:2272] T e197eb61cbe44c1e99a7a9cc182b7268 P f3160b8200a64810983bda11c4af8fff [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:05.645766  6549 tablet_replica.cc:333] T 27e19d91f3664b33a47fc21010adb06d P f3160b8200a64810983bda11c4af8fff: stopping tablet replica
I20260709 14:55:05.646734  6549 raft_consensus.cc:2243] T 27e19d91f3664b33a47fc21010adb06d P f3160b8200a64810983bda11c4af8fff [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 14:55:05.647295  6549 raft_consensus.cc:2272] T 27e19d91f3664b33a47fc21010adb06d P f3160b8200a64810983bda11c4af8fff [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 14:55:05.651208 16660 consensus_peers.cc:597] T c727468585cc4bff8f000e922b7a7d95 P 93374462fb7d40ac80f3d526d4547642 -> Peer 1cb7a022bda844bfb69fec38131c8e31 (127.6.101.65:41617): Couldn't send request to peer 1cb7a022bda844bfb69fec38131c8e31. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:41617: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 14:55:05.654052  6549 tablet_replica.cc:333] T 9a69054eca44462f8f9d0ecadd574a2a P f3160b8200a64810983bda11c4af8fff: stopping tablet replica
I20260709 14:55:05.654947  6549 raft_consensus.cc:2243] T 9a69054eca44462f8f9d0ecadd574a2a P f3160b8200a64810983bda11c4af8fff [term 3 LEADER]: Raft consensus shutting down.
I20260709 14:55:05.655959  6549 raft_consensus.cc:2272] T 9a69054eca44462f8f9d0ecadd574a2a P f3160b8200a64810983bda11c4af8fff [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:05.659765  6549 tablet_replica.cc:333] T 6492b42adab04eceb2ad67a6f9dca9ed P f3160b8200a64810983bda11c4af8fff: stopping tablet replica
I20260709 14:55:05.660862  6549 raft_consensus.cc:2243] T 6492b42adab04eceb2ad67a6f9dca9ed P f3160b8200a64810983bda11c4af8fff [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 14:55:05.662546  6549 raft_consensus.cc:2272] T 6492b42adab04eceb2ad67a6f9dca9ed P f3160b8200a64810983bda11c4af8fff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:05.666163  6549 tablet_replica.cc:333] T 43486d5085024ad4ab238eb24756ce7b P f3160b8200a64810983bda11c4af8fff: stopping tablet replica
I20260709 14:55:05.666945  6549 raft_consensus.cc:2243] T 43486d5085024ad4ab238eb24756ce7b P f3160b8200a64810983bda11c4af8fff [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 14:55:05.667769  6549 raft_consensus.cc:2272] T 43486d5085024ad4ab238eb24756ce7b P f3160b8200a64810983bda11c4af8fff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:05.671504  6549 tablet_replica.cc:333] T 544aaafd8b6b427191e89277cb281bd1 P f3160b8200a64810983bda11c4af8fff: stopping tablet replica
I20260709 14:55:05.672324  6549 raft_consensus.cc:2243] T 544aaafd8b6b427191e89277cb281bd1 P f3160b8200a64810983bda11c4af8fff [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 14:55:05.673002  6549 raft_consensus.cc:2272] T 544aaafd8b6b427191e89277cb281bd1 P f3160b8200a64810983bda11c4af8fff [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:05.676082  6549 tablet_replica.cc:333] T 48f69b6ba5bd492b8470cb9edfa3fc49 P f3160b8200a64810983bda11c4af8fff: stopping tablet replica
I20260709 14:55:05.676913  6549 raft_consensus.cc:2243] T 48f69b6ba5bd492b8470cb9edfa3fc49 P f3160b8200a64810983bda11c4af8fff [term 4 LEADER]: Raft consensus shutting down.
I20260709 14:55:05.678018  6549 raft_consensus.cc:2272] T 48f69b6ba5bd492b8470cb9edfa3fc49 P f3160b8200a64810983bda11c4af8fff [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 14:55:05.717644 16660 consensus_peers.cc:597] T 213053d1a14c4365a4bccd2d11a2764a P 93374462fb7d40ac80f3d526d4547642 -> Peer 1cb7a022bda844bfb69fec38131c8e31 (127.6.101.65:41617): Couldn't send request to peer 1cb7a022bda844bfb69fec38131c8e31. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:41617: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 14:55:05.724733  6549 tablet_server.cc:196] TabletServer@127.6.101.66:0 shutdown complete.
W20260709 14:55:05.734038 16661 consensus_peers.cc:597] T c727468585cc4bff8f000e922b7a7d95 P 93374462fb7d40ac80f3d526d4547642 -> Peer f3160b8200a64810983bda11c4af8fff (127.6.101.66:35977): Couldn't send request to peer f3160b8200a64810983bda11c4af8fff. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.66:35977: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 14:55:05.739935 16661 consensus_peers.cc:597] T 544aaafd8b6b427191e89277cb281bd1 P 93374462fb7d40ac80f3d526d4547642 -> Peer f3160b8200a64810983bda11c4af8fff (127.6.101.66:35977): Couldn't send request to peer f3160b8200a64810983bda11c4af8fff. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.66:35977: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 14:55:05.755298 16661 consensus_peers.cc:597] T 213053d1a14c4365a4bccd2d11a2764a P 93374462fb7d40ac80f3d526d4547642 -> Peer f3160b8200a64810983bda11c4af8fff (127.6.101.66:35977): Couldn't send request to peer f3160b8200a64810983bda11c4af8fff. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.66:35977: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 14:55:05.762658  6549 tablet_server.cc:179] TabletServer@127.6.101.67:0 shutting down...
W20260709 14:55:05.770941 16660 consensus_peers.cc:597] T 43486d5085024ad4ab238eb24756ce7b P 93374462fb7d40ac80f3d526d4547642 -> Peer 1cb7a022bda844bfb69fec38131c8e31 (127.6.101.65:41617): Couldn't send request to peer 1cb7a022bda844bfb69fec38131c8e31. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:41617: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 14:55:05.797205  6549 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 14:55:05.798363  6549 tablet_replica.cc:333] T 213053d1a14c4365a4bccd2d11a2764a P 93374462fb7d40ac80f3d526d4547642: stopping tablet replica
I20260709 14:55:05.799510  6549 raft_consensus.cc:2243] T 213053d1a14c4365a4bccd2d11a2764a P 93374462fb7d40ac80f3d526d4547642 [term 2 LEADER]: Raft consensus shutting down.
I20260709 14:55:05.800558  6549 raft_consensus.cc:2272] T 213053d1a14c4365a4bccd2d11a2764a P 93374462fb7d40ac80f3d526d4547642 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:05.803323  6549 tablet_replica.cc:333] T 9a69054eca44462f8f9d0ecadd574a2a P 93374462fb7d40ac80f3d526d4547642: stopping tablet replica
I20260709 14:55:05.804055  6549 raft_consensus.cc:2243] T 9a69054eca44462f8f9d0ecadd574a2a P 93374462fb7d40ac80f3d526d4547642 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 14:55:05.804587  6549 raft_consensus.cc:2272] T 9a69054eca44462f8f9d0ecadd574a2a P 93374462fb7d40ac80f3d526d4547642 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:05.808292  6549 tablet_replica.cc:333] T 93526d1276e74b9382a2fe40d2694853 P 93374462fb7d40ac80f3d526d4547642: stopping tablet replica
I20260709 14:55:05.809435  6549 raft_consensus.cc:2243] T 93526d1276e74b9382a2fe40d2694853 P 93374462fb7d40ac80f3d526d4547642 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 14:55:05.810078  6549 raft_consensus.cc:2272] T 93526d1276e74b9382a2fe40d2694853 P 93374462fb7d40ac80f3d526d4547642 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:05.812680  6549 tablet_replica.cc:333] T c727468585cc4bff8f000e922b7a7d95 P 93374462fb7d40ac80f3d526d4547642: stopping tablet replica
I20260709 14:55:05.813470  6549 raft_consensus.cc:2243] T c727468585cc4bff8f000e922b7a7d95 P 93374462fb7d40ac80f3d526d4547642 [term 3 LEADER]: Raft consensus shutting down.
I20260709 14:55:05.814483  6549 raft_consensus.cc:2272] T c727468585cc4bff8f000e922b7a7d95 P 93374462fb7d40ac80f3d526d4547642 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:05.819013  6549 tablet_replica.cc:333] T 27e19d91f3664b33a47fc21010adb06d P 93374462fb7d40ac80f3d526d4547642: stopping tablet replica
I20260709 14:55:05.819988  6549 raft_consensus.cc:2243] T 27e19d91f3664b33a47fc21010adb06d P 93374462fb7d40ac80f3d526d4547642 [term 3 LEADER]: Raft consensus shutting down.
I20260709 14:55:05.821188  6549 raft_consensus.cc:2272] T 27e19d91f3664b33a47fc21010adb06d P 93374462fb7d40ac80f3d526d4547642 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:05.824501  6549 tablet_replica.cc:333] T e197eb61cbe44c1e99a7a9cc182b7268 P 93374462fb7d40ac80f3d526d4547642: stopping tablet replica
I20260709 14:55:05.825224  6549 raft_consensus.cc:2243] T e197eb61cbe44c1e99a7a9cc182b7268 P 93374462fb7d40ac80f3d526d4547642 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 14:55:05.825917  6549 raft_consensus.cc:2272] T e197eb61cbe44c1e99a7a9cc182b7268 P 93374462fb7d40ac80f3d526d4547642 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:05.828464  6549 tablet_replica.cc:333] T 43486d5085024ad4ab238eb24756ce7b P 93374462fb7d40ac80f3d526d4547642: stopping tablet replica
I20260709 14:55:05.829078  6549 raft_consensus.cc:2243] T 43486d5085024ad4ab238eb24756ce7b P 93374462fb7d40ac80f3d526d4547642 [term 1 LEADER]: Raft consensus shutting down.
I20260709 14:55:05.830185  6549 raft_consensus.cc:2272] T 43486d5085024ad4ab238eb24756ce7b P 93374462fb7d40ac80f3d526d4547642 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:05.833045  6549 tablet_replica.cc:333] T 6492b42adab04eceb2ad67a6f9dca9ed P 93374462fb7d40ac80f3d526d4547642: stopping tablet replica
I20260709 14:55:05.833732  6549 raft_consensus.cc:2243] T 6492b42adab04eceb2ad67a6f9dca9ed P 93374462fb7d40ac80f3d526d4547642 [term 1 LEADER]: Raft consensus shutting down.
I20260709 14:55:05.834774  6549 raft_consensus.cc:2272] T 6492b42adab04eceb2ad67a6f9dca9ed P 93374462fb7d40ac80f3d526d4547642 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:05.837374  6549 tablet_replica.cc:333] T 544aaafd8b6b427191e89277cb281bd1 P 93374462fb7d40ac80f3d526d4547642: stopping tablet replica
I20260709 14:55:05.837996  6549 raft_consensus.cc:2243] T 544aaafd8b6b427191e89277cb281bd1 P 93374462fb7d40ac80f3d526d4547642 [term 2 LEADER]: Raft consensus shutting down.
I20260709 14:55:05.839041  6549 raft_consensus.cc:2272] T 544aaafd8b6b427191e89277cb281bd1 P 93374462fb7d40ac80f3d526d4547642 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:05.841732  6549 tablet_replica.cc:333] T 48f69b6ba5bd492b8470cb9edfa3fc49 P 93374462fb7d40ac80f3d526d4547642: stopping tablet replica
I20260709 14:55:05.842370  6549 raft_consensus.cc:2243] T 48f69b6ba5bd492b8470cb9edfa3fc49 P 93374462fb7d40ac80f3d526d4547642 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 14:55:05.842890  6549 raft_consensus.cc:2272] T 48f69b6ba5bd492b8470cb9edfa3fc49 P 93374462fb7d40ac80f3d526d4547642 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:05.885637  6549 tablet_server.cc:196] TabletServer@127.6.101.67:0 shutdown complete.
I20260709 14:55:05.921478  6549 master.cc:562] Master@127.6.101.126:42521 shutting down...
I20260709 14:55:05.954298  6549 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 589d8c6bb5194c5abbf34b2b5b715fa2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 14:55:05.955021  6549 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 589d8c6bb5194c5abbf34b2b5b715fa2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:05.955355  6549 tablet_replica.cc:333] T 00000000000000000000000000000000 P 589d8c6bb5194c5abbf34b2b5b715fa2: stopping tablet replica
I20260709 14:55:05.979979  6549 master.cc:584] Master@127.6.101.126:42521 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (14177 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 14:55:06.044418  6549 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.6.101.126:34119
I20260709 14:55:06.045792  6549 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 14:55:06.053452 17040 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 14:55:06.053547 17039 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 14:55:06.053714 17042 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 14:55:06.056068  6549 server_base.cc:1061] running on GCE node
I20260709 14:55:06.057164  6549 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 14:55:06.057439  6549 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 14:55:06.057569  6549 hybrid_clock.cc:648] HybridClock initialized: now 1783608906057556 us; error 0 us; skew 500 ppm
I20260709 14:55:06.058075  6549 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 14:55:06.066408  6549 webserver.cc:533] Webserver started at http://127.6.101.126:44961/ using document root <none> and password file <none>
I20260709 14:55:06.066931  6549 fs_manager.cc:362] Metadata directory not provided
I20260709 14:55:06.067098  6549 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 14:55:06.067339  6549 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 14:55:06.068971  6549 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783608571892863-6549-0/minicluster-data/master-0-root/instance:
uuid: "a178518f1dfb4361b78d27fa9e3a531c"
format_stamp: "Formatted at 2026-07-09 14:55:06 on dist-test-slave-lv34"
I20260709 14:55:06.074223  6549 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.000s
I20260709 14:55:06.078778 17047 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 14:55:06.079805  6549 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 14:55:06.080173  6549 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783608571892863-6549-0/minicluster-data/master-0-root
uuid: "a178518f1dfb4361b78d27fa9e3a531c"
format_stamp: "Formatted at 2026-07-09 14:55:06 on dist-test-slave-lv34"
I20260709 14:55:06.080453  6549 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783608571892863-6549-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783608571892863-6549-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783608571892863-6549-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 14:55:06.097223  6549 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 14:55:06.098640  6549 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 14:55:06.149115  6549 rpc_server.cc:307] RPC server started. Bound to: 127.6.101.126:34119
I20260709 14:55:06.149394 17098 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.101.126:34119 every 8 connection(s)
I20260709 14:55:06.154011 17099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:55:06.171278 17099 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a178518f1dfb4361b78d27fa9e3a531c: Bootstrap starting.
I20260709 14:55:06.180155 17099 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a178518f1dfb4361b78d27fa9e3a531c: Neither blocks nor log segments found. Creating new log.
I20260709 14:55:06.186499 17099 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a178518f1dfb4361b78d27fa9e3a531c: No bootstrap required, opened a new log
I20260709 14:55:06.189483 17099 raft_consensus.cc:359] T 00000000000000000000000000000000 P a178518f1dfb4361b78d27fa9e3a531c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a178518f1dfb4361b78d27fa9e3a531c" member_type: VOTER }
I20260709 14:55:06.190016 17099 raft_consensus.cc:385] T 00000000000000000000000000000000 P a178518f1dfb4361b78d27fa9e3a531c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:55:06.190267 17099 raft_consensus.cc:740] T 00000000000000000000000000000000 P a178518f1dfb4361b78d27fa9e3a531c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a178518f1dfb4361b78d27fa9e3a531c, State: Initialized, Role: FOLLOWER
I20260709 14:55:06.190961 17099 consensus_queue.cc:260] T 00000000000000000000000000000000 P a178518f1dfb4361b78d27fa9e3a531c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a178518f1dfb4361b78d27fa9e3a531c" member_type: VOTER }
I20260709 14:55:06.191473 17099 raft_consensus.cc:399] T 00000000000000000000000000000000 P a178518f1dfb4361b78d27fa9e3a531c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 14:55:06.191718 17099 raft_consensus.cc:493] T 00000000000000000000000000000000 P a178518f1dfb4361b78d27fa9e3a531c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 14:55:06.191982 17099 raft_consensus.cc:3060] T 00000000000000000000000000000000 P a178518f1dfb4361b78d27fa9e3a531c [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:55:06.199631 17099 raft_consensus.cc:515] T 00000000000000000000000000000000 P a178518f1dfb4361b78d27fa9e3a531c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a178518f1dfb4361b78d27fa9e3a531c" member_type: VOTER }
I20260709 14:55:06.200670 17099 leader_election.cc:304] T 00000000000000000000000000000000 P a178518f1dfb4361b78d27fa9e3a531c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a178518f1dfb4361b78d27fa9e3a531c; no voters: 
I20260709 14:55:06.202809 17099 leader_election.cc:290] T 00000000000000000000000000000000 P a178518f1dfb4361b78d27fa9e3a531c [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 14:55:06.203440 17102 raft_consensus.cc:2804] T 00000000000000000000000000000000 P a178518f1dfb4361b78d27fa9e3a531c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:55:06.205372 17102 raft_consensus.cc:697] T 00000000000000000000000000000000 P a178518f1dfb4361b78d27fa9e3a531c [term 1 LEADER]: Becoming Leader. State: Replica: a178518f1dfb4361b78d27fa9e3a531c, State: Running, Role: LEADER
I20260709 14:55:06.206418 17102 consensus_queue.cc:237] T 00000000000000000000000000000000 P a178518f1dfb4361b78d27fa9e3a531c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a178518f1dfb4361b78d27fa9e3a531c" member_type: VOTER }
I20260709 14:55:06.206709 17099 sys_catalog.cc:565] T 00000000000000000000000000000000 P a178518f1dfb4361b78d27fa9e3a531c [sys.catalog]: configured and running, proceeding with master startup.
I20260709 14:55:06.213719 17103 sys_catalog.cc:455] T 00000000000000000000000000000000 P a178518f1dfb4361b78d27fa9e3a531c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a178518f1dfb4361b78d27fa9e3a531c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a178518f1dfb4361b78d27fa9e3a531c" member_type: VOTER } }
I20260709 14:55:06.214650 17103 sys_catalog.cc:458] T 00000000000000000000000000000000 P a178518f1dfb4361b78d27fa9e3a531c [sys.catalog]: This master's current role is: LEADER
I20260709 14:55:06.213222 17104 sys_catalog.cc:455] T 00000000000000000000000000000000 P a178518f1dfb4361b78d27fa9e3a531c [sys.catalog]: SysCatalogTable state changed. Reason: New leader a178518f1dfb4361b78d27fa9e3a531c. Latest consensus state: current_term: 1 leader_uuid: "a178518f1dfb4361b78d27fa9e3a531c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a178518f1dfb4361b78d27fa9e3a531c" member_type: VOTER } }
I20260709 14:55:06.215245 17104 sys_catalog.cc:458] T 00000000000000000000000000000000 P a178518f1dfb4361b78d27fa9e3a531c [sys.catalog]: This master's current role is: LEADER
I20260709 14:55:06.217656 17111 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 14:55:06.225437 17111 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 14:55:06.227707  6549 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 14:55:06.237952 17111 catalog_manager.cc:1383] Generated new cluster ID: 52d53531f051437191625b1826ea8bcd
I20260709 14:55:06.238325 17111 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 14:55:06.255755 17111 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 14:55:06.257364 17111 catalog_manager.cc:1540] Loading token signing keys...
I20260709 14:55:06.276947 17111 catalog_manager.cc:6070] T 00000000000000000000000000000000 P a178518f1dfb4361b78d27fa9e3a531c: Generated new TSK 0
I20260709 14:55:06.277807 17111 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 14:55:06.297958  6549 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 14:55:06.305632 17120 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 14:55:06.306632 17121 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 14:55:06.309916  6549 server_base.cc:1061] running on GCE node
W20260709 14:55:06.309916 17123 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 14:55:06.312318  6549 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 14:55:06.312600  6549 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 14:55:06.312786  6549 hybrid_clock.cc:648] HybridClock initialized: now 1783608906312764 us; error 0 us; skew 500 ppm
I20260709 14:55:06.313522  6549 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 14:55:06.316965  6549 webserver.cc:533] Webserver started at http://127.6.101.65:38229/ using document root <none> and password file <none>
I20260709 14:55:06.317636  6549 fs_manager.cc:362] Metadata directory not provided
I20260709 14:55:06.317840  6549 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 14:55:06.318161  6549 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 14:55:06.319832  6549 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783608571892863-6549-0/minicluster-data/ts-0-root/instance:
uuid: "f3142a82d3794dc8aa655722cb1c6c9c"
format_stamp: "Formatted at 2026-07-09 14:55:06 on dist-test-slave-lv34"
I20260709 14:55:06.325790  6549 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.003s	sys 0.005s
I20260709 14:55:06.331444 17128 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 14:55:06.332773  6549 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.004s	sys 0.001s
I20260709 14:55:06.333225  6549 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783608571892863-6549-0/minicluster-data/ts-0-root
uuid: "f3142a82d3794dc8aa655722cb1c6c9c"
format_stamp: "Formatted at 2026-07-09 14:55:06 on dist-test-slave-lv34"
I20260709 14:55:06.333644  6549 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783608571892863-6549-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783608571892863-6549-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783608571892863-6549-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 14:55:06.352599  6549 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 14:55:06.354525  6549 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 14:55:06.356774  6549 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 14:55:06.360059  6549 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 14:55:06.360352  6549 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 14:55:06.360626  6549 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 14:55:06.360801  6549 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 14:55:06.424557  6549 rpc_server.cc:307] RPC server started. Bound to: 127.6.101.65:37781
I20260709 14:55:06.424687 17190 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.101.65:37781 every 8 connection(s)
I20260709 14:55:06.433004  6549 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 14:55:06.444370 17195 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 14:55:06.447749 17196 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 14:55:06.449052 17191 heartbeater.cc:344] Connected to a master server at 127.6.101.126:34119
I20260709 14:55:06.449666 17191 heartbeater.cc:461] Registering TS with master...
W20260709 14:55:06.449770 17198 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 14:55:06.450865 17191 heartbeater.cc:507] Master 127.6.101.126:34119 requested a full tablet report, sending...
I20260709 14:55:06.451443  6549 server_base.cc:1061] running on GCE node
I20260709 14:55:06.452767  6549 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 14:55:06.453076  6549 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 14:55:06.453320  6549 hybrid_clock.cc:648] HybridClock initialized: now 1783608906453295 us; error 0 us; skew 500 ppm
I20260709 14:55:06.454133  6549 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 14:55:06.454028 17064 ts_manager.cc:194] Registered new tserver with Master: f3142a82d3794dc8aa655722cb1c6c9c (127.6.101.65:37781)
I20260709 14:55:06.457341 17064 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35918
I20260709 14:55:06.459944  6549 webserver.cc:533] Webserver started at http://127.6.101.66:34709/ using document root <none> and password file <none>
I20260709 14:55:06.460719  6549 fs_manager.cc:362] Metadata directory not provided
I20260709 14:55:06.460944  6549 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 14:55:06.461282  6549 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 14:55:06.462872  6549 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783608571892863-6549-0/minicluster-data/ts-1-root/instance:
uuid: "45b4211717954927a5f98f36b9e1cec8"
format_stamp: "Formatted at 2026-07-09 14:55:06 on dist-test-slave-lv34"
I20260709 14:55:06.469130  6549 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.007s	sys 0.000s
I20260709 14:55:06.473994 17203 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 14:55:06.475414  6549 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 14:55:06.475832  6549 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783608571892863-6549-0/minicluster-data/ts-1-root
uuid: "45b4211717954927a5f98f36b9e1cec8"
format_stamp: "Formatted at 2026-07-09 14:55:06 on dist-test-slave-lv34"
I20260709 14:55:06.476264  6549 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783608571892863-6549-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783608571892863-6549-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783608571892863-6549-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 14:55:06.495954  6549 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 14:55:06.497577  6549 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 14:55:06.499516  6549 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 14:55:06.502420  6549 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 14:55:06.502676  6549 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 14:55:06.502974  6549 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 14:55:06.503345  6549 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 14:55:06.577405  6549 rpc_server.cc:307] RPC server started. Bound to: 127.6.101.66:35287
I20260709 14:55:06.577538 17265 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.101.66:35287 every 8 connection(s)
I20260709 14:55:06.585182  6549 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 14:55:06.594887 17269 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 14:55:06.596026 17270 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 14:55:06.598970 17272 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 14:55:06.600456  6549 server_base.cc:1061] running on GCE node
I20260709 14:55:06.601886  6549 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 14:55:06.602240  6549 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 14:55:06.602471  6549 hybrid_clock.cc:648] HybridClock initialized: now 1783608906602449 us; error 0 us; skew 500 ppm
I20260709 14:55:06.602993 17266 heartbeater.cc:344] Connected to a master server at 127.6.101.126:34119
I20260709 14:55:06.603497  6549 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 14:55:06.603562 17266 heartbeater.cc:461] Registering TS with master...
I20260709 14:55:06.604835 17266 heartbeater.cc:507] Master 127.6.101.126:34119 requested a full tablet report, sending...
I20260709 14:55:06.607622  6549 webserver.cc:533] Webserver started at http://127.6.101.67:42637/ using document root <none> and password file <none>
I20260709 14:55:06.608162 17064 ts_manager.cc:194] Registered new tserver with Master: 45b4211717954927a5f98f36b9e1cec8 (127.6.101.66:35287)
I20260709 14:55:06.608594  6549 fs_manager.cc:362] Metadata directory not provided
I20260709 14:55:06.608927  6549 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 14:55:06.609515  6549 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 14:55:06.610911 17064 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35928
I20260709 14:55:06.611759  6549 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783608571892863-6549-0/minicluster-data/ts-2-root/instance:
uuid: "7aa582d7751f4019b7c164fcc8c7e165"
format_stamp: "Formatted at 2026-07-09 14:55:06 on dist-test-slave-lv34"
I20260709 14:55:06.619969  6549 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.005s	sys 0.004s
I20260709 14:55:06.627039 17277 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 14:55:06.628646  6549 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.003s	sys 0.002s
I20260709 14:55:06.629318  6549 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783608571892863-6549-0/minicluster-data/ts-2-root
uuid: "7aa582d7751f4019b7c164fcc8c7e165"
format_stamp: "Formatted at 2026-07-09 14:55:06 on dist-test-slave-lv34"
I20260709 14:55:06.629889  6549 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783608571892863-6549-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783608571892863-6549-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783608571892863-6549-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 14:55:06.648284  6549 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 14:55:06.649971  6549 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 14:55:06.655359  6549 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 14:55:06.659317  6549 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 14:55:06.659590  6549 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 14:55:06.659848  6549 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 14:55:06.660036  6549 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 14:55:06.738510  6549 rpc_server.cc:307] RPC server started. Bound to: 127.6.101.67:33747
I20260709 14:55:06.738672 17339 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.101.67:33747 every 8 connection(s)
I20260709 14:55:06.762342 17340 heartbeater.cc:344] Connected to a master server at 127.6.101.126:34119
I20260709 14:55:06.762905 17340 heartbeater.cc:461] Registering TS with master...
I20260709 14:55:06.763769 17340 heartbeater.cc:507] Master 127.6.101.126:34119 requested a full tablet report, sending...
I20260709 14:55:06.767315 17064 ts_manager.cc:194] Registered new tserver with Master: 7aa582d7751f4019b7c164fcc8c7e165 (127.6.101.67:33747)
I20260709 14:55:06.767776  6549 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.024465573s
I20260709 14:55:06.769991 17064 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35940
I20260709 14:55:06.804574 17064 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35954:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 14:55:06.808286 17064 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 14:55:06.876961 17156 tablet_service.cc:1511] Processing CreateTablet for tablet 760ef607ad0b4709a1edbd330537c600 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=16193ae63571466fa6c8db3bddcf95c7]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 14:55:06.875583 17231 tablet_service.cc:1511] Processing CreateTablet for tablet 760ef607ad0b4709a1edbd330537c600 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=16193ae63571466fa6c8db3bddcf95c7]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 14:55:06.877596 17230 tablet_service.cc:1511] Processing CreateTablet for tablet e3e2759d1c29478c81d4fdaf192559bf (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=16193ae63571466fa6c8db3bddcf95c7]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 14:55:06.878880 17156 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 760ef607ad0b4709a1edbd330537c600. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:55:06.881361 17231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 760ef607ad0b4709a1edbd330537c600. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:55:06.882706 17155 tablet_service.cc:1511] Processing CreateTablet for tablet e3e2759d1c29478c81d4fdaf192559bf (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=16193ae63571466fa6c8db3bddcf95c7]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 14:55:06.884274 17155 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3e2759d1c29478c81d4fdaf192559bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:55:06.887738 17230 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3e2759d1c29478c81d4fdaf192559bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:55:06.889228 17305 tablet_service.cc:1511] Processing CreateTablet for tablet 760ef607ad0b4709a1edbd330537c600 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=16193ae63571466fa6c8db3bddcf95c7]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 14:55:06.889668 17304 tablet_service.cc:1511] Processing CreateTablet for tablet e3e2759d1c29478c81d4fdaf192559bf (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=16193ae63571466fa6c8db3bddcf95c7]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 14:55:06.893659 17305 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 760ef607ad0b4709a1edbd330537c600. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:55:06.903061 17304 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3e2759d1c29478c81d4fdaf192559bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:55:06.920311 17358 tablet_bootstrap.cc:492] T 760ef607ad0b4709a1edbd330537c600 P f3142a82d3794dc8aa655722cb1c6c9c: Bootstrap starting.
I20260709 14:55:06.937572 17358 tablet_bootstrap.cc:654] T 760ef607ad0b4709a1edbd330537c600 P f3142a82d3794dc8aa655722cb1c6c9c: Neither blocks nor log segments found. Creating new log.
I20260709 14:55:06.949106 17361 tablet_bootstrap.cc:492] T e3e2759d1c29478c81d4fdaf192559bf P 45b4211717954927a5f98f36b9e1cec8: Bootstrap starting.
I20260709 14:55:06.960084 17359 tablet_bootstrap.cc:492] T 760ef607ad0b4709a1edbd330537c600 P 7aa582d7751f4019b7c164fcc8c7e165: Bootstrap starting.
I20260709 14:55:06.961028 17358 tablet_bootstrap.cc:492] T 760ef607ad0b4709a1edbd330537c600 P f3142a82d3794dc8aa655722cb1c6c9c: No bootstrap required, opened a new log
I20260709 14:55:06.961797 17358 ts_tablet_manager.cc:1403] T 760ef607ad0b4709a1edbd330537c600 P f3142a82d3794dc8aa655722cb1c6c9c: Time spent bootstrapping tablet: real 0.042s	user 0.013s	sys 0.008s
I20260709 14:55:06.965152 17358 raft_consensus.cc:359] T 760ef607ad0b4709a1edbd330537c600 P f3142a82d3794dc8aa655722cb1c6c9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3142a82d3794dc8aa655722cb1c6c9c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 37781 } } peers { permanent_uuid: "45b4211717954927a5f98f36b9e1cec8" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35287 } } peers { permanent_uuid: "7aa582d7751f4019b7c164fcc8c7e165" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33747 } }
I20260709 14:55:06.965932 17358 raft_consensus.cc:385] T 760ef607ad0b4709a1edbd330537c600 P f3142a82d3794dc8aa655722cb1c6c9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:55:06.966048 17361 tablet_bootstrap.cc:654] T e3e2759d1c29478c81d4fdaf192559bf P 45b4211717954927a5f98f36b9e1cec8: Neither blocks nor log segments found. Creating new log.
I20260709 14:55:06.966187 17358 raft_consensus.cc:740] T 760ef607ad0b4709a1edbd330537c600 P f3142a82d3794dc8aa655722cb1c6c9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3142a82d3794dc8aa655722cb1c6c9c, State: Initialized, Role: FOLLOWER
I20260709 14:55:06.967631 17358 consensus_queue.cc:260] T 760ef607ad0b4709a1edbd330537c600 P f3142a82d3794dc8aa655722cb1c6c9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3142a82d3794dc8aa655722cb1c6c9c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 37781 } } peers { permanent_uuid: "45b4211717954927a5f98f36b9e1cec8" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35287 } } peers { permanent_uuid: "7aa582d7751f4019b7c164fcc8c7e165" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33747 } }
I20260709 14:55:06.970196 17359 tablet_bootstrap.cc:654] T 760ef607ad0b4709a1edbd330537c600 P 7aa582d7751f4019b7c164fcc8c7e165: Neither blocks nor log segments found. Creating new log.
I20260709 14:55:06.970356 17191 heartbeater.cc:499] Master 127.6.101.126:34119 was elected leader, sending a full tablet report...
I20260709 14:55:06.971626 17358 ts_tablet_manager.cc:1434] T 760ef607ad0b4709a1edbd330537c600 P f3142a82d3794dc8aa655722cb1c6c9c: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.001s
I20260709 14:55:06.972976 17358 tablet_bootstrap.cc:492] T e3e2759d1c29478c81d4fdaf192559bf P f3142a82d3794dc8aa655722cb1c6c9c: Bootstrap starting.
I20260709 14:55:06.976402 17361 tablet_bootstrap.cc:492] T e3e2759d1c29478c81d4fdaf192559bf P 45b4211717954927a5f98f36b9e1cec8: No bootstrap required, opened a new log
I20260709 14:55:06.977172 17361 ts_tablet_manager.cc:1403] T e3e2759d1c29478c81d4fdaf192559bf P 45b4211717954927a5f98f36b9e1cec8: Time spent bootstrapping tablet: real 0.028s	user 0.012s	sys 0.003s
I20260709 14:55:06.981755 17358 tablet_bootstrap.cc:654] T e3e2759d1c29478c81d4fdaf192559bf P f3142a82d3794dc8aa655722cb1c6c9c: Neither blocks nor log segments found. Creating new log.
I20260709 14:55:06.981140 17361 raft_consensus.cc:359] T e3e2759d1c29478c81d4fdaf192559bf P 45b4211717954927a5f98f36b9e1cec8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3142a82d3794dc8aa655722cb1c6c9c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 37781 } } peers { permanent_uuid: "45b4211717954927a5f98f36b9e1cec8" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35287 } } peers { permanent_uuid: "7aa582d7751f4019b7c164fcc8c7e165" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33747 } }
I20260709 14:55:06.982659 17361 raft_consensus.cc:385] T e3e2759d1c29478c81d4fdaf192559bf P 45b4211717954927a5f98f36b9e1cec8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:55:06.983366 17359 tablet_bootstrap.cc:492] T 760ef607ad0b4709a1edbd330537c600 P 7aa582d7751f4019b7c164fcc8c7e165: No bootstrap required, opened a new log
I20260709 14:55:06.983829 17361 raft_consensus.cc:740] T e3e2759d1c29478c81d4fdaf192559bf P 45b4211717954927a5f98f36b9e1cec8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45b4211717954927a5f98f36b9e1cec8, State: Initialized, Role: FOLLOWER
I20260709 14:55:06.984238 17359 ts_tablet_manager.cc:1403] T 760ef607ad0b4709a1edbd330537c600 P 7aa582d7751f4019b7c164fcc8c7e165: Time spent bootstrapping tablet: real 0.025s	user 0.018s	sys 0.005s
I20260709 14:55:06.988020 17359 raft_consensus.cc:359] T 760ef607ad0b4709a1edbd330537c600 P 7aa582d7751f4019b7c164fcc8c7e165 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3142a82d3794dc8aa655722cb1c6c9c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 37781 } } peers { permanent_uuid: "45b4211717954927a5f98f36b9e1cec8" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35287 } } peers { permanent_uuid: "7aa582d7751f4019b7c164fcc8c7e165" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33747 } }
I20260709 14:55:06.989149 17359 raft_consensus.cc:385] T 760ef607ad0b4709a1edbd330537c600 P 7aa582d7751f4019b7c164fcc8c7e165 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:55:06.988971 17361 consensus_queue.cc:260] T e3e2759d1c29478c81d4fdaf192559bf P 45b4211717954927a5f98f36b9e1cec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3142a82d3794dc8aa655722cb1c6c9c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 37781 } } peers { permanent_uuid: "45b4211717954927a5f98f36b9e1cec8" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35287 } } peers { permanent_uuid: "7aa582d7751f4019b7c164fcc8c7e165" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33747 } }
I20260709 14:55:06.989946 17359 raft_consensus.cc:740] T 760ef607ad0b4709a1edbd330537c600 P 7aa582d7751f4019b7c164fcc8c7e165 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7aa582d7751f4019b7c164fcc8c7e165, State: Initialized, Role: FOLLOWER
I20260709 14:55:06.991045 17359 consensus_queue.cc:260] T 760ef607ad0b4709a1edbd330537c600 P 7aa582d7751f4019b7c164fcc8c7e165 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3142a82d3794dc8aa655722cb1c6c9c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 37781 } } peers { permanent_uuid: "45b4211717954927a5f98f36b9e1cec8" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35287 } } peers { permanent_uuid: "7aa582d7751f4019b7c164fcc8c7e165" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33747 } }
I20260709 14:55:06.993391 17358 tablet_bootstrap.cc:492] T e3e2759d1c29478c81d4fdaf192559bf P f3142a82d3794dc8aa655722cb1c6c9c: No bootstrap required, opened a new log
I20260709 14:55:06.994452 17358 ts_tablet_manager.cc:1403] T e3e2759d1c29478c81d4fdaf192559bf P f3142a82d3794dc8aa655722cb1c6c9c: Time spent bootstrapping tablet: real 0.022s	user 0.018s	sys 0.000s
I20260709 14:55:06.998912 17358 raft_consensus.cc:359] T e3e2759d1c29478c81d4fdaf192559bf P f3142a82d3794dc8aa655722cb1c6c9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3142a82d3794dc8aa655722cb1c6c9c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 37781 } } peers { permanent_uuid: "45b4211717954927a5f98f36b9e1cec8" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35287 } } peers { permanent_uuid: "7aa582d7751f4019b7c164fcc8c7e165" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33747 } }
I20260709 14:55:06.999905 17358 raft_consensus.cc:385] T e3e2759d1c29478c81d4fdaf192559bf P f3142a82d3794dc8aa655722cb1c6c9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:55:07.000226 17358 raft_consensus.cc:740] T e3e2759d1c29478c81d4fdaf192559bf P f3142a82d3794dc8aa655722cb1c6c9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3142a82d3794dc8aa655722cb1c6c9c, State: Initialized, Role: FOLLOWER
I20260709 14:55:07.000998 17358 consensus_queue.cc:260] T e3e2759d1c29478c81d4fdaf192559bf P f3142a82d3794dc8aa655722cb1c6c9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3142a82d3794dc8aa655722cb1c6c9c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 37781 } } peers { permanent_uuid: "45b4211717954927a5f98f36b9e1cec8" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35287 } } peers { permanent_uuid: "7aa582d7751f4019b7c164fcc8c7e165" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33747 } }
I20260709 14:55:07.003298 17266 heartbeater.cc:499] Master 127.6.101.126:34119 was elected leader, sending a full tablet report...
I20260709 14:55:07.003758 17340 heartbeater.cc:499] Master 127.6.101.126:34119 was elected leader, sending a full tablet report...
I20260709 14:55:07.003996 17358 ts_tablet_manager.cc:1434] T e3e2759d1c29478c81d4fdaf192559bf P f3142a82d3794dc8aa655722cb1c6c9c: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 14:55:07.003322 17359 ts_tablet_manager.cc:1434] T 760ef607ad0b4709a1edbd330537c600 P 7aa582d7751f4019b7c164fcc8c7e165: Time spent starting tablet: real 0.019s	user 0.002s	sys 0.013s
I20260709 14:55:07.007652 17361 ts_tablet_manager.cc:1434] T e3e2759d1c29478c81d4fdaf192559bf P 45b4211717954927a5f98f36b9e1cec8: Time spent starting tablet: real 0.030s	user 0.008s	sys 0.014s
I20260709 14:55:07.007910 17359 tablet_bootstrap.cc:492] T e3e2759d1c29478c81d4fdaf192559bf P 7aa582d7751f4019b7c164fcc8c7e165: Bootstrap starting.
I20260709 14:55:07.009330 17361 tablet_bootstrap.cc:492] T 760ef607ad0b4709a1edbd330537c600 P 45b4211717954927a5f98f36b9e1cec8: Bootstrap starting.
I20260709 14:55:07.017130 17359 tablet_bootstrap.cc:654] T e3e2759d1c29478c81d4fdaf192559bf P 7aa582d7751f4019b7c164fcc8c7e165: Neither blocks nor log segments found. Creating new log.
I20260709 14:55:07.017942 17361 tablet_bootstrap.cc:654] T 760ef607ad0b4709a1edbd330537c600 P 45b4211717954927a5f98f36b9e1cec8: Neither blocks nor log segments found. Creating new log.
I20260709 14:55:07.029485 17361 tablet_bootstrap.cc:492] T 760ef607ad0b4709a1edbd330537c600 P 45b4211717954927a5f98f36b9e1cec8: No bootstrap required, opened a new log
I20260709 14:55:07.030242 17361 ts_tablet_manager.cc:1403] T 760ef607ad0b4709a1edbd330537c600 P 45b4211717954927a5f98f36b9e1cec8: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.007s
I20260709 14:55:07.034192 17361 raft_consensus.cc:359] T 760ef607ad0b4709a1edbd330537c600 P 45b4211717954927a5f98f36b9e1cec8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3142a82d3794dc8aa655722cb1c6c9c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 37781 } } peers { permanent_uuid: "45b4211717954927a5f98f36b9e1cec8" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35287 } } peers { permanent_uuid: "7aa582d7751f4019b7c164fcc8c7e165" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33747 } }
I20260709 14:55:07.034808 17361 raft_consensus.cc:385] T 760ef607ad0b4709a1edbd330537c600 P 45b4211717954927a5f98f36b9e1cec8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:55:07.034873 17359 tablet_bootstrap.cc:492] T e3e2759d1c29478c81d4fdaf192559bf P 7aa582d7751f4019b7c164fcc8c7e165: No bootstrap required, opened a new log
I20260709 14:55:07.035122 17361 raft_consensus.cc:740] T 760ef607ad0b4709a1edbd330537c600 P 45b4211717954927a5f98f36b9e1cec8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45b4211717954927a5f98f36b9e1cec8, State: Initialized, Role: FOLLOWER
I20260709 14:55:07.035642 17359 ts_tablet_manager.cc:1403] T e3e2759d1c29478c81d4fdaf192559bf P 7aa582d7751f4019b7c164fcc8c7e165: Time spent bootstrapping tablet: real 0.028s	user 0.018s	sys 0.005s
I20260709 14:55:07.036058 17361 consensus_queue.cc:260] T 760ef607ad0b4709a1edbd330537c600 P 45b4211717954927a5f98f36b9e1cec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3142a82d3794dc8aa655722cb1c6c9c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 37781 } } peers { permanent_uuid: "45b4211717954927a5f98f36b9e1cec8" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35287 } } peers { permanent_uuid: "7aa582d7751f4019b7c164fcc8c7e165" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33747 } }
I20260709 14:55:07.038897 17361 ts_tablet_manager.cc:1434] T 760ef607ad0b4709a1edbd330537c600 P 45b4211717954927a5f98f36b9e1cec8: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 14:55:07.038822 17359 raft_consensus.cc:359] T e3e2759d1c29478c81d4fdaf192559bf P 7aa582d7751f4019b7c164fcc8c7e165 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3142a82d3794dc8aa655722cb1c6c9c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 37781 } } peers { permanent_uuid: "45b4211717954927a5f98f36b9e1cec8" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35287 } } peers { permanent_uuid: "7aa582d7751f4019b7c164fcc8c7e165" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33747 } }
I20260709 14:55:07.039808 17359 raft_consensus.cc:385] T e3e2759d1c29478c81d4fdaf192559bf P 7aa582d7751f4019b7c164fcc8c7e165 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:55:07.040122 17359 raft_consensus.cc:740] T e3e2759d1c29478c81d4fdaf192559bf P 7aa582d7751f4019b7c164fcc8c7e165 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7aa582d7751f4019b7c164fcc8c7e165, State: Initialized, Role: FOLLOWER
I20260709 14:55:07.040998 17359 consensus_queue.cc:260] T e3e2759d1c29478c81d4fdaf192559bf P 7aa582d7751f4019b7c164fcc8c7e165 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3142a82d3794dc8aa655722cb1c6c9c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 37781 } } peers { permanent_uuid: "45b4211717954927a5f98f36b9e1cec8" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35287 } } peers { permanent_uuid: "7aa582d7751f4019b7c164fcc8c7e165" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33747 } }
I20260709 14:55:07.044317 17359 ts_tablet_manager.cc:1434] T e3e2759d1c29478c81d4fdaf192559bf P 7aa582d7751f4019b7c164fcc8c7e165: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.003s
I20260709 14:55:07.104698 17367 raft_consensus.cc:493] T 760ef607ad0b4709a1edbd330537c600 P 7aa582d7751f4019b7c164fcc8c7e165 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:55:07.105494 17367 raft_consensus.cc:515] T 760ef607ad0b4709a1edbd330537c600 P 7aa582d7751f4019b7c164fcc8c7e165 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3142a82d3794dc8aa655722cb1c6c9c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 37781 } } peers { permanent_uuid: "45b4211717954927a5f98f36b9e1cec8" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35287 } } peers { permanent_uuid: "7aa582d7751f4019b7c164fcc8c7e165" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33747 } }
I20260709 14:55:07.108078 17367 leader_election.cc:290] T 760ef607ad0b4709a1edbd330537c600 P 7aa582d7751f4019b7c164fcc8c7e165 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3142a82d3794dc8aa655722cb1c6c9c (127.6.101.65:37781), 45b4211717954927a5f98f36b9e1cec8 (127.6.101.66:35287)
I20260709 14:55:07.121327 17166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "760ef607ad0b4709a1edbd330537c600" candidate_uuid: "7aa582d7751f4019b7c164fcc8c7e165" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3142a82d3794dc8aa655722cb1c6c9c" is_pre_election: true
I20260709 14:55:07.122385 17166 raft_consensus.cc:2468] T 760ef607ad0b4709a1edbd330537c600 P f3142a82d3794dc8aa655722cb1c6c9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7aa582d7751f4019b7c164fcc8c7e165 in term 0.
I20260709 14:55:07.123236 17241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "760ef607ad0b4709a1edbd330537c600" candidate_uuid: "7aa582d7751f4019b7c164fcc8c7e165" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45b4211717954927a5f98f36b9e1cec8" is_pre_election: true
I20260709 14:55:07.124155 17278 leader_election.cc:304] T 760ef607ad0b4709a1edbd330537c600 P 7aa582d7751f4019b7c164fcc8c7e165 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7aa582d7751f4019b7c164fcc8c7e165, f3142a82d3794dc8aa655722cb1c6c9c; no voters: 
I20260709 14:55:07.124229 17241 raft_consensus.cc:2468] T 760ef607ad0b4709a1edbd330537c600 P 45b4211717954927a5f98f36b9e1cec8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7aa582d7751f4019b7c164fcc8c7e165 in term 0.
I20260709 14:55:07.125213 17367 raft_consensus.cc:2804] T 760ef607ad0b4709a1edbd330537c600 P 7aa582d7751f4019b7c164fcc8c7e165 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:55:07.125636 17367 raft_consensus.cc:493] T 760ef607ad0b4709a1edbd330537c600 P 7aa582d7751f4019b7c164fcc8c7e165 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:55:07.126000 17367 raft_consensus.cc:3060] T 760ef607ad0b4709a1edbd330537c600 P 7aa582d7751f4019b7c164fcc8c7e165 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:55:07.134912 17367 raft_consensus.cc:515] T 760ef607ad0b4709a1edbd330537c600 P 7aa582d7751f4019b7c164fcc8c7e165 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3142a82d3794dc8aa655722cb1c6c9c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 37781 } } peers { permanent_uuid: "45b4211717954927a5f98f36b9e1cec8" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35287 } } peers { permanent_uuid: "7aa582d7751f4019b7c164fcc8c7e165" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33747 } }
I20260709 14:55:07.137318 17371 raft_consensus.cc:493] T e3e2759d1c29478c81d4fdaf192559bf P 7aa582d7751f4019b7c164fcc8c7e165 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:55:07.137316 17367 leader_election.cc:290] T 760ef607ad0b4709a1edbd330537c600 P 7aa582d7751f4019b7c164fcc8c7e165 [CANDIDATE]: Term 1 election: Requested vote from peers f3142a82d3794dc8aa655722cb1c6c9c (127.6.101.65:37781), 45b4211717954927a5f98f36b9e1cec8 (127.6.101.66:35287)
I20260709 14:55:07.137998 17371 raft_consensus.cc:515] T e3e2759d1c29478c81d4fdaf192559bf P 7aa582d7751f4019b7c164fcc8c7e165 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3142a82d3794dc8aa655722cb1c6c9c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 37781 } } peers { permanent_uuid: "45b4211717954927a5f98f36b9e1cec8" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35287 } } peers { permanent_uuid: "7aa582d7751f4019b7c164fcc8c7e165" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33747 } }
I20260709 14:55:07.138489 17166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "760ef607ad0b4709a1edbd330537c600" candidate_uuid: "7aa582d7751f4019b7c164fcc8c7e165" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3142a82d3794dc8aa655722cb1c6c9c"
I20260709 14:55:07.138612 17241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "760ef607ad0b4709a1edbd330537c600" candidate_uuid: "7aa582d7751f4019b7c164fcc8c7e165" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45b4211717954927a5f98f36b9e1cec8"
I20260709 14:55:07.139441 17166 raft_consensus.cc:3060] T 760ef607ad0b4709a1edbd330537c600 P f3142a82d3794dc8aa655722cb1c6c9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:55:07.139539 17241 raft_consensus.cc:3060] T 760ef607ad0b4709a1edbd330537c600 P 45b4211717954927a5f98f36b9e1cec8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:55:07.140563 17371 leader_election.cc:290] T e3e2759d1c29478c81d4fdaf192559bf P 7aa582d7751f4019b7c164fcc8c7e165 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3142a82d3794dc8aa655722cb1c6c9c (127.6.101.65:37781), 45b4211717954927a5f98f36b9e1cec8 (127.6.101.66:35287)
I20260709 14:55:07.141988 17165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e2759d1c29478c81d4fdaf192559bf" candidate_uuid: "7aa582d7751f4019b7c164fcc8c7e165" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3142a82d3794dc8aa655722cb1c6c9c" is_pre_election: true
I20260709 14:55:07.142786 17165 raft_consensus.cc:2468] T e3e2759d1c29478c81d4fdaf192559bf P f3142a82d3794dc8aa655722cb1c6c9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7aa582d7751f4019b7c164fcc8c7e165 in term 0.
I20260709 14:55:07.142964 17240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e2759d1c29478c81d4fdaf192559bf" candidate_uuid: "7aa582d7751f4019b7c164fcc8c7e165" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45b4211717954927a5f98f36b9e1cec8" is_pre_election: true
I20260709 14:55:07.143893 17240 raft_consensus.cc:2468] T e3e2759d1c29478c81d4fdaf192559bf P 45b4211717954927a5f98f36b9e1cec8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7aa582d7751f4019b7c164fcc8c7e165 in term 0.
I20260709 14:55:07.144351 17278 leader_election.cc:304] T e3e2759d1c29478c81d4fdaf192559bf P 7aa582d7751f4019b7c164fcc8c7e165 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7aa582d7751f4019b7c164fcc8c7e165, f3142a82d3794dc8aa655722cb1c6c9c; no voters: 
I20260709 14:55:07.145790 17371 raft_consensus.cc:2804] T e3e2759d1c29478c81d4fdaf192559bf P 7aa582d7751f4019b7c164fcc8c7e165 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:55:07.146250 17371 raft_consensus.cc:493] T e3e2759d1c29478c81d4fdaf192559bf P 7aa582d7751f4019b7c164fcc8c7e165 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:55:07.146591 17371 raft_consensus.cc:3060] T e3e2759d1c29478c81d4fdaf192559bf P 7aa582d7751f4019b7c164fcc8c7e165 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:55:07.149187 17166 raft_consensus.cc:2468] T 760ef607ad0b4709a1edbd330537c600 P f3142a82d3794dc8aa655722cb1c6c9c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7aa582d7751f4019b7c164fcc8c7e165 in term 1.
I20260709 14:55:07.151039 17278 leader_election.cc:304] T 760ef607ad0b4709a1edbd330537c600 P 7aa582d7751f4019b7c164fcc8c7e165 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7aa582d7751f4019b7c164fcc8c7e165, f3142a82d3794dc8aa655722cb1c6c9c; no voters: 
I20260709 14:55:07.151280 17241 raft_consensus.cc:2468] T 760ef607ad0b4709a1edbd330537c600 P 45b4211717954927a5f98f36b9e1cec8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7aa582d7751f4019b7c164fcc8c7e165 in term 1.
I20260709 14:55:07.152171 17367 raft_consensus.cc:2804] T 760ef607ad0b4709a1edbd330537c600 P 7aa582d7751f4019b7c164fcc8c7e165 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:55:07.153782 17367 raft_consensus.cc:697] T 760ef607ad0b4709a1edbd330537c600 P 7aa582d7751f4019b7c164fcc8c7e165 [term 1 LEADER]: Becoming Leader. State: Replica: 7aa582d7751f4019b7c164fcc8c7e165, State: Running, Role: LEADER
I20260709 14:55:07.154652 17367 consensus_queue.cc:237] T 760ef607ad0b4709a1edbd330537c600 P 7aa582d7751f4019b7c164fcc8c7e165 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3142a82d3794dc8aa655722cb1c6c9c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 37781 } } peers { permanent_uuid: "45b4211717954927a5f98f36b9e1cec8" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35287 } } peers { permanent_uuid: "7aa582d7751f4019b7c164fcc8c7e165" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33747 } }
I20260709 14:55:07.155933 17371 raft_consensus.cc:515] T e3e2759d1c29478c81d4fdaf192559bf P 7aa582d7751f4019b7c164fcc8c7e165 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3142a82d3794dc8aa655722cb1c6c9c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 37781 } } peers { permanent_uuid: "45b4211717954927a5f98f36b9e1cec8" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35287 } } peers { permanent_uuid: "7aa582d7751f4019b7c164fcc8c7e165" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33747 } }
I20260709 14:55:07.158417 17371 leader_election.cc:290] T e3e2759d1c29478c81d4fdaf192559bf P 7aa582d7751f4019b7c164fcc8c7e165 [CANDIDATE]: Term 1 election: Requested vote from peers f3142a82d3794dc8aa655722cb1c6c9c (127.6.101.65:37781), 45b4211717954927a5f98f36b9e1cec8 (127.6.101.66:35287)
I20260709 14:55:07.159489 17166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e2759d1c29478c81d4fdaf192559bf" candidate_uuid: "7aa582d7751f4019b7c164fcc8c7e165" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3142a82d3794dc8aa655722cb1c6c9c"
I20260709 14:55:07.160633 17166 raft_consensus.cc:3060] T e3e2759d1c29478c81d4fdaf192559bf P f3142a82d3794dc8aa655722cb1c6c9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:55:07.161444 17241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e2759d1c29478c81d4fdaf192559bf" candidate_uuid: "7aa582d7751f4019b7c164fcc8c7e165" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45b4211717954927a5f98f36b9e1cec8"
I20260709 14:55:07.162396 17241 raft_consensus.cc:3060] T e3e2759d1c29478c81d4fdaf192559bf P 45b4211717954927a5f98f36b9e1cec8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:55:07.170423 17166 raft_consensus.cc:2468] T e3e2759d1c29478c81d4fdaf192559bf P f3142a82d3794dc8aa655722cb1c6c9c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7aa582d7751f4019b7c164fcc8c7e165 in term 1.
I20260709 14:55:07.170469 17064 catalog_manager.cc:5697] T 760ef607ad0b4709a1edbd330537c600 P 7aa582d7751f4019b7c164fcc8c7e165 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7aa582d7751f4019b7c164fcc8c7e165 (127.6.101.67). New cstate: current_term: 1 leader_uuid: "7aa582d7751f4019b7c164fcc8c7e165" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3142a82d3794dc8aa655722cb1c6c9c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 37781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45b4211717954927a5f98f36b9e1cec8" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7aa582d7751f4019b7c164fcc8c7e165" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33747 } health_report { overall_health: HEALTHY } } }
I20260709 14:55:07.171566 17241 raft_consensus.cc:2468] T e3e2759d1c29478c81d4fdaf192559bf P 45b4211717954927a5f98f36b9e1cec8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7aa582d7751f4019b7c164fcc8c7e165 in term 1.
I20260709 14:55:07.171780 17278 leader_election.cc:304] T e3e2759d1c29478c81d4fdaf192559bf P 7aa582d7751f4019b7c164fcc8c7e165 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7aa582d7751f4019b7c164fcc8c7e165, f3142a82d3794dc8aa655722cb1c6c9c; no voters: 
I20260709 14:55:07.172946 17367 raft_consensus.cc:2804] T e3e2759d1c29478c81d4fdaf192559bf P 7aa582d7751f4019b7c164fcc8c7e165 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:55:07.173774 17367 raft_consensus.cc:697] T e3e2759d1c29478c81d4fdaf192559bf P 7aa582d7751f4019b7c164fcc8c7e165 [term 1 LEADER]: Becoming Leader. State: Replica: 7aa582d7751f4019b7c164fcc8c7e165, State: Running, Role: LEADER
I20260709 14:55:07.174775 17367 consensus_queue.cc:237] T e3e2759d1c29478c81d4fdaf192559bf P 7aa582d7751f4019b7c164fcc8c7e165 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3142a82d3794dc8aa655722cb1c6c9c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 37781 } } peers { permanent_uuid: "45b4211717954927a5f98f36b9e1cec8" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35287 } } peers { permanent_uuid: "7aa582d7751f4019b7c164fcc8c7e165" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33747 } }
I20260709 14:55:07.187213 17064 catalog_manager.cc:5697] T e3e2759d1c29478c81d4fdaf192559bf P 7aa582d7751f4019b7c164fcc8c7e165 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7aa582d7751f4019b7c164fcc8c7e165 (127.6.101.67). New cstate: current_term: 1 leader_uuid: "7aa582d7751f4019b7c164fcc8c7e165" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3142a82d3794dc8aa655722cb1c6c9c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 37781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45b4211717954927a5f98f36b9e1cec8" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7aa582d7751f4019b7c164fcc8c7e165" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33747 } health_report { overall_health: HEALTHY } } }
I20260709 14:55:07.294374 17064 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35960:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 14:55:07.296355 17064 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 14:55:07.326639 17155 tablet_service.cc:1511] Processing CreateTablet for tablet ec8a0493e0304bb69aa91999d7d7f660 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=37047247f3044df089e5df34f29c41b2]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 14:55:07.328163 17155 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec8a0493e0304bb69aa91999d7d7f660. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:55:07.327848 17231 tablet_service.cc:1511] Processing CreateTablet for tablet ec8a0493e0304bb69aa91999d7d7f660 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=37047247f3044df089e5df34f29c41b2]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 14:55:07.329588 17231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec8a0493e0304bb69aa91999d7d7f660. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:55:07.330693 17305 tablet_service.cc:1511] Processing CreateTablet for tablet ec8a0493e0304bb69aa91999d7d7f660 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=37047247f3044df089e5df34f29c41b2]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 14:55:07.332213 17305 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec8a0493e0304bb69aa91999d7d7f660. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:55:07.338420 17156 tablet_service.cc:1511] Processing CreateTablet for tablet 7f2f04eff4224b908232b77ec2722983 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=37047247f3044df089e5df34f29c41b2]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 14:55:07.339390 17230 tablet_service.cc:1511] Processing CreateTablet for tablet 7f2f04eff4224b908232b77ec2722983 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=37047247f3044df089e5df34f29c41b2]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 14:55:07.340072 17156 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f2f04eff4224b908232b77ec2722983. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:55:07.341210 17230 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f2f04eff4224b908232b77ec2722983. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:55:07.345680 17304 tablet_service.cc:1511] Processing CreateTablet for tablet 7f2f04eff4224b908232b77ec2722983 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=37047247f3044df089e5df34f29c41b2]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 14:55:07.347388 17304 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f2f04eff4224b908232b77ec2722983. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:55:07.352643 17361 tablet_bootstrap.cc:492] T ec8a0493e0304bb69aa91999d7d7f660 P 45b4211717954927a5f98f36b9e1cec8: Bootstrap starting.
I20260709 14:55:07.360984 17358 tablet_bootstrap.cc:492] T 7f2f04eff4224b908232b77ec2722983 P f3142a82d3794dc8aa655722cb1c6c9c: Bootstrap starting.
I20260709 14:55:07.361157 17361 tablet_bootstrap.cc:654] T ec8a0493e0304bb69aa91999d7d7f660 P 45b4211717954927a5f98f36b9e1cec8: Neither blocks nor log segments found. Creating new log.
I20260709 14:55:07.372339 17359 tablet_bootstrap.cc:492] T ec8a0493e0304bb69aa91999d7d7f660 P 7aa582d7751f4019b7c164fcc8c7e165: Bootstrap starting.
I20260709 14:55:07.372565 17358 tablet_bootstrap.cc:654] T 7f2f04eff4224b908232b77ec2722983 P f3142a82d3794dc8aa655722cb1c6c9c: Neither blocks nor log segments found. Creating new log.
I20260709 14:55:07.381229 17359 tablet_bootstrap.cc:654] T ec8a0493e0304bb69aa91999d7d7f660 P 7aa582d7751f4019b7c164fcc8c7e165: Neither blocks nor log segments found. Creating new log.
I20260709 14:55:07.392359 17361 tablet_bootstrap.cc:492] T ec8a0493e0304bb69aa91999d7d7f660 P 45b4211717954927a5f98f36b9e1cec8: No bootstrap required, opened a new log
I20260709 14:55:07.392784 17358 tablet_bootstrap.cc:492] T 7f2f04eff4224b908232b77ec2722983 P f3142a82d3794dc8aa655722cb1c6c9c: No bootstrap required, opened a new log
I20260709 14:55:07.393203 17361 ts_tablet_manager.cc:1403] T ec8a0493e0304bb69aa91999d7d7f660 P 45b4211717954927a5f98f36b9e1cec8: Time spent bootstrapping tablet: real 0.041s	user 0.013s	sys 0.001s
I20260709 14:55:07.393585 17358 ts_tablet_manager.cc:1403] T 7f2f04eff4224b908232b77ec2722983 P f3142a82d3794dc8aa655722cb1c6c9c: Time spent bootstrapping tablet: real 0.033s	user 0.013s	sys 0.015s
I20260709 14:55:07.394588 17359 tablet_bootstrap.cc:492] T ec8a0493e0304bb69aa91999d7d7f660 P 7aa582d7751f4019b7c164fcc8c7e165: No bootstrap required, opened a new log
I20260709 14:55:07.395239 17359 ts_tablet_manager.cc:1403] T ec8a0493e0304bb69aa91999d7d7f660 P 7aa582d7751f4019b7c164fcc8c7e165: Time spent bootstrapping tablet: real 0.023s	user 0.008s	sys 0.008s
I20260709 14:55:07.397125 17358 raft_consensus.cc:359] T 7f2f04eff4224b908232b77ec2722983 P f3142a82d3794dc8aa655722cb1c6c9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3142a82d3794dc8aa655722cb1c6c9c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 37781 } } peers { permanent_uuid: "45b4211717954927a5f98f36b9e1cec8" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35287 } } peers { permanent_uuid: "7aa582d7751f4019b7c164fcc8c7e165" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33747 } }
I20260709 14:55:07.398047 17358 raft_consensus.cc:385] T 7f2f04eff4224b908232b77ec2722983 P f3142a82d3794dc8aa655722cb1c6c9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:55:07.398391 17358 raft_consensus.cc:740] T 7f2f04eff4224b908232b77ec2722983 P f3142a82d3794dc8aa655722cb1c6c9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3142a82d3794dc8aa655722cb1c6c9c, State: Initialized, Role: FOLLOWER
I20260709 14:55:07.398756 17359 raft_consensus.cc:359] T ec8a0493e0304bb69aa91999d7d7f660 P 7aa582d7751f4019b7c164fcc8c7e165 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3142a82d3794dc8aa655722cb1c6c9c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 37781 } } peers { permanent_uuid: "45b4211717954927a5f98f36b9e1cec8" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35287 } } peers { permanent_uuid: "7aa582d7751f4019b7c164fcc8c7e165" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33747 } }
I20260709 14:55:07.399736 17359 raft_consensus.cc:385] T ec8a0493e0304bb69aa91999d7d7f660 P 7aa582d7751f4019b7c164fcc8c7e165 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:55:07.399370 17358 consensus_queue.cc:260] T 7f2f04eff4224b908232b77ec2722983 P f3142a82d3794dc8aa655722cb1c6c9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3142a82d3794dc8aa655722cb1c6c9c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 37781 } } peers { permanent_uuid: "45b4211717954927a5f98f36b9e1cec8" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35287 } } peers { permanent_uuid: "7aa582d7751f4019b7c164fcc8c7e165" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33747 } }
I20260709 14:55:07.400095 17359 raft_consensus.cc:740] T ec8a0493e0304bb69aa91999d7d7f660 P 7aa582d7751f4019b7c164fcc8c7e165 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7aa582d7751f4019b7c164fcc8c7e165, State: Initialized, Role: FOLLOWER
I20260709 14:55:07.401114 17359 consensus_queue.cc:260] T ec8a0493e0304bb69aa91999d7d7f660 P 7aa582d7751f4019b7c164fcc8c7e165 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3142a82d3794dc8aa655722cb1c6c9c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 37781 } } peers { permanent_uuid: "45b4211717954927a5f98f36b9e1cec8" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35287 } } peers { permanent_uuid: "7aa582d7751f4019b7c164fcc8c7e165" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33747 } }
I20260709 14:55:07.401818 17361 raft_consensus.cc:359] T ec8a0493e0304bb69aa91999d7d7f660 P 45b4211717954927a5f98f36b9e1cec8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3142a82d3794dc8aa655722cb1c6c9c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 37781 } } peers { permanent_uuid: "45b4211717954927a5f98f36b9e1cec8" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35287 } } peers { permanent_uuid: "7aa582d7751f4019b7c164fcc8c7e165" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33747 } }
I20260709 14:55:07.402815 17361 raft_consensus.cc:385] T ec8a0493e0304bb69aa91999d7d7f660 P 45b4211717954927a5f98f36b9e1cec8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:55:07.403180 17361 raft_consensus.cc:740] T ec8a0493e0304bb69aa91999d7d7f660 P 45b4211717954927a5f98f36b9e1cec8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45b4211717954927a5f98f36b9e1cec8, State: Initialized, Role: FOLLOWER
I20260709 14:55:07.403781 17359 ts_tablet_manager.cc:1434] T ec8a0493e0304bb69aa91999d7d7f660 P 7aa582d7751f4019b7c164fcc8c7e165: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 14:55:07.404379 17361 consensus_queue.cc:260] T ec8a0493e0304bb69aa91999d7d7f660 P 45b4211717954927a5f98f36b9e1cec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3142a82d3794dc8aa655722cb1c6c9c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 37781 } } peers { permanent_uuid: "45b4211717954927a5f98f36b9e1cec8" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35287 } } peers { permanent_uuid: "7aa582d7751f4019b7c164fcc8c7e165" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33747 } }
I20260709 14:55:07.405143 17359 tablet_bootstrap.cc:492] T 7f2f04eff4224b908232b77ec2722983 P 7aa582d7751f4019b7c164fcc8c7e165: Bootstrap starting.
I20260709 14:55:07.407120 17361 ts_tablet_manager.cc:1434] T ec8a0493e0304bb69aa91999d7d7f660 P 45b4211717954927a5f98f36b9e1cec8: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 14:55:07.408788 17361 tablet_bootstrap.cc:492] T 7f2f04eff4224b908232b77ec2722983 P 45b4211717954927a5f98f36b9e1cec8: Bootstrap starting.
I20260709 14:55:07.408967 17358 ts_tablet_manager.cc:1434] T 7f2f04eff4224b908232b77ec2722983 P f3142a82d3794dc8aa655722cb1c6c9c: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.004s
I20260709 14:55:07.410410 17358 tablet_bootstrap.cc:492] T ec8a0493e0304bb69aa91999d7d7f660 P f3142a82d3794dc8aa655722cb1c6c9c: Bootstrap starting.
I20260709 14:55:07.417807 17358 tablet_bootstrap.cc:654] T ec8a0493e0304bb69aa91999d7d7f660 P f3142a82d3794dc8aa655722cb1c6c9c: Neither blocks nor log segments found. Creating new log.
I20260709 14:55:07.419482 17359 tablet_bootstrap.cc:654] T 7f2f04eff4224b908232b77ec2722983 P 7aa582d7751f4019b7c164fcc8c7e165: Neither blocks nor log segments found. Creating new log.
I20260709 14:55:07.419482 17361 tablet_bootstrap.cc:654] T 7f2f04eff4224b908232b77ec2722983 P 45b4211717954927a5f98f36b9e1cec8: Neither blocks nor log segments found. Creating new log.
I20260709 14:55:07.434572 17361 tablet_bootstrap.cc:492] T 7f2f04eff4224b908232b77ec2722983 P 45b4211717954927a5f98f36b9e1cec8: No bootstrap required, opened a new log
I20260709 14:55:07.435359 17361 ts_tablet_manager.cc:1403] T 7f2f04eff4224b908232b77ec2722983 P 45b4211717954927a5f98f36b9e1cec8: Time spent bootstrapping tablet: real 0.027s	user 0.011s	sys 0.011s
I20260709 14:55:07.436340 17359 tablet_bootstrap.cc:492] T 7f2f04eff4224b908232b77ec2722983 P 7aa582d7751f4019b7c164fcc8c7e165: No bootstrap required, opened a new log
I20260709 14:55:07.437095 17359 ts_tablet_manager.cc:1403] T 7f2f04eff4224b908232b77ec2722983 P 7aa582d7751f4019b7c164fcc8c7e165: Time spent bootstrapping tablet: real 0.032s	user 0.008s	sys 0.012s
I20260709 14:55:07.441741 17359 raft_consensus.cc:359] T 7f2f04eff4224b908232b77ec2722983 P 7aa582d7751f4019b7c164fcc8c7e165 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3142a82d3794dc8aa655722cb1c6c9c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 37781 } } peers { permanent_uuid: "45b4211717954927a5f98f36b9e1cec8" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35287 } } peers { permanent_uuid: "7aa582d7751f4019b7c164fcc8c7e165" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33747 } }
I20260709 14:55:07.442677 17359 raft_consensus.cc:385] T 7f2f04eff4224b908232b77ec2722983 P 7aa582d7751f4019b7c164fcc8c7e165 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:55:07.443011 17359 raft_consensus.cc:740] T 7f2f04eff4224b908232b77ec2722983 P 7aa582d7751f4019b7c164fcc8c7e165 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7aa582d7751f4019b7c164fcc8c7e165, State: Initialized, Role: FOLLOWER
I20260709 14:55:07.443482 17361 raft_consensus.cc:359] T 7f2f04eff4224b908232b77ec2722983 P 45b4211717954927a5f98f36b9e1cec8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3142a82d3794dc8aa655722cb1c6c9c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 37781 } } peers { permanent_uuid: "45b4211717954927a5f98f36b9e1cec8" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35287 } } peers { permanent_uuid: "7aa582d7751f4019b7c164fcc8c7e165" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33747 } }
I20260709 14:55:07.444691 17361 raft_consensus.cc:385] T 7f2f04eff4224b908232b77ec2722983 P 45b4211717954927a5f98f36b9e1cec8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:55:07.445091 17361 raft_consensus.cc:740] T 7f2f04eff4224b908232b77ec2722983 P 45b4211717954927a5f98f36b9e1cec8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45b4211717954927a5f98f36b9e1cec8, State: Initialized, Role: FOLLOWER
I20260709 14:55:07.444362 17359 consensus_queue.cc:260] T 7f2f04eff4224b908232b77ec2722983 P 7aa582d7751f4019b7c164fcc8c7e165 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3142a82d3794dc8aa655722cb1c6c9c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 37781 } } peers { permanent_uuid: "45b4211717954927a5f98f36b9e1cec8" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35287 } } peers { permanent_uuid: "7aa582d7751f4019b7c164fcc8c7e165" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33747 } }
I20260709 14:55:07.446460 17361 consensus_queue.cc:260] T 7f2f04eff4224b908232b77ec2722983 P 45b4211717954927a5f98f36b9e1cec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3142a82d3794dc8aa655722cb1c6c9c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 37781 } } peers { permanent_uuid: "45b4211717954927a5f98f36b9e1cec8" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35287 } } peers { permanent_uuid: "7aa582d7751f4019b7c164fcc8c7e165" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33747 } }
I20260709 14:55:07.448391 17359 ts_tablet_manager.cc:1434] T 7f2f04eff4224b908232b77ec2722983 P 7aa582d7751f4019b7c164fcc8c7e165: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 14:55:07.449316 17361 ts_tablet_manager.cc:1434] T 7f2f04eff4224b908232b77ec2722983 P 45b4211717954927a5f98f36b9e1cec8: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.001s
I20260709 14:55:07.453859 17358 tablet_bootstrap.cc:492] T ec8a0493e0304bb69aa91999d7d7f660 P f3142a82d3794dc8aa655722cb1c6c9c: No bootstrap required, opened a new log
I20260709 14:55:07.455502 17358 ts_tablet_manager.cc:1403] T ec8a0493e0304bb69aa91999d7d7f660 P f3142a82d3794dc8aa655722cb1c6c9c: Time spent bootstrapping tablet: real 0.045s	user 0.033s	sys 0.007s
I20260709 14:55:07.459173 17358 raft_consensus.cc:359] T ec8a0493e0304bb69aa91999d7d7f660 P f3142a82d3794dc8aa655722cb1c6c9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3142a82d3794dc8aa655722cb1c6c9c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 37781 } } peers { permanent_uuid: "45b4211717954927a5f98f36b9e1cec8" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35287 } } peers { permanent_uuid: "7aa582d7751f4019b7c164fcc8c7e165" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33747 } }
I20260709 14:55:07.460034 17358 raft_consensus.cc:385] T ec8a0493e0304bb69aa91999d7d7f660 P f3142a82d3794dc8aa655722cb1c6c9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:55:07.460496 17358 raft_consensus.cc:740] T ec8a0493e0304bb69aa91999d7d7f660 P f3142a82d3794dc8aa655722cb1c6c9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3142a82d3794dc8aa655722cb1c6c9c, State: Initialized, Role: FOLLOWER
I20260709 14:55:07.461302 17358 consensus_queue.cc:260] T ec8a0493e0304bb69aa91999d7d7f660 P f3142a82d3794dc8aa655722cb1c6c9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3142a82d3794dc8aa655722cb1c6c9c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 37781 } } peers { permanent_uuid: "45b4211717954927a5f98f36b9e1cec8" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35287 } } peers { permanent_uuid: "7aa582d7751f4019b7c164fcc8c7e165" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33747 } }
I20260709 14:55:07.464334 17358 ts_tablet_manager.cc:1434] T ec8a0493e0304bb69aa91999d7d7f660 P f3142a82d3794dc8aa655722cb1c6c9c: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 14:55:07.498971 17366 raft_consensus.cc:493] T 7f2f04eff4224b908232b77ec2722983 P 45b4211717954927a5f98f36b9e1cec8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:55:07.499689 17366 raft_consensus.cc:515] T 7f2f04eff4224b908232b77ec2722983 P 45b4211717954927a5f98f36b9e1cec8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3142a82d3794dc8aa655722cb1c6c9c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 37781 } } peers { permanent_uuid: "45b4211717954927a5f98f36b9e1cec8" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35287 } } peers { permanent_uuid: "7aa582d7751f4019b7c164fcc8c7e165" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33747 } }
I20260709 14:55:07.502272 17366 leader_election.cc:290] T 7f2f04eff4224b908232b77ec2722983 P 45b4211717954927a5f98f36b9e1cec8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3142a82d3794dc8aa655722cb1c6c9c (127.6.101.65:37781), 7aa582d7751f4019b7c164fcc8c7e165 (127.6.101.67:33747)
I20260709 14:55:07.504534 17362 raft_consensus.cc:493] T ec8a0493e0304bb69aa91999d7d7f660 P f3142a82d3794dc8aa655722cb1c6c9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:55:07.505545 17362 raft_consensus.cc:515] T ec8a0493e0304bb69aa91999d7d7f660 P f3142a82d3794dc8aa655722cb1c6c9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3142a82d3794dc8aa655722cb1c6c9c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 37781 } } peers { permanent_uuid: "45b4211717954927a5f98f36b9e1cec8" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35287 } } peers { permanent_uuid: "7aa582d7751f4019b7c164fcc8c7e165" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33747 } }
I20260709 14:55:07.519403 17362 leader_election.cc:290] T ec8a0493e0304bb69aa91999d7d7f660 P f3142a82d3794dc8aa655722cb1c6c9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45b4211717954927a5f98f36b9e1cec8 (127.6.101.66:35287), 7aa582d7751f4019b7c164fcc8c7e165 (127.6.101.67:33747)
I20260709 14:55:07.534279 17166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2f04eff4224b908232b77ec2722983" candidate_uuid: "45b4211717954927a5f98f36b9e1cec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3142a82d3794dc8aa655722cb1c6c9c" is_pre_election: true
I20260709 14:55:07.535405 17166 raft_consensus.cc:2468] T 7f2f04eff4224b908232b77ec2722983 P f3142a82d3794dc8aa655722cb1c6c9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45b4211717954927a5f98f36b9e1cec8 in term 0.
I20260709 14:55:07.537881 17204 leader_election.cc:304] T 7f2f04eff4224b908232b77ec2722983 P 45b4211717954927a5f98f36b9e1cec8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45b4211717954927a5f98f36b9e1cec8, f3142a82d3794dc8aa655722cb1c6c9c; no voters: 
I20260709 14:55:07.539055 17366 raft_consensus.cc:2804] T 7f2f04eff4224b908232b77ec2722983 P 45b4211717954927a5f98f36b9e1cec8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:55:07.539618 17366 raft_consensus.cc:493] T 7f2f04eff4224b908232b77ec2722983 P 45b4211717954927a5f98f36b9e1cec8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:55:07.540004 17366 raft_consensus.cc:3060] T 7f2f04eff4224b908232b77ec2722983 P 45b4211717954927a5f98f36b9e1cec8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:55:07.545346 17241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec8a0493e0304bb69aa91999d7d7f660" candidate_uuid: "f3142a82d3794dc8aa655722cb1c6c9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45b4211717954927a5f98f36b9e1cec8" is_pre_election: true
I20260709 14:55:07.546312 17241 raft_consensus.cc:2468] T ec8a0493e0304bb69aa91999d7d7f660 P 45b4211717954927a5f98f36b9e1cec8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3142a82d3794dc8aa655722cb1c6c9c in term 0.
I20260709 14:55:07.547809 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2f04eff4224b908232b77ec2722983" candidate_uuid: "45b4211717954927a5f98f36b9e1cec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7aa582d7751f4019b7c164fcc8c7e165" is_pre_election: true
I20260709 14:55:07.548116 17131 leader_election.cc:304] T ec8a0493e0304bb69aa91999d7d7f660 P f3142a82d3794dc8aa655722cb1c6c9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45b4211717954927a5f98f36b9e1cec8, f3142a82d3794dc8aa655722cb1c6c9c; no voters: 
I20260709 14:55:07.548734 17315 raft_consensus.cc:2468] T 7f2f04eff4224b908232b77ec2722983 P 7aa582d7751f4019b7c164fcc8c7e165 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45b4211717954927a5f98f36b9e1cec8 in term 0.
I20260709 14:55:07.549348 17362 raft_consensus.cc:2804] T ec8a0493e0304bb69aa91999d7d7f660 P f3142a82d3794dc8aa655722cb1c6c9c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:55:07.549891 17362 raft_consensus.cc:493] T ec8a0493e0304bb69aa91999d7d7f660 P f3142a82d3794dc8aa655722cb1c6c9c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:55:07.550254 17362 raft_consensus.cc:3060] T ec8a0493e0304bb69aa91999d7d7f660 P f3142a82d3794dc8aa655722cb1c6c9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:55:07.551137 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec8a0493e0304bb69aa91999d7d7f660" candidate_uuid: "f3142a82d3794dc8aa655722cb1c6c9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7aa582d7751f4019b7c164fcc8c7e165" is_pre_election: true
I20260709 14:55:07.551903 17315 raft_consensus.cc:2468] T ec8a0493e0304bb69aa91999d7d7f660 P 7aa582d7751f4019b7c164fcc8c7e165 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3142a82d3794dc8aa655722cb1c6c9c in term 0.
I20260709 14:55:07.552596 17366 raft_consensus.cc:515] T 7f2f04eff4224b908232b77ec2722983 P 45b4211717954927a5f98f36b9e1cec8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3142a82d3794dc8aa655722cb1c6c9c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 37781 } } peers { permanent_uuid: "45b4211717954927a5f98f36b9e1cec8" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35287 } } peers { permanent_uuid: "7aa582d7751f4019b7c164fcc8c7e165" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33747 } }
I20260709 14:55:07.555701 17366 leader_election.cc:290] T 7f2f04eff4224b908232b77ec2722983 P 45b4211717954927a5f98f36b9e1cec8 [CANDIDATE]: Term 1 election: Requested vote from peers f3142a82d3794dc8aa655722cb1c6c9c (127.6.101.65:37781), 7aa582d7751f4019b7c164fcc8c7e165 (127.6.101.67:33747)
I20260709 14:55:07.556030 17166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2f04eff4224b908232b77ec2722983" candidate_uuid: "45b4211717954927a5f98f36b9e1cec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3142a82d3794dc8aa655722cb1c6c9c"
I20260709 14:55:07.556491 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2f04eff4224b908232b77ec2722983" candidate_uuid: "45b4211717954927a5f98f36b9e1cec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7aa582d7751f4019b7c164fcc8c7e165"
I20260709 14:55:07.556828 17166 raft_consensus.cc:3060] T 7f2f04eff4224b908232b77ec2722983 P f3142a82d3794dc8aa655722cb1c6c9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:55:07.557116 17315 raft_consensus.cc:3060] T 7f2f04eff4224b908232b77ec2722983 P 7aa582d7751f4019b7c164fcc8c7e165 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:55:07.559095 17362 raft_consensus.cc:515] T ec8a0493e0304bb69aa91999d7d7f660 P f3142a82d3794dc8aa655722cb1c6c9c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3142a82d3794dc8aa655722cb1c6c9c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 37781 } } peers { permanent_uuid: "45b4211717954927a5f98f36b9e1cec8" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35287 } } peers { permanent_uuid: "7aa582d7751f4019b7c164fcc8c7e165" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33747 } }
I20260709 14:55:07.561806 17362 leader_election.cc:290] T ec8a0493e0304bb69aa91999d7d7f660 P f3142a82d3794dc8aa655722cb1c6c9c [CANDIDATE]: Term 1 election: Requested vote from peers 45b4211717954927a5f98f36b9e1cec8 (127.6.101.66:35287), 7aa582d7751f4019b7c164fcc8c7e165 (127.6.101.67:33747)
I20260709 14:55:07.562819 17241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec8a0493e0304bb69aa91999d7d7f660" candidate_uuid: "f3142a82d3794dc8aa655722cb1c6c9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45b4211717954927a5f98f36b9e1cec8"
I20260709 14:55:07.563611 17241 raft_consensus.cc:3060] T ec8a0493e0304bb69aa91999d7d7f660 P 45b4211717954927a5f98f36b9e1cec8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:55:07.563894 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec8a0493e0304bb69aa91999d7d7f660" candidate_uuid: "f3142a82d3794dc8aa655722cb1c6c9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7aa582d7751f4019b7c164fcc8c7e165"
I20260709 14:55:07.564906 17314 raft_consensus.cc:3060] T ec8a0493e0304bb69aa91999d7d7f660 P 7aa582d7751f4019b7c164fcc8c7e165 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:55:07.566617 17166 raft_consensus.cc:2468] T 7f2f04eff4224b908232b77ec2722983 P f3142a82d3794dc8aa655722cb1c6c9c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45b4211717954927a5f98f36b9e1cec8 in term 1.
I20260709 14:55:07.567408 17315 raft_consensus.cc:2468] T 7f2f04eff4224b908232b77ec2722983 P 7aa582d7751f4019b7c164fcc8c7e165 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45b4211717954927a5f98f36b9e1cec8 in term 1.
I20260709 14:55:07.568188 17204 leader_election.cc:304] T 7f2f04eff4224b908232b77ec2722983 P 45b4211717954927a5f98f36b9e1cec8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45b4211717954927a5f98f36b9e1cec8, f3142a82d3794dc8aa655722cb1c6c9c; no voters: 
I20260709 14:55:07.569409 17366 raft_consensus.cc:2804] T 7f2f04eff4224b908232b77ec2722983 P 45b4211717954927a5f98f36b9e1cec8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:55:07.571033 17366 raft_consensus.cc:697] T 7f2f04eff4224b908232b77ec2722983 P 45b4211717954927a5f98f36b9e1cec8 [term 1 LEADER]: Becoming Leader. State: Replica: 45b4211717954927a5f98f36b9e1cec8, State: Running, Role: LEADER
I20260709 14:55:07.572082 17366 consensus_queue.cc:237] T 7f2f04eff4224b908232b77ec2722983 P 45b4211717954927a5f98f36b9e1cec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3142a82d3794dc8aa655722cb1c6c9c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 37781 } } peers { permanent_uuid: "45b4211717954927a5f98f36b9e1cec8" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35287 } } peers { permanent_uuid: "7aa582d7751f4019b7c164fcc8c7e165" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33747 } }
I20260709 14:55:07.572899 17241 raft_consensus.cc:2468] T ec8a0493e0304bb69aa91999d7d7f660 P 45b4211717954927a5f98f36b9e1cec8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3142a82d3794dc8aa655722cb1c6c9c in term 1.
I20260709 14:55:07.574519 17131 leader_election.cc:304] T ec8a0493e0304bb69aa91999d7d7f660 P f3142a82d3794dc8aa655722cb1c6c9c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45b4211717954927a5f98f36b9e1cec8, f3142a82d3794dc8aa655722cb1c6c9c; no voters: 
I20260709 14:55:07.574805 17314 raft_consensus.cc:2468] T ec8a0493e0304bb69aa91999d7d7f660 P 7aa582d7751f4019b7c164fcc8c7e165 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3142a82d3794dc8aa655722cb1c6c9c in term 1.
I20260709 14:55:07.575577 17362 raft_consensus.cc:2804] T ec8a0493e0304bb69aa91999d7d7f660 P f3142a82d3794dc8aa655722cb1c6c9c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:55:07.578025 17362 raft_consensus.cc:697] T ec8a0493e0304bb69aa91999d7d7f660 P f3142a82d3794dc8aa655722cb1c6c9c [term 1 LEADER]: Becoming Leader. State: Replica: f3142a82d3794dc8aa655722cb1c6c9c, State: Running, Role: LEADER
I20260709 14:55:07.579684 17362 consensus_queue.cc:237] T ec8a0493e0304bb69aa91999d7d7f660 P f3142a82d3794dc8aa655722cb1c6c9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3142a82d3794dc8aa655722cb1c6c9c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 37781 } } peers { permanent_uuid: "45b4211717954927a5f98f36b9e1cec8" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35287 } } peers { permanent_uuid: "7aa582d7751f4019b7c164fcc8c7e165" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33747 } }
I20260709 14:55:07.583346 17061 catalog_manager.cc:5697] T 7f2f04eff4224b908232b77ec2722983 P 45b4211717954927a5f98f36b9e1cec8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 45b4211717954927a5f98f36b9e1cec8 (127.6.101.66). New cstate: current_term: 1 leader_uuid: "45b4211717954927a5f98f36b9e1cec8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3142a82d3794dc8aa655722cb1c6c9c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 37781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45b4211717954927a5f98f36b9e1cec8" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35287 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7aa582d7751f4019b7c164fcc8c7e165" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33747 } health_report { overall_health: UNKNOWN } } }
I20260709 14:55:07.592052 17367 consensus_queue.cc:1048] T 760ef607ad0b4709a1edbd330537c600 P 7aa582d7751f4019b7c164fcc8c7e165 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3142a82d3794dc8aa655722cb1c6c9c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 37781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 14:55:07.593834 17063 catalog_manager.cc:5697] T ec8a0493e0304bb69aa91999d7d7f660 P f3142a82d3794dc8aa655722cb1c6c9c reported cstate change: term changed from 0 to 1, leader changed from <none> to f3142a82d3794dc8aa655722cb1c6c9c (127.6.101.65). New cstate: current_term: 1 leader_uuid: "f3142a82d3794dc8aa655722cb1c6c9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3142a82d3794dc8aa655722cb1c6c9c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 37781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45b4211717954927a5f98f36b9e1cec8" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7aa582d7751f4019b7c164fcc8c7e165" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33747 } health_report { overall_health: UNKNOWN } } }
I20260709 14:55:07.598958 17367 consensus_queue.cc:1048] T e3e2759d1c29478c81d4fdaf192559bf P 7aa582d7751f4019b7c164fcc8c7e165 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45b4211717954927a5f98f36b9e1cec8" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:55:07.620765 17367 consensus_queue.cc:1048] T e3e2759d1c29478c81d4fdaf192559bf P 7aa582d7751f4019b7c164fcc8c7e165 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3142a82d3794dc8aa655722cb1c6c9c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 37781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 14:55:07.642194 17400 consensus_queue.cc:1048] T 760ef607ad0b4709a1edbd330537c600 P 7aa582d7751f4019b7c164fcc8c7e165 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45b4211717954927a5f98f36b9e1cec8" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:55:07.676056 17314 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "760ef607ad0b4709a1edbd330537c600"
dest_uuid: "7aa582d7751f4019b7c164fcc8c7e165"
mode: GRACEFUL
new_leader_uuid: "f3142a82d3794dc8aa655722cb1c6c9c"
 from {username='slave'} at 127.0.0.1:44736
I20260709 14:55:07.676867 17314 raft_consensus.cc:606] T 760ef607ad0b4709a1edbd330537c600 P 7aa582d7751f4019b7c164fcc8c7e165 [term 1 LEADER]: Received request to transfer leadership to TS f3142a82d3794dc8aa655722cb1c6c9c
I20260709 14:55:07.683775 17314 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e3e2759d1c29478c81d4fdaf192559bf"
dest_uuid: "7aa582d7751f4019b7c164fcc8c7e165"
mode: GRACEFUL
new_leader_uuid: "45b4211717954927a5f98f36b9e1cec8"
 from {username='slave'} at 127.0.0.1:44736
I20260709 14:55:07.684383 17314 raft_consensus.cc:606] T e3e2759d1c29478c81d4fdaf192559bf P 7aa582d7751f4019b7c164fcc8c7e165 [term 1 LEADER]: Received request to transfer leadership to TS 45b4211717954927a5f98f36b9e1cec8
I20260709 14:55:07.706990 17241 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7f2f04eff4224b908232b77ec2722983"
dest_uuid: "45b4211717954927a5f98f36b9e1cec8"
mode: GRACEFUL
new_leader_uuid: "f3142a82d3794dc8aa655722cb1c6c9c"
 from {username='slave'} at 127.0.0.1:44688
I20260709 14:55:07.707636 17241 raft_consensus.cc:606] T 7f2f04eff4224b908232b77ec2722983 P 45b4211717954927a5f98f36b9e1cec8 [term 1 LEADER]: Received request to transfer leadership to TS f3142a82d3794dc8aa655722cb1c6c9c
I20260709 14:55:08.040982 17403 raft_consensus.cc:993] T e3e2759d1c29478c81d4fdaf192559bf P 7aa582d7751f4019b7c164fcc8c7e165: : Instructing follower 45b4211717954927a5f98f36b9e1cec8 to start an election
I20260709 14:55:08.041582 17400 raft_consensus.cc:1081] T e3e2759d1c29478c81d4fdaf192559bf P 7aa582d7751f4019b7c164fcc8c7e165 [term 1 LEADER]: Signalling peer 45b4211717954927a5f98f36b9e1cec8 to start an election
I20260709 14:55:08.043634 17241 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e3e2759d1c29478c81d4fdaf192559bf"
dest_uuid: "45b4211717954927a5f98f36b9e1cec8"
 from {username='slave'} at 127.0.0.1:44672
I20260709 14:55:08.044333 17241 raft_consensus.cc:493] T e3e2759d1c29478c81d4fdaf192559bf P 45b4211717954927a5f98f36b9e1cec8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:55:08.044749 17241 raft_consensus.cc:3060] T e3e2759d1c29478c81d4fdaf192559bf P 45b4211717954927a5f98f36b9e1cec8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:55:08.053507 17241 raft_consensus.cc:515] T e3e2759d1c29478c81d4fdaf192559bf P 45b4211717954927a5f98f36b9e1cec8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3142a82d3794dc8aa655722cb1c6c9c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 37781 } } peers { permanent_uuid: "45b4211717954927a5f98f36b9e1cec8" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35287 } } peers { permanent_uuid: "7aa582d7751f4019b7c164fcc8c7e165" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33747 } }
I20260709 14:55:08.056638 17241 leader_election.cc:290] T e3e2759d1c29478c81d4fdaf192559bf P 45b4211717954927a5f98f36b9e1cec8 [CANDIDATE]: Term 2 election: Requested vote from peers f3142a82d3794dc8aa655722cb1c6c9c (127.6.101.65:37781), 7aa582d7751f4019b7c164fcc8c7e165 (127.6.101.67:33747)
I20260709 14:55:08.057927 17166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e2759d1c29478c81d4fdaf192559bf" candidate_uuid: "45b4211717954927a5f98f36b9e1cec8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f3142a82d3794dc8aa655722cb1c6c9c"
I20260709 14:55:08.058066 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e2759d1c29478c81d4fdaf192559bf" candidate_uuid: "45b4211717954927a5f98f36b9e1cec8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7aa582d7751f4019b7c164fcc8c7e165"
I20260709 14:55:08.058687 17166 raft_consensus.cc:3060] T e3e2759d1c29478c81d4fdaf192559bf P f3142a82d3794dc8aa655722cb1c6c9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:55:08.058842 17314 raft_consensus.cc:3055] T e3e2759d1c29478c81d4fdaf192559bf P 7aa582d7751f4019b7c164fcc8c7e165 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 14:55:08.059521 17314 raft_consensus.cc:740] T e3e2759d1c29478c81d4fdaf192559bf P 7aa582d7751f4019b7c164fcc8c7e165 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7aa582d7751f4019b7c164fcc8c7e165, State: Running, Role: LEADER
I20260709 14:55:08.059195 17366 consensus_queue.cc:1048] T 7f2f04eff4224b908232b77ec2722983 P 45b4211717954927a5f98f36b9e1cec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3142a82d3794dc8aa655722cb1c6c9c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 37781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:55:08.060544 17314 consensus_queue.cc:260] T e3e2759d1c29478c81d4fdaf192559bf P 7aa582d7751f4019b7c164fcc8c7e165 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3142a82d3794dc8aa655722cb1c6c9c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 37781 } } peers { permanent_uuid: "45b4211717954927a5f98f36b9e1cec8" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35287 } } peers { permanent_uuid: "7aa582d7751f4019b7c164fcc8c7e165" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33747 } }
I20260709 14:55:08.062167 17314 raft_consensus.cc:3060] T e3e2759d1c29478c81d4fdaf192559bf P 7aa582d7751f4019b7c164fcc8c7e165 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:55:08.068259 17366 consensus_queue.cc:1048] T 7f2f04eff4224b908232b77ec2722983 P 45b4211717954927a5f98f36b9e1cec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7aa582d7751f4019b7c164fcc8c7e165" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:55:08.068832 17362 consensus_queue.cc:1048] T ec8a0493e0304bb69aa91999d7d7f660 P f3142a82d3794dc8aa655722cb1c6c9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "45b4211717954927a5f98f36b9e1cec8" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:55:08.080543 17166 raft_consensus.cc:2468] T e3e2759d1c29478c81d4fdaf192559bf P f3142a82d3794dc8aa655722cb1c6c9c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45b4211717954927a5f98f36b9e1cec8 in term 2.
I20260709 14:55:08.084214 17314 raft_consensus.cc:2468] T e3e2759d1c29478c81d4fdaf192559bf P 7aa582d7751f4019b7c164fcc8c7e165 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45b4211717954927a5f98f36b9e1cec8 in term 2.
I20260709 14:55:08.086014 17207 leader_election.cc:304] T e3e2759d1c29478c81d4fdaf192559bf P 45b4211717954927a5f98f36b9e1cec8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45b4211717954927a5f98f36b9e1cec8, 7aa582d7751f4019b7c164fcc8c7e165; no voters: 
I20260709 14:55:08.098003 17410 raft_consensus.cc:2804] T e3e2759d1c29478c81d4fdaf192559bf P 45b4211717954927a5f98f36b9e1cec8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:55:08.097675 17362 consensus_queue.cc:1048] T ec8a0493e0304bb69aa91999d7d7f660 P f3142a82d3794dc8aa655722cb1c6c9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7aa582d7751f4019b7c164fcc8c7e165" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:55:08.117358 17410 raft_consensus.cc:697] T e3e2759d1c29478c81d4fdaf192559bf P 45b4211717954927a5f98f36b9e1cec8 [term 2 LEADER]: Becoming Leader. State: Replica: 45b4211717954927a5f98f36b9e1cec8, State: Running, Role: LEADER
I20260709 14:55:08.118748 17410 consensus_queue.cc:237] T e3e2759d1c29478c81d4fdaf192559bf P 45b4211717954927a5f98f36b9e1cec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3142a82d3794dc8aa655722cb1c6c9c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 37781 } } peers { permanent_uuid: "45b4211717954927a5f98f36b9e1cec8" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35287 } } peers { permanent_uuid: "7aa582d7751f4019b7c164fcc8c7e165" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33747 } }
I20260709 14:55:08.125694 17416 raft_consensus.cc:993] T 7f2f04eff4224b908232b77ec2722983 P 45b4211717954927a5f98f36b9e1cec8: : Instructing follower f3142a82d3794dc8aa655722cb1c6c9c to start an election
I20260709 14:55:08.126555 17366 raft_consensus.cc:1081] T 7f2f04eff4224b908232b77ec2722983 P 45b4211717954927a5f98f36b9e1cec8 [term 1 LEADER]: Signalling peer f3142a82d3794dc8aa655722cb1c6c9c to start an election
I20260709 14:55:08.128544 17165 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7f2f04eff4224b908232b77ec2722983"
dest_uuid: "f3142a82d3794dc8aa655722cb1c6c9c"
 from {username='slave'} at 127.0.0.1:54664
I20260709 14:55:08.129460 17165 raft_consensus.cc:493] T 7f2f04eff4224b908232b77ec2722983 P f3142a82d3794dc8aa655722cb1c6c9c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:55:08.129976 17165 raft_consensus.cc:3060] T 7f2f04eff4224b908232b77ec2722983 P f3142a82d3794dc8aa655722cb1c6c9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:55:08.141952 17165 raft_consensus.cc:515] T 7f2f04eff4224b908232b77ec2722983 P f3142a82d3794dc8aa655722cb1c6c9c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3142a82d3794dc8aa655722cb1c6c9c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 37781 } } peers { permanent_uuid: "45b4211717954927a5f98f36b9e1cec8" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35287 } } peers { permanent_uuid: "7aa582d7751f4019b7c164fcc8c7e165" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33747 } }
I20260709 14:55:08.145969 17064 catalog_manager.cc:5697] T e3e2759d1c29478c81d4fdaf192559bf P 45b4211717954927a5f98f36b9e1cec8 reported cstate change: term changed from 1 to 2, leader changed from 7aa582d7751f4019b7c164fcc8c7e165 (127.6.101.67) to 45b4211717954927a5f98f36b9e1cec8 (127.6.101.66). New cstate: current_term: 2 leader_uuid: "45b4211717954927a5f98f36b9e1cec8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3142a82d3794dc8aa655722cb1c6c9c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 37781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45b4211717954927a5f98f36b9e1cec8" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35287 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7aa582d7751f4019b7c164fcc8c7e165" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33747 } health_report { overall_health: UNKNOWN } } }
I20260709 14:55:08.146764 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2f04eff4224b908232b77ec2722983" candidate_uuid: "f3142a82d3794dc8aa655722cb1c6c9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7aa582d7751f4019b7c164fcc8c7e165"
I20260709 14:55:08.147727 17314 raft_consensus.cc:3060] T 7f2f04eff4224b908232b77ec2722983 P 7aa582d7751f4019b7c164fcc8c7e165 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:55:08.145980 17241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2f04eff4224b908232b77ec2722983" candidate_uuid: "f3142a82d3794dc8aa655722cb1c6c9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "45b4211717954927a5f98f36b9e1cec8"
I20260709 14:55:08.149415 17241 raft_consensus.cc:3055] T 7f2f04eff4224b908232b77ec2722983 P 45b4211717954927a5f98f36b9e1cec8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 14:55:08.149820 17241 raft_consensus.cc:740] T 7f2f04eff4224b908232b77ec2722983 P 45b4211717954927a5f98f36b9e1cec8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 45b4211717954927a5f98f36b9e1cec8, State: Running, Role: LEADER
I20260709 14:55:08.150734 17241 consensus_queue.cc:260] T 7f2f04eff4224b908232b77ec2722983 P 45b4211717954927a5f98f36b9e1cec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3142a82d3794dc8aa655722cb1c6c9c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 37781 } } peers { permanent_uuid: "45b4211717954927a5f98f36b9e1cec8" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35287 } } peers { permanent_uuid: "7aa582d7751f4019b7c164fcc8c7e165" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33747 } }
I20260709 14:55:08.152001 17241 raft_consensus.cc:3060] T 7f2f04eff4224b908232b77ec2722983 P 45b4211717954927a5f98f36b9e1cec8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:55:08.159094 17165 leader_election.cc:290] T 7f2f04eff4224b908232b77ec2722983 P f3142a82d3794dc8aa655722cb1c6c9c [CANDIDATE]: Term 2 election: Requested vote from peers 45b4211717954927a5f98f36b9e1cec8 (127.6.101.66:35287), 7aa582d7751f4019b7c164fcc8c7e165 (127.6.101.67:33747)
I20260709 14:55:08.162855 17241 raft_consensus.cc:2468] T 7f2f04eff4224b908232b77ec2722983 P 45b4211717954927a5f98f36b9e1cec8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3142a82d3794dc8aa655722cb1c6c9c in term 2.
I20260709 14:55:08.164328 17314 raft_consensus.cc:2468] T 7f2f04eff4224b908232b77ec2722983 P 7aa582d7751f4019b7c164fcc8c7e165 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3142a82d3794dc8aa655722cb1c6c9c in term 2.
I20260709 14:55:08.165122 17131 leader_election.cc:304] T 7f2f04eff4224b908232b77ec2722983 P f3142a82d3794dc8aa655722cb1c6c9c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45b4211717954927a5f98f36b9e1cec8, f3142a82d3794dc8aa655722cb1c6c9c; no voters: 
I20260709 14:55:08.166225 17412 raft_consensus.cc:2804] T 7f2f04eff4224b908232b77ec2722983 P f3142a82d3794dc8aa655722cb1c6c9c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:55:08.167127 17412 raft_consensus.cc:697] T 7f2f04eff4224b908232b77ec2722983 P f3142a82d3794dc8aa655722cb1c6c9c [term 2 LEADER]: Becoming Leader. State: Replica: f3142a82d3794dc8aa655722cb1c6c9c, State: Running, Role: LEADER
I20260709 14:55:08.168269 17412 consensus_queue.cc:237] T 7f2f04eff4224b908232b77ec2722983 P f3142a82d3794dc8aa655722cb1c6c9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3142a82d3794dc8aa655722cb1c6c9c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 37781 } } peers { permanent_uuid: "45b4211717954927a5f98f36b9e1cec8" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35287 } } peers { permanent_uuid: "7aa582d7751f4019b7c164fcc8c7e165" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33747 } }
I20260709 14:55:08.175969 17064 catalog_manager.cc:5697] T 7f2f04eff4224b908232b77ec2722983 P f3142a82d3794dc8aa655722cb1c6c9c reported cstate change: term changed from 1 to 2, leader changed from 45b4211717954927a5f98f36b9e1cec8 (127.6.101.66) to f3142a82d3794dc8aa655722cb1c6c9c (127.6.101.65). New cstate: current_term: 2 leader_uuid: "f3142a82d3794dc8aa655722cb1c6c9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3142a82d3794dc8aa655722cb1c6c9c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 37781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45b4211717954927a5f98f36b9e1cec8" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7aa582d7751f4019b7c164fcc8c7e165" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33747 } health_report { overall_health: UNKNOWN } } }
I20260709 14:55:08.231637 17403 raft_consensus.cc:993] T 760ef607ad0b4709a1edbd330537c600 P 7aa582d7751f4019b7c164fcc8c7e165: : Instructing follower f3142a82d3794dc8aa655722cb1c6c9c to start an election
I20260709 14:55:08.232259 17403 raft_consensus.cc:1081] T 760ef607ad0b4709a1edbd330537c600 P 7aa582d7751f4019b7c164fcc8c7e165 [term 1 LEADER]: Signalling peer f3142a82d3794dc8aa655722cb1c6c9c to start an election
I20260709 14:55:08.234301 17165 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "760ef607ad0b4709a1edbd330537c600"
dest_uuid: "f3142a82d3794dc8aa655722cb1c6c9c"
 from {username='slave'} at 127.0.0.1:54652
I20260709 14:55:08.234897 17165 raft_consensus.cc:493] T 760ef607ad0b4709a1edbd330537c600 P f3142a82d3794dc8aa655722cb1c6c9c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:55:08.235314 17165 raft_consensus.cc:3060] T 760ef607ad0b4709a1edbd330537c600 P f3142a82d3794dc8aa655722cb1c6c9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:55:08.242858 17165 raft_consensus.cc:515] T 760ef607ad0b4709a1edbd330537c600 P f3142a82d3794dc8aa655722cb1c6c9c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3142a82d3794dc8aa655722cb1c6c9c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 37781 } } peers { permanent_uuid: "45b4211717954927a5f98f36b9e1cec8" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35287 } } peers { permanent_uuid: "7aa582d7751f4019b7c164fcc8c7e165" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33747 } }
I20260709 14:55:08.245201 17165 leader_election.cc:290] T 760ef607ad0b4709a1edbd330537c600 P f3142a82d3794dc8aa655722cb1c6c9c [CANDIDATE]: Term 2 election: Requested vote from peers 45b4211717954927a5f98f36b9e1cec8 (127.6.101.66:35287), 7aa582d7751f4019b7c164fcc8c7e165 (127.6.101.67:33747)
I20260709 14:55:08.246189 17241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "760ef607ad0b4709a1edbd330537c600" candidate_uuid: "f3142a82d3794dc8aa655722cb1c6c9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "45b4211717954927a5f98f36b9e1cec8"
I20260709 14:55:08.246765 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "760ef607ad0b4709a1edbd330537c600" candidate_uuid: "f3142a82d3794dc8aa655722cb1c6c9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7aa582d7751f4019b7c164fcc8c7e165"
I20260709 14:55:08.247248 17241 raft_consensus.cc:3060] T 760ef607ad0b4709a1edbd330537c600 P 45b4211717954927a5f98f36b9e1cec8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:55:08.247675 17314 raft_consensus.cc:3055] T 760ef607ad0b4709a1edbd330537c600 P 7aa582d7751f4019b7c164fcc8c7e165 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 14:55:08.248186 17314 raft_consensus.cc:740] T 760ef607ad0b4709a1edbd330537c600 P 7aa582d7751f4019b7c164fcc8c7e165 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7aa582d7751f4019b7c164fcc8c7e165, State: Running, Role: LEADER
I20260709 14:55:08.249333 17314 consensus_queue.cc:260] T 760ef607ad0b4709a1edbd330537c600 P 7aa582d7751f4019b7c164fcc8c7e165 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3142a82d3794dc8aa655722cb1c6c9c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 37781 } } peers { permanent_uuid: "45b4211717954927a5f98f36b9e1cec8" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35287 } } peers { permanent_uuid: "7aa582d7751f4019b7c164fcc8c7e165" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33747 } }
I20260709 14:55:08.251077 17314 raft_consensus.cc:3060] T 760ef607ad0b4709a1edbd330537c600 P 7aa582d7751f4019b7c164fcc8c7e165 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:55:08.256433 17241 raft_consensus.cc:2468] T 760ef607ad0b4709a1edbd330537c600 P 45b4211717954927a5f98f36b9e1cec8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3142a82d3794dc8aa655722cb1c6c9c in term 2.
I20260709 14:55:08.258059 17131 leader_election.cc:304] T 760ef607ad0b4709a1edbd330537c600 P f3142a82d3794dc8aa655722cb1c6c9c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45b4211717954927a5f98f36b9e1cec8, f3142a82d3794dc8aa655722cb1c6c9c; no voters: 
I20260709 14:55:08.258816 17314 raft_consensus.cc:2468] T 760ef607ad0b4709a1edbd330537c600 P 7aa582d7751f4019b7c164fcc8c7e165 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3142a82d3794dc8aa655722cb1c6c9c in term 2.
I20260709 14:55:08.259043 17412 raft_consensus.cc:2804] T 760ef607ad0b4709a1edbd330537c600 P f3142a82d3794dc8aa655722cb1c6c9c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:55:08.259763 17412 raft_consensus.cc:697] T 760ef607ad0b4709a1edbd330537c600 P f3142a82d3794dc8aa655722cb1c6c9c [term 2 LEADER]: Becoming Leader. State: Replica: f3142a82d3794dc8aa655722cb1c6c9c, State: Running, Role: LEADER
I20260709 14:55:08.260704 17412 consensus_queue.cc:237] T 760ef607ad0b4709a1edbd330537c600 P f3142a82d3794dc8aa655722cb1c6c9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3142a82d3794dc8aa655722cb1c6c9c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 37781 } } peers { permanent_uuid: "45b4211717954927a5f98f36b9e1cec8" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35287 } } peers { permanent_uuid: "7aa582d7751f4019b7c164fcc8c7e165" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33747 } }
I20260709 14:55:08.268254 17063 catalog_manager.cc:5697] T 760ef607ad0b4709a1edbd330537c600 P f3142a82d3794dc8aa655722cb1c6c9c reported cstate change: term changed from 1 to 2, leader changed from 7aa582d7751f4019b7c164fcc8c7e165 (127.6.101.67) to f3142a82d3794dc8aa655722cb1c6c9c (127.6.101.65). New cstate: current_term: 2 leader_uuid: "f3142a82d3794dc8aa655722cb1c6c9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3142a82d3794dc8aa655722cb1c6c9c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 37781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45b4211717954927a5f98f36b9e1cec8" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7aa582d7751f4019b7c164fcc8c7e165" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33747 } health_report { overall_health: UNKNOWN } } }
I20260709 14:55:08.524315  6549 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 14:55:08.526301  6549 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 14:55:08.526809  6549 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 14:55:08.545320 17165 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7f2f04eff4224b908232b77ec2722983"
dest_uuid: "f3142a82d3794dc8aa655722cb1c6c9c"
mode: GRACEFUL
new_leader_uuid: "7aa582d7751f4019b7c164fcc8c7e165"
 from {username='slave'} at 127.0.0.1:54670
I20260709 14:55:08.545892 17165 raft_consensus.cc:606] T 7f2f04eff4224b908232b77ec2722983 P f3142a82d3794dc8aa655722cb1c6c9c [term 2 LEADER]: Received request to transfer leadership to TS 7aa582d7751f4019b7c164fcc8c7e165
I20260709 14:55:08.547914  6549 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 14:55:08.579124 17165 raft_consensus.cc:1275] T e3e2759d1c29478c81d4fdaf192559bf P f3142a82d3794dc8aa655722cb1c6c9c [term 2 FOLLOWER]: Refusing update from remote peer 45b4211717954927a5f98f36b9e1cec8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:55:08.581342 17413 consensus_queue.cc:1048] T e3e2759d1c29478c81d4fdaf192559bf P 45b4211717954927a5f98f36b9e1cec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3142a82d3794dc8aa655722cb1c6c9c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 37781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 14:55:08.592875 17314 raft_consensus.cc:1275] T e3e2759d1c29478c81d4fdaf192559bf P 7aa582d7751f4019b7c164fcc8c7e165 [term 2 FOLLOWER]: Refusing update from remote peer 45b4211717954927a5f98f36b9e1cec8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:55:08.595034 17366 consensus_queue.cc:1048] T e3e2759d1c29478c81d4fdaf192559bf P 45b4211717954927a5f98f36b9e1cec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7aa582d7751f4019b7c164fcc8c7e165" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 14:55:08.673099 17314 raft_consensus.cc:1275] T 7f2f04eff4224b908232b77ec2722983 P 7aa582d7751f4019b7c164fcc8c7e165 [term 2 FOLLOWER]: Refusing update from remote peer f3142a82d3794dc8aa655722cb1c6c9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:55:08.675237 17412 consensus_queue.cc:1048] T 7f2f04eff4224b908232b77ec2722983 P f3142a82d3794dc8aa655722cb1c6c9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7aa582d7751f4019b7c164fcc8c7e165" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 14:55:08.683377 17423 raft_consensus.cc:993] T 7f2f04eff4224b908232b77ec2722983 P f3142a82d3794dc8aa655722cb1c6c9c: : Instructing follower 7aa582d7751f4019b7c164fcc8c7e165 to start an election
I20260709 14:55:08.684540 17394 raft_consensus.cc:1081] T 7f2f04eff4224b908232b77ec2722983 P f3142a82d3794dc8aa655722cb1c6c9c [term 2 LEADER]: Signalling peer 7aa582d7751f4019b7c164fcc8c7e165 to start an election
I20260709 14:55:08.687247 17315 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7f2f04eff4224b908232b77ec2722983"
dest_uuid: "7aa582d7751f4019b7c164fcc8c7e165"
 from {username='slave'} at 127.0.0.1:44722
I20260709 14:55:08.688562 17241 raft_consensus.cc:1275] T 7f2f04eff4224b908232b77ec2722983 P 45b4211717954927a5f98f36b9e1cec8 [term 2 FOLLOWER]: Refusing update from remote peer f3142a82d3794dc8aa655722cb1c6c9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:55:08.688849 17315 raft_consensus.cc:493] T 7f2f04eff4224b908232b77ec2722983 P 7aa582d7751f4019b7c164fcc8c7e165 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:55:08.689538 17315 raft_consensus.cc:3060] T 7f2f04eff4224b908232b77ec2722983 P 7aa582d7751f4019b7c164fcc8c7e165 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:55:08.690251 17423 consensus_queue.cc:1048] T 7f2f04eff4224b908232b77ec2722983 P f3142a82d3794dc8aa655722cb1c6c9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "45b4211717954927a5f98f36b9e1cec8" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 14:55:08.699522 17315 raft_consensus.cc:515] T 7f2f04eff4224b908232b77ec2722983 P 7aa582d7751f4019b7c164fcc8c7e165 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3142a82d3794dc8aa655722cb1c6c9c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 37781 } } peers { permanent_uuid: "45b4211717954927a5f98f36b9e1cec8" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35287 } } peers { permanent_uuid: "7aa582d7751f4019b7c164fcc8c7e165" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33747 } }
I20260709 14:55:08.706331 17165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2f04eff4224b908232b77ec2722983" candidate_uuid: "7aa582d7751f4019b7c164fcc8c7e165" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f3142a82d3794dc8aa655722cb1c6c9c"
I20260709 14:55:08.707139 17165 raft_consensus.cc:3055] T 7f2f04eff4224b908232b77ec2722983 P f3142a82d3794dc8aa655722cb1c6c9c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 14:55:08.707528 17165 raft_consensus.cc:740] T 7f2f04eff4224b908232b77ec2722983 P f3142a82d3794dc8aa655722cb1c6c9c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f3142a82d3794dc8aa655722cb1c6c9c, State: Running, Role: LEADER
I20260709 14:55:08.708915 17165 consensus_queue.cc:260] T 7f2f04eff4224b908232b77ec2722983 P f3142a82d3794dc8aa655722cb1c6c9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3142a82d3794dc8aa655722cb1c6c9c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 37781 } } peers { permanent_uuid: "45b4211717954927a5f98f36b9e1cec8" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35287 } } peers { permanent_uuid: "7aa582d7751f4019b7c164fcc8c7e165" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33747 } }
I20260709 14:55:08.710595 17165 raft_consensus.cc:3060] T 7f2f04eff4224b908232b77ec2722983 P f3142a82d3794dc8aa655722cb1c6c9c [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:55:08.711689 17315 leader_election.cc:290] T 7f2f04eff4224b908232b77ec2722983 P 7aa582d7751f4019b7c164fcc8c7e165 [CANDIDATE]: Term 3 election: Requested vote from peers f3142a82d3794dc8aa655722cb1c6c9c (127.6.101.65:37781), 45b4211717954927a5f98f36b9e1cec8 (127.6.101.66:35287)
I20260709 14:55:08.712462 17241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2f04eff4224b908232b77ec2722983" candidate_uuid: "7aa582d7751f4019b7c164fcc8c7e165" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "45b4211717954927a5f98f36b9e1cec8"
I20260709 14:55:08.713371 17241 raft_consensus.cc:3060] T 7f2f04eff4224b908232b77ec2722983 P 45b4211717954927a5f98f36b9e1cec8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:55:08.722196 17241 raft_consensus.cc:2468] T 7f2f04eff4224b908232b77ec2722983 P 45b4211717954927a5f98f36b9e1cec8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7aa582d7751f4019b7c164fcc8c7e165 in term 3.
I20260709 14:55:08.722790 17165 raft_consensus.cc:2468] T 7f2f04eff4224b908232b77ec2722983 P f3142a82d3794dc8aa655722cb1c6c9c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7aa582d7751f4019b7c164fcc8c7e165 in term 3.
I20260709 14:55:08.723610 17280 leader_election.cc:304] T 7f2f04eff4224b908232b77ec2722983 P 7aa582d7751f4019b7c164fcc8c7e165 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45b4211717954927a5f98f36b9e1cec8, 7aa582d7751f4019b7c164fcc8c7e165; no voters: 
I20260709 14:55:08.724702 17403 raft_consensus.cc:2804] T 7f2f04eff4224b908232b77ec2722983 P 7aa582d7751f4019b7c164fcc8c7e165 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 14:55:08.725169 17403 raft_consensus.cc:697] T 7f2f04eff4224b908232b77ec2722983 P 7aa582d7751f4019b7c164fcc8c7e165 [term 3 LEADER]: Becoming Leader. State: Replica: 7aa582d7751f4019b7c164fcc8c7e165, State: Running, Role: LEADER
I20260709 14:55:08.725996 17403 consensus_queue.cc:237] T 7f2f04eff4224b908232b77ec2722983 P 7aa582d7751f4019b7c164fcc8c7e165 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3142a82d3794dc8aa655722cb1c6c9c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 37781 } } peers { permanent_uuid: "45b4211717954927a5f98f36b9e1cec8" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35287 } } peers { permanent_uuid: "7aa582d7751f4019b7c164fcc8c7e165" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33747 } }
I20260709 14:55:08.733903 17063 catalog_manager.cc:5697] T 7f2f04eff4224b908232b77ec2722983 P 7aa582d7751f4019b7c164fcc8c7e165 reported cstate change: term changed from 2 to 3, leader changed from f3142a82d3794dc8aa655722cb1c6c9c (127.6.101.65) to 7aa582d7751f4019b7c164fcc8c7e165 (127.6.101.67). New cstate: current_term: 3 leader_uuid: "7aa582d7751f4019b7c164fcc8c7e165" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3142a82d3794dc8aa655722cb1c6c9c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 37781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45b4211717954927a5f98f36b9e1cec8" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7aa582d7751f4019b7c164fcc8c7e165" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33747 } health_report { overall_health: HEALTHY } } }
I20260709 14:55:08.800582  6549 tablet_server.cc:179] TabletServer@127.6.101.65:0 shutting down...
I20260709 14:55:08.810293 17315 raft_consensus.cc:1275] T 760ef607ad0b4709a1edbd330537c600 P 7aa582d7751f4019b7c164fcc8c7e165 [term 2 FOLLOWER]: Refusing update from remote peer f3142a82d3794dc8aa655722cb1c6c9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:55:08.810290 17241 raft_consensus.cc:1275] T 760ef607ad0b4709a1edbd330537c600 P 45b4211717954927a5f98f36b9e1cec8 [term 2 FOLLOWER]: Refusing update from remote peer f3142a82d3794dc8aa655722cb1c6c9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:55:08.812615 17394 consensus_queue.cc:1048] T 760ef607ad0b4709a1edbd330537c600 P f3142a82d3794dc8aa655722cb1c6c9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7aa582d7751f4019b7c164fcc8c7e165" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 33747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 14:55:08.815106 17423 consensus_queue.cc:1048] T 760ef607ad0b4709a1edbd330537c600 P f3142a82d3794dc8aa655722cb1c6c9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "45b4211717954927a5f98f36b9e1cec8" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 14:55:08.857425  6549 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 14:55:08.858675  6549 tablet_replica.cc:333] T ec8a0493e0304bb69aa91999d7d7f660 P f3142a82d3794dc8aa655722cb1c6c9c: stopping tablet replica
I20260709 14:55:08.859370  6549 raft_consensus.cc:2243] T ec8a0493e0304bb69aa91999d7d7f660 P f3142a82d3794dc8aa655722cb1c6c9c [term 1 LEADER]: Raft consensus shutting down.
I20260709 14:55:08.860186  6549 raft_consensus.cc:2272] T ec8a0493e0304bb69aa91999d7d7f660 P f3142a82d3794dc8aa655722cb1c6c9c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:08.863276  6549 tablet_replica.cc:333] T 7f2f04eff4224b908232b77ec2722983 P f3142a82d3794dc8aa655722cb1c6c9c: stopping tablet replica
I20260709 14:55:08.864081  6549 raft_consensus.cc:2243] T 7f2f04eff4224b908232b77ec2722983 P f3142a82d3794dc8aa655722cb1c6c9c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 14:55:08.864679  6549 raft_consensus.cc:2272] T 7f2f04eff4224b908232b77ec2722983 P f3142a82d3794dc8aa655722cb1c6c9c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:08.868010  6549 tablet_replica.cc:333] T e3e2759d1c29478c81d4fdaf192559bf P f3142a82d3794dc8aa655722cb1c6c9c: stopping tablet replica
I20260709 14:55:08.868829  6549 raft_consensus.cc:2243] T e3e2759d1c29478c81d4fdaf192559bf P f3142a82d3794dc8aa655722cb1c6c9c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 14:55:08.869693  6549 raft_consensus.cc:2272] T e3e2759d1c29478c81d4fdaf192559bf P f3142a82d3794dc8aa655722cb1c6c9c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:08.873040  6549 tablet_replica.cc:333] T 760ef607ad0b4709a1edbd330537c600 P f3142a82d3794dc8aa655722cb1c6c9c: stopping tablet replica
I20260709 14:55:08.873644  6549 raft_consensus.cc:2243] T 760ef607ad0b4709a1edbd330537c600 P f3142a82d3794dc8aa655722cb1c6c9c [term 2 LEADER]: Raft consensus shutting down.
I20260709 14:55:08.874490  6549 raft_consensus.cc:2272] T 760ef607ad0b4709a1edbd330537c600 P f3142a82d3794dc8aa655722cb1c6c9c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:08.890718  6549 tablet_server.cc:196] TabletServer@127.6.101.65:0 shutdown complete.
I20260709 14:55:08.909624  6549 tablet_server.cc:179] TabletServer@127.6.101.66:0 shutting down...
I20260709 14:55:08.943571  6549 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 14:55:08.944535  6549 tablet_replica.cc:333] T 7f2f04eff4224b908232b77ec2722983 P 45b4211717954927a5f98f36b9e1cec8: stopping tablet replica
I20260709 14:55:08.945379  6549 raft_consensus.cc:2243] T 7f2f04eff4224b908232b77ec2722983 P 45b4211717954927a5f98f36b9e1cec8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 14:55:08.946127  6549 raft_consensus.cc:2272] T 7f2f04eff4224b908232b77ec2722983 P 45b4211717954927a5f98f36b9e1cec8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:08.949463  6549 tablet_replica.cc:333] T ec8a0493e0304bb69aa91999d7d7f660 P 45b4211717954927a5f98f36b9e1cec8: stopping tablet replica
I20260709 14:55:08.950220  6549 raft_consensus.cc:2243] T ec8a0493e0304bb69aa91999d7d7f660 P 45b4211717954927a5f98f36b9e1cec8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 14:55:08.950770  6549 raft_consensus.cc:2272] T ec8a0493e0304bb69aa91999d7d7f660 P 45b4211717954927a5f98f36b9e1cec8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:08.954692  6549 tablet_replica.cc:333] T 760ef607ad0b4709a1edbd330537c600 P 45b4211717954927a5f98f36b9e1cec8: stopping tablet replica
I20260709 14:55:08.955806  6549 raft_consensus.cc:2243] T 760ef607ad0b4709a1edbd330537c600 P 45b4211717954927a5f98f36b9e1cec8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 14:55:08.956470  6549 raft_consensus.cc:2272] T 760ef607ad0b4709a1edbd330537c600 P 45b4211717954927a5f98f36b9e1cec8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:08.960378  6549 tablet_replica.cc:333] T e3e2759d1c29478c81d4fdaf192559bf P 45b4211717954927a5f98f36b9e1cec8: stopping tablet replica
I20260709 14:55:08.961069  6549 raft_consensus.cc:2243] T e3e2759d1c29478c81d4fdaf192559bf P 45b4211717954927a5f98f36b9e1cec8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 14:55:08.962388  6549 raft_consensus.cc:2272] T e3e2759d1c29478c81d4fdaf192559bf P 45b4211717954927a5f98f36b9e1cec8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:08.980726  6549 tablet_server.cc:196] TabletServer@127.6.101.66:0 shutdown complete.
I20260709 14:55:08.997696  6549 tablet_server.cc:179] TabletServer@127.6.101.67:0 shutting down...
I20260709 14:55:09.034962  6549 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 14:55:09.035811  6549 tablet_replica.cc:333] T 7f2f04eff4224b908232b77ec2722983 P 7aa582d7751f4019b7c164fcc8c7e165: stopping tablet replica
I20260709 14:55:09.036520  6549 raft_consensus.cc:2243] T 7f2f04eff4224b908232b77ec2722983 P 7aa582d7751f4019b7c164fcc8c7e165 [term 3 LEADER]: Raft consensus shutting down.
I20260709 14:55:09.037626  6549 pending_rounds.cc:70] T 7f2f04eff4224b908232b77ec2722983 P 7aa582d7751f4019b7c164fcc8c7e165: Trying to abort 1 pending ops.
I20260709 14:55:09.037858  6549 pending_rounds.cc:77] T 7f2f04eff4224b908232b77ec2722983 P 7aa582d7751f4019b7c164fcc8c7e165: Aborting op as it isn't in flight: id { term: 3 index: 3 } timestamp: 7305662090149756928 op_type: NO_OP noop_request { }
I20260709 14:55:09.038224  6549 raft_consensus.cc:2889] T 7f2f04eff4224b908232b77ec2722983 P 7aa582d7751f4019b7c164fcc8c7e165 [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 14:55:09.038674  6549 raft_consensus.cc:2272] T 7f2f04eff4224b908232b77ec2722983 P 7aa582d7751f4019b7c164fcc8c7e165 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:09.041887  6549 tablet_replica.cc:333] T ec8a0493e0304bb69aa91999d7d7f660 P 7aa582d7751f4019b7c164fcc8c7e165: stopping tablet replica
I20260709 14:55:09.042716  6549 raft_consensus.cc:2243] T ec8a0493e0304bb69aa91999d7d7f660 P 7aa582d7751f4019b7c164fcc8c7e165 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 14:55:09.043464  6549 raft_consensus.cc:2272] T ec8a0493e0304bb69aa91999d7d7f660 P 7aa582d7751f4019b7c164fcc8c7e165 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:09.047941  6549 tablet_replica.cc:333] T e3e2759d1c29478c81d4fdaf192559bf P 7aa582d7751f4019b7c164fcc8c7e165: stopping tablet replica
I20260709 14:55:09.048641  6549 raft_consensus.cc:2243] T e3e2759d1c29478c81d4fdaf192559bf P 7aa582d7751f4019b7c164fcc8c7e165 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 14:55:09.049180  6549 raft_consensus.cc:2272] T e3e2759d1c29478c81d4fdaf192559bf P 7aa582d7751f4019b7c164fcc8c7e165 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:09.051944  6549 tablet_replica.cc:333] T 760ef607ad0b4709a1edbd330537c600 P 7aa582d7751f4019b7c164fcc8c7e165: stopping tablet replica
I20260709 14:55:09.052707  6549 raft_consensus.cc:2243] T 760ef607ad0b4709a1edbd330537c600 P 7aa582d7751f4019b7c164fcc8c7e165 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 14:55:09.053285  6549 raft_consensus.cc:2272] T 760ef607ad0b4709a1edbd330537c600 P 7aa582d7751f4019b7c164fcc8c7e165 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:09.071764  6549 tablet_server.cc:196] TabletServer@127.6.101.67:0 shutdown complete.
I20260709 14:55:09.088827  6549 master.cc:562] Master@127.6.101.126:34119 shutting down...
I20260709 14:55:09.111532  6549 raft_consensus.cc:2243] T 00000000000000000000000000000000 P a178518f1dfb4361b78d27fa9e3a531c [term 1 LEADER]: Raft consensus shutting down.
I20260709 14:55:09.112289  6549 raft_consensus.cc:2272] T 00000000000000000000000000000000 P a178518f1dfb4361b78d27fa9e3a531c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:09.112679  6549 tablet_replica.cc:333] T 00000000000000000000000000000000 P a178518f1dfb4361b78d27fa9e3a531c: stopping tablet replica
I20260709 14:55:09.135473  6549 master.cc:584] Master@127.6.101.126:34119 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (3128 ms)
[----------] 6 tests from LeaderRebalancerTest (337055 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 14:55:09.172492  6549 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.6.101.126:36551
I20260709 14:55:09.174212  6549 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 14:55:09.179894 17426 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 14:55:09.181413 17427 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 14:55:09.183944 17429 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 14:55:09.184559  6549 server_base.cc:1061] running on GCE node
I20260709 14:55:09.185887  6549 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 14:55:09.186139  6549 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 14:55:09.186275  6549 hybrid_clock.cc:648] HybridClock initialized: now 1783608909186262 us; error 0 us; skew 500 ppm
I20260709 14:55:09.186815  6549 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 14:55:09.190100  6549 webserver.cc:533] Webserver started at http://127.6.101.126:46817/ using document root <none> and password file <none>
I20260709 14:55:09.190670  6549 fs_manager.cc:362] Metadata directory not provided
I20260709 14:55:09.190845  6549 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 14:55:09.191118  6549 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 14:55:09.192768  6549 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783608571892863-6549-0/minicluster-data/master-0-root/instance:
uuid: "a42a4a4a6b5b40539d164bf0216d7432"
format_stamp: "Formatted at 2026-07-09 14:55:09 on dist-test-slave-lv34"
I20260709 14:55:09.200742  6549 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.005s	sys 0.000s
I20260709 14:55:09.206243 17434 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 14:55:09.207974  6549 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 14:55:09.208828  6549 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783608571892863-6549-0/minicluster-data/master-0-root
uuid: "a42a4a4a6b5b40539d164bf0216d7432"
format_stamp: "Formatted at 2026-07-09 14:55:09 on dist-test-slave-lv34"
I20260709 14:55:09.209362  6549 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783608571892863-6549-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783608571892863-6549-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783608571892863-6549-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 14:55:09.224581  6549 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 14:55:09.226112  6549 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 14:55:09.282107  6549 rpc_server.cc:307] RPC server started. Bound to: 127.6.101.126:36551
I20260709 14:55:09.282370 17485 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.101.126:36551 every 8 connection(s)
I20260709 14:55:09.286975 17486 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:55:09.302536 17486 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a42a4a4a6b5b40539d164bf0216d7432: Bootstrap starting.
I20260709 14:55:09.308308 17486 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a42a4a4a6b5b40539d164bf0216d7432: Neither blocks nor log segments found. Creating new log.
I20260709 14:55:09.314314 17486 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a42a4a4a6b5b40539d164bf0216d7432: No bootstrap required, opened a new log
I20260709 14:55:09.317472 17486 raft_consensus.cc:359] T 00000000000000000000000000000000 P a42a4a4a6b5b40539d164bf0216d7432 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a42a4a4a6b5b40539d164bf0216d7432" member_type: VOTER }
I20260709 14:55:09.318055 17486 raft_consensus.cc:385] T 00000000000000000000000000000000 P a42a4a4a6b5b40539d164bf0216d7432 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:55:09.318351 17486 raft_consensus.cc:740] T 00000000000000000000000000000000 P a42a4a4a6b5b40539d164bf0216d7432 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a42a4a4a6b5b40539d164bf0216d7432, State: Initialized, Role: FOLLOWER
I20260709 14:55:09.319422 17486 consensus_queue.cc:260] T 00000000000000000000000000000000 P a42a4a4a6b5b40539d164bf0216d7432 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a42a4a4a6b5b40539d164bf0216d7432" member_type: VOTER }
I20260709 14:55:09.320132 17486 raft_consensus.cc:399] T 00000000000000000000000000000000 P a42a4a4a6b5b40539d164bf0216d7432 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 14:55:09.320588 17486 raft_consensus.cc:493] T 00000000000000000000000000000000 P a42a4a4a6b5b40539d164bf0216d7432 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 14:55:09.320969 17486 raft_consensus.cc:3060] T 00000000000000000000000000000000 P a42a4a4a6b5b40539d164bf0216d7432 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:55:09.328121 17486 raft_consensus.cc:515] T 00000000000000000000000000000000 P a42a4a4a6b5b40539d164bf0216d7432 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a42a4a4a6b5b40539d164bf0216d7432" member_type: VOTER }
I20260709 14:55:09.328737 17486 leader_election.cc:304] T 00000000000000000000000000000000 P a42a4a4a6b5b40539d164bf0216d7432 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a42a4a4a6b5b40539d164bf0216d7432; no voters: 
I20260709 14:55:09.330056 17486 leader_election.cc:290] T 00000000000000000000000000000000 P a42a4a4a6b5b40539d164bf0216d7432 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 14:55:09.330570 17489 raft_consensus.cc:2804] T 00000000000000000000000000000000 P a42a4a4a6b5b40539d164bf0216d7432 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:55:09.332226 17489 raft_consensus.cc:697] T 00000000000000000000000000000000 P a42a4a4a6b5b40539d164bf0216d7432 [term 1 LEADER]: Becoming Leader. State: Replica: a42a4a4a6b5b40539d164bf0216d7432, State: Running, Role: LEADER
I20260709 14:55:09.333094 17489 consensus_queue.cc:237] T 00000000000000000000000000000000 P a42a4a4a6b5b40539d164bf0216d7432 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a42a4a4a6b5b40539d164bf0216d7432" member_type: VOTER }
I20260709 14:55:09.333309 17486 sys_catalog.cc:565] T 00000000000000000000000000000000 P a42a4a4a6b5b40539d164bf0216d7432 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 14:55:09.336640 17491 sys_catalog.cc:455] T 00000000000000000000000000000000 P a42a4a4a6b5b40539d164bf0216d7432 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a42a4a4a6b5b40539d164bf0216d7432. Latest consensus state: current_term: 1 leader_uuid: "a42a4a4a6b5b40539d164bf0216d7432" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a42a4a4a6b5b40539d164bf0216d7432" member_type: VOTER } }
I20260709 14:55:09.336627 17490 sys_catalog.cc:455] T 00000000000000000000000000000000 P a42a4a4a6b5b40539d164bf0216d7432 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a42a4a4a6b5b40539d164bf0216d7432" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a42a4a4a6b5b40539d164bf0216d7432" member_type: VOTER } }
I20260709 14:55:09.337433 17491 sys_catalog.cc:458] T 00000000000000000000000000000000 P a42a4a4a6b5b40539d164bf0216d7432 [sys.catalog]: This master's current role is: LEADER
I20260709 14:55:09.337479 17490 sys_catalog.cc:458] T 00000000000000000000000000000000 P a42a4a4a6b5b40539d164bf0216d7432 [sys.catalog]: This master's current role is: LEADER
I20260709 14:55:09.343783 17494 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 14:55:09.349447 17494 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 14:55:09.350616  6549 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 14:55:09.360366 17494 catalog_manager.cc:1383] Generated new cluster ID: 9f9869d49f57451ebf71b0f3ca1e5a09
I20260709 14:55:09.360812 17494 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 14:55:09.383301 17494 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 14:55:09.384696 17494 catalog_manager.cc:1540] Loading token signing keys...
I20260709 14:55:09.400107 17494 catalog_manager.cc:6070] T 00000000000000000000000000000000 P a42a4a4a6b5b40539d164bf0216d7432: Generated new TSK 0
I20260709 14:55:09.400826 17494 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 14:55:09.419106  6549 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 14:55:09.428004 17507 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 14:55:09.429116 17508 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 14:55:09.431042 17510 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 14:55:09.431694  6549 server_base.cc:1061] running on GCE node
I20260709 14:55:09.433018  6549 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 14:55:09.433667  6549 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 14:55:09.434041  6549 hybrid_clock.cc:648] HybridClock initialized: now 1783608909434005 us; error 0 us; skew 500 ppm
I20260709 14:55:09.434787  6549 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 14:55:09.438153  6549 webserver.cc:533] Webserver started at http://127.6.101.65:38809/ using document root <none> and password file <none>
I20260709 14:55:09.438813  6549 fs_manager.cc:362] Metadata directory not provided
I20260709 14:55:09.439455  6549 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 14:55:09.439867  6549 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 14:55:09.441543  6549 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783608571892863-6549-0/minicluster-data/ts-0-root/instance:
uuid: "2be4570f313d4a219ad149e28ab546c5"
format_stamp: "Formatted at 2026-07-09 14:55:09 on dist-test-slave-lv34"
I20260709 14:55:09.447248  6549 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 14:55:09.451979 17515 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 14:55:09.453044  6549 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 14:55:09.453519  6549 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783608571892863-6549-0/minicluster-data/ts-0-root
uuid: "2be4570f313d4a219ad149e28ab546c5"
format_stamp: "Formatted at 2026-07-09 14:55:09 on dist-test-slave-lv34"
I20260709 14:55:09.453887  6549 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783608571892863-6549-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783608571892863-6549-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783608571892863-6549-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 14:55:09.477454  6549 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 14:55:09.479218  6549 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 14:55:09.481048  6549 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 14:55:09.483757  6549 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 14:55:09.484061  6549 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 14:55:09.484313  6549 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 14:55:09.484467  6549 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 14:55:09.539392  6549 rpc_server.cc:307] RPC server started. Bound to: 127.6.101.65:43507
I20260709 14:55:09.539552 17577 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.101.65:43507 every 8 connection(s)
I20260709 14:55:09.545960  6549 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 14:55:09.554702 17582 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 14:55:09.556658 17583 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 14:55:09.560451 17585 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 14:55:09.560480  6549 server_base.cc:1061] running on GCE node
I20260709 14:55:09.561987  6549 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 14:55:09.562072 17578 heartbeater.cc:344] Connected to a master server at 127.6.101.126:36551
W20260709 14:55:09.562371  6549 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 14:55:09.562626 17578 heartbeater.cc:461] Registering TS with master...
I20260709 14:55:09.562626  6549 hybrid_clock.cc:648] HybridClock initialized: now 1783608909562595 us; error 0 us; skew 500 ppm
I20260709 14:55:09.563763  6549 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 14:55:09.563979 17578 heartbeater.cc:507] Master 127.6.101.126:36551 requested a full tablet report, sending...
I20260709 14:55:09.567121 17451 ts_manager.cc:194] Registered new tserver with Master: 2be4570f313d4a219ad149e28ab546c5 (127.6.101.65:43507)
I20260709 14:55:09.567337  6549 webserver.cc:533] Webserver started at http://127.6.101.66:32991/ using document root <none> and password file <none>
I20260709 14:55:09.568130  6549 fs_manager.cc:362] Metadata directory not provided
I20260709 14:55:09.568333  6549 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 14:55:09.568657  6549 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 14:55:09.569862 17451 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41860
I20260709 14:55:09.570075  6549 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783608571892863-6549-0/minicluster-data/ts-1-root/instance:
uuid: "450b7f1304cb4c2ca4c9ccf62afb6937"
format_stamp: "Formatted at 2026-07-09 14:55:09 on dist-test-slave-lv34"
I20260709 14:55:09.576280  6549 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.001s
I20260709 14:55:09.580816 17590 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 14:55:09.581863  6549 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 14:55:09.582265  6549 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783608571892863-6549-0/minicluster-data/ts-1-root
uuid: "450b7f1304cb4c2ca4c9ccf62afb6937"
format_stamp: "Formatted at 2026-07-09 14:55:09 on dist-test-slave-lv34"
I20260709 14:55:09.582584  6549 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783608571892863-6549-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783608571892863-6549-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783608571892863-6549-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 14:55:09.596952  6549 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 14:55:09.598440  6549 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 14:55:09.600153  6549 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 14:55:09.603225  6549 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 14:55:09.603474  6549 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 14:55:09.603719  6549 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 14:55:09.603875  6549 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 14:55:09.663684  6549 rpc_server.cc:307] RPC server started. Bound to: 127.6.101.66:35877
I20260709 14:55:09.663817 17652 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.101.66:35877 every 8 connection(s)
I20260709 14:55:09.670359  6549 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 14:55:09.678963 17656 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 14:55:09.680730 17657 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 14:55:09.684235  6549 server_base.cc:1061] running on GCE node
W20260709 14:55:09.684669 17659 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 14:55:09.686020  6549 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 14:55:09.686281  6549 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 14:55:09.686337 17653 heartbeater.cc:344] Connected to a master server at 127.6.101.126:36551
I20260709 14:55:09.686484  6549 hybrid_clock.cc:648] HybridClock initialized: now 1783608909686463 us; error 0 us; skew 500 ppm
I20260709 14:55:09.687139 17653 heartbeater.cc:461] Registering TS with master...
I20260709 14:55:09.687517  6549 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 14:55:09.688048 17653 heartbeater.cc:507] Master 127.6.101.126:36551 requested a full tablet report, sending...
I20260709 14:55:09.690629  6549 webserver.cc:533] Webserver started at http://127.6.101.67:43305/ using document root <none> and password file <none>
I20260709 14:55:09.690964 17451 ts_manager.cc:194] Registered new tserver with Master: 450b7f1304cb4c2ca4c9ccf62afb6937 (127.6.101.66:35877)
I20260709 14:55:09.691414  6549 fs_manager.cc:362] Metadata directory not provided
I20260709 14:55:09.691768  6549 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 14:55:09.692114  6549 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 14:55:09.692997 17451 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41862
I20260709 14:55:09.694020  6549 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783608571892863-6549-0/minicluster-data/ts-2-root/instance:
uuid: "3f9e4abf970849caa70a02ede7f97cd8"
format_stamp: "Formatted at 2026-07-09 14:55:09 on dist-test-slave-lv34"
I20260709 14:55:09.700801  6549 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.006s	sys 0.000s
I20260709 14:55:09.706116 17664 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 14:55:09.707203  6549 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.002s
I20260709 14:55:09.707649  6549 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783608571892863-6549-0/minicluster-data/ts-2-root
uuid: "3f9e4abf970849caa70a02ede7f97cd8"
format_stamp: "Formatted at 2026-07-09 14:55:09 on dist-test-slave-lv34"
I20260709 14:55:09.707943  6549 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783608571892863-6549-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783608571892863-6549-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783608571892863-6549-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 14:55:09.721866  6549 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 14:55:09.723220  6549 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 14:55:09.725049  6549 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 14:55:09.728313  6549 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 14:55:09.728571  6549 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 14:55:09.728837  6549 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 14:55:09.729024  6549 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 14:55:09.781780  6549 rpc_server.cc:307] RPC server started. Bound to: 127.6.101.67:42489
I20260709 14:55:09.782068 17726 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.101.67:42489 every 8 connection(s)
I20260709 14:55:09.800467 17727 heartbeater.cc:344] Connected to a master server at 127.6.101.126:36551
I20260709 14:55:09.801024 17727 heartbeater.cc:461] Registering TS with master...
I20260709 14:55:09.801945 17727 heartbeater.cc:507] Master 127.6.101.126:36551 requested a full tablet report, sending...
I20260709 14:55:09.804538 17451 ts_manager.cc:194] Registered new tserver with Master: 3f9e4abf970849caa70a02ede7f97cd8 (127.6.101.67:42489)
I20260709 14:55:09.805307  6549 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.019548976s
I20260709 14:55:09.806627 17451 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41876
I20260709 14:55:09.844099 17451 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41882:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 14:55:09.847349 17451 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 14:55:09.938370 17616 tablet_service.cc:1511] Processing CreateTablet for tablet dde79436f56b4ce7805822a819a1d9bf (DEFAULT_TABLE table=test-workload [id=13b07229b5924d2f88972b0525753be3]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 14:55:09.940253 17616 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dde79436f56b4ce7805822a819a1d9bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:55:09.940400 17617 tablet_service.cc:1511] Processing CreateTablet for tablet f9509b6f243644ed9e147299153953b2 (DEFAULT_TABLE table=test-workload [id=13b07229b5924d2f88972b0525753be3]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 14:55:09.942028 17617 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9509b6f243644ed9e147299153953b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:55:09.943404 17615 tablet_service.cc:1511] Processing CreateTablet for tablet 2e8e053361a54d7c91f2fe670f4aa514 (DEFAULT_TABLE table=test-workload [id=13b07229b5924d2f88972b0525753be3]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 14:55:09.938370 17618 tablet_service.cc:1511] Processing CreateTablet for tablet f9764d88fc354df8a8b107f95579fc60 (DEFAULT_TABLE table=test-workload [id=13b07229b5924d2f88972b0525753be3]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 14:55:09.949501 17614 tablet_service.cc:1511] Processing CreateTablet for tablet 2ee76f3707314e23b707060672d77fdb (DEFAULT_TABLE table=test-workload [id=13b07229b5924d2f88972b0525753be3]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 14:55:09.945089 17615 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e8e053361a54d7c91f2fe670f4aa514. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:55:09.955221 17618 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9764d88fc354df8a8b107f95579fc60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:55:09.956149 17692 tablet_service.cc:1511] Processing CreateTablet for tablet f9764d88fc354df8a8b107f95579fc60 (DEFAULT_TABLE table=test-workload [id=13b07229b5924d2f88972b0525753be3]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 14:55:09.959642 17692 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9764d88fc354df8a8b107f95579fc60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:55:09.962604 17614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ee76f3707314e23b707060672d77fdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:55:09.964994 17613 tablet_service.cc:1511] Processing CreateTablet for tablet 876c059b51af47a9a687c1e92c95a515 (DEFAULT_TABLE table=test-workload [id=13b07229b5924d2f88972b0525753be3]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 14:55:09.967087 17613 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 876c059b51af47a9a687c1e92c95a515. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:55:09.970160 17691 tablet_service.cc:1511] Processing CreateTablet for tablet f9509b6f243644ed9e147299153953b2 (DEFAULT_TABLE table=test-workload [id=13b07229b5924d2f88972b0525753be3]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 14:55:09.972087 17691 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9509b6f243644ed9e147299153953b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:55:09.985083 17690 tablet_service.cc:1511] Processing CreateTablet for tablet dde79436f56b4ce7805822a819a1d9bf (DEFAULT_TABLE table=test-workload [id=13b07229b5924d2f88972b0525753be3]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 14:55:09.987392 17690 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dde79436f56b4ce7805822a819a1d9bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:55:09.993131 17689 tablet_service.cc:1511] Processing CreateTablet for tablet 2e8e053361a54d7c91f2fe670f4aa514 (DEFAULT_TABLE table=test-workload [id=13b07229b5924d2f88972b0525753be3]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 14:55:10.000804 17689 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e8e053361a54d7c91f2fe670f4aa514. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:55:10.007365 17612 tablet_service.cc:1511] Processing CreateTablet for tablet 87215280bbb9434c86b8e0c862d78e44 (DEFAULT_TABLE table=test-workload [id=13b07229b5924d2f88972b0525753be3]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 14:55:10.008275 17688 tablet_service.cc:1511] Processing CreateTablet for tablet 2ee76f3707314e23b707060672d77fdb (DEFAULT_TABLE table=test-workload [id=13b07229b5924d2f88972b0525753be3]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 14:55:10.009887 17612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87215280bbb9434c86b8e0c862d78e44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:55:10.010802 17688 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ee76f3707314e23b707060672d77fdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:55:10.015538 17687 tablet_service.cc:1511] Processing CreateTablet for tablet 876c059b51af47a9a687c1e92c95a515 (DEFAULT_TABLE table=test-workload [id=13b07229b5924d2f88972b0525753be3]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 14:55:10.017993 17687 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 876c059b51af47a9a687c1e92c95a515. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:55:10.030543 17686 tablet_service.cc:1511] Processing CreateTablet for tablet 87215280bbb9434c86b8e0c862d78e44 (DEFAULT_TABLE table=test-workload [id=13b07229b5924d2f88972b0525753be3]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 14:55:10.033004 17686 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87215280bbb9434c86b8e0c862d78e44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:55:10.042796 17742 tablet_bootstrap.cc:492] T 2ee76f3707314e23b707060672d77fdb P 450b7f1304cb4c2ca4c9ccf62afb6937: Bootstrap starting.
I20260709 14:55:10.062202 17614 tablet_service.cc:1511] Processing CreateTablet for tablet 062ea10ecbd54055988e22c53a4387c5 (DEFAULT_TABLE table=test-workload [id=13b07229b5924d2f88972b0525753be3]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 14:55:10.064088 17542 tablet_service.cc:1511] Processing CreateTablet for tablet f9509b6f243644ed9e147299153953b2 (DEFAULT_TABLE table=test-workload [id=13b07229b5924d2f88972b0525753be3]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 14:55:10.066613 17541 tablet_service.cc:1511] Processing CreateTablet for tablet dde79436f56b4ce7805822a819a1d9bf (DEFAULT_TABLE table=test-workload [id=13b07229b5924d2f88972b0525753be3]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 14:55:10.062510 17543 tablet_service.cc:1511] Processing CreateTablet for tablet f9764d88fc354df8a8b107f95579fc60 (DEFAULT_TABLE table=test-workload [id=13b07229b5924d2f88972b0525753be3]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 14:55:10.071563 17685 tablet_service.cc:1511] Processing CreateTablet for tablet 062ea10ecbd54055988e22c53a4387c5 (DEFAULT_TABLE table=test-workload [id=13b07229b5924d2f88972b0525753be3]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 14:55:10.072021 17540 tablet_service.cc:1511] Processing CreateTablet for tablet 2e8e053361a54d7c91f2fe670f4aa514 (DEFAULT_TABLE table=test-workload [id=13b07229b5924d2f88972b0525753be3]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 14:55:10.073350 17542 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9509b6f243644ed9e147299153953b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:55:10.073664 17685 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 062ea10ecbd54055988e22c53a4387c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:55:10.075510 17536 tablet_service.cc:1511] Processing CreateTablet for tablet 062ea10ecbd54055988e22c53a4387c5 (DEFAULT_TABLE table=test-workload [id=13b07229b5924d2f88972b0525753be3]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 14:55:10.078981 17537 tablet_service.cc:1511] Processing CreateTablet for tablet 87215280bbb9434c86b8e0c862d78e44 (DEFAULT_TABLE table=test-workload [id=13b07229b5924d2f88972b0525753be3]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 14:55:10.072196 17539 tablet_service.cc:1511] Processing CreateTablet for tablet 2ee76f3707314e23b707060672d77fdb (DEFAULT_TABLE table=test-workload [id=13b07229b5924d2f88972b0525753be3]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 14:55:10.083077 17539 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ee76f3707314e23b707060672d77fdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:55:10.084030 17540 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e8e053361a54d7c91f2fe670f4aa514. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:55:10.086217 17541 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dde79436f56b4ce7805822a819a1d9bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:55:10.064577 17614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 062ea10ecbd54055988e22c53a4387c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:55:10.073603 17538 tablet_service.cc:1511] Processing CreateTablet for tablet 876c059b51af47a9a687c1e92c95a515 (DEFAULT_TABLE table=test-workload [id=13b07229b5924d2f88972b0525753be3]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 14:55:10.090916 17538 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 876c059b51af47a9a687c1e92c95a515. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:55:10.093910 17536 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 062ea10ecbd54055988e22c53a4387c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:55:10.095773 17543 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9764d88fc354df8a8b107f95579fc60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:55:10.097410 17537 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87215280bbb9434c86b8e0c862d78e44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:55:10.134543 17535 tablet_service.cc:1511] Processing CreateTablet for tablet c26e43514e564f9e906f938557e587e8 (DEFAULT_TABLE table=test-workload [id=13b07229b5924d2f88972b0525753be3]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 14:55:10.136158 17535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c26e43514e564f9e906f938557e587e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:55:10.134330 17743 tablet_bootstrap.cc:492] T dde79436f56b4ce7805822a819a1d9bf P 3f9e4abf970849caa70a02ede7f97cd8: Bootstrap starting.
I20260709 14:55:10.148357 17743 tablet_bootstrap.cc:654] T dde79436f56b4ce7805822a819a1d9bf P 3f9e4abf970849caa70a02ede7f97cd8: Neither blocks nor log segments found. Creating new log.
I20260709 14:55:10.160247 17743 tablet_bootstrap.cc:492] T dde79436f56b4ce7805822a819a1d9bf P 3f9e4abf970849caa70a02ede7f97cd8: No bootstrap required, opened a new log
I20260709 14:55:10.161017 17743 ts_tablet_manager.cc:1403] T dde79436f56b4ce7805822a819a1d9bf P 3f9e4abf970849caa70a02ede7f97cd8: Time spent bootstrapping tablet: real 0.027s	user 0.015s	sys 0.004s
I20260709 14:55:10.164314 17743 raft_consensus.cc:359] T dde79436f56b4ce7805822a819a1d9bf P 3f9e4abf970849caa70a02ede7f97cd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:10.165082 17743 raft_consensus.cc:385] T dde79436f56b4ce7805822a819a1d9bf P 3f9e4abf970849caa70a02ede7f97cd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:55:10.165436 17743 raft_consensus.cc:740] T dde79436f56b4ce7805822a819a1d9bf P 3f9e4abf970849caa70a02ede7f97cd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f9e4abf970849caa70a02ede7f97cd8, State: Initialized, Role: FOLLOWER
I20260709 14:55:10.166513 17743 consensus_queue.cc:260] T dde79436f56b4ce7805822a819a1d9bf P 3f9e4abf970849caa70a02ede7f97cd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:10.175625 17614 tablet_service.cc:1511] Processing CreateTablet for tablet c26e43514e564f9e906f938557e587e8 (DEFAULT_TABLE table=test-workload [id=13b07229b5924d2f88972b0525753be3]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 14:55:10.177589 17614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c26e43514e564f9e906f938557e587e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:55:10.183451 17742 tablet_bootstrap.cc:654] T 2ee76f3707314e23b707060672d77fdb P 450b7f1304cb4c2ca4c9ccf62afb6937: Neither blocks nor log segments found. Creating new log.
I20260709 14:55:10.193794 17746 tablet_bootstrap.cc:492] T f9764d88fc354df8a8b107f95579fc60 P 2be4570f313d4a219ad149e28ab546c5: Bootstrap starting.
I20260709 14:55:10.202615 17727 heartbeater.cc:499] Master 127.6.101.126:36551 was elected leader, sending a full tablet report...
I20260709 14:55:10.208087 17743 ts_tablet_manager.cc:1434] T dde79436f56b4ce7805822a819a1d9bf P 3f9e4abf970849caa70a02ede7f97cd8: Time spent starting tablet: real 0.047s	user 0.005s	sys 0.030s
I20260709 14:55:10.212970 17743 tablet_bootstrap.cc:492] T f9509b6f243644ed9e147299153953b2 P 3f9e4abf970849caa70a02ede7f97cd8: Bootstrap starting.
I20260709 14:55:10.220218 17687 tablet_service.cc:1511] Processing CreateTablet for tablet c26e43514e564f9e906f938557e587e8 (DEFAULT_TABLE table=test-workload [id=13b07229b5924d2f88972b0525753be3]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 14:55:10.223585 17743 tablet_bootstrap.cc:654] T f9509b6f243644ed9e147299153953b2 P 3f9e4abf970849caa70a02ede7f97cd8: Neither blocks nor log segments found. Creating new log.
I20260709 14:55:10.229188 17746 tablet_bootstrap.cc:654] T f9764d88fc354df8a8b107f95579fc60 P 2be4570f313d4a219ad149e28ab546c5: Neither blocks nor log segments found. Creating new log.
I20260709 14:55:10.237646 17687 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c26e43514e564f9e906f938557e587e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:55:10.263883 17742 tablet_bootstrap.cc:492] T 2ee76f3707314e23b707060672d77fdb P 450b7f1304cb4c2ca4c9ccf62afb6937: No bootstrap required, opened a new log
I20260709 14:55:10.263897 17743 tablet_bootstrap.cc:492] T f9509b6f243644ed9e147299153953b2 P 3f9e4abf970849caa70a02ede7f97cd8: No bootstrap required, opened a new log
I20260709 14:55:10.265424 17742 ts_tablet_manager.cc:1403] T 2ee76f3707314e23b707060672d77fdb P 450b7f1304cb4c2ca4c9ccf62afb6937: Time spent bootstrapping tablet: real 0.223s	user 0.017s	sys 0.000s
I20260709 14:55:10.265534 17743 ts_tablet_manager.cc:1403] T f9509b6f243644ed9e147299153953b2 P 3f9e4abf970849caa70a02ede7f97cd8: Time spent bootstrapping tablet: real 0.053s	user 0.015s	sys 0.008s
I20260709 14:55:10.269315 17743 raft_consensus.cc:359] T f9509b6f243644ed9e147299153953b2 P 3f9e4abf970849caa70a02ede7f97cd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:10.270130 17743 raft_consensus.cc:385] T f9509b6f243644ed9e147299153953b2 P 3f9e4abf970849caa70a02ede7f97cd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:55:10.270450 17743 raft_consensus.cc:740] T f9509b6f243644ed9e147299153953b2 P 3f9e4abf970849caa70a02ede7f97cd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f9e4abf970849caa70a02ede7f97cd8, State: Initialized, Role: FOLLOWER
I20260709 14:55:10.271916 17743 consensus_queue.cc:260] T f9509b6f243644ed9e147299153953b2 P 3f9e4abf970849caa70a02ede7f97cd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:10.275182 17743 ts_tablet_manager.cc:1434] T f9509b6f243644ed9e147299153953b2 P 3f9e4abf970849caa70a02ede7f97cd8: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 14:55:10.270360 17742 raft_consensus.cc:359] T 2ee76f3707314e23b707060672d77fdb P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:10.276281 17742 raft_consensus.cc:385] T 2ee76f3707314e23b707060672d77fdb P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:55:10.276379 17743 tablet_bootstrap.cc:492] T 2e8e053361a54d7c91f2fe670f4aa514 P 3f9e4abf970849caa70a02ede7f97cd8: Bootstrap starting.
I20260709 14:55:10.277652 17746 tablet_bootstrap.cc:492] T f9764d88fc354df8a8b107f95579fc60 P 2be4570f313d4a219ad149e28ab546c5: No bootstrap required, opened a new log
I20260709 14:55:10.278010 17742 raft_consensus.cc:740] T 2ee76f3707314e23b707060672d77fdb P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 450b7f1304cb4c2ca4c9ccf62afb6937, State: Initialized, Role: FOLLOWER
I20260709 14:55:10.278997 17742 consensus_queue.cc:260] T 2ee76f3707314e23b707060672d77fdb P 450b7f1304cb4c2ca4c9ccf62afb6937 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:10.282563 17746 ts_tablet_manager.cc:1403] T f9764d88fc354df8a8b107f95579fc60 P 2be4570f313d4a219ad149e28ab546c5: Time spent bootstrapping tablet: real 0.109s	user 0.015s	sys 0.002s
I20260709 14:55:10.284749 17743 tablet_bootstrap.cc:654] T 2e8e053361a54d7c91f2fe670f4aa514 P 3f9e4abf970849caa70a02ede7f97cd8: Neither blocks nor log segments found. Creating new log.
I20260709 14:55:10.286835 17746 raft_consensus.cc:359] T f9764d88fc354df8a8b107f95579fc60 P 2be4570f313d4a219ad149e28ab546c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } } peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } }
I20260709 14:55:10.288967 17653 heartbeater.cc:499] Master 127.6.101.126:36551 was elected leader, sending a full tablet report...
I20260709 14:55:10.289505 17742 ts_tablet_manager.cc:1434] T 2ee76f3707314e23b707060672d77fdb P 450b7f1304cb4c2ca4c9ccf62afb6937: Time spent starting tablet: real 0.024s	user 0.010s	sys 0.000s
I20260709 14:55:10.290021 17746 raft_consensus.cc:385] T f9764d88fc354df8a8b107f95579fc60 P 2be4570f313d4a219ad149e28ab546c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:55:10.290704 17746 raft_consensus.cc:740] T f9764d88fc354df8a8b107f95579fc60 P 2be4570f313d4a219ad149e28ab546c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2be4570f313d4a219ad149e28ab546c5, State: Initialized, Role: FOLLOWER
I20260709 14:55:10.291380 17742 tablet_bootstrap.cc:492] T f9764d88fc354df8a8b107f95579fc60 P 450b7f1304cb4c2ca4c9ccf62afb6937: Bootstrap starting.
I20260709 14:55:10.291724 17746 consensus_queue.cc:260] T f9764d88fc354df8a8b107f95579fc60 P 2be4570f313d4a219ad149e28ab546c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } } peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } }
I20260709 14:55:10.293186 17743 tablet_bootstrap.cc:492] T 2e8e053361a54d7c91f2fe670f4aa514 P 3f9e4abf970849caa70a02ede7f97cd8: No bootstrap required, opened a new log
I20260709 14:55:10.293923 17743 ts_tablet_manager.cc:1403] T 2e8e053361a54d7c91f2fe670f4aa514 P 3f9e4abf970849caa70a02ede7f97cd8: Time spent bootstrapping tablet: real 0.018s	user 0.006s	sys 0.008s
I20260709 14:55:10.297420 17743 raft_consensus.cc:359] T 2e8e053361a54d7c91f2fe670f4aa514 P 3f9e4abf970849caa70a02ede7f97cd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:10.298280 17743 raft_consensus.cc:385] T 2e8e053361a54d7c91f2fe670f4aa514 P 3f9e4abf970849caa70a02ede7f97cd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:55:10.298588 17743 raft_consensus.cc:740] T 2e8e053361a54d7c91f2fe670f4aa514 P 3f9e4abf970849caa70a02ede7f97cd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f9e4abf970849caa70a02ede7f97cd8, State: Initialized, Role: FOLLOWER
I20260709 14:55:10.299098 17742 tablet_bootstrap.cc:654] T f9764d88fc354df8a8b107f95579fc60 P 450b7f1304cb4c2ca4c9ccf62afb6937: Neither blocks nor log segments found. Creating new log.
I20260709 14:55:10.299829 17743 consensus_queue.cc:260] T 2e8e053361a54d7c91f2fe670f4aa514 P 3f9e4abf970849caa70a02ede7f97cd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:10.302974 17743 ts_tablet_manager.cc:1434] T 2e8e053361a54d7c91f2fe670f4aa514 P 3f9e4abf970849caa70a02ede7f97cd8: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 14:55:10.313651 17746 ts_tablet_manager.cc:1434] T f9764d88fc354df8a8b107f95579fc60 P 2be4570f313d4a219ad149e28ab546c5: Time spent starting tablet: real 0.031s	user 0.005s	sys 0.022s
I20260709 14:55:10.313675 17578 heartbeater.cc:499] Master 127.6.101.126:36551 was elected leader, sending a full tablet report...
I20260709 14:55:10.314919 17746 tablet_bootstrap.cc:492] T f9509b6f243644ed9e147299153953b2 P 2be4570f313d4a219ad149e28ab546c5: Bootstrap starting.
I20260709 14:55:10.322762 17746 tablet_bootstrap.cc:654] T f9509b6f243644ed9e147299153953b2 P 2be4570f313d4a219ad149e28ab546c5: Neither blocks nor log segments found. Creating new log.
I20260709 14:55:10.322927 17742 tablet_bootstrap.cc:492] T f9764d88fc354df8a8b107f95579fc60 P 450b7f1304cb4c2ca4c9ccf62afb6937: No bootstrap required, opened a new log
I20260709 14:55:10.323640 17742 ts_tablet_manager.cc:1403] T f9764d88fc354df8a8b107f95579fc60 P 450b7f1304cb4c2ca4c9ccf62afb6937: Time spent bootstrapping tablet: real 0.033s	user 0.011s	sys 0.013s
I20260709 14:55:10.326916 17743 tablet_bootstrap.cc:492] T 2ee76f3707314e23b707060672d77fdb P 3f9e4abf970849caa70a02ede7f97cd8: Bootstrap starting.
I20260709 14:55:10.327183 17742 raft_consensus.cc:359] T f9764d88fc354df8a8b107f95579fc60 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } } peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } }
I20260709 14:55:10.328343 17742 raft_consensus.cc:385] T f9764d88fc354df8a8b107f95579fc60 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:55:10.328680 17742 raft_consensus.cc:740] T f9764d88fc354df8a8b107f95579fc60 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 450b7f1304cb4c2ca4c9ccf62afb6937, State: Initialized, Role: FOLLOWER
I20260709 14:55:10.329828 17742 consensus_queue.cc:260] T f9764d88fc354df8a8b107f95579fc60 P 450b7f1304cb4c2ca4c9ccf62afb6937 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } } peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } }
I20260709 14:55:10.332533 17742 ts_tablet_manager.cc:1434] T f9764d88fc354df8a8b107f95579fc60 P 450b7f1304cb4c2ca4c9ccf62afb6937: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 14:55:10.333920 17742 tablet_bootstrap.cc:492] T 2e8e053361a54d7c91f2fe670f4aa514 P 450b7f1304cb4c2ca4c9ccf62afb6937: Bootstrap starting.
I20260709 14:55:10.342454 17742 tablet_bootstrap.cc:654] T 2e8e053361a54d7c91f2fe670f4aa514 P 450b7f1304cb4c2ca4c9ccf62afb6937: Neither blocks nor log segments found. Creating new log.
I20260709 14:55:10.343472 17745 raft_consensus.cc:493] T f9509b6f243644ed9e147299153953b2 P 3f9e4abf970849caa70a02ede7f97cd8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:55:10.344211 17745 raft_consensus.cc:515] T f9509b6f243644ed9e147299153953b2 P 3f9e4abf970849caa70a02ede7f97cd8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
W20260709 14:55:10.345750 17499 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 14:55:10.347446 17743 tablet_bootstrap.cc:654] T 2ee76f3707314e23b707060672d77fdb P 3f9e4abf970849caa70a02ede7f97cd8: Neither blocks nor log segments found. Creating new log.
I20260709 14:55:10.354322 17750 raft_consensus.cc:493] T 2ee76f3707314e23b707060672d77fdb P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:55:10.355005 17750 raft_consensus.cc:515] T 2ee76f3707314e23b707060672d77fdb P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:10.361955 17745 leader_election.cc:290] T f9509b6f243644ed9e147299153953b2 P 3f9e4abf970849caa70a02ede7f97cd8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2be4570f313d4a219ad149e28ab546c5 (127.6.101.65:43507), 450b7f1304cb4c2ca4c9ccf62afb6937 (127.6.101.66:35877)
I20260709 14:55:10.363914 17750 leader_election.cc:290] T 2ee76f3707314e23b707060672d77fdb P 450b7f1304cb4c2ca4c9ccf62afb6937 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2be4570f313d4a219ad149e28ab546c5 (127.6.101.65:43507), 3f9e4abf970849caa70a02ede7f97cd8 (127.6.101.67:42489)
I20260709 14:55:10.368233 17743 tablet_bootstrap.cc:492] T 2ee76f3707314e23b707060672d77fdb P 3f9e4abf970849caa70a02ede7f97cd8: No bootstrap required, opened a new log
I20260709 14:55:10.369040 17743 ts_tablet_manager.cc:1403] T 2ee76f3707314e23b707060672d77fdb P 3f9e4abf970849caa70a02ede7f97cd8: Time spent bootstrapping tablet: real 0.043s	user 0.015s	sys 0.007s
I20260709 14:55:10.379359 17746 tablet_bootstrap.cc:492] T f9509b6f243644ed9e147299153953b2 P 2be4570f313d4a219ad149e28ab546c5: No bootstrap required, opened a new log
I20260709 14:55:10.380527 17746 ts_tablet_manager.cc:1403] T f9509b6f243644ed9e147299153953b2 P 2be4570f313d4a219ad149e28ab546c5: Time spent bootstrapping tablet: real 0.066s	user 0.019s	sys 0.020s
I20260709 14:55:10.373792 17743 raft_consensus.cc:359] T 2ee76f3707314e23b707060672d77fdb P 3f9e4abf970849caa70a02ede7f97cd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:10.383553 17743 raft_consensus.cc:385] T 2ee76f3707314e23b707060672d77fdb P 3f9e4abf970849caa70a02ede7f97cd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:55:10.385344 17746 raft_consensus.cc:359] T f9509b6f243644ed9e147299153953b2 P 2be4570f313d4a219ad149e28ab546c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:10.384089 17743 raft_consensus.cc:740] T 2ee76f3707314e23b707060672d77fdb P 3f9e4abf970849caa70a02ede7f97cd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f9e4abf970849caa70a02ede7f97cd8, State: Initialized, Role: FOLLOWER
I20260709 14:55:10.388926 17746 raft_consensus.cc:385] T f9509b6f243644ed9e147299153953b2 P 2be4570f313d4a219ad149e28ab546c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:55:10.389968 17746 raft_consensus.cc:740] T f9509b6f243644ed9e147299153953b2 P 2be4570f313d4a219ad149e28ab546c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2be4570f313d4a219ad149e28ab546c5, State: Initialized, Role: FOLLOWER
I20260709 14:55:10.391480 17746 consensus_queue.cc:260] T f9509b6f243644ed9e147299153953b2 P 2be4570f313d4a219ad149e28ab546c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:10.392853 17553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9509b6f243644ed9e147299153953b2" candidate_uuid: "3f9e4abf970849caa70a02ede7f97cd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2be4570f313d4a219ad149e28ab546c5" is_pre_election: true
I20260709 14:55:10.393766 17553 raft_consensus.cc:2468] T f9509b6f243644ed9e147299153953b2 P 2be4570f313d4a219ad149e28ab546c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f9e4abf970849caa70a02ede7f97cd8 in term 0.
I20260709 14:55:10.390475 17745 raft_consensus.cc:493] T dde79436f56b4ce7805822a819a1d9bf P 3f9e4abf970849caa70a02ede7f97cd8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:55:10.395422 17745 raft_consensus.cc:515] T dde79436f56b4ce7805822a819a1d9bf P 3f9e4abf970849caa70a02ede7f97cd8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:10.396029 17742 tablet_bootstrap.cc:492] T 2e8e053361a54d7c91f2fe670f4aa514 P 450b7f1304cb4c2ca4c9ccf62afb6937: No bootstrap required, opened a new log
I20260709 14:55:10.396819 17742 ts_tablet_manager.cc:1403] T 2e8e053361a54d7c91f2fe670f4aa514 P 450b7f1304cb4c2ca4c9ccf62afb6937: Time spent bootstrapping tablet: real 0.063s	user 0.017s	sys 0.004s
I20260709 14:55:10.393664 17746 ts_tablet_manager.cc:1434] T f9509b6f243644ed9e147299153953b2 P 2be4570f313d4a219ad149e28ab546c5: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.000s
I20260709 14:55:10.390748 17743 consensus_queue.cc:260] T 2ee76f3707314e23b707060672d77fdb P 3f9e4abf970849caa70a02ede7f97cd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:10.399808 17746 tablet_bootstrap.cc:492] T 2ee76f3707314e23b707060672d77fdb P 2be4570f313d4a219ad149e28ab546c5: Bootstrap starting.
I20260709 14:55:10.400775 17742 raft_consensus.cc:359] T 2e8e053361a54d7c91f2fe670f4aa514 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:10.401921 17742 raft_consensus.cc:385] T 2e8e053361a54d7c91f2fe670f4aa514 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:55:10.402304 17742 raft_consensus.cc:740] T 2e8e053361a54d7c91f2fe670f4aa514 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 450b7f1304cb4c2ca4c9ccf62afb6937, State: Initialized, Role: FOLLOWER
I20260709 14:55:10.403381 17742 consensus_queue.cc:260] T 2e8e053361a54d7c91f2fe670f4aa514 P 450b7f1304cb4c2ca4c9ccf62afb6937 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:10.396705 17665 leader_election.cc:304] T f9509b6f243644ed9e147299153953b2 P 3f9e4abf970849caa70a02ede7f97cd8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2be4570f313d4a219ad149e28ab546c5, 3f9e4abf970849caa70a02ede7f97cd8; no voters: 
I20260709 14:55:10.408541 17746 tablet_bootstrap.cc:654] T 2ee76f3707314e23b707060672d77fdb P 2be4570f313d4a219ad149e28ab546c5: Neither blocks nor log segments found. Creating new log.
I20260709 14:55:10.406262 17742 ts_tablet_manager.cc:1434] T 2e8e053361a54d7c91f2fe670f4aa514 P 450b7f1304cb4c2ca4c9ccf62afb6937: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 14:55:10.416438 17742 tablet_bootstrap.cc:492] T 876c059b51af47a9a687c1e92c95a515 P 450b7f1304cb4c2ca4c9ccf62afb6937: Bootstrap starting.
I20260709 14:55:10.418362 17745 leader_election.cc:290] T dde79436f56b4ce7805822a819a1d9bf P 3f9e4abf970849caa70a02ede7f97cd8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2be4570f313d4a219ad149e28ab546c5 (127.6.101.65:43507), 450b7f1304cb4c2ca4c9ccf62afb6937 (127.6.101.66:35877)
I20260709 14:55:10.423100 17750 raft_consensus.cc:493] T f9764d88fc354df8a8b107f95579fc60 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:55:10.423748 17750 raft_consensus.cc:515] T f9764d88fc354df8a8b107f95579fc60 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } } peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } }
I20260709 14:55:10.424338 17628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9509b6f243644ed9e147299153953b2" candidate_uuid: "3f9e4abf970849caa70a02ede7f97cd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" is_pre_election: true
I20260709 14:55:10.425930 17742 tablet_bootstrap.cc:654] T 876c059b51af47a9a687c1e92c95a515 P 450b7f1304cb4c2ca4c9ccf62afb6937: Neither blocks nor log segments found. Creating new log.
I20260709 14:55:10.426260 17627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dde79436f56b4ce7805822a819a1d9bf" candidate_uuid: "3f9e4abf970849caa70a02ede7f97cd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" is_pre_election: true
I20260709 14:55:10.427872 17750 leader_election.cc:290] T f9764d88fc354df8a8b107f95579fc60 P 450b7f1304cb4c2ca4c9ccf62afb6937 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f9e4abf970849caa70a02ede7f97cd8 (127.6.101.67:42489), 2be4570f313d4a219ad149e28ab546c5 (127.6.101.65:43507)
W20260709 14:55:10.428650 17667 leader_election.cc:343] T f9509b6f243644ed9e147299153953b2 P 3f9e4abf970849caa70a02ede7f97cd8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 450b7f1304cb4c2ca4c9ccf62afb6937 (127.6.101.66:35877): Illegal state: must be running to vote when last-logged opid is not known
W20260709 14:55:10.429589 17667 leader_election.cc:343] T dde79436f56b4ce7805822a819a1d9bf P 3f9e4abf970849caa70a02ede7f97cd8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 450b7f1304cb4c2ca4c9ccf62afb6937 (127.6.101.66:35877): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:55:10.431074 17552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9764d88fc354df8a8b107f95579fc60" candidate_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2be4570f313d4a219ad149e28ab546c5" is_pre_election: true
I20260709 14:55:10.432547 17552 raft_consensus.cc:2468] T f9764d88fc354df8a8b107f95579fc60 P 2be4570f313d4a219ad149e28ab546c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 450b7f1304cb4c2ca4c9ccf62afb6937 in term 0.
I20260709 14:55:10.434538 17591 leader_election.cc:304] T f9764d88fc354df8a8b107f95579fc60 P 450b7f1304cb4c2ca4c9ccf62afb6937 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2be4570f313d4a219ad149e28ab546c5, 450b7f1304cb4c2ca4c9ccf62afb6937; no voters: 
I20260709 14:55:10.440627 17745 raft_consensus.cc:2804] T f9509b6f243644ed9e147299153953b2 P 3f9e4abf970849caa70a02ede7f97cd8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:55:10.441370 17745 raft_consensus.cc:493] T f9509b6f243644ed9e147299153953b2 P 3f9e4abf970849caa70a02ede7f97cd8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:55:10.441495 17750 raft_consensus.cc:2804] T f9764d88fc354df8a8b107f95579fc60 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:55:10.441799 17745 raft_consensus.cc:3060] T f9509b6f243644ed9e147299153953b2 P 3f9e4abf970849caa70a02ede7f97cd8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:55:10.414057 17553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee76f3707314e23b707060672d77fdb" candidate_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2be4570f313d4a219ad149e28ab546c5" is_pre_election: true
W20260709 14:55:10.443632 17591 leader_election.cc:343] T 2ee76f3707314e23b707060672d77fdb P 450b7f1304cb4c2ca4c9ccf62afb6937 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2be4570f313d4a219ad149e28ab546c5 (127.6.101.65:43507): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:55:10.445537 17742 tablet_bootstrap.cc:492] T 876c059b51af47a9a687c1e92c95a515 P 450b7f1304cb4c2ca4c9ccf62afb6937: No bootstrap required, opened a new log
I20260709 14:55:10.446717 17742 ts_tablet_manager.cc:1403] T 876c059b51af47a9a687c1e92c95a515 P 450b7f1304cb4c2ca4c9ccf62afb6937: Time spent bootstrapping tablet: real 0.031s	user 0.023s	sys 0.004s
I20260709 14:55:10.447520 17750 raft_consensus.cc:493] T f9764d88fc354df8a8b107f95579fc60 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:55:10.448024 17750 raft_consensus.cc:3060] T f9764d88fc354df8a8b107f95579fc60 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:55:10.451438 17742 raft_consensus.cc:359] T 876c059b51af47a9a687c1e92c95a515 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:10.452836 17742 raft_consensus.cc:385] T 876c059b51af47a9a687c1e92c95a515 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:55:10.453282 17742 raft_consensus.cc:740] T 876c059b51af47a9a687c1e92c95a515 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 450b7f1304cb4c2ca4c9ccf62afb6937, State: Initialized, Role: FOLLOWER
I20260709 14:55:10.454749 17745 raft_consensus.cc:515] T f9509b6f243644ed9e147299153953b2 P 3f9e4abf970849caa70a02ede7f97cd8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
W20260709 14:55:10.456614 17665 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.65:43507, user_credentials={real_user=slave}} blocked reactor thread for 60166.5us
I20260709 14:55:10.454962 17764 raft_consensus.cc:493] T 2e8e053361a54d7c91f2fe670f4aa514 P 3f9e4abf970849caa70a02ede7f97cd8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:55:10.459208 17552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9509b6f243644ed9e147299153953b2" candidate_uuid: "3f9e4abf970849caa70a02ede7f97cd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2be4570f313d4a219ad149e28ab546c5"
I20260709 14:55:10.459874 17552 raft_consensus.cc:3060] T f9509b6f243644ed9e147299153953b2 P 2be4570f313d4a219ad149e28ab546c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:55:10.459671 17764 raft_consensus.cc:515] T 2e8e053361a54d7c91f2fe670f4aa514 P 3f9e4abf970849caa70a02ede7f97cd8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:10.462374 17764 leader_election.cc:290] T 2e8e053361a54d7c91f2fe670f4aa514 P 3f9e4abf970849caa70a02ede7f97cd8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2be4570f313d4a219ad149e28ab546c5 (127.6.101.65:43507), 450b7f1304cb4c2ca4c9ccf62afb6937 (127.6.101.66:35877)
I20260709 14:55:10.454869 17742 consensus_queue.cc:260] T 876c059b51af47a9a687c1e92c95a515 P 450b7f1304cb4c2ca4c9ccf62afb6937 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:10.463148 17764 raft_consensus.cc:493] T 2ee76f3707314e23b707060672d77fdb P 3f9e4abf970849caa70a02ede7f97cd8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:55:10.469731 17627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e8e053361a54d7c91f2fe670f4aa514" candidate_uuid: "3f9e4abf970849caa70a02ede7f97cd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" is_pre_election: true
I20260709 14:55:10.470808 17627 raft_consensus.cc:2468] T 2e8e053361a54d7c91f2fe670f4aa514 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f9e4abf970849caa70a02ede7f97cd8 in term 0.
I20260709 14:55:10.475109 17551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e8e053361a54d7c91f2fe670f4aa514" candidate_uuid: "3f9e4abf970849caa70a02ede7f97cd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2be4570f313d4a219ad149e28ab546c5" is_pre_election: true
I20260709 14:55:10.469784 17553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dde79436f56b4ce7805822a819a1d9bf" candidate_uuid: "3f9e4abf970849caa70a02ede7f97cd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2be4570f313d4a219ad149e28ab546c5" is_pre_election: true
I20260709 14:55:10.478022 17743 ts_tablet_manager.cc:1434] T 2ee76f3707314e23b707060672d77fdb P 3f9e4abf970849caa70a02ede7f97cd8: Time spent starting tablet: real 0.108s	user 0.006s	sys 0.008s
I20260709 14:55:10.476770 17667 leader_election.cc:304] T 2e8e053361a54d7c91f2fe670f4aa514 P 3f9e4abf970849caa70a02ede7f97cd8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f9e4abf970849caa70a02ede7f97cd8, 450b7f1304cb4c2ca4c9ccf62afb6937; no voters: 
I20260709 14:55:10.479849 17743 tablet_bootstrap.cc:492] T 876c059b51af47a9a687c1e92c95a515 P 3f9e4abf970849caa70a02ede7f97cd8: Bootstrap starting.
I20260709 14:55:10.480091 17766 raft_consensus.cc:2804] T 2e8e053361a54d7c91f2fe670f4aa514 P 3f9e4abf970849caa70a02ede7f97cd8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:55:10.480564 17766 raft_consensus.cc:493] T 2e8e053361a54d7c91f2fe670f4aa514 P 3f9e4abf970849caa70a02ede7f97cd8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:55:10.480932 17766 raft_consensus.cc:3060] T 2e8e053361a54d7c91f2fe670f4aa514 P 3f9e4abf970849caa70a02ede7f97cd8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:55:10.467662 17764 raft_consensus.cc:515] T 2ee76f3707314e23b707060672d77fdb P 3f9e4abf970849caa70a02ede7f97cd8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:10.485564 17745 leader_election.cc:290] T f9509b6f243644ed9e147299153953b2 P 3f9e4abf970849caa70a02ede7f97cd8 [CANDIDATE]: Term 1 election: Requested vote from peers 2be4570f313d4a219ad149e28ab546c5 (127.6.101.65:43507), 450b7f1304cb4c2ca4c9ccf62afb6937 (127.6.101.66:35877)
I20260709 14:55:10.487874 17627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9509b6f243644ed9e147299153953b2" candidate_uuid: "3f9e4abf970849caa70a02ede7f97cd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937"
W20260709 14:55:10.489907 17667 leader_election.cc:343] T f9509b6f243644ed9e147299153953b2 P 3f9e4abf970849caa70a02ede7f97cd8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 450b7f1304cb4c2ca4c9ccf62afb6937 (127.6.101.66:35877): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:55:10.494099 17702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee76f3707314e23b707060672d77fdb" candidate_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f9e4abf970849caa70a02ede7f97cd8" is_pre_election: true
I20260709 14:55:10.494359 17701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9764d88fc354df8a8b107f95579fc60" candidate_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f9e4abf970849caa70a02ede7f97cd8" is_pre_election: true
I20260709 14:55:10.495268 17702 raft_consensus.cc:2468] T 2ee76f3707314e23b707060672d77fdb P 3f9e4abf970849caa70a02ede7f97cd8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 450b7f1304cb4c2ca4c9ccf62afb6937 in term 0.
I20260709 14:55:10.496099 17552 raft_consensus.cc:2468] T f9509b6f243644ed9e147299153953b2 P 2be4570f313d4a219ad149e28ab546c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f9e4abf970849caa70a02ede7f97cd8 in term 1.
W20260709 14:55:10.497102 17593 leader_election.cc:343] T f9764d88fc354df8a8b107f95579fc60 P 450b7f1304cb4c2ca4c9ccf62afb6937 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f9e4abf970849caa70a02ede7f97cd8 (127.6.101.67:42489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:55:10.498430 17746 tablet_bootstrap.cc:492] T 2ee76f3707314e23b707060672d77fdb P 2be4570f313d4a219ad149e28ab546c5: No bootstrap required, opened a new log
I20260709 14:55:10.499183 17746 ts_tablet_manager.cc:1403] T 2ee76f3707314e23b707060672d77fdb P 2be4570f313d4a219ad149e28ab546c5: Time spent bootstrapping tablet: real 0.100s	user 0.027s	sys 0.059s
I20260709 14:55:10.498837 17593 leader_election.cc:304] T 2ee76f3707314e23b707060672d77fdb P 450b7f1304cb4c2ca4c9ccf62afb6937 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f9e4abf970849caa70a02ede7f97cd8, 450b7f1304cb4c2ca4c9ccf62afb6937; no voters: 2be4570f313d4a219ad149e28ab546c5
I20260709 14:55:10.502744 17764 leader_election.cc:290] T 2ee76f3707314e23b707060672d77fdb P 3f9e4abf970849caa70a02ede7f97cd8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2be4570f313d4a219ad149e28ab546c5 (127.6.101.65:43507), 450b7f1304cb4c2ca4c9ccf62afb6937 (127.6.101.66:35877)
I20260709 14:55:10.504094 17627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee76f3707314e23b707060672d77fdb" candidate_uuid: "3f9e4abf970849caa70a02ede7f97cd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" is_pre_election: true
I20260709 14:55:10.504858 17627 raft_consensus.cc:2468] T 2ee76f3707314e23b707060672d77fdb P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f9e4abf970849caa70a02ede7f97cd8 in term 0.
I20260709 14:55:10.506098 17667 leader_election.cc:304] T 2ee76f3707314e23b707060672d77fdb P 3f9e4abf970849caa70a02ede7f97cd8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f9e4abf970849caa70a02ede7f97cd8, 450b7f1304cb4c2ca4c9ccf62afb6937; no voters: 
I20260709 14:55:10.507089 17750 raft_consensus.cc:515] T f9764d88fc354df8a8b107f95579fc60 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } } peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } }
I20260709 14:55:10.508558 17553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee76f3707314e23b707060672d77fdb" candidate_uuid: "3f9e4abf970849caa70a02ede7f97cd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2be4570f313d4a219ad149e28ab546c5" is_pre_election: true
I20260709 14:55:10.510171 17764 raft_consensus.cc:2804] T 2ee76f3707314e23b707060672d77fdb P 3f9e4abf970849caa70a02ede7f97cd8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:55:10.510715 17764 raft_consensus.cc:493] T 2ee76f3707314e23b707060672d77fdb P 3f9e4abf970849caa70a02ede7f97cd8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:55:10.511077 17764 raft_consensus.cc:3060] T 2ee76f3707314e23b707060672d77fdb P 3f9e4abf970849caa70a02ede7f97cd8 [term 0 FOLLOWER]: Advancing to term 1
W20260709 14:55:10.511088 17665 leader_election.cc:343] T 2e8e053361a54d7c91f2fe670f4aa514 P 3f9e4abf970849caa70a02ede7f97cd8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2be4570f313d4a219ad149e28ab546c5 (127.6.101.65:43507): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:55:10.516568 17702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9764d88fc354df8a8b107f95579fc60" candidate_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f9e4abf970849caa70a02ede7f97cd8"
W20260709 14:55:10.519300 17593 leader_election.cc:343] T f9764d88fc354df8a8b107f95579fc60 P 450b7f1304cb4c2ca4c9ccf62afb6937 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3f9e4abf970849caa70a02ede7f97cd8 (127.6.101.67:42489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:55:10.520102 17743 tablet_bootstrap.cc:654] T 876c059b51af47a9a687c1e92c95a515 P 3f9e4abf970849caa70a02ede7f97cd8: Neither blocks nor log segments found. Creating new log.
I20260709 14:55:10.521993 17742 ts_tablet_manager.cc:1434] T 876c059b51af47a9a687c1e92c95a515 P 450b7f1304cb4c2ca4c9ccf62afb6937: Time spent starting tablet: real 0.075s	user 0.022s	sys 0.021s
I20260709 14:55:10.522850 17746 raft_consensus.cc:359] T 2ee76f3707314e23b707060672d77fdb P 2be4570f313d4a219ad149e28ab546c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:10.523301 17742 tablet_bootstrap.cc:492] T 87215280bbb9434c86b8e0c862d78e44 P 450b7f1304cb4c2ca4c9ccf62afb6937: Bootstrap starting.
W20260709 14:55:10.524758 17665 leader_election.cc:343] T dde79436f56b4ce7805822a819a1d9bf P 3f9e4abf970849caa70a02ede7f97cd8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2be4570f313d4a219ad149e28ab546c5 (127.6.101.65:43507): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:55:10.520185 17766 raft_consensus.cc:515] T 2e8e053361a54d7c91f2fe670f4aa514 P 3f9e4abf970849caa70a02ede7f97cd8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:10.523962 17746 raft_consensus.cc:385] T 2ee76f3707314e23b707060672d77fdb P 2be4570f313d4a219ad149e28ab546c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:55:10.531298 17746 raft_consensus.cc:740] T 2ee76f3707314e23b707060672d77fdb P 2be4570f313d4a219ad149e28ab546c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2be4570f313d4a219ad149e28ab546c5, State: Initialized, Role: FOLLOWER
I20260709 14:55:10.532415 17627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e8e053361a54d7c91f2fe670f4aa514" candidate_uuid: "3f9e4abf970849caa70a02ede7f97cd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937"
I20260709 14:55:10.532415 17746 consensus_queue.cc:260] T 2ee76f3707314e23b707060672d77fdb P 2be4570f313d4a219ad149e28ab546c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:10.533778 17627 raft_consensus.cc:3060] T 2e8e053361a54d7c91f2fe670f4aa514 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:55:10.533987 17742 tablet_bootstrap.cc:654] T 87215280bbb9434c86b8e0c862d78e44 P 450b7f1304cb4c2ca4c9ccf62afb6937: Neither blocks nor log segments found. Creating new log.
I20260709 14:55:10.525460 17665 leader_election.cc:304] T dde79436f56b4ce7805822a819a1d9bf P 3f9e4abf970849caa70a02ede7f97cd8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f9e4abf970849caa70a02ede7f97cd8; no voters: 2be4570f313d4a219ad149e28ab546c5, 450b7f1304cb4c2ca4c9ccf62afb6937
I20260709 14:55:10.535853 17750 leader_election.cc:290] T f9764d88fc354df8a8b107f95579fc60 P 450b7f1304cb4c2ca4c9ccf62afb6937 [CANDIDATE]: Term 1 election: Requested vote from peers 3f9e4abf970849caa70a02ede7f97cd8 (127.6.101.67:42489), 2be4570f313d4a219ad149e28ab546c5 (127.6.101.65:43507)
I20260709 14:55:10.536542 17766 leader_election.cc:290] T 2e8e053361a54d7c91f2fe670f4aa514 P 3f9e4abf970849caa70a02ede7f97cd8 [CANDIDATE]: Term 1 election: Requested vote from peers 2be4570f313d4a219ad149e28ab546c5 (127.6.101.65:43507), 450b7f1304cb4c2ca4c9ccf62afb6937 (127.6.101.66:35877)
I20260709 14:55:10.536871 17762 raft_consensus.cc:2749] T dde79436f56b4ce7805822a819a1d9bf P 3f9e4abf970849caa70a02ede7f97cd8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 14:55:10.538117 17665 leader_election.cc:343] T 2ee76f3707314e23b707060672d77fdb P 3f9e4abf970849caa70a02ede7f97cd8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2be4570f313d4a219ad149e28ab546c5 (127.6.101.65:43507): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:55:10.540345 17665 leader_election.cc:304] T f9509b6f243644ed9e147299153953b2 P 3f9e4abf970849caa70a02ede7f97cd8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2be4570f313d4a219ad149e28ab546c5, 3f9e4abf970849caa70a02ede7f97cd8; no voters: 450b7f1304cb4c2ca4c9ccf62afb6937
I20260709 14:55:10.540692 17746 ts_tablet_manager.cc:1434] T 2ee76f3707314e23b707060672d77fdb P 2be4570f313d4a219ad149e28ab546c5: Time spent starting tablet: real 0.041s	user 0.011s	sys 0.001s
I20260709 14:55:10.541462 17762 raft_consensus.cc:2804] T f9509b6f243644ed9e147299153953b2 P 3f9e4abf970849caa70a02ede7f97cd8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:55:10.541990 17762 raft_consensus.cc:697] T f9509b6f243644ed9e147299153953b2 P 3f9e4abf970849caa70a02ede7f97cd8 [term 1 LEADER]: Becoming Leader. State: Replica: 3f9e4abf970849caa70a02ede7f97cd8, State: Running, Role: LEADER
I20260709 14:55:10.542346 17746 tablet_bootstrap.cc:492] T dde79436f56b4ce7805822a819a1d9bf P 2be4570f313d4a219ad149e28ab546c5: Bootstrap starting.
I20260709 14:55:10.543924 17552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9764d88fc354df8a8b107f95579fc60" candidate_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2be4570f313d4a219ad149e28ab546c5"
I20260709 14:55:10.543407 17762 consensus_queue.cc:237] T f9509b6f243644ed9e147299153953b2 P 3f9e4abf970849caa70a02ede7f97cd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:10.544554 17552 raft_consensus.cc:3060] T f9764d88fc354df8a8b107f95579fc60 P 2be4570f313d4a219ad149e28ab546c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:55:10.553640 17553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e8e053361a54d7c91f2fe670f4aa514" candidate_uuid: "3f9e4abf970849caa70a02ede7f97cd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2be4570f313d4a219ad149e28ab546c5"
I20260709 14:55:10.567041 17552 raft_consensus.cc:2468] T f9764d88fc354df8a8b107f95579fc60 P 2be4570f313d4a219ad149e28ab546c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 450b7f1304cb4c2ca4c9ccf62afb6937 in term 1.
I20260709 14:55:10.567327 17764 raft_consensus.cc:515] T 2ee76f3707314e23b707060672d77fdb P 3f9e4abf970849caa70a02ede7f97cd8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:10.569187 17591 leader_election.cc:304] T f9764d88fc354df8a8b107f95579fc60 P 450b7f1304cb4c2ca4c9ccf62afb6937 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2be4570f313d4a219ad149e28ab546c5, 450b7f1304cb4c2ca4c9ccf62afb6937; no voters: 3f9e4abf970849caa70a02ede7f97cd8
I20260709 14:55:10.569423 17768 raft_consensus.cc:2804] T 2ee76f3707314e23b707060672d77fdb P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:55:10.569998 17768 raft_consensus.cc:493] T 2ee76f3707314e23b707060672d77fdb P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:55:10.570374 17768 raft_consensus.cc:3060] T 2ee76f3707314e23b707060672d77fdb P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:55:10.570950 17767 raft_consensus.cc:2804] T f9764d88fc354df8a8b107f95579fc60 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:55:10.571520 17743 tablet_bootstrap.cc:492] T 876c059b51af47a9a687c1e92c95a515 P 3f9e4abf970849caa70a02ede7f97cd8: No bootstrap required, opened a new log
I20260709 14:55:10.572551 17743 ts_tablet_manager.cc:1403] T 876c059b51af47a9a687c1e92c95a515 P 3f9e4abf970849caa70a02ede7f97cd8: Time spent bootstrapping tablet: real 0.093s	user 0.013s	sys 0.005s
I20260709 14:55:10.573149 17750 raft_consensus.cc:493] T 876c059b51af47a9a687c1e92c95a515 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:55:10.573632 17628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee76f3707314e23b707060672d77fdb" candidate_uuid: "3f9e4abf970849caa70a02ede7f97cd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937"
I20260709 14:55:10.571537 17767 raft_consensus.cc:697] T f9764d88fc354df8a8b107f95579fc60 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 1 LEADER]: Becoming Leader. State: Replica: 450b7f1304cb4c2ca4c9ccf62afb6937, State: Running, Role: LEADER
I20260709 14:55:10.574462 17764 leader_election.cc:290] T 2ee76f3707314e23b707060672d77fdb P 3f9e4abf970849caa70a02ede7f97cd8 [CANDIDATE]: Term 1 election: Requested vote from peers 2be4570f313d4a219ad149e28ab546c5 (127.6.101.65:43507), 450b7f1304cb4c2ca4c9ccf62afb6937 (127.6.101.66:35877)
I20260709 14:55:10.574986 17767 consensus_queue.cc:237] T f9764d88fc354df8a8b107f95579fc60 P 450b7f1304cb4c2ca4c9ccf62afb6937 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } } peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } }
W20260709 14:55:10.574672 17665 leader_election.cc:343] T 2e8e053361a54d7c91f2fe670f4aa514 P 3f9e4abf970849caa70a02ede7f97cd8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2be4570f313d4a219ad149e28ab546c5 (127.6.101.65:43507): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:55:10.577848 17750 raft_consensus.cc:515] T 876c059b51af47a9a687c1e92c95a515 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:10.578285 17746 tablet_bootstrap.cc:654] T dde79436f56b4ce7805822a819a1d9bf P 2be4570f313d4a219ad149e28ab546c5: Neither blocks nor log segments found. Creating new log.
I20260709 14:55:10.579133 17627 raft_consensus.cc:2468] T 2e8e053361a54d7c91f2fe670f4aa514 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f9e4abf970849caa70a02ede7f97cd8 in term 1.
I20260709 14:55:10.580873 17667 leader_election.cc:304] T 2e8e053361a54d7c91f2fe670f4aa514 P 3f9e4abf970849caa70a02ede7f97cd8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f9e4abf970849caa70a02ede7f97cd8, 450b7f1304cb4c2ca4c9ccf62afb6937; no voters: 2be4570f313d4a219ad149e28ab546c5
I20260709 14:55:10.581511 17553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "876c059b51af47a9a687c1e92c95a515" candidate_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2be4570f313d4a219ad149e28ab546c5" is_pre_election: true
W20260709 14:55:10.583374 17591 leader_election.cc:343] T 876c059b51af47a9a687c1e92c95a515 P 450b7f1304cb4c2ca4c9ccf62afb6937 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2be4570f313d4a219ad149e28ab546c5 (127.6.101.65:43507): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:55:10.584259 17750 leader_election.cc:290] T 876c059b51af47a9a687c1e92c95a515 P 450b7f1304cb4c2ca4c9ccf62afb6937 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2be4570f313d4a219ad149e28ab546c5 (127.6.101.65:43507), 3f9e4abf970849caa70a02ede7f97cd8 (127.6.101.67:42489)
I20260709 14:55:10.586126 17702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "876c059b51af47a9a687c1e92c95a515" candidate_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f9e4abf970849caa70a02ede7f97cd8" is_pre_election: true
W20260709 14:55:10.589783 17593 leader_election.cc:343] T 876c059b51af47a9a687c1e92c95a515 P 450b7f1304cb4c2ca4c9ccf62afb6937 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f9e4abf970849caa70a02ede7f97cd8 (127.6.101.67:42489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:55:10.592111 17552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee76f3707314e23b707060672d77fdb" candidate_uuid: "3f9e4abf970849caa70a02ede7f97cd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2be4570f313d4a219ad149e28ab546c5"
I20260709 14:55:10.593361 17552 raft_consensus.cc:3060] T 2ee76f3707314e23b707060672d77fdb P 2be4570f313d4a219ad149e28ab546c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:55:10.594595 17746 tablet_bootstrap.cc:492] T dde79436f56b4ce7805822a819a1d9bf P 2be4570f313d4a219ad149e28ab546c5: No bootstrap required, opened a new log
I20260709 14:55:10.591240 17593 leader_election.cc:304] T 876c059b51af47a9a687c1e92c95a515 P 450b7f1304cb4c2ca4c9ccf62afb6937 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 450b7f1304cb4c2ca4c9ccf62afb6937; no voters: 2be4570f313d4a219ad149e28ab546c5, 3f9e4abf970849caa70a02ede7f97cd8
I20260709 14:55:10.595278 17746 ts_tablet_manager.cc:1403] T dde79436f56b4ce7805822a819a1d9bf P 2be4570f313d4a219ad149e28ab546c5: Time spent bootstrapping tablet: real 0.053s	user 0.012s	sys 0.009s
I20260709 14:55:10.596326 17767 raft_consensus.cc:2749] T 876c059b51af47a9a687c1e92c95a515 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:55:10.589856 17762 raft_consensus.cc:2804] T 2e8e053361a54d7c91f2fe670f4aa514 P 3f9e4abf970849caa70a02ede7f97cd8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:55:10.597690 17762 raft_consensus.cc:697] T 2e8e053361a54d7c91f2fe670f4aa514 P 3f9e4abf970849caa70a02ede7f97cd8 [term 1 LEADER]: Becoming Leader. State: Replica: 3f9e4abf970849caa70a02ede7f97cd8, State: Running, Role: LEADER
I20260709 14:55:10.598601 17762 consensus_queue.cc:237] T 2e8e053361a54d7c91f2fe670f4aa514 P 3f9e4abf970849caa70a02ede7f97cd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:10.599570 17746 raft_consensus.cc:359] T dde79436f56b4ce7805822a819a1d9bf P 2be4570f313d4a219ad149e28ab546c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:10.600674 17746 raft_consensus.cc:385] T dde79436f56b4ce7805822a819a1d9bf P 2be4570f313d4a219ad149e28ab546c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:55:10.601011 17746 raft_consensus.cc:740] T dde79436f56b4ce7805822a819a1d9bf P 2be4570f313d4a219ad149e28ab546c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2be4570f313d4a219ad149e28ab546c5, State: Initialized, Role: FOLLOWER
I20260709 14:55:10.590675 17743 raft_consensus.cc:359] T 876c059b51af47a9a687c1e92c95a515 P 3f9e4abf970849caa70a02ede7f97cd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:10.602533 17743 raft_consensus.cc:385] T 876c059b51af47a9a687c1e92c95a515 P 3f9e4abf970849caa70a02ede7f97cd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:55:10.602855 17743 raft_consensus.cc:740] T 876c059b51af47a9a687c1e92c95a515 P 3f9e4abf970849caa70a02ede7f97cd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f9e4abf970849caa70a02ede7f97cd8, State: Initialized, Role: FOLLOWER
I20260709 14:55:10.604233 17742 tablet_bootstrap.cc:492] T 87215280bbb9434c86b8e0c862d78e44 P 450b7f1304cb4c2ca4c9ccf62afb6937: No bootstrap required, opened a new log
I20260709 14:55:10.604949 17742 ts_tablet_manager.cc:1403] T 87215280bbb9434c86b8e0c862d78e44 P 450b7f1304cb4c2ca4c9ccf62afb6937: Time spent bootstrapping tablet: real 0.082s	user 0.014s	sys 0.003s
I20260709 14:55:10.603319 17450 catalog_manager.cc:5697] T f9764d88fc354df8a8b107f95579fc60 P 450b7f1304cb4c2ca4c9ccf62afb6937 reported cstate change: term changed from 0 to 1, leader changed from <none> to 450b7f1304cb4c2ca4c9ccf62afb6937 (127.6.101.66). New cstate: current_term: 1 leader_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } health_report { overall_health: UNKNOWN } } }
I20260709 14:55:10.604233 17743 consensus_queue.cc:260] T 876c059b51af47a9a687c1e92c95a515 P 3f9e4abf970849caa70a02ede7f97cd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:10.605602 17746 consensus_queue.cc:260] T dde79436f56b4ce7805822a819a1d9bf P 2be4570f313d4a219ad149e28ab546c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:10.608124 17743 ts_tablet_manager.cc:1434] T 876c059b51af47a9a687c1e92c95a515 P 3f9e4abf970849caa70a02ede7f97cd8: Time spent starting tablet: real 0.035s	user 0.011s	sys 0.000s
I20260709 14:55:10.604729 17552 raft_consensus.cc:2468] T 2ee76f3707314e23b707060672d77fdb P 2be4570f313d4a219ad149e28ab546c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f9e4abf970849caa70a02ede7f97cd8 in term 1.
I20260709 14:55:10.604468 17768 raft_consensus.cc:515] T 2ee76f3707314e23b707060672d77fdb P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:10.610038 17628 raft_consensus.cc:2393] T 2ee76f3707314e23b707060672d77fdb P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f9e4abf970849caa70a02ede7f97cd8 in current term 1: Already voted for candidate 450b7f1304cb4c2ca4c9ccf62afb6937 in this term.
I20260709 14:55:10.610280 17665 leader_election.cc:304] T 2ee76f3707314e23b707060672d77fdb P 3f9e4abf970849caa70a02ede7f97cd8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2be4570f313d4a219ad149e28ab546c5, 3f9e4abf970849caa70a02ede7f97cd8; no voters: 
I20260709 14:55:10.611370 17764 raft_consensus.cc:2804] T 2ee76f3707314e23b707060672d77fdb P 3f9e4abf970849caa70a02ede7f97cd8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:55:10.611810 17743 tablet_bootstrap.cc:492] T 87215280bbb9434c86b8e0c862d78e44 P 3f9e4abf970849caa70a02ede7f97cd8: Bootstrap starting.
I20260709 14:55:10.612368 17764 raft_consensus.cc:697] T 2ee76f3707314e23b707060672d77fdb P 3f9e4abf970849caa70a02ede7f97cd8 [term 1 LEADER]: Becoming Leader. State: Replica: 3f9e4abf970849caa70a02ede7f97cd8, State: Running, Role: LEADER
I20260709 14:55:10.610078 17746 ts_tablet_manager.cc:1434] T dde79436f56b4ce7805822a819a1d9bf P 2be4570f313d4a219ad149e28ab546c5: Time spent starting tablet: real 0.014s	user 0.009s	sys 0.000s
I20260709 14:55:10.613778 17764 consensus_queue.cc:237] T 2ee76f3707314e23b707060672d77fdb P 3f9e4abf970849caa70a02ede7f97cd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:10.614744 17746 tablet_bootstrap.cc:492] T 2e8e053361a54d7c91f2fe670f4aa514 P 2be4570f313d4a219ad149e28ab546c5: Bootstrap starting.
I20260709 14:55:10.620908 17768 leader_election.cc:290] T 2ee76f3707314e23b707060672d77fdb P 450b7f1304cb4c2ca4c9ccf62afb6937 [CANDIDATE]: Term 1 election: Requested vote from peers 2be4570f313d4a219ad149e28ab546c5 (127.6.101.65:43507), 3f9e4abf970849caa70a02ede7f97cd8 (127.6.101.67:42489)
I20260709 14:55:10.620100 17552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee76f3707314e23b707060672d77fdb" candidate_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2be4570f313d4a219ad149e28ab546c5"
I20260709 14:55:10.621001 17702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee76f3707314e23b707060672d77fdb" candidate_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f9e4abf970849caa70a02ede7f97cd8"
I20260709 14:55:10.611285 17451 catalog_manager.cc:5697] T f9509b6f243644ed9e147299153953b2 P 3f9e4abf970849caa70a02ede7f97cd8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3f9e4abf970849caa70a02ede7f97cd8 (127.6.101.67). New cstate: current_term: 1 leader_uuid: "3f9e4abf970849caa70a02ede7f97cd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } health_report { overall_health: HEALTHY } } }
I20260709 14:55:10.626859 17552 raft_consensus.cc:2393] T 2ee76f3707314e23b707060672d77fdb P 2be4570f313d4a219ad149e28ab546c5 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 450b7f1304cb4c2ca4c9ccf62afb6937 in current term 1: Already voted for candidate 3f9e4abf970849caa70a02ede7f97cd8 in this term.
I20260709 14:55:10.609159 17742 raft_consensus.cc:359] T 87215280bbb9434c86b8e0c862d78e44 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:10.627691 17762 raft_consensus.cc:493] T 876c059b51af47a9a687c1e92c95a515 P 3f9e4abf970849caa70a02ede7f97cd8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:55:10.631565 17762 raft_consensus.cc:515] T 876c059b51af47a9a687c1e92c95a515 P 3f9e4abf970849caa70a02ede7f97cd8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:10.635172 17762 leader_election.cc:290] T 876c059b51af47a9a687c1e92c95a515 P 3f9e4abf970849caa70a02ede7f97cd8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2be4570f313d4a219ad149e28ab546c5 (127.6.101.65:43507), 450b7f1304cb4c2ca4c9ccf62afb6937 (127.6.101.66:35877)
I20260709 14:55:10.636160 17628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "876c059b51af47a9a687c1e92c95a515" candidate_uuid: "3f9e4abf970849caa70a02ede7f97cd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" is_pre_election: true
I20260709 14:55:10.635859 17552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "876c059b51af47a9a687c1e92c95a515" candidate_uuid: "3f9e4abf970849caa70a02ede7f97cd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2be4570f313d4a219ad149e28ab546c5" is_pre_election: true
I20260709 14:55:10.636881 17628 raft_consensus.cc:2468] T 876c059b51af47a9a687c1e92c95a515 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f9e4abf970849caa70a02ede7f97cd8 in term 0.
I20260709 14:55:10.629369 17593 leader_election.cc:304] T 2ee76f3707314e23b707060672d77fdb P 450b7f1304cb4c2ca4c9ccf62afb6937 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 450b7f1304cb4c2ca4c9ccf62afb6937; no voters: 2be4570f313d4a219ad149e28ab546c5, 3f9e4abf970849caa70a02ede7f97cd8
I20260709 14:55:10.638556 17667 leader_election.cc:304] T 876c059b51af47a9a687c1e92c95a515 P 3f9e4abf970849caa70a02ede7f97cd8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f9e4abf970849caa70a02ede7f97cd8, 450b7f1304cb4c2ca4c9ccf62afb6937; no voters: 
I20260709 14:55:10.639708 17768 raft_consensus.cc:2749] T 2ee76f3707314e23b707060672d77fdb P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 14:55:10.639981 17665 leader_election.cc:343] T 876c059b51af47a9a687c1e92c95a515 P 3f9e4abf970849caa70a02ede7f97cd8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2be4570f313d4a219ad149e28ab546c5 (127.6.101.65:43507): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:55:10.641578 17762 raft_consensus.cc:2804] T 876c059b51af47a9a687c1e92c95a515 P 3f9e4abf970849caa70a02ede7f97cd8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:55:10.642201 17762 raft_consensus.cc:493] T 876c059b51af47a9a687c1e92c95a515 P 3f9e4abf970849caa70a02ede7f97cd8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:55:10.642799 17762 raft_consensus.cc:3060] T 876c059b51af47a9a687c1e92c95a515 P 3f9e4abf970849caa70a02ede7f97cd8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:55:10.629674 17742 raft_consensus.cc:385] T 87215280bbb9434c86b8e0c862d78e44 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:55:10.642454 17746 tablet_bootstrap.cc:654] T 2e8e053361a54d7c91f2fe670f4aa514 P 2be4570f313d4a219ad149e28ab546c5: Neither blocks nor log segments found. Creating new log.
I20260709 14:55:10.645058 17742 raft_consensus.cc:740] T 87215280bbb9434c86b8e0c862d78e44 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 450b7f1304cb4c2ca4c9ccf62afb6937, State: Initialized, Role: FOLLOWER
I20260709 14:55:10.628737 17743 tablet_bootstrap.cc:654] T 87215280bbb9434c86b8e0c862d78e44 P 3f9e4abf970849caa70a02ede7f97cd8: Neither blocks nor log segments found. Creating new log.
I20260709 14:55:10.649983 17742 consensus_queue.cc:260] T 87215280bbb9434c86b8e0c862d78e44 P 450b7f1304cb4c2ca4c9ccf62afb6937 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:10.654088 17762 raft_consensus.cc:515] T 876c059b51af47a9a687c1e92c95a515 P 3f9e4abf970849caa70a02ede7f97cd8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:10.657832 17742 ts_tablet_manager.cc:1434] T 87215280bbb9434c86b8e0c862d78e44 P 450b7f1304cb4c2ca4c9ccf62afb6937: Time spent starting tablet: real 0.052s	user 0.011s	sys 0.000s
I20260709 14:55:10.659116 17552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "876c059b51af47a9a687c1e92c95a515" candidate_uuid: "3f9e4abf970849caa70a02ede7f97cd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2be4570f313d4a219ad149e28ab546c5"
I20260709 14:55:10.659466 17742 tablet_bootstrap.cc:492] T 062ea10ecbd54055988e22c53a4387c5 P 450b7f1304cb4c2ca4c9ccf62afb6937: Bootstrap starting.
I20260709 14:55:10.661927 17628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "876c059b51af47a9a687c1e92c95a515" candidate_uuid: "3f9e4abf970849caa70a02ede7f97cd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937"
I20260709 14:55:10.663338 17628 raft_consensus.cc:3060] T 876c059b51af47a9a687c1e92c95a515 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:55:10.677919 17762 leader_election.cc:290] T 876c059b51af47a9a687c1e92c95a515 P 3f9e4abf970849caa70a02ede7f97cd8 [CANDIDATE]: Term 1 election: Requested vote from peers 2be4570f313d4a219ad149e28ab546c5 (127.6.101.65:43507), 450b7f1304cb4c2ca4c9ccf62afb6937 (127.6.101.66:35877)
I20260709 14:55:10.690202 17752 raft_consensus.cc:493] T dde79436f56b4ce7805822a819a1d9bf P 2be4570f313d4a219ad149e28ab546c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:55:10.687505 17665 leader_election.cc:343] T 876c059b51af47a9a687c1e92c95a515 P 3f9e4abf970849caa70a02ede7f97cd8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2be4570f313d4a219ad149e28ab546c5 (127.6.101.65:43507): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:55:10.690984 17752 raft_consensus.cc:515] T dde79436f56b4ce7805822a819a1d9bf P 2be4570f313d4a219ad149e28ab546c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:10.696568 17752 leader_election.cc:290] T dde79436f56b4ce7805822a819a1d9bf P 2be4570f313d4a219ad149e28ab546c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 450b7f1304cb4c2ca4c9ccf62afb6937 (127.6.101.66:35877), 3f9e4abf970849caa70a02ede7f97cd8 (127.6.101.67:42489)
I20260709 14:55:10.697556 17743 tablet_bootstrap.cc:492] T 87215280bbb9434c86b8e0c862d78e44 P 3f9e4abf970849caa70a02ede7f97cd8: No bootstrap required, opened a new log
I20260709 14:55:10.702839 17743 ts_tablet_manager.cc:1403] T 87215280bbb9434c86b8e0c862d78e44 P 3f9e4abf970849caa70a02ede7f97cd8: Time spent bootstrapping tablet: real 0.091s	user 0.021s	sys 0.005s
I20260709 14:55:10.703478 17746 tablet_bootstrap.cc:492] T 2e8e053361a54d7c91f2fe670f4aa514 P 2be4570f313d4a219ad149e28ab546c5: No bootstrap required, opened a new log
I20260709 14:55:10.709815 17746 ts_tablet_manager.cc:1403] T 2e8e053361a54d7c91f2fe670f4aa514 P 2be4570f313d4a219ad149e28ab546c5: Time spent bootstrapping tablet: real 0.095s	user 0.021s	sys 0.015s
I20260709 14:55:10.714648 17628 raft_consensus.cc:2468] T 876c059b51af47a9a687c1e92c95a515 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f9e4abf970849caa70a02ede7f97cd8 in term 1.
I20260709 14:55:10.716416 17667 leader_election.cc:304] T 876c059b51af47a9a687c1e92c95a515 P 3f9e4abf970849caa70a02ede7f97cd8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f9e4abf970849caa70a02ede7f97cd8, 450b7f1304cb4c2ca4c9ccf62afb6937; no voters: 2be4570f313d4a219ad149e28ab546c5
I20260709 14:55:10.717984 17742 tablet_bootstrap.cc:654] T 062ea10ecbd54055988e22c53a4387c5 P 450b7f1304cb4c2ca4c9ccf62afb6937: Neither blocks nor log segments found. Creating new log.
I20260709 14:55:10.718178 17762 raft_consensus.cc:2804] T 876c059b51af47a9a687c1e92c95a515 P 3f9e4abf970849caa70a02ede7f97cd8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:55:10.718902 17762 raft_consensus.cc:697] T 876c059b51af47a9a687c1e92c95a515 P 3f9e4abf970849caa70a02ede7f97cd8 [term 1 LEADER]: Becoming Leader. State: Replica: 3f9e4abf970849caa70a02ede7f97cd8, State: Running, Role: LEADER
I20260709 14:55:10.719833 17762 consensus_queue.cc:237] T 876c059b51af47a9a687c1e92c95a515 P 3f9e4abf970849caa70a02ede7f97cd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:10.721504 17743 raft_consensus.cc:359] T 87215280bbb9434c86b8e0c862d78e44 P 3f9e4abf970849caa70a02ede7f97cd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:10.723126 17743 raft_consensus.cc:385] T 87215280bbb9434c86b8e0c862d78e44 P 3f9e4abf970849caa70a02ede7f97cd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:55:10.723479 17743 raft_consensus.cc:740] T 87215280bbb9434c86b8e0c862d78e44 P 3f9e4abf970849caa70a02ede7f97cd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f9e4abf970849caa70a02ede7f97cd8, State: Initialized, Role: FOLLOWER
I20260709 14:55:10.728783 17746 raft_consensus.cc:359] T 2e8e053361a54d7c91f2fe670f4aa514 P 2be4570f313d4a219ad149e28ab546c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:10.740859 17746 raft_consensus.cc:385] T 2e8e053361a54d7c91f2fe670f4aa514 P 2be4570f313d4a219ad149e28ab546c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:55:10.741632 17746 raft_consensus.cc:740] T 2e8e053361a54d7c91f2fe670f4aa514 P 2be4570f313d4a219ad149e28ab546c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2be4570f313d4a219ad149e28ab546c5, State: Initialized, Role: FOLLOWER
I20260709 14:55:10.742884 17742 tablet_bootstrap.cc:492] T 062ea10ecbd54055988e22c53a4387c5 P 450b7f1304cb4c2ca4c9ccf62afb6937: No bootstrap required, opened a new log
I20260709 14:55:10.742524 17746 consensus_queue.cc:260] T 2e8e053361a54d7c91f2fe670f4aa514 P 2be4570f313d4a219ad149e28ab546c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:10.724805 17743 consensus_queue.cc:260] T 87215280bbb9434c86b8e0c862d78e44 P 3f9e4abf970849caa70a02ede7f97cd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:10.743777 17742 ts_tablet_manager.cc:1403] T 062ea10ecbd54055988e22c53a4387c5 P 450b7f1304cb4c2ca4c9ccf62afb6937: Time spent bootstrapping tablet: real 0.085s	user 0.012s	sys 0.019s
I20260709 14:55:10.746032 17743 ts_tablet_manager.cc:1434] T 87215280bbb9434c86b8e0c862d78e44 P 3f9e4abf970849caa70a02ede7f97cd8: Time spent starting tablet: real 0.043s	user 0.011s	sys 0.001s
I20260709 14:55:10.747495 17743 tablet_bootstrap.cc:492] T 062ea10ecbd54055988e22c53a4387c5 P 3f9e4abf970849caa70a02ede7f97cd8: Bootstrap starting.
I20260709 14:55:10.747681 17742 raft_consensus.cc:359] T 062ea10ecbd54055988e22c53a4387c5 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:10.748718 17742 raft_consensus.cc:385] T 062ea10ecbd54055988e22c53a4387c5 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:55:10.747968 17450 catalog_manager.cc:5697] T 2ee76f3707314e23b707060672d77fdb P 3f9e4abf970849caa70a02ede7f97cd8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3f9e4abf970849caa70a02ede7f97cd8 (127.6.101.67). New cstate: current_term: 1 leader_uuid: "3f9e4abf970849caa70a02ede7f97cd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } health_report { overall_health: HEALTHY } } }
I20260709 14:55:10.749104 17742 raft_consensus.cc:740] T 062ea10ecbd54055988e22c53a4387c5 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 450b7f1304cb4c2ca4c9ccf62afb6937, State: Initialized, Role: FOLLOWER
I20260709 14:55:10.750238 17702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dde79436f56b4ce7805822a819a1d9bf" candidate_uuid: "2be4570f313d4a219ad149e28ab546c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f9e4abf970849caa70a02ede7f97cd8" is_pre_election: true
I20260709 14:55:10.750986 17702 raft_consensus.cc:2468] T dde79436f56b4ce7805822a819a1d9bf P 3f9e4abf970849caa70a02ede7f97cd8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2be4570f313d4a219ad149e28ab546c5 in term 0.
I20260709 14:55:10.750373 17742 consensus_queue.cc:260] T 062ea10ecbd54055988e22c53a4387c5 P 450b7f1304cb4c2ca4c9ccf62afb6937 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:10.752508 17518 leader_election.cc:304] T dde79436f56b4ce7805822a819a1d9bf P 2be4570f313d4a219ad149e28ab546c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2be4570f313d4a219ad149e28ab546c5, 3f9e4abf970849caa70a02ede7f97cd8; no voters: 
I20260709 14:55:10.740031 17628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dde79436f56b4ce7805822a819a1d9bf" candidate_uuid: "2be4570f313d4a219ad149e28ab546c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" is_pre_election: true
I20260709 14:55:10.752229 17450 catalog_manager.cc:5697] T 2e8e053361a54d7c91f2fe670f4aa514 P 3f9e4abf970849caa70a02ede7f97cd8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3f9e4abf970849caa70a02ede7f97cd8 (127.6.101.67). New cstate: current_term: 1 leader_uuid: "3f9e4abf970849caa70a02ede7f97cd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } health_report { overall_health: HEALTHY } } }
W20260709 14:55:10.754667 17518 leader_election.cc:343] T dde79436f56b4ce7805822a819a1d9bf P 2be4570f313d4a219ad149e28ab546c5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 450b7f1304cb4c2ca4c9ccf62afb6937 (127.6.101.66:35877): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:55:10.754717 17752 raft_consensus.cc:2804] T dde79436f56b4ce7805822a819a1d9bf P 2be4570f313d4a219ad149e28ab546c5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:55:10.754402 17450 catalog_manager.cc:5697] T 876c059b51af47a9a687c1e92c95a515 P 3f9e4abf970849caa70a02ede7f97cd8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3f9e4abf970849caa70a02ede7f97cd8 (127.6.101.67). New cstate: current_term: 1 leader_uuid: "3f9e4abf970849caa70a02ede7f97cd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } health_report { overall_health: HEALTHY } } }
I20260709 14:55:10.755945 17743 tablet_bootstrap.cc:654] T 062ea10ecbd54055988e22c53a4387c5 P 3f9e4abf970849caa70a02ede7f97cd8: Neither blocks nor log segments found. Creating new log.
I20260709 14:55:10.755371 17752 raft_consensus.cc:493] T dde79436f56b4ce7805822a819a1d9bf P 2be4570f313d4a219ad149e28ab546c5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:55:10.762130 17752 raft_consensus.cc:3060] T dde79436f56b4ce7805822a819a1d9bf P 2be4570f313d4a219ad149e28ab546c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:55:10.777346 17742 ts_tablet_manager.cc:1434] T 062ea10ecbd54055988e22c53a4387c5 P 450b7f1304cb4c2ca4c9ccf62afb6937: Time spent starting tablet: real 0.033s	user 0.009s	sys 0.000s
I20260709 14:55:10.782975 17746 ts_tablet_manager.cc:1434] T 2e8e053361a54d7c91f2fe670f4aa514 P 2be4570f313d4a219ad149e28ab546c5: Time spent starting tablet: real 0.073s	user 0.032s	sys 0.004s
I20260709 14:55:10.784564 17742 tablet_bootstrap.cc:492] T dde79436f56b4ce7805822a819a1d9bf P 450b7f1304cb4c2ca4c9ccf62afb6937: Bootstrap starting.
I20260709 14:55:10.785560 17743 tablet_bootstrap.cc:492] T 062ea10ecbd54055988e22c53a4387c5 P 3f9e4abf970849caa70a02ede7f97cd8: No bootstrap required, opened a new log
I20260709 14:55:10.786206 17743 ts_tablet_manager.cc:1403] T 062ea10ecbd54055988e22c53a4387c5 P 3f9e4abf970849caa70a02ede7f97cd8: Time spent bootstrapping tablet: real 0.039s	user 0.023s	sys 0.012s
I20260709 14:55:10.787750 17752 raft_consensus.cc:515] T dde79436f56b4ce7805822a819a1d9bf P 2be4570f313d4a219ad149e28ab546c5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:10.790278 17743 raft_consensus.cc:359] T 062ea10ecbd54055988e22c53a4387c5 P 3f9e4abf970849caa70a02ede7f97cd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:10.791487 17743 raft_consensus.cc:385] T 062ea10ecbd54055988e22c53a4387c5 P 3f9e4abf970849caa70a02ede7f97cd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:55:10.791855 17743 raft_consensus.cc:740] T 062ea10ecbd54055988e22c53a4387c5 P 3f9e4abf970849caa70a02ede7f97cd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f9e4abf970849caa70a02ede7f97cd8, State: Initialized, Role: FOLLOWER
I20260709 14:55:10.792265 17628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dde79436f56b4ce7805822a819a1d9bf" candidate_uuid: "2be4570f313d4a219ad149e28ab546c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937"
I20260709 14:55:10.792403 17768 raft_consensus.cc:493] T 87215280bbb9434c86b8e0c862d78e44 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:55:10.793025 17743 consensus_queue.cc:260] T 062ea10ecbd54055988e22c53a4387c5 P 3f9e4abf970849caa70a02ede7f97cd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:10.794154 17742 tablet_bootstrap.cc:654] T dde79436f56b4ce7805822a819a1d9bf P 450b7f1304cb4c2ca4c9ccf62afb6937: Neither blocks nor log segments found. Creating new log.
I20260709 14:55:10.796108 17743 ts_tablet_manager.cc:1434] T 062ea10ecbd54055988e22c53a4387c5 P 3f9e4abf970849caa70a02ede7f97cd8: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.003s
I20260709 14:55:10.797914 17743 tablet_bootstrap.cc:492] T f9764d88fc354df8a8b107f95579fc60 P 3f9e4abf970849caa70a02ede7f97cd8: Bootstrap starting.
W20260709 14:55:10.798571 17518 leader_election.cc:343] T dde79436f56b4ce7805822a819a1d9bf P 2be4570f313d4a219ad149e28ab546c5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 450b7f1304cb4c2ca4c9ccf62afb6937 (127.6.101.66:35877): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:55:10.794066 17768 raft_consensus.cc:515] T 87215280bbb9434c86b8e0c862d78e44 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:10.804768 17552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87215280bbb9434c86b8e0c862d78e44" candidate_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2be4570f313d4a219ad149e28ab546c5" is_pre_election: true
W20260709 14:55:10.806878 17591 leader_election.cc:343] T 87215280bbb9434c86b8e0c862d78e44 P 450b7f1304cb4c2ca4c9ccf62afb6937 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2be4570f313d4a219ad149e28ab546c5 (127.6.101.65:43507): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:55:10.807264 17743 tablet_bootstrap.cc:654] T f9764d88fc354df8a8b107f95579fc60 P 3f9e4abf970849caa70a02ede7f97cd8: Neither blocks nor log segments found. Creating new log.
I20260709 14:55:10.809666 17702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87215280bbb9434c86b8e0c862d78e44" candidate_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f9e4abf970849caa70a02ede7f97cd8" is_pre_election: true
I20260709 14:55:10.810536 17702 raft_consensus.cc:2468] T 87215280bbb9434c86b8e0c862d78e44 P 3f9e4abf970849caa70a02ede7f97cd8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 450b7f1304cb4c2ca4c9ccf62afb6937 in term 0.
I20260709 14:55:10.812567 17593 leader_election.cc:304] T 87215280bbb9434c86b8e0c862d78e44 P 450b7f1304cb4c2ca4c9ccf62afb6937 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f9e4abf970849caa70a02ede7f97cd8, 450b7f1304cb4c2ca4c9ccf62afb6937; no voters: 2be4570f313d4a219ad149e28ab546c5
I20260709 14:55:10.813598 17746 tablet_bootstrap.cc:492] T 876c059b51af47a9a687c1e92c95a515 P 2be4570f313d4a219ad149e28ab546c5: Bootstrap starting.
I20260709 14:55:10.814340 17767 raft_consensus.cc:2804] T 87215280bbb9434c86b8e0c862d78e44 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:55:10.814790 17767 raft_consensus.cc:493] T 87215280bbb9434c86b8e0c862d78e44 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:55:10.815205 17767 raft_consensus.cc:3060] T 87215280bbb9434c86b8e0c862d78e44 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:55:10.826020 17746 tablet_bootstrap.cc:654] T 876c059b51af47a9a687c1e92c95a515 P 2be4570f313d4a219ad149e28ab546c5: Neither blocks nor log segments found. Creating new log.
I20260709 14:55:10.830494 17743 tablet_bootstrap.cc:492] T f9764d88fc354df8a8b107f95579fc60 P 3f9e4abf970849caa70a02ede7f97cd8: No bootstrap required, opened a new log
I20260709 14:55:10.831560 17743 ts_tablet_manager.cc:1403] T f9764d88fc354df8a8b107f95579fc60 P 3f9e4abf970849caa70a02ede7f97cd8: Time spent bootstrapping tablet: real 0.034s	user 0.022s	sys 0.008s
I20260709 14:55:10.833961 17768 leader_election.cc:290] T 87215280bbb9434c86b8e0c862d78e44 P 450b7f1304cb4c2ca4c9ccf62afb6937 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2be4570f313d4a219ad149e28ab546c5 (127.6.101.65:43507), 3f9e4abf970849caa70a02ede7f97cd8 (127.6.101.67:42489)
I20260709 14:55:10.835803 17743 raft_consensus.cc:359] T f9764d88fc354df8a8b107f95579fc60 P 3f9e4abf970849caa70a02ede7f97cd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } } peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } }
I20260709 14:55:10.836863 17743 raft_consensus.cc:385] T f9764d88fc354df8a8b107f95579fc60 P 3f9e4abf970849caa70a02ede7f97cd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:55:10.837137 17743 raft_consensus.cc:740] T f9764d88fc354df8a8b107f95579fc60 P 3f9e4abf970849caa70a02ede7f97cd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f9e4abf970849caa70a02ede7f97cd8, State: Initialized, Role: FOLLOWER
I20260709 14:55:10.838115 17743 consensus_queue.cc:260] T f9764d88fc354df8a8b107f95579fc60 P 3f9e4abf970849caa70a02ede7f97cd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } } peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } }
I20260709 14:55:10.840663 17743 ts_tablet_manager.cc:1434] T f9764d88fc354df8a8b107f95579fc60 P 3f9e4abf970849caa70a02ede7f97cd8: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 14:55:10.842497 17743 tablet_bootstrap.cc:492] T c26e43514e564f9e906f938557e587e8 P 3f9e4abf970849caa70a02ede7f97cd8: Bootstrap starting.
I20260709 14:55:10.850955 17743 tablet_bootstrap.cc:654] T c26e43514e564f9e906f938557e587e8 P 3f9e4abf970849caa70a02ede7f97cd8: Neither blocks nor log segments found. Creating new log.
I20260709 14:55:10.858386 17702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dde79436f56b4ce7805822a819a1d9bf" candidate_uuid: "2be4570f313d4a219ad149e28ab546c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f9e4abf970849caa70a02ede7f97cd8"
I20260709 14:55:10.859315 17702 raft_consensus.cc:3060] T dde79436f56b4ce7805822a819a1d9bf P 3f9e4abf970849caa70a02ede7f97cd8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:55:10.866804 17752 leader_election.cc:290] T dde79436f56b4ce7805822a819a1d9bf P 2be4570f313d4a219ad149e28ab546c5 [CANDIDATE]: Term 1 election: Requested vote from peers 450b7f1304cb4c2ca4c9ccf62afb6937 (127.6.101.66:35877), 3f9e4abf970849caa70a02ede7f97cd8 (127.6.101.67:42489)
I20260709 14:55:10.867683 17767 raft_consensus.cc:515] T 87215280bbb9434c86b8e0c862d78e44 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:10.871963 17552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87215280bbb9434c86b8e0c862d78e44" candidate_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2be4570f313d4a219ad149e28ab546c5"
W20260709 14:55:10.874627 17591 leader_election.cc:343] T 87215280bbb9434c86b8e0c862d78e44 P 450b7f1304cb4c2ca4c9ccf62afb6937 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2be4570f313d4a219ad149e28ab546c5 (127.6.101.65:43507): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:55:10.874522 17702 raft_consensus.cc:2468] T dde79436f56b4ce7805822a819a1d9bf P 3f9e4abf970849caa70a02ede7f97cd8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2be4570f313d4a219ad149e28ab546c5 in term 1.
I20260709 14:55:10.877516 17518 leader_election.cc:304] T dde79436f56b4ce7805822a819a1d9bf P 2be4570f313d4a219ad149e28ab546c5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2be4570f313d4a219ad149e28ab546c5, 3f9e4abf970849caa70a02ede7f97cd8; no voters: 450b7f1304cb4c2ca4c9ccf62afb6937
I20260709 14:55:10.878796 17752 raft_consensus.cc:2804] T dde79436f56b4ce7805822a819a1d9bf P 2be4570f313d4a219ad149e28ab546c5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:55:10.878903 17701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87215280bbb9434c86b8e0c862d78e44" candidate_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f9e4abf970849caa70a02ede7f97cd8"
I20260709 14:55:10.879485 17752 raft_consensus.cc:697] T dde79436f56b4ce7805822a819a1d9bf P 2be4570f313d4a219ad149e28ab546c5 [term 1 LEADER]: Becoming Leader. State: Replica: 2be4570f313d4a219ad149e28ab546c5, State: Running, Role: LEADER
I20260709 14:55:10.877687 17767 leader_election.cc:290] T 87215280bbb9434c86b8e0c862d78e44 P 450b7f1304cb4c2ca4c9ccf62afb6937 [CANDIDATE]: Term 1 election: Requested vote from peers 2be4570f313d4a219ad149e28ab546c5 (127.6.101.65:43507), 3f9e4abf970849caa70a02ede7f97cd8 (127.6.101.67:42489)
I20260709 14:55:10.880172 17701 raft_consensus.cc:3060] T 87215280bbb9434c86b8e0c862d78e44 P 3f9e4abf970849caa70a02ede7f97cd8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:55:10.880918 17752 consensus_queue.cc:237] T dde79436f56b4ce7805822a819a1d9bf P 2be4570f313d4a219ad149e28ab546c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:10.882647 17742 tablet_bootstrap.cc:492] T dde79436f56b4ce7805822a819a1d9bf P 450b7f1304cb4c2ca4c9ccf62afb6937: No bootstrap required, opened a new log
I20260709 14:55:10.883400 17742 ts_tablet_manager.cc:1403] T dde79436f56b4ce7805822a819a1d9bf P 450b7f1304cb4c2ca4c9ccf62afb6937: Time spent bootstrapping tablet: real 0.099s	user 0.042s	sys 0.054s
I20260709 14:55:10.884435 17743 tablet_bootstrap.cc:492] T c26e43514e564f9e906f938557e587e8 P 3f9e4abf970849caa70a02ede7f97cd8: No bootstrap required, opened a new log
I20260709 14:55:10.885161 17743 ts_tablet_manager.cc:1403] T c26e43514e564f9e906f938557e587e8 P 3f9e4abf970849caa70a02ede7f97cd8: Time spent bootstrapping tablet: real 0.043s	user 0.011s	sys 0.010s
I20260709 14:55:10.889608 17742 raft_consensus.cc:359] T dde79436f56b4ce7805822a819a1d9bf P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:10.889608 17743 raft_consensus.cc:359] T c26e43514e564f9e906f938557e587e8 P 3f9e4abf970849caa70a02ede7f97cd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:10.891040 17743 raft_consensus.cc:385] T c26e43514e564f9e906f938557e587e8 P 3f9e4abf970849caa70a02ede7f97cd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:55:10.890797 17742 raft_consensus.cc:385] T dde79436f56b4ce7805822a819a1d9bf P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:55:10.891851 17743 raft_consensus.cc:740] T c26e43514e564f9e906f938557e587e8 P 3f9e4abf970849caa70a02ede7f97cd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f9e4abf970849caa70a02ede7f97cd8, State: Initialized, Role: FOLLOWER
I20260709 14:55:10.892164 17742 raft_consensus.cc:740] T dde79436f56b4ce7805822a819a1d9bf P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 450b7f1304cb4c2ca4c9ccf62afb6937, State: Initialized, Role: FOLLOWER
I20260709 14:55:10.893306 17743 consensus_queue.cc:260] T c26e43514e564f9e906f938557e587e8 P 3f9e4abf970849caa70a02ede7f97cd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:10.893790 17742 consensus_queue.cc:260] T dde79436f56b4ce7805822a819a1d9bf P 450b7f1304cb4c2ca4c9ccf62afb6937 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:10.897516 17742 ts_tablet_manager.cc:1434] T dde79436f56b4ce7805822a819a1d9bf P 450b7f1304cb4c2ca4c9ccf62afb6937: Time spent starting tablet: real 0.014s	user 0.010s	sys 0.002s
I20260709 14:55:10.898792 17742 tablet_bootstrap.cc:492] T f9509b6f243644ed9e147299153953b2 P 450b7f1304cb4c2ca4c9ccf62afb6937: Bootstrap starting.
I20260709 14:55:10.902186 17743 ts_tablet_manager.cc:1434] T c26e43514e564f9e906f938557e587e8 P 3f9e4abf970849caa70a02ede7f97cd8: Time spent starting tablet: real 0.017s	user 0.010s	sys 0.000s
I20260709 14:55:10.904127 17449 catalog_manager.cc:5697] T dde79436f56b4ce7805822a819a1d9bf P 2be4570f313d4a219ad149e28ab546c5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2be4570f313d4a219ad149e28ab546c5 (127.6.101.65). New cstate: current_term: 1 leader_uuid: "2be4570f313d4a219ad149e28ab546c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } health_report { overall_health: UNKNOWN } } }
I20260709 14:55:10.907976 17746 tablet_bootstrap.cc:492] T 876c059b51af47a9a687c1e92c95a515 P 2be4570f313d4a219ad149e28ab546c5: No bootstrap required, opened a new log
I20260709 14:55:10.908893 17746 ts_tablet_manager.cc:1403] T 876c059b51af47a9a687c1e92c95a515 P 2be4570f313d4a219ad149e28ab546c5: Time spent bootstrapping tablet: real 0.096s	user 0.028s	sys 0.027s
I20260709 14:55:10.908910 17752 raft_consensus.cc:493] T 2e8e053361a54d7c91f2fe670f4aa514 P 2be4570f313d4a219ad149e28ab546c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:55:10.910356 17752 raft_consensus.cc:515] T 2e8e053361a54d7c91f2fe670f4aa514 P 2be4570f313d4a219ad149e28ab546c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:10.914444 17746 raft_consensus.cc:359] T 876c059b51af47a9a687c1e92c95a515 P 2be4570f313d4a219ad149e28ab546c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:10.915416 17746 raft_consensus.cc:385] T 876c059b51af47a9a687c1e92c95a515 P 2be4570f313d4a219ad149e28ab546c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:55:10.915697 17628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e8e053361a54d7c91f2fe670f4aa514" candidate_uuid: "2be4570f313d4a219ad149e28ab546c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" is_pre_election: true
I20260709 14:55:10.915742 17746 raft_consensus.cc:740] T 876c059b51af47a9a687c1e92c95a515 P 2be4570f313d4a219ad149e28ab546c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2be4570f313d4a219ad149e28ab546c5, State: Initialized, Role: FOLLOWER
I20260709 14:55:10.910959 17701 raft_consensus.cc:2468] T 87215280bbb9434c86b8e0c862d78e44 P 3f9e4abf970849caa70a02ede7f97cd8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 450b7f1304cb4c2ca4c9ccf62afb6937 in term 1.
I20260709 14:55:10.907096 17742 tablet_bootstrap.cc:654] T f9509b6f243644ed9e147299153953b2 P 450b7f1304cb4c2ca4c9ccf62afb6937: Neither blocks nor log segments found. Creating new log.
I20260709 14:55:10.917443 17746 consensus_queue.cc:260] T 876c059b51af47a9a687c1e92c95a515 P 2be4570f313d4a219ad149e28ab546c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:10.918399 17593 leader_election.cc:304] T 87215280bbb9434c86b8e0c862d78e44 P 450b7f1304cb4c2ca4c9ccf62afb6937 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f9e4abf970849caa70a02ede7f97cd8, 450b7f1304cb4c2ca4c9ccf62afb6937; no voters: 2be4570f313d4a219ad149e28ab546c5
I20260709 14:55:10.916427 17752 leader_election.cc:290] T 2e8e053361a54d7c91f2fe670f4aa514 P 2be4570f313d4a219ad149e28ab546c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 450b7f1304cb4c2ca4c9ccf62afb6937 (127.6.101.66:35877), 3f9e4abf970849caa70a02ede7f97cd8 (127.6.101.67:42489)
I20260709 14:55:10.920557 17746 ts_tablet_manager.cc:1434] T 876c059b51af47a9a687c1e92c95a515 P 2be4570f313d4a219ad149e28ab546c5: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 14:55:10.920800 17767 raft_consensus.cc:2804] T 87215280bbb9434c86b8e0c862d78e44 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:55:10.921489 17767 raft_consensus.cc:697] T 87215280bbb9434c86b8e0c862d78e44 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 1 LEADER]: Becoming Leader. State: Replica: 450b7f1304cb4c2ca4c9ccf62afb6937, State: Running, Role: LEADER
I20260709 14:55:10.922178 17746 tablet_bootstrap.cc:492] T 062ea10ecbd54055988e22c53a4387c5 P 2be4570f313d4a219ad149e28ab546c5: Bootstrap starting.
I20260709 14:55:10.922920 17767 consensus_queue.cc:237] T 87215280bbb9434c86b8e0c862d78e44 P 450b7f1304cb4c2ca4c9ccf62afb6937 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:10.916630 17628 raft_consensus.cc:2393] T 2e8e053361a54d7c91f2fe670f4aa514 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2be4570f313d4a219ad149e28ab546c5 in current term 1: Already voted for candidate 3f9e4abf970849caa70a02ede7f97cd8 in this term.
I20260709 14:55:10.931418 17746 tablet_bootstrap.cc:654] T 062ea10ecbd54055988e22c53a4387c5 P 2be4570f313d4a219ad149e28ab546c5: Neither blocks nor log segments found. Creating new log.
I20260709 14:55:10.936178 17701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e8e053361a54d7c91f2fe670f4aa514" candidate_uuid: "2be4570f313d4a219ad149e28ab546c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f9e4abf970849caa70a02ede7f97cd8" is_pre_election: true
I20260709 14:55:10.940557 17518 leader_election.cc:304] T 2e8e053361a54d7c91f2fe670f4aa514 P 2be4570f313d4a219ad149e28ab546c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2be4570f313d4a219ad149e28ab546c5; no voters: 3f9e4abf970849caa70a02ede7f97cd8, 450b7f1304cb4c2ca4c9ccf62afb6937
I20260709 14:55:10.943027 17786 raft_consensus.cc:3060] T 2e8e053361a54d7c91f2fe670f4aa514 P 2be4570f313d4a219ad149e28ab546c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:55:10.949719 17762 consensus_queue.cc:1048] T f9509b6f243644ed9e147299153953b2 P 3f9e4abf970849caa70a02ede7f97cd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:55:10.950815 17746 tablet_bootstrap.cc:492] T 062ea10ecbd54055988e22c53a4387c5 P 2be4570f313d4a219ad149e28ab546c5: No bootstrap required, opened a new log
I20260709 14:55:10.951088 17742 tablet_bootstrap.cc:492] T f9509b6f243644ed9e147299153953b2 P 450b7f1304cb4c2ca4c9ccf62afb6937: No bootstrap required, opened a new log
I20260709 14:55:10.951552 17746 ts_tablet_manager.cc:1403] T 062ea10ecbd54055988e22c53a4387c5 P 2be4570f313d4a219ad149e28ab546c5: Time spent bootstrapping tablet: real 0.030s	user 0.021s	sys 0.005s
I20260709 14:55:10.951702 17742 ts_tablet_manager.cc:1403] T f9509b6f243644ed9e147299153953b2 P 450b7f1304cb4c2ca4c9ccf62afb6937: Time spent bootstrapping tablet: real 0.053s	user 0.020s	sys 0.013s
I20260709 14:55:10.955426 17742 raft_consensus.cc:359] T f9509b6f243644ed9e147299153953b2 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:10.956393 17742 raft_consensus.cc:385] T f9509b6f243644ed9e147299153953b2 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:55:10.956771 17742 raft_consensus.cc:740] T f9509b6f243644ed9e147299153953b2 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 450b7f1304cb4c2ca4c9ccf62afb6937, State: Initialized, Role: FOLLOWER
I20260709 14:55:10.957677 17742 consensus_queue.cc:260] T f9509b6f243644ed9e147299153953b2 P 450b7f1304cb4c2ca4c9ccf62afb6937 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:10.959525 17786 raft_consensus.cc:2749] T 2e8e053361a54d7c91f2fe670f4aa514 P 2be4570f313d4a219ad149e28ab546c5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:55:10.960816 17742 ts_tablet_manager.cc:1434] T f9509b6f243644ed9e147299153953b2 P 450b7f1304cb4c2ca4c9ccf62afb6937: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 14:55:10.962142 17742 tablet_bootstrap.cc:492] T c26e43514e564f9e906f938557e587e8 P 450b7f1304cb4c2ca4c9ccf62afb6937: Bootstrap starting.
I20260709 14:55:10.961967 17746 raft_consensus.cc:359] T 062ea10ecbd54055988e22c53a4387c5 P 2be4570f313d4a219ad149e28ab546c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:10.963078 17746 raft_consensus.cc:385] T 062ea10ecbd54055988e22c53a4387c5 P 2be4570f313d4a219ad149e28ab546c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:55:10.963447 17746 raft_consensus.cc:740] T 062ea10ecbd54055988e22c53a4387c5 P 2be4570f313d4a219ad149e28ab546c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2be4570f313d4a219ad149e28ab546c5, State: Initialized, Role: FOLLOWER
I20260709 14:55:10.964707 17767 raft_consensus.cc:493] T 062ea10ecbd54055988e22c53a4387c5 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:55:10.965587 17767 raft_consensus.cc:515] T 062ea10ecbd54055988e22c53a4387c5 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:10.968128 17746 consensus_queue.cc:260] T 062ea10ecbd54055988e22c53a4387c5 P 2be4570f313d4a219ad149e28ab546c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:10.963765 17450 catalog_manager.cc:5697] T 87215280bbb9434c86b8e0c862d78e44 P 450b7f1304cb4c2ca4c9ccf62afb6937 reported cstate change: term changed from 0 to 1, leader changed from <none> to 450b7f1304cb4c2ca4c9ccf62afb6937 (127.6.101.66). New cstate: current_term: 1 leader_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } health_report { overall_health: UNKNOWN } } }
I20260709 14:55:10.971367 17746 ts_tablet_manager.cc:1434] T 062ea10ecbd54055988e22c53a4387c5 P 2be4570f313d4a219ad149e28ab546c5: Time spent starting tablet: real 0.019s	user 0.013s	sys 0.001s
I20260709 14:55:10.972647 17746 tablet_bootstrap.cc:492] T 87215280bbb9434c86b8e0c862d78e44 P 2be4570f313d4a219ad149e28ab546c5: Bootstrap starting.
I20260709 14:55:10.972888 17742 tablet_bootstrap.cc:654] T c26e43514e564f9e906f938557e587e8 P 450b7f1304cb4c2ca4c9ccf62afb6937: Neither blocks nor log segments found. Creating new log.
I20260709 14:55:10.974453 17551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062ea10ecbd54055988e22c53a4387c5" candidate_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2be4570f313d4a219ad149e28ab546c5" is_pre_election: true
I20260709 14:55:10.975309 17551 raft_consensus.cc:2468] T 062ea10ecbd54055988e22c53a4387c5 P 2be4570f313d4a219ad149e28ab546c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 450b7f1304cb4c2ca4c9ccf62afb6937 in term 0.
I20260709 14:55:10.978652 17701 raft_consensus.cc:3060] T f9764d88fc354df8a8b107f95579fc60 P 3f9e4abf970849caa70a02ede7f97cd8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:55:10.977541 17702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062ea10ecbd54055988e22c53a4387c5" candidate_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f9e4abf970849caa70a02ede7f97cd8" is_pre_election: true
I20260709 14:55:10.980109 17702 raft_consensus.cc:2468] T 062ea10ecbd54055988e22c53a4387c5 P 3f9e4abf970849caa70a02ede7f97cd8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 450b7f1304cb4c2ca4c9ccf62afb6937 in term 0.
I20260709 14:55:10.975476 17767 leader_election.cc:290] T 062ea10ecbd54055988e22c53a4387c5 P 450b7f1304cb4c2ca4c9ccf62afb6937 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2be4570f313d4a219ad149e28ab546c5 (127.6.101.65:43507), 3f9e4abf970849caa70a02ede7f97cd8 (127.6.101.67:42489)
I20260709 14:55:10.982235 17591 leader_election.cc:304] T 062ea10ecbd54055988e22c53a4387c5 P 450b7f1304cb4c2ca4c9ccf62afb6937 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2be4570f313d4a219ad149e28ab546c5, 450b7f1304cb4c2ca4c9ccf62afb6937; no voters: 
I20260709 14:55:10.989626 17767 raft_consensus.cc:2804] T 062ea10ecbd54055988e22c53a4387c5 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:55:10.990170 17767 raft_consensus.cc:493] T 062ea10ecbd54055988e22c53a4387c5 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:55:10.990586 17767 raft_consensus.cc:3060] T 062ea10ecbd54055988e22c53a4387c5 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:55:10.993304 17746 tablet_bootstrap.cc:654] T 87215280bbb9434c86b8e0c862d78e44 P 2be4570f313d4a219ad149e28ab546c5: Neither blocks nor log segments found. Creating new log.
I20260709 14:55:11.008354 17746 tablet_bootstrap.cc:492] T 87215280bbb9434c86b8e0c862d78e44 P 2be4570f313d4a219ad149e28ab546c5: No bootstrap required, opened a new log
I20260709 14:55:11.008556 17768 consensus_queue.cc:1048] T f9764d88fc354df8a8b107f95579fc60 P 450b7f1304cb4c2ca4c9ccf62afb6937 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:55:11.011564 17746 ts_tablet_manager.cc:1403] T 87215280bbb9434c86b8e0c862d78e44 P 2be4570f313d4a219ad149e28ab546c5: Time spent bootstrapping tablet: real 0.039s	user 0.010s	sys 0.007s
I20260709 14:55:11.010808 17750 consensus_queue.cc:1048] T f9764d88fc354df8a8b107f95579fc60 P 450b7f1304cb4c2ca4c9ccf62afb6937 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:55:11.016026 17628 raft_consensus.cc:3060] T f9509b6f243644ed9e147299153953b2 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:55:11.029721 17767 raft_consensus.cc:515] T 062ea10ecbd54055988e22c53a4387c5 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:11.030961 17742 tablet_bootstrap.cc:492] T c26e43514e564f9e906f938557e587e8 P 450b7f1304cb4c2ca4c9ccf62afb6937: No bootstrap required, opened a new log
I20260709 14:55:11.032047 17742 ts_tablet_manager.cc:1403] T c26e43514e564f9e906f938557e587e8 P 450b7f1304cb4c2ca4c9ccf62afb6937: Time spent bootstrapping tablet: real 0.070s	user 0.024s	sys 0.039s
I20260709 14:55:11.036266 17746 raft_consensus.cc:359] T 87215280bbb9434c86b8e0c862d78e44 P 2be4570f313d4a219ad149e28ab546c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:11.037092 17746 raft_consensus.cc:385] T 87215280bbb9434c86b8e0c862d78e44 P 2be4570f313d4a219ad149e28ab546c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:55:11.037429 17746 raft_consensus.cc:740] T 87215280bbb9434c86b8e0c862d78e44 P 2be4570f313d4a219ad149e28ab546c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2be4570f313d4a219ad149e28ab546c5, State: Initialized, Role: FOLLOWER
I20260709 14:55:11.038317 17746 consensus_queue.cc:260] T 87215280bbb9434c86b8e0c862d78e44 P 2be4570f313d4a219ad149e28ab546c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:11.039328 17702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062ea10ecbd54055988e22c53a4387c5" candidate_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f9e4abf970849caa70a02ede7f97cd8"
I20260709 14:55:11.040012 17702 raft_consensus.cc:3060] T 062ea10ecbd54055988e22c53a4387c5 P 3f9e4abf970849caa70a02ede7f97cd8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:55:11.040814 17746 ts_tablet_manager.cc:1434] T 87215280bbb9434c86b8e0c862d78e44 P 2be4570f313d4a219ad149e28ab546c5: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.001s
I20260709 14:55:11.040833 17742 raft_consensus.cc:359] T c26e43514e564f9e906f938557e587e8 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:11.042047 17746 tablet_bootstrap.cc:492] T c26e43514e564f9e906f938557e587e8 P 2be4570f313d4a219ad149e28ab546c5: Bootstrap starting.
I20260709 14:55:11.043866 17742 raft_consensus.cc:385] T c26e43514e564f9e906f938557e587e8 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:55:11.045222 17742 raft_consensus.cc:740] T c26e43514e564f9e906f938557e587e8 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 450b7f1304cb4c2ca4c9ccf62afb6937, State: Initialized, Role: FOLLOWER
I20260709 14:55:11.047708 17742 consensus_queue.cc:260] T c26e43514e564f9e906f938557e587e8 P 450b7f1304cb4c2ca4c9ccf62afb6937 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:11.051760 17746 tablet_bootstrap.cc:654] T c26e43514e564f9e906f938557e587e8 P 2be4570f313d4a219ad149e28ab546c5: Neither blocks nor log segments found. Creating new log.
I20260709 14:55:11.052314 17553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062ea10ecbd54055988e22c53a4387c5" candidate_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2be4570f313d4a219ad149e28ab546c5"
I20260709 14:55:11.053234 17553 raft_consensus.cc:3060] T 062ea10ecbd54055988e22c53a4387c5 P 2be4570f313d4a219ad149e28ab546c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:55:11.055034 17742 ts_tablet_manager.cc:1434] T c26e43514e564f9e906f938557e587e8 P 450b7f1304cb4c2ca4c9ccf62afb6937: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.002s
I20260709 14:55:11.059154 17762 consensus_queue.cc:1048] T f9509b6f243644ed9e147299153953b2 P 3f9e4abf970849caa70a02ede7f97cd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:55:11.066044 17746 tablet_bootstrap.cc:492] T c26e43514e564f9e906f938557e587e8 P 2be4570f313d4a219ad149e28ab546c5: No bootstrap required, opened a new log
I20260709 14:55:11.066722 17746 ts_tablet_manager.cc:1403] T c26e43514e564f9e906f938557e587e8 P 2be4570f313d4a219ad149e28ab546c5: Time spent bootstrapping tablet: real 0.025s	user 0.018s	sys 0.002s
I20260709 14:55:11.070369 17767 leader_election.cc:290] T 062ea10ecbd54055988e22c53a4387c5 P 450b7f1304cb4c2ca4c9ccf62afb6937 [CANDIDATE]: Term 1 election: Requested vote from peers 2be4570f313d4a219ad149e28ab546c5 (127.6.101.65:43507), 3f9e4abf970849caa70a02ede7f97cd8 (127.6.101.67:42489)
I20260709 14:55:11.074153 17702 raft_consensus.cc:2468] T 062ea10ecbd54055988e22c53a4387c5 P 3f9e4abf970849caa70a02ede7f97cd8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 450b7f1304cb4c2ca4c9ccf62afb6937 in term 1.
I20260709 14:55:11.075847 17593 leader_election.cc:304] T 062ea10ecbd54055988e22c53a4387c5 P 450b7f1304cb4c2ca4c9ccf62afb6937 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f9e4abf970849caa70a02ede7f97cd8, 450b7f1304cb4c2ca4c9ccf62afb6937; no voters: 
I20260709 14:55:11.076884 17767 raft_consensus.cc:2804] T 062ea10ecbd54055988e22c53a4387c5 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:55:11.070538 17746 raft_consensus.cc:359] T c26e43514e564f9e906f938557e587e8 P 2be4570f313d4a219ad149e28ab546c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:11.078303 17746 raft_consensus.cc:385] T c26e43514e564f9e906f938557e587e8 P 2be4570f313d4a219ad149e28ab546c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:55:11.078677 17746 raft_consensus.cc:740] T c26e43514e564f9e906f938557e587e8 P 2be4570f313d4a219ad149e28ab546c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2be4570f313d4a219ad149e28ab546c5, State: Initialized, Role: FOLLOWER
I20260709 14:55:11.079747 17746 consensus_queue.cc:260] T c26e43514e564f9e906f938557e587e8 P 2be4570f313d4a219ad149e28ab546c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:11.077749 17767 raft_consensus.cc:697] T 062ea10ecbd54055988e22c53a4387c5 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 1 LEADER]: Becoming Leader. State: Replica: 450b7f1304cb4c2ca4c9ccf62afb6937, State: Running, Role: LEADER
I20260709 14:55:11.087314 17767 consensus_queue.cc:237] T 062ea10ecbd54055988e22c53a4387c5 P 450b7f1304cb4c2ca4c9ccf62afb6937 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:11.091898 17746 ts_tablet_manager.cc:1434] T c26e43514e564f9e906f938557e587e8 P 2be4570f313d4a219ad149e28ab546c5: Time spent starting tablet: real 0.025s	user 0.009s	sys 0.001s
I20260709 14:55:11.091725 17762 consensus_queue.cc:1048] T 2ee76f3707314e23b707060672d77fdb P 3f9e4abf970849caa70a02ede7f97cd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:55:11.104920 17553 raft_consensus.cc:2468] T 062ea10ecbd54055988e22c53a4387c5 P 2be4570f313d4a219ad149e28ab546c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 450b7f1304cb4c2ca4c9ccf62afb6937 in term 1.
I20260709 14:55:11.108377 17449 catalog_manager.cc:5697] T 062ea10ecbd54055988e22c53a4387c5 P 450b7f1304cb4c2ca4c9ccf62afb6937 reported cstate change: term changed from 0 to 1, leader changed from <none> to 450b7f1304cb4c2ca4c9ccf62afb6937 (127.6.101.66). New cstate: current_term: 1 leader_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } health_report { overall_health: UNKNOWN } } }
I20260709 14:55:11.130941 17762 consensus_queue.cc:1048] T 2ee76f3707314e23b707060672d77fdb P 3f9e4abf970849caa70a02ede7f97cd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 14:55:11.151255 17762 consensus_queue.cc:1048] T 2e8e053361a54d7c91f2fe670f4aa514 P 3f9e4abf970849caa70a02ede7f97cd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 14:55:11.157598 17762 consensus_queue.cc:1048] T 876c059b51af47a9a687c1e92c95a515 P 3f9e4abf970849caa70a02ede7f97cd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 14:55:11.167912 17766 consensus_queue.cc:1048] T 2e8e053361a54d7c91f2fe670f4aa514 P 3f9e4abf970849caa70a02ede7f97cd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:55:11.184119 17551 raft_consensus.cc:3060] T 876c059b51af47a9a687c1e92c95a515 P 2be4570f313d4a219ad149e28ab546c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:55:11.194053 17762 consensus_queue.cc:1048] T 876c059b51af47a9a687c1e92c95a515 P 3f9e4abf970849caa70a02ede7f97cd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 14:55:11.255263 17786 raft_consensus.cc:493] T c26e43514e564f9e906f938557e587e8 P 2be4570f313d4a219ad149e28ab546c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:55:11.255797 17786 raft_consensus.cc:515] T c26e43514e564f9e906f938557e587e8 P 2be4570f313d4a219ad149e28ab546c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:11.257727 17786 leader_election.cc:290] T c26e43514e564f9e906f938557e587e8 P 2be4570f313d4a219ad149e28ab546c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 450b7f1304cb4c2ca4c9ccf62afb6937 (127.6.101.66:35877), 3f9e4abf970849caa70a02ede7f97cd8 (127.6.101.67:42489)
I20260709 14:55:11.258829 17626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26e43514e564f9e906f938557e587e8" candidate_uuid: "2be4570f313d4a219ad149e28ab546c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" is_pre_election: true
I20260709 14:55:11.259078 17701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26e43514e564f9e906f938557e587e8" candidate_uuid: "2be4570f313d4a219ad149e28ab546c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f9e4abf970849caa70a02ede7f97cd8" is_pre_election: true
I20260709 14:55:11.259807 17626 raft_consensus.cc:2468] T c26e43514e564f9e906f938557e587e8 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2be4570f313d4a219ad149e28ab546c5 in term 0.
I20260709 14:55:11.259897 17701 raft_consensus.cc:2468] T c26e43514e564f9e906f938557e587e8 P 3f9e4abf970849caa70a02ede7f97cd8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2be4570f313d4a219ad149e28ab546c5 in term 0.
I20260709 14:55:11.261205 17518 leader_election.cc:304] T c26e43514e564f9e906f938557e587e8 P 2be4570f313d4a219ad149e28ab546c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2be4570f313d4a219ad149e28ab546c5, 450b7f1304cb4c2ca4c9ccf62afb6937; no voters: 
I20260709 14:55:11.262132 17786 raft_consensus.cc:2804] T c26e43514e564f9e906f938557e587e8 P 2be4570f313d4a219ad149e28ab546c5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:55:11.262488 17786 raft_consensus.cc:493] T c26e43514e564f9e906f938557e587e8 P 2be4570f313d4a219ad149e28ab546c5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:55:11.263126 17786 raft_consensus.cc:3060] T c26e43514e564f9e906f938557e587e8 P 2be4570f313d4a219ad149e28ab546c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:55:11.270310 17786 raft_consensus.cc:515] T c26e43514e564f9e906f938557e587e8 P 2be4570f313d4a219ad149e28ab546c5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:11.272902 17786 leader_election.cc:290] T c26e43514e564f9e906f938557e587e8 P 2be4570f313d4a219ad149e28ab546c5 [CANDIDATE]: Term 1 election: Requested vote from peers 450b7f1304cb4c2ca4c9ccf62afb6937 (127.6.101.66:35877), 3f9e4abf970849caa70a02ede7f97cd8 (127.6.101.67:42489)
I20260709 14:55:11.273795 17626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26e43514e564f9e906f938557e587e8" candidate_uuid: "2be4570f313d4a219ad149e28ab546c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937"
I20260709 14:55:11.274053 17701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26e43514e564f9e906f938557e587e8" candidate_uuid: "2be4570f313d4a219ad149e28ab546c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f9e4abf970849caa70a02ede7f97cd8"
I20260709 14:55:11.274580 17701 raft_consensus.cc:3060] T c26e43514e564f9e906f938557e587e8 P 3f9e4abf970849caa70a02ede7f97cd8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:55:11.274580 17626 raft_consensus.cc:3060] T c26e43514e564f9e906f938557e587e8 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:55:11.281296 17750 raft_consensus.cc:493] T dde79436f56b4ce7805822a819a1d9bf P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:55:11.282018 17750 raft_consensus.cc:515] T dde79436f56b4ce7805822a819a1d9bf P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:11.282725 17701 raft_consensus.cc:2468] T c26e43514e564f9e906f938557e587e8 P 3f9e4abf970849caa70a02ede7f97cd8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2be4570f313d4a219ad149e28ab546c5 in term 1.
I20260709 14:55:11.282728 17626 raft_consensus.cc:2468] T c26e43514e564f9e906f938557e587e8 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2be4570f313d4a219ad149e28ab546c5 in term 1.
I20260709 14:55:11.284395 17518 leader_election.cc:304] T c26e43514e564f9e906f938557e587e8 P 2be4570f313d4a219ad149e28ab546c5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2be4570f313d4a219ad149e28ab546c5, 450b7f1304cb4c2ca4c9ccf62afb6937; no voters: 
I20260709 14:55:11.284933 17750 leader_election.cc:290] T dde79436f56b4ce7805822a819a1d9bf P 450b7f1304cb4c2ca4c9ccf62afb6937 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2be4570f313d4a219ad149e28ab546c5 (127.6.101.65:43507), 3f9e4abf970849caa70a02ede7f97cd8 (127.6.101.67:42489)
I20260709 14:55:11.285368 17786 raft_consensus.cc:2804] T c26e43514e564f9e906f938557e587e8 P 2be4570f313d4a219ad149e28ab546c5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:55:11.285761 17701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dde79436f56b4ce7805822a819a1d9bf" candidate_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f9e4abf970849caa70a02ede7f97cd8" is_pre_election: true
I20260709 14:55:11.286136 17786 raft_consensus.cc:697] T c26e43514e564f9e906f938557e587e8 P 2be4570f313d4a219ad149e28ab546c5 [term 1 LEADER]: Becoming Leader. State: Replica: 2be4570f313d4a219ad149e28ab546c5, State: Running, Role: LEADER
I20260709 14:55:11.286702 17701 raft_consensus.cc:2393] T dde79436f56b4ce7805822a819a1d9bf P 3f9e4abf970849caa70a02ede7f97cd8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 450b7f1304cb4c2ca4c9ccf62afb6937 in current term 1: Already voted for candidate 2be4570f313d4a219ad149e28ab546c5 in this term.
I20260709 14:55:11.287110 17786 consensus_queue.cc:237] T c26e43514e564f9e906f938557e587e8 P 2be4570f313d4a219ad149e28ab546c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:11.288059 17551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dde79436f56b4ce7805822a819a1d9bf" candidate_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2be4570f313d4a219ad149e28ab546c5" is_pre_election: true
I20260709 14:55:11.289748 17591 leader_election.cc:304] T dde79436f56b4ce7805822a819a1d9bf P 450b7f1304cb4c2ca4c9ccf62afb6937 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 450b7f1304cb4c2ca4c9ccf62afb6937; no voters: 2be4570f313d4a219ad149e28ab546c5, 3f9e4abf970849caa70a02ede7f97cd8
I20260709 14:55:11.291085 17750 raft_consensus.cc:3060] T dde79436f56b4ce7805822a819a1d9bf P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:55:11.298032 17450 catalog_manager.cc:5697] T c26e43514e564f9e906f938557e587e8 P 2be4570f313d4a219ad149e28ab546c5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2be4570f313d4a219ad149e28ab546c5 (127.6.101.65). New cstate: current_term: 1 leader_uuid: "2be4570f313d4a219ad149e28ab546c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } health_report { overall_health: UNKNOWN } } }
I20260709 14:55:11.301047 17750 raft_consensus.cc:2749] T dde79436f56b4ce7805822a819a1d9bf P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:55:11.374352 17786 consensus_queue.cc:1048] T dde79436f56b4ce7805822a819a1d9bf P 2be4570f313d4a219ad149e28ab546c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:55:11.379475 17750 consensus_queue.cc:1048] T 87215280bbb9434c86b8e0c862d78e44 P 450b7f1304cb4c2ca4c9ccf62afb6937 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:55:11.396124 17786 consensus_queue.cc:1048] T dde79436f56b4ce7805822a819a1d9bf P 2be4570f313d4a219ad149e28ab546c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:55:11.417464 17551 raft_consensus.cc:3060] T 87215280bbb9434c86b8e0c862d78e44 P 2be4570f313d4a219ad149e28ab546c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:55:11.430469 17767 consensus_queue.cc:1048] T 87215280bbb9434c86b8e0c862d78e44 P 450b7f1304cb4c2ca4c9ccf62afb6937 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:55:11.433526 17626 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f9764d88fc354df8a8b107f95579fc60"
dest_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937"
mode: GRACEFUL
new_leader_uuid: "2be4570f313d4a219ad149e28ab546c5"
 from {username='slave'} at 127.0.0.1:55412
I20260709 14:55:11.434366 17626 raft_consensus.cc:606] T f9764d88fc354df8a8b107f95579fc60 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 1 LEADER]: Received request to transfer leadership to TS 2be4570f313d4a219ad149e28ab546c5
I20260709 14:55:11.455551 17702 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f9509b6f243644ed9e147299153953b2"
dest_uuid: "3f9e4abf970849caa70a02ede7f97cd8"
mode: GRACEFUL
new_leader_uuid: "2be4570f313d4a219ad149e28ab546c5"
 from {username='slave'} at 127.0.0.1:35864
I20260709 14:55:11.456216 17702 raft_consensus.cc:606] T f9509b6f243644ed9e147299153953b2 P 3f9e4abf970849caa70a02ede7f97cd8 [term 1 LEADER]: Received request to transfer leadership to TS 2be4570f313d4a219ad149e28ab546c5
I20260709 14:55:11.466835 17702 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2e8e053361a54d7c91f2fe670f4aa514"
dest_uuid: "3f9e4abf970849caa70a02ede7f97cd8"
mode: GRACEFUL
new_leader_uuid: "2be4570f313d4a219ad149e28ab546c5"
 from {username='slave'} at 127.0.0.1:35864
I20260709 14:55:11.467561 17702 raft_consensus.cc:606] T 2e8e053361a54d7c91f2fe670f4aa514 P 3f9e4abf970849caa70a02ede7f97cd8 [term 1 LEADER]: Received request to transfer leadership to TS 2be4570f313d4a219ad149e28ab546c5
I20260709 14:55:11.474983 17702 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2ee76f3707314e23b707060672d77fdb"
dest_uuid: "3f9e4abf970849caa70a02ede7f97cd8"
mode: GRACEFUL
new_leader_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937"
 from {username='slave'} at 127.0.0.1:35864
I20260709 14:55:11.475697 17702 raft_consensus.cc:606] T 2ee76f3707314e23b707060672d77fdb P 3f9e4abf970849caa70a02ede7f97cd8 [term 1 LEADER]: Received request to transfer leadership to TS 450b7f1304cb4c2ca4c9ccf62afb6937
I20260709 14:55:11.483342 17702 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "876c059b51af47a9a687c1e92c95a515"
dest_uuid: "3f9e4abf970849caa70a02ede7f97cd8"
mode: GRACEFUL
new_leader_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937"
 from {username='slave'} at 127.0.0.1:35864
I20260709 14:55:11.484105 17702 raft_consensus.cc:606] T 876c059b51af47a9a687c1e92c95a515 P 3f9e4abf970849caa70a02ede7f97cd8 [term 1 LEADER]: Received request to transfer leadership to TS 450b7f1304cb4c2ca4c9ccf62afb6937
I20260709 14:55:11.494990 17766 raft_consensus.cc:993] T f9509b6f243644ed9e147299153953b2 P 3f9e4abf970849caa70a02ede7f97cd8: : Instructing follower 2be4570f313d4a219ad149e28ab546c5 to start an election
I20260709 14:55:11.495576 17766 raft_consensus.cc:1081] T f9509b6f243644ed9e147299153953b2 P 3f9e4abf970849caa70a02ede7f97cd8 [term 1 LEADER]: Signalling peer 2be4570f313d4a219ad149e28ab546c5 to start an election
I20260709 14:55:11.497833 17551 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f9509b6f243644ed9e147299153953b2"
dest_uuid: "2be4570f313d4a219ad149e28ab546c5"
 from {username='slave'} at 127.0.0.1:49710
I20260709 14:55:11.498553 17551 raft_consensus.cc:493] T f9509b6f243644ed9e147299153953b2 P 2be4570f313d4a219ad149e28ab546c5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:55:11.498970 17551 raft_consensus.cc:3060] T f9509b6f243644ed9e147299153953b2 P 2be4570f313d4a219ad149e28ab546c5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:55:11.506628 17551 raft_consensus.cc:515] T f9509b6f243644ed9e147299153953b2 P 2be4570f313d4a219ad149e28ab546c5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:11.509089 17551 leader_election.cc:290] T f9509b6f243644ed9e147299153953b2 P 2be4570f313d4a219ad149e28ab546c5 [CANDIDATE]: Term 2 election: Requested vote from peers 450b7f1304cb4c2ca4c9ccf62afb6937 (127.6.101.66:35877), 3f9e4abf970849caa70a02ede7f97cd8 (127.6.101.67:42489)
I20260709 14:55:11.510265 17626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9509b6f243644ed9e147299153953b2" candidate_uuid: "2be4570f313d4a219ad149e28ab546c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937"
I20260709 14:55:11.511144 17626 raft_consensus.cc:3060] T f9509b6f243644ed9e147299153953b2 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:55:11.511545 17551 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c26e43514e564f9e906f938557e587e8"
dest_uuid: "2be4570f313d4a219ad149e28ab546c5"
mode: GRACEFUL
new_leader_uuid: "3f9e4abf970849caa70a02ede7f97cd8"
 from {username='slave'} at 127.0.0.1:49736
I20260709 14:55:11.512024 17702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9509b6f243644ed9e147299153953b2" candidate_uuid: "2be4570f313d4a219ad149e28ab546c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3f9e4abf970849caa70a02ede7f97cd8"
I20260709 14:55:11.512408 17551 raft_consensus.cc:606] T c26e43514e564f9e906f938557e587e8 P 2be4570f313d4a219ad149e28ab546c5 [term 1 LEADER]: Received request to transfer leadership to TS 3f9e4abf970849caa70a02ede7f97cd8
I20260709 14:55:11.512765 17702 raft_consensus.cc:3055] T f9509b6f243644ed9e147299153953b2 P 3f9e4abf970849caa70a02ede7f97cd8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 14:55:11.513172 17702 raft_consensus.cc:740] T f9509b6f243644ed9e147299153953b2 P 3f9e4abf970849caa70a02ede7f97cd8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3f9e4abf970849caa70a02ede7f97cd8, State: Running, Role: LEADER
I20260709 14:55:11.514259 17702 consensus_queue.cc:260] T f9509b6f243644ed9e147299153953b2 P 3f9e4abf970849caa70a02ede7f97cd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:11.515763 17702 raft_consensus.cc:3060] T f9509b6f243644ed9e147299153953b2 P 3f9e4abf970849caa70a02ede7f97cd8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:55:11.519399 17767 consensus_queue.cc:1048] T 062ea10ecbd54055988e22c53a4387c5 P 450b7f1304cb4c2ca4c9ccf62afb6937 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:55:11.520182 17626 raft_consensus.cc:2468] T f9509b6f243644ed9e147299153953b2 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2be4570f313d4a219ad149e28ab546c5 in term 2.
I20260709 14:55:11.521881 17518 leader_election.cc:304] T f9509b6f243644ed9e147299153953b2 P 2be4570f313d4a219ad149e28ab546c5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2be4570f313d4a219ad149e28ab546c5, 450b7f1304cb4c2ca4c9ccf62afb6937; no voters: 
I20260709 14:55:11.522760 17786 raft_consensus.cc:2804] T f9509b6f243644ed9e147299153953b2 P 2be4570f313d4a219ad149e28ab546c5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:55:11.523520 17786 raft_consensus.cc:697] T f9509b6f243644ed9e147299153953b2 P 2be4570f313d4a219ad149e28ab546c5 [term 2 LEADER]: Becoming Leader. State: Replica: 2be4570f313d4a219ad149e28ab546c5, State: Running, Role: LEADER
I20260709 14:55:11.524519 17786 consensus_queue.cc:237] T f9509b6f243644ed9e147299153953b2 P 2be4570f313d4a219ad149e28ab546c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:11.527024 17702 raft_consensus.cc:2468] T f9509b6f243644ed9e147299153953b2 P 3f9e4abf970849caa70a02ede7f97cd8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2be4570f313d4a219ad149e28ab546c5 in term 2.
I20260709 14:55:11.534586 17768 consensus_queue.cc:1048] T 062ea10ecbd54055988e22c53a4387c5 P 450b7f1304cb4c2ca4c9ccf62afb6937 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 14:55:11.534976 17450 catalog_manager.cc:5697] T f9509b6f243644ed9e147299153953b2 P 2be4570f313d4a219ad149e28ab546c5 reported cstate change: term changed from 1 to 2, leader changed from 3f9e4abf970849caa70a02ede7f97cd8 (127.6.101.67) to 2be4570f313d4a219ad149e28ab546c5 (127.6.101.65). New cstate: current_term: 2 leader_uuid: "2be4570f313d4a219ad149e28ab546c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } health_report { overall_health: UNKNOWN } } }
I20260709 14:55:11.582518 17762 raft_consensus.cc:993] T 876c059b51af47a9a687c1e92c95a515 P 3f9e4abf970849caa70a02ede7f97cd8: : Instructing follower 450b7f1304cb4c2ca4c9ccf62afb6937 to start an election
I20260709 14:55:11.583104 17766 raft_consensus.cc:1081] T 876c059b51af47a9a687c1e92c95a515 P 3f9e4abf970849caa70a02ede7f97cd8 [term 1 LEADER]: Signalling peer 450b7f1304cb4c2ca4c9ccf62afb6937 to start an election
I20260709 14:55:11.585352 17626 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "876c059b51af47a9a687c1e92c95a515"
dest_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937"
 from {username='slave'} at 127.0.0.1:55394
I20260709 14:55:11.586014 17626 raft_consensus.cc:493] T 876c059b51af47a9a687c1e92c95a515 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:55:11.586346 17626 raft_consensus.cc:3060] T 876c059b51af47a9a687c1e92c95a515 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:55:11.592787 17626 raft_consensus.cc:515] T 876c059b51af47a9a687c1e92c95a515 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:11.594959 17626 leader_election.cc:290] T 876c059b51af47a9a687c1e92c95a515 P 450b7f1304cb4c2ca4c9ccf62afb6937 [CANDIDATE]: Term 2 election: Requested vote from peers 2be4570f313d4a219ad149e28ab546c5 (127.6.101.65:43507), 3f9e4abf970849caa70a02ede7f97cd8 (127.6.101.67:42489)
I20260709 14:55:11.596180 17702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "876c059b51af47a9a687c1e92c95a515" candidate_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3f9e4abf970849caa70a02ede7f97cd8"
I20260709 14:55:11.596187 17551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "876c059b51af47a9a687c1e92c95a515" candidate_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2be4570f313d4a219ad149e28ab546c5"
I20260709 14:55:11.596949 17702 raft_consensus.cc:3055] T 876c059b51af47a9a687c1e92c95a515 P 3f9e4abf970849caa70a02ede7f97cd8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 14:55:11.597028 17551 raft_consensus.cc:3060] T 876c059b51af47a9a687c1e92c95a515 P 2be4570f313d4a219ad149e28ab546c5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:55:11.597316 17702 raft_consensus.cc:740] T 876c059b51af47a9a687c1e92c95a515 P 3f9e4abf970849caa70a02ede7f97cd8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3f9e4abf970849caa70a02ede7f97cd8, State: Running, Role: LEADER
I20260709 14:55:11.598235 17702 consensus_queue.cc:260] T 876c059b51af47a9a687c1e92c95a515 P 3f9e4abf970849caa70a02ede7f97cd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:11.599565 17702 raft_consensus.cc:3060] T 876c059b51af47a9a687c1e92c95a515 P 3f9e4abf970849caa70a02ede7f97cd8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:55:11.604496 17551 raft_consensus.cc:2468] T 876c059b51af47a9a687c1e92c95a515 P 2be4570f313d4a219ad149e28ab546c5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 450b7f1304cb4c2ca4c9ccf62afb6937 in term 2.
I20260709 14:55:11.606290 17591 leader_election.cc:304] T 876c059b51af47a9a687c1e92c95a515 P 450b7f1304cb4c2ca4c9ccf62afb6937 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2be4570f313d4a219ad149e28ab546c5, 450b7f1304cb4c2ca4c9ccf62afb6937; no voters: 
I20260709 14:55:11.607208 17767 raft_consensus.cc:2804] T 876c059b51af47a9a687c1e92c95a515 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:55:11.607654 17767 raft_consensus.cc:697] T 876c059b51af47a9a687c1e92c95a515 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 2 LEADER]: Becoming Leader. State: Replica: 450b7f1304cb4c2ca4c9ccf62afb6937, State: Running, Role: LEADER
I20260709 14:55:11.608103 17702 raft_consensus.cc:2468] T 876c059b51af47a9a687c1e92c95a515 P 3f9e4abf970849caa70a02ede7f97cd8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 450b7f1304cb4c2ca4c9ccf62afb6937 in term 2.
I20260709 14:55:11.608517 17767 consensus_queue.cc:237] T 876c059b51af47a9a687c1e92c95a515 P 450b7f1304cb4c2ca4c9ccf62afb6937 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:11.617489 17449 catalog_manager.cc:5697] T 876c059b51af47a9a687c1e92c95a515 P 450b7f1304cb4c2ca4c9ccf62afb6937 reported cstate change: term changed from 1 to 2, leader changed from 3f9e4abf970849caa70a02ede7f97cd8 (127.6.101.67) to 450b7f1304cb4c2ca4c9ccf62afb6937 (127.6.101.66). New cstate: current_term: 2 leader_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } health_report { overall_health: UNKNOWN } } }
I20260709 14:55:11.691531 17786 consensus_queue.cc:1048] T c26e43514e564f9e906f938557e587e8 P 2be4570f313d4a219ad149e28ab546c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:55:11.708024 17768 raft_consensus.cc:993] T f9764d88fc354df8a8b107f95579fc60 P 450b7f1304cb4c2ca4c9ccf62afb6937: : Instructing follower 2be4570f313d4a219ad149e28ab546c5 to start an election
I20260709 14:55:11.708586 17768 raft_consensus.cc:1081] T f9764d88fc354df8a8b107f95579fc60 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 1 LEADER]: Signalling peer 2be4570f313d4a219ad149e28ab546c5 to start an election
I20260709 14:55:11.715384 17766 raft_consensus.cc:993] T 2e8e053361a54d7c91f2fe670f4aa514 P 3f9e4abf970849caa70a02ede7f97cd8: : Instructing follower 2be4570f313d4a219ad149e28ab546c5 to start an election
I20260709 14:55:11.715363 17817 consensus_queue.cc:1048] T c26e43514e564f9e906f938557e587e8 P 2be4570f313d4a219ad149e28ab546c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:55:11.716023 17766 raft_consensus.cc:1081] T 2e8e053361a54d7c91f2fe670f4aa514 P 3f9e4abf970849caa70a02ede7f97cd8 [term 1 LEADER]: Signalling peer 2be4570f313d4a219ad149e28ab546c5 to start an election
I20260709 14:55:11.717648 17551 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f9764d88fc354df8a8b107f95579fc60"
dest_uuid: "2be4570f313d4a219ad149e28ab546c5"
 from {username='slave'} at 127.0.0.1:49722
I20260709 14:55:11.718569 17551 raft_consensus.cc:493] T f9764d88fc354df8a8b107f95579fc60 P 2be4570f313d4a219ad149e28ab546c5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:55:11.719241 17551 raft_consensus.cc:3060] T f9764d88fc354df8a8b107f95579fc60 P 2be4570f313d4a219ad149e28ab546c5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:55:11.719558 17553 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2e8e053361a54d7c91f2fe670f4aa514"
dest_uuid: "2be4570f313d4a219ad149e28ab546c5"
 from {username='slave'} at 127.0.0.1:49710
I20260709 14:55:11.720927 17553 raft_consensus.cc:493] T 2e8e053361a54d7c91f2fe670f4aa514 P 2be4570f313d4a219ad149e28ab546c5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:55:11.721508 17553 raft_consensus.cc:3060] T 2e8e053361a54d7c91f2fe670f4aa514 P 2be4570f313d4a219ad149e28ab546c5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:55:11.728617 17551 raft_consensus.cc:515] T f9764d88fc354df8a8b107f95579fc60 P 2be4570f313d4a219ad149e28ab546c5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } } peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } }
I20260709 14:55:11.731711 17551 leader_election.cc:290] T f9764d88fc354df8a8b107f95579fc60 P 2be4570f313d4a219ad149e28ab546c5 [CANDIDATE]: Term 2 election: Requested vote from peers 450b7f1304cb4c2ca4c9ccf62afb6937 (127.6.101.66:35877), 3f9e4abf970849caa70a02ede7f97cd8 (127.6.101.67:42489)
I20260709 14:55:11.733690 17626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9764d88fc354df8a8b107f95579fc60" candidate_uuid: "2be4570f313d4a219ad149e28ab546c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937"
I20260709 14:55:11.734567 17626 raft_consensus.cc:3055] T f9764d88fc354df8a8b107f95579fc60 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 14:55:11.734978 17626 raft_consensus.cc:740] T f9764d88fc354df8a8b107f95579fc60 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 450b7f1304cb4c2ca4c9ccf62afb6937, State: Running, Role: LEADER
I20260709 14:55:11.735450 17701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9764d88fc354df8a8b107f95579fc60" candidate_uuid: "2be4570f313d4a219ad149e28ab546c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3f9e4abf970849caa70a02ede7f97cd8"
I20260709 14:55:11.735927 17626 consensus_queue.cc:260] T f9764d88fc354df8a8b107f95579fc60 P 450b7f1304cb4c2ca4c9ccf62afb6937 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } } peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } }
I20260709 14:55:11.737433 17701 raft_consensus.cc:3060] T f9764d88fc354df8a8b107f95579fc60 P 3f9e4abf970849caa70a02ede7f97cd8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:55:11.737752 17626 raft_consensus.cc:3060] T f9764d88fc354df8a8b107f95579fc60 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:55:11.738299 17553 raft_consensus.cc:515] T 2e8e053361a54d7c91f2fe670f4aa514 P 2be4570f313d4a219ad149e28ab546c5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:11.740864 17553 leader_election.cc:290] T 2e8e053361a54d7c91f2fe670f4aa514 P 2be4570f313d4a219ad149e28ab546c5 [CANDIDATE]: Term 2 election: Requested vote from peers 450b7f1304cb4c2ca4c9ccf62afb6937 (127.6.101.66:35877), 3f9e4abf970849caa70a02ede7f97cd8 (127.6.101.67:42489)
I20260709 14:55:11.742710 17627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e8e053361a54d7c91f2fe670f4aa514" candidate_uuid: "2be4570f313d4a219ad149e28ab546c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937"
I20260709 14:55:11.743145 17700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e8e053361a54d7c91f2fe670f4aa514" candidate_uuid: "2be4570f313d4a219ad149e28ab546c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3f9e4abf970849caa70a02ede7f97cd8"
I20260709 14:55:11.743592 17627 raft_consensus.cc:3060] T 2e8e053361a54d7c91f2fe670f4aa514 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:55:11.744282 17700 raft_consensus.cc:3055] T 2e8e053361a54d7c91f2fe670f4aa514 P 3f9e4abf970849caa70a02ede7f97cd8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 14:55:11.744804 17700 raft_consensus.cc:740] T 2e8e053361a54d7c91f2fe670f4aa514 P 3f9e4abf970849caa70a02ede7f97cd8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3f9e4abf970849caa70a02ede7f97cd8, State: Running, Role: LEADER
I20260709 14:55:11.743475 17766 raft_consensus.cc:993] T 2ee76f3707314e23b707060672d77fdb P 3f9e4abf970849caa70a02ede7f97cd8: : Instructing follower 450b7f1304cb4c2ca4c9ccf62afb6937 to start an election
I20260709 14:55:11.746021 17762 raft_consensus.cc:1081] T 2ee76f3707314e23b707060672d77fdb P 3f9e4abf970849caa70a02ede7f97cd8 [term 1 LEADER]: Signalling peer 450b7f1304cb4c2ca4c9ccf62afb6937 to start an election
I20260709 14:55:11.746109 17817 raft_consensus.cc:993] T c26e43514e564f9e906f938557e587e8 P 2be4570f313d4a219ad149e28ab546c5: : Instructing follower 3f9e4abf970849caa70a02ede7f97cd8 to start an election
I20260709 14:55:11.747599 17817 raft_consensus.cc:1081] T c26e43514e564f9e906f938557e587e8 P 2be4570f313d4a219ad149e28ab546c5 [term 1 LEADER]: Signalling peer 3f9e4abf970849caa70a02ede7f97cd8 to start an election
I20260709 14:55:11.746899 17700 consensus_queue.cc:260] T 2e8e053361a54d7c91f2fe670f4aa514 P 3f9e4abf970849caa70a02ede7f97cd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:11.750237 17628 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2ee76f3707314e23b707060672d77fdb"
dest_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937"
 from {username='slave'} at 127.0.0.1:55394
I20260709 14:55:11.750501 17626 raft_consensus.cc:2468] T f9764d88fc354df8a8b107f95579fc60 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2be4570f313d4a219ad149e28ab546c5 in term 2.
I20260709 14:55:11.751071 17628 raft_consensus.cc:493] T 2ee76f3707314e23b707060672d77fdb P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:55:11.751220 17700 raft_consensus.cc:3060] T 2e8e053361a54d7c91f2fe670f4aa514 P 3f9e4abf970849caa70a02ede7f97cd8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:55:11.751592 17628 raft_consensus.cc:3060] T 2ee76f3707314e23b707060672d77fdb P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:55:11.753021 17518 leader_election.cc:304] T f9764d88fc354df8a8b107f95579fc60 P 2be4570f313d4a219ad149e28ab546c5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2be4570f313d4a219ad149e28ab546c5, 450b7f1304cb4c2ca4c9ccf62afb6937; no voters: 
I20260709 14:55:11.754189 17786 raft_consensus.cc:2804] T f9764d88fc354df8a8b107f95579fc60 P 2be4570f313d4a219ad149e28ab546c5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:55:11.754799 17786 raft_consensus.cc:697] T f9764d88fc354df8a8b107f95579fc60 P 2be4570f313d4a219ad149e28ab546c5 [term 2 LEADER]: Becoming Leader. State: Replica: 2be4570f313d4a219ad149e28ab546c5, State: Running, Role: LEADER
I20260709 14:55:11.755023 17702 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c26e43514e564f9e906f938557e587e8"
dest_uuid: "3f9e4abf970849caa70a02ede7f97cd8"
 from {username='slave'} at 127.0.0.1:35860
I20260709 14:55:11.755928 17702 raft_consensus.cc:493] T c26e43514e564f9e906f938557e587e8 P 3f9e4abf970849caa70a02ede7f97cd8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:55:11.755726 17786 consensus_queue.cc:237] T f9764d88fc354df8a8b107f95579fc60 P 2be4570f313d4a219ad149e28ab546c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } } peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } }
I20260709 14:55:11.764448 17700 raft_consensus.cc:2468] T 2e8e053361a54d7c91f2fe670f4aa514 P 3f9e4abf970849caa70a02ede7f97cd8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2be4570f313d4a219ad149e28ab546c5 in term 2.
I20260709 14:55:11.765606 17701 raft_consensus.cc:2468] T f9764d88fc354df8a8b107f95579fc60 P 3f9e4abf970849caa70a02ede7f97cd8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2be4570f313d4a219ad149e28ab546c5 in term 2.
I20260709 14:55:11.766510 17518 leader_election.cc:304] T 2e8e053361a54d7c91f2fe670f4aa514 P 2be4570f313d4a219ad149e28ab546c5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2be4570f313d4a219ad149e28ab546c5, 3f9e4abf970849caa70a02ede7f97cd8; no voters: 
I20260709 14:55:11.766553 17628 raft_consensus.cc:515] T 2ee76f3707314e23b707060672d77fdb P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:11.768750 17817 raft_consensus.cc:2804] T 2e8e053361a54d7c91f2fe670f4aa514 P 2be4570f313d4a219ad149e28ab546c5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:55:11.769536 17817 raft_consensus.cc:697] T 2e8e053361a54d7c91f2fe670f4aa514 P 2be4570f313d4a219ad149e28ab546c5 [term 2 LEADER]: Becoming Leader. State: Replica: 2be4570f313d4a219ad149e28ab546c5, State: Running, Role: LEADER
I20260709 14:55:11.768355 17450 catalog_manager.cc:5697] T f9764d88fc354df8a8b107f95579fc60 P 2be4570f313d4a219ad149e28ab546c5 reported cstate change: term changed from 1 to 2, leader changed from 450b7f1304cb4c2ca4c9ccf62afb6937 (127.6.101.66) to 2be4570f313d4a219ad149e28ab546c5 (127.6.101.65). New cstate: current_term: 2 leader_uuid: "2be4570f313d4a219ad149e28ab546c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } health_report { overall_health: HEALTHY } } }
I20260709 14:55:11.770368 17628 leader_election.cc:290] T 2ee76f3707314e23b707060672d77fdb P 450b7f1304cb4c2ca4c9ccf62afb6937 [CANDIDATE]: Term 2 election: Requested vote from peers 2be4570f313d4a219ad149e28ab546c5 (127.6.101.65:43507), 3f9e4abf970849caa70a02ede7f97cd8 (127.6.101.67:42489)
I20260709 14:55:11.770607 17817 consensus_queue.cc:237] T 2e8e053361a54d7c91f2fe670f4aa514 P 2be4570f313d4a219ad149e28ab546c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:11.771966 17553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee76f3707314e23b707060672d77fdb" candidate_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2be4570f313d4a219ad149e28ab546c5"
I20260709 14:55:11.772751 17553 raft_consensus.cc:3060] T 2ee76f3707314e23b707060672d77fdb P 2be4570f313d4a219ad149e28ab546c5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:55:11.772046 17700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee76f3707314e23b707060672d77fdb" candidate_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3f9e4abf970849caa70a02ede7f97cd8"
I20260709 14:55:11.777012 17700 raft_consensus.cc:3055] T 2ee76f3707314e23b707060672d77fdb P 3f9e4abf970849caa70a02ede7f97cd8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 14:55:11.756428 17702 raft_consensus.cc:3060] T c26e43514e564f9e906f938557e587e8 P 3f9e4abf970849caa70a02ede7f97cd8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:55:11.778126 17700 raft_consensus.cc:740] T 2ee76f3707314e23b707060672d77fdb P 3f9e4abf970849caa70a02ede7f97cd8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3f9e4abf970849caa70a02ede7f97cd8, State: Running, Role: LEADER
I20260709 14:55:11.777096 17627 raft_consensus.cc:2468] T 2e8e053361a54d7c91f2fe670f4aa514 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2be4570f313d4a219ad149e28ab546c5 in term 2.
I20260709 14:55:11.779525 17700 consensus_queue.cc:260] T 2ee76f3707314e23b707060672d77fdb P 3f9e4abf970849caa70a02ede7f97cd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:11.782272 17700 raft_consensus.cc:3060] T 2ee76f3707314e23b707060672d77fdb P 3f9e4abf970849caa70a02ede7f97cd8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:55:11.788172 17553 raft_consensus.cc:2468] T 2ee76f3707314e23b707060672d77fdb P 2be4570f313d4a219ad149e28ab546c5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 450b7f1304cb4c2ca4c9ccf62afb6937 in term 2.
I20260709 14:55:11.790118 17591 leader_election.cc:304] T 2ee76f3707314e23b707060672d77fdb P 450b7f1304cb4c2ca4c9ccf62afb6937 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2be4570f313d4a219ad149e28ab546c5, 450b7f1304cb4c2ca4c9ccf62afb6937; no voters: 
I20260709 14:55:11.790721 17700 raft_consensus.cc:2468] T 2ee76f3707314e23b707060672d77fdb P 3f9e4abf970849caa70a02ede7f97cd8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 450b7f1304cb4c2ca4c9ccf62afb6937 in term 2.
I20260709 14:55:11.791045 17768 raft_consensus.cc:2804] T 2ee76f3707314e23b707060672d77fdb P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:55:11.791783 17768 raft_consensus.cc:697] T 2ee76f3707314e23b707060672d77fdb P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 2 LEADER]: Becoming Leader. State: Replica: 450b7f1304cb4c2ca4c9ccf62afb6937, State: Running, Role: LEADER
I20260709 14:55:11.791803 17702 raft_consensus.cc:515] T c26e43514e564f9e906f938557e587e8 P 3f9e4abf970849caa70a02ede7f97cd8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:11.791800 17450 catalog_manager.cc:5697] T 2e8e053361a54d7c91f2fe670f4aa514 P 2be4570f313d4a219ad149e28ab546c5 reported cstate change: term changed from 1 to 2, leader changed from 3f9e4abf970849caa70a02ede7f97cd8 (127.6.101.67) to 2be4570f313d4a219ad149e28ab546c5 (127.6.101.65). New cstate: current_term: 2 leader_uuid: "2be4570f313d4a219ad149e28ab546c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } health_report { overall_health: UNKNOWN } } }
I20260709 14:55:11.794245 17768 consensus_queue.cc:237] T 2ee76f3707314e23b707060672d77fdb P 450b7f1304cb4c2ca4c9ccf62afb6937 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:11.796597 17702 leader_election.cc:290] T c26e43514e564f9e906f938557e587e8 P 3f9e4abf970849caa70a02ede7f97cd8 [CANDIDATE]: Term 2 election: Requested vote from peers 2be4570f313d4a219ad149e28ab546c5 (127.6.101.65:43507), 450b7f1304cb4c2ca4c9ccf62afb6937 (127.6.101.66:35877)
I20260709 14:55:11.798002 17627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26e43514e564f9e906f938557e587e8" candidate_uuid: "3f9e4abf970849caa70a02ede7f97cd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937"
I20260709 14:55:11.798208 17553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c26e43514e564f9e906f938557e587e8" candidate_uuid: "3f9e4abf970849caa70a02ede7f97cd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2be4570f313d4a219ad149e28ab546c5"
I20260709 14:55:11.798732 17627 raft_consensus.cc:3060] T c26e43514e564f9e906f938557e587e8 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:55:11.799048 17553 raft_consensus.cc:3055] T c26e43514e564f9e906f938557e587e8 P 2be4570f313d4a219ad149e28ab546c5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 14:55:11.799458 17553 raft_consensus.cc:740] T c26e43514e564f9e906f938557e587e8 P 2be4570f313d4a219ad149e28ab546c5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2be4570f313d4a219ad149e28ab546c5, State: Running, Role: LEADER
I20260709 14:55:11.800403 17553 consensus_queue.cc:260] T c26e43514e564f9e906f938557e587e8 P 2be4570f313d4a219ad149e28ab546c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:11.802016 17553 raft_consensus.cc:3060] T c26e43514e564f9e906f938557e587e8 P 2be4570f313d4a219ad149e28ab546c5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:55:11.806213 17627 raft_consensus.cc:2468] T c26e43514e564f9e906f938557e587e8 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f9e4abf970849caa70a02ede7f97cd8 in term 2.
I20260709 14:55:11.808910 17667 leader_election.cc:304] T c26e43514e564f9e906f938557e587e8 P 3f9e4abf970849caa70a02ede7f97cd8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f9e4abf970849caa70a02ede7f97cd8, 450b7f1304cb4c2ca4c9ccf62afb6937; no voters: 
I20260709 14:55:11.810400 17762 raft_consensus.cc:2804] T c26e43514e564f9e906f938557e587e8 P 3f9e4abf970849caa70a02ede7f97cd8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:55:11.811196 17762 raft_consensus.cc:697] T c26e43514e564f9e906f938557e587e8 P 3f9e4abf970849caa70a02ede7f97cd8 [term 2 LEADER]: Becoming Leader. State: Replica: 3f9e4abf970849caa70a02ede7f97cd8, State: Running, Role: LEADER
I20260709 14:55:11.811825 17553 raft_consensus.cc:2468] T c26e43514e564f9e906f938557e587e8 P 2be4570f313d4a219ad149e28ab546c5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f9e4abf970849caa70a02ede7f97cd8 in term 2.
I20260709 14:55:11.812306 17762 consensus_queue.cc:237] T c26e43514e564f9e906f938557e587e8 P 3f9e4abf970849caa70a02ede7f97cd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:11.815557 17450 catalog_manager.cc:5697] T 2ee76f3707314e23b707060672d77fdb P 450b7f1304cb4c2ca4c9ccf62afb6937 reported cstate change: term changed from 1 to 2, leader changed from 3f9e4abf970849caa70a02ede7f97cd8 (127.6.101.67) to 450b7f1304cb4c2ca4c9ccf62afb6937 (127.6.101.66). New cstate: current_term: 2 leader_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } health_report { overall_health: UNKNOWN } } }
I20260709 14:55:11.824532 17449 catalog_manager.cc:5697] T c26e43514e564f9e906f938557e587e8 P 3f9e4abf970849caa70a02ede7f97cd8 reported cstate change: term changed from 1 to 2, leader changed from 2be4570f313d4a219ad149e28ab546c5 (127.6.101.65) to 3f9e4abf970849caa70a02ede7f97cd8 (127.6.101.67). New cstate: current_term: 2 leader_uuid: "3f9e4abf970849caa70a02ede7f97cd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } health_report { overall_health: HEALTHY } } }
I20260709 14:55:11.964295 17702 raft_consensus.cc:1275] T f9509b6f243644ed9e147299153953b2 P 3f9e4abf970849caa70a02ede7f97cd8 [term 2 FOLLOWER]: Refusing update from remote peer 2be4570f313d4a219ad149e28ab546c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:55:11.966094 17817 consensus_queue.cc:1048] T f9509b6f243644ed9e147299153953b2 P 2be4570f313d4a219ad149e28ab546c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 14:55:11.975260 17627 raft_consensus.cc:1275] T f9509b6f243644ed9e147299153953b2 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 2 FOLLOWER]: Refusing update from remote peer 2be4570f313d4a219ad149e28ab546c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:55:11.977118 17786 consensus_queue.cc:1048] T f9509b6f243644ed9e147299153953b2 P 2be4570f313d4a219ad149e28ab546c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 14:55:12.156736 17553 raft_consensus.cc:1275] T 876c059b51af47a9a687c1e92c95a515 P 2be4570f313d4a219ad149e28ab546c5 [term 2 FOLLOWER]: Refusing update from remote peer 450b7f1304cb4c2ca4c9ccf62afb6937: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:55:12.158663 17767 consensus_queue.cc:1048] T 876c059b51af47a9a687c1e92c95a515 P 450b7f1304cb4c2ca4c9ccf62afb6937 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 14:55:12.170246 17702 raft_consensus.cc:1275] T 876c059b51af47a9a687c1e92c95a515 P 3f9e4abf970849caa70a02ede7f97cd8 [term 2 FOLLOWER]: Refusing update from remote peer 450b7f1304cb4c2ca4c9ccf62afb6937: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:55:12.172422 17768 consensus_queue.cc:1048] T 876c059b51af47a9a687c1e92c95a515 P 450b7f1304cb4c2ca4c9ccf62afb6937 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 14:55:12.198359 17702 raft_consensus.cc:1275] T 2e8e053361a54d7c91f2fe670f4aa514 P 3f9e4abf970849caa70a02ede7f97cd8 [term 2 FOLLOWER]: Refusing update from remote peer 2be4570f313d4a219ad149e28ab546c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:55:12.200744 17786 consensus_queue.cc:1048] T 2e8e053361a54d7c91f2fe670f4aa514 P 2be4570f313d4a219ad149e28ab546c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 14:55:12.213918 17627 raft_consensus.cc:1275] T 2e8e053361a54d7c91f2fe670f4aa514 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 2 FOLLOWER]: Refusing update from remote peer 2be4570f313d4a219ad149e28ab546c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:55:12.216007 17786 consensus_queue.cc:1048] T 2e8e053361a54d7c91f2fe670f4aa514 P 2be4570f313d4a219ad149e28ab546c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 14:55:12.245008 17553 raft_consensus.cc:1275] T c26e43514e564f9e906f938557e587e8 P 2be4570f313d4a219ad149e28ab546c5 [term 2 FOLLOWER]: Refusing update from remote peer 3f9e4abf970849caa70a02ede7f97cd8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:55:12.246130 17627 raft_consensus.cc:1275] T f9764d88fc354df8a8b107f95579fc60 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 2 FOLLOWER]: Refusing update from remote peer 2be4570f313d4a219ad149e28ab546c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:55:12.246723 17762 consensus_queue.cc:1048] T c26e43514e564f9e906f938557e587e8 P 3f9e4abf970849caa70a02ede7f97cd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 14:55:12.248060 17786 consensus_queue.cc:1048] T f9764d88fc354df8a8b107f95579fc60 P 2be4570f313d4a219ad149e28ab546c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 14:55:12.264137 17628 raft_consensus.cc:1275] T c26e43514e564f9e906f938557e587e8 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 2 FOLLOWER]: Refusing update from remote peer 3f9e4abf970849caa70a02ede7f97cd8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:55:12.266165 17762 consensus_queue.cc:1048] T c26e43514e564f9e906f938557e587e8 P 3f9e4abf970849caa70a02ede7f97cd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 14:55:12.267572 17551 raft_consensus.cc:1275] T 2ee76f3707314e23b707060672d77fdb P 2be4570f313d4a219ad149e28ab546c5 [term 2 FOLLOWER]: Refusing update from remote peer 450b7f1304cb4c2ca4c9ccf62afb6937: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:55:12.269918 17768 consensus_queue.cc:1048] T 2ee76f3707314e23b707060672d77fdb P 450b7f1304cb4c2ca4c9ccf62afb6937 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 14:55:12.273350 17702 raft_consensus.cc:1275] T f9764d88fc354df8a8b107f95579fc60 P 3f9e4abf970849caa70a02ede7f97cd8 [term 2 FOLLOWER]: Refusing update from remote peer 2be4570f313d4a219ad149e28ab546c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:55:12.277127 17786 consensus_queue.cc:1048] T f9764d88fc354df8a8b107f95579fc60 P 2be4570f313d4a219ad149e28ab546c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 14:55:12.286468 17700 raft_consensus.cc:1275] T 2ee76f3707314e23b707060672d77fdb P 3f9e4abf970849caa70a02ede7f97cd8 [term 2 FOLLOWER]: Refusing update from remote peer 450b7f1304cb4c2ca4c9ccf62afb6937: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:55:12.288386 17768 consensus_queue.cc:1048] T 2ee76f3707314e23b707060672d77fdb P 450b7f1304cb4c2ca4c9ccf62afb6937 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 14:55:14.551710 17451 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33274:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 14:55:14.554667 17451 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 14:55:14.623059 17535 tablet_service.cc:1511] Processing CreateTablet for tablet 22cb1b4f8c5f457b9f5661dd2d0e208d (DEFAULT_TABLE table=soft_deleted_table [id=e47f68bf5da0475b8ec262d0b5aa974e]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 14:55:14.624522 17614 tablet_service.cc:1511] Processing CreateTablet for tablet 22cb1b4f8c5f457b9f5661dd2d0e208d (DEFAULT_TABLE table=soft_deleted_table [id=e47f68bf5da0475b8ec262d0b5aa974e]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 14:55:14.625414 17535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22cb1b4f8c5f457b9f5661dd2d0e208d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:55:14.626526 17614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22cb1b4f8c5f457b9f5661dd2d0e208d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:55:14.630803 17687 tablet_service.cc:1511] Processing CreateTablet for tablet 22cb1b4f8c5f457b9f5661dd2d0e208d (DEFAULT_TABLE table=soft_deleted_table [id=e47f68bf5da0475b8ec262d0b5aa974e]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 14:55:14.634228 17687 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22cb1b4f8c5f457b9f5661dd2d0e208d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:55:14.631019 17692 tablet_service.cc:1511] Processing CreateTablet for tablet b5d16339e8c74f8aa5c9bef2ed4ef1c6 (DEFAULT_TABLE table=soft_deleted_table [id=e47f68bf5da0475b8ec262d0b5aa974e]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 14:55:14.637758 17692 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5d16339e8c74f8aa5c9bef2ed4ef1c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:55:14.638707 17537 tablet_service.cc:1511] Processing CreateTablet for tablet b5d16339e8c74f8aa5c9bef2ed4ef1c6 (DEFAULT_TABLE table=soft_deleted_table [id=e47f68bf5da0475b8ec262d0b5aa974e]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 14:55:14.640614 17537 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5d16339e8c74f8aa5c9bef2ed4ef1c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:55:14.642910 17536 tablet_service.cc:1511] Processing CreateTablet for tablet 947a22f76d864a6dbbb88eb7f085fe17 (DEFAULT_TABLE table=soft_deleted_table [id=e47f68bf5da0475b8ec262d0b5aa974e]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 14:55:14.644883 17536 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 947a22f76d864a6dbbb88eb7f085fe17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:55:14.646615 17617 tablet_service.cc:1511] Processing CreateTablet for tablet 947a22f76d864a6dbbb88eb7f085fe17 (DEFAULT_TABLE table=soft_deleted_table [id=e47f68bf5da0475b8ec262d0b5aa974e]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 14:55:14.648622 17617 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 947a22f76d864a6dbbb88eb7f085fe17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:55:14.649121 17686 tablet_service.cc:1511] Processing CreateTablet for tablet bdbd06b81c1f4dddbfd9a9f52f3f90c2 (DEFAULT_TABLE table=soft_deleted_table [id=e47f68bf5da0475b8ec262d0b5aa974e]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 14:55:14.651028 17612 tablet_service.cc:1511] Processing CreateTablet for tablet bdbd06b81c1f4dddbfd9a9f52f3f90c2 (DEFAULT_TABLE table=soft_deleted_table [id=e47f68bf5da0475b8ec262d0b5aa974e]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 14:55:14.652758 17612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bdbd06b81c1f4dddbfd9a9f52f3f90c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:55:14.646441 17685 tablet_service.cc:1511] Processing CreateTablet for tablet 947a22f76d864a6dbbb88eb7f085fe17 (DEFAULT_TABLE table=soft_deleted_table [id=e47f68bf5da0475b8ec262d0b5aa974e]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 14:55:14.633710 17616 tablet_service.cc:1511] Processing CreateTablet for tablet b5d16339e8c74f8aa5c9bef2ed4ef1c6 (DEFAULT_TABLE table=soft_deleted_table [id=e47f68bf5da0475b8ec262d0b5aa974e]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 14:55:14.656975 17540 tablet_service.cc:1511] Processing CreateTablet for tablet bdbd06b81c1f4dddbfd9a9f52f3f90c2 (DEFAULT_TABLE table=soft_deleted_table [id=e47f68bf5da0475b8ec262d0b5aa974e]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 14:55:14.651042 17686 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bdbd06b81c1f4dddbfd9a9f52f3f90c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:55:14.659379 17613 tablet_service.cc:1511] Processing CreateTablet for tablet b56c5a30e63c401cbfb713fd3a859194 (DEFAULT_TABLE table=soft_deleted_table [id=e47f68bf5da0475b8ec262d0b5aa974e]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 14:55:14.659996 17538 tablet_service.cc:1511] Processing CreateTablet for tablet b56c5a30e63c401cbfb713fd3a859194 (DEFAULT_TABLE table=soft_deleted_table [id=e47f68bf5da0475b8ec262d0b5aa974e]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 14:55:14.664551 17688 tablet_service.cc:1511] Processing CreateTablet for tablet b56c5a30e63c401cbfb713fd3a859194 (DEFAULT_TABLE table=soft_deleted_table [id=e47f68bf5da0475b8ec262d0b5aa974e]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 14:55:14.666635 17541 tablet_service.cc:1511] Processing CreateTablet for tablet 9bc3dcde63fb4f438cb12b4e64ee2d30 (DEFAULT_TABLE table=soft_deleted_table [id=e47f68bf5da0475b8ec262d0b5aa974e]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 14:55:14.669548 17613 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b56c5a30e63c401cbfb713fd3a859194. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:55:14.670014 17689 tablet_service.cc:1511] Processing CreateTablet for tablet 9bc3dcde63fb4f438cb12b4e64ee2d30 (DEFAULT_TABLE table=soft_deleted_table [id=e47f68bf5da0475b8ec262d0b5aa974e]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 14:55:14.670408 17615 tablet_service.cc:1511] Processing CreateTablet for tablet 9bc3dcde63fb4f438cb12b4e64ee2d30 (DEFAULT_TABLE table=soft_deleted_table [id=e47f68bf5da0475b8ec262d0b5aa974e]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 14:55:14.671797 17615 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9bc3dcde63fb4f438cb12b4e64ee2d30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:55:14.677289 17618 tablet_service.cc:1511] Processing CreateTablet for tablet bba029f9d36e45249ae3b3699bebed9b (DEFAULT_TABLE table=soft_deleted_table [id=e47f68bf5da0475b8ec262d0b5aa974e]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 14:55:14.679106 17618 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bba029f9d36e45249ae3b3699bebed9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:55:14.682600 17690 tablet_service.cc:1511] Processing CreateTablet for tablet bba029f9d36e45249ae3b3699bebed9b (DEFAULT_TABLE table=soft_deleted_table [id=e47f68bf5da0475b8ec262d0b5aa974e]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 14:55:14.683975 17616 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5d16339e8c74f8aa5c9bef2ed4ef1c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:55:14.689664 17541 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9bc3dcde63fb4f438cb12b4e64ee2d30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:55:14.692196 17540 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bdbd06b81c1f4dddbfd9a9f52f3f90c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:55:14.693362 17538 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b56c5a30e63c401cbfb713fd3a859194. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:55:14.664599 17685 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 947a22f76d864a6dbbb88eb7f085fe17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:55:14.697345 17688 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b56c5a30e63c401cbfb713fd3a859194. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:55:14.700299 17689 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9bc3dcde63fb4f438cb12b4e64ee2d30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:55:14.702914 17690 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bba029f9d36e45249ae3b3699bebed9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:55:14.708462 17539 tablet_service.cc:1511] Processing CreateTablet for tablet bba029f9d36e45249ae3b3699bebed9b (DEFAULT_TABLE table=soft_deleted_table [id=e47f68bf5da0475b8ec262d0b5aa974e]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 14:55:14.710912 17539 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bba029f9d36e45249ae3b3699bebed9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:55:14.727519 17611 tablet_service.cc:1511] Processing CreateTablet for tablet ac091812917c4fa0a02bdc0d9984206d (DEFAULT_TABLE table=soft_deleted_table [id=e47f68bf5da0475b8ec262d0b5aa974e]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 14:55:14.730275 17691 tablet_service.cc:1511] Processing CreateTablet for tablet ac091812917c4fa0a02bdc0d9984206d (DEFAULT_TABLE table=soft_deleted_table [id=e47f68bf5da0475b8ec262d0b5aa974e]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 14:55:14.732049 17691 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac091812917c4fa0a02bdc0d9984206d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:55:14.736286 17610 tablet_service.cc:1511] Processing CreateTablet for tablet d778ef6fbde3497389223b362f88a26a (DEFAULT_TABLE table=soft_deleted_table [id=e47f68bf5da0475b8ec262d0b5aa974e]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 14:55:14.737607 17611 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac091812917c4fa0a02bdc0d9984206d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:55:14.739151 17684 tablet_service.cc:1511] Processing CreateTablet for tablet d778ef6fbde3497389223b362f88a26a (DEFAULT_TABLE table=soft_deleted_table [id=e47f68bf5da0475b8ec262d0b5aa974e]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 14:55:14.740666 17684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d778ef6fbde3497389223b362f88a26a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:55:14.742159 17610 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d778ef6fbde3497389223b362f88a26a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:55:14.777916 17543 tablet_service.cc:1511] Processing CreateTablet for tablet d778ef6fbde3497389223b362f88a26a (DEFAULT_TABLE table=soft_deleted_table [id=e47f68bf5da0475b8ec262d0b5aa974e]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 14:55:14.778693 17542 tablet_service.cc:1511] Processing CreateTablet for tablet ac091812917c4fa0a02bdc0d9984206d (DEFAULT_TABLE table=soft_deleted_table [id=e47f68bf5da0475b8ec262d0b5aa974e]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 14:55:14.779597 17543 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d778ef6fbde3497389223b362f88a26a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:55:14.780314 17542 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac091812917c4fa0a02bdc0d9984206d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:55:14.844863 17850 tablet_bootstrap.cc:492] T 22cb1b4f8c5f457b9f5661dd2d0e208d P 450b7f1304cb4c2ca4c9ccf62afb6937: Bootstrap starting.
I20260709 14:55:14.878043 17852 tablet_bootstrap.cc:492] T 22cb1b4f8c5f457b9f5661dd2d0e208d P 2be4570f313d4a219ad149e28ab546c5: Bootstrap starting.
I20260709 14:55:14.920845 17850 tablet_bootstrap.cc:654] T 22cb1b4f8c5f457b9f5661dd2d0e208d P 450b7f1304cb4c2ca4c9ccf62afb6937: Neither blocks nor log segments found. Creating new log.
I20260709 14:55:14.947649 17851 tablet_bootstrap.cc:492] T d778ef6fbde3497389223b362f88a26a P 3f9e4abf970849caa70a02ede7f97cd8: Bootstrap starting.
I20260709 14:55:14.960114 17851 tablet_bootstrap.cc:654] T d778ef6fbde3497389223b362f88a26a P 3f9e4abf970849caa70a02ede7f97cd8: Neither blocks nor log segments found. Creating new log.
I20260709 14:55:14.961313 17852 tablet_bootstrap.cc:654] T 22cb1b4f8c5f457b9f5661dd2d0e208d P 2be4570f313d4a219ad149e28ab546c5: Neither blocks nor log segments found. Creating new log.
I20260709 14:55:14.965633 17850 tablet_bootstrap.cc:492] T 22cb1b4f8c5f457b9f5661dd2d0e208d P 450b7f1304cb4c2ca4c9ccf62afb6937: No bootstrap required, opened a new log
I20260709 14:55:14.967496 17850 ts_tablet_manager.cc:1403] T 22cb1b4f8c5f457b9f5661dd2d0e208d P 450b7f1304cb4c2ca4c9ccf62afb6937: Time spent bootstrapping tablet: real 0.123s	user 0.014s	sys 0.016s
I20260709 14:55:14.971537 17850 raft_consensus.cc:359] T 22cb1b4f8c5f457b9f5661dd2d0e208d P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:14.972826 17850 raft_consensus.cc:385] T 22cb1b4f8c5f457b9f5661dd2d0e208d P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:55:14.973181 17850 raft_consensus.cc:740] T 22cb1b4f8c5f457b9f5661dd2d0e208d P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 450b7f1304cb4c2ca4c9ccf62afb6937, State: Initialized, Role: FOLLOWER
I20260709 14:55:14.974149 17850 consensus_queue.cc:260] T 22cb1b4f8c5f457b9f5661dd2d0e208d P 450b7f1304cb4c2ca4c9ccf62afb6937 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:14.974992 17851 tablet_bootstrap.cc:492] T d778ef6fbde3497389223b362f88a26a P 3f9e4abf970849caa70a02ede7f97cd8: No bootstrap required, opened a new log
I20260709 14:55:14.976459 17851 ts_tablet_manager.cc:1403] T d778ef6fbde3497389223b362f88a26a P 3f9e4abf970849caa70a02ede7f97cd8: Time spent bootstrapping tablet: real 0.029s	user 0.004s	sys 0.011s
I20260709 14:55:14.980208 17851 raft_consensus.cc:359] T d778ef6fbde3497389223b362f88a26a P 3f9e4abf970849caa70a02ede7f97cd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:14.981076 17851 raft_consensus.cc:385] T d778ef6fbde3497389223b362f88a26a P 3f9e4abf970849caa70a02ede7f97cd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:55:14.981213 17850 ts_tablet_manager.cc:1434] T 22cb1b4f8c5f457b9f5661dd2d0e208d P 450b7f1304cb4c2ca4c9ccf62afb6937: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.001s
I20260709 14:55:14.981455 17851 raft_consensus.cc:740] T d778ef6fbde3497389223b362f88a26a P 3f9e4abf970849caa70a02ede7f97cd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f9e4abf970849caa70a02ede7f97cd8, State: Initialized, Role: FOLLOWER
I20260709 14:55:14.982832 17850 tablet_bootstrap.cc:492] T b56c5a30e63c401cbfb713fd3a859194 P 450b7f1304cb4c2ca4c9ccf62afb6937: Bootstrap starting.
I20260709 14:55:14.982776 17851 consensus_queue.cc:260] T d778ef6fbde3497389223b362f88a26a P 3f9e4abf970849caa70a02ede7f97cd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:14.984609 17852 tablet_bootstrap.cc:492] T 22cb1b4f8c5f457b9f5661dd2d0e208d P 2be4570f313d4a219ad149e28ab546c5: No bootstrap required, opened a new log
I20260709 14:55:14.985214 17852 ts_tablet_manager.cc:1403] T 22cb1b4f8c5f457b9f5661dd2d0e208d P 2be4570f313d4a219ad149e28ab546c5: Time spent bootstrapping tablet: real 0.108s	user 0.013s	sys 0.005s
I20260709 14:55:14.990566 17850 tablet_bootstrap.cc:654] T b56c5a30e63c401cbfb713fd3a859194 P 450b7f1304cb4c2ca4c9ccf62afb6937: Neither blocks nor log segments found. Creating new log.
I20260709 14:55:14.994287 17852 raft_consensus.cc:359] T 22cb1b4f8c5f457b9f5661dd2d0e208d P 2be4570f313d4a219ad149e28ab546c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:14.994613 17851 ts_tablet_manager.cc:1434] T d778ef6fbde3497389223b362f88a26a P 3f9e4abf970849caa70a02ede7f97cd8: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.001s
I20260709 14:55:14.995296 17852 raft_consensus.cc:385] T 22cb1b4f8c5f457b9f5661dd2d0e208d P 2be4570f313d4a219ad149e28ab546c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:55:14.995730 17852 raft_consensus.cc:740] T 22cb1b4f8c5f457b9f5661dd2d0e208d P 2be4570f313d4a219ad149e28ab546c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2be4570f313d4a219ad149e28ab546c5, State: Initialized, Role: FOLLOWER
I20260709 14:55:14.996248 17851 tablet_bootstrap.cc:492] T b5d16339e8c74f8aa5c9bef2ed4ef1c6 P 3f9e4abf970849caa70a02ede7f97cd8: Bootstrap starting.
I20260709 14:55:14.996758 17852 consensus_queue.cc:260] T 22cb1b4f8c5f457b9f5661dd2d0e208d P 2be4570f313d4a219ad149e28ab546c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:15.003465 17851 tablet_bootstrap.cc:654] T b5d16339e8c74f8aa5c9bef2ed4ef1c6 P 3f9e4abf970849caa70a02ede7f97cd8: Neither blocks nor log segments found. Creating new log.
I20260709 14:55:15.005168 17852 ts_tablet_manager.cc:1434] T 22cb1b4f8c5f457b9f5661dd2d0e208d P 2be4570f313d4a219ad149e28ab546c5: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.002s
I20260709 14:55:15.006481 17852 tablet_bootstrap.cc:492] T b56c5a30e63c401cbfb713fd3a859194 P 2be4570f313d4a219ad149e28ab546c5: Bootstrap starting.
I20260709 14:55:15.011870 17851 tablet_bootstrap.cc:492] T b5d16339e8c74f8aa5c9bef2ed4ef1c6 P 3f9e4abf970849caa70a02ede7f97cd8: No bootstrap required, opened a new log
I20260709 14:55:15.012508 17851 ts_tablet_manager.cc:1403] T b5d16339e8c74f8aa5c9bef2ed4ef1c6 P 3f9e4abf970849caa70a02ede7f97cd8: Time spent bootstrapping tablet: real 0.016s	user 0.008s	sys 0.004s
I20260709 14:55:15.015738 17850 tablet_bootstrap.cc:492] T b56c5a30e63c401cbfb713fd3a859194 P 450b7f1304cb4c2ca4c9ccf62afb6937: No bootstrap required, opened a new log
I20260709 14:55:15.015935 17852 tablet_bootstrap.cc:654] T b56c5a30e63c401cbfb713fd3a859194 P 2be4570f313d4a219ad149e28ab546c5: Neither blocks nor log segments found. Creating new log.
I20260709 14:55:15.016546 17850 ts_tablet_manager.cc:1403] T b56c5a30e63c401cbfb713fd3a859194 P 450b7f1304cb4c2ca4c9ccf62afb6937: Time spent bootstrapping tablet: real 0.034s	user 0.014s	sys 0.004s
I20260709 14:55:15.016382 17851 raft_consensus.cc:359] T b5d16339e8c74f8aa5c9bef2ed4ef1c6 P 3f9e4abf970849caa70a02ede7f97cd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:15.017218 17851 raft_consensus.cc:385] T b5d16339e8c74f8aa5c9bef2ed4ef1c6 P 3f9e4abf970849caa70a02ede7f97cd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:55:15.017674 17851 raft_consensus.cc:740] T b5d16339e8c74f8aa5c9bef2ed4ef1c6 P 3f9e4abf970849caa70a02ede7f97cd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f9e4abf970849caa70a02ede7f97cd8, State: Initialized, Role: FOLLOWER
I20260709 14:55:15.018800 17851 consensus_queue.cc:260] T b5d16339e8c74f8aa5c9bef2ed4ef1c6 P 3f9e4abf970849caa70a02ede7f97cd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:15.020751 17850 raft_consensus.cc:359] T b56c5a30e63c401cbfb713fd3a859194 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:15.021757 17850 raft_consensus.cc:385] T b56c5a30e63c401cbfb713fd3a859194 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:55:15.022078 17851 ts_tablet_manager.cc:1434] T b5d16339e8c74f8aa5c9bef2ed4ef1c6 P 3f9e4abf970849caa70a02ede7f97cd8: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.009s
I20260709 14:55:15.022091 17850 raft_consensus.cc:740] T b56c5a30e63c401cbfb713fd3a859194 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 450b7f1304cb4c2ca4c9ccf62afb6937, State: Initialized, Role: FOLLOWER
I20260709 14:55:15.023567 17851 tablet_bootstrap.cc:492] T 9bc3dcde63fb4f438cb12b4e64ee2d30 P 3f9e4abf970849caa70a02ede7f97cd8: Bootstrap starting.
I20260709 14:55:15.023197 17850 consensus_queue.cc:260] T b56c5a30e63c401cbfb713fd3a859194 P 450b7f1304cb4c2ca4c9ccf62afb6937 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:15.026314 17852 tablet_bootstrap.cc:492] T b56c5a30e63c401cbfb713fd3a859194 P 2be4570f313d4a219ad149e28ab546c5: No bootstrap required, opened a new log
I20260709 14:55:15.027052 17852 ts_tablet_manager.cc:1403] T b56c5a30e63c401cbfb713fd3a859194 P 2be4570f313d4a219ad149e28ab546c5: Time spent bootstrapping tablet: real 0.021s	user 0.009s	sys 0.005s
I20260709 14:55:15.030437 17850 ts_tablet_manager.cc:1434] T b56c5a30e63c401cbfb713fd3a859194 P 450b7f1304cb4c2ca4c9ccf62afb6937: Time spent starting tablet: real 0.013s	user 0.011s	sys 0.001s
I20260709 14:55:15.031114 17852 raft_consensus.cc:359] T b56c5a30e63c401cbfb713fd3a859194 P 2be4570f313d4a219ad149e28ab546c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:15.031810 17850 tablet_bootstrap.cc:492] T b5d16339e8c74f8aa5c9bef2ed4ef1c6 P 450b7f1304cb4c2ca4c9ccf62afb6937: Bootstrap starting.
I20260709 14:55:15.032199 17851 tablet_bootstrap.cc:654] T 9bc3dcde63fb4f438cb12b4e64ee2d30 P 3f9e4abf970849caa70a02ede7f97cd8: Neither blocks nor log segments found. Creating new log.
I20260709 14:55:15.032141 17852 raft_consensus.cc:385] T b56c5a30e63c401cbfb713fd3a859194 P 2be4570f313d4a219ad149e28ab546c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:55:15.041962 17852 raft_consensus.cc:740] T b56c5a30e63c401cbfb713fd3a859194 P 2be4570f313d4a219ad149e28ab546c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2be4570f313d4a219ad149e28ab546c5, State: Initialized, Role: FOLLOWER
I20260709 14:55:15.042335 17850 tablet_bootstrap.cc:654] T b5d16339e8c74f8aa5c9bef2ed4ef1c6 P 450b7f1304cb4c2ca4c9ccf62afb6937: Neither blocks nor log segments found. Creating new log.
I20260709 14:55:15.043171 17852 consensus_queue.cc:260] T b56c5a30e63c401cbfb713fd3a859194 P 2be4570f313d4a219ad149e28ab546c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:15.049278 17852 ts_tablet_manager.cc:1434] T b56c5a30e63c401cbfb713fd3a859194 P 2be4570f313d4a219ad149e28ab546c5: Time spent starting tablet: real 0.022s	user 0.009s	sys 0.008s
I20260709 14:55:15.050580 17852 tablet_bootstrap.cc:492] T bba029f9d36e45249ae3b3699bebed9b P 2be4570f313d4a219ad149e28ab546c5: Bootstrap starting.
I20260709 14:55:15.058262 17850 tablet_bootstrap.cc:492] T b5d16339e8c74f8aa5c9bef2ed4ef1c6 P 450b7f1304cb4c2ca4c9ccf62afb6937: No bootstrap required, opened a new log
I20260709 14:55:15.058431 17851 tablet_bootstrap.cc:492] T 9bc3dcde63fb4f438cb12b4e64ee2d30 P 3f9e4abf970849caa70a02ede7f97cd8: No bootstrap required, opened a new log
I20260709 14:55:15.059036 17850 ts_tablet_manager.cc:1403] T b5d16339e8c74f8aa5c9bef2ed4ef1c6 P 450b7f1304cb4c2ca4c9ccf62afb6937: Time spent bootstrapping tablet: real 0.028s	user 0.017s	sys 0.004s
I20260709 14:55:15.059109 17852 tablet_bootstrap.cc:654] T bba029f9d36e45249ae3b3699bebed9b P 2be4570f313d4a219ad149e28ab546c5: Neither blocks nor log segments found. Creating new log.
I20260709 14:55:15.059265 17851 ts_tablet_manager.cc:1403] T 9bc3dcde63fb4f438cb12b4e64ee2d30 P 3f9e4abf970849caa70a02ede7f97cd8: Time spent bootstrapping tablet: real 0.036s	user 0.014s	sys 0.007s
I20260709 14:55:15.063225 17850 raft_consensus.cc:359] T b5d16339e8c74f8aa5c9bef2ed4ef1c6 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:15.064172 17850 raft_consensus.cc:385] T b5d16339e8c74f8aa5c9bef2ed4ef1c6 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:55:15.063853 17851 raft_consensus.cc:359] T 9bc3dcde63fb4f438cb12b4e64ee2d30 P 3f9e4abf970849caa70a02ede7f97cd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:15.064505 17850 raft_consensus.cc:740] T b5d16339e8c74f8aa5c9bef2ed4ef1c6 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 450b7f1304cb4c2ca4c9ccf62afb6937, State: Initialized, Role: FOLLOWER
I20260709 14:55:15.064692 17851 raft_consensus.cc:385] T 9bc3dcde63fb4f438cb12b4e64ee2d30 P 3f9e4abf970849caa70a02ede7f97cd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:55:15.065012 17851 raft_consensus.cc:740] T 9bc3dcde63fb4f438cb12b4e64ee2d30 P 3f9e4abf970849caa70a02ede7f97cd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f9e4abf970849caa70a02ede7f97cd8, State: Initialized, Role: FOLLOWER
I20260709 14:55:15.065649 17850 consensus_queue.cc:260] T b5d16339e8c74f8aa5c9bef2ed4ef1c6 P 450b7f1304cb4c2ca4c9ccf62afb6937 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:15.068431 17850 ts_tablet_manager.cc:1434] T b5d16339e8c74f8aa5c9bef2ed4ef1c6 P 450b7f1304cb4c2ca4c9ccf62afb6937: Time spent starting tablet: real 0.009s	user 0.001s	sys 0.004s
I20260709 14:55:15.066007 17851 consensus_queue.cc:260] T 9bc3dcde63fb4f438cb12b4e64ee2d30 P 3f9e4abf970849caa70a02ede7f97cd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:15.072438 17851 ts_tablet_manager.cc:1434] T 9bc3dcde63fb4f438cb12b4e64ee2d30 P 3f9e4abf970849caa70a02ede7f97cd8: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 14:55:15.074337 17851 tablet_bootstrap.cc:492] T bdbd06b81c1f4dddbfd9a9f52f3f90c2 P 3f9e4abf970849caa70a02ede7f97cd8: Bootstrap starting.
I20260709 14:55:15.080400 17850 tablet_bootstrap.cc:492] T bba029f9d36e45249ae3b3699bebed9b P 450b7f1304cb4c2ca4c9ccf62afb6937: Bootstrap starting.
I20260709 14:55:15.082476 17851 tablet_bootstrap.cc:654] T bdbd06b81c1f4dddbfd9a9f52f3f90c2 P 3f9e4abf970849caa70a02ede7f97cd8: Neither blocks nor log segments found. Creating new log.
I20260709 14:55:15.088948 17852 tablet_bootstrap.cc:492] T bba029f9d36e45249ae3b3699bebed9b P 2be4570f313d4a219ad149e28ab546c5: No bootstrap required, opened a new log
I20260709 14:55:15.089427 17837 raft_consensus.cc:493] T 9bc3dcde63fb4f438cb12b4e64ee2d30 P 3f9e4abf970849caa70a02ede7f97cd8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:55:15.090149 17852 ts_tablet_manager.cc:1403] T bba029f9d36e45249ae3b3699bebed9b P 2be4570f313d4a219ad149e28ab546c5: Time spent bootstrapping tablet: real 0.040s	user 0.030s	sys 0.003s
I20260709 14:55:15.090255 17837 raft_consensus.cc:515] T 9bc3dcde63fb4f438cb12b4e64ee2d30 P 3f9e4abf970849caa70a02ede7f97cd8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:15.091351 17850 tablet_bootstrap.cc:654] T bba029f9d36e45249ae3b3699bebed9b P 450b7f1304cb4c2ca4c9ccf62afb6937: Neither blocks nor log segments found. Creating new log.
I20260709 14:55:15.094002 17851 tablet_bootstrap.cc:492] T bdbd06b81c1f4dddbfd9a9f52f3f90c2 P 3f9e4abf970849caa70a02ede7f97cd8: No bootstrap required, opened a new log
I20260709 14:55:15.094643 17852 raft_consensus.cc:359] T bba029f9d36e45249ae3b3699bebed9b P 2be4570f313d4a219ad149e28ab546c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:15.095286 17551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc3dcde63fb4f438cb12b4e64ee2d30" candidate_uuid: "3f9e4abf970849caa70a02ede7f97cd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2be4570f313d4a219ad149e28ab546c5" is_pre_election: true
I20260709 14:55:15.095777 17837 leader_election.cc:290] T 9bc3dcde63fb4f438cb12b4e64ee2d30 P 3f9e4abf970849caa70a02ede7f97cd8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2be4570f313d4a219ad149e28ab546c5 (127.6.101.65:43507), 450b7f1304cb4c2ca4c9ccf62afb6937 (127.6.101.66:35877)
I20260709 14:55:15.094645 17851 ts_tablet_manager.cc:1403] T bdbd06b81c1f4dddbfd9a9f52f3f90c2 P 3f9e4abf970849caa70a02ede7f97cd8: Time spent bootstrapping tablet: real 0.021s	user 0.016s	sys 0.000s
I20260709 14:55:15.095664 17852 raft_consensus.cc:385] T bba029f9d36e45249ae3b3699bebed9b P 2be4570f313d4a219ad149e28ab546c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:55:15.097378 17852 raft_consensus.cc:740] T bba029f9d36e45249ae3b3699bebed9b P 2be4570f313d4a219ad149e28ab546c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2be4570f313d4a219ad149e28ab546c5, State: Initialized, Role: FOLLOWER
I20260709 14:55:15.098352 17852 consensus_queue.cc:260] T bba029f9d36e45249ae3b3699bebed9b P 2be4570f313d4a219ad149e28ab546c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:15.099205 17627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc3dcde63fb4f438cb12b4e64ee2d30" candidate_uuid: "3f9e4abf970849caa70a02ede7f97cd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" is_pre_election: true
I20260709 14:55:15.099586 17851 raft_consensus.cc:359] T bdbd06b81c1f4dddbfd9a9f52f3f90c2 P 3f9e4abf970849caa70a02ede7f97cd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:15.100514 17851 raft_consensus.cc:385] T bdbd06b81c1f4dddbfd9a9f52f3f90c2 P 3f9e4abf970849caa70a02ede7f97cd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:55:15.100835 17851 raft_consensus.cc:740] T bdbd06b81c1f4dddbfd9a9f52f3f90c2 P 3f9e4abf970849caa70a02ede7f97cd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f9e4abf970849caa70a02ede7f97cd8, State: Initialized, Role: FOLLOWER
I20260709 14:55:15.100911 17852 ts_tablet_manager.cc:1434] T bba029f9d36e45249ae3b3699bebed9b P 2be4570f313d4a219ad149e28ab546c5: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 14:55:15.101701 17851 consensus_queue.cc:260] T bdbd06b81c1f4dddbfd9a9f52f3f90c2 P 3f9e4abf970849caa70a02ede7f97cd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
W20260709 14:55:15.103287 17667 leader_election.cc:343] T 9bc3dcde63fb4f438cb12b4e64ee2d30 P 3f9e4abf970849caa70a02ede7f97cd8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 450b7f1304cb4c2ca4c9ccf62afb6937 (127.6.101.66:35877): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:55:15.104391 17851 ts_tablet_manager.cc:1434] T bdbd06b81c1f4dddbfd9a9f52f3f90c2 P 3f9e4abf970849caa70a02ede7f97cd8: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 14:55:15.102195 17852 tablet_bootstrap.cc:492] T 9bc3dcde63fb4f438cb12b4e64ee2d30 P 2be4570f313d4a219ad149e28ab546c5: Bootstrap starting.
W20260709 14:55:15.105531 17665 leader_election.cc:343] T 9bc3dcde63fb4f438cb12b4e64ee2d30 P 3f9e4abf970849caa70a02ede7f97cd8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2be4570f313d4a219ad149e28ab546c5 (127.6.101.65:43507): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:55:15.106050 17665 leader_election.cc:304] T 9bc3dcde63fb4f438cb12b4e64ee2d30 P 3f9e4abf970849caa70a02ede7f97cd8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f9e4abf970849caa70a02ede7f97cd8; no voters: 2be4570f313d4a219ad149e28ab546c5, 450b7f1304cb4c2ca4c9ccf62afb6937
I20260709 14:55:15.107328 17837 raft_consensus.cc:2749] T 9bc3dcde63fb4f438cb12b4e64ee2d30 P 3f9e4abf970849caa70a02ede7f97cd8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:55:15.111461 17850 tablet_bootstrap.cc:492] T bba029f9d36e45249ae3b3699bebed9b P 450b7f1304cb4c2ca4c9ccf62afb6937: No bootstrap required, opened a new log
I20260709 14:55:15.112010 17852 tablet_bootstrap.cc:654] T 9bc3dcde63fb4f438cb12b4e64ee2d30 P 2be4570f313d4a219ad149e28ab546c5: Neither blocks nor log segments found. Creating new log.
I20260709 14:55:15.112273 17850 ts_tablet_manager.cc:1403] T bba029f9d36e45249ae3b3699bebed9b P 450b7f1304cb4c2ca4c9ccf62afb6937: Time spent bootstrapping tablet: real 0.043s	user 0.019s	sys 0.009s
I20260709 14:55:15.113205 17851 tablet_bootstrap.cc:492] T 22cb1b4f8c5f457b9f5661dd2d0e208d P 3f9e4abf970849caa70a02ede7f97cd8: Bootstrap starting.
I20260709 14:55:15.124132 17850 raft_consensus.cc:359] T bba029f9d36e45249ae3b3699bebed9b P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:15.125072 17850 raft_consensus.cc:385] T bba029f9d36e45249ae3b3699bebed9b P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:55:15.128188 17850 raft_consensus.cc:740] T bba029f9d36e45249ae3b3699bebed9b P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 450b7f1304cb4c2ca4c9ccf62afb6937, State: Initialized, Role: FOLLOWER
I20260709 14:55:15.128429 17851 tablet_bootstrap.cc:654] T 22cb1b4f8c5f457b9f5661dd2d0e208d P 3f9e4abf970849caa70a02ede7f97cd8: Neither blocks nor log segments found. Creating new log.
I20260709 14:55:15.129703 17850 consensus_queue.cc:260] T bba029f9d36e45249ae3b3699bebed9b P 450b7f1304cb4c2ca4c9ccf62afb6937 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:15.135185 17852 tablet_bootstrap.cc:492] T 9bc3dcde63fb4f438cb12b4e64ee2d30 P 2be4570f313d4a219ad149e28ab546c5: No bootstrap required, opened a new log
I20260709 14:55:15.135953 17852 ts_tablet_manager.cc:1403] T 9bc3dcde63fb4f438cb12b4e64ee2d30 P 2be4570f313d4a219ad149e28ab546c5: Time spent bootstrapping tablet: real 0.034s	user 0.024s	sys 0.004s
I20260709 14:55:15.139657 17852 raft_consensus.cc:359] T 9bc3dcde63fb4f438cb12b4e64ee2d30 P 2be4570f313d4a219ad149e28ab546c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:15.140795 17852 raft_consensus.cc:385] T 9bc3dcde63fb4f438cb12b4e64ee2d30 P 2be4570f313d4a219ad149e28ab546c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:55:15.141145 17852 raft_consensus.cc:740] T 9bc3dcde63fb4f438cb12b4e64ee2d30 P 2be4570f313d4a219ad149e28ab546c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2be4570f313d4a219ad149e28ab546c5, State: Initialized, Role: FOLLOWER
I20260709 14:55:15.142930 17852 consensus_queue.cc:260] T 9bc3dcde63fb4f438cb12b4e64ee2d30 P 2be4570f313d4a219ad149e28ab546c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:15.146019 17852 ts_tablet_manager.cc:1434] T 9bc3dcde63fb4f438cb12b4e64ee2d30 P 2be4570f313d4a219ad149e28ab546c5: Time spent starting tablet: real 0.010s	user 0.010s	sys 0.000s
I20260709 14:55:15.147840 17852 tablet_bootstrap.cc:492] T b5d16339e8c74f8aa5c9bef2ed4ef1c6 P 2be4570f313d4a219ad149e28ab546c5: Bootstrap starting.
I20260709 14:55:15.154374 17839 raft_consensus.cc:493] T 9bc3dcde63fb4f438cb12b4e64ee2d30 P 2be4570f313d4a219ad149e28ab546c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:55:15.155587 17839 raft_consensus.cc:515] T 9bc3dcde63fb4f438cb12b4e64ee2d30 P 2be4570f313d4a219ad149e28ab546c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:15.159844 17627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc3dcde63fb4f438cb12b4e64ee2d30" candidate_uuid: "2be4570f313d4a219ad149e28ab546c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" is_pre_election: true
W20260709 14:55:15.162377 17518 leader_election.cc:343] T 9bc3dcde63fb4f438cb12b4e64ee2d30 P 2be4570f313d4a219ad149e28ab546c5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 450b7f1304cb4c2ca4c9ccf62afb6937 (127.6.101.66:35877): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:55:15.164304 17839 leader_election.cc:290] T 9bc3dcde63fb4f438cb12b4e64ee2d30 P 2be4570f313d4a219ad149e28ab546c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 450b7f1304cb4c2ca4c9ccf62afb6937 (127.6.101.66:35877), 3f9e4abf970849caa70a02ede7f97cd8 (127.6.101.67:42489)
I20260709 14:55:15.166882 17702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc3dcde63fb4f438cb12b4e64ee2d30" candidate_uuid: "2be4570f313d4a219ad149e28ab546c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f9e4abf970849caa70a02ede7f97cd8" is_pre_election: true
I20260709 14:55:15.168092 17702 raft_consensus.cc:2468] T 9bc3dcde63fb4f438cb12b4e64ee2d30 P 3f9e4abf970849caa70a02ede7f97cd8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2be4570f313d4a219ad149e28ab546c5 in term 0.
I20260709 14:55:15.169798 17852 tablet_bootstrap.cc:654] T b5d16339e8c74f8aa5c9bef2ed4ef1c6 P 2be4570f313d4a219ad149e28ab546c5: Neither blocks nor log segments found. Creating new log.
I20260709 14:55:15.173094 17518 leader_election.cc:304] T 9bc3dcde63fb4f438cb12b4e64ee2d30 P 2be4570f313d4a219ad149e28ab546c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2be4570f313d4a219ad149e28ab546c5, 3f9e4abf970849caa70a02ede7f97cd8; no voters: 450b7f1304cb4c2ca4c9ccf62afb6937
I20260709 14:55:15.178061 17839 raft_consensus.cc:2804] T 9bc3dcde63fb4f438cb12b4e64ee2d30 P 2be4570f313d4a219ad149e28ab546c5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:55:15.178640 17839 raft_consensus.cc:493] T 9bc3dcde63fb4f438cb12b4e64ee2d30 P 2be4570f313d4a219ad149e28ab546c5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:55:15.179008 17839 raft_consensus.cc:3060] T 9bc3dcde63fb4f438cb12b4e64ee2d30 P 2be4570f313d4a219ad149e28ab546c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:55:15.183960 17850 ts_tablet_manager.cc:1434] T bba029f9d36e45249ae3b3699bebed9b P 450b7f1304cb4c2ca4c9ccf62afb6937: Time spent starting tablet: real 0.071s	user 0.033s	sys 0.017s
I20260709 14:55:15.185580 17850 tablet_bootstrap.cc:492] T bdbd06b81c1f4dddbfd9a9f52f3f90c2 P 450b7f1304cb4c2ca4c9ccf62afb6937: Bootstrap starting.
I20260709 14:55:15.193792 17851 tablet_bootstrap.cc:492] T 22cb1b4f8c5f457b9f5661dd2d0e208d P 3f9e4abf970849caa70a02ede7f97cd8: No bootstrap required, opened a new log
I20260709 14:55:15.194648 17851 ts_tablet_manager.cc:1403] T 22cb1b4f8c5f457b9f5661dd2d0e208d P 3f9e4abf970849caa70a02ede7f97cd8: Time spent bootstrapping tablet: real 0.082s	user 0.045s	sys 0.022s
I20260709 14:55:15.196208 17850 tablet_bootstrap.cc:654] T bdbd06b81c1f4dddbfd9a9f52f3f90c2 P 450b7f1304cb4c2ca4c9ccf62afb6937: Neither blocks nor log segments found. Creating new log.
I20260709 14:55:15.196938 17839 raft_consensus.cc:515] T 9bc3dcde63fb4f438cb12b4e64ee2d30 P 2be4570f313d4a219ad149e28ab546c5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:15.198534 17851 raft_consensus.cc:359] T 22cb1b4f8c5f457b9f5661dd2d0e208d P 3f9e4abf970849caa70a02ede7f97cd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:15.199458 17851 raft_consensus.cc:385] T 22cb1b4f8c5f457b9f5661dd2d0e208d P 3f9e4abf970849caa70a02ede7f97cd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:55:15.199898 17851 raft_consensus.cc:740] T 22cb1b4f8c5f457b9f5661dd2d0e208d P 3f9e4abf970849caa70a02ede7f97cd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f9e4abf970849caa70a02ede7f97cd8, State: Initialized, Role: FOLLOWER
I20260709 14:55:15.201318 17852 tablet_bootstrap.cc:492] T b5d16339e8c74f8aa5c9bef2ed4ef1c6 P 2be4570f313d4a219ad149e28ab546c5: No bootstrap required, opened a new log
I20260709 14:55:15.201355 17851 consensus_queue.cc:260] T 22cb1b4f8c5f457b9f5661dd2d0e208d P 3f9e4abf970849caa70a02ede7f97cd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:15.201910 17627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc3dcde63fb4f438cb12b4e64ee2d30" candidate_uuid: "2be4570f313d4a219ad149e28ab546c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937"
I20260709 14:55:15.202270 17852 ts_tablet_manager.cc:1403] T b5d16339e8c74f8aa5c9bef2ed4ef1c6 P 2be4570f313d4a219ad149e28ab546c5: Time spent bootstrapping tablet: real 0.055s	user 0.016s	sys 0.018s
W20260709 14:55:15.204669 17518 leader_election.cc:343] T 9bc3dcde63fb4f438cb12b4e64ee2d30 P 2be4570f313d4a219ad149e28ab546c5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 450b7f1304cb4c2ca4c9ccf62afb6937 (127.6.101.66:35877): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:55:15.206218 17852 raft_consensus.cc:359] T b5d16339e8c74f8aa5c9bef2ed4ef1c6 P 2be4570f313d4a219ad149e28ab546c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:15.206879 17865 raft_consensus.cc:493] T b5d16339e8c74f8aa5c9bef2ed4ef1c6 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:55:15.207336 17852 raft_consensus.cc:385] T b5d16339e8c74f8aa5c9bef2ed4ef1c6 P 2be4570f313d4a219ad149e28ab546c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:55:15.207813 17852 raft_consensus.cc:740] T b5d16339e8c74f8aa5c9bef2ed4ef1c6 P 2be4570f313d4a219ad149e28ab546c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2be4570f313d4a219ad149e28ab546c5, State: Initialized, Role: FOLLOWER
I20260709 14:55:15.207698 17865 raft_consensus.cc:515] T b5d16339e8c74f8aa5c9bef2ed4ef1c6 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:15.204674 17851 ts_tablet_manager.cc:1434] T 22cb1b4f8c5f457b9f5661dd2d0e208d P 3f9e4abf970849caa70a02ede7f97cd8: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 14:55:15.208912 17852 consensus_queue.cc:260] T b5d16339e8c74f8aa5c9bef2ed4ef1c6 P 2be4570f313d4a219ad149e28ab546c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:15.210134 17851 tablet_bootstrap.cc:492] T 947a22f76d864a6dbbb88eb7f085fe17 P 3f9e4abf970849caa70a02ede7f97cd8: Bootstrap starting.
I20260709 14:55:15.214759 17702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d16339e8c74f8aa5c9bef2ed4ef1c6" candidate_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f9e4abf970849caa70a02ede7f97cd8" is_pre_election: true
I20260709 14:55:15.216084 17702 raft_consensus.cc:2468] T b5d16339e8c74f8aa5c9bef2ed4ef1c6 P 3f9e4abf970849caa70a02ede7f97cd8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 450b7f1304cb4c2ca4c9ccf62afb6937 in term 0.
I20260709 14:55:15.218312 17593 leader_election.cc:304] T b5d16339e8c74f8aa5c9bef2ed4ef1c6 P 450b7f1304cb4c2ca4c9ccf62afb6937 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f9e4abf970849caa70a02ede7f97cd8, 450b7f1304cb4c2ca4c9ccf62afb6937; no voters: 
I20260709 14:55:15.219686 17768 raft_consensus.cc:2804] T b5d16339e8c74f8aa5c9bef2ed4ef1c6 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:55:15.220031 17852 ts_tablet_manager.cc:1434] T b5d16339e8c74f8aa5c9bef2ed4ef1c6 P 2be4570f313d4a219ad149e28ab546c5: Time spent starting tablet: real 0.017s	user 0.011s	sys 0.005s
I20260709 14:55:15.220090 17768 raft_consensus.cc:493] T b5d16339e8c74f8aa5c9bef2ed4ef1c6 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:55:15.220584 17850 tablet_bootstrap.cc:492] T bdbd06b81c1f4dddbfd9a9f52f3f90c2 P 450b7f1304cb4c2ca4c9ccf62afb6937: No bootstrap required, opened a new log
I20260709 14:55:15.220888 17768 raft_consensus.cc:3060] T b5d16339e8c74f8aa5c9bef2ed4ef1c6 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:55:15.221210 17850 ts_tablet_manager.cc:1403] T bdbd06b81c1f4dddbfd9a9f52f3f90c2 P 450b7f1304cb4c2ca4c9ccf62afb6937: Time spent bootstrapping tablet: real 0.036s	user 0.026s	sys 0.002s
I20260709 14:55:15.221737 17852 tablet_bootstrap.cc:492] T ac091812917c4fa0a02bdc0d9984206d P 2be4570f313d4a219ad149e28ab546c5: Bootstrap starting.
I20260709 14:55:15.222666 17551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d16339e8c74f8aa5c9bef2ed4ef1c6" candidate_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2be4570f313d4a219ad149e28ab546c5" is_pre_election: true
I20260709 14:55:15.223784 17551 raft_consensus.cc:2468] T b5d16339e8c74f8aa5c9bef2ed4ef1c6 P 2be4570f313d4a219ad149e28ab546c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 450b7f1304cb4c2ca4c9ccf62afb6937 in term 0.
I20260709 14:55:15.226622 17851 tablet_bootstrap.cc:654] T 947a22f76d864a6dbbb88eb7f085fe17 P 3f9e4abf970849caa70a02ede7f97cd8: Neither blocks nor log segments found. Creating new log.
I20260709 14:55:15.226845 17865 leader_election.cc:290] T b5d16339e8c74f8aa5c9bef2ed4ef1c6 P 450b7f1304cb4c2ca4c9ccf62afb6937 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2be4570f313d4a219ad149e28ab546c5 (127.6.101.65:43507), 3f9e4abf970849caa70a02ede7f97cd8 (127.6.101.67:42489)
I20260709 14:55:15.233112 17852 tablet_bootstrap.cc:654] T ac091812917c4fa0a02bdc0d9984206d P 2be4570f313d4a219ad149e28ab546c5: Neither blocks nor log segments found. Creating new log.
I20260709 14:55:15.234359 17768 raft_consensus.cc:515] T b5d16339e8c74f8aa5c9bef2ed4ef1c6 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:15.238098 17551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d16339e8c74f8aa5c9bef2ed4ef1c6" candidate_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2be4570f313d4a219ad149e28ab546c5"
I20260709 14:55:15.238837 17551 raft_consensus.cc:3060] T b5d16339e8c74f8aa5c9bef2ed4ef1c6 P 2be4570f313d4a219ad149e28ab546c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:55:15.247886 17702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d16339e8c74f8aa5c9bef2ed4ef1c6" candidate_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f9e4abf970849caa70a02ede7f97cd8"
I20260709 14:55:15.248963 17702 raft_consensus.cc:3060] T b5d16339e8c74f8aa5c9bef2ed4ef1c6 P 3f9e4abf970849caa70a02ede7f97cd8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:55:15.257901 17839 leader_election.cc:290] T 9bc3dcde63fb4f438cb12b4e64ee2d30 P 2be4570f313d4a219ad149e28ab546c5 [CANDIDATE]: Term 1 election: Requested vote from peers 450b7f1304cb4c2ca4c9ccf62afb6937 (127.6.101.66:35877), 3f9e4abf970849caa70a02ede7f97cd8 (127.6.101.67:42489)
I20260709 14:55:15.259533 17700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc3dcde63fb4f438cb12b4e64ee2d30" candidate_uuid: "2be4570f313d4a219ad149e28ab546c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f9e4abf970849caa70a02ede7f97cd8"
I20260709 14:55:15.292215 17700 raft_consensus.cc:3060] T 9bc3dcde63fb4f438cb12b4e64ee2d30 P 3f9e4abf970849caa70a02ede7f97cd8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:55:15.261559 17850 raft_consensus.cc:359] T bdbd06b81c1f4dddbfd9a9f52f3f90c2 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:15.257640 17768 leader_election.cc:290] T b5d16339e8c74f8aa5c9bef2ed4ef1c6 P 450b7f1304cb4c2ca4c9ccf62afb6937 [CANDIDATE]: Term 1 election: Requested vote from peers 2be4570f313d4a219ad149e28ab546c5 (127.6.101.65:43507), 3f9e4abf970849caa70a02ede7f97cd8 (127.6.101.67:42489)
I20260709 14:55:15.305693 17850 raft_consensus.cc:385] T bdbd06b81c1f4dddbfd9a9f52f3f90c2 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:55:15.276047 17865 raft_consensus.cc:493] T 22cb1b4f8c5f457b9f5661dd2d0e208d P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:55:15.306391 17850 raft_consensus.cc:740] T bdbd06b81c1f4dddbfd9a9f52f3f90c2 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 450b7f1304cb4c2ca4c9ccf62afb6937, State: Initialized, Role: FOLLOWER
I20260709 14:55:15.291159 17702 raft_consensus.cc:2468] T b5d16339e8c74f8aa5c9bef2ed4ef1c6 P 3f9e4abf970849caa70a02ede7f97cd8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 450b7f1304cb4c2ca4c9ccf62afb6937 in term 1.
I20260709 14:55:15.306586 17865 raft_consensus.cc:515] T 22cb1b4f8c5f457b9f5661dd2d0e208d P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:15.308261 17593 leader_election.cc:304] T b5d16339e8c74f8aa5c9bef2ed4ef1c6 P 450b7f1304cb4c2ca4c9ccf62afb6937 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f9e4abf970849caa70a02ede7f97cd8, 450b7f1304cb4c2ca4c9ccf62afb6937; no voters: 
I20260709 14:55:15.308277 17850 consensus_queue.cc:260] T bdbd06b81c1f4dddbfd9a9f52f3f90c2 P 450b7f1304cb4c2ca4c9ccf62afb6937 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:15.311692 17874 raft_consensus.cc:493] T b56c5a30e63c401cbfb713fd3a859194 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:55:15.312985 17850 ts_tablet_manager.cc:1434] T bdbd06b81c1f4dddbfd9a9f52f3f90c2 P 450b7f1304cb4c2ca4c9ccf62afb6937: Time spent starting tablet: real 0.056s	user 0.017s	sys 0.005s
I20260709 14:55:15.314314 17850 tablet_bootstrap.cc:492] T 9bc3dcde63fb4f438cb12b4e64ee2d30 P 450b7f1304cb4c2ca4c9ccf62afb6937: Bootstrap starting.
I20260709 14:55:15.312448 17874 raft_consensus.cc:515] T b56c5a30e63c401cbfb713fd3a859194 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:15.312676 17702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22cb1b4f8c5f457b9f5661dd2d0e208d" candidate_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f9e4abf970849caa70a02ede7f97cd8" is_pre_election: true
I20260709 14:55:15.316869 17702 raft_consensus.cc:2468] T 22cb1b4f8c5f457b9f5661dd2d0e208d P 3f9e4abf970849caa70a02ede7f97cd8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 450b7f1304cb4c2ca4c9ccf62afb6937 in term 0.
I20260709 14:55:15.318460 17874 leader_election.cc:290] T b56c5a30e63c401cbfb713fd3a859194 P 450b7f1304cb4c2ca4c9ccf62afb6937 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2be4570f313d4a219ad149e28ab546c5 (127.6.101.65:43507), 3f9e4abf970849caa70a02ede7f97cd8 (127.6.101.67:42489)
I20260709 14:55:15.319643 17874 raft_consensus.cc:2804] T b5d16339e8c74f8aa5c9bef2ed4ef1c6 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:55:15.320281 17874 raft_consensus.cc:697] T b5d16339e8c74f8aa5c9bef2ed4ef1c6 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 1 LEADER]: Becoming Leader. State: Replica: 450b7f1304cb4c2ca4c9ccf62afb6937, State: Running, Role: LEADER
I20260709 14:55:15.321508 17874 consensus_queue.cc:237] T b5d16339e8c74f8aa5c9bef2ed4ef1c6 P 450b7f1304cb4c2ca4c9ccf62afb6937 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:15.321852 17702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56c5a30e63c401cbfb713fd3a859194" candidate_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f9e4abf970849caa70a02ede7f97cd8" is_pre_election: true
I20260709 14:55:15.320375 17593 leader_election.cc:304] T 22cb1b4f8c5f457b9f5661dd2d0e208d P 450b7f1304cb4c2ca4c9ccf62afb6937 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f9e4abf970849caa70a02ede7f97cd8, 450b7f1304cb4c2ca4c9ccf62afb6937; no voters: 
W20260709 14:55:15.326989 17593 leader_election.cc:343] T b56c5a30e63c401cbfb713fd3a859194 P 450b7f1304cb4c2ca4c9ccf62afb6937 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f9e4abf970849caa70a02ede7f97cd8 (127.6.101.67:42489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:55:15.327080 17551 raft_consensus.cc:2468] T b5d16339e8c74f8aa5c9bef2ed4ef1c6 P 2be4570f313d4a219ad149e28ab546c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 450b7f1304cb4c2ca4c9ccf62afb6937 in term 1.
I20260709 14:55:15.305199 17700 raft_consensus.cc:2468] T 9bc3dcde63fb4f438cb12b4e64ee2d30 P 3f9e4abf970849caa70a02ede7f97cd8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2be4570f313d4a219ad149e28ab546c5 in term 1.
I20260709 14:55:15.329949 17518 leader_election.cc:304] T 9bc3dcde63fb4f438cb12b4e64ee2d30 P 2be4570f313d4a219ad149e28ab546c5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2be4570f313d4a219ad149e28ab546c5, 3f9e4abf970849caa70a02ede7f97cd8; no voters: 450b7f1304cb4c2ca4c9ccf62afb6937
I20260709 14:55:15.331066 17839 raft_consensus.cc:2804] T 9bc3dcde63fb4f438cb12b4e64ee2d30 P 2be4570f313d4a219ad149e28ab546c5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:55:15.331773 17839 raft_consensus.cc:697] T 9bc3dcde63fb4f438cb12b4e64ee2d30 P 2be4570f313d4a219ad149e28ab546c5 [term 1 LEADER]: Becoming Leader. State: Replica: 2be4570f313d4a219ad149e28ab546c5, State: Running, Role: LEADER
I20260709 14:55:15.332804 17839 consensus_queue.cc:237] T 9bc3dcde63fb4f438cb12b4e64ee2d30 P 2be4570f313d4a219ad149e28ab546c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:15.313392 17865 leader_election.cc:290] T 22cb1b4f8c5f457b9f5661dd2d0e208d P 450b7f1304cb4c2ca4c9ccf62afb6937 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2be4570f313d4a219ad149e28ab546c5 (127.6.101.65:43507), 3f9e4abf970849caa70a02ede7f97cd8 (127.6.101.67:42489)
I20260709 14:55:15.336156 17768 raft_consensus.cc:2804] T 22cb1b4f8c5f457b9f5661dd2d0e208d P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:55:15.338719 17768 raft_consensus.cc:493] T 22cb1b4f8c5f457b9f5661dd2d0e208d P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:55:15.339154 17768 raft_consensus.cc:3060] T 22cb1b4f8c5f457b9f5661dd2d0e208d P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:55:15.343202 17851 tablet_bootstrap.cc:492] T 947a22f76d864a6dbbb88eb7f085fe17 P 3f9e4abf970849caa70a02ede7f97cd8: No bootstrap required, opened a new log
I20260709 14:55:15.344422 17851 ts_tablet_manager.cc:1403] T 947a22f76d864a6dbbb88eb7f085fe17 P 3f9e4abf970849caa70a02ede7f97cd8: Time spent bootstrapping tablet: real 0.135s	user 0.042s	sys 0.071s
I20260709 14:55:15.347594 17553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56c5a30e63c401cbfb713fd3a859194" candidate_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2be4570f313d4a219ad149e28ab546c5" is_pre_election: true
I20260709 14:55:15.348547 17553 raft_consensus.cc:2468] T b56c5a30e63c401cbfb713fd3a859194 P 2be4570f313d4a219ad149e28ab546c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 450b7f1304cb4c2ca4c9ccf62afb6937 in term 0.
I20260709 14:55:15.348944 17850 tablet_bootstrap.cc:654] T 9bc3dcde63fb4f438cb12b4e64ee2d30 P 450b7f1304cb4c2ca4c9ccf62afb6937: Neither blocks nor log segments found. Creating new log.
I20260709 14:55:15.350010 17551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22cb1b4f8c5f457b9f5661dd2d0e208d" candidate_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2be4570f313d4a219ad149e28ab546c5" is_pre_election: true
I20260709 14:55:15.351334 17551 raft_consensus.cc:2468] T 22cb1b4f8c5f457b9f5661dd2d0e208d P 2be4570f313d4a219ad149e28ab546c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 450b7f1304cb4c2ca4c9ccf62afb6937 in term 0.
I20260709 14:55:15.353052 17851 raft_consensus.cc:359] T 947a22f76d864a6dbbb88eb7f085fe17 P 3f9e4abf970849caa70a02ede7f97cd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:15.354295 17851 raft_consensus.cc:385] T 947a22f76d864a6dbbb88eb7f085fe17 P 3f9e4abf970849caa70a02ede7f97cd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:55:15.354660 17851 raft_consensus.cc:740] T 947a22f76d864a6dbbb88eb7f085fe17 P 3f9e4abf970849caa70a02ede7f97cd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f9e4abf970849caa70a02ede7f97cd8, State: Initialized, Role: FOLLOWER
I20260709 14:55:15.356174 17851 consensus_queue.cc:260] T 947a22f76d864a6dbbb88eb7f085fe17 P 3f9e4abf970849caa70a02ede7f97cd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:15.356778 17591 leader_election.cc:304] T b56c5a30e63c401cbfb713fd3a859194 P 450b7f1304cb4c2ca4c9ccf62afb6937 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2be4570f313d4a219ad149e28ab546c5, 450b7f1304cb4c2ca4c9ccf62afb6937; no voters: 3f9e4abf970849caa70a02ede7f97cd8
I20260709 14:55:15.362953 17865 raft_consensus.cc:2804] T b56c5a30e63c401cbfb713fd3a859194 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:55:15.363503 17865 raft_consensus.cc:493] T b56c5a30e63c401cbfb713fd3a859194 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:55:15.363940 17851 ts_tablet_manager.cc:1434] T 947a22f76d864a6dbbb88eb7f085fe17 P 3f9e4abf970849caa70a02ede7f97cd8: Time spent starting tablet: real 0.019s	user 0.010s	sys 0.002s
I20260709 14:55:15.363869 17865 raft_consensus.cc:3060] T b56c5a30e63c401cbfb713fd3a859194 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:55:15.377120 17872 raft_consensus.cc:493] T bdbd06b81c1f4dddbfd9a9f52f3f90c2 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:55:15.377399 17851 tablet_bootstrap.cc:492] T bba029f9d36e45249ae3b3699bebed9b P 3f9e4abf970849caa70a02ede7f97cd8: Bootstrap starting.
I20260709 14:55:15.376731 17865 raft_consensus.cc:515] T b56c5a30e63c401cbfb713fd3a859194 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:15.378482 17872 raft_consensus.cc:515] T bdbd06b81c1f4dddbfd9a9f52f3f90c2 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:15.384876 17702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbd06b81c1f4dddbfd9a9f52f3f90c2" candidate_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f9e4abf970849caa70a02ede7f97cd8" is_pre_election: true
I20260709 14:55:15.385730 17702 raft_consensus.cc:2468] T bdbd06b81c1f4dddbfd9a9f52f3f90c2 P 3f9e4abf970849caa70a02ede7f97cd8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 450b7f1304cb4c2ca4c9ccf62afb6937 in term 0.
I20260709 14:55:15.387663 17553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbd06b81c1f4dddbfd9a9f52f3f90c2" candidate_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2be4570f313d4a219ad149e28ab546c5" is_pre_election: true
I20260709 14:55:15.384164 17447 catalog_manager.cc:5697] T 9bc3dcde63fb4f438cb12b4e64ee2d30 P 2be4570f313d4a219ad149e28ab546c5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2be4570f313d4a219ad149e28ab546c5 (127.6.101.65). New cstate: current_term: 1 leader_uuid: "2be4570f313d4a219ad149e28ab546c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } health_report { overall_health: UNKNOWN } } }
I20260709 14:55:15.389272 17593 leader_election.cc:304] T bdbd06b81c1f4dddbfd9a9f52f3f90c2 P 450b7f1304cb4c2ca4c9ccf62afb6937 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f9e4abf970849caa70a02ede7f97cd8, 450b7f1304cb4c2ca4c9ccf62afb6937; no voters: 
I20260709 14:55:15.392513 17837 raft_consensus.cc:493] T d778ef6fbde3497389223b362f88a26a P 3f9e4abf970849caa70a02ede7f97cd8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:55:15.393182 17837 raft_consensus.cc:515] T d778ef6fbde3497389223b362f88a26a P 3f9e4abf970849caa70a02ede7f97cd8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:15.397097 17627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d778ef6fbde3497389223b362f88a26a" candidate_uuid: "3f9e4abf970849caa70a02ede7f97cd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" is_pre_election: true
I20260709 14:55:15.397740 17553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d778ef6fbde3497389223b362f88a26a" candidate_uuid: "3f9e4abf970849caa70a02ede7f97cd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2be4570f313d4a219ad149e28ab546c5" is_pre_election: true
I20260709 14:55:15.398483 17837 leader_election.cc:290] T d778ef6fbde3497389223b362f88a26a P 3f9e4abf970849caa70a02ede7f97cd8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2be4570f313d4a219ad149e28ab546c5 (127.6.101.65:43507), 450b7f1304cb4c2ca4c9ccf62afb6937 (127.6.101.66:35877)
I20260709 14:55:15.399839 17851 tablet_bootstrap.cc:654] T bba029f9d36e45249ae3b3699bebed9b P 3f9e4abf970849caa70a02ede7f97cd8: Neither blocks nor log segments found. Creating new log.
W20260709 14:55:15.399694 17665 leader_election.cc:343] T d778ef6fbde3497389223b362f88a26a P 3f9e4abf970849caa70a02ede7f97cd8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2be4570f313d4a219ad149e28ab546c5 (127.6.101.65:43507): Illegal state: must be running to vote when last-logged opid is not known
W20260709 14:55:15.402508 17667 leader_election.cc:343] T d778ef6fbde3497389223b362f88a26a P 3f9e4abf970849caa70a02ede7f97cd8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 450b7f1304cb4c2ca4c9ccf62afb6937 (127.6.101.66:35877): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:55:15.403976 17865 leader_election.cc:290] T b56c5a30e63c401cbfb713fd3a859194 P 450b7f1304cb4c2ca4c9ccf62afb6937 [CANDIDATE]: Term 1 election: Requested vote from peers 2be4570f313d4a219ad149e28ab546c5 (127.6.101.65:43507), 3f9e4abf970849caa70a02ede7f97cd8 (127.6.101.67:42489)
I20260709 14:55:15.405040 17873 raft_consensus.cc:2804] T bdbd06b81c1f4dddbfd9a9f52f3f90c2 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:55:15.412685 17667 leader_election.cc:304] T d778ef6fbde3497389223b362f88a26a P 3f9e4abf970849caa70a02ede7f97cd8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f9e4abf970849caa70a02ede7f97cd8; no voters: 2be4570f313d4a219ad149e28ab546c5, 450b7f1304cb4c2ca4c9ccf62afb6937
I20260709 14:55:15.410843 17839 raft_consensus.cc:493] T bba029f9d36e45249ae3b3699bebed9b P 2be4570f313d4a219ad149e28ab546c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 14:55:15.401526 17591 leader_election.cc:343] T bdbd06b81c1f4dddbfd9a9f52f3f90c2 P 450b7f1304cb4c2ca4c9ccf62afb6937 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2be4570f313d4a219ad149e28ab546c5 (127.6.101.65:43507): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:55:15.391125 17872 leader_election.cc:290] T bdbd06b81c1f4dddbfd9a9f52f3f90c2 P 450b7f1304cb4c2ca4c9ccf62afb6937 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2be4570f313d4a219ad149e28ab546c5 (127.6.101.65:43507), 3f9e4abf970849caa70a02ede7f97cd8 (127.6.101.67:42489)
I20260709 14:55:15.410239 17873 raft_consensus.cc:493] T bdbd06b81c1f4dddbfd9a9f52f3f90c2 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:55:15.421365 17837 raft_consensus.cc:2749] T d778ef6fbde3497389223b362f88a26a P 3f9e4abf970849caa70a02ede7f97cd8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:55:15.429148 17873 raft_consensus.cc:3060] T bdbd06b81c1f4dddbfd9a9f52f3f90c2 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:55:15.416945 17839 raft_consensus.cc:515] T bba029f9d36e45249ae3b3699bebed9b P 2be4570f313d4a219ad149e28ab546c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:15.434353 17852 tablet_bootstrap.cc:492] T ac091812917c4fa0a02bdc0d9984206d P 2be4570f313d4a219ad149e28ab546c5: No bootstrap required, opened a new log
I20260709 14:55:15.436160 17553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56c5a30e63c401cbfb713fd3a859194" candidate_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2be4570f313d4a219ad149e28ab546c5"
I20260709 14:55:15.458936 17852 ts_tablet_manager.cc:1403] T ac091812917c4fa0a02bdc0d9984206d P 2be4570f313d4a219ad149e28ab546c5: Time spent bootstrapping tablet: real 0.238s	user 0.067s	sys 0.048s
I20260709 14:55:15.459355 17839 leader_election.cc:290] T bba029f9d36e45249ae3b3699bebed9b P 2be4570f313d4a219ad149e28ab546c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 450b7f1304cb4c2ca4c9ccf62afb6937 (127.6.101.66:35877), 3f9e4abf970849caa70a02ede7f97cd8 (127.6.101.67:42489)
I20260709 14:55:15.459270 17553 raft_consensus.cc:3060] T b56c5a30e63c401cbfb713fd3a859194 P 2be4570f313d4a219ad149e28ab546c5 [term 0 FOLLOWER]: Advancing to term 1
W20260709 14:55:15.462586 17499 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 14:55:15.467159 17628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bba029f9d36e45249ae3b3699bebed9b" candidate_uuid: "2be4570f313d4a219ad149e28ab546c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" is_pre_election: true
I20260709 14:55:15.468204 17628 raft_consensus.cc:2468] T bba029f9d36e45249ae3b3699bebed9b P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2be4570f313d4a219ad149e28ab546c5 in term 0.
I20260709 14:55:15.469468 17852 raft_consensus.cc:359] T ac091812917c4fa0a02bdc0d9984206d P 2be4570f313d4a219ad149e28ab546c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:15.470399 17852 raft_consensus.cc:385] T ac091812917c4fa0a02bdc0d9984206d P 2be4570f313d4a219ad149e28ab546c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:55:15.470141 17518 leader_election.cc:304] T bba029f9d36e45249ae3b3699bebed9b P 2be4570f313d4a219ad149e28ab546c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2be4570f313d4a219ad149e28ab546c5, 450b7f1304cb4c2ca4c9ccf62afb6937; no voters: 
I20260709 14:55:15.470976 17852 raft_consensus.cc:740] T ac091812917c4fa0a02bdc0d9984206d P 2be4570f313d4a219ad149e28ab546c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2be4570f313d4a219ad149e28ab546c5, State: Initialized, Role: FOLLOWER
I20260709 14:55:15.471690 17839 raft_consensus.cc:2804] T bba029f9d36e45249ae3b3699bebed9b P 2be4570f313d4a219ad149e28ab546c5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:55:15.470736 17850 tablet_bootstrap.cc:492] T 9bc3dcde63fb4f438cb12b4e64ee2d30 P 450b7f1304cb4c2ca4c9ccf62afb6937: No bootstrap required, opened a new log
I20260709 14:55:15.472983 17839 raft_consensus.cc:493] T bba029f9d36e45249ae3b3699bebed9b P 2be4570f313d4a219ad149e28ab546c5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:55:15.482064 17850 ts_tablet_manager.cc:1403] T 9bc3dcde63fb4f438cb12b4e64ee2d30 P 450b7f1304cb4c2ca4c9ccf62afb6937: Time spent bootstrapping tablet: real 0.168s	user 0.016s	sys 0.008s
I20260709 14:55:15.488615 17702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56c5a30e63c401cbfb713fd3a859194" candidate_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f9e4abf970849caa70a02ede7f97cd8"
I20260709 14:55:15.491180 17873 raft_consensus.cc:515] T bdbd06b81c1f4dddbfd9a9f52f3f90c2 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:15.492198 17768 raft_consensus.cc:515] T 22cb1b4f8c5f457b9f5661dd2d0e208d P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:15.492375 17850 raft_consensus.cc:359] T 9bc3dcde63fb4f438cb12b4e64ee2d30 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:15.487483 17839 raft_consensus.cc:3060] T bba029f9d36e45249ae3b3699bebed9b P 2be4570f313d4a219ad149e28ab546c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:55:15.495497 17850 raft_consensus.cc:385] T 9bc3dcde63fb4f438cb12b4e64ee2d30 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:55:15.496181 17850 raft_consensus.cc:740] T 9bc3dcde63fb4f438cb12b4e64ee2d30 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 450b7f1304cb4c2ca4c9ccf62afb6937, State: Initialized, Role: FOLLOWER
W20260709 14:55:15.497304 17593 leader_election.cc:343] T b56c5a30e63c401cbfb713fd3a859194 P 450b7f1304cb4c2ca4c9ccf62afb6937 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3f9e4abf970849caa70a02ede7f97cd8 (127.6.101.67:42489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:55:15.472820 17852 consensus_queue.cc:260] T ac091812917c4fa0a02bdc0d9984206d P 2be4570f313d4a219ad149e28ab546c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:15.501067 17851 tablet_bootstrap.cc:492] T bba029f9d36e45249ae3b3699bebed9b P 3f9e4abf970849caa70a02ede7f97cd8: No bootstrap required, opened a new log
I20260709 14:55:15.501173 17551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbd06b81c1f4dddbfd9a9f52f3f90c2" candidate_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2be4570f313d4a219ad149e28ab546c5"
W20260709 14:55:15.503774 17591 leader_election.cc:343] T bdbd06b81c1f4dddbfd9a9f52f3f90c2 P 450b7f1304cb4c2ca4c9ccf62afb6937 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2be4570f313d4a219ad149e28ab546c5 (127.6.101.65:43507): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:55:15.504660 17873 leader_election.cc:290] T bdbd06b81c1f4dddbfd9a9f52f3f90c2 P 450b7f1304cb4c2ca4c9ccf62afb6937 [CANDIDATE]: Term 1 election: Requested vote from peers 2be4570f313d4a219ad149e28ab546c5 (127.6.101.65:43507), 3f9e4abf970849caa70a02ede7f97cd8 (127.6.101.67:42489)
I20260709 14:55:15.504896 17551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22cb1b4f8c5f457b9f5661dd2d0e208d" candidate_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2be4570f313d4a219ad149e28ab546c5"
I20260709 14:55:15.505765 17551 raft_consensus.cc:3060] T 22cb1b4f8c5f457b9f5661dd2d0e208d P 2be4570f313d4a219ad149e28ab546c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:55:15.506088 17851 ts_tablet_manager.cc:1403] T bba029f9d36e45249ae3b3699bebed9b P 3f9e4abf970849caa70a02ede7f97cd8: Time spent bootstrapping tablet: real 0.141s	user 0.009s	sys 0.033s
I20260709 14:55:15.507550 17553 raft_consensus.cc:2468] T b56c5a30e63c401cbfb713fd3a859194 P 2be4570f313d4a219ad149e28ab546c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 450b7f1304cb4c2ca4c9ccf62afb6937 in term 1.
I20260709 14:55:15.508582 17850 consensus_queue.cc:260] T 9bc3dcde63fb4f438cb12b4e64ee2d30 P 450b7f1304cb4c2ca4c9ccf62afb6937 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
W20260709 14:55:15.476282 17665 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:43507, user_credentials={real_user=slave}} blocked reactor thread for 59592.9us
I20260709 14:55:15.509502 17591 leader_election.cc:304] T b56c5a30e63c401cbfb713fd3a859194 P 450b7f1304cb4c2ca4c9ccf62afb6937 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2be4570f313d4a219ad149e28ab546c5, 450b7f1304cb4c2ca4c9ccf62afb6937; no voters: 3f9e4abf970849caa70a02ede7f97cd8
I20260709 14:55:15.513645 17880 raft_consensus.cc:493] T 947a22f76d864a6dbbb88eb7f085fe17 P 3f9e4abf970849caa70a02ede7f97cd8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:55:15.512884 17852 ts_tablet_manager.cc:1434] T ac091812917c4fa0a02bdc0d9984206d P 2be4570f313d4a219ad149e28ab546c5: Time spent starting tablet: real 0.053s	user 0.006s	sys 0.005s
I20260709 14:55:15.510335 17851 raft_consensus.cc:359] T bba029f9d36e45249ae3b3699bebed9b P 3f9e4abf970849caa70a02ede7f97cd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:15.528065 17701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22cb1b4f8c5f457b9f5661dd2d0e208d" candidate_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f9e4abf970849caa70a02ede7f97cd8"
I20260709 14:55:15.505788 17768 leader_election.cc:290] T 22cb1b4f8c5f457b9f5661dd2d0e208d P 450b7f1304cb4c2ca4c9ccf62afb6937 [CANDIDATE]: Term 1 election: Requested vote from peers 2be4570f313d4a219ad149e28ab546c5 (127.6.101.65:43507), 3f9e4abf970849caa70a02ede7f97cd8 (127.6.101.67:42489)
I20260709 14:55:15.512778 17702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bba029f9d36e45249ae3b3699bebed9b" candidate_uuid: "2be4570f313d4a219ad149e28ab546c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f9e4abf970849caa70a02ede7f97cd8" is_pre_election: true
I20260709 14:55:15.512773 17873 raft_consensus.cc:2804] T b56c5a30e63c401cbfb713fd3a859194 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:55:15.529670 17701 raft_consensus.cc:3060] T 22cb1b4f8c5f457b9f5661dd2d0e208d P 3f9e4abf970849caa70a02ede7f97cd8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:55:15.513974 17850 ts_tablet_manager.cc:1434] T 9bc3dcde63fb4f438cb12b4e64ee2d30 P 450b7f1304cb4c2ca4c9ccf62afb6937: Time spent starting tablet: real 0.025s	user 0.002s	sys 0.007s
I20260709 14:55:15.530673 17851 raft_consensus.cc:385] T bba029f9d36e45249ae3b3699bebed9b P 3f9e4abf970849caa70a02ede7f97cd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:55:15.531001 17851 raft_consensus.cc:740] T bba029f9d36e45249ae3b3699bebed9b P 3f9e4abf970849caa70a02ede7f97cd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f9e4abf970849caa70a02ede7f97cd8, State: Initialized, Role: FOLLOWER
I20260709 14:55:15.531414 17850 tablet_bootstrap.cc:492] T d778ef6fbde3497389223b362f88a26a P 450b7f1304cb4c2ca4c9ccf62afb6937: Bootstrap starting.
I20260709 14:55:15.531813 17851 consensus_queue.cc:260] T bba029f9d36e45249ae3b3699bebed9b P 3f9e4abf970849caa70a02ede7f97cd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:15.530295 17873 raft_consensus.cc:697] T b56c5a30e63c401cbfb713fd3a859194 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 1 LEADER]: Becoming Leader. State: Replica: 450b7f1304cb4c2ca4c9ccf62afb6937, State: Running, Role: LEADER
I20260709 14:55:15.529165 17880 raft_consensus.cc:515] T 947a22f76d864a6dbbb88eb7f085fe17 P 3f9e4abf970849caa70a02ede7f97cd8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:15.534861 17873 consensus_queue.cc:237] T b56c5a30e63c401cbfb713fd3a859194 P 450b7f1304cb4c2ca4c9ccf62afb6937 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:15.537003 17880 leader_election.cc:290] T 947a22f76d864a6dbbb88eb7f085fe17 P 3f9e4abf970849caa70a02ede7f97cd8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2be4570f313d4a219ad149e28ab546c5 (127.6.101.65:43507), 450b7f1304cb4c2ca4c9ccf62afb6937 (127.6.101.66:35877)
I20260709 14:55:15.514864 17700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbd06b81c1f4dddbfd9a9f52f3f90c2" candidate_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f9e4abf970849caa70a02ede7f97cd8"
I20260709 14:55:15.538995 17700 raft_consensus.cc:3060] T bdbd06b81c1f4dddbfd9a9f52f3f90c2 P 3f9e4abf970849caa70a02ede7f97cd8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:55:15.539256 17702 raft_consensus.cc:2468] T bba029f9d36e45249ae3b3699bebed9b P 3f9e4abf970849caa70a02ede7f97cd8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2be4570f313d4a219ad149e28ab546c5 in term 0.
I20260709 14:55:15.539319 17553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "947a22f76d864a6dbbb88eb7f085fe17" candidate_uuid: "3f9e4abf970849caa70a02ede7f97cd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2be4570f313d4a219ad149e28ab546c5" is_pre_election: true
I20260709 14:55:15.529937 17852 tablet_bootstrap.cc:492] T bdbd06b81c1f4dddbfd9a9f52f3f90c2 P 2be4570f313d4a219ad149e28ab546c5: Bootstrap starting.
I20260709 14:55:15.541509 17627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "947a22f76d864a6dbbb88eb7f085fe17" candidate_uuid: "3f9e4abf970849caa70a02ede7f97cd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" is_pre_election: true
W20260709 14:55:15.542069 17665 leader_election.cc:343] T 947a22f76d864a6dbbb88eb7f085fe17 P 3f9e4abf970849caa70a02ede7f97cd8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2be4570f313d4a219ad149e28ab546c5 (127.6.101.65:43507): Illegal state: must be running to vote when last-logged opid is not known
W20260709 14:55:15.546756 17667 leader_election.cc:343] T 947a22f76d864a6dbbb88eb7f085fe17 P 3f9e4abf970849caa70a02ede7f97cd8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 450b7f1304cb4c2ca4c9ccf62afb6937 (127.6.101.66:35877): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:55:15.547322 17667 leader_election.cc:304] T 947a22f76d864a6dbbb88eb7f085fe17 P 3f9e4abf970849caa70a02ede7f97cd8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f9e4abf970849caa70a02ede7f97cd8; no voters: 2be4570f313d4a219ad149e28ab546c5, 450b7f1304cb4c2ca4c9ccf62afb6937
I20260709 14:55:15.547883 17851 ts_tablet_manager.cc:1434] T bba029f9d36e45249ae3b3699bebed9b P 3f9e4abf970849caa70a02ede7f97cd8: Time spent starting tablet: real 0.041s	user 0.009s	sys 0.000s
I20260709 14:55:15.543946 17850 tablet_bootstrap.cc:654] T d778ef6fbde3497389223b362f88a26a P 450b7f1304cb4c2ca4c9ccf62afb6937: Neither blocks nor log segments found. Creating new log.
I20260709 14:55:15.549566 17851 tablet_bootstrap.cc:492] T b56c5a30e63c401cbfb713fd3a859194 P 3f9e4abf970849caa70a02ede7f97cd8: Bootstrap starting.
I20260709 14:55:15.524539 17449 catalog_manager.cc:5697] T b5d16339e8c74f8aa5c9bef2ed4ef1c6 P 450b7f1304cb4c2ca4c9ccf62afb6937 reported cstate change: term changed from 0 to 1, leader changed from <none> to 450b7f1304cb4c2ca4c9ccf62afb6937 (127.6.101.66). New cstate: current_term: 1 leader_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } health_report { overall_health: UNKNOWN } } }
I20260709 14:55:15.572497 17851 tablet_bootstrap.cc:654] T b56c5a30e63c401cbfb713fd3a859194 P 3f9e4abf970849caa70a02ede7f97cd8: Neither blocks nor log segments found. Creating new log.
I20260709 14:55:15.573129 17701 raft_consensus.cc:2468] T 22cb1b4f8c5f457b9f5661dd2d0e208d P 3f9e4abf970849caa70a02ede7f97cd8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 450b7f1304cb4c2ca4c9ccf62afb6937 in term 1.
I20260709 14:55:15.558943 17880 raft_consensus.cc:2749] T 947a22f76d864a6dbbb88eb7f085fe17 P 3f9e4abf970849caa70a02ede7f97cd8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:55:15.576284 17593 leader_election.cc:304] T 22cb1b4f8c5f457b9f5661dd2d0e208d P 450b7f1304cb4c2ca4c9ccf62afb6937 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f9e4abf970849caa70a02ede7f97cd8, 450b7f1304cb4c2ca4c9ccf62afb6937; no voters: 
I20260709 14:55:15.577838 17878 raft_consensus.cc:2804] T 22cb1b4f8c5f457b9f5661dd2d0e208d P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:55:15.578500 17878 raft_consensus.cc:697] T 22cb1b4f8c5f457b9f5661dd2d0e208d P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 1 LEADER]: Becoming Leader. State: Replica: 450b7f1304cb4c2ca4c9ccf62afb6937, State: Running, Role: LEADER
I20260709 14:55:15.578780 17551 raft_consensus.cc:2468] T 22cb1b4f8c5f457b9f5661dd2d0e208d P 2be4570f313d4a219ad149e28ab546c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 450b7f1304cb4c2ca4c9ccf62afb6937 in term 1.
I20260709 14:55:15.579491 17878 consensus_queue.cc:237] T 22cb1b4f8c5f457b9f5661dd2d0e208d P 450b7f1304cb4c2ca4c9ccf62afb6937 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:15.582060 17700 raft_consensus.cc:2468] T bdbd06b81c1f4dddbfd9a9f52f3f90c2 P 3f9e4abf970849caa70a02ede7f97cd8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 450b7f1304cb4c2ca4c9ccf62afb6937 in term 1.
I20260709 14:55:15.585212 17593 leader_election.cc:304] T bdbd06b81c1f4dddbfd9a9f52f3f90c2 P 450b7f1304cb4c2ca4c9ccf62afb6937 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f9e4abf970849caa70a02ede7f97cd8, 450b7f1304cb4c2ca4c9ccf62afb6937; no voters: 2be4570f313d4a219ad149e28ab546c5
I20260709 14:55:15.587575 17768 raft_consensus.cc:2804] T bdbd06b81c1f4dddbfd9a9f52f3f90c2 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:55:15.588541 17768 raft_consensus.cc:697] T bdbd06b81c1f4dddbfd9a9f52f3f90c2 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 1 LEADER]: Becoming Leader. State: Replica: 450b7f1304cb4c2ca4c9ccf62afb6937, State: Running, Role: LEADER
I20260709 14:55:15.589676 17768 consensus_queue.cc:237] T bdbd06b81c1f4dddbfd9a9f52f3f90c2 P 450b7f1304cb4c2ca4c9ccf62afb6937 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:15.594125 17852 tablet_bootstrap.cc:654] T bdbd06b81c1f4dddbfd9a9f52f3f90c2 P 2be4570f313d4a219ad149e28ab546c5: Neither blocks nor log segments found. Creating new log.
I20260709 14:55:15.597824 17839 raft_consensus.cc:515] T bba029f9d36e45249ae3b3699bebed9b P 2be4570f313d4a219ad149e28ab546c5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:15.603399 17852 tablet_bootstrap.cc:492] T bdbd06b81c1f4dddbfd9a9f52f3f90c2 P 2be4570f313d4a219ad149e28ab546c5: No bootstrap required, opened a new log
I20260709 14:55:15.604257 17852 ts_tablet_manager.cc:1403] T bdbd06b81c1f4dddbfd9a9f52f3f90c2 P 2be4570f313d4a219ad149e28ab546c5: Time spent bootstrapping tablet: real 0.075s	user 0.008s	sys 0.008s
I20260709 14:55:15.604305 17627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bba029f9d36e45249ae3b3699bebed9b" candidate_uuid: "2be4570f313d4a219ad149e28ab546c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937"
I20260709 14:55:15.605371 17627 raft_consensus.cc:3060] T bba029f9d36e45249ae3b3699bebed9b P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:55:15.607005 17851 tablet_bootstrap.cc:492] T b56c5a30e63c401cbfb713fd3a859194 P 3f9e4abf970849caa70a02ede7f97cd8: No bootstrap required, opened a new log
I20260709 14:55:15.607633 17851 ts_tablet_manager.cc:1403] T b56c5a30e63c401cbfb713fd3a859194 P 3f9e4abf970849caa70a02ede7f97cd8: Time spent bootstrapping tablet: real 0.059s	user 0.011s	sys 0.009s
I20260709 14:55:15.607756 17852 raft_consensus.cc:359] T bdbd06b81c1f4dddbfd9a9f52f3f90c2 P 2be4570f313d4a219ad149e28ab546c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:15.608816 17852 raft_consensus.cc:385] T bdbd06b81c1f4dddbfd9a9f52f3f90c2 P 2be4570f313d4a219ad149e28ab546c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:55:15.609143 17852 raft_consensus.cc:740] T bdbd06b81c1f4dddbfd9a9f52f3f90c2 P 2be4570f313d4a219ad149e28ab546c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2be4570f313d4a219ad149e28ab546c5, State: Initialized, Role: FOLLOWER
I20260709 14:55:15.610632 17851 raft_consensus.cc:359] T b56c5a30e63c401cbfb713fd3a859194 P 3f9e4abf970849caa70a02ede7f97cd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:15.610394 17852 consensus_queue.cc:260] T bdbd06b81c1f4dddbfd9a9f52f3f90c2 P 2be4570f313d4a219ad149e28ab546c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:15.611621 17851 raft_consensus.cc:385] T b56c5a30e63c401cbfb713fd3a859194 P 3f9e4abf970849caa70a02ede7f97cd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:55:15.612141 17851 raft_consensus.cc:740] T b56c5a30e63c401cbfb713fd3a859194 P 3f9e4abf970849caa70a02ede7f97cd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f9e4abf970849caa70a02ede7f97cd8, State: Initialized, Role: FOLLOWER
I20260709 14:55:15.613063 17851 consensus_queue.cc:260] T b56c5a30e63c401cbfb713fd3a859194 P 3f9e4abf970849caa70a02ede7f97cd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:15.615687 17851 ts_tablet_manager.cc:1434] T b56c5a30e63c401cbfb713fd3a859194 P 3f9e4abf970849caa70a02ede7f97cd8: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 14:55:15.616540 17839 leader_election.cc:290] T bba029f9d36e45249ae3b3699bebed9b P 2be4570f313d4a219ad149e28ab546c5 [CANDIDATE]: Term 1 election: Requested vote from peers 450b7f1304cb4c2ca4c9ccf62afb6937 (127.6.101.66:35877), 3f9e4abf970849caa70a02ede7f97cd8 (127.6.101.67:42489)
I20260709 14:55:15.618423 17700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bba029f9d36e45249ae3b3699bebed9b" candidate_uuid: "2be4570f313d4a219ad149e28ab546c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f9e4abf970849caa70a02ede7f97cd8"
I20260709 14:55:15.619518 17700 raft_consensus.cc:3060] T bba029f9d36e45249ae3b3699bebed9b P 3f9e4abf970849caa70a02ede7f97cd8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:55:15.627389 17850 tablet_bootstrap.cc:492] T d778ef6fbde3497389223b362f88a26a P 450b7f1304cb4c2ca4c9ccf62afb6937: No bootstrap required, opened a new log
I20260709 14:55:15.628165 17850 ts_tablet_manager.cc:1403] T d778ef6fbde3497389223b362f88a26a P 450b7f1304cb4c2ca4c9ccf62afb6937: Time spent bootstrapping tablet: real 0.097s	user 0.024s	sys 0.019s
I20260709 14:55:15.633279 17851 tablet_bootstrap.cc:492] T ac091812917c4fa0a02bdc0d9984206d P 3f9e4abf970849caa70a02ede7f97cd8: Bootstrap starting.
I20260709 14:55:15.628805 17852 ts_tablet_manager.cc:1434] T bdbd06b81c1f4dddbfd9a9f52f3f90c2 P 2be4570f313d4a219ad149e28ab546c5: Time spent starting tablet: real 0.024s	user 0.009s	sys 0.003s
I20260709 14:55:15.645956 17627 raft_consensus.cc:2468] T bba029f9d36e45249ae3b3699bebed9b P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2be4570f313d4a219ad149e28ab546c5 in term 1.
I20260709 14:55:15.642994 17850 raft_consensus.cc:359] T d778ef6fbde3497389223b362f88a26a P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:15.647696 17850 raft_consensus.cc:385] T d778ef6fbde3497389223b362f88a26a P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:55:15.648283 17850 raft_consensus.cc:740] T d778ef6fbde3497389223b362f88a26a P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 450b7f1304cb4c2ca4c9ccf62afb6937, State: Initialized, Role: FOLLOWER
I20260709 14:55:15.648809 17518 leader_election.cc:304] T bba029f9d36e45249ae3b3699bebed9b P 2be4570f313d4a219ad149e28ab546c5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2be4570f313d4a219ad149e28ab546c5, 450b7f1304cb4c2ca4c9ccf62afb6937; no voters: 
I20260709 14:55:15.650699 17839 raft_consensus.cc:2804] T bba029f9d36e45249ae3b3699bebed9b P 2be4570f313d4a219ad149e28ab546c5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:55:15.651674 17839 raft_consensus.cc:697] T bba029f9d36e45249ae3b3699bebed9b P 2be4570f313d4a219ad149e28ab546c5 [term 1 LEADER]: Becoming Leader. State: Replica: 2be4570f313d4a219ad149e28ab546c5, State: Running, Role: LEADER
I20260709 14:55:15.628891 17700 raft_consensus.cc:2468] T bba029f9d36e45249ae3b3699bebed9b P 3f9e4abf970849caa70a02ede7f97cd8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2be4570f313d4a219ad149e28ab546c5 in term 1.
I20260709 14:55:15.652891 17839 consensus_queue.cc:237] T bba029f9d36e45249ae3b3699bebed9b P 2be4570f313d4a219ad149e28ab546c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:15.653512 17850 consensus_queue.cc:260] T d778ef6fbde3497389223b362f88a26a P 450b7f1304cb4c2ca4c9ccf62afb6937 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:15.654613 17852 tablet_bootstrap.cc:492] T 947a22f76d864a6dbbb88eb7f085fe17 P 2be4570f313d4a219ad149e28ab546c5: Bootstrap starting.
I20260709 14:55:15.657660 17850 ts_tablet_manager.cc:1434] T d778ef6fbde3497389223b362f88a26a P 450b7f1304cb4c2ca4c9ccf62afb6937: Time spent starting tablet: real 0.029s	user 0.012s	sys 0.000s
I20260709 14:55:15.669366 17878 raft_consensus.cc:493] T 9bc3dcde63fb4f438cb12b4e64ee2d30 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:55:15.670433 17850 tablet_bootstrap.cc:492] T 947a22f76d864a6dbbb88eb7f085fe17 P 450b7f1304cb4c2ca4c9ccf62afb6937: Bootstrap starting.
I20260709 14:55:15.664956 17852 tablet_bootstrap.cc:654] T 947a22f76d864a6dbbb88eb7f085fe17 P 2be4570f313d4a219ad149e28ab546c5: Neither blocks nor log segments found. Creating new log.
I20260709 14:55:15.670117 17878 raft_consensus.cc:515] T 9bc3dcde63fb4f438cb12b4e64ee2d30 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:15.665469 17851 tablet_bootstrap.cc:654] T ac091812917c4fa0a02bdc0d9984206d P 3f9e4abf970849caa70a02ede7f97cd8: Neither blocks nor log segments found. Creating new log.
I20260709 14:55:15.678054 17878 leader_election.cc:290] T 9bc3dcde63fb4f438cb12b4e64ee2d30 P 450b7f1304cb4c2ca4c9ccf62afb6937 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2be4570f313d4a219ad149e28ab546c5 (127.6.101.65:43507), 3f9e4abf970849caa70a02ede7f97cd8 (127.6.101.67:42489)
I20260709 14:55:15.681535 17700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc3dcde63fb4f438cb12b4e64ee2d30" candidate_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f9e4abf970849caa70a02ede7f97cd8" is_pre_election: true
I20260709 14:55:15.682515 17700 raft_consensus.cc:2393] T 9bc3dcde63fb4f438cb12b4e64ee2d30 P 3f9e4abf970849caa70a02ede7f97cd8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 450b7f1304cb4c2ca4c9ccf62afb6937 in current term 1: Already voted for candidate 2be4570f313d4a219ad149e28ab546c5 in this term.
I20260709 14:55:15.686445 17551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc3dcde63fb4f438cb12b4e64ee2d30" candidate_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2be4570f313d4a219ad149e28ab546c5" is_pre_election: true
I20260709 14:55:15.690327 17593 leader_election.cc:304] T 9bc3dcde63fb4f438cb12b4e64ee2d30 P 450b7f1304cb4c2ca4c9ccf62afb6937 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 450b7f1304cb4c2ca4c9ccf62afb6937; no voters: 2be4570f313d4a219ad149e28ab546c5, 3f9e4abf970849caa70a02ede7f97cd8
I20260709 14:55:15.691802 17878 raft_consensus.cc:3060] T 9bc3dcde63fb4f438cb12b4e64ee2d30 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:55:15.695642 17850 tablet_bootstrap.cc:654] T 947a22f76d864a6dbbb88eb7f085fe17 P 450b7f1304cb4c2ca4c9ccf62afb6937: Neither blocks nor log segments found. Creating new log.
I20260709 14:55:15.695946 17851 tablet_bootstrap.cc:492] T ac091812917c4fa0a02bdc0d9984206d P 3f9e4abf970849caa70a02ede7f97cd8: No bootstrap required, opened a new log
I20260709 14:55:15.701333 17851 ts_tablet_manager.cc:1403] T ac091812917c4fa0a02bdc0d9984206d P 3f9e4abf970849caa70a02ede7f97cd8: Time spent bootstrapping tablet: real 0.072s	user 0.022s	sys 0.006s
I20260709 14:55:15.702316 17451 catalog_manager.cc:5697] T bba029f9d36e45249ae3b3699bebed9b P 2be4570f313d4a219ad149e28ab546c5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2be4570f313d4a219ad149e28ab546c5 (127.6.101.65). New cstate: current_term: 1 leader_uuid: "2be4570f313d4a219ad149e28ab546c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } health_report { overall_health: UNKNOWN } } }
I20260709 14:55:15.705489 17880 raft_consensus.cc:493] T b56c5a30e63c401cbfb713fd3a859194 P 3f9e4abf970849caa70a02ede7f97cd8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:55:15.705734 17851 raft_consensus.cc:359] T ac091812917c4fa0a02bdc0d9984206d P 3f9e4abf970849caa70a02ede7f97cd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:15.705854 17878 raft_consensus.cc:2749] T 9bc3dcde63fb4f438cb12b4e64ee2d30 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:55:15.706845 17851 raft_consensus.cc:385] T ac091812917c4fa0a02bdc0d9984206d P 3f9e4abf970849caa70a02ede7f97cd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:55:15.706319 17880 raft_consensus.cc:515] T b56c5a30e63c401cbfb713fd3a859194 P 3f9e4abf970849caa70a02ede7f97cd8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:15.707146 17851 raft_consensus.cc:740] T ac091812917c4fa0a02bdc0d9984206d P 3f9e4abf970849caa70a02ede7f97cd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f9e4abf970849caa70a02ede7f97cd8, State: Initialized, Role: FOLLOWER
I20260709 14:55:15.708353 17851 consensus_queue.cc:260] T ac091812917c4fa0a02bdc0d9984206d P 3f9e4abf970849caa70a02ede7f97cd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:15.709115 17880 leader_election.cc:290] T b56c5a30e63c401cbfb713fd3a859194 P 3f9e4abf970849caa70a02ede7f97cd8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2be4570f313d4a219ad149e28ab546c5 (127.6.101.65:43507), 450b7f1304cb4c2ca4c9ccf62afb6937 (127.6.101.66:35877)
I20260709 14:55:15.710742 17551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56c5a30e63c401cbfb713fd3a859194" candidate_uuid: "3f9e4abf970849caa70a02ede7f97cd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2be4570f313d4a219ad149e28ab546c5" is_pre_election: true
I20260709 14:55:15.711941 17551 raft_consensus.cc:2393] T b56c5a30e63c401cbfb713fd3a859194 P 2be4570f313d4a219ad149e28ab546c5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f9e4abf970849caa70a02ede7f97cd8 in current term 1: Already voted for candidate 450b7f1304cb4c2ca4c9ccf62afb6937 in this term.
I20260709 14:55:15.714720 17627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56c5a30e63c401cbfb713fd3a859194" candidate_uuid: "3f9e4abf970849caa70a02ede7f97cd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" is_pre_election: true
I20260709 14:55:15.716543 17880 raft_consensus.cc:493] T ac091812917c4fa0a02bdc0d9984206d P 3f9e4abf970849caa70a02ede7f97cd8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:55:15.716718 17667 leader_election.cc:304] T b56c5a30e63c401cbfb713fd3a859194 P 3f9e4abf970849caa70a02ede7f97cd8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f9e4abf970849caa70a02ede7f97cd8; no voters: 2be4570f313d4a219ad149e28ab546c5, 450b7f1304cb4c2ca4c9ccf62afb6937
I20260709 14:55:15.717446 17880 raft_consensus.cc:515] T ac091812917c4fa0a02bdc0d9984206d P 3f9e4abf970849caa70a02ede7f97cd8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:15.718119 17837 raft_consensus.cc:3060] T b56c5a30e63c401cbfb713fd3a859194 P 3f9e4abf970849caa70a02ede7f97cd8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:55:15.720876 17850 tablet_bootstrap.cc:492] T 947a22f76d864a6dbbb88eb7f085fe17 P 450b7f1304cb4c2ca4c9ccf62afb6937: No bootstrap required, opened a new log
I20260709 14:55:15.721306 17551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac091812917c4fa0a02bdc0d9984206d" candidate_uuid: "3f9e4abf970849caa70a02ede7f97cd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2be4570f313d4a219ad149e28ab546c5" is_pre_election: true
I20260709 14:55:15.721776 17850 ts_tablet_manager.cc:1403] T 947a22f76d864a6dbbb88eb7f085fe17 P 450b7f1304cb4c2ca4c9ccf62afb6937: Time spent bootstrapping tablet: real 0.052s	user 0.017s	sys 0.002s
I20260709 14:55:15.722177 17551 raft_consensus.cc:2468] T ac091812917c4fa0a02bdc0d9984206d P 2be4570f313d4a219ad149e28ab546c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f9e4abf970849caa70a02ede7f97cd8 in term 0.
I20260709 14:55:15.724556 17665 leader_election.cc:304] T ac091812917c4fa0a02bdc0d9984206d P 3f9e4abf970849caa70a02ede7f97cd8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2be4570f313d4a219ad149e28ab546c5, 3f9e4abf970849caa70a02ede7f97cd8; no voters: 
I20260709 14:55:15.726070 17879 raft_consensus.cc:2804] T ac091812917c4fa0a02bdc0d9984206d P 3f9e4abf970849caa70a02ede7f97cd8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:55:15.726619 17879 raft_consensus.cc:493] T ac091812917c4fa0a02bdc0d9984206d P 3f9e4abf970849caa70a02ede7f97cd8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:55:15.726918 17879 raft_consensus.cc:3060] T ac091812917c4fa0a02bdc0d9984206d P 3f9e4abf970849caa70a02ede7f97cd8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:55:15.727945 17852 tablet_bootstrap.cc:492] T 947a22f76d864a6dbbb88eb7f085fe17 P 2be4570f313d4a219ad149e28ab546c5: No bootstrap required, opened a new log
I20260709 14:55:15.728610 17852 ts_tablet_manager.cc:1403] T 947a22f76d864a6dbbb88eb7f085fe17 P 2be4570f313d4a219ad149e28ab546c5: Time spent bootstrapping tablet: real 0.074s	user 0.017s	sys 0.008s
I20260709 14:55:15.728382 17447 catalog_manager.cc:5697] T b56c5a30e63c401cbfb713fd3a859194 P 450b7f1304cb4c2ca4c9ccf62afb6937 reported cstate change: term changed from 0 to 1, leader changed from <none> to 450b7f1304cb4c2ca4c9ccf62afb6937 (127.6.101.66). New cstate: current_term: 1 leader_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } health_report { overall_health: UNKNOWN } } }
I20260709 14:55:15.730459 17447 catalog_manager.cc:5697] T 22cb1b4f8c5f457b9f5661dd2d0e208d P 450b7f1304cb4c2ca4c9ccf62afb6937 reported cstate change: term changed from 0 to 1, leader changed from <none> to 450b7f1304cb4c2ca4c9ccf62afb6937 (127.6.101.66). New cstate: current_term: 1 leader_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } health_report { overall_health: UNKNOWN } } }
I20260709 14:55:15.731701 17852 raft_consensus.cc:359] T 947a22f76d864a6dbbb88eb7f085fe17 P 2be4570f313d4a219ad149e28ab546c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:15.732441 17852 raft_consensus.cc:385] T 947a22f76d864a6dbbb88eb7f085fe17 P 2be4570f313d4a219ad149e28ab546c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:55:15.726018 17627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac091812917c4fa0a02bdc0d9984206d" candidate_uuid: "3f9e4abf970849caa70a02ede7f97cd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" is_pre_election: true
W20260709 14:55:15.734488 17667 leader_election.cc:343] T ac091812917c4fa0a02bdc0d9984206d P 3f9e4abf970849caa70a02ede7f97cd8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 450b7f1304cb4c2ca4c9ccf62afb6937 (127.6.101.66:35877): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:55:15.734112 17447 catalog_manager.cc:5697] T bdbd06b81c1f4dddbfd9a9f52f3f90c2 P 450b7f1304cb4c2ca4c9ccf62afb6937 reported cstate change: term changed from 0 to 1, leader changed from <none> to 450b7f1304cb4c2ca4c9ccf62afb6937 (127.6.101.66). New cstate: current_term: 1 leader_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } health_report { overall_health: UNKNOWN } } }
I20260709 14:55:15.726140 17880 leader_election.cc:290] T ac091812917c4fa0a02bdc0d9984206d P 3f9e4abf970849caa70a02ede7f97cd8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2be4570f313d4a219ad149e28ab546c5 (127.6.101.65:43507), 450b7f1304cb4c2ca4c9ccf62afb6937 (127.6.101.66:35877)
I20260709 14:55:15.732760 17852 raft_consensus.cc:740] T 947a22f76d864a6dbbb88eb7f085fe17 P 2be4570f313d4a219ad149e28ab546c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2be4570f313d4a219ad149e28ab546c5, State: Initialized, Role: FOLLOWER
I20260709 14:55:15.735378 17879 raft_consensus.cc:515] T ac091812917c4fa0a02bdc0d9984206d P 3f9e4abf970849caa70a02ede7f97cd8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:15.736883 17852 consensus_queue.cc:260] T 947a22f76d864a6dbbb88eb7f085fe17 P 2be4570f313d4a219ad149e28ab546c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:15.739264 17551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac091812917c4fa0a02bdc0d9984206d" candidate_uuid: "3f9e4abf970849caa70a02ede7f97cd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2be4570f313d4a219ad149e28ab546c5"
I20260709 14:55:15.740023 17551 raft_consensus.cc:3060] T ac091812917c4fa0a02bdc0d9984206d P 2be4570f313d4a219ad149e28ab546c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:55:15.739643 17852 ts_tablet_manager.cc:1434] T 947a22f76d864a6dbbb88eb7f085fe17 P 2be4570f313d4a219ad149e28ab546c5: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.004s
I20260709 14:55:15.740810 17851 ts_tablet_manager.cc:1434] T ac091812917c4fa0a02bdc0d9984206d P 3f9e4abf970849caa70a02ede7f97cd8: Time spent starting tablet: real 0.039s	user 0.010s	sys 0.000s
I20260709 14:55:15.725975 17850 raft_consensus.cc:359] T 947a22f76d864a6dbbb88eb7f085fe17 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:15.744211 17850 raft_consensus.cc:385] T 947a22f76d864a6dbbb88eb7f085fe17 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:55:15.744570 17850 raft_consensus.cc:740] T 947a22f76d864a6dbbb88eb7f085fe17 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 450b7f1304cb4c2ca4c9ccf62afb6937, State: Initialized, Role: FOLLOWER
I20260709 14:55:15.745445 17850 consensus_queue.cc:260] T 947a22f76d864a6dbbb88eb7f085fe17 P 450b7f1304cb4c2ca4c9ccf62afb6937 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:15.746588 17839 consensus_queue.cc:1048] T 9bc3dcde63fb4f438cb12b4e64ee2d30 P 2be4570f313d4a219ad149e28ab546c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:55:15.748822 17850 ts_tablet_manager.cc:1434] T 947a22f76d864a6dbbb88eb7f085fe17 P 450b7f1304cb4c2ca4c9ccf62afb6937: Time spent starting tablet: real 0.026s	user 0.008s	sys 0.000s
I20260709 14:55:15.750313 17850 tablet_bootstrap.cc:492] T ac091812917c4fa0a02bdc0d9984206d P 450b7f1304cb4c2ca4c9ccf62afb6937: Bootstrap starting.
I20260709 14:55:15.741386 17852 tablet_bootstrap.cc:492] T d778ef6fbde3497389223b362f88a26a P 2be4570f313d4a219ad149e28ab546c5: Bootstrap starting.
I20260709 14:55:15.742424 17837 raft_consensus.cc:2749] T b56c5a30e63c401cbfb713fd3a859194 P 3f9e4abf970849caa70a02ede7f97cd8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:55:15.758421 17850 tablet_bootstrap.cc:654] T ac091812917c4fa0a02bdc0d9984206d P 450b7f1304cb4c2ca4c9ccf62afb6937: Neither blocks nor log segments found. Creating new log.
I20260709 14:55:15.775328 17852 tablet_bootstrap.cc:654] T d778ef6fbde3497389223b362f88a26a P 2be4570f313d4a219ad149e28ab546c5: Neither blocks nor log segments found. Creating new log.
I20260709 14:55:15.781906 17879 leader_election.cc:290] T ac091812917c4fa0a02bdc0d9984206d P 3f9e4abf970849caa70a02ede7f97cd8 [CANDIDATE]: Term 1 election: Requested vote from peers 2be4570f313d4a219ad149e28ab546c5 (127.6.101.65:43507), 450b7f1304cb4c2ca4c9ccf62afb6937 (127.6.101.66:35877)
I20260709 14:55:15.783413 17551 raft_consensus.cc:2468] T ac091812917c4fa0a02bdc0d9984206d P 2be4570f313d4a219ad149e28ab546c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f9e4abf970849caa70a02ede7f97cd8 in term 1.
I20260709 14:55:15.784267 17628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac091812917c4fa0a02bdc0d9984206d" candidate_uuid: "3f9e4abf970849caa70a02ede7f97cd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937"
I20260709 14:55:15.785369 17665 leader_election.cc:304] T ac091812917c4fa0a02bdc0d9984206d P 3f9e4abf970849caa70a02ede7f97cd8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2be4570f313d4a219ad149e28ab546c5, 3f9e4abf970849caa70a02ede7f97cd8; no voters: 
W20260709 14:55:15.786357 17667 leader_election.cc:343] T ac091812917c4fa0a02bdc0d9984206d P 3f9e4abf970849caa70a02ede7f97cd8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 450b7f1304cb4c2ca4c9ccf62afb6937 (127.6.101.66:35877): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:55:15.788141 17879 raft_consensus.cc:2804] T ac091812917c4fa0a02bdc0d9984206d P 3f9e4abf970849caa70a02ede7f97cd8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:55:15.788718 17879 raft_consensus.cc:697] T ac091812917c4fa0a02bdc0d9984206d P 3f9e4abf970849caa70a02ede7f97cd8 [term 1 LEADER]: Becoming Leader. State: Replica: 3f9e4abf970849caa70a02ede7f97cd8, State: Running, Role: LEADER
I20260709 14:55:15.790096 17768 consensus_queue.cc:1048] T b5d16339e8c74f8aa5c9bef2ed4ef1c6 P 450b7f1304cb4c2ca4c9ccf62afb6937 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 14:55:15.789624 17879 consensus_queue.cc:237] T ac091812917c4fa0a02bdc0d9984206d P 3f9e4abf970849caa70a02ede7f97cd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:15.798550 17850 tablet_bootstrap.cc:492] T ac091812917c4fa0a02bdc0d9984206d P 450b7f1304cb4c2ca4c9ccf62afb6937: No bootstrap required, opened a new log
I20260709 14:55:15.799207 17850 ts_tablet_manager.cc:1403] T ac091812917c4fa0a02bdc0d9984206d P 450b7f1304cb4c2ca4c9ccf62afb6937: Time spent bootstrapping tablet: real 0.049s	user 0.026s	sys 0.006s
I20260709 14:55:15.803579 17850 raft_consensus.cc:359] T ac091812917c4fa0a02bdc0d9984206d P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:15.804320 17850 raft_consensus.cc:385] T ac091812917c4fa0a02bdc0d9984206d P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:55:15.804598 17850 raft_consensus.cc:740] T ac091812917c4fa0a02bdc0d9984206d P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 450b7f1304cb4c2ca4c9ccf62afb6937, State: Initialized, Role: FOLLOWER
I20260709 14:55:15.806279 17850 consensus_queue.cc:260] T ac091812917c4fa0a02bdc0d9984206d P 450b7f1304cb4c2ca4c9ccf62afb6937 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:15.808976 17850 ts_tablet_manager.cc:1434] T ac091812917c4fa0a02bdc0d9984206d P 450b7f1304cb4c2ca4c9ccf62afb6937: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 14:55:15.812669 17768 raft_consensus.cc:493] T d778ef6fbde3497389223b362f88a26a P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:55:15.813438 17768 raft_consensus.cc:515] T d778ef6fbde3497389223b362f88a26a P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:15.813880 17447 catalog_manager.cc:5697] T ac091812917c4fa0a02bdc0d9984206d P 3f9e4abf970849caa70a02ede7f97cd8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3f9e4abf970849caa70a02ede7f97cd8 (127.6.101.67). New cstate: current_term: 1 leader_uuid: "3f9e4abf970849caa70a02ede7f97cd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } health_report { overall_health: HEALTHY } } }
I20260709 14:55:15.815853 17768 leader_election.cc:290] T d778ef6fbde3497389223b362f88a26a P 450b7f1304cb4c2ca4c9ccf62afb6937 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2be4570f313d4a219ad149e28ab546c5 (127.6.101.65:43507), 3f9e4abf970849caa70a02ede7f97cd8 (127.6.101.67:42489)
I20260709 14:55:15.817574 17701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d778ef6fbde3497389223b362f88a26a" candidate_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f9e4abf970849caa70a02ede7f97cd8" is_pre_election: true
I20260709 14:55:15.818444 17701 raft_consensus.cc:2468] T d778ef6fbde3497389223b362f88a26a P 3f9e4abf970849caa70a02ede7f97cd8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 450b7f1304cb4c2ca4c9ccf62afb6937 in term 0.
I20260709 14:55:15.819902 17593 leader_election.cc:304] T d778ef6fbde3497389223b362f88a26a P 450b7f1304cb4c2ca4c9ccf62afb6937 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f9e4abf970849caa70a02ede7f97cd8, 450b7f1304cb4c2ca4c9ccf62afb6937; no voters: 
I20260709 14:55:15.821230 17768 raft_consensus.cc:2804] T d778ef6fbde3497389223b362f88a26a P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:55:15.821653 17768 raft_consensus.cc:493] T d778ef6fbde3497389223b362f88a26a P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:55:15.821659 17852 tablet_bootstrap.cc:492] T d778ef6fbde3497389223b362f88a26a P 2be4570f313d4a219ad149e28ab546c5: No bootstrap required, opened a new log
I20260709 14:55:15.822256 17768 raft_consensus.cc:3060] T d778ef6fbde3497389223b362f88a26a P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:55:15.822521 17852 ts_tablet_manager.cc:1403] T d778ef6fbde3497389223b362f88a26a P 2be4570f313d4a219ad149e28ab546c5: Time spent bootstrapping tablet: real 0.081s	user 0.026s	sys 0.010s
I20260709 14:55:15.826785 17551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d778ef6fbde3497389223b362f88a26a" candidate_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2be4570f313d4a219ad149e28ab546c5" is_pre_election: true
I20260709 14:55:15.828967 17852 raft_consensus.cc:359] T d778ef6fbde3497389223b362f88a26a P 2be4570f313d4a219ad149e28ab546c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:15.829711 17852 raft_consensus.cc:385] T d778ef6fbde3497389223b362f88a26a P 2be4570f313d4a219ad149e28ab546c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:55:15.830065 17852 raft_consensus.cc:740] T d778ef6fbde3497389223b362f88a26a P 2be4570f313d4a219ad149e28ab546c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2be4570f313d4a219ad149e28ab546c5, State: Initialized, Role: FOLLOWER
I20260709 14:55:15.830687 17852 consensus_queue.cc:260] T d778ef6fbde3497389223b362f88a26a P 2be4570f313d4a219ad149e28ab546c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
W20260709 14:55:15.838536 17591 leader_election.cc:343] T d778ef6fbde3497389223b362f88a26a P 450b7f1304cb4c2ca4c9ccf62afb6937 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2be4570f313d4a219ad149e28ab546c5 (127.6.101.65:43507): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:55:15.842371 17878 consensus_queue.cc:1048] T b5d16339e8c74f8aa5c9bef2ed4ef1c6 P 450b7f1304cb4c2ca4c9ccf62afb6937 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 14:55:15.844916 17852 ts_tablet_manager.cc:1434] T d778ef6fbde3497389223b362f88a26a P 2be4570f313d4a219ad149e28ab546c5: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.000s
I20260709 14:55:15.857967 17768 raft_consensus.cc:515] T d778ef6fbde3497389223b362f88a26a P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:15.860266 17768 leader_election.cc:290] T d778ef6fbde3497389223b362f88a26a P 450b7f1304cb4c2ca4c9ccf62afb6937 [CANDIDATE]: Term 1 election: Requested vote from peers 2be4570f313d4a219ad149e28ab546c5 (127.6.101.65:43507), 3f9e4abf970849caa70a02ede7f97cd8 (127.6.101.67:42489)
I20260709 14:55:15.861899 17553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d778ef6fbde3497389223b362f88a26a" candidate_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2be4570f313d4a219ad149e28ab546c5"
I20260709 14:55:15.862887 17553 raft_consensus.cc:3060] T d778ef6fbde3497389223b362f88a26a P 2be4570f313d4a219ad149e28ab546c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:55:15.873095 17701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d778ef6fbde3497389223b362f88a26a" candidate_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f9e4abf970849caa70a02ede7f97cd8"
I20260709 14:55:15.879104 17553 raft_consensus.cc:2468] T d778ef6fbde3497389223b362f88a26a P 2be4570f313d4a219ad149e28ab546c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 450b7f1304cb4c2ca4c9ccf62afb6937 in term 1.
I20260709 14:55:15.874168 17701 raft_consensus.cc:3060] T d778ef6fbde3497389223b362f88a26a P 3f9e4abf970849caa70a02ede7f97cd8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:55:15.893822 17591 leader_election.cc:304] T d778ef6fbde3497389223b362f88a26a P 450b7f1304cb4c2ca4c9ccf62afb6937 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2be4570f313d4a219ad149e28ab546c5, 450b7f1304cb4c2ca4c9ccf62afb6937; no voters: 
I20260709 14:55:15.895183 17869 raft_consensus.cc:493] T bdbd06b81c1f4dddbfd9a9f52f3f90c2 P 2be4570f313d4a219ad149e28ab546c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:55:15.896593 17906 consensus_queue.cc:1048] T 9bc3dcde63fb4f438cb12b4e64ee2d30 P 2be4570f313d4a219ad149e28ab546c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:55:15.896533 17869 raft_consensus.cc:515] T bdbd06b81c1f4dddbfd9a9f52f3f90c2 P 2be4570f313d4a219ad149e28ab546c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:15.897522 17701 raft_consensus.cc:2468] T d778ef6fbde3497389223b362f88a26a P 3f9e4abf970849caa70a02ede7f97cd8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 450b7f1304cb4c2ca4c9ccf62afb6937 in term 1.
I20260709 14:55:15.899085 17869 leader_election.cc:290] T bdbd06b81c1f4dddbfd9a9f52f3f90c2 P 2be4570f313d4a219ad149e28ab546c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 450b7f1304cb4c2ca4c9ccf62afb6937 (127.6.101.66:35877), 3f9e4abf970849caa70a02ede7f97cd8 (127.6.101.67:42489)
I20260709 14:55:15.894865 17768 raft_consensus.cc:2804] T d778ef6fbde3497389223b362f88a26a P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:55:15.901119 17628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbd06b81c1f4dddbfd9a9f52f3f90c2" candidate_uuid: "2be4570f313d4a219ad149e28ab546c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" is_pre_election: true
I20260709 14:55:15.902711 17700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbd06b81c1f4dddbfd9a9f52f3f90c2" candidate_uuid: "2be4570f313d4a219ad149e28ab546c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f9e4abf970849caa70a02ede7f97cd8" is_pre_election: true
I20260709 14:55:15.903463 17700 raft_consensus.cc:2393] T bdbd06b81c1f4dddbfd9a9f52f3f90c2 P 3f9e4abf970849caa70a02ede7f97cd8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2be4570f313d4a219ad149e28ab546c5 in current term 1: Already voted for candidate 450b7f1304cb4c2ca4c9ccf62afb6937 in this term.
I20260709 14:55:15.904539 17768 raft_consensus.cc:697] T d778ef6fbde3497389223b362f88a26a P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 1 LEADER]: Becoming Leader. State: Replica: 450b7f1304cb4c2ca4c9ccf62afb6937, State: Running, Role: LEADER
I20260709 14:55:15.904685 17518 leader_election.cc:304] T bdbd06b81c1f4dddbfd9a9f52f3f90c2 P 2be4570f313d4a219ad149e28ab546c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2be4570f313d4a219ad149e28ab546c5; no voters: 3f9e4abf970849caa70a02ede7f97cd8, 450b7f1304cb4c2ca4c9ccf62afb6937
I20260709 14:55:15.905699 17768 consensus_queue.cc:237] T d778ef6fbde3497389223b362f88a26a P 450b7f1304cb4c2ca4c9ccf62afb6937 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:15.906173 17839 raft_consensus.cc:3060] T bdbd06b81c1f4dddbfd9a9f52f3f90c2 P 2be4570f313d4a219ad149e28ab546c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:55:15.919019 17839 raft_consensus.cc:2749] T bdbd06b81c1f4dddbfd9a9f52f3f90c2 P 2be4570f313d4a219ad149e28ab546c5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:55:15.925328 17448 catalog_manager.cc:5697] T d778ef6fbde3497389223b362f88a26a P 450b7f1304cb4c2ca4c9ccf62afb6937 reported cstate change: term changed from 0 to 1, leader changed from <none> to 450b7f1304cb4c2ca4c9ccf62afb6937 (127.6.101.66). New cstate: current_term: 1 leader_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } health_report { overall_health: UNKNOWN } } }
I20260709 14:55:16.008448 17768 raft_consensus.cc:493] T ac091812917c4fa0a02bdc0d9984206d P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:55:16.009145 17768 raft_consensus.cc:515] T ac091812917c4fa0a02bdc0d9984206d P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:16.011170 17768 leader_election.cc:290] T ac091812917c4fa0a02bdc0d9984206d P 450b7f1304cb4c2ca4c9ccf62afb6937 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2be4570f313d4a219ad149e28ab546c5 (127.6.101.65:43507), 3f9e4abf970849caa70a02ede7f97cd8 (127.6.101.67:42489)
I20260709 14:55:16.012435 17701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac091812917c4fa0a02bdc0d9984206d" candidate_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f9e4abf970849caa70a02ede7f97cd8" is_pre_election: true
I20260709 14:55:16.012435 17551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac091812917c4fa0a02bdc0d9984206d" candidate_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2be4570f313d4a219ad149e28ab546c5" is_pre_election: true
I20260709 14:55:16.013604 17551 raft_consensus.cc:2393] T ac091812917c4fa0a02bdc0d9984206d P 2be4570f313d4a219ad149e28ab546c5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 450b7f1304cb4c2ca4c9ccf62afb6937 in current term 1: Already voted for candidate 3f9e4abf970849caa70a02ede7f97cd8 in this term.
I20260709 14:55:16.014612 17591 leader_election.cc:304] T ac091812917c4fa0a02bdc0d9984206d P 450b7f1304cb4c2ca4c9ccf62afb6937 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 450b7f1304cb4c2ca4c9ccf62afb6937; no voters: 2be4570f313d4a219ad149e28ab546c5, 3f9e4abf970849caa70a02ede7f97cd8
I20260709 14:55:16.015414 17768 raft_consensus.cc:3060] T ac091812917c4fa0a02bdc0d9984206d P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:55:16.021924 17768 raft_consensus.cc:2749] T ac091812917c4fa0a02bdc0d9984206d P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:55:16.035804 17768 consensus_queue.cc:1048] T b56c5a30e63c401cbfb713fd3a859194 P 450b7f1304cb4c2ca4c9ccf62afb6937 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:55:16.047042 17768 consensus_queue.cc:1048] T b56c5a30e63c401cbfb713fd3a859194 P 450b7f1304cb4c2ca4c9ccf62afb6937 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 14:55:16.072690 17873 consensus_queue.cc:1048] T bdbd06b81c1f4dddbfd9a9f52f3f90c2 P 450b7f1304cb4c2ca4c9ccf62afb6937 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 14:55:16.085763 17768 consensus_queue.cc:1048] T bdbd06b81c1f4dddbfd9a9f52f3f90c2 P 450b7f1304cb4c2ca4c9ccf62afb6937 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:55:16.123097 17839 raft_consensus.cc:493] T 947a22f76d864a6dbbb88eb7f085fe17 P 2be4570f313d4a219ad149e28ab546c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:55:16.123871 17839 raft_consensus.cc:515] T 947a22f76d864a6dbbb88eb7f085fe17 P 2be4570f313d4a219ad149e28ab546c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:16.126820 17839 leader_election.cc:290] T 947a22f76d864a6dbbb88eb7f085fe17 P 2be4570f313d4a219ad149e28ab546c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 450b7f1304cb4c2ca4c9ccf62afb6937 (127.6.101.66:35877), 3f9e4abf970849caa70a02ede7f97cd8 (127.6.101.67:42489)
I20260709 14:55:16.127975 17628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "947a22f76d864a6dbbb88eb7f085fe17" candidate_uuid: "2be4570f313d4a219ad149e28ab546c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" is_pre_election: true
I20260709 14:55:16.128381 17701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "947a22f76d864a6dbbb88eb7f085fe17" candidate_uuid: "2be4570f313d4a219ad149e28ab546c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f9e4abf970849caa70a02ede7f97cd8" is_pre_election: true
I20260709 14:55:16.128881 17628 raft_consensus.cc:2468] T 947a22f76d864a6dbbb88eb7f085fe17 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2be4570f313d4a219ad149e28ab546c5 in term 0.
I20260709 14:55:16.129204 17701 raft_consensus.cc:2468] T 947a22f76d864a6dbbb88eb7f085fe17 P 3f9e4abf970849caa70a02ede7f97cd8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2be4570f313d4a219ad149e28ab546c5 in term 0.
I20260709 14:55:16.130436 17518 leader_election.cc:304] T 947a22f76d864a6dbbb88eb7f085fe17 P 2be4570f313d4a219ad149e28ab546c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2be4570f313d4a219ad149e28ab546c5, 450b7f1304cb4c2ca4c9ccf62afb6937; no voters: 
I20260709 14:55:16.131289 17839 raft_consensus.cc:2804] T 947a22f76d864a6dbbb88eb7f085fe17 P 2be4570f313d4a219ad149e28ab546c5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:55:16.131659 17839 raft_consensus.cc:493] T 947a22f76d864a6dbbb88eb7f085fe17 P 2be4570f313d4a219ad149e28ab546c5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:55:16.131943 17839 raft_consensus.cc:3060] T 947a22f76d864a6dbbb88eb7f085fe17 P 2be4570f313d4a219ad149e28ab546c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:55:16.140275 17839 raft_consensus.cc:515] T 947a22f76d864a6dbbb88eb7f085fe17 P 2be4570f313d4a219ad149e28ab546c5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:16.142323 17839 leader_election.cc:290] T 947a22f76d864a6dbbb88eb7f085fe17 P 2be4570f313d4a219ad149e28ab546c5 [CANDIDATE]: Term 1 election: Requested vote from peers 450b7f1304cb4c2ca4c9ccf62afb6937 (127.6.101.66:35877), 3f9e4abf970849caa70a02ede7f97cd8 (127.6.101.67:42489)
I20260709 14:55:16.143438 17628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "947a22f76d864a6dbbb88eb7f085fe17" candidate_uuid: "2be4570f313d4a219ad149e28ab546c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937"
I20260709 14:55:16.144253 17628 raft_consensus.cc:3060] T 947a22f76d864a6dbbb88eb7f085fe17 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:55:16.144357 17701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "947a22f76d864a6dbbb88eb7f085fe17" candidate_uuid: "2be4570f313d4a219ad149e28ab546c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f9e4abf970849caa70a02ede7f97cd8"
I20260709 14:55:16.144974 17701 raft_consensus.cc:3060] T 947a22f76d864a6dbbb88eb7f085fe17 P 3f9e4abf970849caa70a02ede7f97cd8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:55:16.152489 17628 raft_consensus.cc:2468] T 947a22f76d864a6dbbb88eb7f085fe17 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2be4570f313d4a219ad149e28ab546c5 in term 1.
I20260709 14:55:16.152531 17701 raft_consensus.cc:2468] T 947a22f76d864a6dbbb88eb7f085fe17 P 3f9e4abf970849caa70a02ede7f97cd8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2be4570f313d4a219ad149e28ab546c5 in term 1.
I20260709 14:55:16.154472 17518 leader_election.cc:304] T 947a22f76d864a6dbbb88eb7f085fe17 P 2be4570f313d4a219ad149e28ab546c5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2be4570f313d4a219ad149e28ab546c5, 3f9e4abf970849caa70a02ede7f97cd8; no voters: 
I20260709 14:55:16.155424 17839 raft_consensus.cc:2804] T 947a22f76d864a6dbbb88eb7f085fe17 P 2be4570f313d4a219ad149e28ab546c5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:55:16.156065 17839 raft_consensus.cc:697] T 947a22f76d864a6dbbb88eb7f085fe17 P 2be4570f313d4a219ad149e28ab546c5 [term 1 LEADER]: Becoming Leader. State: Replica: 2be4570f313d4a219ad149e28ab546c5, State: Running, Role: LEADER
I20260709 14:55:16.156742 17839 consensus_queue.cc:237] T 947a22f76d864a6dbbb88eb7f085fe17 P 2be4570f313d4a219ad149e28ab546c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:16.165494 17448 catalog_manager.cc:5697] T 947a22f76d864a6dbbb88eb7f085fe17 P 2be4570f313d4a219ad149e28ab546c5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2be4570f313d4a219ad149e28ab546c5 (127.6.101.65). New cstate: current_term: 1 leader_uuid: "2be4570f313d4a219ad149e28ab546c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } health_report { overall_health: UNKNOWN } } }
I20260709 14:55:16.166185 17873 consensus_queue.cc:1048] T 22cb1b4f8c5f457b9f5661dd2d0e208d P 450b7f1304cb4c2ca4c9ccf62afb6937 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:55:16.185746 17872 consensus_queue.cc:1048] T 22cb1b4f8c5f457b9f5661dd2d0e208d P 450b7f1304cb4c2ca4c9ccf62afb6937 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:55:16.210336 17628 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "22cb1b4f8c5f457b9f5661dd2d0e208d"
dest_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937"
mode: GRACEFUL
new_leader_uuid: "2be4570f313d4a219ad149e28ab546c5"
 from {username='slave'} at 127.0.0.1:55412
I20260709 14:55:16.211246 17628 raft_consensus.cc:606] T 22cb1b4f8c5f457b9f5661dd2d0e208d P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 1 LEADER]: Received request to transfer leadership to TS 2be4570f313d4a219ad149e28ab546c5
I20260709 14:55:16.219341 17628 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b5d16339e8c74f8aa5c9bef2ed4ef1c6"
dest_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937"
mode: GRACEFUL
new_leader_uuid: "2be4570f313d4a219ad149e28ab546c5"
 from {username='slave'} at 127.0.0.1:55412
I20260709 14:55:16.220019 17628 raft_consensus.cc:606] T b5d16339e8c74f8aa5c9bef2ed4ef1c6 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 1 LEADER]: Received request to transfer leadership to TS 2be4570f313d4a219ad149e28ab546c5
I20260709 14:55:16.232887 17628 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bdbd06b81c1f4dddbfd9a9f52f3f90c2"
dest_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937"
mode: GRACEFUL
new_leader_uuid: "2be4570f313d4a219ad149e28ab546c5"
 from {username='slave'} at 127.0.0.1:55412
I20260709 14:55:16.233517 17628 raft_consensus.cc:606] T bdbd06b81c1f4dddbfd9a9f52f3f90c2 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 1 LEADER]: Received request to transfer leadership to TS 2be4570f313d4a219ad149e28ab546c5
I20260709 14:55:16.236335 17839 consensus_queue.cc:1048] T bba029f9d36e45249ae3b3699bebed9b P 2be4570f313d4a219ad149e28ab546c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 14:55:16.248299 17839 consensus_queue.cc:1048] T bba029f9d36e45249ae3b3699bebed9b P 2be4570f313d4a219ad149e28ab546c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:55:16.250048 17553 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9bc3dcde63fb4f438cb12b4e64ee2d30"
dest_uuid: "2be4570f313d4a219ad149e28ab546c5"
mode: GRACEFUL
new_leader_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937"
 from {username='slave'} at 127.0.0.1:49736
I20260709 14:55:16.251276 17553 raft_consensus.cc:606] T 9bc3dcde63fb4f438cb12b4e64ee2d30 P 2be4570f313d4a219ad149e28ab546c5 [term 1 LEADER]: Received request to transfer leadership to TS 450b7f1304cb4c2ca4c9ccf62afb6937
I20260709 14:55:16.273204 17553 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bba029f9d36e45249ae3b3699bebed9b"
dest_uuid: "2be4570f313d4a219ad149e28ab546c5"
mode: GRACEFUL
new_leader_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937"
 from {username='slave'} at 127.0.0.1:49736
I20260709 14:55:16.273959 17553 raft_consensus.cc:606] T bba029f9d36e45249ae3b3699bebed9b P 2be4570f313d4a219ad149e28ab546c5 [term 1 LEADER]: Received request to transfer leadership to TS 450b7f1304cb4c2ca4c9ccf62afb6937
I20260709 14:55:16.275561 17869 raft_consensus.cc:993] T bba029f9d36e45249ae3b3699bebed9b P 2be4570f313d4a219ad149e28ab546c5: : Instructing follower 450b7f1304cb4c2ca4c9ccf62afb6937 to start an election
I20260709 14:55:16.276078 17869 raft_consensus.cc:1081] T bba029f9d36e45249ae3b3699bebed9b P 2be4570f313d4a219ad149e28ab546c5 [term 1 LEADER]: Signalling peer 450b7f1304cb4c2ca4c9ccf62afb6937 to start an election
I20260709 14:55:16.278003 17837 consensus_queue.cc:1048] T ac091812917c4fa0a02bdc0d9984206d P 3f9e4abf970849caa70a02ede7f97cd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:55:16.280109 17628 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bba029f9d36e45249ae3b3699bebed9b"
dest_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937"
 from {username='slave'} at 127.0.0.1:55406
I20260709 14:55:16.281199 17628 raft_consensus.cc:493] T bba029f9d36e45249ae3b3699bebed9b P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:55:16.281785 17628 raft_consensus.cc:3060] T bba029f9d36e45249ae3b3699bebed9b P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:55:16.283085 17701 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ac091812917c4fa0a02bdc0d9984206d"
dest_uuid: "3f9e4abf970849caa70a02ede7f97cd8"
mode: GRACEFUL
new_leader_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937"
 from {username='slave'} at 127.0.0.1:35864
I20260709 14:55:16.283876 17701 raft_consensus.cc:606] T ac091812917c4fa0a02bdc0d9984206d P 3f9e4abf970849caa70a02ede7f97cd8 [term 1 LEADER]: Received request to transfer leadership to TS 450b7f1304cb4c2ca4c9ccf62afb6937
I20260709 14:55:16.293426 17626 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d778ef6fbde3497389223b362f88a26a"
dest_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937"
mode: GRACEFUL
new_leader_uuid: "3f9e4abf970849caa70a02ede7f97cd8"
 from {username='slave'} at 127.0.0.1:55412
I20260709 14:55:16.294034 17626 raft_consensus.cc:606] T d778ef6fbde3497389223b362f88a26a P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 1 LEADER]: Received request to transfer leadership to TS 3f9e4abf970849caa70a02ede7f97cd8
I20260709 14:55:16.295676 17628 raft_consensus.cc:515] T bba029f9d36e45249ae3b3699bebed9b P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:16.298813 17628 leader_election.cc:290] T bba029f9d36e45249ae3b3699bebed9b P 450b7f1304cb4c2ca4c9ccf62afb6937 [CANDIDATE]: Term 2 election: Requested vote from peers 2be4570f313d4a219ad149e28ab546c5 (127.6.101.65:43507), 3f9e4abf970849caa70a02ede7f97cd8 (127.6.101.67:42489)
I20260709 14:55:16.300029 17700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bba029f9d36e45249ae3b3699bebed9b" candidate_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3f9e4abf970849caa70a02ede7f97cd8"
I20260709 14:55:16.300681 17700 raft_consensus.cc:3060] T bba029f9d36e45249ae3b3699bebed9b P 3f9e4abf970849caa70a02ede7f97cd8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:55:16.301733 17553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bba029f9d36e45249ae3b3699bebed9b" candidate_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2be4570f313d4a219ad149e28ab546c5"
I20260709 14:55:16.302552 17553 raft_consensus.cc:3055] T bba029f9d36e45249ae3b3699bebed9b P 2be4570f313d4a219ad149e28ab546c5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 14:55:16.302881 17553 raft_consensus.cc:740] T bba029f9d36e45249ae3b3699bebed9b P 2be4570f313d4a219ad149e28ab546c5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2be4570f313d4a219ad149e28ab546c5, State: Running, Role: LEADER
I20260709 14:55:16.303761 17553 consensus_queue.cc:260] T bba029f9d36e45249ae3b3699bebed9b P 2be4570f313d4a219ad149e28ab546c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:16.303026 17879 raft_consensus.cc:993] T ac091812917c4fa0a02bdc0d9984206d P 3f9e4abf970849caa70a02ede7f97cd8: : Instructing follower 450b7f1304cb4c2ca4c9ccf62afb6937 to start an election
I20260709 14:55:16.305102 17879 raft_consensus.cc:1081] T ac091812917c4fa0a02bdc0d9984206d P 3f9e4abf970849caa70a02ede7f97cd8 [term 1 LEADER]: Signalling peer 450b7f1304cb4c2ca4c9ccf62afb6937 to start an election
I20260709 14:55:16.310348 17700 raft_consensus.cc:2468] T bba029f9d36e45249ae3b3699bebed9b P 3f9e4abf970849caa70a02ede7f97cd8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 450b7f1304cb4c2ca4c9ccf62afb6937 in term 2.
I20260709 14:55:16.314438 17839 raft_consensus.cc:993] T 9bc3dcde63fb4f438cb12b4e64ee2d30 P 2be4570f313d4a219ad149e28ab546c5: : Instructing follower 450b7f1304cb4c2ca4c9ccf62afb6937 to start an election
I20260709 14:55:16.315105 17869 raft_consensus.cc:1081] T 9bc3dcde63fb4f438cb12b4e64ee2d30 P 2be4570f313d4a219ad149e28ab546c5 [term 1 LEADER]: Signalling peer 450b7f1304cb4c2ca4c9ccf62afb6937 to start an election
I20260709 14:55:16.317312 17627 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ac091812917c4fa0a02bdc0d9984206d"
dest_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937"
 from {username='slave'} at 127.0.0.1:55394
I20260709 14:55:16.305074 17553 raft_consensus.cc:3060] T bba029f9d36e45249ae3b3699bebed9b P 2be4570f313d4a219ad149e28ab546c5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:55:16.318325 17627 raft_consensus.cc:493] T ac091812917c4fa0a02bdc0d9984206d P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:55:16.318856 17627 raft_consensus.cc:3060] T ac091812917c4fa0a02bdc0d9984206d P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:55:16.322710 17628 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9bc3dcde63fb4f438cb12b4e64ee2d30"
dest_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937"
 from {username='slave'} at 127.0.0.1:55406
I20260709 14:55:16.323707 17628 raft_consensus.cc:493] T 9bc3dcde63fb4f438cb12b4e64ee2d30 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:55:16.322927 17837 consensus_queue.cc:1048] T ac091812917c4fa0a02bdc0d9984206d P 3f9e4abf970849caa70a02ede7f97cd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 14:55:16.324513 17628 raft_consensus.cc:3060] T 9bc3dcde63fb4f438cb12b4e64ee2d30 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:55:16.331820 17553 raft_consensus.cc:2468] T bba029f9d36e45249ae3b3699bebed9b P 2be4570f313d4a219ad149e28ab546c5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 450b7f1304cb4c2ca4c9ccf62afb6937 in term 2.
I20260709 14:55:16.335594 17627 raft_consensus.cc:515] T ac091812917c4fa0a02bdc0d9984206d P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:16.336426 17591 leader_election.cc:304] T bba029f9d36e45249ae3b3699bebed9b P 450b7f1304cb4c2ca4c9ccf62afb6937 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2be4570f313d4a219ad149e28ab546c5, 450b7f1304cb4c2ca4c9ccf62afb6937; no voters: 
I20260709 14:55:16.337524 17872 raft_consensus.cc:2804] T bba029f9d36e45249ae3b3699bebed9b P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:55:16.338052 17872 raft_consensus.cc:697] T bba029f9d36e45249ae3b3699bebed9b P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 2 LEADER]: Becoming Leader. State: Replica: 450b7f1304cb4c2ca4c9ccf62afb6937, State: Running, Role: LEADER
I20260709 14:55:16.339020 17872 consensus_queue.cc:237] T bba029f9d36e45249ae3b3699bebed9b P 450b7f1304cb4c2ca4c9ccf62afb6937 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:16.340708 17702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac091812917c4fa0a02bdc0d9984206d" candidate_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3f9e4abf970849caa70a02ede7f97cd8"
I20260709 14:55:16.341568 17702 raft_consensus.cc:3055] T ac091812917c4fa0a02bdc0d9984206d P 3f9e4abf970849caa70a02ede7f97cd8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 14:55:16.341917 17702 raft_consensus.cc:740] T ac091812917c4fa0a02bdc0d9984206d P 3f9e4abf970849caa70a02ede7f97cd8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3f9e4abf970849caa70a02ede7f97cd8, State: Running, Role: LEADER
I20260709 14:55:16.342756 17702 consensus_queue.cc:260] T ac091812917c4fa0a02bdc0d9984206d P 3f9e4abf970849caa70a02ede7f97cd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:16.343703 17702 raft_consensus.cc:3060] T ac091812917c4fa0a02bdc0d9984206d P 3f9e4abf970849caa70a02ede7f97cd8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:55:16.349327 17553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac091812917c4fa0a02bdc0d9984206d" candidate_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2be4570f313d4a219ad149e28ab546c5"
I20260709 14:55:16.350445 17553 raft_consensus.cc:3060] T ac091812917c4fa0a02bdc0d9984206d P 2be4570f313d4a219ad149e28ab546c5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:55:16.350574 17628 raft_consensus.cc:515] T 9bc3dcde63fb4f438cb12b4e64ee2d30 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:16.355023 17628 leader_election.cc:290] T 9bc3dcde63fb4f438cb12b4e64ee2d30 P 450b7f1304cb4c2ca4c9ccf62afb6937 [CANDIDATE]: Term 2 election: Requested vote from peers 2be4570f313d4a219ad149e28ab546c5 (127.6.101.65:43507), 3f9e4abf970849caa70a02ede7f97cd8 (127.6.101.67:42489)
I20260709 14:55:16.355031 17449 catalog_manager.cc:5697] T bba029f9d36e45249ae3b3699bebed9b P 450b7f1304cb4c2ca4c9ccf62afb6937 reported cstate change: term changed from 1 to 2, leader changed from 2be4570f313d4a219ad149e28ab546c5 (127.6.101.65) to 450b7f1304cb4c2ca4c9ccf62afb6937 (127.6.101.66). New cstate: current_term: 2 leader_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } health_report { overall_health: UNKNOWN } } }
I20260709 14:55:16.356832 17701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc3dcde63fb4f438cb12b4e64ee2d30" candidate_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3f9e4abf970849caa70a02ede7f97cd8"
I20260709 14:55:16.357728 17701 raft_consensus.cc:3060] T 9bc3dcde63fb4f438cb12b4e64ee2d30 P 3f9e4abf970849caa70a02ede7f97cd8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:55:16.359709 17551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc3dcde63fb4f438cb12b4e64ee2d30" candidate_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2be4570f313d4a219ad149e28ab546c5"
I20260709 14:55:16.360517 17551 raft_consensus.cc:3055] T 9bc3dcde63fb4f438cb12b4e64ee2d30 P 2be4570f313d4a219ad149e28ab546c5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 14:55:16.360816 17551 raft_consensus.cc:740] T 9bc3dcde63fb4f438cb12b4e64ee2d30 P 2be4570f313d4a219ad149e28ab546c5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2be4570f313d4a219ad149e28ab546c5, State: Running, Role: LEADER
I20260709 14:55:16.360700 17627 leader_election.cc:290] T ac091812917c4fa0a02bdc0d9984206d P 450b7f1304cb4c2ca4c9ccf62afb6937 [CANDIDATE]: Term 2 election: Requested vote from peers 2be4570f313d4a219ad149e28ab546c5 (127.6.101.65:43507), 3f9e4abf970849caa70a02ede7f97cd8 (127.6.101.67:42489)
I20260709 14:55:16.361544 17553 raft_consensus.cc:2468] T ac091812917c4fa0a02bdc0d9984206d P 2be4570f313d4a219ad149e28ab546c5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 450b7f1304cb4c2ca4c9ccf62afb6937 in term 2.
I20260709 14:55:16.363931 17702 raft_consensus.cc:2468] T ac091812917c4fa0a02bdc0d9984206d P 3f9e4abf970849caa70a02ede7f97cd8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 450b7f1304cb4c2ca4c9ccf62afb6937 in term 2.
I20260709 14:55:16.366168 17593 leader_election.cc:304] T ac091812917c4fa0a02bdc0d9984206d P 450b7f1304cb4c2ca4c9ccf62afb6937 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f9e4abf970849caa70a02ede7f97cd8, 450b7f1304cb4c2ca4c9ccf62afb6937; no voters: 
I20260709 14:55:16.367123 17701 raft_consensus.cc:2468] T 9bc3dcde63fb4f438cb12b4e64ee2d30 P 3f9e4abf970849caa70a02ede7f97cd8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 450b7f1304cb4c2ca4c9ccf62afb6937 in term 2.
I20260709 14:55:16.368026 17872 raft_consensus.cc:2804] T ac091812917c4fa0a02bdc0d9984206d P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:55:16.368794 17872 raft_consensus.cc:697] T ac091812917c4fa0a02bdc0d9984206d P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 2 LEADER]: Becoming Leader. State: Replica: 450b7f1304cb4c2ca4c9ccf62afb6937, State: Running, Role: LEADER
I20260709 14:55:16.369793 17593 leader_election.cc:304] T 9bc3dcde63fb4f438cb12b4e64ee2d30 P 450b7f1304cb4c2ca4c9ccf62afb6937 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f9e4abf970849caa70a02ede7f97cd8, 450b7f1304cb4c2ca4c9ccf62afb6937; no voters: 
I20260709 14:55:16.369822 17872 consensus_queue.cc:237] T ac091812917c4fa0a02bdc0d9984206d P 450b7f1304cb4c2ca4c9ccf62afb6937 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:16.371584 17768 raft_consensus.cc:2804] T 9bc3dcde63fb4f438cb12b4e64ee2d30 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:55:16.372232 17768 raft_consensus.cc:697] T 9bc3dcde63fb4f438cb12b4e64ee2d30 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 2 LEADER]: Becoming Leader. State: Replica: 450b7f1304cb4c2ca4c9ccf62afb6937, State: Running, Role: LEADER
I20260709 14:55:16.361920 17551 consensus_queue.cc:260] T 9bc3dcde63fb4f438cb12b4e64ee2d30 P 2be4570f313d4a219ad149e28ab546c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:16.373358 17768 consensus_queue.cc:237] T 9bc3dcde63fb4f438cb12b4e64ee2d30 P 450b7f1304cb4c2ca4c9ccf62afb6937 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:16.374365 17551 raft_consensus.cc:3060] T 9bc3dcde63fb4f438cb12b4e64ee2d30 P 2be4570f313d4a219ad149e28ab546c5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:55:16.382792 17872 consensus_queue.cc:1048] T d778ef6fbde3497389223b362f88a26a P 450b7f1304cb4c2ca4c9ccf62afb6937 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:55:16.384213 17551 raft_consensus.cc:2468] T 9bc3dcde63fb4f438cb12b4e64ee2d30 P 2be4570f313d4a219ad149e28ab546c5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 450b7f1304cb4c2ca4c9ccf62afb6937 in term 2.
I20260709 14:55:16.388482 17449 catalog_manager.cc:5697] T ac091812917c4fa0a02bdc0d9984206d P 450b7f1304cb4c2ca4c9ccf62afb6937 reported cstate change: term changed from 1 to 2, leader changed from 3f9e4abf970849caa70a02ede7f97cd8 (127.6.101.67) to 450b7f1304cb4c2ca4c9ccf62afb6937 (127.6.101.66). New cstate: current_term: 2 leader_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } health_report { overall_health: UNKNOWN } } }
I20260709 14:55:16.390467 17449 catalog_manager.cc:5697] T 9bc3dcde63fb4f438cb12b4e64ee2d30 P 450b7f1304cb4c2ca4c9ccf62afb6937 reported cstate change: term changed from 1 to 2, leader changed from 2be4570f313d4a219ad149e28ab546c5 (127.6.101.65) to 450b7f1304cb4c2ca4c9ccf62afb6937 (127.6.101.66). New cstate: current_term: 2 leader_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } health_report { overall_health: UNKNOWN } } }
I20260709 14:55:16.395254 17878 consensus_queue.cc:1048] T d778ef6fbde3497389223b362f88a26a P 450b7f1304cb4c2ca4c9ccf62afb6937 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 14:55:16.405382 17878 raft_consensus.cc:993] T d778ef6fbde3497389223b362f88a26a P 450b7f1304cb4c2ca4c9ccf62afb6937: : Instructing follower 3f9e4abf970849caa70a02ede7f97cd8 to start an election
I20260709 14:55:16.405911 17878 raft_consensus.cc:1081] T d778ef6fbde3497389223b362f88a26a P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 1 LEADER]: Signalling peer 3f9e4abf970849caa70a02ede7f97cd8 to start an election
I20260709 14:55:16.408502 17701 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d778ef6fbde3497389223b362f88a26a"
dest_uuid: "3f9e4abf970849caa70a02ede7f97cd8"
 from {username='slave'} at 127.0.0.1:35854
I20260709 14:55:16.410240 17701 raft_consensus.cc:493] T d778ef6fbde3497389223b362f88a26a P 3f9e4abf970849caa70a02ede7f97cd8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:55:16.410790 17701 raft_consensus.cc:3060] T d778ef6fbde3497389223b362f88a26a P 3f9e4abf970849caa70a02ede7f97cd8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:55:16.419242 17701 raft_consensus.cc:515] T d778ef6fbde3497389223b362f88a26a P 3f9e4abf970849caa70a02ede7f97cd8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:16.421434 17701 leader_election.cc:290] T d778ef6fbde3497389223b362f88a26a P 3f9e4abf970849caa70a02ede7f97cd8 [CANDIDATE]: Term 2 election: Requested vote from peers 2be4570f313d4a219ad149e28ab546c5 (127.6.101.65:43507), 450b7f1304cb4c2ca4c9ccf62afb6937 (127.6.101.66:35877)
I20260709 14:55:16.422755 17551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d778ef6fbde3497389223b362f88a26a" candidate_uuid: "3f9e4abf970849caa70a02ede7f97cd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2be4570f313d4a219ad149e28ab546c5"
I20260709 14:55:16.423224 17628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d778ef6fbde3497389223b362f88a26a" candidate_uuid: "3f9e4abf970849caa70a02ede7f97cd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937"
I20260709 14:55:16.423605 17551 raft_consensus.cc:3060] T d778ef6fbde3497389223b362f88a26a P 2be4570f313d4a219ad149e28ab546c5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:55:16.423862 17628 raft_consensus.cc:3055] T d778ef6fbde3497389223b362f88a26a P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 14:55:16.424198 17628 raft_consensus.cc:740] T d778ef6fbde3497389223b362f88a26a P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 450b7f1304cb4c2ca4c9ccf62afb6937, State: Running, Role: LEADER
I20260709 14:55:16.425102 17628 consensus_queue.cc:260] T d778ef6fbde3497389223b362f88a26a P 450b7f1304cb4c2ca4c9ccf62afb6937 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:16.426736 17628 raft_consensus.cc:3060] T d778ef6fbde3497389223b362f88a26a P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:55:16.433640 17551 raft_consensus.cc:2468] T d778ef6fbde3497389223b362f88a26a P 2be4570f313d4a219ad149e28ab546c5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f9e4abf970849caa70a02ede7f97cd8 in term 2.
I20260709 14:55:16.435348 17665 leader_election.cc:304] T d778ef6fbde3497389223b362f88a26a P 3f9e4abf970849caa70a02ede7f97cd8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2be4570f313d4a219ad149e28ab546c5, 3f9e4abf970849caa70a02ede7f97cd8; no voters: 
I20260709 14:55:16.436463 17837 raft_consensus.cc:2804] T d778ef6fbde3497389223b362f88a26a P 3f9e4abf970849caa70a02ede7f97cd8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:55:16.436659 17628 raft_consensus.cc:2468] T d778ef6fbde3497389223b362f88a26a P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f9e4abf970849caa70a02ede7f97cd8 in term 2.
I20260709 14:55:16.437167 17837 raft_consensus.cc:697] T d778ef6fbde3497389223b362f88a26a P 3f9e4abf970849caa70a02ede7f97cd8 [term 2 LEADER]: Becoming Leader. State: Replica: 3f9e4abf970849caa70a02ede7f97cd8, State: Running, Role: LEADER
I20260709 14:55:16.438794 17837 consensus_queue.cc:237] T d778ef6fbde3497389223b362f88a26a P 3f9e4abf970849caa70a02ede7f97cd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:16.448226 17448 catalog_manager.cc:5697] T d778ef6fbde3497389223b362f88a26a P 3f9e4abf970849caa70a02ede7f97cd8 reported cstate change: term changed from 1 to 2, leader changed from 450b7f1304cb4c2ca4c9ccf62afb6937 (127.6.101.66) to 3f9e4abf970849caa70a02ede7f97cd8 (127.6.101.67). New cstate: current_term: 2 leader_uuid: "3f9e4abf970849caa70a02ede7f97cd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } health_report { overall_health: HEALTHY } } }
I20260709 14:55:16.460770 17873 raft_consensus.cc:993] T b5d16339e8c74f8aa5c9bef2ed4ef1c6 P 450b7f1304cb4c2ca4c9ccf62afb6937: : Instructing follower 2be4570f313d4a219ad149e28ab546c5 to start an election
I20260709 14:55:16.461306 17878 raft_consensus.cc:1081] T b5d16339e8c74f8aa5c9bef2ed4ef1c6 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 1 LEADER]: Signalling peer 2be4570f313d4a219ad149e28ab546c5 to start an election
I20260709 14:55:16.463148 17551 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b5d16339e8c74f8aa5c9bef2ed4ef1c6"
dest_uuid: "2be4570f313d4a219ad149e28ab546c5"
 from {username='slave'} at 127.0.0.1:49722
I20260709 14:55:16.463845 17551 raft_consensus.cc:493] T b5d16339e8c74f8aa5c9bef2ed4ef1c6 P 2be4570f313d4a219ad149e28ab546c5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:55:16.464210 17551 raft_consensus.cc:3060] T b5d16339e8c74f8aa5c9bef2ed4ef1c6 P 2be4570f313d4a219ad149e28ab546c5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:55:16.472669 17551 raft_consensus.cc:515] T b5d16339e8c74f8aa5c9bef2ed4ef1c6 P 2be4570f313d4a219ad149e28ab546c5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:16.475158 17551 leader_election.cc:290] T b5d16339e8c74f8aa5c9bef2ed4ef1c6 P 2be4570f313d4a219ad149e28ab546c5 [CANDIDATE]: Term 2 election: Requested vote from peers 450b7f1304cb4c2ca4c9ccf62afb6937 (127.6.101.66:35877), 3f9e4abf970849caa70a02ede7f97cd8 (127.6.101.67:42489)
I20260709 14:55:16.476603 17628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d16339e8c74f8aa5c9bef2ed4ef1c6" candidate_uuid: "2be4570f313d4a219ad149e28ab546c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937"
I20260709 14:55:16.476620 17701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d16339e8c74f8aa5c9bef2ed4ef1c6" candidate_uuid: "2be4570f313d4a219ad149e28ab546c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3f9e4abf970849caa70a02ede7f97cd8"
I20260709 14:55:16.477524 17628 raft_consensus.cc:3055] T b5d16339e8c74f8aa5c9bef2ed4ef1c6 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 14:55:16.477726 17701 raft_consensus.cc:3060] T b5d16339e8c74f8aa5c9bef2ed4ef1c6 P 3f9e4abf970849caa70a02ede7f97cd8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:55:16.477962 17628 raft_consensus.cc:740] T b5d16339e8c74f8aa5c9bef2ed4ef1c6 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 450b7f1304cb4c2ca4c9ccf62afb6937, State: Running, Role: LEADER
I20260709 14:55:16.479300 17628 consensus_queue.cc:260] T b5d16339e8c74f8aa5c9bef2ed4ef1c6 P 450b7f1304cb4c2ca4c9ccf62afb6937 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:16.481233 17628 raft_consensus.cc:3060] T b5d16339e8c74f8aa5c9bef2ed4ef1c6 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:55:16.488293 17701 raft_consensus.cc:2468] T b5d16339e8c74f8aa5c9bef2ed4ef1c6 P 3f9e4abf970849caa70a02ede7f97cd8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2be4570f313d4a219ad149e28ab546c5 in term 2.
I20260709 14:55:16.490265 17518 leader_election.cc:304] T b5d16339e8c74f8aa5c9bef2ed4ef1c6 P 2be4570f313d4a219ad149e28ab546c5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2be4570f313d4a219ad149e28ab546c5, 3f9e4abf970849caa70a02ede7f97cd8; no voters: 
I20260709 14:55:16.490883 17628 raft_consensus.cc:2468] T b5d16339e8c74f8aa5c9bef2ed4ef1c6 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2be4570f313d4a219ad149e28ab546c5 in term 2.
I20260709 14:55:16.491261 17839 raft_consensus.cc:2804] T b5d16339e8c74f8aa5c9bef2ed4ef1c6 P 2be4570f313d4a219ad149e28ab546c5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:55:16.491842 17839 raft_consensus.cc:697] T b5d16339e8c74f8aa5c9bef2ed4ef1c6 P 2be4570f313d4a219ad149e28ab546c5 [term 2 LEADER]: Becoming Leader. State: Replica: 2be4570f313d4a219ad149e28ab546c5, State: Running, Role: LEADER
I20260709 14:55:16.493480 17839 consensus_queue.cc:237] T b5d16339e8c74f8aa5c9bef2ed4ef1c6 P 2be4570f313d4a219ad149e28ab546c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:16.502583 17448 catalog_manager.cc:5697] T b5d16339e8c74f8aa5c9bef2ed4ef1c6 P 2be4570f313d4a219ad149e28ab546c5 reported cstate change: term changed from 1 to 2, leader changed from 450b7f1304cb4c2ca4c9ccf62afb6937 (127.6.101.66) to 2be4570f313d4a219ad149e28ab546c5 (127.6.101.65). New cstate: current_term: 2 leader_uuid: "2be4570f313d4a219ad149e28ab546c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } health_report { overall_health: UNKNOWN } } }
I20260709 14:55:16.637616 17839 consensus_queue.cc:1048] T 947a22f76d864a6dbbb88eb7f085fe17 P 2be4570f313d4a219ad149e28ab546c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 14:55:16.656301 17839 consensus_queue.cc:1048] T 947a22f76d864a6dbbb88eb7f085fe17 P 2be4570f313d4a219ad149e28ab546c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:55:16.711387 17878 raft_consensus.cc:993] T bdbd06b81c1f4dddbfd9a9f52f3f90c2 P 450b7f1304cb4c2ca4c9ccf62afb6937: : Instructing follower 2be4570f313d4a219ad149e28ab546c5 to start an election
I20260709 14:55:16.712150 17768 raft_consensus.cc:1081] T bdbd06b81c1f4dddbfd9a9f52f3f90c2 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 1 LEADER]: Signalling peer 2be4570f313d4a219ad149e28ab546c5 to start an election
I20260709 14:55:16.714583 17551 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bdbd06b81c1f4dddbfd9a9f52f3f90c2"
dest_uuid: "2be4570f313d4a219ad149e28ab546c5"
 from {username='slave'} at 127.0.0.1:49722
I20260709 14:55:16.715413 17551 raft_consensus.cc:493] T bdbd06b81c1f4dddbfd9a9f52f3f90c2 P 2be4570f313d4a219ad149e28ab546c5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:55:16.716681 17551 raft_consensus.cc:3060] T bdbd06b81c1f4dddbfd9a9f52f3f90c2 P 2be4570f313d4a219ad149e28ab546c5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:55:16.720572 17878 raft_consensus.cc:993] T 22cb1b4f8c5f457b9f5661dd2d0e208d P 450b7f1304cb4c2ca4c9ccf62afb6937: : Instructing follower 2be4570f313d4a219ad149e28ab546c5 to start an election
I20260709 14:55:16.721632 17873 raft_consensus.cc:1081] T 22cb1b4f8c5f457b9f5661dd2d0e208d P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 1 LEADER]: Signalling peer 2be4570f313d4a219ad149e28ab546c5 to start an election
I20260709 14:55:16.726851 17551 raft_consensus.cc:515] T bdbd06b81c1f4dddbfd9a9f52f3f90c2 P 2be4570f313d4a219ad149e28ab546c5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:16.728173 17553 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "22cb1b4f8c5f457b9f5661dd2d0e208d"
dest_uuid: "2be4570f313d4a219ad149e28ab546c5"
 from {username='slave'} at 127.0.0.1:49722
I20260709 14:55:16.730540 17551 leader_election.cc:290] T bdbd06b81c1f4dddbfd9a9f52f3f90c2 P 2be4570f313d4a219ad149e28ab546c5 [CANDIDATE]: Term 2 election: Requested vote from peers 450b7f1304cb4c2ca4c9ccf62afb6937 (127.6.101.66:35877), 3f9e4abf970849caa70a02ede7f97cd8 (127.6.101.67:42489)
I20260709 14:55:16.731626 17628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbd06b81c1f4dddbfd9a9f52f3f90c2" candidate_uuid: "2be4570f313d4a219ad149e28ab546c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937"
I20260709 14:55:16.732363 17702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbd06b81c1f4dddbfd9a9f52f3f90c2" candidate_uuid: "2be4570f313d4a219ad149e28ab546c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3f9e4abf970849caa70a02ede7f97cd8"
I20260709 14:55:16.733754 17628 raft_consensus.cc:3055] T bdbd06b81c1f4dddbfd9a9f52f3f90c2 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 14:55:16.729061 17553 raft_consensus.cc:493] T 22cb1b4f8c5f457b9f5661dd2d0e208d P 2be4570f313d4a219ad149e28ab546c5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:55:16.733816 17702 raft_consensus.cc:3060] T bdbd06b81c1f4dddbfd9a9f52f3f90c2 P 3f9e4abf970849caa70a02ede7f97cd8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:55:16.734215 17628 raft_consensus.cc:740] T bdbd06b81c1f4dddbfd9a9f52f3f90c2 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 450b7f1304cb4c2ca4c9ccf62afb6937, State: Running, Role: LEADER
I20260709 14:55:16.734513 17553 raft_consensus.cc:3060] T 22cb1b4f8c5f457b9f5661dd2d0e208d P 2be4570f313d4a219ad149e28ab546c5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:55:16.735333 17628 consensus_queue.cc:260] T bdbd06b81c1f4dddbfd9a9f52f3f90c2 P 450b7f1304cb4c2ca4c9ccf62afb6937 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:16.736826 17628 raft_consensus.cc:3060] T bdbd06b81c1f4dddbfd9a9f52f3f90c2 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:55:16.742545 17702 raft_consensus.cc:2468] T bdbd06b81c1f4dddbfd9a9f52f3f90c2 P 3f9e4abf970849caa70a02ede7f97cd8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2be4570f313d4a219ad149e28ab546c5 in term 2.
I20260709 14:55:16.742784 17553 raft_consensus.cc:515] T 22cb1b4f8c5f457b9f5661dd2d0e208d P 2be4570f313d4a219ad149e28ab546c5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:16.744576 17518 leader_election.cc:304] T bdbd06b81c1f4dddbfd9a9f52f3f90c2 P 2be4570f313d4a219ad149e28ab546c5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2be4570f313d4a219ad149e28ab546c5, 3f9e4abf970849caa70a02ede7f97cd8; no voters: 
I20260709 14:55:16.744746 17628 raft_consensus.cc:2468] T bdbd06b81c1f4dddbfd9a9f52f3f90c2 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2be4570f313d4a219ad149e28ab546c5 in term 2.
I20260709 14:55:16.745558 17927 raft_consensus.cc:2804] T bdbd06b81c1f4dddbfd9a9f52f3f90c2 P 2be4570f313d4a219ad149e28ab546c5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:55:16.745849 17553 leader_election.cc:290] T 22cb1b4f8c5f457b9f5661dd2d0e208d P 2be4570f313d4a219ad149e28ab546c5 [CANDIDATE]: Term 2 election: Requested vote from peers 450b7f1304cb4c2ca4c9ccf62afb6937 (127.6.101.66:35877), 3f9e4abf970849caa70a02ede7f97cd8 (127.6.101.67:42489)
I20260709 14:55:16.746460 17927 raft_consensus.cc:697] T bdbd06b81c1f4dddbfd9a9f52f3f90c2 P 2be4570f313d4a219ad149e28ab546c5 [term 2 LEADER]: Becoming Leader. State: Replica: 2be4570f313d4a219ad149e28ab546c5, State: Running, Role: LEADER
I20260709 14:55:16.747421 17628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22cb1b4f8c5f457b9f5661dd2d0e208d" candidate_uuid: "2be4570f313d4a219ad149e28ab546c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937"
I20260709 14:55:16.748265 17628 raft_consensus.cc:3055] T 22cb1b4f8c5f457b9f5661dd2d0e208d P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 14:55:16.748772 17628 raft_consensus.cc:740] T 22cb1b4f8c5f457b9f5661dd2d0e208d P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 450b7f1304cb4c2ca4c9ccf62afb6937, State: Running, Role: LEADER
I20260709 14:55:16.748968 17927 consensus_queue.cc:237] T bdbd06b81c1f4dddbfd9a9f52f3f90c2 P 2be4570f313d4a219ad149e28ab546c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:16.752746 17702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22cb1b4f8c5f457b9f5661dd2d0e208d" candidate_uuid: "2be4570f313d4a219ad149e28ab546c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3f9e4abf970849caa70a02ede7f97cd8"
I20260709 14:55:16.753665 17702 raft_consensus.cc:3060] T 22cb1b4f8c5f457b9f5661dd2d0e208d P 3f9e4abf970849caa70a02ede7f97cd8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:55:16.754539 17701 raft_consensus.cc:1275] T 9bc3dcde63fb4f438cb12b4e64ee2d30 P 3f9e4abf970849caa70a02ede7f97cd8 [term 2 FOLLOWER]: Refusing update from remote peer 450b7f1304cb4c2ca4c9ccf62afb6937: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:55:16.756924 17628 consensus_queue.cc:260] T 22cb1b4f8c5f457b9f5661dd2d0e208d P 450b7f1304cb4c2ca4c9ccf62afb6937 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:16.759359 17628 raft_consensus.cc:3060] T 22cb1b4f8c5f457b9f5661dd2d0e208d P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:55:16.759740 17448 catalog_manager.cc:5697] T bdbd06b81c1f4dddbfd9a9f52f3f90c2 P 2be4570f313d4a219ad149e28ab546c5 reported cstate change: term changed from 1 to 2, leader changed from 450b7f1304cb4c2ca4c9ccf62afb6937 (127.6.101.66) to 2be4570f313d4a219ad149e28ab546c5 (127.6.101.65). New cstate: current_term: 2 leader_uuid: "2be4570f313d4a219ad149e28ab546c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } health_report { overall_health: UNKNOWN } } }
I20260709 14:55:16.762918 17768 consensus_queue.cc:1048] T 9bc3dcde63fb4f438cb12b4e64ee2d30 P 450b7f1304cb4c2ca4c9ccf62afb6937 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 14:55:16.763152 17702 raft_consensus.cc:2468] T 22cb1b4f8c5f457b9f5661dd2d0e208d P 3f9e4abf970849caa70a02ede7f97cd8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2be4570f313d4a219ad149e28ab546c5 in term 2.
I20260709 14:55:16.767719 17518 leader_election.cc:304] T 22cb1b4f8c5f457b9f5661dd2d0e208d P 2be4570f313d4a219ad149e28ab546c5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2be4570f313d4a219ad149e28ab546c5, 3f9e4abf970849caa70a02ede7f97cd8; no voters: 
I20260709 14:55:16.768817 17927 raft_consensus.cc:2804] T 22cb1b4f8c5f457b9f5661dd2d0e208d P 2be4570f313d4a219ad149e28ab546c5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:55:16.769832 17927 raft_consensus.cc:697] T 22cb1b4f8c5f457b9f5661dd2d0e208d P 2be4570f313d4a219ad149e28ab546c5 [term 2 LEADER]: Becoming Leader. State: Replica: 2be4570f313d4a219ad149e28ab546c5, State: Running, Role: LEADER
I20260709 14:55:16.772518 17628 raft_consensus.cc:2468] T 22cb1b4f8c5f457b9f5661dd2d0e208d P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2be4570f313d4a219ad149e28ab546c5 in term 2.
I20260709 14:55:16.772886 17927 consensus_queue.cc:237] T 22cb1b4f8c5f457b9f5661dd2d0e208d P 2be4570f313d4a219ad149e28ab546c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:16.780025 17553 raft_consensus.cc:1275] T 9bc3dcde63fb4f438cb12b4e64ee2d30 P 2be4570f313d4a219ad149e28ab546c5 [term 2 FOLLOWER]: Refusing update from remote peer 450b7f1304cb4c2ca4c9ccf62afb6937: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:55:16.781906 17878 consensus_queue.cc:1048] T 9bc3dcde63fb4f438cb12b4e64ee2d30 P 450b7f1304cb4c2ca4c9ccf62afb6937 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 14:55:16.786208 17449 catalog_manager.cc:5697] T 22cb1b4f8c5f457b9f5661dd2d0e208d P 2be4570f313d4a219ad149e28ab546c5 reported cstate change: term changed from 1 to 2, leader changed from 450b7f1304cb4c2ca4c9ccf62afb6937 (127.6.101.66) to 2be4570f313d4a219ad149e28ab546c5 (127.6.101.65). New cstate: current_term: 2 leader_uuid: "2be4570f313d4a219ad149e28ab546c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } health_report { overall_health: UNKNOWN } } }
I20260709 14:55:16.806273 17702 raft_consensus.cc:1275] T bba029f9d36e45249ae3b3699bebed9b P 3f9e4abf970849caa70a02ede7f97cd8 [term 2 FOLLOWER]: Refusing update from remote peer 450b7f1304cb4c2ca4c9ccf62afb6937: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:55:16.807936 17878 consensus_queue.cc:1048] T bba029f9d36e45249ae3b3699bebed9b P 450b7f1304cb4c2ca4c9ccf62afb6937 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 14:55:16.817762 17553 raft_consensus.cc:1275] T bba029f9d36e45249ae3b3699bebed9b P 2be4570f313d4a219ad149e28ab546c5 [term 2 FOLLOWER]: Refusing update from remote peer 450b7f1304cb4c2ca4c9ccf62afb6937: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:55:16.820595 17872 consensus_queue.cc:1048] T bba029f9d36e45249ae3b3699bebed9b P 450b7f1304cb4c2ca4c9ccf62afb6937 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 14:55:16.897846 17702 raft_consensus.cc:1275] T b5d16339e8c74f8aa5c9bef2ed4ef1c6 P 3f9e4abf970849caa70a02ede7f97cd8 [term 2 FOLLOWER]: Refusing update from remote peer 2be4570f313d4a219ad149e28ab546c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:55:16.899478 17926 consensus_queue.cc:1048] T b5d16339e8c74f8aa5c9bef2ed4ef1c6 P 2be4570f313d4a219ad149e28ab546c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 14:55:16.910566 17628 raft_consensus.cc:1275] T b5d16339e8c74f8aa5c9bef2ed4ef1c6 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 2 FOLLOWER]: Refusing update from remote peer 2be4570f313d4a219ad149e28ab546c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:55:16.913631 17926 consensus_queue.cc:1048] T b5d16339e8c74f8aa5c9bef2ed4ef1c6 P 2be4570f313d4a219ad149e28ab546c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 14:55:16.917922 17628 raft_consensus.cc:1275] T d778ef6fbde3497389223b362f88a26a P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 2 FOLLOWER]: Refusing update from remote peer 3f9e4abf970849caa70a02ede7f97cd8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:55:16.920600 17837 consensus_queue.cc:1048] T d778ef6fbde3497389223b362f88a26a P 3f9e4abf970849caa70a02ede7f97cd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 14:55:16.932140 17702 raft_consensus.cc:1275] T ac091812917c4fa0a02bdc0d9984206d P 3f9e4abf970849caa70a02ede7f97cd8 [term 2 FOLLOWER]: Refusing update from remote peer 450b7f1304cb4c2ca4c9ccf62afb6937: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:55:16.934516 17872 consensus_queue.cc:1048] T ac091812917c4fa0a02bdc0d9984206d P 450b7f1304cb4c2ca4c9ccf62afb6937 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 14:55:16.936838 17553 raft_consensus.cc:1275] T d778ef6fbde3497389223b362f88a26a P 2be4570f313d4a219ad149e28ab546c5 [term 2 FOLLOWER]: Refusing update from remote peer 3f9e4abf970849caa70a02ede7f97cd8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:55:16.942587 17837 consensus_queue.cc:1048] T d778ef6fbde3497389223b362f88a26a P 3f9e4abf970849caa70a02ede7f97cd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 14:55:16.952216 17551 raft_consensus.cc:1275] T ac091812917c4fa0a02bdc0d9984206d P 2be4570f313d4a219ad149e28ab546c5 [term 2 FOLLOWER]: Refusing update from remote peer 450b7f1304cb4c2ca4c9ccf62afb6937: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:55:16.954308 17872 consensus_queue.cc:1048] T ac091812917c4fa0a02bdc0d9984206d P 450b7f1304cb4c2ca4c9ccf62afb6937 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 14:55:17.138412 17702 raft_consensus.cc:1275] T bdbd06b81c1f4dddbfd9a9f52f3f90c2 P 3f9e4abf970849caa70a02ede7f97cd8 [term 2 FOLLOWER]: Refusing update from remote peer 2be4570f313d4a219ad149e28ab546c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:55:17.140475 17839 consensus_queue.cc:1048] T bdbd06b81c1f4dddbfd9a9f52f3f90c2 P 2be4570f313d4a219ad149e28ab546c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 14:55:17.154104 17627 raft_consensus.cc:1275] T bdbd06b81c1f4dddbfd9a9f52f3f90c2 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 2 FOLLOWER]: Refusing update from remote peer 2be4570f313d4a219ad149e28ab546c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:55:17.156093 17839 consensus_queue.cc:1048] T bdbd06b81c1f4dddbfd9a9f52f3f90c2 P 2be4570f313d4a219ad149e28ab546c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 14:55:17.271345 17702 raft_consensus.cc:1275] T 22cb1b4f8c5f457b9f5661dd2d0e208d P 3f9e4abf970849caa70a02ede7f97cd8 [term 2 FOLLOWER]: Refusing update from remote peer 2be4570f313d4a219ad149e28ab546c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:55:17.273345 17906 consensus_queue.cc:1048] T 22cb1b4f8c5f457b9f5661dd2d0e208d P 2be4570f313d4a219ad149e28ab546c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 14:55:17.285508 17627 raft_consensus.cc:1275] T 22cb1b4f8c5f457b9f5661dd2d0e208d P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 2 FOLLOWER]: Refusing update from remote peer 2be4570f313d4a219ad149e28ab546c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:55:17.287822 17906 consensus_queue.cc:1048] T 22cb1b4f8c5f457b9f5661dd2d0e208d P 2be4570f313d4a219ad149e28ab546c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 14:55:19.298292 17447 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33274:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 14:55:19.320122 17447 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33274:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 14:55:19.393405  6549 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
W20260709 14:55:19.553812 17518 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:42489, user_credentials={real_user=slave}} blocked reactor thread for 69097.5us
W20260709 14:55:19.552632 17967 log.cc:927] Time spent T 22cb1b4f8c5f457b9f5661dd2d0e208d P 450b7f1304cb4c2ca4c9ccf62afb6937: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
W20260709 14:55:19.575444 17965 log.cc:927] Time spent T 947a22f76d864a6dbbb88eb7f085fe17 P 450b7f1304cb4c2ca4c9ccf62afb6937: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
W20260709 14:55:19.577505 17966 log.cc:927] Time spent T d778ef6fbde3497389223b362f88a26a P 3f9e4abf970849caa70a02ede7f97cd8: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
I20260709 14:55:19.592108 17985 tablet.cc:1724] T 22cb1b4f8c5f457b9f5661dd2d0e208d P 2be4570f313d4a219ad149e28ab546c5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 14:55:19.643781 17987 tablet.cc:1724] T 947a22f76d864a6dbbb88eb7f085fe17 P 2be4570f313d4a219ad149e28ab546c5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 14:55:19.662060 17593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:42489, user_credentials={real_user=slave}} blocked reactor thread for 57803.5us
I20260709 14:55:19.740057 17995 tablet.cc:1724] T 22cb1b4f8c5f457b9f5661dd2d0e208d P 3f9e4abf970849caa70a02ede7f97cd8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 14:55:19.714864 17990 tablet.cc:1724] T d778ef6fbde3497389223b362f88a26a P 3f9e4abf970849caa70a02ede7f97cd8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 14:55:19.777710 17997 tablet.cc:1724] T 947a22f76d864a6dbbb88eb7f085fe17 P 3f9e4abf970849caa70a02ede7f97cd8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 14:55:19.799700 17579 tablet_mm_ops.cc:139] Rowset compaction is disabled (check --enable_rowset_compaction and disable_compaction in extra_config for tablet:22cb1b4f8c5f457b9f5661dd2d0e208d)
I20260709 14:55:19.872180 17549 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "22cb1b4f8c5f457b9f5661dd2d0e208d"
dest_uuid: "2be4570f313d4a219ad149e28ab546c5"
mode: GRACEFUL
new_leader_uuid: "3f9e4abf970849caa70a02ede7f97cd8"
 from {username='slave'} at 127.0.0.1:45290
I20260709 14:55:19.815531 17999 tablet.cc:1724] T 947a22f76d864a6dbbb88eb7f085fe17 P 450b7f1304cb4c2ca4c9ccf62afb6937: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 14:55:19.883656 18003 tablet.cc:1724] T d778ef6fbde3497389223b362f88a26a P 450b7f1304cb4c2ca4c9ccf62afb6937: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 14:55:19.886592 17987 tablet.cc:1724] T b5d16339e8c74f8aa5c9bef2ed4ef1c6 P 2be4570f313d4a219ad149e28ab546c5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 14:55:19.887738 18007 tablet.cc:1724] T bdbd06b81c1f4dddbfd9a9f52f3f90c2 P 2be4570f313d4a219ad149e28ab546c5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 14:55:19.889786 17593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:42489, user_credentials={real_user=slave}} blocked reactor thread for 206244us
W20260709 14:55:19.894083 17579 tablet_mm_ops.cc:304] Major delta compaction is disabled (check --enable_major_delta_compaction and disable_compaction in extra_config for tablet:22cb1b4f8c5f457b9f5661dd2d0e208d)
I20260709 14:55:19.895128 17985 tablet.cc:1724] T d778ef6fbde3497389223b362f88a26a P 2be4570f313d4a219ad149e28ab546c5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 14:55:19.900322 17591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:43507, user_credentials={real_user=slave}} blocked reactor thread for 143989us
I20260709 14:55:19.901302 17995 tablet.cc:1724] T b5d16339e8c74f8aa5c9bef2ed4ef1c6 P 3f9e4abf970849caa70a02ede7f97cd8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 14:55:19.892889 17549 raft_consensus.cc:606] T 22cb1b4f8c5f457b9f5661dd2d0e208d P 2be4570f313d4a219ad149e28ab546c5 [term 2 LEADER]: Received request to transfer leadership to TS 3f9e4abf970849caa70a02ede7f97cd8
W20260709 14:55:19.913592 17728 tablet_mm_ops.cc:220] Minor delta compaction is disabled (check --enable_minor_delta_compaction and disable_compaction in extra_config for tablet:22cb1b4f8c5f457b9f5661dd2d0e208d)
I20260709 14:55:19.921975 18010 tablet.cc:1724] T 22cb1b4f8c5f457b9f5661dd2d0e208d P 450b7f1304cb4c2ca4c9ccf62afb6937: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 14:55:19.945698 17995 tablet.cc:1724] T bdbd06b81c1f4dddbfd9a9f52f3f90c2 P 3f9e4abf970849caa70a02ede7f97cd8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 14:55:19.954595 18003 tablet.cc:1724] T b5d16339e8c74f8aa5c9bef2ed4ef1c6 P 450b7f1304cb4c2ca4c9ccf62afb6937: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 14:55:19.961381 18010 tablet.cc:1724] T ac091812917c4fa0a02bdc0d9984206d P 450b7f1304cb4c2ca4c9ccf62afb6937: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 14:55:19.976435 17449 catalog_manager.cc:5789] TS 450b7f1304cb4c2ca4c9ccf62afb6937 (127.6.101.66:35877) does not have the latest schema for tablet ac091812917c4fa0a02bdc0d9984206d (table soft_deleted_table [id=e47f68bf5da0475b8ec262d0b5aa974e]). Expected version 1 got 0
I20260709 14:55:19.977700 17449 catalog_manager.cc:5789] TS 450b7f1304cb4c2ca4c9ccf62afb6937 (127.6.101.66:35877) does not have the latest schema for tablet b56c5a30e63c401cbfb713fd3a859194 (table soft_deleted_table [id=e47f68bf5da0475b8ec262d0b5aa974e]). Expected version 1 got 0
I20260709 14:55:19.980516 17449 catalog_manager.cc:5789] TS 450b7f1304cb4c2ca4c9ccf62afb6937 (127.6.101.66:35877) does not have the latest schema for tablet bba029f9d36e45249ae3b3699bebed9b (table soft_deleted_table [id=e47f68bf5da0475b8ec262d0b5aa974e]). Expected version 1 got 0
I20260709 14:55:19.987182 18009 tablet.cc:1724] T bba029f9d36e45249ae3b3699bebed9b P 450b7f1304cb4c2ca4c9ccf62afb6937: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 14:55:19.988807 17990 tablet.cc:1724] T ac091812917c4fa0a02bdc0d9984206d P 3f9e4abf970849caa70a02ede7f97cd8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 14:55:19.994267 17449 catalog_manager.cc:5789] TS 450b7f1304cb4c2ca4c9ccf62afb6937 (127.6.101.66:35877) does not have the latest schema for tablet 9bc3dcde63fb4f438cb12b4e64ee2d30 (table soft_deleted_table [id=e47f68bf5da0475b8ec262d0b5aa974e]). Expected version 1 got 0
I20260709 14:55:19.996117 17995 tablet.cc:1724] T b56c5a30e63c401cbfb713fd3a859194 P 3f9e4abf970849caa70a02ede7f97cd8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 14:55:20.011984 18011 tablet.cc:1724] T bba029f9d36e45249ae3b3699bebed9b P 3f9e4abf970849caa70a02ede7f97cd8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 14:55:20.031147 17987 tablet.cc:1724] T b56c5a30e63c401cbfb713fd3a859194 P 2be4570f313d4a219ad149e28ab546c5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 14:55:20.034897 18012 tablet.cc:1724] T ac091812917c4fa0a02bdc0d9984206d P 2be4570f313d4a219ad149e28ab546c5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 14:55:20.044267 17997 tablet.cc:1724] T 9bc3dcde63fb4f438cb12b4e64ee2d30 P 3f9e4abf970849caa70a02ede7f97cd8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 14:55:20.034610 17999 tablet.cc:1724] T 9bc3dcde63fb4f438cb12b4e64ee2d30 P 450b7f1304cb4c2ca4c9ccf62afb6937: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 14:55:20.066097 18007 tablet.cc:1724] T bba029f9d36e45249ae3b3699bebed9b P 2be4570f313d4a219ad149e28ab546c5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 14:55:20.072095 18003 tablet.cc:1724] T b56c5a30e63c401cbfb713fd3a859194 P 450b7f1304cb4c2ca4c9ccf62afb6937: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 14:55:20.077026 17626 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ac091812917c4fa0a02bdc0d9984206d"
dest_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937"
mode: GRACEFUL
new_leader_uuid: "3f9e4abf970849caa70a02ede7f97cd8"
 from {username='slave'} at 127.0.0.1:33848
I20260709 14:55:20.078289 17626 raft_consensus.cc:606] T ac091812917c4fa0a02bdc0d9984206d P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 2 LEADER]: Received request to transfer leadership to TS 3f9e4abf970849caa70a02ede7f97cd8
I20260709 14:55:20.078531 18009 tablet.cc:1724] T bdbd06b81c1f4dddbfd9a9f52f3f90c2 P 450b7f1304cb4c2ca4c9ccf62afb6937: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 14:55:20.080193  6549 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260709 14:55:20.081068  6549 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 14:55:20.103924 18007 tablet.cc:1724] T 9bc3dcde63fb4f438cb12b4e64ee2d30 P 2be4570f313d4a219ad149e28ab546c5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 14:55:20.109547 17549 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2e8e053361a54d7c91f2fe670f4aa514"
dest_uuid: "2be4570f313d4a219ad149e28ab546c5"
mode: GRACEFUL
new_leader_uuid: "3f9e4abf970849caa70a02ede7f97cd8"
 from {username='slave'} at 127.0.0.1:45290
I20260709 14:55:20.110453 17549 raft_consensus.cc:606] T 2e8e053361a54d7c91f2fe670f4aa514 P 2be4570f313d4a219ad149e28ab546c5 [term 2 LEADER]: Received request to transfer leadership to TS 3f9e4abf970849caa70a02ede7f97cd8
I20260709 14:55:20.115886 17626 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "876c059b51af47a9a687c1e92c95a515"
dest_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937"
mode: GRACEFUL
new_leader_uuid: "3f9e4abf970849caa70a02ede7f97cd8"
 from {username='slave'} at 127.0.0.1:33848
I20260709 14:55:20.116739 17626 raft_consensus.cc:606] T 876c059b51af47a9a687c1e92c95a515 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 2 LEADER]: Received request to transfer leadership to TS 3f9e4abf970849caa70a02ede7f97cd8
I20260709 14:55:20.121469  6549 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 14:55:20.122332  6549 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 14:55:20.131204 17982 raft_consensus.cc:993] T 22cb1b4f8c5f457b9f5661dd2d0e208d P 2be4570f313d4a219ad149e28ab546c5: : Instructing follower 3f9e4abf970849caa70a02ede7f97cd8 to start an election
I20260709 14:55:20.132074 17976 raft_consensus.cc:1081] T 22cb1b4f8c5f457b9f5661dd2d0e208d P 2be4570f313d4a219ad149e28ab546c5 [term 2 LEADER]: Signalling peer 3f9e4abf970849caa70a02ede7f97cd8 to start an election
I20260709 14:55:20.134783 17701 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "22cb1b4f8c5f457b9f5661dd2d0e208d"
dest_uuid: "3f9e4abf970849caa70a02ede7f97cd8"
 from {username='slave'} at 127.0.0.1:35860
I20260709 14:55:20.135494 17701 raft_consensus.cc:493] T 22cb1b4f8c5f457b9f5661dd2d0e208d P 3f9e4abf970849caa70a02ede7f97cd8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:55:20.135885 17701 raft_consensus.cc:3060] T 22cb1b4f8c5f457b9f5661dd2d0e208d P 3f9e4abf970849caa70a02ede7f97cd8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:55:20.143137 17448 catalog_manager.cc:6242] T 00000000000000000000000000000000 P a42a4a4a6b5b40539d164bf0216d7432: soft_deleted_table [id=e47f68bf5da0475b8ec262d0b5aa974e] alter complete (version 1)
I20260709 14:55:20.144761 17701 raft_consensus.cc:515] T 22cb1b4f8c5f457b9f5661dd2d0e208d P 3f9e4abf970849caa70a02ede7f97cd8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:20.147694 17701 leader_election.cc:290] T 22cb1b4f8c5f457b9f5661dd2d0e208d P 3f9e4abf970849caa70a02ede7f97cd8 [CANDIDATE]: Term 3 election: Requested vote from peers 2be4570f313d4a219ad149e28ab546c5 (127.6.101.65:43507), 450b7f1304cb4c2ca4c9ccf62afb6937 (127.6.101.66:35877)
I20260709 14:55:20.148754 17549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22cb1b4f8c5f457b9f5661dd2d0e208d" candidate_uuid: "3f9e4abf970849caa70a02ede7f97cd8" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "2be4570f313d4a219ad149e28ab546c5"
I20260709 14:55:20.149523 17549 raft_consensus.cc:3055] T 22cb1b4f8c5f457b9f5661dd2d0e208d P 2be4570f313d4a219ad149e28ab546c5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 14:55:20.149590 17626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22cb1b4f8c5f457b9f5661dd2d0e208d" candidate_uuid: "3f9e4abf970849caa70a02ede7f97cd8" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937"
I20260709 14:55:20.149953 17549 raft_consensus.cc:740] T 22cb1b4f8c5f457b9f5661dd2d0e208d P 2be4570f313d4a219ad149e28ab546c5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2be4570f313d4a219ad149e28ab546c5, State: Running, Role: LEADER
I20260709 14:55:20.150393 17626 raft_consensus.cc:3060] T 22cb1b4f8c5f457b9f5661dd2d0e208d P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:55:20.150888 17549 consensus_queue.cc:260] T 22cb1b4f8c5f457b9f5661dd2d0e208d P 2be4570f313d4a219ad149e28ab546c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:20.152248 17549 raft_consensus.cc:3060] T 22cb1b4f8c5f457b9f5661dd2d0e208d P 2be4570f313d4a219ad149e28ab546c5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:55:20.162714 17549 raft_consensus.cc:2468] T 22cb1b4f8c5f457b9f5661dd2d0e208d P 2be4570f313d4a219ad149e28ab546c5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f9e4abf970849caa70a02ede7f97cd8 in term 3.
I20260709 14:55:20.164037 17665 leader_election.cc:304] T 22cb1b4f8c5f457b9f5661dd2d0e208d P 3f9e4abf970849caa70a02ede7f97cd8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2be4570f313d4a219ad149e28ab546c5, 3f9e4abf970849caa70a02ede7f97cd8; no voters: 
I20260709 14:55:20.165089 18005 raft_consensus.cc:2804] T 22cb1b4f8c5f457b9f5661dd2d0e208d P 3f9e4abf970849caa70a02ede7f97cd8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 14:55:20.165202 17626 raft_consensus.cc:2468] T 22cb1b4f8c5f457b9f5661dd2d0e208d P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f9e4abf970849caa70a02ede7f97cd8 in term 3.
I20260709 14:55:20.165709 18005 raft_consensus.cc:697] T 22cb1b4f8c5f457b9f5661dd2d0e208d P 3f9e4abf970849caa70a02ede7f97cd8 [term 3 LEADER]: Becoming Leader. State: Replica: 3f9e4abf970849caa70a02ede7f97cd8, State: Running, Role: LEADER
I20260709 14:55:20.166683 18005 consensus_queue.cc:237] T 22cb1b4f8c5f457b9f5661dd2d0e208d P 3f9e4abf970849caa70a02ede7f97cd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:20.174702 17447 catalog_manager.cc:5697] T 22cb1b4f8c5f457b9f5661dd2d0e208d P 3f9e4abf970849caa70a02ede7f97cd8 reported cstate change: term changed from 2 to 3, leader changed from 2be4570f313d4a219ad149e28ab546c5 (127.6.101.65) to 3f9e4abf970849caa70a02ede7f97cd8 (127.6.101.67). New cstate: current_term: 3 leader_uuid: "3f9e4abf970849caa70a02ede7f97cd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } health_report { overall_health: HEALTHY } } }
I20260709 14:55:20.300248 17964 raft_consensus.cc:993] T 876c059b51af47a9a687c1e92c95a515 P 450b7f1304cb4c2ca4c9ccf62afb6937: : Instructing follower 3f9e4abf970849caa70a02ede7f97cd8 to start an election
I20260709 14:55:20.300872 17971 raft_consensus.cc:1081] T 876c059b51af47a9a687c1e92c95a515 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 2 LEADER]: Signalling peer 3f9e4abf970849caa70a02ede7f97cd8 to start an election
I20260709 14:55:20.302783 17701 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "876c059b51af47a9a687c1e92c95a515"
dest_uuid: "3f9e4abf970849caa70a02ede7f97cd8"
 from {username='slave'} at 127.0.0.1:35854
I20260709 14:55:20.303246 17701 raft_consensus.cc:493] T 876c059b51af47a9a687c1e92c95a515 P 3f9e4abf970849caa70a02ede7f97cd8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:55:20.303596 17701 raft_consensus.cc:3060] T 876c059b51af47a9a687c1e92c95a515 P 3f9e4abf970849caa70a02ede7f97cd8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:55:20.311280 17701 raft_consensus.cc:515] T 876c059b51af47a9a687c1e92c95a515 P 3f9e4abf970849caa70a02ede7f97cd8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:20.313905 17701 leader_election.cc:290] T 876c059b51af47a9a687c1e92c95a515 P 3f9e4abf970849caa70a02ede7f97cd8 [CANDIDATE]: Term 3 election: Requested vote from peers 2be4570f313d4a219ad149e28ab546c5 (127.6.101.65:43507), 450b7f1304cb4c2ca4c9ccf62afb6937 (127.6.101.66:35877)
I20260709 14:55:20.314858 17549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "876c059b51af47a9a687c1e92c95a515" candidate_uuid: "3f9e4abf970849caa70a02ede7f97cd8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2be4570f313d4a219ad149e28ab546c5"
I20260709 14:55:20.315114 17626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "876c059b51af47a9a687c1e92c95a515" candidate_uuid: "3f9e4abf970849caa70a02ede7f97cd8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937"
I20260709 14:55:20.315876 17549 raft_consensus.cc:3060] T 876c059b51af47a9a687c1e92c95a515 P 2be4570f313d4a219ad149e28ab546c5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:55:20.315915 17626 raft_consensus.cc:3055] T 876c059b51af47a9a687c1e92c95a515 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 14:55:20.316483 17626 raft_consensus.cc:740] T 876c059b51af47a9a687c1e92c95a515 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 450b7f1304cb4c2ca4c9ccf62afb6937, State: Running, Role: LEADER
I20260709 14:55:20.317529 17626 consensus_queue.cc:260] T 876c059b51af47a9a687c1e92c95a515 P 450b7f1304cb4c2ca4c9ccf62afb6937 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:20.319178 17626 raft_consensus.cc:3060] T 876c059b51af47a9a687c1e92c95a515 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:55:20.326514 17549 raft_consensus.cc:2468] T 876c059b51af47a9a687c1e92c95a515 P 2be4570f313d4a219ad149e28ab546c5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f9e4abf970849caa70a02ede7f97cd8 in term 3.
I20260709 14:55:20.328369 17665 leader_election.cc:304] T 876c059b51af47a9a687c1e92c95a515 P 3f9e4abf970849caa70a02ede7f97cd8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2be4570f313d4a219ad149e28ab546c5, 3f9e4abf970849caa70a02ede7f97cd8; no voters: 
I20260709 14:55:20.328965 17626 raft_consensus.cc:2468] T 876c059b51af47a9a687c1e92c95a515 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f9e4abf970849caa70a02ede7f97cd8 in term 3.
I20260709 14:55:20.329495 18005 raft_consensus.cc:2804] T 876c059b51af47a9a687c1e92c95a515 P 3f9e4abf970849caa70a02ede7f97cd8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 14:55:20.330065 18005 raft_consensus.cc:697] T 876c059b51af47a9a687c1e92c95a515 P 3f9e4abf970849caa70a02ede7f97cd8 [term 3 LEADER]: Becoming Leader. State: Replica: 3f9e4abf970849caa70a02ede7f97cd8, State: Running, Role: LEADER
I20260709 14:55:20.330890 18005 consensus_queue.cc:237] T 876c059b51af47a9a687c1e92c95a515 P 3f9e4abf970849caa70a02ede7f97cd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:20.340620 17447 catalog_manager.cc:5697] T 876c059b51af47a9a687c1e92c95a515 P 3f9e4abf970849caa70a02ede7f97cd8 reported cstate change: term changed from 2 to 3, leader changed from 450b7f1304cb4c2ca4c9ccf62afb6937 (127.6.101.66) to 3f9e4abf970849caa70a02ede7f97cd8 (127.6.101.67). New cstate: current_term: 3 leader_uuid: "3f9e4abf970849caa70a02ede7f97cd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } health_report { overall_health: HEALTHY } } }
I20260709 14:55:20.353010 17964 raft_consensus.cc:993] T ac091812917c4fa0a02bdc0d9984206d P 450b7f1304cb4c2ca4c9ccf62afb6937: : Instructing follower 3f9e4abf970849caa70a02ede7f97cd8 to start an election
I20260709 14:55:20.353880 17971 raft_consensus.cc:1081] T ac091812917c4fa0a02bdc0d9984206d P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 2 LEADER]: Signalling peer 3f9e4abf970849caa70a02ede7f97cd8 to start an election
I20260709 14:55:20.356336 17701 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ac091812917c4fa0a02bdc0d9984206d"
dest_uuid: "3f9e4abf970849caa70a02ede7f97cd8"
 from {username='slave'} at 127.0.0.1:35854
I20260709 14:55:20.357046 17701 raft_consensus.cc:493] T ac091812917c4fa0a02bdc0d9984206d P 3f9e4abf970849caa70a02ede7f97cd8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:55:20.357409 17701 raft_consensus.cc:3060] T ac091812917c4fa0a02bdc0d9984206d P 3f9e4abf970849caa70a02ede7f97cd8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:55:20.364400 17701 raft_consensus.cc:515] T ac091812917c4fa0a02bdc0d9984206d P 3f9e4abf970849caa70a02ede7f97cd8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:20.367254 17701 leader_election.cc:290] T ac091812917c4fa0a02bdc0d9984206d P 3f9e4abf970849caa70a02ede7f97cd8 [CANDIDATE]: Term 3 election: Requested vote from peers 2be4570f313d4a219ad149e28ab546c5 (127.6.101.65:43507), 450b7f1304cb4c2ca4c9ccf62afb6937 (127.6.101.66:35877)
I20260709 14:55:20.367664 17553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac091812917c4fa0a02bdc0d9984206d" candidate_uuid: "3f9e4abf970849caa70a02ede7f97cd8" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "2be4570f313d4a219ad149e28ab546c5"
I20260709 14:55:20.368438 17553 raft_consensus.cc:3060] T ac091812917c4fa0a02bdc0d9984206d P 2be4570f313d4a219ad149e28ab546c5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:55:20.369793 17626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac091812917c4fa0a02bdc0d9984206d" candidate_uuid: "3f9e4abf970849caa70a02ede7f97cd8" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937"
I20260709 14:55:20.370709 17626 raft_consensus.cc:3055] T ac091812917c4fa0a02bdc0d9984206d P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 14:55:20.371066 17626 raft_consensus.cc:740] T ac091812917c4fa0a02bdc0d9984206d P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 450b7f1304cb4c2ca4c9ccf62afb6937, State: Running, Role: LEADER
I20260709 14:55:20.372042 17626 consensus_queue.cc:260] T ac091812917c4fa0a02bdc0d9984206d P 450b7f1304cb4c2ca4c9ccf62afb6937 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:20.374068 17626 raft_consensus.cc:3060] T ac091812917c4fa0a02bdc0d9984206d P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:55:20.378855 17553 raft_consensus.cc:2468] T ac091812917c4fa0a02bdc0d9984206d P 2be4570f313d4a219ad149e28ab546c5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f9e4abf970849caa70a02ede7f97cd8 in term 3.
I20260709 14:55:20.380095 17665 leader_election.cc:304] T ac091812917c4fa0a02bdc0d9984206d P 3f9e4abf970849caa70a02ede7f97cd8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2be4570f313d4a219ad149e28ab546c5, 3f9e4abf970849caa70a02ede7f97cd8; no voters: 
I20260709 14:55:20.381487 18005 raft_consensus.cc:2804] T ac091812917c4fa0a02bdc0d9984206d P 3f9e4abf970849caa70a02ede7f97cd8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 14:55:20.382119 18005 raft_consensus.cc:697] T ac091812917c4fa0a02bdc0d9984206d P 3f9e4abf970849caa70a02ede7f97cd8 [term 3 LEADER]: Becoming Leader. State: Replica: 3f9e4abf970849caa70a02ede7f97cd8, State: Running, Role: LEADER
I20260709 14:55:20.383085 18005 consensus_queue.cc:237] T ac091812917c4fa0a02bdc0d9984206d P 3f9e4abf970849caa70a02ede7f97cd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:20.383669 17626 raft_consensus.cc:2468] T ac091812917c4fa0a02bdc0d9984206d P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f9e4abf970849caa70a02ede7f97cd8 in term 3.
I20260709 14:55:20.392797 17447 catalog_manager.cc:5697] T ac091812917c4fa0a02bdc0d9984206d P 3f9e4abf970849caa70a02ede7f97cd8 reported cstate change: term changed from 2 to 3, leader changed from 450b7f1304cb4c2ca4c9ccf62afb6937 (127.6.101.66) to 3f9e4abf970849caa70a02ede7f97cd8 (127.6.101.67). New cstate: current_term: 3 leader_uuid: "3f9e4abf970849caa70a02ede7f97cd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } health_report { overall_health: HEALTHY } } }
I20260709 14:55:20.541792 17976 raft_consensus.cc:993] T 2e8e053361a54d7c91f2fe670f4aa514 P 2be4570f313d4a219ad149e28ab546c5: : Instructing follower 3f9e4abf970849caa70a02ede7f97cd8 to start an election
I20260709 14:55:20.542323 17982 raft_consensus.cc:1081] T 2e8e053361a54d7c91f2fe670f4aa514 P 2be4570f313d4a219ad149e28ab546c5 [term 2 LEADER]: Signalling peer 3f9e4abf970849caa70a02ede7f97cd8 to start an election
I20260709 14:55:20.544407 17701 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2e8e053361a54d7c91f2fe670f4aa514"
dest_uuid: "3f9e4abf970849caa70a02ede7f97cd8"
 from {username='slave'} at 127.0.0.1:35860
I20260709 14:55:20.544972 17701 raft_consensus.cc:493] T 2e8e053361a54d7c91f2fe670f4aa514 P 3f9e4abf970849caa70a02ede7f97cd8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:55:20.545274 17701 raft_consensus.cc:3060] T 2e8e053361a54d7c91f2fe670f4aa514 P 3f9e4abf970849caa70a02ede7f97cd8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:55:20.551183 17701 raft_consensus.cc:515] T 2e8e053361a54d7c91f2fe670f4aa514 P 3f9e4abf970849caa70a02ede7f97cd8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:20.553174 17701 leader_election.cc:290] T 2e8e053361a54d7c91f2fe670f4aa514 P 3f9e4abf970849caa70a02ede7f97cd8 [CANDIDATE]: Term 3 election: Requested vote from peers 2be4570f313d4a219ad149e28ab546c5 (127.6.101.65:43507), 450b7f1304cb4c2ca4c9ccf62afb6937 (127.6.101.66:35877)
I20260709 14:55:20.554121 17553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e8e053361a54d7c91f2fe670f4aa514" candidate_uuid: "3f9e4abf970849caa70a02ede7f97cd8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2be4570f313d4a219ad149e28ab546c5"
I20260709 14:55:20.554261 17626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e8e053361a54d7c91f2fe670f4aa514" candidate_uuid: "3f9e4abf970849caa70a02ede7f97cd8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937"
I20260709 14:55:20.554827 17553 raft_consensus.cc:3055] T 2e8e053361a54d7c91f2fe670f4aa514 P 2be4570f313d4a219ad149e28ab546c5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 14:55:20.555058 17626 raft_consensus.cc:3060] T 2e8e053361a54d7c91f2fe670f4aa514 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:55:20.555119 17553 raft_consensus.cc:740] T 2e8e053361a54d7c91f2fe670f4aa514 P 2be4570f313d4a219ad149e28ab546c5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2be4570f313d4a219ad149e28ab546c5, State: Running, Role: LEADER
I20260709 14:55:20.556348 17553 consensus_queue.cc:260] T 2e8e053361a54d7c91f2fe670f4aa514 P 2be4570f313d4a219ad149e28ab546c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:20.557435 17553 raft_consensus.cc:3060] T 2e8e053361a54d7c91f2fe670f4aa514 P 2be4570f313d4a219ad149e28ab546c5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:55:20.561825 17626 raft_consensus.cc:2468] T 2e8e053361a54d7c91f2fe670f4aa514 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f9e4abf970849caa70a02ede7f97cd8 in term 3.
I20260709 14:55:20.563262 17667 leader_election.cc:304] T 2e8e053361a54d7c91f2fe670f4aa514 P 3f9e4abf970849caa70a02ede7f97cd8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f9e4abf970849caa70a02ede7f97cd8, 450b7f1304cb4c2ca4c9ccf62afb6937; no voters: 
I20260709 14:55:20.564270 18005 raft_consensus.cc:2804] T 2e8e053361a54d7c91f2fe670f4aa514 P 3f9e4abf970849caa70a02ede7f97cd8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 14:55:20.565129 17553 raft_consensus.cc:2468] T 2e8e053361a54d7c91f2fe670f4aa514 P 2be4570f313d4a219ad149e28ab546c5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f9e4abf970849caa70a02ede7f97cd8 in term 3.
I20260709 14:55:20.564853 18005 raft_consensus.cc:697] T 2e8e053361a54d7c91f2fe670f4aa514 P 3f9e4abf970849caa70a02ede7f97cd8 [term 3 LEADER]: Becoming Leader. State: Replica: 3f9e4abf970849caa70a02ede7f97cd8, State: Running, Role: LEADER
I20260709 14:55:20.566573 18005 consensus_queue.cc:237] T 2e8e053361a54d7c91f2fe670f4aa514 P 3f9e4abf970849caa70a02ede7f97cd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } }
I20260709 14:55:20.576419 17447 catalog_manager.cc:5697] T 2e8e053361a54d7c91f2fe670f4aa514 P 3f9e4abf970849caa70a02ede7f97cd8 reported cstate change: term changed from 2 to 3, leader changed from 2be4570f313d4a219ad149e28ab546c5 (127.6.101.65) to 3f9e4abf970849caa70a02ede7f97cd8 (127.6.101.67). New cstate: current_term: 3 leader_uuid: "3f9e4abf970849caa70a02ede7f97cd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f9e4abf970849caa70a02ede7f97cd8" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42489 } health_report { overall_health: HEALTHY } } }
I20260709 14:55:20.584960 17553 raft_consensus.cc:1275] T 22cb1b4f8c5f457b9f5661dd2d0e208d P 2be4570f313d4a219ad149e28ab546c5 [term 3 FOLLOWER]: Refusing update from remote peer 3f9e4abf970849caa70a02ede7f97cd8: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 14:55:20.586673 18005 consensus_queue.cc:1048] T 22cb1b4f8c5f457b9f5661dd2d0e208d P 3f9e4abf970849caa70a02ede7f97cd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 14:55:20.601210 17626 raft_consensus.cc:1275] T 22cb1b4f8c5f457b9f5661dd2d0e208d P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 3 FOLLOWER]: Refusing update from remote peer 3f9e4abf970849caa70a02ede7f97cd8: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 14:55:20.602896 18005 consensus_queue.cc:1048] T 22cb1b4f8c5f457b9f5661dd2d0e208d P 3f9e4abf970849caa70a02ede7f97cd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 14:55:20.814881 17553 raft_consensus.cc:1275] T ac091812917c4fa0a02bdc0d9984206d P 2be4570f313d4a219ad149e28ab546c5 [term 3 FOLLOWER]: Refusing update from remote peer 3f9e4abf970849caa70a02ede7f97cd8: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 14:55:20.816622 17994 consensus_queue.cc:1048] T ac091812917c4fa0a02bdc0d9984206d P 3f9e4abf970849caa70a02ede7f97cd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 14:55:20.825430 17626 raft_consensus.cc:1275] T ac091812917c4fa0a02bdc0d9984206d P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 3 FOLLOWER]: Refusing update from remote peer 3f9e4abf970849caa70a02ede7f97cd8: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 14:55:20.828447 18005 consensus_queue.cc:1048] T ac091812917c4fa0a02bdc0d9984206d P 3f9e4abf970849caa70a02ede7f97cd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 14:55:20.884428 17553 raft_consensus.cc:1275] T 876c059b51af47a9a687c1e92c95a515 P 2be4570f313d4a219ad149e28ab546c5 [term 3 FOLLOWER]: Refusing update from remote peer 3f9e4abf970849caa70a02ede7f97cd8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 14:55:20.885972 17994 consensus_queue.cc:1048] T 876c059b51af47a9a687c1e92c95a515 P 3f9e4abf970849caa70a02ede7f97cd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 14:55:20.898684 17627 raft_consensus.cc:1275] T 876c059b51af47a9a687c1e92c95a515 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 3 FOLLOWER]: Refusing update from remote peer 3f9e4abf970849caa70a02ede7f97cd8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 14:55:20.901113 18023 consensus_queue.cc:1048] T 876c059b51af47a9a687c1e92c95a515 P 3f9e4abf970849caa70a02ede7f97cd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 14:55:20.994411 17553 raft_consensus.cc:1275] T 2e8e053361a54d7c91f2fe670f4aa514 P 2be4570f313d4a219ad149e28ab546c5 [term 3 FOLLOWER]: Refusing update from remote peer 3f9e4abf970849caa70a02ede7f97cd8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 14:55:20.996075 18023 consensus_queue.cc:1048] T 2e8e053361a54d7c91f2fe670f4aa514 P 3f9e4abf970849caa70a02ede7f97cd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2be4570f313d4a219ad149e28ab546c5" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 43507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 14:55:21.006573 17626 raft_consensus.cc:1275] T 2e8e053361a54d7c91f2fe670f4aa514 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 3 FOLLOWER]: Refusing update from remote peer 3f9e4abf970849caa70a02ede7f97cd8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 14:55:21.008584 18005 consensus_queue.cc:1048] T 2e8e053361a54d7c91f2fe670f4aa514 P 3f9e4abf970849caa70a02ede7f97cd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "450b7f1304cb4c2ca4c9ccf62afb6937" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 35877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 14:55:21.219267  6549 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 14:55:21.225486  6549 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 14:55:21.226097  6549 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 14:55:21.231783  6549 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 14:55:21.232308  6549 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 14:55:22.271932  6549 tablet_server.cc:179] TabletServer@127.6.101.65:0 shutting down...
W20260709 14:55:22.293612 17591 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 8 similar messages]
W20260709 14:55:22.297493 17591 consensus_peers.cc:597] T 2ee76f3707314e23b707060672d77fdb P 450b7f1304cb4c2ca4c9ccf62afb6937 -> Peer 2be4570f313d4a219ad149e28ab546c5 (127.6.101.65:43507): Couldn't send request to peer 2be4570f313d4a219ad149e28ab546c5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:55:22.308342  6549 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 14:55:22.309415  6549 tablet_replica.cc:333] T d778ef6fbde3497389223b362f88a26a P 2be4570f313d4a219ad149e28ab546c5: stopping tablet replica
I20260709 14:55:22.310268  6549 raft_consensus.cc:2243] T d778ef6fbde3497389223b362f88a26a P 2be4570f313d4a219ad149e28ab546c5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 14:55:22.310819  6549 raft_consensus.cc:2272] T d778ef6fbde3497389223b362f88a26a P 2be4570f313d4a219ad149e28ab546c5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:22.313234  6549 tablet_replica.cc:333] T 947a22f76d864a6dbbb88eb7f085fe17 P 2be4570f313d4a219ad149e28ab546c5: stopping tablet replica
I20260709 14:55:22.313952  6549 raft_consensus.cc:2243] T 947a22f76d864a6dbbb88eb7f085fe17 P 2be4570f313d4a219ad149e28ab546c5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 14:55:22.314878  6549 raft_consensus.cc:2272] T 947a22f76d864a6dbbb88eb7f085fe17 P 2be4570f313d4a219ad149e28ab546c5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:22.317065  6549 tablet_replica.cc:333] T bdbd06b81c1f4dddbfd9a9f52f3f90c2 P 2be4570f313d4a219ad149e28ab546c5: stopping tablet replica
I20260709 14:55:22.317764  6549 raft_consensus.cc:2243] T bdbd06b81c1f4dddbfd9a9f52f3f90c2 P 2be4570f313d4a219ad149e28ab546c5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 14:55:22.318703  6549 raft_consensus.cc:2272] T bdbd06b81c1f4dddbfd9a9f52f3f90c2 P 2be4570f313d4a219ad149e28ab546c5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:22.320879  6549 tablet_replica.cc:333] T bba029f9d36e45249ae3b3699bebed9b P 2be4570f313d4a219ad149e28ab546c5: stopping tablet replica
I20260709 14:55:22.321569  6549 raft_consensus.cc:2243] T bba029f9d36e45249ae3b3699bebed9b P 2be4570f313d4a219ad149e28ab546c5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 14:55:22.322059  6549 raft_consensus.cc:2272] T bba029f9d36e45249ae3b3699bebed9b P 2be4570f313d4a219ad149e28ab546c5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:22.324084  6549 tablet_replica.cc:333] T 062ea10ecbd54055988e22c53a4387c5 P 2be4570f313d4a219ad149e28ab546c5: stopping tablet replica
I20260709 14:55:22.324683  6549 raft_consensus.cc:2243] T 062ea10ecbd54055988e22c53a4387c5 P 2be4570f313d4a219ad149e28ab546c5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 14:55:22.325333  6549 raft_consensus.cc:2272] T 062ea10ecbd54055988e22c53a4387c5 P 2be4570f313d4a219ad149e28ab546c5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:22.327694  6549 tablet_replica.cc:333] T 22cb1b4f8c5f457b9f5661dd2d0e208d P 2be4570f313d4a219ad149e28ab546c5: stopping tablet replica
I20260709 14:55:22.328307  6549 raft_consensus.cc:2243] T 22cb1b4f8c5f457b9f5661dd2d0e208d P 2be4570f313d4a219ad149e28ab546c5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 14:55:22.328753  6549 raft_consensus.cc:2272] T 22cb1b4f8c5f457b9f5661dd2d0e208d P 2be4570f313d4a219ad149e28ab546c5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:22.330850  6549 tablet_replica.cc:333] T c26e43514e564f9e906f938557e587e8 P 2be4570f313d4a219ad149e28ab546c5: stopping tablet replica
I20260709 14:55:22.331427  6549 raft_consensus.cc:2243] T c26e43514e564f9e906f938557e587e8 P 2be4570f313d4a219ad149e28ab546c5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 14:55:22.331938  6549 raft_consensus.cc:2272] T c26e43514e564f9e906f938557e587e8 P 2be4570f313d4a219ad149e28ab546c5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:22.335418  6549 tablet_replica.cc:333] T f9509b6f243644ed9e147299153953b2 P 2be4570f313d4a219ad149e28ab546c5: stopping tablet replica
I20260709 14:55:22.336268  6549 raft_consensus.cc:2243] T f9509b6f243644ed9e147299153953b2 P 2be4570f313d4a219ad149e28ab546c5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 14:55:22.337303  6549 raft_consensus.cc:2272] T f9509b6f243644ed9e147299153953b2 P 2be4570f313d4a219ad149e28ab546c5 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 14:55:22.337970 17591 consensus_peers.cc:597] T bba029f9d36e45249ae3b3699bebed9b P 450b7f1304cb4c2ca4c9ccf62afb6937 -> Peer 2be4570f313d4a219ad149e28ab546c5 (127.6.101.65:43507): Couldn't send request to peer 2be4570f313d4a219ad149e28ab546c5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:55:22.339744  6549 tablet_replica.cc:333] T 87215280bbb9434c86b8e0c862d78e44 P 2be4570f313d4a219ad149e28ab546c5: stopping tablet replica
I20260709 14:55:22.340409  6549 raft_consensus.cc:2243] T 87215280bbb9434c86b8e0c862d78e44 P 2be4570f313d4a219ad149e28ab546c5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 14:55:22.340840  6549 raft_consensus.cc:2272] T 87215280bbb9434c86b8e0c862d78e44 P 2be4570f313d4a219ad149e28ab546c5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:22.343057  6549 tablet_replica.cc:333] T ac091812917c4fa0a02bdc0d9984206d P 2be4570f313d4a219ad149e28ab546c5: stopping tablet replica
I20260709 14:55:22.343675  6549 raft_consensus.cc:2243] T ac091812917c4fa0a02bdc0d9984206d P 2be4570f313d4a219ad149e28ab546c5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 14:55:22.344126  6549 raft_consensus.cc:2272] T ac091812917c4fa0a02bdc0d9984206d P 2be4570f313d4a219ad149e28ab546c5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:22.346130  6549 tablet_replica.cc:333] T b5d16339e8c74f8aa5c9bef2ed4ef1c6 P 2be4570f313d4a219ad149e28ab546c5: stopping tablet replica
I20260709 14:55:22.346710  6549 raft_consensus.cc:2243] T b5d16339e8c74f8aa5c9bef2ed4ef1c6 P 2be4570f313d4a219ad149e28ab546c5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 14:55:22.347545  6549 raft_consensus.cc:2272] T b5d16339e8c74f8aa5c9bef2ed4ef1c6 P 2be4570f313d4a219ad149e28ab546c5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:22.349630  6549 tablet_replica.cc:333] T 9bc3dcde63fb4f438cb12b4e64ee2d30 P 2be4570f313d4a219ad149e28ab546c5: stopping tablet replica
I20260709 14:55:22.350201  6549 raft_consensus.cc:2243] T 9bc3dcde63fb4f438cb12b4e64ee2d30 P 2be4570f313d4a219ad149e28ab546c5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 14:55:22.350651  6549 raft_consensus.cc:2272] T 9bc3dcde63fb4f438cb12b4e64ee2d30 P 2be4570f313d4a219ad149e28ab546c5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:22.352778  6549 tablet_replica.cc:333] T 876c059b51af47a9a687c1e92c95a515 P 2be4570f313d4a219ad149e28ab546c5: stopping tablet replica
I20260709 14:55:22.353621  6549 raft_consensus.cc:2243] T 876c059b51af47a9a687c1e92c95a515 P 2be4570f313d4a219ad149e28ab546c5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 14:55:22.354143  6549 raft_consensus.cc:2272] T 876c059b51af47a9a687c1e92c95a515 P 2be4570f313d4a219ad149e28ab546c5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:22.357213  6549 tablet_replica.cc:333] T 2e8e053361a54d7c91f2fe670f4aa514 P 2be4570f313d4a219ad149e28ab546c5: stopping tablet replica
I20260709 14:55:22.357962  6549 raft_consensus.cc:2243] T 2e8e053361a54d7c91f2fe670f4aa514 P 2be4570f313d4a219ad149e28ab546c5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 14:55:22.358417  6549 raft_consensus.cc:2272] T 2e8e053361a54d7c91f2fe670f4aa514 P 2be4570f313d4a219ad149e28ab546c5 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 14:55:22.358721 17665 consensus_peers.cc:597] T 876c059b51af47a9a687c1e92c95a515 P 3f9e4abf970849caa70a02ede7f97cd8 -> Peer 2be4570f313d4a219ad149e28ab546c5 (127.6.101.65:43507): Couldn't send request to peer 2be4570f313d4a219ad149e28ab546c5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:55:22.360906  6549 tablet_replica.cc:333] T dde79436f56b4ce7805822a819a1d9bf P 2be4570f313d4a219ad149e28ab546c5: stopping tablet replica
I20260709 14:55:22.361861  6549 raft_consensus.cc:2243] T dde79436f56b4ce7805822a819a1d9bf P 2be4570f313d4a219ad149e28ab546c5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 14:55:22.362980  6549 raft_consensus.cc:2272] T dde79436f56b4ce7805822a819a1d9bf P 2be4570f313d4a219ad149e28ab546c5 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 14:55:22.365993 17591 consensus_peers.cc:597] T 87215280bbb9434c86b8e0c862d78e44 P 450b7f1304cb4c2ca4c9ccf62afb6937 -> Peer 2be4570f313d4a219ad149e28ab546c5 (127.6.101.65:43507): Couldn't send request to peer 2be4570f313d4a219ad149e28ab546c5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:55:22.366204  6549 tablet_replica.cc:333] T 2ee76f3707314e23b707060672d77fdb P 2be4570f313d4a219ad149e28ab546c5: stopping tablet replica
I20260709 14:55:22.367035  6549 raft_consensus.cc:2243] T 2ee76f3707314e23b707060672d77fdb P 2be4570f313d4a219ad149e28ab546c5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 14:55:22.367579  6549 raft_consensus.cc:2272] T 2ee76f3707314e23b707060672d77fdb P 2be4570f313d4a219ad149e28ab546c5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:22.370113  6549 tablet_replica.cc:333] T b56c5a30e63c401cbfb713fd3a859194 P 2be4570f313d4a219ad149e28ab546c5: stopping tablet replica
I20260709 14:55:22.370898  6549 raft_consensus.cc:2243] T b56c5a30e63c401cbfb713fd3a859194 P 2be4570f313d4a219ad149e28ab546c5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 14:55:22.371447  6549 raft_consensus.cc:2272] T b56c5a30e63c401cbfb713fd3a859194 P 2be4570f313d4a219ad149e28ab546c5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:22.374192  6549 tablet_replica.cc:333] T f9764d88fc354df8a8b107f95579fc60 P 2be4570f313d4a219ad149e28ab546c5: stopping tablet replica
I20260709 14:55:22.374821  6549 raft_consensus.cc:2243] T f9764d88fc354df8a8b107f95579fc60 P 2be4570f313d4a219ad149e28ab546c5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 14:55:22.375782  6549 raft_consensus.cc:2272] T f9764d88fc354df8a8b107f95579fc60 P 2be4570f313d4a219ad149e28ab546c5 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 14:55:22.384332 17665 consensus_peers.cc:597] T 2e8e053361a54d7c91f2fe670f4aa514 P 3f9e4abf970849caa70a02ede7f97cd8 -> Peer 2be4570f313d4a219ad149e28ab546c5 (127.6.101.65:43507): Couldn't send request to peer 2be4570f313d4a219ad149e28ab546c5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 14:55:22.390641 17591 consensus_peers.cc:597] T 062ea10ecbd54055988e22c53a4387c5 P 450b7f1304cb4c2ca4c9ccf62afb6937 -> Peer 2be4570f313d4a219ad149e28ab546c5 (127.6.101.65:43507): Couldn't send request to peer 2be4570f313d4a219ad149e28ab546c5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 14:55:22.417752 17591 consensus_peers.cc:597] T b56c5a30e63c401cbfb713fd3a859194 P 450b7f1304cb4c2ca4c9ccf62afb6937 -> Peer 2be4570f313d4a219ad149e28ab546c5 (127.6.101.65:43507): Couldn't send request to peer 2be4570f313d4a219ad149e28ab546c5. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:43507: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 14:55:22.423727  6549 tablet_server.cc:196] TabletServer@127.6.101.65:0 shutdown complete.
I20260709 14:55:22.461596  6549 tablet_server.cc:179] TabletServer@127.6.101.66:0 shutting down...
W20260709 14:55:22.482583 17665 consensus_peers.cc:597] T ac091812917c4fa0a02bdc0d9984206d P 3f9e4abf970849caa70a02ede7f97cd8 -> Peer 2be4570f313d4a219ad149e28ab546c5 (127.6.101.65:43507): Couldn't send request to peer 2be4570f313d4a219ad149e28ab546c5. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:43507: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 14:55:22.518319 17667 consensus_peers.cc:597] T d778ef6fbde3497389223b362f88a26a P 3f9e4abf970849caa70a02ede7f97cd8 -> Peer 450b7f1304cb4c2ca4c9ccf62afb6937 (127.6.101.66:35877): Couldn't send request to peer 450b7f1304cb4c2ca4c9ccf62afb6937. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:55:22.544288  6549 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 14:55:22.545758  6549 tablet_replica.cc:333] T 947a22f76d864a6dbbb88eb7f085fe17 P 450b7f1304cb4c2ca4c9ccf62afb6937: stopping tablet replica
I20260709 14:55:22.546679  6549 raft_consensus.cc:2243] T 947a22f76d864a6dbbb88eb7f085fe17 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 14:55:22.547326  6549 raft_consensus.cc:2272] T 947a22f76d864a6dbbb88eb7f085fe17 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:22.549712  6549 tablet_replica.cc:333] T d778ef6fbde3497389223b362f88a26a P 450b7f1304cb4c2ca4c9ccf62afb6937: stopping tablet replica
I20260709 14:55:22.550401  6549 raft_consensus.cc:2243] T d778ef6fbde3497389223b362f88a26a P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 14:55:22.550927  6549 raft_consensus.cc:2272] T d778ef6fbde3497389223b362f88a26a P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:22.553390  6549 tablet_replica.cc:333] T bdbd06b81c1f4dddbfd9a9f52f3f90c2 P 450b7f1304cb4c2ca4c9ccf62afb6937: stopping tablet replica
I20260709 14:55:22.554291  6549 raft_consensus.cc:2243] T bdbd06b81c1f4dddbfd9a9f52f3f90c2 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 14:55:22.554814  6549 raft_consensus.cc:2272] T bdbd06b81c1f4dddbfd9a9f52f3f90c2 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 14:55:22.557006 17667 consensus_peers.cc:597] T 2e8e053361a54d7c91f2fe670f4aa514 P 3f9e4abf970849caa70a02ede7f97cd8 -> Peer 450b7f1304cb4c2ca4c9ccf62afb6937 (127.6.101.66:35877): Couldn't send request to peer 450b7f1304cb4c2ca4c9ccf62afb6937. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:55:22.557401  6549 tablet_replica.cc:333] T bba029f9d36e45249ae3b3699bebed9b P 450b7f1304cb4c2ca4c9ccf62afb6937: stopping tablet replica
W20260709 14:55:22.557868 17667 consensus_peers.cc:597] T c26e43514e564f9e906f938557e587e8 P 3f9e4abf970849caa70a02ede7f97cd8 -> Peer 450b7f1304cb4c2ca4c9ccf62afb6937 (127.6.101.66:35877): Couldn't send request to peer 450b7f1304cb4c2ca4c9ccf62afb6937. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:55:22.558252  6549 raft_consensus.cc:2243] T bba029f9d36e45249ae3b3699bebed9b P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 2 LEADER]: Raft consensus shutting down.
I20260709 14:55:22.559247  6549 raft_consensus.cc:2272] T bba029f9d36e45249ae3b3699bebed9b P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:22.561581  6549 tablet_replica.cc:333] T 062ea10ecbd54055988e22c53a4387c5 P 450b7f1304cb4c2ca4c9ccf62afb6937: stopping tablet replica
I20260709 14:55:22.562304  6549 raft_consensus.cc:2243] T 062ea10ecbd54055988e22c53a4387c5 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 1 LEADER]: Raft consensus shutting down.
I20260709 14:55:22.563215  6549 raft_consensus.cc:2272] T 062ea10ecbd54055988e22c53a4387c5 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:22.565595  6549 tablet_replica.cc:333] T 22cb1b4f8c5f457b9f5661dd2d0e208d P 450b7f1304cb4c2ca4c9ccf62afb6937: stopping tablet replica
I20260709 14:55:22.566205  6549 raft_consensus.cc:2243] T 22cb1b4f8c5f457b9f5661dd2d0e208d P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 14:55:22.566659  6549 raft_consensus.cc:2272] T 22cb1b4f8c5f457b9f5661dd2d0e208d P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:22.568740  6549 tablet_replica.cc:333] T 87215280bbb9434c86b8e0c862d78e44 P 450b7f1304cb4c2ca4c9ccf62afb6937: stopping tablet replica
I20260709 14:55:22.569424  6549 raft_consensus.cc:2243] T 87215280bbb9434c86b8e0c862d78e44 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 1 LEADER]: Raft consensus shutting down.
I20260709 14:55:22.570355  6549 raft_consensus.cc:2272] T 87215280bbb9434c86b8e0c862d78e44 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:22.572832  6549 tablet_replica.cc:333] T f9509b6f243644ed9e147299153953b2 P 450b7f1304cb4c2ca4c9ccf62afb6937: stopping tablet replica
I20260709 14:55:22.573525  6549 raft_consensus.cc:2243] T f9509b6f243644ed9e147299153953b2 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 14:55:22.574038  6549 raft_consensus.cc:2272] T f9509b6f243644ed9e147299153953b2 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:22.576452  6549 tablet_replica.cc:333] T dde79436f56b4ce7805822a819a1d9bf P 450b7f1304cb4c2ca4c9ccf62afb6937: stopping tablet replica
I20260709 14:55:22.577055  6549 raft_consensus.cc:2243] T dde79436f56b4ce7805822a819a1d9bf P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 14:55:22.577593  6549 raft_consensus.cc:2272] T dde79436f56b4ce7805822a819a1d9bf P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:22.579944  6549 tablet_replica.cc:333] T b56c5a30e63c401cbfb713fd3a859194 P 450b7f1304cb4c2ca4c9ccf62afb6937: stopping tablet replica
I20260709 14:55:22.580547  6549 raft_consensus.cc:2243] T b56c5a30e63c401cbfb713fd3a859194 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 1 LEADER]: Raft consensus shutting down.
I20260709 14:55:22.581489  6549 raft_consensus.cc:2272] T b56c5a30e63c401cbfb713fd3a859194 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:22.583899  6549 tablet_replica.cc:333] T f9764d88fc354df8a8b107f95579fc60 P 450b7f1304cb4c2ca4c9ccf62afb6937: stopping tablet replica
I20260709 14:55:22.584578  6549 raft_consensus.cc:2243] T f9764d88fc354df8a8b107f95579fc60 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 14:55:22.585207  6549 raft_consensus.cc:2272] T f9764d88fc354df8a8b107f95579fc60 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:22.587982  6549 tablet_replica.cc:333] T ac091812917c4fa0a02bdc0d9984206d P 450b7f1304cb4c2ca4c9ccf62afb6937: stopping tablet replica
I20260709 14:55:22.588680  6549 raft_consensus.cc:2243] T ac091812917c4fa0a02bdc0d9984206d P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 14:55:22.589174  6549 raft_consensus.cc:2272] T ac091812917c4fa0a02bdc0d9984206d P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 14:55:22.589293 17665 consensus_peers.cc:597] T d778ef6fbde3497389223b362f88a26a P 3f9e4abf970849caa70a02ede7f97cd8 -> Peer 2be4570f313d4a219ad149e28ab546c5 (127.6.101.65:43507): Couldn't send request to peer 2be4570f313d4a219ad149e28ab546c5. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:43507: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 14:55:22.591710  6549 tablet_replica.cc:333] T 9bc3dcde63fb4f438cb12b4e64ee2d30 P 450b7f1304cb4c2ca4c9ccf62afb6937: stopping tablet replica
I20260709 14:55:22.592340  6549 raft_consensus.cc:2243] T 9bc3dcde63fb4f438cb12b4e64ee2d30 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 2 LEADER]: Raft consensus shutting down.
I20260709 14:55:22.593282  6549 raft_consensus.cc:2272] T 9bc3dcde63fb4f438cb12b4e64ee2d30 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:22.595773  6549 tablet_replica.cc:333] T b5d16339e8c74f8aa5c9bef2ed4ef1c6 P 450b7f1304cb4c2ca4c9ccf62afb6937: stopping tablet replica
I20260709 14:55:22.596426  6549 raft_consensus.cc:2243] T b5d16339e8c74f8aa5c9bef2ed4ef1c6 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 14:55:22.596909  6549 raft_consensus.cc:2272] T b5d16339e8c74f8aa5c9bef2ed4ef1c6 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:22.599119  6549 tablet_replica.cc:333] T 876c059b51af47a9a687c1e92c95a515 P 450b7f1304cb4c2ca4c9ccf62afb6937: stopping tablet replica
I20260709 14:55:22.599684  6549 raft_consensus.cc:2243] T 876c059b51af47a9a687c1e92c95a515 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 14:55:22.600116  6549 raft_consensus.cc:2272] T 876c059b51af47a9a687c1e92c95a515 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:22.602818  6549 tablet_replica.cc:333] T 2e8e053361a54d7c91f2fe670f4aa514 P 450b7f1304cb4c2ca4c9ccf62afb6937: stopping tablet replica
I20260709 14:55:22.603436  6549 raft_consensus.cc:2243] T 2e8e053361a54d7c91f2fe670f4aa514 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 14:55:22.603920  6549 raft_consensus.cc:2272] T 2e8e053361a54d7c91f2fe670f4aa514 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:22.606528  6549 tablet_replica.cc:333] T c26e43514e564f9e906f938557e587e8 P 450b7f1304cb4c2ca4c9ccf62afb6937: stopping tablet replica
I20260709 14:55:22.607205  6549 raft_consensus.cc:2243] T c26e43514e564f9e906f938557e587e8 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 14:55:22.607733  6549 raft_consensus.cc:2272] T c26e43514e564f9e906f938557e587e8 P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:22.610446  6549 tablet_replica.cc:333] T 2ee76f3707314e23b707060672d77fdb P 450b7f1304cb4c2ca4c9ccf62afb6937: stopping tablet replica
I20260709 14:55:22.611037  6549 raft_consensus.cc:2243] T 2ee76f3707314e23b707060672d77fdb P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 2 LEADER]: Raft consensus shutting down.
I20260709 14:55:22.612116  6549 raft_consensus.cc:2272] T 2ee76f3707314e23b707060672d77fdb P 450b7f1304cb4c2ca4c9ccf62afb6937 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:22.666688  6549 tablet_server.cc:196] TabletServer@127.6.101.66:0 shutdown complete.
W20260709 14:55:22.696622 17665 consensus_peers.cc:597] T c26e43514e564f9e906f938557e587e8 P 3f9e4abf970849caa70a02ede7f97cd8 -> Peer 2be4570f313d4a219ad149e28ab546c5 (127.6.101.65:43507): Couldn't send request to peer 2be4570f313d4a219ad149e28ab546c5. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:43507: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 14:55:22.707957  6549 tablet_server.cc:179] TabletServer@127.6.101.67:0 shutting down...
I20260709 14:55:22.746981  6549 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 14:55:22.747884  6549 tablet_replica.cc:333] T b56c5a30e63c401cbfb713fd3a859194 P 3f9e4abf970849caa70a02ede7f97cd8: stopping tablet replica
I20260709 14:55:22.748832  6549 raft_consensus.cc:2243] T b56c5a30e63c401cbfb713fd3a859194 P 3f9e4abf970849caa70a02ede7f97cd8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 14:55:22.749670  6549 raft_consensus.cc:2272] T b56c5a30e63c401cbfb713fd3a859194 P 3f9e4abf970849caa70a02ede7f97cd8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:22.751927  6549 tablet_replica.cc:333] T bba029f9d36e45249ae3b3699bebed9b P 3f9e4abf970849caa70a02ede7f97cd8: stopping tablet replica
I20260709 14:55:22.752545  6549 raft_consensus.cc:2243] T bba029f9d36e45249ae3b3699bebed9b P 3f9e4abf970849caa70a02ede7f97cd8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 14:55:22.753198  6549 raft_consensus.cc:2272] T bba029f9d36e45249ae3b3699bebed9b P 3f9e4abf970849caa70a02ede7f97cd8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:22.755913  6549 tablet_replica.cc:333] T 947a22f76d864a6dbbb88eb7f085fe17 P 3f9e4abf970849caa70a02ede7f97cd8: stopping tablet replica
W20260709 14:55:22.756531 17667 consensus_peers.cc:597] T 22cb1b4f8c5f457b9f5661dd2d0e208d P 3f9e4abf970849caa70a02ede7f97cd8 -> Peer 450b7f1304cb4c2ca4c9ccf62afb6937 (127.6.101.66:35877): Couldn't send request to peer 450b7f1304cb4c2ca4c9ccf62afb6937. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.66:35877: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 14:55:22.756897  6549 raft_consensus.cc:2243] T 947a22f76d864a6dbbb88eb7f085fe17 P 3f9e4abf970849caa70a02ede7f97cd8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 14:55:22.757572  6549 raft_consensus.cc:2272] T 947a22f76d864a6dbbb88eb7f085fe17 P 3f9e4abf970849caa70a02ede7f97cd8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:22.759624  6549 tablet_replica.cc:333] T bdbd06b81c1f4dddbfd9a9f52f3f90c2 P 3f9e4abf970849caa70a02ede7f97cd8: stopping tablet replica
I20260709 14:55:22.760203  6549 raft_consensus.cc:2243] T bdbd06b81c1f4dddbfd9a9f52f3f90c2 P 3f9e4abf970849caa70a02ede7f97cd8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 14:55:22.760623  6549 raft_consensus.cc:2272] T bdbd06b81c1f4dddbfd9a9f52f3f90c2 P 3f9e4abf970849caa70a02ede7f97cd8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:22.762892  6549 tablet_replica.cc:333] T ac091812917c4fa0a02bdc0d9984206d P 3f9e4abf970849caa70a02ede7f97cd8: stopping tablet replica
I20260709 14:55:22.763504  6549 raft_consensus.cc:2243] T ac091812917c4fa0a02bdc0d9984206d P 3f9e4abf970849caa70a02ede7f97cd8 [term 3 LEADER]: Raft consensus shutting down.
I20260709 14:55:22.764585  6549 raft_consensus.cc:2272] T ac091812917c4fa0a02bdc0d9984206d P 3f9e4abf970849caa70a02ede7f97cd8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:22.766718  6549 tablet_replica.cc:333] T 9bc3dcde63fb4f438cb12b4e64ee2d30 P 3f9e4abf970849caa70a02ede7f97cd8: stopping tablet replica
I20260709 14:55:22.767331  6549 raft_consensus.cc:2243] T 9bc3dcde63fb4f438cb12b4e64ee2d30 P 3f9e4abf970849caa70a02ede7f97cd8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 14:55:22.767818  6549 raft_consensus.cc:2272] T 9bc3dcde63fb4f438cb12b4e64ee2d30 P 3f9e4abf970849caa70a02ede7f97cd8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:22.769838  6549 tablet_replica.cc:333] T 2e8e053361a54d7c91f2fe670f4aa514 P 3f9e4abf970849caa70a02ede7f97cd8: stopping tablet replica
I20260709 14:55:22.770463  6549 raft_consensus.cc:2243] T 2e8e053361a54d7c91f2fe670f4aa514 P 3f9e4abf970849caa70a02ede7f97cd8 [term 3 LEADER]: Raft consensus shutting down.
I20260709 14:55:22.771301  6549 raft_consensus.cc:2272] T 2e8e053361a54d7c91f2fe670f4aa514 P 3f9e4abf970849caa70a02ede7f97cd8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:22.773691  6549 tablet_replica.cc:333] T 876c059b51af47a9a687c1e92c95a515 P 3f9e4abf970849caa70a02ede7f97cd8: stopping tablet replica
I20260709 14:55:22.774356  6549 raft_consensus.cc:2243] T 876c059b51af47a9a687c1e92c95a515 P 3f9e4abf970849caa70a02ede7f97cd8 [term 3 LEADER]: Raft consensus shutting down.
I20260709 14:55:22.775261  6549 raft_consensus.cc:2272] T 876c059b51af47a9a687c1e92c95a515 P 3f9e4abf970849caa70a02ede7f97cd8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:22.777971  6549 tablet_replica.cc:333] T b5d16339e8c74f8aa5c9bef2ed4ef1c6 P 3f9e4abf970849caa70a02ede7f97cd8: stopping tablet replica
I20260709 14:55:22.778682  6549 raft_consensus.cc:2243] T b5d16339e8c74f8aa5c9bef2ed4ef1c6 P 3f9e4abf970849caa70a02ede7f97cd8 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 14:55:22.778772 17665 consensus_peers.cc:597] T 22cb1b4f8c5f457b9f5661dd2d0e208d P 3f9e4abf970849caa70a02ede7f97cd8 -> Peer 2be4570f313d4a219ad149e28ab546c5 (127.6.101.65:43507): Couldn't send request to peer 2be4570f313d4a219ad149e28ab546c5. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:43507: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 14:55:22.779312  6549 raft_consensus.cc:2272] T b5d16339e8c74f8aa5c9bef2ed4ef1c6 P 3f9e4abf970849caa70a02ede7f97cd8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:22.781652  6549 tablet_replica.cc:333] T d778ef6fbde3497389223b362f88a26a P 3f9e4abf970849caa70a02ede7f97cd8: stopping tablet replica
I20260709 14:55:22.782274  6549 raft_consensus.cc:2243] T d778ef6fbde3497389223b362f88a26a P 3f9e4abf970849caa70a02ede7f97cd8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 14:55:22.783185  6549 raft_consensus.cc:2272] T d778ef6fbde3497389223b362f88a26a P 3f9e4abf970849caa70a02ede7f97cd8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:22.785409  6549 tablet_replica.cc:333] T c26e43514e564f9e906f938557e587e8 P 3f9e4abf970849caa70a02ede7f97cd8: stopping tablet replica
I20260709 14:55:22.786063  6549 raft_consensus.cc:2243] T c26e43514e564f9e906f938557e587e8 P 3f9e4abf970849caa70a02ede7f97cd8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 14:55:22.786984  6549 raft_consensus.cc:2272] T c26e43514e564f9e906f938557e587e8 P 3f9e4abf970849caa70a02ede7f97cd8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:22.789425  6549 tablet_replica.cc:333] T 22cb1b4f8c5f457b9f5661dd2d0e208d P 3f9e4abf970849caa70a02ede7f97cd8: stopping tablet replica
I20260709 14:55:22.790022  6549 raft_consensus.cc:2243] T 22cb1b4f8c5f457b9f5661dd2d0e208d P 3f9e4abf970849caa70a02ede7f97cd8 [term 3 LEADER]: Raft consensus shutting down.
I20260709 14:55:22.790928  6549 raft_consensus.cc:2272] T 22cb1b4f8c5f457b9f5661dd2d0e208d P 3f9e4abf970849caa70a02ede7f97cd8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:22.793218  6549 tablet_replica.cc:333] T 062ea10ecbd54055988e22c53a4387c5 P 3f9e4abf970849caa70a02ede7f97cd8: stopping tablet replica
I20260709 14:55:22.793916  6549 raft_consensus.cc:2243] T 062ea10ecbd54055988e22c53a4387c5 P 3f9e4abf970849caa70a02ede7f97cd8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 14:55:22.794466  6549 raft_consensus.cc:2272] T 062ea10ecbd54055988e22c53a4387c5 P 3f9e4abf970849caa70a02ede7f97cd8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:22.797003  6549 tablet_replica.cc:333] T f9509b6f243644ed9e147299153953b2 P 3f9e4abf970849caa70a02ede7f97cd8: stopping tablet replica
I20260709 14:55:22.797708  6549 raft_consensus.cc:2243] T f9509b6f243644ed9e147299153953b2 P 3f9e4abf970849caa70a02ede7f97cd8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 14:55:22.798239  6549 raft_consensus.cc:2272] T f9509b6f243644ed9e147299153953b2 P 3f9e4abf970849caa70a02ede7f97cd8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:22.800618  6549 tablet_replica.cc:333] T 87215280bbb9434c86b8e0c862d78e44 P 3f9e4abf970849caa70a02ede7f97cd8: stopping tablet replica
I20260709 14:55:22.801288  6549 raft_consensus.cc:2243] T 87215280bbb9434c86b8e0c862d78e44 P 3f9e4abf970849caa70a02ede7f97cd8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 14:55:22.801808  6549 raft_consensus.cc:2272] T 87215280bbb9434c86b8e0c862d78e44 P 3f9e4abf970849caa70a02ede7f97cd8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:22.804196  6549 tablet_replica.cc:333] T f9764d88fc354df8a8b107f95579fc60 P 3f9e4abf970849caa70a02ede7f97cd8: stopping tablet replica
I20260709 14:55:22.804819  6549 raft_consensus.cc:2243] T f9764d88fc354df8a8b107f95579fc60 P 3f9e4abf970849caa70a02ede7f97cd8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 14:55:22.805341  6549 raft_consensus.cc:2272] T f9764d88fc354df8a8b107f95579fc60 P 3f9e4abf970849caa70a02ede7f97cd8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:22.807819  6549 tablet_replica.cc:333] T 2ee76f3707314e23b707060672d77fdb P 3f9e4abf970849caa70a02ede7f97cd8: stopping tablet replica
I20260709 14:55:22.808394  6549 raft_consensus.cc:2243] T 2ee76f3707314e23b707060672d77fdb P 3f9e4abf970849caa70a02ede7f97cd8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 14:55:22.808938  6549 raft_consensus.cc:2272] T 2ee76f3707314e23b707060672d77fdb P 3f9e4abf970849caa70a02ede7f97cd8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:22.811318  6549 tablet_replica.cc:333] T dde79436f56b4ce7805822a819a1d9bf P 3f9e4abf970849caa70a02ede7f97cd8: stopping tablet replica
I20260709 14:55:22.811893  6549 raft_consensus.cc:2243] T dde79436f56b4ce7805822a819a1d9bf P 3f9e4abf970849caa70a02ede7f97cd8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 14:55:22.812340  6549 raft_consensus.cc:2272] T dde79436f56b4ce7805822a819a1d9bf P 3f9e4abf970849caa70a02ede7f97cd8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:22.858718  6549 tablet_server.cc:196] TabletServer@127.6.101.67:0 shutdown complete.
I20260709 14:55:22.897423  6549 master.cc:562] Master@127.6.101.126:36551 shutting down...
I20260709 14:55:22.927726  6549 raft_consensus.cc:2243] T 00000000000000000000000000000000 P a42a4a4a6b5b40539d164bf0216d7432 [term 1 LEADER]: Raft consensus shutting down.
I20260709 14:55:22.928495  6549 raft_consensus.cc:2272] T 00000000000000000000000000000000 P a42a4a4a6b5b40539d164bf0216d7432 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:22.928872  6549 tablet_replica.cc:333] T 00000000000000000000000000000000 P a42a4a4a6b5b40539d164bf0216d7432: stopping tablet replica
I20260709 14:55:22.952586  6549 master.cc:584] Master@127.6.101.126:36551 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (13843 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 14:55:23.016142  6549 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.6.101.126:38877
I20260709 14:55:23.017405  6549 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 14:55:23.023638 18037 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 14:55:23.023576 18036 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 14:55:23.024387 18039 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 14:55:23.027182  6549 server_base.cc:1061] running on GCE node
I20260709 14:55:23.028471  6549 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 14:55:23.028729  6549 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 14:55:23.028887  6549 hybrid_clock.cc:648] HybridClock initialized: now 1783608923028864 us; error 0 us; skew 500 ppm
I20260709 14:55:23.029699  6549 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 14:55:23.033996  6549 webserver.cc:533] Webserver started at http://127.6.101.126:33973/ using document root <none> and password file <none>
I20260709 14:55:23.034554  6549 fs_manager.cc:362] Metadata directory not provided
I20260709 14:55:23.034746  6549 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 14:55:23.035187  6549 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 14:55:23.036720  6549 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783608571892863-6549-0/minicluster-data/master-0-root/instance:
uuid: "233fa68c7088489f892c8e7dd6b70f02"
format_stamp: "Formatted at 2026-07-09 14:55:23 on dist-test-slave-lv34"
I20260709 14:55:23.044129  6549 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 14:55:23.049401 18044 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 14:55:23.050701  6549 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 14:55:23.051144  6549 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783608571892863-6549-0/minicluster-data/master-0-root
uuid: "233fa68c7088489f892c8e7dd6b70f02"
format_stamp: "Formatted at 2026-07-09 14:55:23 on dist-test-slave-lv34"
I20260709 14:55:23.051448  6549 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783608571892863-6549-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783608571892863-6549-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783608571892863-6549-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 14:55:23.071396  6549 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 14:55:23.072693  6549 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 14:55:23.128091  6549 rpc_server.cc:307] RPC server started. Bound to: 127.6.101.126:38877
I20260709 14:55:23.128319 18095 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.101.126:38877 every 8 connection(s)
I20260709 14:55:23.133684 18096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:55:23.149693 18096 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 233fa68c7088489f892c8e7dd6b70f02: Bootstrap starting.
I20260709 14:55:23.155828 18096 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 233fa68c7088489f892c8e7dd6b70f02: Neither blocks nor log segments found. Creating new log.
I20260709 14:55:23.161473 18096 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 233fa68c7088489f892c8e7dd6b70f02: No bootstrap required, opened a new log
I20260709 14:55:23.164252 18096 raft_consensus.cc:359] T 00000000000000000000000000000000 P 233fa68c7088489f892c8e7dd6b70f02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "233fa68c7088489f892c8e7dd6b70f02" member_type: VOTER }
I20260709 14:55:23.164763 18096 raft_consensus.cc:385] T 00000000000000000000000000000000 P 233fa68c7088489f892c8e7dd6b70f02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:55:23.164974 18096 raft_consensus.cc:740] T 00000000000000000000000000000000 P 233fa68c7088489f892c8e7dd6b70f02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 233fa68c7088489f892c8e7dd6b70f02, State: Initialized, Role: FOLLOWER
I20260709 14:55:23.165700 18096 consensus_queue.cc:260] T 00000000000000000000000000000000 P 233fa68c7088489f892c8e7dd6b70f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "233fa68c7088489f892c8e7dd6b70f02" member_type: VOTER }
I20260709 14:55:23.166237 18096 raft_consensus.cc:399] T 00000000000000000000000000000000 P 233fa68c7088489f892c8e7dd6b70f02 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 14:55:23.166441 18096 raft_consensus.cc:493] T 00000000000000000000000000000000 P 233fa68c7088489f892c8e7dd6b70f02 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 14:55:23.166684 18096 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 233fa68c7088489f892c8e7dd6b70f02 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:55:23.173206 18096 raft_consensus.cc:515] T 00000000000000000000000000000000 P 233fa68c7088489f892c8e7dd6b70f02 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "233fa68c7088489f892c8e7dd6b70f02" member_type: VOTER }
I20260709 14:55:23.173951 18096 leader_election.cc:304] T 00000000000000000000000000000000 P 233fa68c7088489f892c8e7dd6b70f02 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 233fa68c7088489f892c8e7dd6b70f02; no voters: 
I20260709 14:55:23.175524 18096 leader_election.cc:290] T 00000000000000000000000000000000 P 233fa68c7088489f892c8e7dd6b70f02 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 14:55:23.175968 18099 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 233fa68c7088489f892c8e7dd6b70f02 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:55:23.177774 18099 raft_consensus.cc:697] T 00000000000000000000000000000000 P 233fa68c7088489f892c8e7dd6b70f02 [term 1 LEADER]: Becoming Leader. State: Replica: 233fa68c7088489f892c8e7dd6b70f02, State: Running, Role: LEADER
I20260709 14:55:23.178869 18099 consensus_queue.cc:237] T 00000000000000000000000000000000 P 233fa68c7088489f892c8e7dd6b70f02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "233fa68c7088489f892c8e7dd6b70f02" member_type: VOTER }
I20260709 14:55:23.179634 18096 sys_catalog.cc:565] T 00000000000000000000000000000000 P 233fa68c7088489f892c8e7dd6b70f02 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 14:55:23.185122 18101 sys_catalog.cc:455] T 00000000000000000000000000000000 P 233fa68c7088489f892c8e7dd6b70f02 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 233fa68c7088489f892c8e7dd6b70f02. Latest consensus state: current_term: 1 leader_uuid: "233fa68c7088489f892c8e7dd6b70f02" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "233fa68c7088489f892c8e7dd6b70f02" member_type: VOTER } }
I20260709 14:55:23.186478 18101 sys_catalog.cc:458] T 00000000000000000000000000000000 P 233fa68c7088489f892c8e7dd6b70f02 [sys.catalog]: This master's current role is: LEADER
I20260709 14:55:23.185103 18100 sys_catalog.cc:455] T 00000000000000000000000000000000 P 233fa68c7088489f892c8e7dd6b70f02 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "233fa68c7088489f892c8e7dd6b70f02" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "233fa68c7088489f892c8e7dd6b70f02" member_type: VOTER } }
I20260709 14:55:23.187757 18100 sys_catalog.cc:458] T 00000000000000000000000000000000 P 233fa68c7088489f892c8e7dd6b70f02 [sys.catalog]: This master's current role is: LEADER
I20260709 14:55:23.190104 18107 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 14:55:23.196734 18107 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 14:55:23.199141  6549 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 14:55:23.209602 18107 catalog_manager.cc:1383] Generated new cluster ID: c3b7bce636544522a9e1c76cb5fbea35
I20260709 14:55:23.210155 18107 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 14:55:23.254709 18107 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 14:55:23.256141 18107 catalog_manager.cc:1540] Loading token signing keys...
I20260709 14:55:23.278216 18107 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 233fa68c7088489f892c8e7dd6b70f02: Generated new TSK 0
I20260709 14:55:23.278934 18107 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 14:55:23.332938  6549 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 14:55:23.341183 18117 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 14:55:23.343462 18118 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 14:55:23.345839 18120 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 14:55:23.346487  6549 server_base.cc:1061] running on GCE node
I20260709 14:55:23.347985  6549 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 14:55:23.348377  6549 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 14:55:23.348614  6549 hybrid_clock.cc:648] HybridClock initialized: now 1783608923348588 us; error 0 us; skew 500 ppm
I20260709 14:55:23.349391  6549 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 14:55:23.352548  6549 webserver.cc:533] Webserver started at http://127.6.101.65:43491/ using document root <none> and password file <none>
I20260709 14:55:23.353435  6549 fs_manager.cc:362] Metadata directory not provided
I20260709 14:55:23.353693  6549 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 14:55:23.353971  6549 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 14:55:23.355659  6549 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783608571892863-6549-0/minicluster-data/ts-0-root/instance:
uuid: "f75b4aa933fd4b8c82ea07567024882c"
format_stamp: "Formatted at 2026-07-09 14:55:23 on dist-test-slave-lv34"
I20260709 14:55:23.362080  6549 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.006s	sys 0.002s
I20260709 14:55:23.367084 18125 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 14:55:23.368249  6549 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.001s
I20260709 14:55:23.368673  6549 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783608571892863-6549-0/minicluster-data/ts-0-root
uuid: "f75b4aa933fd4b8c82ea07567024882c"
format_stamp: "Formatted at 2026-07-09 14:55:23 on dist-test-slave-lv34"
I20260709 14:55:23.369038  6549 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783608571892863-6549-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783608571892863-6549-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783608571892863-6549-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 14:55:23.386139  6549 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 14:55:23.387745  6549 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 14:55:23.389808  6549 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 14:55:23.392768  6549 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 14:55:23.393009  6549 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 14:55:23.393294  6549 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 14:55:23.393486  6549 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 14:55:23.451824  6549 rpc_server.cc:307] RPC server started. Bound to: 127.6.101.65:40449
I20260709 14:55:23.451992 18187 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.101.65:40449 every 8 connection(s)
I20260709 14:55:23.457333  6549 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 14:55:23.466164 18192 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 14:55:23.469069 18193 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 14:55:23.470124 18195 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 14:55:23.471181  6549 server_base.cc:1061] running on GCE node
I20260709 14:55:23.472786  6549 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 14:55:23.473279  6549 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 14:55:23.473506  6549 hybrid_clock.cc:648] HybridClock initialized: now 1783608923473482 us; error 0 us; skew 500 ppm
I20260709 14:55:23.474390  6549 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 14:55:23.477684  6549 webserver.cc:533] Webserver started at http://127.6.101.66:46525/ using document root <none> and password file <none>
I20260709 14:55:23.478320  6549 fs_manager.cc:362] Metadata directory not provided
I20260709 14:55:23.478536 18188 heartbeater.cc:344] Connected to a master server at 127.6.101.126:38877
I20260709 14:55:23.478541  6549 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 14:55:23.479183 18188 heartbeater.cc:461] Registering TS with master...
I20260709 14:55:23.479344  6549 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 14:55:23.480192 18188 heartbeater.cc:507] Master 127.6.101.126:38877 requested a full tablet report, sending...
I20260709 14:55:23.480988  6549 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783608571892863-6549-0/minicluster-data/ts-1-root/instance:
uuid: "95234c5b69eb4fe4a7558e56eedbe71a"
format_stamp: "Formatted at 2026-07-09 14:55:23 on dist-test-slave-lv34"
I20260709 14:55:23.483254 18061 ts_manager.cc:194] Registered new tserver with Master: f75b4aa933fd4b8c82ea07567024882c (127.6.101.65:40449)
I20260709 14:55:23.485934 18061 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51032
I20260709 14:55:23.487701  6549 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.005s	sys 0.000s
I20260709 14:55:23.492479 18200 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 14:55:23.493528  6549 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 14:55:23.493990  6549 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783608571892863-6549-0/minicluster-data/ts-1-root
uuid: "95234c5b69eb4fe4a7558e56eedbe71a"
format_stamp: "Formatted at 2026-07-09 14:55:23 on dist-test-slave-lv34"
I20260709 14:55:23.494339  6549 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783608571892863-6549-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783608571892863-6549-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783608571892863-6549-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 14:55:23.523303  6549 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 14:55:23.524781  6549 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 14:55:23.526643  6549 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 14:55:23.529748  6549 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 14:55:23.530046  6549 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 14:55:23.530309  6549 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 14:55:23.530472  6549 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 14:55:23.585217  6549 rpc_server.cc:307] RPC server started. Bound to: 127.6.101.66:42897
I20260709 14:55:23.585420 18262 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.101.66:42897 every 8 connection(s)
I20260709 14:55:23.591342  6549 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 14:55:23.605948 18266 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 14:55:23.606200 18267 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 14:55:23.610584 18263 heartbeater.cc:344] Connected to a master server at 127.6.101.126:38877
I20260709 14:55:23.611207 18263 heartbeater.cc:461] Registering TS with master...
W20260709 14:55:23.611418 18269 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 14:55:23.612250 18263 heartbeater.cc:507] Master 127.6.101.126:38877 requested a full tablet report, sending...
I20260709 14:55:23.612649  6549 server_base.cc:1061] running on GCE node
I20260709 14:55:23.614084  6549 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 14:55:23.614424  6549 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 14:55:23.614648  6549 hybrid_clock.cc:648] HybridClock initialized: now 1783608923614622 us; error 0 us; skew 500 ppm
I20260709 14:55:23.615235  6549 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 14:55:23.615111 18061 ts_manager.cc:194] Registered new tserver with Master: 95234c5b69eb4fe4a7558e56eedbe71a (127.6.101.66:42897)
I20260709 14:55:23.617594 18061 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51046
I20260709 14:55:23.619041  6549 webserver.cc:533] Webserver started at http://127.6.101.67:33101/ using document root <none> and password file <none>
I20260709 14:55:23.619809  6549 fs_manager.cc:362] Metadata directory not provided
I20260709 14:55:23.620229  6549 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 14:55:23.620639  6549 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 14:55:23.622073  6549 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783608571892863-6549-0/minicluster-data/ts-2-root/instance:
uuid: "ec71ef77a55848a0add75a6c104cc9a9"
format_stamp: "Formatted at 2026-07-09 14:55:23 on dist-test-slave-lv34"
I20260709 14:55:23.629125  6549 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.002s	sys 0.005s
I20260709 14:55:23.634120 18274 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 14:55:23.635710  6549 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 14:55:23.636224  6549 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783608571892863-6549-0/minicluster-data/ts-2-root
uuid: "ec71ef77a55848a0add75a6c104cc9a9"
format_stamp: "Formatted at 2026-07-09 14:55:23 on dist-test-slave-lv34"
I20260709 14:55:23.636684  6549 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783608571892863-6549-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783608571892863-6549-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskexC32E/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783608571892863-6549-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 14:55:23.655143  6549 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 14:55:23.656548  6549 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 14:55:23.658414  6549 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 14:55:23.661403  6549 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 14:55:23.661669  6549 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 14:55:23.661922  6549 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 14:55:23.662093  6549 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 14:55:23.720773  6549 rpc_server.cc:307] RPC server started. Bound to: 127.6.101.67:42661
I20260709 14:55:23.720947 18336 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.101.67:42661 every 8 connection(s)
I20260709 14:55:23.785904 18337 heartbeater.cc:344] Connected to a master server at 127.6.101.126:38877
I20260709 14:55:23.786804 18337 heartbeater.cc:461] Registering TS with master...
I20260709 14:55:23.788196 18337 heartbeater.cc:507] Master 127.6.101.126:38877 requested a full tablet report, sending...
I20260709 14:55:23.791905 18061 ts_manager.cc:194] Registered new tserver with Master: ec71ef77a55848a0add75a6c104cc9a9 (127.6.101.67:42661)
I20260709 14:55:23.792821  6549 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.067683572s
I20260709 14:55:23.795312 18061 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58810
I20260709 14:55:23.831723 18061 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58822:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 14:55:23.834890 18061 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 14:55:23.935427 18228 tablet_service.cc:1511] Processing CreateTablet for tablet 8c253d3492704370910e00d866ea41a2 (DEFAULT_TABLE table=test-workload [id=ecb43dbc1691465ba90658757ba7994c]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 14:55:23.936951 18226 tablet_service.cc:1511] Processing CreateTablet for tablet 528cd6046e1f4e7e8cc77f09c4578612 (DEFAULT_TABLE table=test-workload [id=ecb43dbc1691465ba90658757ba7994c]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 14:55:23.936765 18225 tablet_service.cc:1511] Processing CreateTablet for tablet f2ae10cc8d774889b54c598119fa0deb (DEFAULT_TABLE table=test-workload [id=ecb43dbc1691465ba90658757ba7994c]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 14:55:23.935362 18227 tablet_service.cc:1511] Processing CreateTablet for tablet bf34b3256cdf42dbaf4cad11d1a42160 (DEFAULT_TABLE table=test-workload [id=ecb43dbc1691465ba90658757ba7994c]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 14:55:23.940460 18228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c253d3492704370910e00d866ea41a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:55:23.941792 18227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf34b3256cdf42dbaf4cad11d1a42160. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:55:23.942732 18226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 528cd6046e1f4e7e8cc77f09c4578612. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:55:23.947161 18224 tablet_service.cc:1511] Processing CreateTablet for tablet 39965dc306aa4828a74a07da020fe662 (DEFAULT_TABLE table=test-workload [id=ecb43dbc1691465ba90658757ba7994c]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 14:55:23.948308 18225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2ae10cc8d774889b54c598119fa0deb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:55:23.950433 18224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39965dc306aa4828a74a07da020fe662. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:55:23.977106 18153 tablet_service.cc:1511] Processing CreateTablet for tablet 8c253d3492704370910e00d866ea41a2 (DEFAULT_TABLE table=test-workload [id=ecb43dbc1691465ba90658757ba7994c]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 14:55:23.981782 18152 tablet_service.cc:1511] Processing CreateTablet for tablet bf34b3256cdf42dbaf4cad11d1a42160 (DEFAULT_TABLE table=test-workload [id=ecb43dbc1691465ba90658757ba7994c]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 14:55:23.985081 18151 tablet_service.cc:1511] Processing CreateTablet for tablet 528cd6046e1f4e7e8cc77f09c4578612 (DEFAULT_TABLE table=test-workload [id=ecb43dbc1691465ba90658757ba7994c]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 14:55:23.987201 18151 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 528cd6046e1f4e7e8cc77f09c4578612. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:55:23.990922 18150 tablet_service.cc:1511] Processing CreateTablet for tablet f2ae10cc8d774889b54c598119fa0deb (DEFAULT_TABLE table=test-workload [id=ecb43dbc1691465ba90658757ba7994c]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 14:55:24.003775 18149 tablet_service.cc:1511] Processing CreateTablet for tablet 39965dc306aa4828a74a07da020fe662 (DEFAULT_TABLE table=test-workload [id=ecb43dbc1691465ba90658757ba7994c]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 14:55:23.992964 18150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2ae10cc8d774889b54c598119fa0deb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:55:24.009090 18148 tablet_service.cc:1511] Processing CreateTablet for tablet b2b20170ec59458c9b9a18ca1e2a34d6 (DEFAULT_TABLE table=test-workload [id=ecb43dbc1691465ba90658757ba7994c]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 14:55:24.015450 18148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2b20170ec59458c9b9a18ca1e2a34d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:55:24.027480 18153 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c253d3492704370910e00d866ea41a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:55:24.032495 18152 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf34b3256cdf42dbaf4cad11d1a42160. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:55:24.033818 18149 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39965dc306aa4828a74a07da020fe662. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:55:24.037477 18356 tablet_bootstrap.cc:492] T bf34b3256cdf42dbaf4cad11d1a42160 P 95234c5b69eb4fe4a7558e56eedbe71a: Bootstrap starting.
I20260709 14:55:24.043212 18224 tablet_service.cc:1511] Processing CreateTablet for tablet b2b20170ec59458c9b9a18ca1e2a34d6 (DEFAULT_TABLE table=test-workload [id=ecb43dbc1691465ba90658757ba7994c]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 14:55:24.045207 18224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2b20170ec59458c9b9a18ca1e2a34d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:55:24.055115 18300 tablet_service.cc:1511] Processing CreateTablet for tablet 528cd6046e1f4e7e8cc77f09c4578612 (DEFAULT_TABLE table=test-workload [id=ecb43dbc1691465ba90658757ba7994c]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 14:55:24.059301 18299 tablet_service.cc:1511] Processing CreateTablet for tablet f2ae10cc8d774889b54c598119fa0deb (DEFAULT_TABLE table=test-workload [id=ecb43dbc1691465ba90658757ba7994c]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 14:55:24.062718 18298 tablet_service.cc:1511] Processing CreateTablet for tablet 39965dc306aa4828a74a07da020fe662 (DEFAULT_TABLE table=test-workload [id=ecb43dbc1691465ba90658757ba7994c]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 14:55:24.066342 18297 tablet_service.cc:1511] Processing CreateTablet for tablet b2b20170ec59458c9b9a18ca1e2a34d6 (DEFAULT_TABLE table=test-workload [id=ecb43dbc1691465ba90658757ba7994c]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 14:55:24.067068 18147 tablet_service.cc:1511] Processing CreateTablet for tablet 11525d1d42074736bf180ebaafed1e98 (DEFAULT_TABLE table=test-workload [id=ecb43dbc1691465ba90658757ba7994c]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 14:55:24.067679 18302 tablet_service.cc:1511] Processing CreateTablet for tablet 8c253d3492704370910e00d866ea41a2 (DEFAULT_TABLE table=test-workload [id=ecb43dbc1691465ba90658757ba7994c]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 14:55:24.051801 18301 tablet_service.cc:1511] Processing CreateTablet for tablet bf34b3256cdf42dbaf4cad11d1a42160 (DEFAULT_TABLE table=test-workload [id=ecb43dbc1691465ba90658757ba7994c]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 14:55:24.069572 18147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11525d1d42074736bf180ebaafed1e98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:55:24.070688 18300 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 528cd6046e1f4e7e8cc77f09c4578612. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:55:24.073750 18302 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c253d3492704370910e00d866ea41a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:55:24.077921 18299 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2ae10cc8d774889b54c598119fa0deb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:55:24.080860 18297 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2b20170ec59458c9b9a18ca1e2a34d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:55:24.085731 18298 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39965dc306aa4828a74a07da020fe662. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:55:24.086041 18226 tablet_service.cc:1511] Processing CreateTablet for tablet 11525d1d42074736bf180ebaafed1e98 (DEFAULT_TABLE table=test-workload [id=ecb43dbc1691465ba90658757ba7994c]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 14:55:24.087576 18226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11525d1d42074736bf180ebaafed1e98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:55:24.089730 18301 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf34b3256cdf42dbaf4cad11d1a42160. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:55:24.106528 18296 tablet_service.cc:1511] Processing CreateTablet for tablet 11525d1d42074736bf180ebaafed1e98 (DEFAULT_TABLE table=test-workload [id=ecb43dbc1691465ba90658757ba7994c]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 14:55:24.108443 18296 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11525d1d42074736bf180ebaafed1e98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:55:24.120843 18149 tablet_service.cc:1511] Processing CreateTablet for tablet e68e41550ad240f5842867f3c8b8604d (DEFAULT_TABLE table=test-workload [id=ecb43dbc1691465ba90658757ba7994c]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 14:55:24.122709 18149 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e68e41550ad240f5842867f3c8b8604d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:55:24.129316 18224 tablet_service.cc:1511] Processing CreateTablet for tablet e68e41550ad240f5842867f3c8b8604d (DEFAULT_TABLE table=test-workload [id=ecb43dbc1691465ba90658757ba7994c]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 14:55:24.131599 18224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e68e41550ad240f5842867f3c8b8604d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:55:24.139519 18295 tablet_service.cc:1511] Processing CreateTablet for tablet e68e41550ad240f5842867f3c8b8604d (DEFAULT_TABLE table=test-workload [id=ecb43dbc1691465ba90658757ba7994c]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 14:55:24.141412 18295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e68e41550ad240f5842867f3c8b8604d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:55:24.149682 18146 tablet_service.cc:1511] Processing CreateTablet for tablet 1f97050ecf494124a1ef8f3a359d6fd4 (DEFAULT_TABLE table=test-workload [id=ecb43dbc1691465ba90658757ba7994c]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 14:55:24.151209 18146 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f97050ecf494124a1ef8f3a359d6fd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:55:24.167241 18357 tablet_bootstrap.cc:492] T f2ae10cc8d774889b54c598119fa0deb P f75b4aa933fd4b8c82ea07567024882c: Bootstrap starting.
I20260709 14:55:24.173496 18225 tablet_service.cc:1511] Processing CreateTablet for tablet 1f97050ecf494124a1ef8f3a359d6fd4 (DEFAULT_TABLE table=test-workload [id=ecb43dbc1691465ba90658757ba7994c]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 14:55:24.174958 18225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f97050ecf494124a1ef8f3a359d6fd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:55:24.180976 18294 tablet_service.cc:1511] Processing CreateTablet for tablet 1f97050ecf494124a1ef8f3a359d6fd4 (DEFAULT_TABLE table=test-workload [id=ecb43dbc1691465ba90658757ba7994c]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 14:55:24.182955 18294 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f97050ecf494124a1ef8f3a359d6fd4. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 14:55:24.192379 18109 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 14:55:24.201192 18356 tablet_bootstrap.cc:654] T bf34b3256cdf42dbaf4cad11d1a42160 P 95234c5b69eb4fe4a7558e56eedbe71a: Neither blocks nor log segments found. Creating new log.
I20260709 14:55:24.233114 18357 tablet_bootstrap.cc:654] T f2ae10cc8d774889b54c598119fa0deb P f75b4aa933fd4b8c82ea07567024882c: Neither blocks nor log segments found. Creating new log.
I20260709 14:55:24.260056 18358 tablet_bootstrap.cc:492] T 8c253d3492704370910e00d866ea41a2 P ec71ef77a55848a0add75a6c104cc9a9: Bootstrap starting.
I20260709 14:55:24.263681 18356 tablet_bootstrap.cc:492] T bf34b3256cdf42dbaf4cad11d1a42160 P 95234c5b69eb4fe4a7558e56eedbe71a: No bootstrap required, opened a new log
I20260709 14:55:24.264632 18356 ts_tablet_manager.cc:1403] T bf34b3256cdf42dbaf4cad11d1a42160 P 95234c5b69eb4fe4a7558e56eedbe71a: Time spent bootstrapping tablet: real 0.228s	user 0.026s	sys 0.012s
I20260709 14:55:24.269289 18358 tablet_bootstrap.cc:654] T 8c253d3492704370910e00d866ea41a2 P ec71ef77a55848a0add75a6c104cc9a9: Neither blocks nor log segments found. Creating new log.
I20260709 14:55:24.269219 18356 raft_consensus.cc:359] T bf34b3256cdf42dbaf4cad11d1a42160 P 95234c5b69eb4fe4a7558e56eedbe71a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:24.270594 18357 tablet_bootstrap.cc:492] T f2ae10cc8d774889b54c598119fa0deb P f75b4aa933fd4b8c82ea07567024882c: No bootstrap required, opened a new log
I20260709 14:55:24.270871 18356 raft_consensus.cc:385] T bf34b3256cdf42dbaf4cad11d1a42160 P 95234c5b69eb4fe4a7558e56eedbe71a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:55:24.271193 18357 ts_tablet_manager.cc:1403] T f2ae10cc8d774889b54c598119fa0deb P f75b4aa933fd4b8c82ea07567024882c: Time spent bootstrapping tablet: real 0.104s	user 0.020s	sys 0.019s
I20260709 14:55:24.271275 18356 raft_consensus.cc:740] T bf34b3256cdf42dbaf4cad11d1a42160 P 95234c5b69eb4fe4a7558e56eedbe71a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95234c5b69eb4fe4a7558e56eedbe71a, State: Initialized, Role: FOLLOWER
I20260709 14:55:24.272858 18356 consensus_queue.cc:260] T bf34b3256cdf42dbaf4cad11d1a42160 P 95234c5b69eb4fe4a7558e56eedbe71a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:24.276400 18356 ts_tablet_manager.cc:1434] T bf34b3256cdf42dbaf4cad11d1a42160 P 95234c5b69eb4fe4a7558e56eedbe71a: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.003s
I20260709 14:55:24.276113 18357 raft_consensus.cc:359] T f2ae10cc8d774889b54c598119fa0deb P f75b4aa933fd4b8c82ea07567024882c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:24.277012 18357 raft_consensus.cc:385] T f2ae10cc8d774889b54c598119fa0deb P f75b4aa933fd4b8c82ea07567024882c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:55:24.277312 18358 tablet_bootstrap.cc:492] T 8c253d3492704370910e00d866ea41a2 P ec71ef77a55848a0add75a6c104cc9a9: No bootstrap required, opened a new log
I20260709 14:55:24.277415 18357 raft_consensus.cc:740] T f2ae10cc8d774889b54c598119fa0deb P f75b4aa933fd4b8c82ea07567024882c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f75b4aa933fd4b8c82ea07567024882c, State: Initialized, Role: FOLLOWER
I20260709 14:55:24.277874 18263 heartbeater.cc:499] Master 127.6.101.126:38877 was elected leader, sending a full tablet report...
I20260709 14:55:24.278059 18358 ts_tablet_manager.cc:1403] T 8c253d3492704370910e00d866ea41a2 P ec71ef77a55848a0add75a6c104cc9a9: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.004s
I20260709 14:55:24.278416 18357 consensus_queue.cc:260] T f2ae10cc8d774889b54c598119fa0deb P f75b4aa933fd4b8c82ea07567024882c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:24.281231 18188 heartbeater.cc:499] Master 127.6.101.126:38877 was elected leader, sending a full tablet report...
I20260709 14:55:24.281692 18357 ts_tablet_manager.cc:1434] T f2ae10cc8d774889b54c598119fa0deb P f75b4aa933fd4b8c82ea07567024882c: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.002s
I20260709 14:55:24.282047 18358 raft_consensus.cc:359] T 8c253d3492704370910e00d866ea41a2 P ec71ef77a55848a0add75a6c104cc9a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:24.282810 18357 tablet_bootstrap.cc:492] T 39965dc306aa4828a74a07da020fe662 P f75b4aa933fd4b8c82ea07567024882c: Bootstrap starting.
I20260709 14:55:24.283001 18358 raft_consensus.cc:385] T 8c253d3492704370910e00d866ea41a2 P ec71ef77a55848a0add75a6c104cc9a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:55:24.286208 18358 raft_consensus.cc:740] T 8c253d3492704370910e00d866ea41a2 P ec71ef77a55848a0add75a6c104cc9a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec71ef77a55848a0add75a6c104cc9a9, State: Initialized, Role: FOLLOWER
I20260709 14:55:24.284054 18356 tablet_bootstrap.cc:492] T f2ae10cc8d774889b54c598119fa0deb P 95234c5b69eb4fe4a7558e56eedbe71a: Bootstrap starting.
I20260709 14:55:24.287197 18358 consensus_queue.cc:260] T 8c253d3492704370910e00d866ea41a2 P ec71ef77a55848a0add75a6c104cc9a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:24.291241 18357 tablet_bootstrap.cc:654] T 39965dc306aa4828a74a07da020fe662 P f75b4aa933fd4b8c82ea07567024882c: Neither blocks nor log segments found. Creating new log.
I20260709 14:55:24.296204 18356 tablet_bootstrap.cc:654] T f2ae10cc8d774889b54c598119fa0deb P 95234c5b69eb4fe4a7558e56eedbe71a: Neither blocks nor log segments found. Creating new log.
I20260709 14:55:24.297806 18358 ts_tablet_manager.cc:1434] T 8c253d3492704370910e00d866ea41a2 P ec71ef77a55848a0add75a6c104cc9a9: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.012s
I20260709 14:55:24.299059 18337 heartbeater.cc:499] Master 127.6.101.126:38877 was elected leader, sending a full tablet report...
I20260709 14:55:24.299750 18358 tablet_bootstrap.cc:492] T 528cd6046e1f4e7e8cc77f09c4578612 P ec71ef77a55848a0add75a6c104cc9a9: Bootstrap starting.
I20260709 14:55:24.307655 18358 tablet_bootstrap.cc:654] T 528cd6046e1f4e7e8cc77f09c4578612 P ec71ef77a55848a0add75a6c104cc9a9: Neither blocks nor log segments found. Creating new log.
I20260709 14:55:24.310137 18356 tablet_bootstrap.cc:492] T f2ae10cc8d774889b54c598119fa0deb P 95234c5b69eb4fe4a7558e56eedbe71a: No bootstrap required, opened a new log
I20260709 14:55:24.310913 18356 ts_tablet_manager.cc:1403] T f2ae10cc8d774889b54c598119fa0deb P 95234c5b69eb4fe4a7558e56eedbe71a: Time spent bootstrapping tablet: real 0.027s	user 0.020s	sys 0.002s
I20260709 14:55:24.311895 18357 tablet_bootstrap.cc:492] T 39965dc306aa4828a74a07da020fe662 P f75b4aa933fd4b8c82ea07567024882c: No bootstrap required, opened a new log
I20260709 14:55:24.312839 18357 ts_tablet_manager.cc:1403] T 39965dc306aa4828a74a07da020fe662 P f75b4aa933fd4b8c82ea07567024882c: Time spent bootstrapping tablet: real 0.030s	user 0.020s	sys 0.007s
I20260709 14:55:24.314518 18356 raft_consensus.cc:359] T f2ae10cc8d774889b54c598119fa0deb P 95234c5b69eb4fe4a7558e56eedbe71a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:24.315595 18356 raft_consensus.cc:385] T f2ae10cc8d774889b54c598119fa0deb P 95234c5b69eb4fe4a7558e56eedbe71a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:55:24.315990 18356 raft_consensus.cc:740] T f2ae10cc8d774889b54c598119fa0deb P 95234c5b69eb4fe4a7558e56eedbe71a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95234c5b69eb4fe4a7558e56eedbe71a, State: Initialized, Role: FOLLOWER
I20260709 14:55:24.316319 18357 raft_consensus.cc:359] T 39965dc306aa4828a74a07da020fe662 P f75b4aa933fd4b8c82ea07567024882c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:24.317307 18357 raft_consensus.cc:385] T 39965dc306aa4828a74a07da020fe662 P f75b4aa933fd4b8c82ea07567024882c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:55:24.317740 18357 raft_consensus.cc:740] T 39965dc306aa4828a74a07da020fe662 P f75b4aa933fd4b8c82ea07567024882c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f75b4aa933fd4b8c82ea07567024882c, State: Initialized, Role: FOLLOWER
I20260709 14:55:24.317359 18356 consensus_queue.cc:260] T f2ae10cc8d774889b54c598119fa0deb P 95234c5b69eb4fe4a7558e56eedbe71a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:24.319291 18357 consensus_queue.cc:260] T 39965dc306aa4828a74a07da020fe662 P f75b4aa933fd4b8c82ea07567024882c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:24.327524 18356 ts_tablet_manager.cc:1434] T f2ae10cc8d774889b54c598119fa0deb P 95234c5b69eb4fe4a7558e56eedbe71a: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.001s
I20260709 14:55:24.328836 18357 ts_tablet_manager.cc:1434] T 39965dc306aa4828a74a07da020fe662 P f75b4aa933fd4b8c82ea07567024882c: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 14:55:24.329303 18356 tablet_bootstrap.cc:492] T 8c253d3492704370910e00d866ea41a2 P 95234c5b69eb4fe4a7558e56eedbe71a: Bootstrap starting.
I20260709 14:55:24.330430 18357 tablet_bootstrap.cc:492] T bf34b3256cdf42dbaf4cad11d1a42160 P f75b4aa933fd4b8c82ea07567024882c: Bootstrap starting.
I20260709 14:55:24.339110 18356 tablet_bootstrap.cc:654] T 8c253d3492704370910e00d866ea41a2 P 95234c5b69eb4fe4a7558e56eedbe71a: Neither blocks nor log segments found. Creating new log.
W20260709 14:55:24.340768 18264 tablet.cc:2406] T bf34b3256cdf42dbaf4cad11d1a42160 P 95234c5b69eb4fe4a7558e56eedbe71a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 14:55:24.339301 18357 tablet_bootstrap.cc:654] T bf34b3256cdf42dbaf4cad11d1a42160 P f75b4aa933fd4b8c82ea07567024882c: Neither blocks nor log segments found. Creating new log.
I20260709 14:55:24.349203 18358 tablet_bootstrap.cc:492] T 528cd6046e1f4e7e8cc77f09c4578612 P ec71ef77a55848a0add75a6c104cc9a9: No bootstrap required, opened a new log
I20260709 14:55:24.350107 18358 ts_tablet_manager.cc:1403] T 528cd6046e1f4e7e8cc77f09c4578612 P ec71ef77a55848a0add75a6c104cc9a9: Time spent bootstrapping tablet: real 0.051s	user 0.023s	sys 0.021s
I20260709 14:55:24.353812 18358 raft_consensus.cc:359] T 528cd6046e1f4e7e8cc77f09c4578612 P ec71ef77a55848a0add75a6c104cc9a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:24.354776 18358 raft_consensus.cc:385] T 528cd6046e1f4e7e8cc77f09c4578612 P ec71ef77a55848a0add75a6c104cc9a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:55:24.355154 18358 raft_consensus.cc:740] T 528cd6046e1f4e7e8cc77f09c4578612 P ec71ef77a55848a0add75a6c104cc9a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec71ef77a55848a0add75a6c104cc9a9, State: Initialized, Role: FOLLOWER
I20260709 14:55:24.356009 18358 consensus_queue.cc:260] T 528cd6046e1f4e7e8cc77f09c4578612 P ec71ef77a55848a0add75a6c104cc9a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:24.358803 18358 ts_tablet_manager.cc:1434] T 528cd6046e1f4e7e8cc77f09c4578612 P ec71ef77a55848a0add75a6c104cc9a9: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.002s
I20260709 14:55:24.360006 18358 tablet_bootstrap.cc:492] T b2b20170ec59458c9b9a18ca1e2a34d6 P ec71ef77a55848a0add75a6c104cc9a9: Bootstrap starting.
I20260709 14:55:24.368777 18358 tablet_bootstrap.cc:654] T b2b20170ec59458c9b9a18ca1e2a34d6 P ec71ef77a55848a0add75a6c104cc9a9: Neither blocks nor log segments found. Creating new log.
I20260709 14:55:24.390182 18356 tablet_bootstrap.cc:492] T 8c253d3492704370910e00d866ea41a2 P 95234c5b69eb4fe4a7558e56eedbe71a: No bootstrap required, opened a new log
I20260709 14:55:24.390936 18358 tablet_bootstrap.cc:492] T b2b20170ec59458c9b9a18ca1e2a34d6 P ec71ef77a55848a0add75a6c104cc9a9: No bootstrap required, opened a new log
I20260709 14:55:24.391301 18357 tablet_bootstrap.cc:492] T bf34b3256cdf42dbaf4cad11d1a42160 P f75b4aa933fd4b8c82ea07567024882c: No bootstrap required, opened a new log
I20260709 14:55:24.391343 18356 ts_tablet_manager.cc:1403] T 8c253d3492704370910e00d866ea41a2 P 95234c5b69eb4fe4a7558e56eedbe71a: Time spent bootstrapping tablet: real 0.062s	user 0.033s	sys 0.024s
I20260709 14:55:24.391687 18358 ts_tablet_manager.cc:1403] T b2b20170ec59458c9b9a18ca1e2a34d6 P ec71ef77a55848a0add75a6c104cc9a9: Time spent bootstrapping tablet: real 0.032s	user 0.016s	sys 0.014s
I20260709 14:55:24.392073 18357 ts_tablet_manager.cc:1403] T bf34b3256cdf42dbaf4cad11d1a42160 P f75b4aa933fd4b8c82ea07567024882c: Time spent bootstrapping tablet: real 0.062s	user 0.030s	sys 0.025s
I20260709 14:55:24.395028 18358 raft_consensus.cc:359] T b2b20170ec59458c9b9a18ca1e2a34d6 P ec71ef77a55848a0add75a6c104cc9a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:24.395265 18356 raft_consensus.cc:359] T 8c253d3492704370910e00d866ea41a2 P 95234c5b69eb4fe4a7558e56eedbe71a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:24.395586 18357 raft_consensus.cc:359] T bf34b3256cdf42dbaf4cad11d1a42160 P f75b4aa933fd4b8c82ea07567024882c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:24.396107 18358 raft_consensus.cc:385] T b2b20170ec59458c9b9a18ca1e2a34d6 P ec71ef77a55848a0add75a6c104cc9a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:55:24.396481 18357 raft_consensus.cc:385] T bf34b3256cdf42dbaf4cad11d1a42160 P f75b4aa933fd4b8c82ea07567024882c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:55:24.396178 18356 raft_consensus.cc:385] T 8c253d3492704370910e00d866ea41a2 P 95234c5b69eb4fe4a7558e56eedbe71a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:55:24.396654 18358 raft_consensus.cc:740] T b2b20170ec59458c9b9a18ca1e2a34d6 P ec71ef77a55848a0add75a6c104cc9a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec71ef77a55848a0add75a6c104cc9a9, State: Initialized, Role: FOLLOWER
I20260709 14:55:24.396915 18357 raft_consensus.cc:740] T bf34b3256cdf42dbaf4cad11d1a42160 P f75b4aa933fd4b8c82ea07567024882c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f75b4aa933fd4b8c82ea07567024882c, State: Initialized, Role: FOLLOWER
I20260709 14:55:24.397192 18356 raft_consensus.cc:740] T 8c253d3492704370910e00d866ea41a2 P 95234c5b69eb4fe4a7558e56eedbe71a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95234c5b69eb4fe4a7558e56eedbe71a, State: Initialized, Role: FOLLOWER
I20260709 14:55:24.397920 18357 consensus_queue.cc:260] T bf34b3256cdf42dbaf4cad11d1a42160 P f75b4aa933fd4b8c82ea07567024882c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:24.398159 18358 consensus_queue.cc:260] T b2b20170ec59458c9b9a18ca1e2a34d6 P ec71ef77a55848a0add75a6c104cc9a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:24.398325 18356 consensus_queue.cc:260] T 8c253d3492704370910e00d866ea41a2 P 95234c5b69eb4fe4a7558e56eedbe71a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:24.400961 18357 ts_tablet_manager.cc:1434] T bf34b3256cdf42dbaf4cad11d1a42160 P f75b4aa933fd4b8c82ea07567024882c: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.007s
I20260709 14:55:24.401196 18358 ts_tablet_manager.cc:1434] T b2b20170ec59458c9b9a18ca1e2a34d6 P ec71ef77a55848a0add75a6c104cc9a9: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.005s
I20260709 14:55:24.404171 18357 tablet_bootstrap.cc:492] T b2b20170ec59458c9b9a18ca1e2a34d6 P f75b4aa933fd4b8c82ea07567024882c: Bootstrap starting.
I20260709 14:55:24.405120 18356 ts_tablet_manager.cc:1434] T 8c253d3492704370910e00d866ea41a2 P 95234c5b69eb4fe4a7558e56eedbe71a: Time spent starting tablet: real 0.013s	user 0.003s	sys 0.004s
I20260709 14:55:24.406718 18356 tablet_bootstrap.cc:492] T 39965dc306aa4828a74a07da020fe662 P 95234c5b69eb4fe4a7558e56eedbe71a: Bootstrap starting.
I20260709 14:55:24.410324 18358 tablet_bootstrap.cc:492] T e68e41550ad240f5842867f3c8b8604d P ec71ef77a55848a0add75a6c104cc9a9: Bootstrap starting.
I20260709 14:55:24.415381 18357 tablet_bootstrap.cc:654] T b2b20170ec59458c9b9a18ca1e2a34d6 P f75b4aa933fd4b8c82ea07567024882c: Neither blocks nor log segments found. Creating new log.
I20260709 14:55:24.418774 18358 tablet_bootstrap.cc:654] T e68e41550ad240f5842867f3c8b8604d P ec71ef77a55848a0add75a6c104cc9a9: Neither blocks nor log segments found. Creating new log.
I20260709 14:55:24.423969 18356 tablet_bootstrap.cc:654] T 39965dc306aa4828a74a07da020fe662 P 95234c5b69eb4fe4a7558e56eedbe71a: Neither blocks nor log segments found. Creating new log.
I20260709 14:55:24.427964 18357 tablet_bootstrap.cc:492] T b2b20170ec59458c9b9a18ca1e2a34d6 P f75b4aa933fd4b8c82ea07567024882c: No bootstrap required, opened a new log
I20260709 14:55:24.428630 18357 ts_tablet_manager.cc:1403] T b2b20170ec59458c9b9a18ca1e2a34d6 P f75b4aa933fd4b8c82ea07567024882c: Time spent bootstrapping tablet: real 0.025s	user 0.019s	sys 0.004s
I20260709 14:55:24.431962 18364 raft_consensus.cc:493] T 8c253d3492704370910e00d866ea41a2 P ec71ef77a55848a0add75a6c104cc9a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:55:24.432646 18364 raft_consensus.cc:515] T 8c253d3492704370910e00d866ea41a2 P ec71ef77a55848a0add75a6c104cc9a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:24.431913 18357 raft_consensus.cc:359] T b2b20170ec59458c9b9a18ca1e2a34d6 P f75b4aa933fd4b8c82ea07567024882c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:24.437497 18357 raft_consensus.cc:385] T b2b20170ec59458c9b9a18ca1e2a34d6 P f75b4aa933fd4b8c82ea07567024882c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:55:24.437863 18357 raft_consensus.cc:740] T b2b20170ec59458c9b9a18ca1e2a34d6 P f75b4aa933fd4b8c82ea07567024882c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f75b4aa933fd4b8c82ea07567024882c, State: Initialized, Role: FOLLOWER
I20260709 14:55:24.439047 18357 consensus_queue.cc:260] T b2b20170ec59458c9b9a18ca1e2a34d6 P f75b4aa933fd4b8c82ea07567024882c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:24.436882 18364 leader_election.cc:290] T 8c253d3492704370910e00d866ea41a2 P ec71ef77a55848a0add75a6c104cc9a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95234c5b69eb4fe4a7558e56eedbe71a (127.6.101.66:42897), f75b4aa933fd4b8c82ea07567024882c (127.6.101.65:40449)
I20260709 14:55:24.442386 18357 ts_tablet_manager.cc:1434] T b2b20170ec59458c9b9a18ca1e2a34d6 P f75b4aa933fd4b8c82ea07567024882c: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 14:55:24.451745 18357 tablet_bootstrap.cc:492] T 8c253d3492704370910e00d866ea41a2 P f75b4aa933fd4b8c82ea07567024882c: Bootstrap starting.
I20260709 14:55:24.463174 18356 tablet_bootstrap.cc:492] T 39965dc306aa4828a74a07da020fe662 P 95234c5b69eb4fe4a7558e56eedbe71a: No bootstrap required, opened a new log
I20260709 14:55:24.463953 18356 ts_tablet_manager.cc:1403] T 39965dc306aa4828a74a07da020fe662 P 95234c5b69eb4fe4a7558e56eedbe71a: Time spent bootstrapping tablet: real 0.058s	user 0.010s	sys 0.014s
I20260709 14:55:24.467777 18362 raft_consensus.cc:493] T f2ae10cc8d774889b54c598119fa0deb P 95234c5b69eb4fe4a7558e56eedbe71a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:55:24.467799 18356 raft_consensus.cc:359] T 39965dc306aa4828a74a07da020fe662 P 95234c5b69eb4fe4a7558e56eedbe71a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:24.468549 18362 raft_consensus.cc:515] T f2ae10cc8d774889b54c598119fa0deb P 95234c5b69eb4fe4a7558e56eedbe71a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:24.470383 18356 raft_consensus.cc:385] T 39965dc306aa4828a74a07da020fe662 P 95234c5b69eb4fe4a7558e56eedbe71a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:55:24.470794 18356 raft_consensus.cc:740] T 39965dc306aa4828a74a07da020fe662 P 95234c5b69eb4fe4a7558e56eedbe71a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95234c5b69eb4fe4a7558e56eedbe71a, State: Initialized, Role: FOLLOWER
I20260709 14:55:24.471953 18356 consensus_queue.cc:260] T 39965dc306aa4828a74a07da020fe662 P 95234c5b69eb4fe4a7558e56eedbe71a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:24.473009 18357 tablet_bootstrap.cc:654] T 8c253d3492704370910e00d866ea41a2 P f75b4aa933fd4b8c82ea07567024882c: Neither blocks nor log segments found. Creating new log.
I20260709 14:55:24.474092 18362 leader_election.cc:290] T f2ae10cc8d774889b54c598119fa0deb P 95234c5b69eb4fe4a7558e56eedbe71a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f75b4aa933fd4b8c82ea07567024882c (127.6.101.65:40449), ec71ef77a55848a0add75a6c104cc9a9 (127.6.101.67:42661)
I20260709 14:55:24.477910 18358 tablet_bootstrap.cc:492] T e68e41550ad240f5842867f3c8b8604d P ec71ef77a55848a0add75a6c104cc9a9: No bootstrap required, opened a new log
I20260709 14:55:24.478883 18358 ts_tablet_manager.cc:1403] T e68e41550ad240f5842867f3c8b8604d P ec71ef77a55848a0add75a6c104cc9a9: Time spent bootstrapping tablet: real 0.069s	user 0.018s	sys 0.022s
I20260709 14:55:24.496192 18358 raft_consensus.cc:359] T e68e41550ad240f5842867f3c8b8604d P ec71ef77a55848a0add75a6c104cc9a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:24.497120 18358 raft_consensus.cc:385] T e68e41550ad240f5842867f3c8b8604d P ec71ef77a55848a0add75a6c104cc9a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:55:24.497604 18358 raft_consensus.cc:740] T e68e41550ad240f5842867f3c8b8604d P ec71ef77a55848a0add75a6c104cc9a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec71ef77a55848a0add75a6c104cc9a9, State: Initialized, Role: FOLLOWER
I20260709 14:55:24.502030 18238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c253d3492704370910e00d866ea41a2" candidate_uuid: "ec71ef77a55848a0add75a6c104cc9a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" is_pre_election: true
I20260709 14:55:24.503388 18238 raft_consensus.cc:2468] T 8c253d3492704370910e00d866ea41a2 P 95234c5b69eb4fe4a7558e56eedbe71a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec71ef77a55848a0add75a6c104cc9a9 in term 0.
I20260709 14:55:24.505224 18278 leader_election.cc:304] T 8c253d3492704370910e00d866ea41a2 P ec71ef77a55848a0add75a6c104cc9a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95234c5b69eb4fe4a7558e56eedbe71a, ec71ef77a55848a0add75a6c104cc9a9; no voters: 
I20260709 14:55:24.506552 18364 raft_consensus.cc:2804] T 8c253d3492704370910e00d866ea41a2 P ec71ef77a55848a0add75a6c104cc9a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:55:24.507023 18364 raft_consensus.cc:493] T 8c253d3492704370910e00d866ea41a2 P ec71ef77a55848a0add75a6c104cc9a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:55:24.507211 18356 ts_tablet_manager.cc:1434] T 39965dc306aa4828a74a07da020fe662 P 95234c5b69eb4fe4a7558e56eedbe71a: Time spent starting tablet: real 0.042s	user 0.011s	sys 0.001s
I20260709 14:55:24.507434 18364 raft_consensus.cc:3060] T 8c253d3492704370910e00d866ea41a2 P ec71ef77a55848a0add75a6c104cc9a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:55:24.507804 18163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c253d3492704370910e00d866ea41a2" candidate_uuid: "ec71ef77a55848a0add75a6c104cc9a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f75b4aa933fd4b8c82ea07567024882c" is_pre_election: true
W20260709 14:55:24.510756 18276 leader_election.cc:343] T 8c253d3492704370910e00d866ea41a2 P ec71ef77a55848a0add75a6c104cc9a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f75b4aa933fd4b8c82ea07567024882c (127.6.101.65:40449): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:55:24.512462 18356 tablet_bootstrap.cc:492] T 528cd6046e1f4e7e8cc77f09c4578612 P 95234c5b69eb4fe4a7558e56eedbe71a: Bootstrap starting.
I20260709 14:55:24.518492 18358 consensus_queue.cc:260] T e68e41550ad240f5842867f3c8b8604d P ec71ef77a55848a0add75a6c104cc9a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:24.521767 18364 raft_consensus.cc:515] T 8c253d3492704370910e00d866ea41a2 P ec71ef77a55848a0add75a6c104cc9a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:24.522586 18356 tablet_bootstrap.cc:654] T 528cd6046e1f4e7e8cc77f09c4578612 P 95234c5b69eb4fe4a7558e56eedbe71a: Neither blocks nor log segments found. Creating new log.
I20260709 14:55:24.523909 18382 raft_consensus.cc:493] T e68e41550ad240f5842867f3c8b8604d P ec71ef77a55848a0add75a6c104cc9a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:55:24.529333 18382 raft_consensus.cc:515] T e68e41550ad240f5842867f3c8b8604d P ec71ef77a55848a0add75a6c104cc9a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:24.528230 18357 tablet_bootstrap.cc:492] T 8c253d3492704370910e00d866ea41a2 P f75b4aa933fd4b8c82ea07567024882c: No bootstrap required, opened a new log
I20260709 14:55:24.530897 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ae10cc8d774889b54c598119fa0deb" candidate_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec71ef77a55848a0add75a6c104cc9a9" is_pre_election: true
I20260709 14:55:24.531404 18357 ts_tablet_manager.cc:1403] T 8c253d3492704370910e00d866ea41a2 P f75b4aa933fd4b8c82ea07567024882c: Time spent bootstrapping tablet: real 0.080s	user 0.027s	sys 0.018s
I20260709 14:55:24.533135 18238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c253d3492704370910e00d866ea41a2" candidate_uuid: "ec71ef77a55848a0add75a6c104cc9a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95234c5b69eb4fe4a7558e56eedbe71a"
I20260709 14:55:24.533867 18238 raft_consensus.cc:3060] T 8c253d3492704370910e00d866ea41a2 P 95234c5b69eb4fe4a7558e56eedbe71a [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:55:24.527076 18358 ts_tablet_manager.cc:1434] T e68e41550ad240f5842867f3c8b8604d P ec71ef77a55848a0add75a6c104cc9a9: Time spent starting tablet: real 0.048s	user 0.006s	sys 0.004s
W20260709 14:55:24.537992 18202 leader_election.cc:343] T f2ae10cc8d774889b54c598119fa0deb P 95234c5b69eb4fe4a7558e56eedbe71a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ec71ef77a55848a0add75a6c104cc9a9 (127.6.101.67:42661): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:55:24.538161 18364 leader_election.cc:290] T 8c253d3492704370910e00d866ea41a2 P ec71ef77a55848a0add75a6c104cc9a9 [CANDIDATE]: Term 1 election: Requested vote from peers 95234c5b69eb4fe4a7558e56eedbe71a (127.6.101.66:42897), f75b4aa933fd4b8c82ea07567024882c (127.6.101.65:40449)
I20260709 14:55:24.535425 18357 raft_consensus.cc:359] T 8c253d3492704370910e00d866ea41a2 P f75b4aa933fd4b8c82ea07567024882c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:24.538401 18163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c253d3492704370910e00d866ea41a2" candidate_uuid: "ec71ef77a55848a0add75a6c104cc9a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f75b4aa933fd4b8c82ea07567024882c"
I20260709 14:55:24.539001 18357 raft_consensus.cc:385] T 8c253d3492704370910e00d866ea41a2 P f75b4aa933fd4b8c82ea07567024882c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:55:24.539848 18357 raft_consensus.cc:740] T 8c253d3492704370910e00d866ea41a2 P f75b4aa933fd4b8c82ea07567024882c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f75b4aa933fd4b8c82ea07567024882c, State: Initialized, Role: FOLLOWER
I20260709 14:55:24.541054 18357 consensus_queue.cc:260] T 8c253d3492704370910e00d866ea41a2 P f75b4aa933fd4b8c82ea07567024882c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:24.543596 18163 raft_consensus.cc:3060] T 8c253d3492704370910e00d866ea41a2 P f75b4aa933fd4b8c82ea07567024882c [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:55:24.544185 18162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e68e41550ad240f5842867f3c8b8604d" candidate_uuid: "ec71ef77a55848a0add75a6c104cc9a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f75b4aa933fd4b8c82ea07567024882c" is_pre_election: true
I20260709 14:55:24.548925 18357 ts_tablet_manager.cc:1434] T 8c253d3492704370910e00d866ea41a2 P f75b4aa933fd4b8c82ea07567024882c: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
W20260709 14:55:24.549929 18276 leader_election.cc:343] T e68e41550ad240f5842867f3c8b8604d P ec71ef77a55848a0add75a6c104cc9a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f75b4aa933fd4b8c82ea07567024882c (127.6.101.65:40449): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:55:24.550333 18357 tablet_bootstrap.cc:492] T 11525d1d42074736bf180ebaafed1e98 P f75b4aa933fd4b8c82ea07567024882c: Bootstrap starting.
I20260709 14:55:24.540000 18358 tablet_bootstrap.cc:492] T 1f97050ecf494124a1ef8f3a359d6fd4 P ec71ef77a55848a0add75a6c104cc9a9: Bootstrap starting.
I20260709 14:55:24.551059 18238 raft_consensus.cc:2468] T 8c253d3492704370910e00d866ea41a2 P 95234c5b69eb4fe4a7558e56eedbe71a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec71ef77a55848a0add75a6c104cc9a9 in term 1.
I20260709 14:55:24.562608 18278 leader_election.cc:304] T 8c253d3492704370910e00d866ea41a2 P ec71ef77a55848a0add75a6c104cc9a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95234c5b69eb4fe4a7558e56eedbe71a, ec71ef77a55848a0add75a6c104cc9a9; no voters: 
I20260709 14:55:24.563899 18364 raft_consensus.cc:2804] T 8c253d3492704370910e00d866ea41a2 P ec71ef77a55848a0add75a6c104cc9a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:55:24.564425 18364 raft_consensus.cc:697] T 8c253d3492704370910e00d866ea41a2 P ec71ef77a55848a0add75a6c104cc9a9 [term 1 LEADER]: Becoming Leader. State: Replica: ec71ef77a55848a0add75a6c104cc9a9, State: Running, Role: LEADER
I20260709 14:55:24.565361 18364 consensus_queue.cc:237] T 8c253d3492704370910e00d866ea41a2 P ec71ef77a55848a0add75a6c104cc9a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:24.569275 18382 leader_election.cc:290] T e68e41550ad240f5842867f3c8b8604d P ec71ef77a55848a0add75a6c104cc9a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f75b4aa933fd4b8c82ea07567024882c (127.6.101.65:40449), 95234c5b69eb4fe4a7558e56eedbe71a (127.6.101.66:42897)
I20260709 14:55:24.571010 18357 tablet_bootstrap.cc:654] T 11525d1d42074736bf180ebaafed1e98 P f75b4aa933fd4b8c82ea07567024882c: Neither blocks nor log segments found. Creating new log.
I20260709 14:55:24.571777 18238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e68e41550ad240f5842867f3c8b8604d" candidate_uuid: "ec71ef77a55848a0add75a6c104cc9a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" is_pre_election: true
W20260709 14:55:24.574460 18278 leader_election.cc:343] T e68e41550ad240f5842867f3c8b8604d P ec71ef77a55848a0add75a6c104cc9a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95234c5b69eb4fe4a7558e56eedbe71a (127.6.101.66:42897): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:55:24.575037 18278 leader_election.cc:304] T e68e41550ad240f5842867f3c8b8604d P ec71ef77a55848a0add75a6c104cc9a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec71ef77a55848a0add75a6c104cc9a9; no voters: 95234c5b69eb4fe4a7558e56eedbe71a, f75b4aa933fd4b8c82ea07567024882c
I20260709 14:55:24.576928 18060 catalog_manager.cc:5697] T 8c253d3492704370910e00d866ea41a2 P ec71ef77a55848a0add75a6c104cc9a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to ec71ef77a55848a0add75a6c104cc9a9 (127.6.101.67). New cstate: current_term: 1 leader_uuid: "ec71ef77a55848a0add75a6c104cc9a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } health_report { overall_health: HEALTHY } } }
I20260709 14:55:24.578629 18382 raft_consensus.cc:2749] T e68e41550ad240f5842867f3c8b8604d P ec71ef77a55848a0add75a6c104cc9a9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:55:24.586488 18163 raft_consensus.cc:2468] T 8c253d3492704370910e00d866ea41a2 P f75b4aa933fd4b8c82ea07567024882c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec71ef77a55848a0add75a6c104cc9a9 in term 1.
I20260709 14:55:24.585458 18162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ae10cc8d774889b54c598119fa0deb" candidate_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f75b4aa933fd4b8c82ea07567024882c" is_pre_election: true
I20260709 14:55:24.590605 18356 tablet_bootstrap.cc:492] T 528cd6046e1f4e7e8cc77f09c4578612 P 95234c5b69eb4fe4a7558e56eedbe71a: No bootstrap required, opened a new log
I20260709 14:55:24.590893 18162 raft_consensus.cc:2468] T f2ae10cc8d774889b54c598119fa0deb P f75b4aa933fd4b8c82ea07567024882c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95234c5b69eb4fe4a7558e56eedbe71a in term 0.
I20260709 14:55:24.591554 18356 ts_tablet_manager.cc:1403] T 528cd6046e1f4e7e8cc77f09c4578612 P 95234c5b69eb4fe4a7558e56eedbe71a: Time spent bootstrapping tablet: real 0.079s	user 0.033s	sys 0.039s
I20260709 14:55:24.593113 18357 tablet_bootstrap.cc:492] T 11525d1d42074736bf180ebaafed1e98 P f75b4aa933fd4b8c82ea07567024882c: No bootstrap required, opened a new log
I20260709 14:55:24.593765 18357 ts_tablet_manager.cc:1403] T 11525d1d42074736bf180ebaafed1e98 P f75b4aa933fd4b8c82ea07567024882c: Time spent bootstrapping tablet: real 0.044s	user 0.016s	sys 0.004s
I20260709 14:55:24.594743 18202 leader_election.cc:304] T f2ae10cc8d774889b54c598119fa0deb P 95234c5b69eb4fe4a7558e56eedbe71a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95234c5b69eb4fe4a7558e56eedbe71a, f75b4aa933fd4b8c82ea07567024882c; no voters: ec71ef77a55848a0add75a6c104cc9a9
I20260709 14:55:24.595548 18356 raft_consensus.cc:359] T 528cd6046e1f4e7e8cc77f09c4578612 P 95234c5b69eb4fe4a7558e56eedbe71a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:24.596047 18378 raft_consensus.cc:2804] T f2ae10cc8d774889b54c598119fa0deb P 95234c5b69eb4fe4a7558e56eedbe71a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:55:24.596572 18356 raft_consensus.cc:385] T 528cd6046e1f4e7e8cc77f09c4578612 P 95234c5b69eb4fe4a7558e56eedbe71a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:55:24.596957 18378 raft_consensus.cc:493] T f2ae10cc8d774889b54c598119fa0deb P 95234c5b69eb4fe4a7558e56eedbe71a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:55:24.597029 18356 raft_consensus.cc:740] T 528cd6046e1f4e7e8cc77f09c4578612 P 95234c5b69eb4fe4a7558e56eedbe71a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95234c5b69eb4fe4a7558e56eedbe71a, State: Initialized, Role: FOLLOWER
I20260709 14:55:24.597679 18378 raft_consensus.cc:3060] T f2ae10cc8d774889b54c598119fa0deb P 95234c5b69eb4fe4a7558e56eedbe71a [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:55:24.598526 18356 consensus_queue.cc:260] T 528cd6046e1f4e7e8cc77f09c4578612 P 95234c5b69eb4fe4a7558e56eedbe71a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:24.589416 18358 tablet_bootstrap.cc:654] T 1f97050ecf494124a1ef8f3a359d6fd4 P ec71ef77a55848a0add75a6c104cc9a9: Neither blocks nor log segments found. Creating new log.
I20260709 14:55:24.606382 18363 raft_consensus.cc:493] T b2b20170ec59458c9b9a18ca1e2a34d6 P f75b4aa933fd4b8c82ea07567024882c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:55:24.606495 18356 ts_tablet_manager.cc:1434] T 528cd6046e1f4e7e8cc77f09c4578612 P 95234c5b69eb4fe4a7558e56eedbe71a: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.000s
I20260709 14:55:24.607157 18363 raft_consensus.cc:515] T b2b20170ec59458c9b9a18ca1e2a34d6 P f75b4aa933fd4b8c82ea07567024882c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:24.608079 18356 tablet_bootstrap.cc:492] T b2b20170ec59458c9b9a18ca1e2a34d6 P 95234c5b69eb4fe4a7558e56eedbe71a: Bootstrap starting.
I20260709 14:55:24.612862 18378 raft_consensus.cc:515] T f2ae10cc8d774889b54c598119fa0deb P 95234c5b69eb4fe4a7558e56eedbe71a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:24.616456 18363 leader_election.cc:290] T b2b20170ec59458c9b9a18ca1e2a34d6 P f75b4aa933fd4b8c82ea07567024882c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95234c5b69eb4fe4a7558e56eedbe71a (127.6.101.66:42897), ec71ef77a55848a0add75a6c104cc9a9 (127.6.101.67:42661)
I20260709 14:55:24.620769 18356 tablet_bootstrap.cc:654] T b2b20170ec59458c9b9a18ca1e2a34d6 P 95234c5b69eb4fe4a7558e56eedbe71a: Neither blocks nor log segments found. Creating new log.
I20260709 14:55:24.624913 18163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ae10cc8d774889b54c598119fa0deb" candidate_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f75b4aa933fd4b8c82ea07567024882c"
I20260709 14:55:24.622577 18378 leader_election.cc:290] T f2ae10cc8d774889b54c598119fa0deb P 95234c5b69eb4fe4a7558e56eedbe71a [CANDIDATE]: Term 1 election: Requested vote from peers f75b4aa933fd4b8c82ea07567024882c (127.6.101.65:40449), ec71ef77a55848a0add75a6c104cc9a9 (127.6.101.67:42661)
I20260709 14:55:24.626027 18163 raft_consensus.cc:3060] T f2ae10cc8d774889b54c598119fa0deb P f75b4aa933fd4b8c82ea07567024882c [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:55:24.633837 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ae10cc8d774889b54c598119fa0deb" candidate_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec71ef77a55848a0add75a6c104cc9a9"
W20260709 14:55:24.635967 18202 leader_election.cc:343] T f2ae10cc8d774889b54c598119fa0deb P 95234c5b69eb4fe4a7558e56eedbe71a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ec71ef77a55848a0add75a6c104cc9a9 (127.6.101.67:42661): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:55:24.640939 18163 raft_consensus.cc:2468] T f2ae10cc8d774889b54c598119fa0deb P f75b4aa933fd4b8c82ea07567024882c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95234c5b69eb4fe4a7558e56eedbe71a in term 1.
I20260709 14:55:24.596860 18357 raft_consensus.cc:359] T 11525d1d42074736bf180ebaafed1e98 P f75b4aa933fd4b8c82ea07567024882c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:24.642699 18202 leader_election.cc:304] T f2ae10cc8d774889b54c598119fa0deb P 95234c5b69eb4fe4a7558e56eedbe71a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95234c5b69eb4fe4a7558e56eedbe71a, f75b4aa933fd4b8c82ea07567024882c; no voters: ec71ef77a55848a0add75a6c104cc9a9
I20260709 14:55:24.643848 18378 raft_consensus.cc:2804] T f2ae10cc8d774889b54c598119fa0deb P 95234c5b69eb4fe4a7558e56eedbe71a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:55:24.644411 18378 raft_consensus.cc:697] T f2ae10cc8d774889b54c598119fa0deb P 95234c5b69eb4fe4a7558e56eedbe71a [term 1 LEADER]: Becoming Leader. State: Replica: 95234c5b69eb4fe4a7558e56eedbe71a, State: Running, Role: LEADER
I20260709 14:55:24.644892 18356 tablet_bootstrap.cc:492] T b2b20170ec59458c9b9a18ca1e2a34d6 P 95234c5b69eb4fe4a7558e56eedbe71a: No bootstrap required, opened a new log
I20260709 14:55:24.645642 18356 ts_tablet_manager.cc:1403] T b2b20170ec59458c9b9a18ca1e2a34d6 P 95234c5b69eb4fe4a7558e56eedbe71a: Time spent bootstrapping tablet: real 0.038s	user 0.017s	sys 0.012s
I20260709 14:55:24.645411 18378 consensus_queue.cc:237] T f2ae10cc8d774889b54c598119fa0deb P 95234c5b69eb4fe4a7558e56eedbe71a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:24.642320 18357 raft_consensus.cc:385] T 11525d1d42074736bf180ebaafed1e98 P f75b4aa933fd4b8c82ea07567024882c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:55:24.649537 18357 raft_consensus.cc:740] T 11525d1d42074736bf180ebaafed1e98 P f75b4aa933fd4b8c82ea07567024882c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f75b4aa933fd4b8c82ea07567024882c, State: Initialized, Role: FOLLOWER
I20260709 14:55:24.649816 18356 raft_consensus.cc:359] T b2b20170ec59458c9b9a18ca1e2a34d6 P 95234c5b69eb4fe4a7558e56eedbe71a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:24.650873 18356 raft_consensus.cc:385] T b2b20170ec59458c9b9a18ca1e2a34d6 P 95234c5b69eb4fe4a7558e56eedbe71a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:55:24.651093 18357 consensus_queue.cc:260] T 11525d1d42074736bf180ebaafed1e98 P f75b4aa933fd4b8c82ea07567024882c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:24.655310 18358 tablet_bootstrap.cc:492] T 1f97050ecf494124a1ef8f3a359d6fd4 P ec71ef77a55848a0add75a6c104cc9a9: No bootstrap required, opened a new log
I20260709 14:55:24.656126 18358 ts_tablet_manager.cc:1403] T 1f97050ecf494124a1ef8f3a359d6fd4 P ec71ef77a55848a0add75a6c104cc9a9: Time spent bootstrapping tablet: real 0.119s	user 0.006s	sys 0.024s
I20260709 14:55:24.657624 18357 ts_tablet_manager.cc:1434] T 11525d1d42074736bf180ebaafed1e98 P f75b4aa933fd4b8c82ea07567024882c: Time spent starting tablet: real 0.064s	user 0.008s	sys 0.002s
I20260709 14:55:24.659083 18357 tablet_bootstrap.cc:492] T 528cd6046e1f4e7e8cc77f09c4578612 P f75b4aa933fd4b8c82ea07567024882c: Bootstrap starting.
I20260709 14:55:24.660552 18238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b20170ec59458c9b9a18ca1e2a34d6" candidate_uuid: "f75b4aa933fd4b8c82ea07567024882c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" is_pre_election: true
I20260709 14:55:24.663757 18358 raft_consensus.cc:359] T 1f97050ecf494124a1ef8f3a359d6fd4 P ec71ef77a55848a0add75a6c104cc9a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:24.664899 18358 raft_consensus.cc:385] T 1f97050ecf494124a1ef8f3a359d6fd4 P ec71ef77a55848a0add75a6c104cc9a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:55:24.665295 18358 raft_consensus.cc:740] T 1f97050ecf494124a1ef8f3a359d6fd4 P ec71ef77a55848a0add75a6c104cc9a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec71ef77a55848a0add75a6c104cc9a9, State: Initialized, Role: FOLLOWER
I20260709 14:55:24.651278 18356 raft_consensus.cc:740] T b2b20170ec59458c9b9a18ca1e2a34d6 P 95234c5b69eb4fe4a7558e56eedbe71a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95234c5b69eb4fe4a7558e56eedbe71a, State: Initialized, Role: FOLLOWER
I20260709 14:55:24.668386 18356 consensus_queue.cc:260] T b2b20170ec59458c9b9a18ca1e2a34d6 P 95234c5b69eb4fe4a7558e56eedbe71a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:24.669595 18238 raft_consensus.cc:2468] T b2b20170ec59458c9b9a18ca1e2a34d6 P 95234c5b69eb4fe4a7558e56eedbe71a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f75b4aa933fd4b8c82ea07567024882c in term 0.
I20260709 14:55:24.671167 18356 ts_tablet_manager.cc:1434] T b2b20170ec59458c9b9a18ca1e2a34d6 P 95234c5b69eb4fe4a7558e56eedbe71a: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.004s
I20260709 14:55:24.672144 18129 leader_election.cc:304] T b2b20170ec59458c9b9a18ca1e2a34d6 P f75b4aa933fd4b8c82ea07567024882c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95234c5b69eb4fe4a7558e56eedbe71a, f75b4aa933fd4b8c82ea07567024882c; no voters: 
I20260709 14:55:24.672474 18356 tablet_bootstrap.cc:492] T 1f97050ecf494124a1ef8f3a359d6fd4 P 95234c5b69eb4fe4a7558e56eedbe71a: Bootstrap starting.
I20260709 14:55:24.673883 18363 raft_consensus.cc:2804] T b2b20170ec59458c9b9a18ca1e2a34d6 P f75b4aa933fd4b8c82ea07567024882c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:55:24.673849 18358 consensus_queue.cc:260] T 1f97050ecf494124a1ef8f3a359d6fd4 P ec71ef77a55848a0add75a6c104cc9a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:24.674764 18363 raft_consensus.cc:493] T b2b20170ec59458c9b9a18ca1e2a34d6 P f75b4aa933fd4b8c82ea07567024882c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:55:24.675328 18363 raft_consensus.cc:3060] T b2b20170ec59458c9b9a18ca1e2a34d6 P f75b4aa933fd4b8c82ea07567024882c [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:55:24.677166 18358 ts_tablet_manager.cc:1434] T 1f97050ecf494124a1ef8f3a359d6fd4 P ec71ef77a55848a0add75a6c104cc9a9: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.003s
I20260709 14:55:24.672593 18060 catalog_manager.cc:5697] T f2ae10cc8d774889b54c598119fa0deb P 95234c5b69eb4fe4a7558e56eedbe71a reported cstate change: term changed from 0 to 1, leader changed from <none> to 95234c5b69eb4fe4a7558e56eedbe71a (127.6.101.66). New cstate: current_term: 1 leader_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } health_report { overall_health: UNKNOWN } } }
I20260709 14:55:24.679054 18358 tablet_bootstrap.cc:492] T bf34b3256cdf42dbaf4cad11d1a42160 P ec71ef77a55848a0add75a6c104cc9a9: Bootstrap starting.
I20260709 14:55:24.683879 18356 tablet_bootstrap.cc:654] T 1f97050ecf494124a1ef8f3a359d6fd4 P 95234c5b69eb4fe4a7558e56eedbe71a: Neither blocks nor log segments found. Creating new log.
I20260709 14:55:24.687379 18358 tablet_bootstrap.cc:654] T bf34b3256cdf42dbaf4cad11d1a42160 P ec71ef77a55848a0add75a6c104cc9a9: Neither blocks nor log segments found. Creating new log.
I20260709 14:55:24.695416 18358 tablet_bootstrap.cc:492] T bf34b3256cdf42dbaf4cad11d1a42160 P ec71ef77a55848a0add75a6c104cc9a9: No bootstrap required, opened a new log
I20260709 14:55:24.696436 18358 ts_tablet_manager.cc:1403] T bf34b3256cdf42dbaf4cad11d1a42160 P ec71ef77a55848a0add75a6c104cc9a9: Time spent bootstrapping tablet: real 0.018s	user 0.012s	sys 0.004s
I20260709 14:55:24.696725 18356 tablet_bootstrap.cc:492] T 1f97050ecf494124a1ef8f3a359d6fd4 P 95234c5b69eb4fe4a7558e56eedbe71a: No bootstrap required, opened a new log
I20260709 14:55:24.697642 18356 ts_tablet_manager.cc:1403] T 1f97050ecf494124a1ef8f3a359d6fd4 P 95234c5b69eb4fe4a7558e56eedbe71a: Time spent bootstrapping tablet: real 0.025s	user 0.013s	sys 0.006s
I20260709 14:55:24.701532 18358 raft_consensus.cc:359] T bf34b3256cdf42dbaf4cad11d1a42160 P ec71ef77a55848a0add75a6c104cc9a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:24.702080 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b20170ec59458c9b9a18ca1e2a34d6" candidate_uuid: "f75b4aa933fd4b8c82ea07567024882c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec71ef77a55848a0add75a6c104cc9a9" is_pre_election: true
I20260709 14:55:24.703020 18358 raft_consensus.cc:385] T bf34b3256cdf42dbaf4cad11d1a42160 P ec71ef77a55848a0add75a6c104cc9a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:55:24.703233 18312 raft_consensus.cc:2468] T b2b20170ec59458c9b9a18ca1e2a34d6 P ec71ef77a55848a0add75a6c104cc9a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f75b4aa933fd4b8c82ea07567024882c in term 0.
I20260709 14:55:24.703640 18358 raft_consensus.cc:740] T bf34b3256cdf42dbaf4cad11d1a42160 P ec71ef77a55848a0add75a6c104cc9a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec71ef77a55848a0add75a6c104cc9a9, State: Initialized, Role: FOLLOWER
I20260709 14:55:24.701648 18356 raft_consensus.cc:359] T 1f97050ecf494124a1ef8f3a359d6fd4 P 95234c5b69eb4fe4a7558e56eedbe71a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:24.704412 18356 raft_consensus.cc:385] T 1f97050ecf494124a1ef8f3a359d6fd4 P 95234c5b69eb4fe4a7558e56eedbe71a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:55:24.704789 18356 raft_consensus.cc:740] T 1f97050ecf494124a1ef8f3a359d6fd4 P 95234c5b69eb4fe4a7558e56eedbe71a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95234c5b69eb4fe4a7558e56eedbe71a, State: Initialized, Role: FOLLOWER
I20260709 14:55:24.704948 18358 consensus_queue.cc:260] T bf34b3256cdf42dbaf4cad11d1a42160 P ec71ef77a55848a0add75a6c104cc9a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:24.709710 18363 raft_consensus.cc:515] T b2b20170ec59458c9b9a18ca1e2a34d6 P f75b4aa933fd4b8c82ea07567024882c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:24.714018 18238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b20170ec59458c9b9a18ca1e2a34d6" candidate_uuid: "f75b4aa933fd4b8c82ea07567024882c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95234c5b69eb4fe4a7558e56eedbe71a"
I20260709 14:55:24.714097 18357 tablet_bootstrap.cc:654] T 528cd6046e1f4e7e8cc77f09c4578612 P f75b4aa933fd4b8c82ea07567024882c: Neither blocks nor log segments found. Creating new log.
I20260709 14:55:24.715845 18238 raft_consensus.cc:3060] T b2b20170ec59458c9b9a18ca1e2a34d6 P 95234c5b69eb4fe4a7558e56eedbe71a [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:55:24.715593 18356 consensus_queue.cc:260] T 1f97050ecf494124a1ef8f3a359d6fd4 P 95234c5b69eb4fe4a7558e56eedbe71a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:24.715618 18378 raft_consensus.cc:493] T bf34b3256cdf42dbaf4cad11d1a42160 P 95234c5b69eb4fe4a7558e56eedbe71a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:55:24.720427 18363 leader_election.cc:290] T b2b20170ec59458c9b9a18ca1e2a34d6 P f75b4aa933fd4b8c82ea07567024882c [CANDIDATE]: Term 1 election: Requested vote from peers 95234c5b69eb4fe4a7558e56eedbe71a (127.6.101.66:42897), ec71ef77a55848a0add75a6c104cc9a9 (127.6.101.67:42661)
I20260709 14:55:24.720062 18378 raft_consensus.cc:515] T bf34b3256cdf42dbaf4cad11d1a42160 P 95234c5b69eb4fe4a7558e56eedbe71a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:24.721189 18363 raft_consensus.cc:493] T 11525d1d42074736bf180ebaafed1e98 P f75b4aa933fd4b8c82ea07567024882c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:55:24.721701 18363 raft_consensus.cc:515] T 11525d1d42074736bf180ebaafed1e98 P f75b4aa933fd4b8c82ea07567024882c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:24.723548 18378 leader_election.cc:290] T bf34b3256cdf42dbaf4cad11d1a42160 P 95234c5b69eb4fe4a7558e56eedbe71a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f75b4aa933fd4b8c82ea07567024882c (127.6.101.65:40449), ec71ef77a55848a0add75a6c104cc9a9 (127.6.101.67:42661)
I20260709 14:55:24.725634 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11525d1d42074736bf180ebaafed1e98" candidate_uuid: "f75b4aa933fd4b8c82ea07567024882c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" is_pre_election: true
I20260709 14:55:24.726236 18163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf34b3256cdf42dbaf4cad11d1a42160" candidate_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f75b4aa933fd4b8c82ea07567024882c" is_pre_election: true
I20260709 14:55:24.727193 18163 raft_consensus.cc:2468] T bf34b3256cdf42dbaf4cad11d1a42160 P f75b4aa933fd4b8c82ea07567024882c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95234c5b69eb4fe4a7558e56eedbe71a in term 0.
I20260709 14:55:24.728022 18356 ts_tablet_manager.cc:1434] T 1f97050ecf494124a1ef8f3a359d6fd4 P 95234c5b69eb4fe4a7558e56eedbe71a: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.003s
W20260709 14:55:24.728193 18129 leader_election.cc:343] T 11525d1d42074736bf180ebaafed1e98 P f75b4aa933fd4b8c82ea07567024882c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95234c5b69eb4fe4a7558e56eedbe71a (127.6.101.66:42897): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:55:24.728787 18202 leader_election.cc:304] T bf34b3256cdf42dbaf4cad11d1a42160 P 95234c5b69eb4fe4a7558e56eedbe71a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95234c5b69eb4fe4a7558e56eedbe71a, f75b4aa933fd4b8c82ea07567024882c; no voters: 
I20260709 14:55:24.729890 18378 raft_consensus.cc:2804] T bf34b3256cdf42dbaf4cad11d1a42160 P 95234c5b69eb4fe4a7558e56eedbe71a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:55:24.730276 18378 raft_consensus.cc:493] T bf34b3256cdf42dbaf4cad11d1a42160 P 95234c5b69eb4fe4a7558e56eedbe71a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:55:24.730508 18363 leader_election.cc:290] T 11525d1d42074736bf180ebaafed1e98 P f75b4aa933fd4b8c82ea07567024882c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95234c5b69eb4fe4a7558e56eedbe71a (127.6.101.66:42897), ec71ef77a55848a0add75a6c104cc9a9 (127.6.101.67:42661)
I20260709 14:55:24.730705 18378 raft_consensus.cc:3060] T bf34b3256cdf42dbaf4cad11d1a42160 P 95234c5b69eb4fe4a7558e56eedbe71a [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:55:24.732825 18356 tablet_bootstrap.cc:492] T 11525d1d42074736bf180ebaafed1e98 P 95234c5b69eb4fe4a7558e56eedbe71a: Bootstrap starting.
I20260709 14:55:24.726651 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf34b3256cdf42dbaf4cad11d1a42160" candidate_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec71ef77a55848a0add75a6c104cc9a9" is_pre_election: true
I20260709 14:55:24.734228 18312 raft_consensus.cc:2468] T bf34b3256cdf42dbaf4cad11d1a42160 P ec71ef77a55848a0add75a6c104cc9a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95234c5b69eb4fe4a7558e56eedbe71a in term 0.
I20260709 14:55:24.737452 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b20170ec59458c9b9a18ca1e2a34d6" candidate_uuid: "f75b4aa933fd4b8c82ea07567024882c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec71ef77a55848a0add75a6c104cc9a9"
I20260709 14:55:24.738114 18312 raft_consensus.cc:3060] T b2b20170ec59458c9b9a18ca1e2a34d6 P ec71ef77a55848a0add75a6c104cc9a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:55:24.742120 18356 tablet_bootstrap.cc:654] T 11525d1d42074736bf180ebaafed1e98 P 95234c5b69eb4fe4a7558e56eedbe71a: Neither blocks nor log segments found. Creating new log.
I20260709 14:55:24.742162 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11525d1d42074736bf180ebaafed1e98" candidate_uuid: "f75b4aa933fd4b8c82ea07567024882c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec71ef77a55848a0add75a6c104cc9a9" is_pre_election: true
I20260709 14:55:24.744938 18238 raft_consensus.cc:2468] T b2b20170ec59458c9b9a18ca1e2a34d6 P 95234c5b69eb4fe4a7558e56eedbe71a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f75b4aa933fd4b8c82ea07567024882c in term 1.
I20260709 14:55:24.746789 18129 leader_election.cc:304] T b2b20170ec59458c9b9a18ca1e2a34d6 P f75b4aa933fd4b8c82ea07567024882c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95234c5b69eb4fe4a7558e56eedbe71a, f75b4aa933fd4b8c82ea07567024882c; no voters: 
W20260709 14:55:24.747450 18127 leader_election.cc:343] T 11525d1d42074736bf180ebaafed1e98 P f75b4aa933fd4b8c82ea07567024882c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ec71ef77a55848a0add75a6c104cc9a9 (127.6.101.67:42661): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:55:24.748008 18363 raft_consensus.cc:2804] T b2b20170ec59458c9b9a18ca1e2a34d6 P f75b4aa933fd4b8c82ea07567024882c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:55:24.748556 18127 leader_election.cc:304] T 11525d1d42074736bf180ebaafed1e98 P f75b4aa933fd4b8c82ea07567024882c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f75b4aa933fd4b8c82ea07567024882c; no voters: 95234c5b69eb4fe4a7558e56eedbe71a, ec71ef77a55848a0add75a6c104cc9a9
I20260709 14:55:24.748735 18363 raft_consensus.cc:697] T b2b20170ec59458c9b9a18ca1e2a34d6 P f75b4aa933fd4b8c82ea07567024882c [term 1 LEADER]: Becoming Leader. State: Replica: f75b4aa933fd4b8c82ea07567024882c, State: Running, Role: LEADER
I20260709 14:55:24.749684 18378 raft_consensus.cc:515] T bf34b3256cdf42dbaf4cad11d1a42160 P 95234c5b69eb4fe4a7558e56eedbe71a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:24.751552 18358 ts_tablet_manager.cc:1434] T bf34b3256cdf42dbaf4cad11d1a42160 P ec71ef77a55848a0add75a6c104cc9a9: Time spent starting tablet: real 0.055s	user 0.007s	sys 0.003s
I20260709 14:55:24.754240 18378 leader_election.cc:290] T bf34b3256cdf42dbaf4cad11d1a42160 P 95234c5b69eb4fe4a7558e56eedbe71a [CANDIDATE]: Term 1 election: Requested vote from peers f75b4aa933fd4b8c82ea07567024882c (127.6.101.65:40449), ec71ef77a55848a0add75a6c104cc9a9 (127.6.101.67:42661)
I20260709 14:55:24.755482 18357 tablet_bootstrap.cc:492] T 528cd6046e1f4e7e8cc77f09c4578612 P f75b4aa933fd4b8c82ea07567024882c: No bootstrap required, opened a new log
I20260709 14:55:24.755925 18163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf34b3256cdf42dbaf4cad11d1a42160" candidate_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f75b4aa933fd4b8c82ea07567024882c"
I20260709 14:55:24.756263 18358 tablet_bootstrap.cc:492] T 11525d1d42074736bf180ebaafed1e98 P ec71ef77a55848a0add75a6c104cc9a9: Bootstrap starting.
I20260709 14:55:24.756717 18163 raft_consensus.cc:3060] T bf34b3256cdf42dbaf4cad11d1a42160 P f75b4aa933fd4b8c82ea07567024882c [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:55:24.759150 18312 raft_consensus.cc:2468] T b2b20170ec59458c9b9a18ca1e2a34d6 P ec71ef77a55848a0add75a6c104cc9a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f75b4aa933fd4b8c82ea07567024882c in term 1.
I20260709 14:55:24.761461 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf34b3256cdf42dbaf4cad11d1a42160" candidate_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec71ef77a55848a0add75a6c104cc9a9"
I20260709 14:55:24.756222 18357 ts_tablet_manager.cc:1403] T 528cd6046e1f4e7e8cc77f09c4578612 P f75b4aa933fd4b8c82ea07567024882c: Time spent bootstrapping tablet: real 0.097s	user 0.011s	sys 0.005s
I20260709 14:55:24.763293 18311 raft_consensus.cc:3060] T bf34b3256cdf42dbaf4cad11d1a42160 P ec71ef77a55848a0add75a6c104cc9a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:55:24.765710 18363 consensus_queue.cc:237] T b2b20170ec59458c9b9a18ca1e2a34d6 P f75b4aa933fd4b8c82ea07567024882c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:24.768356 18357 raft_consensus.cc:359] T 528cd6046e1f4e7e8cc77f09c4578612 P f75b4aa933fd4b8c82ea07567024882c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:24.771029 18357 raft_consensus.cc:385] T 528cd6046e1f4e7e8cc77f09c4578612 P f75b4aa933fd4b8c82ea07567024882c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:55:24.771406 18357 raft_consensus.cc:740] T 528cd6046e1f4e7e8cc77f09c4578612 P f75b4aa933fd4b8c82ea07567024882c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f75b4aa933fd4b8c82ea07567024882c, State: Initialized, Role: FOLLOWER
I20260709 14:55:24.773021 18357 consensus_queue.cc:260] T 528cd6046e1f4e7e8cc77f09c4578612 P f75b4aa933fd4b8c82ea07567024882c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:24.780845 18163 raft_consensus.cc:2468] T bf34b3256cdf42dbaf4cad11d1a42160 P f75b4aa933fd4b8c82ea07567024882c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95234c5b69eb4fe4a7558e56eedbe71a in term 1.
I20260709 14:55:24.775812 18358 tablet_bootstrap.cc:654] T 11525d1d42074736bf180ebaafed1e98 P ec71ef77a55848a0add75a6c104cc9a9: Neither blocks nor log segments found. Creating new log.
I20260709 14:55:24.782919 18397 raft_consensus.cc:2749] T 11525d1d42074736bf180ebaafed1e98 P f75b4aa933fd4b8c82ea07567024882c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:55:24.785400 18202 leader_election.cc:304] T bf34b3256cdf42dbaf4cad11d1a42160 P 95234c5b69eb4fe4a7558e56eedbe71a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95234c5b69eb4fe4a7558e56eedbe71a, f75b4aa933fd4b8c82ea07567024882c; no voters: 
I20260709 14:55:24.787845 18378 raft_consensus.cc:2804] T bf34b3256cdf42dbaf4cad11d1a42160 P 95234c5b69eb4fe4a7558e56eedbe71a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:55:24.788298 18378 raft_consensus.cc:697] T bf34b3256cdf42dbaf4cad11d1a42160 P 95234c5b69eb4fe4a7558e56eedbe71a [term 1 LEADER]: Becoming Leader. State: Replica: 95234c5b69eb4fe4a7558e56eedbe71a, State: Running, Role: LEADER
I20260709 14:55:24.788522 18357 ts_tablet_manager.cc:1434] T 528cd6046e1f4e7e8cc77f09c4578612 P f75b4aa933fd4b8c82ea07567024882c: Time spent starting tablet: real 0.025s	user 0.011s	sys 0.009s
I20260709 14:55:24.789901 18357 tablet_bootstrap.cc:492] T 1f97050ecf494124a1ef8f3a359d6fd4 P f75b4aa933fd4b8c82ea07567024882c: Bootstrap starting.
I20260709 14:55:24.789333 18378 consensus_queue.cc:237] T bf34b3256cdf42dbaf4cad11d1a42160 P 95234c5b69eb4fe4a7558e56eedbe71a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:24.794045 18400 raft_consensus.cc:493] T 39965dc306aa4828a74a07da020fe662 P f75b4aa933fd4b8c82ea07567024882c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:55:24.804517 18358 tablet_bootstrap.cc:492] T 11525d1d42074736bf180ebaafed1e98 P ec71ef77a55848a0add75a6c104cc9a9: No bootstrap required, opened a new log
I20260709 14:55:24.805277 18358 ts_tablet_manager.cc:1403] T 11525d1d42074736bf180ebaafed1e98 P ec71ef77a55848a0add75a6c104cc9a9: Time spent bootstrapping tablet: real 0.049s	user 0.017s	sys 0.000s
I20260709 14:55:24.795792 18400 raft_consensus.cc:515] T 39965dc306aa4828a74a07da020fe662 P f75b4aa933fd4b8c82ea07567024882c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:24.808545 18060 catalog_manager.cc:5697] T b2b20170ec59458c9b9a18ca1e2a34d6 P f75b4aa933fd4b8c82ea07567024882c reported cstate change: term changed from 0 to 1, leader changed from <none> to f75b4aa933fd4b8c82ea07567024882c (127.6.101.65). New cstate: current_term: 1 leader_uuid: "f75b4aa933fd4b8c82ea07567024882c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } health_report { overall_health: UNKNOWN } } }
I20260709 14:55:24.810878 18358 raft_consensus.cc:359] T 11525d1d42074736bf180ebaafed1e98 P ec71ef77a55848a0add75a6c104cc9a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:24.811805 18358 raft_consensus.cc:385] T 11525d1d42074736bf180ebaafed1e98 P ec71ef77a55848a0add75a6c104cc9a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:55:24.812160 18358 raft_consensus.cc:740] T 11525d1d42074736bf180ebaafed1e98 P ec71ef77a55848a0add75a6c104cc9a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec71ef77a55848a0add75a6c104cc9a9, State: Initialized, Role: FOLLOWER
I20260709 14:55:24.813090 18358 consensus_queue.cc:260] T 11525d1d42074736bf180ebaafed1e98 P ec71ef77a55848a0add75a6c104cc9a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:24.814052 18238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39965dc306aa4828a74a07da020fe662" candidate_uuid: "f75b4aa933fd4b8c82ea07567024882c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" is_pre_election: true
I20260709 14:55:24.814925 18238 raft_consensus.cc:2468] T 39965dc306aa4828a74a07da020fe662 P 95234c5b69eb4fe4a7558e56eedbe71a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f75b4aa933fd4b8c82ea07567024882c in term 0.
I20260709 14:55:24.810215 18357 tablet_bootstrap.cc:654] T 1f97050ecf494124a1ef8f3a359d6fd4 P f75b4aa933fd4b8c82ea07567024882c: Neither blocks nor log segments found. Creating new log.
I20260709 14:55:24.816409 18358 ts_tablet_manager.cc:1434] T 11525d1d42074736bf180ebaafed1e98 P ec71ef77a55848a0add75a6c104cc9a9: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.001s
I20260709 14:55:24.816465 18129 leader_election.cc:304] T 39965dc306aa4828a74a07da020fe662 P f75b4aa933fd4b8c82ea07567024882c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95234c5b69eb4fe4a7558e56eedbe71a, f75b4aa933fd4b8c82ea07567024882c; no voters: 
I20260709 14:55:24.818053 18363 raft_consensus.cc:2804] T 39965dc306aa4828a74a07da020fe662 P f75b4aa933fd4b8c82ea07567024882c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:55:24.818281 18358 tablet_bootstrap.cc:492] T 39965dc306aa4828a74a07da020fe662 P ec71ef77a55848a0add75a6c104cc9a9: Bootstrap starting.
I20260709 14:55:24.818620 18363 raft_consensus.cc:493] T 39965dc306aa4828a74a07da020fe662 P f75b4aa933fd4b8c82ea07567024882c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:55:24.809399 18311 raft_consensus.cc:2468] T bf34b3256cdf42dbaf4cad11d1a42160 P ec71ef77a55848a0add75a6c104cc9a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95234c5b69eb4fe4a7558e56eedbe71a in term 1.
I20260709 14:55:24.819280 18382 raft_consensus.cc:493] T 528cd6046e1f4e7e8cc77f09c4578612 P ec71ef77a55848a0add75a6c104cc9a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:55:24.820111 18382 raft_consensus.cc:515] T 528cd6046e1f4e7e8cc77f09c4578612 P ec71ef77a55848a0add75a6c104cc9a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:24.819531 18363 raft_consensus.cc:3060] T 39965dc306aa4828a74a07da020fe662 P f75b4aa933fd4b8c82ea07567024882c [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:55:24.824306 18356 tablet_bootstrap.cc:492] T 11525d1d42074736bf180ebaafed1e98 P 95234c5b69eb4fe4a7558e56eedbe71a: No bootstrap required, opened a new log
I20260709 14:55:24.825019 18356 ts_tablet_manager.cc:1403] T 11525d1d42074736bf180ebaafed1e98 P 95234c5b69eb4fe4a7558e56eedbe71a: Time spent bootstrapping tablet: real 0.093s	user 0.009s	sys 0.010s
I20260709 14:55:24.825168 18382 leader_election.cc:290] T 528cd6046e1f4e7e8cc77f09c4578612 P ec71ef77a55848a0add75a6c104cc9a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f75b4aa933fd4b8c82ea07567024882c (127.6.101.65:40449), 95234c5b69eb4fe4a7558e56eedbe71a (127.6.101.66:42897)
I20260709 14:55:24.826610 18163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528cd6046e1f4e7e8cc77f09c4578612" candidate_uuid: "ec71ef77a55848a0add75a6c104cc9a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f75b4aa933fd4b8c82ea07567024882c" is_pre_election: true
I20260709 14:55:24.827450 18163 raft_consensus.cc:2468] T 528cd6046e1f4e7e8cc77f09c4578612 P f75b4aa933fd4b8c82ea07567024882c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec71ef77a55848a0add75a6c104cc9a9 in term 0.
I20260709 14:55:24.828964 18276 leader_election.cc:304] T 528cd6046e1f4e7e8cc77f09c4578612 P ec71ef77a55848a0add75a6c104cc9a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ec71ef77a55848a0add75a6c104cc9a9, f75b4aa933fd4b8c82ea07567024882c; no voters: 
I20260709 14:55:24.829993 18382 raft_consensus.cc:2804] T 528cd6046e1f4e7e8cc77f09c4578612 P ec71ef77a55848a0add75a6c104cc9a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:55:24.829762 18356 raft_consensus.cc:359] T 11525d1d42074736bf180ebaafed1e98 P 95234c5b69eb4fe4a7558e56eedbe71a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:24.830432 18382 raft_consensus.cc:493] T 528cd6046e1f4e7e8cc77f09c4578612 P ec71ef77a55848a0add75a6c104cc9a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:55:24.830819 18382 raft_consensus.cc:3060] T 528cd6046e1f4e7e8cc77f09c4578612 P ec71ef77a55848a0add75a6c104cc9a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:55:24.832314 18238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528cd6046e1f4e7e8cc77f09c4578612" candidate_uuid: "ec71ef77a55848a0add75a6c104cc9a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" is_pre_election: true
I20260709 14:55:24.833868 18356 raft_consensus.cc:385] T 11525d1d42074736bf180ebaafed1e98 P 95234c5b69eb4fe4a7558e56eedbe71a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:55:24.834270 18356 raft_consensus.cc:740] T 11525d1d42074736bf180ebaafed1e98 P 95234c5b69eb4fe4a7558e56eedbe71a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95234c5b69eb4fe4a7558e56eedbe71a, State: Initialized, Role: FOLLOWER
I20260709 14:55:24.833709 18238 raft_consensus.cc:2468] T 528cd6046e1f4e7e8cc77f09c4578612 P 95234c5b69eb4fe4a7558e56eedbe71a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec71ef77a55848a0add75a6c104cc9a9 in term 0.
I20260709 14:55:24.836164 18356 consensus_queue.cc:260] T 11525d1d42074736bf180ebaafed1e98 P 95234c5b69eb4fe4a7558e56eedbe71a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:24.838745 18356 ts_tablet_manager.cc:1434] T 11525d1d42074736bf180ebaafed1e98 P 95234c5b69eb4fe4a7558e56eedbe71a: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 14:55:24.837100 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39965dc306aa4828a74a07da020fe662" candidate_uuid: "f75b4aa933fd4b8c82ea07567024882c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec71ef77a55848a0add75a6c104cc9a9" is_pre_election: true
W20260709 14:55:24.841032 18127 leader_election.cc:343] T 39965dc306aa4828a74a07da020fe662 P f75b4aa933fd4b8c82ea07567024882c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ec71ef77a55848a0add75a6c104cc9a9 (127.6.101.67:42661): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:55:24.842310 18358 tablet_bootstrap.cc:654] T 39965dc306aa4828a74a07da020fe662 P ec71ef77a55848a0add75a6c104cc9a9: Neither blocks nor log segments found. Creating new log.
I20260709 14:55:24.843923 18400 leader_election.cc:290] T 39965dc306aa4828a74a07da020fe662 P f75b4aa933fd4b8c82ea07567024882c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95234c5b69eb4fe4a7558e56eedbe71a (127.6.101.66:42897), ec71ef77a55848a0add75a6c104cc9a9 (127.6.101.67:42661)
I20260709 14:55:24.849839 18382 raft_consensus.cc:515] T 528cd6046e1f4e7e8cc77f09c4578612 P ec71ef77a55848a0add75a6c104cc9a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:24.851406 18363 raft_consensus.cc:515] T 39965dc306aa4828a74a07da020fe662 P f75b4aa933fd4b8c82ea07567024882c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:24.851156 18059 catalog_manager.cc:5697] T bf34b3256cdf42dbaf4cad11d1a42160 P 95234c5b69eb4fe4a7558e56eedbe71a reported cstate change: term changed from 0 to 1, leader changed from <none> to 95234c5b69eb4fe4a7558e56eedbe71a (127.6.101.66). New cstate: current_term: 1 leader_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } health_report { overall_health: UNKNOWN } } }
I20260709 14:55:24.854496 18356 tablet_bootstrap.cc:492] T e68e41550ad240f5842867f3c8b8604d P 95234c5b69eb4fe4a7558e56eedbe71a: Bootstrap starting.
I20260709 14:55:24.855595 18163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528cd6046e1f4e7e8cc77f09c4578612" candidate_uuid: "ec71ef77a55848a0add75a6c104cc9a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f75b4aa933fd4b8c82ea07567024882c"
I20260709 14:55:24.856408 18163 raft_consensus.cc:3060] T 528cd6046e1f4e7e8cc77f09c4578612 P f75b4aa933fd4b8c82ea07567024882c [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:55:24.856787 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39965dc306aa4828a74a07da020fe662" candidate_uuid: "f75b4aa933fd4b8c82ea07567024882c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec71ef77a55848a0add75a6c104cc9a9"
I20260709 14:55:24.858934 18363 leader_election.cc:290] T 39965dc306aa4828a74a07da020fe662 P f75b4aa933fd4b8c82ea07567024882c [CANDIDATE]: Term 1 election: Requested vote from peers 95234c5b69eb4fe4a7558e56eedbe71a (127.6.101.66:42897), ec71ef77a55848a0add75a6c104cc9a9 (127.6.101.67:42661)
W20260709 14:55:24.861195 18127 leader_election.cc:343] T 39965dc306aa4828a74a07da020fe662 P f75b4aa933fd4b8c82ea07567024882c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ec71ef77a55848a0add75a6c104cc9a9 (127.6.101.67:42661): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:55:24.862046 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39965dc306aa4828a74a07da020fe662" candidate_uuid: "f75b4aa933fd4b8c82ea07567024882c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95234c5b69eb4fe4a7558e56eedbe71a"
I20260709 14:55:24.862936 18237 raft_consensus.cc:3060] T 39965dc306aa4828a74a07da020fe662 P 95234c5b69eb4fe4a7558e56eedbe71a [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:55:24.865613 18356 tablet_bootstrap.cc:654] T e68e41550ad240f5842867f3c8b8604d P 95234c5b69eb4fe4a7558e56eedbe71a: Neither blocks nor log segments found. Creating new log.
I20260709 14:55:24.875519 18238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528cd6046e1f4e7e8cc77f09c4578612" candidate_uuid: "ec71ef77a55848a0add75a6c104cc9a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95234c5b69eb4fe4a7558e56eedbe71a"
I20260709 14:55:24.876410 18238 raft_consensus.cc:3060] T 528cd6046e1f4e7e8cc77f09c4578612 P 95234c5b69eb4fe4a7558e56eedbe71a [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:55:24.896868 18358 tablet_bootstrap.cc:492] T 39965dc306aa4828a74a07da020fe662 P ec71ef77a55848a0add75a6c104cc9a9: No bootstrap required, opened a new log
I20260709 14:55:24.898279 18358 ts_tablet_manager.cc:1403] T 39965dc306aa4828a74a07da020fe662 P ec71ef77a55848a0add75a6c104cc9a9: Time spent bootstrapping tablet: real 0.080s	user 0.024s	sys 0.019s
I20260709 14:55:24.899916 18364 raft_consensus.cc:493] T 1f97050ecf494124a1ef8f3a359d6fd4 P ec71ef77a55848a0add75a6c104cc9a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:55:24.900766 18364 raft_consensus.cc:515] T 1f97050ecf494124a1ef8f3a359d6fd4 P ec71ef77a55848a0add75a6c104cc9a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:24.906011 18163 raft_consensus.cc:2468] T 528cd6046e1f4e7e8cc77f09c4578612 P f75b4aa933fd4b8c82ea07567024882c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec71ef77a55848a0add75a6c104cc9a9 in term 1.
I20260709 14:55:24.906716 18162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f97050ecf494124a1ef8f3a359d6fd4" candidate_uuid: "ec71ef77a55848a0add75a6c104cc9a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f75b4aa933fd4b8c82ea07567024882c" is_pre_election: true
I20260709 14:55:24.910008 18364 leader_election.cc:290] T 1f97050ecf494124a1ef8f3a359d6fd4 P ec71ef77a55848a0add75a6c104cc9a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f75b4aa933fd4b8c82ea07567024882c (127.6.101.65:40449), 95234c5b69eb4fe4a7558e56eedbe71a (127.6.101.66:42897)
I20260709 14:55:24.910447 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f97050ecf494124a1ef8f3a359d6fd4" candidate_uuid: "ec71ef77a55848a0add75a6c104cc9a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" is_pre_election: true
I20260709 14:55:24.911923 18236 raft_consensus.cc:2468] T 1f97050ecf494124a1ef8f3a359d6fd4 P 95234c5b69eb4fe4a7558e56eedbe71a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec71ef77a55848a0add75a6c104cc9a9 in term 0.
I20260709 14:55:24.913435 18276 leader_election.cc:304] T 528cd6046e1f4e7e8cc77f09c4578612 P ec71ef77a55848a0add75a6c104cc9a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ec71ef77a55848a0add75a6c104cc9a9, f75b4aa933fd4b8c82ea07567024882c; no voters: 
I20260709 14:55:24.914330 18358 raft_consensus.cc:359] T 39965dc306aa4828a74a07da020fe662 P ec71ef77a55848a0add75a6c104cc9a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:24.915047 18278 leader_election.cc:304] T 1f97050ecf494124a1ef8f3a359d6fd4 P ec71ef77a55848a0add75a6c104cc9a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95234c5b69eb4fe4a7558e56eedbe71a, ec71ef77a55848a0add75a6c104cc9a9; no voters: 
I20260709 14:55:24.915102 18383 raft_consensus.cc:2804] T 528cd6046e1f4e7e8cc77f09c4578612 P ec71ef77a55848a0add75a6c104cc9a9 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 14:55:24.916790 18276 leader_election.cc:343] T 1f97050ecf494124a1ef8f3a359d6fd4 P ec71ef77a55848a0add75a6c104cc9a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f75b4aa933fd4b8c82ea07567024882c (127.6.101.65:40449): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:55:24.900740 18382 leader_election.cc:290] T 528cd6046e1f4e7e8cc77f09c4578612 P ec71ef77a55848a0add75a6c104cc9a9 [CANDIDATE]: Term 1 election: Requested vote from peers f75b4aa933fd4b8c82ea07567024882c (127.6.101.65:40449), 95234c5b69eb4fe4a7558e56eedbe71a (127.6.101.66:42897)
I20260709 14:55:24.918232 18364 raft_consensus.cc:2804] T 1f97050ecf494124a1ef8f3a359d6fd4 P ec71ef77a55848a0add75a6c104cc9a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:55:24.918685 18364 raft_consensus.cc:493] T 1f97050ecf494124a1ef8f3a359d6fd4 P ec71ef77a55848a0add75a6c104cc9a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:55:24.919014 18364 raft_consensus.cc:3060] T 1f97050ecf494124a1ef8f3a359d6fd4 P ec71ef77a55848a0add75a6c104cc9a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:55:24.921633 18238 raft_consensus.cc:2468] T 528cd6046e1f4e7e8cc77f09c4578612 P 95234c5b69eb4fe4a7558e56eedbe71a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec71ef77a55848a0add75a6c104cc9a9 in term 1.
I20260709 14:55:24.924758 18358 raft_consensus.cc:385] T 39965dc306aa4828a74a07da020fe662 P ec71ef77a55848a0add75a6c104cc9a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:55:24.922791 18237 raft_consensus.cc:2468] T 39965dc306aa4828a74a07da020fe662 P 95234c5b69eb4fe4a7558e56eedbe71a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f75b4aa933fd4b8c82ea07567024882c in term 1.
I20260709 14:55:24.924196 18383 raft_consensus.cc:697] T 528cd6046e1f4e7e8cc77f09c4578612 P ec71ef77a55848a0add75a6c104cc9a9 [term 1 LEADER]: Becoming Leader. State: Replica: ec71ef77a55848a0add75a6c104cc9a9, State: Running, Role: LEADER
I20260709 14:55:24.925427 18358 raft_consensus.cc:740] T 39965dc306aa4828a74a07da020fe662 P ec71ef77a55848a0add75a6c104cc9a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec71ef77a55848a0add75a6c104cc9a9, State: Initialized, Role: FOLLOWER
I20260709 14:55:24.926367 18383 consensus_queue.cc:237] T 528cd6046e1f4e7e8cc77f09c4578612 P ec71ef77a55848a0add75a6c104cc9a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:24.926757 18129 leader_election.cc:304] T 39965dc306aa4828a74a07da020fe662 P f75b4aa933fd4b8c82ea07567024882c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95234c5b69eb4fe4a7558e56eedbe71a, f75b4aa933fd4b8c82ea07567024882c; no voters: ec71ef77a55848a0add75a6c104cc9a9
I20260709 14:55:24.928556 18363 raft_consensus.cc:2804] T 39965dc306aa4828a74a07da020fe662 P f75b4aa933fd4b8c82ea07567024882c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:55:24.929754 18363 raft_consensus.cc:697] T 39965dc306aa4828a74a07da020fe662 P f75b4aa933fd4b8c82ea07567024882c [term 1 LEADER]: Becoming Leader. State: Replica: f75b4aa933fd4b8c82ea07567024882c, State: Running, Role: LEADER
I20260709 14:55:24.928876 18358 consensus_queue.cc:260] T 39965dc306aa4828a74a07da020fe662 P ec71ef77a55848a0add75a6c104cc9a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:24.932168 18363 consensus_queue.cc:237] T 39965dc306aa4828a74a07da020fe662 P f75b4aa933fd4b8c82ea07567024882c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:24.936203 18358 ts_tablet_manager.cc:1434] T 39965dc306aa4828a74a07da020fe662 P ec71ef77a55848a0add75a6c104cc9a9: Time spent starting tablet: real 0.037s	user 0.008s	sys 0.003s
I20260709 14:55:24.937897 18358 tablet_bootstrap.cc:492] T f2ae10cc8d774889b54c598119fa0deb P ec71ef77a55848a0add75a6c104cc9a9: Bootstrap starting.
I20260709 14:55:24.940426 18357 tablet_bootstrap.cc:492] T 1f97050ecf494124a1ef8f3a359d6fd4 P f75b4aa933fd4b8c82ea07567024882c: No bootstrap required, opened a new log
I20260709 14:55:24.941102 18357 ts_tablet_manager.cc:1403] T 1f97050ecf494124a1ef8f3a359d6fd4 P f75b4aa933fd4b8c82ea07567024882c: Time spent bootstrapping tablet: real 0.151s	user 0.050s	sys 0.020s
I20260709 14:55:24.947279 18356 tablet_bootstrap.cc:492] T e68e41550ad240f5842867f3c8b8604d P 95234c5b69eb4fe4a7558e56eedbe71a: No bootstrap required, opened a new log
I20260709 14:55:24.948078 18356 ts_tablet_manager.cc:1403] T e68e41550ad240f5842867f3c8b8604d P 95234c5b69eb4fe4a7558e56eedbe71a: Time spent bootstrapping tablet: real 0.094s	user 0.030s	sys 0.042s
I20260709 14:55:24.949460 18364 raft_consensus.cc:515] T 1f97050ecf494124a1ef8f3a359d6fd4 P ec71ef77a55848a0add75a6c104cc9a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:24.945195 18357 raft_consensus.cc:359] T 1f97050ecf494124a1ef8f3a359d6fd4 P f75b4aa933fd4b8c82ea07567024882c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:24.951184 18357 raft_consensus.cc:385] T 1f97050ecf494124a1ef8f3a359d6fd4 P f75b4aa933fd4b8c82ea07567024882c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:55:24.951500 18357 raft_consensus.cc:740] T 1f97050ecf494124a1ef8f3a359d6fd4 P f75b4aa933fd4b8c82ea07567024882c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f75b4aa933fd4b8c82ea07567024882c, State: Initialized, Role: FOLLOWER
I20260709 14:55:24.952682 18357 consensus_queue.cc:260] T 1f97050ecf494124a1ef8f3a359d6fd4 P f75b4aa933fd4b8c82ea07567024882c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:24.953063 18364 leader_election.cc:290] T 1f97050ecf494124a1ef8f3a359d6fd4 P ec71ef77a55848a0add75a6c104cc9a9 [CANDIDATE]: Term 1 election: Requested vote from peers f75b4aa933fd4b8c82ea07567024882c (127.6.101.65:40449), 95234c5b69eb4fe4a7558e56eedbe71a (127.6.101.66:42897)
I20260709 14:55:24.955418 18163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f97050ecf494124a1ef8f3a359d6fd4" candidate_uuid: "ec71ef77a55848a0add75a6c104cc9a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f75b4aa933fd4b8c82ea07567024882c"
I20260709 14:55:24.956123 18357 ts_tablet_manager.cc:1434] T 1f97050ecf494124a1ef8f3a359d6fd4 P f75b4aa933fd4b8c82ea07567024882c: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.002s
I20260709 14:55:24.955847 18238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f97050ecf494124a1ef8f3a359d6fd4" candidate_uuid: "ec71ef77a55848a0add75a6c104cc9a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95234c5b69eb4fe4a7558e56eedbe71a"
I20260709 14:55:24.956390 18163 raft_consensus.cc:3060] T 1f97050ecf494124a1ef8f3a359d6fd4 P f75b4aa933fd4b8c82ea07567024882c [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:55:24.957621 18238 raft_consensus.cc:3060] T 1f97050ecf494124a1ef8f3a359d6fd4 P 95234c5b69eb4fe4a7558e56eedbe71a [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:55:24.962589 18358 tablet_bootstrap.cc:654] T f2ae10cc8d774889b54c598119fa0deb P ec71ef77a55848a0add75a6c104cc9a9: Neither blocks nor log segments found. Creating new log.
I20260709 14:55:24.968662 18357 tablet_bootstrap.cc:492] T e68e41550ad240f5842867f3c8b8604d P f75b4aa933fd4b8c82ea07567024882c: Bootstrap starting.
I20260709 14:55:24.972743 18059 catalog_manager.cc:5697] T 528cd6046e1f4e7e8cc77f09c4578612 P ec71ef77a55848a0add75a6c104cc9a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to ec71ef77a55848a0add75a6c104cc9a9 (127.6.101.67). New cstate: current_term: 1 leader_uuid: "ec71ef77a55848a0add75a6c104cc9a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } health_report { overall_health: HEALTHY } } }
I20260709 14:55:24.974516 18238 raft_consensus.cc:2468] T 1f97050ecf494124a1ef8f3a359d6fd4 P 95234c5b69eb4fe4a7558e56eedbe71a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec71ef77a55848a0add75a6c104cc9a9 in term 1.
I20260709 14:55:24.967160 18356 raft_consensus.cc:359] T e68e41550ad240f5842867f3c8b8604d P 95234c5b69eb4fe4a7558e56eedbe71a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:24.977416 18278 leader_election.cc:304] T 1f97050ecf494124a1ef8f3a359d6fd4 P ec71ef77a55848a0add75a6c104cc9a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95234c5b69eb4fe4a7558e56eedbe71a, ec71ef77a55848a0add75a6c104cc9a9; no voters: 
I20260709 14:55:24.977844 18060 catalog_manager.cc:5697] T 39965dc306aa4828a74a07da020fe662 P f75b4aa933fd4b8c82ea07567024882c reported cstate change: term changed from 0 to 1, leader changed from <none> to f75b4aa933fd4b8c82ea07567024882c (127.6.101.65). New cstate: current_term: 1 leader_uuid: "f75b4aa933fd4b8c82ea07567024882c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } health_report { overall_health: UNKNOWN } } }
I20260709 14:55:24.977757 18356 raft_consensus.cc:385] T e68e41550ad240f5842867f3c8b8604d P 95234c5b69eb4fe4a7558e56eedbe71a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:55:24.978771 18383 raft_consensus.cc:2804] T 1f97050ecf494124a1ef8f3a359d6fd4 P ec71ef77a55848a0add75a6c104cc9a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:55:24.979696 18356 raft_consensus.cc:740] T e68e41550ad240f5842867f3c8b8604d P 95234c5b69eb4fe4a7558e56eedbe71a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95234c5b69eb4fe4a7558e56eedbe71a, State: Initialized, Role: FOLLOWER
I20260709 14:55:24.980367 18383 raft_consensus.cc:697] T 1f97050ecf494124a1ef8f3a359d6fd4 P ec71ef77a55848a0add75a6c104cc9a9 [term 1 LEADER]: Becoming Leader. State: Replica: ec71ef77a55848a0add75a6c104cc9a9, State: Running, Role: LEADER
I20260709 14:55:24.982115 18163 raft_consensus.cc:2468] T 1f97050ecf494124a1ef8f3a359d6fd4 P f75b4aa933fd4b8c82ea07567024882c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec71ef77a55848a0add75a6c104cc9a9 in term 1.
I20260709 14:55:24.981818 18383 consensus_queue.cc:237] T 1f97050ecf494124a1ef8f3a359d6fd4 P ec71ef77a55848a0add75a6c104cc9a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:24.980661 18356 consensus_queue.cc:260] T e68e41550ad240f5842867f3c8b8604d P 95234c5b69eb4fe4a7558e56eedbe71a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:24.985594 18408 consensus_queue.cc:1048] T 8c253d3492704370910e00d866ea41a2 P ec71ef77a55848a0add75a6c104cc9a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:55:24.989957 18356 ts_tablet_manager.cc:1434] T e68e41550ad240f5842867f3c8b8604d P 95234c5b69eb4fe4a7558e56eedbe71a: Time spent starting tablet: real 0.042s	user 0.010s	sys 0.001s
I20260709 14:55:24.991398 18357 tablet_bootstrap.cc:654] T e68e41550ad240f5842867f3c8b8604d P f75b4aa933fd4b8c82ea07567024882c: Neither blocks nor log segments found. Creating new log.
I20260709 14:55:25.034423 18383 raft_consensus.cc:493] T 11525d1d42074736bf180ebaafed1e98 P ec71ef77a55848a0add75a6c104cc9a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:55:25.035635 18383 raft_consensus.cc:515] T 11525d1d42074736bf180ebaafed1e98 P ec71ef77a55848a0add75a6c104cc9a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:25.040541 18383 leader_election.cc:290] T 11525d1d42074736bf180ebaafed1e98 P ec71ef77a55848a0add75a6c104cc9a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f75b4aa933fd4b8c82ea07567024882c (127.6.101.65:40449), 95234c5b69eb4fe4a7558e56eedbe71a (127.6.101.66:42897)
I20260709 14:55:25.042948 18238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11525d1d42074736bf180ebaafed1e98" candidate_uuid: "ec71ef77a55848a0add75a6c104cc9a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" is_pre_election: true
I20260709 14:55:25.044142 18238 raft_consensus.cc:2468] T 11525d1d42074736bf180ebaafed1e98 P 95234c5b69eb4fe4a7558e56eedbe71a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec71ef77a55848a0add75a6c104cc9a9 in term 0.
I20260709 14:55:25.046101 18278 leader_election.cc:304] T 11525d1d42074736bf180ebaafed1e98 P ec71ef77a55848a0add75a6c104cc9a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95234c5b69eb4fe4a7558e56eedbe71a, ec71ef77a55848a0add75a6c104cc9a9; no voters: 
I20260709 14:55:25.047478 18383 raft_consensus.cc:2804] T 11525d1d42074736bf180ebaafed1e98 P ec71ef77a55848a0add75a6c104cc9a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:55:25.047940 18383 raft_consensus.cc:493] T 11525d1d42074736bf180ebaafed1e98 P ec71ef77a55848a0add75a6c104cc9a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:55:25.048182 18163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11525d1d42074736bf180ebaafed1e98" candidate_uuid: "ec71ef77a55848a0add75a6c104cc9a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f75b4aa933fd4b8c82ea07567024882c" is_pre_election: true
I20260709 14:55:25.048309 18383 raft_consensus.cc:3060] T 11525d1d42074736bf180ebaafed1e98 P ec71ef77a55848a0add75a6c104cc9a9 [term 0 FOLLOWER]: Advancing to term 1
W20260709 14:55:25.054553 18202 consensus_peers.cc:597] T f2ae10cc8d774889b54c598119fa0deb P 95234c5b69eb4fe4a7558e56eedbe71a -> Peer ec71ef77a55848a0add75a6c104cc9a9 (127.6.101.67:42661): Couldn't send request to peer ec71ef77a55848a0add75a6c104cc9a9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:55:25.058043 18163 raft_consensus.cc:2468] T 11525d1d42074736bf180ebaafed1e98 P f75b4aa933fd4b8c82ea07567024882c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec71ef77a55848a0add75a6c104cc9a9 in term 0.
I20260709 14:55:25.052467 18059 catalog_manager.cc:5697] T 1f97050ecf494124a1ef8f3a359d6fd4 P ec71ef77a55848a0add75a6c104cc9a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to ec71ef77a55848a0add75a6c104cc9a9 (127.6.101.67). New cstate: current_term: 1 leader_uuid: "ec71ef77a55848a0add75a6c104cc9a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } health_report { overall_health: HEALTHY } } }
I20260709 14:55:25.071648 18383 raft_consensus.cc:515] T 11525d1d42074736bf180ebaafed1e98 P ec71ef77a55848a0add75a6c104cc9a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:25.075412 18383 leader_election.cc:290] T 11525d1d42074736bf180ebaafed1e98 P ec71ef77a55848a0add75a6c104cc9a9 [CANDIDATE]: Term 1 election: Requested vote from peers f75b4aa933fd4b8c82ea07567024882c (127.6.101.65:40449), 95234c5b69eb4fe4a7558e56eedbe71a (127.6.101.66:42897)
I20260709 14:55:25.077571 18238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11525d1d42074736bf180ebaafed1e98" candidate_uuid: "ec71ef77a55848a0add75a6c104cc9a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95234c5b69eb4fe4a7558e56eedbe71a"
I20260709 14:55:25.078325 18163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11525d1d42074736bf180ebaafed1e98" candidate_uuid: "ec71ef77a55848a0add75a6c104cc9a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f75b4aa933fd4b8c82ea07567024882c"
I20260709 14:55:25.079058 18238 raft_consensus.cc:3060] T 11525d1d42074736bf180ebaafed1e98 P 95234c5b69eb4fe4a7558e56eedbe71a [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:55:25.079517 18163 raft_consensus.cc:3060] T 11525d1d42074736bf180ebaafed1e98 P f75b4aa933fd4b8c82ea07567024882c [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:55:25.101675 18357 tablet_bootstrap.cc:492] T e68e41550ad240f5842867f3c8b8604d P f75b4aa933fd4b8c82ea07567024882c: No bootstrap required, opened a new log
I20260709 14:55:25.101675 18358 tablet_bootstrap.cc:492] T f2ae10cc8d774889b54c598119fa0deb P ec71ef77a55848a0add75a6c104cc9a9: No bootstrap required, opened a new log
I20260709 14:55:25.102828 18357 ts_tablet_manager.cc:1403] T e68e41550ad240f5842867f3c8b8604d P f75b4aa933fd4b8c82ea07567024882c: Time spent bootstrapping tablet: real 0.134s	user 0.053s	sys 0.055s
I20260709 14:55:25.102926 18358 ts_tablet_manager.cc:1403] T f2ae10cc8d774889b54c598119fa0deb P ec71ef77a55848a0add75a6c104cc9a9: Time spent bootstrapping tablet: real 0.165s	user 0.046s	sys 0.055s
I20260709 14:55:25.106340 18358 raft_consensus.cc:359] T f2ae10cc8d774889b54c598119fa0deb P ec71ef77a55848a0add75a6c104cc9a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:25.106490 18357 raft_consensus.cc:359] T e68e41550ad240f5842867f3c8b8604d P f75b4aa933fd4b8c82ea07567024882c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:25.107229 18358 raft_consensus.cc:385] T f2ae10cc8d774889b54c598119fa0deb P ec71ef77a55848a0add75a6c104cc9a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:55:25.107391 18357 raft_consensus.cc:385] T e68e41550ad240f5842867f3c8b8604d P f75b4aa933fd4b8c82ea07567024882c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:55:25.107585 18358 raft_consensus.cc:740] T f2ae10cc8d774889b54c598119fa0deb P ec71ef77a55848a0add75a6c104cc9a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec71ef77a55848a0add75a6c104cc9a9, State: Initialized, Role: FOLLOWER
I20260709 14:55:25.107700 18357 raft_consensus.cc:740] T e68e41550ad240f5842867f3c8b8604d P f75b4aa933fd4b8c82ea07567024882c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f75b4aa933fd4b8c82ea07567024882c, State: Initialized, Role: FOLLOWER
I20260709 14:55:25.108546 18357 consensus_queue.cc:260] T e68e41550ad240f5842867f3c8b8604d P f75b4aa933fd4b8c82ea07567024882c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:25.108608 18358 consensus_queue.cc:260] T f2ae10cc8d774889b54c598119fa0deb P ec71ef77a55848a0add75a6c104cc9a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:25.110999 18357 ts_tablet_manager.cc:1434] T e68e41550ad240f5842867f3c8b8604d P f75b4aa933fd4b8c82ea07567024882c: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.002s
I20260709 14:55:25.111268 18358 ts_tablet_manager.cc:1434] T f2ae10cc8d774889b54c598119fa0deb P ec71ef77a55848a0add75a6c104cc9a9: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 14:55:25.117707 18163 raft_consensus.cc:2468] T 11525d1d42074736bf180ebaafed1e98 P f75b4aa933fd4b8c82ea07567024882c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec71ef77a55848a0add75a6c104cc9a9 in term 1.
I20260709 14:55:25.120407 18276 leader_election.cc:304] T 11525d1d42074736bf180ebaafed1e98 P ec71ef77a55848a0add75a6c104cc9a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ec71ef77a55848a0add75a6c104cc9a9, f75b4aa933fd4b8c82ea07567024882c; no voters: 
I20260709 14:55:25.121886 18383 raft_consensus.cc:2804] T 11525d1d42074736bf180ebaafed1e98 P ec71ef77a55848a0add75a6c104cc9a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:55:25.122488 18383 raft_consensus.cc:697] T 11525d1d42074736bf180ebaafed1e98 P ec71ef77a55848a0add75a6c104cc9a9 [term 1 LEADER]: Becoming Leader. State: Replica: ec71ef77a55848a0add75a6c104cc9a9, State: Running, Role: LEADER
I20260709 14:55:25.123449 18383 consensus_queue.cc:237] T 11525d1d42074736bf180ebaafed1e98 P ec71ef77a55848a0add75a6c104cc9a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:25.120306 18238 raft_consensus.cc:2468] T 11525d1d42074736bf180ebaafed1e98 P 95234c5b69eb4fe4a7558e56eedbe71a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec71ef77a55848a0add75a6c104cc9a9 in term 1.
I20260709 14:55:25.136538 18409 consensus_queue.cc:1048] T 8c253d3492704370910e00d866ea41a2 P ec71ef77a55848a0add75a6c104cc9a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:55:25.145298 18362 raft_consensus.cc:493] T e68e41550ad240f5842867f3c8b8604d P 95234c5b69eb4fe4a7558e56eedbe71a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:55:25.145936 18362 raft_consensus.cc:515] T e68e41550ad240f5842867f3c8b8604d P 95234c5b69eb4fe4a7558e56eedbe71a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:25.148469 18362 leader_election.cc:290] T e68e41550ad240f5842867f3c8b8604d P 95234c5b69eb4fe4a7558e56eedbe71a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f75b4aa933fd4b8c82ea07567024882c (127.6.101.65:40449), ec71ef77a55848a0add75a6c104cc9a9 (127.6.101.67:42661)
I20260709 14:55:25.149684 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e68e41550ad240f5842867f3c8b8604d" candidate_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec71ef77a55848a0add75a6c104cc9a9" is_pre_election: true
I20260709 14:55:25.150530 18311 raft_consensus.cc:2468] T e68e41550ad240f5842867f3c8b8604d P ec71ef77a55848a0add75a6c104cc9a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95234c5b69eb4fe4a7558e56eedbe71a in term 0.
I20260709 14:55:25.147588 18060 catalog_manager.cc:5697] T 11525d1d42074736bf180ebaafed1e98 P ec71ef77a55848a0add75a6c104cc9a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to ec71ef77a55848a0add75a6c104cc9a9 (127.6.101.67). New cstate: current_term: 1 leader_uuid: "ec71ef77a55848a0add75a6c104cc9a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } health_report { overall_health: HEALTHY } } }
I20260709 14:55:25.151816 18202 leader_election.cc:304] T e68e41550ad240f5842867f3c8b8604d P 95234c5b69eb4fe4a7558e56eedbe71a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95234c5b69eb4fe4a7558e56eedbe71a, ec71ef77a55848a0add75a6c104cc9a9; no voters: 
I20260709 14:55:25.152972 18362 raft_consensus.cc:2804] T e68e41550ad240f5842867f3c8b8604d P 95234c5b69eb4fe4a7558e56eedbe71a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:55:25.153422 18362 raft_consensus.cc:493] T e68e41550ad240f5842867f3c8b8604d P 95234c5b69eb4fe4a7558e56eedbe71a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:55:25.153968 18362 raft_consensus.cc:3060] T e68e41550ad240f5842867f3c8b8604d P 95234c5b69eb4fe4a7558e56eedbe71a [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:55:25.153702 18162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e68e41550ad240f5842867f3c8b8604d" candidate_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f75b4aa933fd4b8c82ea07567024882c" is_pre_election: true
I20260709 14:55:25.154929 18162 raft_consensus.cc:2468] T e68e41550ad240f5842867f3c8b8604d P f75b4aa933fd4b8c82ea07567024882c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95234c5b69eb4fe4a7558e56eedbe71a in term 0.
I20260709 14:55:25.166642 18362 raft_consensus.cc:515] T e68e41550ad240f5842867f3c8b8604d P 95234c5b69eb4fe4a7558e56eedbe71a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:25.169103 18362 leader_election.cc:290] T e68e41550ad240f5842867f3c8b8604d P 95234c5b69eb4fe4a7558e56eedbe71a [CANDIDATE]: Term 1 election: Requested vote from peers f75b4aa933fd4b8c82ea07567024882c (127.6.101.65:40449), ec71ef77a55848a0add75a6c104cc9a9 (127.6.101.67:42661)
I20260709 14:55:25.169883 18162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e68e41550ad240f5842867f3c8b8604d" candidate_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f75b4aa933fd4b8c82ea07567024882c"
I20260709 14:55:25.170679 18162 raft_consensus.cc:3060] T e68e41550ad240f5842867f3c8b8604d P f75b4aa933fd4b8c82ea07567024882c [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:55:25.171248 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e68e41550ad240f5842867f3c8b8604d" candidate_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec71ef77a55848a0add75a6c104cc9a9"
I20260709 14:55:25.172037 18311 raft_consensus.cc:3060] T e68e41550ad240f5842867f3c8b8604d P ec71ef77a55848a0add75a6c104cc9a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:55:25.177845 18162 raft_consensus.cc:2468] T e68e41550ad240f5842867f3c8b8604d P f75b4aa933fd4b8c82ea07567024882c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95234c5b69eb4fe4a7558e56eedbe71a in term 1.
I20260709 14:55:25.178174 18311 raft_consensus.cc:2468] T e68e41550ad240f5842867f3c8b8604d P ec71ef77a55848a0add75a6c104cc9a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95234c5b69eb4fe4a7558e56eedbe71a in term 1.
I20260709 14:55:25.179476 18202 leader_election.cc:304] T e68e41550ad240f5842867f3c8b8604d P 95234c5b69eb4fe4a7558e56eedbe71a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95234c5b69eb4fe4a7558e56eedbe71a, f75b4aa933fd4b8c82ea07567024882c; no voters: 
I20260709 14:55:25.180370 18362 raft_consensus.cc:2804] T e68e41550ad240f5842867f3c8b8604d P 95234c5b69eb4fe4a7558e56eedbe71a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:55:25.180949 18362 raft_consensus.cc:697] T e68e41550ad240f5842867f3c8b8604d P 95234c5b69eb4fe4a7558e56eedbe71a [term 1 LEADER]: Becoming Leader. State: Replica: 95234c5b69eb4fe4a7558e56eedbe71a, State: Running, Role: LEADER
I20260709 14:55:25.181792 18362 consensus_queue.cc:237] T e68e41550ad240f5842867f3c8b8604d P 95234c5b69eb4fe4a7558e56eedbe71a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:25.191594 18060 catalog_manager.cc:5697] T e68e41550ad240f5842867f3c8b8604d P 95234c5b69eb4fe4a7558e56eedbe71a reported cstate change: term changed from 0 to 1, leader changed from <none> to 95234c5b69eb4fe4a7558e56eedbe71a (127.6.101.66). New cstate: current_term: 1 leader_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } health_report { overall_health: UNKNOWN } } }
I20260709 14:55:25.222038 18362 consensus_queue.cc:1048] T bf34b3256cdf42dbaf4cad11d1a42160 P 95234c5b69eb4fe4a7558e56eedbe71a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 14:55:25.237136 18378 consensus_queue.cc:1048] T bf34b3256cdf42dbaf4cad11d1a42160 P 95234c5b69eb4fe4a7558e56eedbe71a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:55:25.260075 18378 consensus_queue.cc:1048] T f2ae10cc8d774889b54c598119fa0deb P 95234c5b69eb4fe4a7558e56eedbe71a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 14:55:25.316627 18409 raft_consensus.cc:493] T 39965dc306aa4828a74a07da020fe662 P ec71ef77a55848a0add75a6c104cc9a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:55:25.317345 18409 raft_consensus.cc:515] T 39965dc306aa4828a74a07da020fe662 P ec71ef77a55848a0add75a6c104cc9a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:25.319159 18363 consensus_queue.cc:1048] T b2b20170ec59458c9b9a18ca1e2a34d6 P f75b4aa933fd4b8c82ea07567024882c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:55:25.319403 18409 leader_election.cc:290] T 39965dc306aa4828a74a07da020fe662 P ec71ef77a55848a0add75a6c104cc9a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f75b4aa933fd4b8c82ea07567024882c (127.6.101.65:40449), 95234c5b69eb4fe4a7558e56eedbe71a (127.6.101.66:42897)
I20260709 14:55:25.320582 18238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39965dc306aa4828a74a07da020fe662" candidate_uuid: "ec71ef77a55848a0add75a6c104cc9a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" is_pre_election: true
I20260709 14:55:25.321125 18162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39965dc306aa4828a74a07da020fe662" candidate_uuid: "ec71ef77a55848a0add75a6c104cc9a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f75b4aa933fd4b8c82ea07567024882c" is_pre_election: true
I20260709 14:55:25.321439 18238 raft_consensus.cc:2393] T 39965dc306aa4828a74a07da020fe662 P 95234c5b69eb4fe4a7558e56eedbe71a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ec71ef77a55848a0add75a6c104cc9a9 in current term 1: Already voted for candidate f75b4aa933fd4b8c82ea07567024882c in this term.
I20260709 14:55:25.322829 18278 leader_election.cc:304] T 39965dc306aa4828a74a07da020fe662 P ec71ef77a55848a0add75a6c104cc9a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec71ef77a55848a0add75a6c104cc9a9; no voters: 95234c5b69eb4fe4a7558e56eedbe71a, f75b4aa933fd4b8c82ea07567024882c
I20260709 14:55:25.323760 18409 raft_consensus.cc:3060] T 39965dc306aa4828a74a07da020fe662 P ec71ef77a55848a0add75a6c104cc9a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:55:25.335668 18400 consensus_queue.cc:1048] T b2b20170ec59458c9b9a18ca1e2a34d6 P f75b4aa933fd4b8c82ea07567024882c [LEADER]: Connected to new peer: Peer: permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:55:25.339215 18409 raft_consensus.cc:2749] T 39965dc306aa4828a74a07da020fe662 P ec71ef77a55848a0add75a6c104cc9a9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:55:25.352779 18409 consensus_queue.cc:1048] T 528cd6046e1f4e7e8cc77f09c4578612 P ec71ef77a55848a0add75a6c104cc9a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:55:25.361689 18311 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8c253d3492704370910e00d866ea41a2"
dest_uuid: "ec71ef77a55848a0add75a6c104cc9a9"
mode: GRACEFUL
new_leader_uuid: "f75b4aa933fd4b8c82ea07567024882c"
 from {username='slave'} at 127.0.0.1:52800
I20260709 14:55:25.362491 18311 raft_consensus.cc:606] T 8c253d3492704370910e00d866ea41a2 P ec71ef77a55848a0add75a6c104cc9a9 [term 1 LEADER]: Received request to transfer leadership to TS f75b4aa933fd4b8c82ea07567024882c
I20260709 14:55:25.370309 18408 consensus_queue.cc:1048] T 528cd6046e1f4e7e8cc77f09c4578612 P ec71ef77a55848a0add75a6c104cc9a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:55:25.387172 18237 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bf34b3256cdf42dbaf4cad11d1a42160"
dest_uuid: "95234c5b69eb4fe4a7558e56eedbe71a"
mode: GRACEFUL
new_leader_uuid: "f75b4aa933fd4b8c82ea07567024882c"
 from {username='slave'} at 127.0.0.1:60394
I20260709 14:55:25.387948 18237 raft_consensus.cc:606] T bf34b3256cdf42dbaf4cad11d1a42160 P 95234c5b69eb4fe4a7558e56eedbe71a [term 1 LEADER]: Received request to transfer leadership to TS f75b4aa933fd4b8c82ea07567024882c
I20260709 14:55:25.395422 18311 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "528cd6046e1f4e7e8cc77f09c4578612"
dest_uuid: "ec71ef77a55848a0add75a6c104cc9a9"
mode: GRACEFUL
new_leader_uuid: "f75b4aa933fd4b8c82ea07567024882c"
 from {username='slave'} at 127.0.0.1:52800
I20260709 14:55:25.396119 18311 raft_consensus.cc:606] T 528cd6046e1f4e7e8cc77f09c4578612 P ec71ef77a55848a0add75a6c104cc9a9 [term 1 LEADER]: Received request to transfer leadership to TS f75b4aa933fd4b8c82ea07567024882c
I20260709 14:55:25.404650 18237 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f2ae10cc8d774889b54c598119fa0deb"
dest_uuid: "95234c5b69eb4fe4a7558e56eedbe71a"
mode: GRACEFUL
new_leader_uuid: "f75b4aa933fd4b8c82ea07567024882c"
 from {username='slave'} at 127.0.0.1:60394
I20260709 14:55:25.405393 18237 raft_consensus.cc:606] T f2ae10cc8d774889b54c598119fa0deb P 95234c5b69eb4fe4a7558e56eedbe71a [term 1 LEADER]: Received request to transfer leadership to TS f75b4aa933fd4b8c82ea07567024882c
I20260709 14:55:25.423753 18162 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "39965dc306aa4828a74a07da020fe662"
dest_uuid: "f75b4aa933fd4b8c82ea07567024882c"
mode: GRACEFUL
new_leader_uuid: "95234c5b69eb4fe4a7558e56eedbe71a"
 from {username='slave'} at 127.0.0.1:55812
I20260709 14:55:25.424441 18162 raft_consensus.cc:606] T 39965dc306aa4828a74a07da020fe662 P f75b4aa933fd4b8c82ea07567024882c [term 1 LEADER]: Received request to transfer leadership to TS 95234c5b69eb4fe4a7558e56eedbe71a
I20260709 14:55:25.431981 18162 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b2b20170ec59458c9b9a18ca1e2a34d6"
dest_uuid: "f75b4aa933fd4b8c82ea07567024882c"
mode: GRACEFUL
new_leader_uuid: "95234c5b69eb4fe4a7558e56eedbe71a"
 from {username='slave'} at 127.0.0.1:55812
I20260709 14:55:25.432581 18162 raft_consensus.cc:606] T b2b20170ec59458c9b9a18ca1e2a34d6 P f75b4aa933fd4b8c82ea07567024882c [term 1 LEADER]: Received request to transfer leadership to TS 95234c5b69eb4fe4a7558e56eedbe71a
I20260709 14:55:25.439661 18311 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "11525d1d42074736bf180ebaafed1e98"
dest_uuid: "ec71ef77a55848a0add75a6c104cc9a9"
mode: GRACEFUL
new_leader_uuid: "95234c5b69eb4fe4a7558e56eedbe71a"
 from {username='slave'} at 127.0.0.1:52800
I20260709 14:55:25.440429 18311 raft_consensus.cc:606] T 11525d1d42074736bf180ebaafed1e98 P ec71ef77a55848a0add75a6c104cc9a9 [term 1 LEADER]: Received request to transfer leadership to TS 95234c5b69eb4fe4a7558e56eedbe71a
I20260709 14:55:25.489548 18363 consensus_queue.cc:1048] T 39965dc306aa4828a74a07da020fe662 P f75b4aa933fd4b8c82ea07567024882c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 14:55:25.497047 18408 raft_consensus.cc:493] T f2ae10cc8d774889b54c598119fa0deb P ec71ef77a55848a0add75a6c104cc9a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:55:25.497750 18408 raft_consensus.cc:515] T f2ae10cc8d774889b54c598119fa0deb P ec71ef77a55848a0add75a6c104cc9a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:25.501322 18408 leader_election.cc:290] T f2ae10cc8d774889b54c598119fa0deb P ec71ef77a55848a0add75a6c104cc9a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f75b4aa933fd4b8c82ea07567024882c (127.6.101.65:40449), 95234c5b69eb4fe4a7558e56eedbe71a (127.6.101.66:42897)
I20260709 14:55:25.503541 18238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ae10cc8d774889b54c598119fa0deb" candidate_uuid: "ec71ef77a55848a0add75a6c104cc9a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" is_pre_election: true
I20260709 14:55:25.504900 18162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ae10cc8d774889b54c598119fa0deb" candidate_uuid: "ec71ef77a55848a0add75a6c104cc9a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f75b4aa933fd4b8c82ea07567024882c" is_pre_election: true
I20260709 14:55:25.506783 18276 leader_election.cc:304] T f2ae10cc8d774889b54c598119fa0deb P ec71ef77a55848a0add75a6c104cc9a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec71ef77a55848a0add75a6c104cc9a9; no voters: 95234c5b69eb4fe4a7558e56eedbe71a, f75b4aa933fd4b8c82ea07567024882c
I20260709 14:55:25.508490 18408 raft_consensus.cc:2749] T f2ae10cc8d774889b54c598119fa0deb P ec71ef77a55848a0add75a6c104cc9a9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:55:25.511276 18363 consensus_queue.cc:1048] T 39965dc306aa4828a74a07da020fe662 P f75b4aa933fd4b8c82ea07567024882c [LEADER]: Connected to new peer: Peer: permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:55:25.514814 18311 raft_consensus.cc:3060] T f2ae10cc8d774889b54c598119fa0deb P ec71ef77a55848a0add75a6c104cc9a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:55:25.523716 18435 raft_consensus.cc:993] T 39965dc306aa4828a74a07da020fe662 P f75b4aa933fd4b8c82ea07567024882c: : Instructing follower 95234c5b69eb4fe4a7558e56eedbe71a to start an election
I20260709 14:55:25.524282 18363 raft_consensus.cc:1081] T 39965dc306aa4828a74a07da020fe662 P f75b4aa933fd4b8c82ea07567024882c [term 1 LEADER]: Signalling peer 95234c5b69eb4fe4a7558e56eedbe71a to start an election
I20260709 14:55:25.526252 18237 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "39965dc306aa4828a74a07da020fe662"
dest_uuid: "95234c5b69eb4fe4a7558e56eedbe71a"
 from {username='slave'} at 127.0.0.1:60384
I20260709 14:55:25.527014 18237 raft_consensus.cc:493] T 39965dc306aa4828a74a07da020fe662 P 95234c5b69eb4fe4a7558e56eedbe71a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:55:25.527462 18237 raft_consensus.cc:3060] T 39965dc306aa4828a74a07da020fe662 P 95234c5b69eb4fe4a7558e56eedbe71a [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:55:25.538005 18237 raft_consensus.cc:515] T 39965dc306aa4828a74a07da020fe662 P 95234c5b69eb4fe4a7558e56eedbe71a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:25.540983 18237 leader_election.cc:290] T 39965dc306aa4828a74a07da020fe662 P 95234c5b69eb4fe4a7558e56eedbe71a [CANDIDATE]: Term 2 election: Requested vote from peers f75b4aa933fd4b8c82ea07567024882c (127.6.101.65:40449), ec71ef77a55848a0add75a6c104cc9a9 (127.6.101.67:42661)
I20260709 14:55:25.541867 18408 consensus_queue.cc:1048] T 1f97050ecf494124a1ef8f3a359d6fd4 P ec71ef77a55848a0add75a6c104cc9a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:55:25.541913 18162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39965dc306aa4828a74a07da020fe662" candidate_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f75b4aa933fd4b8c82ea07567024882c"
I20260709 14:55:25.543040 18162 raft_consensus.cc:3055] T 39965dc306aa4828a74a07da020fe662 P f75b4aa933fd4b8c82ea07567024882c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 14:55:25.543421 18162 raft_consensus.cc:740] T 39965dc306aa4828a74a07da020fe662 P f75b4aa933fd4b8c82ea07567024882c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f75b4aa933fd4b8c82ea07567024882c, State: Running, Role: LEADER
I20260709 14:55:25.544265 18162 consensus_queue.cc:260] T 39965dc306aa4828a74a07da020fe662 P f75b4aa933fd4b8c82ea07567024882c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:25.545885 18162 raft_consensus.cc:3060] T 39965dc306aa4828a74a07da020fe662 P f75b4aa933fd4b8c82ea07567024882c [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:55:25.550311 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39965dc306aa4828a74a07da020fe662" candidate_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ec71ef77a55848a0add75a6c104cc9a9"
I20260709 14:55:25.551215 18311 raft_consensus.cc:3060] T 39965dc306aa4828a74a07da020fe662 P ec71ef77a55848a0add75a6c104cc9a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:55:25.555339 18383 consensus_queue.cc:1048] T 1f97050ecf494124a1ef8f3a359d6fd4 P ec71ef77a55848a0add75a6c104cc9a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:55:25.555744 18162 raft_consensus.cc:2468] T 39965dc306aa4828a74a07da020fe662 P f75b4aa933fd4b8c82ea07567024882c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95234c5b69eb4fe4a7558e56eedbe71a in term 2.
I20260709 14:55:25.557730 18202 leader_election.cc:304] T 39965dc306aa4828a74a07da020fe662 P 95234c5b69eb4fe4a7558e56eedbe71a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95234c5b69eb4fe4a7558e56eedbe71a, f75b4aa933fd4b8c82ea07567024882c; no voters: 
I20260709 14:55:25.558837 18423 raft_consensus.cc:2804] T 39965dc306aa4828a74a07da020fe662 P 95234c5b69eb4fe4a7558e56eedbe71a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:55:25.559360 18423 raft_consensus.cc:697] T 39965dc306aa4828a74a07da020fe662 P 95234c5b69eb4fe4a7558e56eedbe71a [term 2 LEADER]: Becoming Leader. State: Replica: 95234c5b69eb4fe4a7558e56eedbe71a, State: Running, Role: LEADER
I20260709 14:55:25.560261 18423 consensus_queue.cc:237] T 39965dc306aa4828a74a07da020fe662 P 95234c5b69eb4fe4a7558e56eedbe71a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:25.561116 18311 raft_consensus.cc:2468] T 39965dc306aa4828a74a07da020fe662 P ec71ef77a55848a0add75a6c104cc9a9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95234c5b69eb4fe4a7558e56eedbe71a in term 2.
I20260709 14:55:25.563660 18383 consensus_queue.cc:1048] T 11525d1d42074736bf180ebaafed1e98 P ec71ef77a55848a0add75a6c104cc9a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:55:25.583705 18058 catalog_manager.cc:5697] T 39965dc306aa4828a74a07da020fe662 P 95234c5b69eb4fe4a7558e56eedbe71a reported cstate change: term changed from 1 to 2, leader changed from f75b4aa933fd4b8c82ea07567024882c (127.6.101.65) to 95234c5b69eb4fe4a7558e56eedbe71a (127.6.101.66). New cstate: current_term: 2 leader_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } health_report { overall_health: UNKNOWN } } }
I20260709 14:55:25.590711 18409 consensus_queue.cc:1048] T 11525d1d42074736bf180ebaafed1e98 P ec71ef77a55848a0add75a6c104cc9a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 14:55:25.602242 18409 raft_consensus.cc:993] T 8c253d3492704370910e00d866ea41a2 P ec71ef77a55848a0add75a6c104cc9a9: : Instructing follower f75b4aa933fd4b8c82ea07567024882c to start an election
I20260709 14:55:25.602664 18409 raft_consensus.cc:1081] T 8c253d3492704370910e00d866ea41a2 P ec71ef77a55848a0add75a6c104cc9a9 [term 1 LEADER]: Signalling peer f75b4aa933fd4b8c82ea07567024882c to start an election
I20260709 14:55:25.604476 18163 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8c253d3492704370910e00d866ea41a2"
dest_uuid: "f75b4aa933fd4b8c82ea07567024882c"
 from {username='slave'} at 127.0.0.1:55796
I20260709 14:55:25.605213 18163 raft_consensus.cc:493] T 8c253d3492704370910e00d866ea41a2 P f75b4aa933fd4b8c82ea07567024882c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:55:25.605752 18163 raft_consensus.cc:3060] T 8c253d3492704370910e00d866ea41a2 P f75b4aa933fd4b8c82ea07567024882c [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:55:25.607527 18383 raft_consensus.cc:993] T 11525d1d42074736bf180ebaafed1e98 P ec71ef77a55848a0add75a6c104cc9a9: : Instructing follower 95234c5b69eb4fe4a7558e56eedbe71a to start an election
I20260709 14:55:25.608227 18382 raft_consensus.cc:1081] T 11525d1d42074736bf180ebaafed1e98 P ec71ef77a55848a0add75a6c104cc9a9 [term 1 LEADER]: Signalling peer 95234c5b69eb4fe4a7558e56eedbe71a to start an election
I20260709 14:55:25.610576 18237 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "11525d1d42074736bf180ebaafed1e98"
dest_uuid: "95234c5b69eb4fe4a7558e56eedbe71a"
 from {username='slave'} at 127.0.0.1:60378
I20260709 14:55:25.611389 18237 raft_consensus.cc:493] T 11525d1d42074736bf180ebaafed1e98 P 95234c5b69eb4fe4a7558e56eedbe71a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:55:25.612485 18237 raft_consensus.cc:3060] T 11525d1d42074736bf180ebaafed1e98 P 95234c5b69eb4fe4a7558e56eedbe71a [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:55:25.616866 18163 raft_consensus.cc:515] T 8c253d3492704370910e00d866ea41a2 P f75b4aa933fd4b8c82ea07567024882c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:25.619351 18163 leader_election.cc:290] T 8c253d3492704370910e00d866ea41a2 P f75b4aa933fd4b8c82ea07567024882c [CANDIDATE]: Term 2 election: Requested vote from peers 95234c5b69eb4fe4a7558e56eedbe71a (127.6.101.66:42897), ec71ef77a55848a0add75a6c104cc9a9 (127.6.101.67:42661)
I20260709 14:55:25.619472 18237 raft_consensus.cc:515] T 11525d1d42074736bf180ebaafed1e98 P 95234c5b69eb4fe4a7558e56eedbe71a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:25.620421 18238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c253d3492704370910e00d866ea41a2" candidate_uuid: "f75b4aa933fd4b8c82ea07567024882c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "95234c5b69eb4fe4a7558e56eedbe71a"
I20260709 14:55:25.620843 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c253d3492704370910e00d866ea41a2" candidate_uuid: "f75b4aa933fd4b8c82ea07567024882c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ec71ef77a55848a0add75a6c104cc9a9"
I20260709 14:55:25.621306 18238 raft_consensus.cc:3060] T 8c253d3492704370910e00d866ea41a2 P 95234c5b69eb4fe4a7558e56eedbe71a [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:55:25.621474 18311 raft_consensus.cc:3055] T 8c253d3492704370910e00d866ea41a2 P ec71ef77a55848a0add75a6c104cc9a9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 14:55:25.621981 18311 raft_consensus.cc:740] T 8c253d3492704370910e00d866ea41a2 P ec71ef77a55848a0add75a6c104cc9a9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ec71ef77a55848a0add75a6c104cc9a9, State: Running, Role: LEADER
I20260709 14:55:25.622210 18237 leader_election.cc:290] T 11525d1d42074736bf180ebaafed1e98 P 95234c5b69eb4fe4a7558e56eedbe71a [CANDIDATE]: Term 2 election: Requested vote from peers f75b4aa933fd4b8c82ea07567024882c (127.6.101.65:40449), ec71ef77a55848a0add75a6c104cc9a9 (127.6.101.67:42661)
I20260709 14:55:25.623211 18311 consensus_queue.cc:260] T 8c253d3492704370910e00d866ea41a2 P ec71ef77a55848a0add75a6c104cc9a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:25.624078 18163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11525d1d42074736bf180ebaafed1e98" candidate_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f75b4aa933fd4b8c82ea07567024882c"
I20260709 14:55:25.624850 18163 raft_consensus.cc:3060] T 11525d1d42074736bf180ebaafed1e98 P f75b4aa933fd4b8c82ea07567024882c [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:55:25.625012 18311 raft_consensus.cc:3060] T 8c253d3492704370910e00d866ea41a2 P ec71ef77a55848a0add75a6c104cc9a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:55:25.625717 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11525d1d42074736bf180ebaafed1e98" candidate_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ec71ef77a55848a0add75a6c104cc9a9"
I20260709 14:55:25.626475 18310 raft_consensus.cc:3055] T 11525d1d42074736bf180ebaafed1e98 P ec71ef77a55848a0add75a6c104cc9a9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 14:55:25.626849 18310 raft_consensus.cc:740] T 11525d1d42074736bf180ebaafed1e98 P ec71ef77a55848a0add75a6c104cc9a9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ec71ef77a55848a0add75a6c104cc9a9, State: Running, Role: LEADER
I20260709 14:55:25.627801 18310 consensus_queue.cc:260] T 11525d1d42074736bf180ebaafed1e98 P ec71ef77a55848a0add75a6c104cc9a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:25.629377 18310 raft_consensus.cc:3060] T 11525d1d42074736bf180ebaafed1e98 P ec71ef77a55848a0add75a6c104cc9a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:55:25.634742 18163 raft_consensus.cc:2468] T 11525d1d42074736bf180ebaafed1e98 P f75b4aa933fd4b8c82ea07567024882c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95234c5b69eb4fe4a7558e56eedbe71a in term 2.
I20260709 14:55:25.635329 18311 raft_consensus.cc:2468] T 8c253d3492704370910e00d866ea41a2 P ec71ef77a55848a0add75a6c104cc9a9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f75b4aa933fd4b8c82ea07567024882c in term 2.
I20260709 14:55:25.636399 18202 leader_election.cc:304] T 11525d1d42074736bf180ebaafed1e98 P 95234c5b69eb4fe4a7558e56eedbe71a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95234c5b69eb4fe4a7558e56eedbe71a, f75b4aa933fd4b8c82ea07567024882c; no voters: 
I20260709 14:55:25.637441 18127 leader_election.cc:304] T 8c253d3492704370910e00d866ea41a2 P f75b4aa933fd4b8c82ea07567024882c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ec71ef77a55848a0add75a6c104cc9a9, f75b4aa933fd4b8c82ea07567024882c; no voters: 
I20260709 14:55:25.637857 18423 raft_consensus.cc:2804] T 11525d1d42074736bf180ebaafed1e98 P 95234c5b69eb4fe4a7558e56eedbe71a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:55:25.635999 18238 raft_consensus.cc:2468] T 8c253d3492704370910e00d866ea41a2 P 95234c5b69eb4fe4a7558e56eedbe71a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f75b4aa933fd4b8c82ea07567024882c in term 2.
I20260709 14:55:25.638475 18423 raft_consensus.cc:697] T 11525d1d42074736bf180ebaafed1e98 P 95234c5b69eb4fe4a7558e56eedbe71a [term 2 LEADER]: Becoming Leader. State: Replica: 95234c5b69eb4fe4a7558e56eedbe71a, State: Running, Role: LEADER
I20260709 14:55:25.638680 18363 raft_consensus.cc:2804] T 8c253d3492704370910e00d866ea41a2 P f75b4aa933fd4b8c82ea07567024882c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:55:25.639369 18363 raft_consensus.cc:697] T 8c253d3492704370910e00d866ea41a2 P f75b4aa933fd4b8c82ea07567024882c [term 2 LEADER]: Becoming Leader. State: Replica: f75b4aa933fd4b8c82ea07567024882c, State: Running, Role: LEADER
I20260709 14:55:25.639494 18423 consensus_queue.cc:237] T 11525d1d42074736bf180ebaafed1e98 P 95234c5b69eb4fe4a7558e56eedbe71a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:25.640306 18363 consensus_queue.cc:237] T 8c253d3492704370910e00d866ea41a2 P f75b4aa933fd4b8c82ea07567024882c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:25.641755 18310 raft_consensus.cc:2468] T 11525d1d42074736bf180ebaafed1e98 P ec71ef77a55848a0add75a6c104cc9a9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95234c5b69eb4fe4a7558e56eedbe71a in term 2.
I20260709 14:55:25.647200 18423 consensus_queue.cc:1048] T e68e41550ad240f5842867f3c8b8604d P 95234c5b69eb4fe4a7558e56eedbe71a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 14:55:25.649691 18060 catalog_manager.cc:5697] T 11525d1d42074736bf180ebaafed1e98 P 95234c5b69eb4fe4a7558e56eedbe71a reported cstate change: term changed from 1 to 2, leader changed from ec71ef77a55848a0add75a6c104cc9a9 (127.6.101.67) to 95234c5b69eb4fe4a7558e56eedbe71a (127.6.101.66). New cstate: current_term: 2 leader_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } health_report { overall_health: UNKNOWN } } }
I20260709 14:55:25.649691 18059 catalog_manager.cc:5697] T 8c253d3492704370910e00d866ea41a2 P f75b4aa933fd4b8c82ea07567024882c reported cstate change: term changed from 1 to 2, leader changed from ec71ef77a55848a0add75a6c104cc9a9 (127.6.101.67) to f75b4aa933fd4b8c82ea07567024882c (127.6.101.65). New cstate: current_term: 2 leader_uuid: "f75b4aa933fd4b8c82ea07567024882c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } health_report { overall_health: UNKNOWN } } }
I20260709 14:55:25.655443 18362 raft_consensus.cc:993] T f2ae10cc8d774889b54c598119fa0deb P 95234c5b69eb4fe4a7558e56eedbe71a: : Instructing follower f75b4aa933fd4b8c82ea07567024882c to start an election
I20260709 14:55:25.656224 18423 raft_consensus.cc:1081] T f2ae10cc8d774889b54c598119fa0deb P 95234c5b69eb4fe4a7558e56eedbe71a [term 1 LEADER]: Signalling peer f75b4aa933fd4b8c82ea07567024882c to start an election
I20260709 14:55:25.658689 18163 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f2ae10cc8d774889b54c598119fa0deb"
dest_uuid: "f75b4aa933fd4b8c82ea07567024882c"
 from {username='slave'} at 127.0.0.1:55806
I20260709 14:55:25.659381 18163 raft_consensus.cc:493] T f2ae10cc8d774889b54c598119fa0deb P f75b4aa933fd4b8c82ea07567024882c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:55:25.659808 18163 raft_consensus.cc:3060] T f2ae10cc8d774889b54c598119fa0deb P f75b4aa933fd4b8c82ea07567024882c [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:55:25.665747 18362 consensus_queue.cc:1048] T e68e41550ad240f5842867f3c8b8604d P 95234c5b69eb4fe4a7558e56eedbe71a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:55:25.670045 18163 raft_consensus.cc:515] T f2ae10cc8d774889b54c598119fa0deb P f75b4aa933fd4b8c82ea07567024882c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:25.673460 18163 leader_election.cc:290] T f2ae10cc8d774889b54c598119fa0deb P f75b4aa933fd4b8c82ea07567024882c [CANDIDATE]: Term 2 election: Requested vote from peers 95234c5b69eb4fe4a7558e56eedbe71a (127.6.101.66:42897), ec71ef77a55848a0add75a6c104cc9a9 (127.6.101.67:42661)
I20260709 14:55:25.676154 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ae10cc8d774889b54c598119fa0deb" candidate_uuid: "f75b4aa933fd4b8c82ea07567024882c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ec71ef77a55848a0add75a6c104cc9a9"
I20260709 14:55:25.676869 18311 raft_consensus.cc:3060] T f2ae10cc8d774889b54c598119fa0deb P ec71ef77a55848a0add75a6c104cc9a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:55:25.677536 18238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ae10cc8d774889b54c598119fa0deb" candidate_uuid: "f75b4aa933fd4b8c82ea07567024882c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "95234c5b69eb4fe4a7558e56eedbe71a"
I20260709 14:55:25.678359 18238 raft_consensus.cc:3055] T f2ae10cc8d774889b54c598119fa0deb P 95234c5b69eb4fe4a7558e56eedbe71a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 14:55:25.678681 18238 raft_consensus.cc:740] T f2ae10cc8d774889b54c598119fa0deb P 95234c5b69eb4fe4a7558e56eedbe71a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 95234c5b69eb4fe4a7558e56eedbe71a, State: Running, Role: LEADER
I20260709 14:55:25.679777 18238 consensus_queue.cc:260] T f2ae10cc8d774889b54c598119fa0deb P 95234c5b69eb4fe4a7558e56eedbe71a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:25.681525 18238 raft_consensus.cc:3060] T f2ae10cc8d774889b54c598119fa0deb P 95234c5b69eb4fe4a7558e56eedbe71a [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:55:25.687101 18311 raft_consensus.cc:2468] T f2ae10cc8d774889b54c598119fa0deb P ec71ef77a55848a0add75a6c104cc9a9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f75b4aa933fd4b8c82ea07567024882c in term 2.
I20260709 14:55:25.689677 18127 leader_election.cc:304] T f2ae10cc8d774889b54c598119fa0deb P f75b4aa933fd4b8c82ea07567024882c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ec71ef77a55848a0add75a6c104cc9a9, f75b4aa933fd4b8c82ea07567024882c; no voters: 
I20260709 14:55:25.691443 18363 raft_consensus.cc:2804] T f2ae10cc8d774889b54c598119fa0deb P f75b4aa933fd4b8c82ea07567024882c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:55:25.691516 18238 raft_consensus.cc:2468] T f2ae10cc8d774889b54c598119fa0deb P 95234c5b69eb4fe4a7558e56eedbe71a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f75b4aa933fd4b8c82ea07567024882c in term 2.
I20260709 14:55:25.692294 18363 raft_consensus.cc:697] T f2ae10cc8d774889b54c598119fa0deb P f75b4aa933fd4b8c82ea07567024882c [term 2 LEADER]: Becoming Leader. State: Replica: f75b4aa933fd4b8c82ea07567024882c, State: Running, Role: LEADER
I20260709 14:55:25.693372 18363 consensus_queue.cc:237] T f2ae10cc8d774889b54c598119fa0deb P f75b4aa933fd4b8c82ea07567024882c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:25.702056 18060 catalog_manager.cc:5697] T f2ae10cc8d774889b54c598119fa0deb P f75b4aa933fd4b8c82ea07567024882c reported cstate change: term changed from 1 to 2, leader changed from 95234c5b69eb4fe4a7558e56eedbe71a (127.6.101.66) to f75b4aa933fd4b8c82ea07567024882c (127.6.101.65). New cstate: current_term: 2 leader_uuid: "f75b4aa933fd4b8c82ea07567024882c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } health_report { overall_health: UNKNOWN } } }
I20260709 14:55:25.782338 18362 raft_consensus.cc:993] T bf34b3256cdf42dbaf4cad11d1a42160 P 95234c5b69eb4fe4a7558e56eedbe71a: : Instructing follower f75b4aa933fd4b8c82ea07567024882c to start an election
I20260709 14:55:25.782894 18362 raft_consensus.cc:1081] T bf34b3256cdf42dbaf4cad11d1a42160 P 95234c5b69eb4fe4a7558e56eedbe71a [term 1 LEADER]: Signalling peer f75b4aa933fd4b8c82ea07567024882c to start an election
I20260709 14:55:25.785050 18163 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bf34b3256cdf42dbaf4cad11d1a42160"
dest_uuid: "f75b4aa933fd4b8c82ea07567024882c"
 from {username='slave'} at 127.0.0.1:55806
I20260709 14:55:25.785640 18163 raft_consensus.cc:493] T bf34b3256cdf42dbaf4cad11d1a42160 P f75b4aa933fd4b8c82ea07567024882c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:55:25.786142 18163 raft_consensus.cc:3060] T bf34b3256cdf42dbaf4cad11d1a42160 P f75b4aa933fd4b8c82ea07567024882c [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:55:25.791955 18163 raft_consensus.cc:515] T bf34b3256cdf42dbaf4cad11d1a42160 P f75b4aa933fd4b8c82ea07567024882c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:25.794155 18163 leader_election.cc:290] T bf34b3256cdf42dbaf4cad11d1a42160 P f75b4aa933fd4b8c82ea07567024882c [CANDIDATE]: Term 2 election: Requested vote from peers 95234c5b69eb4fe4a7558e56eedbe71a (127.6.101.66:42897), ec71ef77a55848a0add75a6c104cc9a9 (127.6.101.67:42661)
I20260709 14:55:25.795279 18238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf34b3256cdf42dbaf4cad11d1a42160" candidate_uuid: "f75b4aa933fd4b8c82ea07567024882c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "95234c5b69eb4fe4a7558e56eedbe71a"
I20260709 14:55:25.795442 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf34b3256cdf42dbaf4cad11d1a42160" candidate_uuid: "f75b4aa933fd4b8c82ea07567024882c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ec71ef77a55848a0add75a6c104cc9a9"
I20260709 14:55:25.795912 18238 raft_consensus.cc:3055] T bf34b3256cdf42dbaf4cad11d1a42160 P 95234c5b69eb4fe4a7558e56eedbe71a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 14:55:25.796192 18311 raft_consensus.cc:3060] T bf34b3256cdf42dbaf4cad11d1a42160 P ec71ef77a55848a0add75a6c104cc9a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:55:25.796339 18238 raft_consensus.cc:740] T bf34b3256cdf42dbaf4cad11d1a42160 P 95234c5b69eb4fe4a7558e56eedbe71a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 95234c5b69eb4fe4a7558e56eedbe71a, State: Running, Role: LEADER
I20260709 14:55:25.797287 18238 consensus_queue.cc:260] T bf34b3256cdf42dbaf4cad11d1a42160 P 95234c5b69eb4fe4a7558e56eedbe71a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:25.798322 18238 raft_consensus.cc:3060] T bf34b3256cdf42dbaf4cad11d1a42160 P 95234c5b69eb4fe4a7558e56eedbe71a [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:55:25.803093 18311 raft_consensus.cc:2468] T bf34b3256cdf42dbaf4cad11d1a42160 P ec71ef77a55848a0add75a6c104cc9a9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f75b4aa933fd4b8c82ea07567024882c in term 2.
I20260709 14:55:25.804826 18127 leader_election.cc:304] T bf34b3256cdf42dbaf4cad11d1a42160 P f75b4aa933fd4b8c82ea07567024882c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ec71ef77a55848a0add75a6c104cc9a9, f75b4aa933fd4b8c82ea07567024882c; no voters: 
I20260709 14:55:25.805117 18238 raft_consensus.cc:2468] T bf34b3256cdf42dbaf4cad11d1a42160 P 95234c5b69eb4fe4a7558e56eedbe71a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f75b4aa933fd4b8c82ea07567024882c in term 2.
I20260709 14:55:25.805913 18363 raft_consensus.cc:2804] T bf34b3256cdf42dbaf4cad11d1a42160 P f75b4aa933fd4b8c82ea07567024882c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:55:25.806591 18363 raft_consensus.cc:697] T bf34b3256cdf42dbaf4cad11d1a42160 P f75b4aa933fd4b8c82ea07567024882c [term 2 LEADER]: Becoming Leader. State: Replica: f75b4aa933fd4b8c82ea07567024882c, State: Running, Role: LEADER
I20260709 14:55:25.807902 18363 consensus_queue.cc:237] T bf34b3256cdf42dbaf4cad11d1a42160 P f75b4aa933fd4b8c82ea07567024882c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:25.815299 18060 catalog_manager.cc:5697] T bf34b3256cdf42dbaf4cad11d1a42160 P f75b4aa933fd4b8c82ea07567024882c reported cstate change: term changed from 1 to 2, leader changed from 95234c5b69eb4fe4a7558e56eedbe71a (127.6.101.66) to f75b4aa933fd4b8c82ea07567024882c (127.6.101.65). New cstate: current_term: 2 leader_uuid: "f75b4aa933fd4b8c82ea07567024882c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } health_report { overall_health: UNKNOWN } } }
I20260709 14:55:25.819129 18400 raft_consensus.cc:993] T b2b20170ec59458c9b9a18ca1e2a34d6 P f75b4aa933fd4b8c82ea07567024882c: : Instructing follower 95234c5b69eb4fe4a7558e56eedbe71a to start an election
I20260709 14:55:25.819787 18363 raft_consensus.cc:1081] T b2b20170ec59458c9b9a18ca1e2a34d6 P f75b4aa933fd4b8c82ea07567024882c [term 1 LEADER]: Signalling peer 95234c5b69eb4fe4a7558e56eedbe71a to start an election
I20260709 14:55:25.822082 18238 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b2b20170ec59458c9b9a18ca1e2a34d6"
dest_uuid: "95234c5b69eb4fe4a7558e56eedbe71a"
 from {username='slave'} at 127.0.0.1:60384
I20260709 14:55:25.822701 18238 raft_consensus.cc:493] T b2b20170ec59458c9b9a18ca1e2a34d6 P 95234c5b69eb4fe4a7558e56eedbe71a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:55:25.823275 18238 raft_consensus.cc:3060] T b2b20170ec59458c9b9a18ca1e2a34d6 P 95234c5b69eb4fe4a7558e56eedbe71a [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:55:25.830029 18238 raft_consensus.cc:515] T b2b20170ec59458c9b9a18ca1e2a34d6 P 95234c5b69eb4fe4a7558e56eedbe71a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:25.832273 18238 leader_election.cc:290] T b2b20170ec59458c9b9a18ca1e2a34d6 P 95234c5b69eb4fe4a7558e56eedbe71a [CANDIDATE]: Term 2 election: Requested vote from peers f75b4aa933fd4b8c82ea07567024882c (127.6.101.65:40449), ec71ef77a55848a0add75a6c104cc9a9 (127.6.101.67:42661)
I20260709 14:55:25.833422 18163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b20170ec59458c9b9a18ca1e2a34d6" candidate_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f75b4aa933fd4b8c82ea07567024882c"
I20260709 14:55:25.833943 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b20170ec59458c9b9a18ca1e2a34d6" candidate_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ec71ef77a55848a0add75a6c104cc9a9"
I20260709 14:55:25.834201 18163 raft_consensus.cc:3055] T b2b20170ec59458c9b9a18ca1e2a34d6 P f75b4aa933fd4b8c82ea07567024882c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 14:55:25.834688 18163 raft_consensus.cc:740] T b2b20170ec59458c9b9a18ca1e2a34d6 P f75b4aa933fd4b8c82ea07567024882c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f75b4aa933fd4b8c82ea07567024882c, State: Running, Role: LEADER
I20260709 14:55:25.834703 18311 raft_consensus.cc:3060] T b2b20170ec59458c9b9a18ca1e2a34d6 P ec71ef77a55848a0add75a6c104cc9a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:55:25.835511 18163 consensus_queue.cc:260] T b2b20170ec59458c9b9a18ca1e2a34d6 P f75b4aa933fd4b8c82ea07567024882c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:25.836621 18163 raft_consensus.cc:3060] T b2b20170ec59458c9b9a18ca1e2a34d6 P f75b4aa933fd4b8c82ea07567024882c [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:55:25.842422 18311 raft_consensus.cc:2468] T b2b20170ec59458c9b9a18ca1e2a34d6 P ec71ef77a55848a0add75a6c104cc9a9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95234c5b69eb4fe4a7558e56eedbe71a in term 2.
I20260709 14:55:25.842751 18163 raft_consensus.cc:2468] T b2b20170ec59458c9b9a18ca1e2a34d6 P f75b4aa933fd4b8c82ea07567024882c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95234c5b69eb4fe4a7558e56eedbe71a in term 2.
I20260709 14:55:25.844138 18202 leader_election.cc:304] T b2b20170ec59458c9b9a18ca1e2a34d6 P 95234c5b69eb4fe4a7558e56eedbe71a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95234c5b69eb4fe4a7558e56eedbe71a, ec71ef77a55848a0add75a6c104cc9a9; no voters: 
I20260709 14:55:25.845175 18362 raft_consensus.cc:2804] T b2b20170ec59458c9b9a18ca1e2a34d6 P 95234c5b69eb4fe4a7558e56eedbe71a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:55:25.845808 18362 raft_consensus.cc:697] T b2b20170ec59458c9b9a18ca1e2a34d6 P 95234c5b69eb4fe4a7558e56eedbe71a [term 2 LEADER]: Becoming Leader. State: Replica: 95234c5b69eb4fe4a7558e56eedbe71a, State: Running, Role: LEADER
I20260709 14:55:25.846630 18362 consensus_queue.cc:237] T b2b20170ec59458c9b9a18ca1e2a34d6 P 95234c5b69eb4fe4a7558e56eedbe71a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:25.854720 18060 catalog_manager.cc:5697] T b2b20170ec59458c9b9a18ca1e2a34d6 P 95234c5b69eb4fe4a7558e56eedbe71a reported cstate change: term changed from 1 to 2, leader changed from f75b4aa933fd4b8c82ea07567024882c (127.6.101.65) to 95234c5b69eb4fe4a7558e56eedbe71a (127.6.101.66). New cstate: current_term: 2 leader_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } health_report { overall_health: UNKNOWN } } }
I20260709 14:55:25.912200 18383 raft_consensus.cc:993] T 528cd6046e1f4e7e8cc77f09c4578612 P ec71ef77a55848a0add75a6c104cc9a9: : Instructing follower f75b4aa933fd4b8c82ea07567024882c to start an election
I20260709 14:55:25.912873 18382 raft_consensus.cc:1081] T 528cd6046e1f4e7e8cc77f09c4578612 P ec71ef77a55848a0add75a6c104cc9a9 [term 1 LEADER]: Signalling peer f75b4aa933fd4b8c82ea07567024882c to start an election
I20260709 14:55:25.915040 18163 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "528cd6046e1f4e7e8cc77f09c4578612"
dest_uuid: "f75b4aa933fd4b8c82ea07567024882c"
 from {username='slave'} at 127.0.0.1:55796
I20260709 14:55:25.915750 18163 raft_consensus.cc:493] T 528cd6046e1f4e7e8cc77f09c4578612 P f75b4aa933fd4b8c82ea07567024882c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:55:25.916085 18163 raft_consensus.cc:3060] T 528cd6046e1f4e7e8cc77f09c4578612 P f75b4aa933fd4b8c82ea07567024882c [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:55:25.922302 18163 raft_consensus.cc:515] T 528cd6046e1f4e7e8cc77f09c4578612 P f75b4aa933fd4b8c82ea07567024882c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:25.924873 18163 leader_election.cc:290] T 528cd6046e1f4e7e8cc77f09c4578612 P f75b4aa933fd4b8c82ea07567024882c [CANDIDATE]: Term 2 election: Requested vote from peers 95234c5b69eb4fe4a7558e56eedbe71a (127.6.101.66:42897), ec71ef77a55848a0add75a6c104cc9a9 (127.6.101.67:42661)
I20260709 14:55:25.926059 18238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528cd6046e1f4e7e8cc77f09c4578612" candidate_uuid: "f75b4aa933fd4b8c82ea07567024882c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "95234c5b69eb4fe4a7558e56eedbe71a"
I20260709 14:55:25.926142 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528cd6046e1f4e7e8cc77f09c4578612" candidate_uuid: "f75b4aa933fd4b8c82ea07567024882c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ec71ef77a55848a0add75a6c104cc9a9"
I20260709 14:55:25.926769 18238 raft_consensus.cc:3060] T 528cd6046e1f4e7e8cc77f09c4578612 P 95234c5b69eb4fe4a7558e56eedbe71a [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:55:25.926946 18311 raft_consensus.cc:3055] T 528cd6046e1f4e7e8cc77f09c4578612 P ec71ef77a55848a0add75a6c104cc9a9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 14:55:25.927335 18311 raft_consensus.cc:740] T 528cd6046e1f4e7e8cc77f09c4578612 P ec71ef77a55848a0add75a6c104cc9a9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ec71ef77a55848a0add75a6c104cc9a9, State: Running, Role: LEADER
I20260709 14:55:25.928043 18311 consensus_queue.cc:260] T 528cd6046e1f4e7e8cc77f09c4578612 P ec71ef77a55848a0add75a6c104cc9a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:25.929044 18311 raft_consensus.cc:3060] T 528cd6046e1f4e7e8cc77f09c4578612 P ec71ef77a55848a0add75a6c104cc9a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:55:25.933563 18238 raft_consensus.cc:2468] T 528cd6046e1f4e7e8cc77f09c4578612 P 95234c5b69eb4fe4a7558e56eedbe71a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f75b4aa933fd4b8c82ea07567024882c in term 2.
I20260709 14:55:25.934722 18311 raft_consensus.cc:2468] T 528cd6046e1f4e7e8cc77f09c4578612 P ec71ef77a55848a0add75a6c104cc9a9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f75b4aa933fd4b8c82ea07567024882c in term 2.
I20260709 14:55:25.935115 18129 leader_election.cc:304] T 528cd6046e1f4e7e8cc77f09c4578612 P f75b4aa933fd4b8c82ea07567024882c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95234c5b69eb4fe4a7558e56eedbe71a, f75b4aa933fd4b8c82ea07567024882c; no voters: 
I20260709 14:55:25.936127 18363 raft_consensus.cc:2804] T 528cd6046e1f4e7e8cc77f09c4578612 P f75b4aa933fd4b8c82ea07567024882c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:55:25.936575 18363 raft_consensus.cc:697] T 528cd6046e1f4e7e8cc77f09c4578612 P f75b4aa933fd4b8c82ea07567024882c [term 2 LEADER]: Becoming Leader. State: Replica: f75b4aa933fd4b8c82ea07567024882c, State: Running, Role: LEADER
I20260709 14:55:25.937610 18363 consensus_queue.cc:237] T 528cd6046e1f4e7e8cc77f09c4578612 P f75b4aa933fd4b8c82ea07567024882c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:25.945339 18060 catalog_manager.cc:5697] T 528cd6046e1f4e7e8cc77f09c4578612 P f75b4aa933fd4b8c82ea07567024882c reported cstate change: term changed from 1 to 2, leader changed from ec71ef77a55848a0add75a6c104cc9a9 (127.6.101.67) to f75b4aa933fd4b8c82ea07567024882c (127.6.101.65). New cstate: current_term: 2 leader_uuid: "f75b4aa933fd4b8c82ea07567024882c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } health_report { overall_health: UNKNOWN } } }
I20260709 14:55:26.033919 18238 raft_consensus.cc:1275] T 8c253d3492704370910e00d866ea41a2 P 95234c5b69eb4fe4a7558e56eedbe71a [term 2 FOLLOWER]: Refusing update from remote peer f75b4aa933fd4b8c82ea07567024882c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:55:26.039006 18363 consensus_queue.cc:1048] T 8c253d3492704370910e00d866ea41a2 P f75b4aa933fd4b8c82ea07567024882c [LEADER]: Connected to new peer: Peer: permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 14:55:26.040939 18311 raft_consensus.cc:1275] T 11525d1d42074736bf180ebaafed1e98 P ec71ef77a55848a0add75a6c104cc9a9 [term 2 FOLLOWER]: Refusing update from remote peer 95234c5b69eb4fe4a7558e56eedbe71a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:55:26.042673 18423 consensus_queue.cc:1048] T 11525d1d42074736bf180ebaafed1e98 P 95234c5b69eb4fe4a7558e56eedbe71a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 14:55:26.050781 18310 raft_consensus.cc:1275] T 8c253d3492704370910e00d866ea41a2 P ec71ef77a55848a0add75a6c104cc9a9 [term 2 FOLLOWER]: Refusing update from remote peer f75b4aa933fd4b8c82ea07567024882c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:55:26.052230 18435 consensus_queue.cc:1048] T 8c253d3492704370910e00d866ea41a2 P f75b4aa933fd4b8c82ea07567024882c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 14:55:26.062124 18163 raft_consensus.cc:1275] T 11525d1d42074736bf180ebaafed1e98 P f75b4aa933fd4b8c82ea07567024882c [term 2 FOLLOWER]: Refusing update from remote peer 95234c5b69eb4fe4a7558e56eedbe71a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:55:26.066654 18362 consensus_queue.cc:1048] T 11525d1d42074736bf180ebaafed1e98 P 95234c5b69eb4fe4a7558e56eedbe71a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 14:55:26.067946 18163 raft_consensus.cc:1275] T 39965dc306aa4828a74a07da020fe662 P f75b4aa933fd4b8c82ea07567024882c [term 2 FOLLOWER]: Refusing update from remote peer 95234c5b69eb4fe4a7558e56eedbe71a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:55:26.070142 18362 consensus_queue.cc:1048] T 39965dc306aa4828a74a07da020fe662 P 95234c5b69eb4fe4a7558e56eedbe71a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 14:55:26.088158 18310 raft_consensus.cc:1275] T 39965dc306aa4828a74a07da020fe662 P ec71ef77a55848a0add75a6c104cc9a9 [term 2 FOLLOWER]: Refusing update from remote peer 95234c5b69eb4fe4a7558e56eedbe71a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:55:26.089838 18362 consensus_queue.cc:1048] T 39965dc306aa4828a74a07da020fe662 P 95234c5b69eb4fe4a7558e56eedbe71a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 14:55:26.194820 18238 raft_consensus.cc:1275] T f2ae10cc8d774889b54c598119fa0deb P 95234c5b69eb4fe4a7558e56eedbe71a [term 2 FOLLOWER]: Refusing update from remote peer f75b4aa933fd4b8c82ea07567024882c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:55:26.196473 18435 consensus_queue.cc:1048] T f2ae10cc8d774889b54c598119fa0deb P f75b4aa933fd4b8c82ea07567024882c [LEADER]: Connected to new peer: Peer: permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 14:55:26.207319 18310 raft_consensus.cc:1275] T f2ae10cc8d774889b54c598119fa0deb P ec71ef77a55848a0add75a6c104cc9a9 [term 2 FOLLOWER]: Refusing update from remote peer f75b4aa933fd4b8c82ea07567024882c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:55:26.209981 18435 consensus_queue.cc:1048] T f2ae10cc8d774889b54c598119fa0deb P f75b4aa933fd4b8c82ea07567024882c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 14:55:26.254705 18310 raft_consensus.cc:1275] T b2b20170ec59458c9b9a18ca1e2a34d6 P ec71ef77a55848a0add75a6c104cc9a9 [term 2 FOLLOWER]: Refusing update from remote peer 95234c5b69eb4fe4a7558e56eedbe71a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:55:26.256335 18362 consensus_queue.cc:1048] T b2b20170ec59458c9b9a18ca1e2a34d6 P 95234c5b69eb4fe4a7558e56eedbe71a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 14:55:26.267290 18162 raft_consensus.cc:1275] T b2b20170ec59458c9b9a18ca1e2a34d6 P f75b4aa933fd4b8c82ea07567024882c [term 2 FOLLOWER]: Refusing update from remote peer 95234c5b69eb4fe4a7558e56eedbe71a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:55:26.269234 18362 consensus_queue.cc:1048] T b2b20170ec59458c9b9a18ca1e2a34d6 P 95234c5b69eb4fe4a7558e56eedbe71a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 14:55:26.334416 18238 raft_consensus.cc:1275] T bf34b3256cdf42dbaf4cad11d1a42160 P 95234c5b69eb4fe4a7558e56eedbe71a [term 2 FOLLOWER]: Refusing update from remote peer f75b4aa933fd4b8c82ea07567024882c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:55:26.336203 18435 consensus_queue.cc:1048] T bf34b3256cdf42dbaf4cad11d1a42160 P f75b4aa933fd4b8c82ea07567024882c [LEADER]: Connected to new peer: Peer: permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 14:55:26.347419 18310 raft_consensus.cc:1275] T bf34b3256cdf42dbaf4cad11d1a42160 P ec71ef77a55848a0add75a6c104cc9a9 [term 2 FOLLOWER]: Refusing update from remote peer f75b4aa933fd4b8c82ea07567024882c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:55:26.349118 18400 consensus_queue.cc:1048] T bf34b3256cdf42dbaf4cad11d1a42160 P f75b4aa933fd4b8c82ea07567024882c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 14:55:26.462589 18310 raft_consensus.cc:1275] T 528cd6046e1f4e7e8cc77f09c4578612 P ec71ef77a55848a0add75a6c104cc9a9 [term 2 FOLLOWER]: Refusing update from remote peer f75b4aa933fd4b8c82ea07567024882c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:55:26.464090 18400 consensus_queue.cc:1048] T 528cd6046e1f4e7e8cc77f09c4578612 P f75b4aa933fd4b8c82ea07567024882c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 14:55:26.474805 18238 raft_consensus.cc:1275] T 528cd6046e1f4e7e8cc77f09c4578612 P 95234c5b69eb4fe4a7558e56eedbe71a [term 2 FOLLOWER]: Refusing update from remote peer f75b4aa933fd4b8c82ea07567024882c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:55:26.476668 18363 consensus_queue.cc:1048] T 528cd6046e1f4e7e8cc77f09c4578612 P f75b4aa933fd4b8c82ea07567024882c [LEADER]: Connected to new peer: Peer: permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 14:55:28.480979 18060 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58838:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 14:55:28.484099 18060 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 14:55:28.539587 18149 tablet_service.cc:1511] Processing CreateTablet for tablet 84b1a73cbc1e4c56a0a733d2cdacc300 (DEFAULT_TABLE table=soft_deleted_table [id=889304c2491e40d188f32c57660dc3ba]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 14:55:28.540808 18149 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84b1a73cbc1e4c56a0a733d2cdacc300. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:55:28.540567 18224 tablet_service.cc:1511] Processing CreateTablet for tablet 84b1a73cbc1e4c56a0a733d2cdacc300 (DEFAULT_TABLE table=soft_deleted_table [id=889304c2491e40d188f32c57660dc3ba]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 14:55:28.542150 18224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84b1a73cbc1e4c56a0a733d2cdacc300. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:55:28.543264 18299 tablet_service.cc:1511] Processing CreateTablet for tablet 84b1a73cbc1e4c56a0a733d2cdacc300 (DEFAULT_TABLE table=soft_deleted_table [id=889304c2491e40d188f32c57660dc3ba]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 14:55:28.544839 18299 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84b1a73cbc1e4c56a0a733d2cdacc300. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:55:28.545464 18151 tablet_service.cc:1511] Processing CreateTablet for tablet 4040b77ce4d34a34baf6e31e9364f07b (DEFAULT_TABLE table=soft_deleted_table [id=889304c2491e40d188f32c57660dc3ba]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 14:55:28.547075 18151 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4040b77ce4d34a34baf6e31e9364f07b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:55:28.548158 18226 tablet_service.cc:1511] Processing CreateTablet for tablet 4040b77ce4d34a34baf6e31e9364f07b (DEFAULT_TABLE table=soft_deleted_table [id=889304c2491e40d188f32c57660dc3ba]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 14:55:28.549636 18226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4040b77ce4d34a34baf6e31e9364f07b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:55:28.554059 18298 tablet_service.cc:1511] Processing CreateTablet for tablet 4040b77ce4d34a34baf6e31e9364f07b (DEFAULT_TABLE table=soft_deleted_table [id=889304c2491e40d188f32c57660dc3ba]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 14:55:28.555529 18298 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4040b77ce4d34a34baf6e31e9364f07b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:55:28.556725 18146 tablet_service.cc:1511] Processing CreateTablet for tablet f0007e8bcd5d478482896147adc197b0 (DEFAULT_TABLE table=soft_deleted_table [id=889304c2491e40d188f32c57660dc3ba]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 14:55:28.558255 18146 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0007e8bcd5d478482896147adc197b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:55:28.559099 18225 tablet_service.cc:1511] Processing CreateTablet for tablet f0007e8bcd5d478482896147adc197b0 (DEFAULT_TABLE table=soft_deleted_table [id=889304c2491e40d188f32c57660dc3ba]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 14:55:28.560432 18225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0007e8bcd5d478482896147adc197b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:55:28.561674 18296 tablet_service.cc:1511] Processing CreateTablet for tablet f0007e8bcd5d478482896147adc197b0 (DEFAULT_TABLE table=soft_deleted_table [id=889304c2491e40d188f32c57660dc3ba]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 14:55:28.563265 18296 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0007e8bcd5d478482896147adc197b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:55:28.582999 18147 tablet_service.cc:1511] Processing CreateTablet for tablet e416808f5061489aa8191b18817678d0 (DEFAULT_TABLE table=soft_deleted_table [id=889304c2491e40d188f32c57660dc3ba]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 14:55:28.584676 18147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e416808f5061489aa8191b18817678d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:55:28.585378 18228 tablet_service.cc:1511] Processing CreateTablet for tablet e416808f5061489aa8191b18817678d0 (DEFAULT_TABLE table=soft_deleted_table [id=889304c2491e40d188f32c57660dc3ba]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 14:55:28.586814 18228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e416808f5061489aa8191b18817678d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:55:28.587582 18302 tablet_service.cc:1511] Processing CreateTablet for tablet e416808f5061489aa8191b18817678d0 (DEFAULT_TABLE table=soft_deleted_table [id=889304c2491e40d188f32c57660dc3ba]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 14:55:28.589769 18302 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e416808f5061489aa8191b18817678d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:55:28.594282 18153 tablet_service.cc:1511] Processing CreateTablet for tablet 03cb02cb11914a5db0023952fc210283 (DEFAULT_TABLE table=soft_deleted_table [id=889304c2491e40d188f32c57660dc3ba]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 14:55:28.595973 18153 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03cb02cb11914a5db0023952fc210283. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:55:28.599697 18301 tablet_service.cc:1511] Processing CreateTablet for tablet 03cb02cb11914a5db0023952fc210283 (DEFAULT_TABLE table=soft_deleted_table [id=889304c2491e40d188f32c57660dc3ba]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 14:55:28.597430 18227 tablet_service.cc:1511] Processing CreateTablet for tablet 03cb02cb11914a5db0023952fc210283 (DEFAULT_TABLE table=soft_deleted_table [id=889304c2491e40d188f32c57660dc3ba]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 14:55:28.602504 18152 tablet_service.cc:1511] Processing CreateTablet for tablet 8885f7ee722545ff8d091567e7f09d69 (DEFAULT_TABLE table=soft_deleted_table [id=889304c2491e40d188f32c57660dc3ba]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 14:55:28.603272 18227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03cb02cb11914a5db0023952fc210283. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:55:28.603979 18152 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8885f7ee722545ff8d091567e7f09d69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:55:28.605345 18301 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03cb02cb11914a5db0023952fc210283. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:55:28.610797 18223 tablet_service.cc:1511] Processing CreateTablet for tablet 8885f7ee722545ff8d091567e7f09d69 (DEFAULT_TABLE table=soft_deleted_table [id=889304c2491e40d188f32c57660dc3ba]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 14:55:28.612601 18223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8885f7ee722545ff8d091567e7f09d69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:55:28.614424 18299 tablet_service.cc:1511] Processing CreateTablet for tablet 8885f7ee722545ff8d091567e7f09d69 (DEFAULT_TABLE table=soft_deleted_table [id=889304c2491e40d188f32c57660dc3ba]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 14:55:28.616432 18148 tablet_service.cc:1511] Processing CreateTablet for tablet 86887bfdd39840a4ac9a63d78fcf0c67 (DEFAULT_TABLE table=soft_deleted_table [id=889304c2491e40d188f32c57660dc3ba]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 14:55:28.619354 18148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86887bfdd39840a4ac9a63d78fcf0c67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:55:28.619441 18222 tablet_service.cc:1511] Processing CreateTablet for tablet 86887bfdd39840a4ac9a63d78fcf0c67 (DEFAULT_TABLE table=soft_deleted_table [id=889304c2491e40d188f32c57660dc3ba]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 14:55:28.623430 18222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86887bfdd39840a4ac9a63d78fcf0c67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:55:28.632916 18299 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8885f7ee722545ff8d091567e7f09d69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:55:28.637506 18150 tablet_service.cc:1511] Processing CreateTablet for tablet 45dc6924b995473493ccf8d5b0ba3668 (DEFAULT_TABLE table=soft_deleted_table [id=889304c2491e40d188f32c57660dc3ba]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 14:55:28.643885 18150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45dc6924b995473493ccf8d5b0ba3668. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:55:28.638582 18296 tablet_service.cc:1511] Processing CreateTablet for tablet 86887bfdd39840a4ac9a63d78fcf0c67 (DEFAULT_TABLE table=soft_deleted_table [id=889304c2491e40d188f32c57660dc3ba]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 14:55:28.638669 18221 tablet_service.cc:1511] Processing CreateTablet for tablet 45dc6924b995473493ccf8d5b0ba3668 (DEFAULT_TABLE table=soft_deleted_table [id=889304c2491e40d188f32c57660dc3ba]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 14:55:28.654186 18221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45dc6924b995473493ccf8d5b0ba3668. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:55:28.656450 18295 tablet_service.cc:1511] Processing CreateTablet for tablet 45dc6924b995473493ccf8d5b0ba3668 (DEFAULT_TABLE table=soft_deleted_table [id=889304c2491e40d188f32c57660dc3ba]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 14:55:28.664721 18295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45dc6924b995473493ccf8d5b0ba3668. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:55:28.667150 18149 tablet_service.cc:1511] Processing CreateTablet for tablet 744d4bd8bf6440d78510bd3a8b14481c (DEFAULT_TABLE table=soft_deleted_table [id=889304c2491e40d188f32c57660dc3ba]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 14:55:28.669016 18149 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 744d4bd8bf6440d78510bd3a8b14481c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:55:28.675537 18296 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86887bfdd39840a4ac9a63d78fcf0c67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:55:28.683764 18220 tablet_service.cc:1511] Processing CreateTablet for tablet 744d4bd8bf6440d78510bd3a8b14481c (DEFAULT_TABLE table=soft_deleted_table [id=889304c2491e40d188f32c57660dc3ba]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 14:55:28.685501 18220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 744d4bd8bf6440d78510bd3a8b14481c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:55:28.715852 18459 tablet_bootstrap.cc:492] T 4040b77ce4d34a34baf6e31e9364f07b P ec71ef77a55848a0add75a6c104cc9a9: Bootstrap starting.
I20260709 14:55:28.734273 18298 tablet_service.cc:1511] Processing CreateTablet for tablet 744d4bd8bf6440d78510bd3a8b14481c (DEFAULT_TABLE table=soft_deleted_table [id=889304c2491e40d188f32c57660dc3ba]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 14:55:28.735764 18298 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 744d4bd8bf6440d78510bd3a8b14481c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 14:55:28.738009 18460 tablet_bootstrap.cc:492] T 8885f7ee722545ff8d091567e7f09d69 P f75b4aa933fd4b8c82ea07567024882c: Bootstrap starting.
I20260709 14:55:28.743786 18461 tablet_bootstrap.cc:492] T f0007e8bcd5d478482896147adc197b0 P 95234c5b69eb4fe4a7558e56eedbe71a: Bootstrap starting.
I20260709 14:55:28.746323 18459 tablet_bootstrap.cc:654] T 4040b77ce4d34a34baf6e31e9364f07b P ec71ef77a55848a0add75a6c104cc9a9: Neither blocks nor log segments found. Creating new log.
I20260709 14:55:28.755349 18461 tablet_bootstrap.cc:654] T f0007e8bcd5d478482896147adc197b0 P 95234c5b69eb4fe4a7558e56eedbe71a: Neither blocks nor log segments found. Creating new log.
I20260709 14:55:28.750864 18460 tablet_bootstrap.cc:654] T 8885f7ee722545ff8d091567e7f09d69 P f75b4aa933fd4b8c82ea07567024882c: Neither blocks nor log segments found. Creating new log.
I20260709 14:55:28.776643 18459 tablet_bootstrap.cc:492] T 4040b77ce4d34a34baf6e31e9364f07b P ec71ef77a55848a0add75a6c104cc9a9: No bootstrap required, opened a new log
I20260709 14:55:28.777396 18459 ts_tablet_manager.cc:1403] T 4040b77ce4d34a34baf6e31e9364f07b P ec71ef77a55848a0add75a6c104cc9a9: Time spent bootstrapping tablet: real 0.062s	user 0.014s	sys 0.000s
I20260709 14:55:28.787374 18461 tablet_bootstrap.cc:492] T f0007e8bcd5d478482896147adc197b0 P 95234c5b69eb4fe4a7558e56eedbe71a: No bootstrap required, opened a new log
I20260709 14:55:28.788209 18461 ts_tablet_manager.cc:1403] T f0007e8bcd5d478482896147adc197b0 P 95234c5b69eb4fe4a7558e56eedbe71a: Time spent bootstrapping tablet: real 0.045s	user 0.012s	sys 0.007s
I20260709 14:55:28.792079 18461 raft_consensus.cc:359] T f0007e8bcd5d478482896147adc197b0 P 95234c5b69eb4fe4a7558e56eedbe71a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:28.780696 18459 raft_consensus.cc:359] T 4040b77ce4d34a34baf6e31e9364f07b P ec71ef77a55848a0add75a6c104cc9a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:28.795106 18459 raft_consensus.cc:385] T 4040b77ce4d34a34baf6e31e9364f07b P ec71ef77a55848a0add75a6c104cc9a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:55:28.795588 18459 raft_consensus.cc:740] T 4040b77ce4d34a34baf6e31e9364f07b P ec71ef77a55848a0add75a6c104cc9a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec71ef77a55848a0add75a6c104cc9a9, State: Initialized, Role: FOLLOWER
I20260709 14:55:28.802143 18459 consensus_queue.cc:260] T 4040b77ce4d34a34baf6e31e9364f07b P ec71ef77a55848a0add75a6c104cc9a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:28.806457 18460 tablet_bootstrap.cc:492] T 8885f7ee722545ff8d091567e7f09d69 P f75b4aa933fd4b8c82ea07567024882c: No bootstrap required, opened a new log
I20260709 14:55:28.807309 18460 ts_tablet_manager.cc:1403] T 8885f7ee722545ff8d091567e7f09d69 P f75b4aa933fd4b8c82ea07567024882c: Time spent bootstrapping tablet: real 0.070s	user 0.017s	sys 0.021s
I20260709 14:55:28.806742 18459 ts_tablet_manager.cc:1434] T 4040b77ce4d34a34baf6e31e9364f07b P ec71ef77a55848a0add75a6c104cc9a9: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.000s
I20260709 14:55:28.810813 18460 raft_consensus.cc:359] T 8885f7ee722545ff8d091567e7f09d69 P f75b4aa933fd4b8c82ea07567024882c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:28.811717 18459 tablet_bootstrap.cc:492] T f0007e8bcd5d478482896147adc197b0 P ec71ef77a55848a0add75a6c104cc9a9: Bootstrap starting.
I20260709 14:55:28.811705 18460 raft_consensus.cc:385] T 8885f7ee722545ff8d091567e7f09d69 P f75b4aa933fd4b8c82ea07567024882c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:55:28.814153 18460 raft_consensus.cc:740] T 8885f7ee722545ff8d091567e7f09d69 P f75b4aa933fd4b8c82ea07567024882c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f75b4aa933fd4b8c82ea07567024882c, State: Initialized, Role: FOLLOWER
I20260709 14:55:28.794335 18461 raft_consensus.cc:385] T f0007e8bcd5d478482896147adc197b0 P 95234c5b69eb4fe4a7558e56eedbe71a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:55:28.815213 18461 raft_consensus.cc:740] T f0007e8bcd5d478482896147adc197b0 P 95234c5b69eb4fe4a7558e56eedbe71a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95234c5b69eb4fe4a7558e56eedbe71a, State: Initialized, Role: FOLLOWER
I20260709 14:55:28.815337 18460 consensus_queue.cc:260] T 8885f7ee722545ff8d091567e7f09d69 P f75b4aa933fd4b8c82ea07567024882c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:28.816265 18461 consensus_queue.cc:260] T f0007e8bcd5d478482896147adc197b0 P 95234c5b69eb4fe4a7558e56eedbe71a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:28.819991 18459 tablet_bootstrap.cc:654] T f0007e8bcd5d478482896147adc197b0 P ec71ef77a55848a0add75a6c104cc9a9: Neither blocks nor log segments found. Creating new log.
I20260709 14:55:28.820323 18461 ts_tablet_manager.cc:1434] T f0007e8bcd5d478482896147adc197b0 P 95234c5b69eb4fe4a7558e56eedbe71a: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.001s
I20260709 14:55:28.821566 18461 tablet_bootstrap.cc:492] T e416808f5061489aa8191b18817678d0 P 95234c5b69eb4fe4a7558e56eedbe71a: Bootstrap starting.
I20260709 14:55:28.830145 18461 tablet_bootstrap.cc:654] T e416808f5061489aa8191b18817678d0 P 95234c5b69eb4fe4a7558e56eedbe71a: Neither blocks nor log segments found. Creating new log.
I20260709 14:55:28.830250 18460 ts_tablet_manager.cc:1434] T 8885f7ee722545ff8d091567e7f09d69 P f75b4aa933fd4b8c82ea07567024882c: Time spent starting tablet: real 0.023s	user 0.003s	sys 0.005s
I20260709 14:55:28.831553 18460 tablet_bootstrap.cc:492] T 84b1a73cbc1e4c56a0a733d2cdacc300 P f75b4aa933fd4b8c82ea07567024882c: Bootstrap starting.
I20260709 14:55:28.834121 18459 tablet_bootstrap.cc:492] T f0007e8bcd5d478482896147adc197b0 P ec71ef77a55848a0add75a6c104cc9a9: No bootstrap required, opened a new log
I20260709 14:55:28.834903 18459 ts_tablet_manager.cc:1403] T f0007e8bcd5d478482896147adc197b0 P ec71ef77a55848a0add75a6c104cc9a9: Time spent bootstrapping tablet: real 0.023s	user 0.016s	sys 0.004s
I20260709 14:55:28.838790 18460 tablet_bootstrap.cc:654] T 84b1a73cbc1e4c56a0a733d2cdacc300 P f75b4aa933fd4b8c82ea07567024882c: Neither blocks nor log segments found. Creating new log.
I20260709 14:55:28.838821 18459 raft_consensus.cc:359] T f0007e8bcd5d478482896147adc197b0 P ec71ef77a55848a0add75a6c104cc9a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:28.840076 18459 raft_consensus.cc:385] T f0007e8bcd5d478482896147adc197b0 P ec71ef77a55848a0add75a6c104cc9a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:55:28.840461 18459 raft_consensus.cc:740] T f0007e8bcd5d478482896147adc197b0 P ec71ef77a55848a0add75a6c104cc9a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec71ef77a55848a0add75a6c104cc9a9, State: Initialized, Role: FOLLOWER
I20260709 14:55:28.841617 18459 consensus_queue.cc:260] T f0007e8bcd5d478482896147adc197b0 P ec71ef77a55848a0add75a6c104cc9a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:28.844627 18459 ts_tablet_manager.cc:1434] T f0007e8bcd5d478482896147adc197b0 P ec71ef77a55848a0add75a6c104cc9a9: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.004s
I20260709 14:55:28.847101 18459 tablet_bootstrap.cc:492] T 84b1a73cbc1e4c56a0a733d2cdacc300 P ec71ef77a55848a0add75a6c104cc9a9: Bootstrap starting.
I20260709 14:55:28.848030 18461 tablet_bootstrap.cc:492] T e416808f5061489aa8191b18817678d0 P 95234c5b69eb4fe4a7558e56eedbe71a: No bootstrap required, opened a new log
I20260709 14:55:28.848798 18461 ts_tablet_manager.cc:1403] T e416808f5061489aa8191b18817678d0 P 95234c5b69eb4fe4a7558e56eedbe71a: Time spent bootstrapping tablet: real 0.028s	user 0.014s	sys 0.011s
I20260709 14:55:28.852854 18461 raft_consensus.cc:359] T e416808f5061489aa8191b18817678d0 P 95234c5b69eb4fe4a7558e56eedbe71a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:28.854199 18461 raft_consensus.cc:385] T e416808f5061489aa8191b18817678d0 P 95234c5b69eb4fe4a7558e56eedbe71a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:55:28.854627 18461 raft_consensus.cc:740] T e416808f5061489aa8191b18817678d0 P 95234c5b69eb4fe4a7558e56eedbe71a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95234c5b69eb4fe4a7558e56eedbe71a, State: Initialized, Role: FOLLOWER
I20260709 14:55:28.855461 18459 tablet_bootstrap.cc:654] T 84b1a73cbc1e4c56a0a733d2cdacc300 P ec71ef77a55848a0add75a6c104cc9a9: Neither blocks nor log segments found. Creating new log.
I20260709 14:55:28.855717 18461 consensus_queue.cc:260] T e416808f5061489aa8191b18817678d0 P 95234c5b69eb4fe4a7558e56eedbe71a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:28.859090 18461 ts_tablet_manager.cc:1434] T e416808f5061489aa8191b18817678d0 P 95234c5b69eb4fe4a7558e56eedbe71a: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.001s
I20260709 14:55:28.860625 18461 tablet_bootstrap.cc:492] T 84b1a73cbc1e4c56a0a733d2cdacc300 P 95234c5b69eb4fe4a7558e56eedbe71a: Bootstrap starting.
I20260709 14:55:28.862715 18460 tablet_bootstrap.cc:492] T 84b1a73cbc1e4c56a0a733d2cdacc300 P f75b4aa933fd4b8c82ea07567024882c: No bootstrap required, opened a new log
I20260709 14:55:28.863428 18460 ts_tablet_manager.cc:1403] T 84b1a73cbc1e4c56a0a733d2cdacc300 P f75b4aa933fd4b8c82ea07567024882c: Time spent bootstrapping tablet: real 0.032s	user 0.014s	sys 0.000s
I20260709 14:55:28.866995 18460 raft_consensus.cc:359] T 84b1a73cbc1e4c56a0a733d2cdacc300 P f75b4aa933fd4b8c82ea07567024882c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:28.867878 18460 raft_consensus.cc:385] T 84b1a73cbc1e4c56a0a733d2cdacc300 P f75b4aa933fd4b8c82ea07567024882c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:55:28.868206 18460 raft_consensus.cc:740] T 84b1a73cbc1e4c56a0a733d2cdacc300 P f75b4aa933fd4b8c82ea07567024882c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f75b4aa933fd4b8c82ea07567024882c, State: Initialized, Role: FOLLOWER
I20260709 14:55:28.868901 18461 tablet_bootstrap.cc:654] T 84b1a73cbc1e4c56a0a733d2cdacc300 P 95234c5b69eb4fe4a7558e56eedbe71a: Neither blocks nor log segments found. Creating new log.
I20260709 14:55:28.869021 18460 consensus_queue.cc:260] T 84b1a73cbc1e4c56a0a733d2cdacc300 P f75b4aa933fd4b8c82ea07567024882c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:28.875313 18459 tablet_bootstrap.cc:492] T 84b1a73cbc1e4c56a0a733d2cdacc300 P ec71ef77a55848a0add75a6c104cc9a9: No bootstrap required, opened a new log
I20260709 14:55:28.876024 18459 ts_tablet_manager.cc:1403] T 84b1a73cbc1e4c56a0a733d2cdacc300 P ec71ef77a55848a0add75a6c104cc9a9: Time spent bootstrapping tablet: real 0.029s	user 0.009s	sys 0.009s
I20260709 14:55:28.876842 18460 ts_tablet_manager.cc:1434] T 84b1a73cbc1e4c56a0a733d2cdacc300 P f75b4aa933fd4b8c82ea07567024882c: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.000s
I20260709 14:55:28.878062 18460 tablet_bootstrap.cc:492] T f0007e8bcd5d478482896147adc197b0 P f75b4aa933fd4b8c82ea07567024882c: Bootstrap starting.
I20260709 14:55:28.880115 18459 raft_consensus.cc:359] T 84b1a73cbc1e4c56a0a733d2cdacc300 P ec71ef77a55848a0add75a6c104cc9a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:28.881532 18459 raft_consensus.cc:385] T 84b1a73cbc1e4c56a0a733d2cdacc300 P ec71ef77a55848a0add75a6c104cc9a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:55:28.882018 18459 raft_consensus.cc:740] T 84b1a73cbc1e4c56a0a733d2cdacc300 P ec71ef77a55848a0add75a6c104cc9a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec71ef77a55848a0add75a6c104cc9a9, State: Initialized, Role: FOLLOWER
I20260709 14:55:28.882905 18459 consensus_queue.cc:260] T 84b1a73cbc1e4c56a0a733d2cdacc300 P ec71ef77a55848a0add75a6c104cc9a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:28.887614 18460 tablet_bootstrap.cc:654] T f0007e8bcd5d478482896147adc197b0 P f75b4aa933fd4b8c82ea07567024882c: Neither blocks nor log segments found. Creating new log.
I20260709 14:55:28.887780 18459 ts_tablet_manager.cc:1434] T 84b1a73cbc1e4c56a0a733d2cdacc300 P ec71ef77a55848a0add75a6c104cc9a9: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.003s
I20260709 14:55:28.890041 18461 tablet_bootstrap.cc:492] T 84b1a73cbc1e4c56a0a733d2cdacc300 P 95234c5b69eb4fe4a7558e56eedbe71a: No bootstrap required, opened a new log
I20260709 14:55:28.890740 18461 ts_tablet_manager.cc:1403] T 84b1a73cbc1e4c56a0a733d2cdacc300 P 95234c5b69eb4fe4a7558e56eedbe71a: Time spent bootstrapping tablet: real 0.030s	user 0.017s	sys 0.003s
I20260709 14:55:28.890828 18459 tablet_bootstrap.cc:492] T e416808f5061489aa8191b18817678d0 P ec71ef77a55848a0add75a6c104cc9a9: Bootstrap starting.
I20260709 14:55:28.894539 18461 raft_consensus.cc:359] T 84b1a73cbc1e4c56a0a733d2cdacc300 P 95234c5b69eb4fe4a7558e56eedbe71a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:28.895190 18461 raft_consensus.cc:385] T 84b1a73cbc1e4c56a0a733d2cdacc300 P 95234c5b69eb4fe4a7558e56eedbe71a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:55:28.895555 18461 raft_consensus.cc:740] T 84b1a73cbc1e4c56a0a733d2cdacc300 P 95234c5b69eb4fe4a7558e56eedbe71a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95234c5b69eb4fe4a7558e56eedbe71a, State: Initialized, Role: FOLLOWER
I20260709 14:55:28.896270 18461 consensus_queue.cc:260] T 84b1a73cbc1e4c56a0a733d2cdacc300 P 95234c5b69eb4fe4a7558e56eedbe71a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:28.898036 18459 tablet_bootstrap.cc:654] T e416808f5061489aa8191b18817678d0 P ec71ef77a55848a0add75a6c104cc9a9: Neither blocks nor log segments found. Creating new log.
I20260709 14:55:28.898682 18461 ts_tablet_manager.cc:1434] T 84b1a73cbc1e4c56a0a733d2cdacc300 P 95234c5b69eb4fe4a7558e56eedbe71a: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.002s
I20260709 14:55:28.900183 18461 tablet_bootstrap.cc:492] T 744d4bd8bf6440d78510bd3a8b14481c P 95234c5b69eb4fe4a7558e56eedbe71a: Bootstrap starting.
I20260709 14:55:28.909137 18461 tablet_bootstrap.cc:654] T 744d4bd8bf6440d78510bd3a8b14481c P 95234c5b69eb4fe4a7558e56eedbe71a: Neither blocks nor log segments found. Creating new log.
I20260709 14:55:28.920586 18460 tablet_bootstrap.cc:492] T f0007e8bcd5d478482896147adc197b0 P f75b4aa933fd4b8c82ea07567024882c: No bootstrap required, opened a new log
I20260709 14:55:28.921350 18459 tablet_bootstrap.cc:492] T e416808f5061489aa8191b18817678d0 P ec71ef77a55848a0add75a6c104cc9a9: No bootstrap required, opened a new log
I20260709 14:55:28.921890 18460 ts_tablet_manager.cc:1403] T f0007e8bcd5d478482896147adc197b0 P f75b4aa933fd4b8c82ea07567024882c: Time spent bootstrapping tablet: real 0.044s	user 0.025s	sys 0.007s
I20260709 14:55:28.922245 18459 ts_tablet_manager.cc:1403] T e416808f5061489aa8191b18817678d0 P ec71ef77a55848a0add75a6c104cc9a9: Time spent bootstrapping tablet: real 0.032s	user 0.017s	sys 0.003s
I20260709 14:55:28.925469 18459 raft_consensus.cc:359] T e416808f5061489aa8191b18817678d0 P ec71ef77a55848a0add75a6c104cc9a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:28.926342 18459 raft_consensus.cc:385] T e416808f5061489aa8191b18817678d0 P ec71ef77a55848a0add75a6c104cc9a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:55:28.926667 18459 raft_consensus.cc:740] T e416808f5061489aa8191b18817678d0 P ec71ef77a55848a0add75a6c104cc9a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec71ef77a55848a0add75a6c104cc9a9, State: Initialized, Role: FOLLOWER
I20260709 14:55:28.926512 18460 raft_consensus.cc:359] T f0007e8bcd5d478482896147adc197b0 P f75b4aa933fd4b8c82ea07567024882c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:28.927575 18460 raft_consensus.cc:385] T f0007e8bcd5d478482896147adc197b0 P f75b4aa933fd4b8c82ea07567024882c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:55:28.927947 18460 raft_consensus.cc:740] T f0007e8bcd5d478482896147adc197b0 P f75b4aa933fd4b8c82ea07567024882c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f75b4aa933fd4b8c82ea07567024882c, State: Initialized, Role: FOLLOWER
I20260709 14:55:28.927712 18459 consensus_queue.cc:260] T e416808f5061489aa8191b18817678d0 P ec71ef77a55848a0add75a6c104cc9a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:28.928634 18461 tablet_bootstrap.cc:492] T 744d4bd8bf6440d78510bd3a8b14481c P 95234c5b69eb4fe4a7558e56eedbe71a: No bootstrap required, opened a new log
I20260709 14:55:28.928982 18460 consensus_queue.cc:260] T f0007e8bcd5d478482896147adc197b0 P f75b4aa933fd4b8c82ea07567024882c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:28.929850 18461 ts_tablet_manager.cc:1403] T 744d4bd8bf6440d78510bd3a8b14481c P 95234c5b69eb4fe4a7558e56eedbe71a: Time spent bootstrapping tablet: real 0.030s	user 0.018s	sys 0.003s
I20260709 14:55:28.930979 18459 ts_tablet_manager.cc:1434] T e416808f5061489aa8191b18817678d0 P ec71ef77a55848a0add75a6c104cc9a9: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 14:55:28.931768 18460 ts_tablet_manager.cc:1434] T f0007e8bcd5d478482896147adc197b0 P f75b4aa933fd4b8c82ea07567024882c: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 14:55:28.932288 18459 tablet_bootstrap.cc:492] T 86887bfdd39840a4ac9a63d78fcf0c67 P ec71ef77a55848a0add75a6c104cc9a9: Bootstrap starting.
I20260709 14:55:28.933516 18461 raft_consensus.cc:359] T 744d4bd8bf6440d78510bd3a8b14481c P 95234c5b69eb4fe4a7558e56eedbe71a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:28.936451 18461 raft_consensus.cc:385] T 744d4bd8bf6440d78510bd3a8b14481c P 95234c5b69eb4fe4a7558e56eedbe71a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:55:28.936851 18461 raft_consensus.cc:740] T 744d4bd8bf6440d78510bd3a8b14481c P 95234c5b69eb4fe4a7558e56eedbe71a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95234c5b69eb4fe4a7558e56eedbe71a, State: Initialized, Role: FOLLOWER
I20260709 14:55:28.937776 18461 consensus_queue.cc:260] T 744d4bd8bf6440d78510bd3a8b14481c P 95234c5b69eb4fe4a7558e56eedbe71a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:28.940719 18461 ts_tablet_manager.cc:1434] T 744d4bd8bf6440d78510bd3a8b14481c P 95234c5b69eb4fe4a7558e56eedbe71a: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 14:55:28.941941 18461 tablet_bootstrap.cc:492] T 8885f7ee722545ff8d091567e7f09d69 P 95234c5b69eb4fe4a7558e56eedbe71a: Bootstrap starting.
I20260709 14:55:28.942438 18459 tablet_bootstrap.cc:654] T 86887bfdd39840a4ac9a63d78fcf0c67 P ec71ef77a55848a0add75a6c104cc9a9: Neither blocks nor log segments found. Creating new log.
I20260709 14:55:28.933003 18460 tablet_bootstrap.cc:492] T 4040b77ce4d34a34baf6e31e9364f07b P f75b4aa933fd4b8c82ea07567024882c: Bootstrap starting.
I20260709 14:55:28.950120 18461 tablet_bootstrap.cc:654] T 8885f7ee722545ff8d091567e7f09d69 P 95234c5b69eb4fe4a7558e56eedbe71a: Neither blocks nor log segments found. Creating new log.
I20260709 14:55:28.953495 18460 tablet_bootstrap.cc:654] T 4040b77ce4d34a34baf6e31e9364f07b P f75b4aa933fd4b8c82ea07567024882c: Neither blocks nor log segments found. Creating new log.
I20260709 14:55:28.960186 18383 raft_consensus.cc:493] T 4040b77ce4d34a34baf6e31e9364f07b P ec71ef77a55848a0add75a6c104cc9a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:55:28.961090 18383 raft_consensus.cc:515] T 4040b77ce4d34a34baf6e31e9364f07b P ec71ef77a55848a0add75a6c104cc9a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:28.964506 18461 tablet_bootstrap.cc:492] T 8885f7ee722545ff8d091567e7f09d69 P 95234c5b69eb4fe4a7558e56eedbe71a: No bootstrap required, opened a new log
I20260709 14:55:28.965310 18459 tablet_bootstrap.cc:492] T 86887bfdd39840a4ac9a63d78fcf0c67 P ec71ef77a55848a0add75a6c104cc9a9: No bootstrap required, opened a new log
I20260709 14:55:28.965067 18162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4040b77ce4d34a34baf6e31e9364f07b" candidate_uuid: "ec71ef77a55848a0add75a6c104cc9a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f75b4aa933fd4b8c82ea07567024882c" is_pre_election: true
I20260709 14:55:28.965436 18461 ts_tablet_manager.cc:1403] T 8885f7ee722545ff8d091567e7f09d69 P 95234c5b69eb4fe4a7558e56eedbe71a: Time spent bootstrapping tablet: real 0.024s	user 0.013s	sys 0.003s
I20260709 14:55:28.965975 18459 ts_tablet_manager.cc:1403] T 86887bfdd39840a4ac9a63d78fcf0c67 P ec71ef77a55848a0add75a6c104cc9a9: Time spent bootstrapping tablet: real 0.034s	user 0.017s	sys 0.000s
I20260709 14:55:28.966042 18460 tablet_bootstrap.cc:492] T 4040b77ce4d34a34baf6e31e9364f07b P f75b4aa933fd4b8c82ea07567024882c: No bootstrap required, opened a new log
I20260709 14:55:28.967445 18460 ts_tablet_manager.cc:1403] T 4040b77ce4d34a34baf6e31e9364f07b P f75b4aa933fd4b8c82ea07567024882c: Time spent bootstrapping tablet: real 0.035s	user 0.010s	sys 0.008s
I20260709 14:55:28.967690 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4040b77ce4d34a34baf6e31e9364f07b" candidate_uuid: "ec71ef77a55848a0add75a6c104cc9a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" is_pre_election: true
W20260709 14:55:28.969640 18278 leader_election.cc:343] T 4040b77ce4d34a34baf6e31e9364f07b P ec71ef77a55848a0add75a6c104cc9a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95234c5b69eb4fe4a7558e56eedbe71a (127.6.101.66:42897): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:55:28.970129 18459 raft_consensus.cc:359] T 86887bfdd39840a4ac9a63d78fcf0c67 P ec71ef77a55848a0add75a6c104cc9a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:28.973999 18459 raft_consensus.cc:385] T 86887bfdd39840a4ac9a63d78fcf0c67 P ec71ef77a55848a0add75a6c104cc9a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 14:55:28.975315 18276 leader_election.cc:343] T 4040b77ce4d34a34baf6e31e9364f07b P ec71ef77a55848a0add75a6c104cc9a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f75b4aa933fd4b8c82ea07567024882c (127.6.101.65:40449): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:55:28.974439 18459 raft_consensus.cc:740] T 86887bfdd39840a4ac9a63d78fcf0c67 P ec71ef77a55848a0add75a6c104cc9a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec71ef77a55848a0add75a6c104cc9a9, State: Initialized, Role: FOLLOWER
I20260709 14:55:28.971547 18383 leader_election.cc:290] T 4040b77ce4d34a34baf6e31e9364f07b P ec71ef77a55848a0add75a6c104cc9a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f75b4aa933fd4b8c82ea07567024882c (127.6.101.65:40449), 95234c5b69eb4fe4a7558e56eedbe71a (127.6.101.66:42897)
I20260709 14:55:28.976199 18276 leader_election.cc:304] T 4040b77ce4d34a34baf6e31e9364f07b P ec71ef77a55848a0add75a6c104cc9a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec71ef77a55848a0add75a6c104cc9a9; no voters: 95234c5b69eb4fe4a7558e56eedbe71a, f75b4aa933fd4b8c82ea07567024882c
I20260709 14:55:28.979979 18383 raft_consensus.cc:2749] T 4040b77ce4d34a34baf6e31e9364f07b P ec71ef77a55848a0add75a6c104cc9a9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 14:55:28.973040 18460 raft_consensus.cc:359] T 4040b77ce4d34a34baf6e31e9364f07b P f75b4aa933fd4b8c82ea07567024882c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:28.979584 18459 consensus_queue.cc:260] T 86887bfdd39840a4ac9a63d78fcf0c67 P ec71ef77a55848a0add75a6c104cc9a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:28.980751 18460 raft_consensus.cc:385] T 4040b77ce4d34a34baf6e31e9364f07b P f75b4aa933fd4b8c82ea07567024882c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:55:28.981505 18460 raft_consensus.cc:740] T 4040b77ce4d34a34baf6e31e9364f07b P f75b4aa933fd4b8c82ea07567024882c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f75b4aa933fd4b8c82ea07567024882c, State: Initialized, Role: FOLLOWER
I20260709 14:55:28.977035 18461 raft_consensus.cc:359] T 8885f7ee722545ff8d091567e7f09d69 P 95234c5b69eb4fe4a7558e56eedbe71a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:28.983160 18459 ts_tablet_manager.cc:1434] T 86887bfdd39840a4ac9a63d78fcf0c67 P ec71ef77a55848a0add75a6c104cc9a9: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 14:55:28.983436 18461 raft_consensus.cc:385] T 8885f7ee722545ff8d091567e7f09d69 P 95234c5b69eb4fe4a7558e56eedbe71a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:55:28.983166 18460 consensus_queue.cc:260] T 4040b77ce4d34a34baf6e31e9364f07b P f75b4aa933fd4b8c82ea07567024882c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:28.984900 18459 tablet_bootstrap.cc:492] T 03cb02cb11914a5db0023952fc210283 P ec71ef77a55848a0add75a6c104cc9a9: Bootstrap starting.
I20260709 14:55:28.986028 18460 ts_tablet_manager.cc:1434] T 4040b77ce4d34a34baf6e31e9364f07b P f75b4aa933fd4b8c82ea07567024882c: Time spent starting tablet: real 0.018s	user 0.009s	sys 0.001s
I20260709 14:55:28.987789 18460 tablet_bootstrap.cc:492] T 86887bfdd39840a4ac9a63d78fcf0c67 P f75b4aa933fd4b8c82ea07567024882c: Bootstrap starting.
I20260709 14:55:28.993525 18465 raft_consensus.cc:493] T 84b1a73cbc1e4c56a0a733d2cdacc300 P 95234c5b69eb4fe4a7558e56eedbe71a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:55:28.994280 18465 raft_consensus.cc:515] T 84b1a73cbc1e4c56a0a733d2cdacc300 P 95234c5b69eb4fe4a7558e56eedbe71a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:28.984079 18461 raft_consensus.cc:740] T 8885f7ee722545ff8d091567e7f09d69 P 95234c5b69eb4fe4a7558e56eedbe71a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95234c5b69eb4fe4a7558e56eedbe71a, State: Initialized, Role: FOLLOWER
I20260709 14:55:28.996832 18461 consensus_queue.cc:260] T 8885f7ee722545ff8d091567e7f09d69 P 95234c5b69eb4fe4a7558e56eedbe71a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:28.997442 18460 tablet_bootstrap.cc:654] T 86887bfdd39840a4ac9a63d78fcf0c67 P f75b4aa933fd4b8c82ea07567024882c: Neither blocks nor log segments found. Creating new log.
I20260709 14:55:28.998072 18162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84b1a73cbc1e4c56a0a733d2cdacc300" candidate_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f75b4aa933fd4b8c82ea07567024882c" is_pre_election: true
I20260709 14:55:28.999234 18162 raft_consensus.cc:2468] T 84b1a73cbc1e4c56a0a733d2cdacc300 P f75b4aa933fd4b8c82ea07567024882c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95234c5b69eb4fe4a7558e56eedbe71a in term 0.
I20260709 14:55:28.999972 18465 leader_election.cc:290] T 84b1a73cbc1e4c56a0a733d2cdacc300 P 95234c5b69eb4fe4a7558e56eedbe71a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f75b4aa933fd4b8c82ea07567024882c (127.6.101.65:40449), ec71ef77a55848a0add75a6c104cc9a9 (127.6.101.67:42661)
I20260709 14:55:28.994186 18459 tablet_bootstrap.cc:654] T 03cb02cb11914a5db0023952fc210283 P ec71ef77a55848a0add75a6c104cc9a9: Neither blocks nor log segments found. Creating new log.
I20260709 14:55:29.001720 18202 leader_election.cc:304] T 84b1a73cbc1e4c56a0a733d2cdacc300 P 95234c5b69eb4fe4a7558e56eedbe71a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95234c5b69eb4fe4a7558e56eedbe71a, f75b4aa933fd4b8c82ea07567024882c; no voters: 
I20260709 14:55:29.002405 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84b1a73cbc1e4c56a0a733d2cdacc300" candidate_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec71ef77a55848a0add75a6c104cc9a9" is_pre_election: true
I20260709 14:55:29.003245 18310 raft_consensus.cc:2468] T 84b1a73cbc1e4c56a0a733d2cdacc300 P ec71ef77a55848a0add75a6c104cc9a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95234c5b69eb4fe4a7558e56eedbe71a in term 0.
I20260709 14:55:29.003672 18423 raft_consensus.cc:2804] T 84b1a73cbc1e4c56a0a733d2cdacc300 P 95234c5b69eb4fe4a7558e56eedbe71a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:55:29.004113 18423 raft_consensus.cc:493] T 84b1a73cbc1e4c56a0a733d2cdacc300 P 95234c5b69eb4fe4a7558e56eedbe71a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:55:29.004572 18423 raft_consensus.cc:3060] T 84b1a73cbc1e4c56a0a733d2cdacc300 P 95234c5b69eb4fe4a7558e56eedbe71a [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:55:29.013759 18460 tablet_bootstrap.cc:492] T 86887bfdd39840a4ac9a63d78fcf0c67 P f75b4aa933fd4b8c82ea07567024882c: No bootstrap required, opened a new log
I20260709 14:55:29.014652 18460 ts_tablet_manager.cc:1403] T 86887bfdd39840a4ac9a63d78fcf0c67 P f75b4aa933fd4b8c82ea07567024882c: Time spent bootstrapping tablet: real 0.027s	user 0.008s	sys 0.015s
I20260709 14:55:29.019558 18460 raft_consensus.cc:359] T 86887bfdd39840a4ac9a63d78fcf0c67 P f75b4aa933fd4b8c82ea07567024882c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:29.021950 18460 raft_consensus.cc:385] T 86887bfdd39840a4ac9a63d78fcf0c67 P f75b4aa933fd4b8c82ea07567024882c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:55:29.022128 18459 tablet_bootstrap.cc:492] T 03cb02cb11914a5db0023952fc210283 P ec71ef77a55848a0add75a6c104cc9a9: No bootstrap required, opened a new log
I20260709 14:55:29.022503 18460 raft_consensus.cc:740] T 86887bfdd39840a4ac9a63d78fcf0c67 P f75b4aa933fd4b8c82ea07567024882c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f75b4aa933fd4b8c82ea07567024882c, State: Initialized, Role: FOLLOWER
I20260709 14:55:29.023020 18459 ts_tablet_manager.cc:1403] T 03cb02cb11914a5db0023952fc210283 P ec71ef77a55848a0add75a6c104cc9a9: Time spent bootstrapping tablet: real 0.038s	user 0.012s	sys 0.014s
I20260709 14:55:29.024116 18460 consensus_queue.cc:260] T 86887bfdd39840a4ac9a63d78fcf0c67 P f75b4aa933fd4b8c82ea07567024882c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:29.026037 18461 ts_tablet_manager.cc:1434] T 8885f7ee722545ff8d091567e7f09d69 P 95234c5b69eb4fe4a7558e56eedbe71a: Time spent starting tablet: real 0.060s	user 0.007s	sys 0.003s
I20260709 14:55:29.028175 18460 ts_tablet_manager.cc:1434] T 86887bfdd39840a4ac9a63d78fcf0c67 P f75b4aa933fd4b8c82ea07567024882c: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.004s
I20260709 14:55:29.030474 18461 tablet_bootstrap.cc:492] T 4040b77ce4d34a34baf6e31e9364f07b P 95234c5b69eb4fe4a7558e56eedbe71a: Bootstrap starting.
I20260709 14:55:29.031308 18460 tablet_bootstrap.cc:492] T 03cb02cb11914a5db0023952fc210283 P f75b4aa933fd4b8c82ea07567024882c: Bootstrap starting.
I20260709 14:55:29.028620 18423 raft_consensus.cc:515] T 84b1a73cbc1e4c56a0a733d2cdacc300 P 95234c5b69eb4fe4a7558e56eedbe71a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:29.027942 18459 raft_consensus.cc:359] T 03cb02cb11914a5db0023952fc210283 P ec71ef77a55848a0add75a6c104cc9a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:29.038106 18459 raft_consensus.cc:385] T 03cb02cb11914a5db0023952fc210283 P ec71ef77a55848a0add75a6c104cc9a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:55:29.039132 18459 raft_consensus.cc:740] T 03cb02cb11914a5db0023952fc210283 P ec71ef77a55848a0add75a6c104cc9a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec71ef77a55848a0add75a6c104cc9a9, State: Initialized, Role: FOLLOWER
I20260709 14:55:29.040987 18459 consensus_queue.cc:260] T 03cb02cb11914a5db0023952fc210283 P ec71ef77a55848a0add75a6c104cc9a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:29.044265 18461 tablet_bootstrap.cc:654] T 4040b77ce4d34a34baf6e31e9364f07b P 95234c5b69eb4fe4a7558e56eedbe71a: Neither blocks nor log segments found. Creating new log.
I20260709 14:55:29.044960 18459 ts_tablet_manager.cc:1434] T 03cb02cb11914a5db0023952fc210283 P ec71ef77a55848a0add75a6c104cc9a9: Time spent starting tablet: real 0.021s	user 0.010s	sys 0.001s
I20260709 14:55:29.045786 18162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84b1a73cbc1e4c56a0a733d2cdacc300" candidate_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f75b4aa933fd4b8c82ea07567024882c"
I20260709 14:55:29.046482 18459 tablet_bootstrap.cc:492] T 8885f7ee722545ff8d091567e7f09d69 P ec71ef77a55848a0add75a6c104cc9a9: Bootstrap starting.
I20260709 14:55:29.046571 18162 raft_consensus.cc:3060] T 84b1a73cbc1e4c56a0a733d2cdacc300 P f75b4aa933fd4b8c82ea07567024882c [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:55:29.053632 18460 tablet_bootstrap.cc:654] T 03cb02cb11914a5db0023952fc210283 P f75b4aa933fd4b8c82ea07567024882c: Neither blocks nor log segments found. Creating new log.
I20260709 14:55:29.054791 18459 tablet_bootstrap.cc:654] T 8885f7ee722545ff8d091567e7f09d69 P ec71ef77a55848a0add75a6c104cc9a9: Neither blocks nor log segments found. Creating new log.
I20260709 14:55:29.061162 18162 raft_consensus.cc:2468] T 84b1a73cbc1e4c56a0a733d2cdacc300 P f75b4aa933fd4b8c82ea07567024882c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95234c5b69eb4fe4a7558e56eedbe71a in term 1.
I20260709 14:55:29.066587 18423 leader_election.cc:290] T 84b1a73cbc1e4c56a0a733d2cdacc300 P 95234c5b69eb4fe4a7558e56eedbe71a [CANDIDATE]: Term 1 election: Requested vote from peers f75b4aa933fd4b8c82ea07567024882c (127.6.101.65:40449), ec71ef77a55848a0add75a6c104cc9a9 (127.6.101.67:42661)
I20260709 14:55:29.068454 18202 leader_election.cc:304] T 84b1a73cbc1e4c56a0a733d2cdacc300 P 95234c5b69eb4fe4a7558e56eedbe71a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95234c5b69eb4fe4a7558e56eedbe71a, f75b4aa933fd4b8c82ea07567024882c; no voters: 
I20260709 14:55:29.069690 18423 raft_consensus.cc:2804] T 84b1a73cbc1e4c56a0a733d2cdacc300 P 95234c5b69eb4fe4a7558e56eedbe71a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:55:29.069814 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84b1a73cbc1e4c56a0a733d2cdacc300" candidate_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec71ef77a55848a0add75a6c104cc9a9"
I20260709 14:55:29.070267 18423 raft_consensus.cc:697] T 84b1a73cbc1e4c56a0a733d2cdacc300 P 95234c5b69eb4fe4a7558e56eedbe71a [term 1 LEADER]: Becoming Leader. State: Replica: 95234c5b69eb4fe4a7558e56eedbe71a, State: Running, Role: LEADER
I20260709 14:55:29.070804 18310 raft_consensus.cc:3060] T 84b1a73cbc1e4c56a0a733d2cdacc300 P ec71ef77a55848a0add75a6c104cc9a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:55:29.071306 18423 consensus_queue.cc:237] T 84b1a73cbc1e4c56a0a733d2cdacc300 P 95234c5b69eb4fe4a7558e56eedbe71a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:29.076685 18460 tablet_bootstrap.cc:492] T 03cb02cb11914a5db0023952fc210283 P f75b4aa933fd4b8c82ea07567024882c: No bootstrap required, opened a new log
I20260709 14:55:29.077833 18460 ts_tablet_manager.cc:1403] T 03cb02cb11914a5db0023952fc210283 P f75b4aa933fd4b8c82ea07567024882c: Time spent bootstrapping tablet: real 0.047s	user 0.006s	sys 0.014s
I20260709 14:55:29.081648 18460 raft_consensus.cc:359] T 03cb02cb11914a5db0023952fc210283 P f75b4aa933fd4b8c82ea07567024882c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:29.082178 18310 raft_consensus.cc:2468] T 84b1a73cbc1e4c56a0a733d2cdacc300 P ec71ef77a55848a0add75a6c104cc9a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95234c5b69eb4fe4a7558e56eedbe71a in term 1.
I20260709 14:55:29.083122 18461 tablet_bootstrap.cc:492] T 4040b77ce4d34a34baf6e31e9364f07b P 95234c5b69eb4fe4a7558e56eedbe71a: No bootstrap required, opened a new log
I20260709 14:55:29.083736 18461 ts_tablet_manager.cc:1403] T 4040b77ce4d34a34baf6e31e9364f07b P 95234c5b69eb4fe4a7558e56eedbe71a: Time spent bootstrapping tablet: real 0.054s	user 0.014s	sys 0.010s
I20260709 14:55:29.082541 18460 raft_consensus.cc:385] T 03cb02cb11914a5db0023952fc210283 P f75b4aa933fd4b8c82ea07567024882c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:55:29.085482 18460 raft_consensus.cc:740] T 03cb02cb11914a5db0023952fc210283 P f75b4aa933fd4b8c82ea07567024882c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f75b4aa933fd4b8c82ea07567024882c, State: Initialized, Role: FOLLOWER
I20260709 14:55:29.088135 18461 raft_consensus.cc:359] T 4040b77ce4d34a34baf6e31e9364f07b P 95234c5b69eb4fe4a7558e56eedbe71a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:29.089083 18461 raft_consensus.cc:385] T 4040b77ce4d34a34baf6e31e9364f07b P 95234c5b69eb4fe4a7558e56eedbe71a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:55:29.089425 18461 raft_consensus.cc:740] T 4040b77ce4d34a34baf6e31e9364f07b P 95234c5b69eb4fe4a7558e56eedbe71a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95234c5b69eb4fe4a7558e56eedbe71a, State: Initialized, Role: FOLLOWER
I20260709 14:55:29.089818 18459 tablet_bootstrap.cc:492] T 8885f7ee722545ff8d091567e7f09d69 P ec71ef77a55848a0add75a6c104cc9a9: No bootstrap required, opened a new log
I20260709 14:55:29.090744 18459 ts_tablet_manager.cc:1403] T 8885f7ee722545ff8d091567e7f09d69 P ec71ef77a55848a0add75a6c104cc9a9: Time spent bootstrapping tablet: real 0.045s	user 0.020s	sys 0.000s
I20260709 14:55:29.090420 18461 consensus_queue.cc:260] T 4040b77ce4d34a34baf6e31e9364f07b P 95234c5b69eb4fe4a7558e56eedbe71a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:29.093626 18461 ts_tablet_manager.cc:1434] T 4040b77ce4d34a34baf6e31e9364f07b P 95234c5b69eb4fe4a7558e56eedbe71a: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.004s
I20260709 14:55:29.093580 18061 catalog_manager.cc:5697] T 84b1a73cbc1e4c56a0a733d2cdacc300 P 95234c5b69eb4fe4a7558e56eedbe71a reported cstate change: term changed from 0 to 1, leader changed from <none> to 95234c5b69eb4fe4a7558e56eedbe71a (127.6.101.66). New cstate: current_term: 1 leader_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } health_report { overall_health: UNKNOWN } } }
I20260709 14:55:29.095165 18461 tablet_bootstrap.cc:492] T 45dc6924b995473493ccf8d5b0ba3668 P 95234c5b69eb4fe4a7558e56eedbe71a: Bootstrap starting.
I20260709 14:55:29.093453 18400 raft_consensus.cc:493] T f0007e8bcd5d478482896147adc197b0 P f75b4aa933fd4b8c82ea07567024882c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:55:29.095857 18400 raft_consensus.cc:515] T f0007e8bcd5d478482896147adc197b0 P f75b4aa933fd4b8c82ea07567024882c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:29.096318 18460 consensus_queue.cc:260] T 03cb02cb11914a5db0023952fc210283 P f75b4aa933fd4b8c82ea07567024882c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:29.099138 18460 ts_tablet_manager.cc:1434] T 03cb02cb11914a5db0023952fc210283 P f75b4aa933fd4b8c82ea07567024882c: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.001s
I20260709 14:55:29.095538 18459 raft_consensus.cc:359] T 8885f7ee722545ff8d091567e7f09d69 P ec71ef77a55848a0add75a6c104cc9a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:29.099814 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0007e8bcd5d478482896147adc197b0" candidate_uuid: "f75b4aa933fd4b8c82ea07567024882c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" is_pre_election: true
I20260709 14:55:29.100318 18459 raft_consensus.cc:385] T 8885f7ee722545ff8d091567e7f09d69 P ec71ef77a55848a0add75a6c104cc9a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:55:29.100841 18459 raft_consensus.cc:740] T 8885f7ee722545ff8d091567e7f09d69 P ec71ef77a55848a0add75a6c104cc9a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec71ef77a55848a0add75a6c104cc9a9, State: Initialized, Role: FOLLOWER
I20260709 14:55:29.101872 18459 consensus_queue.cc:260] T 8885f7ee722545ff8d091567e7f09d69 P ec71ef77a55848a0add75a6c104cc9a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:29.103839 18461 tablet_bootstrap.cc:654] T 45dc6924b995473493ccf8d5b0ba3668 P 95234c5b69eb4fe4a7558e56eedbe71a: Neither blocks nor log segments found. Creating new log.
I20260709 14:55:29.105264 18460 tablet_bootstrap.cc:492] T 45dc6924b995473493ccf8d5b0ba3668 P f75b4aa933fd4b8c82ea07567024882c: Bootstrap starting.
I20260709 14:55:29.106122 18459 ts_tablet_manager.cc:1434] T 8885f7ee722545ff8d091567e7f09d69 P ec71ef77a55848a0add75a6c104cc9a9: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 14:55:29.111266 18459 tablet_bootstrap.cc:492] T 45dc6924b995473493ccf8d5b0ba3668 P ec71ef77a55848a0add75a6c104cc9a9: Bootstrap starting.
I20260709 14:55:29.115419 18460 tablet_bootstrap.cc:654] T 45dc6924b995473493ccf8d5b0ba3668 P f75b4aa933fd4b8c82ea07567024882c: Neither blocks nor log segments found. Creating new log.
I20260709 14:55:29.100930 18237 raft_consensus.cc:2468] T f0007e8bcd5d478482896147adc197b0 P 95234c5b69eb4fe4a7558e56eedbe71a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f75b4aa933fd4b8c82ea07567024882c in term 0.
I20260709 14:55:29.126643 18459 tablet_bootstrap.cc:654] T 45dc6924b995473493ccf8d5b0ba3668 P ec71ef77a55848a0add75a6c104cc9a9: Neither blocks nor log segments found. Creating new log.
I20260709 14:55:29.128870 18129 leader_election.cc:304] T f0007e8bcd5d478482896147adc197b0 P f75b4aa933fd4b8c82ea07567024882c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95234c5b69eb4fe4a7558e56eedbe71a, f75b4aa933fd4b8c82ea07567024882c; no voters: 
I20260709 14:55:29.130784 18475 raft_consensus.cc:2804] T f0007e8bcd5d478482896147adc197b0 P f75b4aa933fd4b8c82ea07567024882c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:55:29.131322 18475 raft_consensus.cc:493] T f0007e8bcd5d478482896147adc197b0 P f75b4aa933fd4b8c82ea07567024882c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:55:29.131667 18475 raft_consensus.cc:3060] T f0007e8bcd5d478482896147adc197b0 P f75b4aa933fd4b8c82ea07567024882c [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:55:29.143723 18460 tablet_bootstrap.cc:492] T 45dc6924b995473493ccf8d5b0ba3668 P f75b4aa933fd4b8c82ea07567024882c: No bootstrap required, opened a new log
I20260709 14:55:29.148113 18460 ts_tablet_manager.cc:1403] T 45dc6924b995473493ccf8d5b0ba3668 P f75b4aa933fd4b8c82ea07567024882c: Time spent bootstrapping tablet: real 0.043s	user 0.017s	sys 0.004s
I20260709 14:55:29.148227 18459 tablet_bootstrap.cc:492] T 45dc6924b995473493ccf8d5b0ba3668 P ec71ef77a55848a0add75a6c104cc9a9: No bootstrap required, opened a new log
I20260709 14:55:29.148845 18459 ts_tablet_manager.cc:1403] T 45dc6924b995473493ccf8d5b0ba3668 P ec71ef77a55848a0add75a6c104cc9a9: Time spent bootstrapping tablet: real 0.038s	user 0.013s	sys 0.005s
I20260709 14:55:29.149025 18465 raft_consensus.cc:493] T e416808f5061489aa8191b18817678d0 P 95234c5b69eb4fe4a7558e56eedbe71a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:55:29.149806 18465 raft_consensus.cc:515] T e416808f5061489aa8191b18817678d0 P 95234c5b69eb4fe4a7558e56eedbe71a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:29.152323 18459 raft_consensus.cc:359] T 45dc6924b995473493ccf8d5b0ba3668 P ec71ef77a55848a0add75a6c104cc9a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:29.155004 18459 raft_consensus.cc:385] T 45dc6924b995473493ccf8d5b0ba3668 P ec71ef77a55848a0add75a6c104cc9a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:55:29.155328 18459 raft_consensus.cc:740] T 45dc6924b995473493ccf8d5b0ba3668 P ec71ef77a55848a0add75a6c104cc9a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec71ef77a55848a0add75a6c104cc9a9, State: Initialized, Role: FOLLOWER
I20260709 14:55:29.156229 18459 consensus_queue.cc:260] T 45dc6924b995473493ccf8d5b0ba3668 P ec71ef77a55848a0add75a6c104cc9a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:29.157958 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0007e8bcd5d478482896147adc197b0" candidate_uuid: "f75b4aa933fd4b8c82ea07567024882c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec71ef77a55848a0add75a6c104cc9a9" is_pre_election: true
I20260709 14:55:29.158921 18459 ts_tablet_manager.cc:1434] T 45dc6924b995473493ccf8d5b0ba3668 P ec71ef77a55848a0add75a6c104cc9a9: Time spent starting tablet: real 0.010s	user 0.011s	sys 0.000s
I20260709 14:55:29.159258 18311 raft_consensus.cc:2468] T f0007e8bcd5d478482896147adc197b0 P ec71ef77a55848a0add75a6c104cc9a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f75b4aa933fd4b8c82ea07567024882c in term 0.
I20260709 14:55:29.160288 18459 tablet_bootstrap.cc:492] T 744d4bd8bf6440d78510bd3a8b14481c P ec71ef77a55848a0add75a6c104cc9a9: Bootstrap starting.
I20260709 14:55:29.155668 18400 leader_election.cc:290] T f0007e8bcd5d478482896147adc197b0 P f75b4aa933fd4b8c82ea07567024882c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95234c5b69eb4fe4a7558e56eedbe71a (127.6.101.66:42897), ec71ef77a55848a0add75a6c104cc9a9 (127.6.101.67:42661)
I20260709 14:55:29.162421 18460 raft_consensus.cc:359] T 45dc6924b995473493ccf8d5b0ba3668 P f75b4aa933fd4b8c82ea07567024882c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:29.163295 18460 raft_consensus.cc:385] T 45dc6924b995473493ccf8d5b0ba3668 P f75b4aa933fd4b8c82ea07567024882c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:55:29.163611 18460 raft_consensus.cc:740] T 45dc6924b995473493ccf8d5b0ba3668 P f75b4aa933fd4b8c82ea07567024882c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f75b4aa933fd4b8c82ea07567024882c, State: Initialized, Role: FOLLOWER
I20260709 14:55:29.164508 18460 consensus_queue.cc:260] T 45dc6924b995473493ccf8d5b0ba3668 P f75b4aa933fd4b8c82ea07567024882c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:29.167369 18460 ts_tablet_manager.cc:1434] T 45dc6924b995473493ccf8d5b0ba3668 P f75b4aa933fd4b8c82ea07567024882c: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.003s
I20260709 14:55:29.168587 18460 tablet_bootstrap.cc:492] T e416808f5061489aa8191b18817678d0 P f75b4aa933fd4b8c82ea07567024882c: Bootstrap starting.
I20260709 14:55:29.176671 18459 tablet_bootstrap.cc:654] T 744d4bd8bf6440d78510bd3a8b14481c P ec71ef77a55848a0add75a6c104cc9a9: Neither blocks nor log segments found. Creating new log.
I20260709 14:55:29.187784 18465 leader_election.cc:290] T e416808f5061489aa8191b18817678d0 P 95234c5b69eb4fe4a7558e56eedbe71a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f75b4aa933fd4b8c82ea07567024882c (127.6.101.65:40449), ec71ef77a55848a0add75a6c104cc9a9 (127.6.101.67:42661)
I20260709 14:55:29.188551 18460 tablet_bootstrap.cc:654] T e416808f5061489aa8191b18817678d0 P f75b4aa933fd4b8c82ea07567024882c: Neither blocks nor log segments found. Creating new log.
I20260709 14:55:29.219003 18475 raft_consensus.cc:515] T f0007e8bcd5d478482896147adc197b0 P f75b4aa933fd4b8c82ea07567024882c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:29.228252 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0007e8bcd5d478482896147adc197b0" candidate_uuid: "f75b4aa933fd4b8c82ea07567024882c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95234c5b69eb4fe4a7558e56eedbe71a"
I20260709 14:55:29.229112 18237 raft_consensus.cc:3060] T f0007e8bcd5d478482896147adc197b0 P 95234c5b69eb4fe4a7558e56eedbe71a [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:55:29.238420 18237 raft_consensus.cc:2468] T f0007e8bcd5d478482896147adc197b0 P 95234c5b69eb4fe4a7558e56eedbe71a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f75b4aa933fd4b8c82ea07567024882c in term 1.
I20260709 14:55:29.239120 18400 raft_consensus.cc:493] T 86887bfdd39840a4ac9a63d78fcf0c67 P f75b4aa933fd4b8c82ea07567024882c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:55:29.239902 18400 raft_consensus.cc:515] T 86887bfdd39840a4ac9a63d78fcf0c67 P f75b4aa933fd4b8c82ea07567024882c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:29.240350 18129 leader_election.cc:304] T f0007e8bcd5d478482896147adc197b0 P f75b4aa933fd4b8c82ea07567024882c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95234c5b69eb4fe4a7558e56eedbe71a, f75b4aa933fd4b8c82ea07567024882c; no voters: 
I20260709 14:55:29.241801 18490 raft_consensus.cc:2804] T f0007e8bcd5d478482896147adc197b0 P f75b4aa933fd4b8c82ea07567024882c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:55:29.242996 18400 leader_election.cc:290] T 86887bfdd39840a4ac9a63d78fcf0c67 P f75b4aa933fd4b8c82ea07567024882c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95234c5b69eb4fe4a7558e56eedbe71a (127.6.101.66:42897), ec71ef77a55848a0add75a6c104cc9a9 (127.6.101.67:42661)
I20260709 14:55:29.244220 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86887bfdd39840a4ac9a63d78fcf0c67" candidate_uuid: "f75b4aa933fd4b8c82ea07567024882c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec71ef77a55848a0add75a6c104cc9a9" is_pre_election: true
I20260709 14:55:29.244925 18311 raft_consensus.cc:2468] T 86887bfdd39840a4ac9a63d78fcf0c67 P ec71ef77a55848a0add75a6c104cc9a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f75b4aa933fd4b8c82ea07567024882c in term 0.
I20260709 14:55:29.245318 18238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86887bfdd39840a4ac9a63d78fcf0c67" candidate_uuid: "f75b4aa933fd4b8c82ea07567024882c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" is_pre_election: true
I20260709 14:55:29.246222 18127 leader_election.cc:304] T 86887bfdd39840a4ac9a63d78fcf0c67 P f75b4aa933fd4b8c82ea07567024882c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ec71ef77a55848a0add75a6c104cc9a9, f75b4aa933fd4b8c82ea07567024882c; no voters: 
W20260709 14:55:29.246999 18129 leader_election.cc:343] T 86887bfdd39840a4ac9a63d78fcf0c67 P f75b4aa933fd4b8c82ea07567024882c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95234c5b69eb4fe4a7558e56eedbe71a (127.6.101.66:42897): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:55:29.248114 18423 raft_consensus.cc:493] T 8885f7ee722545ff8d091567e7f09d69 P 95234c5b69eb4fe4a7558e56eedbe71a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:55:29.248750 18400 raft_consensus.cc:2804] T 86887bfdd39840a4ac9a63d78fcf0c67 P f75b4aa933fd4b8c82ea07567024882c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:55:29.249207 18400 raft_consensus.cc:493] T 86887bfdd39840a4ac9a63d78fcf0c67 P f75b4aa933fd4b8c82ea07567024882c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:55:29.251173 18400 raft_consensus.cc:3060] T 86887bfdd39840a4ac9a63d78fcf0c67 P f75b4aa933fd4b8c82ea07567024882c [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:55:29.248795 18423 raft_consensus.cc:515] T 8885f7ee722545ff8d091567e7f09d69 P 95234c5b69eb4fe4a7558e56eedbe71a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:29.254890 18423 leader_election.cc:290] T 8885f7ee722545ff8d091567e7f09d69 P 95234c5b69eb4fe4a7558e56eedbe71a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f75b4aa933fd4b8c82ea07567024882c (127.6.101.65:40449), ec71ef77a55848a0add75a6c104cc9a9 (127.6.101.67:42661)
W20260709 14:55:29.257661 18109 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 14:55:29.258754 18460 tablet_bootstrap.cc:492] T e416808f5061489aa8191b18817678d0 P f75b4aa933fd4b8c82ea07567024882c: No bootstrap required, opened a new log
I20260709 14:55:29.259824 18475 leader_election.cc:290] T f0007e8bcd5d478482896147adc197b0 P f75b4aa933fd4b8c82ea07567024882c [CANDIDATE]: Term 1 election: Requested vote from peers 95234c5b69eb4fe4a7558e56eedbe71a (127.6.101.66:42897), ec71ef77a55848a0add75a6c104cc9a9 (127.6.101.67:42661)
I20260709 14:55:29.262293 18459 tablet_bootstrap.cc:492] T 744d4bd8bf6440d78510bd3a8b14481c P ec71ef77a55848a0add75a6c104cc9a9: No bootstrap required, opened a new log
I20260709 14:55:29.263222 18459 ts_tablet_manager.cc:1403] T 744d4bd8bf6440d78510bd3a8b14481c P ec71ef77a55848a0add75a6c104cc9a9: Time spent bootstrapping tablet: real 0.103s	user 0.032s	sys 0.018s
I20260709 14:55:29.259881 18460 ts_tablet_manager.cc:1403] T e416808f5061489aa8191b18817678d0 P f75b4aa933fd4b8c82ea07567024882c: Time spent bootstrapping tablet: real 0.092s	user 0.023s	sys 0.010s
I20260709 14:55:29.261139 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0007e8bcd5d478482896147adc197b0" candidate_uuid: "f75b4aa933fd4b8c82ea07567024882c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec71ef77a55848a0add75a6c104cc9a9"
I20260709 14:55:29.266523 18311 raft_consensus.cc:3060] T f0007e8bcd5d478482896147adc197b0 P ec71ef77a55848a0add75a6c104cc9a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:55:29.268682 18465 raft_consensus.cc:493] T 744d4bd8bf6440d78510bd3a8b14481c P 95234c5b69eb4fe4a7558e56eedbe71a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:55:29.269346 18465 raft_consensus.cc:515] T 744d4bd8bf6440d78510bd3a8b14481c P 95234c5b69eb4fe4a7558e56eedbe71a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:29.271685 18465 leader_election.cc:290] T 744d4bd8bf6440d78510bd3a8b14481c P 95234c5b69eb4fe4a7558e56eedbe71a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f75b4aa933fd4b8c82ea07567024882c (127.6.101.65:40449), ec71ef77a55848a0add75a6c104cc9a9 (127.6.101.67:42661)
I20260709 14:55:29.272912 18459 raft_consensus.cc:359] T 744d4bd8bf6440d78510bd3a8b14481c P ec71ef77a55848a0add75a6c104cc9a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:29.273985 18459 raft_consensus.cc:385] T 744d4bd8bf6440d78510bd3a8b14481c P ec71ef77a55848a0add75a6c104cc9a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:55:29.274291 18459 raft_consensus.cc:740] T 744d4bd8bf6440d78510bd3a8b14481c P ec71ef77a55848a0add75a6c104cc9a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec71ef77a55848a0add75a6c104cc9a9, State: Initialized, Role: FOLLOWER
W20260709 14:55:29.274683 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:42661, user_credentials={real_user=slave}} blocked reactor thread for 153048us
I20260709 14:55:29.275457 18383 raft_consensus.cc:493] T e416808f5061489aa8191b18817678d0 P ec71ef77a55848a0add75a6c104cc9a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:55:29.269202 18460 raft_consensus.cc:359] T e416808f5061489aa8191b18817678d0 P f75b4aa933fd4b8c82ea07567024882c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:29.277593 18383 raft_consensus.cc:515] T e416808f5061489aa8191b18817678d0 P ec71ef77a55848a0add75a6c104cc9a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:29.280022 18383 leader_election.cc:290] T e416808f5061489aa8191b18817678d0 P ec71ef77a55848a0add75a6c104cc9a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f75b4aa933fd4b8c82ea07567024882c (127.6.101.65:40449), 95234c5b69eb4fe4a7558e56eedbe71a (127.6.101.66:42897)
I20260709 14:55:29.280296 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e416808f5061489aa8191b18817678d0" candidate_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec71ef77a55848a0add75a6c104cc9a9" is_pre_election: true
I20260709 14:55:29.278148 18460 raft_consensus.cc:385] T e416808f5061489aa8191b18817678d0 P f75b4aa933fd4b8c82ea07567024882c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:55:29.281560 18310 raft_consensus.cc:2468] T e416808f5061489aa8191b18817678d0 P ec71ef77a55848a0add75a6c104cc9a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95234c5b69eb4fe4a7558e56eedbe71a in term 0.
I20260709 14:55:29.281718 18460 raft_consensus.cc:740] T e416808f5061489aa8191b18817678d0 P f75b4aa933fd4b8c82ea07567024882c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f75b4aa933fd4b8c82ea07567024882c, State: Initialized, Role: FOLLOWER
I20260709 14:55:29.283165 18460 consensus_queue.cc:260] T e416808f5061489aa8191b18817678d0 P f75b4aa933fd4b8c82ea07567024882c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:29.283391 18163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e416808f5061489aa8191b18817678d0" candidate_uuid: "ec71ef77a55848a0add75a6c104cc9a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f75b4aa933fd4b8c82ea07567024882c" is_pre_election: true
I20260709 14:55:29.283836 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e416808f5061489aa8191b18817678d0" candidate_uuid: "ec71ef77a55848a0add75a6c104cc9a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" is_pre_election: true
I20260709 14:55:29.284498 18163 raft_consensus.cc:2468] T e416808f5061489aa8191b18817678d0 P f75b4aa933fd4b8c82ea07567024882c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec71ef77a55848a0add75a6c104cc9a9 in term 0.
I20260709 14:55:29.277063 18475 raft_consensus.cc:493] T 8885f7ee722545ff8d091567e7f09d69 P f75b4aa933fd4b8c82ea07567024882c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:55:29.285006 18311 raft_consensus.cc:2468] T f0007e8bcd5d478482896147adc197b0 P ec71ef77a55848a0add75a6c104cc9a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f75b4aa933fd4b8c82ea07567024882c in term 1.
I20260709 14:55:29.285777 18460 ts_tablet_manager.cc:1434] T e416808f5061489aa8191b18817678d0 P f75b4aa933fd4b8c82ea07567024882c: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.001s
I20260709 14:55:29.285606 18475 raft_consensus.cc:515] T 8885f7ee722545ff8d091567e7f09d69 P f75b4aa933fd4b8c82ea07567024882c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:29.287012 18276 leader_election.cc:304] T e416808f5061489aa8191b18817678d0 P ec71ef77a55848a0add75a6c104cc9a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ec71ef77a55848a0add75a6c104cc9a9, f75b4aa933fd4b8c82ea07567024882c; no voters: 
I20260709 14:55:29.288185 18490 raft_consensus.cc:697] T f0007e8bcd5d478482896147adc197b0 P f75b4aa933fd4b8c82ea07567024882c [term 1 LEADER]: Becoming Leader. State: Replica: f75b4aa933fd4b8c82ea07567024882c, State: Running, Role: LEADER
I20260709 14:55:29.288452 18383 raft_consensus.cc:2804] T e416808f5061489aa8191b18817678d0 P ec71ef77a55848a0add75a6c104cc9a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:55:29.275161 18459 consensus_queue.cc:260] T 744d4bd8bf6440d78510bd3a8b14481c P ec71ef77a55848a0add75a6c104cc9a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:29.289204 18383 raft_consensus.cc:493] T e416808f5061489aa8191b18817678d0 P ec71ef77a55848a0add75a6c104cc9a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:55:29.289705 18238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8885f7ee722545ff8d091567e7f09d69" candidate_uuid: "f75b4aa933fd4b8c82ea07567024882c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" is_pre_election: true
I20260709 14:55:29.287055 18460 tablet_bootstrap.cc:492] T 744d4bd8bf6440d78510bd3a8b14481c P f75b4aa933fd4b8c82ea07567024882c: Bootstrap starting.
I20260709 14:55:29.292424 18459 ts_tablet_manager.cc:1434] T 744d4bd8bf6440d78510bd3a8b14481c P ec71ef77a55848a0add75a6c104cc9a9: Time spent starting tablet: real 0.029s	user 0.009s	sys 0.000s
I20260709 14:55:29.292650 18461 tablet_bootstrap.cc:492] T 45dc6924b995473493ccf8d5b0ba3668 P 95234c5b69eb4fe4a7558e56eedbe71a: No bootstrap required, opened a new log
I20260709 14:55:29.293558 18461 ts_tablet_manager.cc:1403] T 45dc6924b995473493ccf8d5b0ba3668 P 95234c5b69eb4fe4a7558e56eedbe71a: Time spent bootstrapping tablet: real 0.199s	user 0.047s	sys 0.044s
I20260709 14:55:29.293437 18465 raft_consensus.cc:493] T 4040b77ce4d34a34baf6e31e9364f07b P 95234c5b69eb4fe4a7558e56eedbe71a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:55:29.294271 18465 raft_consensus.cc:515] T 4040b77ce4d34a34baf6e31e9364f07b P 95234c5b69eb4fe4a7558e56eedbe71a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:29.289311 18490 consensus_queue.cc:237] T f0007e8bcd5d478482896147adc197b0 P f75b4aa933fd4b8c82ea07567024882c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:29.281101 18162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e416808f5061489aa8191b18817678d0" candidate_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f75b4aa933fd4b8c82ea07567024882c" is_pre_election: true
I20260709 14:55:29.299331 18162 raft_consensus.cc:2468] T e416808f5061489aa8191b18817678d0 P f75b4aa933fd4b8c82ea07567024882c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95234c5b69eb4fe4a7558e56eedbe71a in term 0.
I20260709 14:55:29.300518 18460 tablet_bootstrap.cc:654] T 744d4bd8bf6440d78510bd3a8b14481c P f75b4aa933fd4b8c82ea07567024882c: Neither blocks nor log segments found. Creating new log.
I20260709 14:55:29.305598 18471 raft_consensus.cc:493] T 45dc6924b995473493ccf8d5b0ba3668 P ec71ef77a55848a0add75a6c104cc9a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:55:29.306209 18461 raft_consensus.cc:359] T 45dc6924b995473493ccf8d5b0ba3668 P 95234c5b69eb4fe4a7558e56eedbe71a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:29.289924 18383 raft_consensus.cc:3060] T e416808f5061489aa8191b18817678d0 P ec71ef77a55848a0add75a6c104cc9a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:55:29.307255 18238 raft_consensus.cc:2468] T 8885f7ee722545ff8d091567e7f09d69 P 95234c5b69eb4fe4a7558e56eedbe71a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f75b4aa933fd4b8c82ea07567024882c in term 0.
I20260709 14:55:29.328871 18461 raft_consensus.cc:385] T 45dc6924b995473493ccf8d5b0ba3668 P 95234c5b69eb4fe4a7558e56eedbe71a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:55:29.329362 18461 raft_consensus.cc:740] T 45dc6924b995473493ccf8d5b0ba3668 P 95234c5b69eb4fe4a7558e56eedbe71a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95234c5b69eb4fe4a7558e56eedbe71a, State: Initialized, Role: FOLLOWER
I20260709 14:55:29.330425 18129 leader_election.cc:304] T 8885f7ee722545ff8d091567e7f09d69 P f75b4aa933fd4b8c82ea07567024882c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95234c5b69eb4fe4a7558e56eedbe71a, f75b4aa933fd4b8c82ea07567024882c; no voters: 
I20260709 14:55:29.315271 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8885f7ee722545ff8d091567e7f09d69" candidate_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec71ef77a55848a0add75a6c104cc9a9" is_pre_election: true
I20260709 14:55:29.331956 18311 raft_consensus.cc:2468] T 8885f7ee722545ff8d091567e7f09d69 P ec71ef77a55848a0add75a6c104cc9a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95234c5b69eb4fe4a7558e56eedbe71a in term 0.
I20260709 14:55:29.317665 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "744d4bd8bf6440d78510bd3a8b14481c" candidate_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec71ef77a55848a0add75a6c104cc9a9" is_pre_election: true
I20260709 14:55:29.333215 18310 raft_consensus.cc:2468] T 744d4bd8bf6440d78510bd3a8b14481c P ec71ef77a55848a0add75a6c104cc9a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95234c5b69eb4fe4a7558e56eedbe71a in term 0.
I20260709 14:55:29.333966 18475 leader_election.cc:290] T 8885f7ee722545ff8d091567e7f09d69 P f75b4aa933fd4b8c82ea07567024882c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95234c5b69eb4fe4a7558e56eedbe71a (127.6.101.66:42897), ec71ef77a55848a0add75a6c104cc9a9 (127.6.101.67:42661)
I20260709 14:55:29.320168 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4040b77ce4d34a34baf6e31e9364f07b" candidate_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec71ef77a55848a0add75a6c104cc9a9" is_pre_election: true
I20260709 14:55:29.315132 18460 tablet_bootstrap.cc:492] T 744d4bd8bf6440d78510bd3a8b14481c P f75b4aa933fd4b8c82ea07567024882c: No bootstrap required, opened a new log
I20260709 14:55:29.319989 18493 raft_consensus.cc:493] T 03cb02cb11914a5db0023952fc210283 P f75b4aa933fd4b8c82ea07567024882c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:55:29.321583 18202 leader_election.cc:304] T e416808f5061489aa8191b18817678d0 P 95234c5b69eb4fe4a7558e56eedbe71a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95234c5b69eb4fe4a7558e56eedbe71a, f75b4aa933fd4b8c82ea07567024882c; no voters: 
I20260709 14:55:29.335408 18312 raft_consensus.cc:2468] T 4040b77ce4d34a34baf6e31e9364f07b P ec71ef77a55848a0add75a6c104cc9a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95234c5b69eb4fe4a7558e56eedbe71a in term 0.
I20260709 14:55:29.298039 18465 leader_election.cc:290] T 4040b77ce4d34a34baf6e31e9364f07b P 95234c5b69eb4fe4a7558e56eedbe71a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f75b4aa933fd4b8c82ea07567024882c (127.6.101.65:40449), ec71ef77a55848a0add75a6c104cc9a9 (127.6.101.67:42661)
I20260709 14:55:29.321852 18161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "744d4bd8bf6440d78510bd3a8b14481c" candidate_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f75b4aa933fd4b8c82ea07567024882c" is_pre_election: true
I20260709 14:55:29.335489 18493 raft_consensus.cc:515] T 03cb02cb11914a5db0023952fc210283 P f75b4aa933fd4b8c82ea07567024882c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:29.325649 18162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8885f7ee722545ff8d091567e7f09d69" candidate_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f75b4aa933fd4b8c82ea07567024882c" is_pre_election: true
I20260709 14:55:29.342954 18493 leader_election.cc:290] T 03cb02cb11914a5db0023952fc210283 P f75b4aa933fd4b8c82ea07567024882c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95234c5b69eb4fe4a7558e56eedbe71a (127.6.101.66:42897), ec71ef77a55848a0add75a6c104cc9a9 (127.6.101.67:42661)
I20260709 14:55:29.320750 18163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4040b77ce4d34a34baf6e31e9364f07b" candidate_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f75b4aa933fd4b8c82ea07567024882c" is_pre_election: true
I20260709 14:55:29.344404 18163 raft_consensus.cc:2468] T 4040b77ce4d34a34baf6e31e9364f07b P f75b4aa933fd4b8c82ea07567024882c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95234c5b69eb4fe4a7558e56eedbe71a in term 0.
I20260709 14:55:29.306257 18471 raft_consensus.cc:515] T 45dc6924b995473493ccf8d5b0ba3668 P ec71ef77a55848a0add75a6c104cc9a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:29.288439 18400 raft_consensus.cc:515] T 86887bfdd39840a4ac9a63d78fcf0c67 P f75b4aa933fd4b8c82ea07567024882c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:29.335851 18460 ts_tablet_manager.cc:1403] T 744d4bd8bf6440d78510bd3a8b14481c P f75b4aa933fd4b8c82ea07567024882c: Time spent bootstrapping tablet: real 0.049s	user 0.017s	sys 0.004s
I20260709 14:55:29.347062 18400 leader_election.cc:290] T 86887bfdd39840a4ac9a63d78fcf0c67 P f75b4aa933fd4b8c82ea07567024882c [CANDIDATE]: Term 1 election: Requested vote from peers 95234c5b69eb4fe4a7558e56eedbe71a (127.6.101.66:42897), ec71ef77a55848a0add75a6c104cc9a9 (127.6.101.67:42661)
I20260709 14:55:29.330235 18461 consensus_queue.cc:260] T 45dc6924b995473493ccf8d5b0ba3668 P 95234c5b69eb4fe4a7558e56eedbe71a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:29.347589 18471 leader_election.cc:290] T 45dc6924b995473493ccf8d5b0ba3668 P ec71ef77a55848a0add75a6c104cc9a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f75b4aa933fd4b8c82ea07567024882c (127.6.101.65:40449), 95234c5b69eb4fe4a7558e56eedbe71a (127.6.101.66:42897)
I20260709 14:55:29.334740 18475 raft_consensus.cc:2804] T 8885f7ee722545ff8d091567e7f09d69 P f75b4aa933fd4b8c82ea07567024882c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:55:29.349555 18461 ts_tablet_manager.cc:1434] T 45dc6924b995473493ccf8d5b0ba3668 P 95234c5b69eb4fe4a7558e56eedbe71a: Time spent starting tablet: real 0.055s	user 0.012s	sys 0.007s
I20260709 14:55:29.349509 18475 raft_consensus.cc:493] T 8885f7ee722545ff8d091567e7f09d69 P f75b4aa933fd4b8c82ea07567024882c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:55:29.350248 18475 raft_consensus.cc:3060] T 8885f7ee722545ff8d091567e7f09d69 P f75b4aa933fd4b8c82ea07567024882c [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:55:29.351043 18461 tablet_bootstrap.cc:492] T 03cb02cb11914a5db0023952fc210283 P 95234c5b69eb4fe4a7558e56eedbe71a: Bootstrap starting.
I20260709 14:55:29.353006 18238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dc6924b995473493ccf8d5b0ba3668" candidate_uuid: "ec71ef77a55848a0add75a6c104cc9a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" is_pre_election: true
I20260709 14:55:29.354229 18238 raft_consensus.cc:2468] T 45dc6924b995473493ccf8d5b0ba3668 P 95234c5b69eb4fe4a7558e56eedbe71a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec71ef77a55848a0add75a6c104cc9a9 in term 0.
I20260709 14:55:29.285017 18237 raft_consensus.cc:2468] T e416808f5061489aa8191b18817678d0 P 95234c5b69eb4fe4a7558e56eedbe71a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec71ef77a55848a0add75a6c104cc9a9 in term 0.
I20260709 14:55:29.357124 18163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dc6924b995473493ccf8d5b0ba3668" candidate_uuid: "ec71ef77a55848a0add75a6c104cc9a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f75b4aa933fd4b8c82ea07567024882c" is_pre_election: true
I20260709 14:55:29.357653 18202 leader_election.cc:304] T 8885f7ee722545ff8d091567e7f09d69 P 95234c5b69eb4fe4a7558e56eedbe71a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95234c5b69eb4fe4a7558e56eedbe71a, ec71ef77a55848a0add75a6c104cc9a9; no voters: 
I20260709 14:55:29.357869 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03cb02cb11914a5db0023952fc210283" candidate_uuid: "f75b4aa933fd4b8c82ea07567024882c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec71ef77a55848a0add75a6c104cc9a9" is_pre_election: true
I20260709 14:55:29.359088 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86887bfdd39840a4ac9a63d78fcf0c67" candidate_uuid: "f75b4aa933fd4b8c82ea07567024882c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec71ef77a55848a0add75a6c104cc9a9"
I20260709 14:55:29.360335 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8885f7ee722545ff8d091567e7f09d69" candidate_uuid: "f75b4aa933fd4b8c82ea07567024882c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec71ef77a55848a0add75a6c104cc9a9" is_pre_election: true
I20260709 14:55:29.361410 18461 tablet_bootstrap.cc:654] T 03cb02cb11914a5db0023952fc210283 P 95234c5b69eb4fe4a7558e56eedbe71a: Neither blocks nor log segments found. Creating new log.
I20260709 14:55:29.364648 18460 raft_consensus.cc:359] T 744d4bd8bf6440d78510bd3a8b14481c P f75b4aa933fd4b8c82ea07567024882c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:29.365887 18460 raft_consensus.cc:385] T 744d4bd8bf6440d78510bd3a8b14481c P f75b4aa933fd4b8c82ea07567024882c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:55:29.366205 18460 raft_consensus.cc:740] T 744d4bd8bf6440d78510bd3a8b14481c P f75b4aa933fd4b8c82ea07567024882c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f75b4aa933fd4b8c82ea07567024882c, State: Initialized, Role: FOLLOWER
I20260709 14:55:29.363706 18465 raft_consensus.cc:2804] T e416808f5061489aa8191b18817678d0 P 95234c5b69eb4fe4a7558e56eedbe71a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:55:29.368338 18278 leader_election.cc:304] T 45dc6924b995473493ccf8d5b0ba3668 P ec71ef77a55848a0add75a6c104cc9a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95234c5b69eb4fe4a7558e56eedbe71a, ec71ef77a55848a0add75a6c104cc9a9; no voters: 
I20260709 14:55:29.369234 18465 raft_consensus.cc:493] T e416808f5061489aa8191b18817678d0 P 95234c5b69eb4fe4a7558e56eedbe71a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:55:29.369755 18465 raft_consensus.cc:3060] T e416808f5061489aa8191b18817678d0 P 95234c5b69eb4fe4a7558e56eedbe71a [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:55:29.369928 18471 raft_consensus.cc:2804] T 45dc6924b995473493ccf8d5b0ba3668 P ec71ef77a55848a0add75a6c104cc9a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:55:29.370525 18471 raft_consensus.cc:493] T 45dc6924b995473493ccf8d5b0ba3668 P ec71ef77a55848a0add75a6c104cc9a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:55:29.370766 18202 leader_election.cc:304] T 744d4bd8bf6440d78510bd3a8b14481c P 95234c5b69eb4fe4a7558e56eedbe71a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95234c5b69eb4fe4a7558e56eedbe71a, ec71ef77a55848a0add75a6c104cc9a9; no voters: 
I20260709 14:55:29.367136 18311 raft_consensus.cc:3060] T 86887bfdd39840a4ac9a63d78fcf0c67 P ec71ef77a55848a0add75a6c104cc9a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:55:29.371937 18202 leader_election.cc:304] T 4040b77ce4d34a34baf6e31e9364f07b P 95234c5b69eb4fe4a7558e56eedbe71a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95234c5b69eb4fe4a7558e56eedbe71a, ec71ef77a55848a0add75a6c104cc9a9; no voters: 
I20260709 14:55:29.373492 18423 raft_consensus.cc:2804] T 8885f7ee722545ff8d091567e7f09d69 P 95234c5b69eb4fe4a7558e56eedbe71a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:55:29.373958 18423 raft_consensus.cc:493] T 8885f7ee722545ff8d091567e7f09d69 P 95234c5b69eb4fe4a7558e56eedbe71a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:55:29.374308 18423 raft_consensus.cc:3060] T 8885f7ee722545ff8d091567e7f09d69 P 95234c5b69eb4fe4a7558e56eedbe71a [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:55:29.373520 18460 consensus_queue.cc:260] T 744d4bd8bf6440d78510bd3a8b14481c P f75b4aa933fd4b8c82ea07567024882c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:29.370903 18471 raft_consensus.cc:3060] T 45dc6924b995473493ccf8d5b0ba3668 P ec71ef77a55848a0add75a6c104cc9a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:55:29.377672 18487 raft_consensus.cc:2804] T 744d4bd8bf6440d78510bd3a8b14481c P 95234c5b69eb4fe4a7558e56eedbe71a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:55:29.370885 18163 raft_consensus.cc:2468] T 45dc6924b995473493ccf8d5b0ba3668 P f75b4aa933fd4b8c82ea07567024882c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec71ef77a55848a0add75a6c104cc9a9 in term 0.
I20260709 14:55:29.378055 18487 raft_consensus.cc:493] T 744d4bd8bf6440d78510bd3a8b14481c P 95234c5b69eb4fe4a7558e56eedbe71a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:55:29.377880 18460 ts_tablet_manager.cc:1434] T 744d4bd8bf6440d78510bd3a8b14481c P f75b4aa933fd4b8c82ea07567024882c: Time spent starting tablet: real 0.031s	user 0.012s	sys 0.000s
I20260709 14:55:29.378589 18487 raft_consensus.cc:3060] T 744d4bd8bf6440d78510bd3a8b14481c P 95234c5b69eb4fe4a7558e56eedbe71a [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:55:29.367067 18312 raft_consensus.cc:2468] T 8885f7ee722545ff8d091567e7f09d69 P ec71ef77a55848a0add75a6c104cc9a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f75b4aa933fd4b8c82ea07567024882c in term 0.
W20260709 14:55:29.373027 18202 leader_election.cc:343] T 744d4bd8bf6440d78510bd3a8b14481c P 95234c5b69eb4fe4a7558e56eedbe71a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f75b4aa933fd4b8c82ea07567024882c (127.6.101.65:40449): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:55:29.367215 18310 raft_consensus.cc:2468] T 03cb02cb11914a5db0023952fc210283 P ec71ef77a55848a0add75a6c104cc9a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f75b4aa933fd4b8c82ea07567024882c in term 0.
I20260709 14:55:29.388656 18127 leader_election.cc:304] T 03cb02cb11914a5db0023952fc210283 P f75b4aa933fd4b8c82ea07567024882c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ec71ef77a55848a0add75a6c104cc9a9, f75b4aa933fd4b8c82ea07567024882c; no voters: 
I20260709 14:55:29.389881 18400 raft_consensus.cc:2804] T 03cb02cb11914a5db0023952fc210283 P f75b4aa933fd4b8c82ea07567024882c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:55:29.390336 18400 raft_consensus.cc:493] T 03cb02cb11914a5db0023952fc210283 P f75b4aa933fd4b8c82ea07567024882c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:55:29.390673 18400 raft_consensus.cc:3060] T 03cb02cb11914a5db0023952fc210283 P f75b4aa933fd4b8c82ea07567024882c [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:55:29.393477 18311 raft_consensus.cc:2468] T 86887bfdd39840a4ac9a63d78fcf0c67 P ec71ef77a55848a0add75a6c104cc9a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f75b4aa933fd4b8c82ea07567024882c in term 1.
I20260709 14:55:29.395344 18127 leader_election.cc:304] T 86887bfdd39840a4ac9a63d78fcf0c67 P f75b4aa933fd4b8c82ea07567024882c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ec71ef77a55848a0add75a6c104cc9a9, f75b4aa933fd4b8c82ea07567024882c; no voters: 
I20260709 14:55:29.393652 18383 raft_consensus.cc:515] T e416808f5061489aa8191b18817678d0 P ec71ef77a55848a0add75a6c104cc9a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:29.397042 18493 raft_consensus.cc:2804] T 86887bfdd39840a4ac9a63d78fcf0c67 P f75b4aa933fd4b8c82ea07567024882c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:55:29.401005 18493 raft_consensus.cc:697] T 86887bfdd39840a4ac9a63d78fcf0c67 P f75b4aa933fd4b8c82ea07567024882c [term 1 LEADER]: Becoming Leader. State: Replica: f75b4aa933fd4b8c82ea07567024882c, State: Running, Role: LEADER
I20260709 14:55:29.401496 18497 raft_consensus.cc:2804] T 4040b77ce4d34a34baf6e31e9364f07b P 95234c5b69eb4fe4a7558e56eedbe71a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 14:55:29.402191 18497 raft_consensus.cc:493] T 4040b77ce4d34a34baf6e31e9364f07b P 95234c5b69eb4fe4a7558e56eedbe71a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:55:29.402570 18497 raft_consensus.cc:3060] T 4040b77ce4d34a34baf6e31e9364f07b P 95234c5b69eb4fe4a7558e56eedbe71a [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:55:29.402495 18493 consensus_queue.cc:237] T 86887bfdd39840a4ac9a63d78fcf0c67 P f75b4aa933fd4b8c82ea07567024882c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:29.410688 18423 raft_consensus.cc:515] T 8885f7ee722545ff8d091567e7f09d69 P 95234c5b69eb4fe4a7558e56eedbe71a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:29.412227 18497 raft_consensus.cc:515] T 4040b77ce4d34a34baf6e31e9364f07b P 95234c5b69eb4fe4a7558e56eedbe71a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:29.416352 18163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4040b77ce4d34a34baf6e31e9364f07b" candidate_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f75b4aa933fd4b8c82ea07567024882c"
I20260709 14:55:29.417167 18163 raft_consensus.cc:3060] T 4040b77ce4d34a34baf6e31e9364f07b P f75b4aa933fd4b8c82ea07567024882c [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:55:29.417788 18497 leader_election.cc:290] T 4040b77ce4d34a34baf6e31e9364f07b P 95234c5b69eb4fe4a7558e56eedbe71a [CANDIDATE]: Term 1 election: Requested vote from peers f75b4aa933fd4b8c82ea07567024882c (127.6.101.65:40449), ec71ef77a55848a0add75a6c104cc9a9 (127.6.101.67:42661)
I20260709 14:55:29.418835 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4040b77ce4d34a34baf6e31e9364f07b" candidate_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec71ef77a55848a0add75a6c104cc9a9"
I20260709 14:55:29.426728 18461 tablet_bootstrap.cc:492] T 03cb02cb11914a5db0023952fc210283 P 95234c5b69eb4fe4a7558e56eedbe71a: No bootstrap required, opened a new log
I20260709 14:55:29.427393 18461 ts_tablet_manager.cc:1403] T 03cb02cb11914a5db0023952fc210283 P 95234c5b69eb4fe4a7558e56eedbe71a: Time spent bootstrapping tablet: real 0.077s	user 0.019s	sys 0.012s
I20260709 14:55:29.431304 18163 raft_consensus.cc:2468] T 4040b77ce4d34a34baf6e31e9364f07b P f75b4aa933fd4b8c82ea07567024882c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95234c5b69eb4fe4a7558e56eedbe71a in term 1.
I20260709 14:55:29.431664 18461 raft_consensus.cc:359] T 03cb02cb11914a5db0023952fc210283 P 95234c5b69eb4fe4a7558e56eedbe71a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:29.433166 18202 leader_election.cc:304] T 4040b77ce4d34a34baf6e31e9364f07b P 95234c5b69eb4fe4a7558e56eedbe71a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95234c5b69eb4fe4a7558e56eedbe71a, f75b4aa933fd4b8c82ea07567024882c; no voters: 
I20260709 14:55:29.433553 18461 raft_consensus.cc:385] T 03cb02cb11914a5db0023952fc210283 P 95234c5b69eb4fe4a7558e56eedbe71a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:55:29.434474 18497 raft_consensus.cc:2804] T 4040b77ce4d34a34baf6e31e9364f07b P 95234c5b69eb4fe4a7558e56eedbe71a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:55:29.434721 18465 raft_consensus.cc:515] T e416808f5061489aa8191b18817678d0 P 95234c5b69eb4fe4a7558e56eedbe71a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:29.435318 18461 raft_consensus.cc:740] T 03cb02cb11914a5db0023952fc210283 P 95234c5b69eb4fe4a7558e56eedbe71a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95234c5b69eb4fe4a7558e56eedbe71a, State: Initialized, Role: FOLLOWER
I20260709 14:55:29.436802 18461 consensus_queue.cc:260] T 03cb02cb11914a5db0023952fc210283 P 95234c5b69eb4fe4a7558e56eedbe71a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:29.420967 18471 raft_consensus.cc:515] T 45dc6924b995473493ccf8d5b0ba3668 P ec71ef77a55848a0add75a6c104cc9a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:29.423282 18311 raft_consensus.cc:3060] T 4040b77ce4d34a34baf6e31e9364f07b P ec71ef77a55848a0add75a6c104cc9a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:55:29.415503 18475 raft_consensus.cc:515] T 8885f7ee722545ff8d091567e7f09d69 P f75b4aa933fd4b8c82ea07567024882c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:29.446444 18163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8885f7ee722545ff8d091567e7f09d69" candidate_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f75b4aa933fd4b8c82ea07567024882c"
I20260709 14:55:29.448662 18471 leader_election.cc:290] T 45dc6924b995473493ccf8d5b0ba3668 P ec71ef77a55848a0add75a6c104cc9a9 [CANDIDATE]: Term 1 election: Requested vote from peers f75b4aa933fd4b8c82ea07567024882c (127.6.101.65:40449), 95234c5b69eb4fe4a7558e56eedbe71a (127.6.101.66:42897)
I20260709 14:55:29.450959 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dc6924b995473493ccf8d5b0ba3668" candidate_uuid: "ec71ef77a55848a0add75a6c104cc9a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95234c5b69eb4fe4a7558e56eedbe71a"
I20260709 14:55:29.452420 18383 leader_election.cc:290] T e416808f5061489aa8191b18817678d0 P ec71ef77a55848a0add75a6c104cc9a9 [CANDIDATE]: Term 1 election: Requested vote from peers f75b4aa933fd4b8c82ea07567024882c (127.6.101.65:40449), 95234c5b69eb4fe4a7558e56eedbe71a (127.6.101.66:42897)
I20260709 14:55:29.454254 18238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e416808f5061489aa8191b18817678d0" candidate_uuid: "ec71ef77a55848a0add75a6c104cc9a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95234c5b69eb4fe4a7558e56eedbe71a"
I20260709 14:55:29.455163 18161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e416808f5061489aa8191b18817678d0" candidate_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f75b4aa933fd4b8c82ea07567024882c"
I20260709 14:55:29.456130 18423 leader_election.cc:290] T 8885f7ee722545ff8d091567e7f09d69 P 95234c5b69eb4fe4a7558e56eedbe71a [CANDIDATE]: Term 1 election: Requested vote from peers f75b4aa933fd4b8c82ea07567024882c (127.6.101.65:40449), ec71ef77a55848a0add75a6c104cc9a9 (127.6.101.67:42661)
W20260709 14:55:29.421634 18129 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.101.66:42897, user_credentials={real_user=slave}} blocked reactor thread for 91300.2us
I20260709 14:55:29.459667 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8885f7ee722545ff8d091567e7f09d69" candidate_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec71ef77a55848a0add75a6c104cc9a9"
I20260709 14:55:29.422932 18487 raft_consensus.cc:515] T 744d4bd8bf6440d78510bd3a8b14481c P 95234c5b69eb4fe4a7558e56eedbe71a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:29.466590 18400 raft_consensus.cc:515] T 03cb02cb11914a5db0023952fc210283 P f75b4aa933fd4b8c82ea07567024882c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:29.467571 18461 ts_tablet_manager.cc:1434] T 03cb02cb11914a5db0023952fc210283 P 95234c5b69eb4fe4a7558e56eedbe71a: Time spent starting tablet: real 0.040s	user 0.008s	sys 0.005s
I20260709 14:55:29.465065 18238 raft_consensus.cc:2393] T e416808f5061489aa8191b18817678d0 P 95234c5b69eb4fe4a7558e56eedbe71a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ec71ef77a55848a0add75a6c104cc9a9 in current term 1: Already voted for candidate 95234c5b69eb4fe4a7558e56eedbe71a in this term.
I20260709 14:55:29.461491 18497 raft_consensus.cc:697] T 4040b77ce4d34a34baf6e31e9364f07b P 95234c5b69eb4fe4a7558e56eedbe71a [term 1 LEADER]: Becoming Leader. State: Replica: 95234c5b69eb4fe4a7558e56eedbe71a, State: Running, Role: LEADER
I20260709 14:55:29.470930 18161 raft_consensus.cc:3060] T e416808f5061489aa8191b18817678d0 P f75b4aa933fd4b8c82ea07567024882c [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:55:29.469484 18237 raft_consensus.cc:3060] T 45dc6924b995473493ccf8d5b0ba3668 P 95234c5b69eb4fe4a7558e56eedbe71a [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:55:29.476145 18310 raft_consensus.cc:3060] T 8885f7ee722545ff8d091567e7f09d69 P ec71ef77a55848a0add75a6c104cc9a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:55:29.482368 18163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e416808f5061489aa8191b18817678d0" candidate_uuid: "ec71ef77a55848a0add75a6c104cc9a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f75b4aa933fd4b8c82ea07567024882c"
I20260709 14:55:29.482612 18160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dc6924b995473493ccf8d5b0ba3668" candidate_uuid: "ec71ef77a55848a0add75a6c104cc9a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f75b4aa933fd4b8c82ea07567024882c"
I20260709 14:55:29.483479 18160 raft_consensus.cc:3060] T 45dc6924b995473493ccf8d5b0ba3668 P f75b4aa933fd4b8c82ea07567024882c [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:55:29.476487 18162 raft_consensus.cc:2393] T 8885f7ee722545ff8d091567e7f09d69 P f75b4aa933fd4b8c82ea07567024882c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95234c5b69eb4fe4a7558e56eedbe71a in current term 1: Already voted for candidate f75b4aa933fd4b8c82ea07567024882c in this term.
I20260709 14:55:29.484187 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86887bfdd39840a4ac9a63d78fcf0c67" candidate_uuid: "f75b4aa933fd4b8c82ea07567024882c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95234c5b69eb4fe4a7558e56eedbe71a"
I20260709 14:55:29.488430 18276 leader_election.cc:304] T e416808f5061489aa8191b18817678d0 P ec71ef77a55848a0add75a6c104cc9a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec71ef77a55848a0add75a6c104cc9a9; no voters: 95234c5b69eb4fe4a7558e56eedbe71a, f75b4aa933fd4b8c82ea07567024882c
I20260709 14:55:29.490839 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e416808f5061489aa8191b18817678d0" candidate_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec71ef77a55848a0add75a6c104cc9a9"
I20260709 14:55:29.491868 18312 raft_consensus.cc:2393] T e416808f5061489aa8191b18817678d0 P ec71ef77a55848a0add75a6c104cc9a9 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 95234c5b69eb4fe4a7558e56eedbe71a in current term 1: Already voted for candidate ec71ef77a55848a0add75a6c104cc9a9 in this term.
I20260709 14:55:29.493786 18238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03cb02cb11914a5db0023952fc210283" candidate_uuid: "f75b4aa933fd4b8c82ea07567024882c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" is_pre_election: true
I20260709 14:55:29.494596 18238 raft_consensus.cc:2468] T 03cb02cb11914a5db0023952fc210283 P 95234c5b69eb4fe4a7558e56eedbe71a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f75b4aa933fd4b8c82ea07567024882c in term 0.
I20260709 14:55:29.494778 18471 raft_consensus.cc:2749] T e416808f5061489aa8191b18817678d0 P ec71ef77a55848a0add75a6c104cc9a9 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 14:55:29.496667 18487 leader_election.cc:290] T 744d4bd8bf6440d78510bd3a8b14481c P 95234c5b69eb4fe4a7558e56eedbe71a [CANDIDATE]: Term 1 election: Requested vote from peers f75b4aa933fd4b8c82ea07567024882c (127.6.101.65:40449), ec71ef77a55848a0add75a6c104cc9a9 (127.6.101.67:42661)
I20260709 14:55:29.478385 18465 leader_election.cc:290] T e416808f5061489aa8191b18817678d0 P 95234c5b69eb4fe4a7558e56eedbe71a [CANDIDATE]: Term 1 election: Requested vote from peers f75b4aa933fd4b8c82ea07567024882c (127.6.101.65:40449), ec71ef77a55848a0add75a6c104cc9a9 (127.6.101.67:42661)
I20260709 14:55:29.497917 18497 consensus_queue.cc:237] T 4040b77ce4d34a34baf6e31e9364f07b P 95234c5b69eb4fe4a7558e56eedbe71a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:29.500229 18163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "744d4bd8bf6440d78510bd3a8b14481c" candidate_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f75b4aa933fd4b8c82ea07567024882c"
I20260709 14:55:29.500998 18163 raft_consensus.cc:3060] T 744d4bd8bf6440d78510bd3a8b14481c P f75b4aa933fd4b8c82ea07567024882c [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:55:29.501742 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "744d4bd8bf6440d78510bd3a8b14481c" candidate_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec71ef77a55848a0add75a6c104cc9a9"
I20260709 14:55:29.502511 18312 raft_consensus.cc:3060] T 744d4bd8bf6440d78510bd3a8b14481c P ec71ef77a55848a0add75a6c104cc9a9 [term 0 FOLLOWER]: Advancing to term 1
W20260709 14:55:29.506026 18129 leader_election.cc:343] T 86887bfdd39840a4ac9a63d78fcf0c67 P f75b4aa933fd4b8c82ea07567024882c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 95234c5b69eb4fe4a7558e56eedbe71a (127.6.101.66:42897): Illegal state: must be running to vote when last-logged opid is not known
I20260709 14:55:29.488201 18061 catalog_manager.cc:5697] T f0007e8bcd5d478482896147adc197b0 P f75b4aa933fd4b8c82ea07567024882c reported cstate change: term changed from 0 to 1, leader changed from <none> to f75b4aa933fd4b8c82ea07567024882c (127.6.101.65). New cstate: current_term: 1 leader_uuid: "f75b4aa933fd4b8c82ea07567024882c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } health_report { overall_health: UNKNOWN } } }
I20260709 14:55:29.508008 18160 raft_consensus.cc:2468] T 45dc6924b995473493ccf8d5b0ba3668 P f75b4aa933fd4b8c82ea07567024882c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec71ef77a55848a0add75a6c104cc9a9 in term 1.
I20260709 14:55:29.508085 18311 raft_consensus.cc:2468] T 4040b77ce4d34a34baf6e31e9364f07b P ec71ef77a55848a0add75a6c104cc9a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95234c5b69eb4fe4a7558e56eedbe71a in term 1.
I20260709 14:55:29.508980 18310 raft_consensus.cc:2468] T 8885f7ee722545ff8d091567e7f09d69 P ec71ef77a55848a0add75a6c104cc9a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95234c5b69eb4fe4a7558e56eedbe71a in term 1.
I20260709 14:55:29.509811 18276 leader_election.cc:304] T 45dc6924b995473493ccf8d5b0ba3668 P ec71ef77a55848a0add75a6c104cc9a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ec71ef77a55848a0add75a6c104cc9a9, f75b4aa933fd4b8c82ea07567024882c; no voters: 
I20260709 14:55:29.510516 18202 leader_election.cc:304] T 8885f7ee722545ff8d091567e7f09d69 P 95234c5b69eb4fe4a7558e56eedbe71a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95234c5b69eb4fe4a7558e56eedbe71a, ec71ef77a55848a0add75a6c104cc9a9; no voters: f75b4aa933fd4b8c82ea07567024882c
I20260709 14:55:29.511338 18471 raft_consensus.cc:2804] T 45dc6924b995473493ccf8d5b0ba3668 P ec71ef77a55848a0add75a6c104cc9a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:55:29.511921 18471 raft_consensus.cc:697] T 45dc6924b995473493ccf8d5b0ba3668 P ec71ef77a55848a0add75a6c104cc9a9 [term 1 LEADER]: Becoming Leader. State: Replica: ec71ef77a55848a0add75a6c104cc9a9, State: Running, Role: LEADER
I20260709 14:55:29.512672 18471 consensus_queue.cc:237] T 45dc6924b995473493ccf8d5b0ba3668 P ec71ef77a55848a0add75a6c104cc9a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:29.513765 18504 raft_consensus.cc:2804] T 8885f7ee722545ff8d091567e7f09d69 P 95234c5b69eb4fe4a7558e56eedbe71a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:55:29.514428 18504 raft_consensus.cc:697] T 8885f7ee722545ff8d091567e7f09d69 P 95234c5b69eb4fe4a7558e56eedbe71a [term 1 LEADER]: Becoming Leader. State: Replica: 95234c5b69eb4fe4a7558e56eedbe71a, State: Running, Role: LEADER
I20260709 14:55:29.516363 18461 tablet_bootstrap.cc:492] T 86887bfdd39840a4ac9a63d78fcf0c67 P 95234c5b69eb4fe4a7558e56eedbe71a: Bootstrap starting.
I20260709 14:55:29.520622 18238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03cb02cb11914a5db0023952fc210283" candidate_uuid: "f75b4aa933fd4b8c82ea07567024882c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95234c5b69eb4fe4a7558e56eedbe71a"
I20260709 14:55:29.522033 18238 raft_consensus.cc:3060] T 03cb02cb11914a5db0023952fc210283 P 95234c5b69eb4fe4a7558e56eedbe71a [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:55:29.521106 18163 raft_consensus.cc:2468] T 744d4bd8bf6440d78510bd3a8b14481c P f75b4aa933fd4b8c82ea07567024882c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95234c5b69eb4fe4a7558e56eedbe71a in term 1.
I20260709 14:55:29.515359 18504 consensus_queue.cc:237] T 8885f7ee722545ff8d091567e7f09d69 P 95234c5b69eb4fe4a7558e56eedbe71a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:29.524206 18475 leader_election.cc:290] T 8885f7ee722545ff8d091567e7f09d69 P f75b4aa933fd4b8c82ea07567024882c [CANDIDATE]: Term 1 election: Requested vote from peers 95234c5b69eb4fe4a7558e56eedbe71a (127.6.101.66:42897), ec71ef77a55848a0add75a6c104cc9a9 (127.6.101.67:42661)
I20260709 14:55:29.526453 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8885f7ee722545ff8d091567e7f09d69" candidate_uuid: "f75b4aa933fd4b8c82ea07567024882c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95234c5b69eb4fe4a7558e56eedbe71a"
I20260709 14:55:29.524322 18161 raft_consensus.cc:2468] T e416808f5061489aa8191b18817678d0 P f75b4aa933fd4b8c82ea07567024882c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95234c5b69eb4fe4a7558e56eedbe71a in term 1.
I20260709 14:55:29.524773 18202 leader_election.cc:304] T 744d4bd8bf6440d78510bd3a8b14481c P 95234c5b69eb4fe4a7558e56eedbe71a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95234c5b69eb4fe4a7558e56eedbe71a, f75b4aa933fd4b8c82ea07567024882c; no voters: 
I20260709 14:55:29.529469 18465 raft_consensus.cc:2804] T 744d4bd8bf6440d78510bd3a8b14481c P 95234c5b69eb4fe4a7558e56eedbe71a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:55:29.529737 18202 leader_election.cc:304] T e416808f5061489aa8191b18817678d0 P 95234c5b69eb4fe4a7558e56eedbe71a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95234c5b69eb4fe4a7558e56eedbe71a, f75b4aa933fd4b8c82ea07567024882c; no voters: ec71ef77a55848a0add75a6c104cc9a9
I20260709 14:55:29.530047 18465 raft_consensus.cc:697] T 744d4bd8bf6440d78510bd3a8b14481c P 95234c5b69eb4fe4a7558e56eedbe71a [term 1 LEADER]: Becoming Leader. State: Replica: 95234c5b69eb4fe4a7558e56eedbe71a, State: Running, Role: LEADER
I20260709 14:55:29.531038 18503 raft_consensus.cc:2804] T e416808f5061489aa8191b18817678d0 P 95234c5b69eb4fe4a7558e56eedbe71a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:55:29.531833 18503 raft_consensus.cc:697] T e416808f5061489aa8191b18817678d0 P 95234c5b69eb4fe4a7558e56eedbe71a [term 1 LEADER]: Becoming Leader. State: Replica: 95234c5b69eb4fe4a7558e56eedbe71a, State: Running, Role: LEADER
I20260709 14:55:29.531155 18465 consensus_queue.cc:237] T 744d4bd8bf6440d78510bd3a8b14481c P 95234c5b69eb4fe4a7558e56eedbe71a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:29.532809 18503 consensus_queue.cc:237] T e416808f5061489aa8191b18817678d0 P 95234c5b69eb4fe4a7558e56eedbe71a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:29.540946 18237 raft_consensus.cc:2468] T 45dc6924b995473493ccf8d5b0ba3668 P 95234c5b69eb4fe4a7558e56eedbe71a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec71ef77a55848a0add75a6c104cc9a9 in term 1.
I20260709 14:55:29.541074 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8885f7ee722545ff8d091567e7f09d69" candidate_uuid: "f75b4aa933fd4b8c82ea07567024882c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec71ef77a55848a0add75a6c104cc9a9"
I20260709 14:55:29.546911 18311 raft_consensus.cc:2393] T 8885f7ee722545ff8d091567e7f09d69 P ec71ef77a55848a0add75a6c104cc9a9 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f75b4aa933fd4b8c82ea07567024882c in current term 1: Already voted for candidate 95234c5b69eb4fe4a7558e56eedbe71a in this term.
I20260709 14:55:29.548172 18400 leader_election.cc:290] T 03cb02cb11914a5db0023952fc210283 P f75b4aa933fd4b8c82ea07567024882c [CANDIDATE]: Term 1 election: Requested vote from peers 95234c5b69eb4fe4a7558e56eedbe71a (127.6.101.66:42897), ec71ef77a55848a0add75a6c104cc9a9 (127.6.101.67:42661)
I20260709 14:55:29.547660 18060 catalog_manager.cc:5697] T 45dc6924b995473493ccf8d5b0ba3668 P ec71ef77a55848a0add75a6c104cc9a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to ec71ef77a55848a0add75a6c104cc9a9 (127.6.101.67). New cstate: current_term: 1 leader_uuid: "ec71ef77a55848a0add75a6c104cc9a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } health_report { overall_health: HEALTHY } } }
I20260709 14:55:29.548614 18127 leader_election.cc:304] T 8885f7ee722545ff8d091567e7f09d69 P f75b4aa933fd4b8c82ea07567024882c [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f75b4aa933fd4b8c82ea07567024882c; no voters: 95234c5b69eb4fe4a7558e56eedbe71a, ec71ef77a55848a0add75a6c104cc9a9
I20260709 14:55:29.550053 18238 raft_consensus.cc:2468] T 03cb02cb11914a5db0023952fc210283 P 95234c5b69eb4fe4a7558e56eedbe71a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f75b4aa933fd4b8c82ea07567024882c in term 1.
I20260709 14:55:29.551745 18475 raft_consensus.cc:2749] T 8885f7ee722545ff8d091567e7f09d69 P f75b4aa933fd4b8c82ea07567024882c [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 14:55:29.560413 18129 leader_election.cc:304] T 03cb02cb11914a5db0023952fc210283 P f75b4aa933fd4b8c82ea07567024882c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95234c5b69eb4fe4a7558e56eedbe71a, f75b4aa933fd4b8c82ea07567024882c; no voters: 
I20260709 14:55:29.562668 18461 tablet_bootstrap.cc:654] T 86887bfdd39840a4ac9a63d78fcf0c67 P 95234c5b69eb4fe4a7558e56eedbe71a: Neither blocks nor log segments found. Creating new log.
I20260709 14:55:29.547715 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03cb02cb11914a5db0023952fc210283" candidate_uuid: "f75b4aa933fd4b8c82ea07567024882c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec71ef77a55848a0add75a6c104cc9a9"
I20260709 14:55:29.570859 18310 raft_consensus.cc:3060] T 03cb02cb11914a5db0023952fc210283 P ec71ef77a55848a0add75a6c104cc9a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:55:29.573223 18400 raft_consensus.cc:2804] T 03cb02cb11914a5db0023952fc210283 P f75b4aa933fd4b8c82ea07567024882c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 14:55:29.580685 18400 raft_consensus.cc:697] T 03cb02cb11914a5db0023952fc210283 P f75b4aa933fd4b8c82ea07567024882c [term 1 LEADER]: Becoming Leader. State: Replica: f75b4aa933fd4b8c82ea07567024882c, State: Running, Role: LEADER
I20260709 14:55:29.582870 18400 consensus_queue.cc:237] T 03cb02cb11914a5db0023952fc210283 P f75b4aa933fd4b8c82ea07567024882c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:29.585862 18060 catalog_manager.cc:5697] T 86887bfdd39840a4ac9a63d78fcf0c67 P f75b4aa933fd4b8c82ea07567024882c reported cstate change: term changed from 0 to 1, leader changed from <none> to f75b4aa933fd4b8c82ea07567024882c (127.6.101.65). New cstate: current_term: 1 leader_uuid: "f75b4aa933fd4b8c82ea07567024882c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } health_report { overall_health: UNKNOWN } } }
I20260709 14:55:29.588428 18312 raft_consensus.cc:2468] T 744d4bd8bf6440d78510bd3a8b14481c P ec71ef77a55848a0add75a6c104cc9a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95234c5b69eb4fe4a7558e56eedbe71a in term 1.
I20260709 14:55:29.608989 18310 raft_consensus.cc:2468] T 03cb02cb11914a5db0023952fc210283 P ec71ef77a55848a0add75a6c104cc9a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f75b4aa933fd4b8c82ea07567024882c in term 1.
I20260709 14:55:29.614444 18061 catalog_manager.cc:5697] T 4040b77ce4d34a34baf6e31e9364f07b P 95234c5b69eb4fe4a7558e56eedbe71a reported cstate change: term changed from 0 to 1, leader changed from <none> to 95234c5b69eb4fe4a7558e56eedbe71a (127.6.101.66). New cstate: current_term: 1 leader_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } health_report { overall_health: UNKNOWN } } }
I20260709 14:55:29.632503 18060 catalog_manager.cc:5697] T 03cb02cb11914a5db0023952fc210283 P f75b4aa933fd4b8c82ea07567024882c reported cstate change: term changed from 0 to 1, leader changed from <none> to f75b4aa933fd4b8c82ea07567024882c (127.6.101.65). New cstate: current_term: 1 leader_uuid: "f75b4aa933fd4b8c82ea07567024882c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } health_report { overall_health: UNKNOWN } } }
I20260709 14:55:29.635129 18461 tablet_bootstrap.cc:492] T 86887bfdd39840a4ac9a63d78fcf0c67 P 95234c5b69eb4fe4a7558e56eedbe71a: No bootstrap required, opened a new log
I20260709 14:55:29.635218 18487 consensus_queue.cc:1048] T 84b1a73cbc1e4c56a0a733d2cdacc300 P 95234c5b69eb4fe4a7558e56eedbe71a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:55:29.635944 18461 ts_tablet_manager.cc:1403] T 86887bfdd39840a4ac9a63d78fcf0c67 P 95234c5b69eb4fe4a7558e56eedbe71a: Time spent bootstrapping tablet: real 0.124s	user 0.031s	sys 0.004s
I20260709 14:55:29.640431 18461 raft_consensus.cc:359] T 86887bfdd39840a4ac9a63d78fcf0c67 P 95234c5b69eb4fe4a7558e56eedbe71a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:29.641440 18461 raft_consensus.cc:385] T 86887bfdd39840a4ac9a63d78fcf0c67 P 95234c5b69eb4fe4a7558e56eedbe71a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 14:55:29.641741 18461 raft_consensus.cc:740] T 86887bfdd39840a4ac9a63d78fcf0c67 P 95234c5b69eb4fe4a7558e56eedbe71a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95234c5b69eb4fe4a7558e56eedbe71a, State: Initialized, Role: FOLLOWER
I20260709 14:55:29.642665 18461 consensus_queue.cc:260] T 86887bfdd39840a4ac9a63d78fcf0c67 P 95234c5b69eb4fe4a7558e56eedbe71a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:29.646190 18461 ts_tablet_manager.cc:1434] T 86887bfdd39840a4ac9a63d78fcf0c67 P 95234c5b69eb4fe4a7558e56eedbe71a: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.003s
I20260709 14:55:29.650465 18465 consensus_queue.cc:1048] T 84b1a73cbc1e4c56a0a733d2cdacc300 P 95234c5b69eb4fe4a7558e56eedbe71a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:55:29.687484 18060 catalog_manager.cc:5697] T e416808f5061489aa8191b18817678d0 P 95234c5b69eb4fe4a7558e56eedbe71a reported cstate change: term changed from 0 to 1, leader changed from <none> to 95234c5b69eb4fe4a7558e56eedbe71a (127.6.101.66). New cstate: current_term: 1 leader_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } health_report { overall_health: UNKNOWN } } }
I20260709 14:55:29.689487 18060 catalog_manager.cc:5697] T 744d4bd8bf6440d78510bd3a8b14481c P 95234c5b69eb4fe4a7558e56eedbe71a reported cstate change: term changed from 0 to 1, leader changed from <none> to 95234c5b69eb4fe4a7558e56eedbe71a (127.6.101.66). New cstate: current_term: 1 leader_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } health_report { overall_health: UNKNOWN } } }
I20260709 14:55:29.699769 18060 catalog_manager.cc:5697] T 8885f7ee722545ff8d091567e7f09d69 P 95234c5b69eb4fe4a7558e56eedbe71a reported cstate change: term changed from 0 to 1, leader changed from <none> to 95234c5b69eb4fe4a7558e56eedbe71a (127.6.101.66). New cstate: current_term: 1 leader_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } health_report { overall_health: UNKNOWN } } }
I20260709 14:55:29.778580 18475 consensus_queue.cc:1048] T f0007e8bcd5d478482896147adc197b0 P f75b4aa933fd4b8c82ea07567024882c [LEADER]: Connected to new peer: Peer: permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:55:29.794101 18493 consensus_queue.cc:1048] T f0007e8bcd5d478482896147adc197b0 P f75b4aa933fd4b8c82ea07567024882c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:55:29.841711 18238 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "84b1a73cbc1e4c56a0a733d2cdacc300"
dest_uuid: "95234c5b69eb4fe4a7558e56eedbe71a"
mode: GRACEFUL
new_leader_uuid: "f75b4aa933fd4b8c82ea07567024882c"
 from {username='slave'} at 127.0.0.1:60394
I20260709 14:55:29.842453 18238 raft_consensus.cc:606] T 84b1a73cbc1e4c56a0a733d2cdacc300 P 95234c5b69eb4fe4a7558e56eedbe71a [term 1 LEADER]: Received request to transfer leadership to TS f75b4aa933fd4b8c82ea07567024882c
I20260709 14:55:29.848227 18238 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4040b77ce4d34a34baf6e31e9364f07b"
dest_uuid: "95234c5b69eb4fe4a7558e56eedbe71a"
mode: GRACEFUL
new_leader_uuid: "f75b4aa933fd4b8c82ea07567024882c"
 from {username='slave'} at 127.0.0.1:60394
I20260709 14:55:29.849082 18238 raft_consensus.cc:606] T 4040b77ce4d34a34baf6e31e9364f07b P 95234c5b69eb4fe4a7558e56eedbe71a [term 1 LEADER]: Received request to transfer leadership to TS f75b4aa933fd4b8c82ea07567024882c
I20260709 14:55:29.860445 18238 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e416808f5061489aa8191b18817678d0"
dest_uuid: "95234c5b69eb4fe4a7558e56eedbe71a"
mode: GRACEFUL
new_leader_uuid: "f75b4aa933fd4b8c82ea07567024882c"
 from {username='slave'} at 127.0.0.1:60394
I20260709 14:55:29.860970 18238 raft_consensus.cc:606] T e416808f5061489aa8191b18817678d0 P 95234c5b69eb4fe4a7558e56eedbe71a [term 1 LEADER]: Received request to transfer leadership to TS f75b4aa933fd4b8c82ea07567024882c
I20260709 14:55:29.866006 18238 raft_consensus.cc:3060] T 86887bfdd39840a4ac9a63d78fcf0c67 P 95234c5b69eb4fe4a7558e56eedbe71a [term 0 FOLLOWER]: Advancing to term 1
I20260709 14:55:29.873035 18161 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "03cb02cb11914a5db0023952fc210283"
dest_uuid: "f75b4aa933fd4b8c82ea07567024882c"
mode: GRACEFUL
new_leader_uuid: "95234c5b69eb4fe4a7558e56eedbe71a"
 from {username='slave'} at 127.0.0.1:55812
I20260709 14:55:29.874148 18161 raft_consensus.cc:606] T 03cb02cb11914a5db0023952fc210283 P f75b4aa933fd4b8c82ea07567024882c [term 1 LEADER]: Received request to transfer leadership to TS 95234c5b69eb4fe4a7558e56eedbe71a
I20260709 14:55:29.877099 18504 raft_consensus.cc:493] T 86887bfdd39840a4ac9a63d78fcf0c67 P 95234c5b69eb4fe4a7558e56eedbe71a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:55:29.877782 18504 raft_consensus.cc:515] T 86887bfdd39840a4ac9a63d78fcf0c67 P 95234c5b69eb4fe4a7558e56eedbe71a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:29.878537 18493 consensus_queue.cc:1048] T 86887bfdd39840a4ac9a63d78fcf0c67 P f75b4aa933fd4b8c82ea07567024882c [LEADER]: Connected to new peer: Peer: permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 14:55:29.883502 18161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86887bfdd39840a4ac9a63d78fcf0c67" candidate_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f75b4aa933fd4b8c82ea07567024882c" is_pre_election: true
I20260709 14:55:29.884553 18504 leader_election.cc:290] T 86887bfdd39840a4ac9a63d78fcf0c67 P 95234c5b69eb4fe4a7558e56eedbe71a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f75b4aa933fd4b8c82ea07567024882c (127.6.101.65:40449), ec71ef77a55848a0add75a6c104cc9a9 (127.6.101.67:42661)
I20260709 14:55:29.885272 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86887bfdd39840a4ac9a63d78fcf0c67" candidate_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec71ef77a55848a0add75a6c104cc9a9" is_pre_election: true
I20260709 14:55:29.886063 18310 raft_consensus.cc:2468] T 86887bfdd39840a4ac9a63d78fcf0c67 P ec71ef77a55848a0add75a6c104cc9a9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95234c5b69eb4fe4a7558e56eedbe71a in term 1.
I20260709 14:55:29.887463 18202 leader_election.cc:304] T 86887bfdd39840a4ac9a63d78fcf0c67 P 95234c5b69eb4fe4a7558e56eedbe71a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95234c5b69eb4fe4a7558e56eedbe71a, ec71ef77a55848a0add75a6c104cc9a9; no voters: f75b4aa933fd4b8c82ea07567024882c
I20260709 14:55:29.887823 18161 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "86887bfdd39840a4ac9a63d78fcf0c67"
dest_uuid: "f75b4aa933fd4b8c82ea07567024882c"
mode: GRACEFUL
new_leader_uuid: "95234c5b69eb4fe4a7558e56eedbe71a"
 from {username='slave'} at 127.0.0.1:55812
I20260709 14:55:29.888763 18504 raft_consensus.cc:2804] T 86887bfdd39840a4ac9a63d78fcf0c67 P 95234c5b69eb4fe4a7558e56eedbe71a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 14:55:29.889204 18504 raft_consensus.cc:493] T 86887bfdd39840a4ac9a63d78fcf0c67 P 95234c5b69eb4fe4a7558e56eedbe71a [term 1 FOLLOWER]: Starting leader election (detected failure of leader f75b4aa933fd4b8c82ea07567024882c)
I20260709 14:55:29.889638 18504 raft_consensus.cc:3060] T 86887bfdd39840a4ac9a63d78fcf0c67 P 95234c5b69eb4fe4a7558e56eedbe71a [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:55:29.893671 18161 raft_consensus.cc:606] T 86887bfdd39840a4ac9a63d78fcf0c67 P f75b4aa933fd4b8c82ea07567024882c [term 1 LEADER]: Received request to transfer leadership to TS 95234c5b69eb4fe4a7558e56eedbe71a
I20260709 14:55:29.899147 18504 raft_consensus.cc:515] T 86887bfdd39840a4ac9a63d78fcf0c67 P 95234c5b69eb4fe4a7558e56eedbe71a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:29.902113 18493 consensus_queue.cc:1048] T 86887bfdd39840a4ac9a63d78fcf0c67 P f75b4aa933fd4b8c82ea07567024882c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:55:29.903192 18161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86887bfdd39840a4ac9a63d78fcf0c67" candidate_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f75b4aa933fd4b8c82ea07567024882c"
I20260709 14:55:29.907089 18238 raft_consensus.cc:1240] T 86887bfdd39840a4ac9a63d78fcf0c67 P 95234c5b69eb4fe4a7558e56eedbe71a [term 2 FOLLOWER]: Rejecting Update request from peer f75b4aa933fd4b8c82ea07567024882c for earlier term 1. Current term is 2. Ops: []
I20260709 14:55:29.908622 18471 consensus_queue.cc:1048] T 45dc6924b995473493ccf8d5b0ba3668 P ec71ef77a55848a0add75a6c104cc9a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:55:29.910264 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86887bfdd39840a4ac9a63d78fcf0c67" candidate_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ec71ef77a55848a0add75a6c104cc9a9"
I20260709 14:55:29.912518 18496 consensus_queue.cc:1059] T 86887bfdd39840a4ac9a63d78fcf0c67 P f75b4aa933fd4b8c82ea07567024882c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:55:29.914024 18496 raft_consensus.cc:3055] T 86887bfdd39840a4ac9a63d78fcf0c67 P f75b4aa933fd4b8c82ea07567024882c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 14:55:29.914716 18496 raft_consensus.cc:740] T 86887bfdd39840a4ac9a63d78fcf0c67 P f75b4aa933fd4b8c82ea07567024882c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f75b4aa933fd4b8c82ea07567024882c, State: Running, Role: LEADER
I20260709 14:55:29.915611 18312 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "45dc6924b995473493ccf8d5b0ba3668"
dest_uuid: "ec71ef77a55848a0add75a6c104cc9a9"
mode: GRACEFUL
new_leader_uuid: "95234c5b69eb4fe4a7558e56eedbe71a"
 from {username='slave'} at 127.0.0.1:52800
I20260709 14:55:29.916756 18312 raft_consensus.cc:606] T 45dc6924b995473493ccf8d5b0ba3668 P ec71ef77a55848a0add75a6c104cc9a9 [term 1 LEADER]: Received request to transfer leadership to TS 95234c5b69eb4fe4a7558e56eedbe71a
I20260709 14:55:29.915685 18496 consensus_queue.cc:260] T 86887bfdd39840a4ac9a63d78fcf0c67 P f75b4aa933fd4b8c82ea07567024882c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:29.913297 18202 leader_election.cc:304] T 86887bfdd39840a4ac9a63d78fcf0c67 P 95234c5b69eb4fe4a7558e56eedbe71a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95234c5b69eb4fe4a7558e56eedbe71a; no voters: ec71ef77a55848a0add75a6c104cc9a9, f75b4aa933fd4b8c82ea07567024882c
I20260709 14:55:29.919406 18496 raft_consensus.cc:3060] T 86887bfdd39840a4ac9a63d78fcf0c67 P f75b4aa933fd4b8c82ea07567024882c [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:55:29.919816 18504 leader_election.cc:290] T 86887bfdd39840a4ac9a63d78fcf0c67 P 95234c5b69eb4fe4a7558e56eedbe71a [CANDIDATE]: Term 2 election: Requested vote from peers f75b4aa933fd4b8c82ea07567024882c (127.6.101.65:40449), ec71ef77a55848a0add75a6c104cc9a9 (127.6.101.67:42661)
I20260709 14:55:29.920794 18504 raft_consensus.cc:2749] T 86887bfdd39840a4ac9a63d78fcf0c67 P 95234c5b69eb4fe4a7558e56eedbe71a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 14:55:29.934839 18238 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "744d4bd8bf6440d78510bd3a8b14481c"
dest_uuid: "95234c5b69eb4fe4a7558e56eedbe71a"
mode: GRACEFUL
new_leader_uuid: "ec71ef77a55848a0add75a6c104cc9a9"
 from {username='slave'} at 127.0.0.1:60394
I20260709 14:55:29.935583 18238 raft_consensus.cc:606] T 744d4bd8bf6440d78510bd3a8b14481c P 95234c5b69eb4fe4a7558e56eedbe71a [term 1 LEADER]: Received request to transfer leadership to TS ec71ef77a55848a0add75a6c104cc9a9
I20260709 14:55:29.937382 18471 consensus_queue.cc:1048] T 45dc6924b995473493ccf8d5b0ba3668 P ec71ef77a55848a0add75a6c104cc9a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:55:29.943280 18504 consensus_queue.cc:1048] T 4040b77ce4d34a34baf6e31e9364f07b P 95234c5b69eb4fe4a7558e56eedbe71a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 14:55:29.952675 18383 raft_consensus.cc:993] T 45dc6924b995473493ccf8d5b0ba3668 P ec71ef77a55848a0add75a6c104cc9a9: : Instructing follower 95234c5b69eb4fe4a7558e56eedbe71a to start an election
I20260709 14:55:29.953292 18383 raft_consensus.cc:1081] T 45dc6924b995473493ccf8d5b0ba3668 P ec71ef77a55848a0add75a6c104cc9a9 [term 1 LEADER]: Signalling peer 95234c5b69eb4fe4a7558e56eedbe71a to start an election
I20260709 14:55:29.955739 18238 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "45dc6924b995473493ccf8d5b0ba3668"
dest_uuid: "95234c5b69eb4fe4a7558e56eedbe71a"
 from {username='slave'} at 127.0.0.1:60378
I20260709 14:55:29.956490 18238 raft_consensus.cc:493] T 45dc6924b995473493ccf8d5b0ba3668 P 95234c5b69eb4fe4a7558e56eedbe71a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:55:29.956925 18238 raft_consensus.cc:3060] T 45dc6924b995473493ccf8d5b0ba3668 P 95234c5b69eb4fe4a7558e56eedbe71a [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:55:29.962180 18504 consensus_queue.cc:1048] T 8885f7ee722545ff8d091567e7f09d69 P 95234c5b69eb4fe4a7558e56eedbe71a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:55:29.965142 18504 consensus_queue.cc:1048] T 8885f7ee722545ff8d091567e7f09d69 P 95234c5b69eb4fe4a7558e56eedbe71a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 14:55:29.968473 18238 raft_consensus.cc:515] T 45dc6924b995473493ccf8d5b0ba3668 P 95234c5b69eb4fe4a7558e56eedbe71a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:29.969493 18493 consensus_queue.cc:1048] T 03cb02cb11914a5db0023952fc210283 P f75b4aa933fd4b8c82ea07567024882c [LEADER]: Connected to new peer: Peer: permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:55:29.974004 18487 raft_consensus.cc:993] T 4040b77ce4d34a34baf6e31e9364f07b P 95234c5b69eb4fe4a7558e56eedbe71a: : Instructing follower f75b4aa933fd4b8c82ea07567024882c to start an election
I20260709 14:55:29.975023 18487 raft_consensus.cc:1081] T 4040b77ce4d34a34baf6e31e9364f07b P 95234c5b69eb4fe4a7558e56eedbe71a [term 1 LEADER]: Signalling peer f75b4aa933fd4b8c82ea07567024882c to start an election
I20260709 14:55:29.978776 18238 leader_election.cc:290] T 45dc6924b995473493ccf8d5b0ba3668 P 95234c5b69eb4fe4a7558e56eedbe71a [CANDIDATE]: Term 2 election: Requested vote from peers f75b4aa933fd4b8c82ea07567024882c (127.6.101.65:40449), ec71ef77a55848a0add75a6c104cc9a9 (127.6.101.67:42661)
I20260709 14:55:29.995113 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dc6924b995473493ccf8d5b0ba3668" candidate_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ec71ef77a55848a0add75a6c104cc9a9"
I20260709 14:55:29.995882 18310 raft_consensus.cc:3055] T 45dc6924b995473493ccf8d5b0ba3668 P ec71ef77a55848a0add75a6c104cc9a9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 14:55:29.996206 18310 raft_consensus.cc:740] T 45dc6924b995473493ccf8d5b0ba3668 P ec71ef77a55848a0add75a6c104cc9a9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ec71ef77a55848a0add75a6c104cc9a9, State: Running, Role: LEADER
I20260709 14:55:29.997059 18310 consensus_queue.cc:260] T 45dc6924b995473493ccf8d5b0ba3668 P ec71ef77a55848a0add75a6c104cc9a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:29.998553 18310 raft_consensus.cc:3060] T 45dc6924b995473493ccf8d5b0ba3668 P ec71ef77a55848a0add75a6c104cc9a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:55:30.001199 18160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dc6924b995473493ccf8d5b0ba3668" candidate_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f75b4aa933fd4b8c82ea07567024882c"
I20260709 14:55:30.002079 18160 raft_consensus.cc:3060] T 45dc6924b995473493ccf8d5b0ba3668 P f75b4aa933fd4b8c82ea07567024882c [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:55:30.011062 18493 raft_consensus.cc:993] T 03cb02cb11914a5db0023952fc210283 P f75b4aa933fd4b8c82ea07567024882c: : Instructing follower 95234c5b69eb4fe4a7558e56eedbe71a to start an election
I20260709 14:55:30.011819 18493 raft_consensus.cc:1081] T 03cb02cb11914a5db0023952fc210283 P f75b4aa933fd4b8c82ea07567024882c [term 1 LEADER]: Signalling peer 95234c5b69eb4fe4a7558e56eedbe71a to start an election
I20260709 14:55:30.012650 18163 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4040b77ce4d34a34baf6e31e9364f07b"
dest_uuid: "f75b4aa933fd4b8c82ea07567024882c"
 from {username='slave'} at 127.0.0.1:55806
I20260709 14:55:30.013532 18163 raft_consensus.cc:493] T 4040b77ce4d34a34baf6e31e9364f07b P f75b4aa933fd4b8c82ea07567024882c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:55:30.013988 18163 raft_consensus.cc:3060] T 4040b77ce4d34a34baf6e31e9364f07b P f75b4aa933fd4b8c82ea07567024882c [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:55:30.014439 18160 raft_consensus.cc:2468] T 45dc6924b995473493ccf8d5b0ba3668 P f75b4aa933fd4b8c82ea07567024882c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95234c5b69eb4fe4a7558e56eedbe71a in term 2.
I20260709 14:55:30.020661 18496 consensus_queue.cc:1048] T 03cb02cb11914a5db0023952fc210283 P f75b4aa933fd4b8c82ea07567024882c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 14:55:30.022640 18310 raft_consensus.cc:2468] T 45dc6924b995473493ccf8d5b0ba3668 P ec71ef77a55848a0add75a6c104cc9a9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95234c5b69eb4fe4a7558e56eedbe71a in term 2.
I20260709 14:55:30.024091 18163 raft_consensus.cc:515] T 4040b77ce4d34a34baf6e31e9364f07b P f75b4aa933fd4b8c82ea07567024882c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:30.026528 18238 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "03cb02cb11914a5db0023952fc210283"
dest_uuid: "95234c5b69eb4fe4a7558e56eedbe71a"
 from {username='slave'} at 127.0.0.1:60384
I20260709 14:55:30.027274 18163 leader_election.cc:290] T 4040b77ce4d34a34baf6e31e9364f07b P f75b4aa933fd4b8c82ea07567024882c [CANDIDATE]: Term 2 election: Requested vote from peers 95234c5b69eb4fe4a7558e56eedbe71a (127.6.101.66:42897), ec71ef77a55848a0add75a6c104cc9a9 (127.6.101.67:42661)
I20260709 14:55:30.030587 18202 leader_election.cc:304] T 45dc6924b995473493ccf8d5b0ba3668 P 95234c5b69eb4fe4a7558e56eedbe71a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95234c5b69eb4fe4a7558e56eedbe71a, f75b4aa933fd4b8c82ea07567024882c; no voters: 
I20260709 14:55:30.031885 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4040b77ce4d34a34baf6e31e9364f07b" candidate_uuid: "f75b4aa933fd4b8c82ea07567024882c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ec71ef77a55848a0add75a6c104cc9a9"
I20260709 14:55:30.032931 18309 raft_consensus.cc:3060] T 4040b77ce4d34a34baf6e31e9364f07b P ec71ef77a55848a0add75a6c104cc9a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:55:30.033095 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4040b77ce4d34a34baf6e31e9364f07b" candidate_uuid: "f75b4aa933fd4b8c82ea07567024882c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "95234c5b69eb4fe4a7558e56eedbe71a"
I20260709 14:55:30.033916 18236 raft_consensus.cc:3055] T 4040b77ce4d34a34baf6e31e9364f07b P 95234c5b69eb4fe4a7558e56eedbe71a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 14:55:30.034237 18236 raft_consensus.cc:740] T 4040b77ce4d34a34baf6e31e9364f07b P 95234c5b69eb4fe4a7558e56eedbe71a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 95234c5b69eb4fe4a7558e56eedbe71a, State: Running, Role: LEADER
I20260709 14:55:30.035212 18236 consensus_queue.cc:260] T 4040b77ce4d34a34baf6e31e9364f07b P 95234c5b69eb4fe4a7558e56eedbe71a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:30.037638 18497 raft_consensus.cc:2804] T 45dc6924b995473493ccf8d5b0ba3668 P 95234c5b69eb4fe4a7558e56eedbe71a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:55:30.038375 18497 raft_consensus.cc:697] T 45dc6924b995473493ccf8d5b0ba3668 P 95234c5b69eb4fe4a7558e56eedbe71a [term 2 LEADER]: Becoming Leader. State: Replica: 95234c5b69eb4fe4a7558e56eedbe71a, State: Running, Role: LEADER
I20260709 14:55:30.039304 18497 consensus_queue.cc:237] T 45dc6924b995473493ccf8d5b0ba3668 P 95234c5b69eb4fe4a7558e56eedbe71a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:30.043363 18504 consensus_queue.cc:1048] T e416808f5061489aa8191b18817678d0 P 95234c5b69eb4fe4a7558e56eedbe71a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 14:55:30.050676 18238 raft_consensus.cc:493] T 03cb02cb11914a5db0023952fc210283 P 95234c5b69eb4fe4a7558e56eedbe71a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:55:30.051380 18238 raft_consensus.cc:3060] T 03cb02cb11914a5db0023952fc210283 P 95234c5b69eb4fe4a7558e56eedbe71a [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:55:30.037220 18236 raft_consensus.cc:3060] T 4040b77ce4d34a34baf6e31e9364f07b P 95234c5b69eb4fe4a7558e56eedbe71a [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:55:30.063234 18238 raft_consensus.cc:515] T 03cb02cb11914a5db0023952fc210283 P 95234c5b69eb4fe4a7558e56eedbe71a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:30.063320 18059 catalog_manager.cc:5697] T 45dc6924b995473493ccf8d5b0ba3668 P 95234c5b69eb4fe4a7558e56eedbe71a reported cstate change: term changed from 1 to 2, leader changed from ec71ef77a55848a0add75a6c104cc9a9 (127.6.101.67) to 95234c5b69eb4fe4a7558e56eedbe71a (127.6.101.66). New cstate: current_term: 2 leader_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } health_report { overall_health: UNKNOWN } } }
I20260709 14:55:30.068962 18160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03cb02cb11914a5db0023952fc210283" candidate_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f75b4aa933fd4b8c82ea07567024882c"
I20260709 14:55:30.069938 18160 raft_consensus.cc:3055] T 03cb02cb11914a5db0023952fc210283 P f75b4aa933fd4b8c82ea07567024882c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 14:55:30.070417 18160 raft_consensus.cc:740] T 03cb02cb11914a5db0023952fc210283 P f75b4aa933fd4b8c82ea07567024882c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f75b4aa933fd4b8c82ea07567024882c, State: Running, Role: LEADER
I20260709 14:55:30.071283 18160 consensus_queue.cc:260] T 03cb02cb11914a5db0023952fc210283 P f75b4aa933fd4b8c82ea07567024882c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:30.072351 18160 raft_consensus.cc:3060] T 03cb02cb11914a5db0023952fc210283 P f75b4aa933fd4b8c82ea07567024882c [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:55:30.072500 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03cb02cb11914a5db0023952fc210283" candidate_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ec71ef77a55848a0add75a6c104cc9a9"
I20260709 14:55:30.074306 18238 leader_election.cc:290] T 03cb02cb11914a5db0023952fc210283 P 95234c5b69eb4fe4a7558e56eedbe71a [CANDIDATE]: Term 2 election: Requested vote from peers f75b4aa933fd4b8c82ea07567024882c (127.6.101.65:40449), ec71ef77a55848a0add75a6c104cc9a9 (127.6.101.67:42661)
I20260709 14:55:30.078821 18497 consensus_queue.cc:1048] T 744d4bd8bf6440d78510bd3a8b14481c P 95234c5b69eb4fe4a7558e56eedbe71a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 14:55:30.089990 18236 raft_consensus.cc:2468] T 4040b77ce4d34a34baf6e31e9364f07b P 95234c5b69eb4fe4a7558e56eedbe71a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f75b4aa933fd4b8c82ea07567024882c in term 2.
I20260709 14:55:30.091055 18309 raft_consensus.cc:2468] T 4040b77ce4d34a34baf6e31e9364f07b P ec71ef77a55848a0add75a6c104cc9a9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f75b4aa933fd4b8c82ea07567024882c in term 2.
I20260709 14:55:30.091504 18129 leader_election.cc:304] T 4040b77ce4d34a34baf6e31e9364f07b P f75b4aa933fd4b8c82ea07567024882c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95234c5b69eb4fe4a7558e56eedbe71a, f75b4aa933fd4b8c82ea07567024882c; no voters: 
I20260709 14:55:30.091820 18160 raft_consensus.cc:2468] T 03cb02cb11914a5db0023952fc210283 P f75b4aa933fd4b8c82ea07567024882c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95234c5b69eb4fe4a7558e56eedbe71a in term 2.
I20260709 14:55:30.092478 18496 raft_consensus.cc:2804] T 4040b77ce4d34a34baf6e31e9364f07b P f75b4aa933fd4b8c82ea07567024882c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:55:30.093142 18496 raft_consensus.cc:697] T 4040b77ce4d34a34baf6e31e9364f07b P f75b4aa933fd4b8c82ea07567024882c [term 2 LEADER]: Becoming Leader. State: Replica: f75b4aa933fd4b8c82ea07567024882c, State: Running, Role: LEADER
I20260709 14:55:30.094331 18496 consensus_queue.cc:237] T 4040b77ce4d34a34baf6e31e9364f07b P f75b4aa933fd4b8c82ea07567024882c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:30.097915 18202 leader_election.cc:304] T 03cb02cb11914a5db0023952fc210283 P 95234c5b69eb4fe4a7558e56eedbe71a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95234c5b69eb4fe4a7558e56eedbe71a, f75b4aa933fd4b8c82ea07567024882c; no voters: ec71ef77a55848a0add75a6c104cc9a9
I20260709 14:55:30.101683 18503 raft_consensus.cc:2804] T 03cb02cb11914a5db0023952fc210283 P 95234c5b69eb4fe4a7558e56eedbe71a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:55:30.102272 18503 raft_consensus.cc:697] T 03cb02cb11914a5db0023952fc210283 P 95234c5b69eb4fe4a7558e56eedbe71a [term 2 LEADER]: Becoming Leader. State: Replica: 95234c5b69eb4fe4a7558e56eedbe71a, State: Running, Role: LEADER
I20260709 14:55:30.103297 18503 consensus_queue.cc:237] T 03cb02cb11914a5db0023952fc210283 P 95234c5b69eb4fe4a7558e56eedbe71a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:30.109632 18465 consensus_queue.cc:1048] T e416808f5061489aa8191b18817678d0 P 95234c5b69eb4fe4a7558e56eedbe71a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:55:30.121807 18487 consensus_queue.cc:1048] T 744d4bd8bf6440d78510bd3a8b14481c P 95234c5b69eb4fe4a7558e56eedbe71a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:55:30.130905 18059 catalog_manager.cc:5697] T 03cb02cb11914a5db0023952fc210283 P 95234c5b69eb4fe4a7558e56eedbe71a reported cstate change: term changed from 1 to 2, leader changed from f75b4aa933fd4b8c82ea07567024882c (127.6.101.65) to 95234c5b69eb4fe4a7558e56eedbe71a (127.6.101.66). New cstate: current_term: 2 leader_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } health_report { overall_health: UNKNOWN } } }
I20260709 14:55:30.135429 18060 catalog_manager.cc:5697] T 4040b77ce4d34a34baf6e31e9364f07b P f75b4aa933fd4b8c82ea07567024882c reported cstate change: term changed from 1 to 2, leader changed from 95234c5b69eb4fe4a7558e56eedbe71a (127.6.101.66) to f75b4aa933fd4b8c82ea07567024882c (127.6.101.65). New cstate: current_term: 2 leader_uuid: "f75b4aa933fd4b8c82ea07567024882c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } health_report { overall_health: UNKNOWN } } }
I20260709 14:55:30.144402 18487 raft_consensus.cc:993] T e416808f5061489aa8191b18817678d0 P 95234c5b69eb4fe4a7558e56eedbe71a: : Instructing follower f75b4aa933fd4b8c82ea07567024882c to start an election
I20260709 14:55:30.145025 18487 raft_consensus.cc:1081] T e416808f5061489aa8191b18817678d0 P 95234c5b69eb4fe4a7558e56eedbe71a [term 1 LEADER]: Signalling peer f75b4aa933fd4b8c82ea07567024882c to start an election
I20260709 14:55:30.147415 18163 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e416808f5061489aa8191b18817678d0"
dest_uuid: "f75b4aa933fd4b8c82ea07567024882c"
 from {username='slave'} at 127.0.0.1:55806
I20260709 14:55:30.148121 18163 raft_consensus.cc:493] T e416808f5061489aa8191b18817678d0 P f75b4aa933fd4b8c82ea07567024882c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:55:30.148375 18163 raft_consensus.cc:3060] T e416808f5061489aa8191b18817678d0 P f75b4aa933fd4b8c82ea07567024882c [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:55:30.152711 18503 raft_consensus.cc:993] T 744d4bd8bf6440d78510bd3a8b14481c P 95234c5b69eb4fe4a7558e56eedbe71a: : Instructing follower ec71ef77a55848a0add75a6c104cc9a9 to start an election
I20260709 14:55:30.153452 18504 raft_consensus.cc:1081] T 744d4bd8bf6440d78510bd3a8b14481c P 95234c5b69eb4fe4a7558e56eedbe71a [term 1 LEADER]: Signalling peer ec71ef77a55848a0add75a6c104cc9a9 to start an election
I20260709 14:55:30.155407 18310 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "744d4bd8bf6440d78510bd3a8b14481c"
dest_uuid: "ec71ef77a55848a0add75a6c104cc9a9"
 from {username='slave'} at 127.0.0.1:52786
I20260709 14:55:30.156104 18310 raft_consensus.cc:493] T 744d4bd8bf6440d78510bd3a8b14481c P ec71ef77a55848a0add75a6c104cc9a9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:55:30.156492 18310 raft_consensus.cc:3060] T 744d4bd8bf6440d78510bd3a8b14481c P ec71ef77a55848a0add75a6c104cc9a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:55:30.169034 18310 raft_consensus.cc:515] T 744d4bd8bf6440d78510bd3a8b14481c P ec71ef77a55848a0add75a6c104cc9a9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:30.171821 18310 leader_election.cc:290] T 744d4bd8bf6440d78510bd3a8b14481c P ec71ef77a55848a0add75a6c104cc9a9 [CANDIDATE]: Term 2 election: Requested vote from peers f75b4aa933fd4b8c82ea07567024882c (127.6.101.65:40449), 95234c5b69eb4fe4a7558e56eedbe71a (127.6.101.66:42897)
I20260709 14:55:30.172914 18161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "744d4bd8bf6440d78510bd3a8b14481c" candidate_uuid: "ec71ef77a55848a0add75a6c104cc9a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f75b4aa933fd4b8c82ea07567024882c"
I20260709 14:55:30.173713 18161 raft_consensus.cc:3060] T 744d4bd8bf6440d78510bd3a8b14481c P f75b4aa933fd4b8c82ea07567024882c [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:55:30.174750 18163 raft_consensus.cc:515] T e416808f5061489aa8191b18817678d0 P f75b4aa933fd4b8c82ea07567024882c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:30.175522 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "744d4bd8bf6440d78510bd3a8b14481c" candidate_uuid: "ec71ef77a55848a0add75a6c104cc9a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "95234c5b69eb4fe4a7558e56eedbe71a"
I20260709 14:55:30.176352 18236 raft_consensus.cc:3055] T 744d4bd8bf6440d78510bd3a8b14481c P 95234c5b69eb4fe4a7558e56eedbe71a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 14:55:30.176714 18236 raft_consensus.cc:740] T 744d4bd8bf6440d78510bd3a8b14481c P 95234c5b69eb4fe4a7558e56eedbe71a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 95234c5b69eb4fe4a7558e56eedbe71a, State: Running, Role: LEADER
I20260709 14:55:30.177609 18236 consensus_queue.cc:260] T 744d4bd8bf6440d78510bd3a8b14481c P 95234c5b69eb4fe4a7558e56eedbe71a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:30.178072 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e416808f5061489aa8191b18817678d0" candidate_uuid: "f75b4aa933fd4b8c82ea07567024882c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "95234c5b69eb4fe4a7558e56eedbe71a"
I20260709 14:55:30.178886 18237 raft_consensus.cc:3055] T e416808f5061489aa8191b18817678d0 P 95234c5b69eb4fe4a7558e56eedbe71a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 14:55:30.179214 18237 raft_consensus.cc:740] T e416808f5061489aa8191b18817678d0 P 95234c5b69eb4fe4a7558e56eedbe71a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 95234c5b69eb4fe4a7558e56eedbe71a, State: Running, Role: LEADER
I20260709 14:55:30.180095 18237 consensus_queue.cc:260] T e416808f5061489aa8191b18817678d0 P 95234c5b69eb4fe4a7558e56eedbe71a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:30.179347 18236 raft_consensus.cc:3060] T 744d4bd8bf6440d78510bd3a8b14481c P 95234c5b69eb4fe4a7558e56eedbe71a [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:55:30.181865 18237 raft_consensus.cc:3060] T e416808f5061489aa8191b18817678d0 P 95234c5b69eb4fe4a7558e56eedbe71a [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:55:30.182338 18161 raft_consensus.cc:2468] T 744d4bd8bf6440d78510bd3a8b14481c P f75b4aa933fd4b8c82ea07567024882c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec71ef77a55848a0add75a6c104cc9a9 in term 2.
I20260709 14:55:30.184085 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e416808f5061489aa8191b18817678d0" candidate_uuid: "f75b4aa933fd4b8c82ea07567024882c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ec71ef77a55848a0add75a6c104cc9a9"
I20260709 14:55:30.184878 18310 raft_consensus.cc:3060] T e416808f5061489aa8191b18817678d0 P ec71ef77a55848a0add75a6c104cc9a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:55:30.182565 18163 leader_election.cc:290] T e416808f5061489aa8191b18817678d0 P f75b4aa933fd4b8c82ea07567024882c [CANDIDATE]: Term 2 election: Requested vote from peers 95234c5b69eb4fe4a7558e56eedbe71a (127.6.101.66:42897), ec71ef77a55848a0add75a6c104cc9a9 (127.6.101.67:42661)
I20260709 14:55:30.193723 18236 raft_consensus.cc:2468] T 744d4bd8bf6440d78510bd3a8b14481c P 95234c5b69eb4fe4a7558e56eedbe71a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec71ef77a55848a0add75a6c104cc9a9 in term 2.
I20260709 14:55:30.193903 18237 raft_consensus.cc:2468] T e416808f5061489aa8191b18817678d0 P 95234c5b69eb4fe4a7558e56eedbe71a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f75b4aa933fd4b8c82ea07567024882c in term 2.
I20260709 14:55:30.195351 18487 raft_consensus.cc:993] T 84b1a73cbc1e4c56a0a733d2cdacc300 P 95234c5b69eb4fe4a7558e56eedbe71a: : Instructing follower f75b4aa933fd4b8c82ea07567024882c to start an election
I20260709 14:55:30.195564 18276 leader_election.cc:304] T 744d4bd8bf6440d78510bd3a8b14481c P ec71ef77a55848a0add75a6c104cc9a9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ec71ef77a55848a0add75a6c104cc9a9, f75b4aa933fd4b8c82ea07567024882c; no voters: 
I20260709 14:55:30.196115 18497 raft_consensus.cc:1081] T 84b1a73cbc1e4c56a0a733d2cdacc300 P 95234c5b69eb4fe4a7558e56eedbe71a [term 1 LEADER]: Signalling peer f75b4aa933fd4b8c82ea07567024882c to start an election
I20260709 14:55:30.196683 18471 raft_consensus.cc:2804] T 744d4bd8bf6440d78510bd3a8b14481c P ec71ef77a55848a0add75a6c104cc9a9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:55:30.197194 18471 raft_consensus.cc:697] T 744d4bd8bf6440d78510bd3a8b14481c P ec71ef77a55848a0add75a6c104cc9a9 [term 2 LEADER]: Becoming Leader. State: Replica: ec71ef77a55848a0add75a6c104cc9a9, State: Running, Role: LEADER
I20260709 14:55:30.198271 18129 leader_election.cc:304] T e416808f5061489aa8191b18817678d0 P f75b4aa933fd4b8c82ea07567024882c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95234c5b69eb4fe4a7558e56eedbe71a, f75b4aa933fd4b8c82ea07567024882c; no voters: 
I20260709 14:55:30.198092 18471 consensus_queue.cc:237] T 744d4bd8bf6440d78510bd3a8b14481c P ec71ef77a55848a0add75a6c104cc9a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:30.199306 18496 raft_consensus.cc:2804] T e416808f5061489aa8191b18817678d0 P f75b4aa933fd4b8c82ea07567024882c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:55:30.199918 18496 raft_consensus.cc:697] T e416808f5061489aa8191b18817678d0 P f75b4aa933fd4b8c82ea07567024882c [term 2 LEADER]: Becoming Leader. State: Replica: f75b4aa933fd4b8c82ea07567024882c, State: Running, Role: LEADER
I20260709 14:55:30.200083 18310 raft_consensus.cc:2468] T e416808f5061489aa8191b18817678d0 P ec71ef77a55848a0add75a6c104cc9a9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f75b4aa933fd4b8c82ea07567024882c in term 2.
I20260709 14:55:30.200898 18496 consensus_queue.cc:237] T e416808f5061489aa8191b18817678d0 P f75b4aa933fd4b8c82ea07567024882c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:30.201478 18163 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "84b1a73cbc1e4c56a0a733d2cdacc300"
dest_uuid: "f75b4aa933fd4b8c82ea07567024882c"
 from {username='slave'} at 127.0.0.1:55806
I20260709 14:55:30.202458 18163 raft_consensus.cc:493] T 84b1a73cbc1e4c56a0a733d2cdacc300 P f75b4aa933fd4b8c82ea07567024882c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:55:30.202934 18163 raft_consensus.cc:3060] T 84b1a73cbc1e4c56a0a733d2cdacc300 P f75b4aa933fd4b8c82ea07567024882c [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:55:30.208776 18060 catalog_manager.cc:5697] T 744d4bd8bf6440d78510bd3a8b14481c P ec71ef77a55848a0add75a6c104cc9a9 reported cstate change: term changed from 1 to 2, leader changed from 95234c5b69eb4fe4a7558e56eedbe71a (127.6.101.66) to ec71ef77a55848a0add75a6c104cc9a9 (127.6.101.67). New cstate: current_term: 2 leader_uuid: "ec71ef77a55848a0add75a6c104cc9a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } health_report { overall_health: HEALTHY } } }
I20260709 14:55:30.212349 18059 catalog_manager.cc:5697] T e416808f5061489aa8191b18817678d0 P f75b4aa933fd4b8c82ea07567024882c reported cstate change: term changed from 1 to 2, leader changed from 95234c5b69eb4fe4a7558e56eedbe71a (127.6.101.66) to f75b4aa933fd4b8c82ea07567024882c (127.6.101.65). New cstate: current_term: 2 leader_uuid: "f75b4aa933fd4b8c82ea07567024882c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } health_report { overall_health: UNKNOWN } } }
I20260709 14:55:30.212961 18163 raft_consensus.cc:515] T 84b1a73cbc1e4c56a0a733d2cdacc300 P f75b4aa933fd4b8c82ea07567024882c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:30.220857 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84b1a73cbc1e4c56a0a733d2cdacc300" candidate_uuid: "f75b4aa933fd4b8c82ea07567024882c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "95234c5b69eb4fe4a7558e56eedbe71a"
I20260709 14:55:30.221756 18236 raft_consensus.cc:3055] T 84b1a73cbc1e4c56a0a733d2cdacc300 P 95234c5b69eb4fe4a7558e56eedbe71a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 14:55:30.222323 18236 raft_consensus.cc:740] T 84b1a73cbc1e4c56a0a733d2cdacc300 P 95234c5b69eb4fe4a7558e56eedbe71a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 95234c5b69eb4fe4a7558e56eedbe71a, State: Running, Role: LEADER
I20260709 14:55:30.223392 18236 consensus_queue.cc:260] T 84b1a73cbc1e4c56a0a733d2cdacc300 P 95234c5b69eb4fe4a7558e56eedbe71a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:30.225051 18236 raft_consensus.cc:3060] T 84b1a73cbc1e4c56a0a733d2cdacc300 P 95234c5b69eb4fe4a7558e56eedbe71a [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:55:30.230063 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84b1a73cbc1e4c56a0a733d2cdacc300" candidate_uuid: "f75b4aa933fd4b8c82ea07567024882c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ec71ef77a55848a0add75a6c104cc9a9"
I20260709 14:55:30.230293 18163 leader_election.cc:290] T 84b1a73cbc1e4c56a0a733d2cdacc300 P f75b4aa933fd4b8c82ea07567024882c [CANDIDATE]: Term 2 election: Requested vote from peers 95234c5b69eb4fe4a7558e56eedbe71a (127.6.101.66:42897), ec71ef77a55848a0add75a6c104cc9a9 (127.6.101.67:42661)
I20260709 14:55:30.230798 18310 raft_consensus.cc:3060] T 84b1a73cbc1e4c56a0a733d2cdacc300 P ec71ef77a55848a0add75a6c104cc9a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:55:30.234575 18236 raft_consensus.cc:2468] T 84b1a73cbc1e4c56a0a733d2cdacc300 P 95234c5b69eb4fe4a7558e56eedbe71a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f75b4aa933fd4b8c82ea07567024882c in term 2.
I20260709 14:55:30.236183 18129 leader_election.cc:304] T 84b1a73cbc1e4c56a0a733d2cdacc300 P f75b4aa933fd4b8c82ea07567024882c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95234c5b69eb4fe4a7558e56eedbe71a, f75b4aa933fd4b8c82ea07567024882c; no voters: 
I20260709 14:55:30.237036 18496 raft_consensus.cc:2804] T 84b1a73cbc1e4c56a0a733d2cdacc300 P f75b4aa933fd4b8c82ea07567024882c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:55:30.237352 18310 raft_consensus.cc:2468] T 84b1a73cbc1e4c56a0a733d2cdacc300 P ec71ef77a55848a0add75a6c104cc9a9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f75b4aa933fd4b8c82ea07567024882c in term 2.
I20260709 14:55:30.237644 18496 raft_consensus.cc:697] T 84b1a73cbc1e4c56a0a733d2cdacc300 P f75b4aa933fd4b8c82ea07567024882c [term 2 LEADER]: Becoming Leader. State: Replica: f75b4aa933fd4b8c82ea07567024882c, State: Running, Role: LEADER
I20260709 14:55:30.239349 18496 consensus_queue.cc:237] T 84b1a73cbc1e4c56a0a733d2cdacc300 P f75b4aa933fd4b8c82ea07567024882c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:30.247689 18060 catalog_manager.cc:5697] T 84b1a73cbc1e4c56a0a733d2cdacc300 P f75b4aa933fd4b8c82ea07567024882c reported cstate change: term changed from 1 to 2, leader changed from 95234c5b69eb4fe4a7558e56eedbe71a (127.6.101.66) to f75b4aa933fd4b8c82ea07567024882c (127.6.101.65). New cstate: current_term: 2 leader_uuid: "f75b4aa933fd4b8c82ea07567024882c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } health_report { overall_health: UNKNOWN } } }
I20260709 14:55:30.496456 18310 raft_consensus.cc:1275] T 45dc6924b995473493ccf8d5b0ba3668 P ec71ef77a55848a0add75a6c104cc9a9 [term 2 FOLLOWER]: Refusing update from remote peer 95234c5b69eb4fe4a7558e56eedbe71a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:55:30.498382 18497 consensus_queue.cc:1048] T 45dc6924b995473493ccf8d5b0ba3668 P 95234c5b69eb4fe4a7558e56eedbe71a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 14:55:30.507725 18163 raft_consensus.cc:1275] T 45dc6924b995473493ccf8d5b0ba3668 P f75b4aa933fd4b8c82ea07567024882c [term 2 FOLLOWER]: Refusing update from remote peer 95234c5b69eb4fe4a7558e56eedbe71a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:55:30.510916 18310 raft_consensus.cc:1275] T 4040b77ce4d34a34baf6e31e9364f07b P ec71ef77a55848a0add75a6c104cc9a9 [term 2 FOLLOWER]: Refusing update from remote peer f75b4aa933fd4b8c82ea07567024882c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:55:30.511256 18497 consensus_queue.cc:1048] T 45dc6924b995473493ccf8d5b0ba3668 P 95234c5b69eb4fe4a7558e56eedbe71a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 14:55:30.513618 18493 consensus_queue.cc:1048] T 4040b77ce4d34a34baf6e31e9364f07b P f75b4aa933fd4b8c82ea07567024882c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 14:55:30.516180 18236 raft_consensus.cc:1275] T 4040b77ce4d34a34baf6e31e9364f07b P 95234c5b69eb4fe4a7558e56eedbe71a [term 2 FOLLOWER]: Refusing update from remote peer f75b4aa933fd4b8c82ea07567024882c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:55:30.518371 18493 consensus_queue.cc:1048] T 4040b77ce4d34a34baf6e31e9364f07b P f75b4aa933fd4b8c82ea07567024882c [LEADER]: Connected to new peer: Peer: permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 14:55:30.576352 18161 raft_consensus.cc:1275] T 03cb02cb11914a5db0023952fc210283 P f75b4aa933fd4b8c82ea07567024882c [term 2 FOLLOWER]: Refusing update from remote peer 95234c5b69eb4fe4a7558e56eedbe71a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:55:30.578337 18497 consensus_queue.cc:1048] T 03cb02cb11914a5db0023952fc210283 P 95234c5b69eb4fe4a7558e56eedbe71a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 14:55:30.587735 18310 raft_consensus.cc:3060] T 03cb02cb11914a5db0023952fc210283 P ec71ef77a55848a0add75a6c104cc9a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:55:30.596093 18310 raft_consensus.cc:1275] T 03cb02cb11914a5db0023952fc210283 P ec71ef77a55848a0add75a6c104cc9a9 [term 2 FOLLOWER]: Refusing update from remote peer 95234c5b69eb4fe4a7558e56eedbe71a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:55:30.597723 18497 consensus_queue.cc:1048] T 03cb02cb11914a5db0023952fc210283 P 95234c5b69eb4fe4a7558e56eedbe71a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 14:55:30.625339 18310 raft_consensus.cc:1275] T e416808f5061489aa8191b18817678d0 P ec71ef77a55848a0add75a6c104cc9a9 [term 2 FOLLOWER]: Refusing update from remote peer f75b4aa933fd4b8c82ea07567024882c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:55:30.627274 18493 consensus_queue.cc:1048] T e416808f5061489aa8191b18817678d0 P f75b4aa933fd4b8c82ea07567024882c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 14:55:30.637007 18236 raft_consensus.cc:1275] T e416808f5061489aa8191b18817678d0 P 95234c5b69eb4fe4a7558e56eedbe71a [term 2 FOLLOWER]: Refusing update from remote peer f75b4aa933fd4b8c82ea07567024882c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:55:30.639995 18493 consensus_queue.cc:1048] T e416808f5061489aa8191b18817678d0 P f75b4aa933fd4b8c82ea07567024882c [LEADER]: Connected to new peer: Peer: permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 14:55:30.728526 18236 raft_consensus.cc:1275] T 744d4bd8bf6440d78510bd3a8b14481c P 95234c5b69eb4fe4a7558e56eedbe71a [term 2 FOLLOWER]: Refusing update from remote peer ec71ef77a55848a0add75a6c104cc9a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:55:30.730867 18471 consensus_queue.cc:1048] T 744d4bd8bf6440d78510bd3a8b14481c P ec71ef77a55848a0add75a6c104cc9a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 14:55:30.742748 18161 raft_consensus.cc:1275] T 744d4bd8bf6440d78510bd3a8b14481c P f75b4aa933fd4b8c82ea07567024882c [term 2 FOLLOWER]: Refusing update from remote peer ec71ef77a55848a0add75a6c104cc9a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:55:30.745106 18536 consensus_queue.cc:1048] T 744d4bd8bf6440d78510bd3a8b14481c P ec71ef77a55848a0add75a6c104cc9a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 14:55:30.778200 18310 raft_consensus.cc:1275] T 84b1a73cbc1e4c56a0a733d2cdacc300 P ec71ef77a55848a0add75a6c104cc9a9 [term 2 FOLLOWER]: Refusing update from remote peer f75b4aa933fd4b8c82ea07567024882c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:55:30.779677 18493 consensus_queue.cc:1048] T 84b1a73cbc1e4c56a0a733d2cdacc300 P f75b4aa933fd4b8c82ea07567024882c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 14:55:30.789618 18236 raft_consensus.cc:1275] T 84b1a73cbc1e4c56a0a733d2cdacc300 P 95234c5b69eb4fe4a7558e56eedbe71a [term 2 FOLLOWER]: Refusing update from remote peer f75b4aa933fd4b8c82ea07567024882c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 14:55:30.791610 18493 consensus_queue.cc:1048] T 84b1a73cbc1e4c56a0a733d2cdacc300 P f75b4aa933fd4b8c82ea07567024882c [LEADER]: Connected to new peer: Peer: permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 14:55:31.278638 18490 raft_consensus.cc:493] T 86887bfdd39840a4ac9a63d78fcf0c67 P f75b4aa933fd4b8c82ea07567024882c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:55:31.279330 18490 raft_consensus.cc:515] T 86887bfdd39840a4ac9a63d78fcf0c67 P f75b4aa933fd4b8c82ea07567024882c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:31.281342 18490 leader_election.cc:290] T 86887bfdd39840a4ac9a63d78fcf0c67 P f75b4aa933fd4b8c82ea07567024882c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95234c5b69eb4fe4a7558e56eedbe71a (127.6.101.66:42897), ec71ef77a55848a0add75a6c104cc9a9 (127.6.101.67:42661)
I20260709 14:55:31.282438 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86887bfdd39840a4ac9a63d78fcf0c67" candidate_uuid: "f75b4aa933fd4b8c82ea07567024882c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ec71ef77a55848a0add75a6c104cc9a9" is_pre_election: true
I20260709 14:55:31.282402 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86887bfdd39840a4ac9a63d78fcf0c67" candidate_uuid: "f75b4aa933fd4b8c82ea07567024882c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" is_pre_election: true
I20260709 14:55:31.284523 18127 leader_election.cc:304] T 86887bfdd39840a4ac9a63d78fcf0c67 P f75b4aa933fd4b8c82ea07567024882c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f75b4aa933fd4b8c82ea07567024882c; no voters: 95234c5b69eb4fe4a7558e56eedbe71a, ec71ef77a55848a0add75a6c104cc9a9
I20260709 14:55:31.285539 18490 raft_consensus.cc:2749] T 86887bfdd39840a4ac9a63d78fcf0c67 P f75b4aa933fd4b8c82ea07567024882c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 14:55:31.407169 18540 raft_consensus.cc:493] T 86887bfdd39840a4ac9a63d78fcf0c67 P ec71ef77a55848a0add75a6c104cc9a9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f75b4aa933fd4b8c82ea07567024882c)
I20260709 14:55:31.407886 18540 raft_consensus.cc:515] T 86887bfdd39840a4ac9a63d78fcf0c67 P ec71ef77a55848a0add75a6c104cc9a9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:31.410038 18540 leader_election.cc:290] T 86887bfdd39840a4ac9a63d78fcf0c67 P ec71ef77a55848a0add75a6c104cc9a9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f75b4aa933fd4b8c82ea07567024882c (127.6.101.65:40449), 95234c5b69eb4fe4a7558e56eedbe71a (127.6.101.66:42897)
I20260709 14:55:31.411055 18161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86887bfdd39840a4ac9a63d78fcf0c67" candidate_uuid: "ec71ef77a55848a0add75a6c104cc9a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f75b4aa933fd4b8c82ea07567024882c" is_pre_election: true
I20260709 14:55:31.411311 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86887bfdd39840a4ac9a63d78fcf0c67" candidate_uuid: "ec71ef77a55848a0add75a6c104cc9a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" is_pre_election: true
I20260709 14:55:31.411796 18161 raft_consensus.cc:2468] T 86887bfdd39840a4ac9a63d78fcf0c67 P f75b4aa933fd4b8c82ea07567024882c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec71ef77a55848a0add75a6c104cc9a9 in term 2.
I20260709 14:55:31.412153 18236 raft_consensus.cc:2393] T 86887bfdd39840a4ac9a63d78fcf0c67 P 95234c5b69eb4fe4a7558e56eedbe71a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ec71ef77a55848a0add75a6c104cc9a9 in current term 2: Already voted for candidate 95234c5b69eb4fe4a7558e56eedbe71a in this term.
I20260709 14:55:31.413530 18276 leader_election.cc:304] T 86887bfdd39840a4ac9a63d78fcf0c67 P ec71ef77a55848a0add75a6c104cc9a9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ec71ef77a55848a0add75a6c104cc9a9, f75b4aa933fd4b8c82ea07567024882c; no voters: 95234c5b69eb4fe4a7558e56eedbe71a
I20260709 14:55:31.414328 18540 raft_consensus.cc:2804] T 86887bfdd39840a4ac9a63d78fcf0c67 P ec71ef77a55848a0add75a6c104cc9a9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 14:55:31.414676 18540 raft_consensus.cc:493] T 86887bfdd39840a4ac9a63d78fcf0c67 P ec71ef77a55848a0add75a6c104cc9a9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f75b4aa933fd4b8c82ea07567024882c)
I20260709 14:55:31.415005 18540 raft_consensus.cc:3060] T 86887bfdd39840a4ac9a63d78fcf0c67 P ec71ef77a55848a0add75a6c104cc9a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 14:55:31.421466 18540 raft_consensus.cc:515] T 86887bfdd39840a4ac9a63d78fcf0c67 P ec71ef77a55848a0add75a6c104cc9a9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:31.423429 18540 leader_election.cc:290] T 86887bfdd39840a4ac9a63d78fcf0c67 P ec71ef77a55848a0add75a6c104cc9a9 [CANDIDATE]: Term 2 election: Requested vote from peers f75b4aa933fd4b8c82ea07567024882c (127.6.101.65:40449), 95234c5b69eb4fe4a7558e56eedbe71a (127.6.101.66:42897)
I20260709 14:55:31.424618 18161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86887bfdd39840a4ac9a63d78fcf0c67" candidate_uuid: "ec71ef77a55848a0add75a6c104cc9a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f75b4aa933fd4b8c82ea07567024882c"
I20260709 14:55:31.424719 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86887bfdd39840a4ac9a63d78fcf0c67" candidate_uuid: "ec71ef77a55848a0add75a6c104cc9a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95234c5b69eb4fe4a7558e56eedbe71a"
I20260709 14:55:31.425859 18236 raft_consensus.cc:2393] T 86887bfdd39840a4ac9a63d78fcf0c67 P 95234c5b69eb4fe4a7558e56eedbe71a [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ec71ef77a55848a0add75a6c104cc9a9 in current term 2: Already voted for candidate 95234c5b69eb4fe4a7558e56eedbe71a in this term.
I20260709 14:55:31.431906 18161 raft_consensus.cc:2468] T 86887bfdd39840a4ac9a63d78fcf0c67 P f75b4aa933fd4b8c82ea07567024882c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec71ef77a55848a0add75a6c104cc9a9 in term 2.
I20260709 14:55:31.433512 18276 leader_election.cc:304] T 86887bfdd39840a4ac9a63d78fcf0c67 P ec71ef77a55848a0add75a6c104cc9a9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ec71ef77a55848a0add75a6c104cc9a9, f75b4aa933fd4b8c82ea07567024882c; no voters: 95234c5b69eb4fe4a7558e56eedbe71a
I20260709 14:55:31.434420 18540 raft_consensus.cc:2804] T 86887bfdd39840a4ac9a63d78fcf0c67 P ec71ef77a55848a0add75a6c104cc9a9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 14:55:31.434964 18540 raft_consensus.cc:697] T 86887bfdd39840a4ac9a63d78fcf0c67 P ec71ef77a55848a0add75a6c104cc9a9 [term 2 LEADER]: Becoming Leader. State: Replica: ec71ef77a55848a0add75a6c104cc9a9, State: Running, Role: LEADER
I20260709 14:55:31.435726 18540 consensus_queue.cc:237] T 86887bfdd39840a4ac9a63d78fcf0c67 P ec71ef77a55848a0add75a6c104cc9a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:31.445959 18059 catalog_manager.cc:5697] T 86887bfdd39840a4ac9a63d78fcf0c67 P ec71ef77a55848a0add75a6c104cc9a9 reported cstate change: term changed from 1 to 2, leader changed from f75b4aa933fd4b8c82ea07567024882c (127.6.101.65) to ec71ef77a55848a0add75a6c104cc9a9 (127.6.101.67). New cstate: current_term: 2 leader_uuid: "ec71ef77a55848a0add75a6c104cc9a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } health_report { overall_health: HEALTHY } } }
I20260709 14:55:31.657620 18487 raft_consensus.cc:493] T 86887bfdd39840a4ac9a63d78fcf0c67 P 95234c5b69eb4fe4a7558e56eedbe71a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 14:55:31.658278 18487 raft_consensus.cc:515] T 86887bfdd39840a4ac9a63d78fcf0c67 P 95234c5b69eb4fe4a7558e56eedbe71a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:31.660199 18487 leader_election.cc:290] T 86887bfdd39840a4ac9a63d78fcf0c67 P 95234c5b69eb4fe4a7558e56eedbe71a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f75b4aa933fd4b8c82ea07567024882c (127.6.101.65:40449), ec71ef77a55848a0add75a6c104cc9a9 (127.6.101.67:42661)
I20260709 14:55:31.661084 18161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86887bfdd39840a4ac9a63d78fcf0c67" candidate_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f75b4aa933fd4b8c82ea07567024882c" is_pre_election: true
I20260709 14:55:31.661397 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86887bfdd39840a4ac9a63d78fcf0c67" candidate_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ec71ef77a55848a0add75a6c104cc9a9" is_pre_election: true
I20260709 14:55:31.661999 18161 raft_consensus.cc:2468] T 86887bfdd39840a4ac9a63d78fcf0c67 P f75b4aa933fd4b8c82ea07567024882c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95234c5b69eb4fe4a7558e56eedbe71a in term 2.
I20260709 14:55:31.663334 18202 leader_election.cc:304] T 86887bfdd39840a4ac9a63d78fcf0c67 P 95234c5b69eb4fe4a7558e56eedbe71a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95234c5b69eb4fe4a7558e56eedbe71a, f75b4aa933fd4b8c82ea07567024882c; no voters: ec71ef77a55848a0add75a6c104cc9a9
I20260709 14:55:31.664062 18487 raft_consensus.cc:2804] T 86887bfdd39840a4ac9a63d78fcf0c67 P 95234c5b69eb4fe4a7558e56eedbe71a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 14:55:31.664429 18487 raft_consensus.cc:493] T 86887bfdd39840a4ac9a63d78fcf0c67 P 95234c5b69eb4fe4a7558e56eedbe71a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 14:55:31.664665 18487 raft_consensus.cc:3060] T 86887bfdd39840a4ac9a63d78fcf0c67 P 95234c5b69eb4fe4a7558e56eedbe71a [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:55:31.670776 18487 raft_consensus.cc:515] T 86887bfdd39840a4ac9a63d78fcf0c67 P 95234c5b69eb4fe4a7558e56eedbe71a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:31.672675 18487 leader_election.cc:290] T 86887bfdd39840a4ac9a63d78fcf0c67 P 95234c5b69eb4fe4a7558e56eedbe71a [CANDIDATE]: Term 3 election: Requested vote from peers f75b4aa933fd4b8c82ea07567024882c (127.6.101.65:40449), ec71ef77a55848a0add75a6c104cc9a9 (127.6.101.67:42661)
I20260709 14:55:31.673607 18161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86887bfdd39840a4ac9a63d78fcf0c67" candidate_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f75b4aa933fd4b8c82ea07567024882c"
I20260709 14:55:31.673830 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86887bfdd39840a4ac9a63d78fcf0c67" candidate_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ec71ef77a55848a0add75a6c104cc9a9"
I20260709 14:55:31.674484 18161 raft_consensus.cc:3060] T 86887bfdd39840a4ac9a63d78fcf0c67 P f75b4aa933fd4b8c82ea07567024882c [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:55:31.682578 18161 raft_consensus.cc:2468] T 86887bfdd39840a4ac9a63d78fcf0c67 P f75b4aa933fd4b8c82ea07567024882c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95234c5b69eb4fe4a7558e56eedbe71a in term 3.
I20260709 14:55:31.683723 18202 leader_election.cc:304] T 86887bfdd39840a4ac9a63d78fcf0c67 P 95234c5b69eb4fe4a7558e56eedbe71a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95234c5b69eb4fe4a7558e56eedbe71a, f75b4aa933fd4b8c82ea07567024882c; no voters: ec71ef77a55848a0add75a6c104cc9a9
I20260709 14:55:31.684609 18497 raft_consensus.cc:2804] T 86887bfdd39840a4ac9a63d78fcf0c67 P 95234c5b69eb4fe4a7558e56eedbe71a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 14:55:31.685204 18497 raft_consensus.cc:697] T 86887bfdd39840a4ac9a63d78fcf0c67 P 95234c5b69eb4fe4a7558e56eedbe71a [term 3 LEADER]: Becoming Leader. State: Replica: 95234c5b69eb4fe4a7558e56eedbe71a, State: Running, Role: LEADER
I20260709 14:55:31.686084 18497 consensus_queue.cc:237] T 86887bfdd39840a4ac9a63d78fcf0c67 P 95234c5b69eb4fe4a7558e56eedbe71a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:31.695070 18059 catalog_manager.cc:5697] T 86887bfdd39840a4ac9a63d78fcf0c67 P 95234c5b69eb4fe4a7558e56eedbe71a reported cstate change: term changed from 2 to 3, leader changed from ec71ef77a55848a0add75a6c104cc9a9 (127.6.101.67) to 95234c5b69eb4fe4a7558e56eedbe71a (127.6.101.66). New cstate: current_term: 3 leader_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } health_report { overall_health: UNKNOWN } } }
I20260709 14:55:31.892946 18237 raft_consensus.cc:1240] T 86887bfdd39840a4ac9a63d78fcf0c67 P 95234c5b69eb4fe4a7558e56eedbe71a [term 3 LEADER]: Rejecting Update request from peer ec71ef77a55848a0add75a6c104cc9a9 for earlier term 2. Current term is 3. Ops: []
I20260709 14:55:31.894843 18540 consensus_queue.cc:1059] T 86887bfdd39840a4ac9a63d78fcf0c67 P ec71ef77a55848a0add75a6c104cc9a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 14:55:31.895562 18540 consensus_queue.cc:1243] T 86887bfdd39840a4ac9a63d78fcf0c67 P ec71ef77a55848a0add75a6c104cc9a9 [LEADER]: Peer 95234c5b69eb4fe4a7558e56eedbe71a log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 0
I20260709 14:55:31.896046 18539 raft_consensus.cc:3055] T 86887bfdd39840a4ac9a63d78fcf0c67 P ec71ef77a55848a0add75a6c104cc9a9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 14:55:31.896405 18539 raft_consensus.cc:740] T 86887bfdd39840a4ac9a63d78fcf0c67 P ec71ef77a55848a0add75a6c104cc9a9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ec71ef77a55848a0add75a6c104cc9a9, State: Running, Role: LEADER
I20260709 14:55:31.897363 18539 consensus_queue.cc:260] T 86887bfdd39840a4ac9a63d78fcf0c67 P ec71ef77a55848a0add75a6c104cc9a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:31.898464 18539 raft_consensus.cc:3060] T 86887bfdd39840a4ac9a63d78fcf0c67 P ec71ef77a55848a0add75a6c104cc9a9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:55:32.139751 18161 raft_consensus.cc:1275] T 86887bfdd39840a4ac9a63d78fcf0c67 P f75b4aa933fd4b8c82ea07567024882c [term 3 FOLLOWER]: Refusing update from remote peer 95234c5b69eb4fe4a7558e56eedbe71a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 14:55:32.141710 18497 consensus_queue.cc:1048] T 86887bfdd39840a4ac9a63d78fcf0c67 P 95234c5b69eb4fe4a7558e56eedbe71a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 14:55:32.154243 18310 raft_consensus.cc:1275] T 86887bfdd39840a4ac9a63d78fcf0c67 P ec71ef77a55848a0add75a6c104cc9a9 [term 3 FOLLOWER]: Refusing update from remote peer 95234c5b69eb4fe4a7558e56eedbe71a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 14:55:32.154630 18310 pending_rounds.cc:85] T 86887bfdd39840a4ac9a63d78fcf0c67 P ec71ef77a55848a0add75a6c104cc9a9: Aborting all ops after (but not including) 1
I20260709 14:55:32.154860 18310 pending_rounds.cc:107] T 86887bfdd39840a4ac9a63d78fcf0c67 P ec71ef77a55848a0add75a6c104cc9a9: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 14:55:32.155186 18310 raft_consensus.cc:2889] T 86887bfdd39840a4ac9a63d78fcf0c67 P ec71ef77a55848a0add75a6c104cc9a9 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 14:55:32.156852 18497 consensus_queue.cc:1048] T 86887bfdd39840a4ac9a63d78fcf0c67 P 95234c5b69eb4fe4a7558e56eedbe71a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 14:55:32.939256 18060 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58838:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 14:55:32.962524 18060 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58838:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 14:55:33.039739  6549 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 14:55:33.130321 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.65:40449, user_credentials={real_user=slave}} blocked reactor thread for 60421.9us
I20260709 14:55:33.265828 18594 tablet.cc:1724] T 84b1a73cbc1e4c56a0a733d2cdacc300 P ec71ef77a55848a0add75a6c104cc9a9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 14:55:33.284617 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.101.67:42661, user_credentials={real_user=slave}} blocked reactor thread for 111649us
W20260709 14:55:33.271399 18581 log.cc:927] Time spent T f0007e8bcd5d478482896147adc197b0 P f75b4aa933fd4b8c82ea07567024882c: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 14:55:33.310490 18602 tablet.cc:1724] T 86887bfdd39840a4ac9a63d78fcf0c67 P 95234c5b69eb4fe4a7558e56eedbe71a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 14:55:33.311066 18603 tablet.cc:1724] T 84b1a73cbc1e4c56a0a733d2cdacc300 P f75b4aa933fd4b8c82ea07567024882c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 14:55:33.320744 18584 log.cc:927] Time spent T 744d4bd8bf6440d78510bd3a8b14481c P ec71ef77a55848a0add75a6c104cc9a9: Append to log took a long time: real 0.192s	user 0.002s	sys 0.003s
W20260709 14:55:33.354063 18593 log.cc:927] Time spent T 4040b77ce4d34a34baf6e31e9364f07b P 95234c5b69eb4fe4a7558e56eedbe71a: Append to log took a long time: real 0.086s	user 0.002s	sys 0.000s
I20260709 14:55:33.387817 18612 tablet.cc:1724] T 86887bfdd39840a4ac9a63d78fcf0c67 P ec71ef77a55848a0add75a6c104cc9a9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 14:55:33.395714 18618 tablet.cc:1724] T 744d4bd8bf6440d78510bd3a8b14481c P ec71ef77a55848a0add75a6c104cc9a9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 14:55:33.399305 18614 tablet.cc:1724] T 8885f7ee722545ff8d091567e7f09d69 P 95234c5b69eb4fe4a7558e56eedbe71a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 14:55:33.402289 18613 tablet.cc:1724] T 4040b77ce4d34a34baf6e31e9364f07b P f75b4aa933fd4b8c82ea07567024882c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 14:55:33.406577 18237 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "11525d1d42074736bf180ebaafed1e98"
dest_uuid: "95234c5b69eb4fe4a7558e56eedbe71a"
mode: GRACEFUL
new_leader_uuid: "ec71ef77a55848a0add75a6c104cc9a9"
 from {username='slave'} at 127.0.0.1:60404
I20260709 14:55:33.419015 18237 raft_consensus.cc:606] T 11525d1d42074736bf180ebaafed1e98 P 95234c5b69eb4fe4a7558e56eedbe71a [term 2 LEADER]: Received request to transfer leadership to TS ec71ef77a55848a0add75a6c104cc9a9
W20260709 14:55:33.430313 18600 log.cc:927] Time spent T f0007e8bcd5d478482896147adc197b0 P 95234c5b69eb4fe4a7558e56eedbe71a: Append to log took a long time: real 0.165s	user 0.003s	sys 0.000s
I20260709 14:55:33.421942 18607 tablet.cc:1724] T 84b1a73cbc1e4c56a0a733d2cdacc300 P 95234c5b69eb4fe4a7558e56eedbe71a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 14:55:33.487048 18608 log.cc:927] Time spent T 45dc6924b995473493ccf8d5b0ba3668 P ec71ef77a55848a0add75a6c104cc9a9: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 14:55:33.515545 18621 tablet.cc:1724] T 4040b77ce4d34a34baf6e31e9364f07b P 95234c5b69eb4fe4a7558e56eedbe71a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 14:55:33.516885 18594 tablet.cc:1724] T 8885f7ee722545ff8d091567e7f09d69 P ec71ef77a55848a0add75a6c104cc9a9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 14:55:33.482863 18610 tablet.cc:1724] T 86887bfdd39840a4ac9a63d78fcf0c67 P f75b4aa933fd4b8c82ea07567024882c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 14:55:33.517050 18623 tablet.cc:1724] T 8885f7ee722545ff8d091567e7f09d69 P f75b4aa933fd4b8c82ea07567024882c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 14:55:33.533612 18621 tablet.cc:1724] T e416808f5061489aa8191b18817678d0 P 95234c5b69eb4fe4a7558e56eedbe71a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 14:55:33.535239 18610 tablet.cc:1724] T f0007e8bcd5d478482896147adc197b0 P f75b4aa933fd4b8c82ea07567024882c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 14:55:33.549971 18621 tablet.cc:1724] T 03cb02cb11914a5db0023952fc210283 P 95234c5b69eb4fe4a7558e56eedbe71a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 14:55:33.492676 18602 tablet.cc:1724] T 744d4bd8bf6440d78510bd3a8b14481c P 95234c5b69eb4fe4a7558e56eedbe71a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 14:55:33.556537 18607 tablet.cc:1724] T 45dc6924b995473493ccf8d5b0ba3668 P 95234c5b69eb4fe4a7558e56eedbe71a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 14:55:33.597626 18594 tablet.cc:1724] T 03cb02cb11914a5db0023952fc210283 P ec71ef77a55848a0add75a6c104cc9a9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 14:55:33.609376 18618 tablet.cc:1724] T 45dc6924b995473493ccf8d5b0ba3668 P ec71ef77a55848a0add75a6c104cc9a9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 14:55:33.630306 18612 tablet.cc:1724] T 4040b77ce4d34a34baf6e31e9364f07b P ec71ef77a55848a0add75a6c104cc9a9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 14:55:33.646147 18610 tablet.cc:1724] T e416808f5061489aa8191b18817678d0 P f75b4aa933fd4b8c82ea07567024882c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 14:55:33.648006 18621 tablet.cc:1724] T f0007e8bcd5d478482896147adc197b0 P 95234c5b69eb4fe4a7558e56eedbe71a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 14:55:33.673904 18623 tablet.cc:1724] T 744d4bd8bf6440d78510bd3a8b14481c P f75b4aa933fd4b8c82ea07567024882c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 14:55:33.655073 18603 tablet.cc:1724] T 03cb02cb11914a5db0023952fc210283 P f75b4aa933fd4b8c82ea07567024882c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 14:55:33.683715 18612 tablet.cc:1724] T e416808f5061489aa8191b18817678d0 P ec71ef77a55848a0add75a6c104cc9a9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 14:55:33.697206 18612 tablet.cc:1724] T f0007e8bcd5d478482896147adc197b0 P ec71ef77a55848a0add75a6c104cc9a9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 14:55:33.715854 18161 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "528cd6046e1f4e7e8cc77f09c4578612"
dest_uuid: "f75b4aa933fd4b8c82ea07567024882c"
mode: GRACEFUL
new_leader_uuid: "ec71ef77a55848a0add75a6c104cc9a9"
 from {username='slave'} at 127.0.0.1:55824
I20260709 14:55:33.717031 18161 raft_consensus.cc:606] T 528cd6046e1f4e7e8cc77f09c4578612 P f75b4aa933fd4b8c82ea07567024882c [term 2 LEADER]: Received request to transfer leadership to TS ec71ef77a55848a0add75a6c104cc9a9
I20260709 14:55:33.719715  6549 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 14:55:33.720799  6549 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 14:55:33.713294 18613 tablet.cc:1724] T 45dc6924b995473493ccf8d5b0ba3668 P f75b4aa933fd4b8c82ea07567024882c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 14:55:33.754017 18591 raft_consensus.cc:993] T 11525d1d42074736bf180ebaafed1e98 P 95234c5b69eb4fe4a7558e56eedbe71a: : Instructing follower ec71ef77a55848a0add75a6c104cc9a9 to start an election
I20260709 14:55:33.754567 18591 raft_consensus.cc:1081] T 11525d1d42074736bf180ebaafed1e98 P 95234c5b69eb4fe4a7558e56eedbe71a [term 2 LEADER]: Signalling peer ec71ef77a55848a0add75a6c104cc9a9 to start an election
I20260709 14:55:33.756778 18305 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "11525d1d42074736bf180ebaafed1e98"
dest_uuid: "ec71ef77a55848a0add75a6c104cc9a9"
 from {username='slave'} at 127.0.0.1:52786
I20260709 14:55:33.757376 18305 raft_consensus.cc:493] T 11525d1d42074736bf180ebaafed1e98 P ec71ef77a55848a0add75a6c104cc9a9 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:55:33.757704 18305 raft_consensus.cc:3060] T 11525d1d42074736bf180ebaafed1e98 P ec71ef77a55848a0add75a6c104cc9a9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:55:33.763903 18060 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 233fa68c7088489f892c8e7dd6b70f02: soft_deleted_table [id=889304c2491e40d188f32c57660dc3ba] alter complete (version 1)
I20260709 14:55:33.765779 18305 raft_consensus.cc:515] T 11525d1d42074736bf180ebaafed1e98 P ec71ef77a55848a0add75a6c104cc9a9 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:33.769605 18161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11525d1d42074736bf180ebaafed1e98" candidate_uuid: "ec71ef77a55848a0add75a6c104cc9a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f75b4aa933fd4b8c82ea07567024882c"
I20260709 14:55:33.770323 18161 raft_consensus.cc:3060] T 11525d1d42074736bf180ebaafed1e98 P f75b4aa933fd4b8c82ea07567024882c [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:55:33.773183 18305 leader_election.cc:290] T 11525d1d42074736bf180ebaafed1e98 P ec71ef77a55848a0add75a6c104cc9a9 [CANDIDATE]: Term 3 election: Requested vote from peers f75b4aa933fd4b8c82ea07567024882c (127.6.101.65:40449), 95234c5b69eb4fe4a7558e56eedbe71a (127.6.101.66:42897)
I20260709 14:55:33.773315 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11525d1d42074736bf180ebaafed1e98" candidate_uuid: "ec71ef77a55848a0add75a6c104cc9a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "95234c5b69eb4fe4a7558e56eedbe71a"
I20260709 14:55:33.774183 18237 raft_consensus.cc:3055] T 11525d1d42074736bf180ebaafed1e98 P 95234c5b69eb4fe4a7558e56eedbe71a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 14:55:33.774513 18237 raft_consensus.cc:740] T 11525d1d42074736bf180ebaafed1e98 P 95234c5b69eb4fe4a7558e56eedbe71a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 95234c5b69eb4fe4a7558e56eedbe71a, State: Running, Role: LEADER
I20260709 14:55:33.775421 18237 consensus_queue.cc:260] T 11525d1d42074736bf180ebaafed1e98 P 95234c5b69eb4fe4a7558e56eedbe71a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:33.776640 18237 raft_consensus.cc:3060] T 11525d1d42074736bf180ebaafed1e98 P 95234c5b69eb4fe4a7558e56eedbe71a [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:55:33.779592 18161 raft_consensus.cc:2468] T 11525d1d42074736bf180ebaafed1e98 P f75b4aa933fd4b8c82ea07567024882c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec71ef77a55848a0add75a6c104cc9a9 in term 3.
I20260709 14:55:33.781200 18276 leader_election.cc:304] T 11525d1d42074736bf180ebaafed1e98 P ec71ef77a55848a0add75a6c104cc9a9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ec71ef77a55848a0add75a6c104cc9a9, f75b4aa933fd4b8c82ea07567024882c; no voters: 
I20260709 14:55:33.782317 18595 raft_consensus.cc:2804] T 11525d1d42074736bf180ebaafed1e98 P ec71ef77a55848a0add75a6c104cc9a9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 14:55:33.782823 18595 raft_consensus.cc:697] T 11525d1d42074736bf180ebaafed1e98 P ec71ef77a55848a0add75a6c104cc9a9 [term 3 LEADER]: Becoming Leader. State: Replica: ec71ef77a55848a0add75a6c104cc9a9, State: Running, Role: LEADER
I20260709 14:55:33.784178 18237 raft_consensus.cc:2468] T 11525d1d42074736bf180ebaafed1e98 P 95234c5b69eb4fe4a7558e56eedbe71a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec71ef77a55848a0add75a6c104cc9a9 in term 3.
I20260709 14:55:33.783789 18595 consensus_queue.cc:237] T 11525d1d42074736bf180ebaafed1e98 P ec71ef77a55848a0add75a6c104cc9a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:33.793754 18061 catalog_manager.cc:5697] T 11525d1d42074736bf180ebaafed1e98 P ec71ef77a55848a0add75a6c104cc9a9 reported cstate change: term changed from 2 to 3, leader changed from 95234c5b69eb4fe4a7558e56eedbe71a (127.6.101.66) to ec71ef77a55848a0add75a6c104cc9a9 (127.6.101.67). New cstate: current_term: 3 leader_uuid: "ec71ef77a55848a0add75a6c104cc9a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } health_report { overall_health: HEALTHY } } }
I20260709 14:55:33.974059 18592 raft_consensus.cc:993] T 528cd6046e1f4e7e8cc77f09c4578612 P f75b4aa933fd4b8c82ea07567024882c: : Instructing follower ec71ef77a55848a0add75a6c104cc9a9 to start an election
I20260709 14:55:33.974846 18592 raft_consensus.cc:1081] T 528cd6046e1f4e7e8cc77f09c4578612 P f75b4aa933fd4b8c82ea07567024882c [term 2 LEADER]: Signalling peer ec71ef77a55848a0add75a6c104cc9a9 to start an election
I20260709 14:55:33.977005 18305 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "528cd6046e1f4e7e8cc77f09c4578612"
dest_uuid: "ec71ef77a55848a0add75a6c104cc9a9"
 from {username='slave'} at 127.0.0.1:52796
I20260709 14:55:33.977900 18305 raft_consensus.cc:493] T 528cd6046e1f4e7e8cc77f09c4578612 P ec71ef77a55848a0add75a6c104cc9a9 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 14:55:33.978307 18305 raft_consensus.cc:3060] T 528cd6046e1f4e7e8cc77f09c4578612 P ec71ef77a55848a0add75a6c104cc9a9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:55:33.994992 18305 raft_consensus.cc:515] T 528cd6046e1f4e7e8cc77f09c4578612 P ec71ef77a55848a0add75a6c104cc9a9 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:33.998802 18305 leader_election.cc:290] T 528cd6046e1f4e7e8cc77f09c4578612 P ec71ef77a55848a0add75a6c104cc9a9 [CANDIDATE]: Term 3 election: Requested vote from peers f75b4aa933fd4b8c82ea07567024882c (127.6.101.65:40449), 95234c5b69eb4fe4a7558e56eedbe71a (127.6.101.66:42897)
I20260709 14:55:33.999550 18159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528cd6046e1f4e7e8cc77f09c4578612" candidate_uuid: "ec71ef77a55848a0add75a6c104cc9a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f75b4aa933fd4b8c82ea07567024882c"
I20260709 14:55:34.000784 18159 raft_consensus.cc:3055] T 528cd6046e1f4e7e8cc77f09c4578612 P f75b4aa933fd4b8c82ea07567024882c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 14:55:34.001209 18159 raft_consensus.cc:740] T 528cd6046e1f4e7e8cc77f09c4578612 P f75b4aa933fd4b8c82ea07567024882c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f75b4aa933fd4b8c82ea07567024882c, State: Running, Role: LEADER
I20260709 14:55:34.002311 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528cd6046e1f4e7e8cc77f09c4578612" candidate_uuid: "ec71ef77a55848a0add75a6c104cc9a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "95234c5b69eb4fe4a7558e56eedbe71a"
I20260709 14:55:34.003266 18237 raft_consensus.cc:3060] T 528cd6046e1f4e7e8cc77f09c4578612 P 95234c5b69eb4fe4a7558e56eedbe71a [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:55:34.002811 18159 consensus_queue.cc:260] T 528cd6046e1f4e7e8cc77f09c4578612 P f75b4aa933fd4b8c82ea07567024882c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:34.004945 18159 raft_consensus.cc:3060] T 528cd6046e1f4e7e8cc77f09c4578612 P f75b4aa933fd4b8c82ea07567024882c [term 2 FOLLOWER]: Advancing to term 3
I20260709 14:55:34.016523 18159 raft_consensus.cc:2468] T 528cd6046e1f4e7e8cc77f09c4578612 P f75b4aa933fd4b8c82ea07567024882c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec71ef77a55848a0add75a6c104cc9a9 in term 3.
I20260709 14:55:34.018564 18237 raft_consensus.cc:2468] T 528cd6046e1f4e7e8cc77f09c4578612 P 95234c5b69eb4fe4a7558e56eedbe71a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec71ef77a55848a0add75a6c104cc9a9 in term 3.
I20260709 14:55:34.019716 18276 leader_election.cc:304] T 528cd6046e1f4e7e8cc77f09c4578612 P ec71ef77a55848a0add75a6c104cc9a9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ec71ef77a55848a0add75a6c104cc9a9, f75b4aa933fd4b8c82ea07567024882c; no voters: 
I20260709 14:55:34.021514 18595 raft_consensus.cc:2804] T 528cd6046e1f4e7e8cc77f09c4578612 P ec71ef77a55848a0add75a6c104cc9a9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 14:55:34.022543 18595 raft_consensus.cc:697] T 528cd6046e1f4e7e8cc77f09c4578612 P ec71ef77a55848a0add75a6c104cc9a9 [term 3 LEADER]: Becoming Leader. State: Replica: ec71ef77a55848a0add75a6c104cc9a9, State: Running, Role: LEADER
I20260709 14:55:34.024665 18595 consensus_queue.cc:237] T 528cd6046e1f4e7e8cc77f09c4578612 P ec71ef77a55848a0add75a6c104cc9a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } }
I20260709 14:55:34.052953 18061 catalog_manager.cc:5697] T 528cd6046e1f4e7e8cc77f09c4578612 P ec71ef77a55848a0add75a6c104cc9a9 reported cstate change: term changed from 2 to 3, leader changed from f75b4aa933fd4b8c82ea07567024882c (127.6.101.65) to ec71ef77a55848a0add75a6c104cc9a9 (127.6.101.67). New cstate: current_term: 3 leader_uuid: "ec71ef77a55848a0add75a6c104cc9a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec71ef77a55848a0add75a6c104cc9a9" member_type: VOTER last_known_addr { host: "127.6.101.67" port: 42661 } health_report { overall_health: HEALTHY } } }
I20260709 14:55:34.268795 18159 raft_consensus.cc:1275] T 11525d1d42074736bf180ebaafed1e98 P f75b4aa933fd4b8c82ea07567024882c [term 3 FOLLOWER]: Refusing update from remote peer ec71ef77a55848a0add75a6c104cc9a9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 14:55:34.270383 18595 consensus_queue.cc:1048] T 11525d1d42074736bf180ebaafed1e98 P ec71ef77a55848a0add75a6c104cc9a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 14:55:34.283998 18237 raft_consensus.cc:1275] T 11525d1d42074736bf180ebaafed1e98 P 95234c5b69eb4fe4a7558e56eedbe71a [term 3 FOLLOWER]: Refusing update from remote peer ec71ef77a55848a0add75a6c104cc9a9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 14:55:34.286502 18633 consensus_queue.cc:1048] T 11525d1d42074736bf180ebaafed1e98 P ec71ef77a55848a0add75a6c104cc9a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 14:55:34.457863 18159 raft_consensus.cc:1275] T 528cd6046e1f4e7e8cc77f09c4578612 P f75b4aa933fd4b8c82ea07567024882c [term 3 FOLLOWER]: Refusing update from remote peer ec71ef77a55848a0add75a6c104cc9a9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 14:55:34.459383 18633 consensus_queue.cc:1048] T 528cd6046e1f4e7e8cc77f09c4578612 P ec71ef77a55848a0add75a6c104cc9a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f75b4aa933fd4b8c82ea07567024882c" member_type: VOTER last_known_addr { host: "127.6.101.65" port: 40449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 14:55:34.462266 18236 raft_consensus.cc:1275] T 528cd6046e1f4e7e8cc77f09c4578612 P 95234c5b69eb4fe4a7558e56eedbe71a [term 3 FOLLOWER]: Refusing update from remote peer ec71ef77a55848a0add75a6c104cc9a9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 14:55:34.463900 18595 consensus_queue.cc:1048] T 528cd6046e1f4e7e8cc77f09c4578612 P ec71ef77a55848a0add75a6c104cc9a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95234c5b69eb4fe4a7558e56eedbe71a" member_type: VOTER last_known_addr { host: "127.6.101.66" port: 42897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 14:55:34.791923  6549 tablet_server.cc:179] TabletServer@127.6.101.65:0 shutting down...
W20260709 14:55:34.808172 18202 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 15 similar messages]
W20260709 14:55:34.818562 18202 consensus_peers.cc:597] T 8885f7ee722545ff8d091567e7f09d69 P 95234c5b69eb4fe4a7558e56eedbe71a -> Peer f75b4aa933fd4b8c82ea07567024882c (127.6.101.65:40449): Couldn't send request to peer f75b4aa933fd4b8c82ea07567024882c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:55:34.832311  6549 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 14:55:34.833721  6549 tablet_replica.cc:333] T 744d4bd8bf6440d78510bd3a8b14481c P f75b4aa933fd4b8c82ea07567024882c: stopping tablet replica
W20260709 14:55:34.834569 18276 consensus_peers.cc:597] T 11525d1d42074736bf180ebaafed1e98 P ec71ef77a55848a0add75a6c104cc9a9 -> Peer f75b4aa933fd4b8c82ea07567024882c (127.6.101.65:40449): Couldn't send request to peer f75b4aa933fd4b8c82ea07567024882c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:55:34.835122  6549 raft_consensus.cc:2243] T 744d4bd8bf6440d78510bd3a8b14481c P f75b4aa933fd4b8c82ea07567024882c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 14:55:34.836054  6549 raft_consensus.cc:2272] T 744d4bd8bf6440d78510bd3a8b14481c P f75b4aa933fd4b8c82ea07567024882c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:34.838804  6549 tablet_replica.cc:333] T 45dc6924b995473493ccf8d5b0ba3668 P f75b4aa933fd4b8c82ea07567024882c: stopping tablet replica
I20260709 14:55:34.839638  6549 raft_consensus.cc:2243] T 45dc6924b995473493ccf8d5b0ba3668 P f75b4aa933fd4b8c82ea07567024882c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 14:55:34.840184  6549 raft_consensus.cc:2272] T 45dc6924b995473493ccf8d5b0ba3668 P f75b4aa933fd4b8c82ea07567024882c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:34.842530  6549 tablet_replica.cc:333] T f0007e8bcd5d478482896147adc197b0 P f75b4aa933fd4b8c82ea07567024882c: stopping tablet replica
I20260709 14:55:34.843184  6549 raft_consensus.cc:2243] T f0007e8bcd5d478482896147adc197b0 P f75b4aa933fd4b8c82ea07567024882c [term 1 LEADER]: Raft consensus shutting down.
I20260709 14:55:34.844136  6549 raft_consensus.cc:2272] T f0007e8bcd5d478482896147adc197b0 P f75b4aa933fd4b8c82ea07567024882c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:34.846747  6549 tablet_replica.cc:333] T 84b1a73cbc1e4c56a0a733d2cdacc300 P f75b4aa933fd4b8c82ea07567024882c: stopping tablet replica
I20260709 14:55:34.847517  6549 raft_consensus.cc:2243] T 84b1a73cbc1e4c56a0a733d2cdacc300 P f75b4aa933fd4b8c82ea07567024882c [term 2 LEADER]: Raft consensus shutting down.
I20260709 14:55:34.848471  6549 raft_consensus.cc:2272] T 84b1a73cbc1e4c56a0a733d2cdacc300 P f75b4aa933fd4b8c82ea07567024882c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:34.850986  6549 tablet_replica.cc:333] T 528cd6046e1f4e7e8cc77f09c4578612 P f75b4aa933fd4b8c82ea07567024882c: stopping tablet replica
I20260709 14:55:34.851555  6549 raft_consensus.cc:2243] T 528cd6046e1f4e7e8cc77f09c4578612 P f75b4aa933fd4b8c82ea07567024882c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 14:55:34.851961  6549 raft_consensus.cc:2272] T 528cd6046e1f4e7e8cc77f09c4578612 P f75b4aa933fd4b8c82ea07567024882c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:34.856194  6549 tablet_replica.cc:333] T e68e41550ad240f5842867f3c8b8604d P f75b4aa933fd4b8c82ea07567024882c: stopping tablet replica
I20260709 14:55:34.857371  6549 raft_consensus.cc:2243] T e68e41550ad240f5842867f3c8b8604d P f75b4aa933fd4b8c82ea07567024882c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 14:55:34.858197  6549 raft_consensus.cc:2272] T e68e41550ad240f5842867f3c8b8604d P f75b4aa933fd4b8c82ea07567024882c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:34.862174  6549 tablet_replica.cc:333] T 03cb02cb11914a5db0023952fc210283 P f75b4aa933fd4b8c82ea07567024882c: stopping tablet replica
I20260709 14:55:34.863246  6549 raft_consensus.cc:2243] T 03cb02cb11914a5db0023952fc210283 P f75b4aa933fd4b8c82ea07567024882c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 14:55:34.864060  6549 raft_consensus.cc:2272] T 03cb02cb11914a5db0023952fc210283 P f75b4aa933fd4b8c82ea07567024882c [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 14:55:34.866386 18202 consensus_peers.cc:597] T b2b20170ec59458c9b9a18ca1e2a34d6 P 95234c5b69eb4fe4a7558e56eedbe71a -> Peer f75b4aa933fd4b8c82ea07567024882c (127.6.101.65:40449): Couldn't send request to peer f75b4aa933fd4b8c82ea07567024882c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:55:34.868011  6549 tablet_replica.cc:333] T 86887bfdd39840a4ac9a63d78fcf0c67 P f75b4aa933fd4b8c82ea07567024882c: stopping tablet replica
I20260709 14:55:34.868899  6549 raft_consensus.cc:2243] T 86887bfdd39840a4ac9a63d78fcf0c67 P f75b4aa933fd4b8c82ea07567024882c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 14:55:34.869556  6549 raft_consensus.cc:2272] T 86887bfdd39840a4ac9a63d78fcf0c67 P f75b4aa933fd4b8c82ea07567024882c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:34.872335  6549 tablet_replica.cc:333] T 1f97050ecf494124a1ef8f3a359d6fd4 P f75b4aa933fd4b8c82ea07567024882c: stopping tablet replica
I20260709 14:55:34.873013  6549 raft_consensus.cc:2243] T 1f97050ecf494124a1ef8f3a359d6fd4 P f75b4aa933fd4b8c82ea07567024882c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 14:55:34.873533  6549 raft_consensus.cc:2272] T 1f97050ecf494124a1ef8f3a359d6fd4 P f75b4aa933fd4b8c82ea07567024882c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:34.875999  6549 tablet_replica.cc:333] T 8c253d3492704370910e00d866ea41a2 P f75b4aa933fd4b8c82ea07567024882c: stopping tablet replica
I20260709 14:55:34.876617  6549 raft_consensus.cc:2243] T 8c253d3492704370910e00d866ea41a2 P f75b4aa933fd4b8c82ea07567024882c [term 2 LEADER]: Raft consensus shutting down.
I20260709 14:55:34.877650  6549 raft_consensus.cc:2272] T 8c253d3492704370910e00d866ea41a2 P f75b4aa933fd4b8c82ea07567024882c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:34.880188  6549 tablet_replica.cc:333] T b2b20170ec59458c9b9a18ca1e2a34d6 P f75b4aa933fd4b8c82ea07567024882c: stopping tablet replica
I20260709 14:55:34.880841  6549 raft_consensus.cc:2243] T b2b20170ec59458c9b9a18ca1e2a34d6 P f75b4aa933fd4b8c82ea07567024882c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 14:55:34.881500  6549 raft_consensus.cc:2272] T b2b20170ec59458c9b9a18ca1e2a34d6 P f75b4aa933fd4b8c82ea07567024882c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:34.884099  6549 tablet_replica.cc:333] T 11525d1d42074736bf180ebaafed1e98 P f75b4aa933fd4b8c82ea07567024882c: stopping tablet replica
I20260709 14:55:34.884776  6549 raft_consensus.cc:2243] T 11525d1d42074736bf180ebaafed1e98 P f75b4aa933fd4b8c82ea07567024882c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 14:55:34.885311  6549 raft_consensus.cc:2272] T 11525d1d42074736bf180ebaafed1e98 P f75b4aa933fd4b8c82ea07567024882c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:34.888598  6549 tablet_replica.cc:333] T bf34b3256cdf42dbaf4cad11d1a42160 P f75b4aa933fd4b8c82ea07567024882c: stopping tablet replica
I20260709 14:55:34.889210  6549 raft_consensus.cc:2243] T bf34b3256cdf42dbaf4cad11d1a42160 P f75b4aa933fd4b8c82ea07567024882c [term 2 LEADER]: Raft consensus shutting down.
I20260709 14:55:34.890226  6549 raft_consensus.cc:2272] T bf34b3256cdf42dbaf4cad11d1a42160 P f75b4aa933fd4b8c82ea07567024882c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:34.893952  6549 tablet_replica.cc:333] T e416808f5061489aa8191b18817678d0 P f75b4aa933fd4b8c82ea07567024882c: stopping tablet replica
I20260709 14:55:34.894760  6549 raft_consensus.cc:2243] T e416808f5061489aa8191b18817678d0 P f75b4aa933fd4b8c82ea07567024882c [term 2 LEADER]: Raft consensus shutting down.
I20260709 14:55:34.895895  6549 raft_consensus.cc:2272] T e416808f5061489aa8191b18817678d0 P f75b4aa933fd4b8c82ea07567024882c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:34.899923  6549 tablet_replica.cc:333] T 8885f7ee722545ff8d091567e7f09d69 P f75b4aa933fd4b8c82ea07567024882c: stopping tablet replica
I20260709 14:55:34.900837  6549 raft_consensus.cc:2243] T 8885f7ee722545ff8d091567e7f09d69 P f75b4aa933fd4b8c82ea07567024882c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 14:55:34.901656  6549 raft_consensus.cc:2272] T 8885f7ee722545ff8d091567e7f09d69 P f75b4aa933fd4b8c82ea07567024882c [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 14:55:34.901511 18276 consensus_peers.cc:597] T 744d4bd8bf6440d78510bd3a8b14481c P ec71ef77a55848a0add75a6c104cc9a9 -> Peer f75b4aa933fd4b8c82ea07567024882c (127.6.101.65:40449): Couldn't send request to peer f75b4aa933fd4b8c82ea07567024882c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 14:55:34.904537  6549 tablet_replica.cc:333] T 39965dc306aa4828a74a07da020fe662 P f75b4aa933fd4b8c82ea07567024882c: stopping tablet replica
I20260709 14:55:34.905169  6549 raft_consensus.cc:2243] T 39965dc306aa4828a74a07da020fe662 P f75b4aa933fd4b8c82ea07567024882c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 14:55:34.905797  6549 raft_consensus.cc:2272] T 39965dc306aa4828a74a07da020fe662 P f75b4aa933fd4b8c82ea07567024882c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:34.908506  6549 tablet_replica.cc:333] T 4040b77ce4d34a34baf6e31e9364f07b P f75b4aa933fd4b8c82ea07567024882c: stopping tablet replica
I20260709 14:55:34.909096  6549 raft_consensus.cc:2243] T 4040b77ce4d34a34baf6e31e9364f07b P f75b4aa933fd4b8c82ea07567024882c [term 2 LEADER]: Raft consensus shutting down.
I20260709 14:55:34.910355  6549 raft_consensus.cc:2272] T 4040b77ce4d34a34baf6e31e9364f07b P f75b4aa933fd4b8c82ea07567024882c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:34.913358  6549 tablet_replica.cc:333] T f2ae10cc8d774889b54c598119fa0deb P f75b4aa933fd4b8c82ea07567024882c: stopping tablet replica
I20260709 14:55:34.913930  6549 raft_consensus.cc:2243] T f2ae10cc8d774889b54c598119fa0deb P f75b4aa933fd4b8c82ea07567024882c [term 2 LEADER]: Raft consensus shutting down.
I20260709 14:55:34.914983  6549 raft_consensus.cc:2272] T f2ae10cc8d774889b54c598119fa0deb P f75b4aa933fd4b8c82ea07567024882c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:34.969205  6549 tablet_server.cc:196] TabletServer@127.6.101.65:0 shutdown complete.
W20260709 14:55:34.985297 18276 consensus_peers.cc:597] T 528cd6046e1f4e7e8cc77f09c4578612 P ec71ef77a55848a0add75a6c104cc9a9 -> Peer f75b4aa933fd4b8c82ea07567024882c (127.6.101.65:40449): Couldn't send request to peer f75b4aa933fd4b8c82ea07567024882c. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40449: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 14:55:35.026194  6549 tablet_server.cc:179] TabletServer@127.6.101.66:0 shutting down...
W20260709 14:55:35.061324 18202 consensus_peers.cc:597] T 03cb02cb11914a5db0023952fc210283 P 95234c5b69eb4fe4a7558e56eedbe71a -> Peer f75b4aa933fd4b8c82ea07567024882c (127.6.101.65:40449): Couldn't send request to peer f75b4aa933fd4b8c82ea07567024882c. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40449: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 14:55:35.064690  6549 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 14:55:35.065722  6549 tablet_replica.cc:333] T 45dc6924b995473493ccf8d5b0ba3668 P 95234c5b69eb4fe4a7558e56eedbe71a: stopping tablet replica
I20260709 14:55:35.066754  6549 raft_consensus.cc:2243] T 45dc6924b995473493ccf8d5b0ba3668 P 95234c5b69eb4fe4a7558e56eedbe71a [term 2 LEADER]: Raft consensus shutting down.
I20260709 14:55:35.068001  6549 raft_consensus.cc:2272] T 45dc6924b995473493ccf8d5b0ba3668 P 95234c5b69eb4fe4a7558e56eedbe71a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:35.071135  6549 tablet_replica.cc:333] T 744d4bd8bf6440d78510bd3a8b14481c P 95234c5b69eb4fe4a7558e56eedbe71a: stopping tablet replica
I20260709 14:55:35.072073  6549 raft_consensus.cc:2243] T 744d4bd8bf6440d78510bd3a8b14481c P 95234c5b69eb4fe4a7558e56eedbe71a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 14:55:35.072866  6549 raft_consensus.cc:2272] T 744d4bd8bf6440d78510bd3a8b14481c P 95234c5b69eb4fe4a7558e56eedbe71a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:35.076489  6549 tablet_replica.cc:333] T 84b1a73cbc1e4c56a0a733d2cdacc300 P 95234c5b69eb4fe4a7558e56eedbe71a: stopping tablet replica
I20260709 14:55:35.077491  6549 raft_consensus.cc:2243] T 84b1a73cbc1e4c56a0a733d2cdacc300 P 95234c5b69eb4fe4a7558e56eedbe71a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 14:55:35.078339  6549 raft_consensus.cc:2272] T 84b1a73cbc1e4c56a0a733d2cdacc300 P 95234c5b69eb4fe4a7558e56eedbe71a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:35.082864  6549 tablet_replica.cc:333] T 8885f7ee722545ff8d091567e7f09d69 P 95234c5b69eb4fe4a7558e56eedbe71a: stopping tablet replica
I20260709 14:55:35.083588  6549 raft_consensus.cc:2243] T 8885f7ee722545ff8d091567e7f09d69 P 95234c5b69eb4fe4a7558e56eedbe71a [term 1 LEADER]: Raft consensus shutting down.
I20260709 14:55:35.084595  6549 raft_consensus.cc:2272] T 8885f7ee722545ff8d091567e7f09d69 P 95234c5b69eb4fe4a7558e56eedbe71a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:35.087462  6549 tablet_replica.cc:333] T e416808f5061489aa8191b18817678d0 P 95234c5b69eb4fe4a7558e56eedbe71a: stopping tablet replica
I20260709 14:55:35.088282  6549 raft_consensus.cc:2243] T e416808f5061489aa8191b18817678d0 P 95234c5b69eb4fe4a7558e56eedbe71a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 14:55:35.088873  6549 raft_consensus.cc:2272] T e416808f5061489aa8191b18817678d0 P 95234c5b69eb4fe4a7558e56eedbe71a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:35.091307  6549 tablet_replica.cc:333] T f0007e8bcd5d478482896147adc197b0 P 95234c5b69eb4fe4a7558e56eedbe71a: stopping tablet replica
I20260709 14:55:35.091902  6549 raft_consensus.cc:2243] T f0007e8bcd5d478482896147adc197b0 P 95234c5b69eb4fe4a7558e56eedbe71a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 14:55:35.092485  6549 raft_consensus.cc:2272] T f0007e8bcd5d478482896147adc197b0 P 95234c5b69eb4fe4a7558e56eedbe71a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:35.095804  6549 tablet_replica.cc:333] T 528cd6046e1f4e7e8cc77f09c4578612 P 95234c5b69eb4fe4a7558e56eedbe71a: stopping tablet replica
I20260709 14:55:35.096607  6549 raft_consensus.cc:2243] T 528cd6046e1f4e7e8cc77f09c4578612 P 95234c5b69eb4fe4a7558e56eedbe71a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 14:55:35.097155  6549 raft_consensus.cc:2272] T 528cd6046e1f4e7e8cc77f09c4578612 P 95234c5b69eb4fe4a7558e56eedbe71a [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 14:55:35.098749 18202 consensus_peers.cc:597] T e68e41550ad240f5842867f3c8b8604d P 95234c5b69eb4fe4a7558e56eedbe71a -> Peer f75b4aa933fd4b8c82ea07567024882c (127.6.101.65:40449): Couldn't send request to peer f75b4aa933fd4b8c82ea07567024882c. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40449: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 14:55:35.100185  6549 tablet_replica.cc:333] T e68e41550ad240f5842867f3c8b8604d P 95234c5b69eb4fe4a7558e56eedbe71a: stopping tablet replica
I20260709 14:55:35.100943  6549 raft_consensus.cc:2243] T e68e41550ad240f5842867f3c8b8604d P 95234c5b69eb4fe4a7558e56eedbe71a [term 1 LEADER]: Raft consensus shutting down.
I20260709 14:55:35.101910  6549 raft_consensus.cc:2272] T e68e41550ad240f5842867f3c8b8604d P 95234c5b69eb4fe4a7558e56eedbe71a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:35.104576  6549 tablet_replica.cc:333] T 03cb02cb11914a5db0023952fc210283 P 95234c5b69eb4fe4a7558e56eedbe71a: stopping tablet replica
I20260709 14:55:35.105525  6549 raft_consensus.cc:2243] T 03cb02cb11914a5db0023952fc210283 P 95234c5b69eb4fe4a7558e56eedbe71a [term 2 LEADER]: Raft consensus shutting down.
I20260709 14:55:35.106806  6549 raft_consensus.cc:2272] T 03cb02cb11914a5db0023952fc210283 P 95234c5b69eb4fe4a7558e56eedbe71a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:35.109603  6549 tablet_replica.cc:333] T 86887bfdd39840a4ac9a63d78fcf0c67 P 95234c5b69eb4fe4a7558e56eedbe71a: stopping tablet replica
I20260709 14:55:35.110222  6549 raft_consensus.cc:2243] T 86887bfdd39840a4ac9a63d78fcf0c67 P 95234c5b69eb4fe4a7558e56eedbe71a [term 3 LEADER]: Raft consensus shutting down.
I20260709 14:55:35.111048  6549 raft_consensus.cc:2272] T 86887bfdd39840a4ac9a63d78fcf0c67 P 95234c5b69eb4fe4a7558e56eedbe71a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:35.113420  6549 tablet_replica.cc:333] T 1f97050ecf494124a1ef8f3a359d6fd4 P 95234c5b69eb4fe4a7558e56eedbe71a: stopping tablet replica
I20260709 14:55:35.114403  6549 raft_consensus.cc:2243] T 1f97050ecf494124a1ef8f3a359d6fd4 P 95234c5b69eb4fe4a7558e56eedbe71a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 14:55:35.115033  6549 raft_consensus.cc:2272] T 1f97050ecf494124a1ef8f3a359d6fd4 P 95234c5b69eb4fe4a7558e56eedbe71a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:35.117528  6549 tablet_replica.cc:333] T 11525d1d42074736bf180ebaafed1e98 P 95234c5b69eb4fe4a7558e56eedbe71a: stopping tablet replica
I20260709 14:55:35.118127  6549 raft_consensus.cc:2243] T 11525d1d42074736bf180ebaafed1e98 P 95234c5b69eb4fe4a7558e56eedbe71a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 14:55:35.118595  6549 raft_consensus.cc:2272] T 11525d1d42074736bf180ebaafed1e98 P 95234c5b69eb4fe4a7558e56eedbe71a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:35.121548  6549 tablet_replica.cc:333] T b2b20170ec59458c9b9a18ca1e2a34d6 P 95234c5b69eb4fe4a7558e56eedbe71a: stopping tablet replica
I20260709 14:55:35.122174  6549 raft_consensus.cc:2243] T b2b20170ec59458c9b9a18ca1e2a34d6 P 95234c5b69eb4fe4a7558e56eedbe71a [term 2 LEADER]: Raft consensus shutting down.
I20260709 14:55:35.123082  6549 raft_consensus.cc:2272] T b2b20170ec59458c9b9a18ca1e2a34d6 P 95234c5b69eb4fe4a7558e56eedbe71a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:35.125737  6549 tablet_replica.cc:333] T 8c253d3492704370910e00d866ea41a2 P 95234c5b69eb4fe4a7558e56eedbe71a: stopping tablet replica
I20260709 14:55:35.126425  6549 raft_consensus.cc:2243] T 8c253d3492704370910e00d866ea41a2 P 95234c5b69eb4fe4a7558e56eedbe71a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 14:55:35.127143  6549 raft_consensus.cc:2272] T 8c253d3492704370910e00d866ea41a2 P 95234c5b69eb4fe4a7558e56eedbe71a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:35.129683  6549 tablet_replica.cc:333] T 39965dc306aa4828a74a07da020fe662 P 95234c5b69eb4fe4a7558e56eedbe71a: stopping tablet replica
I20260709 14:55:35.130227  6549 raft_consensus.cc:2243] T 39965dc306aa4828a74a07da020fe662 P 95234c5b69eb4fe4a7558e56eedbe71a [term 2 LEADER]: Raft consensus shutting down.
I20260709 14:55:35.131354  6549 raft_consensus.cc:2272] T 39965dc306aa4828a74a07da020fe662 P 95234c5b69eb4fe4a7558e56eedbe71a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:35.133766  6549 tablet_replica.cc:333] T 4040b77ce4d34a34baf6e31e9364f07b P 95234c5b69eb4fe4a7558e56eedbe71a: stopping tablet replica
I20260709 14:55:35.134285  6549 raft_consensus.cc:2243] T 4040b77ce4d34a34baf6e31e9364f07b P 95234c5b69eb4fe4a7558e56eedbe71a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 14:55:35.134792  6549 raft_consensus.cc:2272] T 4040b77ce4d34a34baf6e31e9364f07b P 95234c5b69eb4fe4a7558e56eedbe71a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:35.137485  6549 tablet_replica.cc:333] T f2ae10cc8d774889b54c598119fa0deb P 95234c5b69eb4fe4a7558e56eedbe71a: stopping tablet replica
I20260709 14:55:35.137995  6549 raft_consensus.cc:2243] T f2ae10cc8d774889b54c598119fa0deb P 95234c5b69eb4fe4a7558e56eedbe71a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 14:55:35.138461  6549 raft_consensus.cc:2272] T f2ae10cc8d774889b54c598119fa0deb P 95234c5b69eb4fe4a7558e56eedbe71a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:35.140838  6549 tablet_replica.cc:333] T bf34b3256cdf42dbaf4cad11d1a42160 P 95234c5b69eb4fe4a7558e56eedbe71a: stopping tablet replica
I20260709 14:55:35.141409  6549 raft_consensus.cc:2243] T bf34b3256cdf42dbaf4cad11d1a42160 P 95234c5b69eb4fe4a7558e56eedbe71a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 14:55:35.141897  6549 raft_consensus.cc:2272] T bf34b3256cdf42dbaf4cad11d1a42160 P 95234c5b69eb4fe4a7558e56eedbe71a [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 14:55:35.159315 18276 consensus_peers.cc:597] T 1f97050ecf494124a1ef8f3a359d6fd4 P ec71ef77a55848a0add75a6c104cc9a9 -> Peer f75b4aa933fd4b8c82ea07567024882c (127.6.101.65:40449): Couldn't send request to peer f75b4aa933fd4b8c82ea07567024882c. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.65:40449: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 14:55:35.189046  6549 tablet_server.cc:196] TabletServer@127.6.101.66:0 shutdown complete.
W20260709 14:55:35.198437 18278 consensus_peers.cc:597] T 1f97050ecf494124a1ef8f3a359d6fd4 P ec71ef77a55848a0add75a6c104cc9a9 -> Peer 95234c5b69eb4fe4a7558e56eedbe71a (127.6.101.66:42897): Couldn't send request to peer 95234c5b69eb4fe4a7558e56eedbe71a. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.66:42897: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 14:55:35.225371 18278 consensus_peers.cc:597] T 11525d1d42074736bf180ebaafed1e98 P ec71ef77a55848a0add75a6c104cc9a9 -> Peer 95234c5b69eb4fe4a7558e56eedbe71a (127.6.101.66:42897): Couldn't send request to peer 95234c5b69eb4fe4a7558e56eedbe71a. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.66:42897: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 14:55:35.231952  6549 tablet_server.cc:179] TabletServer@127.6.101.67:0 shutting down...
I20260709 14:55:35.266353  6549 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 14:55:35.267275  6549 tablet_replica.cc:333] T 744d4bd8bf6440d78510bd3a8b14481c P ec71ef77a55848a0add75a6c104cc9a9: stopping tablet replica
I20260709 14:55:35.268334  6549 raft_consensus.cc:2243] T 744d4bd8bf6440d78510bd3a8b14481c P ec71ef77a55848a0add75a6c104cc9a9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 14:55:35.269412  6549 raft_consensus.cc:2272] T 744d4bd8bf6440d78510bd3a8b14481c P ec71ef77a55848a0add75a6c104cc9a9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:35.271883  6549 tablet_replica.cc:333] T 45dc6924b995473493ccf8d5b0ba3668 P ec71ef77a55848a0add75a6c104cc9a9: stopping tablet replica
I20260709 14:55:35.272544  6549 raft_consensus.cc:2243] T 45dc6924b995473493ccf8d5b0ba3668 P ec71ef77a55848a0add75a6c104cc9a9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 14:55:35.273083  6549 raft_consensus.cc:2272] T 45dc6924b995473493ccf8d5b0ba3668 P ec71ef77a55848a0add75a6c104cc9a9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:35.275324  6549 tablet_replica.cc:333] T 8885f7ee722545ff8d091567e7f09d69 P ec71ef77a55848a0add75a6c104cc9a9: stopping tablet replica
I20260709 14:55:35.275928  6549 raft_consensus.cc:2243] T 8885f7ee722545ff8d091567e7f09d69 P ec71ef77a55848a0add75a6c104cc9a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 14:55:35.276414  6549 raft_consensus.cc:2272] T 8885f7ee722545ff8d091567e7f09d69 P ec71ef77a55848a0add75a6c104cc9a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:35.278647  6549 tablet_replica.cc:333] T e416808f5061489aa8191b18817678d0 P ec71ef77a55848a0add75a6c104cc9a9: stopping tablet replica
I20260709 14:55:35.279273  6549 raft_consensus.cc:2243] T e416808f5061489aa8191b18817678d0 P ec71ef77a55848a0add75a6c104cc9a9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 14:55:35.279882  6549 raft_consensus.cc:2272] T e416808f5061489aa8191b18817678d0 P ec71ef77a55848a0add75a6c104cc9a9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:35.282399  6549 tablet_replica.cc:333] T 84b1a73cbc1e4c56a0a733d2cdacc300 P ec71ef77a55848a0add75a6c104cc9a9: stopping tablet replica
I20260709 14:55:35.282968  6549 raft_consensus.cc:2243] T 84b1a73cbc1e4c56a0a733d2cdacc300 P ec71ef77a55848a0add75a6c104cc9a9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 14:55:35.283650  6549 raft_consensus.cc:2272] T 84b1a73cbc1e4c56a0a733d2cdacc300 P ec71ef77a55848a0add75a6c104cc9a9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:35.285953  6549 tablet_replica.cc:333] T 4040b77ce4d34a34baf6e31e9364f07b P ec71ef77a55848a0add75a6c104cc9a9: stopping tablet replica
I20260709 14:55:35.286743  6549 raft_consensus.cc:2243] T 4040b77ce4d34a34baf6e31e9364f07b P ec71ef77a55848a0add75a6c104cc9a9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 14:55:35.287422  6549 raft_consensus.cc:2272] T 4040b77ce4d34a34baf6e31e9364f07b P ec71ef77a55848a0add75a6c104cc9a9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:35.289889  6549 tablet_replica.cc:333] T f2ae10cc8d774889b54c598119fa0deb P ec71ef77a55848a0add75a6c104cc9a9: stopping tablet replica
I20260709 14:55:35.290890  6549 raft_consensus.cc:2243] T f2ae10cc8d774889b54c598119fa0deb P ec71ef77a55848a0add75a6c104cc9a9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 14:55:35.291424  6549 raft_consensus.cc:2272] T f2ae10cc8d774889b54c598119fa0deb P ec71ef77a55848a0add75a6c104cc9a9 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 14:55:35.291919 18278 consensus_peers.cc:597] T 528cd6046e1f4e7e8cc77f09c4578612 P ec71ef77a55848a0add75a6c104cc9a9 -> Peer 95234c5b69eb4fe4a7558e56eedbe71a (127.6.101.66:42897): Couldn't send request to peer 95234c5b69eb4fe4a7558e56eedbe71a. Status: Network error: Client connection negotiation failed: client connection to 127.6.101.66:42897: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 14:55:35.294699  6549 tablet_replica.cc:333] T 39965dc306aa4828a74a07da020fe662 P ec71ef77a55848a0add75a6c104cc9a9: stopping tablet replica
I20260709 14:55:35.295770  6549 raft_consensus.cc:2243] T 39965dc306aa4828a74a07da020fe662 P ec71ef77a55848a0add75a6c104cc9a9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 14:55:35.296358  6549 raft_consensus.cc:2272] T 39965dc306aa4828a74a07da020fe662 P ec71ef77a55848a0add75a6c104cc9a9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:35.299315  6549 tablet_replica.cc:333] T b2b20170ec59458c9b9a18ca1e2a34d6 P ec71ef77a55848a0add75a6c104cc9a9: stopping tablet replica
I20260709 14:55:35.300122  6549 raft_consensus.cc:2243] T b2b20170ec59458c9b9a18ca1e2a34d6 P ec71ef77a55848a0add75a6c104cc9a9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 14:55:35.300678  6549 raft_consensus.cc:2272] T b2b20170ec59458c9b9a18ca1e2a34d6 P ec71ef77a55848a0add75a6c104cc9a9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:35.303068  6549 tablet_replica.cc:333] T 11525d1d42074736bf180ebaafed1e98 P ec71ef77a55848a0add75a6c104cc9a9: stopping tablet replica
I20260709 14:55:35.303659  6549 raft_consensus.cc:2243] T 11525d1d42074736bf180ebaafed1e98 P ec71ef77a55848a0add75a6c104cc9a9 [term 3 LEADER]: Raft consensus shutting down.
I20260709 14:55:35.304459  6549 raft_consensus.cc:2272] T 11525d1d42074736bf180ebaafed1e98 P ec71ef77a55848a0add75a6c104cc9a9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:35.306581  6549 tablet_replica.cc:333] T bf34b3256cdf42dbaf4cad11d1a42160 P ec71ef77a55848a0add75a6c104cc9a9: stopping tablet replica
I20260709 14:55:35.307112  6549 raft_consensus.cc:2243] T bf34b3256cdf42dbaf4cad11d1a42160 P ec71ef77a55848a0add75a6c104cc9a9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 14:55:35.307556  6549 raft_consensus.cc:2272] T bf34b3256cdf42dbaf4cad11d1a42160 P ec71ef77a55848a0add75a6c104cc9a9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:35.309669  6549 tablet_replica.cc:333] T f0007e8bcd5d478482896147adc197b0 P ec71ef77a55848a0add75a6c104cc9a9: stopping tablet replica
I20260709 14:55:35.310168  6549 raft_consensus.cc:2243] T f0007e8bcd5d478482896147adc197b0 P ec71ef77a55848a0add75a6c104cc9a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 14:55:35.310678  6549 raft_consensus.cc:2272] T f0007e8bcd5d478482896147adc197b0 P ec71ef77a55848a0add75a6c104cc9a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:35.313450  6549 tablet_replica.cc:333] T 03cb02cb11914a5db0023952fc210283 P ec71ef77a55848a0add75a6c104cc9a9: stopping tablet replica
I20260709 14:55:35.314133  6549 raft_consensus.cc:2243] T 03cb02cb11914a5db0023952fc210283 P ec71ef77a55848a0add75a6c104cc9a9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 14:55:35.314684  6549 raft_consensus.cc:2272] T 03cb02cb11914a5db0023952fc210283 P ec71ef77a55848a0add75a6c104cc9a9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:35.317166  6549 tablet_replica.cc:333] T 86887bfdd39840a4ac9a63d78fcf0c67 P ec71ef77a55848a0add75a6c104cc9a9: stopping tablet replica
I20260709 14:55:35.317857  6549 raft_consensus.cc:2243] T 86887bfdd39840a4ac9a63d78fcf0c67 P ec71ef77a55848a0add75a6c104cc9a9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 14:55:35.318413  6549 raft_consensus.cc:2272] T 86887bfdd39840a4ac9a63d78fcf0c67 P ec71ef77a55848a0add75a6c104cc9a9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:35.320720  6549 tablet_replica.cc:333] T 1f97050ecf494124a1ef8f3a359d6fd4 P ec71ef77a55848a0add75a6c104cc9a9: stopping tablet replica
I20260709 14:55:35.321281  6549 raft_consensus.cc:2243] T 1f97050ecf494124a1ef8f3a359d6fd4 P ec71ef77a55848a0add75a6c104cc9a9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 14:55:35.322192  6549 raft_consensus.cc:2272] T 1f97050ecf494124a1ef8f3a359d6fd4 P ec71ef77a55848a0add75a6c104cc9a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:35.324474  6549 tablet_replica.cc:333] T e68e41550ad240f5842867f3c8b8604d P ec71ef77a55848a0add75a6c104cc9a9: stopping tablet replica
I20260709 14:55:35.324985  6549 raft_consensus.cc:2243] T e68e41550ad240f5842867f3c8b8604d P ec71ef77a55848a0add75a6c104cc9a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 14:55:35.325496  6549 raft_consensus.cc:2272] T e68e41550ad240f5842867f3c8b8604d P ec71ef77a55848a0add75a6c104cc9a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:35.327673  6549 tablet_replica.cc:333] T 528cd6046e1f4e7e8cc77f09c4578612 P ec71ef77a55848a0add75a6c104cc9a9: stopping tablet replica
I20260709 14:55:35.328197  6549 raft_consensus.cc:2243] T 528cd6046e1f4e7e8cc77f09c4578612 P ec71ef77a55848a0add75a6c104cc9a9 [term 3 LEADER]: Raft consensus shutting down.
I20260709 14:55:35.329058  6549 raft_consensus.cc:2272] T 528cd6046e1f4e7e8cc77f09c4578612 P ec71ef77a55848a0add75a6c104cc9a9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:35.331820  6549 tablet_replica.cc:333] T 8c253d3492704370910e00d866ea41a2 P ec71ef77a55848a0add75a6c104cc9a9: stopping tablet replica
I20260709 14:55:35.332336  6549 raft_consensus.cc:2243] T 8c253d3492704370910e00d866ea41a2 P ec71ef77a55848a0add75a6c104cc9a9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 14:55:35.332809  6549 raft_consensus.cc:2272] T 8c253d3492704370910e00d866ea41a2 P ec71ef77a55848a0add75a6c104cc9a9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:35.378664  6549 tablet_server.cc:196] TabletServer@127.6.101.67:0 shutdown complete.
I20260709 14:55:35.427282  6549 master.cc:562] Master@127.6.101.126:38877 shutting down...
I20260709 14:55:35.461042  6549 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 233fa68c7088489f892c8e7dd6b70f02 [term 1 LEADER]: Raft consensus shutting down.
I20260709 14:55:35.461748  6549 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 233fa68c7088489f892c8e7dd6b70f02 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 14:55:35.462102  6549 tablet_replica.cc:333] T 00000000000000000000000000000000 P 233fa68c7088489f892c8e7dd6b70f02: stopping tablet replica
I20260709 14:55:35.485056  6549 master.cc:584] Master@127.6.101.126:38877 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (12532 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (26376 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (363432 ms total)
[  PASSED  ] 7 tests.
[  FAILED  ] 1 test, listed below:
[  FAILED  ] LeaderRebalancerTest.AddTserver

 1 FAILED TEST
I20260709 14:55:35.553893  6549 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 420 messages since previous log ~15 seconds ago
I20260709 14:55:35.554442  6549 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 420 messages since previous log ~15 seconds ago
I20260709 14:55:35.554725  6549 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 411 messages since previous log ~15 seconds ago
I20260709 14:55:35.554965  6549 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~35 seconds ago
I20260709 14:55:35.555154  6549 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~35 seconds ago
I20260709 14:55:35.555384  6549 logging.cc:436] LogThrottler Service Queue Overflow: suppressed but not reported on 3 messages since previous log ~201 seconds ago
I20260709 14:55:35.555580  6549 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/service_pool.cc:136: suppressed but not reported on 3 messages since previous log ~201 seconds ago
I20260709 14:55:35.555971  6549 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 10 messages since previous log ~0 seconds ago
I20260709 14:55:35.556507  6549 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 53 messages since previous log ~11 seconds ago
